2024-09-19T06:21:06.703 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-19T06:21:06.728 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T06:21:06.815 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911742 branch: squid description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7911742' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/quincy ' name: teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 1747 sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 sleep_before_teardown: 0 subset: 176/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e targets: smithi099.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBAGJQhrz5KRg8k9xVyi/zE+Xi1dUqw9ewJoXK0pLLB/zkvp7HpxkaPOmwvy7qA8APjpyBclZRr2ETSzjXMAERg= smithi117.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHPh+4WpR0zQP1iLOaiAWRaxZeCo7xzZHEVMgxDxpeWvRxNyoVPgkp4FU922OdVdTvNwHYfr3cw4OIthkQRM8uI= tasks: - install: branch: quincy exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: cephadm_branch: quincy cephadm_git_url: https://github.com/ceph/ceph conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:quincy roleless: true - print: '**** done end installing quincy cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 2 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay false - cephadm.shell: host.a: - ceph fs set cephfs inline_data false - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - ceph-fuse: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: [] meta: {} postmerge: [] variables: fail_fs: true teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-18_21:24:17 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph versions | jq -e '.mgr | length == 1' - ceph versions | jq -e '.mgr | keys' | grep $sha1 - ceph versions | jq -e '.overall | length == 2' - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 2' - ceph orch ps - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-09-19T06:21:06.815 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa; will attempt to use it 2024-09-19T06:21:06.815 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks 2024-09-19T06:21:06.815 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-19T06:21:06.817 INFO:teuthology.task.internal:Checking packages... 2024-09-19T06:21:06.837 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '2f599a46ad10e37c929e5c43da2f6907ddcd1961' 2024-09-19T06:21:06.837 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-19T06:21:06.837 INFO:teuthology.packaging:ref: None 2024-09-19T06:21:06.837 INFO:teuthology.packaging:tag: None 2024-09-19T06:21:06.837 INFO:teuthology.packaging:branch: squid 2024-09-19T06:21:06.837 INFO:teuthology.packaging:sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:21:06.837 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-19T06:21:07.075 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-363.g6fad5dd7 2024-09-19T06:21:07.077 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-19T06:21:07.084 INFO:teuthology.task.internal:no buildpackages task found 2024-09-19T06:21:07.084 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-19T06:21:07.099 INFO:teuthology.task.internal:Saving configuration 2024-09-19T06:21:07.118 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-19T06:21:07.124 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-19T06:21:07.149 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi099.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911742', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 06:16:08.755501', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBAGJQhrz5KRg8k9xVyi/zE+Xi1dUqw9ewJoXK0pLLB/zkvp7HpxkaPOmwvy7qA8APjpyBclZRr2ETSzjXMAERg='} 2024-09-19T06:21:07.172 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi117.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911742', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 06:16:08.754052', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHPh+4WpR0zQP1iLOaiAWRaxZeCo7xzZHEVMgxDxpeWvRxNyoVPgkp4FU922OdVdTvNwHYfr3cw4OIthkQRM8uI='} 2024-09-19T06:21:07.172 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-19T06:21:07.179 INFO:teuthology.task.internal:roles: ubuntu@smithi099.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-09-19T06:21:07.179 INFO:teuthology.task.internal:roles: ubuntu@smithi117.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-09-19T06:21:07.179 INFO:teuthology.run_tasks:Running task console_log... 2024-09-19T06:21:07.238 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2d31493be0>, signals=[15]) 2024-09-19T06:21:07.239 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-19T06:21:07.248 INFO:teuthology.task.internal:Opening connections... 2024-09-19T06:21:07.248 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi099.front.sepia.ceph.com 2024-09-19T06:21:07.250 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T06:21:07.329 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi117.front.sepia.ceph.com 2024-09-19T06:21:07.330 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T06:21:07.405 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-19T06:21:07.410 DEBUG:teuthology.orchestra.run.smithi099:> uname -m 2024-09-19T06:21:07.429 INFO:teuthology.orchestra.run.smithi099.stdout:x86_64 2024-09-19T06:21:07.429 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2024-09-19T06:21:07.486 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="CentOS Stream" 2024-09-19T06:21:07.486 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="9" 2024-09-19T06:21:07.486 INFO:teuthology.orchestra.run.smithi099.stdout:ID="centos" 2024-09-19T06:21:07.486 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="rhel fedora" 2024-09-19T06:21:07.487 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="9" 2024-09-19T06:21:07.487 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el9" 2024-09-19T06:21:07.487 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T06:21:07.487 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31" 2024-09-19T06:21:07.487 INFO:teuthology.orchestra.run.smithi099.stdout:LOGO="fedora-logo-icon" 2024-09-19T06:21:07.487 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T06:21:07.487 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://centos.org/" 2024-09-19T06:21:07.487 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T06:21:07.487 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T06:21:07.487 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T06:21:07.488 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2024-09-19T06:21:07.512 DEBUG:teuthology.orchestra.run.smithi117:> uname -m 2024-09-19T06:21:07.530 INFO:teuthology.orchestra.run.smithi117.stdout:x86_64 2024-09-19T06:21:07.530 DEBUG:teuthology.orchestra.run.smithi117:> cat /etc/os-release 2024-09-19T06:21:07.588 INFO:teuthology.orchestra.run.smithi117.stdout:NAME="CentOS Stream" 2024-09-19T06:21:07.588 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION="9" 2024-09-19T06:21:07.588 INFO:teuthology.orchestra.run.smithi117.stdout:ID="centos" 2024-09-19T06:21:07.589 INFO:teuthology.orchestra.run.smithi117.stdout:ID_LIKE="rhel fedora" 2024-09-19T06:21:07.589 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_ID="9" 2024-09-19T06:21:07.589 INFO:teuthology.orchestra.run.smithi117.stdout:PLATFORM_ID="platform:el9" 2024-09-19T06:21:07.589 INFO:teuthology.orchestra.run.smithi117.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T06:21:07.589 INFO:teuthology.orchestra.run.smithi117.stdout:ANSI_COLOR="0;31" 2024-09-19T06:21:07.589 INFO:teuthology.orchestra.run.smithi117.stdout:LOGO="fedora-logo-icon" 2024-09-19T06:21:07.589 INFO:teuthology.orchestra.run.smithi117.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T06:21:07.589 INFO:teuthology.orchestra.run.smithi117.stdout:HOME_URL="https://centos.org/" 2024-09-19T06:21:07.589 INFO:teuthology.orchestra.run.smithi117.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T06:21:07.589 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T06:21:07.589 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T06:21:07.590 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server 2024-09-19T06:21:07.612 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-19T06:21:07.621 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-19T06:21:07.626 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-19T06:21:07.626 DEBUG:teuthology.orchestra.run.smithi099:> test '!' -e /home/ubuntu/cephtest 2024-09-19T06:21:07.628 DEBUG:teuthology.orchestra.run.smithi117:> test '!' -e /home/ubuntu/cephtest 2024-09-19T06:21:07.645 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-19T06:21:07.651 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-19T06:21:07.651 DEBUG:teuthology.orchestra.run.smithi099:> test -z $(ls -A /var/lib/ceph) 2024-09-19T06:21:07.686 DEBUG:teuthology.orchestra.run.smithi117:> test -z $(ls -A /var/lib/ceph) 2024-09-19T06:21:07.790 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-19T06:21:07.843 INFO:teuthology.run_tasks:Running task kernel... 2024-09-19T06:21:07.857 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-19T06:21:07.857 INFO:teuthology.task.kernel:config {'host.a': {'kdb': 1, 'sha1': 'distro'}, 'host.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-19T06:21:07.857 DEBUG:teuthology.orchestra.run.smithi099:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T06:21:07.858 DEBUG:teuthology.orchestra.run.smithi117:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T06:21:07.875 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T06:21:07.875 DEBUG:teuthology.orchestra.run.smithi117:> uname -r 2024-09-19T06:21:07.876 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T06:21:07.876 DEBUG:teuthology.orchestra.run.smithi099:> uname -r 2024-09-19T06:21:07.932 INFO:teuthology.orchestra.run.smithi117.stdout:5.14.0-503.el9.x86_64 2024-09-19T06:21:07.932 INFO:teuthology.task.kernel:Running kernel on smithi117: 5.14.0-503.el9.x86_64 2024-09-19T06:21:07.933 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum install -y kernel 2024-09-19T06:21:07.934 INFO:teuthology.orchestra.run.smithi099.stdout:5.14.0-503.el9.x86_64 2024-09-19T06:21:07.934 INFO:teuthology.task.kernel:Running kernel on smithi099: 5.14.0-503.el9.x86_64 2024-09-19T06:21:07.934 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum install -y kernel 2024-09-19T06:21:10.348 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.3 MB 00:00 2024-09-19T06:21:12.107 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - BaseOS 3.3 MB/s | 8.3 MB 00:02 2024-09-19T06:21:13.390 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - AppStream 10 MB/s | 20 MB 00:01 2024-09-19T06:21:17.674 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - AppStream 4.5 MB/s | 20 MB 00:04 2024-09-19T06:21:21.983 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.5 MB 00:00 2024-09-19T06:21:23.616 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - Extras packages 43 kB/s | 19 kB 00:00 2024-09-19T06:21:24.787 INFO:teuthology.orchestra.run.smithi099.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-19T06:21:24.972 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - CRB 852 kB/s | 6.5 MB 00:07 2024-09-19T06:21:26.422 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - Extras packages 76 kB/s | 19 kB 00:00 2024-09-19T06:21:27.410 INFO:teuthology.orchestra.run.smithi117.stdout:Extra Packages for Enterprise Linux 26 MB/s | 23 MB 00:00 2024-09-19T06:21:30.159 INFO:teuthology.orchestra.run.smithi099.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-09-19T06:21:32.074 INFO:teuthology.orchestra.run.smithi099.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-19T06:21:32.074 INFO:teuthology.orchestra.run.smithi099.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-19T06:21:32.153 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-19T06:21:32.160 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-19T06:21:32.160 INFO:teuthology.orchestra.run.smithi099.stdout: Package Architecture Version Repository Size 2024-09-19T06:21:32.160 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-19T06:21:32.160 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-09-19T06:21:32.160 INFO:teuthology.orchestra.run.smithi099.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-19T06:21:32.160 INFO:teuthology.orchestra.run.smithi099.stdout:Installing dependencies: 2024-09-19T06:21:32.160 INFO:teuthology.orchestra.run.smithi099.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-19T06:21:32.160 INFO:teuthology.orchestra.run.smithi099.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-19T06:21:32.161 INFO:teuthology.orchestra.run.smithi099.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-19T06:21:32.161 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:21:32.161 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-09-19T06:21:32.161 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-19T06:21:32.161 INFO:teuthology.orchestra.run.smithi099.stdout:Install 4 Packages 2024-09-19T06:21:32.161 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:21:32.161 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 79 M 2024-09-19T06:21:32.161 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 126 M 2024-09-19T06:21:32.161 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-09-19T06:21:32.319 INFO:teuthology.orchestra.run.smithi099.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 315 kB/s | 36 kB 00:00 2024-09-19T06:21:32.798 INFO:teuthology.orchestra.run.smithi117.stdout:lab-extras 47 kB/s | 1.7 kB 00:00 2024-09-19T06:21:32.819 INFO:teuthology.orchestra.run.smithi099.stdout:(2/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 56 MB/s | 35 MB 00:00 2024-09-19T06:21:33.194 INFO:teuthology.orchestra.run.smithi099.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 33 MB/s | 29 MB 00:00 2024-09-19T06:21:33.536 INFO:teuthology.orchestra.run.smithi099.stdout:(4/4): kernel-core-5.14.0-508.el9.x86_64.rpm 12 MB/s | 16 MB 00:01 2024-09-19T06:21:33.537 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-09-19T06:21:33.537 INFO:teuthology.orchestra.run.smithi099.stdout:Total 57 MB/s | 79 MB 00:01 2024-09-19T06:21:34.217 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-09-19T06:21:34.565 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-09-19T06:21:34.565 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-09-19T06:21:34.696 INFO:teuthology.orchestra.run.smithi117.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-19T06:21:34.696 INFO:teuthology.orchestra.run.smithi117.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-19T06:21:34.788 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-09-19T06:21:34.799 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-19T06:21:34.800 INFO:teuthology.orchestra.run.smithi117.stdout: Package Architecture Version Repository Size 2024-09-19T06:21:34.800 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-19T06:21:34.800 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-09-19T06:21:34.800 INFO:teuthology.orchestra.run.smithi117.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-19T06:21:34.800 INFO:teuthology.orchestra.run.smithi117.stdout:Installing dependencies: 2024-09-19T06:21:34.800 INFO:teuthology.orchestra.run.smithi117.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-19T06:21:34.800 INFO:teuthology.orchestra.run.smithi117.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-19T06:21:34.800 INFO:teuthology.orchestra.run.smithi117.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-19T06:21:34.800 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:21:34.800 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-09-19T06:21:34.801 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-19T06:21:34.801 INFO:teuthology.orchestra.run.smithi117.stdout:Install 4 Packages 2024-09-19T06:21:34.801 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:21:34.801 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 79 M 2024-09-19T06:21:34.801 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 126 M 2024-09-19T06:21:34.802 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-09-19T06:21:34.900 INFO:teuthology.orchestra.run.smithi117.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 467 kB/s | 36 kB 00:00 2024-09-19T06:21:35.392 INFO:teuthology.orchestra.run.smithi117.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 28 MB/s | 16 MB 00:00 2024-09-19T06:21:35.519 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-09-19T06:21:35.519 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-09-19T06:21:36.092 INFO:teuthology.orchestra.run.smithi117.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 27 MB/s | 35 MB 00:01 2024-09-19T06:21:36.534 INFO:teuthology.orchestra.run.smithi117.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 17 MB/s | 29 MB 00:01 2024-09-19T06:21:36.534 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-09-19T06:21:36.534 INFO:teuthology.orchestra.run.smithi117.stdout:Total 45 MB/s | 79 MB 00:01 2024-09-19T06:21:37.217 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-09-19T06:21:37.591 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-09-19T06:21:37.591 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-09-19T06:21:37.935 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-09-19T06:21:38.541 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-09-19T06:21:38.542 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-09-19T06:21:38.561 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-19T06:21:38.638 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T06:21:40.952 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-09-19T06:21:41.387 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T06:21:41.526 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T06:21:41.686 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-19T06:21:41.760 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T06:21:44.492 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T06:21:44.628 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T06:21:46.381 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T06:21:46.510 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T06:21:49.479 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T06:21:49.520 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T06:21:51.397 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T06:21:54.336 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T06:22:30.078 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T06:22:30.123 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-19T06:22:30.477 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T06:22:30.477 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-19T06:22:30.477 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T06:22:30.477 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T06:22:31.342 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T06:22:31.342 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:22:31.342 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-09-19T06:22:31.342 INFO:teuthology.orchestra.run.smithi099.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-19T06:22:31.342 INFO:teuthology.orchestra.run.smithi099.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-19T06:22:31.342 INFO:teuthology.orchestra.run.smithi099.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-19T06:22:31.342 INFO:teuthology.orchestra.run.smithi099.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-19T06:22:31.343 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:22:31.343 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-19T06:22:31.658 DEBUG:teuthology.orchestra.run.smithi099:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T06:22:31.744 INFO:teuthology.orchestra.run.smithi099.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T06:22:31.745 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T06:22:31.745 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-19T06:22:31.745 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-19T06:22:31.745 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-19T06:22:31.746 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2024-09-19T06:22:31.746 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi099.front.sepia.ceph.com, path=None, version=distro) 2024-09-19T06:22:31.746 DEBUG:teuthology.orchestra.run.smithi099:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T06:22:31.805 INFO:teuthology.orchestra.run.smithi099.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T06:22:31.805 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T06:22:31.805 DEBUG:teuthology.orchestra.run.smithi099:> sudo rpm -qi grub2-tools 2024-09-19T06:22:31.846 INFO:teuthology.orchestra.run.smithi099.stdout:Name : grub2-tools 2024-09-19T06:22:31.846 INFO:teuthology.orchestra.run.smithi099.stdout:Epoch : 1 2024-09-19T06:22:31.846 INFO:teuthology.orchestra.run.smithi099.stdout:Version : 2.06 2024-09-19T06:22:31.846 INFO:teuthology.orchestra.run.smithi099.stdout:Release : 82.el9 2024-09-19T06:22:31.847 INFO:teuthology.orchestra.run.smithi099.stdout:Architecture: x86_64 2024-09-19T06:22:31.847 INFO:teuthology.orchestra.run.smithi099.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-19T06:22:31.847 INFO:teuthology.orchestra.run.smithi099.stdout:Group : Unspecified 2024-09-19T06:22:31.847 INFO:teuthology.orchestra.run.smithi099.stdout:Size : 8274670 2024-09-19T06:22:31.847 INFO:teuthology.orchestra.run.smithi099.stdout:License : GPLv3+ 2024-09-19T06:22:31.847 INFO:teuthology.orchestra.run.smithi099.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-19T06:22:31.847 INFO:teuthology.orchestra.run.smithi099.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-19T06:22:31.847 INFO:teuthology.orchestra.run.smithi099.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-19T06:22:31.847 INFO:teuthology.orchestra.run.smithi099.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-19T06:22:31.847 INFO:teuthology.orchestra.run.smithi099.stdout:Packager : builder@centos.org 2024-09-19T06:22:31.847 INFO:teuthology.orchestra.run.smithi099.stdout:Vendor : CentOS 2024-09-19T06:22:31.847 INFO:teuthology.orchestra.run.smithi099.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-19T06:22:31.848 INFO:teuthology.orchestra.run.smithi099.stdout:Summary : Support tools for GRUB. 2024-09-19T06:22:31.848 INFO:teuthology.orchestra.run.smithi099.stdout:Description : 2024-09-19T06:22:31.848 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:22:31.848 INFO:teuthology.orchestra.run.smithi099.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-19T06:22:31.848 INFO:teuthology.orchestra.run.smithi099.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-19T06:22:31.848 INFO:teuthology.orchestra.run.smithi099.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-19T06:22:31.848 INFO:teuthology.orchestra.run.smithi099.stdout:hardware devices. 2024-09-19T06:22:31.848 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:22:31.848 INFO:teuthology.orchestra.run.smithi099.stdout:This subpackage provides tools for support of all platforms. 2024-09-19T06:22:31.849 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-19T06:22:31.849 INFO:teuthology.task.kernel:Updating grub on smithi099 to boot 5.14.0-508.el9.x86_64 2024-09-19T06:22:31.849 DEBUG:teuthology.orchestra.run.smithi099:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-19T06:22:32.423 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T06:22:32.463 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-19T06:22:32.487 INFO:teuthology.orchestra.run.smithi099.stderr:Generating grub configuration file ... 2024-09-19T06:22:32.786 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T06:22:32.786 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-19T06:22:32.786 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T06:22:32.786 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T06:22:33.608 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T06:22:33.608 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:22:33.609 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-09-19T06:22:33.609 INFO:teuthology.orchestra.run.smithi117.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-19T06:22:33.609 INFO:teuthology.orchestra.run.smithi117.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-19T06:22:33.609 INFO:teuthology.orchestra.run.smithi117.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-19T06:22:33.609 INFO:teuthology.orchestra.run.smithi117.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-19T06:22:33.609 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:22:33.609 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-09-19T06:22:33.807 INFO:teuthology.orchestra.run.smithi099.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-19T06:22:33.827 INFO:teuthology.orchestra.run.smithi099.stderr:done 2024-09-19T06:22:33.829 DEBUG:teuthology.orchestra.run.smithi099:> mktemp 2024-09-19T06:22:33.845 INFO:teuthology.orchestra.run.smithi099.stdout:/tmp/tmp.Rcn34dYfxA 2024-09-19T06:22:33.846 DEBUG:teuthology.orchestra.run.smithi099:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Rcn34dYfxA 2024-09-19T06:22:33.913 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 0666 /tmp/tmp.Rcn34dYfxA 2024-09-19T06:22:33.954 DEBUG:teuthology.orchestra.run.smithi117:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T06:22:34.043 INFO:teuthology.orchestra.run.smithi117.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T06:22:34.043 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T06:22:34.043 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-19T06:22:34.043 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-19T06:22:34.043 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-19T06:22:34.044 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2024-09-19T06:22:34.044 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi117.front.sepia.ceph.com, path=None, version=distro) 2024-09-19T06:22:34.044 DEBUG:teuthology.orchestra.run.smithi117:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T06:22:34.054 DEBUG:teuthology.orchestra.remote:smithi099:/tmp/tmp.Rcn34dYfxA is 6KB 2024-09-19T06:22:34.103 INFO:teuthology.orchestra.run.smithi117.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T06:22:34.103 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T06:22:34.103 DEBUG:teuthology.orchestra.run.smithi117:> sudo rpm -qi grub2-tools 2024-09-19T06:22:34.105 DEBUG:teuthology.orchestra.run.smithi099:> rm -fr /tmp/tmp.Rcn34dYfxA 2024-09-19T06:22:34.120 DEBUG:teuthology.orchestra.run.smithi099:> sudo /bin/ls /boot/loader/entries || true 2024-09-19T06:22:34.135 INFO:teuthology.orchestra.run.smithi117.stdout:Name : grub2-tools 2024-09-19T06:22:34.135 INFO:teuthology.orchestra.run.smithi117.stdout:Epoch : 1 2024-09-19T06:22:34.135 INFO:teuthology.orchestra.run.smithi117.stdout:Version : 2.06 2024-09-19T06:22:34.135 INFO:teuthology.orchestra.run.smithi117.stdout:Release : 82.el9 2024-09-19T06:22:34.135 INFO:teuthology.orchestra.run.smithi117.stdout:Architecture: x86_64 2024-09-19T06:22:34.135 INFO:teuthology.orchestra.run.smithi117.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-19T06:22:34.135 INFO:teuthology.orchestra.run.smithi117.stdout:Group : Unspecified 2024-09-19T06:22:34.135 INFO:teuthology.orchestra.run.smithi117.stdout:Size : 8274670 2024-09-19T06:22:34.136 INFO:teuthology.orchestra.run.smithi117.stdout:License : GPLv3+ 2024-09-19T06:22:34.136 INFO:teuthology.orchestra.run.smithi117.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-19T06:22:34.136 INFO:teuthology.orchestra.run.smithi117.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-19T06:22:34.136 INFO:teuthology.orchestra.run.smithi117.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-19T06:22:34.136 INFO:teuthology.orchestra.run.smithi117.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-19T06:22:34.136 INFO:teuthology.orchestra.run.smithi117.stdout:Packager : builder@centos.org 2024-09-19T06:22:34.136 INFO:teuthology.orchestra.run.smithi117.stdout:Vendor : CentOS 2024-09-19T06:22:34.136 INFO:teuthology.orchestra.run.smithi117.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-19T06:22:34.136 INFO:teuthology.orchestra.run.smithi117.stdout:Summary : Support tools for GRUB. 2024-09-19T06:22:34.136 INFO:teuthology.orchestra.run.smithi117.stdout:Description : 2024-09-19T06:22:34.136 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:22:34.136 INFO:teuthology.orchestra.run.smithi117.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-19T06:22:34.136 INFO:teuthology.orchestra.run.smithi117.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-19T06:22:34.137 INFO:teuthology.orchestra.run.smithi117.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-19T06:22:34.137 INFO:teuthology.orchestra.run.smithi117.stdout:hardware devices. 2024-09-19T06:22:34.137 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:22:34.137 INFO:teuthology.orchestra.run.smithi117.stdout:This subpackage provides tools for support of all platforms. 2024-09-19T06:22:34.138 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-19T06:22:34.138 INFO:teuthology.task.kernel:Updating grub on smithi117 to boot 5.14.0-508.el9.x86_64 2024-09-19T06:22:34.138 DEBUG:teuthology.orchestra.run.smithi117:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-19T06:22:34.182 INFO:teuthology.orchestra.run.smithi099.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-19T06:22:34.183 INFO:teuthology.orchestra.run.smithi099.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-19T06:22:34.183 INFO:teuthology.orchestra.run.smithi099.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-19T06:22:34.183 INFO:teuthology.orchestra.run.smithi099.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-19T06:22:34.184 DEBUG:teuthology.orchestra.run.smithi099:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-19T06:22:34.342 DEBUG:teuthology.orchestra.run.smithi099:> sudo shutdown -r now 2024-09-19T06:22:34.824 INFO:teuthology.orchestra.run.smithi117.stderr:Generating grub configuration file ... 2024-09-19T06:22:36.159 INFO:teuthology.orchestra.run.smithi117.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-19T06:22:36.180 INFO:teuthology.orchestra.run.smithi117.stderr:done 2024-09-19T06:22:36.183 DEBUG:teuthology.orchestra.run.smithi117:> mktemp 2024-09-19T06:22:36.198 INFO:teuthology.orchestra.run.smithi117.stdout:/tmp/tmp.adAPYIE85z 2024-09-19T06:22:36.199 DEBUG:teuthology.orchestra.run.smithi117:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.adAPYIE85z 2024-09-19T06:22:36.265 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 0666 /tmp/tmp.adAPYIE85z 2024-09-19T06:22:36.410 DEBUG:teuthology.orchestra.remote:smithi117:/tmp/tmp.adAPYIE85z is 6KB 2024-09-19T06:22:36.459 DEBUG:teuthology.orchestra.run.smithi117:> rm -fr /tmp/tmp.adAPYIE85z 2024-09-19T06:22:36.473 DEBUG:teuthology.orchestra.run.smithi117:> sudo /bin/ls /boot/loader/entries || true 2024-09-19T06:22:36.536 INFO:teuthology.orchestra.run.smithi117.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-19T06:22:36.536 INFO:teuthology.orchestra.run.smithi117.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-19T06:22:36.536 INFO:teuthology.orchestra.run.smithi117.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-19T06:22:36.536 INFO:teuthology.orchestra.run.smithi117.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-19T06:22:36.538 DEBUG:teuthology.orchestra.run.smithi117:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-19T06:22:36.682 DEBUG:teuthology.orchestra.run.smithi117:> sudo shutdown -r now 2024-09-19T06:23:04.373 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-09-19T06:23:04.374 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-09-19T06:23:04.375 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T06:23:06.693 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-09-19T06:23:06.693 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-09-19T06:23:06.693 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T06:23:22.945 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-09-19T06:23:25.245 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.117 2024-09-19T06:23:31.953 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-09-19T06:23:31.954 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T06:23:34.248 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-09-19T06:23:34.249 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T06:23:35.005 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-09-19T06:23:37.309 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.117 2024-09-19T06:23:47.013 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-09-19T06:23:47.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T06:23:49.311 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-09-19T06:23:49.311 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T06:24:07.741 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.117 2024-09-19T06:24:18.874 DEBUG:teuthology.orchestra.run.smithi099:> true 2024-09-19T06:24:19.301 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-09-19T06:24:19.302 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.14.0-508.el9.x86_64"... 2024-09-19T06:24:19.302 DEBUG:teuthology.orchestra.run.smithi099:> uname -r 2024-09-19T06:24:19.317 INFO:teuthology.orchestra.run.smithi099.stdout:5.14.0-508.el9.x86_64 2024-09-19T06:24:19.317 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-19T06:24:19.317 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-19T06:24:19.317 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-19T06:24:20.318 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-09-19T06:24:20.318 DEBUG:teuthology.orchestra.run.smithi099:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-19T06:24:20.379 INFO:teuthology.orchestra.run.smithi099.stdout:ttyS1 2024-09-19T06:24:20.403 DEBUG:teuthology.parallel:result is None 2024-09-19T06:24:22.742 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-09-19T06:24:22.743 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T06:24:23.177 DEBUG:teuthology.orchestra.run.smithi117:> true 2024-09-19T06:24:23.588 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-09-19T06:24:23.588 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.14.0-508.el9.x86_64"... 2024-09-19T06:24:23.588 DEBUG:teuthology.orchestra.run.smithi117:> uname -r 2024-09-19T06:24:23.603 INFO:teuthology.orchestra.run.smithi117.stdout:5.14.0-508.el9.x86_64 2024-09-19T06:24:23.603 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-19T06:24:23.603 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-19T06:24:23.603 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-19T06:24:24.604 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-09-19T06:24:24.605 DEBUG:teuthology.orchestra.run.smithi117:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-19T06:24:24.701 INFO:teuthology.orchestra.run.smithi117.stdout:ttyS1 2024-09-19T06:24:24.719 DEBUG:teuthology.parallel:result is None 2024-09-19T06:24:24.719 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-19T06:24:24.732 INFO:teuthology.task.internal:Creating test directory... 2024-09-19T06:24:24.733 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T06:24:24.735 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T06:24:24.751 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-19T06:24:24.757 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-19T06:24:24.775 INFO:teuthology.task.internal:Creating archive directory... 2024-09-19T06:24:24.775 DEBUG:teuthology.orchestra.run.smithi099:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T06:24:24.794 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T06:24:24.825 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-19T06:24:24.838 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-19T06:24:24.839 DEBUG:teuthology.orchestra.run.smithi099:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T06:24:24.863 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T06:24:24.887 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T06:24:24.897 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T06:24:24.898 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T06:24:24.909 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T06:24:24.910 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-19T06:24:24.918 INFO:teuthology.task.internal:Configuring sudo... 2024-09-19T06:24:24.918 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T06:24:24.954 DEBUG:teuthology.orchestra.run.smithi117:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T06:24:24.980 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-19T06:24:24.989 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-19T06:24:24.989 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T06:24:25.023 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T06:24:25.038 DEBUG:teuthology.orchestra.run.smithi099:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T06:24:25.121 DEBUG:teuthology.orchestra.run.smithi099:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T06:24:25.178 DEBUG:teuthology.orchestra.run.smithi099:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T06:24:25.263 DEBUG:teuthology.orchestra.run.smithi099:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T06:24:25.303 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-19T06:24:25.303 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T06:24:25.369 DEBUG:teuthology.orchestra.run.smithi117:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T06:24:25.409 DEBUG:teuthology.orchestra.run.smithi117:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T06:24:25.460 DEBUG:teuthology.orchestra.run.smithi117:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T06:24:25.547 DEBUG:teuthology.orchestra.run.smithi117:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T06:24:25.587 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-19T06:24:25.587 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T06:24:25.651 DEBUG:teuthology.orchestra.run.smithi099:> sudo service rsyslog restart 2024-09-19T06:24:25.653 DEBUG:teuthology.orchestra.run.smithi117:> sudo service rsyslog restart 2024-09-19T06:24:25.697 INFO:teuthology.orchestra.run.smithi099.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T06:24:25.730 INFO:teuthology.orchestra.run.smithi117.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T06:24:26.118 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-19T06:24:26.124 INFO:teuthology.task.internal:Starting timer... 2024-09-19T06:24:26.124 INFO:teuthology.run_tasks:Running task pcp... 2024-09-19T06:24:26.139 INFO:teuthology.run_tasks:Running task selinux... 2024-09-19T06:24:26.148 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-19T06:24:26.148 DEBUG:teuthology.orchestra.run.smithi099:> sudo service auditd rotate 2024-09-19T06:24:26.197 INFO:teuthology.orchestra.run.smithi099.stdout:Rotating logs: 2024-09-19T06:24:26.199 DEBUG:teuthology.orchestra.run.smithi117:> sudo service auditd rotate 2024-09-19T06:24:26.316 INFO:teuthology.orchestra.run.smithi117.stdout:Rotating logs: 2024-09-19T06:24:26.319 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-19T06:24:26.319 DEBUG:teuthology.orchestra.run.smithi099:> /usr/sbin/getenforce 2024-09-19T06:24:26.349 INFO:teuthology.orchestra.run.smithi099.stdout:Permissive 2024-09-19T06:24:26.349 DEBUG:teuthology.orchestra.run.smithi117:> /usr/sbin/getenforce 2024-09-19T06:24:26.400 INFO:teuthology.orchestra.run.smithi117.stdout:Permissive 2024-09-19T06:24:26.400 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi099.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi117.front.sepia.ceph.com': 'permissive'} 2024-09-19T06:24:26.400 DEBUG:teuthology.orchestra.run.smithi099:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T06:24:26.427 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T06:24:26.428 DEBUG:teuthology.orchestra.run.smithi117:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T06:24:26.491 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T06:24:26.491 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-19T06:24:26.491 DEBUG:teuthology.orchestra.run.smithi099:> sudo /usr/sbin/setenforce permissive 2024-09-19T06:24:26.527 DEBUG:teuthology.orchestra.run.smithi117:> sudo /usr/sbin/setenforce permissive 2024-09-19T06:24:26.707 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-19T06:24:26.715 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-19T06:24:26.719 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-19T06:24:26.829 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-19T06:24:26.840 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-19T06:24:26.841 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi099.front.sepia.ceph.com,smithi117.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-19T06:28:11.649 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi099.front.sepia.ceph.com'), Remote(name='ubuntu@smithi117.front.sepia.ceph.com')] 2024-09-19T06:28:11.650 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-09-19T06:28:11.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T06:28:11.730 DEBUG:teuthology.orchestra.run.smithi099:> true 2024-09-19T06:28:11.765 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-09-19T06:28:11.765 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-09-19T06:28:11.766 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T06:28:11.842 DEBUG:teuthology.orchestra.run.smithi117:> true 2024-09-19T06:28:11.920 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-09-19T06:28:11.921 INFO:teuthology.run_tasks:Running task clock... 2024-09-19T06:28:11.931 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-19T06:28:11.931 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T06:28:11.932 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T06:28:11.934 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T06:28:11.934 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T06:28:11.961 INFO:teuthology.orchestra.run.smithi099.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T06:28:11.975 INFO:teuthology.orchestra.run.smithi099.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T06:28:11.991 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T06:28:11.999 INFO:teuthology.orchestra.run.smithi099.stderr:sudo: ntpd: command not found 2024-09-19T06:28:12.006 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T06:28:12.010 INFO:teuthology.orchestra.run.smithi099.stdout:506 Cannot talk to daemon 2024-09-19T06:28:12.024 INFO:teuthology.orchestra.run.smithi099.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T06:28:12.030 INFO:teuthology.orchestra.run.smithi117.stderr:sudo: ntpd: command not found 2024-09-19T06:28:12.038 INFO:teuthology.orchestra.run.smithi099.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T06:28:12.042 INFO:teuthology.orchestra.run.smithi117.stdout:506 Cannot talk to daemon 2024-09-19T06:28:12.056 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T06:28:12.070 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T06:28:12.095 INFO:teuthology.orchestra.run.smithi099.stderr:bash: line 1: ntpq: command not found 2024-09-19T06:28:12.099 INFO:teuthology.orchestra.run.smithi099.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T06:28:12.099 INFO:teuthology.orchestra.run.smithi099.stdout:=============================================================================== 2024-09-19T06:28:12.099 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:28:12.099 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:28:12.099 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:28:12.099 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:28:12.123 INFO:teuthology.orchestra.run.smithi117.stderr:bash: line 1: ntpq: command not found 2024-09-19T06:28:12.127 INFO:teuthology.orchestra.run.smithi117.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T06:28:12.127 INFO:teuthology.orchestra.run.smithi117.stdout:=============================================================================== 2024-09-19T06:28:12.127 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:28:12.127 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:28:12.127 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:28:12.127 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T06:28:12.128 INFO:teuthology.run_tasks:Running task install... 2024-09-19T06:28:12.137 DEBUG:teuthology.task.install:project ceph 2024-09-19T06:28:12.137 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'}} 2024-09-19T06:28:12.137 DEBUG:teuthology.task.install:config {'branch': 'quincy', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'} 2024-09-19T06:28:12.137 INFO:teuthology.task.install:Using flavor: default 2024-09-19T06:28:12.143 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-19T06:28:12.143 INFO:teuthology.task.install:extra packages: [] 2024-09-19T06:28:12.144 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T06:28:12.144 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-19T06:28:12.144 INFO:teuthology.packaging:ref: None 2024-09-19T06:28:12.144 INFO:teuthology.packaging:tag: None 2024-09-19T06:28:12.144 INFO:teuthology.packaging:branch: quincy 2024-09-19T06:28:12.144 INFO:teuthology.packaging:sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:28:12.145 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-09-19T06:28:12.147 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T06:28:12.147 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-19T06:28:12.148 INFO:teuthology.packaging:ref: None 2024-09-19T06:28:12.148 INFO:teuthology.packaging:tag: None 2024-09-19T06:28:12.148 INFO:teuthology.packaging:branch: quincy 2024-09-19T06:28:12.148 INFO:teuthology.packaging:sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:28:12.148 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-09-19T06:28:12.368 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/quincy/6e06d1e002b6603c076b9260a58131a040dabe75/centos/9/flavors/default/ 2024-09-19T06:28:12.368 INFO:teuthology.task.install.rpm:Package version is 17.2.7-1637.g6e06d1e0 2024-09-19T06:28:12.404 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/quincy/6e06d1e002b6603c076b9260a58131a040dabe75/centos/9/flavors/default/ 2024-09-19T06:28:12.404 INFO:teuthology.task.install.rpm:Package version is 17.2.7-1637.g6e06d1e0 2024-09-19T06:28:12.484 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/quincy/6e06d1e002b6603c076b9260a58131a040dabe75/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/6e06d1e002b6603c076b9260a58131a040dabe75/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/6e06d1e002b6603c076b9260a58131a040dabe75/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T06:28:12.484 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-19T06:28:12.484 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T06:28:12.511 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-19T06:28:12.511 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-19T06:28:12.511 INFO:teuthology.packaging:ref: None 2024-09-19T06:28:12.511 INFO:teuthology.packaging:tag: None 2024-09-19T06:28:12.511 INFO:teuthology.packaging:branch: quincy 2024-09-19T06:28:12.511 INFO:teuthology.packaging:sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:28:12.512 DEBUG:teuthology.orchestra.run.smithi099:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T06:28:12.515 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/quincy/6e06d1e002b6603c076b9260a58131a040dabe75/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/6e06d1e002b6603c076b9260a58131a040dabe75/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/6e06d1e002b6603c076b9260a58131a040dabe75/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T06:28:12.515 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-19T06:28:12.515 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T06:28:12.542 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-19T06:28:12.542 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-19T06:28:12.542 INFO:teuthology.packaging:ref: None 2024-09-19T06:28:12.542 INFO:teuthology.packaging:tag: None 2024-09-19T06:28:12.542 INFO:teuthology.packaging:branch: quincy 2024-09-19T06:28:12.542 INFO:teuthology.packaging:sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:28:12.542 DEBUG:teuthology.orchestra.run.smithi117:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T06:28:12.577 DEBUG:teuthology.orchestra.run.smithi099:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T06:28:12.608 DEBUG:teuthology.orchestra.run.smithi117:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T06:28:12.654 DEBUG:teuthology.orchestra.run.smithi099:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T06:28:12.684 DEBUG:teuthology.orchestra.run.smithi117:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T06:28:12.718 INFO:teuthology.orchestra.run.smithi099.stdout:check_obsoletes = 1 2024-09-19T06:28:12.719 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum clean all 2024-09-19T06:28:12.748 INFO:teuthology.orchestra.run.smithi117.stdout:check_obsoletes = 1 2024-09-19T06:28:12.750 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum clean all 2024-09-19T06:28:12.954 INFO:teuthology.orchestra.run.smithi099.stdout:45 files removed 2024-09-19T06:28:12.981 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install ceph-radosgw 2024-09-19T06:28:12.987 INFO:teuthology.orchestra.run.smithi117.stdout:45 files removed 2024-09-19T06:28:13.014 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph-radosgw 2024-09-19T06:28:13.514 INFO:teuthology.orchestra.run.smithi099.stdout:ceph packages for x86_64 313 kB/s | 77 kB 00:00 2024-09-19T06:28:13.584 INFO:teuthology.orchestra.run.smithi117.stdout:ceph packages for x86_64 270 kB/s | 77 kB 00:00 2024-09-19T06:28:13.798 INFO:teuthology.orchestra.run.smithi099.stdout:ceph noarch packages 45 kB/s | 11 kB 00:00 2024-09-19T06:28:13.852 INFO:teuthology.orchestra.run.smithi117.stdout:ceph noarch packages 48 kB/s | 11 kB 00:00 2024-09-19T06:28:14.065 INFO:teuthology.orchestra.run.smithi099.stdout:ceph source packages 7.7 kB/s | 1.8 kB 00:00 2024-09-19T06:28:14.127 INFO:teuthology.orchestra.run.smithi117.stdout:ceph source packages 7.4 kB/s | 1.8 kB 00:00 2024-09-19T06:28:14.849 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.3 MB 00:00 2024-09-19T06:28:16.335 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - BaseOS 3.8 MB/s | 8.3 MB 00:02 2024-09-19T06:28:20.758 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - AppStream 4.2 MB/s | 20 MB 00:04 2024-09-19T06:28:22.785 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - AppStream 3.8 MB/s | 20 MB 00:05 2024-09-19T06:28:27.369 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - CRB 7.9 MB/s | 6.5 MB 00:00 2024-09-19T06:28:29.103 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - Extras packages 49 kB/s | 19 kB 00:00 2024-09-19T06:28:29.282 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - CRB 1.4 MB/s | 6.5 MB 00:04 2024-09-19T06:28:30.041 INFO:teuthology.orchestra.run.smithi117.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-19T06:28:30.741 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - Extras packages 85 kB/s | 19 kB 00:00 2024-09-19T06:28:31.870 INFO:teuthology.orchestra.run.smithi099.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:01 2024-09-19T06:28:35.504 INFO:teuthology.orchestra.run.smithi117.stdout:lab-extras 41 kB/s | 1.7 kB 00:00 2024-09-19T06:28:37.225 INFO:teuthology.orchestra.run.smithi099.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-19T06:28:37.737 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-09-19T06:28:37.746 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-19T06:28:37.746 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repository Size 2024-09-19T06:28:37.746 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-19T06:28:37.746 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-09-19T06:28:37.746 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-radosgw x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 14 M 2024-09-19T06:28:37.747 INFO:teuthology.orchestra.run.smithi117.stdout:Upgrading: 2024-09-19T06:28:37.747 INFO:teuthology.orchestra.run.smithi117.stdout: librados2 x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 3.1 M 2024-09-19T06:28:37.747 INFO:teuthology.orchestra.run.smithi117.stdout: librbd1 x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 2.9 M 2024-09-19T06:28:37.747 INFO:teuthology.orchestra.run.smithi117.stdout:Installing dependencies: 2024-09-19T06:28:37.747 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-base x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 5.0 M 2024-09-19T06:28:37.747 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-common x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 22 M 2024-09-19T06:28:37.747 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-selinux x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 25 k 2024-09-19T06:28:37.747 INFO:teuthology.orchestra.run.smithi117.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T06:28:37.747 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs2 x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 636 k 2024-09-19T06:28:37.747 INFO:teuthology.orchestra.run.smithi117.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T06:28:37.747 INFO:teuthology.orchestra.run.smithi117.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T06:28:37.747 INFO:teuthology.orchestra.run.smithi117.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T06:28:37.748 INFO:teuthology.orchestra.run.smithi117.stdout: libradosstriper1 x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 457 k 2024-09-19T06:28:37.748 INFO:teuthology.orchestra.run.smithi117.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T06:28:37.748 INFO:teuthology.orchestra.run.smithi117.stdout: librgw2 x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 4.9 M 2024-09-19T06:28:37.748 INFO:teuthology.orchestra.run.smithi117.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T06:28:37.748 INFO:teuthology.orchestra.run.smithi117.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T06:28:37.748 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-argparse x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 45 k 2024-09-19T06:28:37.748 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-common x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 120 k 2024-09-19T06:28:37.748 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cephfs x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 156 k 2024-09-19T06:28:37.748 INFO:teuthology.orchestra.run.smithi117.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T06:28:37.748 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rados x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 320 k 2024-09-19T06:28:37.748 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rbd x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 295 k 2024-09-19T06:28:37.748 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rgw x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 99 k 2024-09-19T06:28:37.749 INFO:teuthology.orchestra.run.smithi117.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T06:28:37.749 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:28:37.749 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-09-19T06:28:37.749 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-19T06:28:37.749 INFO:teuthology.orchestra.run.smithi117.stdout:Install 22 Packages 2024-09-19T06:28:37.749 INFO:teuthology.orchestra.run.smithi117.stdout:Upgrade 2 Packages 2024-09-19T06:28:37.749 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:28:37.749 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 58 M 2024-09-19T06:28:37.750 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-09-19T06:28:38.605 INFO:teuthology.orchestra.run.smithi117.stdout:(1/24): ceph-base-17.2.7-1637.g6e06d1e0.el9.x86 11 MB/s | 5.0 MB 00:00 2024-09-19T06:28:38.655 INFO:teuthology.orchestra.run.smithi117.stdout:(2/24): ceph-selinux-17.2.7-1637.g6e06d1e0.el9. 503 kB/s | 25 kB 00:00 2024-09-19T06:28:38.747 INFO:teuthology.orchestra.run.smithi117.stdout:(3/24): libcephfs2-17.2.7-1637.g6e06d1e0.el9.x8 6.8 MB/s | 636 kB 00:00 2024-09-19T06:28:38.840 INFO:teuthology.orchestra.run.smithi117.stdout:(4/24): libradosstriper1-17.2.7-1637.g6e06d1e0. 4.9 MB/s | 457 kB 00:00 2024-09-19T06:28:39.206 INFO:teuthology.orchestra.run.smithi117.stdout:(5/24): librgw2-17.2.7-1637.g6e06d1e0.el9.x86_6 13 MB/s | 4.9 MB 00:00 2024-09-19T06:28:39.415 INFO:teuthology.orchestra.run.smithi117.stdout:(6/24): ceph-common-17.2.7-1637.g6e06d1e0.el9.x 18 MB/s | 22 MB 00:01 2024-09-19T06:28:39.432 INFO:teuthology.orchestra.run.smithi117.stdout:(7/24): python3-ceph-argparse-17.2.7-1637.g6e06 200 kB/s | 45 kB 00:00 2024-09-19T06:28:39.459 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-19T06:28:39.462 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-19T06:28:39.462 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repository Size 2024-09-19T06:28:39.462 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-19T06:28:39.462 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-09-19T06:28:39.463 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-radosgw x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 14 M 2024-09-19T06:28:39.463 INFO:teuthology.orchestra.run.smithi099.stdout:Upgrading: 2024-09-19T06:28:39.463 INFO:teuthology.orchestra.run.smithi099.stdout: librados2 x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 3.1 M 2024-09-19T06:28:39.463 INFO:teuthology.orchestra.run.smithi099.stdout: librbd1 x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 2.9 M 2024-09-19T06:28:39.463 INFO:teuthology.orchestra.run.smithi099.stdout:Installing dependencies: 2024-09-19T06:28:39.463 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-base x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 5.0 M 2024-09-19T06:28:39.463 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-common x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 22 M 2024-09-19T06:28:39.463 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-selinux x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 25 k 2024-09-19T06:28:39.463 INFO:teuthology.orchestra.run.smithi099.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T06:28:39.463 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs2 x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 636 k 2024-09-19T06:28:39.463 INFO:teuthology.orchestra.run.smithi099.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T06:28:39.463 INFO:teuthology.orchestra.run.smithi099.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T06:28:39.463 INFO:teuthology.orchestra.run.smithi099.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T06:28:39.463 INFO:teuthology.orchestra.run.smithi099.stdout: libradosstriper1 x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 457 k 2024-09-19T06:28:39.464 INFO:teuthology.orchestra.run.smithi099.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T06:28:39.464 INFO:teuthology.orchestra.run.smithi099.stdout: librgw2 x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 4.9 M 2024-09-19T06:28:39.464 INFO:teuthology.orchestra.run.smithi099.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T06:28:39.464 INFO:teuthology.orchestra.run.smithi099.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T06:28:39.464 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-argparse x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 45 k 2024-09-19T06:28:39.464 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-common x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 120 k 2024-09-19T06:28:39.464 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cephfs x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 156 k 2024-09-19T06:28:39.464 INFO:teuthology.orchestra.run.smithi099.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T06:28:39.464 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rados x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 320 k 2024-09-19T06:28:39.464 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rbd x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 295 k 2024-09-19T06:28:39.464 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rgw x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 99 k 2024-09-19T06:28:39.464 INFO:teuthology.orchestra.run.smithi099.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T06:28:39.464 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:28:39.465 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-09-19T06:28:39.465 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-19T06:28:39.465 INFO:teuthology.orchestra.run.smithi099.stdout:Install 22 Packages 2024-09-19T06:28:39.465 INFO:teuthology.orchestra.run.smithi099.stdout:Upgrade 2 Packages 2024-09-19T06:28:39.465 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:28:39.465 INFO:teuthology.orchestra.run.smithi117.stdout:(8/24): python3-ceph-common-17.2.7-1637.g6e06d1 2.4 MB/s | 120 kB 00:00 2024-09-19T06:28:39.466 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 58 M 2024-09-19T06:28:39.466 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-09-19T06:28:39.490 INFO:teuthology.orchestra.run.smithi117.stdout:(9/24): python3-cephfs-17.2.7-1637.g6e06d1e0.el 2.6 MB/s | 156 kB 00:00 2024-09-19T06:28:39.516 INFO:teuthology.orchestra.run.smithi117.stdout:(10/24): python3-rados-17.2.7-1637.g6e06d1e0.el 6.3 MB/s | 320 kB 00:00 2024-09-19T06:28:39.541 INFO:teuthology.orchestra.run.smithi117.stdout:(11/24): python3-rbd-17.2.7-1637.g6e06d1e0.el9. 5.7 MB/s | 295 kB 00:00 2024-09-19T06:28:39.566 INFO:teuthology.orchestra.run.smithi117.stdout:(12/24): python3-rgw-17.2.7-1637.g6e06d1e0.el9. 1.9 MB/s | 99 kB 00:00 2024-09-19T06:28:39.709 INFO:teuthology.orchestra.run.smithi117.stdout:(13/24): ceph-radosgw-17.2.7-1637.g6e06d1e0.el9 9.4 MB/s | 14 MB 00:01 2024-09-19T06:28:39.775 INFO:teuthology.orchestra.run.smithi117.stdout:(14/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 217 kB/s | 45 kB 00:00 2024-09-19T06:28:39.801 INFO:teuthology.orchestra.run.smithi117.stdout:(15/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 617 kB/s | 160 kB 00:00 2024-09-19T06:28:39.834 INFO:teuthology.orchestra.run.smithi117.stdout:(16/24): python3-prettytable-0.7.2-27.el9.noarc 1.2 MB/s | 42 kB 00:00 2024-09-19T06:28:39.885 INFO:teuthology.orchestra.run.smithi117.stdout:(17/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-09-19T06:28:39.918 INFO:teuthology.orchestra.run.smithi117.stdout:(18/24): librdkafka-1.6.1-102.el9.x86_64.rpm 3.1 MB/s | 662 kB 00:00 2024-09-19T06:28:39.952 INFO:teuthology.orchestra.run.smithi117.stdout:(19/24): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.6 MB/s | 308 kB 00:00 2024-09-19T06:28:39.977 INFO:teuthology.orchestra.run.smithi117.stdout:(20/24): liboath-2.6.7-2.el9.x86_64.rpm 528 kB/s | 49 kB 00:00 2024-09-19T06:28:40.011 INFO:teuthology.orchestra.run.smithi117.stdout:(21/24): libunwind-1.6.2-1.el9.x86_64.rpm 797 kB/s | 67 kB 00:00 2024-09-19T06:28:40.052 INFO:teuthology.orchestra.run.smithi117.stdout:(22/24): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-09-19T06:28:40.186 INFO:teuthology.orchestra.run.smithi117.stdout:(23/24): librados2-17.2.7-1637.g6e06d1e0.el9.x8 15 MB/s | 3.1 MB 00:00 2024-09-19T06:28:40.276 INFO:teuthology.orchestra.run.smithi099.stdout:(1/24): ceph-base-17.2.7-1637.g6e06d1e0.el9.x86 10 MB/s | 5.0 MB 00:00 2024-09-19T06:28:40.327 INFO:teuthology.orchestra.run.smithi099.stdout:(2/24): ceph-selinux-17.2.7-1637.g6e06d1e0.el9. 503 kB/s | 25 kB 00:00 2024-09-19T06:28:40.328 INFO:teuthology.orchestra.run.smithi117.stdout:(24/24): librbd1-17.2.7-1637.g6e06d1e0.el9.x86_ 9.3 MB/s | 2.9 MB 00:00 2024-09-19T06:28:40.333 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-09-19T06:28:40.333 INFO:teuthology.orchestra.run.smithi117.stdout:Total 22 MB/s | 58 MB 00:02 2024-09-19T06:28:40.395 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-09-19T06:28:40.401 INFO:teuthology.orchestra.run.smithi099.stdout:(3/24): libcephfs2-17.2.7-1637.g6e06d1e0.el9.x8 8.3 MB/s | 636 kB 00:00 2024-09-19T06:28:40.428 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-09-19T06:28:40.428 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-09-19T06:28:40.502 INFO:teuthology.orchestra.run.smithi099.stdout:(4/24): libradosstriper1-17.2.7-1637.g6e06d1e0. 4.5 MB/s | 457 kB 00:00 2024-09-19T06:28:40.811 INFO:teuthology.orchestra.run.smithi099.stdout:(5/24): librgw2-17.2.7-1637.g6e06d1e0.el9.x86_6 16 MB/s | 4.9 MB 00:00 2024-09-19T06:28:40.978 INFO:teuthology.orchestra.run.smithi099.stdout:(6/24): ceph-radosgw-17.2.7-1637.g6e06d1e0.el9. 12 MB/s | 14 MB 00:01 2024-09-19T06:28:41.003 INFO:teuthology.orchestra.run.smithi099.stdout:(7/24): python3-ceph-argparse-17.2.7-1637.g6e06 235 kB/s | 45 kB 00:00 2024-09-19T06:28:41.028 INFO:teuthology.orchestra.run.smithi099.stdout:(8/24): python3-ceph-common-17.2.7-1637.g6e06d1 2.3 MB/s | 120 kB 00:00 2024-09-19T06:28:41.053 INFO:teuthology.orchestra.run.smithi099.stdout:(9/24): python3-cephfs-17.2.7-1637.g6e06d1e0.el 3.0 MB/s | 156 kB 00:00 2024-09-19T06:28:41.078 INFO:teuthology.orchestra.run.smithi099.stdout:(10/24): python3-rados-17.2.7-1637.g6e06d1e0.el 6.3 MB/s | 320 kB 00:00 2024-09-19T06:28:41.086 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-09-19T06:28:41.086 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-09-19T06:28:41.112 INFO:teuthology.orchestra.run.smithi099.stdout:(11/24): python3-rbd-17.2.7-1637.g6e06d1e0.el9. 4.9 MB/s | 295 kB 00:00 2024-09-19T06:28:41.137 INFO:teuthology.orchestra.run.smithi099.stdout:(12/24): python3-rgw-17.2.7-1637.g6e06d1e0.el9. 1.7 MB/s | 99 kB 00:00 2024-09-19T06:28:41.404 INFO:teuthology.orchestra.run.smithi099.stdout:(13/24): ceph-common-17.2.7-1637.g6e06d1e0.el9. 14 MB/s | 22 MB 00:01 2024-09-19T06:28:41.421 INFO:teuthology.orchestra.run.smithi099.stdout:(14/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 159 kB/s | 45 kB 00:00 2024-09-19T06:28:41.480 INFO:teuthology.orchestra.run.smithi099.stdout:(15/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 436 kB/s | 160 kB 00:00 2024-09-19T06:28:41.522 INFO:teuthology.orchestra.run.smithi099.stdout:(16/24): python3-prettytable-0.7.2-27.el9.noarc 1.0 MB/s | 42 kB 00:00 2024-09-19T06:28:41.555 INFO:teuthology.orchestra.run.smithi099.stdout:(17/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.1 MB/s | 292 kB 00:00 2024-09-19T06:28:41.597 INFO:teuthology.orchestra.run.smithi099.stdout:(18/24): gperftools-libs-2.9.1-3.el9.x86_64.rpm 4.0 MB/s | 308 kB 00:00 2024-09-19T06:28:41.614 INFO:teuthology.orchestra.run.smithi099.stdout:(19/24): libunwind-1.6.2-1.el9.x86_64.rpm 4.5 MB/s | 67 kB 00:00 2024-09-19T06:28:41.639 INFO:teuthology.orchestra.run.smithi099.stdout:(20/24): liboath-2.6.7-2.el9.x86_64.rpm 594 kB/s | 49 kB 00:00 2024-09-19T06:28:41.673 INFO:teuthology.orchestra.run.smithi099.stdout:(21/24): librdkafka-1.6.1-102.el9.x86_64.rpm 2.4 MB/s | 662 kB 00:00 2024-09-19T06:28:41.742 INFO:teuthology.orchestra.run.smithi099.stdout:(22/24): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-09-19T06:28:41.815 INFO:teuthology.orchestra.run.smithi099.stdout:(23/24): librados2-17.2.7-1637.g6e06d1e0.el9.x8 18 MB/s | 3.1 MB 00:00 2024-09-19T06:28:41.890 INFO:teuthology.orchestra.run.smithi099.stdout:(24/24): librbd1-17.2.7-1637.g6e06d1e0.el9.x86_ 14 MB/s | 2.9 MB 00:00 2024-09-19T06:28:41.895 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-09-19T06:28:41.895 INFO:teuthology.orchestra.run.smithi099.stdout:Total 24 MB/s | 58 MB 00:02 2024-09-19T06:28:41.960 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-09-19T06:28:41.994 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-09-19T06:28:41.994 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-09-19T06:28:42.315 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-09-19T06:28:42.661 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-09-19T06:28:42.662 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-09-19T06:28:42.670 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2024-09-19T06:28:42.772 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : librados2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2/26 2024-09-19T06:28:42.870 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librados2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2/26 2024-09-19T06:28:42.950 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rados-2:17.2.7-1637.g6e06d1e0.el9.x86_64 3/26 2024-09-19T06:28:42.973 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libcephfs2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 4/26 2024-09-19T06:28:43.062 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libcephfs2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 4/26 2024-09-19T06:28:43.107 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2024-09-19T06:28:43.145 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2024-09-19T06:28:43.582 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2024-09-19T06:28:43.619 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librgw2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 8/26 2024-09-19T06:28:43.680 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librgw2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 8/26 2024-09-19T06:28:43.709 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2024-09-19T06:28:43.743 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-ceph-argparse-2:17.2.7-1637.g6e06d1e0.el9. 10/26 2024-09-19T06:28:43.780 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cephfs-2:17.2.7-1637.g6e06d1e0.el9.x86_64 11/26 2024-09-19T06:28:43.842 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rgw-2:17.2.7-1637.g6e06d1e0.el9.x86_64 12/26 2024-09-19T06:28:43.870 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libradosstriper1-2:17.2.7-1637.g6e06d1e0.el9.x86_6 13/26 2024-09-19T06:28:43.876 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-09-19T06:28:43.919 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libradosstriper1-2:17.2.7-1637.g6e06d1e0.el9.x86_6 13/26 2024-09-19T06:28:43.959 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2024-09-19T06:28:43.995 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/26 2024-09-19T06:28:44.046 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2024-09-19T06:28:44.250 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2024-09-19T06:28:44.309 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : librados2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2/26 2024-09-19T06:28:44.349 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2024-09-19T06:28:44.385 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librados2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2/26 2024-09-19T06:28:44.390 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : librbd1-2:17.2.7-1637.g6e06d1e0.el9.x86_64 18/26 2024-09-19T06:28:44.462 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-rados-2:17.2.7-1637.g6e06d1e0.el9.x86_64 3/26 2024-09-19T06:28:44.463 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librbd1-2:17.2.7-1637.g6e06d1e0.el9.x86_64 18/26 2024-09-19T06:28:44.485 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libcephfs2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 4/26 2024-09-19T06:28:44.538 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rbd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 19/26 2024-09-19T06:28:44.568 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-ceph-common-2:17.2.7-1637.g6e06d1e0.el9.x8 20/26 2024-09-19T06:28:44.573 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: libcephfs2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 4/26 2024-09-19T06:28:44.627 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2024-09-19T06:28:44.657 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2024-09-19T06:28:45.093 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2024-09-19T06:28:45.130 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : librgw2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 8/26 2024-09-19T06:28:45.192 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librgw2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 8/26 2024-09-19T06:28:45.221 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2024-09-19T06:28:45.263 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-ceph-argparse-2:17.2.7-1637.g6e06d1e0.el9. 10/26 2024-09-19T06:28:45.300 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cephfs-2:17.2.7-1637.g6e06d1e0.el9.x86_64 11/26 2024-09-19T06:28:45.363 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-rgw-2:17.2.7-1637.g6e06d1e0.el9.x86_64 12/26 2024-09-19T06:28:45.390 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libradosstriper1-2:17.2.7-1637.g6e06d1e0.el9.x86_6 13/26 2024-09-19T06:28:45.456 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: libradosstriper1-2:17.2.7-1637.g6e06d1e0.el9.x86_6 13/26 2024-09-19T06:28:45.513 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2024-09-19T06:28:45.549 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/26 2024-09-19T06:28:45.582 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2024-09-19T06:28:45.878 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2024-09-19T06:28:45.919 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : librbd1-2:17.2.7-1637.g6e06d1e0.el9.x86_64 18/26 2024-09-19T06:28:46.008 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librbd1-2:17.2.7-1637.g6e06d1e0.el9.x86_64 18/26 2024-09-19T06:28:46.082 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-rbd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 19/26 2024-09-19T06:28:46.113 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-ceph-common-2:17.2.7-1637.g6e06d1e0.el9.x8 20/26 2024-09-19T06:28:47.034 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-common-2:17.2.7-1637.g6e06d1e0.el9.x86_64 21/26 2024-09-19T06:28:47.072 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-common-2:17.2.7-1637.g6e06d1e0.el9.x86_64 21/26 2024-09-19T06:28:47.590 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-common-2:17.2.7-1637.g6e06d1e0.el9.x86_64 21/26 2024-09-19T06:28:47.626 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-base-2:17.2.7-1637.g6e06d1e0.el9.x86_64 22/26 2024-09-19T06:28:47.711 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-base-2:17.2.7-1637.g6e06d1e0.el9.x86_64 22/26 2024-09-19T06:28:47.712 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T06:28:47.712 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T06:28:47.712 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:28:47.744 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-selinux-2:17.2.7-1637.g6e06d1e0.el9.x86_64 23/26 2024-09-19T06:28:48.532 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-common-2:17.2.7-1637.g6e06d1e0.el9.x86_64 21/26 2024-09-19T06:28:48.576 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-common-2:17.2.7-1637.g6e06d1e0.el9.x86_64 21/26 2024-09-19T06:28:49.115 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-common-2:17.2.7-1637.g6e06d1e0.el9.x86_64 21/26 2024-09-19T06:28:49.162 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-base-2:17.2.7-1637.g6e06d1e0.el9.x86_64 22/26 2024-09-19T06:28:49.261 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-base-2:17.2.7-1637.g6e06d1e0.el9.x86_64 22/26 2024-09-19T06:28:49.261 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T06:28:49.262 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T06:28:49.262 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:28:49.297 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-selinux-2:17.2.7-1637.g6e06d1e0.el9.x86_64 23/26 2024-09-19T06:28:57.584 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-selinux-2:17.2.7-1637.g6e06d1e0.el9.x86_64 23/26 2024-09-19T06:28:57.584 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /sys 2024-09-19T06:28:57.584 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /proc 2024-09-19T06:28:57.584 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /mnt 2024-09-19T06:28:57.584 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /var/tmp 2024-09-19T06:28:57.584 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /home 2024-09-19T06:28:57.584 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /root 2024-09-19T06:28:57.585 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /tmp 2024-09-19T06:28:57.585 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:28:58.859 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-radosgw-2:17.2.7-1637.g6e06d1e0.el9.x86_64 24/26 2024-09-19T06:28:58.921 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-1637.g6e06d1e0.el9.x86_64 24/26 2024-09-19T06:28:58.921 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:28:58.921 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T06:28:58.921 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T06:28:58.925 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T06:28:58.925 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:28:58.926 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-09-19T06:28:58.995 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-09-19T06:28:58.995 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2024-09-19T06:28:59.124 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-selinux-2:17.2.7-1637.g6e06d1e0.el9.x86_64 23/26 2024-09-19T06:28:59.125 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /sys 2024-09-19T06:28:59.125 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /proc 2024-09-19T06:28:59.125 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /mnt 2024-09-19T06:28:59.125 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /var/tmp 2024-09-19T06:28:59.125 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /home 2024-09-19T06:28:59.125 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /root 2024-09-19T06:28:59.125 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /tmp 2024-09-19T06:28:59.125 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:29:00.256 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2024-09-19T06:29:00.257 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-base-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/26 2024-09-19T06:29:00.257 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-common-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2/26 2024-09-19T06:29:00.257 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-radosgw-2:17.2.7-1637.g6e06d1e0.el9.x86_64 3/26 2024-09-19T06:29:00.257 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-selinux-2:17.2.7-1637.g6e06d1e0.el9.x86_64 4/26 2024-09-19T06:29:00.257 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libcephfs2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 5/26 2024-09-19T06:29:00.257 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libradosstriper1-2:17.2.7-1637.g6e06d1e0.el9.x86_6 6/26 2024-09-19T06:29:00.257 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librgw2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 7/26 2024-09-19T06:29:00.257 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-ceph-argparse-2:17.2.7-1637.g6e06d1e0.el9. 8/26 2024-09-19T06:29:00.257 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-ceph-common-2:17.2.7-1637.g6e06d1e0.el9.x8 9/26 2024-09-19T06:29:00.257 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cephfs-2:17.2.7-1637.g6e06d1e0.el9.x86_64 10/26 2024-09-19T06:29:00.258 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rados-2:17.2.7-1637.g6e06d1e0.el9.x86_64 11/26 2024-09-19T06:29:00.258 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rbd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 12/26 2024-09-19T06:29:00.258 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rgw-2:17.2.7-1637.g6e06d1e0.el9.x86_64 13/26 2024-09-19T06:29:00.258 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2024-09-19T06:29:00.258 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2024-09-19T06:29:00.258 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2024-09-19T06:29:00.258 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2024-09-19T06:29:00.258 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2024-09-19T06:29:00.258 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 19/26 2024-09-19T06:29:00.258 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2024-09-19T06:29:00.258 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2024-09-19T06:29:00.258 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2024-09-19T06:29:00.259 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librados2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 23/26 2024-09-19T06:29:00.259 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2024-09-19T06:29:00.259 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librbd1-2:17.2.7-1637.g6e06d1e0.el9.x86_64 25/26 2024-09-19T06:29:00.418 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-radosgw-2:17.2.7-1637.g6e06d1e0.el9.x86_64 24/26 2024-09-19T06:29:00.485 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-1637.g6e06d1e0.el9.x86_64 24/26 2024-09-19T06:29:00.486 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:29:00.486 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T06:29:00.486 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T06:29:00.486 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T06:29:00.486 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:29:00.487 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-09-19T06:29:00.571 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-09-19T06:29:00.571 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2024-09-19T06:29:01.105 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2024-09-19T06:29:01.105 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:29:01.105 INFO:teuthology.orchestra.run.smithi117.stdout:Upgraded: 2024-09-19T06:29:01.106 INFO:teuthology.orchestra.run.smithi117.stdout: librados2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T06:29:01.106 INFO:teuthology.orchestra.run.smithi117.stdout: librbd1-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T06:29:01.106 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-09-19T06:29:01.106 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-base-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T06:29:01.106 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-common-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T06:29:01.106 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-radosgw-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T06:29:01.106 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-selinux-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T06:29:01.106 INFO:teuthology.orchestra.run.smithi117.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T06:29:01.106 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T06:29:01.106 INFO:teuthology.orchestra.run.smithi117.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T06:29:01.106 INFO:teuthology.orchestra.run.smithi117.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T06:29:01.106 INFO:teuthology.orchestra.run.smithi117.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T06:29:01.107 INFO:teuthology.orchestra.run.smithi117.stdout: libradosstriper1-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T06:29:01.107 INFO:teuthology.orchestra.run.smithi117.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T06:29:01.107 INFO:teuthology.orchestra.run.smithi117.stdout: librgw2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T06:29:01.107 INFO:teuthology.orchestra.run.smithi117.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T06:29:01.107 INFO:teuthology.orchestra.run.smithi117.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T06:29:01.107 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-argparse-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T06:29:01.107 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-common-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T06:29:01.107 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cephfs-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T06:29:01.107 INFO:teuthology.orchestra.run.smithi117.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T06:29:01.107 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rados-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T06:29:01.107 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rbd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T06:29:01.107 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rgw-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T06:29:01.107 INFO:teuthology.orchestra.run.smithi117.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T06:29:01.107 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:29:01.108 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-09-19T06:29:01.492 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph-test 2024-09-19T06:29:01.838 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2024-09-19T06:29:01.839 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-base-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/26 2024-09-19T06:29:01.839 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-common-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2/26 2024-09-19T06:29:01.839 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-radosgw-2:17.2.7-1637.g6e06d1e0.el9.x86_64 3/26 2024-09-19T06:29:01.839 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-selinux-2:17.2.7-1637.g6e06d1e0.el9.x86_64 4/26 2024-09-19T06:29:01.839 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libcephfs2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 5/26 2024-09-19T06:29:01.839 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libradosstriper1-2:17.2.7-1637.g6e06d1e0.el9.x86_6 6/26 2024-09-19T06:29:01.839 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librgw2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 7/26 2024-09-19T06:29:01.839 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-ceph-argparse-2:17.2.7-1637.g6e06d1e0.el9. 8/26 2024-09-19T06:29:01.839 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-ceph-common-2:17.2.7-1637.g6e06d1e0.el9.x8 9/26 2024-09-19T06:29:01.839 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cephfs-2:17.2.7-1637.g6e06d1e0.el9.x86_64 10/26 2024-09-19T06:29:01.839 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-rados-2:17.2.7-1637.g6e06d1e0.el9.x86_64 11/26 2024-09-19T06:29:01.839 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-rbd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 12/26 2024-09-19T06:29:01.839 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-rgw-2:17.2.7-1637.g6e06d1e0.el9.x86_64 13/26 2024-09-19T06:29:01.840 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2024-09-19T06:29:01.840 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2024-09-19T06:29:01.840 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2024-09-19T06:29:01.840 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2024-09-19T06:29:01.840 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2024-09-19T06:29:01.840 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 19/26 2024-09-19T06:29:01.840 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2024-09-19T06:29:01.840 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2024-09-19T06:29:01.840 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2024-09-19T06:29:01.840 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librados2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 23/26 2024-09-19T06:29:01.840 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2024-09-19T06:29:01.840 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librbd1-2:17.2.7-1637.g6e06d1e0.el9.x86_64 25/26 2024-09-19T06:29:02.075 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:00:27 ago on Thu 19 Sep 2024 06:28:35 AM UTC. 2024-09-19T06:29:02.209 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-09-19T06:29:02.209 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-19T06:29:02.209 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repository Size 2024-09-19T06:29:02.210 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-19T06:29:02.210 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-09-19T06:29:02.210 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-test x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 48 M 2024-09-19T06:29:02.210 INFO:teuthology.orchestra.run.smithi117.stdout:Installing dependencies: 2024-09-19T06:29:02.210 INFO:teuthology.orchestra.run.smithi117.stdout: libcephsqlite x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 163 k 2024-09-19T06:29:02.210 INFO:teuthology.orchestra.run.smithi117.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T06:29:02.210 INFO:teuthology.orchestra.run.smithi117.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T06:29:02.210 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:29:02.210 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-09-19T06:29:02.210 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-19T06:29:02.210 INFO:teuthology.orchestra.run.smithi117.stdout:Install 4 Packages 2024-09-19T06:29:02.210 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:29:02.211 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 48 M 2024-09-19T06:29:02.211 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 193 M 2024-09-19T06:29:02.211 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-09-19T06:29:02.544 INFO:teuthology.orchestra.run.smithi117.stdout:(1/4): libcephsqlite-17.2.7-1637.g6e06d1e0.el9. 777 kB/s | 163 kB 00:00 2024-09-19T06:29:02.577 INFO:teuthology.orchestra.run.smithi117.stdout:(2/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.2 MB/s | 304 kB 00:00 2024-09-19T06:29:02.670 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2024-09-19T06:29:02.670 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:29:02.670 INFO:teuthology.orchestra.run.smithi099.stdout:Upgraded: 2024-09-19T06:29:02.670 INFO:teuthology.orchestra.run.smithi099.stdout: librados2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T06:29:02.670 INFO:teuthology.orchestra.run.smithi099.stdout: librbd1-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T06:29:02.670 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-09-19T06:29:02.670 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-base-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T06:29:02.670 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-common-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T06:29:02.670 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-radosgw-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T06:29:02.670 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-selinux-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T06:29:02.670 INFO:teuthology.orchestra.run.smithi099.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T06:29:02.671 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T06:29:02.671 INFO:teuthology.orchestra.run.smithi099.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T06:29:02.671 INFO:teuthology.orchestra.run.smithi099.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T06:29:02.671 INFO:teuthology.orchestra.run.smithi099.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T06:29:02.671 INFO:teuthology.orchestra.run.smithi099.stdout: libradosstriper1-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T06:29:02.671 INFO:teuthology.orchestra.run.smithi099.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T06:29:02.671 INFO:teuthology.orchestra.run.smithi099.stdout: librgw2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T06:29:02.671 INFO:teuthology.orchestra.run.smithi099.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T06:29:02.671 INFO:teuthology.orchestra.run.smithi099.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T06:29:02.671 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-argparse-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T06:29:02.671 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-common-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T06:29:02.671 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cephfs-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T06:29:02.671 INFO:teuthology.orchestra.run.smithi099.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T06:29:02.671 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rados-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T06:29:02.671 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rbd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T06:29:02.672 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rgw-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T06:29:02.672 INFO:teuthology.orchestra.run.smithi099.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T06:29:02.672 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:29:02.672 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-19T06:29:02.686 INFO:teuthology.orchestra.run.smithi117.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 449 kB/s | 64 kB 00:00 2024-09-19T06:29:02.974 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install ceph-test 2024-09-19T06:29:03.553 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:00:26 ago on Thu 19 Sep 2024 06:28:37 AM UTC. 2024-09-19T06:29:03.691 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-19T06:29:03.692 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-19T06:29:03.692 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repository Size 2024-09-19T06:29:03.692 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-19T06:29:03.692 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-09-19T06:29:03.692 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-test x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 48 M 2024-09-19T06:29:03.692 INFO:teuthology.orchestra.run.smithi099.stdout:Installing dependencies: 2024-09-19T06:29:03.692 INFO:teuthology.orchestra.run.smithi099.stdout: libcephsqlite x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 163 k 2024-09-19T06:29:03.692 INFO:teuthology.orchestra.run.smithi099.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T06:29:03.692 INFO:teuthology.orchestra.run.smithi099.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T06:29:03.692 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:29:03.692 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-09-19T06:29:03.693 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-19T06:29:03.693 INFO:teuthology.orchestra.run.smithi099.stdout:Install 4 Packages 2024-09-19T06:29:03.693 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:29:03.693 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 48 M 2024-09-19T06:29:03.693 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 193 M 2024-09-19T06:29:03.693 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-09-19T06:29:03.811 INFO:teuthology.orchestra.run.smithi117.stdout:(4/4): ceph-test-17.2.7-1637.g6e06d1e0.el9.x86_ 32 MB/s | 48 MB 00:01 2024-09-19T06:29:03.813 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-09-19T06:29:03.814 INFO:teuthology.orchestra.run.smithi117.stdout:Total 30 MB/s | 48 MB 00:01 2024-09-19T06:29:03.841 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-09-19T06:29:03.860 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-09-19T06:29:03.860 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-09-19T06:29:03.943 INFO:teuthology.orchestra.run.smithi099.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.5 MB/s | 304 kB 00:00 2024-09-19T06:29:03.968 INFO:teuthology.orchestra.run.smithi099.stdout:(2/4): libcephsqlite-17.2.7-1637.g6e06d1e0.el9. 733 kB/s | 163 kB 00:00 2024-09-19T06:29:03.993 INFO:teuthology.orchestra.run.smithi099.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-19T06:29:04.226 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-09-19T06:29:04.227 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-09-19T06:29:04.757 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-09-19T06:29:04.838 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-19T06:29:04.885 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-19T06:29:04.913 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libcephsqlite-2:17.2.7-1637.g6e06d1e0.el9.x86_64 3/4 2024-09-19T06:29:05.352 INFO:teuthology.orchestra.run.smithi099.stdout:(4/4): ceph-test-17.2.7-1637.g6e06d1e0.el9.x86_ 30 MB/s | 48 MB 00:01 2024-09-19T06:29:05.354 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-09-19T06:29:05.354 INFO:teuthology.orchestra.run.smithi099.stdout:Total 29 MB/s | 48 MB 00:01 2024-09-19T06:29:05.381 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-09-19T06:29:05.400 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-09-19T06:29:05.400 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-09-19T06:29:05.762 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-09-19T06:29:05.763 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-09-19T06:29:06.285 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-09-19T06:29:06.353 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-19T06:29:06.392 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-19T06:29:06.420 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libcephsqlite-2:17.2.7-1637.g6e06d1e0.el9.x86_64 3/4 2024-09-19T06:29:09.314 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libcephsqlite-2:17.2.7-1637.g6e06d1e0.el9.x86_64 3/4 2024-09-19T06:29:09.385 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-test-2:17.2.7-1637.g6e06d1e0.el9.x86_64 4/4 2024-09-19T06:29:10.825 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: libcephsqlite-2:17.2.7-1637.g6e06d1e0.el9.x86_64 3/4 2024-09-19T06:29:10.900 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-test-2:17.2.7-1637.g6e06d1e0.el9.x86_64 4/4 2024-09-19T06:29:11.533 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-test-2:17.2.7-1637.g6e06d1e0.el9.x86_64 4/4 2024-09-19T06:29:11.533 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-test-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/4 2024-09-19T06:29:11.534 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libcephsqlite-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2/4 2024-09-19T06:29:11.534 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-19T06:29:11.833 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-19T06:29:11.834 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:29:11.834 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-09-19T06:29:11.834 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-test-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T06:29:11.834 INFO:teuthology.orchestra.run.smithi117.stdout: libcephsqlite-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T06:29:11.834 INFO:teuthology.orchestra.run.smithi117.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T06:29:11.834 INFO:teuthology.orchestra.run.smithi117.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T06:29:11.834 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:29:11.834 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-09-19T06:29:12.158 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph 2024-09-19T06:29:12.743 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:00:37 ago on Thu 19 Sep 2024 06:28:35 AM UTC. 2024-09-19T06:29:12.885 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-09-19T06:29:12.887 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-19T06:29:12.887 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repository Size 2024-09-19T06:29:12.887 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-19T06:29:12.887 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-09-19T06:29:12.887 INFO:teuthology.orchestra.run.smithi117.stdout: ceph x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 6.5 k 2024-09-19T06:29:12.887 INFO:teuthology.orchestra.run.smithi117.stdout:Installing dependencies: 2024-09-19T06:29:12.887 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mds x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 2.1 M 2024-09-19T06:29:12.888 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 1.4 M 2024-09-19T06:29:12.888 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-modules-core noarch 2:17.2.7-1637.g6e06d1e0.el9 ceph-noarch 240 k 2024-09-19T06:29:12.888 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mon x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 3.9 M 2024-09-19T06:29:12.888 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-osd x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 15 M 2024-09-19T06:29:12.888 INFO:teuthology.orchestra.run.smithi117.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T06:29:12.888 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T06:29:12.888 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T06:29:12.888 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T06:29:12.888 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T06:29:12.888 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T06:29:12.888 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T06:29:12.888 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-collections 2024-09-19T06:29:12.888 INFO:teuthology.orchestra.run.smithi117.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-19T06:29:12.889 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T06:29:12.889 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T06:29:12.889 INFO:teuthology.orchestra.run.smithi117.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T06:29:12.889 INFO:teuthology.orchestra.run.smithi117.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T06:29:12.889 INFO:teuthology.orchestra.run.smithi117.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T06:29:12.889 INFO:teuthology.orchestra.run.smithi117.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T06:29:12.889 INFO:teuthology.orchestra.run.smithi117.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T06:29:12.889 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T06:29:12.889 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T06:29:12.889 INFO:teuthology.orchestra.run.smithi117.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T06:29:12.889 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T06:29:12.889 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T06:29:12.889 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T06:29:12.890 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T06:29:12.890 INFO:teuthology.orchestra.run.smithi117.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T06:29:12.890 INFO:teuthology.orchestra.run.smithi117.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T06:29:12.890 INFO:teuthology.orchestra.run.smithi117.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T06:29:12.890 INFO:teuthology.orchestra.run.smithi117.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T06:29:12.890 INFO:teuthology.orchestra.run.smithi117.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T06:29:12.890 INFO:teuthology.orchestra.run.smithi117.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T06:29:12.890 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:29:12.890 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-09-19T06:29:12.890 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-19T06:29:12.891 INFO:teuthology.orchestra.run.smithi117.stdout:Install 34 Packages 2024-09-19T06:29:12.891 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:29:12.891 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 27 M 2024-09-19T06:29:12.891 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 96 M 2024-09-19T06:29:12.891 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-09-19T06:29:13.179 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-test-2:17.2.7-1637.g6e06d1e0.el9.x86_64 4/4 2024-09-19T06:29:13.179 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-test-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/4 2024-09-19T06:29:13.179 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libcephsqlite-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2/4 2024-09-19T06:29:13.179 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-19T06:29:13.252 INFO:teuthology.orchestra.run.smithi117.stdout:(1/34): ceph-17.2.7-1637.g6e06d1e0.el9.x86_64.r 52 kB/s | 6.5 kB 00:00 2024-09-19T06:29:13.461 INFO:teuthology.orchestra.run.smithi117.stdout:(2/34): ceph-mds-17.2.7-1637.g6e06d1e0.el9.x86_ 6.2 MB/s | 2.1 MB 00:00 2024-09-19T06:29:13.483 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-19T06:29:13.483 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:29:13.483 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-09-19T06:29:13.484 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-test-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T06:29:13.484 INFO:teuthology.orchestra.run.smithi099.stdout: libcephsqlite-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T06:29:13.484 INFO:teuthology.orchestra.run.smithi099.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T06:29:13.484 INFO:teuthology.orchestra.run.smithi099.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T06:29:13.484 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:29:13.484 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-19T06:29:13.502 INFO:teuthology.orchestra.run.smithi117.stdout:(3/34): ceph-mgr-17.2.7-1637.g6e06d1e0.el9.x86_ 3.8 MB/s | 1.4 MB 00:00 2024-09-19T06:29:13.586 INFO:teuthology.orchestra.run.smithi117.stdout:(4/34): ceph-mgr-modules-core-17.2.7-1637.g6e06 2.8 MB/s | 240 kB 00:00 2024-09-19T06:29:13.749 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install ceph 2024-09-19T06:29:13.778 INFO:teuthology.orchestra.run.smithi117.stdout:(5/34): ceph-mon-17.2.7-1637.g6e06d1e0.el9.x86_ 7.5 MB/s | 3.9 MB 00:00 2024-09-19T06:29:13.803 INFO:teuthology.orchestra.run.smithi117.stdout:(6/34): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.1 MB/s | 253 kB 00:00 2024-09-19T06:29:13.979 INFO:teuthology.orchestra.run.smithi117.stdout:(7/34): ceph-osd-17.2.7-1637.g6e06d1e0.el9.x86_ 30 MB/s | 15 MB 00:00 2024-09-19T06:29:14.004 INFO:teuthology.orchestra.run.smithi117.stdout:(8/34): python3-ply-3.11-14.el9.noarch.rpm 531 kB/s | 106 kB 00:00 2024-09-19T06:29:14.054 INFO:teuthology.orchestra.run.smithi117.stdout:(9/34): python3-requests-2.25.1-8.el9.noarch.rp 2.4 MB/s | 125 kB 00:00 2024-09-19T06:29:14.113 INFO:teuthology.orchestra.run.smithi117.stdout:(10/34): python3-urllib3-1.26.5-6.el9.noarch.rp 3.6 MB/s | 215 kB 00:00 2024-09-19T06:29:14.138 INFO:teuthology.orchestra.run.smithi117.stdout:(11/34): python3-pycparser-2.20-6.el9.noarch.rp 849 kB/s | 135 kB 00:00 2024-09-19T06:29:14.205 INFO:teuthology.orchestra.run.smithi117.stdout:(12/34): python3-markupsafe-1.1.1-12.el9.x86_64 521 kB/s | 35 kB 00:00 2024-09-19T06:29:14.264 INFO:teuthology.orchestra.run.smithi117.stdout:(13/34): python3-mako-1.1.4-6.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-09-19T06:29:14.289 INFO:teuthology.orchestra.run.smithi117.stdout:(14/34): python3-packaging-20.9-5.el9.noarch.rp 925 kB/s | 77 kB 00:00 2024-09-19T06:29:14.314 INFO:teuthology.orchestra.run.smithi117.stdout:(15/34): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-19T06:29:14.335 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:00:37 ago on Thu 19 Sep 2024 06:28:37 AM UTC. 2024-09-19T06:29:14.340 INFO:teuthology.orchestra.run.smithi117.stdout:(16/34): python3-toml-0.10.2-6.el9.noarch.rpm 827 kB/s | 42 kB 00:00 2024-09-19T06:29:14.382 INFO:teuthology.orchestra.run.smithi117.stdout:(17/34): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 649 kB/s | 43 kB 00:00 2024-09-19T06:29:14.424 INFO:teuthology.orchestra.run.smithi117.stdout:(18/34): python3-cryptography-36.0.1-4.el9.x86_ 1.9 MB/s | 1.2 MB 00:00 2024-09-19T06:29:14.457 INFO:teuthology.orchestra.run.smithi117.stdout:(19/34): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.4 MB/s | 172 kB 00:00 2024-09-19T06:29:14.475 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-19T06:29:14.477 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-19T06:29:14.477 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repository Size 2024-09-19T06:29:14.477 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-19T06:29:14.477 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-09-19T06:29:14.478 INFO:teuthology.orchestra.run.smithi099.stdout: ceph x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 6.5 k 2024-09-19T06:29:14.478 INFO:teuthology.orchestra.run.smithi099.stdout:Installing dependencies: 2024-09-19T06:29:14.478 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mds x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 2.1 M 2024-09-19T06:29:14.478 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 1.4 M 2024-09-19T06:29:14.478 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-modules-core noarch 2:17.2.7-1637.g6e06d1e0.el9 ceph-noarch 240 k 2024-09-19T06:29:14.478 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mon x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 3.9 M 2024-09-19T06:29:14.478 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-osd x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 15 M 2024-09-19T06:29:14.478 INFO:teuthology.orchestra.run.smithi099.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T06:29:14.478 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T06:29:14.478 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T06:29:14.478 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T06:29:14.478 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T06:29:14.479 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T06:29:14.479 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T06:29:14.479 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-collections 2024-09-19T06:29:14.479 INFO:teuthology.orchestra.run.smithi099.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-19T06:29:14.479 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T06:29:14.479 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T06:29:14.479 INFO:teuthology.orchestra.run.smithi099.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T06:29:14.479 INFO:teuthology.orchestra.run.smithi099.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T06:29:14.479 INFO:teuthology.orchestra.run.smithi099.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T06:29:14.479 INFO:teuthology.orchestra.run.smithi099.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T06:29:14.479 INFO:teuthology.orchestra.run.smithi099.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T06:29:14.479 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T06:29:14.479 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T06:29:14.479 INFO:teuthology.orchestra.run.smithi099.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T06:29:14.480 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T06:29:14.480 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T06:29:14.480 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T06:29:14.480 INFO:teuthology.orchestra.run.smithi099.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T06:29:14.480 INFO:teuthology.orchestra.run.smithi099.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T06:29:14.480 INFO:teuthology.orchestra.run.smithi099.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T06:29:14.480 INFO:teuthology.orchestra.run.smithi099.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T06:29:14.480 INFO:teuthology.orchestra.run.smithi099.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T06:29:14.480 INFO:teuthology.orchestra.run.smithi099.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T06:29:14.480 INFO:teuthology.orchestra.run.smithi099.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T06:29:14.480 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:29:14.480 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-09-19T06:29:14.481 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-19T06:29:14.481 INFO:teuthology.orchestra.run.smithi099.stdout:Install 34 Packages 2024-09-19T06:29:14.481 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:29:14.481 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 27 M 2024-09-19T06:29:14.481 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 96 M 2024-09-19T06:29:14.481 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-09-19T06:29:14.482 INFO:teuthology.orchestra.run.smithi117.stdout:(20/34): python3-cherrypy-18.6.1-2.el9.noarch.r 3.5 MB/s | 358 kB 00:00 2024-09-19T06:29:14.508 INFO:teuthology.orchestra.run.smithi117.stdout:(21/34): python3-jaraco-8.2.1-3.el9.noarch.rpm 128 kB/s | 11 kB 00:00 2024-09-19T06:29:14.533 INFO:teuthology.orchestra.run.smithi117.stdout:(22/34): python3-jaraco-classes-3.2.1-5.el9.noa 240 kB/s | 18 kB 00:00 2024-09-19T06:29:14.558 INFO:teuthology.orchestra.run.smithi117.stdout:(23/34): python3-jaraco-collections-3.0.0-8.el9 307 kB/s | 23 kB 00:00 2024-09-19T06:29:14.583 INFO:teuthology.orchestra.run.smithi117.stdout:(24/34): python3-jaraco-functools-3.5.0-2.el9.n 258 kB/s | 19 kB 00:00 2024-09-19T06:29:14.609 INFO:teuthology.orchestra.run.smithi117.stdout:(25/34): python3-jaraco-text-3.2.0-6.el9.noarch 261 kB/s | 20 kB 00:00 2024-09-19T06:29:14.634 INFO:teuthology.orchestra.run.smithi117.stdout:(26/34): python3-logutils-0.3.5-21.el9.noarch.r 924 kB/s | 46 kB 00:00 2024-09-19T06:29:14.659 INFO:teuthology.orchestra.run.smithi117.stdout:(27/34): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2024-09-19T06:29:14.684 INFO:teuthology.orchestra.run.smithi117.stdout:(28/34): python3-portend-3.1.0-2.el9.noarch.rpm 328 kB/s | 16 kB 00:00 2024-09-19T06:29:14.710 INFO:teuthology.orchestra.run.smithi117.stdout:(29/34): python3-tempora-5.0.0-2.el9.noarch.rpm 1.4 MB/s | 36 kB 00:00 2024-09-19T06:29:14.735 INFO:teuthology.orchestra.run.smithi117.stdout:(30/34): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.2 MB/s | 90 kB 00:00 2024-09-19T06:29:14.769 INFO:teuthology.orchestra.run.smithi117.stdout:(31/34): python3-pecan-1.4.2-3.el9.noarch.rpm 1.7 MB/s | 272 kB 00:00 2024-09-19T06:29:14.784 INFO:teuthology.orchestra.run.smithi099.stdout:(1/34): ceph-17.2.7-1637.g6e06d1e0.el9.x86_64.r 53 kB/s | 6.5 kB 00:00 2024-09-19T06:29:14.794 INFO:teuthology.orchestra.run.smithi117.stdout:(32/34): python3-webob-1.8.8-2.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-09-19T06:29:14.810 INFO:teuthology.orchestra.run.smithi117.stdout:(33/34): python3-zc-lockfile-2.0-10.el9.noarch. 482 kB/s | 20 kB 00:00 2024-09-19T06:29:14.844 INFO:teuthology.orchestra.run.smithi117.stdout:(34/34): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.8 MB/s | 427 kB 00:00 2024-09-19T06:29:14.849 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-09-19T06:29:14.849 INFO:teuthology.orchestra.run.smithi117.stdout:Total 14 MB/s | 27 MB 00:01 2024-09-19T06:29:14.942 INFO:teuthology.orchestra.run.smithi099.stdout:(2/34): ceph-mgr-17.2.7-1637.g6e06d1e0.el9.x86_ 5.0 MB/s | 1.4 MB 00:00 2024-09-19T06:29:14.982 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-09-19T06:29:15.009 INFO:teuthology.orchestra.run.smithi099.stdout:(3/34): ceph-mds-17.2.7-1637.g6e06d1e0.el9.x86_ 5.9 MB/s | 2.1 MB 00:00 2024-09-19T06:29:15.019 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-09-19T06:29:15.019 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-09-19T06:29:15.084 INFO:teuthology.orchestra.run.smithi099.stdout:(4/34): ceph-mon-17.2.7-1637.g6e06d1e0.el9.x86_ 13 MB/s | 3.9 MB 00:00 2024-09-19T06:29:15.110 INFO:teuthology.orchestra.run.smithi099.stdout:(5/34): ceph-mgr-modules-core-17.2.7-1637.g6e06 2.3 MB/s | 240 kB 00:00 2024-09-19T06:29:15.293 INFO:teuthology.orchestra.run.smithi099.stdout:(6/34): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.2 MB/s | 253 kB 00:00 2024-09-19T06:29:15.422 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-09-19T06:29:15.422 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-09-19T06:29:15.452 INFO:teuthology.orchestra.run.smithi099.stdout:(7/34): ceph-osd-17.2.7-1637.g6e06d1e0.el9.x86_ 30 MB/s | 15 MB 00:00 2024-09-19T06:29:15.477 INFO:teuthology.orchestra.run.smithi099.stdout:(8/34): python3-ply-3.11-14.el9.noarch.rpm 581 kB/s | 106 kB 00:00 2024-09-19T06:29:15.527 INFO:teuthology.orchestra.run.smithi099.stdout:(9/34): python3-requests-2.25.1-8.el9.noarch.rp 2.4 MB/s | 125 kB 00:00 2024-09-19T06:29:15.569 INFO:teuthology.orchestra.run.smithi099.stdout:(10/34): python3-cryptography-36.0.1-4.el9.x86_ 2.7 MB/s | 1.2 MB 00:00 2024-09-19T06:29:15.620 INFO:teuthology.orchestra.run.smithi099.stdout:(11/34): python3-urllib3-1.26.5-6.el9.noarch.rp 2.3 MB/s | 215 kB 00:00 2024-09-19T06:29:15.653 INFO:teuthology.orchestra.run.smithi099.stdout:(12/34): python3-pycparser-2.20-6.el9.noarch.rp 673 kB/s | 135 kB 00:00 2024-09-19T06:29:16.655 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-09-19T06:29:16.714 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/34 2024-09-19T06:29:16.754 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/34 2024-09-19T06:29:16.788 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/34 2024-09-19T06:29:16.879 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/34 2024-09-19T06:29:16.950 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/34 2024-09-19T06:29:16.994 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 6/34 2024-09-19T06:29:17.037 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/34 2024-09-19T06:29:17.067 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/34 2024-09-19T06:29:17.101 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/34 2024-09-19T06:29:17.135 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/34 2024-09-19T06:29:17.167 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/34 2024-09-19T06:29:17.210 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/34 2024-09-19T06:29:17.245 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/34 2024-09-19T06:29:17.293 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/34 2024-09-19T06:29:17.333 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-packaging-20.9-5.el9.noarch 15/34 2024-09-19T06:29:17.407 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 16/34 2024-09-19T06:29:17.563 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 17/34 2024-09-19T06:29:17.641 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 18/34 2024-09-19T06:29:17.703 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 19/34 2024-09-19T06:29:17.741 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 20/34 2024-09-19T06:29:17.803 INFO:teuthology.orchestra.run.smithi099.stdout:(13/34): python3-markupsafe-1.1.1-12.el9.x86_64 16 kB/s | 35 kB 00:02 2024-09-19T06:29:17.807 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-ply-3.11-14.el9.noarch 21/34 2024-09-19T06:29:17.828 INFO:teuthology.orchestra.run.smithi099.stdout:(14/34): python3-packaging-20.9-5.el9.noarch.rp 35 kB/s | 77 kB 00:02 2024-09-19T06:29:17.863 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 22/34 2024-09-19T06:29:17.895 INFO:teuthology.orchestra.run.smithi099.stdout:(15/34): python3-mako-1.1.4-6.el9.noarch.rpm 74 kB/s | 172 kB 00:02 2024-09-19T06:29:17.937 INFO:teuthology.orchestra.run.smithi099.stdout:(16/34): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.0 MB/s | 43 kB 00:00 2024-09-19T06:29:17.962 INFO:teuthology.orchestra.run.smithi099.stdout:(17/34): python3-cheroot-8.6.0-4.el9.noarch.rpm 6.8 MB/s | 172 kB 00:00 2024-09-19T06:29:17.996 INFO:teuthology.orchestra.run.smithi099.stdout:(18/34): python3-cherrypy-18.6.1-2.el9.noarch.r 11 MB/s | 358 kB 00:00 2024-09-19T06:29:18.013 INFO:teuthology.orchestra.run.smithi099.stdout:(19/34): python3-jaraco-8.2.1-3.el9.noarch.rpm 643 kB/s | 11 kB 00:00 2024-09-19T06:29:18.030 INFO:teuthology.orchestra.run.smithi099.stdout:(20/34): python3-jaraco-classes-3.2.1-5.el9.noa 1.0 MB/s | 18 kB 00:00 2024-09-19T06:29:18.047 INFO:teuthology.orchestra.run.smithi099.stdout:(21/34): python3-jaraco-collections-3.0.0-8.el9 1.4 MB/s | 23 kB 00:00 2024-09-19T06:29:18.050 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 23/34 2024-09-19T06:29:18.080 INFO:teuthology.orchestra.run.smithi099.stdout:(22/34): python3-jaraco-functools-3.5.0-2.el9.n 584 kB/s | 19 kB 00:00 2024-09-19T06:29:18.104 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 24/34 2024-09-19T06:29:18.105 INFO:teuthology.orchestra.run.smithi099.stdout:(23/34): python3-jaraco-text-3.2.0-6.el9.noarch 787 kB/s | 20 kB 00:00 2024-09-19T06:29:18.139 INFO:teuthology.orchestra.run.smithi099.stdout:(24/34): python3-logutils-0.3.5-21.el9.noarch.r 1.4 MB/s | 46 kB 00:00 2024-09-19T06:29:18.173 INFO:teuthology.orchestra.run.smithi099.stdout:(25/34): python3-more-itertools-8.12.0-2.el9.no 2.3 MB/s | 79 kB 00:00 2024-09-19T06:29:18.183 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 25/34 2024-09-19T06:29:18.206 INFO:teuthology.orchestra.run.smithi099.stdout:(26/34): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-19T06:29:18.223 INFO:teuthology.orchestra.run.smithi099.stdout:(27/34): python3-portend-3.1.0-2.el9.noarch.rpm 984 kB/s | 16 kB 00:00 2024-09-19T06:29:18.257 INFO:teuthology.orchestra.run.smithi099.stdout:(28/34): python3-pyOpenSSL-21.0.0-1.el9.noarch. 2.6 MB/s | 90 kB 00:00 2024-09-19T06:29:18.273 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 26/34 2024-09-19T06:29:18.274 INFO:teuthology.orchestra.run.smithi099.stdout:(29/34): python3-tempora-5.0.0-2.el9.noarch.rpm 2.1 MB/s | 36 kB 00:00 2024-09-19T06:29:18.307 INFO:teuthology.orchestra.run.smithi099.stdout:(30/34): python3-webob-1.8.8-2.el9.noarch.rpm 6.8 MB/s | 230 kB 00:00 2024-09-19T06:29:18.314 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 27/34 2024-09-19T06:29:18.350 INFO:teuthology.orchestra.run.smithi099.stdout:(31/34): python3-werkzeug-2.0.3-3.el9.1.noarch. 10 MB/s | 427 kB 00:00 2024-09-19T06:29:18.366 INFO:teuthology.orchestra.run.smithi099.stdout:(32/34): python3-zc-lockfile-2.0-10.el9.noarch. 1.2 MB/s | 20 kB 00:00 2024-09-19T06:29:18.428 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 28/34 2024-09-19T06:29:18.581 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-1637.g6e06d1e0.el9. 29/34 2024-09-19T06:29:18.614 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-2:17.2.7-1637.g6e06d1e0.el9.x86_64 30/34 2024-09-19T06:29:18.640 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-2:17.2.7-1637.g6e06d1e0.el9.x86_64 30/34 2024-09-19T06:29:18.640 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:29:18.640 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T06:29:18.640 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T06:29:18.640 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T06:29:18.641 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:29:19.999 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-osd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 31/34 2024-09-19T06:29:20.029 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-osd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 31/34 2024-09-19T06:29:20.029 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:29:20.029 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T06:29:20.029 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T06:29:20.029 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T06:29:20.029 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:29:20.408 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mon-2:17.2.7-1637.g6e06d1e0.el9.x86_64 32/34 2024-09-19T06:29:20.433 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mon-2:17.2.7-1637.g6e06d1e0.el9.x86_64 32/34 2024-09-19T06:29:20.433 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:29:20.433 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T06:29:20.433 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T06:29:20.433 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T06:29:20.433 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:29:20.642 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mds-2:17.2.7-1637.g6e06d1e0.el9.x86_64 33/34 2024-09-19T06:29:20.667 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mds-2:17.2.7-1637.g6e06d1e0.el9.x86_64 33/34 2024-09-19T06:29:20.667 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:29:20.667 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T06:29:20.667 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T06:29:20.667 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T06:29:20.667 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:29:20.731 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-2:17.2.7-1637.g6e06d1e0.el9.x86_64 34/34 2024-09-19T06:29:22.417 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-2:17.2.7-1637.g6e06d1e0.el9.x86_64 34/34 2024-09-19T06:29:22.417 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/34 2024-09-19T06:29:22.417 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mds-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2/34 2024-09-19T06:29:22.417 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-2:17.2.7-1637.g6e06d1e0.el9.x86_64 3/34 2024-09-19T06:29:22.417 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mon-2:17.2.7-1637.g6e06d1e0.el9.x86_64 4/34 2024-09-19T06:29:22.417 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-osd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 5/34 2024-09-19T06:29:22.417 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-1637.g6e06d1e0.el9. 6/34 2024-09-19T06:29:22.417 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/34 2024-09-19T06:29:22.418 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/34 2024-09-19T06:29:22.418 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/34 2024-09-19T06:29:22.418 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/34 2024-09-19T06:29:22.418 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/34 2024-09-19T06:29:22.418 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/34 2024-09-19T06:29:22.418 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/34 2024-09-19T06:29:22.418 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/34 2024-09-19T06:29:22.418 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 15/34 2024-09-19T06:29:22.418 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/34 2024-09-19T06:29:22.418 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/34 2024-09-19T06:29:22.418 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 18/34 2024-09-19T06:29:22.418 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 19/34 2024-09-19T06:29:22.418 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 20/34 2024-09-19T06:29:22.419 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 21/34 2024-09-19T06:29:22.419 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 22/34 2024-09-19T06:29:22.419 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 23/34 2024-09-19T06:29:22.419 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 24/34 2024-09-19T06:29:22.419 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 25/34 2024-09-19T06:29:22.419 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 26/34 2024-09-19T06:29:22.419 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 27/34 2024-09-19T06:29:22.419 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 28/34 2024-09-19T06:29:22.419 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 29/34 2024-09-19T06:29:22.419 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 30/34 2024-09-19T06:29:22.419 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 31/34 2024-09-19T06:29:22.419 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 32/34 2024-09-19T06:29:22.419 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 33/34 2024-09-19T06:29:23.074 INFO:teuthology.orchestra.run.smithi099.stdout:(33/34): python3-pytz-2021.1-5.el9.noarch.rpm 9.7 kB/s | 51 kB 00:05 2024-09-19T06:29:23.090 INFO:teuthology.orchestra.run.smithi099.stdout:(34/34): python3-toml-0.10.2-6.el9.noarch.rpm 7.9 kB/s | 42 kB 00:05 2024-09-19T06:29:23.093 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-09-19T06:29:23.094 INFO:teuthology.orchestra.run.smithi099.stdout:Total 3.2 MB/s | 27 MB 00:08 2024-09-19T06:29:23.229 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-09-19T06:29:23.266 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-09-19T06:29:23.266 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-09-19T06:29:23.435 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 34/34 2024-09-19T06:29:23.435 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:29:23.435 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-09-19T06:29:23.435 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T06:29:23.435 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mds-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T06:29:23.435 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T06:29:23.436 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-modules-core-2:17.2.7-1637.g6e06d1e0.el9.noarch 2024-09-19T06:29:23.436 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mon-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T06:29:23.436 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-osd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T06:29:23.436 INFO:teuthology.orchestra.run.smithi117.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T06:29:23.436 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T06:29:23.436 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T06:29:23.436 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T06:29:23.436 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T06:29:23.436 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T06:29:23.436 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T06:29:23.436 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T06:29:23.436 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T06:29:23.436 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T06:29:23.437 INFO:teuthology.orchestra.run.smithi117.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T06:29:23.437 INFO:teuthology.orchestra.run.smithi117.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T06:29:23.437 INFO:teuthology.orchestra.run.smithi117.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T06:29:23.437 INFO:teuthology.orchestra.run.smithi117.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T06:29:23.437 INFO:teuthology.orchestra.run.smithi117.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T06:29:23.437 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T06:29:23.437 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T06:29:23.437 INFO:teuthology.orchestra.run.smithi117.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T06:29:23.437 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T06:29:23.437 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T06:29:23.437 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T06:29:23.437 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T06:29:23.437 INFO:teuthology.orchestra.run.smithi117.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T06:29:23.438 INFO:teuthology.orchestra.run.smithi117.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T06:29:23.438 INFO:teuthology.orchestra.run.smithi117.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T06:29:23.438 INFO:teuthology.orchestra.run.smithi117.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T06:29:23.438 INFO:teuthology.orchestra.run.smithi117.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T06:29:23.438 INFO:teuthology.orchestra.run.smithi117.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T06:29:23.438 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:29:23.438 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-09-19T06:29:23.651 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-09-19T06:29:23.651 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-09-19T06:29:23.789 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph-base 2024-09-19T06:29:24.382 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:00:49 ago on Thu 19 Sep 2024 06:28:35 AM UTC. 2024-09-19T06:29:24.471 INFO:teuthology.orchestra.run.smithi117.stdout:Package ceph-base-2:17.2.7-1637.g6e06d1e0.el9.x86_64 is already installed. 2024-09-19T06:29:24.513 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-09-19T06:29:24.514 INFO:teuthology.orchestra.run.smithi117.stdout:Nothing to do. 2024-09-19T06:29:24.514 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-09-19T06:29:24.573 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install cephadm 2024-09-19T06:29:24.906 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-09-19T06:29:24.968 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/34 2024-09-19T06:29:25.000 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/34 2024-09-19T06:29:25.033 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/34 2024-09-19T06:29:25.124 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/34 2024-09-19T06:29:25.147 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:00:50 ago on Thu 19 Sep 2024 06:28:35 AM UTC. 2024-09-19T06:29:25.194 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/34 2024-09-19T06:29:25.236 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 6/34 2024-09-19T06:29:25.276 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-09-19T06:29:25.276 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-19T06:29:25.276 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repository Size 2024-09-19T06:29:25.277 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-19T06:29:25.277 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-09-19T06:29:25.277 INFO:teuthology.orchestra.run.smithi117.stdout: cephadm noarch 2:17.2.7-1637.g6e06d1e0.el9 ceph-noarch 83 k 2024-09-19T06:29:25.277 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:29:25.277 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-09-19T06:29:25.277 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-19T06:29:25.277 INFO:teuthology.orchestra.run.smithi117.stdout:Install 1 Package 2024-09-19T06:29:25.277 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:29:25.277 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 83 k 2024-09-19T06:29:25.277 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 375 k 2024-09-19T06:29:25.277 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-09-19T06:29:25.279 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/34 2024-09-19T06:29:25.309 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/34 2024-09-19T06:29:25.343 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/34 2024-09-19T06:29:25.377 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/34 2024-09-19T06:29:25.418 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/34 2024-09-19T06:29:25.453 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/34 2024-09-19T06:29:25.475 INFO:teuthology.orchestra.run.smithi117.stdout:cephadm-17.2.7-1637.g6e06d1e0.el9.noarch.rpm 418 kB/s | 83 kB 00:00 2024-09-19T06:29:25.477 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-09-19T06:29:25.477 INFO:teuthology.orchestra.run.smithi117.stdout:Total 414 kB/s | 83 kB 00:00 2024-09-19T06:29:25.477 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-09-19T06:29:25.478 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/34 2024-09-19T06:29:25.481 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-09-19T06:29:25.482 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-09-19T06:29:25.483 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-09-19T06:29:25.484 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-09-19T06:29:25.527 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/34 2024-09-19T06:29:25.558 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-09-19T06:29:25.567 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-packaging-20.9-5.el9.noarch 15/34 2024-09-19T06:29:25.643 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 16/34 2024-09-19T06:29:25.807 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 17/34 2024-09-19T06:29:25.894 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 18/34 2024-09-19T06:29:25.948 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 19/34 2024-09-19T06:29:25.995 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 20/34 2024-09-19T06:29:26.041 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: cephadm-2:17.2.7-1637.g6e06d1e0.el9.noarch 1/1 2024-09-19T06:29:26.043 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-ply-3.11-14.el9.noarch 21/34 2024-09-19T06:29:26.098 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 22/34 2024-09-19T06:29:26.137 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : cephadm-2:17.2.7-1637.g6e06d1e0.el9.noarch 1/1 2024-09-19T06:29:26.282 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 23/34 2024-09-19T06:29:26.332 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 24/34 2024-09-19T06:29:26.409 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 25/34 2024-09-19T06:29:26.486 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: cephadm-2:17.2.7-1637.g6e06d1e0.el9.noarch 1/1 2024-09-19T06:29:26.506 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 26/34 2024-09-19T06:29:26.556 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 27/34 2024-09-19T06:29:26.671 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 28/34 2024-09-19T06:29:26.755 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : cephadm-2:17.2.7-1637.g6e06d1e0.el9.noarch 1/1 2024-09-19T06:29:26.756 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:29:26.756 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-09-19T06:29:26.756 INFO:teuthology.orchestra.run.smithi117.stdout: cephadm-2:17.2.7-1637.g6e06d1e0.el9.noarch 2024-09-19T06:29:26.756 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:29:26.756 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-09-19T06:29:26.819 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-1637.g6e06d1e0.el9. 29/34 2024-09-19T06:29:26.850 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-2:17.2.7-1637.g6e06d1e0.el9.x86_64 30/34 2024-09-19T06:29:26.875 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-2:17.2.7-1637.g6e06d1e0.el9.x86_64 30/34 2024-09-19T06:29:26.876 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:29:26.876 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T06:29:26.876 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T06:29:26.876 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T06:29:26.876 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:29:26.953 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph-immutable-object-cache 2024-09-19T06:29:27.534 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:00:52 ago on Thu 19 Sep 2024 06:28:35 AM UTC. 2024-09-19T06:29:27.665 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-09-19T06:29:27.666 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-19T06:29:27.666 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repo Size 2024-09-19T06:29:27.666 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-19T06:29:27.666 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-09-19T06:29:27.666 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 137 k 2024-09-19T06:29:27.666 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:29:27.666 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-09-19T06:29:27.667 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-19T06:29:27.667 INFO:teuthology.orchestra.run.smithi117.stdout:Install 1 Package 2024-09-19T06:29:27.667 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:29:27.667 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 137 k 2024-09-19T06:29:27.667 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 379 k 2024-09-19T06:29:27.667 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-09-19T06:29:27.881 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-immutable-object-cache-17.2.7-1637.g6e06d1 641 kB/s | 137 kB 00:00 2024-09-19T06:29:27.882 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-09-19T06:29:27.882 INFO:teuthology.orchestra.run.smithi117.stdout:Total 637 kB/s | 137 kB 00:00 2024-09-19T06:29:27.882 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-09-19T06:29:27.889 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-09-19T06:29:27.889 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-09-19T06:29:27.946 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-09-19T06:29:27.946 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-09-19T06:29:28.097 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-09-19T06:29:28.184 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-osd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 31/34 2024-09-19T06:29:28.191 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-1637.g6e06d1e0. 1/1 2024-09-19T06:29:28.213 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-osd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 31/34 2024-09-19T06:29:28.213 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:29:28.213 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T06:29:28.213 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T06:29:28.213 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T06:29:28.213 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:29:28.215 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-1637.g6e06d1e0. 1/1 2024-09-19T06:29:28.215 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:29:28.215 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T06:29:28.215 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:29:28.602 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mon-2:17.2.7-1637.g6e06d1e0.el9.x86_64 32/34 2024-09-19T06:29:28.629 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mon-2:17.2.7-1637.g6e06d1e0.el9.x86_64 32/34 2024-09-19T06:29:28.629 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:29:28.629 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T06:29:28.629 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T06:29:28.629 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T06:29:28.630 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:29:28.844 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mds-2:17.2.7-1637.g6e06d1e0.el9.x86_64 33/34 2024-09-19T06:29:28.869 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mds-2:17.2.7-1637.g6e06d1e0.el9.x86_64 33/34 2024-09-19T06:29:28.869 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:29:28.869 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T06:29:28.869 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T06:29:28.869 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T06:29:28.869 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:29:28.926 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-2:17.2.7-1637.g6e06d1e0.el9.x86_64 34/34 2024-09-19T06:29:29.123 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-1637.g6e06d1e0. 1/1 2024-09-19T06:29:29.123 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:29:29.123 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-09-19T06:29:29.123 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-immutable-object-cache-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T06:29:29.123 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:29:29.123 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-09-19T06:29:29.319 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph-mgr 2024-09-19T06:29:29.918 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:00:54 ago on Thu 19 Sep 2024 06:28:35 AM UTC. 2024-09-19T06:29:30.006 INFO:teuthology.orchestra.run.smithi117.stdout:Package ceph-mgr-2:17.2.7-1637.g6e06d1e0.el9.x86_64 is already installed. 2024-09-19T06:29:30.047 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-09-19T06:29:30.048 INFO:teuthology.orchestra.run.smithi117.stdout:Nothing to do. 2024-09-19T06:29:30.048 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-09-19T06:29:30.112 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph-mgr-dashboard 2024-09-19T06:29:30.536 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-2:17.2.7-1637.g6e06d1e0.el9.x86_64 34/34 2024-09-19T06:29:30.536 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/34 2024-09-19T06:29:30.536 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mds-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2/34 2024-09-19T06:29:30.537 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-2:17.2.7-1637.g6e06d1e0.el9.x86_64 3/34 2024-09-19T06:29:30.537 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mon-2:17.2.7-1637.g6e06d1e0.el9.x86_64 4/34 2024-09-19T06:29:30.537 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-osd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 5/34 2024-09-19T06:29:30.537 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-1637.g6e06d1e0.el9. 6/34 2024-09-19T06:29:30.537 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/34 2024-09-19T06:29:30.537 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/34 2024-09-19T06:29:30.537 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/34 2024-09-19T06:29:30.537 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/34 2024-09-19T06:29:30.537 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/34 2024-09-19T06:29:30.537 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/34 2024-09-19T06:29:30.537 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/34 2024-09-19T06:29:30.537 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/34 2024-09-19T06:29:30.538 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 15/34 2024-09-19T06:29:30.538 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/34 2024-09-19T06:29:30.538 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/34 2024-09-19T06:29:30.538 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 18/34 2024-09-19T06:29:30.538 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 19/34 2024-09-19T06:29:30.538 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 20/34 2024-09-19T06:29:30.538 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 21/34 2024-09-19T06:29:30.538 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 22/34 2024-09-19T06:29:30.538 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 23/34 2024-09-19T06:29:30.538 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 24/34 2024-09-19T06:29:30.538 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 25/34 2024-09-19T06:29:30.538 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 26/34 2024-09-19T06:29:30.538 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 27/34 2024-09-19T06:29:30.539 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 28/34 2024-09-19T06:29:30.539 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 29/34 2024-09-19T06:29:30.539 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 30/34 2024-09-19T06:29:30.540 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 31/34 2024-09-19T06:29:30.540 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 32/34 2024-09-19T06:29:30.540 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 33/34 2024-09-19T06:29:30.689 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:00:55 ago on Thu 19 Sep 2024 06:28:35 AM UTC. 2024-09-19T06:29:30.819 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-09-19T06:29:30.820 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-19T06:29:30.820 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repository Size 2024-09-19T06:29:30.820 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-19T06:29:30.820 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-09-19T06:29:30.820 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-dashboard noarch 2:17.2.7-1637.g6e06d1e0.el9 ceph-noarch 3.4 M 2024-09-19T06:29:30.820 INFO:teuthology.orchestra.run.smithi117.stdout:Installing dependencies: 2024-09-19T06:29:30.820 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-grafana-dashboards noarch 2:17.2.7-1637.g6e06d1e0.el9 ceph-noarch 24 k 2024-09-19T06:29:30.820 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-prometheus-alerts noarch 2:17.2.7-1637.g6e06d1e0.el9 ceph-noarch 15 k 2024-09-19T06:29:30.820 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-09-19T06:29:30.820 INFO:teuthology.orchestra.run.smithi117.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T06:29:30.821 INFO:teuthology.orchestra.run.smithi117.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T06:29:30.821 INFO:teuthology.orchestra.run.smithi117.stdout:Installing weak dependencies: 2024-09-19T06:29:30.821 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-09-19T06:29:30.821 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:29:30.821 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-09-19T06:29:30.821 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-19T06:29:30.821 INFO:teuthology.orchestra.run.smithi117.stdout:Install 7 Packages 2024-09-19T06:29:30.821 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:29:30.822 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 3.7 M 2024-09-19T06:29:30.822 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 80 M 2024-09-19T06:29:30.822 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-09-19T06:29:31.010 INFO:teuthology.orchestra.run.smithi117.stdout:(1/7): ceph-prometheus-alerts-17.2.7-1637.g6e06 93 kB/s | 15 kB 00:00 2024-09-19T06:29:31.026 INFO:teuthology.orchestra.run.smithi117.stdout:(2/7): ceph-grafana-dashboards-17.2.7-1637.g6e0 140 kB/s | 24 kB 00:00 2024-09-19T06:29:31.060 INFO:teuthology.orchestra.run.smithi117.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 180 kB/s | 9.0 kB 00:00 2024-09-19T06:29:31.085 INFO:teuthology.orchestra.run.smithi117.stdout:(4/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 1.3 MB/s | 31 kB 00:00 2024-09-19T06:29:31.111 INFO:teuthology.orchestra.run.smithi117.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 487 kB/s | 41 kB 00:00 2024-09-19T06:29:31.136 INFO:teuthology.orchestra.run.smithi117.stdout:(6/7): python3-routes-2.5.1-5.el9.noarch.rpm 3.7 MB/s | 188 kB 00:00 2024-09-19T06:29:31.245 INFO:teuthology.orchestra.run.smithi117.stdout:(7/7): ceph-mgr-dashboard-17.2.7-1637.g6e06d1e0 8.6 MB/s | 3.4 MB 00:00 2024-09-19T06:29:31.248 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-09-19T06:29:31.249 INFO:teuthology.orchestra.run.smithi117.stdout:Total 8.5 MB/s | 3.7 MB 00:00 2024-09-19T06:29:31.249 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-09-19T06:29:31.257 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-09-19T06:29:31.257 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-09-19T06:29:31.346 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-09-19T06:29:31.346 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-09-19T06:29:31.471 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 34/34 2024-09-19T06:29:31.471 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:29:31.471 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-09-19T06:29:31.471 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T06:29:31.471 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mds-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T06:29:31.471 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T06:29:31.471 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-modules-core-2:17.2.7-1637.g6e06d1e0.el9.noarch 2024-09-19T06:29:31.472 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mon-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T06:29:31.472 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-osd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T06:29:31.472 INFO:teuthology.orchestra.run.smithi099.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T06:29:31.472 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T06:29:31.472 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T06:29:31.472 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T06:29:31.472 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T06:29:31.472 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T06:29:31.472 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T06:29:31.472 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T06:29:31.472 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T06:29:31.472 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T06:29:31.472 INFO:teuthology.orchestra.run.smithi099.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T06:29:31.473 INFO:teuthology.orchestra.run.smithi099.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T06:29:31.473 INFO:teuthology.orchestra.run.smithi099.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T06:29:31.473 INFO:teuthology.orchestra.run.smithi099.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T06:29:31.473 INFO:teuthology.orchestra.run.smithi099.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T06:29:31.473 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T06:29:31.473 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T06:29:31.473 INFO:teuthology.orchestra.run.smithi099.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T06:29:31.473 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T06:29:31.473 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T06:29:31.473 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T06:29:31.473 INFO:teuthology.orchestra.run.smithi099.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T06:29:31.473 INFO:teuthology.orchestra.run.smithi099.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T06:29:31.473 INFO:teuthology.orchestra.run.smithi099.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T06:29:31.474 INFO:teuthology.orchestra.run.smithi099.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T06:29:31.474 INFO:teuthology.orchestra.run.smithi099.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T06:29:31.474 INFO:teuthology.orchestra.run.smithi099.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T06:29:31.474 INFO:teuthology.orchestra.run.smithi099.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T06:29:31.474 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:29:31.474 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-19T06:29:31.654 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-09-19T06:29:31.712 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-09-19T06:29:31.746 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-09-19T06:29:31.792 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-09-19T06:29:31.825 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install ceph-base 2024-09-19T06:29:31.825 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-09-19T06:29:31.854 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-1637.g6e06d1e0.el9.n 5/7 2024-09-19T06:29:32.404 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:00:55 ago on Thu 19 Sep 2024 06:28:37 AM UTC. 2024-09-19T06:29:32.492 INFO:teuthology.orchestra.run.smithi099.stdout:Package ceph-base-2:17.2.7-1637.g6e06d1e0.el9.x86_64 is already installed. 2024-09-19T06:29:32.533 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-19T06:29:32.534 INFO:teuthology.orchestra.run.smithi099.stdout:Nothing to do. 2024-09-19T06:29:32.534 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-19T06:29:32.588 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install cephadm 2024-09-19T06:29:32.847 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-1637.g6e06d1e0.el9. 6/7 2024-09-19T06:29:32.882 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-1637.g6e06d1e0.el9.noarc 7/7 2024-09-19T06:29:33.164 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:00:56 ago on Thu 19 Sep 2024 06:28:37 AM UTC. 2024-09-19T06:29:33.293 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-19T06:29:33.294 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-19T06:29:33.294 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repository Size 2024-09-19T06:29:33.294 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-19T06:29:33.294 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-09-19T06:29:33.294 INFO:teuthology.orchestra.run.smithi099.stdout: cephadm noarch 2:17.2.7-1637.g6e06d1e0.el9 ceph-noarch 83 k 2024-09-19T06:29:33.294 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:29:33.295 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-09-19T06:29:33.295 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-19T06:29:33.295 INFO:teuthology.orchestra.run.smithi099.stdout:Install 1 Package 2024-09-19T06:29:33.295 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:29:33.295 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 83 k 2024-09-19T06:29:33.295 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 375 k 2024-09-19T06:29:33.295 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-09-19T06:29:33.483 INFO:teuthology.orchestra.run.smithi099.stdout:cephadm-17.2.7-1637.g6e06d1e0.el9.noarch.rpm 439 kB/s | 83 kB 00:00 2024-09-19T06:29:33.484 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-09-19T06:29:33.484 INFO:teuthology.orchestra.run.smithi099.stdout:Total 435 kB/s | 83 kB 00:00 2024-09-19T06:29:33.484 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-09-19T06:29:33.489 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-09-19T06:29:33.489 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-09-19T06:29:33.491 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-09-19T06:29:33.492 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-09-19T06:29:33.565 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-09-19T06:29:33.924 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-1637.g6e06d1e0.el9.noarc 7/7 2024-09-19T06:29:33.924 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-1637.g6e06d1e0.el9. 1/7 2024-09-19T06:29:33.924 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-1637.g6e06d1e0.el9.noarc 2/7 2024-09-19T06:29:33.924 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-1637.g6e06d1e0.el9.n 3/7 2024-09-19T06:29:33.924 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-09-19T06:29:33.924 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-09-19T06:29:33.924 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-09-19T06:29:33.924 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: cephadm-2:17.2.7-1637.g6e06d1e0.el9.noarch 1/1 2024-09-19T06:29:33.995 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : cephadm-2:17.2.7-1637.g6e06d1e0.el9.noarch 1/1 2024-09-19T06:29:34.204 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-09-19T06:29:34.204 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:29:34.204 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-09-19T06:29:34.204 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-grafana-dashboards-2:17.2.7-1637.g6e06d1e0.el9.noarch 2024-09-19T06:29:34.204 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-dashboard-2:17.2.7-1637.g6e06d1e0.el9.noarch 2024-09-19T06:29:34.205 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-prometheus-alerts-2:17.2.7-1637.g6e06d1e0.el9.noarch 2024-09-19T06:29:34.205 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-09-19T06:29:34.205 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-09-19T06:29:34.205 INFO:teuthology.orchestra.run.smithi117.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T06:29:34.205 INFO:teuthology.orchestra.run.smithi117.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T06:29:34.205 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:29:34.205 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-09-19T06:29:34.371 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: cephadm-2:17.2.7-1637.g6e06d1e0.el9.noarch 1/1 2024-09-19T06:29:34.406 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-19T06:29:34.615 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : cephadm-2:17.2.7-1637.g6e06d1e0.el9.noarch 1/1 2024-09-19T06:29:34.615 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:29:34.615 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-09-19T06:29:34.615 INFO:teuthology.orchestra.run.smithi099.stdout: cephadm-2:17.2.7-1637.g6e06d1e0.el9.noarch 2024-09-19T06:29:34.615 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:29:34.615 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-19T06:29:34.828 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install ceph-immutable-object-cache 2024-09-19T06:29:34.975 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:00:59 ago on Thu 19 Sep 2024 06:28:35 AM UTC. 2024-09-19T06:29:35.109 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-09-19T06:29:35.109 INFO:teuthology.orchestra.run.smithi117.stdout:======================================================================================= 2024-09-19T06:29:35.110 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repository Size 2024-09-19T06:29:35.110 INFO:teuthology.orchestra.run.smithi117.stdout:======================================================================================= 2024-09-19T06:29:35.110 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-09-19T06:29:35.110 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-1637.g6e06d1e0.el9 ceph-noarch 7.4 M 2024-09-19T06:29:35.110 INFO:teuthology.orchestra.run.smithi117.stdout:Installing dependencies: 2024-09-19T06:29:35.110 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T06:29:35.110 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T06:29:35.110 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T06:29:35.110 INFO:teuthology.orchestra.run.smithi117.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T06:29:35.110 INFO:teuthology.orchestra.run.smithi117.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T06:29:35.110 INFO:teuthology.orchestra.run.smithi117.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T06:29:35.110 INFO:teuthology.orchestra.run.smithi117.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T06:29:35.110 INFO:teuthology.orchestra.run.smithi117.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T06:29:35.111 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T06:29:35.111 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T06:29:35.111 INFO:teuthology.orchestra.run.smithi117.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T06:29:35.111 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:29:35.111 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-09-19T06:29:35.111 INFO:teuthology.orchestra.run.smithi117.stdout:======================================================================================= 2024-09-19T06:29:35.111 INFO:teuthology.orchestra.run.smithi117.stdout:Install 12 Packages 2024-09-19T06:29:35.111 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:29:35.112 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 38 M 2024-09-19T06:29:35.112 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 212 M 2024-09-19T06:29:35.112 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-09-19T06:29:35.416 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:00:58 ago on Thu 19 Sep 2024 06:28:37 AM UTC. 2024-09-19T06:29:35.549 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-19T06:29:35.550 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-19T06:29:35.550 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repo Size 2024-09-19T06:29:35.550 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-19T06:29:35.550 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-09-19T06:29:35.550 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 137 k 2024-09-19T06:29:35.550 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:29:35.550 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-09-19T06:29:35.551 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-19T06:29:35.551 INFO:teuthology.orchestra.run.smithi099.stdout:Install 1 Package 2024-09-19T06:29:35.551 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:29:35.551 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 137 k 2024-09-19T06:29:35.551 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 379 k 2024-09-19T06:29:35.551 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-09-19T06:29:35.644 INFO:teuthology.orchestra.run.smithi117.stdout:(1/12): ceph-mgr-diskprediction-local-17.2.7-16 17 MB/s | 7.4 MB 00:00 2024-09-19T06:29:35.752 INFO:teuthology.orchestra.run.smithi117.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 302 kB/s | 33 kB 00:00 2024-09-19T06:29:35.757 INFO:teuthology.orchestra.run.smithi099.stdout:ceph-immutable-object-cache-17.2.7-1637.g6e06d1 667 kB/s | 137 kB 00:00 2024-09-19T06:29:35.758 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-09-19T06:29:35.758 INFO:teuthology.orchestra.run.smithi099.stdout:Total 661 kB/s | 137 kB 00:00 2024-09-19T06:29:35.758 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-09-19T06:29:35.765 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-09-19T06:29:35.766 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-09-19T06:29:35.822 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-09-19T06:29:35.822 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-09-19T06:29:35.968 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-09-19T06:29:36.020 INFO:teuthology.orchestra.run.smithi117.stdout:(3/12): libquadmath-11.5.0-2.el9.x86_64.rpm 235 kB/s | 191 kB 00:00 2024-09-19T06:29:36.042 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-1637.g6e06d1e0. 1/1 2024-09-19T06:29:36.066 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-1637.g6e06d1e0. 1/1 2024-09-19T06:29:36.066 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:29:36.066 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T06:29:36.066 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:29:36.161 INFO:teuthology.orchestra.run.smithi117.stdout:(4/12): libgfortran-11.5.0-2.el9.x86_64.rpm 838 kB/s | 801 kB 00:00 2024-09-19T06:29:36.420 INFO:teuthology.orchestra.run.smithi117.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 45 kB/s | 18 kB 00:00 2024-09-19T06:29:36.653 INFO:teuthology.orchestra.run.smithi117.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 78 kB/s | 38 kB 00:00 2024-09-19T06:29:36.762 INFO:teuthology.orchestra.run.smithi117.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 2.2 MB/s | 245 kB 00:00 2024-09-19T06:29:36.975 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-1637.g6e06d1e0. 1/1 2024-09-19T06:29:36.976 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:29:36.976 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-09-19T06:29:36.976 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-immutable-object-cache-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T06:29:36.976 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:29:36.976 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-19T06:29:37.190 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install ceph-mgr 2024-09-19T06:29:37.777 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:01:00 ago on Thu 19 Sep 2024 06:28:37 AM UTC. 2024-09-19T06:29:37.867 INFO:teuthology.orchestra.run.smithi099.stdout:Package ceph-mgr-2:17.2.7-1637.g6e06d1e0.el9.x86_64 is already installed. 2024-09-19T06:29:37.908 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-19T06:29:37.908 INFO:teuthology.orchestra.run.smithi099.stdout:Nothing to do. 2024-09-19T06:29:37.909 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-19T06:29:37.972 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install ceph-mgr-dashboard 2024-09-19T06:29:38.479 INFO:teuthology.orchestra.run.smithi117.stdout:(8/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 2.4 MB/s | 4.9 MB 00:02 2024-09-19T06:29:38.546 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:01:01 ago on Thu 19 Sep 2024 06:28:37 AM UTC. 2024-09-19T06:29:38.570 INFO:teuthology.orchestra.run.smithi117.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.7 MB/s | 250 kB 00:00 2024-09-19T06:29:38.677 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-19T06:29:38.677 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-19T06:29:38.677 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repository Size 2024-09-19T06:29:38.677 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-19T06:29:38.678 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-09-19T06:29:38.678 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-dashboard noarch 2:17.2.7-1637.g6e06d1e0.el9 ceph-noarch 3.4 M 2024-09-19T06:29:38.678 INFO:teuthology.orchestra.run.smithi099.stdout:Installing dependencies: 2024-09-19T06:29:38.678 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-grafana-dashboards noarch 2:17.2.7-1637.g6e06d1e0.el9 ceph-noarch 24 k 2024-09-19T06:29:38.678 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-prometheus-alerts noarch 2:17.2.7-1637.g6e06d1e0.el9 ceph-noarch 15 k 2024-09-19T06:29:38.678 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-09-19T06:29:38.678 INFO:teuthology.orchestra.run.smithi099.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T06:29:38.678 INFO:teuthology.orchestra.run.smithi099.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T06:29:38.678 INFO:teuthology.orchestra.run.smithi099.stdout:Installing weak dependencies: 2024-09-19T06:29:38.678 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-09-19T06:29:38.678 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:29:38.678 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-09-19T06:29:38.679 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-19T06:29:38.679 INFO:teuthology.orchestra.run.smithi099.stdout:Install 7 Packages 2024-09-19T06:29:38.679 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:29:38.679 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 3.7 M 2024-09-19T06:29:38.679 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 80 M 2024-09-19T06:29:38.679 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-09-19T06:29:38.977 INFO:teuthology.orchestra.run.smithi099.stdout:(1/7): ceph-grafana-dashboards-17.2.7-1637.g6e0 164 kB/s | 24 kB 00:00 2024-09-19T06:29:39.002 INFO:teuthology.orchestra.run.smithi099.stdout:(2/7): ceph-prometheus-alerts-17.2.7-1637.g6e06 84 kB/s | 15 kB 00:00 2024-09-19T06:29:39.044 INFO:teuthology.orchestra.run.smithi099.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 135 kB/s | 9.0 kB 00:00 2024-09-19T06:29:39.069 INFO:teuthology.orchestra.run.smithi099.stdout:(4/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 1.3 MB/s | 31 kB 00:00 2024-09-19T06:29:39.094 INFO:teuthology.orchestra.run.smithi099.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 444 kB/s | 41 kB 00:00 2024-09-19T06:29:39.128 INFO:teuthology.orchestra.run.smithi099.stdout:(6/7): python3-routes-2.5.1-5.el9.noarch.rpm 3.1 MB/s | 188 kB 00:00 2024-09-19T06:29:39.229 INFO:teuthology.orchestra.run.smithi099.stdout:(7/7): ceph-mgr-dashboard-17.2.7-1637.g6e06d1e0 8.4 MB/s | 3.4 MB 00:00 2024-09-19T06:29:39.232 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-09-19T06:29:39.232 INFO:teuthology.orchestra.run.smithi099.stdout:Total 6.6 MB/s | 3.7 MB 00:00 2024-09-19T06:29:39.232 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-09-19T06:29:39.241 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-09-19T06:29:39.241 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-09-19T06:29:39.331 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-09-19T06:29:39.332 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-09-19T06:29:39.644 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-09-19T06:29:39.696 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-09-19T06:29:39.730 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-09-19T06:29:39.777 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-09-19T06:29:39.817 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-09-19T06:29:39.854 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-1637.g6e06d1e0.el9.n 5/7 2024-09-19T06:29:40.546 INFO:teuthology.orchestra.run.smithi117.stdout:(10/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 8.2 MB/s | 16 MB 00:01 2024-09-19T06:29:40.621 INFO:teuthology.orchestra.run.smithi117.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 1.3 MB/s | 5.1 MB 00:03 2024-09-19T06:29:40.848 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-1637.g6e06d1e0.el9. 6/7 2024-09-19T06:29:40.891 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-1637.g6e06d1e0.el9.noarc 7/7 2024-09-19T06:29:41.054 INFO:teuthology.orchestra.run.smithi117.stdout:(12/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rp 577 kB/s | 3.0 MB 00:05 2024-09-19T06:29:41.055 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-09-19T06:29:41.055 INFO:teuthology.orchestra.run.smithi117.stdout:Total 6.4 MB/s | 38 MB 00:05 2024-09-19T06:29:41.415 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-09-19T06:29:41.442 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-09-19T06:29:41.442 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-09-19T06:29:41.903 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-1637.g6e06d1e0.el9.noarc 7/7 2024-09-19T06:29:41.903 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-1637.g6e06d1e0.el9. 1/7 2024-09-19T06:29:41.903 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-1637.g6e06d1e0.el9.noarc 2/7 2024-09-19T06:29:41.903 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-1637.g6e06d1e0.el9.n 3/7 2024-09-19T06:29:41.904 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-09-19T06:29:41.904 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-09-19T06:29:41.904 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-09-19T06:29:41.969 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-09-19T06:29:41.969 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-09-19T06:29:42.163 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-09-19T06:29:42.163 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:29:42.163 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-09-19T06:29:42.163 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-grafana-dashboards-2:17.2.7-1637.g6e06d1e0.el9.noarch 2024-09-19T06:29:42.163 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-dashboard-2:17.2.7-1637.g6e06d1e0.el9.noarch 2024-09-19T06:29:42.163 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-prometheus-alerts-2:17.2.7-1637.g6e06d1e0.el9.noarch 2024-09-19T06:29:42.163 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-09-19T06:29:42.163 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-09-19T06:29:42.163 INFO:teuthology.orchestra.run.smithi099.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T06:29:42.164 INFO:teuthology.orchestra.run.smithi099.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T06:29:42.164 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:29:42.164 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-19T06:29:42.358 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-19T06:29:42.726 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-09-19T06:29:42.795 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-19T06:29:42.839 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-19T06:29:42.933 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-19T06:29:42.934 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:01:05 ago on Thu 19 Sep 2024 06:28:37 AM UTC. 2024-09-19T06:29:42.978 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-19T06:29:43.068 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-19T06:29:43.069 INFO:teuthology.orchestra.run.smithi099.stdout:======================================================================================= 2024-09-19T06:29:43.069 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repository Size 2024-09-19T06:29:43.070 INFO:teuthology.orchestra.run.smithi099.stdout:======================================================================================= 2024-09-19T06:29:43.070 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-09-19T06:29:43.070 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-1637.g6e06d1e0.el9 ceph-noarch 7.4 M 2024-09-19T06:29:43.070 INFO:teuthology.orchestra.run.smithi099.stdout:Installing dependencies: 2024-09-19T06:29:43.070 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T06:29:43.070 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T06:29:43.070 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T06:29:43.070 INFO:teuthology.orchestra.run.smithi099.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T06:29:43.070 INFO:teuthology.orchestra.run.smithi099.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T06:29:43.070 INFO:teuthology.orchestra.run.smithi099.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T06:29:43.070 INFO:teuthology.orchestra.run.smithi099.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T06:29:43.070 INFO:teuthology.orchestra.run.smithi099.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T06:29:43.070 INFO:teuthology.orchestra.run.smithi099.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T06:29:43.071 INFO:teuthology.orchestra.run.smithi099.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T06:29:43.071 INFO:teuthology.orchestra.run.smithi099.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T06:29:43.071 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:29:43.071 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-09-19T06:29:43.071 INFO:teuthology.orchestra.run.smithi099.stdout:======================================================================================= 2024-09-19T06:29:43.071 INFO:teuthology.orchestra.run.smithi099.stdout:Install 12 Packages 2024-09-19T06:29:43.071 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:29:43.072 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 38 M 2024-09-19T06:29:43.072 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 212 M 2024-09-19T06:29:43.072 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-09-19T06:29:43.162 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-19T06:29:43.196 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-19T06:29:43.271 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-19T06:29:43.427 INFO:teuthology.orchestra.run.smithi099.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.0 MB/s | 191 kB 00:00 2024-09-19T06:29:43.527 INFO:teuthology.orchestra.run.smithi099.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 327 kB/s | 33 kB 00:00 2024-09-19T06:29:43.561 INFO:teuthology.orchestra.run.smithi099.stdout:(3/12): libgfortran-11.5.0-2.el9.x86_64.rpm 2.5 MB/s | 801 kB 00:00 2024-09-19T06:29:43.720 INFO:teuthology.orchestra.run.smithi099.stdout:(4/12): ceph-mgr-diskprediction-local-17.2.7-16 16 MB/s | 7.4 MB 00:00 2024-09-19T06:29:43.736 INFO:teuthology.orchestra.run.smithi099.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 104 kB/s | 18 kB 00:00 2024-09-19T06:29:43.787 INFO:teuthology.orchestra.run.smithi099.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 12 MB/s | 3.0 MB 00:00 2024-09-19T06:29:43.804 INFO:teuthology.orchestra.run.smithi099.stdout:(7/12): openblas-0.3.26-2.el9.x86_64.rpm 460 kB/s | 38 kB 00:00 2024-09-19T06:29:43.862 INFO:teuthology.orchestra.run.smithi099.stdout:(8/12): python3-devel-3.9.19-8.el9.x86_64.rpm 3.2 MB/s | 245 kB 00:00 2024-09-19T06:29:43.943 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-19T06:29:43.954 INFO:teuthology.orchestra.run.smithi099.stdout:(9/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 23 MB/s | 4.9 MB 00:00 2024-09-19T06:29:43.979 INFO:teuthology.orchestra.run.smithi099.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 2.1 MB/s | 250 kB 00:00 2024-09-19T06:29:44.055 INFO:teuthology.orchestra.run.smithi099.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 20 MB/s | 5.1 MB 00:00 2024-09-19T06:29:44.055 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-19T06:29:44.321 INFO:teuthology.orchestra.run.smithi099.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 44 MB/s | 16 MB 00:00 2024-09-19T06:29:44.322 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-09-19T06:29:44.323 INFO:teuthology.orchestra.run.smithi099.stdout:Total 31 MB/s | 38 MB 00:01 2024-09-19T06:29:44.677 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-09-19T06:29:44.703 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-09-19T06:29:44.704 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-09-19T06:29:45.212 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-09-19T06:29:45.212 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-09-19T06:29:45.284 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-19T06:29:45.969 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-09-19T06:29:46.035 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-19T06:29:46.083 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-19T06:29:46.177 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-19T06:29:46.221 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-19T06:29:46.323 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-19T06:29:46.351 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-1637.g6e06d 12/12 2024-09-19T06:29:46.406 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-19T06:29:46.444 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-19T06:29:46.530 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-19T06:29:47.171 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-19T06:29:47.282 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-19T06:29:48.505 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-19T06:29:48.814 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-1637.g6e06d 12/12 2024-09-19T06:29:48.814 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-1637.g6e06d 1/12 2024-09-19T06:29:48.814 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-19T06:29:48.814 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-19T06:29:48.814 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-19T06:29:48.814 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-19T06:29:48.814 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-19T06:29:48.814 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-19T06:29:48.814 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-19T06:29:48.815 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-19T06:29:48.815 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-19T06:29:48.815 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-19T06:29:49.205 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-19T06:29:49.205 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:29:49.205 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-09-19T06:29:49.205 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-diskprediction-local-2:17.2.7-1637.g6e06d1e0.el9.noarch 2024-09-19T06:29:49.205 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T06:29:49.205 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T06:29:49.205 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T06:29:49.205 INFO:teuthology.orchestra.run.smithi117.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T06:29:49.205 INFO:teuthology.orchestra.run.smithi117.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T06:29:49.205 INFO:teuthology.orchestra.run.smithi117.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T06:29:49.205 INFO:teuthology.orchestra.run.smithi117.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T06:29:49.206 INFO:teuthology.orchestra.run.smithi117.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T06:29:49.206 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T06:29:49.206 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T06:29:49.206 INFO:teuthology.orchestra.run.smithi117.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T06:29:49.206 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:29:49.206 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-09-19T06:29:49.536 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-19T06:29:49.570 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph-mgr-rook 2024-09-19T06:29:49.576 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-1637.g6e06d 12/12 2024-09-19T06:29:50.165 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:01:15 ago on Thu 19 Sep 2024 06:28:35 AM UTC. 2024-09-19T06:29:50.302 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-09-19T06:29:50.303 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-19T06:29:50.303 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repository Size 2024-09-19T06:29:50.303 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-19T06:29:50.304 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-09-19T06:29:50.304 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-rook noarch 2:17.2.7-1637.g6e06d1e0.el9 ceph-noarch 47 k 2024-09-19T06:29:50.304 INFO:teuthology.orchestra.run.smithi117.stdout:Installing dependencies: 2024-09-19T06:29:50.304 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T06:29:50.304 INFO:teuthology.orchestra.run.smithi117.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T06:29:50.304 INFO:teuthology.orchestra.run.smithi117.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T06:29:50.304 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T06:29:50.304 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T06:29:50.305 INFO:teuthology.orchestra.run.smithi117.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T06:29:50.305 INFO:teuthology.orchestra.run.smithi117.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T06:29:50.305 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T06:29:50.305 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T06:29:50.305 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T06:29:50.305 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T06:29:50.305 INFO:teuthology.orchestra.run.smithi117.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T06:29:50.305 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:29:50.305 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-09-19T06:29:50.306 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-19T06:29:50.306 INFO:teuthology.orchestra.run.smithi117.stdout:Install 13 Packages 2024-09-19T06:29:50.306 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:29:50.306 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 2.2 M 2024-09-19T06:29:50.306 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 26 M 2024-09-19T06:29:50.307 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-09-19T06:29:50.676 INFO:teuthology.orchestra.run.smithi117.stdout:(1/13): ceph-mgr-rook-17.2.7-1637.g6e06d1e0.el9 290 kB/s | 47 kB 00:00 2024-09-19T06:29:51.051 INFO:teuthology.orchestra.run.smithi117.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 36 kB/s | 19 kB 00:00 2024-09-19T06:29:51.077 INFO:teuthology.orchestra.run.smithi117.stdout:(3/13): python3-jsonpatch-1.21-16.el9.noarch.rp 45 kB/s | 26 kB 00:00 2024-09-19T06:29:51.435 INFO:teuthology.orchestra.run.smithi117.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 293 kB/s | 222 kB 00:00 2024-09-19T06:29:51.819 INFO:teuthology.orchestra.run.smithi117.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 207 kB/s | 159 kB 00:00 2024-09-19T06:29:51.845 INFO:teuthology.orchestra.run.smithi117.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 363 kB/s | 279 kB 00:00 2024-09-19T06:29:51.886 INFO:teuthology.orchestra.run.smithi117.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 483 kB/s | 32 kB 00:00 2024-09-19T06:29:51.911 INFO:teuthology.orchestra.run.smithi117.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 214 kB/s | 14 kB 00:00 2024-09-19T06:29:51.928 INFO:teuthology.orchestra.run.smithi117.stdout:(9/13): python3-google-auth-2.34.0-1.el9.noarch 5.4 MB/s | 220 kB 00:00 2024-09-19T06:29:51.962 INFO:teuthology.orchestra.run.smithi117.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 1.7 MB/s | 59 kB 00:00 2024-09-19T06:29:51.979 INFO:teuthology.orchestra.run.smithi117.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 5.2 MB/s | 90 kB 00:00 2024-09-19T06:29:52.013 INFO:teuthology.orchestra.run.smithi117.stdout:(12/13): python3-kubernetes-26.1.0-2.el9.noarch 10 MB/s | 1.0 MB 00:00 2024-09-19T06:29:52.063 INFO:teuthology.orchestra.run.smithi117.stdout:(13/13): python3-requests-oauthlib-1.3.0-12.el9 85 kB/s | 54 kB 00:00 2024-09-19T06:29:52.066 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-09-19T06:29:52.066 INFO:teuthology.orchestra.run.smithi117.stdout:Total 1.3 MB/s | 2.2 MB 00:01 2024-09-19T06:29:52.091 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-1637.g6e06d 12/12 2024-09-19T06:29:52.091 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-1637.g6e06d 1/12 2024-09-19T06:29:52.091 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-19T06:29:52.091 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-19T06:29:52.091 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-19T06:29:52.091 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-19T06:29:52.092 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-19T06:29:52.092 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-19T06:29:52.092 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-19T06:29:52.092 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-19T06:29:52.092 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-19T06:29:52.092 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-19T06:29:52.132 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-09-19T06:29:52.148 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-09-19T06:29:52.148 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-09-19T06:29:52.236 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-09-19T06:29:52.237 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-09-19T06:29:52.477 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-19T06:29:52.478 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:29:52.478 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-09-19T06:29:52.478 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-diskprediction-local-2:17.2.7-1637.g6e06d1e0.el9.noarch 2024-09-19T06:29:52.478 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T06:29:52.478 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T06:29:52.478 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T06:29:52.478 INFO:teuthology.orchestra.run.smithi099.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T06:29:52.478 INFO:teuthology.orchestra.run.smithi099.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T06:29:52.478 INFO:teuthology.orchestra.run.smithi099.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T06:29:52.478 INFO:teuthology.orchestra.run.smithi099.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T06:29:52.478 INFO:teuthology.orchestra.run.smithi099.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T06:29:52.478 INFO:teuthology.orchestra.run.smithi099.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T06:29:52.479 INFO:teuthology.orchestra.run.smithi099.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T06:29:52.479 INFO:teuthology.orchestra.run.smithi099.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T06:29:52.479 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:29:52.479 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-19T06:29:52.744 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-09-19T06:29:52.872 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install ceph-mgr-rook 2024-09-19T06:29:52.911 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-19T06:29:52.972 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-19T06:29:53.027 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-19T06:29:53.065 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-19T06:29:53.106 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-19T06:29:53.208 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-19T06:29:53.310 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-19T06:29:53.358 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-19T06:29:53.452 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:01:16 ago on Thu 19 Sep 2024 06:28:37 AM UTC. 2024-09-19T06:29:53.583 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-19T06:29:53.585 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-19T06:29:53.586 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repository Size 2024-09-19T06:29:53.586 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-19T06:29:53.586 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-09-19T06:29:53.586 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-rook noarch 2:17.2.7-1637.g6e06d1e0.el9 ceph-noarch 47 k 2024-09-19T06:29:53.586 INFO:teuthology.orchestra.run.smithi099.stdout:Installing dependencies: 2024-09-19T06:29:53.586 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T06:29:53.586 INFO:teuthology.orchestra.run.smithi099.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T06:29:53.586 INFO:teuthology.orchestra.run.smithi099.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T06:29:53.586 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T06:29:53.586 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T06:29:53.587 INFO:teuthology.orchestra.run.smithi099.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T06:29:53.587 INFO:teuthology.orchestra.run.smithi099.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T06:29:53.587 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T06:29:53.587 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T06:29:53.587 INFO:teuthology.orchestra.run.smithi099.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T06:29:53.587 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T06:29:53.587 INFO:teuthology.orchestra.run.smithi099.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T06:29:53.587 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:29:53.587 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-09-19T06:29:53.587 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-19T06:29:53.587 INFO:teuthology.orchestra.run.smithi099.stdout:Install 13 Packages 2024-09-19T06:29:53.588 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:29:53.588 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 2.2 M 2024-09-19T06:29:53.588 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 26 M 2024-09-19T06:29:53.588 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-09-19T06:29:54.069 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-19T06:29:54.092 INFO:teuthology.orchestra.run.smithi099.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 209 kB/s | 19 kB 00:00 2024-09-19T06:29:54.117 INFO:teuthology.orchestra.run.smithi099.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 219 kB/s | 26 kB 00:00 2024-09-19T06:29:54.130 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-19T06:29:54.164 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-19T06:29:54.167 INFO:teuthology.orchestra.run.smithi099.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.9 MB/s | 222 kB 00:00 2024-09-19T06:29:54.201 INFO:teuthology.orchestra.run.smithi099.stdout:(4/13): ceph-mgr-rook-17.2.7-1637.g6e06d1e0.el9 237 kB/s | 47 kB 00:00 2024-09-19T06:29:54.209 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-19T06:29:54.226 INFO:teuthology.orchestra.run.smithi099.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-09-19T06:29:54.234 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-rook-2:17.2.7-1637.g6e06d1e0.el9.noarch 13/13 2024-09-19T06:29:54.260 INFO:teuthology.orchestra.run.smithi099.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 3.0 MB/s | 279 kB 00:00 2024-09-19T06:29:54.294 INFO:teuthology.orchestra.run.smithi099.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 480 kB/s | 32 kB 00:00 2024-09-19T06:29:54.319 INFO:teuthology.orchestra.run.smithi099.stdout:(8/13): python3-requests-oauthlib-1.3.0-12.el9. 456 kB/s | 54 kB 00:00 2024-09-19T06:29:54.344 INFO:teuthology.orchestra.run.smithi099.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 172 kB/s | 14 kB 00:00 2024-09-19T06:29:54.378 INFO:teuthology.orchestra.run.smithi099.stdout:(10/13): python3-google-auth-2.34.0-1.el9.noarc 2.6 MB/s | 220 kB 00:00 2024-09-19T06:29:54.403 INFO:teuthology.orchestra.run.smithi099.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 3.8 MB/s | 90 kB 00:00 2024-09-19T06:29:54.428 INFO:teuthology.orchestra.run.smithi099.stdout:(12/13): python3-rsa-4.9-2.el9.noarch.rpm 707 kB/s | 59 kB 00:00 2024-09-19T06:29:54.470 INFO:teuthology.orchestra.run.smithi099.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 8.1 MB/s | 1.0 MB 00:00 2024-09-19T06:29:54.472 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-09-19T06:29:54.473 INFO:teuthology.orchestra.run.smithi099.stdout:Total 2.5 MB/s | 2.2 MB 00:00 2024-09-19T06:29:54.534 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-09-19T06:29:54.550 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-09-19T06:29:54.550 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-09-19T06:29:54.639 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-09-19T06:29:54.641 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-09-19T06:29:55.022 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-1637.g6e06d1e0.el9.noarch 13/13 2024-09-19T06:29:55.022 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-rook-2:17.2.7-1637.g6e06d1e0.el9.noarch 1/13 2024-09-19T06:29:55.022 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-19T06:29:55.022 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-19T06:29:55.022 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-19T06:29:55.022 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-19T06:29:55.023 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-19T06:29:55.023 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-19T06:29:55.023 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-19T06:29:55.023 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-19T06:29:55.023 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-19T06:29:55.024 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-19T06:29:55.024 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-19T06:29:55.145 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-09-19T06:29:55.309 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-19T06:29:55.359 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-19T06:29:55.359 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:29:55.359 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-09-19T06:29:55.359 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-rook-2:17.2.7-1637.g6e06d1e0.el9.noarch 2024-09-19T06:29:55.359 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T06:29:55.359 INFO:teuthology.orchestra.run.smithi117.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T06:29:55.359 INFO:teuthology.orchestra.run.smithi117.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T06:29:55.359 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T06:29:55.360 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T06:29:55.360 INFO:teuthology.orchestra.run.smithi117.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T06:29:55.360 INFO:teuthology.orchestra.run.smithi117.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T06:29:55.360 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T06:29:55.360 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T06:29:55.360 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T06:29:55.360 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T06:29:55.360 INFO:teuthology.orchestra.run.smithi117.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T06:29:55.360 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:29:55.360 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-09-19T06:29:55.362 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-19T06:29:55.418 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-19T06:29:55.455 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-19T06:29:55.496 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-19T06:29:55.602 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-19T06:29:55.606 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph-mgr-cephadm 2024-09-19T06:29:55.701 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-19T06:29:55.756 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-19T06:29:56.180 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:01:21 ago on Thu 19 Sep 2024 06:28:35 AM UTC. 2024-09-19T06:29:56.314 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-09-19T06:29:56.314 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-19T06:29:56.314 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repository Size 2024-09-19T06:29:56.314 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-19T06:29:56.315 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-09-19T06:29:56.315 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-cephadm noarch 2:17.2.7-1637.g6e06d1e0.el9 ceph-noarch 124 k 2024-09-19T06:29:56.315 INFO:teuthology.orchestra.run.smithi117.stdout:Installing dependencies: 2024-09-19T06:29:56.315 INFO:teuthology.orchestra.run.smithi117.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T06:29:56.315 INFO:teuthology.orchestra.run.smithi117.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T06:29:56.315 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T06:29:56.315 INFO:teuthology.orchestra.run.smithi117.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T06:29:56.315 INFO:teuthology.orchestra.run.smithi117.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T06:29:56.315 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:29:56.315 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-09-19T06:29:56.315 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-19T06:29:56.315 INFO:teuthology.orchestra.run.smithi117.stdout:Install 6 Packages 2024-09-19T06:29:56.315 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:29:56.316 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 7.0 M 2024-09-19T06:29:56.316 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 33 M 2024-09-19T06:29:56.316 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-09-19T06:29:56.465 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-19T06:29:56.520 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-19T06:29:56.554 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-19T06:29:56.599 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-19T06:29:56.615 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-rook-2:17.2.7-1637.g6e06d1e0.el9.noarch 13/13 2024-09-19T06:29:56.831 INFO:teuthology.orchestra.run.smithi117.stdout:(1/6): ceph-mgr-cephadm-17.2.7-1637.g6e06d1e0.e 670 kB/s | 124 kB 00:00 2024-09-19T06:29:56.931 INFO:teuthology.orchestra.run.smithi117.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 5.4 MB/s | 548 kB 00:00 2024-09-19T06:29:56.965 INFO:teuthology.orchestra.run.smithi117.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 1.7 MB/s | 58 kB 00:00 2024-09-19T06:29:56.998 INFO:teuthology.orchestra.run.smithi117.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.2 MB/s | 74 kB 00:00 2024-09-19T06:29:57.232 INFO:teuthology.orchestra.run.smithi117.stdout:(5/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 424 kB/s | 248 kB 00:00 2024-09-19T06:29:57.360 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-1637.g6e06d1e0.el9.noarch 13/13 2024-09-19T06:29:57.360 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-rook-2:17.2.7-1637.g6e06d1e0.el9.noarch 1/13 2024-09-19T06:29:57.360 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-19T06:29:57.360 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-19T06:29:57.360 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-19T06:29:57.360 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-19T06:29:57.360 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-19T06:29:57.360 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-19T06:29:57.361 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-19T06:29:57.361 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-19T06:29:57.361 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-19T06:29:57.361 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-19T06:29:57.361 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-19T06:29:57.678 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-19T06:29:57.678 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:29:57.678 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-09-19T06:29:57.678 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-rook-2:17.2.7-1637.g6e06d1e0.el9.noarch 2024-09-19T06:29:57.678 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T06:29:57.678 INFO:teuthology.orchestra.run.smithi099.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T06:29:57.678 INFO:teuthology.orchestra.run.smithi099.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T06:29:57.678 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T06:29:57.678 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T06:29:57.678 INFO:teuthology.orchestra.run.smithi099.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T06:29:57.679 INFO:teuthology.orchestra.run.smithi099.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T06:29:57.679 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T06:29:57.679 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T06:29:57.679 INFO:teuthology.orchestra.run.smithi099.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T06:29:57.679 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T06:29:57.679 INFO:teuthology.orchestra.run.smithi099.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T06:29:57.679 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:29:57.679 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-19T06:29:57.906 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install ceph-mgr-cephadm 2024-09-19T06:29:57.907 INFO:teuthology.orchestra.run.smithi117.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 4.7 MB/s | 6.0 MB 00:01 2024-09-19T06:29:57.909 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-09-19T06:29:57.909 INFO:teuthology.orchestra.run.smithi117.stdout:Total 4.4 MB/s | 7.0 MB 00:01 2024-09-19T06:29:57.984 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-09-19T06:29:57.995 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-09-19T06:29:57.995 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-09-19T06:29:58.094 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-09-19T06:29:58.095 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-09-19T06:29:58.415 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-09-19T06:29:58.497 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:01:21 ago on Thu 19 Sep 2024 06:28:37 AM UTC. 2024-09-19T06:29:58.590 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-19T06:29:58.637 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-19T06:29:58.638 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-19T06:29:58.638 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repository Size 2024-09-19T06:29:58.638 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-19T06:29:58.638 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-09-19T06:29:58.638 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-cephadm noarch 2:17.2.7-1637.g6e06d1e0.el9 ceph-noarch 124 k 2024-09-19T06:29:58.638 INFO:teuthology.orchestra.run.smithi099.stdout:Installing dependencies: 2024-09-19T06:29:58.638 INFO:teuthology.orchestra.run.smithi099.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T06:29:58.638 INFO:teuthology.orchestra.run.smithi099.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T06:29:58.638 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T06:29:58.638 INFO:teuthology.orchestra.run.smithi099.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T06:29:58.638 INFO:teuthology.orchestra.run.smithi099.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T06:29:58.638 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:29:58.639 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-09-19T06:29:58.639 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-19T06:29:58.639 INFO:teuthology.orchestra.run.smithi099.stdout:Install 6 Packages 2024-09-19T06:29:58.639 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:29:58.639 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 7.0 M 2024-09-19T06:29:58.639 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 33 M 2024-09-19T06:29:58.639 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-09-19T06:29:58.642 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-19T06:29:59.046 INFO:teuthology.orchestra.run.smithi099.stdout:(1/6): ceph-mgr-cephadm-17.2.7-1637.g6e06d1e0.e 591 kB/s | 124 kB 00:00 2024-09-19T06:29:59.071 INFO:teuthology.orchestra.run.smithi099.stdout:(2/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.0 MB/s | 248 kB 00:00 2024-09-19T06:29:59.122 INFO:teuthology.orchestra.run.smithi099.stdout:(3/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 7.1 MB/s | 548 kB 00:00 2024-09-19T06:29:59.147 INFO:teuthology.orchestra.run.smithi099.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 767 kB/s | 58 kB 00:00 2024-09-19T06:29:59.166 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-19T06:29:59.172 INFO:teuthology.orchestra.run.smithi099.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.5 MB/s | 74 kB 00:00 2024-09-19T06:29:59.254 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-19T06:29:59.309 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-19T06:29:59.337 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-1637.g6e06d1e0.el9.noarch 6/6 2024-09-19T06:30:00.093 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-1637.g6e06d1e0.el9.noarch 6/6 2024-09-19T06:30:00.094 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-1637.g6e06d1e0.el9.noarch 1/6 2024-09-19T06:30:00.094 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-19T06:30:00.094 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-19T06:30:00.094 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-19T06:30:00.094 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-19T06:30:00.365 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-19T06:30:00.365 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:30:00.365 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-09-19T06:30:00.365 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-cephadm-2:17.2.7-1637.g6e06d1e0.el9.noarch 2024-09-19T06:30:00.365 INFO:teuthology.orchestra.run.smithi117.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T06:30:00.366 INFO:teuthology.orchestra.run.smithi117.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T06:30:00.366 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T06:30:00.366 INFO:teuthology.orchestra.run.smithi117.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T06:30:00.366 INFO:teuthology.orchestra.run.smithi117.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T06:30:00.366 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:30:00.366 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-09-19T06:30:00.622 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph-fuse 2024-09-19T06:30:01.213 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:01:26 ago on Thu 19 Sep 2024 06:28:35 AM UTC. 2024-09-19T06:30:01.348 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-09-19T06:30:01.348 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-19T06:30:01.348 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repository Size 2024-09-19T06:30:01.348 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-19T06:30:01.349 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-09-19T06:30:01.349 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-fuse x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 813 k 2024-09-19T06:30:01.349 INFO:teuthology.orchestra.run.smithi117.stdout:Installing dependencies: 2024-09-19T06:30:01.349 INFO:teuthology.orchestra.run.smithi117.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T06:30:01.349 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:30:01.349 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-09-19T06:30:01.349 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-19T06:30:01.349 INFO:teuthology.orchestra.run.smithi117.stdout:Install 2 Packages 2024-09-19T06:30:01.349 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:30:01.350 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 893 k 2024-09-19T06:30:01.350 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 2.6 M 2024-09-19T06:30:01.350 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-09-19T06:30:01.405 INFO:teuthology.orchestra.run.smithi099.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 2.3 MB/s | 6.0 MB 00:02 2024-09-19T06:30:01.407 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-09-19T06:30:01.408 INFO:teuthology.orchestra.run.smithi099.stdout:Total 2.5 MB/s | 7.0 MB 00:02 2024-09-19T06:30:01.483 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-09-19T06:30:01.495 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-09-19T06:30:01.495 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-09-19T06:30:01.593 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-09-19T06:30:01.594 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-09-19T06:30:01.625 INFO:teuthology.orchestra.run.smithi117.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 531 kB/s | 80 kB 00:00 2024-09-19T06:30:01.758 INFO:teuthology.orchestra.run.smithi117.stdout:(2/2): ceph-fuse-17.2.7-1637.g6e06d1e0.el9.x86_ 2.8 MB/s | 813 kB 00:00 2024-09-19T06:30:01.759 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-09-19T06:30:01.759 INFO:teuthology.orchestra.run.smithi117.stdout:Total 2.1 MB/s | 893 kB 00:00 2024-09-19T06:30:01.771 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-09-19T06:30:01.793 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-09-19T06:30:01.793 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-09-19T06:30:01.872 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-09-19T06:30:01.873 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-09-19T06:30:01.896 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-09-19T06:30:02.061 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-19T06:30:02.065 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-09-19T06:30:02.115 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-19T06:30:02.204 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-19T06:30:02.265 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-fuse-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2/2 2024-09-19T06:30:02.634 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-19T06:30:02.725 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-19T06:30:02.781 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-19T06:30:02.810 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-1637.g6e06d1e0.el9.noarch 6/6 2024-09-19T06:30:02.963 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-fuse-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2/2 2024-09-19T06:30:02.963 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-fuse-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/2 2024-09-19T06:30:03.257 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-19T06:30:03.257 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:30:03.258 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-09-19T06:30:03.258 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-fuse-2:17.2.7-1637.g6e06d1e0.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-19T06:30:03.258 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:30:03.258 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-09-19T06:30:03.533 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install librados-devel 2024-09-19T06:30:03.613 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-1637.g6e06d1e0.el9.noarch 6/6 2024-09-19T06:30:03.614 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-1637.g6e06d1e0.el9.noarch 1/6 2024-09-19T06:30:03.614 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-19T06:30:03.614 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-19T06:30:03.614 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-19T06:30:03.614 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-19T06:30:03.881 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-19T06:30:03.881 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:30:03.881 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-09-19T06:30:03.881 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-cephadm-2:17.2.7-1637.g6e06d1e0.el9.noarch 2024-09-19T06:30:03.881 INFO:teuthology.orchestra.run.smithi099.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T06:30:03.881 INFO:teuthology.orchestra.run.smithi099.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T06:30:03.881 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T06:30:03.881 INFO:teuthology.orchestra.run.smithi099.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T06:30:03.882 INFO:teuthology.orchestra.run.smithi099.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T06:30:03.882 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:30:03.882 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-19T06:30:04.110 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install ceph-fuse 2024-09-19T06:30:04.116 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:01:29 ago on Thu 19 Sep 2024 06:28:35 AM UTC. 2024-09-19T06:30:04.252 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-09-19T06:30:04.253 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-19T06:30:04.253 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repo Size 2024-09-19T06:30:04.253 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-19T06:30:04.253 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-09-19T06:30:04.253 INFO:teuthology.orchestra.run.smithi117.stdout: librados-devel x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 126 k 2024-09-19T06:30:04.253 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:30:04.253 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-09-19T06:30:04.253 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-19T06:30:04.253 INFO:teuthology.orchestra.run.smithi117.stdout:Install 1 Package 2024-09-19T06:30:04.254 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:30:04.254 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 126 k 2024-09-19T06:30:04.254 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 448 k 2024-09-19T06:30:04.254 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-09-19T06:30:04.463 INFO:teuthology.orchestra.run.smithi117.stdout:librados-devel-17.2.7-1637.g6e06d1e0.el9.x86_64 606 kB/s | 126 kB 00:00 2024-09-19T06:30:04.463 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-09-19T06:30:04.463 INFO:teuthology.orchestra.run.smithi117.stdout:Total 601 kB/s | 126 kB 00:00 2024-09-19T06:30:04.464 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-09-19T06:30:04.469 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-09-19T06:30:04.469 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-09-19T06:30:04.533 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-09-19T06:30:04.533 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-09-19T06:30:04.680 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-09-19T06:30:04.693 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:01:27 ago on Thu 19 Sep 2024 06:28:37 AM UTC. 2024-09-19T06:30:04.776 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librados-devel-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-19T06:30:04.826 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-19T06:30:04.827 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-19T06:30:04.827 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repository Size 2024-09-19T06:30:04.827 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-19T06:30:04.827 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-09-19T06:30:04.827 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-fuse x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 813 k 2024-09-19T06:30:04.827 INFO:teuthology.orchestra.run.smithi099.stdout:Installing dependencies: 2024-09-19T06:30:04.827 INFO:teuthology.orchestra.run.smithi099.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T06:30:04.827 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:30:04.827 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-09-19T06:30:04.828 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-19T06:30:04.828 INFO:teuthology.orchestra.run.smithi099.stdout:Install 2 Packages 2024-09-19T06:30:04.828 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:30:04.829 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 893 k 2024-09-19T06:30:04.829 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 2.6 M 2024-09-19T06:30:04.829 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-09-19T06:30:04.990 INFO:teuthology.orchestra.run.smithi099.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 570 kB/s | 80 kB 00:00 2024-09-19T06:30:05.124 INFO:teuthology.orchestra.run.smithi099.stdout:(2/2): ceph-fuse-17.2.7-1637.g6e06d1e0.el9.x86_ 2.9 MB/s | 813 kB 00:00 2024-09-19T06:30:05.124 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-09-19T06:30:05.124 INFO:teuthology.orchestra.run.smithi099.stdout:Total 2.9 MB/s | 893 kB 00:00 2024-09-19T06:30:05.136 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-09-19T06:30:05.158 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-09-19T06:30:05.158 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-09-19T06:30:05.186 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librados-devel-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-19T06:30:05.237 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-09-19T06:30:05.237 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-09-19T06:30:05.423 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-09-19T06:30:05.456 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librados-devel-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-19T06:30:05.456 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:30:05.456 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-09-19T06:30:05.456 INFO:teuthology.orchestra.run.smithi117.stdout: librados-devel-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T06:30:05.456 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:30:05.456 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-09-19T06:30:05.560 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-19T06:30:05.622 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-fuse-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2/2 2024-09-19T06:30:05.673 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install libcephfs2 2024-09-19T06:30:06.261 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:01:31 ago on Thu 19 Sep 2024 06:28:35 AM UTC. 2024-09-19T06:30:06.352 INFO:teuthology.orchestra.run.smithi117.stdout:Package libcephfs2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 is already installed. 2024-09-19T06:30:06.363 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-fuse-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2/2 2024-09-19T06:30:06.363 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-fuse-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/2 2024-09-19T06:30:06.395 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-09-19T06:30:06.396 INFO:teuthology.orchestra.run.smithi117.stdout:Nothing to do. 2024-09-19T06:30:06.397 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-09-19T06:30:06.463 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install libcephfs-devel 2024-09-19T06:30:06.633 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-19T06:30:06.633 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:30:06.633 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-09-19T06:30:06.633 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-fuse-2:17.2.7-1637.g6e06d1e0.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-19T06:30:06.634 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:30:06.634 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-19T06:30:06.886 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install librados-devel 2024-09-19T06:30:07.038 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:01:32 ago on Thu 19 Sep 2024 06:28:35 AM UTC. 2024-09-19T06:30:07.168 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-09-19T06:30:07.169 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-19T06:30:07.169 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repo Size 2024-09-19T06:30:07.169 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-19T06:30:07.169 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-09-19T06:30:07.169 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs-devel x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 25 k 2024-09-19T06:30:07.169 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:30:07.169 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-09-19T06:30:07.170 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-19T06:30:07.170 INFO:teuthology.orchestra.run.smithi117.stdout:Install 1 Package 2024-09-19T06:30:07.170 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:30:07.170 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 25 k 2024-09-19T06:30:07.170 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 110 k 2024-09-19T06:30:07.170 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-09-19T06:30:07.333 INFO:teuthology.orchestra.run.smithi117.stdout:libcephfs-devel-17.2.7-1637.g6e06d1e0.el9.x86_6 153 kB/s | 25 kB 00:00 2024-09-19T06:30:07.334 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-09-19T06:30:07.334 INFO:teuthology.orchestra.run.smithi117.stdout:Total 152 kB/s | 25 kB 00:00 2024-09-19T06:30:07.334 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-09-19T06:30:07.337 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-09-19T06:30:07.337 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-09-19T06:30:07.339 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-09-19T06:30:07.339 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-09-19T06:30:07.435 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-09-19T06:30:07.480 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:01:30 ago on Thu 19 Sep 2024 06:28:37 AM UTC. 2024-09-19T06:30:07.538 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libcephfs-devel-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-19T06:30:07.613 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-19T06:30:07.613 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-19T06:30:07.614 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repo Size 2024-09-19T06:30:07.614 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-19T06:30:07.614 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-09-19T06:30:07.614 INFO:teuthology.orchestra.run.smithi099.stdout: librados-devel x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 126 k 2024-09-19T06:30:07.614 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:30:07.614 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-09-19T06:30:07.614 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-19T06:30:07.614 INFO:teuthology.orchestra.run.smithi099.stdout:Install 1 Package 2024-09-19T06:30:07.614 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:30:07.614 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 126 k 2024-09-19T06:30:07.614 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 448 k 2024-09-19T06:30:07.614 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-09-19T06:30:07.819 INFO:teuthology.orchestra.run.smithi099.stdout:librados-devel-17.2.7-1637.g6e06d1e0.el9.x86_64 618 kB/s | 126 kB 00:00 2024-09-19T06:30:07.820 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-09-19T06:30:07.820 INFO:teuthology.orchestra.run.smithi099.stdout:Total 613 kB/s | 126 kB 00:00 2024-09-19T06:30:07.821 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-09-19T06:30:07.825 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-09-19T06:30:07.826 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-09-19T06:30:07.888 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-09-19T06:30:07.889 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-09-19T06:30:07.895 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-19T06:30:08.039 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-09-19T06:30:08.137 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libcephfs-devel-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-19T06:30:08.137 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:30:08.138 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-09-19T06:30:08.138 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs-devel-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T06:30:08.138 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:30:08.138 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-09-19T06:30:08.157 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : librados-devel-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-19T06:30:08.325 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install librados2 2024-09-19T06:30:08.566 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librados-devel-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-19T06:30:08.828 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librados-devel-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-19T06:30:08.828 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:30:08.828 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-09-19T06:30:08.828 INFO:teuthology.orchestra.run.smithi099.stdout: librados-devel-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T06:30:08.829 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:30:08.829 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-19T06:30:08.900 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:01:33 ago on Thu 19 Sep 2024 06:28:35 AM UTC. 2024-09-19T06:30:08.988 INFO:teuthology.orchestra.run.smithi117.stdout:Package librados2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 is already installed. 2024-09-19T06:30:09.031 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-09-19T06:30:09.032 INFO:teuthology.orchestra.run.smithi117.stdout:Nothing to do. 2024-09-19T06:30:09.032 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-09-19T06:30:09.069 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install libcephfs2 2024-09-19T06:30:09.092 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install librbd1 2024-09-19T06:30:09.670 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:01:32 ago on Thu 19 Sep 2024 06:28:37 AM UTC. 2024-09-19T06:30:09.670 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:01:34 ago on Thu 19 Sep 2024 06:28:35 AM UTC. 2024-09-19T06:30:09.759 INFO:teuthology.orchestra.run.smithi117.stdout:Package librbd1-2:17.2.7-1637.g6e06d1e0.el9.x86_64 is already installed. 2024-09-19T06:30:09.763 INFO:teuthology.orchestra.run.smithi099.stdout:Package libcephfs2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 is already installed. 2024-09-19T06:30:09.802 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-09-19T06:30:09.802 INFO:teuthology.orchestra.run.smithi117.stdout:Nothing to do. 2024-09-19T06:30:09.803 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-09-19T06:30:09.808 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-19T06:30:09.809 INFO:teuthology.orchestra.run.smithi099.stdout:Nothing to do. 2024-09-19T06:30:09.809 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-19T06:30:09.867 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install python3-rados 2024-09-19T06:30:09.868 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install libcephfs-devel 2024-09-19T06:30:10.438 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:01:35 ago on Thu 19 Sep 2024 06:28:35 AM UTC. 2024-09-19T06:30:10.438 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:01:33 ago on Thu 19 Sep 2024 06:28:37 AM UTC. 2024-09-19T06:30:10.524 INFO:teuthology.orchestra.run.smithi117.stdout:Package python3-rados-2:17.2.7-1637.g6e06d1e0.el9.x86_64 is already installed. 2024-09-19T06:30:10.567 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-09-19T06:30:10.568 INFO:teuthology.orchestra.run.smithi117.stdout:Nothing to do. 2024-09-19T06:30:10.568 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-09-19T06:30:10.569 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-19T06:30:10.570 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-19T06:30:10.570 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repo Size 2024-09-19T06:30:10.570 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-19T06:30:10.571 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-09-19T06:30:10.571 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs-devel x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 25 k 2024-09-19T06:30:10.571 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:30:10.571 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-09-19T06:30:10.571 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-19T06:30:10.571 INFO:teuthology.orchestra.run.smithi099.stdout:Install 1 Package 2024-09-19T06:30:10.571 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:30:10.571 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 25 k 2024-09-19T06:30:10.571 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 110 k 2024-09-19T06:30:10.571 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-09-19T06:30:10.637 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install python3-rgw 2024-09-19T06:30:10.722 INFO:teuthology.orchestra.run.smithi099.stdout:libcephfs-devel-17.2.7-1637.g6e06d1e0.el9.x86_6 166 kB/s | 25 kB 00:00 2024-09-19T06:30:10.723 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-09-19T06:30:10.723 INFO:teuthology.orchestra.run.smithi099.stdout:Total 164 kB/s | 25 kB 00:00 2024-09-19T06:30:10.723 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-09-19T06:30:10.726 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-09-19T06:30:10.726 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-09-19T06:30:10.727 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-09-19T06:30:10.728 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-09-19T06:30:10.816 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-09-19T06:30:10.919 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libcephfs-devel-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-19T06:30:11.213 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:01:36 ago on Thu 19 Sep 2024 06:28:35 AM UTC. 2024-09-19T06:30:11.265 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-19T06:30:11.303 INFO:teuthology.orchestra.run.smithi117.stdout:Package python3-rgw-2:17.2.7-1637.g6e06d1e0.el9.x86_64 is already installed. 2024-09-19T06:30:11.346 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-09-19T06:30:11.348 INFO:teuthology.orchestra.run.smithi117.stdout:Nothing to do. 2024-09-19T06:30:11.348 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-09-19T06:30:11.408 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install python3-cephfs 2024-09-19T06:30:11.489 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libcephfs-devel-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-19T06:30:11.489 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:30:11.489 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-09-19T06:30:11.489 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs-devel-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T06:30:11.489 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:30:11.489 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-19T06:30:11.659 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install librados2 2024-09-19T06:30:11.982 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:01:36 ago on Thu 19 Sep 2024 06:28:35 AM UTC. 2024-09-19T06:30:12.074 INFO:teuthology.orchestra.run.smithi117.stdout:Package python3-cephfs-2:17.2.7-1637.g6e06d1e0.el9.x86_64 is already installed. 2024-09-19T06:30:12.113 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-09-19T06:30:12.114 INFO:teuthology.orchestra.run.smithi117.stdout:Nothing to do. 2024-09-19T06:30:12.115 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-09-19T06:30:12.177 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install python3-rbd 2024-09-19T06:30:12.242 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:01:35 ago on Thu 19 Sep 2024 06:28:37 AM UTC. 2024-09-19T06:30:12.331 INFO:teuthology.orchestra.run.smithi099.stdout:Package librados2-2:17.2.7-1637.g6e06d1e0.el9.x86_64 is already installed. 2024-09-19T06:30:12.373 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-19T06:30:12.374 INFO:teuthology.orchestra.run.smithi099.stdout:Nothing to do. 2024-09-19T06:30:12.374 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-19T06:30:12.431 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install librbd1 2024-09-19T06:30:12.759 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:01:37 ago on Thu 19 Sep 2024 06:28:35 AM UTC. 2024-09-19T06:30:12.848 INFO:teuthology.orchestra.run.smithi117.stdout:Package python3-rbd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 is already installed. 2024-09-19T06:30:12.891 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-09-19T06:30:12.892 INFO:teuthology.orchestra.run.smithi117.stdout:Nothing to do. 2024-09-19T06:30:12.893 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-09-19T06:30:12.953 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install rbd-fuse 2024-09-19T06:30:13.012 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:01:36 ago on Thu 19 Sep 2024 06:28:37 AM UTC. 2024-09-19T06:30:13.101 INFO:teuthology.orchestra.run.smithi099.stdout:Package librbd1-2:17.2.7-1637.g6e06d1e0.el9.x86_64 is already installed. 2024-09-19T06:30:13.144 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-19T06:30:13.145 INFO:teuthology.orchestra.run.smithi099.stdout:Nothing to do. 2024-09-19T06:30:13.145 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-19T06:30:13.201 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install python3-rados 2024-09-19T06:30:13.535 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:01:38 ago on Thu 19 Sep 2024 06:28:35 AM UTC. 2024-09-19T06:30:13.666 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-09-19T06:30:13.667 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-19T06:30:13.667 INFO:teuthology.orchestra.run.smithi117.stdout: Package Architecture Version Repository Size 2024-09-19T06:30:13.667 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-19T06:30:13.667 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-09-19T06:30:13.667 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-fuse x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 82 k 2024-09-19T06:30:13.667 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:30:13.667 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-09-19T06:30:13.667 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-19T06:30:13.668 INFO:teuthology.orchestra.run.smithi117.stdout:Install 1 Package 2024-09-19T06:30:13.668 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:30:13.668 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 82 k 2024-09-19T06:30:13.668 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 222 k 2024-09-19T06:30:13.668 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-09-19T06:30:13.775 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:01:36 ago on Thu 19 Sep 2024 06:28:37 AM UTC. 2024-09-19T06:30:13.861 INFO:teuthology.orchestra.run.smithi117.stdout:rbd-fuse-17.2.7-1637.g6e06d1e0.el9.x86_64.rpm 426 kB/s | 82 kB 00:00 2024-09-19T06:30:13.861 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-09-19T06:30:13.861 INFO:teuthology.orchestra.run.smithi117.stdout:Total 423 kB/s | 82 kB 00:00 2024-09-19T06:30:13.861 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-09-19T06:30:13.862 INFO:teuthology.orchestra.run.smithi099.stdout:Package python3-rados-2:17.2.7-1637.g6e06d1e0.el9.x86_64 is already installed. 2024-09-19T06:30:13.868 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-09-19T06:30:13.868 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-09-19T06:30:13.906 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-19T06:30:13.907 INFO:teuthology.orchestra.run.smithi099.stdout:Nothing to do. 2024-09-19T06:30:13.907 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-19T06:30:13.930 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-09-19T06:30:13.930 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-09-19T06:30:13.969 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install python3-rgw 2024-09-19T06:30:14.079 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-09-19T06:30:14.190 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : rbd-fuse-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-19T06:30:14.544 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:01:37 ago on Thu 19 Sep 2024 06:28:37 AM UTC. 2024-09-19T06:30:14.573 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: rbd-fuse-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-19T06:30:14.632 INFO:teuthology.orchestra.run.smithi099.stdout:Package python3-rgw-2:17.2.7-1637.g6e06d1e0.el9.x86_64 is already installed. 2024-09-19T06:30:14.675 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-19T06:30:14.676 INFO:teuthology.orchestra.run.smithi099.stdout:Nothing to do. 2024-09-19T06:30:14.676 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-19T06:30:14.735 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install python3-cephfs 2024-09-19T06:30:14.846 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : rbd-fuse-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-19T06:30:14.846 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:30:14.846 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-09-19T06:30:14.847 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-fuse-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T06:30:14.847 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:30:14.847 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-09-19T06:30:15.080 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install rbd-mirror 2024-09-19T06:30:15.311 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:01:38 ago on Thu 19 Sep 2024 06:28:37 AM UTC. 2024-09-19T06:30:15.400 INFO:teuthology.orchestra.run.smithi099.stdout:Package python3-cephfs-2:17.2.7-1637.g6e06d1e0.el9.x86_64 is already installed. 2024-09-19T06:30:15.443 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-19T06:30:15.444 INFO:teuthology.orchestra.run.smithi099.stdout:Nothing to do. 2024-09-19T06:30:15.444 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-19T06:30:15.502 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install python3-rbd 2024-09-19T06:30:15.674 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:01:40 ago on Thu 19 Sep 2024 06:28:35 AM UTC. 2024-09-19T06:30:15.809 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-09-19T06:30:15.810 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-19T06:30:15.810 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repo Size 2024-09-19T06:30:15.810 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-19T06:30:15.810 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-09-19T06:30:15.810 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-mirror x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 2.9 M 2024-09-19T06:30:15.810 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:30:15.810 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-09-19T06:30:15.810 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-19T06:30:15.810 INFO:teuthology.orchestra.run.smithi117.stdout:Install 1 Package 2024-09-19T06:30:15.810 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:30:15.810 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 2.9 M 2024-09-19T06:30:15.810 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 12 M 2024-09-19T06:30:15.811 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-09-19T06:30:16.089 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:01:39 ago on Thu 19 Sep 2024 06:28:37 AM UTC. 2024-09-19T06:30:16.155 INFO:teuthology.orchestra.run.smithi117.stdout:rbd-mirror-17.2.7-1637.g6e06d1e0.el9.x86_64.rpm 8.5 MB/s | 2.9 MB 00:00 2024-09-19T06:30:16.156 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-09-19T06:30:16.156 INFO:teuthology.orchestra.run.smithi117.stdout:Total 8.5 MB/s | 2.9 MB 00:00 2024-09-19T06:30:16.156 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-09-19T06:30:16.165 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-09-19T06:30:16.165 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-09-19T06:30:16.179 INFO:teuthology.orchestra.run.smithi099.stdout:Package python3-rbd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 is already installed. 2024-09-19T06:30:16.222 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-19T06:30:16.223 INFO:teuthology.orchestra.run.smithi099.stdout:Nothing to do. 2024-09-19T06:30:16.223 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-19T06:30:16.244 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-09-19T06:30:16.245 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-09-19T06:30:16.292 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install rbd-fuse 2024-09-19T06:30:16.656 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-09-19T06:30:16.714 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : rbd-mirror-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-19T06:30:16.739 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: rbd-mirror-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-19T06:30:16.739 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:30:16.740 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T06:30:16.740 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T06:30:16.740 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T06:30:16.740 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:30:16.876 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:01:39 ago on Thu 19 Sep 2024 06:28:37 AM UTC. 2024-09-19T06:30:17.009 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-19T06:30:17.009 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-19T06:30:17.010 INFO:teuthology.orchestra.run.smithi099.stdout: Package Architecture Version Repository Size 2024-09-19T06:30:17.010 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-19T06:30:17.010 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-09-19T06:30:17.010 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-fuse x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 82 k 2024-09-19T06:30:17.010 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:30:17.010 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-09-19T06:30:17.010 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-19T06:30:17.010 INFO:teuthology.orchestra.run.smithi099.stdout:Install 1 Package 2024-09-19T06:30:17.010 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:30:17.010 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 82 k 2024-09-19T06:30:17.010 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 222 k 2024-09-19T06:30:17.011 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-09-19T06:30:17.175 INFO:teuthology.orchestra.run.smithi099.stdout:rbd-fuse-17.2.7-1637.g6e06d1e0.el9.x86_64.rpm 499 kB/s | 82 kB 00:00 2024-09-19T06:30:17.175 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-09-19T06:30:17.175 INFO:teuthology.orchestra.run.smithi099.stdout:Total 496 kB/s | 82 kB 00:00 2024-09-19T06:30:17.176 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-09-19T06:30:17.182 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-09-19T06:30:17.182 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-09-19T06:30:17.245 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-09-19T06:30:17.246 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-09-19T06:30:17.398 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-09-19T06:30:17.497 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : rbd-fuse-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-19T06:30:17.821 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : rbd-mirror-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-19T06:30:17.821 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:30:17.821 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-09-19T06:30:17.821 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-mirror-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T06:30:17.822 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:30:17.822 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-09-19T06:30:17.936 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: rbd-fuse-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-19T06:30:18.074 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install rbd-nbd 2024-09-19T06:30:18.162 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : rbd-fuse-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-19T06:30:18.162 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:30:18.162 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-09-19T06:30:18.163 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-fuse-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T06:30:18.163 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:30:18.163 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-19T06:30:18.379 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install rbd-mirror 2024-09-19T06:30:18.666 INFO:teuthology.orchestra.run.smithi117.stdout:Last metadata expiration check: 0:01:43 ago on Thu 19 Sep 2024 06:28:35 AM UTC. 2024-09-19T06:30:18.802 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-09-19T06:30:18.803 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-19T06:30:18.803 INFO:teuthology.orchestra.run.smithi117.stdout: Package Architecture Version Repository Size 2024-09-19T06:30:18.803 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-19T06:30:18.803 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-09-19T06:30:18.803 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-nbd x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 165 k 2024-09-19T06:30:18.803 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:30:18.804 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-09-19T06:30:18.804 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-09-19T06:30:18.804 INFO:teuthology.orchestra.run.smithi117.stdout:Install 1 Package 2024-09-19T06:30:18.804 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:30:18.804 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 165 k 2024-09-19T06:30:18.804 INFO:teuthology.orchestra.run.smithi117.stdout:Installed size: 477 k 2024-09-19T06:30:18.804 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-09-19T06:30:18.964 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:01:41 ago on Thu 19 Sep 2024 06:28:37 AM UTC. 2024-09-19T06:30:19.009 INFO:teuthology.orchestra.run.smithi117.stdout:rbd-nbd-17.2.7-1637.g6e06d1e0.el9.x86_64.rpm 806 kB/s | 165 kB 00:00 2024-09-19T06:30:19.010 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-09-19T06:30:19.010 INFO:teuthology.orchestra.run.smithi117.stdout:Total 801 kB/s | 165 kB 00:00 2024-09-19T06:30:19.010 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-09-19T06:30:19.017 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-09-19T06:30:19.017 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-09-19T06:30:19.081 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-09-19T06:30:19.081 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-09-19T06:30:19.097 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-19T06:30:19.098 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-19T06:30:19.098 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repo Size 2024-09-19T06:30:19.098 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-19T06:30:19.098 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-09-19T06:30:19.098 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-mirror x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 2.9 M 2024-09-19T06:30:19.098 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:30:19.098 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-09-19T06:30:19.098 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-19T06:30:19.098 INFO:teuthology.orchestra.run.smithi099.stdout:Install 1 Package 2024-09-19T06:30:19.098 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:30:19.099 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 2.9 M 2024-09-19T06:30:19.099 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 12 M 2024-09-19T06:30:19.099 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-09-19T06:30:19.231 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-09-19T06:30:19.315 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : rbd-nbd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-19T06:30:19.452 INFO:teuthology.orchestra.run.smithi099.stdout:rbd-mirror-17.2.7-1637.g6e06d1e0.el9.x86_64.rpm 8.3 MB/s | 2.9 MB 00:00 2024-09-19T06:30:19.453 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-09-19T06:30:19.453 INFO:teuthology.orchestra.run.smithi099.stdout:Total 8.3 MB/s | 2.9 MB 00:00 2024-09-19T06:30:19.457 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-09-19T06:30:19.462 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-09-19T06:30:19.462 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-09-19T06:30:19.540 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-09-19T06:30:19.540 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-09-19T06:30:19.821 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: rbd-nbd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-19T06:30:19.956 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-09-19T06:30:20.036 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : rbd-mirror-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-19T06:30:20.061 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: rbd-mirror-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-19T06:30:20.061 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T06:30:20.061 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T06:30:20.061 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T06:30:20.061 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T06:30:20.061 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:30:20.106 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : rbd-nbd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-19T06:30:20.106 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:30:20.106 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-09-19T06:30:20.106 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-nbd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T06:30:20.106 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:30:20.106 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-09-19T06:30:20.373 DEBUG:teuthology.parallel:result is None 2024-09-19T06:30:21.081 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : rbd-mirror-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-19T06:30:21.081 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:30:21.081 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-09-19T06:30:21.081 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-mirror-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T06:30:21.081 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:30:21.081 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-19T06:30:21.333 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install rbd-nbd 2024-09-19T06:30:21.921 INFO:teuthology.orchestra.run.smithi099.stdout:Last metadata expiration check: 0:01:44 ago on Thu 19 Sep 2024 06:28:37 AM UTC. 2024-09-19T06:30:22.053 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-09-19T06:30:22.053 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-19T06:30:22.054 INFO:teuthology.orchestra.run.smithi099.stdout: Package Architecture Version Repository Size 2024-09-19T06:30:22.054 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-19T06:30:22.054 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-09-19T06:30:22.054 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-nbd x86_64 2:17.2.7-1637.g6e06d1e0.el9 ceph 165 k 2024-09-19T06:30:22.054 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:30:22.054 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-09-19T06:30:22.054 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-09-19T06:30:22.054 INFO:teuthology.orchestra.run.smithi099.stdout:Install 1 Package 2024-09-19T06:30:22.054 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:30:22.054 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 165 k 2024-09-19T06:30:22.054 INFO:teuthology.orchestra.run.smithi099.stdout:Installed size: 477 k 2024-09-19T06:30:22.054 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-09-19T06:30:22.255 INFO:teuthology.orchestra.run.smithi099.stdout:rbd-nbd-17.2.7-1637.g6e06d1e0.el9.x86_64.rpm 822 kB/s | 165 kB 00:00 2024-09-19T06:30:22.256 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-09-19T06:30:22.256 INFO:teuthology.orchestra.run.smithi099.stdout:Total 817 kB/s | 165 kB 00:00 2024-09-19T06:30:22.256 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-09-19T06:30:22.263 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-09-19T06:30:22.263 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-09-19T06:30:22.326 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-09-19T06:30:22.326 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-09-19T06:30:22.478 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-09-19T06:30:22.593 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : rbd-nbd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-19T06:30:23.017 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: rbd-nbd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-19T06:30:23.279 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : rbd-nbd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 1/1 2024-09-19T06:30:23.280 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:30:23.280 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-09-19T06:30:23.280 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-nbd-2:17.2.7-1637.g6e06d1e0.el9.x86_64 2024-09-19T06:30:23.280 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:30:23.280 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-09-19T06:30:23.517 DEBUG:teuthology.parallel:result is None 2024-09-19T06:30:23.518 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-19T06:30:23.518 INFO:teuthology.packaging:ref: None 2024-09-19T06:30:23.518 INFO:teuthology.packaging:tag: None 2024-09-19T06:30:23.518 INFO:teuthology.packaging:branch: quincy 2024-09-19T06:30:23.518 INFO:teuthology.packaging:sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:30:23.519 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-09-19T06:30:23.723 DEBUG:teuthology.orchestra.run.smithi099:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T06:30:23.745 INFO:teuthology.orchestra.run.smithi099.stdout:17.2.7-1637.g6e06d1e0.el9 2024-09-19T06:30:23.745 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1637.g6e06d1e0.el9 2024-09-19T06:30:23.746 INFO:teuthology.task.install:The correct ceph version 17.2.7-1637.g6e06d1e0 is installed. 2024-09-19T06:30:23.747 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-19T06:30:23.747 INFO:teuthology.packaging:ref: None 2024-09-19T06:30:23.748 INFO:teuthology.packaging:tag: None 2024-09-19T06:30:23.748 INFO:teuthology.packaging:branch: quincy 2024-09-19T06:30:23.748 INFO:teuthology.packaging:sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:30:23.748 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-09-19T06:30:23.949 DEBUG:teuthology.orchestra.run.smithi117:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T06:30:23.975 INFO:teuthology.orchestra.run.smithi117.stdout:17.2.7-1637.g6e06d1e0.el9 2024-09-19T06:30:23.975 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1637.g6e06d1e0.el9 2024-09-19T06:30:23.975 INFO:teuthology.task.install:The correct ceph version 17.2.7-1637.g6e06d1e0 is installed. 2024-09-19T06:30:23.977 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-19T06:30:23.978 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-19T06:30:23.978 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T06:30:24.004 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-19T06:30:24.004 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T06:30:24.045 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-19T06:30:24.045 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-19T06:30:24.045 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T06:30:24.070 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T06:30:24.135 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-19T06:30:24.135 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T06:30:24.164 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T06:30:24.231 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-19T06:30:24.232 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-19T06:30:24.232 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T06:30:24.257 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T06:30:24.322 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-19T06:30:24.322 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T06:30:24.348 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T06:30:24.415 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-19T06:30:24.415 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-19T06:30:24.415 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T06:30:24.440 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T06:30:24.505 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-19T06:30:24.505 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T06:30:24.531 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T06:30:24.597 INFO:teuthology.run_tasks:Running task print... 2024-09-19T06:30:24.610 INFO:teuthology.task.print:**** done install task... 2024-09-19T06:30:24.610 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-19T06:30:24.713 INFO:tasks.cephadm:Config: {'cephadm_branch': 'quincy', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}}, 'image': 'quay.ceph.io/ceph-ci/ceph:quincy', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'} 2024-09-19T06:30:24.713 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:quincy 2024-09-19T06:30:24.714 INFO:tasks.cephadm:Cluster fsid is a73eb958-7650-11ef-bceb-c7b262605968 2024-09-19T06:30:24.714 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-19T06:30:24.714 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-09-19T06:30:24.714 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi099': '172.21.15.99', 'mon.smithi117': '172.21.15.117'} 2024-09-19T06:30:24.714 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-19T06:30:24.715 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname $(hostname -s) 2024-09-19T06:30:24.740 DEBUG:teuthology.orchestra.run.smithi117:> sudo hostname $(hostname -s) 2024-09-19T06:30:24.766 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref quincy)... 2024-09-19T06:30:24.766 DEBUG:teuthology.orchestra.run.smithi099:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T06:30:24.974 INFO:teuthology.orchestra.run.smithi099.stdout:-rw-r--r--. 1 ubuntu ubuntu 378585 Sep 19 06:30 /home/ubuntu/cephtest/cephadm 2024-09-19T06:30:24.974 DEBUG:teuthology.orchestra.run.smithi117:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T06:30:25.103 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r--. 1 ubuntu ubuntu 378585 Sep 19 06:30 /home/ubuntu/cephtest/cephadm 2024-09-19T06:30:25.104 DEBUG:teuthology.orchestra.run.smithi099:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T06:30:25.120 DEBUG:teuthology.orchestra.run.smithi117:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T06:30:25.145 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:quincy on all hosts... 2024-09-19T06:30:25.146 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2024-09-19T06:30:25.162 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2024-09-19T06:30:26.755 INFO:teuthology.orchestra.run.smithi117.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-09-19T06:30:26.760 INFO:teuthology.orchestra.run.smithi099.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-09-19T06:30:57.024 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-09-19T06:30:57.025 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_version": "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)", 2024-09-19T06:30:57.025 INFO:teuthology.orchestra.run.smithi117.stdout: "image_id": "f63ad14e4e434a3de1d471d2841f01aa4ae27e9a9e20f9a042bea34292493ec9", 2024-09-19T06:30:57.025 INFO:teuthology.orchestra.run.smithi117.stdout: "repo_digests": [ 2024-09-19T06:30:57.025 INFO:teuthology.orchestra.run.smithi117.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:4d922a456af336b23156460d93b8143eb9c977eee7e72f2e9e44c816e5b46ac8" 2024-09-19T06:30:57.025 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2024-09-19T06:30:57.025 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-09-19T06:30:59.162 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:30:59.163 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_version": "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)", 2024-09-19T06:30:59.163 INFO:teuthology.orchestra.run.smithi099.stdout: "image_id": "f63ad14e4e434a3de1d471d2841f01aa4ae27e9a9e20f9a042bea34292493ec9", 2024-09-19T06:30:59.163 INFO:teuthology.orchestra.run.smithi099.stdout: "repo_digests": [ 2024-09-19T06:30:59.163 INFO:teuthology.orchestra.run.smithi099.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:4d922a456af336b23156460d93b8143eb9c977eee7e72f2e9e44c816e5b46ac8" 2024-09-19T06:30:59.163 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-19T06:30:59.163 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:30:59.181 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /etc/ceph 2024-09-19T06:30:59.236 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /etc/ceph 2024-09-19T06:30:59.268 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 777 /etc/ceph 2024-09-19T06:30:59.293 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 777 /etc/ceph 2024-09-19T06:30:59.338 INFO:tasks.cephadm:Writing seed config... 2024-09-19T06:30:59.340 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-09-19T06:30:59.340 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-09-19T06:30:59.340 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-19T06:30:59.340 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-19T06:30:59.340 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-19T06:30:59.340 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-19T06:30:59.340 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-19T06:30:59.341 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-19T06:30:59.341 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-19T06:30:59.341 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-19T06:30:59.341 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-19T06:30:59.341 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-19T06:30:59.341 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-19T06:30:59.341 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-19T06:30:59.341 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-19T06:30:59.341 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-19T06:30:59.341 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-19T06:30:59.341 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-19T06:30:59.341 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-19T06:30:59.341 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-19T06:30:59.341 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-19T06:30:59.342 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-19T06:30:59.342 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-19T06:30:59.342 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-09-19T06:30:59.342 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-19T06:30:59.342 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-19T06:30:59.342 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-19T06:30:59.342 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-19T06:30:59.342 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-19T06:30:59.342 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-19T06:30:59.342 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-19T06:30:59.342 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-19T06:30:59.342 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-19T06:30:59.343 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-19T06:30:59.343 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-19T06:30:59.343 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-19T06:30:59.343 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-19T06:30:59.343 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-19T06:30:59.343 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-19T06:30:59.343 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-19T06:30:59.343 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-19T06:30:59.343 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-19T06:30:59.343 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-19T06:30:59.344 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-19T06:30:59.344 DEBUG:teuthology.orchestra.run.smithi099:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-19T06:30:59.360 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = a73eb958-7650-11ef-bceb-c7b262605968 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-19T06:30:59.361 DEBUG:teuthology.orchestra.run.smithi099:mon.smithi099> sudo journalctl -f -n 0 -u ceph-a73eb958-7650-11ef-bceb-c7b262605968@mon.smithi099.service 2024-09-19T06:30:59.402 INFO:tasks.cephadm:Bootstrapping... 2024-09-19T06:30:59.403 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy -v bootstrap --fsid a73eb958-7650-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.99 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-19T06:30:59.600 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-09-19T06:30:59.601 INFO:teuthology.orchestra.run.smithi099.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:quincy', '-v', 'bootstrap', '--fsid', 'a73eb958-7650-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.99', '--skip-admin-label'] 2024-09-19T06:30:59.621 INFO:teuthology.orchestra.run.smithi099.stdout:/bin/podman: stdout 5.2.2 2024-09-19T06:30:59.621 INFO:teuthology.orchestra.run.smithi099.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-19T06:30:59.622 INFO:teuthology.orchestra.run.smithi099.stdout:Verifying podman|docker is present... 2024-09-19T06:30:59.643 INFO:teuthology.orchestra.run.smithi099.stdout:/bin/podman: stdout 5.2.2 2024-09-19T06:30:59.643 INFO:teuthology.orchestra.run.smithi099.stdout:Verifying lvm2 is present... 2024-09-19T06:30:59.643 INFO:teuthology.orchestra.run.smithi099.stdout:Verifying time synchronization is in place... 2024-09-19T06:30:59.651 INFO:teuthology.orchestra.run.smithi099.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-19T06:30:59.651 INFO:teuthology.orchestra.run.smithi099.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-19T06:30:59.658 INFO:teuthology.orchestra.run.smithi099.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-19T06:30:59.658 INFO:teuthology.orchestra.run.smithi099.stdout:systemctl: stdout inactive 2024-09-19T06:30:59.665 INFO:teuthology.orchestra.run.smithi099.stdout:systemctl: stdout enabled 2024-09-19T06:30:59.672 INFO:teuthology.orchestra.run.smithi099.stdout:systemctl: stdout active 2024-09-19T06:30:59.672 INFO:teuthology.orchestra.run.smithi099.stdout:Unit chronyd.service is enabled and running 2024-09-19T06:30:59.672 INFO:teuthology.orchestra.run.smithi099.stdout:Repeating the final host check... 2024-09-19T06:30:59.694 INFO:teuthology.orchestra.run.smithi099.stdout:/bin/podman: stdout 5.2.2 2024-09-19T06:30:59.694 INFO:teuthology.orchestra.run.smithi099.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-19T06:30:59.694 INFO:teuthology.orchestra.run.smithi099.stdout:systemctl is present 2024-09-19T06:30:59.695 INFO:teuthology.orchestra.run.smithi099.stdout:lvcreate is present 2024-09-19T06:30:59.701 INFO:teuthology.orchestra.run.smithi099.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-19T06:30:59.701 INFO:teuthology.orchestra.run.smithi099.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-19T06:30:59.707 INFO:teuthology.orchestra.run.smithi099.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-19T06:30:59.707 INFO:teuthology.orchestra.run.smithi099.stdout:systemctl: stdout inactive 2024-09-19T06:30:59.714 INFO:teuthology.orchestra.run.smithi099.stdout:systemctl: stdout enabled 2024-09-19T06:30:59.721 INFO:teuthology.orchestra.run.smithi099.stdout:systemctl: stdout active 2024-09-19T06:30:59.721 INFO:teuthology.orchestra.run.smithi099.stdout:Unit chronyd.service is enabled and running 2024-09-19T06:30:59.722 INFO:teuthology.orchestra.run.smithi099.stdout:Host looks OK 2024-09-19T06:30:59.722 INFO:teuthology.orchestra.run.smithi099.stdout:Cluster fsid: a73eb958-7650-11ef-bceb-c7b262605968 2024-09-19T06:30:59.722 INFO:teuthology.orchestra.run.smithi099.stdout:Acquiring lock 140070076875104 on /run/cephadm/a73eb958-7650-11ef-bceb-c7b262605968.lock 2024-09-19T06:30:59.722 INFO:teuthology.orchestra.run.smithi099.stdout:Lock 140070076875104 acquired on /run/cephadm/a73eb958-7650-11ef-bceb-c7b262605968.lock 2024-09-19T06:30:59.722 INFO:teuthology.orchestra.run.smithi099.stdout:Verifying IP 172.21.15.99 port 3300 ... 2024-09-19T06:30:59.722 INFO:teuthology.orchestra.run.smithi099.stdout:Verifying IP 172.21.15.99 port 6789 ... 2024-09-19T06:30:59.722 INFO:teuthology.orchestra.run.smithi099.stdout:Base mon IP(s) is [172.21.15.99:3300, 172.21.15.99:6789], mon addrv is [v2:172.21.15.99:3300,v1:172.21.15.99:6789] 2024-09-19T06:30:59.726 INFO:teuthology.orchestra.run.smithi099.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.99 metric 100 2024-09-19T06:30:59.726 INFO:teuthology.orchestra.run.smithi099.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.99 metric 100 2024-09-19T06:30:59.729 INFO:teuthology.orchestra.run.smithi099.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-19T06:30:59.729 INFO:teuthology.orchestra.run.smithi099.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-09-19T06:30:59.729 INFO:teuthology.orchestra.run.smithi099.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-09-19T06:30:59.732 INFO:teuthology.orchestra.run.smithi099.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-19T06:30:59.732 INFO:teuthology.orchestra.run.smithi099.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-19T06:30:59.732 INFO:teuthology.orchestra.run.smithi099.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-19T06:30:59.732 INFO:teuthology.orchestra.run.smithi099.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-19T06:30:59.732 INFO:teuthology.orchestra.run.smithi099.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:d803/64 scope link noprefixroute 2024-09-19T06:30:59.732 INFO:teuthology.orchestra.run.smithi099.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-19T06:30:59.733 INFO:teuthology.orchestra.run.smithi099.stdout:Mon IP `172.21.15.99` is in CIDR network `172.21.0.0/20` 2024-09-19T06:30:59.733 INFO:teuthology.orchestra.run.smithi099.stdout:Mon IP `172.21.15.99` is in CIDR network `172.21.0.0/20` 2024-09-19T06:30:59.733 INFO:teuthology.orchestra.run.smithi099.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-19T06:30:59.733 INFO:teuthology.orchestra.run.smithi099.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-19T06:30:59.734 INFO:teuthology.orchestra.run.smithi099.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-09-19T06:31:00.213 INFO:teuthology.orchestra.run.smithi099.stdout:/bin/podman: stdout f63ad14e4e434a3de1d471d2841f01aa4ae27e9a9e20f9a042bea34292493ec9 2024-09-19T06:31:00.213 INFO:teuthology.orchestra.run.smithi099.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:quincy... 2024-09-19T06:31:00.213 INFO:teuthology.orchestra.run.smithi099.stdout:/bin/podman: stderr Getting image source signatures 2024-09-19T06:31:00.213 INFO:teuthology.orchestra.run.smithi099.stdout:/bin/podman: stderr Copying blob sha256:a57b58ef5be3c9891294d677a25cda6c34cb1998d8001d986a2725631ea2d32e 2024-09-19T06:31:00.213 INFO:teuthology.orchestra.run.smithi099.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-19T06:31:00.213 INFO:teuthology.orchestra.run.smithi099.stdout:/bin/podman: stderr Copying config sha256:f63ad14e4e434a3de1d471d2841f01aa4ae27e9a9e20f9a042bea34292493ec9 2024-09-19T06:31:00.213 INFO:teuthology.orchestra.run.smithi099.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-19T06:31:01.110 INFO:teuthology.orchestra.run.smithi099.stdout:ceph: stdout ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable) 2024-09-19T06:31:01.110 INFO:teuthology.orchestra.run.smithi099.stdout:Ceph version: ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable) 2024-09-19T06:31:01.110 INFO:teuthology.orchestra.run.smithi099.stdout:Extracting ceph user uid/gid from container image... 2024-09-19T06:31:02.115 INFO:teuthology.orchestra.run.smithi099.stdout:stat: stdout 167 167 2024-09-19T06:31:02.115 INFO:teuthology.orchestra.run.smithi099.stdout:Creating initial keys... 2024-09-19T06:31:03.021 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph-authtool: stdout AQAmxetmoDb7GRAADHY+GKiv/a5eELn7ha7Hlw== 2024-09-19T06:31:03.902 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph-authtool: stdout AQAnxetmhKHhExAAKd4VboDIchqTdS6mKMJZ7A== 2024-09-19T06:31:04.757 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph-authtool: stdout AQAoxetmOGrPDBAATGJGtd9PFLalxl6clRu89g== 2024-09-19T06:31:04.758 INFO:teuthology.orchestra.run.smithi099.stdout:Creating initial monmap... 2024-09-19T06:31:05.665 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-19T06:31:05.665 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = octopus 2024-09-19T06:31:05.665 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to a73eb958-7650-11ef-bceb-c7b262605968 2024-09-19T06:31:05.665 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-19T06:31:05.665 INFO:teuthology.orchestra.run.smithi099.stdout:monmaptool for smithi099 [v2:172.21.15.99:3300,v1:172.21.15.99:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-19T06:31:05.665 INFO:teuthology.orchestra.run.smithi099.stdout:setting min_mon_release = octopus 2024-09-19T06:31:05.665 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/monmaptool: set fsid to a73eb958-7650-11ef-bceb-c7b262605968 2024-09-19T06:31:05.666 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-19T06:31:05.666 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:31:05.666 INFO:teuthology.orchestra.run.smithi099.stdout:Creating mon... 2024-09-19T06:31:06.580 INFO:teuthology.orchestra.run.smithi099.stdout:create mon.smithi099 on 2024-09-19T06:31:06.773 INFO:teuthology.orchestra.run.smithi099.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-19T06:31:06.911 INFO:teuthology.orchestra.run.smithi099.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-19T06:31:07.059 INFO:teuthology.orchestra.run.smithi099.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-a73eb958-7650-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-a73eb958-7650-11ef-bceb-c7b262605968.target. 2024-09-19T06:31:07.059 INFO:teuthology.orchestra.run.smithi099.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-a73eb958-7650-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-a73eb958-7650-11ef-bceb-c7b262605968.target. 2024-09-19T06:31:07.223 INFO:teuthology.orchestra.run.smithi099.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-a73eb958-7650-11ef-bceb-c7b262605968@mon.smithi099 2024-09-19T06:31:07.223 INFO:teuthology.orchestra.run.smithi099.stdout:systemctl: stderr Failed to reset failed state of unit ceph-a73eb958-7650-11ef-bceb-c7b262605968@mon.smithi099.service: Unit ceph-a73eb958-7650-11ef-bceb-c7b262605968@mon.smithi099.service not loaded. 2024-09-19T06:31:07.380 INFO:teuthology.orchestra.run.smithi099.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-a73eb958-7650-11ef-bceb-c7b262605968.target.wants/ceph-a73eb958-7650-11ef-bceb-c7b262605968@mon.smithi099.service → /etc/systemd/system/ceph-a73eb958-7650-11ef-bceb-c7b262605968@.service. 2024-09-19T06:31:07.868 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:07 smithi099 podman[27255]: 2024-09-19 06:31:07.83270923 +0000 UTC m=+0.337705581 container start b662b1f28400e2dbb8be7839d817d888664c9f41e90de121f845c835737fafc2 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-mon-smithi099, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=quincy-6e06d1e, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-19T06:31:07.936 INFO:teuthology.orchestra.run.smithi099.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T06:31:07.936 INFO:teuthology.orchestra.run.smithi099.stdout:systemctl: stdout disabled 2024-09-19T06:31:07.943 INFO:teuthology.orchestra.run.smithi099.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T06:31:07.943 INFO:teuthology.orchestra.run.smithi099.stdout:systemctl: stdout inactive 2024-09-19T06:31:07.943 INFO:teuthology.orchestra.run.smithi099.stdout:firewalld.service is not enabled 2024-09-19T06:31:07.943 INFO:teuthology.orchestra.run.smithi099.stdout:Not possible to enable service . firewalld.service is not available 2024-09-19T06:31:07.944 INFO:teuthology.orchestra.run.smithi099.stdout:Waiting for mon to start... 2024-09-19T06:31:07.944 INFO:teuthology.orchestra.run.smithi099.stdout:Waiting for mon... 2024-09-19T06:31:08.170 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:07 smithi099 ceph-mon[27274]: mkfs a73eb958-7650-11ef-bceb-c7b262605968 2024-09-19T06:31:08.170 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:07 smithi099 ceph-mon[27274]: mon.smithi099 is new leader, mons smithi099 in quorum (ranks 0) 2024-09-19T06:31:08.170 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:07 smithi099 bash[27255]: b662b1f28400e2dbb8be7839d817d888664c9f41e90de121f845c835737fafc2 2024-09-19T06:31:08.171 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:07 smithi099 systemd[1]: Started Ceph mon.smithi099 for a73eb958-7650-11ef-bceb-c7b262605968. 2024-09-19T06:31:09.004 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout cluster: 2024-09-19T06:31:09.004 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout id: a73eb958-7650-11ef-bceb-c7b262605968 2024-09-19T06:31:09.004 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-19T06:31:09.005 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout 2024-09-19T06:31:09.005 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout services: 2024-09-19T06:31:09.005 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi099 (age 0.563726s) 2024-09-19T06:31:09.005 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-19T06:31:09.005 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-19T06:31:09.005 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout 2024-09-19T06:31:09.005 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout data: 2024-09-19T06:31:09.005 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-19T06:31:09.005 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-19T06:31:09.005 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-19T06:31:09.005 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout pgs: 2024-09-19T06:31:09.005 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout 2024-09-19T06:31:09.006 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:08.358+0000 7fe705267640 1 Processor -- start 2024-09-19T06:31:09.006 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:08.358+0000 7fe705267640 1 -- start start 2024-09-19T06:31:09.006 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:08.358+0000 7fe705267640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe700100e90 0x7fe7001012a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:09.006 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:08.358+0000 7fe705267640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7001017e0 con 0x7fe700100e90 2024-09-19T06:31:09.006 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:08.359+0000 7fe6feffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe700100e90 0x7fe7001012a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:09.006 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:08.359+0000 7fe6feffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe700100e90 0x7fe7001012a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:39308/0 (socket says 172.21.15.99:39308) 2024-09-19T06:31:09.006 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:08.359+0000 7fe6feffd640 1 -- 172.21.15.99:0/284401211 learned_addr learned my addr 172.21.15.99:0/284401211 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:31:09.006 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:08.359+0000 7fe6feffd640 1 -- 172.21.15.99:0/284401211 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe700101920 con 0x7fe700100e90 2024-09-19T06:31:09.006 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:08.361+0000 7fe6feffd640 1 --2- 172.21.15.99:0/284401211 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe700100e90 0x7fe7001012a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fe6f800baf0 tx=0x7fe6f800b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9de573700e926be server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:09.006 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:08.361+0000 7fe6fdffb640 1 -- 172.21.15.99:0/284401211 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe6f8031790 con 0x7fe700100e90 2024-09-19T06:31:09.006 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:08.361+0000 7fe6fdffb640 1 -- 172.21.15.99:0/284401211 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6f80318f0 con 0x7fe700100e90 2024-09-19T06:31:09.006 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:08.361+0000 7fe6fdffb640 1 -- 172.21.15.99:0/284401211 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe6f8031c20 con 0x7fe700100e90 2024-09-19T06:31:09.007 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:08.362+0000 7fe705267640 1 -- 172.21.15.99:0/284401211 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe700100e90 msgr2=0x7fe7001012a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:09.007 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:08.362+0000 7fe705267640 1 --2- 172.21.15.99:0/284401211 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe700100e90 0x7fe7001012a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fe6f800baf0 tx=0x7fe6f800b460 comp rx=0 tx=0).stop 2024-09-19T06:31:09.007 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:08.362+0000 7fe705267640 1 -- 172.21.15.99:0/284401211 shutdown_connections 2024-09-19T06:31:09.007 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:08.362+0000 7fe705267640 1 --2- 172.21.15.99:0/284401211 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe700100e90 0x7fe7001012a0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:09.007 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:08.362+0000 7fe705267640 1 -- 172.21.15.99:0/284401211 >> 172.21.15.99:0/284401211 conn(0x7fe7000fc6d0 msgr2=0x7fe7000feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:09.007 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:08.362+0000 7fe705267640 1 -- 172.21.15.99:0/284401211 shutdown_connections 2024-09-19T06:31:09.007 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:08.362+0000 7fe705267640 1 -- 172.21.15.99:0/284401211 wait complete. 2024-09-19T06:31:09.007 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:08.363+0000 7fe705267640 1 Processor -- start 2024-09-19T06:31:09.007 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:08.363+0000 7fe705267640 1 -- start start 2024-09-19T06:31:09.007 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:08.363+0000 7fe705267640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe700100e90 0x7fe70010e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:09.007 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:08.363+0000 7fe705267640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe70010e890 con 0x7fe700100e90 2024-09-19T06:31:09.007 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:08.363+0000 7fe6feffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe700100e90 0x7fe70010e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:09.007 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:08.363+0000 7fe6feffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe700100e90 0x7fe70010e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:39318/0 (socket says 172.21.15.99:39318) 2024-09-19T06:31:09.008 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:08.363+0000 7fe6feffd640 1 -- 172.21.15.99:0/2344704505 learned_addr learned my addr 172.21.15.99:0/2344704505 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:31:09.008 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:08.363+0000 7fe6feffd640 1 -- 172.21.15.99:0/2344704505 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f800b700 con 0x7fe700100e90 2024-09-19T06:31:09.008 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:08.363+0000 7fe6feffd640 1 --2- 172.21.15.99:0/2344704505 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe700100e90 0x7fe70010e350 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fe6f800b4a0 tx=0x7fe6f803a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:09.008 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:08.364+0000 7fe6e77fe640 1 -- 172.21.15.99:0/2344704505 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe6f803ae30 con 0x7fe700100e90 2024-09-19T06:31:09.008 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:08.364+0000 7fe6e77fe640 1 -- 172.21.15.99:0/2344704505 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6f8040040 con 0x7fe700100e90 2024-09-19T06:31:09.008 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:08.364+0000 7fe6e77fe640 1 -- 172.21.15.99:0/2344704505 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe6f8044590 con 0x7fe700100e90 2024-09-19T06:31:09.008 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:08.364+0000 7fe705267640 1 -- 172.21.15.99:0/2344704505 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe70010ea90 con 0x7fe700100e90 2024-09-19T06:31:09.008 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:08.364+0000 7fe705267640 1 -- 172.21.15.99:0/2344704505 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe70010ef00 con 0x7fe700100e90 2024-09-19T06:31:09.008 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:08.364+0000 7fe6e77fe640 1 -- 172.21.15.99:0/2344704505 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fe6f8044780 con 0x7fe700100e90 2024-09-19T06:31:09.008 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:08.364+0000 7fe6e77fe640 1 -- 172.21.15.99:0/2344704505 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fe6f804e850 con 0x7fe700100e90 2024-09-19T06:31:09.008 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:08.365+0000 7fe705267640 1 -- 172.21.15.99:0/2344704505 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe70004b720 con 0x7fe700100e90 2024-09-19T06:31:09.008 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:08.367+0000 7fe6e77fe640 1 -- 172.21.15.99:0/2344704505 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fe70010ef00 con 0x7fe700100e90 2024-09-19T06:31:09.009 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:08.427+0000 7fe705267640 1 -- 172.21.15.99:0/2344704505 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7fe700107b30 con 0x7fe700100e90 2024-09-19T06:31:09.009 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:08.427+0000 7fe6e77fe640 1 -- 172.21.15.99:0/2344704505 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+325 (secure 0 0 0) 0x7fe6f8035070 con 0x7fe700100e90 2024-09-19T06:31:09.009 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:08.428+0000 7fe705267640 1 -- 172.21.15.99:0/2344704505 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe700100e90 msgr2=0x7fe70010e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:09.009 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:08.428+0000 7fe705267640 1 --2- 172.21.15.99:0/2344704505 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe700100e90 0x7fe70010e350 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fe6f800b4a0 tx=0x7fe6f803a000 comp rx=0 tx=0).stop 2024-09-19T06:31:09.009 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:08.428+0000 7fe705267640 1 -- 172.21.15.99:0/2344704505 shutdown_connections 2024-09-19T06:31:09.009 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:08.428+0000 7fe705267640 1 --2- 172.21.15.99:0/2344704505 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe700100e90 0x7fe70010e350 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:09.009 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:08.428+0000 7fe705267640 1 -- 172.21.15.99:0/2344704505 >> 172.21.15.99:0/2344704505 conn(0x7fe7000fc6d0 msgr2=0x7fe700105290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:09.009 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:08.428+0000 7fe705267640 1 -- 172.21.15.99:0/2344704505 shutdown_connections 2024-09-19T06:31:09.009 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:08.428+0000 7fe705267640 1 -- 172.21.15.99:0/2344704505 wait complete. 2024-09-19T06:31:09.009 INFO:teuthology.orchestra.run.smithi099.stdout:mon is available 2024-09-19T06:31:09.009 INFO:teuthology.orchestra.run.smithi099.stdout:Assimilating anything we can from ceph.conf... 2024-09-19T06:31:09.121 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:08 smithi099 ceph-mon[27274]: mon.smithi099 is new leader, mons smithi099 in quorum (ranks 0) 2024-09-19T06:31:09.121 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:08 smithi099 ceph-mon[27274]: monmap e1: 1 mons at {smithi099=[v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-19T06:31:09.121 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:08 smithi099 ceph-mon[27274]: fsmap 2024-09-19T06:31:09.121 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:08 smithi099 ceph-mon[27274]: osdmap e1: 0 total, 0 up, 0 in 2024-09-19T06:31:09.121 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:08 smithi099 ceph-mon[27274]: mgrmap e1: no daemons active 2024-09-19T06:31:09.121 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:08 smithi099 ceph-mon[27274]: from='client.? 172.21.15.99:0/2344704505' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-19T06:31:09.986 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout 2024-09-19T06:31:09.986 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout [global] 2024-09-19T06:31:09.986 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout fsid = a73eb958-7650-11ef-bceb-c7b262605968 2024-09-19T06:31:09.986 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-19T06:31:09.986 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.99:3300,v1:172.21.15.99:6789] 2024-09-19T06:31:09.986 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-19T06:31:09.986 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-19T06:31:09.986 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-19T06:31:09.986 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-19T06:31:09.986 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout 2024-09-19T06:31:09.986 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-19T06:31:09.987 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-19T06:31:09.987 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout 2024-09-19T06:31:09.987 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout [osd] 2024-09-19T06:31:09.987 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-19T06:31:09.987 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-19T06:31:09.987 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-19T06:31:09.987 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-19T06:31:09.987 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-19T06:31:09.987 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.371+0000 7f8ef6b16640 1 Processor -- start 2024-09-19T06:31:09.987 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.371+0000 7f8ef6b16640 1 -- start start 2024-09-19T06:31:09.987 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.372+0000 7f8ef6b16640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ef0076b30 0x7f8ef0104bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:09.987 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.372+0000 7f8ef6b16640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef0076f40 con 0x7f8ef0076b30 2024-09-19T06:31:09.987 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.372+0000 7f8ef48b2640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ef0076b30 0x7f8ef0104bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:09.988 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.372+0000 7f8ef48b2640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ef0076b30 0x7f8ef0104bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:39322/0 (socket says 172.21.15.99:39322) 2024-09-19T06:31:09.988 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.372+0000 7f8ef48b2640 1 -- 172.21.15.99:0/3627879553 learned_addr learned my addr 172.21.15.99:0/3627879553 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:31:09.988 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.372+0000 7f8ef48b2640 1 -- 172.21.15.99:0/3627879553 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ef0105100 con 0x7f8ef0076b30 2024-09-19T06:31:09.988 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.373+0000 7f8ef48b2640 1 --2- 172.21.15.99:0/3627879553 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ef0076b30 0x7f8ef0104bc0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f8ee4009840 tx=0x7f8ee40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=126937fd2a10faab server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:09.988 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.373+0000 7f8eef7fe640 1 -- 172.21.15.99:0/3627879553 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8ee4032440 con 0x7f8ef0076b30 2024-09-19T06:31:09.988 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.373+0000 7f8eef7fe640 1 -- 172.21.15.99:0/3627879553 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ee40325a0 con 0x7f8ef0076b30 2024-09-19T06:31:09.988 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.373+0000 7f8eef7fe640 1 -- 172.21.15.99:0/3627879553 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8ee4032890 con 0x7f8ef0076b30 2024-09-19T06:31:09.988 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.374+0000 7f8ef6b16640 1 -- 172.21.15.99:0/3627879553 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ef0076b30 msgr2=0x7f8ef0104bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:09.988 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.374+0000 7f8ef6b16640 1 --2- 172.21.15.99:0/3627879553 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ef0076b30 0x7f8ef0104bc0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f8ee4009840 tx=0x7f8ee40091d0 comp rx=0 tx=0).stop 2024-09-19T06:31:09.988 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.374+0000 7f8ef6b16640 1 -- 172.21.15.99:0/3627879553 shutdown_connections 2024-09-19T06:31:09.988 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.374+0000 7f8ef6b16640 1 --2- 172.21.15.99:0/3627879553 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ef0076b30 0x7f8ef0104bc0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:09.988 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.374+0000 7f8ef6b16640 1 -- 172.21.15.99:0/3627879553 >> 172.21.15.99:0/3627879553 conn(0x7f8ef00fc6d0 msgr2=0x7f8ef00feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:09.989 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.374+0000 7f8ef6b16640 1 -- 172.21.15.99:0/3627879553 shutdown_connections 2024-09-19T06:31:09.989 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.374+0000 7f8ef6b16640 1 -- 172.21.15.99:0/3627879553 wait complete. 2024-09-19T06:31:09.989 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.374+0000 7f8ef6b16640 1 Processor -- start 2024-09-19T06:31:09.989 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.374+0000 7f8ef6b16640 1 -- start start 2024-09-19T06:31:09.989 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.375+0000 7f8ef6b16640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ef0076b30 0x7f8ef01024f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:09.989 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.375+0000 7f8ef6b16640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef0102a30 con 0x7f8ef0076b30 2024-09-19T06:31:09.989 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.375+0000 7f8ef48b2640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ef0076b30 0x7f8ef01024f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:09.989 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.375+0000 7f8ef48b2640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ef0076b30 0x7f8ef01024f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:39332/0 (socket says 172.21.15.99:39332) 2024-09-19T06:31:09.989 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.375+0000 7f8ef48b2640 1 -- 172.21.15.99:0/1040446270 learned_addr learned my addr 172.21.15.99:0/1040446270 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:31:09.989 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.375+0000 7f8ef48b2640 1 -- 172.21.15.99:0/1040446270 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ee4009450 con 0x7f8ef0076b30 2024-09-19T06:31:09.989 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.375+0000 7f8ef48b2640 1 --2- 172.21.15.99:0/1040446270 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ef0076b30 0x7f8ef01024f0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f8ee402a790 tx=0x7f8ee4032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:09.989 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.375+0000 7f8eed7fa640 1 -- 172.21.15.99:0/1040446270 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8ee4031be0 con 0x7f8ef0076b30 2024-09-19T06:31:09.990 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.375+0000 7f8eed7fa640 1 -- 172.21.15.99:0/1040446270 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ee4031d40 con 0x7f8ef0076b30 2024-09-19T06:31:09.990 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.375+0000 7f8eed7fa640 1 -- 172.21.15.99:0/1040446270 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8ee403b5a0 con 0x7f8ef0076b30 2024-09-19T06:31:09.990 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.375+0000 7f8ef6b16640 1 -- 172.21.15.99:0/1040446270 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ef0100ac0 con 0x7f8ef0076b30 2024-09-19T06:31:09.990 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.375+0000 7f8ef6b16640 1 -- 172.21.15.99:0/1040446270 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ef0100ed0 con 0x7f8ef0076b30 2024-09-19T06:31:09.990 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.375+0000 7f8eed7fa640 1 -- 172.21.15.99:0/1040446270 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f8ee4039040 con 0x7f8ef0076b30 2024-09-19T06:31:09.990 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.376+0000 7f8eed7fa640 1 -- 172.21.15.99:0/1040446270 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f8ee4041030 con 0x7f8ef0076b30 2024-09-19T06:31:09.990 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.376+0000 7f8ef6b16640 1 -- 172.21.15.99:0/1040446270 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ef004b720 con 0x7f8ef0076b30 2024-09-19T06:31:09.990 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.378+0000 7f8eed7fa640 1 -- 172.21.15.99:0/1040446270 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f8ee402ae60 con 0x7f8ef0076b30 2024-09-19T06:31:09.990 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.436+0000 7f8ef6b16640 1 -- 172.21.15.99:0/1040446270 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f8ef01018d0 con 0x7f8ef0076b30 2024-09-19T06:31:09.990 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.440+0000 7f8eed7fa640 1 -- 172.21.15.99:0/1040446270 <== mon.0 v2:172.21.15.99:3300/0 7 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f8ee404e7e0 con 0x7f8ef0076b30 2024-09-19T06:31:09.990 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.440+0000 7f8eed7fa640 1 -- 172.21.15.99:0/1040446270 <== mon.0 v2:172.21.15.99:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+465 (secure 0 0 0) 0x7f8ee4054d80 con 0x7f8ef0076b30 2024-09-19T06:31:09.990 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.441+0000 7f8ef6b16640 1 -- 172.21.15.99:0/1040446270 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ef0076b30 msgr2=0x7f8ef01024f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:09.990 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.441+0000 7f8ef6b16640 1 --2- 172.21.15.99:0/1040446270 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ef0076b30 0x7f8ef01024f0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f8ee402a790 tx=0x7f8ee4032000 comp rx=0 tx=0).stop 2024-09-19T06:31:09.991 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.441+0000 7f8ef6b16640 1 -- 172.21.15.99:0/1040446270 shutdown_connections 2024-09-19T06:31:09.991 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.441+0000 7f8ef6b16640 1 --2- 172.21.15.99:0/1040446270 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8ef0076b30 0x7f8ef01024f0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:09.991 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.441+0000 7f8ef6b16640 1 -- 172.21.15.99:0/1040446270 >> 172.21.15.99:0/1040446270 conn(0x7f8ef00fc6d0 msgr2=0x7f8ef00fd990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:09.991 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.441+0000 7f8ef6b16640 1 -- 172.21.15.99:0/1040446270 shutdown_connections 2024-09-19T06:31:09.991 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:09.441+0000 7f8ef6b16640 1 -- 172.21.15.99:0/1040446270 wait complete. 2024-09-19T06:31:09.991 INFO:teuthology.orchestra.run.smithi099.stdout:Generating new minimal ceph.conf... 2024-09-19T06:31:10.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:09 smithi099 ceph-mon[27274]: from='client.? 172.21.15.99:0/1040446270' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-19T06:31:10.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:09 smithi099 ceph-mon[27274]: from='client.? 172.21.15.99:0/1040446270' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-19T06:31:10.961 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.384+0000 7f978b9b7640 1 Processor -- start 2024-09-19T06:31:10.966 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.384+0000 7f978b9b7640 1 -- start start 2024-09-19T06:31:10.966 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.384+0000 7f978b9b7640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9784102070 0x7f9784102480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:10.967 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.384+0000 7f978b9b7640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97841029c0 con 0x7f9784102070 2024-09-19T06:31:10.967 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.384+0000 7f9789753640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9784102070 0x7f9784102480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:10.967 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.384+0000 7f9789753640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9784102070 0x7f9784102480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:39336/0 (socket says 172.21.15.99:39336) 2024-09-19T06:31:10.967 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.384+0000 7f9789753640 1 -- 172.21.15.99:0/3588921684 learned_addr learned my addr 172.21.15.99:0/3588921684 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:31:10.967 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.384+0000 7f9789753640 1 -- 172.21.15.99:0/3588921684 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9784102b00 con 0x7f9784102070 2024-09-19T06:31:10.967 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.385+0000 7f9789753640 1 --2- 172.21.15.99:0/3588921684 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9784102070 0x7f9784102480 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f9774009840 tx=0x7f97740091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27709996852514c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:10.967 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.385+0000 7f977bfff640 1 -- 172.21.15.99:0/3588921684 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9774032440 con 0x7f9784102070 2024-09-19T06:31:10.967 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.385+0000 7f977bfff640 1 -- 172.21.15.99:0/3588921684 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f9774032a00 con 0x7f9784102070 2024-09-19T06:31:10.967 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.385+0000 7f977bfff640 1 -- 172.21.15.99:0/3588921684 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9774031a10 con 0x7f9784102070 2024-09-19T06:31:10.967 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.386+0000 7f978b9b7640 1 -- 172.21.15.99:0/3588921684 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9784102070 msgr2=0x7f9784102480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:10.967 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.386+0000 7f978b9b7640 1 --2- 172.21.15.99:0/3588921684 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9784102070 0x7f9784102480 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f9774009840 tx=0x7f97740091d0 comp rx=0 tx=0).stop 2024-09-19T06:31:10.967 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.386+0000 7f978b9b7640 1 -- 172.21.15.99:0/3588921684 shutdown_connections 2024-09-19T06:31:10.967 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.386+0000 7f978b9b7640 1 --2- 172.21.15.99:0/3588921684 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9784102070 0x7f9784102480 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:10.968 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.386+0000 7f978b9b7640 1 -- 172.21.15.99:0/3588921684 >> 172.21.15.99:0/3588921684 conn(0x7f97840fd850 msgr2=0x7f97840ffc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:10.968 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.386+0000 7f978b9b7640 1 -- 172.21.15.99:0/3588921684 shutdown_connections 2024-09-19T06:31:10.968 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.386+0000 7f978b9b7640 1 -- 172.21.15.99:0/3588921684 wait complete. 2024-09-19T06:31:10.968 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.386+0000 7f978b9b7640 1 Processor -- start 2024-09-19T06:31:10.968 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.387+0000 7f978b9b7640 1 -- start start 2024-09-19T06:31:10.968 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.387+0000 7f978b9b7640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9784102070 0x7f9784110cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:10.968 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.387+0000 7f978b9b7640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9784111230 con 0x7f9784102070 2024-09-19T06:31:10.968 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.387+0000 7f9789753640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9784102070 0x7f9784110cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:10.968 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.387+0000 7f9789753640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9784102070 0x7f9784110cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:39338/0 (socket says 172.21.15.99:39338) 2024-09-19T06:31:10.968 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.387+0000 7f9789753640 1 -- 172.21.15.99:0/701622969 learned_addr learned my addr 172.21.15.99:0/701622969 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:31:10.968 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.387+0000 7f9789753640 1 -- 172.21.15.99:0/701622969 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9774009450 con 0x7f9784102070 2024-09-19T06:31:10.969 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.387+0000 7f9789753640 1 --2- 172.21.15.99:0/701622969 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9784102070 0x7f9784110cf0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f97740098a0 tx=0x7f977402c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:10.969 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.387+0000 7f9779ffb640 1 -- 172.21.15.99:0/701622969 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f97740327b0 con 0x7f9784102070 2024-09-19T06:31:10.969 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.387+0000 7f9779ffb640 1 -- 172.21.15.99:0/701622969 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f977403b870 con 0x7f9784102070 2024-09-19T06:31:10.969 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.387+0000 7f978b9b7640 1 -- 172.21.15.99:0/701622969 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9784111430 con 0x7f9784102070 2024-09-19T06:31:10.969 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.387+0000 7f9779ffb640 1 -- 172.21.15.99:0/701622969 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f977403a550 con 0x7f9784102070 2024-09-19T06:31:10.969 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.388+0000 7f978b9b7640 1 -- 172.21.15.99:0/701622969 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97841118a0 con 0x7f9784102070 2024-09-19T06:31:10.969 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.388+0000 7f9779ffb640 1 -- 172.21.15.99:0/701622969 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f9774039040 con 0x7f9784102070 2024-09-19T06:31:10.969 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.388+0000 7f9779ffb640 1 -- 172.21.15.99:0/701622969 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f97740447a0 con 0x7f9784102070 2024-09-19T06:31:10.969 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.389+0000 7f978b9b7640 1 -- 172.21.15.99:0/701622969 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f978404b720 con 0x7f9784102070 2024-09-19T06:31:10.969 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.391+0000 7f9779ffb640 1 -- 172.21.15.99:0/701622969 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f97841118a0 con 0x7f9784102070 2024-09-19T06:31:10.969 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.445+0000 7f978b9b7640 1 -- 172.21.15.99:0/701622969 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f9784111fc0 con 0x7f9784102070 2024-09-19T06:31:10.969 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.445+0000 7f9779ffb640 1 -- 172.21.15.99:0/701622969 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7f9774049060 con 0x7f9784102070 2024-09-19T06:31:10.970 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.446+0000 7f978b9b7640 1 -- 172.21.15.99:0/701622969 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9784102070 msgr2=0x7f9784110cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:10.970 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.446+0000 7f978b9b7640 1 --2- 172.21.15.99:0/701622969 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9784102070 0x7f9784110cf0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f97740098a0 tx=0x7f977402c040 comp rx=0 tx=0).stop 2024-09-19T06:31:10.970 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.446+0000 7f978b9b7640 1 -- 172.21.15.99:0/701622969 shutdown_connections 2024-09-19T06:31:10.970 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.446+0000 7f978b9b7640 1 --2- 172.21.15.99:0/701622969 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9784102070 0x7f9784110cf0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:10.970 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.446+0000 7f978b9b7640 1 -- 172.21.15.99:0/701622969 >> 172.21.15.99:0/701622969 conn(0x7f97840fd850 msgr2=0x7f97840fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:10.970 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.446+0000 7f978b9b7640 1 -- 172.21.15.99:0/701622969 shutdown_connections 2024-09-19T06:31:10.970 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:10.446+0000 7f978b9b7640 1 -- 172.21.15.99:0/701622969 wait complete. 2024-09-19T06:31:10.970 INFO:teuthology.orchestra.run.smithi099.stdout:Restarting the monitor... 2024-09-19T06:31:11.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:10 smithi099 ceph-mon[27274]: from='client.? 172.21.15.99:0/701622969' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:31:11.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:10 smithi099 systemd[1]: Stopping Ceph mon.smithi099 for a73eb958-7650-11ef-bceb-c7b262605968... 2024-09-19T06:31:11.679 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:11 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-mon-smithi099[27270]: 2024-09-19T06:31:11.252+0000 7ff16be1d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi099 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:31:11.679 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:11 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-mon-smithi099[27270]: 2024-09-19T06:31:11.252+0000 7ff16be1d640 -1 mon.smithi099@0(leader) e1 *** Got Signal Terminated *** 2024-09-19T06:31:11.679 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:11 smithi099 podman[27529]: 2024-09-19 06:31:11.40661509 +0000 UTC m=+0.268302336 container died b662b1f28400e2dbb8be7839d817d888664c9f41e90de121f845c835737fafc2 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-mon-smithi099, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-6e06d1e, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:31:11.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:11 smithi099 podman[27529]: 2024-09-19 06:31:11.777672443 +0000 UTC m=+0.639359675 container cleanup b662b1f28400e2dbb8be7839d817d888664c9f41e90de121f845c835737fafc2 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-mon-smithi099, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=quincy-6e06d1e, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2) 2024-09-19T06:31:11.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:11 smithi099 bash[27529]: ceph-a73eb958-7650-11ef-bceb-c7b262605968-mon-smithi099 2024-09-19T06:31:12.388 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 podman[27543]: 2024-09-19 06:31:12.037150643 +0000 UTC m=+0.627862050 container remove b662b1f28400e2dbb8be7839d817d888664c9f41e90de121f845c835737fafc2 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-mon-smithi099, RELEASE=quincy-6e06d1e, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-19T06:31:12.388 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 systemd[1]: ceph-a73eb958-7650-11ef-bceb-c7b262605968@mon.smithi099.service: Deactivated successfully. 2024-09-19T06:31:12.388 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 systemd[1]: Stopped Ceph mon.smithi099 for a73eb958-7650-11ef-bceb-c7b262605968. 2024-09-19T06:31:12.389 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 systemd[1]: Starting Ceph mon.smithi099 for a73eb958-7650-11ef-bceb-c7b262605968... 2024-09-19T06:31:12.654 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 podman[27633]: 2024-09-19 06:31:12.387762533 +0000 UTC m=+0.111559297 container create 7375c241d06759b2dc0543cd12b20d4bfcb158602f94adb764007b9dc99ec803 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-mon-smithi099, RELEASE=quincy-6e06d1e, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:31:12.654 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 podman[27633]: 2024-09-19 06:31:12.291925442 +0000 UTC m=+0.015722217 image pull f63ad14e4e434a3de1d471d2841f01aa4ae27e9a9e20f9a042bea34292493ec9 quay.ceph.io/ceph-ci/ceph:quincy 2024-09-19T06:31:12.654 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 podman[27633]: 2024-09-19 06:31:12.632208134 +0000 UTC m=+0.356004916 container init 7375c241d06759b2dc0543cd12b20d4bfcb158602f94adb764007b9dc99ec803 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-mon-smithi099, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=quincy-6e06d1e, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:31:12.654 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 podman[27633]: 2024-09-19 06:31:12.635256296 +0000 UTC m=+0.359053067 container start 7375c241d06759b2dc0543cd12b20d4bfcb158602f94adb764007b9dc99ec803 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-mon-smithi099, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=quincy-6e06d1e, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:31:12.745 INFO:teuthology.orchestra.run.smithi099.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-19T06:31:12.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: set uid:gid to 167:167 (ceph:ceph) 2024-09-19T06:31:12.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable), process ceph-mon, pid 2 2024-09-19T06:31:12.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: pidfile_write: ignore empty --pid-file 2024-09-19T06:31:12.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: load: jerasure load: lrc 2024-09-19T06:31:12.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: RocksDB version: 6.15.5 2024-09-19T06:31:12.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-09-19T06:31:12.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Compile date Sep 18 2024 2024-09-19T06:31:12.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: DB SUMMARY 2024-09-19T06:31:12.958 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: DB Session ID: 5XI3VK32BPF79SLNCQ3U 2024-09-19T06:31:12.958 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: CURRENT file: CURRENT 2024-09-19T06:31:12.958 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: IDENTITY file: IDENTITY 2024-09-19T06:31:12.958 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: MANIFEST file: MANIFEST-000009 size: 131 Bytes 2024-09-19T06:31:12.958 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi099/store.db dir, Total Num: 1, files: 000008.sst 2024-09-19T06:31:12.958 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi099/store.db: 000010.log size: 98118 ; 2024-09-19T06:31:12.958 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.error_if_exists: 0 2024-09-19T06:31:12.958 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.create_if_missing: 0 2024-09-19T06:31:12.958 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.paranoid_checks: 1 2024-09-19T06:31:12.958 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-19T06:31:12.958 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.env: 0x55d568de6440 2024-09-19T06:31:12.958 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.fs: Posix File System 2024-09-19T06:31:12.958 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.info_log: 0x55d56b0470c0 2024-09-19T06:31:12.959 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.max_file_opening_threads: 16 2024-09-19T06:31:12.959 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.statistics: (nil) 2024-09-19T06:31:12.959 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.use_fsync: 0 2024-09-19T06:31:12.959 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.max_log_file_size: 0 2024-09-19T06:31:12.959 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-19T06:31:12.959 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-19T06:31:12.959 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.keep_log_file_num: 1000 2024-09-19T06:31:12.959 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.recycle_log_file_num: 0 2024-09-19T06:31:12.959 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.allow_fallocate: 1 2024-09-19T06:31:12.959 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.allow_mmap_reads: 0 2024-09-19T06:31:12.959 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.allow_mmap_writes: 0 2024-09-19T06:31:12.959 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.use_direct_reads: 0 2024-09-19T06:31:12.959 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-19T06:31:12.960 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.create_missing_column_families: 0 2024-09-19T06:31:12.960 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.db_log_dir: 2024-09-19T06:31:12.960 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi099/store.db 2024-09-19T06:31:12.960 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-19T06:31:12.960 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-19T06:31:12.960 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-19T06:31:12.960 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-19T06:31:12.960 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-19T06:31:12.960 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-19T06:31:12.960 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.advise_random_on_open: 1 2024-09-19T06:31:12.960 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.db_write_buffer_size: 0 2024-09-19T06:31:12.960 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.write_buffer_manager: 0x55d56b104870 2024-09-19T06:31:12.960 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-19T06:31:12.961 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-09-19T06:31:12.961 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-19T06:31:12.961 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-19T06:31:12.961 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.rate_limiter: (nil) 2024-09-19T06:31:12.961 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-19T06:31:12.961 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.wal_recovery_mode: 2 2024-09-19T06:31:12.961 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.enable_thread_tracking: 0 2024-09-19T06:31:12.961 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.enable_pipelined_write: 0 2024-09-19T06:31:12.961 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.unordered_write: 0 2024-09-19T06:31:12.961 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-19T06:31:12.961 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-19T06:31:12.961 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-19T06:31:12.962 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-19T06:31:12.962 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.row_cache: None 2024-09-19T06:31:12.962 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.wal_filter: None 2024-09-19T06:31:12.962 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-19T06:31:12.962 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.allow_ingest_behind: 0 2024-09-19T06:31:12.962 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.preserve_deletes: 0 2024-09-19T06:31:12.962 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.two_write_queues: 0 2024-09-19T06:31:12.962 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.manual_wal_flush: 0 2024-09-19T06:31:12.962 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.atomic_flush: 0 2024-09-19T06:31:12.962 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-19T06:31:12.962 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-19T06:31:12.962 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-19T06:31:12.962 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.log_readahead_size: 0 2024-09-19T06:31:12.962 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-19T06:31:12.963 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.best_efforts_recovery: 0 2024-09-19T06:31:12.963 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-19T06:31:12.963 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-19T06:31:12.963 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.allow_data_in_errors: 0 2024-09-19T06:31:12.963 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.db_host_id: __hostname__ 2024-09-19T06:31:12.963 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.max_background_jobs: 2 2024-09-19T06:31:12.964 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.max_background_compactions: -1 2024-09-19T06:31:12.964 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.max_subcompactions: 1 2024-09-19T06:31:12.964 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-19T06:31:12.964 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-19T06:31:12.964 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-19T06:31:12.965 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.max_total_wal_size: 0 2024-09-19T06:31:12.965 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-19T06:31:12.965 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-19T06:31:12.965 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-19T06:31:12.965 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-19T06:31:12.965 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.max_open_files: -1 2024-09-19T06:31:12.965 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.bytes_per_sync: 0 2024-09-19T06:31:12.965 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-19T06:31:12.965 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-19T06:31:12.965 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.compaction_readahead_size: 0 2024-09-19T06:31:12.965 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.max_background_flushes: -1 2024-09-19T06:31:12.965 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Compression algorithms supported: 2024-09-19T06:31:12.965 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: kZSTD supported: 0 2024-09-19T06:31:12.965 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: kXpressCompression supported: 0 2024-09-19T06:31:12.966 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: kBZip2Compression supported: 0 2024-09-19T06:31:12.966 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-19T06:31:12.966 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: kLZ4Compression supported: 1 2024-09-19T06:31:12.966 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: kZlibCompression supported: 1 2024-09-19T06:31:12.966 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: kLZ4HCCompression supported: 1 2024-09-19T06:31:12.966 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: kSnappyCompression supported: 1 2024-09-19T06:31:12.966 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-19T06:31:12.966 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi099/store.db/MANIFEST-000009 2024-09-19T06:31:12.966 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2024-09-19T06:31:12.966 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-19T06:31:12.966 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.merge_operator: 2024-09-19T06:31:12.966 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.compaction_filter: None 2024-09-19T06:31:12.966 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.compaction_filter_factory: None 2024-09-19T06:31:12.966 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.sst_partitioner_factory: None 2024-09-19T06:31:12.967 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-19T06:31:12.967 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-19T06:31:12.967 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55d56afeda38) 2024-09-19T06:31:12.967 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: cache_index_and_filter_blocks: 1 2024-09-19T06:31:12.967 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-19T06:31:12.967 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-19T06:31:12.967 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: pin_top_level_index_and_filter: 1 2024-09-19T06:31:12.967 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: index_type: 0 2024-09-19T06:31:12.967 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: data_block_index_type: 0 2024-09-19T06:31:12.967 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: index_shortening: 1 2024-09-19T06:31:12.967 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-19T06:31:12.967 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: hash_index_allow_collision: 1 2024-09-19T06:31:12.967 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: checksum: 1 2024-09-19T06:31:12.967 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: no_block_cache: 0 2024-09-19T06:31:12.968 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: block_cache: 0x55d56b0231f0 2024-09-19T06:31:12.968 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: block_cache_name: BinnedLRUCache 2024-09-19T06:31:12.968 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: block_cache_options: 2024-09-19T06:31:12.968 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: capacity : 536870912 2024-09-19T06:31:12.968 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: num_shard_bits : 4 2024-09-19T06:31:12.968 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: strict_capacity_limit : 0 2024-09-19T06:31:12.968 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: high_pri_pool_ratio: 0.000 2024-09-19T06:31:12.968 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: block_cache_compressed: (nil) 2024-09-19T06:31:12.968 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: persistent_cache: (nil) 2024-09-19T06:31:12.968 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: block_size: 4096 2024-09-19T06:31:12.968 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: block_size_deviation: 10 2024-09-19T06:31:12.968 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: block_restart_interval: 16 2024-09-19T06:31:12.968 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: index_block_restart_interval: 1 2024-09-19T06:31:12.968 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: metadata_block_size: 4096 2024-09-19T06:31:12.969 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: partition_filters: 0 2024-09-19T06:31:12.969 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: use_delta_encoding: 1 2024-09-19T06:31:12.969 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2024-09-19T06:31:12.969 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: whole_key_filtering: 1 2024-09-19T06:31:12.969 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: verify_compression: 0 2024-09-19T06:31:12.969 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: read_amp_bytes_per_bit: 0 2024-09-19T06:31:12.969 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: format_version: 4 2024-09-19T06:31:12.969 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: enable_index_compression: 1 2024-09-19T06:31:12.969 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: block_align: 0 2024-09-19T06:31:12.969 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.write_buffer_size: 33554432 2024-09-19T06:31:12.969 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.max_write_buffer_number: 2 2024-09-19T06:31:12.969 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.compression: NoCompression 2024-09-19T06:31:12.969 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.bottommost_compression: Disabled 2024-09-19T06:31:12.970 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.prefix_extractor: nullptr 2024-09-19T06:31:12.970 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-19T06:31:12.970 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.num_levels: 7 2024-09-19T06:31:12.970 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-19T06:31:12.970 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-19T06:31:12.970 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-19T06:31:12.970 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-19T06:31:12.970 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-19T06:31:12.970 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-19T06:31:12.970 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-19T06:31:12.970 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-19T06:31:12.970 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-19T06:31:12.970 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-19T06:31:12.970 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-19T06:31:12.971 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.compression_opts.level: 32767 2024-09-19T06:31:12.971 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.compression_opts.strategy: 0 2024-09-19T06:31:12.971 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-19T06:31:12.971 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-19T06:31:12.971 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-19T06:31:12.971 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.compression_opts.enabled: false 2024-09-19T06:31:12.971 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-19T06:31:12.971 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-19T06:31:12.971 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-19T06:31:12.971 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.target_file_size_base: 67108864 2024-09-19T06:31:12.971 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-19T06:31:12.971 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-19T06:31:12.971 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-19T06:31:12.972 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-19T06:31:12.972 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-19T06:31:12.972 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-19T06:31:12.972 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-19T06:31:12.972 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-19T06:31:12.972 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-19T06:31:12.972 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-19T06:31:12.972 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-19T06:31:12.972 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-19T06:31:12.972 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-19T06:31:12.972 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.arena_block_size: 4194304 2024-09-19T06:31:12.972 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-19T06:31:12.972 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-19T06:31:12.972 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-09-19T06:31:12.973 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.disable_auto_compactions: 0 2024-09-19T06:31:12.973 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-19T06:31:12.973 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-19T06:31:12.973 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-19T06:31:12.973 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-19T06:31:12.973 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-19T06:31:12.973 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-19T06:31:12.973 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-19T06:31:12.973 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-19T06:31:12.973 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-19T06:31:12.973 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-19T06:31:12.973 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-19T06:31:12.973 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.inplace_update_support: 0 2024-09-19T06:31:12.973 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-19T06:31:12.974 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-19T06:31:12.974 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-19T06:31:12.974 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-19T06:31:12.974 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.bloom_locality: 0 2024-09-19T06:31:12.974 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.max_successive_merges: 0 2024-09-19T06:31:12.974 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-19T06:31:12.974 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.paranoid_file_checks: 0 2024-09-19T06:31:12.974 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.force_consistency_checks: 1 2024-09-19T06:31:12.974 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.report_bg_io_stats: 0 2024-09-19T06:31:12.974 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.ttl: 2592000 2024-09-19T06:31:12.974 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-19T06:31:12.974 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.enable_blob_files: false 2024-09-19T06:31:12.974 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.min_blob_size: 0 2024-09-19T06:31:12.974 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.blob_file_size: 268435456 2024-09-19T06:31:12.975 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-19T06:31:12.975 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-19T06:31:12.975 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-19T06:31:12.975 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi099/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 11, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-19T06:31:12.975 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 5 2024-09-19T06:31:12.975 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: [db/version_set.cc:4082] Creating manifest 13 2024-09-19T06:31:12.975 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726727472658912, "job": 1, "event": "recovery_started", "wal_files": [10]} 2024-09-19T06:31:12.975 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #10 mode 2 2024-09-19T06:31:12.975 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-09-19T06:31:12.975 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726727472660091, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 14, "file_size": 93350, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 91430, "index_size": 254, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13564, "raw_average_key_size": 49, "raw_value_size": 84012, "raw_average_value_size": 307, "num_data_blocks": 11, "num_entries": 273, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1726727472, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "941c0389-fc11-4bce-91b4-5987fd6cc181", "db_session_id": "5XI3VK32BPF79SLNCQ3U"}} 2024-09-19T06:31:12.975 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: [db/version_set.cc:4082] Creating manifest 15 2024-09-19T06:31:12.975 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726727472660544, "job": 1, "event": "recovery_finished"} 2024-09-19T06:31:12.975 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-smithi099/store.db/000010.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-19T06:31:12.976 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x55d56b056700 2024-09-19T06:31:12.976 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: DB pointer 0x55d56b026000 2024-09-19T06:31:12.976 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2024-09-19T06:31:12.976 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: rocksdb: [db/db_impl/db_impl.cc:903] 2024-09-19T06:31:12.976 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: ** DB Stats ** 2024-09-19T06:31:12.976 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T06:31:12.976 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-19T06:31:12.976 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T06:31:12.976 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T06:31:12.976 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-19T06:31:12.976 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-09-19T06:31:12.976 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T06:31:12.976 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: 2024-09-19T06:31:12.976 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: ** Compaction Stats [default] ** 2024-09-19T06:31:12.977 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-19T06:31:12.977 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-19T06:31:12.977 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: L0 2/0 92.99 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 114.6 0.00 0.00 1 0.001 0 0 2024-09-19T06:31:12.977 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Sum 2/0 92.99 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 114.6 0.00 0.00 1 0.001 0 0 2024-09-19T06:31:12.977 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 114.6 0.00 0.00 1 0.001 0 0 2024-09-19T06:31:12.977 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: 2024-09-19T06:31:12.977 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: ** Compaction Stats [default] ** 2024-09-19T06:31:12.977 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-19T06:31:12.977 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-19T06:31:12.977 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 114.6 0.00 0.00 1 0.001 0 0 2024-09-19T06:31:12.977 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T06:31:12.977 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-19T06:31:12.977 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-19T06:31:12.978 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-19T06:31:12.978 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-19T06:31:12.978 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-19T06:31:12.978 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Cumulative compaction: 0.00 GB write, 20.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T06:31:12.978 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Interval compaction: 0.00 GB write, 20.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T06:31:12.978 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-19T06:31:12.978 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: 2024-09-19T06:31:12.978 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-19T06:31:12.978 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: 2024-09-19T06:31:12.978 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: ** Compaction Stats [default] ** 2024-09-19T06:31:12.978 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-19T06:31:12.978 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-19T06:31:12.978 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: L0 2/0 92.99 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 114.6 0.00 0.00 1 0.001 0 0 2024-09-19T06:31:12.978 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Sum 2/0 92.99 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 114.6 0.00 0.00 1 0.001 0 0 2024-09-19T06:31:12.979 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-09-19T06:31:12.979 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: 2024-09-19T06:31:12.979 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: ** Compaction Stats [default] ** 2024-09-19T06:31:12.979 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-19T06:31:12.979 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-19T06:31:12.979 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 114.6 0.00 0.00 1 0.001 0 0 2024-09-19T06:31:12.979 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T06:31:12.979 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-19T06:31:12.979 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-19T06:31:12.979 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-19T06:31:12.979 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-19T06:31:12.979 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-19T06:31:12.979 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Cumulative compaction: 0.00 GB write, 20.46 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T06:31:12.979 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T06:31:12.980 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-19T06:31:12.980 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: 2024-09-19T06:31:12.980 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-19T06:31:12.980 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: starting mon.smithi099 rank 0 at public addrs [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] at bind addrs [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi099 fsid a73eb958-7650-11ef-bceb-c7b262605968 2024-09-19T06:31:12.980 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: mon.smithi099@-1(???) e1 preinit fsid a73eb958-7650-11ef-bceb-c7b262605968 2024-09-19T06:31:12.980 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: mon.smithi099@-1(???).mds e1 new map 2024-09-19T06:31:12.980 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: mon.smithi099@-1(???).mds e1 print_map 2024-09-19T06:31:12.980 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: e1 2024-09-19T06:31:12.980 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T06:31:12.980 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T06:31:12.980 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: legacy client fscid: -1 2024-09-19T06:31:12.980 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: 2024-09-19T06:31:12.981 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: No filesystems configured 2024-09-19T06:31:12.981 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: mon.smithi099@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-19T06:31:12.981 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: mon.smithi099@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T06:31:12.981 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: mon.smithi099@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T06:31:12.981 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: mon.smithi099@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T06:31:12.981 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: mon.smithi099@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-19T06:31:12.981 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: mon.smithi099 is new leader, mons smithi099 in quorum (ranks 0) 2024-09-19T06:31:12.981 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: monmap e1: 1 mons at {smithi099=[v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-19T06:31:12.981 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: fsmap 2024-09-19T06:31:12.981 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: osdmap e1: 0 total, 0 up, 0 in 2024-09-19T06:31:12.981 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 ceph-mon[27651]: mgrmap e1: no daemons active 2024-09-19T06:31:12.981 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 bash[27633]: 7375c241d06759b2dc0543cd12b20d4bfcb158602f94adb764007b9dc99ec803 2024-09-19T06:31:12.981 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:12 smithi099 systemd[1]: Started Ceph mon.smithi099 for a73eb958-7650-11ef-bceb-c7b262605968. 2024-09-19T06:31:13.723 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.154+0000 7fbda3963640 1 Processor -- start 2024-09-19T06:31:13.723 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.154+0000 7fbda3963640 1 -- start start 2024-09-19T06:31:13.723 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.154+0000 7fbda3963640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd9c078b50 0x7fbd9c077210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:13.723 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.154+0000 7fbda3963640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9c078f60 con 0x7fbd9c078b50 2024-09-19T06:31:13.724 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.154+0000 7fbda16ff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd9c078b50 0x7fbd9c077210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:13.724 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.155+0000 7fbda16ff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd9c078b50 0x7fbd9c077210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:39354/0 (socket says 172.21.15.99:39354) 2024-09-19T06:31:13.724 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.155+0000 7fbda16ff640 1 -- 172.21.15.99:0/3608657660 learned_addr learned my addr 172.21.15.99:0/3608657660 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:31:13.724 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.155+0000 7fbda16ff640 1 -- 172.21.15.99:0/3608657660 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd9c0790a0 con 0x7fbd9c078b50 2024-09-19T06:31:13.724 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.157+0000 7fbda16ff640 1 --2- 172.21.15.99:0/3608657660 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd9c078b50 0x7fbd9c077210 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c009840 tx=0x7fbd8c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c9cb747f7193f00 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:13.724 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.157+0000 7fbd93fff640 1 -- 172.21.15.99:0/3608657660 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbd8c032440 con 0x7fbd9c078b50 2024-09-19T06:31:13.724 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.157+0000 7fbd93fff640 1 -- 172.21.15.99:0/3608657660 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fbd8c032a00 con 0x7fbd9c078b50 2024-09-19T06:31:13.724 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.157+0000 7fbd93fff640 1 -- 172.21.15.99:0/3608657660 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbd8c031a10 con 0x7fbd9c078b50 2024-09-19T06:31:13.724 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.157+0000 7fbda3963640 1 -- 172.21.15.99:0/3608657660 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd9c078b50 msgr2=0x7fbd9c077210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:13.724 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.157+0000 7fbda3963640 1 --2- 172.21.15.99:0/3608657660 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd9c078b50 0x7fbd9c077210 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c009840 tx=0x7fbd8c0091d0 comp rx=0 tx=0).stop 2024-09-19T06:31:13.724 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.157+0000 7fbda3963640 1 -- 172.21.15.99:0/3608657660 shutdown_connections 2024-09-19T06:31:13.724 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.157+0000 7fbda3963640 1 --2- 172.21.15.99:0/3608657660 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd9c078b50 0x7fbd9c077210 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:13.724 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.157+0000 7fbda3963640 1 -- 172.21.15.99:0/3608657660 >> 172.21.15.99:0/3608657660 conn(0x7fbd9c0fd850 msgr2=0x7fbd9c0ffc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:13.725 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.157+0000 7fbda3963640 1 -- 172.21.15.99:0/3608657660 shutdown_connections 2024-09-19T06:31:13.725 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.158+0000 7fbda3963640 1 -- 172.21.15.99:0/3608657660 wait complete. 2024-09-19T06:31:13.725 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.158+0000 7fbda3963640 1 Processor -- start 2024-09-19T06:31:13.725 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.158+0000 7fbda3963640 1 -- start start 2024-09-19T06:31:13.725 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.158+0000 7fbda3963640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd9c078b50 0x7fbd9c112f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:13.725 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.158+0000 7fbda3963640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9c113460 con 0x7fbd9c078b50 2024-09-19T06:31:13.725 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.158+0000 7fbda16ff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd9c078b50 0x7fbd9c112f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:13.725 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.158+0000 7fbda16ff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd9c078b50 0x7fbd9c112f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:39366/0 (socket says 172.21.15.99:39366) 2024-09-19T06:31:13.725 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.158+0000 7fbda16ff640 1 -- 172.21.15.99:0/1259794264 learned_addr learned my addr 172.21.15.99:0/1259794264 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:31:13.725 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.159+0000 7fbda16ff640 1 -- 172.21.15.99:0/1259794264 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd8c009450 con 0x7fbd9c078b50 2024-09-19T06:31:13.725 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.159+0000 7fbda16ff640 1 --2- 172.21.15.99:0/1259794264 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd9c078b50 0x7fbd9c112f20 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c0098a0 tx=0x7fbd8c02c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:13.725 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.159+0000 7fbd91ffb640 1 -- 172.21.15.99:0/1259794264 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbd8c0327b0 con 0x7fbd9c078b50 2024-09-19T06:31:13.725 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.159+0000 7fbd91ffb640 1 -- 172.21.15.99:0/1259794264 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fbd8c03b870 con 0x7fbd9c078b50 2024-09-19T06:31:13.726 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.159+0000 7fbd91ffb640 1 -- 172.21.15.99:0/1259794264 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbd8c03a550 con 0x7fbd9c078b50 2024-09-19T06:31:13.726 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.159+0000 7fbda3963640 1 -- 172.21.15.99:0/1259794264 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd9c113660 con 0x7fbd9c078b50 2024-09-19T06:31:13.726 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.159+0000 7fbda3963640 1 -- 172.21.15.99:0/1259794264 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd9c113ad0 con 0x7fbd9c078b50 2024-09-19T06:31:13.726 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.159+0000 7fbd91ffb640 1 -- 172.21.15.99:0/1259794264 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fbd8c039040 con 0x7fbd9c078b50 2024-09-19T06:31:13.726 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.159+0000 7fbd91ffb640 1 -- 172.21.15.99:0/1259794264 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fbd8c0447e0 con 0x7fbd9c078b50 2024-09-19T06:31:13.726 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.160+0000 7fbda3963640 1 -- 172.21.15.99:0/1259794264 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd9c04b720 con 0x7fbd9c078b50 2024-09-19T06:31:13.726 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.162+0000 7fbd91ffb640 1 -- 172.21.15.99:0/1259794264 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fbd9c113ad0 con 0x7fbd9c078b50 2024-09-19T06:31:13.726 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.216+0000 7fbda3963640 1 -- 172.21.15.99:0/1259794264 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7fbd9c108140 con 0x7fbd9c078b50 2024-09-19T06:31:13.726 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.218+0000 7fbd91ffb640 1 -- 172.21.15.99:0/1259794264 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7fbd8c049060 con 0x7fbd9c078b50 2024-09-19T06:31:13.726 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.219+0000 7fbda3963640 1 -- 172.21.15.99:0/1259794264 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd9c078b50 msgr2=0x7fbd9c112f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:13.726 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.219+0000 7fbda3963640 1 --2- 172.21.15.99:0/1259794264 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd9c078b50 0x7fbd9c112f20 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c0098a0 tx=0x7fbd8c02c040 comp rx=0 tx=0).stop 2024-09-19T06:31:13.726 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.219+0000 7fbda3963640 1 -- 172.21.15.99:0/1259794264 shutdown_connections 2024-09-19T06:31:13.727 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.219+0000 7fbda3963640 1 --2- 172.21.15.99:0/1259794264 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbd9c078b50 0x7fbd9c112f20 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:13.727 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.219+0000 7fbda3963640 1 -- 172.21.15.99:0/1259794264 >> 172.21.15.99:0/1259794264 conn(0x7fbd9c0fd850 msgr2=0x7fbd9c0fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:13.727 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.219+0000 7fbda3963640 1 -- 172.21.15.99:0/1259794264 shutdown_connections 2024-09-19T06:31:13.727 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:13.219+0000 7fbda3963640 1 -- 172.21.15.99:0/1259794264 wait complete. 2024-09-19T06:31:13.727 INFO:teuthology.orchestra.run.smithi099.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-19T06:31:13.727 INFO:teuthology.orchestra.run.smithi099.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-19T06:31:13.727 INFO:teuthology.orchestra.run.smithi099.stdout:Creating mgr... 2024-09-19T06:31:13.727 INFO:teuthology.orchestra.run.smithi099.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-19T06:31:13.727 INFO:teuthology.orchestra.run.smithi099.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-19T06:31:13.727 INFO:teuthology.orchestra.run.smithi099.stdout:Verifying port 0.0.0.0:8443 ... 2024-09-19T06:31:13.891 INFO:teuthology.orchestra.run.smithi099.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-a73eb958-7650-11ef-bceb-c7b262605968@mgr.smithi099.pgvkqi 2024-09-19T06:31:13.892 INFO:teuthology.orchestra.run.smithi099.stdout:systemctl: stderr Failed to reset failed state of unit ceph-a73eb958-7650-11ef-bceb-c7b262605968@mgr.smithi099.pgvkqi.service: Unit ceph-a73eb958-7650-11ef-bceb-c7b262605968@mgr.smithi099.pgvkqi.service not loaded. 2024-09-19T06:31:14.043 INFO:teuthology.orchestra.run.smithi099.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-a73eb958-7650-11ef-bceb-c7b262605968.target.wants/ceph-a73eb958-7650-11ef-bceb-c7b262605968@mgr.smithi099.pgvkqi.service → /etc/systemd/system/ceph-a73eb958-7650-11ef-bceb-c7b262605968@.service. 2024-09-19T06:31:14.536 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:14 smithi099 ceph-mon[27651]: from='client.? 172.21.15.99:0/1259794264' entity='client.admin' 2024-09-19T06:31:14.659 INFO:teuthology.orchestra.run.smithi099.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T06:31:14.659 INFO:teuthology.orchestra.run.smithi099.stdout:systemctl: stdout disabled 2024-09-19T06:31:14.666 INFO:teuthology.orchestra.run.smithi099.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T06:31:14.667 INFO:teuthology.orchestra.run.smithi099.stdout:systemctl: stdout inactive 2024-09-19T06:31:14.667 INFO:teuthology.orchestra.run.smithi099.stdout:firewalld.service is not enabled 2024-09-19T06:31:14.667 INFO:teuthology.orchestra.run.smithi099.stdout:Not possible to enable service . firewalld.service is not available 2024-09-19T06:31:14.676 INFO:teuthology.orchestra.run.smithi099.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T06:31:14.676 INFO:teuthology.orchestra.run.smithi099.stdout:systemctl: stdout disabled 2024-09-19T06:31:14.684 INFO:teuthology.orchestra.run.smithi099.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T06:31:14.684 INFO:teuthology.orchestra.run.smithi099.stdout:systemctl: stdout inactive 2024-09-19T06:31:14.684 INFO:teuthology.orchestra.run.smithi099.stdout:firewalld.service is not enabled 2024-09-19T06:31:14.684 INFO:teuthology.orchestra.run.smithi099.stdout:Not possible to open ports <[9283, 8765, 8443]>. firewalld.service is not available 2024-09-19T06:31:14.684 INFO:teuthology.orchestra.run.smithi099.stdout:Waiting for mgr to start... 2024-09-19T06:31:14.684 INFO:teuthology.orchestra.run.smithi099.stdout:Waiting for mgr... 2024-09-19T06:31:15.373 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:15 smithi099 ceph-mon[27651]: from='client.? 172.21.15.99:0/3485908443' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T06:31:15.771 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout 2024-09-19T06:31:15.771 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout { 2024-09-19T06:31:15.771 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "fsid": "a73eb958-7650-11ef-bceb-c7b262605968", 2024-09-19T06:31:15.772 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T06:31:15.772 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T06:31:15.772 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T06:31:15.772 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T06:31:15.772 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:31:15.772 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T06:31:15.772 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T06:31:15.772 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout 0 2024-09-19T06:31:15.772 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout ], 2024-09-19T06:31:15.772 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T06:31:15.772 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "smithi099" 2024-09-19T06:31:15.772 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout ], 2024-09-19T06:31:15.772 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-19T06:31:15.773 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T06:31:15.773 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:31:15.773 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-09-19T06:31:15.773 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T06:31:15.773 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:31:15.773 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T06:31:15.773 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:31:15.773 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T06:31:15.773 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T06:31:15.773 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T06:31:15.773 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T06:31:15.773 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T06:31:15.773 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T06:31:15.773 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:31:15.773 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T06:31:15.774 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T06:31:15.774 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T06:31:15.774 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T06:31:15.774 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T06:31:15.774 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T06:31:15.774 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T06:31:15.774 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T06:31:15.774 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T06:31:15.774 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:31:15.774 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T06:31:15.774 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:31:15.774 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T06:31:15.774 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T06:31:15.775 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:31:15.775 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T06:31:15.775 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-19T06:31:15.775 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T06:31:15.775 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T06:31:15.775 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T06:31:15.775 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T06:31:15.775 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T06:31:15.775 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout ], 2024-09-19T06:31:15.775 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T06:31:15.775 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:31:15.775 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T06:31:15.775 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:31:15.775 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T06:31:07.865830+0000", 2024-09-19T06:31:15.775 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T06:31:15.776 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:31:15.776 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T06:31:15.776 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout } 2024-09-19T06:31:15.776 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.105+0000 7f913d542640 1 Processor -- start 2024-09-19T06:31:15.776 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.105+0000 7f913d542640 1 -- start start 2024-09-19T06:31:15.776 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.105+0000 7f913d542640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9138100f70 0x7f9138101380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:15.776 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.105+0000 7f913d542640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91381018c0 con 0x7f9138100f70 2024-09-19T06:31:15.776 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.105+0000 7f9136ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9138100f70 0x7f9138101380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:15.776 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.106+0000 7f9136ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9138100f70 0x7f9138101380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:39396/0 (socket says 172.21.15.99:39396) 2024-09-19T06:31:15.776 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.106+0000 7f9136ffd640 1 -- 172.21.15.99:0/2770502551 learned_addr learned my addr 172.21.15.99:0/2770502551 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:31:15.776 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.106+0000 7f9136ffd640 1 -- 172.21.15.99:0/2770502551 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9138101a00 con 0x7f9138100f70 2024-09-19T06:31:15.776 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.107+0000 7f9136ffd640 1 --2- 172.21.15.99:0/2770502551 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9138100f70 0x7f9138101380 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f9128009840 tx=0x7f91280091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd338ce812064f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:15.776 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.107+0000 7f9135ffb640 1 -- 172.21.15.99:0/2770502551 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9128032440 con 0x7f9138100f70 2024-09-19T06:31:15.776 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.107+0000 7f9135ffb640 1 -- 172.21.15.99:0/2770502551 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f9128032a00 con 0x7f9138100f70 2024-09-19T06:31:15.777 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.107+0000 7f9135ffb640 1 -- 172.21.15.99:0/2770502551 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f91280319e0 con 0x7f9138100f70 2024-09-19T06:31:15.777 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.108+0000 7f913d542640 1 -- 172.21.15.99:0/2770502551 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9138100f70 msgr2=0x7f9138101380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:15.777 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.108+0000 7f913d542640 1 --2- 172.21.15.99:0/2770502551 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9138100f70 0x7f9138101380 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f9128009840 tx=0x7f91280091d0 comp rx=0 tx=0).stop 2024-09-19T06:31:15.777 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.108+0000 7f913d542640 1 -- 172.21.15.99:0/2770502551 shutdown_connections 2024-09-19T06:31:15.777 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.108+0000 7f913d542640 1 --2- 172.21.15.99:0/2770502551 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9138100f70 0x7f9138101380 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:15.777 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.108+0000 7f913d542640 1 -- 172.21.15.99:0/2770502551 >> 172.21.15.99:0/2770502551 conn(0x7f91380fc6b0 msgr2=0x7f91380feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:15.777 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.108+0000 7f913d542640 1 -- 172.21.15.99:0/2770502551 shutdown_connections 2024-09-19T06:31:15.777 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.108+0000 7f913d542640 1 -- 172.21.15.99:0/2770502551 wait complete. 2024-09-19T06:31:15.777 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.109+0000 7f913d542640 1 Processor -- start 2024-09-19T06:31:15.777 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.109+0000 7f913d542640 1 -- start start 2024-09-19T06:31:15.777 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.109+0000 7f913d542640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9138100f70 0x7f9138112f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:15.777 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.109+0000 7f913d542640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91381134a0 con 0x7f9138100f70 2024-09-19T06:31:15.777 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.109+0000 7f9136ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9138100f70 0x7f9138112f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:15.778 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.109+0000 7f9136ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9138100f70 0x7f9138112f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:39406/0 (socket says 172.21.15.99:39406) 2024-09-19T06:31:15.778 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.109+0000 7f9136ffd640 1 -- 172.21.15.99:0/3485908443 learned_addr learned my addr 172.21.15.99:0/3485908443 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:31:15.778 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.109+0000 7f9136ffd640 1 -- 172.21.15.99:0/3485908443 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9128009450 con 0x7f9138100f70 2024-09-19T06:31:15.778 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.109+0000 7f9136ffd640 1 --2- 172.21.15.99:0/3485908443 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9138100f70 0x7f9138112f60 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f91280098a0 tx=0x7f9128008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:15.778 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.110+0000 7f911f7fe640 1 -- 172.21.15.99:0/3485908443 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9128032880 con 0x7f9138100f70 2024-09-19T06:31:15.778 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.110+0000 7f913d542640 1 -- 172.21.15.99:0/3485908443 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91381136a0 con 0x7f9138100f70 2024-09-19T06:31:15.778 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.110+0000 7f911f7fe640 1 -- 172.21.15.99:0/3485908443 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f912803d8b0 con 0x7f9138100f70 2024-09-19T06:31:15.778 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.110+0000 7f911f7fe640 1 -- 172.21.15.99:0/3485908443 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f912803b910 con 0x7f9138100f70 2024-09-19T06:31:15.778 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.110+0000 7f913d542640 1 -- 172.21.15.99:0/3485908443 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9138113b10 con 0x7f9138100f70 2024-09-19T06:31:15.778 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.110+0000 7f911f7fe640 1 -- 172.21.15.99:0/3485908443 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f9128039070 con 0x7f9138100f70 2024-09-19T06:31:15.778 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.110+0000 7f911f7fe640 1 -- 172.21.15.99:0/3485908443 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f9128046760 con 0x7f9138100f70 2024-09-19T06:31:15.778 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.111+0000 7f913d542640 1 -- 172.21.15.99:0/3485908443 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f913804b720 con 0x7f9138100f70 2024-09-19T06:31:15.778 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.113+0000 7f911f7fe640 1 -- 172.21.15.99:0/3485908443 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f91280657a0 con 0x7f9138100f70 2024-09-19T06:31:15.778 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.172+0000 7f913d542640 1 -- 172.21.15.99:0/3485908443 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f9138114290 con 0x7f9138100f70 2024-09-19T06:31:15.779 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.173+0000 7f911f7fe640 1 -- 172.21.15.99:0/3485908443 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f9128054030 con 0x7f9138100f70 2024-09-19T06:31:15.779 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.173+0000 7f913d542640 1 -- 172.21.15.99:0/3485908443 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9138100f70 msgr2=0x7f9138112f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:15.779 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.173+0000 7f913d542640 1 --2- 172.21.15.99:0/3485908443 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9138100f70 0x7f9138112f60 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f91280098a0 tx=0x7f9128008040 comp rx=0 tx=0).stop 2024-09-19T06:31:15.779 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.173+0000 7f913d542640 1 -- 172.21.15.99:0/3485908443 shutdown_connections 2024-09-19T06:31:15.779 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.173+0000 7f913d542640 1 --2- 172.21.15.99:0/3485908443 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9138100f70 0x7f9138112f60 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:15.779 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.173+0000 7f913d542640 1 -- 172.21.15.99:0/3485908443 >> 172.21.15.99:0/3485908443 conn(0x7f91380fc6b0 msgr2=0x7f91380fd200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:15.779 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.174+0000 7f913d542640 1 -- 172.21.15.99:0/3485908443 shutdown_connections 2024-09-19T06:31:15.779 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:15.174+0000 7f913d542640 1 -- 172.21.15.99:0/3485908443 wait complete. 2024-09-19T06:31:15.779 INFO:teuthology.orchestra.run.smithi099.stdout:mgr not available, waiting (1/15)... 2024-09-19T06:31:18.674 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:18 smithi099 ceph-mon[27651]: from='client.? 172.21.15.99:0/295592827' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T06:31:18.938 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout 2024-09-19T06:31:18.938 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout { 2024-09-19T06:31:18.938 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "fsid": "a73eb958-7650-11ef-bceb-c7b262605968", 2024-09-19T06:31:18.938 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T06:31:18.938 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T06:31:18.938 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T06:31:18.939 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T06:31:18.939 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:31:18.939 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T06:31:18.939 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T06:31:18.939 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout 0 2024-09-19T06:31:18.939 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout ], 2024-09-19T06:31:18.939 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T06:31:18.939 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "smithi099" 2024-09-19T06:31:18.939 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout ], 2024-09-19T06:31:18.939 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-19T06:31:18.939 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T06:31:18.939 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:31:18.939 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-09-19T06:31:18.939 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T06:31:18.940 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:31:18.940 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T06:31:18.940 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:31:18.940 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T06:31:18.940 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T06:31:18.940 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T06:31:18.947 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T06:31:18.947 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T06:31:18.947 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T06:31:18.947 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:31:18.947 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T06:31:18.948 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T06:31:18.948 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T06:31:18.948 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T06:31:18.948 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T06:31:18.948 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T06:31:18.948 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T06:31:18.948 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T06:31:18.948 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T06:31:18.948 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:31:18.948 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T06:31:18.948 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:31:18.948 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T06:31:18.948 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T06:31:18.948 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:31:18.949 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T06:31:18.949 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-19T06:31:18.949 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T06:31:18.949 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T06:31:18.949 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T06:31:18.949 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T06:31:18.949 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T06:31:18.949 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout ], 2024-09-19T06:31:18.949 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T06:31:18.949 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:31:18.949 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T06:31:18.949 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:31:18.950 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T06:31:07.865830+0000", 2024-09-19T06:31:18.950 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T06:31:18.950 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:31:18.950 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T06:31:18.950 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout } 2024-09-19T06:31:18.950 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:18.201+0000 7f0a50883640 1 Processor -- start 2024-09-19T06:31:18.950 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:18.201+0000 7f0a50883640 1 -- start start 2024-09-19T06:31:18.950 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:18.201+0000 7f0a50883640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a4c100e90 0x7f0a4c1012a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:18.950 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:18.201+0000 7f0a50883640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4c1017e0 con 0x7f0a4c100e90 2024-09-19T06:31:18.950 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:18.201+0000 7f0a4a59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a4c100e90 0x7f0a4c1012a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:18.950 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:18.201+0000 7f0a4a59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a4c100e90 0x7f0a4c1012a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55702/0 (socket says 172.21.15.99:55702) 2024-09-19T06:31:18.950 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:18.201+0000 7f0a4a59c640 1 -- 172.21.15.99:0/3293394163 learned_addr learned my addr 172.21.15.99:0/3293394163 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:31:18.950 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:18.202+0000 7f0a4a59c640 1 -- 172.21.15.99:0/3293394163 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a4c101920 con 0x7f0a4c100e90 2024-09-19T06:31:18.951 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:18.202+0000 7f0a4a59c640 1 --2- 172.21.15.99:0/3293394163 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a4c100e90 0x7f0a4c1012a0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c009840 tx=0x7f0a3c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e6a1b5ab6abea91 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:18.951 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:18.202+0000 7f0a49d9b640 1 -- 172.21.15.99:0/3293394163 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0a3c032440 con 0x7f0a4c100e90 2024-09-19T06:31:18.951 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:18.203+0000 7f0a49d9b640 1 -- 172.21.15.99:0/3293394163 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f0a3c032a00 con 0x7f0a4c100e90 2024-09-19T06:31:18.951 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:18.203+0000 7f0a49d9b640 1 -- 172.21.15.99:0/3293394163 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0a3c031a10 con 0x7f0a4c100e90 2024-09-19T06:31:18.951 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:18.203+0000 7f0a50883640 1 -- 172.21.15.99:0/3293394163 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a4c100e90 msgr2=0x7f0a4c1012a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:18.951 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:18.203+0000 7f0a50883640 1 --2- 172.21.15.99:0/3293394163 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a4c100e90 0x7f0a4c1012a0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c009840 tx=0x7f0a3c0091d0 comp rx=0 tx=0).stop 2024-09-19T06:31:18.951 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:18.203+0000 7f0a50883640 1 -- 172.21.15.99:0/3293394163 shutdown_connections 2024-09-19T06:31:18.951 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:18.203+0000 7f0a50883640 1 --2- 172.21.15.99:0/3293394163 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a4c100e90 0x7f0a4c1012a0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:18.951 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:18.203+0000 7f0a50883640 1 -- 172.21.15.99:0/3293394163 >> 172.21.15.99:0/3293394163 conn(0x7f0a4c0fc6d0 msgr2=0x7f0a4c0feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:18.951 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:18.203+0000 7f0a50883640 1 -- 172.21.15.99:0/3293394163 shutdown_connections 2024-09-19T06:31:18.951 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:18.203+0000 7f0a50883640 1 -- 172.21.15.99:0/3293394163 wait complete. 2024-09-19T06:31:18.951 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:18.204+0000 7f0a50883640 1 Processor -- start 2024-09-19T06:31:18.951 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:18.204+0000 7f0a50883640 1 -- start start 2024-09-19T06:31:18.952 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:18.204+0000 7f0a50883640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a4c100e90 0x7f0a4c10fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:18.952 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:18.204+0000 7f0a50883640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4c110180 con 0x7f0a4c100e90 2024-09-19T06:31:18.952 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:18.204+0000 7f0a4a59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a4c100e90 0x7f0a4c10fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:18.952 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:18.205+0000 7f0a4a59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a4c100e90 0x7f0a4c10fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55716/0 (socket says 172.21.15.99:55716) 2024-09-19T06:31:18.952 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:18.205+0000 7f0a4a59c640 1 -- 172.21.15.99:0/295592827 learned_addr learned my addr 172.21.15.99:0/295592827 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:31:18.952 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:18.205+0000 7f0a4a59c640 1 -- 172.21.15.99:0/295592827 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a3c009450 con 0x7f0a4c100e90 2024-09-19T06:31:18.952 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:18.205+0000 7f0a4a59c640 1 --2- 172.21.15.99:0/295592827 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a4c100e90 0x7f0a4c10fc40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c0098a0 tx=0x7f0a3c02c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:18.952 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:18.205+0000 7f0a42ffd640 1 -- 172.21.15.99:0/295592827 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0a3c0327b0 con 0x7f0a4c100e90 2024-09-19T06:31:18.952 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:18.205+0000 7f0a42ffd640 1 -- 172.21.15.99:0/295592827 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f0a3c03b870 con 0x7f0a4c100e90 2024-09-19T06:31:18.952 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:18.205+0000 7f0a50883640 1 -- 172.21.15.99:0/295592827 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a4c110380 con 0x7f0a4c100e90 2024-09-19T06:31:18.952 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:18.205+0000 7f0a42ffd640 1 -- 172.21.15.99:0/295592827 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0a3c03a550 con 0x7f0a4c100e90 2024-09-19T06:31:18.952 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:18.205+0000 7f0a50883640 1 -- 172.21.15.99:0/295592827 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a4c1107f0 con 0x7f0a4c100e90 2024-09-19T06:31:18.952 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:18.205+0000 7f0a42ffd640 1 -- 172.21.15.99:0/295592827 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f0a3c039040 con 0x7f0a4c100e90 2024-09-19T06:31:18.953 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:18.205+0000 7f0a42ffd640 1 -- 172.21.15.99:0/295592827 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f0a3c0447a0 con 0x7f0a4c100e90 2024-09-19T06:31:18.953 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:18.206+0000 7f0a50883640 1 -- 172.21.15.99:0/295592827 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a4c04b720 con 0x7f0a4c100e90 2024-09-19T06:31:18.953 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:18.208+0000 7f0a42ffd640 1 -- 172.21.15.99:0/295592827 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f0a4c1107f0 con 0x7f0a4c100e90 2024-09-19T06:31:18.953 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:18.267+0000 7f0a50883640 1 -- 172.21.15.99:0/295592827 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f0a4c110f10 con 0x7f0a4c100e90 2024-09-19T06:31:18.953 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:18.268+0000 7f0a42ffd640 1 -- 172.21.15.99:0/295592827 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f0a3c049060 con 0x7f0a4c100e90 2024-09-19T06:31:18.953 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:18.269+0000 7f0a50883640 1 -- 172.21.15.99:0/295592827 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a4c100e90 msgr2=0x7f0a4c10fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:18.953 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:18.269+0000 7f0a50883640 1 --2- 172.21.15.99:0/295592827 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a4c100e90 0x7f0a4c10fc40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c0098a0 tx=0x7f0a3c02c040 comp rx=0 tx=0).stop 2024-09-19T06:31:18.953 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:18.269+0000 7f0a50883640 1 -- 172.21.15.99:0/295592827 shutdown_connections 2024-09-19T06:31:18.953 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:18.269+0000 7f0a50883640 1 --2- 172.21.15.99:0/295592827 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a4c100e90 0x7f0a4c10fc40 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:18.953 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:18.269+0000 7f0a50883640 1 -- 172.21.15.99:0/295592827 >> 172.21.15.99:0/295592827 conn(0x7f0a4c0fc6d0 msgr2=0x7f0a4c0fd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:18.953 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:18.269+0000 7f0a50883640 1 -- 172.21.15.99:0/295592827 shutdown_connections 2024-09-19T06:31:18.953 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:18.269+0000 7f0a50883640 1 -- 172.21.15.99:0/295592827 wait complete. 2024-09-19T06:31:18.953 INFO:teuthology.orchestra.run.smithi099.stdout:mgr not available, waiting (2/15)... 2024-09-19T06:31:19.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:19 smithi099 ceph-mon[27651]: Activating manager daemon smithi099.pgvkqi 2024-09-19T06:31:19.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:19 smithi099 ceph-mon[27651]: mgrmap e2: smithi099.pgvkqi(active, starting, since 0.00321945s) 2024-09-19T06:31:19.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:19 smithi099 ceph-mon[27651]: from='mgr.14100 172.21.15.99:0/498719220' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T06:31:19.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:19 smithi099 ceph-mon[27651]: from='mgr.14100 172.21.15.99:0/498719220' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T06:31:19.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:19 smithi099 ceph-mon[27651]: from='mgr.14100 172.21.15.99:0/498719220' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T06:31:19.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:19 smithi099 ceph-mon[27651]: from='mgr.14100 172.21.15.99:0/498719220' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mon metadata", "id": "smithi099"}]: dispatch 2024-09-19T06:31:19.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:19 smithi099 ceph-mon[27651]: from='mgr.14100 172.21.15.99:0/498719220' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mgr metadata", "who": "smithi099.pgvkqi", "id": "smithi099.pgvkqi"}]: dispatch 2024-09-19T06:31:19.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:19 smithi099 ceph-mon[27651]: Manager daemon smithi099.pgvkqi is now available 2024-09-19T06:31:19.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:19 smithi099 ceph-mon[27651]: from='mgr.14100 172.21.15.99:0/498719220' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi099.pgvkqi/mirror_snapshot_schedule"}]: dispatch 2024-09-19T06:31:19.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:19 smithi099 ceph-mon[27651]: from='mgr.14100 172.21.15.99:0/498719220' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi099.pgvkqi/trash_purge_schedule"}]: dispatch 2024-09-19T06:31:19.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:19 smithi099 ceph-mon[27651]: from='mgr.14100 172.21.15.99:0/498719220' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:31:19.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:19 smithi099 ceph-mon[27651]: from='mgr.14100 172.21.15.99:0/498719220' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:31:19.708 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:19 smithi099 ceph-mon[27651]: from='mgr.14100 172.21.15.99:0/498719220' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:31:21.166 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:20 smithi099 ceph-mon[27651]: mgrmap e3: smithi099.pgvkqi(active, since 1.0064s) 2024-09-19T06:31:22.123 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:21 smithi099 ceph-mon[27651]: mgrmap e4: smithi099.pgvkqi(active, since 2s) 2024-09-19T06:31:22.123 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:21 smithi099 ceph-mon[27651]: from='client.? 172.21.15.99:0/1449476205' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T06:31:22.128 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout 2024-09-19T06:31:22.128 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout { 2024-09-19T06:31:22.128 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "fsid": "a73eb958-7650-11ef-bceb-c7b262605968", 2024-09-19T06:31:22.128 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T06:31:22.128 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T06:31:22.128 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T06:31:22.128 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T06:31:22.128 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:31:22.128 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T06:31:22.128 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T06:31:22.128 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout 0 2024-09-19T06:31:22.128 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout ], 2024-09-19T06:31:22.129 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T06:31:22.129 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "smithi099" 2024-09-19T06:31:22.129 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout ], 2024-09-19T06:31:22.129 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-09-19T06:31:22.129 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T06:31:22.129 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:31:22.129 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-09-19T06:31:22.129 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T06:31:22.129 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:31:22.129 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T06:31:22.129 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:31:22.129 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T06:31:22.129 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T06:31:22.130 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T06:31:22.138 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T06:31:22.138 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T06:31:22.138 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T06:31:22.138 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:31:22.138 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T06:31:22.138 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T06:31:22.138 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T06:31:22.138 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T06:31:22.139 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T06:31:22.139 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T06:31:22.139 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T06:31:22.139 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T06:31:22.139 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T06:31:22.139 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:31:22.139 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T06:31:22.139 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:31:22.139 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T06:31:22.139 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T06:31:22.139 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:31:22.139 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T06:31:22.139 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T06:31:22.139 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T06:31:22.140 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T06:31:22.140 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T06:31:22.140 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T06:31:22.140 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T06:31:22.140 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout ], 2024-09-19T06:31:22.140 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T06:31:22.140 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:31:22.140 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T06:31:22.140 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T06:31:22.140 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T06:31:07.865830+0000", 2024-09-19T06:31:22.140 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T06:31:22.140 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout }, 2024-09-19T06:31:22.141 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T06:31:22.141 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout } 2024-09-19T06:31:22.141 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:21.347+0000 7f076c327640 1 Processor -- start 2024-09-19T06:31:22.141 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:21.347+0000 7f076c327640 1 -- start start 2024-09-19T06:31:22.141 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:21.347+0000 7f076c327640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0764102430 0x7f0764102840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:22.141 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:21.347+0000 7f076c327640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0764102d80 con 0x7f0764102430 2024-09-19T06:31:22.141 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:21.347+0000 7f076a0c3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0764102430 0x7f0764102840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:22.141 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:21.347+0000 7f076a0c3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0764102430 0x7f0764102840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55800/0 (socket says 172.21.15.99:55800) 2024-09-19T06:31:22.141 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:21.348+0000 7f076a0c3640 1 -- 172.21.15.99:0/498990841 learned_addr learned my addr 172.21.15.99:0/498990841 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:31:22.141 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:21.348+0000 7f076a0c3640 1 -- 172.21.15.99:0/498990841 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0764102ec0 con 0x7f0764102430 2024-09-19T06:31:22.141 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:21.348+0000 7f076a0c3640 1 --2- 172.21.15.99:0/498990841 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0764102430 0x7f0764102840 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0760009840 tx=0x7f07600091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9f87bc3c92c9324 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:22.141 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:21.349+0000 7f07690c1640 1 -- 172.21.15.99:0/498990841 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0760032440 con 0x7f0764102430 2024-09-19T06:31:22.141 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:21.349+0000 7f07690c1640 1 -- 172.21.15.99:0/498990841 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f0760032a00 con 0x7f0764102430 2024-09-19T06:31:22.142 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:21.349+0000 7f07690c1640 1 -- 172.21.15.99:0/498990841 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f07600319e0 con 0x7f0764102430 2024-09-19T06:31:22.142 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:21.349+0000 7f076c327640 1 -- 172.21.15.99:0/498990841 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0764102430 msgr2=0x7f0764102840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:22.142 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:21.349+0000 7f076c327640 1 --2- 172.21.15.99:0/498990841 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0764102430 0x7f0764102840 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0760009840 tx=0x7f07600091d0 comp rx=0 tx=0).stop 2024-09-19T06:31:22.142 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:21.349+0000 7f076c327640 1 -- 172.21.15.99:0/498990841 shutdown_connections 2024-09-19T06:31:22.142 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:21.349+0000 7f076c327640 1 --2- 172.21.15.99:0/498990841 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0764102430 0x7f0764102840 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:22.142 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:21.349+0000 7f076c327640 1 -- 172.21.15.99:0/498990841 >> 172.21.15.99:0/498990841 conn(0x7f07640fbdd0 msgr2=0x7f07640fe1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:22.142 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:21.349+0000 7f076c327640 1 -- 172.21.15.99:0/498990841 shutdown_connections 2024-09-19T06:31:22.142 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:21.350+0000 7f076c327640 1 -- 172.21.15.99:0/498990841 wait complete. 2024-09-19T06:31:22.142 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:21.350+0000 7f076c327640 1 Processor -- start 2024-09-19T06:31:22.142 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:21.350+0000 7f076c327640 1 -- start start 2024-09-19T06:31:22.142 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:21.350+0000 7f076c327640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0764102430 0x7f0764100c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:22.142 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:21.350+0000 7f076c327640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0764113a20 con 0x7f0764102430 2024-09-19T06:31:22.143 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:21.350+0000 7f076a0c3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0764102430 0x7f0764100c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:22.143 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:21.350+0000 7f076a0c3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0764102430 0x7f0764100c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55804/0 (socket says 172.21.15.99:55804) 2024-09-19T06:31:22.143 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:21.350+0000 7f076a0c3640 1 -- 172.21.15.99:0/1449476205 learned_addr learned my addr 172.21.15.99:0/1449476205 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:31:22.143 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:21.351+0000 7f076a0c3640 1 -- 172.21.15.99:0/1449476205 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0760009450 con 0x7f0764102430 2024-09-19T06:31:22.143 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:21.351+0000 7f076a0c3640 1 --2- 172.21.15.99:0/1449476205 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0764102430 0x7f0764100c00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0760000c00 tx=0x7f0760008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:22.143 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:21.351+0000 7f075affd640 1 -- 172.21.15.99:0/1449476205 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f076003d450 con 0x7f0764102430 2024-09-19T06:31:22.143 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:21.351+0000 7f075affd640 1 -- 172.21.15.99:0/1449476205 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f076003da10 con 0x7f0764102430 2024-09-19T06:31:22.143 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:21.351+0000 7f075affd640 1 -- 172.21.15.99:0/1449476205 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f076003b8e0 con 0x7f0764102430 2024-09-19T06:31:22.143 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:21.351+0000 7f076c327640 1 -- 172.21.15.99:0/1449476205 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0764113b60 con 0x7f0764102430 2024-09-19T06:31:22.143 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:21.351+0000 7f076c327640 1 -- 172.21.15.99:0/1449476205 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f076410f880 con 0x7f0764102430 2024-09-19T06:31:22.143 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:21.352+0000 7f075affd640 1 -- 172.21.15.99:0/1449476205 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 4) v1 ==== 45496+0+0 (secure 0 0 0) 0x7f0760039070 con 0x7f0764102430 2024-09-19T06:31:22.143 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:21.352+0000 7f076c327640 1 -- 172.21.15.99:0/1449476205 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f076404b720 con 0x7f0764102430 2024-09-19T06:31:22.143 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:21.352+0000 7f075affd640 1 --2- 172.21.15.99:0/1449476205 >> [v2:172.21.15.99:6800/3677321821,v1:172.21.15.99:6801/3677321821] conn(0x7f075003d8a0 0x7f075003fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:22.144 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:21.352+0000 7f075affd640 1 -- 172.21.15.99:0/1449476205 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f076006cfe0 con 0x7f0764102430 2024-09-19T06:31:22.144 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:21.352+0000 7f07698c2640 1 --2- 172.21.15.99:0/1449476205 >> [v2:172.21.15.99:6800/3677321821,v1:172.21.15.99:6801/3677321821] conn(0x7f075003d8a0 0x7f075003fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:22.144 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:21.353+0000 7f07698c2640 1 --2- 172.21.15.99:0/1449476205 >> [v2:172.21.15.99:6800/3677321821,v1:172.21.15.99:6801/3677321821] conn(0x7f075003d8a0 0x7f075003fd50 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0754006fd0 tx=0x7f0754006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:22.144 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:21.357+0000 7f075affd640 1 -- 172.21.15.99:0/1449476205 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f076003ca00 con 0x7f0764102430 2024-09-19T06:31:22.144 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:21.570+0000 7f076c327640 1 -- 172.21.15.99:0/1449476205 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f0764110050 con 0x7f0764102430 2024-09-19T06:31:22.144 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:21.570+0000 7f075affd640 1 -- 172.21.15.99:0/1449476205 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1247 (secure 0 0 0) 0x7f0760041030 con 0x7f0764102430 2024-09-19T06:31:22.144 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:21.572+0000 7f076c327640 1 -- 172.21.15.99:0/1449476205 >> [v2:172.21.15.99:6800/3677321821,v1:172.21.15.99:6801/3677321821] conn(0x7f075003d8a0 msgr2=0x7f075003fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:22.144 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:21.572+0000 7f076c327640 1 --2- 172.21.15.99:0/1449476205 >> [v2:172.21.15.99:6800/3677321821,v1:172.21.15.99:6801/3677321821] conn(0x7f075003d8a0 0x7f075003fd50 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0754006fd0 tx=0x7f0754006db0 comp rx=0 tx=0).stop 2024-09-19T06:31:22.144 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:21.572+0000 7f076c327640 1 -- 172.21.15.99:0/1449476205 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0764102430 msgr2=0x7f0764100c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:22.144 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:21.572+0000 7f076c327640 1 --2- 172.21.15.99:0/1449476205 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0764102430 0x7f0764100c00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0760000c00 tx=0x7f0760008040 comp rx=0 tx=0).stop 2024-09-19T06:31:22.144 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:21.572+0000 7f076c327640 1 -- 172.21.15.99:0/1449476205 shutdown_connections 2024-09-19T06:31:22.144 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:21.572+0000 7f076c327640 1 --2- 172.21.15.99:0/1449476205 >> [v2:172.21.15.99:6800/3677321821,v1:172.21.15.99:6801/3677321821] conn(0x7f075003d8a0 0x7f075003fd50 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:22.144 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:21.572+0000 7f076c327640 1 --2- 172.21.15.99:0/1449476205 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0764102430 0x7f0764100c00 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:22.145 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:21.572+0000 7f076c327640 1 -- 172.21.15.99:0/1449476205 >> 172.21.15.99:0/1449476205 conn(0x7f07640fbdd0 msgr2=0x7f07640fc910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:22.145 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:21.572+0000 7f076c327640 1 -- 172.21.15.99:0/1449476205 shutdown_connections 2024-09-19T06:31:22.145 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:21.572+0000 7f076c327640 1 -- 172.21.15.99:0/1449476205 wait complete. 2024-09-19T06:31:22.145 INFO:teuthology.orchestra.run.smithi099.stdout:mgr is available 2024-09-19T06:31:22.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:22 smithi099 ceph-mon[27651]: from='client.? 172.21.15.99:0/3269861288' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-19T06:31:23.247 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout 2024-09-19T06:31:23.247 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout [global] 2024-09-19T06:31:23.247 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout fsid = a73eb958-7650-11ef-bceb-c7b262605968 2024-09-19T06:31:23.247 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-19T06:31:23.247 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-19T06:31:23.247 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-19T06:31:23.247 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-19T06:31:23.248 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-19T06:31:23.248 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout 2024-09-19T06:31:23.248 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-19T06:31:23.248 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-19T06:31:23.248 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout 2024-09-19T06:31:23.248 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout [osd] 2024-09-19T06:31:23.248 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-19T06:31:23.248 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-19T06:31:23.248 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-19T06:31:23.248 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-19T06:31:23.248 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-19T06:31:23.248 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:22.497+0000 7f407cab2640 1 Processor -- start 2024-09-19T06:31:23.249 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:22.497+0000 7f407cab2640 1 -- start start 2024-09-19T06:31:23.249 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:22.497+0000 7f407cab2640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40781013b0 0x7f40781017c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:23.249 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:22.497+0000 7f407cab2640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4078101d00 con 0x7f40781013b0 2024-09-19T06:31:23.249 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:22.498+0000 7f407659c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40781013b0 0x7f40781017c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:23.249 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:22.498+0000 7f407659c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40781013b0 0x7f40781017c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55820/0 (socket says 172.21.15.99:55820) 2024-09-19T06:31:23.249 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:22.498+0000 7f407659c640 1 -- 172.21.15.99:0/720538695 learned_addr learned my addr 172.21.15.99:0/720538695 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:31:23.249 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:22.498+0000 7f407659c640 1 -- 172.21.15.99:0/720538695 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4078101e40 con 0x7f40781013b0 2024-09-19T06:31:23.249 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:22.498+0000 7f407659c640 1 --2- 172.21.15.99:0/720538695 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40781013b0 0x7f40781017c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4068009840 tx=0x7f40680091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12bfec7da17ee9a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:23.249 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:22.499+0000 7f407559a640 1 -- 172.21.15.99:0/720538695 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4068032440 con 0x7f40781013b0 2024-09-19T06:31:23.249 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:22.499+0000 7f407559a640 1 -- 172.21.15.99:0/720538695 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f4068032a00 con 0x7f40781013b0 2024-09-19T06:31:23.249 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:22.499+0000 7f407559a640 1 -- 172.21.15.99:0/720538695 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f40680319e0 con 0x7f40781013b0 2024-09-19T06:31:23.249 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:22.499+0000 7f407cab2640 1 -- 172.21.15.99:0/720538695 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40781013b0 msgr2=0x7f40781017c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:23.249 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:22.499+0000 7f407cab2640 1 --2- 172.21.15.99:0/720538695 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40781013b0 0x7f40781017c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4068009840 tx=0x7f40680091d0 comp rx=0 tx=0).stop 2024-09-19T06:31:23.250 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:22.499+0000 7f407cab2640 1 -- 172.21.15.99:0/720538695 shutdown_connections 2024-09-19T06:31:23.250 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:22.499+0000 7f407cab2640 1 --2- 172.21.15.99:0/720538695 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40781013b0 0x7f40781017c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:23.250 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:22.499+0000 7f407cab2640 1 -- 172.21.15.99:0/720538695 >> 172.21.15.99:0/720538695 conn(0x7f40780fbdc0 msgr2=0x7f40780fe1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:23.250 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:22.499+0000 7f407cab2640 1 -- 172.21.15.99:0/720538695 shutdown_connections 2024-09-19T06:31:23.250 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:22.499+0000 7f407cab2640 1 -- 172.21.15.99:0/720538695 wait complete. 2024-09-19T06:31:23.250 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:22.500+0000 7f407cab2640 1 Processor -- start 2024-09-19T06:31:23.250 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:22.500+0000 7f407cab2640 1 -- start start 2024-09-19T06:31:23.250 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:22.500+0000 7f407cab2640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40781013b0 0x7f4078100bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:23.250 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:22.500+0000 7f407cab2640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4078113a80 con 0x7f40781013b0 2024-09-19T06:31:23.250 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:22.500+0000 7f407659c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40781013b0 0x7f4078100bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:23.251 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:22.500+0000 7f407659c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40781013b0 0x7f4078100bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55828/0 (socket says 172.21.15.99:55828) 2024-09-19T06:31:23.251 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:22.500+0000 7f407659c640 1 -- 172.21.15.99:0/3269861288 learned_addr learned my addr 172.21.15.99:0/3269861288 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:31:23.251 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:22.500+0000 7f407659c640 1 -- 172.21.15.99:0/3269861288 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4068009450 con 0x7f40781013b0 2024-09-19T06:31:23.251 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:22.501+0000 7f407659c640 1 --2- 172.21.15.99:0/3269861288 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40781013b0 0x7f4078100bb0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f40680098a0 tx=0x7f4068008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:23.251 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:22.501+0000 7f4066ffd640 1 -- 172.21.15.99:0/3269861288 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4068032880 con 0x7f40781013b0 2024-09-19T06:31:23.251 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:22.501+0000 7f4066ffd640 1 -- 172.21.15.99:0/3269861288 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f406803d8b0 con 0x7f40781013b0 2024-09-19T06:31:23.251 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:22.501+0000 7f4066ffd640 1 -- 172.21.15.99:0/3269861288 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f406803b910 con 0x7f40781013b0 2024-09-19T06:31:23.251 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:22.501+0000 7f407cab2640 1 -- 172.21.15.99:0/3269861288 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4078113bc0 con 0x7f40781013b0 2024-09-19T06:31:23.251 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:22.501+0000 7f407cab2640 1 -- 172.21.15.99:0/3269861288 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4078113fd0 con 0x7f40781013b0 2024-09-19T06:31:23.251 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:22.502+0000 7f4066ffd640 1 -- 172.21.15.99:0/3269861288 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 4) v1 ==== 45496+0+0 (secure 0 0 0) 0x7f4068039070 con 0x7f40781013b0 2024-09-19T06:31:23.251 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:22.502+0000 7f4066ffd640 1 --2- 172.21.15.99:0/3269861288 >> [v2:172.21.15.99:6800/3677321821,v1:172.21.15.99:6801/3677321821] conn(0x7f4060039490 0x7f406003b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:23.251 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:22.502+0000 7f407cab2640 1 -- 172.21.15.99:0/3269861288 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f407804b720 con 0x7f40781013b0 2024-09-19T06:31:23.252 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:22.502+0000 7f4066ffd640 1 -- 172.21.15.99:0/3269861288 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f406806d080 con 0x7f40781013b0 2024-09-19T06:31:23.252 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:22.502+0000 7f4075d9b640 1 --2- 172.21.15.99:0/3269861288 >> [v2:172.21.15.99:6800/3677321821,v1:172.21.15.99:6801/3677321821] conn(0x7f4060039490 0x7f406003b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:23.252 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:22.502+0000 7f4075d9b640 1 --2- 172.21.15.99:0/3269861288 >> [v2:172.21.15.99:6800/3677321821,v1:172.21.15.99:6801/3677321821] conn(0x7f4060039490 0x7f406003b940 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f406c006fd0 tx=0x7f406c006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:23.252 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:22.506+0000 7f4066ffd640 1 -- 172.21.15.99:0/3269861288 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f406804e350 con 0x7f40781013b0 2024-09-19T06:31:23.252 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:22.663+0000 7f407cab2640 1 -- 172.21.15.99:0/3269861288 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f4078102bc0 con 0x7f40781013b0 2024-09-19T06:31:23.252 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:22.664+0000 7f4066ffd640 1 -- 172.21.15.99:0/3269861288 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+409 (secure 0 0 0) 0x7f4068041030 con 0x7f40781013b0 2024-09-19T06:31:23.252 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:22.666+0000 7f407cab2640 1 -- 172.21.15.99:0/3269861288 >> [v2:172.21.15.99:6800/3677321821,v1:172.21.15.99:6801/3677321821] conn(0x7f4060039490 msgr2=0x7f406003b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:23.252 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:22.666+0000 7f407cab2640 1 --2- 172.21.15.99:0/3269861288 >> [v2:172.21.15.99:6800/3677321821,v1:172.21.15.99:6801/3677321821] conn(0x7f4060039490 0x7f406003b940 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f406c006fd0 tx=0x7f406c006db0 comp rx=0 tx=0).stop 2024-09-19T06:31:23.252 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:22.666+0000 7f407cab2640 1 -- 172.21.15.99:0/3269861288 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40781013b0 msgr2=0x7f4078100bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:23.252 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:22.666+0000 7f407cab2640 1 --2- 172.21.15.99:0/3269861288 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40781013b0 0x7f4078100bb0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f40680098a0 tx=0x7f4068008040 comp rx=0 tx=0).stop 2024-09-19T06:31:23.252 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:22.666+0000 7f407cab2640 1 -- 172.21.15.99:0/3269861288 shutdown_connections 2024-09-19T06:31:23.252 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:22.666+0000 7f407cab2640 1 --2- 172.21.15.99:0/3269861288 >> [v2:172.21.15.99:6800/3677321821,v1:172.21.15.99:6801/3677321821] conn(0x7f4060039490 0x7f406003b940 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:23.252 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:22.666+0000 7f407cab2640 1 --2- 172.21.15.99:0/3269861288 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40781013b0 0x7f4078100bb0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:23.253 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:22.666+0000 7f407cab2640 1 -- 172.21.15.99:0/3269861288 >> 172.21.15.99:0/3269861288 conn(0x7f40780fbdc0 msgr2=0x7f40780fc980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:23.253 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:22.666+0000 7f407cab2640 1 -- 172.21.15.99:0/3269861288 shutdown_connections 2024-09-19T06:31:23.253 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:22.666+0000 7f407cab2640 1 -- 172.21.15.99:0/3269861288 wait complete. 2024-09-19T06:31:23.253 INFO:teuthology.orchestra.run.smithi099.stdout:Enabling cephadm module... 2024-09-19T06:31:24.141 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:23 smithi099 ceph-mon[27651]: from='client.? 172.21.15.99:0/1930089628' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-19T06:31:24.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:24 smithi099 ceph-mon[27651]: from='client.? 172.21.15.99:0/1930089628' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-19T06:31:24.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:24 smithi099 ceph-mon[27651]: mgrmap e5: smithi099.pgvkqi(active, since 5s) 2024-09-19T06:31:28.608 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:28 smithi099 ceph-mon[27651]: Active manager daemon smithi099.pgvkqi restarted 2024-09-19T06:31:28.608 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:28 smithi099 ceph-mon[27651]: Activating manager daemon smithi099.pgvkqi 2024-09-19T06:31:28.608 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:28 smithi099 ceph-mon[27651]: osdmap e2: 0 total, 0 up, 0 in 2024-09-19T06:31:28.608 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:28 smithi099 ceph-mon[27651]: mgrmap e6: smithi099.pgvkqi(active, starting, since 0.00402323s) 2024-09-19T06:31:28.608 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:28 smithi099 ceph-mon[27651]: from='mgr.14118 172.21.15.99:0/3537138547' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mon metadata", "id": "smithi099"}]: dispatch 2024-09-19T06:31:28.609 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:28 smithi099 ceph-mon[27651]: from='mgr.14118 172.21.15.99:0/3537138547' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mgr metadata", "who": "smithi099.pgvkqi", "id": "smithi099.pgvkqi"}]: dispatch 2024-09-19T06:31:28.609 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:28 smithi099 ceph-mon[27651]: from='mgr.14118 172.21.15.99:0/3537138547' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T06:31:28.609 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:28 smithi099 ceph-mon[27651]: from='mgr.14118 172.21.15.99:0/3537138547' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T06:31:28.609 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:28 smithi099 ceph-mon[27651]: from='mgr.14118 172.21.15.99:0/3537138547' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T06:31:28.609 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:28 smithi099 ceph-mon[27651]: Manager daemon smithi099.pgvkqi is now available 2024-09-19T06:31:28.609 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:28 smithi099 ceph-mon[27651]: from='mgr.14118 172.21.15.99:0/3537138547' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:31:28.609 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:28 smithi099 ceph-mon[27651]: from='mgr.14118 172.21.15.99:0/3537138547' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:31:28.609 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:28 smithi099 ceph-mon[27651]: from='mgr.14118 172.21.15.99:0/3537138547' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:31:28.609 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:28 smithi099 ceph-mon[27651]: from='mgr.14118 172.21.15.99:0/3537138547' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:31:28.609 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:28 smithi099 ceph-mon[27651]: from='mgr.14118 172.21.15.99:0/3537138547' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi099.pgvkqi/mirror_snapshot_schedule"}]: dispatch 2024-09-19T06:31:28.609 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:28 smithi099 ceph-mon[27651]: from='mgr.14118 172.21.15.99:0/3537138547' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi099.pgvkqi/trash_purge_schedule"}]: dispatch 2024-09-19T06:31:29.406 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.665+0000 7fa9b63d1640 1 Processor -- start 2024-09-19T06:31:29.407 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.665+0000 7fa9b63d1640 1 -- start start 2024-09-19T06:31:29.407 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.665+0000 7fa9b63d1640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9b0076b10 0x7fa9b01070a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:29.407 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.665+0000 7fa9b63d1640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b0076f20 con 0x7fa9b0076b10 2024-09-19T06:31:29.407 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.665+0000 7fa9affff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9b0076b10 0x7fa9b01070a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:29.407 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.665+0000 7fa9affff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9b0076b10 0x7fa9b01070a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55840/0 (socket says 172.21.15.99:55840) 2024-09-19T06:31:29.407 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.665+0000 7fa9affff640 1 -- 172.21.15.99:0/1762751331 learned_addr learned my addr 172.21.15.99:0/1762751331 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:31:29.407 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.666+0000 7fa9affff640 1 -- 172.21.15.99:0/1762751331 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9b0102a90 con 0x7fa9b0076b10 2024-09-19T06:31:29.407 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.666+0000 7fa9affff640 1 --2- 172.21.15.99:0/1762751331 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9b0076b10 0x7fa9b01070a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa9a0009840 tx=0x7fa9a00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb09cf7b1605ffd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:29.407 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.666+0000 7fa9aeffd640 1 -- 172.21.15.99:0/1762751331 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa9a0032440 con 0x7fa9b0076b10 2024-09-19T06:31:29.407 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.666+0000 7fa9aeffd640 1 -- 172.21.15.99:0/1762751331 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fa9a0032a00 con 0x7fa9b0076b10 2024-09-19T06:31:29.407 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.667+0000 7fa9aeffd640 1 -- 172.21.15.99:0/1762751331 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa9a00319e0 con 0x7fa9b0076b10 2024-09-19T06:31:29.408 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.667+0000 7fa9b63d1640 1 -- 172.21.15.99:0/1762751331 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9b0076b10 msgr2=0x7fa9b01070a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:29.408 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.667+0000 7fa9b63d1640 1 --2- 172.21.15.99:0/1762751331 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9b0076b10 0x7fa9b01070a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa9a0009840 tx=0x7fa9a00091d0 comp rx=0 tx=0).stop 2024-09-19T06:31:29.408 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.667+0000 7fa9b63d1640 1 -- 172.21.15.99:0/1762751331 shutdown_connections 2024-09-19T06:31:29.408 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.667+0000 7fa9b63d1640 1 --2- 172.21.15.99:0/1762751331 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9b0076b10 0x7fa9b01070a0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:29.408 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.667+0000 7fa9b63d1640 1 -- 172.21.15.99:0/1762751331 >> 172.21.15.99:0/1762751331 conn(0x7fa9b00fc710 msgr2=0x7fa9b00feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:29.408 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.667+0000 7fa9b63d1640 1 -- 172.21.15.99:0/1762751331 shutdown_connections 2024-09-19T06:31:29.408 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.667+0000 7fa9b63d1640 1 -- 172.21.15.99:0/1762751331 wait complete. 2024-09-19T06:31:29.408 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.668+0000 7fa9b63d1640 1 Processor -- start 2024-09-19T06:31:29.408 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.668+0000 7fa9b63d1640 1 -- start start 2024-09-19T06:31:29.408 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.668+0000 7fa9b63d1640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9b0076b10 0x7fa9b0112ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:29.408 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.668+0000 7fa9b63d1640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b0113430 con 0x7fa9b0076b10 2024-09-19T06:31:29.409 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.668+0000 7fa9affff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9b0076b10 0x7fa9b0112ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:29.409 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.668+0000 7fa9affff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9b0076b10 0x7fa9b0112ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55848/0 (socket says 172.21.15.99:55848) 2024-09-19T06:31:29.409 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.668+0000 7fa9affff640 1 -- 172.21.15.99:0/1930089628 learned_addr learned my addr 172.21.15.99:0/1930089628 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:31:29.409 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.668+0000 7fa9affff640 1 -- 172.21.15.99:0/1930089628 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9a0009450 con 0x7fa9b0076b10 2024-09-19T06:31:29.409 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.668+0000 7fa9affff640 1 --2- 172.21.15.99:0/1930089628 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9b0076b10 0x7fa9b0112ef0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa9a00098a0 tx=0x7fa9a0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:29.409 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.669+0000 7fa9acff9640 1 -- 172.21.15.99:0/1930089628 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa9a0032880 con 0x7fa9b0076b10 2024-09-19T06:31:29.409 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.669+0000 7fa9acff9640 1 -- 172.21.15.99:0/1930089628 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fa9a003d8b0 con 0x7fa9b0076b10 2024-09-19T06:31:29.409 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.669+0000 7fa9b63d1640 1 -- 172.21.15.99:0/1930089628 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9b0113690 con 0x7fa9b0076b10 2024-09-19T06:31:29.409 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.669+0000 7fa9acff9640 1 -- 172.21.15.99:0/1930089628 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa9a003b8e0 con 0x7fa9b0076b10 2024-09-19T06:31:29.410 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.669+0000 7fa9b63d1640 1 -- 172.21.15.99:0/1930089628 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9b01141c0 con 0x7fa9b0076b10 2024-09-19T06:31:29.410 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.670+0000 7fa9acff9640 1 -- 172.21.15.99:0/1930089628 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 4) v1 ==== 45496+0+0 (secure 0 0 0) 0x7fa9a0039070 con 0x7fa9b0076b10 2024-09-19T06:31:29.410 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.670+0000 7fa9acff9640 1 --2- 172.21.15.99:0/1930089628 >> [v2:172.21.15.99:6800/3677321821,v1:172.21.15.99:6801/3677321821] conn(0x7fa998039490 0x7fa99803b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:29.410 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.670+0000 7fa9acff9640 1 -- 172.21.15.99:0/1930089628 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fa9a006e2f0 con 0x7fa9b0076b10 2024-09-19T06:31:29.410 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.670+0000 7fa9af7fe640 1 --2- 172.21.15.99:0/1930089628 >> [v2:172.21.15.99:6800/3677321821,v1:172.21.15.99:6801/3677321821] conn(0x7fa998039490 0x7fa99803b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:29.410 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.670+0000 7fa9b63d1640 1 -- 172.21.15.99:0/1930089628 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9b0100390 con 0x7fa9b0076b10 2024-09-19T06:31:29.410 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.670+0000 7fa9af7fe640 1 --2- 172.21.15.99:0/1930089628 >> [v2:172.21.15.99:6800/3677321821,v1:172.21.15.99:6801/3677321821] conn(0x7fa998039490 0x7fa99803b940 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa9a4006fd0 tx=0x7fa9a4006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:29.410 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.675+0000 7fa9acff9640 1 -- 172.21.15.99:0/1930089628 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fa9a0037020 con 0x7fa9b0076b10 2024-09-19T06:31:29.410 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.870+0000 7fa9b63d1640 1 -- 172.21.15.99:0/1930089628 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7fa9b004b720 con 0x7fa9b0076b10 2024-09-19T06:31:29.410 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.896+0000 7fa9acff9640 1 -- 172.21.15.99:0/1930089628 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mgrmap(e 5) v1 ==== 45507+0+0 (secure 0 0 0) 0x7fa9a002fd60 con 0x7fa9b0076b10 2024-09-19T06:31:29.410 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.897+0000 7fa9acff9640 1 -- 172.21.15.99:0/1930089628 <== mon.0 v2:172.21.15.99:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7fa9a0046af0 con 0x7fa9b0076b10 2024-09-19T06:31:29.410 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.899+0000 7fa9b63d1640 1 -- 172.21.15.99:0/1930089628 >> [v2:172.21.15.99:6800/3677321821,v1:172.21.15.99:6801/3677321821] conn(0x7fa998039490 msgr2=0x7fa99803b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:29.411 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.899+0000 7fa9b63d1640 1 --2- 172.21.15.99:0/1930089628 >> [v2:172.21.15.99:6800/3677321821,v1:172.21.15.99:6801/3677321821] conn(0x7fa998039490 0x7fa99803b940 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa9a4006fd0 tx=0x7fa9a4006db0 comp rx=0 tx=0).stop 2024-09-19T06:31:29.411 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.899+0000 7fa9b63d1640 1 -- 172.21.15.99:0/1930089628 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9b0076b10 msgr2=0x7fa9b0112ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:29.411 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.899+0000 7fa9b63d1640 1 --2- 172.21.15.99:0/1930089628 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9b0076b10 0x7fa9b0112ef0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa9a00098a0 tx=0x7fa9a0008040 comp rx=0 tx=0).stop 2024-09-19T06:31:29.411 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.899+0000 7fa9b63d1640 1 -- 172.21.15.99:0/1930089628 shutdown_connections 2024-09-19T06:31:29.411 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.899+0000 7fa9b63d1640 1 --2- 172.21.15.99:0/1930089628 >> [v2:172.21.15.99:6800/3677321821,v1:172.21.15.99:6801/3677321821] conn(0x7fa998039490 0x7fa99803b940 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:29.411 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.899+0000 7fa9b63d1640 1 --2- 172.21.15.99:0/1930089628 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9b0076b10 0x7fa9b0112ef0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:29.411 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.899+0000 7fa9b63d1640 1 -- 172.21.15.99:0/1930089628 >> 172.21.15.99:0/1930089628 conn(0x7fa9b00fc710 msgr2=0x7fa9b00fd280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:29.411 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.899+0000 7fa9b63d1640 1 -- 172.21.15.99:0/1930089628 shutdown_connections 2024-09-19T06:31:29.411 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:23.899+0000 7fa9b63d1640 1 -- 172.21.15.99:0/1930089628 wait complete. 2024-09-19T06:31:29.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:29 smithi099 ceph-mon[27651]: Found migration_current of "None". Setting to last migration. 2024-09-19T06:31:29.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:29 smithi099 ceph-mon[27651]: mgrmap e7: smithi099.pgvkqi(active, since 1.00504s) 2024-09-19T06:31:31.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:30 smithi099 ceph-mon[27651]: [19/Sep/2024:06:31:29] ENGINE Bus STARTING 2024-09-19T06:31:31.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:30 smithi099 ceph-mon[27651]: [19/Sep/2024:06:31:29] ENGINE Serving on https://172.21.15.99:7150 2024-09-19T06:31:31.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:30 smithi099 ceph-mon[27651]: [19/Sep/2024:06:31:29] ENGINE Bus STARTED 2024-09-19T06:31:31.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:30 smithi099 ceph-mon[27651]: [19/Sep/2024:06:31:29] ENGINE Error in HTTPServer.serve 2024-09-19T06:31:31.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Traceback (most recent call last): 2024-09-19T06:31:31.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T06:31:31.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: self._connections.run(self.expiration_interval) 2024-09-19T06:31:31.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T06:31:31.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: self._run(expiration_interval) 2024-09-19T06:31:31.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T06:31:31.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T06:31:31.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T06:31:31.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T06:31:31.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T06:31:31.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: s = self.context.wrap_socket( 2024-09-19T06:31:31.208 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T06:31:31.208 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: return self.sslsocket_class._create( 2024-09-19T06:31:31.208 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T06:31:31.208 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: self.do_handshake() 2024-09-19T06:31:31.208 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T06:31:31.208 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: self._sslobj.do_handshake() 2024-09-19T06:31:31.208 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T06:31:31.208 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:30 smithi099 ceph-mon[27651]: from='mgr.14118 172.21.15.99:0/3537138547' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:31:31.208 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:30 smithi099 ceph-mon[27651]: from='mgr.14118 172.21.15.99:0/3537138547' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:31:32.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:31 smithi099 ceph-mon[27651]: mgrmap e8: smithi099.pgvkqi(active, since 2s) 2024-09-19T06:31:33.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:32 smithi099 ceph-mon[27651]: from='client.? 172.21.15.99:0/3394930091' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-19T06:31:36.326 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout { 2024-09-19T06:31:36.326 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "epoch": 8, 2024-09-19T06:31:36.327 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T06:31:36.327 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "active_name": "smithi099.pgvkqi", 2024-09-19T06:31:36.327 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-19T06:31:36.327 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout } 2024-09-19T06:31:36.327 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:32.674+0000 7fcb567c0640 1 Processor -- start 2024-09-19T06:31:36.327 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:32.675+0000 7fcb567c0640 1 -- start start 2024-09-19T06:31:36.327 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:32.675+0000 7fcb567c0640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcb50101fa0 0x7fcb501023b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:36.327 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:32.675+0000 7fcb567c0640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb501028f0 con 0x7fcb50101fa0 2024-09-19T06:31:36.327 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:32.675+0000 7fcb4ffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcb50101fa0 0x7fcb501023b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:36.327 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:32.675+0000 7fcb4ffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcb50101fa0 0x7fcb501023b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33196/0 (socket says 172.21.15.99:33196) 2024-09-19T06:31:36.327 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:32.675+0000 7fcb4ffff640 1 -- 172.21.15.99:0/481111791 learned_addr learned my addr 172.21.15.99:0/481111791 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:31:36.327 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:32.675+0000 7fcb4ffff640 1 -- 172.21.15.99:0/481111791 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb50102a30 con 0x7fcb50101fa0 2024-09-19T06:31:36.328 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:32.676+0000 7fcb4ffff640 1 --2- 172.21.15.99:0/481111791 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcb50101fa0 0x7fcb501023b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fcb40009840 tx=0x7fcb400091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=974587554e5c45ed server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:36.328 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:32.676+0000 7fcb4effd640 1 -- 172.21.15.99:0/481111791 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcb40032440 con 0x7fcb50101fa0 2024-09-19T06:31:36.328 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:32.676+0000 7fcb4effd640 1 -- 172.21.15.99:0/481111791 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fcb40032a00 con 0x7fcb50101fa0 2024-09-19T06:31:36.328 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:32.676+0000 7fcb4effd640 1 -- 172.21.15.99:0/481111791 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcb400319e0 con 0x7fcb50101fa0 2024-09-19T06:31:36.328 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:32.677+0000 7fcb567c0640 1 -- 172.21.15.99:0/481111791 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcb50101fa0 msgr2=0x7fcb501023b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:36.328 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:32.677+0000 7fcb567c0640 1 --2- 172.21.15.99:0/481111791 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcb50101fa0 0x7fcb501023b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fcb40009840 tx=0x7fcb400091d0 comp rx=0 tx=0).stop 2024-09-19T06:31:36.328 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:32.677+0000 7fcb567c0640 1 -- 172.21.15.99:0/481111791 shutdown_connections 2024-09-19T06:31:36.328 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:32.677+0000 7fcb567c0640 1 --2- 172.21.15.99:0/481111791 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcb50101fa0 0x7fcb501023b0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:36.328 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:32.677+0000 7fcb567c0640 1 -- 172.21.15.99:0/481111791 >> 172.21.15.99:0/481111791 conn(0x7fcb500fd740 msgr2=0x7fcb500ffb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:36.328 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:32.677+0000 7fcb567c0640 1 -- 172.21.15.99:0/481111791 shutdown_connections 2024-09-19T06:31:36.328 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:32.677+0000 7fcb567c0640 1 -- 172.21.15.99:0/481111791 wait complete. 2024-09-19T06:31:36.328 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:32.678+0000 7fcb567c0640 1 Processor -- start 2024-09-19T06:31:36.329 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:32.678+0000 7fcb567c0640 1 -- start start 2024-09-19T06:31:36.329 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:32.678+0000 7fcb567c0640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcb50101fa0 0x7fcb50110df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:36.329 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:32.678+0000 7fcb567c0640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb50111330 con 0x7fcb50101fa0 2024-09-19T06:31:36.329 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:32.678+0000 7fcb4ffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcb50101fa0 0x7fcb50110df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:36.329 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:32.678+0000 7fcb4ffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcb50101fa0 0x7fcb50110df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33204/0 (socket says 172.21.15.99:33204) 2024-09-19T06:31:36.329 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:32.678+0000 7fcb4ffff640 1 -- 172.21.15.99:0/3394930091 learned_addr learned my addr 172.21.15.99:0/3394930091 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:31:36.329 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:32.679+0000 7fcb4ffff640 1 -- 172.21.15.99:0/3394930091 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb40009450 con 0x7fcb50101fa0 2024-09-19T06:31:36.329 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:32.679+0000 7fcb4ffff640 1 --2- 172.21.15.99:0/3394930091 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcb50101fa0 0x7fcb50110df0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fcb400098a0 tx=0x7fcb40008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:36.329 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:32.679+0000 7fcb4cff9640 1 -- 172.21.15.99:0/3394930091 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcb40032880 con 0x7fcb50101fa0 2024-09-19T06:31:36.329 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:32.679+0000 7fcb4cff9640 1 -- 172.21.15.99:0/3394930091 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fcb4003d8b0 con 0x7fcb50101fa0 2024-09-19T06:31:36.329 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:32.679+0000 7fcb567c0640 1 -- 172.21.15.99:0/3394930091 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb50111530 con 0x7fcb50101fa0 2024-09-19T06:31:36.329 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:32.679+0000 7fcb4cff9640 1 -- 172.21.15.99:0/3394930091 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcb4003b910 con 0x7fcb50101fa0 2024-09-19T06:31:36.329 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:32.679+0000 7fcb567c0640 1 -- 172.21.15.99:0/3394930091 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb50111f80 con 0x7fcb50101fa0 2024-09-19T06:31:36.330 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:32.680+0000 7fcb4cff9640 1 -- 172.21.15.99:0/3394930091 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7fcb40039070 con 0x7fcb50101fa0 2024-09-19T06:31:36.330 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:32.680+0000 7fcb4cff9640 1 --2- 172.21.15.99:0/3394930091 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7fcb38039490 0x7fcb3803b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:36.330 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:32.680+0000 7fcb4cff9640 1 -- 172.21.15.99:0/3394930091 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fcb4006d3b0 con 0x7fcb50101fa0 2024-09-19T06:31:36.330 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:32.680+0000 7fcb4f7fe640 1 --2- 172.21.15.99:0/3394930091 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7fcb38039490 0x7fcb3803b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:36.330 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:32.680+0000 7fcb567c0640 1 -- 172.21.15.99:0/3394930091 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb50101400 con 0x7fcb50101fa0 2024-09-19T06:31:36.330 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:32.681+0000 7fcb4f7fe640 1 --2- 172.21.15.99:0/3394930091 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7fcb38039490 0x7fcb3803b940 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fcb44006fd0 tx=0x7fcb44006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:36.330 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:32.685+0000 7fcb4cff9640 1 -- 172.21.15.99:0/3394930091 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fcb40037020 con 0x7fcb50101fa0 2024-09-19T06:31:36.330 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:32.882+0000 7fcb567c0640 1 -- 172.21.15.99:0/3394930091 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fcb50112260 con 0x7fcb50101fa0 2024-09-19T06:31:36.330 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:32.883+0000 7fcb4cff9640 1 -- 172.21.15.99:0/3394930091 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v8) v1 ==== 56+0+103 (secure 0 0 0) 0x7fcb40041070 con 0x7fcb50101fa0 2024-09-19T06:31:36.330 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:32.885+0000 7fcb567c0640 1 -- 172.21.15.99:0/3394930091 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7fcb38039490 msgr2=0x7fcb3803b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:36.330 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:32.885+0000 7fcb567c0640 1 --2- 172.21.15.99:0/3394930091 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7fcb38039490 0x7fcb3803b940 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fcb44006fd0 tx=0x7fcb44006db0 comp rx=0 tx=0).stop 2024-09-19T06:31:36.330 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:32.885+0000 7fcb567c0640 1 -- 172.21.15.99:0/3394930091 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcb50101fa0 msgr2=0x7fcb50110df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:36.330 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:32.885+0000 7fcb567c0640 1 --2- 172.21.15.99:0/3394930091 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcb50101fa0 0x7fcb50110df0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fcb400098a0 tx=0x7fcb40008040 comp rx=0 tx=0).stop 2024-09-19T06:31:36.331 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:32.885+0000 7fcb567c0640 1 -- 172.21.15.99:0/3394930091 shutdown_connections 2024-09-19T06:31:36.331 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:32.885+0000 7fcb567c0640 1 --2- 172.21.15.99:0/3394930091 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7fcb38039490 0x7fcb3803b940 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:36.331 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:32.885+0000 7fcb567c0640 1 --2- 172.21.15.99:0/3394930091 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcb50101fa0 0x7fcb50110df0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:36.331 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:32.885+0000 7fcb567c0640 1 -- 172.21.15.99:0/3394930091 >> 172.21.15.99:0/3394930091 conn(0x7fcb500fd740 msgr2=0x7fcb500fe260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:36.331 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:32.885+0000 7fcb567c0640 1 -- 172.21.15.99:0/3394930091 shutdown_connections 2024-09-19T06:31:36.331 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:32.885+0000 7fcb567c0640 1 -- 172.21.15.99:0/3394930091 wait complete. 2024-09-19T06:31:36.331 INFO:teuthology.orchestra.run.smithi099.stdout:Waiting for the mgr to restart... 2024-09-19T06:31:36.331 INFO:teuthology.orchestra.run.smithi099.stdout:Waiting for mgr epoch 8... 2024-09-19T06:31:37.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:36 smithi099 ceph-mon[27651]: from='client.14128 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-19T06:31:37.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:36 smithi099 ceph-mon[27651]: from='client.14128 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-19T06:31:37.255 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout { 2024-09-19T06:31:37.255 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 8, 2024-09-19T06:31:37.255 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-19T06:31:37.255 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout } 2024-09-19T06:31:37.255 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:36.707+0000 7f85a9ef9640 1 Processor -- start 2024-09-19T06:31:37.255 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:36.707+0000 7f85a9ef9640 1 -- start start 2024-09-19T06:31:37.255 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:36.707+0000 7f85a9ef9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85a4100370 0x7f85a4100780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:37.255 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:36.707+0000 7f85a9ef9640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a4100cc0 con 0x7f85a4100370 2024-09-19T06:31:37.255 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:36.707+0000 7f85a37fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85a4100370 0x7f85a4100780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:37.255 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:36.707+0000 7f85a37fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85a4100370 0x7f85a4100780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35160/0 (socket says 172.21.15.99:35160) 2024-09-19T06:31:37.256 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:36.707+0000 7f85a37fe640 1 -- 172.21.15.99:0/3805697528 learned_addr learned my addr 172.21.15.99:0/3805697528 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:31:37.256 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:36.708+0000 7f85a37fe640 1 -- 172.21.15.99:0/3805697528 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a4100e00 con 0x7f85a4100370 2024-09-19T06:31:37.256 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:36.708+0000 7f85a37fe640 1 --2- 172.21.15.99:0/3805697528 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85a4100370 0x7f85a4100780 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8594009840 tx=0x7f85940091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5444967374d1f4ec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:37.256 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:36.709+0000 7f85a27fc640 1 -- 172.21.15.99:0/3805697528 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8594032440 con 0x7f85a4100370 2024-09-19T06:31:37.256 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:36.709+0000 7f85a27fc640 1 -- 172.21.15.99:0/3805697528 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f8594032a00 con 0x7f85a4100370 2024-09-19T06:31:37.256 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:36.709+0000 7f85a27fc640 1 -- 172.21.15.99:0/3805697528 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f85940319e0 con 0x7f85a4100370 2024-09-19T06:31:37.256 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:36.709+0000 7f85a9ef9640 1 -- 172.21.15.99:0/3805697528 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85a4100370 msgr2=0x7f85a4100780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:37.256 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:36.709+0000 7f85a9ef9640 1 --2- 172.21.15.99:0/3805697528 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85a4100370 0x7f85a4100780 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8594009840 tx=0x7f85940091d0 comp rx=0 tx=0).stop 2024-09-19T06:31:37.256 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:36.709+0000 7f85a9ef9640 1 -- 172.21.15.99:0/3805697528 shutdown_connections 2024-09-19T06:31:37.256 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:36.709+0000 7f85a9ef9640 1 --2- 172.21.15.99:0/3805697528 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85a4100370 0x7f85a4100780 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:37.256 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:36.709+0000 7f85a9ef9640 1 -- 172.21.15.99:0/3805697528 >> 172.21.15.99:0/3805697528 conn(0x7f85a40fbdd0 msgr2=0x7f85a40fe200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:37.256 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:36.709+0000 7f85a9ef9640 1 -- 172.21.15.99:0/3805697528 shutdown_connections 2024-09-19T06:31:37.256 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:36.709+0000 7f85a9ef9640 1 -- 172.21.15.99:0/3805697528 wait complete. 2024-09-19T06:31:37.257 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:36.710+0000 7f85a9ef9640 1 Processor -- start 2024-09-19T06:31:37.257 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:36.710+0000 7f85a9ef9640 1 -- start start 2024-09-19T06:31:37.257 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:36.710+0000 7f85a9ef9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85a4100370 0x7f85a4110de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:37.257 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:36.710+0000 7f85a9ef9640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a4111320 con 0x7f85a4100370 2024-09-19T06:31:37.257 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:36.710+0000 7f85a37fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85a4100370 0x7f85a4110de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:37.257 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:36.710+0000 7f85a37fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85a4100370 0x7f85a4110de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35164/0 (socket says 172.21.15.99:35164) 2024-09-19T06:31:37.257 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:36.710+0000 7f85a37fe640 1 -- 172.21.15.99:0/917776455 learned_addr learned my addr 172.21.15.99:0/917776455 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:31:37.257 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:36.711+0000 7f85a37fe640 1 -- 172.21.15.99:0/917776455 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8594009450 con 0x7f85a4100370 2024-09-19T06:31:37.258 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:36.711+0000 7f85a37fe640 1 --2- 172.21.15.99:0/917776455 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85a4100370 0x7f85a4110de0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f85940098a0 tx=0x7f8594008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:37.258 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:36.711+0000 7f858bfff640 1 -- 172.21.15.99:0/917776455 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8594032880 con 0x7f85a4100370 2024-09-19T06:31:37.258 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:36.711+0000 7f858bfff640 1 -- 172.21.15.99:0/917776455 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f859403d8b0 con 0x7f85a4100370 2024-09-19T06:31:37.258 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:36.711+0000 7f85a9ef9640 1 -- 172.21.15.99:0/917776455 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85a4111520 con 0x7f85a4100370 2024-09-19T06:31:37.258 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:36.711+0000 7f858bfff640 1 -- 172.21.15.99:0/917776455 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f859403b910 con 0x7f85a4100370 2024-09-19T06:31:37.258 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:36.711+0000 7f85a9ef9640 1 -- 172.21.15.99:0/917776455 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85a4111f70 con 0x7f85a4100370 2024-09-19T06:31:37.258 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:36.712+0000 7f858bfff640 1 -- 172.21.15.99:0/917776455 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f8594039070 con 0x7f85a4100370 2024-09-19T06:31:37.258 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:36.712+0000 7f858bfff640 1 --2- 172.21.15.99:0/917776455 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f858c0394e0 0x7f858c03b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:37.258 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:36.712+0000 7f85a9ef9640 1 -- 172.21.15.99:0/917776455 --> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f85a40ffa70 con 0x7f858c0394e0 2024-09-19T06:31:37.258 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:36.712+0000 7f858bfff640 1 -- 172.21.15.99:0/917776455 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f859406d2b0 con 0x7f85a4100370 2024-09-19T06:31:37.258 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:36.712+0000 7f85a2ffd640 1 --2- 172.21.15.99:0/917776455 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f858c0394e0 0x7f858c03b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:37.258 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:36.713+0000 7f85a2ffd640 1 --2- 172.21.15.99:0/917776455 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f858c0394e0 0x7f858c03b990 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8598006fd0 tx=0x7f8598006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:37.259 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:36.713+0000 7f858bfff640 1 -- 172.21.15.99:0/917776455 <== mgr.14118 v2:172.21.15.99:6800/3738534523 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7f85a40ffa70 con 0x7f858c0394e0 2024-09-19T06:31:37.259 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:36.718+0000 7f85a9ef9640 1 -- 172.21.15.99:0/917776455 --> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f85a404b720 con 0x7f858c0394e0 2024-09-19T06:31:37.259 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:36.718+0000 7f858bfff640 1 -- 172.21.15.99:0/917776455 <== mgr.14118 v2:172.21.15.99:6800/3738534523 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f85a404b720 con 0x7f858c0394e0 2024-09-19T06:31:37.259 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:36.718+0000 7f85a9ef9640 1 -- 172.21.15.99:0/917776455 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f858c0394e0 msgr2=0x7f858c03b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:37.259 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:36.718+0000 7f85a9ef9640 1 --2- 172.21.15.99:0/917776455 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f858c0394e0 0x7f858c03b990 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8598006fd0 tx=0x7f8598006db0 comp rx=0 tx=0).stop 2024-09-19T06:31:37.259 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:36.718+0000 7f85a9ef9640 1 -- 172.21.15.99:0/917776455 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85a4100370 msgr2=0x7f85a4110de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:37.259 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:36.718+0000 7f85a9ef9640 1 --2- 172.21.15.99:0/917776455 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85a4100370 0x7f85a4110de0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f85940098a0 tx=0x7f8594008040 comp rx=0 tx=0).stop 2024-09-19T06:31:37.259 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:36.718+0000 7f85a9ef9640 1 -- 172.21.15.99:0/917776455 shutdown_connections 2024-09-19T06:31:37.259 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:36.718+0000 7f85a9ef9640 1 --2- 172.21.15.99:0/917776455 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f858c0394e0 0x7f858c03b990 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:37.259 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:36.718+0000 7f85a9ef9640 1 --2- 172.21.15.99:0/917776455 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85a4100370 0x7f85a4110de0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:37.259 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:36.718+0000 7f85a9ef9640 1 -- 172.21.15.99:0/917776455 >> 172.21.15.99:0/917776455 conn(0x7f85a40fbdd0 msgr2=0x7f85a40fc9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:37.259 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:36.718+0000 7f85a9ef9640 1 -- 172.21.15.99:0/917776455 shutdown_connections 2024-09-19T06:31:37.259 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:36.718+0000 7f85a9ef9640 1 -- 172.21.15.99:0/917776455 wait complete. 2024-09-19T06:31:37.260 INFO:teuthology.orchestra.run.smithi099.stdout:mgr epoch 8 is available 2024-09-19T06:31:37.260 INFO:teuthology.orchestra.run.smithi099.stdout:Setting orchestrator backend to cephadm... 2024-09-19T06:31:38.461 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:37.632+0000 7f0fddf64640 1 Processor -- start 2024-09-19T06:31:38.461 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:37.632+0000 7f0fddf64640 1 -- start start 2024-09-19T06:31:38.461 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:37.632+0000 7f0fddf64640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fd8076ae0 0x7f0fd8104c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:38.461 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:37.632+0000 7f0fddf64640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd8076ef0 con 0x7f0fd8076ae0 2024-09-19T06:31:38.461 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:37.632+0000 7f0fd77fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fd8076ae0 0x7f0fd8104c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:38.461 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:37.632+0000 7f0fd77fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fd8076ae0 0x7f0fd8104c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35170/0 (socket says 172.21.15.99:35170) 2024-09-19T06:31:38.462 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:37.632+0000 7f0fd77fe640 1 -- 172.21.15.99:0/649217980 learned_addr learned my addr 172.21.15.99:0/649217980 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:31:38.462 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:37.632+0000 7f0fd77fe640 1 -- 172.21.15.99:0/649217980 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fd81051b0 con 0x7f0fd8076ae0 2024-09-19T06:31:38.462 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:37.633+0000 7f0fd77fe640 1 --2- 172.21.15.99:0/649217980 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fd8076ae0 0x7f0fd8104c70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0fc8009840 tx=0x7f0fc80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=978c8b5439eeeaec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:38.462 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:37.633+0000 7f0fd67fc640 1 -- 172.21.15.99:0/649217980 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0fc8032440 con 0x7f0fd8076ae0 2024-09-19T06:31:38.462 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:37.633+0000 7f0fd67fc640 1 -- 172.21.15.99:0/649217980 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f0fc8032a00 con 0x7f0fd8076ae0 2024-09-19T06:31:38.462 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:37.633+0000 7f0fd67fc640 1 -- 172.21.15.99:0/649217980 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0fc80319e0 con 0x7f0fd8076ae0 2024-09-19T06:31:38.462 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:37.634+0000 7f0fddf64640 1 -- 172.21.15.99:0/649217980 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fd8076ae0 msgr2=0x7f0fd8104c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:38.462 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:37.634+0000 7f0fddf64640 1 --2- 172.21.15.99:0/649217980 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fd8076ae0 0x7f0fd8104c70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0fc8009840 tx=0x7f0fc80091d0 comp rx=0 tx=0).stop 2024-09-19T06:31:38.462 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:37.634+0000 7f0fddf64640 1 -- 172.21.15.99:0/649217980 shutdown_connections 2024-09-19T06:31:38.462 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:37.634+0000 7f0fddf64640 1 --2- 172.21.15.99:0/649217980 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fd8076ae0 0x7f0fd8104c70 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:38.462 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:37.634+0000 7f0fddf64640 1 -- 172.21.15.99:0/649217980 >> 172.21.15.99:0/649217980 conn(0x7f0fd80fc700 msgr2=0x7f0fd80feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:38.462 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:37.634+0000 7f0fddf64640 1 -- 172.21.15.99:0/649217980 shutdown_connections 2024-09-19T06:31:38.462 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:37.634+0000 7f0fddf64640 1 -- 172.21.15.99:0/649217980 wait complete. 2024-09-19T06:31:38.463 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:37.634+0000 7f0fddf64640 1 Processor -- start 2024-09-19T06:31:38.463 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:37.635+0000 7f0fddf64640 1 -- start start 2024-09-19T06:31:38.463 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:37.635+0000 7f0fddf64640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fd8076ae0 0x7f0fd8110e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:38.463 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:37.635+0000 7f0fddf64640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd8111370 con 0x7f0fd8076ae0 2024-09-19T06:31:38.463 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:37.635+0000 7f0fd77fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fd8076ae0 0x7f0fd8110e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:38.463 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:37.635+0000 7f0fd77fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fd8076ae0 0x7f0fd8110e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35184/0 (socket says 172.21.15.99:35184) 2024-09-19T06:31:38.463 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:37.635+0000 7f0fd77fe640 1 -- 172.21.15.99:0/2910348345 learned_addr learned my addr 172.21.15.99:0/2910348345 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:31:38.463 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:37.635+0000 7f0fd77fe640 1 -- 172.21.15.99:0/2910348345 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc8009450 con 0x7f0fd8076ae0 2024-09-19T06:31:38.463 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:37.635+0000 7f0fd77fe640 1 --2- 172.21.15.99:0/2910348345 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fd8076ae0 0x7f0fd8110e30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0fc80098a0 tx=0x7f0fc8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:38.463 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:37.635+0000 7f0fbffff640 1 -- 172.21.15.99:0/2910348345 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0fc8032880 con 0x7f0fd8076ae0 2024-09-19T06:31:38.463 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:37.635+0000 7f0fbffff640 1 -- 172.21.15.99:0/2910348345 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f0fc803d8b0 con 0x7f0fd8076ae0 2024-09-19T06:31:38.463 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:37.635+0000 7f0fddf64640 1 -- 172.21.15.99:0/2910348345 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fd8111570 con 0x7f0fd8076ae0 2024-09-19T06:31:38.463 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:37.635+0000 7f0fbffff640 1 -- 172.21.15.99:0/2910348345 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0fc803b8e0 con 0x7f0fd8076ae0 2024-09-19T06:31:38.463 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:37.635+0000 7f0fddf64640 1 -- 172.21.15.99:0/2910348345 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fd8111fc0 con 0x7f0fd8076ae0 2024-09-19T06:31:38.464 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:37.636+0000 7f0fbffff640 1 -- 172.21.15.99:0/2910348345 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f0fc8039070 con 0x7f0fd8076ae0 2024-09-19T06:31:38.464 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:37.636+0000 7f0fddf64640 1 -- 172.21.15.99:0/2910348345 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fd8100380 con 0x7f0fd8076ae0 2024-09-19T06:31:38.464 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:37.636+0000 7f0fbffff640 1 --2- 172.21.15.99:0/2910348345 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f0fc0039490 0x7f0fc003b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:38.464 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:37.636+0000 7f0fbffff640 1 -- 172.21.15.99:0/2910348345 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f0fc806d5f0 con 0x7f0fd8076ae0 2024-09-19T06:31:38.464 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:37.637+0000 7f0fd6ffd640 1 --2- 172.21.15.99:0/2910348345 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f0fc0039490 0x7f0fc003b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:38.464 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:37.637+0000 7f0fd6ffd640 1 --2- 172.21.15.99:0/2910348345 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f0fc0039490 0x7f0fc003b940 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc006fd0 tx=0x7f0fcc006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:38.464 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:37.641+0000 7f0fbffff640 1 -- 172.21.15.99:0/2910348345 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f0fc8039550 con 0x7f0fd8076ae0 2024-09-19T06:31:38.464 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:37.805+0000 7f0fddf64640 1 -- 172.21.15.99:0/2910348345 --> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f0fd80fdac0 con 0x7f0fc0039490 2024-09-19T06:31:38.464 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:37.813+0000 7f0fbffff640 1 -- 172.21.15.99:0/2910348345 <== mgr.14118 v2:172.21.15.99:6800/3738534523 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f0fd80fdac0 con 0x7f0fc0039490 2024-09-19T06:31:38.464 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:37.816+0000 7f0fddf64640 1 -- 172.21.15.99:0/2910348345 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f0fc0039490 msgr2=0x7f0fc003b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:38.464 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:37.816+0000 7f0fddf64640 1 --2- 172.21.15.99:0/2910348345 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f0fc0039490 0x7f0fc003b940 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc006fd0 tx=0x7f0fcc006db0 comp rx=0 tx=0).stop 2024-09-19T06:31:38.465 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:37.816+0000 7f0fddf64640 1 -- 172.21.15.99:0/2910348345 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fd8076ae0 msgr2=0x7f0fd8110e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:38.465 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:37.816+0000 7f0fddf64640 1 --2- 172.21.15.99:0/2910348345 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fd8076ae0 0x7f0fd8110e30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0fc80098a0 tx=0x7f0fc8008040 comp rx=0 tx=0).stop 2024-09-19T06:31:38.465 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:37.816+0000 7f0fddf64640 1 -- 172.21.15.99:0/2910348345 shutdown_connections 2024-09-19T06:31:38.465 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:37.816+0000 7f0fddf64640 1 --2- 172.21.15.99:0/2910348345 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f0fc0039490 0x7f0fc003b940 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:38.465 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:37.816+0000 7f0fddf64640 1 --2- 172.21.15.99:0/2910348345 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fd8076ae0 0x7f0fd8110e30 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:38.465 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:37.816+0000 7f0fddf64640 1 -- 172.21.15.99:0/2910348345 >> 172.21.15.99:0/2910348345 conn(0x7f0fd80fc700 msgr2=0x7f0fd80fd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:38.465 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:37.816+0000 7f0fddf64640 1 -- 172.21.15.99:0/2910348345 shutdown_connections 2024-09-19T06:31:38.465 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:37.816+0000 7f0fddf64640 1 -- 172.21.15.99:0/2910348345 wait complete. 2024-09-19T06:31:39.020 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:38 smithi099 ceph-mon[27651]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:31:39.020 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:38 smithi099 ceph-mon[27651]: from='mgr.14118 172.21.15.99:0/3537138547' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:31:39.020 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:38 smithi099 ceph-mon[27651]: from='mgr.14118 172.21.15.99:0/3537138547' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:31:39.559 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-19T06:31:39.559 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:38.840+0000 7f0c0addc640 1 Processor -- start 2024-09-19T06:31:39.559 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:38.840+0000 7f0c0addc640 1 -- start start 2024-09-19T06:31:39.559 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:38.841+0000 7f0c0addc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c04100e90 0x7f0c041012a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:39.559 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:38.841+0000 7f0c0addc640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c041017e0 con 0x7f0c04100e90 2024-09-19T06:31:39.559 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:38.841+0000 7f0c08b78640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c04100e90 0x7f0c041012a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:39.559 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:38.841+0000 7f0c08b78640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c04100e90 0x7f0c041012a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35198/0 (socket says 172.21.15.99:35198) 2024-09-19T06:31:39.560 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:38.841+0000 7f0c08b78640 1 -- 172.21.15.99:0/3675621825 learned_addr learned my addr 172.21.15.99:0/3675621825 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:31:39.560 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:38.841+0000 7f0c08b78640 1 -- 172.21.15.99:0/3675621825 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c04101920 con 0x7f0c04100e90 2024-09-19T06:31:39.560 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:38.842+0000 7f0c08b78640 1 --2- 172.21.15.99:0/3675621825 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c04100e90 0x7f0c041012a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0bf8009840 tx=0x7f0bf80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c3032358fa1ed3e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:39.560 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:38.842+0000 7f0c037fe640 1 -- 172.21.15.99:0/3675621825 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0bf8032440 con 0x7f0c04100e90 2024-09-19T06:31:39.560 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:38.842+0000 7f0c037fe640 1 -- 172.21.15.99:0/3675621825 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f0bf8032a00 con 0x7f0c04100e90 2024-09-19T06:31:39.560 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:38.842+0000 7f0c037fe640 1 -- 172.21.15.99:0/3675621825 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0bf8031a10 con 0x7f0c04100e90 2024-09-19T06:31:39.560 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:38.842+0000 7f0c0addc640 1 -- 172.21.15.99:0/3675621825 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c04100e90 msgr2=0x7f0c041012a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:39.560 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:38.842+0000 7f0c0addc640 1 --2- 172.21.15.99:0/3675621825 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c04100e90 0x7f0c041012a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0bf8009840 tx=0x7f0bf80091d0 comp rx=0 tx=0).stop 2024-09-19T06:31:39.560 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:38.842+0000 7f0c0addc640 1 -- 172.21.15.99:0/3675621825 shutdown_connections 2024-09-19T06:31:39.560 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:38.842+0000 7f0c0addc640 1 --2- 172.21.15.99:0/3675621825 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c04100e90 0x7f0c041012a0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:39.560 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:38.842+0000 7f0c0addc640 1 -- 172.21.15.99:0/3675621825 >> 172.21.15.99:0/3675621825 conn(0x7f0c040fc6d0 msgr2=0x7f0c040feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:39.560 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:38.842+0000 7f0c0addc640 1 -- 172.21.15.99:0/3675621825 shutdown_connections 2024-09-19T06:31:39.561 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:38.842+0000 7f0c0addc640 1 -- 172.21.15.99:0/3675621825 wait complete. 2024-09-19T06:31:39.561 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:38.843+0000 7f0c0addc640 1 Processor -- start 2024-09-19T06:31:39.561 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:38.843+0000 7f0c0addc640 1 -- start start 2024-09-19T06:31:39.561 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:38.843+0000 7f0c0addc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c04100e90 0x7f0c04107080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:39.561 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:38.843+0000 7f0c0addc640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c041075c0 con 0x7f0c04100e90 2024-09-19T06:31:39.561 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:38.843+0000 7f0c08b78640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c04100e90 0x7f0c04107080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:39.561 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:38.843+0000 7f0c08b78640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c04100e90 0x7f0c04107080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35206/0 (socket says 172.21.15.99:35206) 2024-09-19T06:31:39.561 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:38.843+0000 7f0c08b78640 1 -- 172.21.15.99:0/170521104 learned_addr learned my addr 172.21.15.99:0/170521104 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:31:39.561 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:38.844+0000 7f0c08b78640 1 -- 172.21.15.99:0/170521104 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf8009450 con 0x7f0c04100e90 2024-09-19T06:31:39.561 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:38.844+0000 7f0c08b78640 1 --2- 172.21.15.99:0/170521104 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c04100e90 0x7f0c04107080 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0bf8006a70 tx=0x7f0bf802c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:39.561 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:38.844+0000 7f0c017fa640 1 -- 172.21.15.99:0/170521104 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0bf8031d10 con 0x7f0c04100e90 2024-09-19T06:31:39.561 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:38.844+0000 7f0c017fa640 1 -- 172.21.15.99:0/170521104 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f0bf8031e70 con 0x7f0c04100e90 2024-09-19T06:31:39.561 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:38.844+0000 7f0c0addc640 1 -- 172.21.15.99:0/170521104 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c04105650 con 0x7f0c04100e90 2024-09-19T06:31:39.562 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:38.844+0000 7f0c017fa640 1 -- 172.21.15.99:0/170521104 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0bf803b6f0 con 0x7f0c04100e90 2024-09-19T06:31:39.562 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:38.844+0000 7f0c0addc640 1 -- 172.21.15.99:0/170521104 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c04105ac0 con 0x7f0c04100e90 2024-09-19T06:31:39.562 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:38.845+0000 7f0c017fa640 1 -- 172.21.15.99:0/170521104 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f0bf8039070 con 0x7f0c04100e90 2024-09-19T06:31:39.562 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:38.845+0000 7f0c0addc640 1 -- 172.21.15.99:0/170521104 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c04102b10 con 0x7f0c04100e90 2024-09-19T06:31:39.562 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:38.845+0000 7f0c017fa640 1 --2- 172.21.15.99:0/170521104 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f0bf40394e0 0x7f0bf403b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:39.562 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:38.845+0000 7f0c017fa640 1 -- 172.21.15.99:0/170521104 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f0bf806d0e0 con 0x7f0c04100e90 2024-09-19T06:31:39.562 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:38.845+0000 7f0c03fff640 1 --2- 172.21.15.99:0/170521104 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f0bf40394e0 0x7f0bf403b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:39.563 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:38.845+0000 7f0c03fff640 1 --2- 172.21.15.99:0/170521104 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f0bf40394e0 0x7f0bf403b990 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0bf0006fd0 tx=0x7f0bf0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:39.563 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:38.850+0000 7f0c017fa640 1 -- 172.21.15.99:0/170521104 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f0bf8045d60 con 0x7f0c04100e90 2024-09-19T06:31:39.563 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:39.007+0000 7f0c0addc640 1 -- 172.21.15.99:0/170521104 --> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f0c04106520 con 0x7f0bf40394e0 2024-09-19T06:31:39.563 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:39.008+0000 7f0c017fa640 1 -- 172.21.15.99:0/170521104 <== mgr.14118 v2:172.21.15.99:6800/3738534523 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f0c04106520 con 0x7f0bf40394e0 2024-09-19T06:31:39.563 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:39.009+0000 7f0c0addc640 1 -- 172.21.15.99:0/170521104 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f0bf40394e0 msgr2=0x7f0bf403b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:39.563 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:39.009+0000 7f0c0addc640 1 --2- 172.21.15.99:0/170521104 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f0bf40394e0 0x7f0bf403b990 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0bf0006fd0 tx=0x7f0bf0006db0 comp rx=0 tx=0).stop 2024-09-19T06:31:39.564 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:39.009+0000 7f0c0addc640 1 -- 172.21.15.99:0/170521104 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c04100e90 msgr2=0x7f0c04107080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:39.564 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:39.009+0000 7f0c0addc640 1 --2- 172.21.15.99:0/170521104 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c04100e90 0x7f0c04107080 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0bf8006a70 tx=0x7f0bf802c040 comp rx=0 tx=0).stop 2024-09-19T06:31:39.564 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:39.010+0000 7f0c0addc640 1 -- 172.21.15.99:0/170521104 shutdown_connections 2024-09-19T06:31:39.564 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:39.010+0000 7f0c0addc640 1 --2- 172.21.15.99:0/170521104 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f0bf40394e0 0x7f0bf403b990 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:39.564 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:39.010+0000 7f0c0addc640 1 --2- 172.21.15.99:0/170521104 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c04100e90 0x7f0c04107080 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:39.565 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:39.010+0000 7f0c0addc640 1 -- 172.21.15.99:0/170521104 >> 172.21.15.99:0/170521104 conn(0x7f0c040fc6d0 msgr2=0x7f0c040fd2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:39.565 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:39.010+0000 7f0c0addc640 1 -- 172.21.15.99:0/170521104 shutdown_connections 2024-09-19T06:31:39.565 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:39.010+0000 7f0c0addc640 1 -- 172.21.15.99:0/170521104 wait complete. 2024-09-19T06:31:39.565 INFO:teuthology.orchestra.run.smithi099.stdout:Generating ssh key... 2024-09-19T06:31:40.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:39 smithi099 ceph-mon[27651]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:31:40.849 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:39.942+0000 7fed2240c640 1 Processor -- start 2024-09-19T06:31:40.850 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:39.942+0000 7fed2240c640 1 -- start start 2024-09-19T06:31:40.850 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:39.943+0000 7fed2240c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fed1c076a30 0x7fed1c104d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:40.850 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:39.943+0000 7fed2240c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed1c076e40 con 0x7fed1c076a30 2024-09-19T06:31:40.850 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:39.943+0000 7fed1bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fed1c076a30 0x7fed1c104d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:40.850 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:39.943+0000 7fed1bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fed1c076a30 0x7fed1c104d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35208/0 (socket says 172.21.15.99:35208) 2024-09-19T06:31:40.850 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:39.943+0000 7fed1bfff640 1 -- 172.21.15.99:0/1992402540 learned_addr learned my addr 172.21.15.99:0/1992402540 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:31:40.850 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:39.943+0000 7fed1bfff640 1 -- 172.21.15.99:0/1992402540 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed1c105280 con 0x7fed1c076a30 2024-09-19T06:31:40.850 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:39.944+0000 7fed1bfff640 1 --2- 172.21.15.99:0/1992402540 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fed1c076a30 0x7fed1c104d40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fed0c009840 tx=0x7fed0c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=298f7c297003ce6d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:40.850 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:39.944+0000 7fed1affd640 1 -- 172.21.15.99:0/1992402540 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fed0c032440 con 0x7fed1c076a30 2024-09-19T06:31:40.850 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:39.944+0000 7fed1affd640 1 -- 172.21.15.99:0/1992402540 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fed0c032a00 con 0x7fed1c076a30 2024-09-19T06:31:40.850 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:39.944+0000 7fed1affd640 1 -- 172.21.15.99:0/1992402540 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fed0c031a10 con 0x7fed1c076a30 2024-09-19T06:31:40.851 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:39.944+0000 7fed2240c640 1 -- 172.21.15.99:0/1992402540 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fed1c076a30 msgr2=0x7fed1c104d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:40.851 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:39.944+0000 7fed2240c640 1 --2- 172.21.15.99:0/1992402540 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fed1c076a30 0x7fed1c104d40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fed0c009840 tx=0x7fed0c0091d0 comp rx=0 tx=0).stop 2024-09-19T06:31:40.851 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:39.944+0000 7fed2240c640 1 -- 172.21.15.99:0/1992402540 shutdown_connections 2024-09-19T06:31:40.851 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:39.944+0000 7fed2240c640 1 --2- 172.21.15.99:0/1992402540 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fed1c076a30 0x7fed1c104d40 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:40.851 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:39.944+0000 7fed2240c640 1 -- 172.21.15.99:0/1992402540 >> 172.21.15.99:0/1992402540 conn(0x7fed1c0fc790 msgr2=0x7fed1c0feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:40.851 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:39.945+0000 7fed2240c640 1 -- 172.21.15.99:0/1992402540 shutdown_connections 2024-09-19T06:31:40.851 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:39.945+0000 7fed2240c640 1 -- 172.21.15.99:0/1992402540 wait complete. 2024-09-19T06:31:40.851 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:39.945+0000 7fed2240c640 1 Processor -- start 2024-09-19T06:31:40.851 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:39.945+0000 7fed2240c640 1 -- start start 2024-09-19T06:31:40.851 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:39.945+0000 7fed2240c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fed1c076a30 0x7fed1c110df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:40.851 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:39.945+0000 7fed2240c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed1c111330 con 0x7fed1c076a30 2024-09-19T06:31:40.851 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:39.945+0000 7fed1bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fed1c076a30 0x7fed1c110df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:40.851 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:39.945+0000 7fed1bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fed1c076a30 0x7fed1c110df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35218/0 (socket says 172.21.15.99:35218) 2024-09-19T06:31:40.852 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:39.945+0000 7fed1bfff640 1 -- 172.21.15.99:0/1814243043 learned_addr learned my addr 172.21.15.99:0/1814243043 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:31:40.852 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:39.946+0000 7fed1bfff640 1 -- 172.21.15.99:0/1814243043 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed0c009450 con 0x7fed1c076a30 2024-09-19T06:31:40.852 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:39.946+0000 7fed1bfff640 1 --2- 172.21.15.99:0/1814243043 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fed1c076a30 0x7fed1c110df0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fed0c0329d0 tx=0x7fed0c02c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:40.852 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:39.946+0000 7fed18ff9640 1 -- 172.21.15.99:0/1814243043 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fed0c031d10 con 0x7fed1c076a30 2024-09-19T06:31:40.852 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:39.946+0000 7fed18ff9640 1 -- 172.21.15.99:0/1814243043 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fed0c031e70 con 0x7fed1c076a30 2024-09-19T06:31:40.852 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:39.946+0000 7fed2240c640 1 -- 172.21.15.99:0/1814243043 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed1c111530 con 0x7fed1c076a30 2024-09-19T06:31:40.852 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:39.946+0000 7fed18ff9640 1 -- 172.21.15.99:0/1814243043 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fed0c03b670 con 0x7fed1c076a30 2024-09-19T06:31:40.852 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:39.946+0000 7fed2240c640 1 -- 172.21.15.99:0/1814243043 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed1c111f80 con 0x7fed1c076a30 2024-09-19T06:31:40.852 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:39.947+0000 7fed18ff9640 1 -- 172.21.15.99:0/1814243043 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7fed0c039070 con 0x7fed1c076a30 2024-09-19T06:31:40.852 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:39.947+0000 7fed18ff9640 1 --2- 172.21.15.99:0/1814243043 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7fed08039490 0x7fed0803b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:40.852 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:39.947+0000 7fed18ff9640 1 -- 172.21.15.99:0/1814243043 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fed0c06d0f0 con 0x7fed1c076a30 2024-09-19T06:31:40.852 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:39.947+0000 7fed1b7fe640 1 --2- 172.21.15.99:0/1814243043 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7fed08039490 0x7fed0803b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:40.852 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:39.947+0000 7fed2240c640 1 -- 172.21.15.99:0/1814243043 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed1c1003f0 con 0x7fed1c076a30 2024-09-19T06:31:40.853 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:39.948+0000 7fed1b7fe640 1 --2- 172.21.15.99:0/1814243043 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7fed08039490 0x7fed0803b940 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fed04006fd0 tx=0x7fed04006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:40.853 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:39.952+0000 7fed18ff9640 1 -- 172.21.15.99:0/1814243043 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fed0c041070 con 0x7fed1c076a30 2024-09-19T06:31:40.853 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:40.110+0000 7fed2240c640 1 -- 172.21.15.99:0/1814243043 --> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7fed1c0fdb10 con 0x7fed08039490 2024-09-19T06:31:40.853 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:40.330+0000 7fed18ff9640 1 -- 172.21.15.99:0/1814243043 <== mgr.14118 v2:172.21.15.99:6800/3738534523 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fed1c0fdb10 con 0x7fed08039490 2024-09-19T06:31:40.853 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:40.333+0000 7fed2240c640 1 -- 172.21.15.99:0/1814243043 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7fed08039490 msgr2=0x7fed0803b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:40.853 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:40.333+0000 7fed2240c640 1 --2- 172.21.15.99:0/1814243043 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7fed08039490 0x7fed0803b940 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fed04006fd0 tx=0x7fed04006db0 comp rx=0 tx=0).stop 2024-09-19T06:31:40.853 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:40.333+0000 7fed2240c640 1 -- 172.21.15.99:0/1814243043 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fed1c076a30 msgr2=0x7fed1c110df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:40.853 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:40.333+0000 7fed2240c640 1 --2- 172.21.15.99:0/1814243043 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fed1c076a30 0x7fed1c110df0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fed0c0329d0 tx=0x7fed0c02c040 comp rx=0 tx=0).stop 2024-09-19T06:31:40.853 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:40.333+0000 7fed2240c640 1 -- 172.21.15.99:0/1814243043 shutdown_connections 2024-09-19T06:31:40.853 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:40.333+0000 7fed2240c640 1 --2- 172.21.15.99:0/1814243043 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7fed08039490 0x7fed0803b940 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:40.853 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:40.333+0000 7fed2240c640 1 --2- 172.21.15.99:0/1814243043 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fed1c076a30 0x7fed1c110df0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:40.853 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:40.333+0000 7fed2240c640 1 -- 172.21.15.99:0/1814243043 >> 172.21.15.99:0/1814243043 conn(0x7fed1c0fc790 msgr2=0x7fed1c0fd340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:40.853 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:40.333+0000 7fed2240c640 1 -- 172.21.15.99:0/1814243043 shutdown_connections 2024-09-19T06:31:40.854 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:40.333+0000 7fed2240c640 1 -- 172.21.15.99:0/1814243043 wait complete. 2024-09-19T06:31:41.695 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:41 smithi099 ceph-mon[27651]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:31:41.696 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:41 smithi099 ceph-mon[27651]: Generating ssh key... 2024-09-19T06:31:41.696 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:41 smithi099 ceph-mon[27651]: from='mgr.14118 172.21.15.99:0/3537138547' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:31:41.696 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:41 smithi099 ceph-mon[27651]: from='mgr.14118 172.21.15.99:0/3537138547' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:31:42.499 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDoz+Xxpolp74zpvGAPw4w23RjyA7B2Y9DUvzRtPXNZF1UbnzCysYYZEZZ/NDyJv/6H7nO2PdftFX0yzaOx1mRJ0ocIguGFHJgQx6oR4OWObGNqayXA68KykbnhmB941dgQAG5v4sAYIwHLoIsWJa8eOrrHW82NNfEnoUvn+rZ7vPsW0AYhcDrF7vO9iqbgcTQ1kpns/Z2KAGABaIjQJ/ENn6ylO1EVlErx95lgCioDaeCdse0rE74WnUsqAb5ctje1IeEPa/JbFO2yTRvHoXX8aNu6UjS1vVNqb/mWawyjvSN8Z9Tjjl9c2Hxlo1FI9bs0MYtSdpFGiSClU8KJYpDxgzWXcw4fBTMzh6HLLINfb7JhzUMryJFz6iikgeUDo5jANloW+Lcmx6whxy6Xk/ZtrQGGkG4gaMvs+9fuMfMt62qdRwuY0TZ2sBH0GdMfBelIWl6ckN5xX5rYw9WqIQNvvAbm7jgKmtFnRJrBZpQ2LBFO64M+dOBE6azrhTumK0k= ceph-a73eb958-7650-11ef-bceb-c7b262605968 2024-09-19T06:31:42.499 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:41.773+0000 7f0eafc9d640 1 Processor -- start 2024-09-19T06:31:42.499 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:41.773+0000 7f0eafc9d640 1 -- start start 2024-09-19T06:31:42.499 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:41.773+0000 7f0eafc9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ea8102070 0x7f0ea8102480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:42.499 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:41.773+0000 7f0eafc9d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea81029c0 con 0x7f0ea8102070 2024-09-19T06:31:42.499 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:41.773+0000 7f0eada39640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ea8102070 0x7f0ea8102480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:42.500 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:41.773+0000 7f0eada39640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ea8102070 0x7f0ea8102480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35228/0 (socket says 172.21.15.99:35228) 2024-09-19T06:31:42.500 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:41.773+0000 7f0eada39640 1 -- 172.21.15.99:0/651690057 learned_addr learned my addr 172.21.15.99:0/651690057 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:31:42.500 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:41.773+0000 7f0eada39640 1 -- 172.21.15.99:0/651690057 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea8102b00 con 0x7f0ea8102070 2024-09-19T06:31:42.500 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:41.774+0000 7f0eada39640 1 --2- 172.21.15.99:0/651690057 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ea8102070 0x7f0ea8102480 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0ea4009840 tx=0x7f0ea40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33f3066ae0895484 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:42.500 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:41.774+0000 7f0eaca37640 1 -- 172.21.15.99:0/651690057 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0ea4032440 con 0x7f0ea8102070 2024-09-19T06:31:42.500 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:41.774+0000 7f0eaca37640 1 -- 172.21.15.99:0/651690057 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f0ea4032a00 con 0x7f0ea8102070 2024-09-19T06:31:42.500 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:41.774+0000 7f0eaca37640 1 -- 172.21.15.99:0/651690057 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0ea4031a10 con 0x7f0ea8102070 2024-09-19T06:31:42.500 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:41.775+0000 7f0eafc9d640 1 -- 172.21.15.99:0/651690057 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ea8102070 msgr2=0x7f0ea8102480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:42.500 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:41.775+0000 7f0eafc9d640 1 --2- 172.21.15.99:0/651690057 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ea8102070 0x7f0ea8102480 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0ea4009840 tx=0x7f0ea40091d0 comp rx=0 tx=0).stop 2024-09-19T06:31:42.500 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:41.775+0000 7f0eafc9d640 1 -- 172.21.15.99:0/651690057 shutdown_connections 2024-09-19T06:31:42.500 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:41.775+0000 7f0eafc9d640 1 --2- 172.21.15.99:0/651690057 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ea8102070 0x7f0ea8102480 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:42.500 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:41.775+0000 7f0eafc9d640 1 -- 172.21.15.99:0/651690057 >> 172.21.15.99:0/651690057 conn(0x7f0ea80fd850 msgr2=0x7f0ea80ffc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:42.500 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:41.775+0000 7f0eafc9d640 1 -- 172.21.15.99:0/651690057 shutdown_connections 2024-09-19T06:31:42.501 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:41.775+0000 7f0eafc9d640 1 -- 172.21.15.99:0/651690057 wait complete. 2024-09-19T06:31:42.501 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:41.776+0000 7f0eafc9d640 1 Processor -- start 2024-09-19T06:31:42.501 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:41.776+0000 7f0eafc9d640 1 -- start start 2024-09-19T06:31:42.501 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:41.776+0000 7f0eafc9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ea8102070 0x7f0ea8110cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:42.501 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:41.776+0000 7f0eafc9d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea8111230 con 0x7f0ea8102070 2024-09-19T06:31:42.501 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:41.776+0000 7f0eada39640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ea8102070 0x7f0ea8110cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:42.501 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:41.776+0000 7f0eada39640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ea8102070 0x7f0ea8110cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35242/0 (socket says 172.21.15.99:35242) 2024-09-19T06:31:42.501 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:41.776+0000 7f0eada39640 1 -- 172.21.15.99:0/1482486715 learned_addr learned my addr 172.21.15.99:0/1482486715 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:31:42.501 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:41.776+0000 7f0eada39640 1 -- 172.21.15.99:0/1482486715 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea4009450 con 0x7f0ea8102070 2024-09-19T06:31:42.501 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:41.776+0000 7f0eada39640 1 --2- 172.21.15.99:0/1482486715 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ea8102070 0x7f0ea8110cf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0ea40098a0 tx=0x7f0ea402c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:42.501 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:41.777+0000 7f0e9e7fc640 1 -- 172.21.15.99:0/1482486715 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0ea40327b0 con 0x7f0ea8102070 2024-09-19T06:31:42.501 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:41.777+0000 7f0e9e7fc640 1 -- 172.21.15.99:0/1482486715 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f0ea403b870 con 0x7f0ea8102070 2024-09-19T06:31:42.502 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:41.777+0000 7f0eafc9d640 1 -- 172.21.15.99:0/1482486715 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ea8111430 con 0x7f0ea8102070 2024-09-19T06:31:42.502 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:41.777+0000 7f0e9e7fc640 1 -- 172.21.15.99:0/1482486715 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0ea403a550 con 0x7f0ea8102070 2024-09-19T06:31:42.502 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:41.777+0000 7f0eafc9d640 1 -- 172.21.15.99:0/1482486715 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ea81118a0 con 0x7f0ea8102070 2024-09-19T06:31:42.502 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:41.778+0000 7f0e9e7fc640 1 -- 172.21.15.99:0/1482486715 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f0ea4039040 con 0x7f0ea8102070 2024-09-19T06:31:42.502 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:41.778+0000 7f0eafc9d640 1 -- 172.21.15.99:0/1482486715 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ea804b720 con 0x7f0ea8102070 2024-09-19T06:31:42.502 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:41.778+0000 7f0e9e7fc640 1 --2- 172.21.15.99:0/1482486715 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f0e94039490 0x7f0e9403b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:42.502 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:41.778+0000 7f0e9e7fc640 1 -- 172.21.15.99:0/1482486715 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f0ea406c6f0 con 0x7f0ea8102070 2024-09-19T06:31:42.502 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:41.778+0000 7f0ead238640 1 --2- 172.21.15.99:0/1482486715 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f0e94039490 0x7f0e9403b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:42.502 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:41.778+0000 7f0ead238640 1 --2- 172.21.15.99:0/1482486715 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f0e94039490 0x7f0e9403b940 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0e98006fd0 tx=0x7f0e98006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:42.502 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:41.782+0000 7f0e9e7fc640 1 -- 172.21.15.99:0/1482486715 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f0ea4030ae0 con 0x7f0ea8102070 2024-09-19T06:31:42.502 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:41.938+0000 7f0eafc9d640 1 -- 172.21.15.99:0/1482486715 --> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f0ea81118a0 con 0x7f0e94039490 2024-09-19T06:31:42.502 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:41.939+0000 7f0e9e7fc640 1 -- 172.21.15.99:0/1482486715 <== mgr.14118 v2:172.21.15.99:6800/3738534523 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f0ea81118a0 con 0x7f0e94039490 2024-09-19T06:31:42.502 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:41.941+0000 7f0eafc9d640 1 -- 172.21.15.99:0/1482486715 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f0e94039490 msgr2=0x7f0e9403b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:42.503 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:41.941+0000 7f0eafc9d640 1 --2- 172.21.15.99:0/1482486715 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f0e94039490 0x7f0e9403b940 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0e98006fd0 tx=0x7f0e98006db0 comp rx=0 tx=0).stop 2024-09-19T06:31:42.503 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:41.941+0000 7f0eafc9d640 1 -- 172.21.15.99:0/1482486715 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ea8102070 msgr2=0x7f0ea8110cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:42.503 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:41.941+0000 7f0eafc9d640 1 --2- 172.21.15.99:0/1482486715 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ea8102070 0x7f0ea8110cf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0ea40098a0 tx=0x7f0ea402c040 comp rx=0 tx=0).stop 2024-09-19T06:31:42.503 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:41.941+0000 7f0eafc9d640 1 -- 172.21.15.99:0/1482486715 shutdown_connections 2024-09-19T06:31:42.503 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:41.941+0000 7f0eafc9d640 1 --2- 172.21.15.99:0/1482486715 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f0e94039490 0x7f0e9403b940 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:42.503 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:41.941+0000 7f0eafc9d640 1 --2- 172.21.15.99:0/1482486715 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ea8102070 0x7f0ea8110cf0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:42.503 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:41.941+0000 7f0eafc9d640 1 -- 172.21.15.99:0/1482486715 >> 172.21.15.99:0/1482486715 conn(0x7f0ea80fd850 msgr2=0x7f0ea80fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:42.503 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:41.941+0000 7f0eafc9d640 1 -- 172.21.15.99:0/1482486715 shutdown_connections 2024-09-19T06:31:42.503 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:41.941+0000 7f0eafc9d640 1 -- 172.21.15.99:0/1482486715 wait complete. 2024-09-19T06:31:42.503 INFO:teuthology.orchestra.run.smithi099.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-19T06:31:42.503 INFO:teuthology.orchestra.run.smithi099.stdout:Adding key to root@localhost authorized_keys... 2024-09-19T06:31:42.504 INFO:teuthology.orchestra.run.smithi099.stdout:Adding host smithi099... 2024-09-19T06:31:43.053 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:42 smithi099 ceph-mon[27651]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:31:44.098 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:43 smithi099 ceph-mon[27651]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi099", "addr": "172.21.15.99", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:31:45.191 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:44 smithi099 ceph-mon[27651]: Deploying cephadm binary to smithi099 2024-09-19T06:31:46.375 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout Added host 'smithi099' with addr '172.21.15.99' 2024-09-19T06:31:46.375 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:42.879+0000 7f9f4e7cd640 1 Processor -- start 2024-09-19T06:31:46.375 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:42.879+0000 7f9f4e7cd640 1 -- start start 2024-09-19T06:31:46.375 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:42.879+0000 7f9f4e7cd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9f48076a30 0x7f9f48104d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:46.375 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:42.879+0000 7f9f4e7cd640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f48076e40 con 0x7f9f48076a30 2024-09-19T06:31:46.375 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:42.879+0000 7f9f47fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9f48076a30 0x7f9f48104d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:46.375 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:42.879+0000 7f9f47fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9f48076a30 0x7f9f48104d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35256/0 (socket says 172.21.15.99:35256) 2024-09-19T06:31:46.375 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:42.879+0000 7f9f47fff640 1 -- 172.21.15.99:0/2005070468 learned_addr learned my addr 172.21.15.99:0/2005070468 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:31:46.376 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:42.880+0000 7f9f47fff640 1 -- 172.21.15.99:0/2005070468 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f48105280 con 0x7f9f48076a30 2024-09-19T06:31:46.376 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:42.880+0000 7f9f47fff640 1 --2- 172.21.15.99:0/2005070468 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9f48076a30 0x7f9f48104d40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9f38009840 tx=0x7f9f380091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85d7f71633e00331 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:46.376 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:42.881+0000 7f9f46ffd640 1 -- 172.21.15.99:0/2005070468 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9f38032440 con 0x7f9f48076a30 2024-09-19T06:31:46.376 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:42.881+0000 7f9f46ffd640 1 -- 172.21.15.99:0/2005070468 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f9f38032a00 con 0x7f9f48076a30 2024-09-19T06:31:46.376 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:42.881+0000 7f9f46ffd640 1 -- 172.21.15.99:0/2005070468 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9f38031a10 con 0x7f9f48076a30 2024-09-19T06:31:46.376 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:42.881+0000 7f9f4e7cd640 1 -- 172.21.15.99:0/2005070468 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9f48076a30 msgr2=0x7f9f48104d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:46.376 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:42.881+0000 7f9f4e7cd640 1 --2- 172.21.15.99:0/2005070468 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9f48076a30 0x7f9f48104d40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9f38009840 tx=0x7f9f380091d0 comp rx=0 tx=0).stop 2024-09-19T06:31:46.376 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:42.881+0000 7f9f4e7cd640 1 -- 172.21.15.99:0/2005070468 shutdown_connections 2024-09-19T06:31:46.376 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:42.881+0000 7f9f4e7cd640 1 --2- 172.21.15.99:0/2005070468 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9f48076a30 0x7f9f48104d40 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:46.376 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:42.881+0000 7f9f4e7cd640 1 -- 172.21.15.99:0/2005070468 >> 172.21.15.99:0/2005070468 conn(0x7f9f480fc790 msgr2=0x7f9f480feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:46.376 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:42.881+0000 7f9f4e7cd640 1 -- 172.21.15.99:0/2005070468 shutdown_connections 2024-09-19T06:31:46.376 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:42.881+0000 7f9f4e7cd640 1 -- 172.21.15.99:0/2005070468 wait complete. 2024-09-19T06:31:46.377 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:42.882+0000 7f9f4e7cd640 1 Processor -- start 2024-09-19T06:31:46.377 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:42.882+0000 7f9f4e7cd640 1 -- start start 2024-09-19T06:31:46.377 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:42.882+0000 7f9f4e7cd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9f48076a30 0x7f9f48102670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:46.377 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:42.882+0000 7f9f4e7cd640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f48102bb0 con 0x7f9f48076a30 2024-09-19T06:31:46.377 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:42.882+0000 7f9f47fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9f48076a30 0x7f9f48102670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:46.377 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:42.882+0000 7f9f47fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9f48076a30 0x7f9f48102670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35262/0 (socket says 172.21.15.99:35262) 2024-09-19T06:31:46.377 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:42.882+0000 7f9f47fff640 1 -- 172.21.15.99:0/994830668 learned_addr learned my addr 172.21.15.99:0/994830668 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:31:46.377 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:42.882+0000 7f9f47fff640 1 -- 172.21.15.99:0/994830668 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f38009450 con 0x7f9f48076a30 2024-09-19T06:31:46.377 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:42.883+0000 7f9f47fff640 1 --2- 172.21.15.99:0/994830668 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9f48076a30 0x7f9f48102670 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9f380329d0 tx=0x7f9f3802c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:46.377 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:42.883+0000 7f9f44ff9640 1 -- 172.21.15.99:0/994830668 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9f38031d10 con 0x7f9f48076a30 2024-09-19T06:31:46.377 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:42.883+0000 7f9f44ff9640 1 -- 172.21.15.99:0/994830668 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f9f38031e70 con 0x7f9f48076a30 2024-09-19T06:31:46.377 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:42.883+0000 7f9f44ff9640 1 -- 172.21.15.99:0/994830668 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9f3803b670 con 0x7f9f48076a30 2024-09-19T06:31:46.377 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:42.883+0000 7f9f4e7cd640 1 -- 172.21.15.99:0/994830668 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f48100c40 con 0x7f9f48076a30 2024-09-19T06:31:46.378 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:42.883+0000 7f9f4e7cd640 1 -- 172.21.15.99:0/994830668 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f481010b0 con 0x7f9f48076a30 2024-09-19T06:31:46.378 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:42.884+0000 7f9f44ff9640 1 -- 172.21.15.99:0/994830668 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f9f38039070 con 0x7f9f48076a30 2024-09-19T06:31:46.378 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:42.884+0000 7f9f44ff9640 1 --2- 172.21.15.99:0/994830668 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f9f30039490 0x7f9f3003b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:46.378 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:42.884+0000 7f9f44ff9640 1 -- 172.21.15.99:0/994830668 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f9f3806d230 con 0x7f9f48076a30 2024-09-19T06:31:46.378 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:42.884+0000 7f9f4e7cd640 1 -- 172.21.15.99:0/994830668 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f4804b720 con 0x7f9f48076a30 2024-09-19T06:31:46.378 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:42.884+0000 7f9f477fe640 1 --2- 172.21.15.99:0/994830668 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f9f30039490 0x7f9f3003b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:46.378 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:42.884+0000 7f9f477fe640 1 --2- 172.21.15.99:0/994830668 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f9f30039490 0x7f9f3003b940 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c006fd0 tx=0x7f9f3c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:46.378 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:42.888+0000 7f9f44ff9640 1 -- 172.21.15.99:0/994830668 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f9f38041070 con 0x7f9f48076a30 2024-09-19T06:31:46.378 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:43.051+0000 7f9f4e7cd640 1 -- 172.21.15.99:0/994830668 --> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi099", "addr": "172.21.15.99", "target": ["mon-mgr", ""]}) v1 -- 0x7f9f48101860 con 0x7f9f30039490 2024-09-19T06:31:46.379 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:45.763+0000 7f9f44ff9640 1 -- 172.21.15.99:0/994830668 <== mgr.14118 v2:172.21.15.99:6800/3738534523 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7f9f48101860 con 0x7f9f30039490 2024-09-19T06:31:46.379 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:45.765+0000 7f9f4e7cd640 1 -- 172.21.15.99:0/994830668 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f9f30039490 msgr2=0x7f9f3003b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:46.379 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:45.765+0000 7f9f4e7cd640 1 --2- 172.21.15.99:0/994830668 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f9f30039490 0x7f9f3003b940 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c006fd0 tx=0x7f9f3c006db0 comp rx=0 tx=0).stop 2024-09-19T06:31:46.379 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:45.765+0000 7f9f4e7cd640 1 -- 172.21.15.99:0/994830668 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9f48076a30 msgr2=0x7f9f48102670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:46.379 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:45.765+0000 7f9f4e7cd640 1 --2- 172.21.15.99:0/994830668 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9f48076a30 0x7f9f48102670 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9f380329d0 tx=0x7f9f3802c040 comp rx=0 tx=0).stop 2024-09-19T06:31:46.379 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:45.765+0000 7f9f4e7cd640 1 -- 172.21.15.99:0/994830668 shutdown_connections 2024-09-19T06:31:46.379 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:45.765+0000 7f9f4e7cd640 1 --2- 172.21.15.99:0/994830668 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f9f30039490 0x7f9f3003b940 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:46.379 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:45.765+0000 7f9f4e7cd640 1 --2- 172.21.15.99:0/994830668 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9f48076a30 0x7f9f48102670 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:46.379 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:45.766+0000 7f9f4e7cd640 1 -- 172.21.15.99:0/994830668 >> 172.21.15.99:0/994830668 conn(0x7f9f480fc790 msgr2=0x7f9f480fd340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:46.379 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:45.766+0000 7f9f4e7cd640 1 -- 172.21.15.99:0/994830668 shutdown_connections 2024-09-19T06:31:46.379 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:45.766+0000 7f9f4e7cd640 1 -- 172.21.15.99:0/994830668 wait complete. 2024-09-19T06:31:46.379 INFO:teuthology.orchestra.run.smithi099.stdout:Deploying mon service with default placement... 2024-09-19T06:31:46.952 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:46 smithi099 ceph-mon[27651]: from='mgr.14118 172.21.15.99:0/3537138547' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:31:46.952 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:46 smithi099 ceph-mon[27651]: Added host smithi099 2024-09-19T06:31:46.952 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:46 smithi099 ceph-mon[27651]: from='mgr.14118 172.21.15.99:0/3537138547' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:31:47.818 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-19T06:31:47.818 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:46.767+0000 7f6d170fe640 1 Processor -- start 2024-09-19T06:31:47.818 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:46.767+0000 7f6d170fe640 1 -- start start 2024-09-19T06:31:47.818 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:46.767+0000 7f6d170fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6d10100f10 0x7f6d10101320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:47.818 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:46.767+0000 7f6d170fe640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d10101860 con 0x7f6d10100f10 2024-09-19T06:31:47.818 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:46.767+0000 7f6d14e9a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6d10100f10 0x7f6d10101320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:47.818 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:46.767+0000 7f6d14e9a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6d10100f10 0x7f6d10101320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34456/0 (socket says 172.21.15.99:34456) 2024-09-19T06:31:47.819 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:46.767+0000 7f6d14e9a640 1 -- 172.21.15.99:0/830968564 learned_addr learned my addr 172.21.15.99:0/830968564 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:31:47.819 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:46.768+0000 7f6d14e9a640 1 -- 172.21.15.99:0/830968564 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d101019a0 con 0x7f6d10100f10 2024-09-19T06:31:47.819 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:46.768+0000 7f6d14e9a640 1 --2- 172.21.15.99:0/830968564 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6d10100f10 0x7f6d10101320 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6d04009840 tx=0x7f6d040091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54d29add4a217a22 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:47.819 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:46.768+0000 7f6d0f7fe640 1 -- 172.21.15.99:0/830968564 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6d04032440 con 0x7f6d10100f10 2024-09-19T06:31:47.819 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:46.768+0000 7f6d0f7fe640 1 -- 172.21.15.99:0/830968564 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f6d04032a00 con 0x7f6d10100f10 2024-09-19T06:31:47.819 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:46.768+0000 7f6d0f7fe640 1 -- 172.21.15.99:0/830968564 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6d040319e0 con 0x7f6d10100f10 2024-09-19T06:31:47.819 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:46.769+0000 7f6d170fe640 1 -- 172.21.15.99:0/830968564 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6d10100f10 msgr2=0x7f6d10101320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:47.819 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:46.769+0000 7f6d170fe640 1 --2- 172.21.15.99:0/830968564 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6d10100f10 0x7f6d10101320 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6d04009840 tx=0x7f6d040091d0 comp rx=0 tx=0).stop 2024-09-19T06:31:47.819 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:46.769+0000 7f6d170fe640 1 -- 172.21.15.99:0/830968564 shutdown_connections 2024-09-19T06:31:47.819 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:46.769+0000 7f6d170fe640 1 --2- 172.21.15.99:0/830968564 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6d10100f10 0x7f6d10101320 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:47.819 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:46.769+0000 7f6d170fe640 1 -- 172.21.15.99:0/830968564 >> 172.21.15.99:0/830968564 conn(0x7f6d100fc710 msgr2=0x7f6d100feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:47.819 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:46.769+0000 7f6d170fe640 1 -- 172.21.15.99:0/830968564 shutdown_connections 2024-09-19T06:31:47.819 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:46.769+0000 7f6d170fe640 1 -- 172.21.15.99:0/830968564 wait complete. 2024-09-19T06:31:47.819 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:46.770+0000 7f6d170fe640 1 Processor -- start 2024-09-19T06:31:47.820 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:46.770+0000 7f6d170fe640 1 -- start start 2024-09-19T06:31:47.820 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:46.770+0000 7f6d170fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6d10100f10 0x7f6d1010fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:47.820 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:46.770+0000 7f6d170fe640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d10110180 con 0x7f6d10100f10 2024-09-19T06:31:47.820 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:46.770+0000 7f6d14e9a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6d10100f10 0x7f6d1010fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:47.820 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:46.770+0000 7f6d14e9a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6d10100f10 0x7f6d1010fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34464/0 (socket says 172.21.15.99:34464) 2024-09-19T06:31:47.820 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:46.770+0000 7f6d14e9a640 1 -- 172.21.15.99:0/3677125305 learned_addr learned my addr 172.21.15.99:0/3677125305 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:31:47.820 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:46.770+0000 7f6d14e9a640 1 -- 172.21.15.99:0/3677125305 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d04009450 con 0x7f6d10100f10 2024-09-19T06:31:47.820 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:46.771+0000 7f6d14e9a640 1 --2- 172.21.15.99:0/3677125305 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6d10100f10 0x7f6d1010fc40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6d04000c00 tx=0x7f6d04008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:47.820 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:46.771+0000 7f6d0d7fa640 1 -- 172.21.15.99:0/3677125305 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6d0403d450 con 0x7f6d10100f10 2024-09-19T06:31:47.820 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:46.771+0000 7f6d170fe640 1 -- 172.21.15.99:0/3677125305 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d10110380 con 0x7f6d10100f10 2024-09-19T06:31:47.820 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:46.771+0000 7f6d0d7fa640 1 -- 172.21.15.99:0/3677125305 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f6d0403da10 con 0x7f6d10100f10 2024-09-19T06:31:47.820 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:46.771+0000 7f6d0d7fa640 1 -- 172.21.15.99:0/3677125305 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6d0403b8e0 con 0x7f6d10100f10 2024-09-19T06:31:47.820 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:46.771+0000 7f6d170fe640 1 -- 172.21.15.99:0/3677125305 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d101107f0 con 0x7f6d10100f10 2024-09-19T06:31:47.821 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:46.772+0000 7f6d0d7fa640 1 -- 172.21.15.99:0/3677125305 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f6d04039070 con 0x7f6d10100f10 2024-09-19T06:31:47.821 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:46.772+0000 7f6d170fe640 1 -- 172.21.15.99:0/3677125305 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d1004b720 con 0x7f6d10100f10 2024-09-19T06:31:47.821 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:46.772+0000 7f6d0d7fa640 1 --2- 172.21.15.99:0/3677125305 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f6d00039490 0x7f6d0003b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:47.821 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:46.772+0000 7f6d0d7fa640 1 -- 172.21.15.99:0/3677125305 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f6d0406d230 con 0x7f6d10100f10 2024-09-19T06:31:47.821 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:46.772+0000 7f6d0ffff640 1 --2- 172.21.15.99:0/3677125305 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f6d00039490 0x7f6d0003b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:47.821 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:46.772+0000 7f6d0ffff640 1 --2- 172.21.15.99:0/3677125305 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f6d00039490 0x7f6d0003b940 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc006fd0 tx=0x7f6cfc006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:47.821 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:46.776+0000 7f6d0d7fa640 1 -- 172.21.15.99:0/3677125305 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f6d0404ed70 con 0x7f6d10100f10 2024-09-19T06:31:47.821 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:46.950+0000 7f6d170fe640 1 -- 172.21.15.99:0/3677125305 --> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7f6d101107f0 con 0x7f6d00039490 2024-09-19T06:31:47.821 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:46.954+0000 7f6d0d7fa640 1 -- 172.21.15.99:0/3677125305 <== mgr.14118 v2:172.21.15.99:6800/3738534523 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f6d101107f0 con 0x7f6d00039490 2024-09-19T06:31:47.821 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:46.956+0000 7f6d170fe640 1 -- 172.21.15.99:0/3677125305 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f6d00039490 msgr2=0x7f6d0003b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:47.822 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:46.956+0000 7f6d170fe640 1 --2- 172.21.15.99:0/3677125305 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f6d00039490 0x7f6d0003b940 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc006fd0 tx=0x7f6cfc006db0 comp rx=0 tx=0).stop 2024-09-19T06:31:47.822 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:46.956+0000 7f6d170fe640 1 -- 172.21.15.99:0/3677125305 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6d10100f10 msgr2=0x7f6d1010fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:47.822 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:46.956+0000 7f6d170fe640 1 --2- 172.21.15.99:0/3677125305 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6d10100f10 0x7f6d1010fc40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6d04000c00 tx=0x7f6d04008040 comp rx=0 tx=0).stop 2024-09-19T06:31:47.822 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:46.956+0000 7f6d170fe640 1 -- 172.21.15.99:0/3677125305 shutdown_connections 2024-09-19T06:31:47.822 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:46.956+0000 7f6d170fe640 1 --2- 172.21.15.99:0/3677125305 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f6d00039490 0x7f6d0003b940 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:47.822 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:46.956+0000 7f6d170fe640 1 --2- 172.21.15.99:0/3677125305 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6d10100f10 0x7f6d1010fc40 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:47.822 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:46.956+0000 7f6d170fe640 1 -- 172.21.15.99:0/3677125305 >> 172.21.15.99:0/3677125305 conn(0x7f6d100fc710 msgr2=0x7f6d100fd340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:47.822 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:46.956+0000 7f6d170fe640 1 -- 172.21.15.99:0/3677125305 shutdown_connections 2024-09-19T06:31:47.822 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:46.956+0000 7f6d170fe640 1 -- 172.21.15.99:0/3677125305 wait complete. 2024-09-19T06:31:47.822 INFO:teuthology.orchestra.run.smithi099.stdout:Deploying mgr service with default placement... 2024-09-19T06:31:48.147 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:47 smithi099 ceph-mon[27651]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:31:48.147 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:47 smithi099 ceph-mon[27651]: Saving service mon spec with placement count:5 2024-09-19T06:31:48.147 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:47 smithi099 ceph-mon[27651]: from='mgr.14118 172.21.15.99:0/3537138547' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:31:49.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:49 smithi099 ceph-mon[27651]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:31:49.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:49 smithi099 ceph-mon[27651]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:31:49.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:49 smithi099 ceph-mon[27651]: Saving service mgr spec with placement count:2 2024-09-19T06:31:49.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:49 smithi099 ceph-mon[27651]: from='mgr.14118 172.21.15.99:0/3537138547' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:31:49.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:49 smithi099 ceph-mon[27651]: from='mgr.14118 172.21.15.99:0/3537138547' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:31:49.824 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-19T06:31:49.824 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:48.223+0000 7f1bdb868640 1 Processor -- start 2024-09-19T06:31:49.824 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:48.223+0000 7f1bdb868640 1 -- start start 2024-09-19T06:31:49.824 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:48.224+0000 7f1bdb868640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1bd4101f90 0x7f1bd41023a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:49.825 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:48.224+0000 7f1bdb868640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd41028e0 con 0x7f1bd4101f90 2024-09-19T06:31:49.825 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:48.224+0000 7f1bd9604640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1bd4101f90 0x7f1bd41023a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:49.825 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:48.224+0000 7f1bd9604640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1bd4101f90 0x7f1bd41023a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34480/0 (socket says 172.21.15.99:34480) 2024-09-19T06:31:49.825 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:48.224+0000 7f1bd9604640 1 -- 172.21.15.99:0/125572839 learned_addr learned my addr 172.21.15.99:0/125572839 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:31:49.825 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:48.224+0000 7f1bd9604640 1 -- 172.21.15.99:0/125572839 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd4102a20 con 0x7f1bd4101f90 2024-09-19T06:31:49.825 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:48.225+0000 7f1bd9604640 1 --2- 172.21.15.99:0/125572839 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1bd4101f90 0x7f1bd41023a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0009840 tx=0x7f1bd00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cf3882edd1a574 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:49.825 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:48.225+0000 7f1bcbfff640 1 -- 172.21.15.99:0/125572839 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1bd0032440 con 0x7f1bd4101f90 2024-09-19T06:31:49.825 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:48.225+0000 7f1bcbfff640 1 -- 172.21.15.99:0/125572839 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f1bd0032a00 con 0x7f1bd4101f90 2024-09-19T06:31:49.825 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:48.225+0000 7f1bcbfff640 1 -- 172.21.15.99:0/125572839 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1bd00319e0 con 0x7f1bd4101f90 2024-09-19T06:31:49.825 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:48.226+0000 7f1bdb868640 1 -- 172.21.15.99:0/125572839 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1bd4101f90 msgr2=0x7f1bd41023a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:49.825 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:48.226+0000 7f1bdb868640 1 --2- 172.21.15.99:0/125572839 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1bd4101f90 0x7f1bd41023a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0009840 tx=0x7f1bd00091d0 comp rx=0 tx=0).stop 2024-09-19T06:31:49.826 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:48.226+0000 7f1bdb868640 1 -- 172.21.15.99:0/125572839 shutdown_connections 2024-09-19T06:31:49.826 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:48.226+0000 7f1bdb868640 1 --2- 172.21.15.99:0/125572839 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1bd4101f90 0x7f1bd41023a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:49.826 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:48.226+0000 7f1bdb868640 1 -- 172.21.15.99:0/125572839 >> 172.21.15.99:0/125572839 conn(0x7f1bd40fd730 msgr2=0x7f1bd40ffb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:49.826 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:48.226+0000 7f1bdb868640 1 -- 172.21.15.99:0/125572839 shutdown_connections 2024-09-19T06:31:49.826 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:48.226+0000 7f1bdb868640 1 -- 172.21.15.99:0/125572839 wait complete. 2024-09-19T06:31:49.826 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:48.226+0000 7f1bdb868640 1 Processor -- start 2024-09-19T06:31:49.826 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:48.226+0000 7f1bdb868640 1 -- start start 2024-09-19T06:31:49.826 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:48.226+0000 7f1bdb868640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1bd4101f90 0x7f1bd4078c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:49.826 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:48.226+0000 7f1bdb868640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd4079140 con 0x7f1bd4101f90 2024-09-19T06:31:49.826 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:48.227+0000 7f1bd9604640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1bd4101f90 0x7f1bd4078c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:49.826 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:48.227+0000 7f1bd9604640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1bd4101f90 0x7f1bd4078c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34494/0 (socket says 172.21.15.99:34494) 2024-09-19T06:31:49.826 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:48.227+0000 7f1bd9604640 1 -- 172.21.15.99:0/2014142312 learned_addr learned my addr 172.21.15.99:0/2014142312 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:31:49.826 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:48.227+0000 7f1bd9604640 1 -- 172.21.15.99:0/2014142312 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd0009450 con 0x7f1bd4101f90 2024-09-19T06:31:49.826 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:48.227+0000 7f1bd9604640 1 --2- 172.21.15.99:0/2014142312 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1bd4101f90 0x7f1bd4078c00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1bd00098a0 tx=0x7f1bd0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:49.827 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:48.227+0000 7f1bc9ffb640 1 -- 172.21.15.99:0/2014142312 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1bd0032880 con 0x7f1bd4101f90 2024-09-19T06:31:49.827 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:48.227+0000 7f1bc9ffb640 1 -- 172.21.15.99:0/2014142312 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f1bd003d8b0 con 0x7f1bd4101f90 2024-09-19T06:31:49.827 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:48.227+0000 7f1bdb868640 1 -- 172.21.15.99:0/2014142312 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bd40771d0 con 0x7f1bd4101f90 2024-09-19T06:31:49.827 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:48.227+0000 7f1bc9ffb640 1 -- 172.21.15.99:0/2014142312 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1bd003b910 con 0x7f1bd4101f90 2024-09-19T06:31:49.827 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:48.227+0000 7f1bdb868640 1 -- 172.21.15.99:0/2014142312 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bd4077640 con 0x7f1bd4101f90 2024-09-19T06:31:49.827 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:48.228+0000 7f1bc9ffb640 1 -- 172.21.15.99:0/2014142312 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f1bd0039070 con 0x7f1bd4101f90 2024-09-19T06:31:49.827 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:48.228+0000 7f1bc9ffb640 1 --2- 172.21.15.99:0/2014142312 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f1bc0039490 0x7f1bc003b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:49.827 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:48.228+0000 7f1bdb868640 1 -- 172.21.15.99:0/2014142312 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bd404b720 con 0x7f1bd4101f90 2024-09-19T06:31:49.827 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:48.229+0000 7f1bc9ffb640 1 -- 172.21.15.99:0/2014142312 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f1bd006d300 con 0x7f1bd4101f90 2024-09-19T06:31:49.827 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:48.229+0000 7f1bd8e03640 1 --2- 172.21.15.99:0/2014142312 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f1bc0039490 0x7f1bc003b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:49.827 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:48.229+0000 7f1bd8e03640 1 --2- 172.21.15.99:0/2014142312 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f1bc0039490 0x7f1bc003b940 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4006fd0 tx=0x7f1bc4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:49.827 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:48.233+0000 7f1bc9ffb640 1 -- 172.21.15.99:0/2014142312 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f1bd0041020 con 0x7f1bd4101f90 2024-09-19T06:31:49.827 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:48.402+0000 7f1bdb868640 1 -- 172.21.15.99:0/2014142312 --> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f1bd4077c60 con 0x7f1bc0039490 2024-09-19T06:31:49.828 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:48.409+0000 7f1bc9ffb640 1 -- 172.21.15.99:0/2014142312 <== mgr.14118 v2:172.21.15.99:6800/3738534523 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f1bd4077c60 con 0x7f1bc0039490 2024-09-19T06:31:49.828 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:48.411+0000 7f1bdb868640 1 -- 172.21.15.99:0/2014142312 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f1bc0039490 msgr2=0x7f1bc003b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:49.828 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:48.411+0000 7f1bdb868640 1 --2- 172.21.15.99:0/2014142312 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f1bc0039490 0x7f1bc003b940 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4006fd0 tx=0x7f1bc4006db0 comp rx=0 tx=0).stop 2024-09-19T06:31:49.828 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:48.411+0000 7f1bdb868640 1 -- 172.21.15.99:0/2014142312 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1bd4101f90 msgr2=0x7f1bd4078c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:49.828 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:48.411+0000 7f1bdb868640 1 --2- 172.21.15.99:0/2014142312 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1bd4101f90 0x7f1bd4078c00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1bd00098a0 tx=0x7f1bd0008040 comp rx=0 tx=0).stop 2024-09-19T06:31:49.828 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:48.411+0000 7f1bdb868640 1 -- 172.21.15.99:0/2014142312 shutdown_connections 2024-09-19T06:31:49.828 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:48.411+0000 7f1bdb868640 1 --2- 172.21.15.99:0/2014142312 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f1bc0039490 0x7f1bc003b940 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:49.828 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:48.411+0000 7f1bdb868640 1 --2- 172.21.15.99:0/2014142312 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1bd4101f90 0x7f1bd4078c00 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:49.828 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:48.411+0000 7f1bdb868640 1 -- 172.21.15.99:0/2014142312 >> 172.21.15.99:0/2014142312 conn(0x7f1bd40fd730 msgr2=0x7f1bd40fe2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:49.828 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:48.411+0000 7f1bdb868640 1 -- 172.21.15.99:0/2014142312 shutdown_connections 2024-09-19T06:31:49.828 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:48.411+0000 7f1bdb868640 1 -- 172.21.15.99:0/2014142312 wait complete. 2024-09-19T06:31:49.829 INFO:teuthology.orchestra.run.smithi099.stdout:Deploying crash service with default placement... 2024-09-19T06:31:51.038 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-09-19T06:31:51.039 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:50.199+0000 7fae6ff8f640 1 Processor -- start 2024-09-19T06:31:51.039 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:50.199+0000 7fae6ff8f640 1 -- start start 2024-09-19T06:31:51.039 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:50.199+0000 7fae6ff8f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fae68101f90 0x7fae681023a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:51.039 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:50.199+0000 7fae6ff8f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae681028e0 con 0x7fae68101f90 2024-09-19T06:31:51.039 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:50.199+0000 7fae6dd2b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fae68101f90 0x7fae681023a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:51.039 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:50.199+0000 7fae6dd2b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fae68101f90 0x7fae681023a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34506/0 (socket says 172.21.15.99:34506) 2024-09-19T06:31:51.039 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:50.199+0000 7fae6dd2b640 1 -- 172.21.15.99:0/1257049552 learned_addr learned my addr 172.21.15.99:0/1257049552 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:31:51.039 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:50.200+0000 7fae6dd2b640 1 -- 172.21.15.99:0/1257049552 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae68102a20 con 0x7fae68101f90 2024-09-19T06:31:51.039 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:50.200+0000 7fae6dd2b640 1 --2- 172.21.15.99:0/1257049552 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fae68101f90 0x7fae681023a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fae58009840 tx=0x7fae580091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f443ee325e8a7eca server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:51.040 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:50.200+0000 7fae6cd29640 1 -- 172.21.15.99:0/1257049552 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fae58032440 con 0x7fae68101f90 2024-09-19T06:31:51.040 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:50.200+0000 7fae6cd29640 1 -- 172.21.15.99:0/1257049552 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fae58032a40 con 0x7fae68101f90 2024-09-19T06:31:51.040 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:50.200+0000 7fae6cd29640 1 -- 172.21.15.99:0/1257049552 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fae58031a70 con 0x7fae68101f90 2024-09-19T06:31:51.040 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:50.201+0000 7fae6ff8f640 1 -- 172.21.15.99:0/1257049552 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fae68101f90 msgr2=0x7fae681023a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:51.040 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:50.201+0000 7fae6ff8f640 1 --2- 172.21.15.99:0/1257049552 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fae68101f90 0x7fae681023a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fae58009840 tx=0x7fae580091d0 comp rx=0 tx=0).stop 2024-09-19T06:31:51.040 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:50.201+0000 7fae6ff8f640 1 -- 172.21.15.99:0/1257049552 shutdown_connections 2024-09-19T06:31:51.040 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:50.201+0000 7fae6ff8f640 1 --2- 172.21.15.99:0/1257049552 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fae68101f90 0x7fae681023a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:51.040 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:50.201+0000 7fae6ff8f640 1 -- 172.21.15.99:0/1257049552 >> 172.21.15.99:0/1257049552 conn(0x7fae680fd710 msgr2=0x7fae680ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:51.040 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:50.201+0000 7fae6ff8f640 1 -- 172.21.15.99:0/1257049552 shutdown_connections 2024-09-19T06:31:51.040 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:50.201+0000 7fae6ff8f640 1 -- 172.21.15.99:0/1257049552 wait complete. 2024-09-19T06:31:51.040 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:50.202+0000 7fae6ff8f640 1 Processor -- start 2024-09-19T06:31:51.041 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:50.202+0000 7fae6ff8f640 1 -- start start 2024-09-19T06:31:51.041 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:50.202+0000 7fae6ff8f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fae68101f90 0x7fae68110d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:51.041 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:50.202+0000 7fae6ff8f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae68111260 con 0x7fae68101f90 2024-09-19T06:31:51.041 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:50.202+0000 7fae6dd2b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fae68101f90 0x7fae68110d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:51.041 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:50.202+0000 7fae6dd2b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fae68101f90 0x7fae68110d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34508/0 (socket says 172.21.15.99:34508) 2024-09-19T06:31:51.041 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:50.202+0000 7fae6dd2b640 1 -- 172.21.15.99:0/2669046293 learned_addr learned my addr 172.21.15.99:0/2669046293 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:31:51.041 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:50.202+0000 7fae6dd2b640 1 -- 172.21.15.99:0/2669046293 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae58009450 con 0x7fae68101f90 2024-09-19T06:31:51.041 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:50.202+0000 7fae6dd2b640 1 --2- 172.21.15.99:0/2669046293 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fae68101f90 0x7fae68110d20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fae58006a70 tx=0x7fae580091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:51.041 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:50.202+0000 7fae5e7fc640 1 -- 172.21.15.99:0/2669046293 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fae5803c400 con 0x7fae68101f90 2024-09-19T06:31:51.041 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:50.202+0000 7fae5e7fc640 1 -- 172.21.15.99:0/2669046293 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fae5803ca00 con 0x7fae68101f90 2024-09-19T06:31:51.041 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:50.202+0000 7fae6ff8f640 1 -- 172.21.15.99:0/2669046293 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae68111460 con 0x7fae68101f90 2024-09-19T06:31:51.042 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:50.202+0000 7fae5e7fc640 1 -- 172.21.15.99:0/2669046293 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fae5803a9a0 con 0x7fae68101f90 2024-09-19T06:31:51.042 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:50.202+0000 7fae6ff8f640 1 -- 172.21.15.99:0/2669046293 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae681118d0 con 0x7fae68101f90 2024-09-19T06:31:51.042 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:50.203+0000 7fae5e7fc640 1 -- 172.21.15.99:0/2669046293 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7fae5803cb70 con 0x7fae68101f90 2024-09-19T06:31:51.042 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:50.203+0000 7fae6ff8f640 1 -- 172.21.15.99:0/2669046293 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae6804b720 con 0x7fae68101f90 2024-09-19T06:31:51.042 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:50.203+0000 7fae5e7fc640 1 --2- 172.21.15.99:0/2669046293 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7fae540394e0 0x7fae5403b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:51.042 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:50.204+0000 7fae5e7fc640 1 -- 172.21.15.99:0/2669046293 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fae5806cc10 con 0x7fae68101f90 2024-09-19T06:31:51.042 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:50.204+0000 7fae6d52a640 1 --2- 172.21.15.99:0/2669046293 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7fae540394e0 0x7fae5403b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:51.042 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:50.204+0000 7fae6d52a640 1 --2- 172.21.15.99:0/2669046293 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7fae540394e0 0x7fae5403b990 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fae64006fd0 tx=0x7fae64006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:51.042 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:50.208+0000 7fae5e7fc640 1 -- 172.21.15.99:0/2669046293 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fae5803abd0 con 0x7fae68101f90 2024-09-19T06:31:51.042 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:50.388+0000 7fae6ff8f640 1 -- 172.21.15.99:0/2669046293 --> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7fae681118d0 con 0x7fae540394e0 2024-09-19T06:31:51.043 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:50.393+0000 7fae5e7fc640 1 -- 172.21.15.99:0/2669046293 <== mgr.14118 v2:172.21.15.99:6800/3738534523 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7fae681118d0 con 0x7fae540394e0 2024-09-19T06:31:51.043 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:50.395+0000 7fae6ff8f640 1 -- 172.21.15.99:0/2669046293 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7fae540394e0 msgr2=0x7fae5403b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:51.043 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:50.395+0000 7fae6ff8f640 1 --2- 172.21.15.99:0/2669046293 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7fae540394e0 0x7fae5403b990 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fae64006fd0 tx=0x7fae64006db0 comp rx=0 tx=0).stop 2024-09-19T06:31:51.043 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:50.395+0000 7fae6ff8f640 1 -- 172.21.15.99:0/2669046293 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fae68101f90 msgr2=0x7fae68110d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:51.043 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:50.395+0000 7fae6ff8f640 1 --2- 172.21.15.99:0/2669046293 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fae68101f90 0x7fae68110d20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fae58006a70 tx=0x7fae580091d0 comp rx=0 tx=0).stop 2024-09-19T06:31:51.043 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:50.395+0000 7fae6ff8f640 1 -- 172.21.15.99:0/2669046293 shutdown_connections 2024-09-19T06:31:51.043 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:50.395+0000 7fae6ff8f640 1 --2- 172.21.15.99:0/2669046293 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7fae540394e0 0x7fae5403b990 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:51.043 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:50.395+0000 7fae6ff8f640 1 --2- 172.21.15.99:0/2669046293 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fae68101f90 0x7fae68110d20 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:51.043 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:50.395+0000 7fae6ff8f640 1 -- 172.21.15.99:0/2669046293 >> 172.21.15.99:0/2669046293 conn(0x7fae680fd710 msgr2=0x7fae680fe260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:51.043 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:50.396+0000 7fae6ff8f640 1 -- 172.21.15.99:0/2669046293 shutdown_connections 2024-09-19T06:31:51.043 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:50.396+0000 7fae6ff8f640 1 -- 172.21.15.99:0/2669046293 wait complete. 2024-09-19T06:31:51.043 INFO:teuthology.orchestra.run.smithi099.stdout:Deploying prometheus service with default placement... 2024-09-19T06:31:51.611 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:51 smithi099 ceph-mon[27651]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:31:51.612 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:51 smithi099 ceph-mon[27651]: from='mgr.14118 172.21.15.99:0/3537138547' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:31:51.612 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:51 smithi099 ceph-mon[27651]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:31:51.612 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:51 smithi099 ceph-mon[27651]: Saving service crash spec with placement * 2024-09-19T06:31:51.612 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:51 smithi099 ceph-mon[27651]: from='mgr.14118 172.21.15.99:0/3537138547' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:31:52.908 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:52 smithi099 ceph-mon[27651]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:31:52.908 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:52 smithi099 ceph-mon[27651]: Saving service prometheus spec with placement count:1 2024-09-19T06:31:52.908 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:52 smithi099 ceph-mon[27651]: from='mgr.14118 172.21.15.99:0/3537138547' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:31:52.909 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:52 smithi099 ceph-mon[27651]: from='mgr.14118 172.21.15.99:0/3537138547' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:31:52.915 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-09-19T06:31:52.915 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:51.431+0000 7ff3bcdec640 1 Processor -- start 2024-09-19T06:31:52.915 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:51.431+0000 7ff3bcdec640 1 -- start start 2024-09-19T06:31:52.915 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:51.431+0000 7ff3bcdec640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff3b81023b0 0x7ff3b81027a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:52.915 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:51.431+0000 7ff3bcdec640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b8102d70 con 0x7ff3b81023b0 2024-09-19T06:31:52.915 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:51.431+0000 7ff3b659c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff3b81023b0 0x7ff3b81027a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:52.916 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:51.431+0000 7ff3b659c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff3b81023b0 0x7ff3b81027a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34516/0 (socket says 172.21.15.99:34516) 2024-09-19T06:31:52.916 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:51.431+0000 7ff3b659c640 1 -- 172.21.15.99:0/1387396349 learned_addr learned my addr 172.21.15.99:0/1387396349 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:31:52.916 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:51.431+0000 7ff3b659c640 1 -- 172.21.15.99:0/1387396349 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b8102eb0 con 0x7ff3b81023b0 2024-09-19T06:31:52.916 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:51.432+0000 7ff3b659c640 1 --2- 172.21.15.99:0/1387396349 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff3b81023b0 0x7ff3b81027a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff3a8009840 tx=0x7ff3a80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1698fb5650d64356 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:52.916 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:51.432+0000 7ff3b559a640 1 -- 172.21.15.99:0/1387396349 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff3a8032440 con 0x7ff3b81023b0 2024-09-19T06:31:52.916 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:51.432+0000 7ff3b559a640 1 -- 172.21.15.99:0/1387396349 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff3a8032a40 con 0x7ff3b81023b0 2024-09-19T06:31:52.916 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:51.432+0000 7ff3b559a640 1 -- 172.21.15.99:0/1387396349 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff3a8031a70 con 0x7ff3b81023b0 2024-09-19T06:31:52.916 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:51.433+0000 7ff3bcdec640 1 -- 172.21.15.99:0/1387396349 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff3b81023b0 msgr2=0x7ff3b81027a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:52.916 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:51.433+0000 7ff3bcdec640 1 --2- 172.21.15.99:0/1387396349 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff3b81023b0 0x7ff3b81027a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff3a8009840 tx=0x7ff3a80091d0 comp rx=0 tx=0).stop 2024-09-19T06:31:52.916 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:51.433+0000 7ff3bcdec640 1 -- 172.21.15.99:0/1387396349 shutdown_connections 2024-09-19T06:31:52.916 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:51.433+0000 7ff3bcdec640 1 --2- 172.21.15.99:0/1387396349 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff3b81023b0 0x7ff3b81027a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:52.916 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:51.433+0000 7ff3bcdec640 1 -- 172.21.15.99:0/1387396349 >> 172.21.15.99:0/1387396349 conn(0x7ff3b80fbdd0 msgr2=0x7ff3b80fe200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:52.916 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:51.433+0000 7ff3bcdec640 1 -- 172.21.15.99:0/1387396349 shutdown_connections 2024-09-19T06:31:52.917 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:51.433+0000 7ff3bcdec640 1 -- 172.21.15.99:0/1387396349 wait complete. 2024-09-19T06:31:52.917 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:51.433+0000 7ff3bcdec640 1 Processor -- start 2024-09-19T06:31:52.917 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:51.433+0000 7ff3bcdec640 1 -- start start 2024-09-19T06:31:52.917 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:51.434+0000 7ff3bcdec640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff3b81023b0 0x7ff3b8112f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:52.917 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:51.434+0000 7ff3bcdec640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b8113490 con 0x7ff3b81023b0 2024-09-19T06:31:52.917 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:51.434+0000 7ff3b659c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff3b81023b0 0x7ff3b8112f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:52.917 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:51.434+0000 7ff3b659c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff3b81023b0 0x7ff3b8112f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34522/0 (socket says 172.21.15.99:34522) 2024-09-19T06:31:52.917 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:51.434+0000 7ff3b659c640 1 -- 172.21.15.99:0/2118920448 learned_addr learned my addr 172.21.15.99:0/2118920448 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:31:52.917 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:51.434+0000 7ff3b659c640 1 -- 172.21.15.99:0/2118920448 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3a8009450 con 0x7ff3b81023b0 2024-09-19T06:31:52.917 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:51.434+0000 7ff3b659c640 1 --2- 172.21.15.99:0/2118920448 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff3b81023b0 0x7ff3b8112f50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff3a8006a70 tx=0x7ff3a80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:52.917 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:51.434+0000 7ff3aeffd640 1 -- 172.21.15.99:0/2118920448 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff3a803c400 con 0x7ff3b81023b0 2024-09-19T06:31:52.917 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:51.434+0000 7ff3aeffd640 1 -- 172.21.15.99:0/2118920448 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff3a803ca00 con 0x7ff3b81023b0 2024-09-19T06:31:52.917 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:51.434+0000 7ff3aeffd640 1 -- 172.21.15.99:0/2118920448 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff3a803a9a0 con 0x7ff3b81023b0 2024-09-19T06:31:52.917 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:51.434+0000 7ff3bcdec640 1 -- 172.21.15.99:0/2118920448 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3b8113690 con 0x7ff3b81023b0 2024-09-19T06:31:52.918 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:51.434+0000 7ff3bcdec640 1 -- 172.21.15.99:0/2118920448 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3b8113b00 con 0x7ff3b81023b0 2024-09-19T06:31:52.918 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:51.435+0000 7ff3aeffd640 1 -- 172.21.15.99:0/2118920448 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7ff3a803abd0 con 0x7ff3b81023b0 2024-09-19T06:31:52.918 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:51.435+0000 7ff3aeffd640 1 --2- 172.21.15.99:0/2118920448 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7ff3a40394e0 0x7ff3a403b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:52.918 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:51.435+0000 7ff3aeffd640 1 -- 172.21.15.99:0/2118920448 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7ff3a806cf10 con 0x7ff3b81023b0 2024-09-19T06:31:52.918 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:51.435+0000 7ff3bcdec640 1 -- 172.21.15.99:0/2118920448 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3b80ffa70 con 0x7ff3b81023b0 2024-09-19T06:31:52.918 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:51.435+0000 7ff3b5d9b640 1 --2- 172.21.15.99:0/2118920448 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7ff3a40394e0 0x7ff3a403b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:52.918 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:51.436+0000 7ff3b5d9b640 1 --2- 172.21.15.99:0/2118920448 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7ff3a40394e0 0x7ff3a403b990 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff3a0006fd0 tx=0x7ff3a0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:52.918 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:51.440+0000 7ff3aeffd640 1 -- 172.21.15.99:0/2118920448 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ff3a8037070 con 0x7ff3b81023b0 2024-09-19T06:31:52.918 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:51.610+0000 7ff3bcdec640 1 -- 172.21.15.99:0/2118920448 --> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7ff3b80fd090 con 0x7ff3a40394e0 2024-09-19T06:31:52.918 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:51.616+0000 7ff3aeffd640 1 -- 172.21.15.99:0/2118920448 <== mgr.14118 v2:172.21.15.99:6800/3738534523 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7ff3b80fd090 con 0x7ff3a40394e0 2024-09-19T06:31:52.918 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:51.618+0000 7ff3bcdec640 1 -- 172.21.15.99:0/2118920448 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7ff3a40394e0 msgr2=0x7ff3a403b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:52.918 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:51.618+0000 7ff3bcdec640 1 --2- 172.21.15.99:0/2118920448 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7ff3a40394e0 0x7ff3a403b990 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff3a0006fd0 tx=0x7ff3a0006db0 comp rx=0 tx=0).stop 2024-09-19T06:31:52.918 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:51.618+0000 7ff3bcdec640 1 -- 172.21.15.99:0/2118920448 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff3b81023b0 msgr2=0x7ff3b8112f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:52.919 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:51.618+0000 7ff3bcdec640 1 --2- 172.21.15.99:0/2118920448 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff3b81023b0 0x7ff3b8112f50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff3a8006a70 tx=0x7ff3a80091d0 comp rx=0 tx=0).stop 2024-09-19T06:31:52.919 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:51.618+0000 7ff3bcdec640 1 -- 172.21.15.99:0/2118920448 shutdown_connections 2024-09-19T06:31:52.919 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:51.618+0000 7ff3bcdec640 1 --2- 172.21.15.99:0/2118920448 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7ff3a40394e0 0x7ff3a403b990 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:52.919 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:51.618+0000 7ff3bcdec640 1 --2- 172.21.15.99:0/2118920448 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff3b81023b0 0x7ff3b8112f50 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:52.919 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:51.618+0000 7ff3bcdec640 1 -- 172.21.15.99:0/2118920448 >> 172.21.15.99:0/2118920448 conn(0x7ff3b80fbdd0 msgr2=0x7ff3b80fc960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:52.919 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:51.619+0000 7ff3bcdec640 1 -- 172.21.15.99:0/2118920448 shutdown_connections 2024-09-19T06:31:52.919 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:51.619+0000 7ff3bcdec640 1 -- 172.21.15.99:0/2118920448 wait complete. 2024-09-19T06:31:52.919 INFO:teuthology.orchestra.run.smithi099.stdout:Deploying grafana service with default placement... 2024-09-19T06:31:53.832 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:53 smithi099 ceph-mon[27651]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:31:53.833 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:53 smithi099 ceph-mon[27651]: from='mgr.14118 172.21.15.99:0/3537138547' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:31:53.833 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:53 smithi099 ceph-mon[27651]: from='mgr.14118 172.21.15.99:0/3537138547' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:31:54.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:54 smithi099 ceph-mon[27651]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:31:54.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:54 smithi099 ceph-mon[27651]: Saving service grafana spec with placement count:1 2024-09-19T06:31:54.979 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-09-19T06:31:54.980 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:53.342+0000 7fc8d429a640 1 Processor -- start 2024-09-19T06:31:54.980 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:53.343+0000 7fc8d429a640 1 -- start start 2024-09-19T06:31:54.980 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:53.343+0000 7fc8d429a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8cc101440 0x7fc8cc101850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:54.980 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:53.343+0000 7fc8d429a640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8cc101d90 con 0x7fc8cc101440 2024-09-19T06:31:54.980 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:53.343+0000 7fc8d2036640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8cc101440 0x7fc8cc101850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:54.980 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:53.343+0000 7fc8d2036640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8cc101440 0x7fc8cc101850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34526/0 (socket says 172.21.15.99:34526) 2024-09-19T06:31:54.980 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:53.343+0000 7fc8d2036640 1 -- 172.21.15.99:0/2328963738 learned_addr learned my addr 172.21.15.99:0/2328963738 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:31:54.980 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:53.344+0000 7fc8d2036640 1 -- 172.21.15.99:0/2328963738 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8cc101ed0 con 0x7fc8cc101440 2024-09-19T06:31:54.980 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:53.344+0000 7fc8d2036640 1 --2- 172.21.15.99:0/2328963738 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8cc101440 0x7fc8cc101850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc8c0009840 tx=0x7fc8c00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56b6a1f285ab4724 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:54.980 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:53.344+0000 7fc8d1034640 1 -- 172.21.15.99:0/2328963738 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc8c0032440 con 0x7fc8cc101440 2024-09-19T06:31:54.980 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:53.344+0000 7fc8d1034640 1 -- 172.21.15.99:0/2328963738 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc8c0032a40 con 0x7fc8cc101440 2024-09-19T06:31:54.981 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:53.344+0000 7fc8d1034640 1 -- 172.21.15.99:0/2328963738 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc8c0031a70 con 0x7fc8cc101440 2024-09-19T06:31:54.981 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:53.345+0000 7fc8d429a640 1 -- 172.21.15.99:0/2328963738 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8cc101440 msgr2=0x7fc8cc101850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:54.981 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:53.345+0000 7fc8d429a640 1 --2- 172.21.15.99:0/2328963738 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8cc101440 0x7fc8cc101850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc8c0009840 tx=0x7fc8c00091d0 comp rx=0 tx=0).stop 2024-09-19T06:31:54.981 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:53.345+0000 7fc8d429a640 1 -- 172.21.15.99:0/2328963738 shutdown_connections 2024-09-19T06:31:54.981 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:53.345+0000 7fc8d429a640 1 --2- 172.21.15.99:0/2328963738 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8cc101440 0x7fc8cc101850 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:54.981 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:53.345+0000 7fc8d429a640 1 -- 172.21.15.99:0/2328963738 >> 172.21.15.99:0/2328963738 conn(0x7fc8cc0fbdd0 msgr2=0x7fc8cc0fe200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:54.981 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:53.345+0000 7fc8d429a640 1 -- 172.21.15.99:0/2328963738 shutdown_connections 2024-09-19T06:31:54.981 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:53.345+0000 7fc8d429a640 1 -- 172.21.15.99:0/2328963738 wait complete. 2024-09-19T06:31:54.981 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:53.346+0000 7fc8d429a640 1 Processor -- start 2024-09-19T06:31:54.981 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:53.346+0000 7fc8d429a640 1 -- start start 2024-09-19T06:31:54.981 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:53.346+0000 7fc8d429a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8cc101440 0x7fc8cc100c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:54.981 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:53.346+0000 7fc8d429a640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8cc113a90 con 0x7fc8cc101440 2024-09-19T06:31:54.982 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:53.346+0000 7fc8d2036640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8cc101440 0x7fc8cc100c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:54.982 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:53.346+0000 7fc8d2036640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8cc101440 0x7fc8cc100c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34534/0 (socket says 172.21.15.99:34534) 2024-09-19T06:31:54.982 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:53.346+0000 7fc8d2036640 1 -- 172.21.15.99:0/2341897867 learned_addr learned my addr 172.21.15.99:0/2341897867 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:31:54.982 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:53.346+0000 7fc8d2036640 1 -- 172.21.15.99:0/2341897867 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c0009450 con 0x7fc8cc101440 2024-09-19T06:31:54.982 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:53.346+0000 7fc8d2036640 1 --2- 172.21.15.99:0/2341897867 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8cc101440 0x7fc8cc100c40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc8c0006a70 tx=0x7fc8c00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:54.982 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:53.347+0000 7fc8beffd640 1 -- 172.21.15.99:0/2341897867 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc8c003c400 con 0x7fc8cc101440 2024-09-19T06:31:54.982 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:53.347+0000 7fc8beffd640 1 -- 172.21.15.99:0/2341897867 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc8c003ca00 con 0x7fc8cc101440 2024-09-19T06:31:54.982 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:53.347+0000 7fc8d429a640 1 -- 172.21.15.99:0/2341897867 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8cc113bd0 con 0x7fc8cc101440 2024-09-19T06:31:54.982 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:53.347+0000 7fc8beffd640 1 -- 172.21.15.99:0/2341897867 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc8c003a9a0 con 0x7fc8cc101440 2024-09-19T06:31:54.982 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:53.347+0000 7fc8d429a640 1 -- 172.21.15.99:0/2341897867 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8cc113fe0 con 0x7fc8cc101440 2024-09-19T06:31:54.982 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:53.348+0000 7fc8beffd640 1 -- 172.21.15.99:0/2341897867 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7fc8c003abd0 con 0x7fc8cc101440 2024-09-19T06:31:54.983 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:53.348+0000 7fc8d429a640 1 -- 172.21.15.99:0/2341897867 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8cc04b720 con 0x7fc8cc101440 2024-09-19T06:31:54.983 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:53.348+0000 7fc8beffd640 1 --2- 172.21.15.99:0/2341897867 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7fc8b80394e0 0x7fc8b803b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:54.983 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:53.348+0000 7fc8beffd640 1 -- 172.21.15.99:0/2341897867 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fc8c006cdc0 con 0x7fc8cc101440 2024-09-19T06:31:54.983 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:53.348+0000 7fc8d1835640 1 --2- 172.21.15.99:0/2341897867 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7fc8b80394e0 0x7fc8b803b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:54.983 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:53.348+0000 7fc8d1835640 1 --2- 172.21.15.99:0/2341897867 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7fc8b80394e0 0x7fc8b803b990 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc8c8006fd0 tx=0x7fc8c8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:54.983 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:53.352+0000 7fc8beffd640 1 -- 172.21.15.99:0/2341897867 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fc8c003a3b0 con 0x7fc8cc101440 2024-09-19T06:31:54.983 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:53.535+0000 7fc8d429a640 1 -- 172.21.15.99:0/2341897867 --> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7fc8cc04b720 con 0x7fc8b80394e0 2024-09-19T06:31:54.983 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:53.539+0000 7fc8beffd640 1 -- 172.21.15.99:0/2341897867 <== mgr.14118 v2:172.21.15.99:6800/3738534523 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7fc8cc04b720 con 0x7fc8b80394e0 2024-09-19T06:31:54.983 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:53.541+0000 7fc8d429a640 1 -- 172.21.15.99:0/2341897867 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7fc8b80394e0 msgr2=0x7fc8b803b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:54.984 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:53.541+0000 7fc8d429a640 1 --2- 172.21.15.99:0/2341897867 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7fc8b80394e0 0x7fc8b803b990 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc8c8006fd0 tx=0x7fc8c8006db0 comp rx=0 tx=0).stop 2024-09-19T06:31:54.984 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:53.541+0000 7fc8d429a640 1 -- 172.21.15.99:0/2341897867 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8cc101440 msgr2=0x7fc8cc100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:54.984 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:53.541+0000 7fc8d429a640 1 --2- 172.21.15.99:0/2341897867 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8cc101440 0x7fc8cc100c40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc8c0006a70 tx=0x7fc8c00091d0 comp rx=0 tx=0).stop 2024-09-19T06:31:54.984 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:53.541+0000 7fc8d429a640 1 -- 172.21.15.99:0/2341897867 shutdown_connections 2024-09-19T06:31:54.984 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:53.541+0000 7fc8d429a640 1 --2- 172.21.15.99:0/2341897867 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7fc8b80394e0 0x7fc8b803b990 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:54.984 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:53.541+0000 7fc8d429a640 1 --2- 172.21.15.99:0/2341897867 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8cc101440 0x7fc8cc100c40 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:54.984 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:53.541+0000 7fc8d429a640 1 -- 172.21.15.99:0/2341897867 >> 172.21.15.99:0/2341897867 conn(0x7fc8cc0fbdd0 msgr2=0x7fc8cc0fc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:54.984 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:53.541+0000 7fc8d429a640 1 -- 172.21.15.99:0/2341897867 shutdown_connections 2024-09-19T06:31:54.984 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:53.541+0000 7fc8d429a640 1 -- 172.21.15.99:0/2341897867 wait complete. 2024-09-19T06:31:54.984 INFO:teuthology.orchestra.run.smithi099.stdout:Deploying node-exporter service with default placement... 2024-09-19T06:31:55.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:55 smithi099 ceph-mon[27651]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:31:55.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:55 smithi099 ceph-mon[27651]: from='mgr.14118 172.21.15.99:0/3537138547' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:31:56.138 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-09-19T06:31:56.138 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:55.343+0000 7fa566192640 1 Processor -- start 2024-09-19T06:31:56.138 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:55.343+0000 7fa566192640 1 -- start start 2024-09-19T06:31:56.138 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:55.343+0000 7fa566192640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5601035b0 0x7fa5601039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:56.138 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:55.343+0000 7fa566192640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa560070e50 con 0x7fa5601035b0 2024-09-19T06:31:56.138 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:55.343+0000 7fa55f7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5601035b0 0x7fa5601039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:56.139 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:55.343+0000 7fa55f7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5601035b0 0x7fa5601039c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34654/0 (socket says 172.21.15.99:34654) 2024-09-19T06:31:56.139 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:55.343+0000 7fa55f7fe640 1 -- 172.21.15.99:0/1334039727 learned_addr learned my addr 172.21.15.99:0/1334039727 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:31:56.139 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:55.343+0000 7fa55f7fe640 1 -- 172.21.15.99:0/1334039727 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa560103f00 con 0x7fa5601035b0 2024-09-19T06:31:56.139 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:55.344+0000 7fa55f7fe640 1 --2- 172.21.15.99:0/1334039727 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5601035b0 0x7fa5601039c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa550009840 tx=0x7fa5500091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=add186c0f6887646 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:56.139 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:55.344+0000 7fa55e7fc640 1 -- 172.21.15.99:0/1334039727 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa550032440 con 0x7fa5601035b0 2024-09-19T06:31:56.139 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:55.344+0000 7fa55e7fc640 1 -- 172.21.15.99:0/1334039727 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa550032a40 con 0x7fa5601035b0 2024-09-19T06:31:56.139 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:55.344+0000 7fa55e7fc640 1 -- 172.21.15.99:0/1334039727 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa550031a70 con 0x7fa5601035b0 2024-09-19T06:31:56.139 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:55.345+0000 7fa566192640 1 -- 172.21.15.99:0/1334039727 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5601035b0 msgr2=0x7fa5601039c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:56.139 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:55.345+0000 7fa566192640 1 --2- 172.21.15.99:0/1334039727 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5601035b0 0x7fa5601039c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa550009840 tx=0x7fa5500091d0 comp rx=0 tx=0).stop 2024-09-19T06:31:56.139 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:55.345+0000 7fa566192640 1 -- 172.21.15.99:0/1334039727 shutdown_connections 2024-09-19T06:31:56.139 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:55.345+0000 7fa566192640 1 --2- 172.21.15.99:0/1334039727 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5601035b0 0x7fa5601039c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:56.139 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:55.345+0000 7fa566192640 1 -- 172.21.15.99:0/1334039727 >> 172.21.15.99:0/1334039727 conn(0x7fa5600fbdd0 msgr2=0x7fa5600fe200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:56.139 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:55.345+0000 7fa566192640 1 -- 172.21.15.99:0/1334039727 shutdown_connections 2024-09-19T06:31:56.140 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:55.345+0000 7fa566192640 1 -- 172.21.15.99:0/1334039727 wait complete. 2024-09-19T06:31:56.140 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:55.345+0000 7fa566192640 1 Processor -- start 2024-09-19T06:31:56.140 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:55.346+0000 7fa566192640 1 -- start start 2024-09-19T06:31:56.140 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:55.346+0000 7fa566192640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5601035b0 0x7fa560110e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:56.140 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:55.346+0000 7fa566192640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa560111350 con 0x7fa5601035b0 2024-09-19T06:31:56.140 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:55.346+0000 7fa55f7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5601035b0 0x7fa560110e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:56.140 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:55.346+0000 7fa55f7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5601035b0 0x7fa560110e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34668/0 (socket says 172.21.15.99:34668) 2024-09-19T06:31:56.140 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:55.346+0000 7fa55f7fe640 1 -- 172.21.15.99:0/444909736 learned_addr learned my addr 172.21.15.99:0/444909736 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:31:56.140 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:55.346+0000 7fa55f7fe640 1 -- 172.21.15.99:0/444909736 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa550009450 con 0x7fa5601035b0 2024-09-19T06:31:56.140 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:55.346+0000 7fa55f7fe640 1 --2- 172.21.15.99:0/444909736 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5601035b0 0x7fa560110e10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa550009810 tx=0x7fa5500091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:56.140 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:55.346+0000 7fa557fff640 1 -- 172.21.15.99:0/444909736 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa55003c400 con 0x7fa5601035b0 2024-09-19T06:31:56.140 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:55.347+0000 7fa557fff640 1 -- 172.21.15.99:0/444909736 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa55003ca00 con 0x7fa5601035b0 2024-09-19T06:31:56.140 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:55.347+0000 7fa566192640 1 -- 172.21.15.99:0/444909736 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa560111550 con 0x7fa5601035b0 2024-09-19T06:31:56.141 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:55.347+0000 7fa557fff640 1 -- 172.21.15.99:0/444909736 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa55003a870 con 0x7fa5601035b0 2024-09-19T06:31:56.141 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:55.347+0000 7fa566192640 1 -- 172.21.15.99:0/444909736 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa560111fa0 con 0x7fa5601035b0 2024-09-19T06:31:56.141 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:55.347+0000 7fa557fff640 1 -- 172.21.15.99:0/444909736 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7fa55003aae0 con 0x7fa5601035b0 2024-09-19T06:31:56.141 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:55.348+0000 7fa557fff640 1 --2- 172.21.15.99:0/444909736 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7fa54c0394e0 0x7fa54c03b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:56.141 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:55.348+0000 7fa557fff640 1 -- 172.21.15.99:0/444909736 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fa55006cf00 con 0x7fa5601035b0 2024-09-19T06:31:56.141 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:55.348+0000 7fa566192640 1 -- 172.21.15.99:0/444909736 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5600ffa70 con 0x7fa5601035b0 2024-09-19T06:31:56.141 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:55.348+0000 7fa55effd640 1 --2- 172.21.15.99:0/444909736 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7fa54c0394e0 0x7fa54c03b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:56.141 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:55.348+0000 7fa55effd640 1 --2- 172.21.15.99:0/444909736 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7fa54c0394e0 0x7fa54c03b990 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa548006fd0 tx=0x7fa548006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:56.141 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:55.352+0000 7fa557fff640 1 -- 172.21.15.99:0/444909736 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fa550037030 con 0x7fa5601035b0 2024-09-19T06:31:56.141 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:55.514+0000 7fa566192640 1 -- 172.21.15.99:0/444909736 --> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7fa5600fd0a0 con 0x7fa54c0394e0 2024-09-19T06:31:56.141 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:55.519+0000 7fa557fff640 1 -- 172.21.15.99:0/444909736 <== mgr.14118 v2:172.21.15.99:6800/3738534523 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7fa5600fd0a0 con 0x7fa54c0394e0 2024-09-19T06:31:56.141 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:55.521+0000 7fa566192640 1 -- 172.21.15.99:0/444909736 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7fa54c0394e0 msgr2=0x7fa54c03b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:56.142 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:55.521+0000 7fa566192640 1 --2- 172.21.15.99:0/444909736 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7fa54c0394e0 0x7fa54c03b990 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa548006fd0 tx=0x7fa548006db0 comp rx=0 tx=0).stop 2024-09-19T06:31:56.142 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:55.521+0000 7fa566192640 1 -- 172.21.15.99:0/444909736 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5601035b0 msgr2=0x7fa560110e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:56.142 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:55.521+0000 7fa566192640 1 --2- 172.21.15.99:0/444909736 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5601035b0 0x7fa560110e10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa550009810 tx=0x7fa5500091d0 comp rx=0 tx=0).stop 2024-09-19T06:31:56.142 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:55.521+0000 7fa566192640 1 -- 172.21.15.99:0/444909736 shutdown_connections 2024-09-19T06:31:56.142 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:55.521+0000 7fa566192640 1 --2- 172.21.15.99:0/444909736 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7fa54c0394e0 0x7fa54c03b990 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:56.142 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:55.521+0000 7fa566192640 1 --2- 172.21.15.99:0/444909736 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5601035b0 0x7fa560110e10 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:56.142 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:55.521+0000 7fa566192640 1 -- 172.21.15.99:0/444909736 >> 172.21.15.99:0/444909736 conn(0x7fa5600fbdd0 msgr2=0x7fa5600fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:56.142 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:55.521+0000 7fa566192640 1 -- 172.21.15.99:0/444909736 shutdown_connections 2024-09-19T06:31:56.142 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:55.521+0000 7fa566192640 1 -- 172.21.15.99:0/444909736 wait complete. 2024-09-19T06:31:56.142 INFO:teuthology.orchestra.run.smithi099.stdout:Deploying alertmanager service with default placement... 2024-09-19T06:31:56.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:56 smithi099 ceph-mon[27651]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:31:56.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:56 smithi099 ceph-mon[27651]: Saving service node-exporter spec with placement * 2024-09-19T06:31:57.293 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-09-19T06:31:57.294 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:56.529+0000 7fdf60572640 1 Processor -- start 2024-09-19T06:31:57.294 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:56.529+0000 7fdf60572640 1 -- start start 2024-09-19T06:31:57.294 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:56.530+0000 7fdf60572640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf58076ad0 0x7fdf58104cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:57.294 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:56.530+0000 7fdf60572640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf58076ee0 con 0x7fdf58076ad0 2024-09-19T06:31:57.294 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:56.530+0000 7fdf5e30e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf58076ad0 0x7fdf58104cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:57.294 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:56.530+0000 7fdf5e30e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf58076ad0 0x7fdf58104cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34670/0 (socket says 172.21.15.99:34670) 2024-09-19T06:31:57.294 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:56.530+0000 7fdf5e30e640 1 -- 172.21.15.99:0/1444446177 learned_addr learned my addr 172.21.15.99:0/1444446177 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:31:57.294 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:56.530+0000 7fdf5e30e640 1 -- 172.21.15.99:0/1444446177 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf58105210 con 0x7fdf58076ad0 2024-09-19T06:31:57.294 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:56.531+0000 7fdf5e30e640 1 --2- 172.21.15.99:0/1444446177 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf58076ad0 0x7fdf58104cd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdf48009e50 tx=0x7fdf48009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b7eecdf85e88d9d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:57.294 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:56.531+0000 7fdf5d30c640 1 -- 172.21.15.99:0/1444446177 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdf48031560 con 0x7fdf58076ad0 2024-09-19T06:31:57.294 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:56.531+0000 7fdf5d30c640 1 -- 172.21.15.99:0/1444446177 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fdf4802d050 con 0x7fdf58076ad0 2024-09-19T06:31:57.295 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:56.531+0000 7fdf5d30c640 1 -- 172.21.15.99:0/1444446177 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdf48007a60 con 0x7fdf58076ad0 2024-09-19T06:31:57.295 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:56.531+0000 7fdf60572640 1 -- 172.21.15.99:0/1444446177 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf58076ad0 msgr2=0x7fdf58104cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:57.295 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:56.531+0000 7fdf60572640 1 --2- 172.21.15.99:0/1444446177 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf58076ad0 0x7fdf58104cd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdf48009e50 tx=0x7fdf48009840 comp rx=0 tx=0).stop 2024-09-19T06:31:57.295 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:56.531+0000 7fdf60572640 1 -- 172.21.15.99:0/1444446177 shutdown_connections 2024-09-19T06:31:57.295 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:56.531+0000 7fdf60572640 1 --2- 172.21.15.99:0/1444446177 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf58076ad0 0x7fdf58104cd0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:57.295 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:56.531+0000 7fdf60572640 1 -- 172.21.15.99:0/1444446177 >> 172.21.15.99:0/1444446177 conn(0x7fdf580fc6e0 msgr2=0x7fdf580feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:57.295 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:56.531+0000 7fdf60572640 1 -- 172.21.15.99:0/1444446177 shutdown_connections 2024-09-19T06:31:57.295 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:56.531+0000 7fdf60572640 1 -- 172.21.15.99:0/1444446177 wait complete. 2024-09-19T06:31:57.295 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:56.532+0000 7fdf60572640 1 Processor -- start 2024-09-19T06:31:57.295 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:56.532+0000 7fdf60572640 1 -- start start 2024-09-19T06:31:57.296 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:56.532+0000 7fdf60572640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf58076ad0 0x7fdf58102600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:57.296 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:56.532+0000 7fdf60572640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf58102b40 con 0x7fdf58076ad0 2024-09-19T06:31:57.296 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:56.532+0000 7fdf5e30e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf58076ad0 0x7fdf58102600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:57.296 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:56.532+0000 7fdf5e30e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf58076ad0 0x7fdf58102600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34686/0 (socket says 172.21.15.99:34686) 2024-09-19T06:31:57.296 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:56.532+0000 7fdf5e30e640 1 -- 172.21.15.99:0/3122996038 learned_addr learned my addr 172.21.15.99:0/3122996038 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:31:57.296 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:56.532+0000 7fdf5e30e640 1 -- 172.21.15.99:0/3122996038 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf48009ae0 con 0x7fdf58076ad0 2024-09-19T06:31:57.296 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:56.533+0000 7fdf5e30e640 1 --2- 172.21.15.99:0/3122996038 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf58076ad0 0x7fdf58102600 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdf48009560 tx=0x7fdf48009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:57.296 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:56.533+0000 7fdf56ffd640 1 -- 172.21.15.99:0/3122996038 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdf4803b410 con 0x7fdf58076ad0 2024-09-19T06:31:57.296 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:56.533+0000 7fdf56ffd640 1 -- 172.21.15.99:0/3122996038 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fdf4803ba10 con 0x7fdf58076ad0 2024-09-19T06:31:57.296 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:56.533+0000 7fdf60572640 1 -- 172.21.15.99:0/3122996038 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf58100bd0 con 0x7fdf58076ad0 2024-09-19T06:31:57.296 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:56.533+0000 7fdf56ffd640 1 -- 172.21.15.99:0/3122996038 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdf480456b0 con 0x7fdf58076ad0 2024-09-19T06:31:57.296 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:56.533+0000 7fdf60572640 1 -- 172.21.15.99:0/3122996038 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf58101040 con 0x7fdf58076ad0 2024-09-19T06:31:57.297 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:56.534+0000 7fdf56ffd640 1 -- 172.21.15.99:0/3122996038 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7fdf48038050 con 0x7fdf58076ad0 2024-09-19T06:31:57.297 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:56.534+0000 7fdf56ffd640 1 --2- 172.21.15.99:0/3122996038 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7fdf400394e0 0x7fdf4003b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:57.297 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:56.534+0000 7fdf60572640 1 -- 172.21.15.99:0/3122996038 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf5804b720 con 0x7fdf58076ad0 2024-09-19T06:31:57.297 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:56.534+0000 7fdf56ffd640 1 -- 172.21.15.99:0/3122996038 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fdf4806d000 con 0x7fdf58076ad0 2024-09-19T06:31:57.297 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:56.534+0000 7fdf5db0d640 1 --2- 172.21.15.99:0/3122996038 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7fdf400394e0 0x7fdf4003b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:57.297 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:56.534+0000 7fdf5db0d640 1 --2- 172.21.15.99:0/3122996038 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7fdf400394e0 0x7fdf4003b990 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c006fd0 tx=0x7fdf4c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:57.297 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:56.538+0000 7fdf56ffd640 1 -- 172.21.15.99:0/3122996038 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fdf48036070 con 0x7fdf58076ad0 2024-09-19T06:31:57.297 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:56.705+0000 7fdf60572640 1 -- 172.21.15.99:0/3122996038 --> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7fdf581017f0 con 0x7fdf400394e0 2024-09-19T06:31:57.297 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:56.709+0000 7fdf56ffd640 1 -- 172.21.15.99:0/3122996038 <== mgr.14118 v2:172.21.15.99:6800/3738534523 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7fdf581017f0 con 0x7fdf400394e0 2024-09-19T06:31:57.297 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:56.711+0000 7fdf60572640 1 -- 172.21.15.99:0/3122996038 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7fdf400394e0 msgr2=0x7fdf4003b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:57.297 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:56.711+0000 7fdf60572640 1 --2- 172.21.15.99:0/3122996038 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7fdf400394e0 0x7fdf4003b990 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c006fd0 tx=0x7fdf4c006db0 comp rx=0 tx=0).stop 2024-09-19T06:31:57.297 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:56.711+0000 7fdf60572640 1 -- 172.21.15.99:0/3122996038 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf58076ad0 msgr2=0x7fdf58102600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:57.298 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:56.711+0000 7fdf60572640 1 --2- 172.21.15.99:0/3122996038 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf58076ad0 0x7fdf58102600 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdf48009560 tx=0x7fdf48009840 comp rx=0 tx=0).stop 2024-09-19T06:31:57.298 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:56.711+0000 7fdf60572640 1 -- 172.21.15.99:0/3122996038 shutdown_connections 2024-09-19T06:31:57.298 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:56.711+0000 7fdf60572640 1 --2- 172.21.15.99:0/3122996038 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7fdf400394e0 0x7fdf4003b990 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:57.298 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:56.711+0000 7fdf60572640 1 --2- 172.21.15.99:0/3122996038 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf58076ad0 0x7fdf58102600 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:57.298 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:56.711+0000 7fdf60572640 1 -- 172.21.15.99:0/3122996038 >> 172.21.15.99:0/3122996038 conn(0x7fdf580fc6e0 msgr2=0x7fdf580fd2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:57.298 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:56.712+0000 7fdf60572640 1 -- 172.21.15.99:0/3122996038 shutdown_connections 2024-09-19T06:31:57.298 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:56.712+0000 7fdf60572640 1 -- 172.21.15.99:0/3122996038 wait complete. 2024-09-19T06:31:57.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:57 smithi099 ceph-mon[27651]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:31:57.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:57 smithi099 ceph-mon[27651]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:31:57.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:57 smithi099 ceph-mon[27651]: Saving service alertmanager spec with placement count:1 2024-09-19T06:31:57.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:57 smithi099 ceph-mon[27651]: from='mgr.14118 172.21.15.99:0/3537138547' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:31:58.592 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:57.680+0000 7faa904e5640 1 Processor -- start 2024-09-19T06:31:58.592 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:57.680+0000 7faa904e5640 1 -- start start 2024-09-19T06:31:58.592 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:57.680+0000 7faa904e5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa88100e90 0x7faa881012a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:58.592 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:57.680+0000 7faa904e5640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa881017e0 con 0x7faa88100e90 2024-09-19T06:31:58.592 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:57.680+0000 7faa8e281640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa88100e90 0x7faa881012a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:58.592 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:57.680+0000 7faa8e281640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa88100e90 0x7faa881012a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34696/0 (socket says 172.21.15.99:34696) 2024-09-19T06:31:58.592 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:57.680+0000 7faa8e281640 1 -- 172.21.15.99:0/2773867612 learned_addr learned my addr 172.21.15.99:0/2773867612 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:31:58.593 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:57.680+0000 7faa8e281640 1 -- 172.21.15.99:0/2773867612 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa88101920 con 0x7faa88100e90 2024-09-19T06:31:58.593 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:57.681+0000 7faa8e281640 1 --2- 172.21.15.99:0/2773867612 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa88100e90 0x7faa881012a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7faa8400baf0 tx=0x7faa8400b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd584d78eb2f25fb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:58.593 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:57.681+0000 7faa8d27f640 1 -- 172.21.15.99:0/2773867612 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faa84031790 con 0x7faa88100e90 2024-09-19T06:31:58.593 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:57.681+0000 7faa8d27f640 1 -- 172.21.15.99:0/2773867612 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7faa84031d90 con 0x7faa88100e90 2024-09-19T06:31:58.593 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:57.681+0000 7faa8d27f640 1 -- 172.21.15.99:0/2773867612 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faa84039e60 con 0x7faa88100e90 2024-09-19T06:31:58.593 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:57.682+0000 7faa904e5640 1 -- 172.21.15.99:0/2773867612 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa88100e90 msgr2=0x7faa881012a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:58.593 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:57.682+0000 7faa904e5640 1 --2- 172.21.15.99:0/2773867612 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa88100e90 0x7faa881012a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7faa8400baf0 tx=0x7faa8400b460 comp rx=0 tx=0).stop 2024-09-19T06:31:58.593 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:57.682+0000 7faa904e5640 1 -- 172.21.15.99:0/2773867612 shutdown_connections 2024-09-19T06:31:58.594 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:57.682+0000 7faa904e5640 1 --2- 172.21.15.99:0/2773867612 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa88100e90 0x7faa881012a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:58.594 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:57.682+0000 7faa904e5640 1 -- 172.21.15.99:0/2773867612 >> 172.21.15.99:0/2773867612 conn(0x7faa880fc6d0 msgr2=0x7faa880feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:58.594 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:57.682+0000 7faa904e5640 1 -- 172.21.15.99:0/2773867612 shutdown_connections 2024-09-19T06:31:58.594 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:57.682+0000 7faa904e5640 1 -- 172.21.15.99:0/2773867612 wait complete. 2024-09-19T06:31:58.594 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:57.682+0000 7faa904e5640 1 Processor -- start 2024-09-19T06:31:58.594 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:57.683+0000 7faa904e5640 1 -- start start 2024-09-19T06:31:58.594 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:57.683+0000 7faa904e5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa88100e90 0x7faa88112fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:58.594 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:57.683+0000 7faa904e5640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa88113500 con 0x7faa88100e90 2024-09-19T06:31:58.594 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:57.683+0000 7faa8e281640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa88100e90 0x7faa88112fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:58.595 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:57.683+0000 7faa8e281640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa88100e90 0x7faa88112fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34712/0 (socket says 172.21.15.99:34712) 2024-09-19T06:31:58.595 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:57.683+0000 7faa8e281640 1 -- 172.21.15.99:0/815976949 learned_addr learned my addr 172.21.15.99:0/815976949 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:31:58.595 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:57.683+0000 7faa8e281640 1 -- 172.21.15.99:0/815976949 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa8400b700 con 0x7faa88100e90 2024-09-19T06:31:58.595 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:57.683+0000 7faa8e281640 1 --2- 172.21.15.99:0/815976949 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa88100e90 0x7faa88112fc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7faa8400b2c0 tx=0x7faa84008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:58.595 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:57.683+0000 7faa7effd640 1 -- 172.21.15.99:0/815976949 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faa8403a5b0 con 0x7faa88100e90 2024-09-19T06:31:58.595 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:57.683+0000 7faa7effd640 1 -- 172.21.15.99:0/815976949 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7faa8403abb0 con 0x7faa88100e90 2024-09-19T06:31:58.595 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:57.683+0000 7faa904e5640 1 -- 172.21.15.99:0/815976949 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa88113700 con 0x7faa88100e90 2024-09-19T06:31:58.595 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:57.683+0000 7faa7effd640 1 -- 172.21.15.99:0/815976949 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faa84030c10 con 0x7faa88100e90 2024-09-19T06:31:58.595 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:57.683+0000 7faa904e5640 1 -- 172.21.15.99:0/815976949 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa88113b70 con 0x7faa88100e90 2024-09-19T06:31:58.595 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:57.684+0000 7faa7effd640 1 -- 172.21.15.99:0/815976949 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7faa84030d70 con 0x7faa88100e90 2024-09-19T06:31:58.596 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:57.684+0000 7faa7effd640 1 --2- 172.21.15.99:0/815976949 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7faa740394e0 0x7faa7403b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:58.596 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:57.684+0000 7faa904e5640 1 -- 172.21.15.99:0/815976949 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa8804b720 con 0x7faa88100e90 2024-09-19T06:31:58.596 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:57.685+0000 7faa7effd640 1 -- 172.21.15.99:0/815976949 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7faa8406df40 con 0x7faa88100e90 2024-09-19T06:31:58.596 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:57.685+0000 7faa8da80640 1 --2- 172.21.15.99:0/815976949 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7faa740394e0 0x7faa7403b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:58.596 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:57.685+0000 7faa8da80640 1 --2- 172.21.15.99:0/815976949 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7faa740394e0 0x7faa7403b990 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7faa78006fd0 tx=0x7faa78006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:58.596 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:57.689+0000 7faa7effd640 1 -- 172.21.15.99:0/815976949 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7faa84038540 con 0x7faa88100e90 2024-09-19T06:31:58.596 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:57.844+0000 7faa904e5640 1 -- 172.21.15.99:0/815976949 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7faa88113b70 con 0x7faa88100e90 2024-09-19T06:31:58.596 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:57.848+0000 7faa7effd640 1 -- 172.21.15.99:0/815976949 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7faa84035020 con 0x7faa88100e90 2024-09-19T06:31:58.596 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:57.850+0000 7faa904e5640 1 -- 172.21.15.99:0/815976949 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7faa740394e0 msgr2=0x7faa7403b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:58.596 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:57.850+0000 7faa904e5640 1 --2- 172.21.15.99:0/815976949 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7faa740394e0 0x7faa7403b990 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7faa78006fd0 tx=0x7faa78006db0 comp rx=0 tx=0).stop 2024-09-19T06:31:58.596 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:57.850+0000 7faa904e5640 1 -- 172.21.15.99:0/815976949 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa88100e90 msgr2=0x7faa88112fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:58.596 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:57.850+0000 7faa904e5640 1 --2- 172.21.15.99:0/815976949 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa88100e90 0x7faa88112fc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7faa8400b2c0 tx=0x7faa84008040 comp rx=0 tx=0).stop 2024-09-19T06:31:58.597 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:57.850+0000 7faa904e5640 1 -- 172.21.15.99:0/815976949 shutdown_connections 2024-09-19T06:31:58.597 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:57.850+0000 7faa904e5640 1 --2- 172.21.15.99:0/815976949 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7faa740394e0 0x7faa7403b990 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:58.597 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:57.850+0000 7faa904e5640 1 --2- 172.21.15.99:0/815976949 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa88100e90 0x7faa88112fc0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:58.597 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:57.850+0000 7faa904e5640 1 -- 172.21.15.99:0/815976949 >> 172.21.15.99:0/815976949 conn(0x7faa880fc6d0 msgr2=0x7faa88105430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:58.597 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:57.851+0000 7faa904e5640 1 -- 172.21.15.99:0/815976949 shutdown_connections 2024-09-19T06:31:58.597 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:57.851+0000 7faa904e5640 1 -- 172.21.15.99:0/815976949 wait complete. 2024-09-19T06:31:59.145 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:58 smithi099 ceph-mon[27651]: from='client.? 172.21.15.99:0/815976949' entity='client.admin' 2024-09-19T06:31:59.766 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:58.978+0000 7f84cb884640 1 Processor -- start 2024-09-19T06:31:59.766 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:58.978+0000 7f84cb884640 1 -- start start 2024-09-19T06:31:59.766 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:58.978+0000 7f84cb884640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f84c4076ab0 0x7f84c4104cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:59.766 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:58.978+0000 7f84cb884640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c4076ec0 con 0x7f84c4076ab0 2024-09-19T06:31:59.766 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:58.978+0000 7f84c9620640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f84c4076ab0 0x7f84c4104cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:59.766 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:58.978+0000 7f84c9620640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f84c4076ab0 0x7f84c4104cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34724/0 (socket says 172.21.15.99:34724) 2024-09-19T06:31:59.767 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:58.978+0000 7f84c9620640 1 -- 172.21.15.99:0/4020752922 learned_addr learned my addr 172.21.15.99:0/4020752922 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:31:59.767 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:58.979+0000 7f84c9620640 1 -- 172.21.15.99:0/4020752922 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84c4105200 con 0x7f84c4076ab0 2024-09-19T06:31:59.767 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:58.979+0000 7f84c9620640 1 --2- 172.21.15.99:0/4020752922 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f84c4076ab0 0x7f84c4104cc0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f84c0009840 tx=0x7f84c00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f7cf9eb8e04642c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:59.767 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:58.979+0000 7f84bbfff640 1 -- 172.21.15.99:0/4020752922 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f84c0032440 con 0x7f84c4076ab0 2024-09-19T06:31:59.767 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:58.979+0000 7f84bbfff640 1 -- 172.21.15.99:0/4020752922 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f84c0032a40 con 0x7f84c4076ab0 2024-09-19T06:31:59.767 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:58.979+0000 7f84bbfff640 1 -- 172.21.15.99:0/4020752922 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f84c0031aa0 con 0x7f84c4076ab0 2024-09-19T06:31:59.767 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:58.980+0000 7f84cb884640 1 -- 172.21.15.99:0/4020752922 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f84c4076ab0 msgr2=0x7f84c4104cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:59.767 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:58.980+0000 7f84cb884640 1 --2- 172.21.15.99:0/4020752922 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f84c4076ab0 0x7f84c4104cc0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f84c0009840 tx=0x7f84c00091d0 comp rx=0 tx=0).stop 2024-09-19T06:31:59.767 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:58.980+0000 7f84cb884640 1 -- 172.21.15.99:0/4020752922 shutdown_connections 2024-09-19T06:31:59.767 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:58.980+0000 7f84cb884640 1 --2- 172.21.15.99:0/4020752922 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f84c4076ab0 0x7f84c4104cc0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:59.767 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:58.980+0000 7f84cb884640 1 -- 172.21.15.99:0/4020752922 >> 172.21.15.99:0/4020752922 conn(0x7f84c40fc790 msgr2=0x7f84c40feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:59.768 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:58.980+0000 7f84cb884640 1 -- 172.21.15.99:0/4020752922 shutdown_connections 2024-09-19T06:31:59.768 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:58.980+0000 7f84cb884640 1 -- 172.21.15.99:0/4020752922 wait complete. 2024-09-19T06:31:59.768 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:58.981+0000 7f84cb884640 1 Processor -- start 2024-09-19T06:31:59.768 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:58.981+0000 7f84cb884640 1 -- start start 2024-09-19T06:31:59.768 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:58.981+0000 7f84cb884640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f84c4076ab0 0x7f84c4110e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:59.768 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:58.981+0000 7f84cb884640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c41113a0 con 0x7f84c4076ab0 2024-09-19T06:31:59.768 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:58.981+0000 7f84c9620640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f84c4076ab0 0x7f84c4110e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:59.768 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:58.981+0000 7f84c9620640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f84c4076ab0 0x7f84c4110e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34732/0 (socket says 172.21.15.99:34732) 2024-09-19T06:31:59.768 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:58.981+0000 7f84c9620640 1 -- 172.21.15.99:0/1680991703 learned_addr learned my addr 172.21.15.99:0/1680991703 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:31:59.768 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:58.981+0000 7f84c9620640 1 -- 172.21.15.99:0/1680991703 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84c0009450 con 0x7f84c4076ab0 2024-09-19T06:31:59.768 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:58.981+0000 7f84c9620640 1 --2- 172.21.15.99:0/1680991703 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f84c4076ab0 0x7f84c4110e60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f84c0031780 tx=0x7f84c00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:59.769 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:58.981+0000 7f84b9ffb640 1 -- 172.21.15.99:0/1680991703 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f84c00327b0 con 0x7f84c4076ab0 2024-09-19T06:31:59.769 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:58.981+0000 7f84b9ffb640 1 -- 172.21.15.99:0/1680991703 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f84c003b8d0 con 0x7f84c4076ab0 2024-09-19T06:31:59.769 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:58.981+0000 7f84cb884640 1 -- 172.21.15.99:0/1680991703 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84c41115a0 con 0x7f84c4076ab0 2024-09-19T06:31:59.769 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:58.981+0000 7f84b9ffb640 1 -- 172.21.15.99:0/1680991703 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f84c003a790 con 0x7f84c4076ab0 2024-09-19T06:31:59.769 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:58.982+0000 7f84cb884640 1 -- 172.21.15.99:0/1680991703 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84c4111ff0 con 0x7f84c4076ab0 2024-09-19T06:31:59.769 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:58.982+0000 7f84b9ffb640 1 -- 172.21.15.99:0/1680991703 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f84c0039040 con 0x7f84c4076ab0 2024-09-19T06:31:59.769 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:58.983+0000 7f84b9ffb640 1 --2- 172.21.15.99:0/1680991703 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f84b0039490 0x7f84b003b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:31:59.769 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:58.983+0000 7f84cb884640 1 -- 172.21.15.99:0/1680991703 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84c41003f0 con 0x7f84c4076ab0 2024-09-19T06:31:59.769 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:58.983+0000 7f84b9ffb640 1 -- 172.21.15.99:0/1680991703 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f84c006cb30 con 0x7f84c4076ab0 2024-09-19T06:31:59.769 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:58.983+0000 7f84c8e1f640 1 --2- 172.21.15.99:0/1680991703 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f84b0039490 0x7f84b003b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:31:59.769 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:58.983+0000 7f84c8e1f640 1 --2- 172.21.15.99:0/1680991703 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f84b0039490 0x7f84b003b940 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f84b4006fd0 tx=0x7f84b4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:31:59.770 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:58.987+0000 7f84b9ffb640 1 -- 172.21.15.99:0/1680991703 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f84c003b430 con 0x7f84c4076ab0 2024-09-19T06:31:59.770 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:59.143+0000 7f84cb884640 1 -- 172.21.15.99:0/1680991703 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f84c404b720 con 0x7f84c4076ab0 2024-09-19T06:31:59.770 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:59.147+0000 7f84b9ffb640 1 -- 172.21.15.99:0/1680991703 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f84c003b430 con 0x7f84c4076ab0 2024-09-19T06:31:59.770 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:59.149+0000 7f84cb884640 1 -- 172.21.15.99:0/1680991703 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f84b0039490 msgr2=0x7f84b003b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:59.770 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:59.149+0000 7f84cb884640 1 --2- 172.21.15.99:0/1680991703 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f84b0039490 0x7f84b003b940 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f84b4006fd0 tx=0x7f84b4006db0 comp rx=0 tx=0).stop 2024-09-19T06:31:59.770 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:59.149+0000 7f84cb884640 1 -- 172.21.15.99:0/1680991703 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f84c4076ab0 msgr2=0x7f84c4110e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:31:59.770 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:59.149+0000 7f84cb884640 1 --2- 172.21.15.99:0/1680991703 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f84c4076ab0 0x7f84c4110e60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f84c0031780 tx=0x7f84c00091d0 comp rx=0 tx=0).stop 2024-09-19T06:31:59.770 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:59.149+0000 7f84cb884640 1 -- 172.21.15.99:0/1680991703 shutdown_connections 2024-09-19T06:31:59.770 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:59.149+0000 7f84cb884640 1 --2- 172.21.15.99:0/1680991703 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f84b0039490 0x7f84b003b940 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:59.770 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:59.149+0000 7f84cb884640 1 --2- 172.21.15.99:0/1680991703 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f84c4076ab0 0x7f84c4110e60 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:31:59.771 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:59.149+0000 7f84cb884640 1 -- 172.21.15.99:0/1680991703 >> 172.21.15.99:0/1680991703 conn(0x7f84c40fc790 msgr2=0x7f84c40fd370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:31:59.771 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:59.149+0000 7f84cb884640 1 -- 172.21.15.99:0/1680991703 shutdown_connections 2024-09-19T06:31:59.771 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:31:59.149+0000 7f84cb884640 1 -- 172.21.15.99:0/1680991703 wait complete. 2024-09-19T06:31:59.771 INFO:teuthology.orchestra.run.smithi099.stdout:Enabling the dashboard module... 2024-09-19T06:32:00.086 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:59 smithi099 ceph-mon[27651]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:00.086 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:31:59 smithi099 ceph-mon[27651]: from='client.? 172.21.15.99:0/1680991703' entity='client.admin' 2024-09-19T06:32:01.123 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:00 smithi099 ceph-mon[27651]: from='client.? 172.21.15.99:0/2753991245' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-19T06:32:01.523 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:00.161+0000 7f9b41da5640 1 Processor -- start 2024-09-19T06:32:01.523 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:00.161+0000 7f9b41da5640 1 -- start start 2024-09-19T06:32:01.523 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:00.161+0000 7f9b41da5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b3c078cb0 0x7f9b3c077230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:01.523 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:00.161+0000 7f9b41da5640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3c0790c0 con 0x7f9b3c078cb0 2024-09-19T06:32:01.524 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:00.161+0000 7f9b3b7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b3c078cb0 0x7f9b3c077230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:01.524 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:00.161+0000 7f9b3b7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b3c078cb0 0x7f9b3c077230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34746/0 (socket says 172.21.15.99:34746) 2024-09-19T06:32:01.524 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:00.161+0000 7f9b3b7fe640 1 -- 172.21.15.99:0/3040910678 learned_addr learned my addr 172.21.15.99:0/3040910678 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:32:01.524 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:00.161+0000 7f9b3b7fe640 1 -- 172.21.15.99:0/3040910678 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b3c077770 con 0x7f9b3c078cb0 2024-09-19T06:32:01.524 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:00.162+0000 7f9b3b7fe640 1 --2- 172.21.15.99:0/3040910678 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b3c078cb0 0x7f9b3c077230 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c009840 tx=0x7f9b2c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8bad5ad815d5dec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:32:01.524 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:00.162+0000 7f9b3a7fc640 1 -- 172.21.15.99:0/3040910678 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9b2c032440 con 0x7f9b3c078cb0 2024-09-19T06:32:01.524 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:00.162+0000 7f9b3a7fc640 1 -- 172.21.15.99:0/3040910678 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9b2c032a40 con 0x7f9b3c078cb0 2024-09-19T06:32:01.524 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:00.162+0000 7f9b3a7fc640 1 -- 172.21.15.99:0/3040910678 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9b2c031a70 con 0x7f9b3c078cb0 2024-09-19T06:32:01.524 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:00.163+0000 7f9b41da5640 1 -- 172.21.15.99:0/3040910678 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b3c078cb0 msgr2=0x7f9b3c077230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:01.524 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:00.163+0000 7f9b41da5640 1 --2- 172.21.15.99:0/3040910678 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b3c078cb0 0x7f9b3c077230 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c009840 tx=0x7f9b2c0091d0 comp rx=0 tx=0).stop 2024-09-19T06:32:01.524 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:00.163+0000 7f9b41da5640 1 -- 172.21.15.99:0/3040910678 shutdown_connections 2024-09-19T06:32:01.524 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:00.163+0000 7f9b41da5640 1 --2- 172.21.15.99:0/3040910678 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b3c078cb0 0x7f9b3c077230 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:01.524 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:00.163+0000 7f9b41da5640 1 -- 172.21.15.99:0/3040910678 >> 172.21.15.99:0/3040910678 conn(0x7f9b3c0fd730 msgr2=0x7f9b3c0ffb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:32:01.525 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:00.163+0000 7f9b41da5640 1 -- 172.21.15.99:0/3040910678 shutdown_connections 2024-09-19T06:32:01.525 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:00.163+0000 7f9b41da5640 1 -- 172.21.15.99:0/3040910678 wait complete. 2024-09-19T06:32:01.525 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:00.163+0000 7f9b41da5640 1 Processor -- start 2024-09-19T06:32:01.525 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:00.164+0000 7f9b41da5640 1 -- start start 2024-09-19T06:32:01.525 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:00.164+0000 7f9b41da5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b3c078cb0 0x7f9b3c112fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:01.525 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:00.164+0000 7f9b41da5640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3c1134e0 con 0x7f9b3c078cb0 2024-09-19T06:32:01.525 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:00.164+0000 7f9b3b7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b3c078cb0 0x7f9b3c112fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:01.525 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:00.164+0000 7f9b3b7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b3c078cb0 0x7f9b3c112fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34748/0 (socket says 172.21.15.99:34748) 2024-09-19T06:32:01.525 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:00.164+0000 7f9b3b7fe640 1 -- 172.21.15.99:0/2753991245 learned_addr learned my addr 172.21.15.99:0/2753991245 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:32:01.525 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:00.164+0000 7f9b3b7fe640 1 -- 172.21.15.99:0/2753991245 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b2c009450 con 0x7f9b3c078cb0 2024-09-19T06:32:01.525 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:00.164+0000 7f9b3b7fe640 1 --2- 172.21.15.99:0/2753991245 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b3c078cb0 0x7f9b3c112fa0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c009420 tx=0x7f9b2c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:32:01.525 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:00.165+0000 7f9b23fff640 1 -- 172.21.15.99:0/2753991245 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9b2c03c400 con 0x7f9b3c078cb0 2024-09-19T06:32:01.525 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:00.165+0000 7f9b41da5640 1 -- 172.21.15.99:0/2753991245 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b3c1136e0 con 0x7f9b3c078cb0 2024-09-19T06:32:01.526 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:00.165+0000 7f9b23fff640 1 -- 172.21.15.99:0/2753991245 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9b2c03ca00 con 0x7f9b3c078cb0 2024-09-19T06:32:01.526 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:00.165+0000 7f9b23fff640 1 -- 172.21.15.99:0/2753991245 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9b2c03a920 con 0x7f9b3c078cb0 2024-09-19T06:32:01.526 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:00.165+0000 7f9b41da5640 1 -- 172.21.15.99:0/2753991245 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b3c113b50 con 0x7f9b3c078cb0 2024-09-19T06:32:01.526 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:00.166+0000 7f9b23fff640 1 -- 172.21.15.99:0/2753991245 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f9b2c03ab90 con 0x7f9b3c078cb0 2024-09-19T06:32:01.526 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:00.166+0000 7f9b23fff640 1 --2- 172.21.15.99:0/2753991245 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f9b24039490 0x7f9b2403b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:01.526 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:00.166+0000 7f9b23fff640 1 -- 172.21.15.99:0/2753991245 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f9b2c06cd10 con 0x7f9b3c078cb0 2024-09-19T06:32:01.526 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:00.166+0000 7f9b3affd640 1 --2- 172.21.15.99:0/2753991245 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f9b24039490 0x7f9b2403b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:01.526 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:00.166+0000 7f9b41da5640 1 -- 172.21.15.99:0/2753991245 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b3c1013f0 con 0x7f9b3c078cb0 2024-09-19T06:32:01.526 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:00.166+0000 7f9b3affd640 1 --2- 172.21.15.99:0/2753991245 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f9b24039490 0x7f9b2403b940 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9b30006fd0 tx=0x7f9b30006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:32:01.526 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:00.170+0000 7f9b23fff640 1 -- 172.21.15.99:0/2753991245 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f9b2c037030 con 0x7f9b3c078cb0 2024-09-19T06:32:01.526 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:00.374+0000 7f9b41da5640 1 -- 172.21.15.99:0/2753991245 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f9b3c04b720 con 0x7f9b3c078cb0 2024-09-19T06:32:01.526 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:00.856+0000 7f9b23fff640 1 -- 172.21.15.99:0/2753991245 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mgrmap(e 9) v1 ==== 45520+0+0 (secure 0 0 0) 0x7f9b2c046460 con 0x7f9b3c078cb0 2024-09-19T06:32:01.526 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:00.857+0000 7f9b23fff640 1 -- 172.21.15.99:0/2753991245 <== mon.0 v2:172.21.15.99:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f9b2c039b00 con 0x7f9b3c078cb0 2024-09-19T06:32:01.527 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:00.860+0000 7f9b41da5640 1 -- 172.21.15.99:0/2753991245 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f9b24039490 msgr2=0x7f9b2403b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:01.527 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:00.860+0000 7f9b41da5640 1 --2- 172.21.15.99:0/2753991245 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f9b24039490 0x7f9b2403b940 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9b30006fd0 tx=0x7f9b30006db0 comp rx=0 tx=0).stop 2024-09-19T06:32:01.527 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:00.860+0000 7f9b41da5640 1 -- 172.21.15.99:0/2753991245 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b3c078cb0 msgr2=0x7f9b3c112fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:01.527 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:00.860+0000 7f9b41da5640 1 --2- 172.21.15.99:0/2753991245 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b3c078cb0 0x7f9b3c112fa0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c009420 tx=0x7f9b2c0091d0 comp rx=0 tx=0).stop 2024-09-19T06:32:01.527 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:00.860+0000 7f9b41da5640 1 -- 172.21.15.99:0/2753991245 shutdown_connections 2024-09-19T06:32:01.527 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:00.861+0000 7f9b41da5640 1 --2- 172.21.15.99:0/2753991245 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f9b24039490 0x7f9b2403b940 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:01.527 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:00.861+0000 7f9b41da5640 1 --2- 172.21.15.99:0/2753991245 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b3c078cb0 0x7f9b3c112fa0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:01.527 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:00.861+0000 7f9b41da5640 1 -- 172.21.15.99:0/2753991245 >> 172.21.15.99:0/2753991245 conn(0x7f9b3c0fd730 msgr2=0x7f9b3c0fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:32:01.527 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:00.861+0000 7f9b41da5640 1 -- 172.21.15.99:0/2753991245 shutdown_connections 2024-09-19T06:32:01.527 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:00.861+0000 7f9b41da5640 1 -- 172.21.15.99:0/2753991245 wait complete. 2024-09-19T06:32:01.935 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:01 smithi099 ceph-mon[27651]: from='client.? 172.21.15.99:0/2753991245' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-19T06:32:01.936 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:01 smithi099 ceph-mon[27651]: mgrmap e9: smithi099.pgvkqi(active, since 32s) 2024-09-19T06:32:02.772 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout { 2024-09-19T06:32:02.773 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-19T06:32:02.773 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T06:32:02.773 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "active_name": "smithi099.pgvkqi", 2024-09-19T06:32:02.773 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-19T06:32:02.773 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout } 2024-09-19T06:32:02.773 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:01.933+0000 7f235c37b640 1 Processor -- start 2024-09-19T06:32:02.773 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:01.933+0000 7f235c37b640 1 -- start start 2024-09-19T06:32:02.773 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:01.934+0000 7f235c37b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2354078cf0 0x7f2354077270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:02.773 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:01.934+0000 7f235c37b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2354079100 con 0x7f2354078cf0 2024-09-19T06:32:02.773 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:01.934+0000 7f235a117640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2354078cf0 0x7f2354077270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:02.773 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:01.934+0000 7f235a117640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2354078cf0 0x7f2354077270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34776/0 (socket says 172.21.15.99:34776) 2024-09-19T06:32:02.774 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:01.934+0000 7f235a117640 1 -- 172.21.15.99:0/424045053 learned_addr learned my addr 172.21.15.99:0/424045053 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:32:02.774 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:01.934+0000 7f235a117640 1 -- 172.21.15.99:0/424045053 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23540777b0 con 0x7f2354078cf0 2024-09-19T06:32:02.774 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:01.935+0000 7f235a117640 1 --2- 172.21.15.99:0/424045053 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2354078cf0 0x7f2354077270 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2350009840 tx=0x7f23500091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59787e6605841ddb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:32:02.774 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:01.935+0000 7f2359115640 1 -- 172.21.15.99:0/424045053 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2350032440 con 0x7f2354078cf0 2024-09-19T06:32:02.774 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:01.935+0000 7f2359115640 1 -- 172.21.15.99:0/424045053 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2350032a40 con 0x7f2354078cf0 2024-09-19T06:32:02.774 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:01.935+0000 7f2359115640 1 -- 172.21.15.99:0/424045053 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2350031a70 con 0x7f2354078cf0 2024-09-19T06:32:02.774 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:01.936+0000 7f235c37b640 1 -- 172.21.15.99:0/424045053 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2354078cf0 msgr2=0x7f2354077270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:02.774 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:01.936+0000 7f235c37b640 1 --2- 172.21.15.99:0/424045053 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2354078cf0 0x7f2354077270 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2350009840 tx=0x7f23500091d0 comp rx=0 tx=0).stop 2024-09-19T06:32:02.774 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:01.936+0000 7f235c37b640 1 -- 172.21.15.99:0/424045053 shutdown_connections 2024-09-19T06:32:02.774 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:01.936+0000 7f235c37b640 1 --2- 172.21.15.99:0/424045053 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2354078cf0 0x7f2354077270 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:02.774 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:01.936+0000 7f235c37b640 1 -- 172.21.15.99:0/424045053 >> 172.21.15.99:0/424045053 conn(0x7f23540fd730 msgr2=0x7f23540ffb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:32:02.774 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:01.936+0000 7f235c37b640 1 -- 172.21.15.99:0/424045053 shutdown_connections 2024-09-19T06:32:02.774 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:01.936+0000 7f235c37b640 1 -- 172.21.15.99:0/424045053 wait complete. 2024-09-19T06:32:02.774 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:01.937+0000 7f235c37b640 1 Processor -- start 2024-09-19T06:32:02.775 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:01.937+0000 7f235c37b640 1 -- start start 2024-09-19T06:32:02.775 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:01.937+0000 7f235c37b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2354078cf0 0x7f2354112fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:02.775 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:01.937+0000 7f235c37b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23541134f0 con 0x7f2354078cf0 2024-09-19T06:32:02.775 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:01.937+0000 7f235a117640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2354078cf0 0x7f2354112fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:02.775 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:01.937+0000 7f235a117640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2354078cf0 0x7f2354112fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34788/0 (socket says 172.21.15.99:34788) 2024-09-19T06:32:02.775 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:01.937+0000 7f235a117640 1 -- 172.21.15.99:0/159785142 learned_addr learned my addr 172.21.15.99:0/159785142 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:32:02.775 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:01.937+0000 7f235a117640 1 -- 172.21.15.99:0/159785142 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2350009450 con 0x7f2354078cf0 2024-09-19T06:32:02.775 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:01.937+0000 7f235a117640 1 --2- 172.21.15.99:0/159785142 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2354078cf0 0x7f2354112fb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2350009420 tx=0x7f23500091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:32:02.775 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:01.937+0000 7f234affd640 1 -- 172.21.15.99:0/159785142 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f235003c400 con 0x7f2354078cf0 2024-09-19T06:32:02.775 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:01.937+0000 7f235c37b640 1 -- 172.21.15.99:0/159785142 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23541136f0 con 0x7f2354078cf0 2024-09-19T06:32:02.775 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:01.937+0000 7f234affd640 1 -- 172.21.15.99:0/159785142 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f235003ca00 con 0x7f2354078cf0 2024-09-19T06:32:02.775 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:01.937+0000 7f234affd640 1 -- 172.21.15.99:0/159785142 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f235003a920 con 0x7f2354078cf0 2024-09-19T06:32:02.775 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:01.937+0000 7f235c37b640 1 -- 172.21.15.99:0/159785142 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2354113b60 con 0x7f2354078cf0 2024-09-19T06:32:02.775 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:01.938+0000 7f235c37b640 1 -- 172.21.15.99:0/159785142 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f235404b720 con 0x7f2354078cf0 2024-09-19T06:32:02.776 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:01.939+0000 7f234affd640 1 -- 172.21.15.99:0/159785142 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 9) v1 ==== 45520+0+0 (secure 0 0 0) 0x7f235003cb70 con 0x7f2354078cf0 2024-09-19T06:32:02.776 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:01.939+0000 7f234affd640 1 --2- 172.21.15.99:0/159785142 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f23400394e0 0x7f234003b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:02.776 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:01.939+0000 7f234affd640 1 -- 172.21.15.99:0/159785142 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f235006ccf0 con 0x7f2354078cf0 2024-09-19T06:32:02.776 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:01.939+0000 7f2359916640 1 -- 172.21.15.99:0/159785142 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f23400394e0 msgr2=0x7f234003b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.99:6800/3738534523 2024-09-19T06:32:02.776 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:01.939+0000 7f2359916640 1 --2- 172.21.15.99:0/159785142 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f23400394e0 0x7f234003b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T06:32:02.776 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:01.947+0000 7f234affd640 1 -- 172.21.15.99:0/159785142 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f2350071070 con 0x7f2354078cf0 2024-09-19T06:32:02.776 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:02.140+0000 7f2359916640 1 -- 172.21.15.99:0/159785142 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f23400394e0 msgr2=0x7f234003b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.99:6800/3738534523 2024-09-19T06:32:02.776 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:02.140+0000 7f2359916640 1 --2- 172.21.15.99:0/159785142 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f23400394e0 0x7f234003b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T06:32:02.776 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:02.151+0000 7f235c37b640 1 -- 172.21.15.99:0/159785142 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f23541081d0 con 0x7f2354078cf0 2024-09-19T06:32:02.776 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:02.152+0000 7f234affd640 1 -- 172.21.15.99:0/159785142 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7f2350037070 con 0x7f2354078cf0 2024-09-19T06:32:02.776 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:02.154+0000 7f235c37b640 1 -- 172.21.15.99:0/159785142 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f23400394e0 msgr2=0x7f234003b990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:32:02.776 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:02.154+0000 7f235c37b640 1 --2- 172.21.15.99:0/159785142 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f23400394e0 0x7f234003b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:02.776 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:02.154+0000 7f235c37b640 1 -- 172.21.15.99:0/159785142 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2354078cf0 msgr2=0x7f2354112fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:02.777 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:02.154+0000 7f235c37b640 1 --2- 172.21.15.99:0/159785142 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2354078cf0 0x7f2354112fb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2350009420 tx=0x7f23500091d0 comp rx=0 tx=0).stop 2024-09-19T06:32:02.777 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:02.154+0000 7f235c37b640 1 -- 172.21.15.99:0/159785142 shutdown_connections 2024-09-19T06:32:02.777 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:02.154+0000 7f235c37b640 1 --2- 172.21.15.99:0/159785142 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f23400394e0 0x7f234003b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:02.777 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:02.154+0000 7f235c37b640 1 --2- 172.21.15.99:0/159785142 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2354078cf0 0x7f2354112fb0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:02.777 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:02.154+0000 7f235c37b640 1 -- 172.21.15.99:0/159785142 >> 172.21.15.99:0/159785142 conn(0x7f23540fd730 msgr2=0x7f23540fe2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:32:02.777 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:02.154+0000 7f235c37b640 1 -- 172.21.15.99:0/159785142 shutdown_connections 2024-09-19T06:32:02.777 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:02.154+0000 7f235c37b640 1 -- 172.21.15.99:0/159785142 wait complete. 2024-09-19T06:32:02.777 INFO:teuthology.orchestra.run.smithi099.stdout:Waiting for the mgr to restart... 2024-09-19T06:32:02.777 INFO:teuthology.orchestra.run.smithi099.stdout:Waiting for mgr epoch 9... 2024-09-19T06:32:03.092 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:02 smithi099 ceph-mon[27651]: from='client.? 172.21.15.99:0/159785142' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-19T06:32:05.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:05 smithi099 ceph-mon[27651]: Active manager daemon smithi099.pgvkqi restarted 2024-09-19T06:32:05.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:05 smithi099 ceph-mon[27651]: Activating manager daemon smithi099.pgvkqi 2024-09-19T06:32:05.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:05 smithi099 ceph-mon[27651]: osdmap e3: 0 total, 0 up, 0 in 2024-09-19T06:32:05.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:05 smithi099 ceph-mon[27651]: mgrmap e10: smithi099.pgvkqi(active, starting, since 0.00564784s) 2024-09-19T06:32:05.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:05 smithi099 ceph-mon[27651]: from='mgr.14160 172.21.15.99:0/1563599924' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mon metadata", "id": "smithi099"}]: dispatch 2024-09-19T06:32:05.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:05 smithi099 ceph-mon[27651]: from='mgr.14160 172.21.15.99:0/1563599924' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mgr metadata", "who": "smithi099.pgvkqi", "id": "smithi099.pgvkqi"}]: dispatch 2024-09-19T06:32:05.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:05 smithi099 ceph-mon[27651]: from='mgr.14160 172.21.15.99:0/1563599924' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T06:32:05.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:05 smithi099 ceph-mon[27651]: from='mgr.14160 172.21.15.99:0/1563599924' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T06:32:05.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:05 smithi099 ceph-mon[27651]: from='mgr.14160 172.21.15.99:0/1563599924' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T06:32:05.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:05 smithi099 ceph-mon[27651]: Manager daemon smithi099.pgvkqi is now available 2024-09-19T06:32:05.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:05 smithi099 ceph-mon[27651]: from='mgr.14160 172.21.15.99:0/1563599924' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:32:05.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:05 smithi099 ceph-mon[27651]: from='mgr.14160 172.21.15.99:0/1563599924' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi099.pgvkqi/mirror_snapshot_schedule"}]: dispatch 2024-09-19T06:32:05.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:05 smithi099 ceph-mon[27651]: from='mgr.14160 172.21.15.99:0/1563599924' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi099.pgvkqi/trash_purge_schedule"}]: dispatch 2024-09-19T06:32:07.001 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout { 2024-09-19T06:32:07.001 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-19T06:32:07.001 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-19T06:32:07.001 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout } 2024-09-19T06:32:07.001 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:03.165+0000 7f1c94888640 1 Processor -- start 2024-09-19T06:32:07.001 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:03.165+0000 7f1c94888640 1 -- start start 2024-09-19T06:32:07.002 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:03.165+0000 7f1c94888640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c90078cd0 0x7f1c90077250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:07.002 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:03.165+0000 7f1c94888640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c900790e0 con 0x7f1c90078cd0 2024-09-19T06:32:07.002 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:03.165+0000 7f1c8e59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c90078cd0 0x7f1c90077250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:07.002 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:03.165+0000 7f1c8e59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c90078cd0 0x7f1c90077250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34802/0 (socket says 172.21.15.99:34802) 2024-09-19T06:32:07.002 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:03.165+0000 7f1c8e59c640 1 -- 172.21.15.99:0/169511293 learned_addr learned my addr 172.21.15.99:0/169511293 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:32:07.002 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:03.166+0000 7f1c8e59c640 1 -- 172.21.15.99:0/169511293 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c90077790 con 0x7f1c90078cd0 2024-09-19T06:32:07.002 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:03.166+0000 7f1c8e59c640 1 --2- 172.21.15.99:0/169511293 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c90078cd0 0x7f1c90077250 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1c80009840 tx=0x7f1c800091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7739c4ef06b0953 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:32:07.002 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:03.166+0000 7f1c8d59a640 1 -- 172.21.15.99:0/169511293 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1c80032440 con 0x7f1c90078cd0 2024-09-19T06:32:07.002 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:03.167+0000 7f1c8d59a640 1 -- 172.21.15.99:0/169511293 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1c80032a40 con 0x7f1c90078cd0 2024-09-19T06:32:07.002 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:03.167+0000 7f1c8d59a640 1 -- 172.21.15.99:0/169511293 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1c80031a70 con 0x7f1c90078cd0 2024-09-19T06:32:07.003 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:03.167+0000 7f1c94888640 1 -- 172.21.15.99:0/169511293 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c90078cd0 msgr2=0x7f1c90077250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:07.003 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:03.167+0000 7f1c94888640 1 --2- 172.21.15.99:0/169511293 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c90078cd0 0x7f1c90077250 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1c80009840 tx=0x7f1c800091d0 comp rx=0 tx=0).stop 2024-09-19T06:32:07.003 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:03.167+0000 7f1c94888640 1 -- 172.21.15.99:0/169511293 shutdown_connections 2024-09-19T06:32:07.003 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:03.167+0000 7f1c94888640 1 --2- 172.21.15.99:0/169511293 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c90078cd0 0x7f1c90077250 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:07.003 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:03.167+0000 7f1c94888640 1 -- 172.21.15.99:0/169511293 >> 172.21.15.99:0/169511293 conn(0x7f1c900fd740 msgr2=0x7f1c900ffb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:32:07.003 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:03.167+0000 7f1c94888640 1 -- 172.21.15.99:0/169511293 shutdown_connections 2024-09-19T06:32:07.003 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:03.167+0000 7f1c94888640 1 -- 172.21.15.99:0/169511293 wait complete. 2024-09-19T06:32:07.003 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:03.168+0000 7f1c94888640 1 Processor -- start 2024-09-19T06:32:07.003 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:03.168+0000 7f1c94888640 1 -- start start 2024-09-19T06:32:07.003 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:03.168+0000 7f1c94888640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c90078cd0 0x7f1c90112fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:07.003 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:03.168+0000 7f1c94888640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c901134e0 con 0x7f1c90078cd0 2024-09-19T06:32:07.003 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:03.168+0000 7f1c8e59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c90078cd0 0x7f1c90112fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:07.003 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:03.168+0000 7f1c8e59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c90078cd0 0x7f1c90112fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34816/0 (socket says 172.21.15.99:34816) 2024-09-19T06:32:07.003 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:03.168+0000 7f1c8e59c640 1 -- 172.21.15.99:0/1255176649 learned_addr learned my addr 172.21.15.99:0/1255176649 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:32:07.004 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:03.168+0000 7f1c8e59c640 1 -- 172.21.15.99:0/1255176649 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c80009450 con 0x7f1c90078cd0 2024-09-19T06:32:07.004 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:03.169+0000 7f1c8e59c640 1 --2- 172.21.15.99:0/1255176649 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c90078cd0 0x7f1c90112fa0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1c80031750 tx=0x7f1c800091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:32:07.004 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:03.169+0000 7f1c7effd640 1 -- 172.21.15.99:0/1255176649 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1c8003c400 con 0x7f1c90078cd0 2024-09-19T06:32:07.004 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:03.169+0000 7f1c7effd640 1 -- 172.21.15.99:0/1255176649 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1c8003ca00 con 0x7f1c90078cd0 2024-09-19T06:32:07.004 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:03.169+0000 7f1c94888640 1 -- 172.21.15.99:0/1255176649 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c901136e0 con 0x7f1c90078cd0 2024-09-19T06:32:07.004 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:03.169+0000 7f1c7effd640 1 -- 172.21.15.99:0/1255176649 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1c8003a880 con 0x7f1c90078cd0 2024-09-19T06:32:07.004 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:03.169+0000 7f1c94888640 1 -- 172.21.15.99:0/1255176649 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c90113af0 con 0x7f1c90078cd0 2024-09-19T06:32:07.004 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:03.170+0000 7f1c7effd640 1 -- 172.21.15.99:0/1255176649 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 9) v1 ==== 45520+0+0 (secure 0 0 0) 0x7f1c8003a9e0 con 0x7f1c90078cd0 2024-09-19T06:32:07.004 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:03.170+0000 7f1c7effd640 1 --2- 172.21.15.99:0/1255176649 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f1c78039530 0x7f1c7803b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:07.004 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:03.170+0000 7f1c7effd640 1 -- 172.21.15.99:0/1255176649 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f1c8006ce40 con 0x7f1c90078cd0 2024-09-19T06:32:07.004 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:03.170+0000 7f1c8dd9b640 1 -- 172.21.15.99:0/1255176649 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f1c78039530 msgr2=0x7f1c7803b9e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.99:6800/3738534523 2024-09-19T06:32:07.004 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:03.170+0000 7f1c8dd9b640 1 --2- 172.21.15.99:0/1255176649 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f1c78039530 0x7f1c7803b9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T06:32:07.004 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:03.170+0000 7f1c94888640 1 -- 172.21.15.99:0/1255176649 --> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1c9004b720 con 0x7f1c78039530 2024-09-19T06:32:07.005 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:03.371+0000 7f1c8dd9b640 1 -- 172.21.15.99:0/1255176649 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f1c78039530 msgr2=0x7f1c7803b9e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.99:6800/3738534523 2024-09-19T06:32:07.005 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:03.371+0000 7f1c8dd9b640 1 --2- 172.21.15.99:0/1255176649 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f1c78039530 0x7f1c7803b9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T06:32:07.005 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:03.772+0000 7f1c8dd9b640 1 -- 172.21.15.99:0/1255176649 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f1c78039530 msgr2=0x7f1c7803b9e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.99:6800/3738534523 2024-09-19T06:32:07.005 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:03.772+0000 7f1c8dd9b640 1 --2- 172.21.15.99:0/1255176649 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f1c78039530 0x7f1c7803b9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T06:32:07.005 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:04.573+0000 7f1c8dd9b640 1 -- 172.21.15.99:0/1255176649 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f1c78039530 msgr2=0x7f1c7803b9e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.99:6800/3738534523 2024-09-19T06:32:07.005 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:04.573+0000 7f1c8dd9b640 1 --2- 172.21.15.99:0/1255176649 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f1c78039530 0x7f1c7803b9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T06:32:07.005 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:05.262+0000 7f1c7effd640 1 -- 172.21.15.99:0/1255176649 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mgrmap(e 10) v1 ==== 45287+0+0 (secure 0 0 0) 0x7f1c8006bf40 con 0x7f1c90078cd0 2024-09-19T06:32:07.005 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:05.263+0000 7f1c7effd640 1 -- 172.21.15.99:0/1255176649 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f1c78039530 msgr2=0x7f1c7803b9e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:32:07.005 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:05.263+0000 7f1c7effd640 1 --2- 172.21.15.99:0/1255176649 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f1c78039530 0x7f1c7803b9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:07.005 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:06.262+0000 7f1c7effd640 1 -- 172.21.15.99:0/1255176649 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mgrmap(e 11) v1 ==== 45414+0+0 (secure 0 0 0) 0x7f1c80039310 con 0x7f1c90078cd0 2024-09-19T06:32:07.005 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:06.262+0000 7f1c7effd640 1 --2- 172.21.15.99:0/1255176649 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f1c7803ce20 0x7f1c7803f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:07.005 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:06.262+0000 7f1c7effd640 1 -- 172.21.15.99:0/1255176649 --> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1c9004b720 con 0x7f1c7803ce20 2024-09-19T06:32:07.005 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:06.262+0000 7f1c8dd9b640 1 --2- 172.21.15.99:0/1255176649 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f1c7803ce20 0x7f1c7803f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:07.006 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:06.263+0000 7f1c8dd9b640 1 --2- 172.21.15.99:0/1255176649 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f1c7803ce20 0x7f1c7803f200 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f1c84003940 tx=0x7f1c84009350 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:32:07.006 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:06.263+0000 7f1c7effd640 1 -- 172.21.15.99:0/1255176649 <== mgr.14160 v2:172.21.15.99:6800/2333024932 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7f1c9004b720 con 0x7f1c7803ce20 2024-09-19T06:32:07.006 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:06.268+0000 7f1c94888640 1 -- 172.21.15.99:0/1255176649 --> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f1c90108200 con 0x7f1c7803ce20 2024-09-19T06:32:07.006 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:06.269+0000 7f1c7effd640 1 -- 172.21.15.99:0/1255176649 <== mgr.14160 v2:172.21.15.99:6800/2333024932 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f1c90108200 con 0x7f1c7803ce20 2024-09-19T06:32:07.006 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:06.269+0000 7f1c94888640 1 -- 172.21.15.99:0/1255176649 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f1c7803ce20 msgr2=0x7f1c7803f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:07.006 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:06.269+0000 7f1c94888640 1 --2- 172.21.15.99:0/1255176649 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f1c7803ce20 0x7f1c7803f200 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f1c84003940 tx=0x7f1c84009350 comp rx=0 tx=0).stop 2024-09-19T06:32:07.006 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:06.269+0000 7f1c94888640 1 -- 172.21.15.99:0/1255176649 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c90078cd0 msgr2=0x7f1c90112fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:07.006 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:06.269+0000 7f1c94888640 1 --2- 172.21.15.99:0/1255176649 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c90078cd0 0x7f1c90112fa0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1c80031750 tx=0x7f1c800091d0 comp rx=0 tx=0).stop 2024-09-19T06:32:07.006 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:06.269+0000 7f1c94888640 1 -- 172.21.15.99:0/1255176649 shutdown_connections 2024-09-19T06:32:07.006 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:06.269+0000 7f1c94888640 1 --2- 172.21.15.99:0/1255176649 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f1c7803ce20 0x7f1c7803f200 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:07.006 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:06.269+0000 7f1c94888640 1 --2- 172.21.15.99:0/1255176649 >> [v2:172.21.15.99:6800/3738534523,v1:172.21.15.99:6801/3738534523] conn(0x7f1c78039530 0x7f1c7803b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:07.006 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:06.269+0000 7f1c94888640 1 --2- 172.21.15.99:0/1255176649 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1c90078cd0 0x7f1c90112fa0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:07.006 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:06.269+0000 7f1c94888640 1 -- 172.21.15.99:0/1255176649 >> 172.21.15.99:0/1255176649 conn(0x7f1c900fd740 msgr2=0x7f1c900fe280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:32:07.007 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:06.269+0000 7f1c94888640 1 -- 172.21.15.99:0/1255176649 shutdown_connections 2024-09-19T06:32:07.007 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:06.269+0000 7f1c94888640 1 -- 172.21.15.99:0/1255176649 wait complete. 2024-09-19T06:32:07.007 INFO:teuthology.orchestra.run.smithi099.stdout:mgr epoch 9 is available 2024-09-19T06:32:07.007 INFO:teuthology.orchestra.run.smithi099.stdout:Generating a dashboard self-signed certificate... 2024-09-19T06:32:07.604 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:07 smithi099 ceph-mon[27651]: mgrmap e11: smithi099.pgvkqi(active, since 1.00582s) 2024-09-19T06:32:07.604 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:07 smithi099 ceph-mon[27651]: [19/Sep/2024:06:32:06] ENGINE Bus STARTING 2024-09-19T06:32:07.604 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:07 smithi099 ceph-mon[27651]: [19/Sep/2024:06:32:06] ENGINE Serving on https://172.21.15.99:7150 2024-09-19T06:32:07.604 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:07 smithi099 ceph-mon[27651]: [19/Sep/2024:06:32:06] ENGINE Bus STARTED 2024-09-19T06:32:07.604 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:07 smithi099 ceph-mon[27651]: [19/Sep/2024:06:32:06] ENGINE Error in HTTPServer.serve 2024-09-19T06:32:07.604 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Traceback (most recent call last): 2024-09-19T06:32:07.604 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T06:32:07.604 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: self._connections.run(self.expiration_interval) 2024-09-19T06:32:07.604 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T06:32:07.604 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: self._run(expiration_interval) 2024-09-19T06:32:07.605 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T06:32:07.605 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T06:32:07.605 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T06:32:07.605 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T06:32:07.605 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T06:32:07.605 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: s = self.context.wrap_socket( 2024-09-19T06:32:07.605 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T06:32:07.605 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: return self.sslsocket_class._create( 2024-09-19T06:32:07.605 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T06:32:07.605 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: self.do_handshake() 2024-09-19T06:32:07.605 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T06:32:07.605 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: self._sslobj.do_handshake() 2024-09-19T06:32:07.605 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T06:32:07.605 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:07 smithi099 ceph-mon[27651]: from='mgr.14160 172.21.15.99:0/1563599924' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:32:07.606 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:07 smithi099 ceph-mon[27651]: from='mgr.14160 172.21.15.99:0/1563599924' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:32:08.264 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-19T06:32:08.264 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:07.424+0000 7fc13a307640 1 Processor -- start 2024-09-19T06:32:08.264 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:07.425+0000 7fc13a307640 1 -- start start 2024-09-19T06:32:08.264 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:07.425+0000 7fc13a307640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc1340769e0 0x7fc134107000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:08.264 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:07.425+0000 7fc13a307640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc134076df0 con 0x7fc1340769e0 2024-09-19T06:32:08.264 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:07.425+0000 7fc133fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc1340769e0 0x7fc134107000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:08.264 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:07.425+0000 7fc133fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc1340769e0 0x7fc134107000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52908/0 (socket says 172.21.15.99:52908) 2024-09-19T06:32:08.265 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:07.425+0000 7fc133fff640 1 -- 172.21.15.99:0/2147219558 learned_addr learned my addr 172.21.15.99:0/2147219558 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:32:08.265 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:07.425+0000 7fc133fff640 1 -- 172.21.15.99:0/2147219558 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc134107540 con 0x7fc1340769e0 2024-09-19T06:32:08.265 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:07.426+0000 7fc133fff640 1 --2- 172.21.15.99:0/2147219558 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc1340769e0 0x7fc134107000 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc124009840 tx=0x7fc1240091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d004934af8b55a8b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:32:08.265 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:07.426+0000 7fc1337fe640 1 -- 172.21.15.99:0/2147219558 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc124032440 con 0x7fc1340769e0 2024-09-19T06:32:08.265 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:07.426+0000 7fc1337fe640 1 -- 172.21.15.99:0/2147219558 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc124032a40 con 0x7fc1340769e0 2024-09-19T06:32:08.265 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:07.426+0000 7fc1337fe640 1 -- 172.21.15.99:0/2147219558 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc124031aa0 con 0x7fc1340769e0 2024-09-19T06:32:08.265 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:07.427+0000 7fc13a307640 1 -- 172.21.15.99:0/2147219558 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc1340769e0 msgr2=0x7fc134107000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:08.265 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:07.427+0000 7fc13a307640 1 --2- 172.21.15.99:0/2147219558 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc1340769e0 0x7fc134107000 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc124009840 tx=0x7fc1240091d0 comp rx=0 tx=0).stop 2024-09-19T06:32:08.265 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:07.427+0000 7fc13a307640 1 -- 172.21.15.99:0/2147219558 shutdown_connections 2024-09-19T06:32:08.265 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:07.427+0000 7fc13a307640 1 --2- 172.21.15.99:0/2147219558 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc1340769e0 0x7fc134107000 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:08.265 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:07.427+0000 7fc13a307640 1 -- 172.21.15.99:0/2147219558 >> 172.21.15.99:0/2147219558 conn(0x7fc1340fc6d0 msgr2=0x7fc1340feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:32:08.265 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:07.427+0000 7fc13a307640 1 -- 172.21.15.99:0/2147219558 shutdown_connections 2024-09-19T06:32:08.265 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:07.427+0000 7fc13a307640 1 -- 172.21.15.99:0/2147219558 wait complete. 2024-09-19T06:32:08.266 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:07.427+0000 7fc13a307640 1 Processor -- start 2024-09-19T06:32:08.266 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:07.427+0000 7fc13a307640 1 -- start start 2024-09-19T06:32:08.266 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:07.427+0000 7fc13a307640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc1340769e0 0x7fc134112f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:08.266 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:07.427+0000 7fc13a307640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1341134d0 con 0x7fc1340769e0 2024-09-19T06:32:08.266 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:07.427+0000 7fc133fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc1340769e0 0x7fc134112f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:08.266 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:07.427+0000 7fc133fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc1340769e0 0x7fc134112f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52910/0 (socket says 172.21.15.99:52910) 2024-09-19T06:32:08.266 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:07.427+0000 7fc133fff640 1 -- 172.21.15.99:0/1410530793 learned_addr learned my addr 172.21.15.99:0/1410530793 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:32:08.266 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:07.428+0000 7fc133fff640 1 -- 172.21.15.99:0/1410530793 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc124009450 con 0x7fc1340769e0 2024-09-19T06:32:08.266 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:07.428+0000 7fc133fff640 1 --2- 172.21.15.99:0/1410530793 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc1340769e0 0x7fc134112f90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc124009810 tx=0x7fc1240091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:32:08.266 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:07.428+0000 7fc1317fa640 1 -- 172.21.15.99:0/1410530793 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc1240327b0 con 0x7fc1340769e0 2024-09-19T06:32:08.266 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:07.428+0000 7fc1317fa640 1 -- 172.21.15.99:0/1410530793 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc12403b8d0 con 0x7fc1340769e0 2024-09-19T06:32:08.266 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:07.428+0000 7fc13a307640 1 -- 172.21.15.99:0/1410530793 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1341136d0 con 0x7fc1340769e0 2024-09-19T06:32:08.266 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:07.428+0000 7fc1317fa640 1 -- 172.21.15.99:0/1410530793 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc12403a6f0 con 0x7fc1340769e0 2024-09-19T06:32:08.266 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:07.428+0000 7fc13a307640 1 -- 172.21.15.99:0/1410530793 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc134113b40 con 0x7fc1340769e0 2024-09-19T06:32:08.267 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:07.429+0000 7fc1317fa640 1 -- 172.21.15.99:0/1410530793 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 11) v1 ==== 45414+0+0 (secure 0 0 0) 0x7fc124039040 con 0x7fc1340769e0 2024-09-19T06:32:08.267 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:07.429+0000 7fc1317fa640 1 --2- 172.21.15.99:0/1410530793 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7fc120039420 0x7fc12003b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:08.267 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:07.429+0000 7fc1317fa640 1 -- 172.21.15.99:0/1410530793 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fc12406c8c0 con 0x7fc1340769e0 2024-09-19T06:32:08.267 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:07.429+0000 7fc12bfff640 1 --2- 172.21.15.99:0/1410530793 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7fc120039420 0x7fc12003b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:08.267 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:07.429+0000 7fc13a307640 1 -- 172.21.15.99:0/1410530793 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1341002f0 con 0x7fc1340769e0 2024-09-19T06:32:08.267 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:07.429+0000 7fc12bfff640 1 --2- 172.21.15.99:0/1410530793 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7fc120039420 0x7fc12003b8d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc11c006fd0 tx=0x7fc11c006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:32:08.267 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:07.434+0000 7fc1317fa640 1 -- 172.21.15.99:0/1410530793 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fc12403f020 con 0x7fc1340769e0 2024-09-19T06:32:08.267 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:07.602+0000 7fc1317fa640 1 -- 172.21.15.99:0/1410530793 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mgrmap(e 12) v1 ==== 45520+0+0 (secure 0 0 0) 0x7fc12404bd10 con 0x7fc1340769e0 2024-09-19T06:32:08.267 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:07.616+0000 7fc13a307640 1 -- 172.21.15.99:0/1410530793 --> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7fc1340fdb40 con 0x7fc120039420 2024-09-19T06:32:08.267 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:07.670+0000 7fc1317fa640 1 -- 172.21.15.99:0/1410530793 <== mgr.14160 v2:172.21.15.99:6800/2333024932 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7fc1340fdb40 con 0x7fc120039420 2024-09-19T06:32:08.267 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:07.672+0000 7fc13a307640 1 -- 172.21.15.99:0/1410530793 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7fc120039420 msgr2=0x7fc12003b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:08.267 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:07.672+0000 7fc13a307640 1 --2- 172.21.15.99:0/1410530793 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7fc120039420 0x7fc12003b8d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc11c006fd0 tx=0x7fc11c006db0 comp rx=0 tx=0).stop 2024-09-19T06:32:08.267 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:07.672+0000 7fc13a307640 1 -- 172.21.15.99:0/1410530793 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc1340769e0 msgr2=0x7fc134112f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:08.268 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:07.672+0000 7fc13a307640 1 --2- 172.21.15.99:0/1410530793 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc1340769e0 0x7fc134112f90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc124009810 tx=0x7fc1240091d0 comp rx=0 tx=0).stop 2024-09-19T06:32:08.268 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:07.672+0000 7fc13a307640 1 -- 172.21.15.99:0/1410530793 shutdown_connections 2024-09-19T06:32:08.268 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:07.672+0000 7fc13a307640 1 --2- 172.21.15.99:0/1410530793 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7fc120039420 0x7fc12003b8d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:08.268 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:07.672+0000 7fc13a307640 1 --2- 172.21.15.99:0/1410530793 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc1340769e0 0x7fc134112f90 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:08.268 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:07.672+0000 7fc13a307640 1 -- 172.21.15.99:0/1410530793 >> 172.21.15.99:0/1410530793 conn(0x7fc1340fc6d0 msgr2=0x7fc1340fd370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:32:08.268 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:07.672+0000 7fc13a307640 1 -- 172.21.15.99:0/1410530793 shutdown_connections 2024-09-19T06:32:08.268 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:07.672+0000 7fc13a307640 1 -- 172.21.15.99:0/1410530793 wait complete. 2024-09-19T06:32:08.268 INFO:teuthology.orchestra.run.smithi099.stdout:Creating initial admin user... 2024-09-19T06:32:08.652 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:08 smithi099 ceph-mon[27651]: from='mgr.14160 172.21.15.99:0/1563599924' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:32:08.652 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:08 smithi099 ceph-mon[27651]: mgrmap e12: smithi099.pgvkqi(active, since 2s) 2024-09-19T06:32:08.652 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:08 smithi099 ceph-mon[27651]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:32:08.652 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:08 smithi099 ceph-mon[27651]: from='mgr.14160 172.21.15.99:0/1563599924' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:32:08.652 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:08 smithi099 ceph-mon[27651]: from='mgr.14160 172.21.15.99:0/1563599924' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:32:09.584 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:09 smithi099 ceph-mon[27651]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:32:09.584 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:09 smithi099 ceph-mon[27651]: from='mgr.14160 172.21.15.99:0/1563599924' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:32:10.261 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$9fmiYEHQEr3UGRY1EN9PFeJCeKlZ6hKihCiAUozKXcLpEyUZsyxwO", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726727529, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-19T06:32:10.261 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:08.671+0000 7f075a0f0640 1 Processor -- start 2024-09-19T06:32:10.261 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:08.671+0000 7f075a0f0640 1 -- start start 2024-09-19T06:32:10.262 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:08.672+0000 7f075a0f0640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0754101f90 0x7f07541023a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:10.262 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:08.672+0000 7f075a0f0640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07541028e0 con 0x7f0754101f90 2024-09-19T06:32:10.262 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:08.672+0000 7f07537fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0754101f90 0x7f07541023a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:10.262 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:08.672+0000 7f07537fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0754101f90 0x7f07541023a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52912/0 (socket says 172.21.15.99:52912) 2024-09-19T06:32:10.262 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:08.672+0000 7f07537fe640 1 -- 172.21.15.99:0/1699102644 learned_addr learned my addr 172.21.15.99:0/1699102644 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:32:10.262 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:08.672+0000 7f07537fe640 1 -- 172.21.15.99:0/1699102644 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0754102a20 con 0x7f0754101f90 2024-09-19T06:32:10.262 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:08.673+0000 7f07537fe640 1 --2- 172.21.15.99:0/1699102644 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0754101f90 0x7f07541023a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0744009840 tx=0x7f07440091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10198132b47c8243 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:32:10.262 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:08.673+0000 7f07527fc640 1 -- 172.21.15.99:0/1699102644 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0744032440 con 0x7f0754101f90 2024-09-19T06:32:10.262 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:08.673+0000 7f07527fc640 1 -- 172.21.15.99:0/1699102644 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0744032a40 con 0x7f0754101f90 2024-09-19T06:32:10.262 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:08.673+0000 7f07527fc640 1 -- 172.21.15.99:0/1699102644 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0744031a70 con 0x7f0754101f90 2024-09-19T06:32:10.262 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:08.674+0000 7f075a0f0640 1 -- 172.21.15.99:0/1699102644 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0754101f90 msgr2=0x7f07541023a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:10.262 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:08.674+0000 7f075a0f0640 1 --2- 172.21.15.99:0/1699102644 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0754101f90 0x7f07541023a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0744009840 tx=0x7f07440091d0 comp rx=0 tx=0).stop 2024-09-19T06:32:10.262 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:08.674+0000 7f075a0f0640 1 -- 172.21.15.99:0/1699102644 shutdown_connections 2024-09-19T06:32:10.263 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:08.674+0000 7f075a0f0640 1 --2- 172.21.15.99:0/1699102644 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0754101f90 0x7f07541023a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:10.263 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:08.674+0000 7f075a0f0640 1 -- 172.21.15.99:0/1699102644 >> 172.21.15.99:0/1699102644 conn(0x7f07540fd730 msgr2=0x7f07540ffb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:32:10.263 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:08.674+0000 7f075a0f0640 1 -- 172.21.15.99:0/1699102644 shutdown_connections 2024-09-19T06:32:10.263 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:08.674+0000 7f075a0f0640 1 -- 172.21.15.99:0/1699102644 wait complete. 2024-09-19T06:32:10.263 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:08.675+0000 7f075a0f0640 1 Processor -- start 2024-09-19T06:32:10.263 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:08.675+0000 7f075a0f0640 1 -- start start 2024-09-19T06:32:10.263 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:08.675+0000 7f075a0f0640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0754101f90 0x7f0754078c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:10.263 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:08.675+0000 7f075a0f0640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0754079140 con 0x7f0754101f90 2024-09-19T06:32:10.263 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:08.675+0000 7f07537fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0754101f90 0x7f0754078c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:10.263 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:08.675+0000 7f07537fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0754101f90 0x7f0754078c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52918/0 (socket says 172.21.15.99:52918) 2024-09-19T06:32:10.263 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:08.675+0000 7f07537fe640 1 -- 172.21.15.99:0/2135075026 learned_addr learned my addr 172.21.15.99:0/2135075026 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:32:10.264 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:08.675+0000 7f07537fe640 1 -- 172.21.15.99:0/2135075026 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0744009450 con 0x7f0754101f90 2024-09-19T06:32:10.264 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:08.676+0000 7f07537fe640 1 --2- 172.21.15.99:0/2135075026 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0754101f90 0x7f0754078c00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0744006a70 tx=0x7f07440091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:32:10.264 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:08.676+0000 7f073bfff640 1 -- 172.21.15.99:0/2135075026 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f074403c400 con 0x7f0754101f90 2024-09-19T06:32:10.264 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:08.676+0000 7f073bfff640 1 -- 172.21.15.99:0/2135075026 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f074403ca00 con 0x7f0754101f90 2024-09-19T06:32:10.264 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:08.676+0000 7f075a0f0640 1 -- 172.21.15.99:0/2135075026 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07540771d0 con 0x7f0754101f90 2024-09-19T06:32:10.264 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:08.676+0000 7f073bfff640 1 -- 172.21.15.99:0/2135075026 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f074403a9a0 con 0x7f0754101f90 2024-09-19T06:32:10.264 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:08.676+0000 7f075a0f0640 1 -- 172.21.15.99:0/2135075026 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0754077640 con 0x7f0754101f90 2024-09-19T06:32:10.264 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:08.677+0000 7f073bfff640 1 -- 172.21.15.99:0/2135075026 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 12) v1 ==== 45520+0+0 (secure 0 0 0) 0x7f074403ac20 con 0x7f0754101f90 2024-09-19T06:32:10.264 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:08.677+0000 7f075a0f0640 1 -- 172.21.15.99:0/2135075026 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0754103db0 con 0x7f0754101f90 2024-09-19T06:32:10.264 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:08.677+0000 7f073bfff640 1 --2- 172.21.15.99:0/2135075026 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f073c0394e0 0x7f073c03b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:10.264 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:08.677+0000 7f0752ffd640 1 --2- 172.21.15.99:0/2135075026 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f073c0394e0 0x7f073c03b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:10.264 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:08.677+0000 7f073bfff640 1 -- 172.21.15.99:0/2135075026 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f074406cf90 con 0x7f0754101f90 2024-09-19T06:32:10.265 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:08.678+0000 7f0752ffd640 1 --2- 172.21.15.99:0/2135075026 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f073c0394e0 0x7f073c03b990 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0748006fd0 tx=0x7f0748006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:32:10.265 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:08.682+0000 7f073bfff640 1 -- 172.21.15.99:0/2135075026 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f074409f2a0 con 0x7f0754101f90 2024-09-19T06:32:10.265 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:08.853+0000 7f075a0f0640 1 -- 172.21.15.99:0/2135075026 --> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f075405eb60 con 0x7f073c0394e0 2024-09-19T06:32:10.265 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:09.077+0000 7f073bfff640 1 -- 172.21.15.99:0/2135075026 <== mgr.14160 v2:172.21.15.99:6800/2333024932 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f075405eb60 con 0x7f073c0394e0 2024-09-19T06:32:10.265 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:09.079+0000 7f075a0f0640 1 -- 172.21.15.99:0/2135075026 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f073c0394e0 msgr2=0x7f073c03b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:10.265 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:09.079+0000 7f075a0f0640 1 --2- 172.21.15.99:0/2135075026 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f073c0394e0 0x7f073c03b990 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0748006fd0 tx=0x7f0748006db0 comp rx=0 tx=0).stop 2024-09-19T06:32:10.265 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:09.079+0000 7f075a0f0640 1 -- 172.21.15.99:0/2135075026 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0754101f90 msgr2=0x7f0754078c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:10.265 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:09.079+0000 7f075a0f0640 1 --2- 172.21.15.99:0/2135075026 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0754101f90 0x7f0754078c00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0744006a70 tx=0x7f07440091d0 comp rx=0 tx=0).stop 2024-09-19T06:32:10.265 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:09.079+0000 7f075a0f0640 1 -- 172.21.15.99:0/2135075026 shutdown_connections 2024-09-19T06:32:10.265 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:09.079+0000 7f075a0f0640 1 --2- 172.21.15.99:0/2135075026 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f073c0394e0 0x7f073c03b990 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:10.265 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:09.079+0000 7f075a0f0640 1 --2- 172.21.15.99:0/2135075026 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0754101f90 0x7f0754078c00 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:10.265 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:09.079+0000 7f075a0f0640 1 -- 172.21.15.99:0/2135075026 >> 172.21.15.99:0/2135075026 conn(0x7f07540fd730 msgr2=0x7f07540fe2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:32:10.265 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:09.080+0000 7f075a0f0640 1 -- 172.21.15.99:0/2135075026 shutdown_connections 2024-09-19T06:32:10.265 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:09.080+0000 7f075a0f0640 1 -- 172.21.15.99:0/2135075026 wait complete. 2024-09-19T06:32:10.266 INFO:teuthology.orchestra.run.smithi099.stdout:Fetching dashboard port number... 2024-09-19T06:32:11.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:10 smithi099 ceph-mon[27651]: from='client.? 172.21.15.99:0/1934558962' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-19T06:32:11.510 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stdout 8443 2024-09-19T06:32:11.510 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:10.713+0000 7fbe02045640 1 Processor -- start 2024-09-19T06:32:11.510 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:10.713+0000 7fbe02045640 1 -- start start 2024-09-19T06:32:11.510 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:10.713+0000 7fbe02045640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbdfc100300 0x7fbdfc100710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:11.510 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:10.713+0000 7fbe02045640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdfc100c50 con 0x7fbdfc100300 2024-09-19T06:32:11.511 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:10.713+0000 7fbdfb7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbdfc100300 0x7fbdfc100710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:11.511 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:10.713+0000 7fbdfb7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbdfc100300 0x7fbdfc100710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52932/0 (socket says 172.21.15.99:52932) 2024-09-19T06:32:11.511 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:10.713+0000 7fbdfb7fe640 1 -- 172.21.15.99:0/2202623025 learned_addr learned my addr 172.21.15.99:0/2202623025 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:32:11.511 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:10.713+0000 7fbdfb7fe640 1 -- 172.21.15.99:0/2202623025 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdfc100d90 con 0x7fbdfc100300 2024-09-19T06:32:11.511 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:10.714+0000 7fbdfb7fe640 1 --2- 172.21.15.99:0/2202623025 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbdfc100300 0x7fbdfc100710 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbdec009840 tx=0x7fbdec0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a71101977ebdb4da server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:32:11.511 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:10.714+0000 7fbdfa7fc640 1 -- 172.21.15.99:0/2202623025 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbdec032440 con 0x7fbdfc100300 2024-09-19T06:32:11.511 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:10.714+0000 7fbdfa7fc640 1 -- 172.21.15.99:0/2202623025 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fbdec032a40 con 0x7fbdfc100300 2024-09-19T06:32:11.511 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:10.714+0000 7fbdfa7fc640 1 -- 172.21.15.99:0/2202623025 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbdec031a70 con 0x7fbdfc100300 2024-09-19T06:32:11.511 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:10.715+0000 7fbe02045640 1 -- 172.21.15.99:0/2202623025 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbdfc100300 msgr2=0x7fbdfc100710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:11.511 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:10.715+0000 7fbe02045640 1 --2- 172.21.15.99:0/2202623025 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbdfc100300 0x7fbdfc100710 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbdec009840 tx=0x7fbdec0091d0 comp rx=0 tx=0).stop 2024-09-19T06:32:11.511 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:10.715+0000 7fbe02045640 1 -- 172.21.15.99:0/2202623025 shutdown_connections 2024-09-19T06:32:11.511 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:10.715+0000 7fbe02045640 1 --2- 172.21.15.99:0/2202623025 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbdfc100300 0x7fbdfc100710 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:11.512 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:10.715+0000 7fbe02045640 1 -- 172.21.15.99:0/2202623025 >> 172.21.15.99:0/2202623025 conn(0x7fbdfc0fbdc0 msgr2=0x7fbdfc0fe1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:32:11.512 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:10.715+0000 7fbe02045640 1 -- 172.21.15.99:0/2202623025 shutdown_connections 2024-09-19T06:32:11.512 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:10.715+0000 7fbe02045640 1 -- 172.21.15.99:0/2202623025 wait complete. 2024-09-19T06:32:11.512 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:10.716+0000 7fbe02045640 1 Processor -- start 2024-09-19T06:32:11.512 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:10.716+0000 7fbe02045640 1 -- start start 2024-09-19T06:32:11.512 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:10.716+0000 7fbe02045640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbdfc100300 0x7fbdfc110e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:11.512 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:10.716+0000 7fbe02045640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdfc111360 con 0x7fbdfc100300 2024-09-19T06:32:11.512 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:10.716+0000 7fbdfb7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbdfc100300 0x7fbdfc110e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:11.512 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:10.716+0000 7fbdfb7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbdfc100300 0x7fbdfc110e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52934/0 (socket says 172.21.15.99:52934) 2024-09-19T06:32:11.512 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:10.716+0000 7fbdfb7fe640 1 -- 172.21.15.99:0/1934558962 learned_addr learned my addr 172.21.15.99:0/1934558962 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:32:11.512 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:10.716+0000 7fbdfb7fe640 1 -- 172.21.15.99:0/1934558962 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdec009450 con 0x7fbdfc100300 2024-09-19T06:32:11.512 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:10.716+0000 7fbdfb7fe640 1 --2- 172.21.15.99:0/1934558962 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbdfc100300 0x7fbdfc110e20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbdec009810 tx=0x7fbdec0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:32:11.513 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:10.717+0000 7fbde3fff640 1 -- 172.21.15.99:0/1934558962 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbdec03c400 con 0x7fbdfc100300 2024-09-19T06:32:11.513 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:10.717+0000 7fbde3fff640 1 -- 172.21.15.99:0/1934558962 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fbdec03ca00 con 0x7fbdfc100300 2024-09-19T06:32:11.513 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:10.717+0000 7fbe02045640 1 -- 172.21.15.99:0/1934558962 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdfc111560 con 0x7fbdfc100300 2024-09-19T06:32:11.513 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:10.717+0000 7fbde3fff640 1 -- 172.21.15.99:0/1934558962 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbdec03a870 con 0x7fbdfc100300 2024-09-19T06:32:11.513 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:10.717+0000 7fbe02045640 1 -- 172.21.15.99:0/1934558962 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdfc111fb0 con 0x7fbdfc100300 2024-09-19T06:32:11.513 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:10.717+0000 7fbde3fff640 1 -- 172.21.15.99:0/1934558962 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 12) v1 ==== 45520+0+0 (secure 0 0 0) 0x7fbdec03aae0 con 0x7fbdfc100300 2024-09-19T06:32:11.513 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:10.718+0000 7fbde3fff640 1 --2- 172.21.15.99:0/1934558962 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7fbde4039530 0x7fbde403b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:11.513 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:10.718+0000 7fbde3fff640 1 -- 172.21.15.99:0/1934558962 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fbdec03cb70 con 0x7fbdfc100300 2024-09-19T06:32:11.513 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:10.718+0000 7fbdfaffd640 1 --2- 172.21.15.99:0/1934558962 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7fbde4039530 0x7fbde403b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:11.513 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:10.718+0000 7fbe02045640 1 -- 172.21.15.99:0/1934558962 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdfc0ffa60 con 0x7fbdfc100300 2024-09-19T06:32:11.514 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:10.718+0000 7fbdfaffd640 1 --2- 172.21.15.99:0/1934558962 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7fbde4039530 0x7fbde403b9e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fbdf0006fd0 tx=0x7fbdf0006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:32:11.514 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:10.722+0000 7fbde3fff640 1 -- 172.21.15.99:0/1934558962 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fbdec037030 con 0x7fbdfc100300 2024-09-19T06:32:11.514 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:10.881+0000 7fbe02045640 1 -- 172.21.15.99:0/1934558962 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7fbdfc04b720 con 0x7fbdfc100300 2024-09-19T06:32:11.514 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:10.882+0000 7fbde3fff640 1 -- 172.21.15.99:0/1934558962 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7fbdec037020 con 0x7fbdfc100300 2024-09-19T06:32:11.514 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:10.884+0000 7fbe02045640 1 -- 172.21.15.99:0/1934558962 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7fbde4039530 msgr2=0x7fbde403b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:11.514 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:10.884+0000 7fbe02045640 1 --2- 172.21.15.99:0/1934558962 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7fbde4039530 0x7fbde403b9e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fbdf0006fd0 tx=0x7fbdf0006db0 comp rx=0 tx=0).stop 2024-09-19T06:32:11.514 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:10.884+0000 7fbe02045640 1 -- 172.21.15.99:0/1934558962 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbdfc100300 msgr2=0x7fbdfc110e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:11.514 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:10.884+0000 7fbe02045640 1 --2- 172.21.15.99:0/1934558962 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbdfc100300 0x7fbdfc110e20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbdec009810 tx=0x7fbdec0091d0 comp rx=0 tx=0).stop 2024-09-19T06:32:11.514 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:10.884+0000 7fbe02045640 1 -- 172.21.15.99:0/1934558962 shutdown_connections 2024-09-19T06:32:11.514 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:10.884+0000 7fbe02045640 1 --2- 172.21.15.99:0/1934558962 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7fbde4039530 0x7fbde403b9e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:11.514 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:10.884+0000 7fbe02045640 1 --2- 172.21.15.99:0/1934558962 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbdfc100300 0x7fbdfc110e20 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:11.514 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:10.884+0000 7fbe02045640 1 -- 172.21.15.99:0/1934558962 >> 172.21.15.99:0/1934558962 conn(0x7fbdfc0fbdc0 msgr2=0x7fbdfc0fca00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:32:11.515 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:10.884+0000 7fbe02045640 1 -- 172.21.15.99:0/1934558962 shutdown_connections 2024-09-19T06:32:11.515 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:10.884+0000 7fbe02045640 1 -- 172.21.15.99:0/1934558962 wait complete. 2024-09-19T06:32:11.517 INFO:teuthology.orchestra.run.smithi099.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T06:32:11.517 INFO:teuthology.orchestra.run.smithi099.stdout:systemctl: stdout disabled 2024-09-19T06:32:11.525 INFO:teuthology.orchestra.run.smithi099.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T06:32:11.525 INFO:teuthology.orchestra.run.smithi099.stdout:systemctl: stdout inactive 2024-09-19T06:32:11.525 INFO:teuthology.orchestra.run.smithi099.stdout:firewalld.service is not enabled 2024-09-19T06:32:11.525 INFO:teuthology.orchestra.run.smithi099.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-19T06:32:11.527 INFO:teuthology.orchestra.run.smithi099.stdout:Ceph Dashboard is now available at: 2024-09-19T06:32:11.527 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:32:11.527 INFO:teuthology.orchestra.run.smithi099.stdout: URL: https://smithi099.front.sepia.ceph.com:8443/ 2024-09-19T06:32:11.527 INFO:teuthology.orchestra.run.smithi099.stdout: User: admin 2024-09-19T06:32:11.527 INFO:teuthology.orchestra.run.smithi099.stdout: Password: qiptb762vg 2024-09-19T06:32:11.527 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:32:11.528 INFO:teuthology.orchestra.run.smithi099.stdout:Saving cluster configuration to /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/config directory 2024-09-19T06:32:11.528 INFO:teuthology.orchestra.run.smithi099.stdout:Enabling autotune for osd_memory_target 2024-09-19T06:32:12.841 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:12.064+0000 7f016d8e2640 1 Processor -- start 2024-09-19T06:32:12.842 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:12.064+0000 7f016d8e2640 1 -- start start 2024-09-19T06:32:12.842 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:12.064+0000 7f016d8e2640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0168076bc0 0x7f0168104b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:12.842 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:12.064+0000 7f016d8e2640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01681050d0 con 0x7f0168076bc0 2024-09-19T06:32:12.842 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:12.064+0000 7f0166ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0168076bc0 0x7f0168104b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:12.842 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:12.064+0000 7f0166ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0168076bc0 0x7f0168104b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52950/0 (socket says 172.21.15.99:52950) 2024-09-19T06:32:12.842 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:12.064+0000 7f0166ffd640 1 -- 172.21.15.99:0/1773620931 learned_addr learned my addr 172.21.15.99:0/1773620931 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:32:12.842 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:12.064+0000 7f0166ffd640 1 -- 172.21.15.99:0/1773620931 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0168105210 con 0x7f0168076bc0 2024-09-19T06:32:12.842 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:12.065+0000 7f0166ffd640 1 --2- 172.21.15.99:0/1773620931 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0168076bc0 0x7f0168104b90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0158009840 tx=0x7f01580091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb10d83b9188b6f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:32:12.842 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:12.065+0000 7f0165ffb640 1 -- 172.21.15.99:0/1773620931 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0158032440 con 0x7f0168076bc0 2024-09-19T06:32:12.842 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:12.065+0000 7f0165ffb640 1 -- 172.21.15.99:0/1773620931 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0158032a40 con 0x7f0168076bc0 2024-09-19T06:32:12.842 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:12.065+0000 7f0165ffb640 1 -- 172.21.15.99:0/1773620931 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0158031a70 con 0x7f0168076bc0 2024-09-19T06:32:12.843 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:12.066+0000 7f016d8e2640 1 -- 172.21.15.99:0/1773620931 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0168076bc0 msgr2=0x7f0168104b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:12.843 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:12.066+0000 7f016d8e2640 1 --2- 172.21.15.99:0/1773620931 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0168076bc0 0x7f0168104b90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0158009840 tx=0x7f01580091d0 comp rx=0 tx=0).stop 2024-09-19T06:32:12.843 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:12.066+0000 7f016d8e2640 1 -- 172.21.15.99:0/1773620931 shutdown_connections 2024-09-19T06:32:12.843 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:12.066+0000 7f016d8e2640 1 --2- 172.21.15.99:0/1773620931 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0168076bc0 0x7f0168104b90 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:12.843 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:12.066+0000 7f016d8e2640 1 -- 172.21.15.99:0/1773620931 >> 172.21.15.99:0/1773620931 conn(0x7f01680fc5c0 msgr2=0x7f01680fe9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:32:12.843 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:12.066+0000 7f016d8e2640 1 -- 172.21.15.99:0/1773620931 shutdown_connections 2024-09-19T06:32:12.843 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:12.066+0000 7f016d8e2640 1 -- 172.21.15.99:0/1773620931 wait complete. 2024-09-19T06:32:12.843 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:12.066+0000 7f016d8e2640 1 Processor -- start 2024-09-19T06:32:12.843 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:12.066+0000 7f016d8e2640 1 -- start start 2024-09-19T06:32:12.843 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:12.067+0000 7f016d8e2640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0168076bc0 0x7f0168110e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:12.843 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:12.067+0000 7f016d8e2640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0168111370 con 0x7f0168076bc0 2024-09-19T06:32:12.843 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:12.067+0000 7f0166ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0168076bc0 0x7f0168110e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:12.843 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:12.067+0000 7f0166ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0168076bc0 0x7f0168110e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52966/0 (socket says 172.21.15.99:52966) 2024-09-19T06:32:12.844 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:12.067+0000 7f0166ffd640 1 -- 172.21.15.99:0/1569536836 learned_addr learned my addr 172.21.15.99:0/1569536836 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:32:12.844 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:12.067+0000 7f0166ffd640 1 -- 172.21.15.99:0/1569536836 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0158009450 con 0x7f0168076bc0 2024-09-19T06:32:12.844 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:12.067+0000 7f0166ffd640 1 --2- 172.21.15.99:0/1569536836 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0168076bc0 0x7f0168110e30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0158031750 tx=0x7f01580091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:32:12.844 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:12.067+0000 7f014f7fe640 1 -- 172.21.15.99:0/1569536836 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f015803c400 con 0x7f0168076bc0 2024-09-19T06:32:12.844 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:12.067+0000 7f014f7fe640 1 -- 172.21.15.99:0/1569536836 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f015803ca00 con 0x7f0168076bc0 2024-09-19T06:32:12.844 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:12.067+0000 7f014f7fe640 1 -- 172.21.15.99:0/1569536836 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f015803a880 con 0x7f0168076bc0 2024-09-19T06:32:12.844 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:12.067+0000 7f016d8e2640 1 -- 172.21.15.99:0/1569536836 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0168111570 con 0x7f0168076bc0 2024-09-19T06:32:12.844 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:12.067+0000 7f016d8e2640 1 -- 172.21.15.99:0/1569536836 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0168111fc0 con 0x7f0168076bc0 2024-09-19T06:32:12.844 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:12.068+0000 7f014f7fe640 1 -- 172.21.15.99:0/1569536836 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7f015803c560 con 0x7f0168076bc0 2024-09-19T06:32:12.844 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:12.068+0000 7f016d8e2640 1 -- 172.21.15.99:0/1569536836 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f016805ed70 con 0x7f0168076bc0 2024-09-19T06:32:12.844 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:12.068+0000 7f014f7fe640 1 --2- 172.21.15.99:0/1569536836 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f0150039580 0x7f015003ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:12.844 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:12.068+0000 7f014f7fe640 1 -- 172.21.15.99:0/1569536836 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f015806d120 con 0x7f0168076bc0 2024-09-19T06:32:12.846 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:12.068+0000 7f01667fc640 1 --2- 172.21.15.99:0/1569536836 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f0150039580 0x7f015003ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:12.846 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:12.069+0000 7f01667fc640 1 --2- 172.21.15.99:0/1569536836 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f0150039580 0x7f015003ba30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f015c006fd0 tx=0x7f015c006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:32:12.846 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:12.073+0000 7f014f7fe640 1 -- 172.21.15.99:0/1569536836 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f015803b540 con 0x7f0168076bc0 2024-09-19T06:32:12.846 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:12.229+0000 7f016d8e2640 1 -- 172.21.15.99:0/1569536836 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f016804b720 con 0x7f0168076bc0 2024-09-19T06:32:12.846 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:12.229+0000 7f014f7fe640 1 -- 172.21.15.99:0/1569536836 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f0158037030 con 0x7f0168076bc0 2024-09-19T06:32:12.846 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:12.231+0000 7f016d8e2640 1 -- 172.21.15.99:0/1569536836 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f0150039580 msgr2=0x7f015003ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:12.847 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:12.231+0000 7f016d8e2640 1 --2- 172.21.15.99:0/1569536836 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f0150039580 0x7f015003ba30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f015c006fd0 tx=0x7f015c006db0 comp rx=0 tx=0).stop 2024-09-19T06:32:12.847 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:12.231+0000 7f016d8e2640 1 -- 172.21.15.99:0/1569536836 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0168076bc0 msgr2=0x7f0168110e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:12.847 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:12.231+0000 7f016d8e2640 1 --2- 172.21.15.99:0/1569536836 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0168076bc0 0x7f0168110e30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0158031750 tx=0x7f01580091d0 comp rx=0 tx=0).stop 2024-09-19T06:32:12.847 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:12.231+0000 7f016d8e2640 1 -- 172.21.15.99:0/1569536836 shutdown_connections 2024-09-19T06:32:12.847 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:12.231+0000 7f016d8e2640 1 --2- 172.21.15.99:0/1569536836 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f0150039580 0x7f015003ba30 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:12.847 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:12.231+0000 7f016d8e2640 1 --2- 172.21.15.99:0/1569536836 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0168076bc0 0x7f0168110e30 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:12.847 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:12.231+0000 7f016d8e2640 1 -- 172.21.15.99:0/1569536836 >> 172.21.15.99:0/1569536836 conn(0x7f01680fc5c0 msgr2=0x7f01680fd1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:32:12.847 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:12.231+0000 7f016d8e2640 1 -- 172.21.15.99:0/1569536836 shutdown_connections 2024-09-19T06:32:12.847 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:12.231+0000 7f016d8e2640 1 -- 172.21.15.99:0/1569536836 wait complete. 2024-09-19T06:32:13.162 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:12 smithi099 ceph-mon[27651]: mgrmap e13: smithi099.pgvkqi(active, since 6s) 2024-09-19T06:32:14.083 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:13.237+0000 7f1d8f5fe640 1 Processor -- start 2024-09-19T06:32:14.083 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:13.237+0000 7f1d8f5fe640 1 -- start start 2024-09-19T06:32:14.083 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:13.237+0000 7f1d8f5fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d88100310 0x7f1d88100720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:14.083 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:13.237+0000 7f1d8f5fe640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d88100c60 con 0x7f1d88100310 2024-09-19T06:32:14.083 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:13.238+0000 7f1d8d39a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d88100310 0x7f1d88100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:14.083 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:13.238+0000 7f1d8d39a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d88100310 0x7f1d88100720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52974/0 (socket says 172.21.15.99:52974) 2024-09-19T06:32:14.084 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:13.238+0000 7f1d8d39a640 1 -- 172.21.15.99:0/3815322616 learned_addr learned my addr 172.21.15.99:0/3815322616 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:32:14.084 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:13.238+0000 7f1d8d39a640 1 -- 172.21.15.99:0/3815322616 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d88100da0 con 0x7f1d88100310 2024-09-19T06:32:14.084 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:13.238+0000 7f1d8d39a640 1 --2- 172.21.15.99:0/3815322616 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d88100310 0x7f1d88100720 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1d84009840 tx=0x7f1d840091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5043f6fffb36d3e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:32:14.084 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:13.239+0000 7f1d7ffff640 1 -- 172.21.15.99:0/3815322616 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1d84032440 con 0x7f1d88100310 2024-09-19T06:32:14.084 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:13.239+0000 7f1d7ffff640 1 -- 172.21.15.99:0/3815322616 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1d84032a40 con 0x7f1d88100310 2024-09-19T06:32:14.084 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:13.239+0000 7f1d7ffff640 1 -- 172.21.15.99:0/3815322616 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1d84031a70 con 0x7f1d88100310 2024-09-19T06:32:14.085 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:13.239+0000 7f1d8f5fe640 1 -- 172.21.15.99:0/3815322616 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d88100310 msgr2=0x7f1d88100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:14.085 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:13.239+0000 7f1d8f5fe640 1 --2- 172.21.15.99:0/3815322616 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d88100310 0x7f1d88100720 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1d84009840 tx=0x7f1d840091d0 comp rx=0 tx=0).stop 2024-09-19T06:32:14.085 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:13.239+0000 7f1d8f5fe640 1 -- 172.21.15.99:0/3815322616 shutdown_connections 2024-09-19T06:32:14.085 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:13.239+0000 7f1d8f5fe640 1 --2- 172.21.15.99:0/3815322616 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d88100310 0x7f1d88100720 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:14.085 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:13.239+0000 7f1d8f5fe640 1 -- 172.21.15.99:0/3815322616 >> 172.21.15.99:0/3815322616 conn(0x7f1d880fbdd0 msgr2=0x7f1d880fe200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:32:14.085 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:13.239+0000 7f1d8f5fe640 1 -- 172.21.15.99:0/3815322616 shutdown_connections 2024-09-19T06:32:14.085 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:13.239+0000 7f1d8f5fe640 1 -- 172.21.15.99:0/3815322616 wait complete. 2024-09-19T06:32:14.085 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:13.240+0000 7f1d8f5fe640 1 Processor -- start 2024-09-19T06:32:14.085 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:13.240+0000 7f1d8f5fe640 1 -- start start 2024-09-19T06:32:14.085 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:13.240+0000 7f1d8f5fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d88100310 0x7f1d88110e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:14.086 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:13.240+0000 7f1d8f5fe640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d88111370 con 0x7f1d88100310 2024-09-19T06:32:14.086 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:13.240+0000 7f1d8d39a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d88100310 0x7f1d88110e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:14.086 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:13.240+0000 7f1d8d39a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d88100310 0x7f1d88110e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52990/0 (socket says 172.21.15.99:52990) 2024-09-19T06:32:14.086 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:13.240+0000 7f1d8d39a640 1 -- 172.21.15.99:0/4127252106 learned_addr learned my addr 172.21.15.99:0/4127252106 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:32:14.086 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:13.240+0000 7f1d8d39a640 1 -- 172.21.15.99:0/4127252106 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d84009450 con 0x7f1d88100310 2024-09-19T06:32:14.087 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:13.240+0000 7f1d8d39a640 1 --2- 172.21.15.99:0/4127252106 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d88100310 0x7f1d88110e30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1d84009810 tx=0x7f1d840091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:32:14.087 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:13.241+0000 7f1d7dffb640 1 -- 172.21.15.99:0/4127252106 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1d8403c400 con 0x7f1d88100310 2024-09-19T06:32:14.087 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:13.241+0000 7f1d8f5fe640 1 -- 172.21.15.99:0/4127252106 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d88111570 con 0x7f1d88100310 2024-09-19T06:32:14.087 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:13.241+0000 7f1d7dffb640 1 -- 172.21.15.99:0/4127252106 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1d8403ca00 con 0x7f1d88100310 2024-09-19T06:32:14.087 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:13.241+0000 7f1d7dffb640 1 -- 172.21.15.99:0/4127252106 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1d8403a870 con 0x7f1d88100310 2024-09-19T06:32:14.087 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:13.241+0000 7f1d8f5fe640 1 -- 172.21.15.99:0/4127252106 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d88111fc0 con 0x7f1d88100310 2024-09-19T06:32:14.087 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:13.242+0000 7f1d7dffb640 1 -- 172.21.15.99:0/4127252106 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7f1d8403c560 con 0x7f1d88100310 2024-09-19T06:32:14.087 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:13.242+0000 7f1d8f5fe640 1 -- 172.21.15.99:0/4127252106 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d880ffa70 con 0x7f1d88100310 2024-09-19T06:32:14.087 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:13.242+0000 7f1d7dffb640 1 --2- 172.21.15.99:0/4127252106 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f1d74039580 0x7f1d7403ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:14.087 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:13.242+0000 7f1d7dffb640 1 -- 172.21.15.99:0/4127252106 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f1d8406d070 con 0x7f1d88100310 2024-09-19T06:32:14.087 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:13.242+0000 7f1d8cb99640 1 --2- 172.21.15.99:0/4127252106 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f1d74039580 0x7f1d7403ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:14.088 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:13.242+0000 7f1d8cb99640 1 --2- 172.21.15.99:0/4127252106 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f1d74039580 0x7f1d7403ba30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1d78006fd0 tx=0x7f1d78006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:32:14.088 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:13.246+0000 7f1d7dffb640 1 -- 172.21.15.99:0/4127252106 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f1d8403b360 con 0x7f1d88100310 2024-09-19T06:32:14.088 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:13.485+0000 7f1d8f5fe640 1 -- 172.21.15.99:0/4127252106 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f1d88105f50 con 0x7f1d88100310 2024-09-19T06:32:14.089 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:13.487+0000 7f1d7dffb640 1 -- 172.21.15.99:0/4127252106 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v33)=0 set mgr/dashboard/cluster/status v33) v1 ==== 153+0+0 (secure 0 0 0) 0x7f1d84037020 con 0x7f1d88100310 2024-09-19T06:32:14.089 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-19T06:32:14.089 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:13.489+0000 7f1d8f5fe640 1 -- 172.21.15.99:0/4127252106 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f1d74039580 msgr2=0x7f1d7403ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:14.089 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:13.489+0000 7f1d8f5fe640 1 --2- 172.21.15.99:0/4127252106 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f1d74039580 0x7f1d7403ba30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1d78006fd0 tx=0x7f1d78006db0 comp rx=0 tx=0).stop 2024-09-19T06:32:14.089 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:13.489+0000 7f1d8f5fe640 1 -- 172.21.15.99:0/4127252106 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d88100310 msgr2=0x7f1d88110e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:14.089 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:13.489+0000 7f1d8f5fe640 1 --2- 172.21.15.99:0/4127252106 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d88100310 0x7f1d88110e30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1d84009810 tx=0x7f1d840091d0 comp rx=0 tx=0).stop 2024-09-19T06:32:14.090 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:13.489+0000 7f1d8f5fe640 1 -- 172.21.15.99:0/4127252106 shutdown_connections 2024-09-19T06:32:14.090 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:13.489+0000 7f1d8f5fe640 1 --2- 172.21.15.99:0/4127252106 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f1d74039580 0x7f1d7403ba30 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:14.090 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:13.489+0000 7f1d8f5fe640 1 --2- 172.21.15.99:0/4127252106 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1d88100310 0x7f1d88110e30 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:14.090 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:13.489+0000 7f1d8f5fe640 1 -- 172.21.15.99:0/4127252106 >> 172.21.15.99:0/4127252106 conn(0x7f1d880fbdd0 msgr2=0x7f1d880fc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:32:14.090 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:13.489+0000 7f1d8f5fe640 1 -- 172.21.15.99:0/4127252106 shutdown_connections 2024-09-19T06:32:14.091 INFO:teuthology.orchestra.run.smithi099.stdout:/usr/bin/ceph: stderr 2024-09-19T06:32:13.489+0000 7f1d8f5fe640 1 -- 172.21.15.99:0/4127252106 wait complete. 2024-09-19T06:32:14.091 INFO:teuthology.orchestra.run.smithi099.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-19T06:32:14.091 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:32:14.091 INFO:teuthology.orchestra.run.smithi099.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid a73eb958-7650-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-19T06:32:14.091 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:32:14.091 INFO:teuthology.orchestra.run.smithi099.stdout:Or, if you are only running a single cluster on this host: 2024-09-19T06:32:14.091 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:32:14.091 INFO:teuthology.orchestra.run.smithi099.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-19T06:32:14.091 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:32:14.092 INFO:teuthology.orchestra.run.smithi099.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-19T06:32:14.092 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:32:14.092 INFO:teuthology.orchestra.run.smithi099.stdout: ceph telemetry on 2024-09-19T06:32:14.092 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:32:14.092 INFO:teuthology.orchestra.run.smithi099.stdout:For more information see: 2024-09-19T06:32:14.092 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:32:14.092 INFO:teuthology.orchestra.run.smithi099.stdout: https://docs.ceph.com/docs/master/mgr/telemetry/ 2024-09-19T06:32:14.092 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:32:14.092 INFO:teuthology.orchestra.run.smithi099.stdout:Bootstrap complete. 2024-09-19T06:32:14.117 INFO:tasks.cephadm:Fetching config... 2024-09-19T06:32:14.117 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-19T06:32:14.117 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-19T06:32:14.134 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-19T06:32:14.134 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-19T06:32:14.134 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-19T06:32:14.190 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-19T06:32:14.190 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-19T06:32:14.190 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/keyring of=/dev/stdout 2024-09-19T06:32:14.255 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-19T06:32:14.255 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-19T06:32:14.255 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-19T06:32:14.311 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-19T06:32:14.311 DEBUG:teuthology.orchestra.run.smithi099:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDoz+Xxpolp74zpvGAPw4w23RjyA7B2Y9DUvzRtPXNZF1UbnzCysYYZEZZ/NDyJv/6H7nO2PdftFX0yzaOx1mRJ0ocIguGFHJgQx6oR4OWObGNqayXA68KykbnhmB941dgQAG5v4sAYIwHLoIsWJa8eOrrHW82NNfEnoUvn+rZ7vPsW0AYhcDrF7vO9iqbgcTQ1kpns/Z2KAGABaIjQJ/ENn6ylO1EVlErx95lgCioDaeCdse0rE74WnUsqAb5ctje1IeEPa/JbFO2yTRvHoXX8aNu6UjS1vVNqb/mWawyjvSN8Z9Tjjl9c2Hxlo1FI9bs0MYtSdpFGiSClU8KJYpDxgzWXcw4fBTMzh6HLLINfb7JhzUMryJFz6iikgeUDo5jANloW+Lcmx6whxy6Xk/ZtrQGGkG4gaMvs+9fuMfMt62qdRwuY0TZ2sBH0GdMfBelIWl6ckN5xX5rYw9WqIQNvvAbm7jgKmtFnRJrBZpQ2LBFO64M+dOBE6azrhTumK0k= ceph-a73eb958-7650-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T06:32:14.385 INFO:teuthology.orchestra.run.smithi099.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDoz+Xxpolp74zpvGAPw4w23RjyA7B2Y9DUvzRtPXNZF1UbnzCysYYZEZZ/NDyJv/6H7nO2PdftFX0yzaOx1mRJ0ocIguGFHJgQx6oR4OWObGNqayXA68KykbnhmB941dgQAG5v4sAYIwHLoIsWJa8eOrrHW82NNfEnoUvn+rZ7vPsW0AYhcDrF7vO9iqbgcTQ1kpns/Z2KAGABaIjQJ/ENn6ylO1EVlErx95lgCioDaeCdse0rE74WnUsqAb5ctje1IeEPa/JbFO2yTRvHoXX8aNu6UjS1vVNqb/mWawyjvSN8Z9Tjjl9c2Hxlo1FI9bs0MYtSdpFGiSClU8KJYpDxgzWXcw4fBTMzh6HLLINfb7JhzUMryJFz6iikgeUDo5jANloW+Lcmx6whxy6Xk/ZtrQGGkG4gaMvs+9fuMfMt62qdRwuY0TZ2sBH0GdMfBelIWl6ckN5xX5rYw9WqIQNvvAbm7jgKmtFnRJrBZpQ2LBFO64M+dOBE6azrhTumK0k= ceph-a73eb958-7650-11ef-bceb-c7b262605968 2024-09-19T06:32:14.397 DEBUG:teuthology.orchestra.run.smithi117:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDoz+Xxpolp74zpvGAPw4w23RjyA7B2Y9DUvzRtPXNZF1UbnzCysYYZEZZ/NDyJv/6H7nO2PdftFX0yzaOx1mRJ0ocIguGFHJgQx6oR4OWObGNqayXA68KykbnhmB941dgQAG5v4sAYIwHLoIsWJa8eOrrHW82NNfEnoUvn+rZ7vPsW0AYhcDrF7vO9iqbgcTQ1kpns/Z2KAGABaIjQJ/ENn6ylO1EVlErx95lgCioDaeCdse0rE74WnUsqAb5ctje1IeEPa/JbFO2yTRvHoXX8aNu6UjS1vVNqb/mWawyjvSN8Z9Tjjl9c2Hxlo1FI9bs0MYtSdpFGiSClU8KJYpDxgzWXcw4fBTMzh6HLLINfb7JhzUMryJFz6iikgeUDo5jANloW+Lcmx6whxy6Xk/ZtrQGGkG4gaMvs+9fuMfMt62qdRwuY0TZ2sBH0GdMfBelIWl6ckN5xX5rYw9WqIQNvvAbm7jgKmtFnRJrBZpQ2LBFO64M+dOBE6azrhTumK0k= ceph-a73eb958-7650-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T06:32:14.453 INFO:teuthology.orchestra.run.smithi117.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDoz+Xxpolp74zpvGAPw4w23RjyA7B2Y9DUvzRtPXNZF1UbnzCysYYZEZZ/NDyJv/6H7nO2PdftFX0yzaOx1mRJ0ocIguGFHJgQx6oR4OWObGNqayXA68KykbnhmB941dgQAG5v4sAYIwHLoIsWJa8eOrrHW82NNfEnoUvn+rZ7vPsW0AYhcDrF7vO9iqbgcTQ1kpns/Z2KAGABaIjQJ/ENn6ylO1EVlErx95lgCioDaeCdse0rE74WnUsqAb5ctje1IeEPa/JbFO2yTRvHoXX8aNu6UjS1vVNqb/mWawyjvSN8Z9Tjjl9c2Hxlo1FI9bs0MYtSdpFGiSClU8KJYpDxgzWXcw4fBTMzh6HLLINfb7JhzUMryJFz6iikgeUDo5jANloW+Lcmx6whxy6Xk/ZtrQGGkG4gaMvs+9fuMfMt62qdRwuY0TZ2sBH0GdMfBelIWl6ckN5xX5rYw9WqIQNvvAbm7jgKmtFnRJrBZpQ2LBFO64M+dOBE6azrhTumK0k= ceph-a73eb958-7650-11ef-bceb-c7b262605968 2024-09-19T06:32:14.466 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-19T06:32:14.637 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:14 smithi099 ceph-mon[27651]: from='client.? 172.21.15.99:0/4127252106' entity='client.admin' 2024-09-19T06:32:14.709 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T06:32:17.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:17.358+0000 7f9b2ae18640 1 -- 172.21.15.99:0/1495464151 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b240fd8e0 msgr2=0x7f9b240fdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:17.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:17.358+0000 7f9b2ae18640 1 --2- 172.21.15.99:0/1495464151 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b240fd8e0 0x7f9b240fdcf0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9b18004850 tx=0x7f9b18009da0 comp rx=0 tx=0).stop 2024-09-19T06:32:17.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:17.358+0000 7f9b2ae18640 1 -- 172.21.15.99:0/1495464151 shutdown_connections 2024-09-19T06:32:17.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:17.358+0000 7f9b2ae18640 1 --2- 172.21.15.99:0/1495464151 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b240fd8e0 0x7f9b240fdcf0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:17.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:17.358+0000 7f9b2ae18640 1 -- 172.21.15.99:0/1495464151 >> 172.21.15.99:0/1495464151 conn(0x7f9b240f6040 msgr2=0x7f9b240f8450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:32:17.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:17.358+0000 7f9b2ae18640 1 -- 172.21.15.99:0/1495464151 shutdown_connections 2024-09-19T06:32:17.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:17.358+0000 7f9b2ae18640 1 -- 172.21.15.99:0/1495464151 wait complete. 2024-09-19T06:32:17.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:17.359+0000 7f9b2ae18640 1 Processor -- start 2024-09-19T06:32:17.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:17.359+0000 7f9b2ae18640 1 -- start start 2024-09-19T06:32:17.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:17.359+0000 7f9b2ae18640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b240fd8e0 0x7f9b2410c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:17.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:17.359+0000 7f9b2ae18640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b2410cc30 con 0x7f9b240fd8e0 2024-09-19T06:32:17.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:17.359+0000 7f9b28bb4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b240fd8e0 0x7f9b2410c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:17.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:17.359+0000 7f9b28bb4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b240fd8e0 0x7f9b2410c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:58828/0 (socket says 172.21.15.99:58828) 2024-09-19T06:32:17.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:17.359+0000 7f9b28bb4640 1 -- 172.21.15.99:0/2820498569 learned_addr learned my addr 172.21.15.99:0/2820498569 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:32:17.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:17.360+0000 7f9b28bb4640 1 -- 172.21.15.99:0/2820498569 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b18005040 con 0x7f9b240fd8e0 2024-09-19T06:32:17.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:17.360+0000 7f9b28bb4640 1 --2- 172.21.15.99:0/2820498569 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b240fd8e0 0x7f9b2410c6f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9b18009920 tx=0x7f9b18009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:32:17.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:17.360+0000 7f9b217fa640 1 -- 172.21.15.99:0/2820498569 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9b18033630 con 0x7f9b240fd8e0 2024-09-19T06:32:17.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:17.360+0000 7f9b2ae18640 1 -- 172.21.15.99:0/2820498569 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b2410ce30 con 0x7f9b240fd8e0 2024-09-19T06:32:17.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:17.360+0000 7f9b217fa640 1 -- 172.21.15.99:0/2820498569 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9b18033c30 con 0x7f9b240fd8e0 2024-09-19T06:32:17.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:17.360+0000 7f9b217fa640 1 -- 172.21.15.99:0/2820498569 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9b1803dc40 con 0x7f9b240fd8e0 2024-09-19T06:32:17.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:17.360+0000 7f9b2ae18640 1 -- 172.21.15.99:0/2820498569 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b2410d2a0 con 0x7f9b240fd8e0 2024-09-19T06:32:17.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:17.361+0000 7f9b217fa640 1 -- 172.21.15.99:0/2820498569 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7f9b18030020 con 0x7f9b240fd8e0 2024-09-19T06:32:17.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:17.361+0000 7f9b217fa640 1 --2- 172.21.15.99:0/2820498569 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f9b14039580 0x7f9b1403ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:17.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:17.361+0000 7f9b217fa640 1 -- 172.21.15.99:0/2820498569 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f9b1806d910 con 0x7f9b240fd8e0 2024-09-19T06:32:17.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:17.361+0000 7f9b2ae18640 1 -- 172.21.15.99:0/2820498569 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b24102610 con 0x7f9b240fd8e0 2024-09-19T06:32:17.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:17.361+0000 7f9b23fff640 1 --2- 172.21.15.99:0/2820498569 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f9b14039580 0x7f9b1403ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:17.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:17.362+0000 7f9b23fff640 1 --2- 172.21.15.99:0/2820498569 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f9b14039580 0x7f9b1403ba30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9b10006fd0 tx=0x7f9b10006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:32:17.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:17.366+0000 7f9b217fa640 1 -- 172.21.15.99:0/2820498569 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f9b1803bb50 con 0x7f9b240fd8e0 2024-09-19T06:32:17.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:17.545+0000 7f9b2ae18640 1 -- 172.21.15.99:0/2820498569 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f9b2405ed70 con 0x7f9b240fd8e0 2024-09-19T06:32:17.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:17.548+0000 7f9b217fa640 1 -- 172.21.15.99:0/2820498569 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f9b18042210 con 0x7f9b240fd8e0 2024-09-19T06:32:17.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:17.550+0000 7f9b2ae18640 1 -- 172.21.15.99:0/2820498569 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f9b14039580 msgr2=0x7f9b1403ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:17.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:17.550+0000 7f9b2ae18640 1 --2- 172.21.15.99:0/2820498569 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f9b14039580 0x7f9b1403ba30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9b10006fd0 tx=0x7f9b10006db0 comp rx=0 tx=0).stop 2024-09-19T06:32:17.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:17.550+0000 7f9b2ae18640 1 -- 172.21.15.99:0/2820498569 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b240fd8e0 msgr2=0x7f9b2410c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:17.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:17.550+0000 7f9b2ae18640 1 --2- 172.21.15.99:0/2820498569 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b240fd8e0 0x7f9b2410c6f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9b18009920 tx=0x7f9b18009da0 comp rx=0 tx=0).stop 2024-09-19T06:32:17.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:17.550+0000 7f9b2ae18640 1 -- 172.21.15.99:0/2820498569 shutdown_connections 2024-09-19T06:32:17.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:17.550+0000 7f9b2ae18640 1 --2- 172.21.15.99:0/2820498569 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f9b14039580 0x7f9b1403ba30 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:17.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:17.550+0000 7f9b2ae18640 1 --2- 172.21.15.99:0/2820498569 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b240fd8e0 0x7f9b2410c6f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:17.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:17.550+0000 7f9b2ae18640 1 -- 172.21.15.99:0/2820498569 >> 172.21.15.99:0/2820498569 conn(0x7f9b240f6040 msgr2=0x7f9b240f6850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:32:17.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:17.550+0000 7f9b2ae18640 1 -- 172.21.15.99:0/2820498569 shutdown_connections 2024-09-19T06:32:17.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:17.550+0000 7f9b2ae18640 1 -- 172.21.15.99:0/2820498569 wait complete. 2024-09-19T06:32:18.135 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-19T06:32:18.135 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-19T06:32:18.729 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:18 smithi099 ceph-mon[27651]: from='client.? 172.21.15.99:0/2820498569' entity='client.admin' 2024-09-19T06:32:18.812 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T06:32:19.953 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:19 smithi099 ceph-mon[27651]: from='mgr.14160 172.21.15.99:0/1563599924' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:32:19.953 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:19 smithi099 ceph-mon[27651]: from='mgr.14160 172.21.15.99:0/1563599924' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:32:19.953 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:19 smithi099 ceph-mon[27651]: from='mgr.14160 172.21.15.99:0/1563599924' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "who": "osd/host:smithi099", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:32:19.953 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:19 smithi099 ceph-mon[27651]: from='mgr.14160 172.21.15.99:0/1563599924' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:32:19.953 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:19 smithi099 ceph-mon[27651]: from='mgr.14160 172.21.15.99:0/1563599924' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi099", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-19T06:32:19.954 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:19 smithi099 ceph-mon[27651]: from='mgr.14160 172.21.15.99:0/1563599924' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi099", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-19T06:32:19.954 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:19 smithi099 ceph-mon[27651]: from='mgr.14160 172.21.15.99:0/1563599924' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:32:19.954 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:19 smithi099 ceph-mon[27651]: Deploying daemon crash.smithi099 on smithi099 2024-09-19T06:32:20.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:20.410+0000 7f968ee73640 1 -- 172.21.15.99:0/2597753846 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f96880fd820 msgr2=0x7f96880fdc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:20.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:20.410+0000 7f968ee73640 1 --2- 172.21.15.99:0/2597753846 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f96880fd820 0x7f96880fdc30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9678004850 tx=0x7f9678009da0 comp rx=0 tx=0).stop 2024-09-19T06:32:20.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:20.410+0000 7f968ee73640 1 -- 172.21.15.99:0/2597753846 shutdown_connections 2024-09-19T06:32:20.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:20.410+0000 7f968ee73640 1 --2- 172.21.15.99:0/2597753846 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f96880fd820 0x7f96880fdc30 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:20.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:20.410+0000 7f968ee73640 1 -- 172.21.15.99:0/2597753846 >> 172.21.15.99:0/2597753846 conn(0x7f96880f6040 msgr2=0x7f96880f8450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:32:20.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:20.410+0000 7f968ee73640 1 -- 172.21.15.99:0/2597753846 shutdown_connections 2024-09-19T06:32:20.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:20.410+0000 7f968ee73640 1 -- 172.21.15.99:0/2597753846 wait complete. 2024-09-19T06:32:20.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:20.411+0000 7f968ee73640 1 Processor -- start 2024-09-19T06:32:20.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:20.411+0000 7f968ee73640 1 -- start start 2024-09-19T06:32:20.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:20.411+0000 7f968ee73640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f96880fd820 0x7f968810c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:20.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:20.411+0000 7f968ee73640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f968810cc20 con 0x7f96880fd820 2024-09-19T06:32:20.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:20.411+0000 7f968cc0f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f96880fd820 0x7f968810c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:20.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:20.411+0000 7f968cc0f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f96880fd820 0x7f968810c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:58852/0 (socket says 172.21.15.99:58852) 2024-09-19T06:32:20.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:20.411+0000 7f968cc0f640 1 -- 172.21.15.99:0/1123994579 learned_addr learned my addr 172.21.15.99:0/1123994579 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:32:20.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:20.411+0000 7f968cc0f640 1 -- 172.21.15.99:0/1123994579 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9678005040 con 0x7f96880fd820 2024-09-19T06:32:20.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:20.412+0000 7f968cc0f640 1 --2- 172.21.15.99:0/1123994579 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f96880fd820 0x7f968810c6e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f967802a6d0 tx=0x7f9678009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:32:20.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:20.412+0000 7f96857fa640 1 -- 172.21.15.99:0/1123994579 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9678033630 con 0x7f96880fd820 2024-09-19T06:32:20.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:20.412+0000 7f96857fa640 1 -- 172.21.15.99:0/1123994579 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9678033c30 con 0x7f96880fd820 2024-09-19T06:32:20.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:20.412+0000 7f968ee73640 1 -- 172.21.15.99:0/1123994579 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f968810ce20 con 0x7f96880fd820 2024-09-19T06:32:20.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:20.412+0000 7f96857fa640 1 -- 172.21.15.99:0/1123994579 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f967803dc00 con 0x7f96880fd820 2024-09-19T06:32:20.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:20.412+0000 7f968ee73640 1 -- 172.21.15.99:0/1123994579 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f968810d290 con 0x7f96880fd820 2024-09-19T06:32:20.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:20.413+0000 7f96857fa640 1 -- 172.21.15.99:0/1123994579 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7f9678030020 con 0x7f96880fd820 2024-09-19T06:32:20.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:20.413+0000 7f968ee73640 1 -- 172.21.15.99:0/1123994579 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f968805ed70 con 0x7f96880fd820 2024-09-19T06:32:20.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:20.413+0000 7f96857fa640 1 --2- 172.21.15.99:0/1123994579 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f9674039580 0x7f967403ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:20.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:20.413+0000 7f96857fa640 1 -- 172.21.15.99:0/1123994579 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f967806c8a0 con 0x7f96880fd820 2024-09-19T06:32:20.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:20.413+0000 7f9687fff640 1 --2- 172.21.15.99:0/1123994579 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f9674039580 0x7f967403ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:20.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:20.413+0000 7f9687fff640 1 --2- 172.21.15.99:0/1123994579 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f9674039580 0x7f967403ba30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9670006fd0 tx=0x7f9670006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:32:20.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:20.417+0000 7f96857fa640 1 -- 172.21.15.99:0/1123994579 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f9678033790 con 0x7f96880fd820 2024-09-19T06:32:20.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:20.582+0000 7f968ee73640 1 -- 172.21.15.99:0/1123994579 --> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f968810d290 con 0x7f9674039580 2024-09-19T06:32:20.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:20.585+0000 7f96857fa640 1 -- 172.21.15.99:0/1123994579 <== mgr.14160 v2:172.21.15.99:6800/2333024932 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f968810d290 con 0x7f9674039580 2024-09-19T06:32:20.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:20.587+0000 7f968ee73640 1 -- 172.21.15.99:0/1123994579 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f9674039580 msgr2=0x7f967403ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:20.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:20.587+0000 7f968ee73640 1 --2- 172.21.15.99:0/1123994579 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f9674039580 0x7f967403ba30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9670006fd0 tx=0x7f9670006db0 comp rx=0 tx=0).stop 2024-09-19T06:32:20.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:20.587+0000 7f968ee73640 1 -- 172.21.15.99:0/1123994579 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f96880fd820 msgr2=0x7f968810c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:20.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:20.587+0000 7f968ee73640 1 --2- 172.21.15.99:0/1123994579 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f96880fd820 0x7f968810c6e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f967802a6d0 tx=0x7f9678009da0 comp rx=0 tx=0).stop 2024-09-19T06:32:20.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:20.587+0000 7f968ee73640 1 -- 172.21.15.99:0/1123994579 shutdown_connections 2024-09-19T06:32:20.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:20.587+0000 7f968ee73640 1 --2- 172.21.15.99:0/1123994579 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f9674039580 0x7f967403ba30 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:20.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:20.587+0000 7f968ee73640 1 --2- 172.21.15.99:0/1123994579 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f96880fd820 0x7f968810c6e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:20.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:20.587+0000 7f968ee73640 1 -- 172.21.15.99:0/1123994579 >> 172.21.15.99:0/1123994579 conn(0x7f96880f6040 msgr2=0x7f96880f6850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:32:20.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:20.587+0000 7f968ee73640 1 -- 172.21.15.99:0/1123994579 shutdown_connections 2024-09-19T06:32:20.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:20.587+0000 7f968ee73640 1 -- 172.21.15.99:0/1123994579 wait complete. 2024-09-19T06:32:21.189 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi117 2024-09-19T06:32:21.190 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-19T06:32:21.190 DEBUG:teuthology.orchestra.run.smithi117:> dd of=/etc/ceph/ceph.conf 2024-09-19T06:32:21.210 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-19T06:32:21.210 DEBUG:teuthology.orchestra.run.smithi117:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:32:21.269 INFO:tasks.cephadm:Adding host smithi117 to orchestrator... 2024-09-19T06:32:21.270 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph orch host add smithi117 2024-09-19T06:32:21.934 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:21 smithi099 ceph-mon[27651]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:32:21.934 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:21 smithi099 ceph-mon[27651]: from='mgr.14160 172.21.15.99:0/1563599924' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:32:21.974 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T06:32:23.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:23.789+0000 7f3a70bb6640 1 -- 172.21.15.99:0/316174084 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3a6c0fc1d0 msgr2=0x7f3a6c0fc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:23.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:23.789+0000 7f3a70bb6640 1 --2- 172.21.15.99:0/316174084 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3a6c0fc1d0 0x7f3a6c0fc5e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c004850 tx=0x7f3a5c009da0 comp rx=0 tx=0).stop 2024-09-19T06:32:23.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:23.789+0000 7f3a70bb6640 1 -- 172.21.15.99:0/316174084 shutdown_connections 2024-09-19T06:32:23.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:23.789+0000 7f3a70bb6640 1 --2- 172.21.15.99:0/316174084 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3a6c0fc1d0 0x7f3a6c0fc5e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:23.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:23.789+0000 7f3a70bb6640 1 -- 172.21.15.99:0/316174084 >> 172.21.15.99:0/316174084 conn(0x7f3a6c0f79b0 msgr2=0x7f3a6c0f9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:32:23.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:23.789+0000 7f3a70bb6640 1 -- 172.21.15.99:0/316174084 shutdown_connections 2024-09-19T06:32:23.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:23.789+0000 7f3a70bb6640 1 -- 172.21.15.99:0/316174084 wait complete. 2024-09-19T06:32:23.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:23.789+0000 7f3a70bb6640 1 Processor -- start 2024-09-19T06:32:23.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:23.789+0000 7f3a70bb6640 1 -- start start 2024-09-19T06:32:23.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:23.790+0000 7f3a70bb6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3a6c0fc1d0 0x7f3a6c10c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:23.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:23.790+0000 7f3a70bb6640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6c10cc50 con 0x7f3a6c0fc1d0 2024-09-19T06:32:23.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:23.790+0000 7f3a6a59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3a6c0fc1d0 0x7f3a6c10c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:23.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:23.790+0000 7f3a6a59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3a6c0fc1d0 0x7f3a6c10c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:58858/0 (socket says 172.21.15.99:58858) 2024-09-19T06:32:23.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:23.790+0000 7f3a6a59c640 1 -- 172.21.15.99:0/2216342693 learned_addr learned my addr 172.21.15.99:0/2216342693 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:32:23.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:23.790+0000 7f3a6a59c640 1 -- 172.21.15.99:0/2216342693 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a5c005040 con 0x7f3a6c0fc1d0 2024-09-19T06:32:23.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:23.790+0000 7f3a6a59c640 1 --2- 172.21.15.99:0/2216342693 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3a6c0fc1d0 0x7f3a6c10c710 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c02a6d0 tx=0x7f3a5c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:32:23.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:23.790+0000 7f3a62ffd640 1 -- 172.21.15.99:0/2216342693 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3a5c033630 con 0x7f3a6c0fc1d0 2024-09-19T06:32:23.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:23.790+0000 7f3a70bb6640 1 -- 172.21.15.99:0/2216342693 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a6c10ce50 con 0x7f3a6c0fc1d0 2024-09-19T06:32:23.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:23.790+0000 7f3a62ffd640 1 -- 172.21.15.99:0/2216342693 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3a5c033c30 con 0x7f3a6c0fc1d0 2024-09-19T06:32:23.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:23.790+0000 7f3a62ffd640 1 -- 172.21.15.99:0/2216342693 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3a5c03dc00 con 0x7f3a6c0fc1d0 2024-09-19T06:32:23.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:23.790+0000 7f3a70bb6640 1 -- 172.21.15.99:0/2216342693 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a6c10d2c0 con 0x7f3a6c0fc1d0 2024-09-19T06:32:23.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:23.791+0000 7f3a62ffd640 1 -- 172.21.15.99:0/2216342693 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7f3a5c030020 con 0x7f3a6c0fc1d0 2024-09-19T06:32:23.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:23.791+0000 7f3a70bb6640 1 -- 172.21.15.99:0/2216342693 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a6c05ed70 con 0x7f3a6c0fc1d0 2024-09-19T06:32:23.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:23.792+0000 7f3a62ffd640 1 --2- 172.21.15.99:0/2216342693 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f3a58039580 0x7f3a5803ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:23.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:23.792+0000 7f3a62ffd640 1 -- 172.21.15.99:0/2216342693 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f3a5c06c8c0 con 0x7f3a6c0fc1d0 2024-09-19T06:32:23.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:23.792+0000 7f3a63fff640 1 --2- 172.21.15.99:0/2216342693 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f3a58039580 0x7f3a5803ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:23.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:23.792+0000 7f3a63fff640 1 --2- 172.21.15.99:0/2216342693 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f3a58039580 0x7f3a5803ba30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3a54006fd0 tx=0x7f3a54006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:32:23.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:23.796+0000 7f3a62ffd640 1 -- 172.21.15.99:0/2216342693 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f3a5c033790 con 0x7f3a6c0fc1d0 2024-09-19T06:32:23.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:23.962+0000 7f3a70bb6640 1 -- 172.21.15.99:0/2216342693 --> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi117", "target": ["mon-mgr", ""]}) v1 -- 0x7f3a6c10d2c0 con 0x7f3a58039580 2024-09-19T06:32:25.321 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:25 smithi099 ceph-mon[27651]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi117", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:32:25.321 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:25 smithi099 ceph-mon[27651]: from='mgr.14160 172.21.15.99:0/1563599924' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:32:25.321 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:25 smithi099 ceph-mon[27651]: from='mgr.14160 172.21.15.99:0/1563599924' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:32:25.321 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:25 smithi099 ceph-mon[27651]: from='mgr.14160 172.21.15.99:0/1563599924' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:32:25.321 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:25 smithi099 ceph-mon[27651]: from='mgr.14160 172.21.15.99:0/1563599924' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:32:25.321 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:25 smithi099 ceph-mon[27651]: Deploying daemon node-exporter.smithi099 on smithi099 2024-09-19T06:32:25.321 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:25 smithi099 ceph-mon[27651]: Deploying cephadm binary to smithi117 2024-09-19T06:32:26.629 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:26 smithi099 ceph-mon[27651]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:26.629 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:26 smithi099 ceph-mon[27651]: from='mgr.14160 172.21.15.99:0/1563599924' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:32:26.746 INFO:teuthology.orchestra.run.smithi099.stdout:Added host 'smithi117' with addr '172.21.15.117' 2024-09-19T06:32:26.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:26.743+0000 7f3a62ffd640 1 -- 172.21.15.99:0/2216342693 <== mgr.14160 v2:172.21.15.99:6800/2333024932 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f3a6c10d2c0 con 0x7f3a58039580 2024-09-19T06:32:26.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:26.746+0000 7f3a70bb6640 1 -- 172.21.15.99:0/2216342693 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f3a58039580 msgr2=0x7f3a5803ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:26.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:26.746+0000 7f3a70bb6640 1 --2- 172.21.15.99:0/2216342693 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f3a58039580 0x7f3a5803ba30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3a54006fd0 tx=0x7f3a54006db0 comp rx=0 tx=0).stop 2024-09-19T06:32:26.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:26.746+0000 7f3a70bb6640 1 -- 172.21.15.99:0/2216342693 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3a6c0fc1d0 msgr2=0x7f3a6c10c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:26.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:26.746+0000 7f3a70bb6640 1 --2- 172.21.15.99:0/2216342693 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3a6c0fc1d0 0x7f3a6c10c710 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c02a6d0 tx=0x7f3a5c009da0 comp rx=0 tx=0).stop 2024-09-19T06:32:26.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:26.746+0000 7f3a70bb6640 1 -- 172.21.15.99:0/2216342693 shutdown_connections 2024-09-19T06:32:26.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:26.746+0000 7f3a70bb6640 1 --2- 172.21.15.99:0/2216342693 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f3a58039580 0x7f3a5803ba30 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:26.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:26.746+0000 7f3a70bb6640 1 --2- 172.21.15.99:0/2216342693 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3a6c0fc1d0 0x7f3a6c10c710 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:26.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:26.746+0000 7f3a70bb6640 1 -- 172.21.15.99:0/2216342693 >> 172.21.15.99:0/2216342693 conn(0x7f3a6c0f79b0 msgr2=0x7f3a6c0f8260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:32:26.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:26.746+0000 7f3a70bb6640 1 -- 172.21.15.99:0/2216342693 shutdown_connections 2024-09-19T06:32:26.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:26.746+0000 7f3a70bb6640 1 -- 172.21.15.99:0/2216342693 wait complete. 2024-09-19T06:32:27.642 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-19T06:32:27.881 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:27 smithi099 ceph-mon[27651]: from='mgr.14160 172.21.15.99:0/1563599924' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:32:27.881 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:27 smithi099 ceph-mon[27651]: Added host smithi117 2024-09-19T06:32:28.109 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T06:32:29.103 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:28 smithi099 ceph-mon[27651]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:29.103 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:28 smithi099 ceph-mon[27651]: from='mgr.14160 172.21.15.99:0/1563599924' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:32:29.103 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:28 smithi099 ceph-mon[27651]: from='mgr.14160 172.21.15.99:0/1563599924' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:32:29.103 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:28 smithi099 ceph-mon[27651]: from='mgr.14160 172.21.15.99:0/1563599924' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:32:29.103 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:28 smithi099 ceph-mon[27651]: from='mgr.14160 172.21.15.99:0/1563599924' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:32:29.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:29.638+0000 7f8b40f7e640 1 -- 172.21.15.99:0/2865496804 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b3c0fb2e0 msgr2=0x7f8b3c0fb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:29.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:29.638+0000 7f8b40f7e640 1 --2- 172.21.15.99:0/2865496804 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b3c0fb2e0 0x7f8b3c0fb6f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c004850 tx=0x7f8b2c009da0 comp rx=0 tx=0).stop 2024-09-19T06:32:29.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:29.638+0000 7f8b40f7e640 1 -- 172.21.15.99:0/2865496804 shutdown_connections 2024-09-19T06:32:29.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:29.638+0000 7f8b40f7e640 1 --2- 172.21.15.99:0/2865496804 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b3c0fb2e0 0x7f8b3c0fb6f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:29.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:29.638+0000 7f8b40f7e640 1 -- 172.21.15.99:0/2865496804 >> 172.21.15.99:0/2865496804 conn(0x7f8b3c0f6ac0 msgr2=0x7f8b3c0f8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:32:29.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:29.638+0000 7f8b40f7e640 1 -- 172.21.15.99:0/2865496804 shutdown_connections 2024-09-19T06:32:29.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:29.638+0000 7f8b40f7e640 1 -- 172.21.15.99:0/2865496804 wait complete. 2024-09-19T06:32:29.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:29.638+0000 7f8b40f7e640 1 Processor -- start 2024-09-19T06:32:29.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:29.638+0000 7f8b40f7e640 1 -- start start 2024-09-19T06:32:29.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:29.639+0000 7f8b40f7e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b3c0fb2e0 0x7f8b3c065530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:29.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:29.639+0000 7f8b40f7e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3c10f600 con 0x7f8b3c0fb2e0 2024-09-19T06:32:29.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:29.639+0000 7f8b3a59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b3c0fb2e0 0x7f8b3c065530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:29.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:29.639+0000 7f8b3a59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b3c0fb2e0 0x7f8b3c065530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50266/0 (socket says 172.21.15.99:50266) 2024-09-19T06:32:29.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:29.639+0000 7f8b3a59c640 1 -- 172.21.15.99:0/2747071308 learned_addr learned my addr 172.21.15.99:0/2747071308 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:32:29.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:29.639+0000 7f8b3a59c640 1 -- 172.21.15.99:0/2747071308 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b2c005040 con 0x7f8b3c0fb2e0 2024-09-19T06:32:29.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:29.639+0000 7f8b3a59c640 1 --2- 172.21.15.99:0/2747071308 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b3c0fb2e0 0x7f8b3c065530 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c02a6d0 tx=0x7f8b2c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:32:29.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:29.639+0000 7f8b32ffd640 1 -- 172.21.15.99:0/2747071308 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8b2c033630 con 0x7f8b3c0fb2e0 2024-09-19T06:32:29.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:29.639+0000 7f8b40f7e640 1 -- 172.21.15.99:0/2747071308 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b3c10f740 con 0x7f8b3c0fb2e0 2024-09-19T06:32:29.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:29.639+0000 7f8b32ffd640 1 -- 172.21.15.99:0/2747071308 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8b2c033c30 con 0x7f8b3c0fb2e0 2024-09-19T06:32:29.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:29.639+0000 7f8b32ffd640 1 -- 172.21.15.99:0/2747071308 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8b2c03dc00 con 0x7f8b3c0fb2e0 2024-09-19T06:32:29.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:29.640+0000 7f8b40f7e640 1 -- 172.21.15.99:0/2747071308 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b3c10fbb0 con 0x7f8b3c0fb2e0 2024-09-19T06:32:29.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:29.640+0000 7f8b32ffd640 1 -- 172.21.15.99:0/2747071308 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7f8b2c030020 con 0x7f8b3c0fb2e0 2024-09-19T06:32:29.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:29.640+0000 7f8b40f7e640 1 -- 172.21.15.99:0/2747071308 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b3c05ed70 con 0x7f8b3c0fb2e0 2024-09-19T06:32:29.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:29.641+0000 7f8b32ffd640 1 --2- 172.21.15.99:0/2747071308 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f8b280395d0 0x7f8b2803ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:29.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:29.641+0000 7f8b32ffd640 1 -- 172.21.15.99:0/2747071308 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f8b2c06cb60 con 0x7f8b3c0fb2e0 2024-09-19T06:32:29.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:29.641+0000 7f8b39d9b640 1 --2- 172.21.15.99:0/2747071308 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f8b280395d0 0x7f8b2803ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:29.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:29.641+0000 7f8b39d9b640 1 --2- 172.21.15.99:0/2747071308 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f8b280395d0 0x7f8b2803ba80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8b24006fd0 tx=0x7f8b24006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:32:29.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:29.645+0000 7f8b32ffd640 1 -- 172.21.15.99:0/2747071308 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f8b2c047440 con 0x7f8b3c0fb2e0 2024-09-19T06:32:29.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:29.812+0000 7f8b40f7e640 1 -- 172.21.15.99:0/2747071308 --> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8b3c0008d0 con 0x7f8b280395d0 2024-09-19T06:32:29.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:29.813+0000 7f8b32ffd640 1 -- 172.21.15.99:0/2747071308 <== mgr.14160 v2:172.21.15.99:6800/2333024932 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+160 (secure 0 0 0) 0x7f8b3c0008d0 con 0x7f8b280395d0 2024-09-19T06:32:29.815 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:32:29.815 INFO:teuthology.orchestra.run.smithi099.stdout:[{"addr": "172.21.15.99", "hostname": "smithi099", "labels": [], "status": ""}, {"addr": "172.21.15.117", "hostname": "smithi117", "labels": [], "status": ""}] 2024-09-19T06:32:29.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:29.815+0000 7f8b40f7e640 1 -- 172.21.15.99:0/2747071308 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f8b280395d0 msgr2=0x7f8b2803ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:29.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:29.815+0000 7f8b40f7e640 1 --2- 172.21.15.99:0/2747071308 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f8b280395d0 0x7f8b2803ba80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8b24006fd0 tx=0x7f8b24006db0 comp rx=0 tx=0).stop 2024-09-19T06:32:29.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:29.815+0000 7f8b40f7e640 1 -- 172.21.15.99:0/2747071308 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b3c0fb2e0 msgr2=0x7f8b3c065530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:29.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:29.815+0000 7f8b40f7e640 1 --2- 172.21.15.99:0/2747071308 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b3c0fb2e0 0x7f8b3c065530 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c02a6d0 tx=0x7f8b2c009da0 comp rx=0 tx=0).stop 2024-09-19T06:32:29.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:29.815+0000 7f8b40f7e640 1 -- 172.21.15.99:0/2747071308 shutdown_connections 2024-09-19T06:32:29.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:29.815+0000 7f8b40f7e640 1 --2- 172.21.15.99:0/2747071308 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f8b280395d0 0x7f8b2803ba80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:29.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:29.815+0000 7f8b40f7e640 1 --2- 172.21.15.99:0/2747071308 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b3c0fb2e0 0x7f8b3c065530 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:29.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:29.815+0000 7f8b40f7e640 1 -- 172.21.15.99:0/2747071308 >> 172.21.15.99:0/2747071308 conn(0x7f8b3c0f6ac0 msgr2=0x7f8b3c0f7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:32:29.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:29.816+0000 7f8b40f7e640 1 -- 172.21.15.99:0/2747071308 shutdown_connections 2024-09-19T06:32:29.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:29.816+0000 7f8b40f7e640 1 -- 172.21.15.99:0/2747071308 wait complete. 2024-09-19T06:32:29.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:29 smithi099 ceph-mon[27651]: Deploying daemon alertmanager.smithi099 on smithi099 2024-09-19T06:32:30.931 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:30 smithi099 ceph-mon[27651]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:30.931 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:30 smithi099 ceph-mon[27651]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:32:30.931 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:30 smithi099 ceph-mon[27651]: from='mgr.14160 172.21.15.99:0/1563599924' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:32:30.955 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-19T06:32:30.955 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-19T06:32:31.194 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T06:32:33.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:32 smithi099 ceph-mon[27651]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:34.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:34 smithi099 ceph-mon[27651]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:36.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:36.160+0000 7f44eb4c8640 1 -- 172.21.15.99:0/1046559856 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44e40fc1b0 msgr2=0x7f44e40fc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:36.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:36.160+0000 7f44eb4c8640 1 --2- 172.21.15.99:0/1046559856 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44e40fc1b0 0x7f44e40fc5c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f44e0004850 tx=0x7f44e0009da0 comp rx=0 tx=0).stop 2024-09-19T06:32:36.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:36.160+0000 7f44eb4c8640 1 -- 172.21.15.99:0/1046559856 shutdown_connections 2024-09-19T06:32:36.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:36.160+0000 7f44eb4c8640 1 --2- 172.21.15.99:0/1046559856 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44e40fc1b0 0x7f44e40fc5c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:36.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:36.160+0000 7f44eb4c8640 1 -- 172.21.15.99:0/1046559856 >> 172.21.15.99:0/1046559856 conn(0x7f44e40f7990 msgr2=0x7f44e40f9da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:32:36.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:36.161+0000 7f44eb4c8640 1 -- 172.21.15.99:0/1046559856 shutdown_connections 2024-09-19T06:32:36.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:36.161+0000 7f44eb4c8640 1 -- 172.21.15.99:0/1046559856 wait complete. 2024-09-19T06:32:36.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:36.161+0000 7f44eb4c8640 1 Processor -- start 2024-09-19T06:32:36.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:36.161+0000 7f44eb4c8640 1 -- start start 2024-09-19T06:32:36.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:36.162+0000 7f44eb4c8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44e40fc1b0 0x7f44e410c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:36.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:36.162+0000 7f44eb4c8640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e410cc30 con 0x7f44e40fc1b0 2024-09-19T06:32:36.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:36.162+0000 7f44e9264640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44e40fc1b0 0x7f44e410c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:36.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:36.162+0000 7f44e9264640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44e40fc1b0 0x7f44e410c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:58978/0 (socket says 172.21.15.99:58978) 2024-09-19T06:32:36.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:36.162+0000 7f44e9264640 1 -- 172.21.15.99:0/3603599835 learned_addr learned my addr 172.21.15.99:0/3603599835 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:32:36.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:36.162+0000 7f44e9264640 1 -- 172.21.15.99:0/3603599835 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e0005040 con 0x7f44e40fc1b0 2024-09-19T06:32:36.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:36.162+0000 7f44e9264640 1 --2- 172.21.15.99:0/3603599835 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44e40fc1b0 0x7f44e410c6f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f44e0009920 tx=0x7f44e0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:32:36.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:36.162+0000 7f44d9ffb640 1 -- 172.21.15.99:0/3603599835 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f44e0033630 con 0x7f44e40fc1b0 2024-09-19T06:32:36.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:36.162+0000 7f44eb4c8640 1 -- 172.21.15.99:0/3603599835 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44e410ce30 con 0x7f44e40fc1b0 2024-09-19T06:32:36.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:36.162+0000 7f44d9ffb640 1 -- 172.21.15.99:0/3603599835 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f44e0033c30 con 0x7f44e40fc1b0 2024-09-19T06:32:36.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:36.163+0000 7f44d9ffb640 1 -- 172.21.15.99:0/3603599835 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f44e003dc40 con 0x7f44e40fc1b0 2024-09-19T06:32:36.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:36.163+0000 7f44eb4c8640 1 -- 172.21.15.99:0/3603599835 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44e410d2a0 con 0x7f44e40fc1b0 2024-09-19T06:32:36.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:36.164+0000 7f44d9ffb640 1 -- 172.21.15.99:0/3603599835 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7f44e0030020 con 0x7f44e40fc1b0 2024-09-19T06:32:36.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:36.164+0000 7f44eb4c8640 1 -- 172.21.15.99:0/3603599835 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44e405ed70 con 0x7f44e40fc1b0 2024-09-19T06:32:36.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:36.164+0000 7f44d9ffb640 1 --2- 172.21.15.99:0/3603599835 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f44d0039580 0x7f44d003ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:36.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:36.164+0000 7f44d9ffb640 1 -- 172.21.15.99:0/3603599835 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f44e006c9c0 con 0x7f44e40fc1b0 2024-09-19T06:32:36.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:36.164+0000 7f44e8a63640 1 --2- 172.21.15.99:0/3603599835 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f44d0039580 0x7f44d003ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:36.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:36.165+0000 7f44e8a63640 1 --2- 172.21.15.99:0/3603599835 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f44d0039580 0x7f44d003ba30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f44d4006fd0 tx=0x7f44d4006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:32:36.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:36.170+0000 7f44d9ffb640 1 -- 172.21.15.99:0/3603599835 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f44e003bb50 con 0x7f44e40fc1b0 2024-09-19T06:32:36.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:36.333+0000 7f44eb4c8640 1 -- 172.21.15.99:0/3603599835 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f44e404b720 con 0x7f44e40fc1b0 2024-09-19T06:32:36.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:36.758+0000 7f44d9ffb640 1 -- 172.21.15.99:0/3603599835 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f44e003b370 con 0x7f44e40fc1b0 2024-09-19T06:32:36.760 INFO:teuthology.orchestra.run.smithi099.stderr:adjusted tunables profile to default 2024-09-19T06:32:36.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:36.761+0000 7f44eb4c8640 1 -- 172.21.15.99:0/3603599835 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f44d0039580 msgr2=0x7f44d003ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:36.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:36.761+0000 7f44eb4c8640 1 --2- 172.21.15.99:0/3603599835 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f44d0039580 0x7f44d003ba30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f44d4006fd0 tx=0x7f44d4006db0 comp rx=0 tx=0).stop 2024-09-19T06:32:36.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:36.761+0000 7f44eb4c8640 1 -- 172.21.15.99:0/3603599835 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44e40fc1b0 msgr2=0x7f44e410c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:36.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:36.761+0000 7f44eb4c8640 1 --2- 172.21.15.99:0/3603599835 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44e40fc1b0 0x7f44e410c6f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f44e0009920 tx=0x7f44e0009da0 comp rx=0 tx=0).stop 2024-09-19T06:32:36.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:36.761+0000 7f44eb4c8640 1 -- 172.21.15.99:0/3603599835 shutdown_connections 2024-09-19T06:32:36.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:36.761+0000 7f44eb4c8640 1 --2- 172.21.15.99:0/3603599835 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f44d0039580 0x7f44d003ba30 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:36.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:36.761+0000 7f44eb4c8640 1 --2- 172.21.15.99:0/3603599835 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44e40fc1b0 0x7f44e410c6f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:36.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:36.761+0000 7f44eb4c8640 1 -- 172.21.15.99:0/3603599835 >> 172.21.15.99:0/3603599835 conn(0x7f44e40f7990 msgr2=0x7f44e40f8220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:32:36.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:36.761+0000 7f44eb4c8640 1 -- 172.21.15.99:0/3603599835 shutdown_connections 2024-09-19T06:32:36.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:32:36.761+0000 7f44eb4c8640 1 -- 172.21.15.99:0/3603599835 wait complete. 2024-09-19T06:32:36.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:36 smithi099 ceph-mon[27651]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:36.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:36 smithi099 ceph-mon[27651]: from='client.? 172.21.15.99:0/3603599835' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-19T06:32:37.347 INFO:tasks.cephadm:Adding mon.smithi099 on smithi099 2024-09-19T06:32:37.347 INFO:tasks.cephadm:Adding mon.smithi117 on smithi117 2024-09-19T06:32:37.347 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph orch apply mon '2;smithi099:172.21.15.99=smithi099;smithi117:172.21.15.117=smithi117' 2024-09-19T06:32:37.599 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T06:32:37.643 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T06:32:37.876 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:37 smithi099 ceph-mon[27651]: from='client.? 172.21.15.99:0/3603599835' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-19T06:32:37.876 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:37 smithi099 ceph-mon[27651]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T06:32:39.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:39.043+0000 7f8e1bd6c640 1 -- 172.21.15.117:0/2113975575 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8e14065650 msgr2=0x7f8e140feff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:39.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:39.043+0000 7f8e1bd6c640 1 --2- 172.21.15.117:0/2113975575 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8e14065650 0x7f8e140feff0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8e04004850 tx=0x7f8e04009da0 comp rx=0 tx=0).stop 2024-09-19T06:32:39.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:39.043+0000 7f8e1bd6c640 1 -- 172.21.15.117:0/2113975575 shutdown_connections 2024-09-19T06:32:39.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:39.043+0000 7f8e1bd6c640 1 --2- 172.21.15.117:0/2113975575 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8e14065650 0x7f8e140feff0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:39.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:39.043+0000 7f8e1bd6c640 1 -- 172.21.15.117:0/2113975575 >> 172.21.15.117:0/2113975575 conn(0x7f8e140f6ac0 msgr2=0x7f8e140f8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:32:39.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:39.043+0000 7f8e1bd6c640 1 -- 172.21.15.117:0/2113975575 shutdown_connections 2024-09-19T06:32:39.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:39.043+0000 7f8e1bd6c640 1 -- 172.21.15.117:0/2113975575 wait complete. 2024-09-19T06:32:39.046 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:39.044+0000 7f8e1bd6c640 1 Processor -- start 2024-09-19T06:32:39.047 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:39.044+0000 7f8e1bd6c640 1 -- start start 2024-09-19T06:32:39.047 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:39.044+0000 7f8e1bd6c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8e14065650 0x7f8e14115100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:39.047 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:39.044+0000 7f8e1bd6c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e14115640 con 0x7f8e14065650 2024-09-19T06:32:39.047 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:39.044+0000 7f8e19b08640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8e14065650 0x7f8e14115100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:39.047 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:39.044+0000 7f8e19b08640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8e14065650 0x7f8e14115100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.117:57796/0 (socket says 172.21.15.117:57796) 2024-09-19T06:32:39.047 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:39.044+0000 7f8e19b08640 1 -- 172.21.15.117:0/2466700845 learned_addr learned my addr 172.21.15.117:0/2466700845 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T06:32:39.047 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:39.045+0000 7f8e19b08640 1 -- 172.21.15.117:0/2466700845 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e04005040 con 0x7f8e14065650 2024-09-19T06:32:39.048 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:39.045+0000 7f8e19b08640 1 --2- 172.21.15.117:0/2466700845 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8e14065650 0x7f8e14115100 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8e0402a6d0 tx=0x7f8e04009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:32:39.049 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:39.045+0000 7f8e0a7fc640 1 -- 172.21.15.117:0/2466700845 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8e04033630 con 0x7f8e14065650 2024-09-19T06:32:39.049 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:39.045+0000 7f8e1bd6c640 1 -- 172.21.15.117:0/2466700845 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e14115840 con 0x7f8e14065650 2024-09-19T06:32:39.049 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:39.045+0000 7f8e0a7fc640 1 -- 172.21.15.117:0/2466700845 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8e04033c30 con 0x7f8e14065650 2024-09-19T06:32:39.049 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:39.045+0000 7f8e0a7fc640 1 -- 172.21.15.117:0/2466700845 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8e0403dc30 con 0x7f8e14065650 2024-09-19T06:32:39.049 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:39.045+0000 7f8e1bd6c640 1 -- 172.21.15.117:0/2466700845 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e14115cb0 con 0x7f8e14065650 2024-09-19T06:32:39.049 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:39.046+0000 7f8e0a7fc640 1 -- 172.21.15.117:0/2466700845 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7f8e04030020 con 0x7f8e14065650 2024-09-19T06:32:39.049 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:39.046+0000 7f8e0a7fc640 1 --2- 172.21.15.117:0/2466700845 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f8e00039580 0x7f8e0003ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:39.049 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:39.046+0000 7f8e0a7fc640 1 -- 172.21.15.117:0/2466700845 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f8e0406cca0 con 0x7f8e14065650 2024-09-19T06:32:39.049 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:39.046+0000 7f8e1bd6c640 1 -- 172.21.15.117:0/2466700845 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e1405ed70 con 0x7f8e14065650 2024-09-19T06:32:39.049 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:39.046+0000 7f8e19307640 1 --2- 172.21.15.117:0/2466700845 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f8e00039580 0x7f8e0003ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:39.049 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:39.047+0000 7f8e19307640 1 --2- 172.21.15.117:0/2466700845 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f8e00039580 0x7f8e0003ba30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8e10006fd0 tx=0x7f8e10006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:32:39.052 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:39.051+0000 7f8e0a7fc640 1 -- 172.21.15.117:0/2466700845 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f8e0403bd60 con 0x7f8e14065650 2024-09-19T06:32:39.117 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:38 smithi099 ceph-mon[27651]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:39.117 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:38 smithi099 ceph-mon[27651]: from='mgr.14160 172.21.15.99:0/1563599924' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:32:39.117 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:38 smithi099 ceph-mon[27651]: from='mgr.14160 172.21.15.99:0/1563599924' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:32:39.117 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:38 smithi099 ceph-mon[27651]: from='mgr.14160 172.21.15.99:0/1563599924' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:32:39.118 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:38 smithi099 ceph-mon[27651]: from='mgr.14160 172.21.15.99:0/1563599924' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:32:39.118 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:38 smithi099 ceph-mon[27651]: from='mgr.14160 172.21.15.99:0/1563599924' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:32:39.118 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:38 smithi099 ceph-mon[27651]: from='mgr.14160 172.21.15.99:0/1563599924' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:32:39.118 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:38 smithi099 ceph-mon[27651]: from='mgr.14160 172.21.15.99:0/1563599924' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-19T06:32:39.118 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:38 smithi099 ceph-mon[27651]: from='mgr.14160 172.21.15.99:0/1563599924' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:32:39.215 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:39.214+0000 7f8e1bd6c640 1 -- 172.21.15.117:0/2466700845 --> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi099:172.21.15.99=smithi099;smithi117:172.21.15.117=smithi117", "target": ["mon-mgr", ""]}) v1 -- 0x7f8e141021a0 con 0x7f8e00039580 2024-09-19T06:32:39.223 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:39.222+0000 7f8e0a7fc640 1 -- 172.21.15.117:0/2466700845 <== mgr.14160 v2:172.21.15.99:6800/2333024932 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f8e141021a0 con 0x7f8e00039580 2024-09-19T06:32:39.223 INFO:teuthology.orchestra.run.smithi117.stdout:Scheduled mon update... 2024-09-19T06:32:39.225 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:39.223+0000 7f8e1bd6c640 1 -- 172.21.15.117:0/2466700845 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f8e00039580 msgr2=0x7f8e0003ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:39.225 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:39.223+0000 7f8e1bd6c640 1 --2- 172.21.15.117:0/2466700845 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f8e00039580 0x7f8e0003ba30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8e10006fd0 tx=0x7f8e10006db0 comp rx=0 tx=0).stop 2024-09-19T06:32:39.225 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:39.223+0000 7f8e1bd6c640 1 -- 172.21.15.117:0/2466700845 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8e14065650 msgr2=0x7f8e14115100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:39.225 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:39.223+0000 7f8e1bd6c640 1 --2- 172.21.15.117:0/2466700845 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8e14065650 0x7f8e14115100 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8e0402a6d0 tx=0x7f8e04009da0 comp rx=0 tx=0).stop 2024-09-19T06:32:39.226 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:39.224+0000 7f8e1bd6c640 1 -- 172.21.15.117:0/2466700845 shutdown_connections 2024-09-19T06:32:39.226 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:39.224+0000 7f8e1bd6c640 1 --2- 172.21.15.117:0/2466700845 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f8e00039580 0x7f8e0003ba30 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:39.226 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:39.224+0000 7f8e1bd6c640 1 --2- 172.21.15.117:0/2466700845 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8e14065650 0x7f8e14115100 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:39.226 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:39.224+0000 7f8e1bd6c640 1 -- 172.21.15.117:0/2466700845 >> 172.21.15.117:0/2466700845 conn(0x7f8e140f6ac0 msgr2=0x7f8e140f7370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:32:39.226 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:39.224+0000 7f8e1bd6c640 1 -- 172.21.15.117:0/2466700845 shutdown_connections 2024-09-19T06:32:39.226 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:39.224+0000 7f8e1bd6c640 1 -- 172.21.15.117:0/2466700845 wait complete. 2024-09-19T06:32:39.766 DEBUG:teuthology.orchestra.run.smithi117:mon.smithi117> sudo journalctl -f -n 0 -u ceph-a73eb958-7650-11ef-bceb-c7b262605968@mon.smithi117.service 2024-09-19T06:32:39.769 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-19T06:32:39.769 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T06:32:40.037 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T06:32:40.080 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T06:32:40.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:39 smithi099 ceph-mon[27651]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-19T06:32:40.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:39 smithi099 ceph-mon[27651]: Deploying daemon grafana.smithi099 on smithi099 2024-09-19T06:32:40.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:39 smithi099 ceph-mon[27651]: from='mgr.14160 172.21.15.99:0/1563599924' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:32:41.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:40 smithi099 ceph-mon[27651]: from='client.14192 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi099:172.21.15.99=smithi099;smithi117:172.21.15.117=smithi117", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:32:41.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:40 smithi099 ceph-mon[27651]: Saving service mon spec with placement smithi099:172.21.15.99=smithi099;smithi117:172.21.15.117=smithi117;count:2 2024-09-19T06:32:41.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:40 smithi099 ceph-mon[27651]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:41.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:40 smithi099 ceph-mon[27651]: from='mgr.14160 172.21.15.99:0/1563599924' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:32:41.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:41.540+0000 7f1cb0258640 1 -- 172.21.15.117:0/3383948427 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1ca80fa850 msgr2=0x7f1ca80fac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:41.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:41.540+0000 7f1cb0258640 1 --2- 172.21.15.117:0/3383948427 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1ca80fa850 0x7f1ca80fac60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1ca4004850 tx=0x7f1ca4009da0 comp rx=0 tx=0).stop 2024-09-19T06:32:41.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:41.540+0000 7f1cb0258640 1 -- 172.21.15.117:0/3383948427 shutdown_connections 2024-09-19T06:32:41.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:41.540+0000 7f1cb0258640 1 --2- 172.21.15.117:0/3383948427 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1ca80fa850 0x7f1ca80fac60 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:41.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:41.540+0000 7f1cb0258640 1 -- 172.21.15.117:0/3383948427 >> 172.21.15.117:0/3383948427 conn(0x7f1ca80f6010 msgr2=0x7f1ca80f8440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:32:41.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:41.540+0000 7f1cb0258640 1 -- 172.21.15.117:0/3383948427 shutdown_connections 2024-09-19T06:32:41.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:41.540+0000 7f1cb0258640 1 -- 172.21.15.117:0/3383948427 wait complete. 2024-09-19T06:32:41.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:41.540+0000 7f1cb0258640 1 Processor -- start 2024-09-19T06:32:41.567 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:41.541+0000 7f1cb0258640 1 -- start start 2024-09-19T06:32:41.568 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:41.541+0000 7f1cb0258640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1ca80fa850 0x7f1ca81019c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:41.568 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:41.541+0000 7f1cb0258640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca810d2b0 con 0x7f1ca80fa850 2024-09-19T06:32:41.568 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:41.541+0000 7f1cadff4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1ca80fa850 0x7f1ca81019c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:41.568 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:41.541+0000 7f1cadff4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1ca80fa850 0x7f1ca81019c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.117:57814/0 (socket says 172.21.15.117:57814) 2024-09-19T06:32:41.568 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:41.541+0000 7f1cadff4640 1 -- 172.21.15.117:0/2020951648 learned_addr learned my addr 172.21.15.117:0/2020951648 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T06:32:41.568 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:41.541+0000 7f1cadff4640 1 -- 172.21.15.117:0/2020951648 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ca4005040 con 0x7f1ca80fa850 2024-09-19T06:32:41.568 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:41.541+0000 7f1cadff4640 1 --2- 172.21.15.117:0/2020951648 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1ca80fa850 0x7f1ca81019c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1ca402a6d0 tx=0x7f1ca4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:32:41.568 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:41.541+0000 7f1c9e7fc640 1 -- 172.21.15.117:0/2020951648 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1ca4033630 con 0x7f1ca80fa850 2024-09-19T06:32:41.568 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:41.541+0000 7f1c9e7fc640 1 -- 172.21.15.117:0/2020951648 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1ca4033c30 con 0x7f1ca80fa850 2024-09-19T06:32:41.568 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:41.541+0000 7f1cb0258640 1 -- 172.21.15.117:0/2020951648 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ca81118c0 con 0x7f1ca80fa850 2024-09-19T06:32:41.568 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:41.541+0000 7f1c9e7fc640 1 -- 172.21.15.117:0/2020951648 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1ca403dc30 con 0x7f1ca80fa850 2024-09-19T06:32:41.568 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:41.541+0000 7f1cb0258640 1 -- 172.21.15.117:0/2020951648 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ca8111bf0 con 0x7f1ca80fa850 2024-09-19T06:32:41.568 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:41.542+0000 7f1c9e7fc640 1 -- 172.21.15.117:0/2020951648 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7f1ca4030020 con 0x7f1ca80fa850 2024-09-19T06:32:41.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:41.542+0000 7f1c9e7fc640 1 --2- 172.21.15.117:0/2020951648 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f1c94039580 0x7f1c9403ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:41.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:41.542+0000 7f1c9e7fc640 1 -- 172.21.15.117:0/2020951648 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f1ca406cb40 con 0x7f1ca80fa850 2024-09-19T06:32:41.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:41.543+0000 7f1cb0258640 1 -- 172.21.15.117:0/2020951648 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ca805ed70 con 0x7f1ca80fa850 2024-09-19T06:32:41.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:41.543+0000 7f1cad7f3640 1 --2- 172.21.15.117:0/2020951648 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f1c94039580 0x7f1c9403ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:41.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:41.543+0000 7f1cad7f3640 1 --2- 172.21.15.117:0/2020951648 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f1c94039580 0x7f1c9403ba30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1c98006fd0 tx=0x7f1c98006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:32:41.569 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:41.548+0000 7f1c9e7fc640 1 -- 172.21.15.117:0/2020951648 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f1ca403bd70 con 0x7f1ca80fa850 2024-09-19T06:32:41.762 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:41.761+0000 7f1cb0258640 1 -- 172.21.15.117:0/2020951648 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f1ca804b720 con 0x7f1ca80fa850 2024-09-19T06:32:41.762 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:41.761+0000 7f1c9e7fc640 1 -- 172.21.15.117:0/2020951648 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f1ca4042210 con 0x7f1ca80fa850 2024-09-19T06:32:41.763 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:32:41.763 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":1,"fsid":"a73eb958-7650-11ef-bceb-c7b262605968","modified":"2024-09-19T06:31:05.093105Z","created":"2024-09-19T06:31:05.093105Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi099","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:3300","nonce":0},{"type":"v1","addr":"172.21.15.99:6789","nonce":0}]},"addr":"172.21.15.99:6789/0","public_addr":"172.21.15.99:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T06:32:41.763 INFO:teuthology.orchestra.run.smithi117.stderr:dumped monmap epoch 1 2024-09-19T06:32:41.764 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:41.763+0000 7f1cb0258640 1 -- 172.21.15.117:0/2020951648 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f1c94039580 msgr2=0x7f1c9403ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:41.764 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:41.763+0000 7f1cb0258640 1 --2- 172.21.15.117:0/2020951648 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f1c94039580 0x7f1c9403ba30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1c98006fd0 tx=0x7f1c98006db0 comp rx=0 tx=0).stop 2024-09-19T06:32:41.764 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:41.763+0000 7f1cb0258640 1 -- 172.21.15.117:0/2020951648 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1ca80fa850 msgr2=0x7f1ca81019c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:41.764 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:41.763+0000 7f1cb0258640 1 --2- 172.21.15.117:0/2020951648 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1ca80fa850 0x7f1ca81019c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1ca402a6d0 tx=0x7f1ca4009da0 comp rx=0 tx=0).stop 2024-09-19T06:32:41.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:41.763+0000 7f1cb0258640 1 -- 172.21.15.117:0/2020951648 shutdown_connections 2024-09-19T06:32:41.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:41.763+0000 7f1cb0258640 1 --2- 172.21.15.117:0/2020951648 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f1c94039580 0x7f1c9403ba30 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:41.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:41.763+0000 7f1cb0258640 1 --2- 172.21.15.117:0/2020951648 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1ca80fa850 0x7f1ca81019c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:41.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:41.763+0000 7f1cb0258640 1 -- 172.21.15.117:0/2020951648 >> 172.21.15.117:0/2020951648 conn(0x7f1ca80f6010 msgr2=0x7f1ca80f6890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:32:41.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:41.763+0000 7f1cb0258640 1 -- 172.21.15.117:0/2020951648 shutdown_connections 2024-09-19T06:32:41.765 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:41.763+0000 7f1cb0258640 1 -- 172.21.15.117:0/2020951648 wait complete. 2024-09-19T06:32:42.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:41 smithi099 ceph-mon[27651]: from='client.? 172.21.15.117:0/2020951648' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T06:32:43.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:42 smithi099 ceph-mon[27651]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:43.303 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-19T06:32:43.303 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T06:32:43.547 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T06:32:43.591 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T06:32:44.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:44.985+0000 7f5aaf06e640 1 -- 172.21.15.117:0/713222401 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5aa80fc1d0 msgr2=0x7f5aa80fc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:44.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:44.985+0000 7f5aaf06e640 1 --2- 172.21.15.117:0/713222401 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5aa80fc1d0 0x7f5aa80fc5e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5a98009bd0 tx=0x7f5a98004d10 comp rx=0 tx=0).stop 2024-09-19T06:32:44.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:44.985+0000 7f5aaf06e640 1 -- 172.21.15.117:0/713222401 shutdown_connections 2024-09-19T06:32:44.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:44.985+0000 7f5aaf06e640 1 --2- 172.21.15.117:0/713222401 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5aa80fc1d0 0x7f5aa80fc5e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:44.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:44.985+0000 7f5aaf06e640 1 -- 172.21.15.117:0/713222401 >> 172.21.15.117:0/713222401 conn(0x7f5aa80f79b0 msgr2=0x7f5aa80f9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:32:44.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:44.985+0000 7f5aaf06e640 1 -- 172.21.15.117:0/713222401 shutdown_connections 2024-09-19T06:32:44.987 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:44.985+0000 7f5aaf06e640 1 -- 172.21.15.117:0/713222401 wait complete. 2024-09-19T06:32:44.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:44.985+0000 7f5aaf06e640 1 Processor -- start 2024-09-19T06:32:44.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:44.985+0000 7f5aaf06e640 1 -- start start 2024-09-19T06:32:44.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:44.985+0000 7f5aaf06e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5aa80fc1d0 0x7f5aa810c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:44.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:44.986+0000 7f5aaf06e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa810cc50 con 0x7f5aa80fc1d0 2024-09-19T06:32:44.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:44.986+0000 7f5aace0a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5aa80fc1d0 0x7f5aa810c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:44.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:44.986+0000 7f5aace0a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5aa80fc1d0 0x7f5aa810c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.117:37980/0 (socket says 172.21.15.117:37980) 2024-09-19T06:32:44.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:44.986+0000 7f5aace0a640 1 -- 172.21.15.117:0/958506188 learned_addr learned my addr 172.21.15.117:0/958506188 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T06:32:44.988 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:44.986+0000 7f5aace0a640 1 -- 172.21.15.117:0/958506188 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a980098b0 con 0x7f5aa80fc1d0 2024-09-19T06:32:44.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:44.986+0000 7f5aace0a640 1 --2- 172.21.15.117:0/958506188 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5aa80fc1d0 0x7f5aa810c710 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5a98003400 tx=0x7f5a98004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:32:44.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:44.986+0000 7f5aa57fa640 1 -- 172.21.15.117:0/958506188 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5a98032910 con 0x7f5aa80fc1d0 2024-09-19T06:32:44.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:44.986+0000 7f5aa57fa640 1 -- 172.21.15.117:0/958506188 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5a9803d420 con 0x7f5aa80fc1d0 2024-09-19T06:32:44.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:44.986+0000 7f5aaf06e640 1 -- 172.21.15.117:0/958506188 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5aa810ce50 con 0x7f5aa80fc1d0 2024-09-19T06:32:44.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:44.986+0000 7f5aa57fa640 1 -- 172.21.15.117:0/958506188 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5a98031590 con 0x7f5aa80fc1d0 2024-09-19T06:32:44.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:44.986+0000 7f5aaf06e640 1 -- 172.21.15.117:0/958506188 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5aa810d9e0 con 0x7f5aa80fc1d0 2024-09-19T06:32:44.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:44.987+0000 7f5aa57fa640 1 -- 172.21.15.117:0/958506188 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7f5a9802f030 con 0x7f5aa80fc1d0 2024-09-19T06:32:44.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:44.987+0000 7f5aaf06e640 1 -- 172.21.15.117:0/958506188 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5aa810d320 con 0x7f5aa80fc1d0 2024-09-19T06:32:44.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:44.987+0000 7f5aa57fa640 1 --2- 172.21.15.117:0/958506188 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f5a94039580 0x7f5a9403ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:44.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:44.988+0000 7f5aa57fa640 1 -- 172.21.15.117:0/958506188 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f5a9806d7d0 con 0x7f5aa80fc1d0 2024-09-19T06:32:44.990 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:44.988+0000 7f5aa7fff640 1 --2- 172.21.15.117:0/958506188 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f5a94039580 0x7f5a9403ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:44.991 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:44.988+0000 7f5aa7fff640 1 --2- 172.21.15.117:0/958506188 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f5a94039580 0x7f5a9403ba30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5a90006fd0 tx=0x7f5a90006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:32:44.994 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:44.993+0000 7f5aa57fa640 1 -- 172.21.15.117:0/958506188 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f5aa810d320 con 0x7f5aa80fc1d0 2024-09-19T06:32:45.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:44 smithi099 ceph-mon[27651]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:45.209 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:45.208+0000 7f5aaf06e640 1 -- 172.21.15.117:0/958506188 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f5aa81025f0 con 0x7f5aa80fc1d0 2024-09-19T06:32:45.210 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:45.209+0000 7f5aa57fa640 1 -- 172.21.15.117:0/958506188 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f5a98041020 con 0x7f5aa80fc1d0 2024-09-19T06:32:45.210 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:32:45.210 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":1,"fsid":"a73eb958-7650-11ef-bceb-c7b262605968","modified":"2024-09-19T06:31:05.093105Z","created":"2024-09-19T06:31:05.093105Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi099","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:3300","nonce":0},{"type":"v1","addr":"172.21.15.99:6789","nonce":0}]},"addr":"172.21.15.99:6789/0","public_addr":"172.21.15.99:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T06:32:45.211 INFO:teuthology.orchestra.run.smithi117.stderr:dumped monmap epoch 1 2024-09-19T06:32:45.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:45.211+0000 7f5aaf06e640 1 -- 172.21.15.117:0/958506188 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f5a94039580 msgr2=0x7f5a9403ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:45.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:45.211+0000 7f5aaf06e640 1 --2- 172.21.15.117:0/958506188 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f5a94039580 0x7f5a9403ba30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5a90006fd0 tx=0x7f5a90006db0 comp rx=0 tx=0).stop 2024-09-19T06:32:45.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:45.211+0000 7f5aaf06e640 1 -- 172.21.15.117:0/958506188 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5aa80fc1d0 msgr2=0x7f5aa810c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:45.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:45.211+0000 7f5aaf06e640 1 --2- 172.21.15.117:0/958506188 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5aa80fc1d0 0x7f5aa810c710 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5a98003400 tx=0x7f5a98004d10 comp rx=0 tx=0).stop 2024-09-19T06:32:45.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:45.211+0000 7f5aaf06e640 1 -- 172.21.15.117:0/958506188 shutdown_connections 2024-09-19T06:32:45.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:45.211+0000 7f5aaf06e640 1 --2- 172.21.15.117:0/958506188 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f5a94039580 0x7f5a9403ba30 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:45.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:45.211+0000 7f5aaf06e640 1 --2- 172.21.15.117:0/958506188 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5aa80fc1d0 0x7f5aa810c710 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:45.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:45.211+0000 7f5aaf06e640 1 -- 172.21.15.117:0/958506188 >> 172.21.15.117:0/958506188 conn(0x7f5aa80f79b0 msgr2=0x7f5aa80f8260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:32:45.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:45.211+0000 7f5aaf06e640 1 -- 172.21.15.117:0/958506188 shutdown_connections 2024-09-19T06:32:45.213 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:45.211+0000 7f5aaf06e640 1 -- 172.21.15.117:0/958506188 wait complete. 2024-09-19T06:32:46.121 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:45 smithi099 ceph-mon[27651]: from='client.? 172.21.15.117:0/958506188' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T06:32:46.759 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-19T06:32:46.759 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T06:32:46.989 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T06:32:47.033 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T06:32:47.105 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:46 smithi099 ceph-mon[27651]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:48.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:48.337+0000 7f2365979640 1 -- 172.21.15.117:0/4124453912 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23600fc1d0 msgr2=0x7f23600fc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:48.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:48.337+0000 7f2365979640 1 --2- 172.21.15.117:0/4124453912 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23600fc1d0 0x7f23600fc5e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2350004850 tx=0x7f2350009da0 comp rx=0 tx=0).stop 2024-09-19T06:32:48.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:48.337+0000 7f2365979640 1 -- 172.21.15.117:0/4124453912 shutdown_connections 2024-09-19T06:32:48.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:48.337+0000 7f2365979640 1 --2- 172.21.15.117:0/4124453912 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23600fc1d0 0x7f23600fc5e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:48.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:48.337+0000 7f2365979640 1 -- 172.21.15.117:0/4124453912 >> 172.21.15.117:0/4124453912 conn(0x7f23600f79b0 msgr2=0x7f23600f9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:32:48.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:48.337+0000 7f2365979640 1 -- 172.21.15.117:0/4124453912 shutdown_connections 2024-09-19T06:32:48.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:48.337+0000 7f2365979640 1 -- 172.21.15.117:0/4124453912 wait complete. 2024-09-19T06:32:48.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:48.338+0000 7f2365979640 1 Processor -- start 2024-09-19T06:32:48.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:48.338+0000 7f2365979640 1 -- start start 2024-09-19T06:32:48.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:48.338+0000 7f2365979640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23600fc1d0 0x7f236010c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:48.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:48.338+0000 7f2365979640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f236010cc10 con 0x7f23600fc1d0 2024-09-19T06:32:48.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:48.338+0000 7f235effd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23600fc1d0 0x7f236010c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:48.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:48.338+0000 7f235effd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23600fc1d0 0x7f236010c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.117:37998/0 (socket says 172.21.15.117:37998) 2024-09-19T06:32:48.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:48.338+0000 7f235effd640 1 -- 172.21.15.117:0/3744495678 learned_addr learned my addr 172.21.15.117:0/3744495678 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T06:32:48.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:48.338+0000 7f235effd640 1 -- 172.21.15.117:0/3744495678 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2350005040 con 0x7f23600fc1d0 2024-09-19T06:32:48.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:48.338+0000 7f235effd640 1 --2- 172.21.15.117:0/3744495678 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23600fc1d0 0x7f236010c6d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f235002a6d0 tx=0x7f2350009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:32:48.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:48.339+0000 7f23477fe640 1 -- 172.21.15.117:0/3744495678 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2350033630 con 0x7f23600fc1d0 2024-09-19T06:32:48.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:48.339+0000 7f23477fe640 1 -- 172.21.15.117:0/3744495678 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2350033c30 con 0x7f23600fc1d0 2024-09-19T06:32:48.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:48.339+0000 7f2365979640 1 -- 172.21.15.117:0/3744495678 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f236010ce10 con 0x7f23600fc1d0 2024-09-19T06:32:48.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:48.339+0000 7f23477fe640 1 -- 172.21.15.117:0/3744495678 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f235003dc00 con 0x7f23600fc1d0 2024-09-19T06:32:48.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:48.339+0000 7f2365979640 1 -- 172.21.15.117:0/3744495678 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f236010d280 con 0x7f23600fc1d0 2024-09-19T06:32:48.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:48.339+0000 7f23477fe640 1 -- 172.21.15.117:0/3744495678 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7f2350030020 con 0x7f23600fc1d0 2024-09-19T06:32:48.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:48.340+0000 7f2365979640 1 -- 172.21.15.117:0/3744495678 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f236005ed70 con 0x7f23600fc1d0 2024-09-19T06:32:48.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:48.340+0000 7f23477fe640 1 --2- 172.21.15.117:0/3744495678 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f2348039580 0x7f234803ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:48.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:48.340+0000 7f23477fe640 1 -- 172.21.15.117:0/3744495678 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f235006c980 con 0x7f23600fc1d0 2024-09-19T06:32:48.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:48.340+0000 7f235e7fc640 1 --2- 172.21.15.117:0/3744495678 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f2348039580 0x7f234803ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:48.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:48.340+0000 7f235e7fc640 1 --2- 172.21.15.117:0/3744495678 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f2348039580 0x7f234803ba30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2354006fd0 tx=0x7f2354006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:32:48.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:48.344+0000 7f23477fe640 1 -- 172.21.15.117:0/3744495678 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f2350033790 con 0x7f23600fc1d0 2024-09-19T06:32:48.559 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:48.557+0000 7f2365979640 1 -- 172.21.15.117:0/3744495678 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f236004b720 con 0x7f23600fc1d0 2024-09-19T06:32:48.559 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:48.557+0000 7f23477fe640 1 -- 172.21.15.117:0/3744495678 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f2350042210 con 0x7f23600fc1d0 2024-09-19T06:32:48.560 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:32:48.560 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":1,"fsid":"a73eb958-7650-11ef-bceb-c7b262605968","modified":"2024-09-19T06:31:05.093105Z","created":"2024-09-19T06:31:05.093105Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi099","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:3300","nonce":0},{"type":"v1","addr":"172.21.15.99:6789","nonce":0}]},"addr":"172.21.15.99:6789/0","public_addr":"172.21.15.99:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T06:32:48.560 INFO:teuthology.orchestra.run.smithi117.stderr:dumped monmap epoch 1 2024-09-19T06:32:48.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:48.559+0000 7f2365979640 1 -- 172.21.15.117:0/3744495678 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f2348039580 msgr2=0x7f234803ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:48.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:48.559+0000 7f2365979640 1 --2- 172.21.15.117:0/3744495678 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f2348039580 0x7f234803ba30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2354006fd0 tx=0x7f2354006db0 comp rx=0 tx=0).stop 2024-09-19T06:32:48.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:48.559+0000 7f2365979640 1 -- 172.21.15.117:0/3744495678 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23600fc1d0 msgr2=0x7f236010c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:48.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:48.559+0000 7f2365979640 1 --2- 172.21.15.117:0/3744495678 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23600fc1d0 0x7f236010c6d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f235002a6d0 tx=0x7f2350009da0 comp rx=0 tx=0).stop 2024-09-19T06:32:48.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:48.559+0000 7f2365979640 1 -- 172.21.15.117:0/3744495678 shutdown_connections 2024-09-19T06:32:48.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:48.559+0000 7f2365979640 1 --2- 172.21.15.117:0/3744495678 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f2348039580 0x7f234803ba30 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:48.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:48.559+0000 7f2365979640 1 --2- 172.21.15.117:0/3744495678 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23600fc1d0 0x7f236010c6d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:48.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:48.559+0000 7f2365979640 1 -- 172.21.15.117:0/3744495678 >> 172.21.15.117:0/3744495678 conn(0x7f23600f79b0 msgr2=0x7f23600f81c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:32:48.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:48.559+0000 7f2365979640 1 -- 172.21.15.117:0/3744495678 shutdown_connections 2024-09-19T06:32:48.562 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:48.559+0000 7f2365979640 1 -- 172.21.15.117:0/3744495678 wait complete. 2024-09-19T06:32:48.970 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:48 smithi099 ceph-mon[27651]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:48.970 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:48 smithi099 ceph-mon[27651]: from='client.? 172.21.15.117:0/3744495678' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T06:32:48.970 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:48 smithi099 ceph-mon[27651]: from='mgr.14160 172.21.15.99:0/1563599924' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:32:48.970 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:48 smithi099 ceph-mon[27651]: from='mgr.14160 172.21.15.99:0/1563599924' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:32:48.971 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:48 smithi099 ceph-mon[27651]: from='mgr.14160 172.21.15.99:0/1563599924' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:32:48.971 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:48 smithi099 ceph-mon[27651]: from='mgr.14160 172.21.15.99:0/1563599924' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:32:48.971 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:48 smithi099 ceph-mon[27651]: from='mgr.14160 172.21.15.99:0/1563599924' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:32:48.971 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:48 smithi099 ceph-mon[27651]: from='mgr.14160 172.21.15.99:0/1563599924' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:32:50.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:49 smithi099 ceph-mon[27651]: Deploying daemon prometheus.smithi099 on smithi099 2024-09-19T06:32:50.220 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-19T06:32:50.220 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T06:32:50.462 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T06:32:50.506 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T06:32:51.126 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:50 smithi099 ceph-mon[27651]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:51.126 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:50 smithi099 ceph-mon[27651]: from='mgr.14160 172.21.15.99:0/1563599924' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:32:51.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:51.942+0000 7ff439a90640 1 -- 172.21.15.117:0/777982386 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4340655f0 msgr2=0x7ff4340ff050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:51.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:51.942+0000 7ff439a90640 1 --2- 172.21.15.117:0/777982386 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4340655f0 0x7ff4340ff050 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff424004850 tx=0x7ff424009da0 comp rx=0 tx=0).stop 2024-09-19T06:32:51.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:51.942+0000 7ff439a90640 1 -- 172.21.15.117:0/777982386 shutdown_connections 2024-09-19T06:32:51.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:51.942+0000 7ff439a90640 1 --2- 172.21.15.117:0/777982386 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4340655f0 0x7ff4340ff050 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:51.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:51.942+0000 7ff439a90640 1 -- 172.21.15.117:0/777982386 >> 172.21.15.117:0/777982386 conn(0x7ff4340f6ac0 msgr2=0x7ff4340f8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:32:51.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:51.942+0000 7ff439a90640 1 -- 172.21.15.117:0/777982386 shutdown_connections 2024-09-19T06:32:51.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:51.942+0000 7ff439a90640 1 -- 172.21.15.117:0/777982386 wait complete. 2024-09-19T06:32:51.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:51.942+0000 7ff439a90640 1 Processor -- start 2024-09-19T06:32:51.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:51.943+0000 7ff439a90640 1 -- start start 2024-09-19T06:32:51.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:51.943+0000 7ff439a90640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4340655f0 0x7ff43410c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:51.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:51.943+0000 7ff439a90640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff43410cea0 con 0x7ff4340655f0 2024-09-19T06:32:51.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:51.943+0000 7ff4337fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4340655f0 0x7ff43410c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:51.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:51.943+0000 7ff4337fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4340655f0 0x7ff43410c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.117:38012/0 (socket says 172.21.15.117:38012) 2024-09-19T06:32:51.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:51.943+0000 7ff4337fe640 1 -- 172.21.15.117:0/4036276017 learned_addr learned my addr 172.21.15.117:0/4036276017 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T06:32:51.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:51.943+0000 7ff4337fe640 1 -- 172.21.15.117:0/4036276017 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff424005040 con 0x7ff4340655f0 2024-09-19T06:32:51.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:51.944+0000 7ff4337fe640 1 --2- 172.21.15.117:0/4036276017 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4340655f0 0x7ff43410c960 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff4240041d0 tx=0x7ff424009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:32:51.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:51.944+0000 7ff430ff9640 1 -- 172.21.15.117:0/4036276017 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff424007a20 con 0x7ff4340655f0 2024-09-19T06:32:51.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:51.944+0000 7ff430ff9640 1 -- 172.21.15.117:0/4036276017 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff4240328e0 con 0x7ff4340655f0 2024-09-19T06:32:51.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:51.944+0000 7ff430ff9640 1 -- 172.21.15.117:0/4036276017 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff4240339f0 con 0x7ff4340655f0 2024-09-19T06:32:51.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:51.944+0000 7ff439a90640 1 -- 172.21.15.117:0/4036276017 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff43410d0a0 con 0x7ff4340655f0 2024-09-19T06:32:51.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:51.944+0000 7ff439a90640 1 -- 172.21.15.117:0/4036276017 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff43410d430 con 0x7ff4340655f0 2024-09-19T06:32:51.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:51.945+0000 7ff430ff9640 1 -- 172.21.15.117:0/4036276017 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7ff424030020 con 0x7ff4340655f0 2024-09-19T06:32:51.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:51.945+0000 7ff439a90640 1 -- 172.21.15.117:0/4036276017 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff43405ed70 con 0x7ff4340655f0 2024-09-19T06:32:51.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:51.945+0000 7ff430ff9640 1 --2- 172.21.15.117:0/4036276017 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7ff420039580 0x7ff42003ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:51.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:51.945+0000 7ff430ff9640 1 -- 172.21.15.117:0/4036276017 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7ff42406c130 con 0x7ff4340655f0 2024-09-19T06:32:51.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:51.945+0000 7ff42affd640 1 --2- 172.21.15.117:0/4036276017 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7ff420039580 0x7ff42003ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:51.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:51.945+0000 7ff42affd640 1 --2- 172.21.15.117:0/4036276017 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7ff420039580 0x7ff42003ba30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff41c006fd0 tx=0x7ff41c006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:32:51.951 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:51.949+0000 7ff430ff9640 1 -- 172.21.15.117:0/4036276017 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ff424032a50 con 0x7ff4340655f0 2024-09-19T06:32:52.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:52.166+0000 7ff439a90640 1 -- 172.21.15.117:0/4036276017 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ff4341021d0 con 0x7ff4340655f0 2024-09-19T06:32:52.169 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:52.167+0000 7ff430ff9640 1 -- 172.21.15.117:0/4036276017 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7ff4341021d0 con 0x7ff4340655f0 2024-09-19T06:32:52.169 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:32:52.169 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":1,"fsid":"a73eb958-7650-11ef-bceb-c7b262605968","modified":"2024-09-19T06:31:05.093105Z","created":"2024-09-19T06:31:05.093105Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi099","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:3300","nonce":0},{"type":"v1","addr":"172.21.15.99:6789","nonce":0}]},"addr":"172.21.15.99:6789/0","public_addr":"172.21.15.99:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T06:32:52.170 INFO:teuthology.orchestra.run.smithi117.stderr:dumped monmap epoch 1 2024-09-19T06:32:52.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:52.169+0000 7ff439a90640 1 -- 172.21.15.117:0/4036276017 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7ff420039580 msgr2=0x7ff42003ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:52.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:52.169+0000 7ff439a90640 1 --2- 172.21.15.117:0/4036276017 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7ff420039580 0x7ff42003ba30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff41c006fd0 tx=0x7ff41c006db0 comp rx=0 tx=0).stop 2024-09-19T06:32:52.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:52.169+0000 7ff439a90640 1 -- 172.21.15.117:0/4036276017 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4340655f0 msgr2=0x7ff43410c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:52.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:52.169+0000 7ff439a90640 1 --2- 172.21.15.117:0/4036276017 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4340655f0 0x7ff43410c960 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff4240041d0 tx=0x7ff424009da0 comp rx=0 tx=0).stop 2024-09-19T06:32:52.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:52.169+0000 7ff439a90640 1 -- 172.21.15.117:0/4036276017 shutdown_connections 2024-09-19T06:32:52.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:52.169+0000 7ff439a90640 1 --2- 172.21.15.117:0/4036276017 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7ff420039580 0x7ff42003ba30 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:52.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:52.169+0000 7ff439a90640 1 --2- 172.21.15.117:0/4036276017 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4340655f0 0x7ff43410c960 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:52.171 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:52.169+0000 7ff439a90640 1 -- 172.21.15.117:0/4036276017 >> 172.21.15.117:0/4036276017 conn(0x7ff4340f6ac0 msgr2=0x7ff4340f7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:32:52.172 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:52.169+0000 7ff439a90640 1 -- 172.21.15.117:0/4036276017 shutdown_connections 2024-09-19T06:32:52.172 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:52.169+0000 7ff439a90640 1 -- 172.21.15.117:0/4036276017 wait complete. 2024-09-19T06:32:53.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:52 smithi099 ceph-mon[27651]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:53.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:52 smithi099 ceph-mon[27651]: from='client.? 172.21.15.117:0/4036276017' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T06:32:53.755 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-19T06:32:53.755 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T06:32:53.998 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T06:32:54.042 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T06:32:55.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:54 smithi099 ceph-mon[27651]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:55.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:55.353+0000 7f8a3492e640 1 -- 172.21.15.117:0/3865228111 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a300fb2e0 msgr2=0x7f8a300fb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:55.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:55.353+0000 7f8a3492e640 1 --2- 172.21.15.117:0/3865228111 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a300fb2e0 0x7f8a300fb6f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8a20004850 tx=0x7f8a20009da0 comp rx=0 tx=0).stop 2024-09-19T06:32:55.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:55.353+0000 7f8a3492e640 1 -- 172.21.15.117:0/3865228111 shutdown_connections 2024-09-19T06:32:55.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:55.353+0000 7f8a3492e640 1 --2- 172.21.15.117:0/3865228111 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a300fb2e0 0x7f8a300fb6f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:55.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:55.353+0000 7f8a3492e640 1 -- 172.21.15.117:0/3865228111 >> 172.21.15.117:0/3865228111 conn(0x7f8a300f6ac0 msgr2=0x7f8a300f8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:32:55.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:55.353+0000 7f8a3492e640 1 -- 172.21.15.117:0/3865228111 shutdown_connections 2024-09-19T06:32:55.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:55.353+0000 7f8a3492e640 1 -- 172.21.15.117:0/3865228111 wait complete. 2024-09-19T06:32:55.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:55.353+0000 7f8a3492e640 1 Processor -- start 2024-09-19T06:32:55.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:55.354+0000 7f8a3492e640 1 -- start start 2024-09-19T06:32:55.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:55.354+0000 7f8a3492e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a300fb2e0 0x7f8a300f89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:55.357 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:55.354+0000 7f8a3492e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a300f8f20 con 0x7f8a300fb2e0 2024-09-19T06:32:55.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:55.354+0000 7f8a2e59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a300fb2e0 0x7f8a300f89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:55.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:55.354+0000 7f8a2e59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a300fb2e0 0x7f8a300f89e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.117:51048/0 (socket says 172.21.15.117:51048) 2024-09-19T06:32:55.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:55.354+0000 7f8a2e59c640 1 -- 172.21.15.117:0/2366936699 learned_addr learned my addr 172.21.15.117:0/2366936699 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T06:32:55.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:55.354+0000 7f8a2e59c640 1 -- 172.21.15.117:0/2366936699 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a20005040 con 0x7f8a300fb2e0 2024-09-19T06:32:55.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:55.354+0000 7f8a2e59c640 1 --2- 172.21.15.117:0/2366936699 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a300fb2e0 0x7f8a300f89e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8a2002a6d0 tx=0x7f8a20009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:32:55.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:55.354+0000 7f8a1effd640 1 -- 172.21.15.117:0/2366936699 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8a20033630 con 0x7f8a300fb2e0 2024-09-19T06:32:55.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:55.354+0000 7f8a1effd640 1 -- 172.21.15.117:0/2366936699 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8a20033c30 con 0x7f8a300fb2e0 2024-09-19T06:32:55.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:55.354+0000 7f8a3492e640 1 -- 172.21.15.117:0/2366936699 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a300f6fb0 con 0x7f8a300fb2e0 2024-09-19T06:32:55.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:55.354+0000 7f8a1effd640 1 -- 172.21.15.117:0/2366936699 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8a2003dc00 con 0x7f8a300fb2e0 2024-09-19T06:32:55.358 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:55.355+0000 7f8a3492e640 1 -- 172.21.15.117:0/2366936699 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a300f7420 con 0x7f8a300fb2e0 2024-09-19T06:32:55.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:55.355+0000 7f8a1effd640 1 -- 172.21.15.117:0/2366936699 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7f8a20030020 con 0x7f8a300fb2e0 2024-09-19T06:32:55.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:55.355+0000 7f8a3492e640 1 -- 172.21.15.117:0/2366936699 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a3005ed70 con 0x7f8a300fb2e0 2024-09-19T06:32:55.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:55.356+0000 7f8a1effd640 1 --2- 172.21.15.117:0/2366936699 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f8a18039580 0x7f8a1803ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:55.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:55.356+0000 7f8a1effd640 1 -- 172.21.15.117:0/2366936699 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f8a2006cbf0 con 0x7f8a300fb2e0 2024-09-19T06:32:55.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:55.356+0000 7f8a2dd9b640 1 --2- 172.21.15.117:0/2366936699 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f8a18039580 0x7f8a1803ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:55.359 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:55.356+0000 7f8a2dd9b640 1 --2- 172.21.15.117:0/2366936699 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f8a18039580 0x7f8a1803ba30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8a24006fd0 tx=0x7f8a24006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:32:55.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:55.360+0000 7f8a1effd640 1 -- 172.21.15.117:0/2366936699 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f8a20047440 con 0x7f8a300fb2e0 2024-09-19T06:32:55.572 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:55.570+0000 7f8a3492e640 1 -- 172.21.15.117:0/2366936699 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f8a3004b720 con 0x7f8a300fb2e0 2024-09-19T06:32:55.573 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:55.571+0000 7f8a1effd640 1 -- 172.21.15.117:0/2366936699 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f8a2003b370 con 0x7f8a300fb2e0 2024-09-19T06:32:55.573 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:32:55.573 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":1,"fsid":"a73eb958-7650-11ef-bceb-c7b262605968","modified":"2024-09-19T06:31:05.093105Z","created":"2024-09-19T06:31:05.093105Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi099","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:3300","nonce":0},{"type":"v1","addr":"172.21.15.99:6789","nonce":0}]},"addr":"172.21.15.99:6789/0","public_addr":"172.21.15.99:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T06:32:55.574 INFO:teuthology.orchestra.run.smithi117.stderr:dumped monmap epoch 1 2024-09-19T06:32:55.575 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:55.573+0000 7f8a3492e640 1 -- 172.21.15.117:0/2366936699 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f8a18039580 msgr2=0x7f8a1803ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:55.575 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:55.573+0000 7f8a3492e640 1 --2- 172.21.15.117:0/2366936699 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f8a18039580 0x7f8a1803ba30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8a24006fd0 tx=0x7f8a24006db0 comp rx=0 tx=0).stop 2024-09-19T06:32:55.575 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:55.573+0000 7f8a3492e640 1 -- 172.21.15.117:0/2366936699 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a300fb2e0 msgr2=0x7f8a300f89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:55.575 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:55.573+0000 7f8a3492e640 1 --2- 172.21.15.117:0/2366936699 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a300fb2e0 0x7f8a300f89e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8a2002a6d0 tx=0x7f8a20009da0 comp rx=0 tx=0).stop 2024-09-19T06:32:55.575 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:55.573+0000 7f8a3492e640 1 -- 172.21.15.117:0/2366936699 shutdown_connections 2024-09-19T06:32:55.575 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:55.573+0000 7f8a3492e640 1 --2- 172.21.15.117:0/2366936699 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f8a18039580 0x7f8a1803ba30 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:55.575 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:55.573+0000 7f8a3492e640 1 --2- 172.21.15.117:0/2366936699 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a300fb2e0 0x7f8a300f89e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:55.575 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:55.573+0000 7f8a3492e640 1 -- 172.21.15.117:0/2366936699 >> 172.21.15.117:0/2366936699 conn(0x7f8a300f6ac0 msgr2=0x7f8a30064990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:32:55.576 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:55.573+0000 7f8a3492e640 1 -- 172.21.15.117:0/2366936699 shutdown_connections 2024-09-19T06:32:55.576 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:55.573+0000 7f8a3492e640 1 -- 172.21.15.117:0/2366936699 wait complete. 2024-09-19T06:32:56.076 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:55 smithi099 ceph-mon[27651]: from='client.? 172.21.15.117:0/2366936699' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T06:32:57.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:56 smithi099 ceph-mon[27651]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:32:57.090 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-19T06:32:57.090 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T06:32:57.327 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T06:32:57.371 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T06:32:58.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:58.798+0000 7f0aa3cb1640 1 -- 172.21.15.117:0/2426285296 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a9c0fb6c0 msgr2=0x7f0a9c0fbad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:58.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:58.798+0000 7f0aa3cb1640 1 --2- 172.21.15.117:0/2426285296 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a9c0fb6c0 0x7f0a9c0fbad0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0a90004850 tx=0x7f0a90009da0 comp rx=0 tx=0).stop 2024-09-19T06:32:58.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:58.798+0000 7f0aa3cb1640 1 -- 172.21.15.117:0/2426285296 shutdown_connections 2024-09-19T06:32:58.800 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:58.798+0000 7f0aa3cb1640 1 --2- 172.21.15.117:0/2426285296 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a9c0fb6c0 0x7f0a9c0fbad0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:58.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:58.798+0000 7f0aa3cb1640 1 -- 172.21.15.117:0/2426285296 >> 172.21.15.117:0/2426285296 conn(0x7f0a9c0f6010 msgr2=0x7f0a9c0f8440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:32:58.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:58.799+0000 7f0aa3cb1640 1 -- 172.21.15.117:0/2426285296 shutdown_connections 2024-09-19T06:32:58.801 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:58.799+0000 7f0aa3cb1640 1 -- 172.21.15.117:0/2426285296 wait complete. 2024-09-19T06:32:58.802 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:58.799+0000 7f0aa3cb1640 1 Processor -- start 2024-09-19T06:32:58.802 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:58.799+0000 7f0aa3cb1640 1 -- start start 2024-09-19T06:32:58.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:58.799+0000 7f0aa3cb1640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a9c0fb6c0 0x7f0a9c10b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:58.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:58.799+0000 7f0aa3cb1640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9c10bbe0 con 0x7f0a9c0fb6c0 2024-09-19T06:32:58.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:58.800+0000 7f0aa1a4d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a9c0fb6c0 0x7f0a9c10b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:58.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:58.800+0000 7f0aa1a4d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a9c0fb6c0 0x7f0a9c10b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.117:51062/0 (socket says 172.21.15.117:51062) 2024-09-19T06:32:58.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:58.800+0000 7f0aa1a4d640 1 -- 172.21.15.117:0/2668628659 learned_addr learned my addr 172.21.15.117:0/2668628659 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T06:32:58.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:58.800+0000 7f0aa1a4d640 1 -- 172.21.15.117:0/2668628659 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a90005040 con 0x7f0a9c0fb6c0 2024-09-19T06:32:58.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:58.800+0000 7f0aa1a4d640 1 --2- 172.21.15.117:0/2668628659 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a9c0fb6c0 0x7f0a9c10b6a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0a90009920 tx=0x7f0a90009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:32:58.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:58.800+0000 7f0a8e7fc640 1 -- 172.21.15.117:0/2668628659 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0a90033630 con 0x7f0a9c0fb6c0 2024-09-19T06:32:58.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:58.800+0000 7f0a8e7fc640 1 -- 172.21.15.117:0/2668628659 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0a90033c30 con 0x7f0a9c0fb6c0 2024-09-19T06:32:58.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:58.800+0000 7f0aa3cb1640 1 -- 172.21.15.117:0/2668628659 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a9c10bde0 con 0x7f0a9c0fb6c0 2024-09-19T06:32:58.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:58.800+0000 7f0a8e7fc640 1 -- 172.21.15.117:0/2668628659 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0a9003dbc0 con 0x7f0a9c0fb6c0 2024-09-19T06:32:58.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:58.800+0000 7f0aa3cb1640 1 -- 172.21.15.117:0/2668628659 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a9c10c250 con 0x7f0a9c0fb6c0 2024-09-19T06:32:58.803 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:58.801+0000 7f0a8e7fc640 1 -- 172.21.15.117:0/2668628659 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7f0a90030020 con 0x7f0a9c0fb6c0 2024-09-19T06:32:58.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:58.801+0000 7f0aa3cb1640 1 -- 172.21.15.117:0/2668628659 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a9c05ed70 con 0x7f0a9c0fb6c0 2024-09-19T06:32:58.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:58.801+0000 7f0a8e7fc640 1 --2- 172.21.15.117:0/2668628659 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f0a88039580 0x7f0a8803ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:32:58.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:58.801+0000 7f0a8e7fc640 1 -- 172.21.15.117:0/2668628659 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f0a9006c960 con 0x7f0a9c0fb6c0 2024-09-19T06:32:58.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:58.801+0000 7f0aa124c640 1 --2- 172.21.15.117:0/2668628659 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f0a88039580 0x7f0a8803ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:32:58.804 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:58.802+0000 7f0aa124c640 1 --2- 172.21.15.117:0/2668628659 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f0a88039580 0x7f0a8803ba30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0a98006fd0 tx=0x7f0a98006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:32:58.807 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:58.806+0000 7f0a8e7fc640 1 -- 172.21.15.117:0/2668628659 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f0a90045800 con 0x7f0a9c0fb6c0 2024-09-19T06:32:59.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:59.019+0000 7f0aa3cb1640 1 -- 172.21.15.117:0/2668628659 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f0a9c04b720 con 0x7f0a9c0fb6c0 2024-09-19T06:32:59.021 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:59.020+0000 7f0a8e7fc640 1 -- 172.21.15.117:0/2668628659 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f0a90045800 con 0x7f0a9c0fb6c0 2024-09-19T06:32:59.022 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:32:59.022 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":1,"fsid":"a73eb958-7650-11ef-bceb-c7b262605968","modified":"2024-09-19T06:31:05.093105Z","created":"2024-09-19T06:31:05.093105Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi099","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:3300","nonce":0},{"type":"v1","addr":"172.21.15.99:6789","nonce":0}]},"addr":"172.21.15.99:6789/0","public_addr":"172.21.15.99:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T06:32:59.022 INFO:teuthology.orchestra.run.smithi117.stderr:dumped monmap epoch 1 2024-09-19T06:32:59.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:59.022+0000 7f0aa3cb1640 1 -- 172.21.15.117:0/2668628659 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f0a88039580 msgr2=0x7f0a8803ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:59.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:59.022+0000 7f0aa3cb1640 1 --2- 172.21.15.117:0/2668628659 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f0a88039580 0x7f0a8803ba30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0a98006fd0 tx=0x7f0a98006db0 comp rx=0 tx=0).stop 2024-09-19T06:32:59.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:59.022+0000 7f0aa3cb1640 1 -- 172.21.15.117:0/2668628659 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a9c0fb6c0 msgr2=0x7f0a9c10b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:32:59.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:59.022+0000 7f0aa3cb1640 1 --2- 172.21.15.117:0/2668628659 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a9c0fb6c0 0x7f0a9c10b6a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0a90009920 tx=0x7f0a90009da0 comp rx=0 tx=0).stop 2024-09-19T06:32:59.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:59.022+0000 7f0aa3cb1640 1 -- 172.21.15.117:0/2668628659 shutdown_connections 2024-09-19T06:32:59.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:59.022+0000 7f0aa3cb1640 1 --2- 172.21.15.117:0/2668628659 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f0a88039580 0x7f0a8803ba30 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:59.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:59.022+0000 7f0aa3cb1640 1 --2- 172.21.15.117:0/2668628659 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a9c0fb6c0 0x7f0a9c10b6a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:32:59.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:59.022+0000 7f0aa3cb1640 1 -- 172.21.15.117:0/2668628659 >> 172.21.15.117:0/2668628659 conn(0x7f0a9c0f6010 msgr2=0x7f0a9c0f68f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:32:59.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:59.022+0000 7f0aa3cb1640 1 -- 172.21.15.117:0/2668628659 shutdown_connections 2024-09-19T06:32:59.025 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:32:59.022+0000 7f0aa3cb1640 1 -- 172.21.15.117:0/2668628659 wait complete. 2024-09-19T06:32:59.056 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:58 smithi099 ceph-mon[27651]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:33:00.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:59 smithi099 ceph-mon[27651]: from='client.? 172.21.15.117:0/2668628659' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T06:33:00.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:59 smithi099 ceph-mon[27651]: from='mgr.14160 172.21.15.99:0/1563599924' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:00.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:59 smithi099 ceph-mon[27651]: from='mgr.14160 172.21.15.99:0/1563599924' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:00.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:59 smithi099 ceph-mon[27651]: from='mgr.14160 172.21.15.99:0/1563599924' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:00.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:32:59 smithi099 ceph-mon[27651]: from='mgr.14160 172.21.15.99:0/1563599924' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-19T06:33:00.602 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-19T06:33:00.603 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T06:33:00.848 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T06:33:00.890 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T06:33:00.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:00 smithi099 ceph-mon[27651]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:33:00.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:00 smithi099 ceph-mon[27651]: from='mgr.14160 172.21.15.99:0/1563599924' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-19T06:33:00.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:00 smithi099 ceph-mon[27651]: mgrmap e14: smithi099.pgvkqi(active, since 54s) 2024-09-19T06:33:02.286 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:02.284+0000 7f63286f3640 1 -- 172.21.15.117:0/541862007 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63200fc1d0 msgr2=0x7f63200fc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:33:02.287 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:02.284+0000 7f63286f3640 1 --2- 172.21.15.117:0/541862007 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63200fc1d0 0x7f63200fc5e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f631c004850 tx=0x7f631c009da0 comp rx=0 tx=0).stop 2024-09-19T06:33:02.287 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:02.284+0000 7f63286f3640 1 -- 172.21.15.117:0/541862007 shutdown_connections 2024-09-19T06:33:02.287 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:02.284+0000 7f63286f3640 1 --2- 172.21.15.117:0/541862007 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63200fc1d0 0x7f63200fc5e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:33:02.287 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:02.284+0000 7f63286f3640 1 -- 172.21.15.117:0/541862007 >> 172.21.15.117:0/541862007 conn(0x7f63200f79b0 msgr2=0x7f63200f9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:33:02.287 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:02.284+0000 7f63286f3640 1 -- 172.21.15.117:0/541862007 shutdown_connections 2024-09-19T06:33:02.287 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:02.284+0000 7f63286f3640 1 -- 172.21.15.117:0/541862007 wait complete. 2024-09-19T06:33:02.287 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:02.285+0000 7f63286f3640 1 Processor -- start 2024-09-19T06:33:02.287 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:02.285+0000 7f63286f3640 1 -- start start 2024-09-19T06:33:02.287 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:02.285+0000 7f63286f3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63200fc1d0 0x7f632010c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:33:02.287 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:02.285+0000 7f63286f3640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f632010cc10 con 0x7f63200fc1d0 2024-09-19T06:33:02.287 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:02.285+0000 7f632648f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63200fc1d0 0x7f632010c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:33:02.288 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:02.285+0000 7f632648f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63200fc1d0 0x7f632010c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.117:51078/0 (socket says 172.21.15.117:51078) 2024-09-19T06:33:02.288 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:02.285+0000 7f632648f640 1 -- 172.21.15.117:0/430207826 learned_addr learned my addr 172.21.15.117:0/430207826 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T06:33:02.288 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:02.285+0000 7f632648f640 1 -- 172.21.15.117:0/430207826 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f631c005040 con 0x7f63200fc1d0 2024-09-19T06:33:02.289 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:02.286+0000 7f632648f640 1 --2- 172.21.15.117:0/430207826 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63200fc1d0 0x7f632010c6d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f631c02a6d0 tx=0x7f631c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:33:02.289 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:02.286+0000 7f6316ffd640 1 -- 172.21.15.117:0/430207826 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f631c033630 con 0x7f63200fc1d0 2024-09-19T06:33:02.289 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:02.286+0000 7f6316ffd640 1 -- 172.21.15.117:0/430207826 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f631c033c30 con 0x7f63200fc1d0 2024-09-19T06:33:02.289 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:02.286+0000 7f63286f3640 1 -- 172.21.15.117:0/430207826 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f632010ce10 con 0x7f63200fc1d0 2024-09-19T06:33:02.289 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:02.286+0000 7f6316ffd640 1 -- 172.21.15.117:0/430207826 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f631c03dc00 con 0x7f63200fc1d0 2024-09-19T06:33:02.289 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:02.286+0000 7f63286f3640 1 -- 172.21.15.117:0/430207826 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f632010d280 con 0x7f63200fc1d0 2024-09-19T06:33:02.289 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:02.287+0000 7f6316ffd640 1 -- 172.21.15.117:0/430207826 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 45577+0+0 (secure 0 0 0) 0x7f631c030020 con 0x7f63200fc1d0 2024-09-19T06:33:02.289 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:02.287+0000 7f6316ffd640 1 --2- 172.21.15.117:0/430207826 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f630c0395d0 0x7f630c03ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:33:02.289 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:02.287+0000 7f6316ffd640 1 -- 172.21.15.117:0/430207826 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f631c06c9d0 con 0x7f63200fc1d0 2024-09-19T06:33:02.290 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:02.287+0000 7f6325c8e640 1 -- 172.21.15.117:0/430207826 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f630c0395d0 msgr2=0x7f630c03ba80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.99:6800/2333024932 2024-09-19T06:33:02.290 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:02.287+0000 7f63286f3640 1 -- 172.21.15.117:0/430207826 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63201025f0 con 0x7f63200fc1d0 2024-09-19T06:33:02.290 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:02.287+0000 7f6325c8e640 1 --2- 172.21.15.117:0/430207826 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f630c0395d0 0x7f630c03ba80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T06:33:02.293 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:02.292+0000 7f6316ffd640 1 -- 172.21.15.117:0/430207826 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f631c03b730 con 0x7f63200fc1d0 2024-09-19T06:33:02.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:02.488+0000 7f6325c8e640 1 -- 172.21.15.117:0/430207826 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f630c0395d0 msgr2=0x7f630c03ba80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.99:6800/2333024932 2024-09-19T06:33:02.489 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:02.488+0000 7f6325c8e640 1 --2- 172.21.15.117:0/430207826 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f630c0395d0 0x7f630c03ba80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T06:33:02.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:02.505+0000 7f63286f3640 1 -- 172.21.15.117:0/430207826 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f632005ed70 con 0x7f63200fc1d0 2024-09-19T06:33:02.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:02.506+0000 7f6316ffd640 1 -- 172.21.15.117:0/430207826 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f631c03b370 con 0x7f63200fc1d0 2024-09-19T06:33:02.507 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:33:02.507 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":1,"fsid":"a73eb958-7650-11ef-bceb-c7b262605968","modified":"2024-09-19T06:31:05.093105Z","created":"2024-09-19T06:31:05.093105Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi099","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:3300","nonce":0},{"type":"v1","addr":"172.21.15.99:6789","nonce":0}]},"addr":"172.21.15.99:6789/0","public_addr":"172.21.15.99:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T06:33:02.508 INFO:teuthology.orchestra.run.smithi117.stderr:dumped monmap epoch 1 2024-09-19T06:33:02.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:02.508+0000 7f63286f3640 1 -- 172.21.15.117:0/430207826 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f630c0395d0 msgr2=0x7f630c03ba80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:33:02.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:02.508+0000 7f63286f3640 1 --2- 172.21.15.117:0/430207826 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f630c0395d0 0x7f630c03ba80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:33:02.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:02.508+0000 7f63286f3640 1 -- 172.21.15.117:0/430207826 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63200fc1d0 msgr2=0x7f632010c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:33:02.509 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:02.508+0000 7f63286f3640 1 --2- 172.21.15.117:0/430207826 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63200fc1d0 0x7f632010c6d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f631c02a6d0 tx=0x7f631c009da0 comp rx=0 tx=0).stop 2024-09-19T06:33:02.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:02.508+0000 7f63286f3640 1 -- 172.21.15.117:0/430207826 shutdown_connections 2024-09-19T06:33:02.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:02.508+0000 7f63286f3640 1 --2- 172.21.15.117:0/430207826 >> [v2:172.21.15.99:6800/2333024932,v1:172.21.15.99:6801/2333024932] conn(0x7f630c0395d0 0x7f630c03ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:33:02.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:02.508+0000 7f63286f3640 1 --2- 172.21.15.117:0/430207826 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63200fc1d0 0x7f632010c6d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:33:02.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:02.508+0000 7f63286f3640 1 -- 172.21.15.117:0/430207826 >> 172.21.15.117:0/430207826 conn(0x7f63200f79b0 msgr2=0x7f63200f81c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:33:02.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:02.508+0000 7f63286f3640 1 -- 172.21.15.117:0/430207826 shutdown_connections 2024-09-19T06:33:02.510 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:02.508+0000 7f63286f3640 1 -- 172.21.15.117:0/430207826 wait complete. 2024-09-19T06:33:02.874 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:02 smithi099 ceph-mon[27651]: from='client.? 172.21.15.117:0/430207826' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T06:33:04.063 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-19T06:33:04.063 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T06:33:04.304 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T06:33:04.348 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T06:33:04.773 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:04 smithi099 ceph-mon[27651]: Active manager daemon smithi099.pgvkqi restarted 2024-09-19T06:33:04.773 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:04 smithi099 ceph-mon[27651]: Activating manager daemon smithi099.pgvkqi 2024-09-19T06:33:04.774 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:04 smithi099 ceph-mon[27651]: osdmap e5: 0 total, 0 up, 0 in 2024-09-19T06:33:04.774 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:04 smithi099 ceph-mon[27651]: mgrmap e15: smithi099.pgvkqi(active, starting, since 0.0057515s) 2024-09-19T06:33:04.774 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:04 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mon metadata", "id": "smithi099"}]: dispatch 2024-09-19T06:33:04.774 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:04 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mgr metadata", "who": "smithi099.pgvkqi", "id": "smithi099.pgvkqi"}]: dispatch 2024-09-19T06:33:04.774 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:04 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T06:33:04.774 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:04 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T06:33:04.774 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:04 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T06:33:04.774 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:04 smithi099 ceph-mon[27651]: Manager daemon smithi099.pgvkqi is now available 2024-09-19T06:33:04.774 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:04 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:33:04.774 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:04 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:04.774 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:04 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:33:05.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:05 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi099.pgvkqi/mirror_snapshot_schedule"}]: dispatch 2024-09-19T06:33:05.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:05 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi099.pgvkqi/trash_purge_schedule"}]: dispatch 2024-09-19T06:33:05.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:05 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:05.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:05 smithi099 ceph-mon[27651]: mgrmap e16: smithi099.pgvkqi(active, since 1.00592s) 2024-09-19T06:33:05.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:05.763+0000 7f1ed788a640 1 -- 172.21.15.117:0/2337252178 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1ed00fb0c0 msgr2=0x7f1ed00fb4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:33:05.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:05.763+0000 7f1ed788a640 1 --2- 172.21.15.117:0/2337252178 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1ed00fb0c0 0x7f1ed00fb4d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1ec8004850 tx=0x7f1ec8009da0 comp rx=0 tx=0).stop 2024-09-19T06:33:05.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:05.763+0000 7f1ed788a640 1 -- 172.21.15.117:0/2337252178 shutdown_connections 2024-09-19T06:33:05.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:05.763+0000 7f1ed788a640 1 --2- 172.21.15.117:0/2337252178 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1ed00fb0c0 0x7f1ed00fb4d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:33:05.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:05.763+0000 7f1ed788a640 1 -- 172.21.15.117:0/2337252178 >> 172.21.15.117:0/2337252178 conn(0x7f1ed00f6880 msgr2=0x7f1ed00f8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:33:05.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:05.763+0000 7f1ed788a640 1 -- 172.21.15.117:0/2337252178 shutdown_connections 2024-09-19T06:33:05.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:05.763+0000 7f1ed788a640 1 -- 172.21.15.117:0/2337252178 wait complete. 2024-09-19T06:33:05.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:05.764+0000 7f1ed788a640 1 Processor -- start 2024-09-19T06:33:05.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:05.764+0000 7f1ed788a640 1 -- start start 2024-09-19T06:33:05.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:05.764+0000 7f1ed788a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1ed00fb0c0 0x7f1ed010b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:33:05.772 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:05.764+0000 7f1ed788a640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed010bb10 con 0x7f1ed00fb0c0 2024-09-19T06:33:05.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:05.764+0000 7f1ed5626640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1ed00fb0c0 0x7f1ed010b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:33:05.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:05.764+0000 7f1ed5626640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1ed00fb0c0 0x7f1ed010b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.117:51346/0 (socket says 172.21.15.117:51346) 2024-09-19T06:33:05.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:05.764+0000 7f1ed5626640 1 -- 172.21.15.117:0/1180888961 learned_addr learned my addr 172.21.15.117:0/1180888961 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T06:33:05.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:05.764+0000 7f1ed5626640 1 -- 172.21.15.117:0/1180888961 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ec8005040 con 0x7f1ed00fb0c0 2024-09-19T06:33:05.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:05.764+0000 7f1ed5626640 1 --2- 172.21.15.117:0/1180888961 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1ed00fb0c0 0x7f1ed010b5d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1ec802a6d0 tx=0x7f1ec8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:33:05.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:05.765+0000 7f1ecdffb640 1 -- 172.21.15.117:0/1180888961 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1ec8033630 con 0x7f1ed00fb0c0 2024-09-19T06:33:05.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:05.765+0000 7f1ecdffb640 1 -- 172.21.15.117:0/1180888961 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1ec8033c30 con 0x7f1ed00fb0c0 2024-09-19T06:33:05.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:05.765+0000 7f1ed788a640 1 -- 172.21.15.117:0/1180888961 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ed010bd10 con 0x7f1ed00fb0c0 2024-09-19T06:33:05.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:05.765+0000 7f1ecdffb640 1 -- 172.21.15.117:0/1180888961 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1ec803dc00 con 0x7f1ed00fb0c0 2024-09-19T06:33:05.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:05.765+0000 7f1ed788a640 1 -- 172.21.15.117:0/1180888961 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ed010c180 con 0x7f1ed00fb0c0 2024-09-19T06:33:05.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:05.766+0000 7f1ecdffb640 1 -- 172.21.15.117:0/1180888961 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 16) v1 ==== 45428+0+0 (secure 0 0 0) 0x7f1ec8030020 con 0x7f1ed00fb0c0 2024-09-19T06:33:05.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:05.766+0000 7f1ed788a640 1 -- 172.21.15.117:0/1180888961 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ed005ed70 con 0x7f1ed00fb0c0 2024-09-19T06:33:05.773 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:05.766+0000 7f1ecdffb640 1 --2- 172.21.15.117:0/1180888961 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f1eb8039460 0x7f1eb803b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:33:05.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:05.766+0000 7f1ecdffb640 1 -- 172.21.15.117:0/1180888961 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f1ec806c900 con 0x7f1ed00fb0c0 2024-09-19T06:33:05.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:05.766+0000 7f1ed4e25640 1 --2- 172.21.15.117:0/1180888961 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f1eb8039460 0x7f1eb803b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:33:05.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:05.766+0000 7f1ed4e25640 1 --2- 172.21.15.117:0/1180888961 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f1eb8039460 0x7f1eb803b910 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f1ec4006fd0 tx=0x7f1ec4006db0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:33:05.774 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:05.770+0000 7f1ecdffb640 1 -- 172.21.15.117:0/1180888961 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f1ec8047440 con 0x7f1ed00fb0c0 2024-09-19T06:33:06.023 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:06.022+0000 7f1ed788a640 1 -- 172.21.15.117:0/1180888961 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f1ed004b720 con 0x7f1ed00fb0c0 2024-09-19T06:33:06.024 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:06.022+0000 7f1ecdffb640 1 -- 172.21.15.117:0/1180888961 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f1ec8045b80 con 0x7f1ed00fb0c0 2024-09-19T06:33:06.024 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:33:06.024 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":1,"fsid":"a73eb958-7650-11ef-bceb-c7b262605968","modified":"2024-09-19T06:31:05.093105Z","created":"2024-09-19T06:31:05.093105Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi099","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:3300","nonce":0},{"type":"v1","addr":"172.21.15.99:6789","nonce":0}]},"addr":"172.21.15.99:6789/0","public_addr":"172.21.15.99:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T06:33:06.024 INFO:teuthology.orchestra.run.smithi117.stderr:dumped monmap epoch 1 2024-09-19T06:33:06.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:06.026+0000 7f1ed788a640 1 -- 172.21.15.117:0/1180888961 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f1eb8039460 msgr2=0x7f1eb803b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:33:06.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:06.026+0000 7f1ed788a640 1 --2- 172.21.15.117:0/1180888961 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f1eb8039460 0x7f1eb803b910 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f1ec4006fd0 tx=0x7f1ec4006db0 comp rx=0 tx=0).stop 2024-09-19T06:33:06.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:06.026+0000 7f1ed788a640 1 -- 172.21.15.117:0/1180888961 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1ed00fb0c0 msgr2=0x7f1ed010b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:33:06.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:06.026+0000 7f1ed788a640 1 --2- 172.21.15.117:0/1180888961 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1ed00fb0c0 0x7f1ed010b5d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1ec802a6d0 tx=0x7f1ec8009da0 comp rx=0 tx=0).stop 2024-09-19T06:33:06.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:06.026+0000 7f1ed788a640 1 -- 172.21.15.117:0/1180888961 shutdown_connections 2024-09-19T06:33:06.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:06.026+0000 7f1ed788a640 1 --2- 172.21.15.117:0/1180888961 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f1eb8039460 0x7f1eb803b910 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:33:06.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:06.026+0000 7f1ed788a640 1 --2- 172.21.15.117:0/1180888961 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1ed00fb0c0 0x7f1ed010b5d0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:33:06.027 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:06.026+0000 7f1ed788a640 1 -- 172.21.15.117:0/1180888961 >> 172.21.15.117:0/1180888961 conn(0x7f1ed00f6880 msgr2=0x7f1ed00f70e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:33:06.028 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:06.026+0000 7f1ed788a640 1 -- 172.21.15.117:0/1180888961 shutdown_connections 2024-09-19T06:33:06.028 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:06.026+0000 7f1ed788a640 1 -- 172.21.15.117:0/1180888961 wait complete. 2024-09-19T06:33:07.054 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:06 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:07.055 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:06 smithi099 ceph-mon[27651]: from='client.? 172.21.15.117:0/1180888961' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T06:33:07.055 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:06 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:07.055 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:06 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:07.628 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-19T06:33:07.628 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T06:33:07.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:07 smithi099 ceph-mon[27651]: [19/Sep/2024:06:33:06] ENGINE Bus STARTING 2024-09-19T06:33:07.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:07 smithi099 ceph-mon[27651]: [19/Sep/2024:06:33:06] ENGINE Serving on https://172.21.15.99:7150 2024-09-19T06:33:07.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:07 smithi099 ceph-mon[27651]: [19/Sep/2024:06:33:06] ENGINE Bus STARTED 2024-09-19T06:33:07.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:07 smithi099 ceph-mon[27651]: [19/Sep/2024:06:33:06] ENGINE Error in HTTPServer.serve 2024-09-19T06:33:07.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Traceback (most recent call last): 2024-09-19T06:33:07.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T06:33:07.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: self._connections.run(self.expiration_interval) 2024-09-19T06:33:07.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T06:33:07.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: self._run(expiration_interval) 2024-09-19T06:33:07.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T06:33:07.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T06:33:07.958 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T06:33:07.958 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T06:33:07.958 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T06:33:07.958 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: s = self.context.wrap_socket( 2024-09-19T06:33:07.958 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T06:33:07.958 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: return self.sslsocket_class._create( 2024-09-19T06:33:07.958 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T06:33:07.958 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: self.do_handshake() 2024-09-19T06:33:07.958 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T06:33:07.958 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: self._sslobj.do_handshake() 2024-09-19T06:33:07.958 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T06:33:07.958 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:07 smithi099 ceph-mon[27651]: mgrmap e17: smithi099.pgvkqi(active, since 2s) 2024-09-19T06:33:08.477 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T06:33:08.530 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T06:33:10.111 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:10.103+0000 7f3952740640 1 -- 172.21.15.117:0/1696141377 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f394c0fc1b0 msgr2=0x7f394c0fc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:33:10.111 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:10.103+0000 7f3952740640 1 --2- 172.21.15.117:0/1696141377 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f394c0fc1b0 0x7f394c0fc5c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f393c004850 tx=0x7f393c009da0 comp rx=0 tx=0).stop 2024-09-19T06:33:10.112 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:10.103+0000 7f3952740640 1 -- 172.21.15.117:0/1696141377 shutdown_connections 2024-09-19T06:33:10.112 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:10.103+0000 7f3952740640 1 --2- 172.21.15.117:0/1696141377 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f394c0fc1b0 0x7f394c0fc5c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:33:10.112 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:10.103+0000 7f3952740640 1 -- 172.21.15.117:0/1696141377 >> 172.21.15.117:0/1696141377 conn(0x7f394c0f7990 msgr2=0x7f394c0f9da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:33:10.112 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:10.103+0000 7f3952740640 1 -- 172.21.15.117:0/1696141377 shutdown_connections 2024-09-19T06:33:10.112 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:10.103+0000 7f3952740640 1 -- 172.21.15.117:0/1696141377 wait complete. 2024-09-19T06:33:10.112 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:10.104+0000 7f3952740640 1 Processor -- start 2024-09-19T06:33:10.112 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:10.104+0000 7f3952740640 1 -- start start 2024-09-19T06:33:10.112 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:10.104+0000 7f3952740640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f394c0fc1b0 0x7f394c10c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:33:10.112 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:10.104+0000 7f3952740640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f394c10cc30 con 0x7f394c0fc1b0 2024-09-19T06:33:10.113 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:10.104+0000 7f394bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f394c0fc1b0 0x7f394c10c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:33:10.113 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:10.104+0000 7f394bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f394c0fc1b0 0x7f394c10c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.117:51358/0 (socket says 172.21.15.117:51358) 2024-09-19T06:33:10.113 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:10.104+0000 7f394bfff640 1 -- 172.21.15.117:0/2459301878 learned_addr learned my addr 172.21.15.117:0/2459301878 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T06:33:10.113 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:10.105+0000 7f394bfff640 1 -- 172.21.15.117:0/2459301878 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f393c005040 con 0x7f394c0fc1b0 2024-09-19T06:33:10.113 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:10.105+0000 7f394bfff640 1 --2- 172.21.15.117:0/2459301878 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f394c0fc1b0 0x7f394c10c6f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f393c02a6d0 tx=0x7f393c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:33:10.113 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:10.105+0000 7f39497fa640 1 -- 172.21.15.117:0/2459301878 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f393c033630 con 0x7f394c0fc1b0 2024-09-19T06:33:10.113 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:10.105+0000 7f3952740640 1 -- 172.21.15.117:0/2459301878 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f394c10ce30 con 0x7f394c0fc1b0 2024-09-19T06:33:10.113 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:10.105+0000 7f39497fa640 1 -- 172.21.15.117:0/2459301878 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f393c033c30 con 0x7f394c0fc1b0 2024-09-19T06:33:10.113 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:10.105+0000 7f3952740640 1 -- 172.21.15.117:0/2459301878 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f394c10d2a0 con 0x7f394c0fc1b0 2024-09-19T06:33:10.113 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:10.105+0000 7f39497fa640 1 -- 172.21.15.117:0/2459301878 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f393c03dc10 con 0x7f394c0fc1b0 2024-09-19T06:33:10.114 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:10.106+0000 7f39497fa640 1 -- 172.21.15.117:0/2459301878 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 17) v1 ==== 45620+0+0 (secure 0 0 0) 0x7f393c030020 con 0x7f394c0fc1b0 2024-09-19T06:33:10.114 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:10.106+0000 7f3952740640 1 -- 172.21.15.117:0/2459301878 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f394c05ed70 con 0x7f394c0fc1b0 2024-09-19T06:33:10.114 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:10.106+0000 7f39497fa640 1 --2- 172.21.15.117:0/2459301878 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f3938039670 0x7f393803bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:33:10.114 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:10.106+0000 7f39497fa640 1 -- 172.21.15.117:0/2459301878 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f393c06cb70 con 0x7f394c0fc1b0 2024-09-19T06:33:10.114 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:10.106+0000 7f3943fff640 1 --2- 172.21.15.117:0/2459301878 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f3938039670 0x7f393803bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:33:10.114 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:10.107+0000 7f3943fff640 1 --2- 172.21.15.117:0/2459301878 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f3938039670 0x7f393803bb20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3934006fd0 tx=0x7f3934006db0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:33:10.114 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:10.111+0000 7f39497fa640 1 -- 172.21.15.117:0/2459301878 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f393c033790 con 0x7f394c0fc1b0 2024-09-19T06:33:10.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:09 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:10.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:09 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:10.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:09 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:10.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:09 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:10.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:09 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "who": "osd/host:smithi099", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:33:10.329 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:10.328+0000 7f3952740640 1 -- 172.21.15.117:0/2459301878 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f394c04b720 con 0x7f394c0fc1b0 2024-09-19T06:33:10.330 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:10.329+0000 7f39497fa640 1 -- 172.21.15.117:0/2459301878 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f393c0457b0 con 0x7f394c0fc1b0 2024-09-19T06:33:10.331 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:33:10.331 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":1,"fsid":"a73eb958-7650-11ef-bceb-c7b262605968","modified":"2024-09-19T06:31:05.093105Z","created":"2024-09-19T06:31:05.093105Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi099","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:3300","nonce":0},{"type":"v1","addr":"172.21.15.99:6789","nonce":0}]},"addr":"172.21.15.99:6789/0","public_addr":"172.21.15.99:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T06:33:10.331 INFO:teuthology.orchestra.run.smithi117.stderr:dumped monmap epoch 1 2024-09-19T06:33:10.332 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:10.331+0000 7f3952740640 1 -- 172.21.15.117:0/2459301878 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f3938039670 msgr2=0x7f393803bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:33:10.332 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:10.331+0000 7f3952740640 1 --2- 172.21.15.117:0/2459301878 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f3938039670 0x7f393803bb20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3934006fd0 tx=0x7f3934006db0 comp rx=0 tx=0).stop 2024-09-19T06:33:10.332 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:10.331+0000 7f3952740640 1 -- 172.21.15.117:0/2459301878 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f394c0fc1b0 msgr2=0x7f394c10c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:33:10.332 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:10.331+0000 7f3952740640 1 --2- 172.21.15.117:0/2459301878 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f394c0fc1b0 0x7f394c10c6f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f393c02a6d0 tx=0x7f393c009da0 comp rx=0 tx=0).stop 2024-09-19T06:33:10.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:10.331+0000 7f3952740640 1 -- 172.21.15.117:0/2459301878 shutdown_connections 2024-09-19T06:33:10.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:10.331+0000 7f3952740640 1 --2- 172.21.15.117:0/2459301878 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f3938039670 0x7f393803bb20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:33:10.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:10.331+0000 7f3952740640 1 --2- 172.21.15.117:0/2459301878 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f394c0fc1b0 0x7f394c10c6f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:33:10.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:10.331+0000 7f3952740640 1 -- 172.21.15.117:0/2459301878 >> 172.21.15.117:0/2459301878 conn(0x7f394c0f7990 msgr2=0x7f394c0f8200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:33:10.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:10.331+0000 7f3952740640 1 -- 172.21.15.117:0/2459301878 shutdown_connections 2024-09-19T06:33:10.333 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:10.331+0000 7f3952740640 1 -- 172.21.15.117:0/2459301878 wait complete. 2024-09-19T06:33:11.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:10 smithi099 ceph-mon[27651]: from='client.? 172.21.15.117:0/2459301878' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T06:33:11.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:10 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:11.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:10 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:11.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:10 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:11.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:10 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:11.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:10 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "who": "osd/host:smithi117", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:33:11.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:10 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:33:11.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:10 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:33:12.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:11 smithi099 ceph-mon[27651]: Updating smithi099:/etc/ceph/ceph.conf 2024-09-19T06:33:12.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:11 smithi099 ceph-mon[27651]: Updating smithi117:/etc/ceph/ceph.conf 2024-09-19T06:33:12.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:11 smithi099 ceph-mon[27651]: Updating smithi117:/var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:33:12.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:11 smithi099 ceph-mon[27651]: Updating smithi099:/var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:33:12.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:11 smithi099 ceph-mon[27651]: Updating smithi117:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:33:12.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:11 smithi099 ceph-mon[27651]: Updating smithi099:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:33:12.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:11 smithi099 ceph-mon[27651]: Updating smithi117:/var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:33:12.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:11 smithi099 ceph-mon[27651]: Updating smithi099:/var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:33:12.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:11 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:12.208 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:11 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:12.208 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:11 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:12.208 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:11 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:12.208 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:11 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:12.208 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:11 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi117", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-19T06:33:12.208 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:11 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi117", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-19T06:33:12.208 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:11 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:33:12.229 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-19T06:33:12.230 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T06:33:12.588 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:33:13.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:12 smithi099 ceph-mon[27651]: Deploying daemon crash.smithi117 on smithi117 2024-09-19T06:33:14.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:14.489+0000 7f4a619e2640 1 -- 172.21.15.117:0/3546805060 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4a5c1010d0 msgr2=0x7f4a5c1014a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:33:14.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:14.489+0000 7f4a619e2640 1 --2- 172.21.15.117:0/3546805060 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4a5c1010d0 0x7f4a5c1014a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4a54009bd0 tx=0x7f4a54004d10 comp rx=0 tx=0).stop 2024-09-19T06:33:14.505 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:14.489+0000 7f4a619e2640 1 -- 172.21.15.117:0/3546805060 shutdown_connections 2024-09-19T06:33:14.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:14.489+0000 7f4a619e2640 1 --2- 172.21.15.117:0/3546805060 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4a5c1010d0 0x7f4a5c1014a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:33:14.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:14.489+0000 7f4a619e2640 1 -- 172.21.15.117:0/3546805060 >> 172.21.15.117:0/3546805060 conn(0x7f4a5c0f6ca0 msgr2=0x7f4a5c0f90b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:33:14.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:14.489+0000 7f4a619e2640 1 -- 172.21.15.117:0/3546805060 shutdown_connections 2024-09-19T06:33:14.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:14.489+0000 7f4a619e2640 1 -- 172.21.15.117:0/3546805060 wait complete. 2024-09-19T06:33:14.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:14.490+0000 7f4a619e2640 1 Processor -- start 2024-09-19T06:33:14.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:14.490+0000 7f4a619e2640 1 -- start start 2024-09-19T06:33:14.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:14.490+0000 7f4a619e2640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4a5c1010d0 0x7f4a5c111670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:33:14.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:14.490+0000 7f4a619e2640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5c111bb0 con 0x7f4a5c1010d0 2024-09-19T06:33:14.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:14.491+0000 7f4a5affd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4a5c1010d0 0x7f4a5c111670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:33:14.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:14.491+0000 7f4a5affd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4a5c1010d0 0x7f4a5c111670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.117:53146/0 (socket says 172.21.15.117:53146) 2024-09-19T06:33:14.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:14.491+0000 7f4a5affd640 1 -- 172.21.15.117:0/1745078742 learned_addr learned my addr 172.21.15.117:0/1745078742 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T06:33:14.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:14.491+0000 7f4a5affd640 1 -- 172.21.15.117:0/1745078742 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a540098b0 con 0x7f4a5c1010d0 2024-09-19T06:33:14.506 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:14.491+0000 7f4a5affd640 1 --2- 172.21.15.117:0/1745078742 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4a5c1010d0 0x7f4a5c111670 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4a54009ba0 tx=0x7f4a54004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:33:14.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:14.491+0000 7f4a537fe640 1 -- 172.21.15.117:0/1745078742 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4a540327a0 con 0x7f4a5c1010d0 2024-09-19T06:33:14.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:14.491+0000 7f4a619e2640 1 -- 172.21.15.117:0/1745078742 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a5c111db0 con 0x7f4a5c1010d0 2024-09-19T06:33:14.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:14.491+0000 7f4a537fe640 1 -- 172.21.15.117:0/1745078742 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4a54032da0 con 0x7f4a5c1010d0 2024-09-19T06:33:14.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:14.491+0000 7f4a537fe640 1 -- 172.21.15.117:0/1745078742 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4a5403dd80 con 0x7f4a5c1010d0 2024-09-19T06:33:14.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:14.491+0000 7f4a619e2640 1 -- 172.21.15.117:0/1745078742 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a5c112280 con 0x7f4a5c1010d0 2024-09-19T06:33:14.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:14.492+0000 7f4a619e2640 1 -- 172.21.15.117:0/1745078742 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a5c0fc840 con 0x7f4a5c1010d0 2024-09-19T06:33:14.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:14.492+0000 7f4a537fe640 1 -- 172.21.15.117:0/1745078742 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 17) v1 ==== 45620+0+0 (secure 0 0 0) 0x7f4a5402f030 con 0x7f4a5c1010d0 2024-09-19T06:33:14.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:14.492+0000 7f4a537fe640 1 --2- 172.21.15.117:0/1745078742 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f4a48039620 0x7f4a4803bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:33:14.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:14.492+0000 7f4a537fe640 1 -- 172.21.15.117:0/1745078742 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f4a5406da60 con 0x7f4a5c1010d0 2024-09-19T06:33:14.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:14.493+0000 7f4a5a7fc640 1 --2- 172.21.15.117:0/1745078742 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f4a48039620 0x7f4a4803bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:33:14.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:14.493+0000 7f4a5a7fc640 1 --2- 172.21.15.117:0/1745078742 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f4a48039620 0x7f4a4803bad0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4a44006fd0 tx=0x7f4a44006db0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:33:14.507 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:14.497+0000 7f4a537fe640 1 -- 172.21.15.117:0/1745078742 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f4a5404e530 con 0x7f4a5c1010d0 2024-09-19T06:33:14.722 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:14.720+0000 7f4a619e2640 1 -- 172.21.15.117:0/1745078742 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f4a5c05ed70 con 0x7f4a5c1010d0 2024-09-19T06:33:14.723 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:14.722+0000 7f4a537fe640 1 -- 172.21.15.117:0/1745078742 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f4a54041020 con 0x7f4a5c1010d0 2024-09-19T06:33:14.723 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:33:14.723 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":1,"fsid":"a73eb958-7650-11ef-bceb-c7b262605968","modified":"2024-09-19T06:31:05.093105Z","created":"2024-09-19T06:31:05.093105Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi099","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:3300","nonce":0},{"type":"v1","addr":"172.21.15.99:6789","nonce":0}]},"addr":"172.21.15.99:6789/0","public_addr":"172.21.15.99:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T06:33:14.723 INFO:teuthology.orchestra.run.smithi117.stderr:dumped monmap epoch 1 2024-09-19T06:33:14.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:14.724+0000 7f4a619e2640 1 -- 172.21.15.117:0/1745078742 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f4a48039620 msgr2=0x7f4a4803bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:33:14.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:14.724+0000 7f4a619e2640 1 --2- 172.21.15.117:0/1745078742 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f4a48039620 0x7f4a4803bad0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4a44006fd0 tx=0x7f4a44006db0 comp rx=0 tx=0).stop 2024-09-19T06:33:14.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:14.724+0000 7f4a619e2640 1 -- 172.21.15.117:0/1745078742 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4a5c1010d0 msgr2=0x7f4a5c111670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:33:14.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:14.724+0000 7f4a619e2640 1 --2- 172.21.15.117:0/1745078742 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4a5c1010d0 0x7f4a5c111670 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4a54009ba0 tx=0x7f4a54004d10 comp rx=0 tx=0).stop 2024-09-19T06:33:14.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:14.724+0000 7f4a619e2640 1 -- 172.21.15.117:0/1745078742 shutdown_connections 2024-09-19T06:33:14.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:14.724+0000 7f4a619e2640 1 --2- 172.21.15.117:0/1745078742 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f4a48039620 0x7f4a4803bad0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:33:14.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:14.724+0000 7f4a619e2640 1 --2- 172.21.15.117:0/1745078742 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4a5c1010d0 0x7f4a5c111670 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:33:14.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:14.724+0000 7f4a619e2640 1 -- 172.21.15.117:0/1745078742 >> 172.21.15.117:0/1745078742 conn(0x7f4a5c0f6ca0 msgr2=0x7f4a5c0f8510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:33:14.725 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:14.724+0000 7f4a619e2640 1 -- 172.21.15.117:0/1745078742 shutdown_connections 2024-09-19T06:33:14.726 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:14.724+0000 7f4a619e2640 1 -- 172.21.15.117:0/1745078742 wait complete. 2024-09-19T06:33:15.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:15 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:15.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:15 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:15.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:15 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:15.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:15 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:15.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:15 smithi099 ceph-mon[27651]: from='client.? 172.21.15.117:0/1745078742' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T06:33:15.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:15 smithi099 ceph-mon[27651]: Deploying daemon node-exporter.smithi117 on smithi117 2024-09-19T06:33:16.233 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-19T06:33:16.233 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T06:33:16.481 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:33:19.346 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:19.343+0000 7fd8667ee640 1 -- 172.21.15.117:0/299767098 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd860102200 msgr2=0x7fd8601025d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:33:19.346 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:19.343+0000 7fd8667ee640 1 --2- 172.21.15.117:0/299767098 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd860102200 0x7fd8601025d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd850004850 tx=0x7fd850009da0 comp rx=0 tx=0).stop 2024-09-19T06:33:19.346 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:19.343+0000 7fd8667ee640 1 -- 172.21.15.117:0/299767098 shutdown_connections 2024-09-19T06:33:19.346 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:19.343+0000 7fd8667ee640 1 --2- 172.21.15.117:0/299767098 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd860102200 0x7fd8601025d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:33:19.346 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:19.343+0000 7fd8667ee640 1 -- 172.21.15.117:0/299767098 >> 172.21.15.117:0/299767098 conn(0x7fd8600f7dd0 msgr2=0x7fd8600fa1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:33:19.346 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:19.343+0000 7fd8667ee640 1 -- 172.21.15.117:0/299767098 shutdown_connections 2024-09-19T06:33:19.346 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:19.343+0000 7fd8667ee640 1 -- 172.21.15.117:0/299767098 wait complete. 2024-09-19T06:33:19.346 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:19.344+0000 7fd8667ee640 1 Processor -- start 2024-09-19T06:33:19.346 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:19.344+0000 7fd8667ee640 1 -- start start 2024-09-19T06:33:19.346 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:19.344+0000 7fd8667ee640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd860102200 0x7fd86006fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:33:19.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:19.344+0000 7fd8667ee640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd86006ff50 con 0x7fd860102200 2024-09-19T06:33:19.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:19.344+0000 7fd85ffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd860102200 0x7fd86006fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:33:19.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:19.344+0000 7fd85ffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd860102200 0x7fd86006fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.117:53178/0 (socket says 172.21.15.117:53178) 2024-09-19T06:33:19.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:19.344+0000 7fd85ffff640 1 -- 172.21.15.117:0/3160923220 learned_addr learned my addr 172.21.15.117:0/3160923220 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T06:33:19.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:19.345+0000 7fd85ffff640 1 -- 172.21.15.117:0/3160923220 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd850005040 con 0x7fd860102200 2024-09-19T06:33:19.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:19.345+0000 7fd85ffff640 1 --2- 172.21.15.117:0/3160923220 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd860102200 0x7fd86006fa10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd85002a6d0 tx=0x7fd850009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:33:19.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:19.345+0000 7fd85cff9640 1 -- 172.21.15.117:0/3160923220 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd85002cf10 con 0x7fd860102200 2024-09-19T06:33:19.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:19.345+0000 7fd85cff9640 1 -- 172.21.15.117:0/3160923220 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd850033ad0 con 0x7fd860102200 2024-09-19T06:33:19.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:19.345+0000 7fd8667ee640 1 -- 172.21.15.117:0/3160923220 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd860070150 con 0x7fd860102200 2024-09-19T06:33:19.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:19.345+0000 7fd85cff9640 1 -- 172.21.15.117:0/3160923220 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd85003ebb0 con 0x7fd860102200 2024-09-19T06:33:19.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:19.345+0000 7fd8667ee640 1 -- 172.21.15.117:0/3160923220 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd860070620 con 0x7fd860102200 2024-09-19T06:33:19.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:19.346+0000 7fd85cff9640 1 -- 172.21.15.117:0/3160923220 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 17) v1 ==== 45620+0+0 (secure 0 0 0) 0x7fd850030020 con 0x7fd860102200 2024-09-19T06:33:19.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:19.346+0000 7fd8667ee640 1 -- 172.21.15.117:0/3160923220 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8600fd970 con 0x7fd860102200 2024-09-19T06:33:19.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:19.346+0000 7fd85cff9640 1 --2- 172.21.15.117:0/3160923220 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fd84c039670 0x7fd84c03bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:33:19.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:19.346+0000 7fd85cff9640 1 -- 172.21.15.117:0/3160923220 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fd85006c840 con 0x7fd860102200 2024-09-19T06:33:19.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:19.347+0000 7fd85f7fe640 1 --2- 172.21.15.117:0/3160923220 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fd84c039670 0x7fd84c03bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:33:19.349 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:19.347+0000 7fd85f7fe640 1 --2- 172.21.15.117:0/3160923220 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fd84c039670 0x7fd84c03bb20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd848006fd0 tx=0x7fd848006db0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:33:19.352 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:19.351+0000 7fd85cff9640 1 -- 172.21.15.117:0/3160923220 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fd8500473f0 con 0x7fd860102200 2024-09-19T06:33:19.579 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:19.578+0000 7fd8667ee640 1 -- 172.21.15.117:0/3160923220 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fd8601064c0 con 0x7fd860102200 2024-09-19T06:33:19.580 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:19.579+0000 7fd85cff9640 1 -- 172.21.15.117:0/3160923220 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fd85002c8c0 con 0x7fd860102200 2024-09-19T06:33:19.580 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:33:19.580 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":1,"fsid":"a73eb958-7650-11ef-bceb-c7b262605968","modified":"2024-09-19T06:31:05.093105Z","created":"2024-09-19T06:31:05.093105Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi099","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:3300","nonce":0},{"type":"v1","addr":"172.21.15.99:6789","nonce":0}]},"addr":"172.21.15.99:6789/0","public_addr":"172.21.15.99:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T06:33:19.580 INFO:teuthology.orchestra.run.smithi117.stderr:dumped monmap epoch 1 2024-09-19T06:33:19.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:19.581+0000 7fd8667ee640 1 -- 172.21.15.117:0/3160923220 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fd84c039670 msgr2=0x7fd84c03bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:33:19.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:19.581+0000 7fd8667ee640 1 --2- 172.21.15.117:0/3160923220 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fd84c039670 0x7fd84c03bb20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd848006fd0 tx=0x7fd848006db0 comp rx=0 tx=0).stop 2024-09-19T06:33:19.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:19.581+0000 7fd8667ee640 1 -- 172.21.15.117:0/3160923220 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd860102200 msgr2=0x7fd86006fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:33:19.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:19.581+0000 7fd8667ee640 1 --2- 172.21.15.117:0/3160923220 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd860102200 0x7fd86006fa10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd85002a6d0 tx=0x7fd850009da0 comp rx=0 tx=0).stop 2024-09-19T06:33:19.582 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:19.581+0000 7fd8667ee640 1 -- 172.21.15.117:0/3160923220 shutdown_connections 2024-09-19T06:33:19.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:19.581+0000 7fd8667ee640 1 --2- 172.21.15.117:0/3160923220 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fd84c039670 0x7fd84c03bb20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:33:19.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:19.581+0000 7fd8667ee640 1 --2- 172.21.15.117:0/3160923220 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd860102200 0x7fd86006fa10 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:33:19.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:19.581+0000 7fd8667ee640 1 -- 172.21.15.117:0/3160923220 >> 172.21.15.117:0/3160923220 conn(0x7fd8600f7dd0 msgr2=0x7fd8600f9580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:33:19.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:19.581+0000 7fd8667ee640 1 -- 172.21.15.117:0/3160923220 shutdown_connections 2024-09-19T06:33:19.583 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:19.581+0000 7fd8667ee640 1 -- 172.21.15.117:0/3160923220 wait complete. 2024-09-19T06:33:20.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:20 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:20.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:20 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:20.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:20 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:20.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:20 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:20.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:20 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi117.ssmkcf", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T06:33:20.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:20 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi117.ssmkcf", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T06:33:20.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:20 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T06:33:20.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:20 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:33:20.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:20 smithi099 ceph-mon[27651]: Deploying daemon mgr.smithi117.ssmkcf on smithi117 2024-09-19T06:33:20.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:20 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:20.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:20 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:33:20.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:20 smithi099 ceph-mon[27651]: from='client.? 172.21.15.117:0/3160923220' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T06:33:21.363 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-19T06:33:21.363 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T06:33:21.937 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:33:23.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:22 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:23.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:22 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:23.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:22 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:23.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:22 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:23.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:22 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T06:33:23.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:22 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:33:23.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:22 smithi099 ceph-mon[27651]: Deploying daemon mon.smithi117 on smithi117 2024-09-19T06:33:23.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:23.492+0000 7fb6ae230640 1 -- 172.21.15.117:0/1511842660 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb6a8101100 msgr2=0x7fb6a81014d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:33:23.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:23.492+0000 7fb6ae230640 1 --2- 172.21.15.117:0/1511842660 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb6a8101100 0x7fb6a81014d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb698004850 tx=0x7fb698009da0 comp rx=0 tx=0).stop 2024-09-19T06:33:23.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:23.492+0000 7fb6ae230640 1 -- 172.21.15.117:0/1511842660 shutdown_connections 2024-09-19T06:33:23.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:23.492+0000 7fb6ae230640 1 --2- 172.21.15.117:0/1511842660 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb6a8101100 0x7fb6a81014d0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:33:23.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:23.492+0000 7fb6ae230640 1 -- 172.21.15.117:0/1511842660 >> 172.21.15.117:0/1511842660 conn(0x7fb6a80f6d10 msgr2=0x7fb6a80f9120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:33:23.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:23.492+0000 7fb6ae230640 1 -- 172.21.15.117:0/1511842660 shutdown_connections 2024-09-19T06:33:23.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:23.492+0000 7fb6ae230640 1 -- 172.21.15.117:0/1511842660 wait complete. 2024-09-19T06:33:23.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:23.493+0000 7fb6ae230640 1 Processor -- start 2024-09-19T06:33:23.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:23.493+0000 7fb6ae230640 1 -- start start 2024-09-19T06:33:23.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:23.493+0000 7fb6ae230640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb6a8101100 0x7fb6a8111680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:33:23.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:23.494+0000 7fb6ae230640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a8111bc0 con 0x7fb6a8101100 2024-09-19T06:33:23.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:23.494+0000 7fb6a77fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb6a8101100 0x7fb6a8111680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:33:23.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:23.494+0000 7fb6a77fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb6a8101100 0x7fb6a8111680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.117:47770/0 (socket says 172.21.15.117:47770) 2024-09-19T06:33:23.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:23.494+0000 7fb6a77fe640 1 -- 172.21.15.117:0/4044605587 learned_addr learned my addr 172.21.15.117:0/4044605587 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T06:33:23.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:23.494+0000 7fb6a77fe640 1 -- 172.21.15.117:0/4044605587 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb698005040 con 0x7fb6a8101100 2024-09-19T06:33:23.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:23.494+0000 7fb6a77fe640 1 --2- 172.21.15.117:0/4044605587 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb6a8101100 0x7fb6a8111680 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb69802a6d0 tx=0x7fb698009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:33:23.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:23.495+0000 7fb6a4ff9640 1 -- 172.21.15.117:0/4044605587 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb69802cf10 con 0x7fb6a8101100 2024-09-19T06:33:23.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:23.495+0000 7fb6ae230640 1 -- 172.21.15.117:0/4044605587 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6a8111dc0 con 0x7fb6a8101100 2024-09-19T06:33:23.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:23.495+0000 7fb6ae230640 1 -- 172.21.15.117:0/4044605587 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6a8112290 con 0x7fb6a8101100 2024-09-19T06:33:23.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:23.495+0000 7fb6a4ff9640 1 -- 172.21.15.117:0/4044605587 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb698033ad0 con 0x7fb6a8101100 2024-09-19T06:33:23.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:23.495+0000 7fb6a4ff9640 1 -- 172.21.15.117:0/4044605587 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb69803eb40 con 0x7fb6a8101100 2024-09-19T06:33:23.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:23.496+0000 7fb6a4ff9640 1 -- 172.21.15.117:0/4044605587 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 17) v1 ==== 45620+0+0 (secure 0 0 0) 0x7fb698030020 con 0x7fb6a8101100 2024-09-19T06:33:23.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:23.496+0000 7fb6a4ff9640 1 --2- 172.21.15.117:0/4044605587 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fb694039670 0x7fb69403bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:33:23.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:23.496+0000 7fb6a4ff9640 1 -- 172.21.15.117:0/4044605587 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fb69806d780 con 0x7fb6a8101100 2024-09-19T06:33:23.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:23.496+0000 7fb6ae230640 1 -- 172.21.15.117:0/4044605587 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6a80fc870 con 0x7fb6a8101100 2024-09-19T06:33:23.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:23.496+0000 7fb69effd640 1 --2- 172.21.15.117:0/4044605587 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fb694039670 0x7fb69403bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:33:23.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:23.497+0000 7fb69effd640 1 --2- 172.21.15.117:0/4044605587 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fb694039670 0x7fb69403bb20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb690006fd0 tx=0x7fb690006db0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:33:23.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:23.501+0000 7fb6a4ff9640 1 -- 172.21.15.117:0/4044605587 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fb6980473f0 con 0x7fb6a8101100 2024-09-19T06:33:23.734 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:23.733+0000 7fb6ae230640 1 -- 172.21.15.117:0/4044605587 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fb6a805ed70 con 0x7fb6a8101100 2024-09-19T06:33:23.735 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:23.734+0000 7fb6a4ff9640 1 -- 172.21.15.117:0/4044605587 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fb69803c330 con 0x7fb6a8101100 2024-09-19T06:33:23.735 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:33:23.735 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":1,"fsid":"a73eb958-7650-11ef-bceb-c7b262605968","modified":"2024-09-19T06:31:05.093105Z","created":"2024-09-19T06:31:05.093105Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi099","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:3300","nonce":0},{"type":"v1","addr":"172.21.15.99:6789","nonce":0}]},"addr":"172.21.15.99:6789/0","public_addr":"172.21.15.99:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T06:33:23.736 INFO:teuthology.orchestra.run.smithi117.stderr:dumped monmap epoch 1 2024-09-19T06:33:23.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:23.736+0000 7fb6ae230640 1 -- 172.21.15.117:0/4044605587 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fb694039670 msgr2=0x7fb69403bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:33:23.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:23.736+0000 7fb6ae230640 1 --2- 172.21.15.117:0/4044605587 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fb694039670 0x7fb69403bb20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb690006fd0 tx=0x7fb690006db0 comp rx=0 tx=0).stop 2024-09-19T06:33:23.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:23.736+0000 7fb6ae230640 1 -- 172.21.15.117:0/4044605587 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb6a8101100 msgr2=0x7fb6a8111680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:33:23.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:23.736+0000 7fb6ae230640 1 --2- 172.21.15.117:0/4044605587 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb6a8101100 0x7fb6a8111680 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb69802a6d0 tx=0x7fb698009da0 comp rx=0 tx=0).stop 2024-09-19T06:33:23.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:23.736+0000 7fb6ae230640 1 -- 172.21.15.117:0/4044605587 shutdown_connections 2024-09-19T06:33:23.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:23.736+0000 7fb6ae230640 1 --2- 172.21.15.117:0/4044605587 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fb694039670 0x7fb69403bb20 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:33:23.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:23.736+0000 7fb6ae230640 1 --2- 172.21.15.117:0/4044605587 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb6a8101100 0x7fb6a8111680 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:33:23.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:23.736+0000 7fb6ae230640 1 -- 172.21.15.117:0/4044605587 >> 172.21.15.117:0/4044605587 conn(0x7fb6a80f6d10 msgr2=0x7fb6a80f8600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:33:23.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:23.736+0000 7fb6ae230640 1 -- 172.21.15.117:0/4044605587 shutdown_connections 2024-09-19T06:33:23.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:23.736+0000 7fb6ae230640 1 -- 172.21.15.117:0/4044605587 wait complete. 2024-09-19T06:33:24.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:23 smithi099 ceph-mon[27651]: from='client.? 172.21.15.117:0/4044605587' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T06:33:25.671 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-19T06:33:25.672 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T06:33:25.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:25 smithi099 ceph-mon[27651]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:33:25.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:25 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:26.161 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi117/config 2024-09-19T06:33:26.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:26 smithi099 ceph-mon[27651]: Standby manager daemon smithi117.ssmkcf started 2024-09-19T06:33:26.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:26 smithi099 ceph-mon[27651]: from='mgr.? 172.21.15.117:0/3985492917' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi117.ssmkcf/crt"}]: dispatch 2024-09-19T06:33:26.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:26 smithi099 ceph-mon[27651]: from='mgr.? 172.21.15.117:0/3985492917' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T06:33:26.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:26 smithi099 ceph-mon[27651]: from='mgr.? 172.21.15.117:0/3985492917' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi117.ssmkcf/key"}]: dispatch 2024-09-19T06:33:26.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:26 smithi099 ceph-mon[27651]: from='mgr.? 172.21.15.117:0/3985492917' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T06:33:27.707 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:27.699+0000 7f0baf78a640 1 -- 172.21.15.117:0/4180193100 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ba81011f0 msgr2=0x7f0ba81015c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:33:27.707 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:27.699+0000 7f0baf78a640 1 --2- 172.21.15.117:0/4180193100 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ba81011f0 0x7f0ba81015c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0ba4009bd0 tx=0x7f0ba4004d10 comp rx=0 tx=0).stop 2024-09-19T06:33:27.707 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:27.699+0000 7f0baf78a640 1 -- 172.21.15.117:0/4180193100 shutdown_connections 2024-09-19T06:33:27.707 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:27.699+0000 7f0baf78a640 1 --2- 172.21.15.117:0/4180193100 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ba81011f0 0x7f0ba81015c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:33:27.707 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:27.699+0000 7f0baf78a640 1 -- 172.21.15.117:0/4180193100 >> 172.21.15.117:0/4180193100 conn(0x7f0ba80711c0 msgr2=0x7f0ba80715c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:33:27.707 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:27.699+0000 7f0baf78a640 1 -- 172.21.15.117:0/4180193100 shutdown_connections 2024-09-19T06:33:27.707 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:27.699+0000 7f0baf78a640 1 -- 172.21.15.117:0/4180193100 wait complete. 2024-09-19T06:33:27.707 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:27.700+0000 7f0baf78a640 1 Processor -- start 2024-09-19T06:33:27.707 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:27.700+0000 7f0baf78a640 1 -- start start 2024-09-19T06:33:27.708 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:27.700+0000 7f0baf78a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ba81011f0 0x7f0ba810d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:33:27.708 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:27.700+0000 7f0baf78a640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba810ddb0 con 0x7f0ba81011f0 2024-09-19T06:33:27.708 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:27.700+0000 7f0bad526640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ba81011f0 0x7f0ba810d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:33:27.708 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:27.700+0000 7f0bad526640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ba81011f0 0x7f0ba810d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.117:47788/0 (socket says 172.21.15.117:47788) 2024-09-19T06:33:27.708 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:27.700+0000 7f0bad526640 1 -- 172.21.15.117:0/1876294048 learned_addr learned my addr 172.21.15.117:0/1876294048 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T06:33:27.708 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:27.700+0000 7f0bad526640 1 -- 172.21.15.117:0/1876294048 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ba40098b0 con 0x7f0ba81011f0 2024-09-19T06:33:27.708 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:27.700+0000 7f0bad526640 1 --2- 172.21.15.117:0/1876294048 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ba81011f0 0x7f0ba810d870 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0ba4009ba0 tx=0x7f0ba4004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:33:27.708 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:27.701+0000 7f0b9dffb640 1 -- 172.21.15.117:0/1876294048 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0ba40327a0 con 0x7f0ba81011f0 2024-09-19T06:33:27.708 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:27.701+0000 7f0baf78a640 1 -- 172.21.15.117:0/1876294048 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ba810dfb0 con 0x7f0ba81011f0 2024-09-19T06:33:27.708 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:27.701+0000 7f0b9dffb640 1 -- 172.21.15.117:0/1876294048 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0ba4032da0 con 0x7f0ba81011f0 2024-09-19T06:33:27.708 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:27.701+0000 7f0b9dffb640 1 -- 172.21.15.117:0/1876294048 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0ba403dd80 con 0x7f0ba81011f0 2024-09-19T06:33:27.708 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:27.701+0000 7f0baf78a640 1 -- 172.21.15.117:0/1876294048 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ba810e480 con 0x7f0ba81011f0 2024-09-19T06:33:27.708 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:27.702+0000 7f0baf78a640 1 -- 172.21.15.117:0/1876294048 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ba80fc960 con 0x7f0ba81011f0 2024-09-19T06:33:27.708 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:27.702+0000 7f0b9dffb640 1 -- 172.21.15.117:0/1876294048 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 18) v1 ==== 90811+0+0 (secure 0 0 0) 0x7f0ba402f030 con 0x7f0ba81011f0 2024-09-19T06:33:27.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:27.703+0000 7f0b9dffb640 1 --2- 172.21.15.117:0/1876294048 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f0b9406ec40 0x7f0b940710f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:33:27.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:27.703+0000 7f0b9dffb640 1 -- 172.21.15.117:0/1876294048 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f0ba40aeaf0 con 0x7f0ba81011f0 2024-09-19T06:33:27.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:27.703+0000 7f0bacd25640 1 --2- 172.21.15.117:0/1876294048 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f0b9406ec40 0x7f0b940710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:33:27.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:27.703+0000 7f0bacd25640 1 --2- 172.21.15.117:0/1876294048 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f0b9406ec40 0x7f0b940710f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0b98006fd0 tx=0x7f0b98006db0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:33:27.709 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:27.708+0000 7f0b9dffb640 1 -- 172.21.15.117:0/1876294048 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f0ba407cc50 con 0x7f0ba81011f0 2024-09-19T06:33:27.934 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:27.933+0000 7f0baf78a640 1 -- 172.21.15.117:0/1876294048 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f0ba80f9760 con 0x7f0ba81011f0 2024-09-19T06:33:27.935 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:27.934+0000 7f0b9dffb640 1 -- 172.21.15.117:0/1876294048 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f0ba4041300 con 0x7f0ba81011f0 2024-09-19T06:33:27.935 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:33:27.935 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":1,"fsid":"a73eb958-7650-11ef-bceb-c7b262605968","modified":"2024-09-19T06:31:05.093105Z","created":"2024-09-19T06:31:05.093105Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi099","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:3300","nonce":0},{"type":"v1","addr":"172.21.15.99:6789","nonce":0}]},"addr":"172.21.15.99:6789/0","public_addr":"172.21.15.99:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T06:33:27.936 INFO:teuthology.orchestra.run.smithi117.stderr:dumped monmap epoch 1 2024-09-19T06:33:27.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:27.936+0000 7f0baf78a640 1 -- 172.21.15.117:0/1876294048 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f0b9406ec40 msgr2=0x7f0b940710f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:33:27.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:27.936+0000 7f0baf78a640 1 --2- 172.21.15.117:0/1876294048 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f0b9406ec40 0x7f0b940710f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0b98006fd0 tx=0x7f0b98006db0 comp rx=0 tx=0).stop 2024-09-19T06:33:27.937 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:27.936+0000 7f0baf78a640 1 -- 172.21.15.117:0/1876294048 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ba81011f0 msgr2=0x7f0ba810d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:33:27.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:27.936+0000 7f0baf78a640 1 --2- 172.21.15.117:0/1876294048 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ba81011f0 0x7f0ba810d870 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0ba4009ba0 tx=0x7f0ba4004d10 comp rx=0 tx=0).stop 2024-09-19T06:33:27.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:27.936+0000 7f0baf78a640 1 -- 172.21.15.117:0/1876294048 shutdown_connections 2024-09-19T06:33:27.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:27.936+0000 7f0baf78a640 1 --2- 172.21.15.117:0/1876294048 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f0b9406ec40 0x7f0b940710f0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:33:27.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:27.936+0000 7f0baf78a640 1 --2- 172.21.15.117:0/1876294048 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ba81011f0 0x7f0ba810d870 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:33:27.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:27.936+0000 7f0baf78a640 1 -- 172.21.15.117:0/1876294048 >> 172.21.15.117:0/1876294048 conn(0x7f0ba80711c0 msgr2=0x7f0ba80fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:33:27.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:27.936+0000 7f0baf78a640 1 -- 172.21.15.117:0/1876294048 shutdown_connections 2024-09-19T06:33:27.938 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:27.936+0000 7f0baf78a640 1 -- 172.21.15.117:0/1876294048 wait complete. 2024-09-19T06:33:27.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:27 smithi099 ceph-mon[27651]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:33:27.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:27 smithi099 ceph-mon[27651]: mgrmap e18: smithi099.pgvkqi(active, since 22s), standbys: smithi117.ssmkcf 2024-09-19T06:33:27.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:27 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mgr metadata", "who": "smithi117.ssmkcf", "id": "smithi117.ssmkcf"}]: dispatch 2024-09-19T06:33:28.580 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:28 smithi117 systemd[1]: Started Ceph mon.smithi117 for a73eb958-7650-11ef-bceb-c7b262605968. 2024-09-19T06:33:30.006 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-19T06:33:30.006 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T06:33:30.257 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi117/config 2024-09-19T06:33:33.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:33 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mon metadata", "id": "smithi099"}]: dispatch 2024-09-19T06:33:33.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:33 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mon metadata", "id": "smithi117"}]: dispatch 2024-09-19T06:33:33.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:33 smithi099 ceph-mon[27651]: mon.smithi099 calling monitor election 2024-09-19T06:33:33.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:33 smithi099 ceph-mon[27651]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:33:33.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:33 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mon metadata", "id": "smithi117"}]: dispatch 2024-09-19T06:33:33.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:33 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mon metadata", "id": "smithi117"}]: dispatch 2024-09-19T06:33:33.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:33 smithi099 ceph-mon[27651]: mon.smithi117 calling monitor election 2024-09-19T06:33:33.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:33 smithi099 ceph-mon[27651]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:33:33.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:33 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mon metadata", "id": "smithi117"}]: dispatch 2024-09-19T06:33:33.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:33 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mon metadata", "id": "smithi117"}]: dispatch 2024-09-19T06:33:33.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:33 smithi099 ceph-mon[27651]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:33:33.708 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:33 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mon metadata", "id": "smithi117"}]: dispatch 2024-09-19T06:33:33.708 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:33 smithi099 ceph-mon[27651]: mon.smithi099 is new leader, mons smithi099,smithi117 in quorum (ranks 0,1) 2024-09-19T06:33:33.708 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:33 smithi099 ceph-mon[27651]: monmap e2: 2 mons at {smithi099=[v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0],smithi117=[v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-19T06:33:33.708 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:33 smithi099 ceph-mon[27651]: fsmap 2024-09-19T06:33:33.708 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:33 smithi099 ceph-mon[27651]: osdmap e5: 0 total, 0 up, 0 in 2024-09-19T06:33:33.708 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:33 smithi099 ceph-mon[27651]: mgrmap e18: smithi099.pgvkqi(active, since 28s), standbys: smithi117.ssmkcf 2024-09-19T06:33:33.708 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:33 smithi099 ceph-mon[27651]: overall HEALTH_OK 2024-09-19T06:33:33.708 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:33 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:33.708 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:33 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:33.708 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:33 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:33.708 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:33 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:33.709 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:33 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:33.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:33 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mon metadata", "id": "smithi099"}]: dispatch 2024-09-19T06:33:33.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:33 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mon metadata", "id": "smithi117"}]: dispatch 2024-09-19T06:33:33.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:33 smithi117 ceph-mon[34564]: mon.smithi099 calling monitor election 2024-09-19T06:33:33.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:33 smithi117 ceph-mon[34564]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:33:33.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:33 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mon metadata", "id": "smithi117"}]: dispatch 2024-09-19T06:33:33.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:33 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mon metadata", "id": "smithi117"}]: dispatch 2024-09-19T06:33:33.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:33 smithi117 ceph-mon[34564]: mon.smithi117 calling monitor election 2024-09-19T06:33:33.813 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:33 smithi117 ceph-mon[34564]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:33:33.813 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:33 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mon metadata", "id": "smithi117"}]: dispatch 2024-09-19T06:33:33.813 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:33 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mon metadata", "id": "smithi117"}]: dispatch 2024-09-19T06:33:33.813 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:33 smithi117 ceph-mon[34564]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:33:33.813 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:33 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mon metadata", "id": "smithi117"}]: dispatch 2024-09-19T06:33:33.813 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:33 smithi117 ceph-mon[34564]: mon.smithi099 is new leader, mons smithi099,smithi117 in quorum (ranks 0,1) 2024-09-19T06:33:33.813 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:33 smithi117 ceph-mon[34564]: monmap e2: 2 mons at {smithi099=[v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0],smithi117=[v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-19T06:33:33.813 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:33 smithi117 ceph-mon[34564]: fsmap 2024-09-19T06:33:33.813 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:33 smithi117 ceph-mon[34564]: osdmap e5: 0 total, 0 up, 0 in 2024-09-19T06:33:33.813 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:33 smithi117 ceph-mon[34564]: mgrmap e18: smithi099.pgvkqi(active, since 28s), standbys: smithi117.ssmkcf 2024-09-19T06:33:33.813 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:33 smithi117 ceph-mon[34564]: overall HEALTH_OK 2024-09-19T06:33:33.813 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:33 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:33.813 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:33 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:33.814 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:33 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:33.814 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:33 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:33.814 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:33 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:34.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:34.597+0000 7f4fcd670640 1 -- 172.21.15.117:0/1152916410 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4fb00034f0 msgr2=0x7f4fb0005970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:33:34.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:34.597+0000 7f4fcd670640 1 --2- 172.21.15.117:0/1152916410 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4fb00034f0 0x7f4fb0005970 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4fc80657a0 tx=0x7f4fb8009040 comp rx=0 tx=0).stop 2024-09-19T06:33:34.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:34.597+0000 7f4fcd670640 1 -- 172.21.15.117:0/1152916410 shutdown_connections 2024-09-19T06:33:34.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:34.597+0000 7f4fcd670640 1 --2- 172.21.15.117:0/1152916410 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4fb00034f0 0x7f4fb0005970 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:33:34.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:34.597+0000 7f4fcd670640 1 -- 172.21.15.117:0/1152916410 >> 172.21.15.117:0/1152916410 conn(0x7f4fc80f6e40 msgr2=0x7f4fc80f9250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:33:34.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:34.597+0000 7f4fcd670640 1 -- 172.21.15.117:0/1152916410 shutdown_connections 2024-09-19T06:33:34.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:34.598+0000 7f4fcd670640 1 -- 172.21.15.117:0/1152916410 wait complete. 2024-09-19T06:33:34.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:34.599+0000 7f4fcd670640 1 Processor -- start 2024-09-19T06:33:34.601 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:34.599+0000 7f4fcd670640 1 -- start start 2024-09-19T06:33:34.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:34.599+0000 7f4fcd670640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4fb00034f0 0x7f4fc8114c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:33:34.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:34.599+0000 7f4fcd670640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4fc81151b0 0x7f4fc810ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:33:34.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:34.599+0000 7f4fcd670640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc81157c0 con 0x7f4fb00034f0 2024-09-19T06:33:34.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:34.599+0000 7f4fcd670640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc8115900 con 0x7f4fc81151b0 2024-09-19T06:33:34.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:34.599+0000 7f4fc67fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4fc81151b0 0x7f4fc810ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:33:34.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:34.599+0000 7f4fc67fc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4fc81151b0 0x7f4fc810ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:57666/0 (socket says 172.21.15.117:57666) 2024-09-19T06:33:34.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:34.599+0000 7f4fc67fc640 1 -- 172.21.15.117:0/4146319308 learned_addr learned my addr 172.21.15.117:0/4146319308 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T06:33:34.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:34.599+0000 7f4fc6ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4fb00034f0 0x7f4fc8114c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:33:34.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:34.599+0000 7f4fc67fc640 1 -- 172.21.15.117:0/4146319308 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4fc81151b0 msgr2=0x7f4fc810ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-19T06:33:34.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:34.599+0000 7f4fc67fc640 1 -- 172.21.15.117:0/4146319308 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4fc81151b0 msgr2=0x7f4fc810ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T06:33:34.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:34.599+0000 7f4fc67fc640 1 --2- 172.21.15.117:0/4146319308 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4fc81151b0 0x7f4fc810ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-09-19T06:33:34.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:34.599+0000 7f4fc67fc640 1 --2- 172.21.15.117:0/4146319308 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4fc81151b0 0x7f4fc810ebf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T06:33:34.602 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:34.599+0000 7f4fc6ffd640 1 -- 172.21.15.117:0/4146319308 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4fc81151b0 msgr2=0x7f4fc810ebf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:33:34.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:34.599+0000 7f4fc6ffd640 1 --2- 172.21.15.117:0/4146319308 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4fc81151b0 0x7f4fc810ebf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:33:34.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:34.599+0000 7f4fc6ffd640 1 -- 172.21.15.117:0/4146319308 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb8007950 con 0x7f4fb00034f0 2024-09-19T06:33:34.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:34.599+0000 7f4fc6ffd640 1 --2- 172.21.15.117:0/4146319308 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4fb00034f0 0x7f4fc8114c70 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4fc80657a0 tx=0x7f4fb8009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:33:34.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:34.600+0000 7f4faf7fe640 1 -- 172.21.15.117:0/4146319308 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4fb8038780 con 0x7f4fb00034f0 2024-09-19T06:33:34.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:34.600+0000 7f4faf7fe640 1 -- 172.21.15.117:0/4146319308 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4fb803c070 con 0x7f4fb00034f0 2024-09-19T06:33:34.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:34.600+0000 7f4faf7fe640 1 -- 172.21.15.117:0/4146319308 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4fb8041670 con 0x7f4fb00034f0 2024-09-19T06:33:34.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:34.600+0000 7f4fcd670640 1 -- 172.21.15.117:0/4146319308 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fc810f1f0 con 0x7f4fb00034f0 2024-09-19T06:33:34.603 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:34.600+0000 7f4fcd670640 1 -- 172.21.15.117:0/4146319308 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fc810f710 con 0x7f4fb00034f0 2024-09-19T06:33:34.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:34.601+0000 7f4fcd670640 1 -- 172.21.15.117:0/4146319308 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fc8065fa0 con 0x7f4fb00034f0 2024-09-19T06:33:34.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:34.601+0000 7f4faf7fe640 1 -- 172.21.15.117:0/4146319308 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 18) v1 ==== 90811+0+0 (secure 0 0 0) 0x7f4fb803e030 con 0x7f4fb00034f0 2024-09-19T06:33:34.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:34.601+0000 7f4faf7fe640 1 --2- 172.21.15.117:0/4146319308 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f4fb406edc0 0x7f4fb4071270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:33:34.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:34.602+0000 7f4faf7fe640 1 -- 172.21.15.117:0/4146319308 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f4fb8033030 con 0x7f4fb00034f0 2024-09-19T06:33:34.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:34.602+0000 7f4fc67fc640 1 --2- 172.21.15.117:0/4146319308 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f4fb406edc0 0x7f4fb4071270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:33:34.604 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:34.602+0000 7f4fc67fc640 1 --2- 172.21.15.117:0/4146319308 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f4fb406edc0 0x7f4fb4071270 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc006fd0 tx=0x7f4fbc008040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:33:34.607 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:34.606+0000 7f4faf7fe640 1 -- 172.21.15.117:0/4146319308 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f4fb807cec0 con 0x7f4fb00034f0 2024-09-19T06:33:34.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:34 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:33:34.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:34 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mon metadata", "id": "smithi117"}]: dispatch 2024-09-19T06:33:34.720 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:34 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:33:34.720 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:34 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mon metadata", "id": "smithi117"}]: dispatch 2024-09-19T06:33:34.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:34.829+0000 7f4fcd670640 1 -- 172.21.15.117:0/4146319308 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f4fc805ed70 con 0x7f4fb00034f0 2024-09-19T06:33:34.831 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:34.830+0000 7f4faf7fe640 1 -- 172.21.15.117:0/4146319308 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1017 (secure 0 0 0) 0x7f4fb807c860 con 0x7f4fb00034f0 2024-09-19T06:33:34.832 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:33:34.832 INFO:teuthology.orchestra.run.smithi117.stdout:{"epoch":2,"fsid":"a73eb958-7650-11ef-bceb-c7b262605968","modified":"2024-09-19T06:33:28.374622Z","created":"2024-09-19T06:31:05.093105Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi099","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:3300","nonce":0},{"type":"v1","addr":"172.21.15.99:6789","nonce":0}]},"addr":"172.21.15.99:6789/0","public_addr":"172.21.15.99:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi117","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T06:33:34.832 INFO:teuthology.orchestra.run.smithi117.stderr:dumped monmap epoch 2 2024-09-19T06:33:34.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:34.832+0000 7f4fcd670640 1 -- 172.21.15.117:0/4146319308 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f4fb406edc0 msgr2=0x7f4fb4071270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:33:34.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:34.832+0000 7f4fcd670640 1 --2- 172.21.15.117:0/4146319308 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f4fb406edc0 0x7f4fb4071270 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc006fd0 tx=0x7f4fbc008040 comp rx=0 tx=0).stop 2024-09-19T06:33:34.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:34.832+0000 7f4fcd670640 1 -- 172.21.15.117:0/4146319308 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4fb00034f0 msgr2=0x7f4fc8114c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:33:34.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:34.832+0000 7f4fcd670640 1 --2- 172.21.15.117:0/4146319308 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4fb00034f0 0x7f4fc8114c70 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4fc80657a0 tx=0x7f4fb8009040 comp rx=0 tx=0).stop 2024-09-19T06:33:34.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:34.832+0000 7f4fcd670640 1 -- 172.21.15.117:0/4146319308 shutdown_connections 2024-09-19T06:33:34.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:34.832+0000 7f4fcd670640 1 --2- 172.21.15.117:0/4146319308 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f4fb406edc0 0x7f4fb4071270 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:33:34.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:34.832+0000 7f4fcd670640 1 --2- 172.21.15.117:0/4146319308 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4fc81151b0 0x7f4fc810ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:33:34.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:34.832+0000 7f4fcd670640 1 --2- 172.21.15.117:0/4146319308 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4fb00034f0 0x7f4fc8114c70 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:33:34.834 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:34.832+0000 7f4fcd670640 1 -- 172.21.15.117:0/4146319308 >> 172.21.15.117:0/4146319308 conn(0x7f4fc80f6e40 msgr2=0x7f4fc80fb190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:33:34.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:34.832+0000 7f4fcd670640 1 -- 172.21.15.117:0/4146319308 shutdown_connections 2024-09-19T06:33:34.835 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:33:34.832+0000 7f4fcd670640 1 -- 172.21.15.117:0/4146319308 wait complete. 2024-09-19T06:33:35.407 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-19T06:33:35.407 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-19T06:33:35.652 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T06:33:35.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:35 smithi099 ceph-mon[27651]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:33:35.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:35 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:35.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:35 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:33:35.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:35 smithi099 ceph-mon[27651]: from='client.? 172.21.15.117:0/4146319308' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T06:33:35.811 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:35 smithi117 ceph-mon[34564]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:33:35.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:35 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:35.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:35 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:33:35.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:35 smithi117 ceph-mon[34564]: from='client.? 172.21.15.117:0/4146319308' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T06:33:37.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:36 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:37.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:36 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:37.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:36 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:33:37.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:36 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:33:37.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:36 smithi117 ceph-mon[34564]: Updating smithi099:/etc/ceph/ceph.conf 2024-09-19T06:33:37.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:36 smithi117 ceph-mon[34564]: Updating smithi117:/etc/ceph/ceph.conf 2024-09-19T06:33:37.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:36 smithi117 ceph-mon[34564]: Updating smithi099:/var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:33:37.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:36 smithi117 ceph-mon[34564]: Updating smithi117:/var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:33:37.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:36 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:37.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:36 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:37.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:36 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:37.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:36 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:37.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:36 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:37.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:36 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T06:33:37.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:36 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T06:33:37.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:36 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:33:37.125 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:36 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:37.125 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:36 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:37.125 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:36 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:33:37.125 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:36 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:33:37.125 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:36 smithi099 ceph-mon[27651]: Updating smithi099:/etc/ceph/ceph.conf 2024-09-19T06:33:37.125 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:36 smithi099 ceph-mon[27651]: Updating smithi117:/etc/ceph/ceph.conf 2024-09-19T06:33:37.125 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:36 smithi099 ceph-mon[27651]: Updating smithi099:/var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:33:37.126 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:36 smithi099 ceph-mon[27651]: Updating smithi117:/var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:33:37.126 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:36 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:37.126 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:36 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:37.126 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:36 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:37.126 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:36 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:37.126 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:36 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:37.126 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:36 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T06:33:37.126 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:36 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T06:33:37.126 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:36 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:33:37.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:37.939+0000 7f3aa5e23640 1 -- 172.21.15.99:0/3113813232 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3aa01021e0 msgr2=0x7f3aa01025b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:33:37.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:37.939+0000 7f3aa5e23640 1 --2- 172.21.15.99:0/3113813232 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3aa01021e0 0x7f3aa01025b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3a90004850 tx=0x7f3a90009da0 comp rx=0 tx=0).stop 2024-09-19T06:33:37.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:37.939+0000 7f3aa5e23640 1 -- 172.21.15.99:0/3113813232 shutdown_connections 2024-09-19T06:33:37.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:37.939+0000 7f3aa5e23640 1 --2- 172.21.15.99:0/3113813232 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3aa01021e0 0x7f3aa01025b0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:33:37.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:37.939+0000 7f3aa5e23640 1 -- 172.21.15.99:0/3113813232 >> 172.21.15.99:0/3113813232 conn(0x7f3aa00710b0 msgr2=0x7f3aa00714b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:33:37.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:37.939+0000 7f3aa5e23640 1 -- 172.21.15.99:0/3113813232 shutdown_connections 2024-09-19T06:33:37.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:37.939+0000 7f3aa5e23640 1 -- 172.21.15.99:0/3113813232 wait complete. 2024-09-19T06:33:37.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:37.940+0000 7f3aa5e23640 1 Processor -- start 2024-09-19T06:33:37.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:37.940+0000 7f3aa5e23640 1 -- start start 2024-09-19T06:33:37.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:37.940+0000 7f3aa5e23640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3aa01021e0 0x7f3aa0112890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:33:37.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:37.940+0000 7f3aa5e23640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3aa0112dd0 0x7f3aa010c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:33:37.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:37.940+0000 7f3aa5e23640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa0113390 con 0x7f3aa0112dd0 2024-09-19T06:33:37.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:37.940+0000 7f3aa5e23640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa01134d0 con 0x7f3aa01021e0 2024-09-19T06:33:37.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:37.940+0000 7f3a97fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3aa0112dd0 0x7f3aa010c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:33:37.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:37.940+0000 7f3a97fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3aa0112dd0 0x7f3aa010c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60554/0 (socket says 172.21.15.99:60554) 2024-09-19T06:33:37.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:37.940+0000 7f3a97fff640 1 -- 172.21.15.99:0/2333107670 learned_addr learned my addr 172.21.15.99:0/2333107670 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:33:37.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:37.940+0000 7f3a97fff640 1 -- 172.21.15.99:0/2333107670 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3aa01021e0 msgr2=0x7f3aa0112890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:33:37.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:37.940+0000 7f3a9f7fe640 1 --2- 172.21.15.99:0/2333107670 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3aa01021e0 0x7f3aa0112890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:33:37.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:37.940+0000 7f3a97fff640 1 --2- 172.21.15.99:0/2333107670 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3aa01021e0 0x7f3aa0112890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:33:37.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:37.940+0000 7f3a97fff640 1 -- 172.21.15.99:0/2333107670 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a90005040 con 0x7f3aa0112dd0 2024-09-19T06:33:37.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:37.940+0000 7f3a97fff640 1 --2- 172.21.15.99:0/2333107670 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3aa0112dd0 0x7f3aa010c830 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3a8800b790 tx=0x7f3a880091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:33:37.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:37.941+0000 7f3a9cff9640 1 -- 172.21.15.99:0/2333107670 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a8800c910 con 0x7f3aa0112dd0 2024-09-19T06:33:37.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:37.941+0000 7f3a9cff9640 1 -- 172.21.15.99:0/2333107670 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3a8800be60 con 0x7f3aa0112dd0 2024-09-19T06:33:37.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:37.941+0000 7f3a9cff9640 1 -- 172.21.15.99:0/2333107670 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a880133a0 con 0x7f3aa0112dd0 2024-09-19T06:33:37.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:37.941+0000 7f3aa5e23640 1 -- 172.21.15.99:0/2333107670 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3aa010ce30 con 0x7f3aa0112dd0 2024-09-19T06:33:37.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:37.941+0000 7f3aa5e23640 1 -- 172.21.15.99:0/2333107670 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3aa010d350 con 0x7f3aa0112dd0 2024-09-19T06:33:37.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:37.942+0000 7f3aa5e23640 1 -- 172.21.15.99:0/2333107670 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3aa010d680 con 0x7f3aa0112dd0 2024-09-19T06:33:37.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:37.942+0000 7f3a9cff9640 1 -- 172.21.15.99:0/2333107670 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 18) v1 ==== 90811+0+0 (secure 0 0 0) 0x7f3a88014780 con 0x7f3aa0112dd0 2024-09-19T06:33:37.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:37.943+0000 7f3a9cff9640 1 --2- 172.21.15.99:0/2333107670 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f3a8c06ee10 0x7f3a8c0712c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:33:37.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:37.943+0000 7f3a9cff9640 1 -- 172.21.15.99:0/2333107670 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f3a8808c6e0 con 0x7f3aa0112dd0 2024-09-19T06:33:37.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:37.943+0000 7f3a9f7fe640 1 --2- 172.21.15.99:0/2333107670 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f3a8c06ee10 0x7f3a8c0712c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:33:37.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:37.943+0000 7f3a9f7fe640 1 --2- 172.21.15.99:0/2333107670 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f3a8c06ee10 0x7f3a8c0712c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3a90004540 tx=0x7f3a90009da0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:33:37.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:37.947+0000 7f3a9cff9640 1 -- 172.21.15.99:0/2333107670 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f3a8804d2a0 con 0x7f3aa0112dd0 2024-09-19T06:33:38.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:38.105+0000 7f3aa5e23640 1 -- 172.21.15.99:0/2333107670 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f3aa010df90 con 0x7f3aa0112dd0 2024-09-19T06:33:38.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:38.105+0000 7f3a9cff9640 1 -- 172.21.15.99:0/2333107670 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+225 (secure 0 0 0) 0x7f3a88019100 con 0x7f3aa0112dd0 2024-09-19T06:33:38.107 INFO:teuthology.orchestra.run.smithi099.stdout:# minimal ceph.conf for a73eb958-7650-11ef-bceb-c7b262605968 2024-09-19T06:33:38.107 INFO:teuthology.orchestra.run.smithi099.stdout:[global] 2024-09-19T06:33:38.107 INFO:teuthology.orchestra.run.smithi099.stdout: fsid = a73eb958-7650-11ef-bceb-c7b262605968 2024-09-19T06:33:38.108 INFO:teuthology.orchestra.run.smithi099.stdout: mon_host = [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] 2024-09-19T06:33:38.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:38.107+0000 7f3aa5e23640 1 -- 172.21.15.99:0/2333107670 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f3a8c06ee10 msgr2=0x7f3a8c0712c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:33:38.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:38.107+0000 7f3aa5e23640 1 --2- 172.21.15.99:0/2333107670 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f3a8c06ee10 0x7f3a8c0712c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3a90004540 tx=0x7f3a90009da0 comp rx=0 tx=0).stop 2024-09-19T06:33:38.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:38.107+0000 7f3aa5e23640 1 -- 172.21.15.99:0/2333107670 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3aa0112dd0 msgr2=0x7f3aa010c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:33:38.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:38.107+0000 7f3aa5e23640 1 --2- 172.21.15.99:0/2333107670 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3aa0112dd0 0x7f3aa010c830 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3a8800b790 tx=0x7f3a880091d0 comp rx=0 tx=0).stop 2024-09-19T06:33:38.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:38.107+0000 7f3aa5e23640 1 -- 172.21.15.99:0/2333107670 shutdown_connections 2024-09-19T06:33:38.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:38.107+0000 7f3aa5e23640 1 --2- 172.21.15.99:0/2333107670 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f3a8c06ee10 0x7f3a8c0712c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:33:38.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:38.107+0000 7f3aa5e23640 1 --2- 172.21.15.99:0/2333107670 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3aa0112dd0 0x7f3aa010c830 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:33:38.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:38.107+0000 7f3aa5e23640 1 --2- 172.21.15.99:0/2333107670 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3aa01021e0 0x7f3aa0112890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:33:38.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:38.107+0000 7f3aa5e23640 1 -- 172.21.15.99:0/2333107670 >> 172.21.15.99:0/2333107670 conn(0x7f3aa00710b0 msgr2=0x7f3aa00fa170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:33:38.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:38.107+0000 7f3aa5e23640 1 -- 172.21.15.99:0/2333107670 shutdown_connections 2024-09-19T06:33:38.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:38.107+0000 7f3aa5e23640 1 -- 172.21.15.99:0/2333107670 wait complete. 2024-09-19T06:33:38.425 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:38 smithi099 ceph-mon[27651]: Reconfiguring mon.smithi099 (unknown last config time)... 2024-09-19T06:33:38.425 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:38 smithi099 ceph-mon[27651]: Reconfiguring daemon mon.smithi099 on smithi099 2024-09-19T06:33:38.425 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:38 smithi099 ceph-mon[27651]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:33:38.425 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:38 smithi099 ceph-mon[27651]: from='client.? 172.21.15.99:0/2333107670' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:33:38.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:38 smithi117 ceph-mon[34564]: Reconfiguring mon.smithi099 (unknown last config time)... 2024-09-19T06:33:38.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:38 smithi117 ceph-mon[34564]: Reconfiguring daemon mon.smithi099 on smithi099 2024-09-19T06:33:38.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:38 smithi117 ceph-mon[34564]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:33:38.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:38 smithi117 ceph-mon[34564]: from='client.? 172.21.15.99:0/2333107670' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:33:39.185 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-19T06:33:39.186 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-19T06:33:39.186 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T06:33:39.213 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-19T06:33:39.213 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:33:39.279 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-19T06:33:39.279 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T06:33:39.313 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-19T06:33:39.313 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:33:39.383 INFO:tasks.cephadm:Deploying OSDs... 2024-09-19T06:33:39.383 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-19T06:33:39.384 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T06:33:39.400 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T06:33:39.400 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_1 2024-09-19T06:33:39.455 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T06:33:39.456 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T06:33:39.456 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-19T06:33:39.456 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:33:39.456 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T06:33:39.456 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-09-19 06:32:58.566819107 +0000 2024-09-19T06:33:39.456 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-09-19 06:27:49.337144645 +0000 2024-09-19T06:33:39.456 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-09-19 06:27:49.337144645 +0000 2024-09-19T06:33:39.456 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: 2024-09-19 06:27:49.337144645 +0000 2024-09-19T06:33:39.456 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T06:33:39.525 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-09-19T06:33:39.526 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-09-19T06:33:39.526 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000216494 s, 2.4 MB/s 2024-09-19T06:33:39.527 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T06:33:39.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:39 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:39.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:39 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:39.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:39 smithi117 ceph-mon[34564]: Reconfiguring mgr.smithi099.pgvkqi (unknown last config time)... 2024-09-19T06:33:39.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:39 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi099.pgvkqi", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T06:33:39.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:39 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T06:33:39.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:39 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:33:39.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:39 smithi117 ceph-mon[34564]: Reconfiguring daemon mgr.smithi099.pgvkqi on smithi099 2024-09-19T06:33:39.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:39 smithi117 ceph-mon[34564]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:33:39.584 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_2 2024-09-19T06:33:39.639 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T06:33:39.639 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T06:33:39.639 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-19T06:33:39.639 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:33:39.639 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T06:33:39.640 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-09-19 06:32:58.566819107 +0000 2024-09-19T06:33:39.640 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-09-19 06:27:49.664136687 +0000 2024-09-19T06:33:39.640 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-09-19 06:27:49.664136687 +0000 2024-09-19T06:33:39.640 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: 2024-09-19 06:27:49.664136687 +0000 2024-09-19T06:33:39.640 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T06:33:39.704 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-09-19T06:33:39.704 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-09-19T06:33:39.704 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000323717 s, 1.6 MB/s 2024-09-19T06:33:39.705 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T06:33:39.757 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:39 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:39.757 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:39 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:39.758 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:39 smithi099 ceph-mon[27651]: Reconfiguring mgr.smithi099.pgvkqi (unknown last config time)... 2024-09-19T06:33:39.758 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:39 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi099.pgvkqi", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T06:33:39.758 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:39 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T06:33:39.758 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:39 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:33:39.758 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:39 smithi099 ceph-mon[27651]: Reconfiguring daemon mgr.smithi099.pgvkqi on smithi099 2024-09-19T06:33:39.759 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:39 smithi099 ceph-mon[27651]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:33:39.761 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_3 2024-09-19T06:33:39.817 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T06:33:39.817 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T06:33:39.818 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-19T06:33:39.818 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:33:39.818 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T06:33:39.818 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-09-19 06:32:58.567819083 +0000 2024-09-19T06:33:39.818 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-09-19 06:27:49.993128680 +0000 2024-09-19T06:33:39.818 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-09-19 06:27:49.993128680 +0000 2024-09-19T06:33:39.818 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: 2024-09-19 06:27:49.993128680 +0000 2024-09-19T06:33:39.819 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T06:33:39.880 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-09-19T06:33:39.881 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-09-19T06:33:39.881 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000285875 s, 1.8 MB/s 2024-09-19T06:33:39.882 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T06:33:39.938 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_4 2024-09-19T06:33:39.993 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T06:33:39.993 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T06:33:39.994 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-19T06:33:39.994 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:33:39.994 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T06:33:39.994 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-09-19 06:32:58.567819083 +0000 2024-09-19T06:33:39.994 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-09-19 06:27:50.342120186 +0000 2024-09-19T06:33:39.994 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-09-19 06:27:50.342120186 +0000 2024-09-19T06:33:39.994 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: 2024-09-19 06:27:50.342120186 +0000 2024-09-19T06:33:39.994 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T06:33:40.058 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-09-19T06:33:40.058 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-09-19T06:33:40.058 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000190809 s, 2.7 MB/s 2024-09-19T06:33:40.059 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T06:33:40.115 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-19T06:33:40.115 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T06:33:40.135 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T06:33:40.135 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_1 2024-09-19T06:33:40.194 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T06:33:40.194 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T06:33:40.194 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-19T06:33:40.194 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:33:40.194 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T06:33:40.195 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-09-19 06:33:26.417208284 +0000 2024-09-19T06:33:40.195 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-09-19 06:27:51.785914386 +0000 2024-09-19T06:33:40.195 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-09-19 06:27:51.785914386 +0000 2024-09-19T06:33:40.195 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: 2024-09-19 06:27:51.785914386 +0000 2024-09-19T06:33:40.195 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T06:33:40.262 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-09-19T06:33:40.262 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-09-19T06:33:40.263 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.00036396 s, 1.4 MB/s 2024-09-19T06:33:40.264 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T06:33:40.322 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_2 2024-09-19T06:33:40.381 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T06:33:40.384 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T06:33:40.384 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-19T06:33:40.384 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:33:40.384 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T06:33:40.384 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-09-19 06:33:26.417208284 +0000 2024-09-19T06:33:40.384 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-09-19 06:27:52.114907862 +0000 2024-09-19T06:33:40.384 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-09-19 06:27:52.114907862 +0000 2024-09-19T06:33:40.384 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: 2024-09-19 06:27:52.114907862 +0000 2024-09-19T06:33:40.385 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T06:33:40.449 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-09-19T06:33:40.449 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-09-19T06:33:40.449 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000265066 s, 1.9 MB/s 2024-09-19T06:33:40.451 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T06:33:40.509 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_3 2024-09-19T06:33:40.567 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T06:33:40.568 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T06:33:40.568 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-19T06:33:40.568 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:33:40.568 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T06:33:40.568 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-09-19 06:33:26.418208265 +0000 2024-09-19T06:33:40.568 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-09-19 06:27:52.435901497 +0000 2024-09-19T06:33:40.569 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-09-19 06:27:52.435901497 +0000 2024-09-19T06:33:40.569 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: 2024-09-19 06:27:52.435901497 +0000 2024-09-19T06:33:40.569 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T06:33:40.633 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-09-19T06:33:40.633 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-09-19T06:33:40.634 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000220712 s, 2.3 MB/s 2024-09-19T06:33:40.635 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T06:33:40.692 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_4 2024-09-19T06:33:40.748 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T06:33:40.748 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T06:33:40.748 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-19T06:33:40.748 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:33:40.749 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T06:33:40.749 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-09-19 06:33:26.418208265 +0000 2024-09-19T06:33:40.749 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-09-19 06:27:52.762895013 +0000 2024-09-19T06:33:40.749 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-09-19 06:27:52.762895013 +0000 2024-09-19T06:33:40.749 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: 2024-09-19 06:27:52.762895013 +0000 2024-09-19T06:33:40.749 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T06:33:40.816 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-09-19T06:33:40.816 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-09-19T06:33:40.816 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.00019834 s, 2.6 MB/s 2024-09-19T06:33:40.817 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T06:33:40.874 INFO:tasks.cephadm:Deploying osd.0 on smithi099 with /dev/vg_nvme/lv_4... 2024-09-19T06:33:40.874 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T06:33:41.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:41 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:41.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:41 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:41.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:41 smithi099 ceph-mon[27651]: Reconfiguring crash.smithi099 (monmap changed)... 2024-09-19T06:33:41.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:41 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi099", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-19T06:33:41.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:41 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:33:41.708 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:41 smithi099 ceph-mon[27651]: Reconfiguring daemon crash.smithi099 on smithi099 2024-09-19T06:33:41.708 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:41 smithi099 ceph-mon[27651]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:33:41.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:41 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:41.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:41 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:41.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:41 smithi117 ceph-mon[34564]: Reconfiguring crash.smithi099 (monmap changed)... 2024-09-19T06:33:41.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:41 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi099", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-19T06:33:41.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:41 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:33:41.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:41 smithi117 ceph-mon[34564]: Reconfiguring daemon crash.smithi099 on smithi099 2024-09-19T06:33:41.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:41 smithi117 ceph-mon[34564]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:33:41.855 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T06:33:43.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:42 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:43.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:42 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:43.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:42 smithi117 ceph-mon[34564]: Reconfiguring alertmanager.smithi099 (dependencies changed)... 2024-09-19T06:33:43.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:42 smithi117 ceph-mon[34564]: Reconfiguring daemon alertmanager.smithi099 on smithi099 2024-09-19T06:33:43.133 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:42 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:43.133 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:42 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:43.134 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:42 smithi099 ceph-mon[27651]: Reconfiguring alertmanager.smithi099 (dependencies changed)... 2024-09-19T06:33:43.134 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:42 smithi099 ceph-mon[27651]: Reconfiguring daemon alertmanager.smithi099 on smithi099 2024-09-19T06:33:44.133 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:43 smithi099 ceph-mon[27651]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:33:44.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:43 smithi117 ceph-mon[34564]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:33:45.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:45 smithi099 ceph-mon[27651]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:33:46.114 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:45 smithi117 ceph-mon[34564]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:33:47.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:47 smithi099 ceph-mon[27651]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:33:47.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:47 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:47.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:47 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:48.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:47 smithi117 ceph-mon[34564]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:33:48.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:47 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:48.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:47 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:48.917 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:48 smithi099 ceph-mon[27651]: Reconfiguring grafana.smithi099 (dependencies changed)... 2024-09-19T06:33:48.917 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:48 smithi099 ceph-mon[27651]: Reconfiguring daemon grafana.smithi099 on smithi099 2024-09-19T06:33:49.197 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:33:49.220 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi099:vg_nvme/lv_4 2024-09-19T06:33:49.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:48 smithi117 ceph-mon[34564]: Reconfiguring grafana.smithi099 (dependencies changed)... 2024-09-19T06:33:49.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:48 smithi117 ceph-mon[34564]: Reconfiguring daemon grafana.smithi099 on smithi099 2024-09-19T06:33:50.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:49 smithi099 ceph-mon[27651]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:33:50.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:49 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:33:50.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:49 smithi117 ceph-mon[34564]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:33:50.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:49 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:33:50.929 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T06:33:51.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:51 smithi099 ceph-mon[27651]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:33:52.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:51 smithi117 ceph-mon[34564]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:33:53.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:53.372+0000 7fa3d982f640 1 -- 172.21.15.99:0/4208307710 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3d40fb450 msgr2=0x7fa3d40fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:33:53.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:53.372+0000 7fa3d982f640 1 --2- 172.21.15.99:0/4208307710 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3d40fb450 0x7fa3d40fb860 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa3c40048d0 tx=0x7fa3c4009da0 comp rx=0 tx=0).stop 2024-09-19T06:33:53.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:53.372+0000 7fa3d982f640 1 -- 172.21.15.99:0/4208307710 shutdown_connections 2024-09-19T06:33:53.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:53.372+0000 7fa3d982f640 1 --2- 172.21.15.99:0/4208307710 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3d40fc720 0x7fa3d40fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:33:53.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:53.372+0000 7fa3d982f640 1 --2- 172.21.15.99:0/4208307710 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3d40fb450 0x7fa3d40fb860 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:33:53.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:53.372+0000 7fa3d982f640 1 -- 172.21.15.99:0/4208307710 >> 172.21.15.99:0/4208307710 conn(0x7fa3d40f6c10 msgr2=0x7fa3d40f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:33:53.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:53.372+0000 7fa3d982f640 1 -- 172.21.15.99:0/4208307710 shutdown_connections 2024-09-19T06:33:53.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:53.372+0000 7fa3d982f640 1 -- 172.21.15.99:0/4208307710 wait complete. 2024-09-19T06:33:53.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:53.373+0000 7fa3d982f640 1 Processor -- start 2024-09-19T06:33:53.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:53.373+0000 7fa3d982f640 1 -- start start 2024-09-19T06:33:53.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:53.373+0000 7fa3d982f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3d40fb450 0x7fa3d410fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:33:53.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:53.373+0000 7fa3d982f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3d40fc720 0x7fa3d4112410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:33:53.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:53.373+0000 7fa3d982f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d40667c0 con 0x7fa3d40fb450 2024-09-19T06:33:53.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:53.373+0000 7fa3d982f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d4066930 con 0x7fa3d40fc720 2024-09-19T06:33:53.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:53.373+0000 7fa3d2ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3d40fb450 0x7fa3d410fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:33:53.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:53.373+0000 7fa3d2ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3d40fb450 0x7fa3d410fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48896/0 (socket says 172.21.15.99:48896) 2024-09-19T06:33:53.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:53.373+0000 7fa3d2ffd640 1 -- 172.21.15.99:0/2097216578 learned_addr learned my addr 172.21.15.99:0/2097216578 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:33:53.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:53.373+0000 7fa3d27fc640 1 --2- 172.21.15.99:0/2097216578 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3d40fc720 0x7fa3d4112410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:33:53.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:53.373+0000 7fa3d2ffd640 1 -- 172.21.15.99:0/2097216578 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3d40fc720 msgr2=0x7fa3d4112410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:33:53.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:53.373+0000 7fa3d2ffd640 1 --2- 172.21.15.99:0/2097216578 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3d40fc720 0x7fa3d4112410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:33:53.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:53.373+0000 7fa3d2ffd640 1 -- 172.21.15.99:0/2097216578 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3c4005040 con 0x7fa3d40fb450 2024-09-19T06:33:53.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:53.374+0000 7fa3d2ffd640 1 --2- 172.21.15.99:0/2097216578 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3d40fb450 0x7fa3d410fec0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa3c4000c00 tx=0x7fa3c4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:33:53.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:53.374+0000 7fa3bb7fe640 1 -- 172.21.15.99:0/2097216578 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3c4038070 con 0x7fa3d40fb450 2024-09-19T06:33:53.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:53.374+0000 7fa3bb7fe640 1 -- 172.21.15.99:0/2097216578 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa3c402ae90 con 0x7fa3d40fb450 2024-09-19T06:33:53.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:53.374+0000 7fa3d982f640 1 -- 172.21.15.99:0/2097216578 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3d41129b0 con 0x7fa3d40fb450 2024-09-19T06:33:53.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:53.374+0000 7fa3bb7fe640 1 -- 172.21.15.99:0/2097216578 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3c403d420 con 0x7fa3d40fb450 2024-09-19T06:33:53.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:53.374+0000 7fa3d982f640 1 -- 172.21.15.99:0/2097216578 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3d4112ed0 con 0x7fa3d40fb450 2024-09-19T06:33:53.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:53.375+0000 7fa3d982f640 1 -- 172.21.15.99:0/2097216578 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3d40fa8b0 con 0x7fa3d40fb450 2024-09-19T06:33:53.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:53.376+0000 7fa3bb7fe640 1 -- 172.21.15.99:0/2097216578 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 18) v1 ==== 90811+0+0 (secure 0 0 0) 0x7fa3c4030020 con 0x7fa3d40fb450 2024-09-19T06:33:53.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:53.376+0000 7fa3bb7fe640 1 --2- 172.21.15.99:0/2097216578 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fa3bc06ecc0 0x7fa3bc071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:33:53.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:53.376+0000 7fa3bb7fe640 1 -- 172.21.15.99:0/2097216578 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fa3c40ad820 con 0x7fa3d40fb450 2024-09-19T06:33:53.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:53.376+0000 7fa3d27fc640 1 --2- 172.21.15.99:0/2097216578 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fa3bc06ecc0 0x7fa3bc071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:33:53.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:53.377+0000 7fa3d27fc640 1 --2- 172.21.15.99:0/2097216578 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fa3bc06ecc0 0x7fa3bc071170 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa3c8006fd0 tx=0x7fa3c8008040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:33:53.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:53.380+0000 7fa3bb7fe640 1 -- 172.21.15.99:0/2097216578 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fa3c407ba20 con 0x7fa3d40fb450 2024-09-19T06:33:53.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:33:53.564+0000 7fa3d982f640 1 -- 172.21.15.99:0/2097216578 --> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fa3d4100bd0 con 0x7fa3bc06ecc0 2024-09-19T06:33:54.120 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:53 smithi099 ceph-mon[27651]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:33:54.120 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:53 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:33:54.120 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:53 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:33:54.120 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:53 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:33:54.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:53 smithi117 ceph-mon[34564]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:33:54.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:53 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:33:54.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:53 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:33:54.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:53 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:33:54.926 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:54 smithi099 ceph-mon[27651]: from='client.14240 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:33:55.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:54 smithi117 ceph-mon[34564]: from='client.14240 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:33:56.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:56 smithi117 ceph-mon[34564]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:33:56.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:56 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:56.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:56 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:56.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:56 smithi117 ceph-mon[34564]: Reconfiguring prometheus.smithi099 (dependencies changed)... 2024-09-19T06:33:56.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:56 smithi117 ceph-mon[34564]: Reconfiguring daemon prometheus.smithi099 on smithi099 2024-09-19T06:33:56.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:56 smithi099 ceph-mon[27651]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:33:56.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:56 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:56.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:56 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:33:56.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:56 smithi099 ceph-mon[27651]: Reconfiguring prometheus.smithi099 (dependencies changed)... 2024-09-19T06:33:56.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:56 smithi099 ceph-mon[27651]: Reconfiguring daemon prometheus.smithi099 on smithi099 2024-09-19T06:33:57.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:57 smithi099 ceph-mon[27651]: from='client.? 172.21.15.99:0/1817637898' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "161a5999-8f1e-47b7-8539-3fb969206f5f"}]: dispatch 2024-09-19T06:33:57.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:57 smithi099 ceph-mon[27651]: from='client.? 172.21.15.99:0/1817637898' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "161a5999-8f1e-47b7-8539-3fb969206f5f"}]': finished 2024-09-19T06:33:57.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:57 smithi099 ceph-mon[27651]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T06:33:57.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:57 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:33:57.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:57 smithi099 ceph-mon[27651]: from='client.? 172.21.15.99:0/3714657296' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:33:57.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:57 smithi117 ceph-mon[34564]: from='client.? 172.21.15.99:0/1817637898' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "161a5999-8f1e-47b7-8539-3fb969206f5f"}]: dispatch 2024-09-19T06:33:57.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:57 smithi117 ceph-mon[34564]: from='client.? 172.21.15.99:0/1817637898' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "161a5999-8f1e-47b7-8539-3fb969206f5f"}]': finished 2024-09-19T06:33:57.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:57 smithi117 ceph-mon[34564]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T06:33:57.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:57 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:33:57.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:57 smithi117 ceph-mon[34564]: from='client.? 172.21.15.99:0/3714657296' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:33:58.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:33:58 smithi117 ceph-mon[34564]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:33:58.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:33:58 smithi099 ceph-mon[27651]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:34:00.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:00 smithi099 ceph-mon[27651]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:34:00.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:00 smithi117 ceph-mon[34564]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:34:02.265 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:02 smithi099 ceph-mon[27651]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:34:02.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:02 smithi117 ceph-mon[34564]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:34:04.373 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:04 smithi099 ceph-mon[27651]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:34:04.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:04 smithi117 ceph-mon[34564]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:34:05.349 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:05 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:34:05.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:05 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:34:06.189 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:06 smithi099 ceph-mon[27651]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:34:06.190 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:06 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:06.190 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:06 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:06.190 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:06 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi117", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-19T06:34:06.190 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:06 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:34:06.415 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:06 smithi117 ceph-mon[34564]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:34:06.415 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:06 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:06.415 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:06 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:06.416 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:06 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi117", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-19T06:34:06.416 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:06 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:34:07.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:07 smithi117 ceph-mon[34564]: Reconfiguring crash.smithi117 (monmap changed)... 2024-09-19T06:34:07.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:07 smithi117 ceph-mon[34564]: Reconfiguring daemon crash.smithi117 on smithi117 2024-09-19T06:34:07.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:07 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T06:34:07.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:07 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:34:07.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:07 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:07.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:07 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:07.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:07 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi117.ssmkcf", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T06:34:07.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:07 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T06:34:07.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:07 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:34:07.403 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:07 smithi099 ceph-mon[27651]: Reconfiguring crash.smithi117 (monmap changed)... 2024-09-19T06:34:07.403 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:07 smithi099 ceph-mon[27651]: Reconfiguring daemon crash.smithi117 on smithi117 2024-09-19T06:34:07.403 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:07 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T06:34:07.403 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:07 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:34:07.404 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:07 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:07.404 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:07 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:07.404 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:07 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi117.ssmkcf", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T06:34:07.404 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:07 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T06:34:07.404 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:07 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:34:08.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:08 smithi099 ceph-mon[27651]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:34:08.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:08 smithi099 ceph-mon[27651]: Deploying daemon osd.0 on smithi099 2024-09-19T06:34:08.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:08 smithi099 ceph-mon[27651]: Reconfiguring mgr.smithi117.ssmkcf (monmap changed)... 2024-09-19T06:34:08.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:08 smithi099 ceph-mon[27651]: Reconfiguring daemon mgr.smithi117.ssmkcf on smithi117 2024-09-19T06:34:08.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:08 smithi117 ceph-mon[34564]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:34:08.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:08 smithi117 ceph-mon[34564]: Deploying daemon osd.0 on smithi099 2024-09-19T06:34:08.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:08 smithi117 ceph-mon[34564]: Reconfiguring mgr.smithi117.ssmkcf (monmap changed)... 2024-09-19T06:34:08.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:08 smithi117 ceph-mon[34564]: Reconfiguring daemon mgr.smithi117.ssmkcf on smithi117 2024-09-19T06:34:09.605 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:09 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:09.605 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:09 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:09.605 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:09 smithi117 ceph-mon[34564]: Reconfiguring mon.smithi117 (monmap changed)... 2024-09-19T06:34:09.605 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:09 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T06:34:09.605 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:09 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T06:34:09.606 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:09 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:34:09.606 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:09 smithi117 ceph-mon[34564]: Reconfiguring daemon mon.smithi117 on smithi117 2024-09-19T06:34:09.606 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:09 smithi117 ceph-mon[34564]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:34:09.674 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:09 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:09.674 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:09 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:09.674 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:09 smithi099 ceph-mon[27651]: Reconfiguring mon.smithi117 (monmap changed)... 2024-09-19T06:34:09.674 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:09 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T06:34:09.674 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:09 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T06:34:09.674 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:09 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:34:09.674 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:09 smithi099 ceph-mon[27651]: Reconfiguring daemon mon.smithi117 on smithi117 2024-09-19T06:34:09.674 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:09 smithi099 ceph-mon[27651]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:34:10.945 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:10 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:10.945 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:10 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:10.945 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:10 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-19T06:34:10.945 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:10 smithi099 ceph-mon[27651]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-19T06:34:10.945 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:10 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi099.front.sepia.ceph.com:9093"}]: dispatch 2024-09-19T06:34:10.945 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:10 smithi099 ceph-mon[27651]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi099.front.sepia.ceph.com:9093"}]: dispatch 2024-09-19T06:34:10.946 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:10 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:10.946 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:10 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-19T06:34:10.946 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:10 smithi099 ceph-mon[27651]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-19T06:34:10.946 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:10 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi099.front.sepia.ceph.com:3000"}]: dispatch 2024-09-19T06:34:10.946 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:10 smithi099 ceph-mon[27651]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi099.front.sepia.ceph.com:3000"}]: dispatch 2024-09-19T06:34:10.946 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:10 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:10.946 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:10 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-19T06:34:10.946 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:10 smithi099 ceph-mon[27651]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-19T06:34:10.946 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:10 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi099.front.sepia.ceph.com:9095"}]: dispatch 2024-09-19T06:34:10.946 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:10 smithi099 ceph-mon[27651]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi099.front.sepia.ceph.com:9095"}]: dispatch 2024-09-19T06:34:10.946 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:10 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:10.946 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:10 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:34:11.027 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:10 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:11.027 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:10 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:11.027 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:10 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-19T06:34:11.028 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:10 smithi117 ceph-mon[34564]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-19T06:34:11.028 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:10 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi099.front.sepia.ceph.com:9093"}]: dispatch 2024-09-19T06:34:11.028 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:10 smithi117 ceph-mon[34564]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi099.front.sepia.ceph.com:9093"}]: dispatch 2024-09-19T06:34:11.028 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:10 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:11.028 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:10 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-19T06:34:11.028 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:10 smithi117 ceph-mon[34564]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-19T06:34:11.028 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:10 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi099.front.sepia.ceph.com:3000"}]: dispatch 2024-09-19T06:34:11.028 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:10 smithi117 ceph-mon[34564]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi099.front.sepia.ceph.com:3000"}]: dispatch 2024-09-19T06:34:11.028 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:10 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:11.029 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:10 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-19T06:34:11.029 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:10 smithi117 ceph-mon[34564]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-19T06:34:11.029 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:10 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi099.front.sepia.ceph.com:9095"}]: dispatch 2024-09-19T06:34:11.029 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:10 smithi117 ceph-mon[34564]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi099.front.sepia.ceph.com:9095"}]: dispatch 2024-09-19T06:34:11.029 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:10 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:11.029 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:10 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:34:11.741 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:11 smithi099 ceph-mon[27651]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:34:11.741 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:11 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:11.741 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:11 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:11.967 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:11 smithi117 ceph-mon[34564]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:34:11.967 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:11 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:11.967 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:11 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:13.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:13 smithi099 ceph-mon[27651]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:34:14.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:13 smithi117 ceph-mon[34564]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:34:15.811 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:15 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:15.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:15 smithi117 ceph-mon[34564]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:34:15.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:15 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:15.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:15 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:15.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:15 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:15.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:15 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:34:15.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:15 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:34:15.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:15 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:15.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:15 smithi099 ceph-mon[27651]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:34:15.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:15 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:15.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:15 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:15.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:15 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:15.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:15 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:34:15.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:15 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:34:16.776 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:16 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:16.776 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:16 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:34:16.864 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:16 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:16.864 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:16 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:34:17.561 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:17 smithi099 ceph-mon[27651]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:34:17.562 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:17 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:17.562 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:17 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:17.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:17.595+0000 7fa3bb7fe640 1 -- 172.21.15.99:0/2097216578 <== mgr.14206 v2:172.21.15.99:6800/886909451 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fa3d4100bd0 con 0x7fa3bc06ecc0 2024-09-19T06:34:17.597 INFO:teuthology.orchestra.run.smithi099.stdout:Created osd(s) 0 on host 'smithi099' 2024-09-19T06:34:17.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:17.598+0000 7fa3d982f640 1 -- 172.21.15.99:0/2097216578 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fa3bc06ecc0 msgr2=0x7fa3bc071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:34:17.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:17.598+0000 7fa3d982f640 1 --2- 172.21.15.99:0/2097216578 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fa3bc06ecc0 0x7fa3bc071170 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa3c8006fd0 tx=0x7fa3c8008040 comp rx=0 tx=0).stop 2024-09-19T06:34:17.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:17.598+0000 7fa3d982f640 1 -- 172.21.15.99:0/2097216578 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3d40fb450 msgr2=0x7fa3d410fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:34:17.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:17.598+0000 7fa3d982f640 1 --2- 172.21.15.99:0/2097216578 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3d40fb450 0x7fa3d410fec0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa3c4000c00 tx=0x7fa3c4009da0 comp rx=0 tx=0).stop 2024-09-19T06:34:17.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:17.598+0000 7fa3d982f640 1 -- 172.21.15.99:0/2097216578 shutdown_connections 2024-09-19T06:34:17.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:17.598+0000 7fa3d982f640 1 --2- 172.21.15.99:0/2097216578 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fa3bc06ecc0 0x7fa3bc071170 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:34:17.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:17.598+0000 7fa3d982f640 1 --2- 172.21.15.99:0/2097216578 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3d40fc720 0x7fa3d4112410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:34:17.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:17.598+0000 7fa3d982f640 1 --2- 172.21.15.99:0/2097216578 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3d40fb450 0x7fa3d410fec0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:34:17.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:17.598+0000 7fa3d982f640 1 -- 172.21.15.99:0/2097216578 >> 172.21.15.99:0/2097216578 conn(0x7fa3d40f6c10 msgr2=0x7fa3d40f8480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:34:17.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:17.598+0000 7fa3d982f640 1 -- 172.21.15.99:0/2097216578 shutdown_connections 2024-09-19T06:34:17.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:17.598+0000 7fa3d982f640 1 -- 172.21.15.99:0/2097216578 wait complete. 2024-09-19T06:34:17.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:17 smithi117 ceph-mon[34564]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:34:17.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:17 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:17.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:17 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:18.173 DEBUG:teuthology.orchestra.run.smithi099:osd.0> sudo journalctl -f -n 0 -u ceph-a73eb958-7650-11ef-bceb-c7b262605968@osd.0.service 2024-09-19T06:34:18.176 INFO:tasks.cephadm:Deploying osd.1 on smithi099 with /dev/vg_nvme/lv_3... 2024-09-19T06:34:18.176 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T06:34:18.519 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T06:34:18.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:18 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:18.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:18 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:18.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:18 smithi099 ceph-mon[27651]: from='osd.0 [v2:172.21.15.99:6802/223723623,v1:172.21.15.99:6803/223723623]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T06:34:18.707 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 06:34:18 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-0[46051]: 2024-09-19T06:34:18.404+0000 7ff651428440 -1 osd.0 0 log_to_monitors true 2024-09-19T06:34:19.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:18 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:19.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:18 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:19.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:18 smithi117 ceph-mon[34564]: from='osd.0 [v2:172.21.15.99:6802/223723623,v1:172.21.15.99:6803/223723623]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T06:34:19.748 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:19 smithi099 ceph-mon[27651]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:34:19.748 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:19 smithi099 ceph-mon[27651]: from='osd.0 [v2:172.21.15.99:6802/223723623,v1:172.21.15.99:6803/223723623]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T06:34:19.748 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:19 smithi099 ceph-mon[27651]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T06:34:19.748 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:19 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:34:19.748 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:19 smithi099 ceph-mon[27651]: from='osd.0 [v2:172.21.15.99:6802/223723623,v1:172.21.15.99:6803/223723623]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-19T06:34:19.748 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:19 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:34:19.749 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 06:34:19 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-0[46051]: 2024-09-19T06:34:19.601+0000 7ff64cb9a640 -1 osd.0 0 waiting for initial osdmap 2024-09-19T06:34:19.749 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 06:34:19 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-0[46051]: 2024-09-19T06:34:19.604+0000 7ff6471d0640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:34:20.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:19 smithi117 ceph-mon[34564]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:34:20.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:19 smithi117 ceph-mon[34564]: from='osd.0 [v2:172.21.15.99:6802/223723623,v1:172.21.15.99:6803/223723623]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T06:34:20.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:19 smithi117 ceph-mon[34564]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T06:34:20.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:19 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:34:20.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:19 smithi117 ceph-mon[34564]: from='osd.0 [v2:172.21.15.99:6802/223723623,v1:172.21.15.99:6803/223723623]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-19T06:34:20.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:19 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:34:20.836 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:20 smithi099 ceph-mon[27651]: from='osd.0 [v2:172.21.15.99:6802/223723623,v1:172.21.15.99:6803/223723623]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-09-19T06:34:20.836 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:20 smithi099 ceph-mon[27651]: osdmap e8: 1 total, 0 up, 1 in 2024-09-19T06:34:20.836 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:20 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:34:20.836 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:20 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:34:21.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:20 smithi117 ceph-mon[34564]: from='osd.0 [v2:172.21.15.99:6802/223723623,v1:172.21.15.99:6803/223723623]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-09-19T06:34:21.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:20 smithi117 ceph-mon[34564]: osdmap e8: 1 total, 0 up, 1 in 2024-09-19T06:34:21.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:20 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:34:21.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:20 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:34:21.543 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:34:21.564 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi099:vg_nvme/lv_3 2024-09-19T06:34:21.947 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T06:34:21.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:21 smithi099 ceph-mon[27651]: purged_snaps scrub starts 2024-09-19T06:34:21.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:21 smithi099 ceph-mon[27651]: purged_snaps scrub ok 2024-09-19T06:34:21.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:21 smithi099 ceph-mon[27651]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:34:21.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:21 smithi099 ceph-mon[27651]: osd.0 [v2:172.21.15.99:6802/223723623,v1:172.21.15.99:6803/223723623] boot 2024-09-19T06:34:21.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:21 smithi099 ceph-mon[27651]: osdmap e9: 1 total, 1 up, 1 in 2024-09-19T06:34:21.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:21 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:34:21.966 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:21 smithi117 ceph-mon[34564]: purged_snaps scrub starts 2024-09-19T06:34:21.967 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:21 smithi117 ceph-mon[34564]: purged_snaps scrub ok 2024-09-19T06:34:21.967 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:21 smithi117 ceph-mon[34564]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T06:34:21.967 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:21 smithi117 ceph-mon[34564]: osd.0 [v2:172.21.15.99:6802/223723623,v1:172.21.15.99:6803/223723623] boot 2024-09-19T06:34:21.967 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:21 smithi117 ceph-mon[34564]: osdmap e9: 1 total, 1 up, 1 in 2024-09-19T06:34:21.967 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:21 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:34:22.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:22 smithi099 ceph-mon[27651]: osdmap e10: 1 total, 1 up, 1 in 2024-09-19T06:34:23.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:22 smithi117 ceph-mon[34564]: osdmap e10: 1 total, 1 up, 1 in 2024-09-19T06:34:23.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:23 smithi099 ceph-mon[27651]: pgmap v37: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:34:23.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:23 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:23.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:23 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:24.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:23 smithi117 ceph-mon[34564]: pgmap v37: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:34:24.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:23 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:24.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:23 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:25.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:25.116+0000 7fb66ff76640 1 -- 172.21.15.99:0/3752294048 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb6680fc520 msgr2=0x7fb6680fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:34:25.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:25.116+0000 7fb66ff76640 1 --2- 172.21.15.99:0/3752294048 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb6680fc520 0x7fb6680fc930 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb658009c50 tx=0x7fb658004d10 comp rx=0 tx=0).stop 2024-09-19T06:34:25.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:25.116+0000 7fb66ff76640 1 -- 172.21.15.99:0/3752294048 shutdown_connections 2024-09-19T06:34:25.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:25.116+0000 7fb66ff76640 1 --2- 172.21.15.99:0/3752294048 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6680fd7f0 0x7fb6680fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:34:25.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:25.116+0000 7fb66ff76640 1 --2- 172.21.15.99:0/3752294048 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb6680fc520 0x7fb6680fc930 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:34:25.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:25.116+0000 7fb66ff76640 1 -- 172.21.15.99:0/3752294048 >> 172.21.15.99:0/3752294048 conn(0x7fb6680f7ce0 msgr2=0x7fb6680fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:34:25.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:25.116+0000 7fb66ff76640 1 -- 172.21.15.99:0/3752294048 shutdown_connections 2024-09-19T06:34:25.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:25.116+0000 7fb66ff76640 1 -- 172.21.15.99:0/3752294048 wait complete. 2024-09-19T06:34:25.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:25.116+0000 7fb66ff76640 1 Processor -- start 2024-09-19T06:34:25.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:25.116+0000 7fb66ff76640 1 -- start start 2024-09-19T06:34:25.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:25.117+0000 7fb66ff76640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6680fc520 0x7fb66810d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:34:25.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:25.117+0000 7fb66ff76640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb6680fd7f0 0x7fb66810d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:34:25.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:25.117+0000 7fb66ff76640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb66810e450 con 0x7fb6680fd7f0 2024-09-19T06:34:25.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:25.117+0000 7fb66ff76640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb66810e5c0 con 0x7fb6680fc520 2024-09-19T06:34:25.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:25.117+0000 7fb66d511640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb6680fd7f0 0x7fb66810d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:34:25.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:25.117+0000 7fb66d511640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb6680fd7f0 0x7fb66810d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60780/0 (socket says 172.21.15.99:60780) 2024-09-19T06:34:25.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:25.117+0000 7fb66d511640 1 -- 172.21.15.99:0/1140466218 learned_addr learned my addr 172.21.15.99:0/1140466218 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:34:25.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:25.117+0000 7fb66dd12640 1 --2- 172.21.15.99:0/1140466218 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6680fc520 0x7fb66810d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:34:25.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:25.117+0000 7fb66d511640 1 -- 172.21.15.99:0/1140466218 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6680fc520 msgr2=0x7fb66810d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:34:25.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:25.117+0000 7fb66d511640 1 --2- 172.21.15.99:0/1140466218 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6680fc520 0x7fb66810d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:34:25.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:25.117+0000 7fb66d511640 1 -- 172.21.15.99:0/1140466218 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6580098b0 con 0x7fb6680fd7f0 2024-09-19T06:34:25.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:25.117+0000 7fb66d511640 1 --2- 172.21.15.99:0/1140466218 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb6680fd7f0 0x7fb66810d5e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb65c00b790 tx=0x7fb65c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:34:25.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:25.117+0000 7fb6667fc640 1 -- 172.21.15.99:0/1140466218 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb65c00c700 con 0x7fb6680fd7f0 2024-09-19T06:34:25.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:25.117+0000 7fb66ff76640 1 -- 172.21.15.99:0/1140466218 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb66810e8a0 con 0x7fb6680fd7f0 2024-09-19T06:34:25.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:25.117+0000 7fb6667fc640 1 -- 172.21.15.99:0/1140466218 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb65c00cd00 con 0x7fb6680fd7f0 2024-09-19T06:34:25.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:25.117+0000 7fb6667fc640 1 -- 172.21.15.99:0/1140466218 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb65c015e70 con 0x7fb6680fd7f0 2024-09-19T06:34:25.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:25.117+0000 7fb66ff76640 1 -- 172.21.15.99:0/1140466218 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb66810edc0 con 0x7fb6680fd7f0 2024-09-19T06:34:25.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:25.118+0000 7fb66ff76640 1 -- 172.21.15.99:0/1140466218 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6680fb980 con 0x7fb6680fd7f0 2024-09-19T06:34:25.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:25.119+0000 7fb6667fc640 1 -- 172.21.15.99:0/1140466218 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 18) v1 ==== 90811+0+0 (secure 0 0 0) 0x7fb65c012070 con 0x7fb6680fd7f0 2024-09-19T06:34:25.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:25.119+0000 7fb6667fc640 1 --2- 172.21.15.99:0/1140466218 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fb65006ecc0 0x7fb650071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:34:25.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:25.120+0000 7fb66dd12640 1 --2- 172.21.15.99:0/1140466218 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fb65006ecc0 0x7fb650071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:34:25.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:25.120+0000 7fb6667fc640 1 -- 172.21.15.99:0/1140466218 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1978+0+0 (secure 0 0 0) 0x7fb65c08ce40 con 0x7fb6680fd7f0 2024-09-19T06:34:25.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:25.120+0000 7fb66dd12640 1 --2- 172.21.15.99:0/1140466218 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fb65006ecc0 0x7fb650071170 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb658000f80 tx=0x7fb658004d10 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:34:25.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:25.123+0000 7fb6667fc640 1 -- 172.21.15.99:0/1140466218 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fb65c05ade0 con 0x7fb6680fd7f0 2024-09-19T06:34:25.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:25.289+0000 7fb66ff76640 1 -- 172.21.15.99:0/1140466218 --> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fb66810f040 con 0x7fb65006ecc0 2024-09-19T06:34:25.817 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:25 smithi099 ceph-mon[27651]: pgmap v38: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:34:25.818 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:25 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:34:25.818 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:25 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:34:25.818 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:25 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:34:26.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:25 smithi117 ceph-mon[34564]: pgmap v38: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:34:26.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:25 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:34:26.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:25 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:34:26.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:25 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:34:26.699 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:26 smithi099 ceph-mon[27651]: from='client.14258 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:34:27.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:26 smithi117 ceph-mon[34564]: from='client.14258 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:34:27.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:27 smithi099 ceph-mon[27651]: pgmap v39: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:34:27.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:27 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:27.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:27 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:27.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:27 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:34:27.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:27 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:27.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:27 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:34:27.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:27 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:34:27.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:27 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:28.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:27 smithi117 ceph-mon[34564]: pgmap v39: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:34:28.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:27 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:28.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:27 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:28.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:27 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:34:28.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:27 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:28.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:27 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:34:28.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:27 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:34:28.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:27 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:28.930 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:28 smithi099 ceph-mon[27651]: Detected new or changed devices on smithi099 2024-09-19T06:34:28.930 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:28 smithi099 ceph-mon[27651]: Adjusting osd_memory_target on smithi099 to 12864M 2024-09-19T06:34:28.930 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:28 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:34:28.978 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:28 smithi117 ceph-mon[34564]: Detected new or changed devices on smithi099 2024-09-19T06:34:28.978 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:28 smithi117 ceph-mon[34564]: Adjusting osd_memory_target on smithi099 to 12864M 2024-09-19T06:34:28.978 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:28 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:34:29.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:29 smithi099 ceph-mon[27651]: pgmap v40: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:34:29.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:29 smithi099 ceph-mon[27651]: from='client.? 172.21.15.99:0/2193482913' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "daad89b4-7ead-4cc7-bf89-ac6d22dba93b"}]: dispatch 2024-09-19T06:34:29.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:29 smithi099 ceph-mon[27651]: from='client.? 172.21.15.99:0/2193482913' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "daad89b4-7ead-4cc7-bf89-ac6d22dba93b"}]': finished 2024-09-19T06:34:29.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:29 smithi099 ceph-mon[27651]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T06:34:29.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:29 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:34:29.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:29 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:29.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:29 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:30.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:29 smithi117 ceph-mon[34564]: pgmap v40: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:34:30.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:29 smithi117 ceph-mon[34564]: from='client.? 172.21.15.99:0/2193482913' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "daad89b4-7ead-4cc7-bf89-ac6d22dba93b"}]: dispatch 2024-09-19T06:34:30.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:29 smithi117 ceph-mon[34564]: from='client.? 172.21.15.99:0/2193482913' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "daad89b4-7ead-4cc7-bf89-ac6d22dba93b"}]': finished 2024-09-19T06:34:30.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:29 smithi117 ceph-mon[34564]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T06:34:30.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:29 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:34:30.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:29 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:30.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:29 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:30.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:30 smithi099 ceph-mon[27651]: from='client.? 172.21.15.99:0/4193581870' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:34:31.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:30 smithi117 ceph-mon[34564]: from='client.? 172.21.15.99:0/4193581870' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:34:31.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:31 smithi099 ceph-mon[27651]: pgmap v42: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:34:31.967 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:31 smithi117 ceph-mon[34564]: pgmap v42: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:34:33.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:33 smithi099 ceph-mon[27651]: pgmap v43: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:34:33.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:33 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:33.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:33 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:33.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:33 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:34:33.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:33 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:34:33.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:33 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:34.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:33 smithi117 ceph-mon[34564]: pgmap v43: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:34:34.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:33 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:34.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:33 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:34.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:33 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:34:34.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:33 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:34:34.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:33 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:34.895 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:34 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:34:35.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:34 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:34:35.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:35 smithi099 ceph-mon[27651]: pgmap v44: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:34:36.064 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:35 smithi117 ceph-mon[34564]: pgmap v44: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:34:36.804 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:36 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T06:34:36.805 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:36 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:34:36.805 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:36 smithi099 ceph-mon[27651]: Deploying daemon osd.1 on smithi099 2024-09-19T06:34:37.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:36 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T06:34:37.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:36 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:34:37.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:36 smithi117 ceph-mon[34564]: Deploying daemon osd.1 on smithi099 2024-09-19T06:34:37.877 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:37 smithi099 ceph-mon[27651]: pgmap v45: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:34:38.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:37 smithi117 ceph-mon[34564]: pgmap v45: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:34:39.718 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:39 smithi099 ceph-mon[27651]: pgmap v46: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:34:40.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:39 smithi117 ceph-mon[34564]: pgmap v46: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:34:41.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:41 smithi099 ceph-mon[27651]: pgmap v47: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:34:41.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:41 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:34:41.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:41 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:41.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:41 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:41.966 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:41 smithi117 ceph-mon[34564]: pgmap v47: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:34:41.966 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:41 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:34:41.966 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:41 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:41.966 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:41 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:43.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:43.605+0000 7fb6667fc640 1 -- 172.21.15.99:0/1140466218 <== mgr.14206 v2:172.21.15.99:6800/886909451 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fb66810f040 con 0x7fb65006ecc0 2024-09-19T06:34:43.607 INFO:teuthology.orchestra.run.smithi099.stdout:Created osd(s) 1 on host 'smithi099' 2024-09-19T06:34:43.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:43.607+0000 7fb66ff76640 1 -- 172.21.15.99:0/1140466218 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fb65006ecc0 msgr2=0x7fb650071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:34:43.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:43.607+0000 7fb66ff76640 1 --2- 172.21.15.99:0/1140466218 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fb65006ecc0 0x7fb650071170 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb658000f80 tx=0x7fb658004d10 comp rx=0 tx=0).stop 2024-09-19T06:34:43.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:43.607+0000 7fb66ff76640 1 -- 172.21.15.99:0/1140466218 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb6680fd7f0 msgr2=0x7fb66810d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:34:43.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:43.607+0000 7fb66ff76640 1 --2- 172.21.15.99:0/1140466218 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb6680fd7f0 0x7fb66810d5e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb65c00b790 tx=0x7fb65c0091d0 comp rx=0 tx=0).stop 2024-09-19T06:34:43.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:43.607+0000 7fb66ff76640 1 -- 172.21.15.99:0/1140466218 shutdown_connections 2024-09-19T06:34:43.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:43.607+0000 7fb66ff76640 1 --2- 172.21.15.99:0/1140466218 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fb65006ecc0 0x7fb650071170 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:34:43.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:43.607+0000 7fb66ff76640 1 --2- 172.21.15.99:0/1140466218 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb6680fd7f0 0x7fb66810d5e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:34:43.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:43.607+0000 7fb66ff76640 1 --2- 172.21.15.99:0/1140466218 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6680fc520 0x7fb66810d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:34:43.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:43.607+0000 7fb66ff76640 1 -- 172.21.15.99:0/1140466218 >> 172.21.15.99:0/1140466218 conn(0x7fb6680f7ce0 msgr2=0x7fb6680f9480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:34:43.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:43.607+0000 7fb66ff76640 1 -- 172.21.15.99:0/1140466218 shutdown_connections 2024-09-19T06:34:43.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:43.607+0000 7fb66ff76640 1 -- 172.21.15.99:0/1140466218 wait complete. 2024-09-19T06:34:43.901 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:43 smithi099 ceph-mon[27651]: pgmap v48: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:34:43.901 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:43 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:43.901 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:43 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:44.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:43 smithi117 ceph-mon[34564]: pgmap v48: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:34:44.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:43 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:44.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:43 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:44.176 DEBUG:teuthology.orchestra.run.smithi099:osd.1> sudo journalctl -f -n 0 -u ceph-a73eb958-7650-11ef-bceb-c7b262605968@osd.1.service 2024-09-19T06:34:44.179 INFO:tasks.cephadm:Deploying osd.2 on smithi099 with /dev/vg_nvme/lv_2... 2024-09-19T06:34:44.179 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T06:34:44.598 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T06:34:45.031 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:34:44 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-1[53448]: 2024-09-19T06:34:44.752+0000 7fe82b470440 -1 osd.1 0 log_to_monitors true 2024-09-19T06:34:45.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:45 smithi099 ceph-mon[27651]: pgmap v49: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:34:45.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:45 smithi099 ceph-mon[27651]: from='osd.1 [v2:172.21.15.99:6810/1205097168,v1:172.21.15.99:6811/1205097168]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T06:34:46.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:45 smithi117 ceph-mon[34564]: pgmap v49: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:34:46.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:45 smithi117 ceph-mon[34564]: from='osd.1 [v2:172.21.15.99:6810/1205097168,v1:172.21.15.99:6811/1205097168]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T06:34:46.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:46 smithi099 ceph-mon[27651]: from='osd.1 [v2:172.21.15.99:6810/1205097168,v1:172.21.15.99:6811/1205097168]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T06:34:46.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:46 smithi099 ceph-mon[27651]: osdmap e12: 2 total, 1 up, 2 in 2024-09-19T06:34:46.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:46 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:34:46.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:46 smithi099 ceph-mon[27651]: from='osd.1 [v2:172.21.15.99:6810/1205097168,v1:172.21.15.99:6811/1205097168]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-19T06:34:46.957 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:34:46 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-1[53448]: 2024-09-19T06:34:46.632+0000 7fe828407640 -1 osd.1 0 waiting for initial osdmap 2024-09-19T06:34:46.957 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:34:46 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-1[53448]: 2024-09-19T06:34:46.637+0000 7fe821218640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:34:46.963 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:46 smithi117 ceph-mon[34564]: from='osd.1 [v2:172.21.15.99:6810/1205097168,v1:172.21.15.99:6811/1205097168]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T06:34:46.963 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:46 smithi117 ceph-mon[34564]: osdmap e12: 2 total, 1 up, 2 in 2024-09-19T06:34:46.963 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:46 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:34:46.963 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:46 smithi117 ceph-mon[34564]: from='osd.1 [v2:172.21.15.99:6810/1205097168,v1:172.21.15.99:6811/1205097168]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-19T06:34:47.333 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:34:47.352 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi099:vg_nvme/lv_2 2024-09-19T06:34:47.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:47 smithi099 ceph-mon[27651]: pgmap v51: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:34:47.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:47 smithi099 ceph-mon[27651]: from='osd.1 [v2:172.21.15.99:6810/1205097168,v1:172.21.15.99:6811/1205097168]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-09-19T06:34:47.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:47 smithi099 ceph-mon[27651]: osdmap e13: 2 total, 1 up, 2 in 2024-09-19T06:34:47.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:47 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:34:47.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:47 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:34:48.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:47 smithi117 ceph-mon[34564]: pgmap v51: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:34:48.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:47 smithi117 ceph-mon[34564]: from='osd.1 [v2:172.21.15.99:6810/1205097168,v1:172.21.15.99:6811/1205097168]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-09-19T06:34:48.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:47 smithi117 ceph-mon[34564]: osdmap e13: 2 total, 1 up, 2 in 2024-09-19T06:34:48.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:47 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:34:48.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:47 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:34:48.096 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T06:34:48.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:48 smithi099 ceph-mon[27651]: purged_snaps scrub starts 2024-09-19T06:34:48.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:48 smithi099 ceph-mon[27651]: purged_snaps scrub ok 2024-09-19T06:34:48.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:48 smithi099 ceph-mon[27651]: osd.1 [v2:172.21.15.99:6810/1205097168,v1:172.21.15.99:6811/1205097168] boot 2024-09-19T06:34:48.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:48 smithi099 ceph-mon[27651]: osdmap e14: 2 total, 2 up, 2 in 2024-09-19T06:34:48.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:48 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:34:49.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:48 smithi117 ceph-mon[34564]: purged_snaps scrub starts 2024-09-19T06:34:49.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:48 smithi117 ceph-mon[34564]: purged_snaps scrub ok 2024-09-19T06:34:49.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:48 smithi117 ceph-mon[34564]: osd.1 [v2:172.21.15.99:6810/1205097168,v1:172.21.15.99:6811/1205097168] boot 2024-09-19T06:34:49.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:48 smithi117 ceph-mon[34564]: osdmap e14: 2 total, 2 up, 2 in 2024-09-19T06:34:49.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:48 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:34:49.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:49 smithi099 ceph-mon[27651]: pgmap v54: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:34:49.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:49 smithi099 ceph-mon[27651]: osdmap e15: 2 total, 2 up, 2 in 2024-09-19T06:34:49.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:49 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:34:50.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:49 smithi117 ceph-mon[34564]: pgmap v54: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-19T06:34:50.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:49 smithi117 ceph-mon[34564]: osdmap e15: 2 total, 2 up, 2 in 2024-09-19T06:34:50.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:49 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:34:50.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:50.965+0000 7ff7c8ef3640 1 -- 172.21.15.99:0/1241295897 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff7c40fc720 msgr2=0x7ff7c40fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:34:50.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:50.965+0000 7ff7c8ef3640 1 --2- 172.21.15.99:0/1241295897 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff7c40fc720 0x7ff7c40fcb90 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac0048d0 tx=0x7ff7ac009da0 comp rx=0 tx=0).stop 2024-09-19T06:34:50.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:50.965+0000 7ff7c8ef3640 1 -- 172.21.15.99:0/1241295897 shutdown_connections 2024-09-19T06:34:50.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:50.965+0000 7ff7c8ef3640 1 --2- 172.21.15.99:0/1241295897 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff7c40fc720 0x7ff7c40fcb90 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:34:50.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:50.965+0000 7ff7c8ef3640 1 --2- 172.21.15.99:0/1241295897 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7c40fb450 0x7ff7c40fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:34:50.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:50.965+0000 7ff7c8ef3640 1 -- 172.21.15.99:0/1241295897 >> 172.21.15.99:0/1241295897 conn(0x7ff7c40f6c10 msgr2=0x7ff7c40f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:34:50.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:50.966+0000 7ff7c8ef3640 1 -- 172.21.15.99:0/1241295897 shutdown_connections 2024-09-19T06:34:50.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:50.966+0000 7ff7c8ef3640 1 -- 172.21.15.99:0/1241295897 wait complete. 2024-09-19T06:34:50.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:50.966+0000 7ff7c8ef3640 1 Processor -- start 2024-09-19T06:34:50.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:50.966+0000 7ff7c8ef3640 1 -- start start 2024-09-19T06:34:50.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:50.966+0000 7ff7c8ef3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7c40fb450 0x7ff7c40ff570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:34:50.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:50.966+0000 7ff7c8ef3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff7c40fc720 0x7ff7c40fda60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:34:50.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:50.966+0000 7ff7c8ef3640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c40fdff0 con 0x7ff7c40fc720 2024-09-19T06:34:50.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:50.966+0000 7ff7c8ef3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c40fe130 con 0x7ff7c40fb450 2024-09-19T06:34:50.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:50.966+0000 7ff7c1d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff7c40fc720 0x7ff7c40fda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:34:50.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:50.966+0000 7ff7c1d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff7c40fc720 0x7ff7c40fda60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60610/0 (socket says 172.21.15.99:60610) 2024-09-19T06:34:50.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:50.966+0000 7ff7c1d9b640 1 -- 172.21.15.99:0/840975814 learned_addr learned my addr 172.21.15.99:0/840975814 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:34:50.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:50.966+0000 7ff7c259c640 1 --2- 172.21.15.99:0/840975814 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7c40fb450 0x7ff7c40ff570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:34:50.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:50.967+0000 7ff7c1d9b640 1 -- 172.21.15.99:0/840975814 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7c40fb450 msgr2=0x7ff7c40ff570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:34:50.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:50.967+0000 7ff7c1d9b640 1 --2- 172.21.15.99:0/840975814 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7c40fb450 0x7ff7c40ff570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:34:50.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:50.967+0000 7ff7c1d9b640 1 -- 172.21.15.99:0/840975814 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7ac005040 con 0x7ff7c40fc720 2024-09-19T06:34:50.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:50.967+0000 7ff7c1d9b640 1 --2- 172.21.15.99:0/840975814 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff7c40fc720 0x7ff7c40fda60 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac000c00 tx=0x7ff7ac009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:34:50.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:50.967+0000 7ff7baffd640 1 -- 172.21.15.99:0/840975814 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7ac038070 con 0x7ff7c40fc720 2024-09-19T06:34:50.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:50.967+0000 7ff7baffd640 1 -- 172.21.15.99:0/840975814 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff7ac02ae90 con 0x7ff7c40fc720 2024-09-19T06:34:50.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:50.967+0000 7ff7c8ef3640 1 -- 172.21.15.99:0/840975814 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7c40fe3b0 con 0x7ff7c40fc720 2024-09-19T06:34:50.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:50.967+0000 7ff7baffd640 1 -- 172.21.15.99:0/840975814 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7ac03d420 con 0x7ff7c40fc720 2024-09-19T06:34:50.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:50.967+0000 7ff7c8ef3640 1 -- 172.21.15.99:0/840975814 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7c4115100 con 0x7ff7c40fc720 2024-09-19T06:34:50.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:50.968+0000 7ff7c8ef3640 1 -- 172.21.15.99:0/840975814 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7c40fa8b0 con 0x7ff7c40fc720 2024-09-19T06:34:50.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:50.968+0000 7ff7baffd640 1 -- 172.21.15.99:0/840975814 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 18) v1 ==== 90811+0+0 (secure 0 0 0) 0x7ff7ac030020 con 0x7ff7c40fc720 2024-09-19T06:34:50.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:50.969+0000 7ff7baffd640 1 --2- 172.21.15.99:0/840975814 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7ff7b006ecc0 0x7ff7b0071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:34:50.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:50.969+0000 7ff7baffd640 1 -- 172.21.15.99:0/840975814 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2410+0+0 (secure 0 0 0) 0x7ff7ac0adac0 con 0x7ff7c40fc720 2024-09-19T06:34:50.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:50.969+0000 7ff7c259c640 1 --2- 172.21.15.99:0/840975814 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7ff7b006ecc0 0x7ff7b0071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:34:50.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:50.969+0000 7ff7c259c640 1 --2- 172.21.15.99:0/840975814 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7ff7b006ecc0 0x7ff7b0071170 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff7c40ff320 tx=0x7ff7bc009040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:34:50.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:50.973+0000 7ff7baffd640 1 -- 172.21.15.99:0/840975814 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ff7ac07b930 con 0x7ff7c40fc720 2024-09-19T06:34:51.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:34:51.144+0000 7ff7c8ef3640 1 -- 172.21.15.99:0/840975814 --> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7ff7c4103f60 con 0x7ff7b006ecc0 2024-09-19T06:34:52.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:52 smithi117 ceph-mon[34564]: pgmap v56: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-19T06:34:52.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:52 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:52.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:52 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:52.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:52 smithi117 ceph-mon[34564]: from='client.14276 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:34:52.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:52 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:34:52.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:52 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:34:52.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:52 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:34:52.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:52 smithi099 ceph-mon[27651]: pgmap v56: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-19T06:34:52.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:52 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:52.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:52 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:52.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:52 smithi099 ceph-mon[27651]: from='client.14276 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi099:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:34:52.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:52 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:34:52.458 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:52 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:34:52.458 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:52 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:34:54.383 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:54 smithi099 ceph-mon[27651]: pgmap v57: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-19T06:34:54.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:54 smithi117 ceph-mon[34564]: pgmap v57: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-19T06:34:56.123 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:56 smithi099 ceph-mon[27651]: pgmap v58: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-19T06:34:56.124 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:56 smithi099 ceph-mon[27651]: Detected new or changed devices on smithi099 2024-09-19T06:34:56.124 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:56 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:56.124 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:56 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:56.124 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:56 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:34:56.124 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:56 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:34:56.124 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:56 smithi099 ceph-mon[27651]: Adjusting osd_memory_target on smithi099 to 6432M 2024-09-19T06:34:56.124 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:56 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:56.124 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:56 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:34:56.124 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:56 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:34:56.124 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:56 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:56.124 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:56 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:34:56.124 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:56 smithi099 ceph-mon[27651]: from='client.? 172.21.15.99:0/3857690508' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "87dd834e-36dc-48da-8d88-982e9a794e14"}]: dispatch 2024-09-19T06:34:56.125 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:56 smithi099 ceph-mon[27651]: from='client.? 172.21.15.99:0/3857690508' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "87dd834e-36dc-48da-8d88-982e9a794e14"}]': finished 2024-09-19T06:34:56.125 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:56 smithi099 ceph-mon[27651]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T06:34:56.125 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:56 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:34:56.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:56 smithi117 ceph-mon[34564]: pgmap v58: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-19T06:34:56.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:56 smithi117 ceph-mon[34564]: Detected new or changed devices on smithi099 2024-09-19T06:34:56.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:56 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:56.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:56 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:56.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:56 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:34:56.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:56 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:34:56.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:56 smithi117 ceph-mon[34564]: Adjusting osd_memory_target on smithi099 to 6432M 2024-09-19T06:34:56.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:56 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:56.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:56 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:34:56.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:56 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:34:56.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:56 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:34:56.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:56 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:34:56.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:56 smithi117 ceph-mon[34564]: from='client.? 172.21.15.99:0/3857690508' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "87dd834e-36dc-48da-8d88-982e9a794e14"}]: dispatch 2024-09-19T06:34:56.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:56 smithi117 ceph-mon[34564]: from='client.? 172.21.15.99:0/3857690508' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "87dd834e-36dc-48da-8d88-982e9a794e14"}]': finished 2024-09-19T06:34:56.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:56 smithi117 ceph-mon[34564]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T06:34:56.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:56 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:34:57.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:57 smithi117 ceph-mon[34564]: from='client.? 172.21.15.99:0/2154365506' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:34:57.445 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:57 smithi099 ceph-mon[27651]: from='client.? 172.21.15.99:0/2154365506' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:34:58.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:34:58 smithi117 ceph-mon[34564]: pgmap v60: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-19T06:34:58.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:34:58 smithi099 ceph-mon[27651]: pgmap v60: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-19T06:35:00.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:00 smithi099 ceph-mon[27651]: pgmap v61: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-19T06:35:00.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:00 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:35:00.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:00 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:35:00.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:00 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:35:00.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:00 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:35:00.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:00 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:35:00.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:00 smithi117 ceph-mon[34564]: pgmap v61: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-19T06:35:00.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:00 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:35:00.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:00 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:35:00.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:00 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:35:00.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:00 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:35:00.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:00 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:35:02.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:02 smithi099 ceph-mon[27651]: pgmap v62: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-19T06:35:02.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:02 smithi117 ceph-mon[34564]: pgmap v62: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-19T06:35:04.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:04 smithi099 ceph-mon[27651]: pgmap v63: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-19T06:35:04.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:04 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T06:35:04.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:04 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:35:04.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:04 smithi099 ceph-mon[27651]: Deploying daemon osd.2 on smithi099 2024-09-19T06:35:04.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:04 smithi117 ceph-mon[34564]: pgmap v63: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-19T06:35:04.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:04 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T06:35:04.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:04 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:35:04.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:04 smithi117 ceph-mon[34564]: Deploying daemon osd.2 on smithi099 2024-09-19T06:35:05.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:05 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:35:05.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:05 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:35:06.208 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:06 smithi099 ceph-mon[27651]: pgmap v64: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-19T06:35:06.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:06 smithi117 ceph-mon[34564]: pgmap v64: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-19T06:35:08.377 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:08 smithi099 ceph-mon[27651]: pgmap v65: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-19T06:35:08.377 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:08 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:35:08.377 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:08 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:35:08.378 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:08 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:35:08.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:08 smithi117 ceph-mon[34564]: pgmap v65: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-19T06:35:08.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:08 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:35:08.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:08 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:35:08.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:08 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:35:10.399 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:10 smithi099 ceph-mon[27651]: pgmap v66: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-19T06:35:10.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:10 smithi117 ceph-mon[34564]: pgmap v66: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-19T06:35:10.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:35:10.790+0000 7ff7baffd640 1 -- 172.21.15.99:0/840975814 <== mgr.14206 v2:172.21.15.99:6800/886909451 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7ff7c4103f60 con 0x7ff7b006ecc0 2024-09-19T06:35:10.792 INFO:teuthology.orchestra.run.smithi099.stdout:Created osd(s) 2 on host 'smithi099' 2024-09-19T06:35:10.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:35:10.792+0000 7ff7c8ef3640 1 -- 172.21.15.99:0/840975814 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7ff7b006ecc0 msgr2=0x7ff7b0071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:35:10.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:35:10.792+0000 7ff7c8ef3640 1 --2- 172.21.15.99:0/840975814 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7ff7b006ecc0 0x7ff7b0071170 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff7c40ff320 tx=0x7ff7bc009040 comp rx=0 tx=0).stop 2024-09-19T06:35:10.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:35:10.792+0000 7ff7c8ef3640 1 -- 172.21.15.99:0/840975814 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff7c40fc720 msgr2=0x7ff7c40fda60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:35:10.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:35:10.792+0000 7ff7c8ef3640 1 --2- 172.21.15.99:0/840975814 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff7c40fc720 0x7ff7c40fda60 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac000c00 tx=0x7ff7ac009da0 comp rx=0 tx=0).stop 2024-09-19T06:35:10.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:35:10.792+0000 7ff7c8ef3640 1 -- 172.21.15.99:0/840975814 shutdown_connections 2024-09-19T06:35:10.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:35:10.792+0000 7ff7c8ef3640 1 --2- 172.21.15.99:0/840975814 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7ff7b006ecc0 0x7ff7b0071170 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:35:10.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:35:10.792+0000 7ff7c8ef3640 1 --2- 172.21.15.99:0/840975814 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff7c40fc720 0x7ff7c40fda60 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:35:10.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:35:10.792+0000 7ff7c8ef3640 1 --2- 172.21.15.99:0/840975814 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7c40fb450 0x7ff7c40ff570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:35:10.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:35:10.792+0000 7ff7c8ef3640 1 -- 172.21.15.99:0/840975814 >> 172.21.15.99:0/840975814 conn(0x7ff7c40f6c10 msgr2=0x7ff7c4066080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:35:10.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:35:10.793+0000 7ff7c8ef3640 1 -- 172.21.15.99:0/840975814 shutdown_connections 2024-09-19T06:35:10.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:35:10.793+0000 7ff7c8ef3640 1 -- 172.21.15.99:0/840975814 wait complete. 2024-09-19T06:35:11.396 DEBUG:teuthology.orchestra.run.smithi099:osd.2> sudo journalctl -f -n 0 -u ceph-a73eb958-7650-11ef-bceb-c7b262605968@osd.2.service 2024-09-19T06:35:11.398 INFO:tasks.cephadm:Deploying osd.3 on smithi117 with /dev/vg_nvme/lv_4... 2024-09-19T06:35:11.398 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T06:35:11.648 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi117/config 2024-09-19T06:35:12.059 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:11 smithi099 ceph-mon[27651]: pgmap v67: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-19T06:35:12.060 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:11 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:35:12.060 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:11 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:35:12.060 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 06:35:11 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-2[60689]: 2024-09-19T06:35:11.897+0000 7f6f1bdd5440 -1 osd.2 0 log_to_monitors true 2024-09-19T06:35:12.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:11 smithi117 ceph-mon[34564]: pgmap v67: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-19T06:35:12.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:11 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:35:12.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:11 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:35:13.002 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:12 smithi117 ceph-mon[34564]: from='osd.2 [v2:172.21.15.99:6818/1219926965,v1:172.21.15.99:6819/1219926965]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T06:35:13.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:12 smithi099 ceph-mon[27651]: from='osd.2 [v2:172.21.15.99:6818/1219926965,v1:172.21.15.99:6819/1219926965]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T06:35:13.908 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:13 smithi117 ceph-mon[34564]: pgmap v68: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-19T06:35:13.908 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:13 smithi117 ceph-mon[34564]: from='osd.2 [v2:172.21.15.99:6818/1219926965,v1:172.21.15.99:6819/1219926965]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T06:35:13.908 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:13 smithi117 ceph-mon[34564]: osdmap e17: 3 total, 2 up, 3 in 2024-09-19T06:35:13.908 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:13 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:35:13.908 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:13 smithi117 ceph-mon[34564]: from='osd.2 [v2:172.21.15.99:6818/1219926965,v1:172.21.15.99:6819/1219926965]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-19T06:35:14.100 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:35:14.111 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 06:35:13 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-2[60689]: 2024-09-19T06:35:13.800+0000 7f6f18d6c640 -1 osd.2 0 waiting for initial osdmap 2024-09-19T06:35:14.111 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 06:35:13 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-2[60689]: 2024-09-19T06:35:13.806+0000 7f6f1237e640 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:35:14.112 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:13 smithi099 ceph-mon[27651]: pgmap v68: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-19T06:35:14.112 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:13 smithi099 ceph-mon[27651]: from='osd.2 [v2:172.21.15.99:6818/1219926965,v1:172.21.15.99:6819/1219926965]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T06:35:14.112 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:13 smithi099 ceph-mon[27651]: osdmap e17: 3 total, 2 up, 3 in 2024-09-19T06:35:14.112 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:13 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:35:14.112 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:13 smithi099 ceph-mon[27651]: from='osd.2 [v2:172.21.15.99:6818/1219926965,v1:172.21.15.99:6819/1219926965]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-19T06:35:14.120 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi117:vg_nvme/lv_4 2024-09-19T06:35:14.379 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi117/config 2024-09-19T06:35:15.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:14 smithi117 ceph-mon[34564]: from='osd.2 [v2:172.21.15.99:6818/1219926965,v1:172.21.15.99:6819/1219926965]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-09-19T06:35:15.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:14 smithi117 ceph-mon[34564]: osdmap e18: 3 total, 2 up, 3 in 2024-09-19T06:35:15.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:14 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:35:15.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:14 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:35:15.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:14 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:35:15.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:14 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:35:15.136 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:14 smithi099 ceph-mon[27651]: from='osd.2 [v2:172.21.15.99:6818/1219926965,v1:172.21.15.99:6819/1219926965]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]': finished 2024-09-19T06:35:15.136 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:14 smithi099 ceph-mon[27651]: osdmap e18: 3 total, 2 up, 3 in 2024-09-19T06:35:15.136 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:14 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:35:15.136 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:14 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:35:15.136 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:14 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:35:15.137 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:14 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:35:15.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:15.880+0000 7f70151eb640 1 -- 172.21.15.117:0/3217855787 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7010101b00 msgr2=0x7f7010103ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:35:15.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:15.880+0000 7f70151eb640 1 --2- 172.21.15.117:0/3217855787 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7010101b00 0x7f7010103ee0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f70040048d0 tx=0x7f7004009da0 comp rx=0 tx=0).stop 2024-09-19T06:35:15.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:15.880+0000 7f70151eb640 1 -- 172.21.15.117:0/3217855787 shutdown_connections 2024-09-19T06:35:15.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:15.880+0000 7f70151eb640 1 --2- 172.21.15.117:0/3217855787 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7010101b00 0x7f7010103ee0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:35:15.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:15.880+0000 7f70151eb640 1 --2- 172.21.15.117:0/3217855787 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7010065bc0 0x7f70101015c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:35:15.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:15.880+0000 7f70151eb640 1 -- 172.21.15.117:0/3217855787 >> 172.21.15.117:0/3217855787 conn(0x7f70100f6c10 msgr2=0x7f70100f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:35:15.896 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:15.880+0000 7f70151eb640 1 -- 172.21.15.117:0/3217855787 shutdown_connections 2024-09-19T06:35:15.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:15.880+0000 7f70151eb640 1 -- 172.21.15.117:0/3217855787 wait complete. 2024-09-19T06:35:15.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:15.881+0000 7f70151eb640 1 Processor -- start 2024-09-19T06:35:15.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:15.881+0000 7f70151eb640 1 -- start start 2024-09-19T06:35:15.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:15.881+0000 7f70151eb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7010065bc0 0x7f701010f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:35:15.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:15.881+0000 7f70151eb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7010101b00 0x7f701010f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:35:15.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:15.881+0000 7f70151eb640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f701010feb0 con 0x7f7010101b00 2024-09-19T06:35:15.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:15.881+0000 7f70151eb640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7010110680 con 0x7f7010065bc0 2024-09-19T06:35:15.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:15.881+0000 7f700ed9d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7010065bc0 0x7f701010f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:35:15.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:15.881+0000 7f700ed9d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7010065bc0 0x7f701010f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:38536/0 (socket says 172.21.15.117:38536) 2024-09-19T06:35:15.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:15.881+0000 7f700ed9d640 1 -- 172.21.15.117:0/1339175234 learned_addr learned my addr 172.21.15.117:0/1339175234 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T06:35:15.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:15.881+0000 7f700e59c640 1 --2- 172.21.15.117:0/1339175234 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7010101b00 0x7f701010f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:35:15.897 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:15.882+0000 7f700ed9d640 1 -- 172.21.15.117:0/1339175234 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7010101b00 msgr2=0x7f701010f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:35:15.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:15.882+0000 7f700ed9d640 1 --2- 172.21.15.117:0/1339175234 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7010101b00 0x7f701010f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:35:15.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:15.882+0000 7f700ed9d640 1 -- 172.21.15.117:0/1339175234 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7004005040 con 0x7f7010065bc0 2024-09-19T06:35:15.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:15.882+0000 7f700ed9d640 1 --2- 172.21.15.117:0/1339175234 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7010065bc0 0x7f701010f320 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f7000002a80 tx=0x7f7000004600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:35:15.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:15.882+0000 7f6ff77fe640 1 -- 172.21.15.117:0/1339175234 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7000007c30 con 0x7f7010065bc0 2024-09-19T06:35:15.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:15.882+0000 7f70151eb640 1 -- 172.21.15.117:0/1339175234 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7010110910 con 0x7f7010065bc0 2024-09-19T06:35:15.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:15.882+0000 7f6ff77fe640 1 -- 172.21.15.117:0/1339175234 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f700000f040 con 0x7f7010065bc0 2024-09-19T06:35:15.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:15.882+0000 7f6ff77fe640 1 -- 172.21.15.117:0/1339175234 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f700000db10 con 0x7f7010065bc0 2024-09-19T06:35:15.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:15.882+0000 7f70151eb640 1 -- 172.21.15.117:0/1339175234 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7010110e00 con 0x7f7010065bc0 2024-09-19T06:35:15.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:15.883+0000 7f70151eb640 1 -- 172.21.15.117:0/1339175234 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7010107950 con 0x7f7010065bc0 2024-09-19T06:35:15.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:15.884+0000 7f6ff77fe640 1 -- 172.21.15.117:0/1339175234 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 18) v1 ==== 90811+0+0 (secure 0 0 0) 0x7f700000dc70 con 0x7f7010065bc0 2024-09-19T06:35:15.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:15.884+0000 7f6ff77fe640 1 --2- 172.21.15.117:0/1339175234 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f6ff806ecc0 0x7f6ff8071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:35:15.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:15.884+0000 7f6ff77fe640 1 -- 172.21.15.117:0/1339175234 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 2842+0+0 (secure 0 0 0) 0x7f700008d2f0 con 0x7f7010065bc0 2024-09-19T06:35:15.898 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:15.884+0000 7f700e59c640 1 --2- 172.21.15.117:0/1339175234 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f6ff806ecc0 0x7f6ff8071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:35:15.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:15.885+0000 7f700e59c640 1 --2- 172.21.15.117:0/1339175234 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f6ff806ecc0 0x7f6ff8071170 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7004000c00 tx=0x7f7004035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:35:15.899 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:15.888+0000 7f6ff77fe640 1 -- 172.21.15.117:0/1339175234 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f700005af30 con 0x7f7010065bc0 2024-09-19T06:35:16.050 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:16.049+0000 7f70151eb640 1 -- 172.21.15.117:0/1339175234 --> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f7010111160 con 0x7f6ff806ecc0 2024-09-19T06:35:16.050 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:15 smithi117 ceph-mon[34564]: purged_snaps scrub starts 2024-09-19T06:35:16.050 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:15 smithi117 ceph-mon[34564]: purged_snaps scrub ok 2024-09-19T06:35:16.051 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:15 smithi117 ceph-mon[34564]: pgmap v71: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-19T06:35:16.051 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:15 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:35:16.051 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:15 smithi117 ceph-mon[34564]: osd.2 [v2:172.21.15.99:6818/1219926965,v1:172.21.15.99:6819/1219926965] boot 2024-09-19T06:35:16.051 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:15 smithi117 ceph-mon[34564]: osdmap e19: 3 total, 3 up, 3 in 2024-09-19T06:35:16.051 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:15 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:35:16.136 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:15 smithi099 ceph-mon[27651]: purged_snaps scrub starts 2024-09-19T06:35:16.136 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:15 smithi099 ceph-mon[27651]: purged_snaps scrub ok 2024-09-19T06:35:16.136 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:15 smithi099 ceph-mon[27651]: pgmap v71: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-19T06:35:16.136 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:15 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:35:16.136 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:15 smithi099 ceph-mon[27651]: osd.2 [v2:172.21.15.99:6818/1219926965,v1:172.21.15.99:6819/1219926965] boot 2024-09-19T06:35:16.136 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:15 smithi099 ceph-mon[27651]: osdmap e19: 3 total, 3 up, 3 in 2024-09-19T06:35:16.136 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:15 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:35:17.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:16 smithi117 ceph-mon[34564]: osdmap e20: 3 total, 3 up, 3 in 2024-09-19T06:35:17.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:16 smithi117 ceph-mon[34564]: from='client.24135 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:35:17.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:16 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:35:17.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:16 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:35:17.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:16 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:35:17.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:16 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-09-19T06:35:17.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:16 smithi099 ceph-mon[27651]: osdmap e20: 3 total, 3 up, 3 in 2024-09-19T06:35:17.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:16 smithi099 ceph-mon[27651]: from='client.24135 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:35:17.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:16 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:35:17.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:16 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:35:17.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:16 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:35:17.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:16 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-09-19T06:35:18.002 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:17 smithi117 ceph-mon[34564]: pgmap v74: 0 pgs: ; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-19T06:35:18.003 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:17 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-09-19T06:35:18.003 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:17 smithi117 ceph-mon[34564]: osdmap e21: 3 total, 3 up, 3 in 2024-09-19T06:35:18.003 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:17 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T06:35:18.003 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:17 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:35:18.003 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:17 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:35:18.003 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:17 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:35:18.003 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:17 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:35:18.003 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:17 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:35:18.003 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:17 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:35:18.003 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:17 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:35:18.003 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:17 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:35:18.003 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:17 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:35:18.004 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:17 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:35:18.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:17 smithi099 ceph-mon[27651]: pgmap v74: 0 pgs: ; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-19T06:35:18.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:17 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-09-19T06:35:18.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:17 smithi099 ceph-mon[27651]: osdmap e21: 3 total, 3 up, 3 in 2024-09-19T06:35:18.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:17 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T06:35:18.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:17 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:35:18.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:17 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:35:18.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:17 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:35:18.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:17 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:35:18.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:17 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:35:18.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:17 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:35:18.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:17 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:35:18.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:17 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:35:18.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:17 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:35:18.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:17 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:35:18.884 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:18 smithi099 ceph-mon[27651]: Detected new or changed devices on smithi099 2024-09-19T06:35:18.884 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:18 smithi099 ceph-mon[27651]: Adjusting osd_memory_target on smithi099 to 4288M 2024-09-19T06:35:18.884 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:18 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T06:35:18.884 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:18 smithi099 ceph-mon[27651]: osdmap e22: 3 total, 3 up, 3 in 2024-09-19T06:35:18.884 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:18 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:35:18.885 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:18 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:35:18.885 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:18 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:35:18.885 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:18 smithi099 ceph-mon[27651]: from='client.? 172.21.15.117:0/1398638988' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e55ff802-be59-4865-924a-46b72ed0f978"}]: dispatch 2024-09-19T06:35:18.885 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:18 smithi099 ceph-mon[27651]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e55ff802-be59-4865-924a-46b72ed0f978"}]: dispatch 2024-09-19T06:35:18.885 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:18 smithi099 ceph-mon[27651]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e55ff802-be59-4865-924a-46b72ed0f978"}]': finished 2024-09-19T06:35:18.885 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:18 smithi099 ceph-mon[27651]: osdmap e23: 4 total, 3 up, 4 in 2024-09-19T06:35:18.885 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:18 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:35:18.885 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 06:35:18 smithi099 sudo[65063]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T06:35:18.885 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 06:35:18 smithi099 sudo[65063]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T06:35:18.885 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 06:35:18 smithi099 sudo[65063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T06:35:18.886 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 06:35:18 smithi099 sudo[65063]: pam_unix(sudo:session): session closed for user root 2024-09-19T06:35:19.151 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 06:35:18 smithi099 sudo[65066]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T06:35:19.151 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 06:35:18 smithi099 sudo[65066]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T06:35:19.151 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 06:35:18 smithi099 sudo[65066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T06:35:19.151 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 06:35:18 smithi099 sudo[65066]: pam_unix(sudo:session): session closed for user root 2024-09-19T06:35:19.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:18 smithi117 ceph-mon[34564]: Detected new or changed devices on smithi099 2024-09-19T06:35:19.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:18 smithi117 ceph-mon[34564]: Adjusting osd_memory_target on smithi099 to 4288M 2024-09-19T06:35:19.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:18 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T06:35:19.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:18 smithi117 ceph-mon[34564]: osdmap e22: 3 total, 3 up, 3 in 2024-09-19T06:35:19.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:18 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:35:19.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:18 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:35:19.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:18 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:35:19.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:18 smithi117 ceph-mon[34564]: from='client.? 172.21.15.117:0/1398638988' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e55ff802-be59-4865-924a-46b72ed0f978"}]: dispatch 2024-09-19T06:35:19.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:18 smithi117 ceph-mon[34564]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e55ff802-be59-4865-924a-46b72ed0f978"}]: dispatch 2024-09-19T06:35:19.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:18 smithi117 ceph-mon[34564]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e55ff802-be59-4865-924a-46b72ed0f978"}]': finished 2024-09-19T06:35:19.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:18 smithi117 ceph-mon[34564]: osdmap e23: 4 total, 3 up, 4 in 2024-09-19T06:35:19.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:18 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:35:19.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:19.315+0000 7f6ff77fe640 1 -- 172.21.15.117:0/1339175234 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f7000057490 con 0x7f7010065bc0 2024-09-19T06:35:19.407 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:35:19 smithi099 sudo[65069]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T06:35:19.407 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:35:19 smithi099 sudo[65069]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T06:35:19.407 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:35:19 smithi099 sudo[65069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T06:35:19.407 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:35:19 smithi099 sudo[65069]: pam_unix(sudo:session): session closed for user root 2024-09-19T06:35:19.668 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:35:19 smithi099 sudo[65072]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T06:35:19.668 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:35:19 smithi099 sudo[65072]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T06:35:19.668 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:35:19 smithi099 sudo[65072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T06:35:19.668 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:35:19 smithi099 sudo[65072]: pam_unix(sudo:session): session closed for user root 2024-09-19T06:35:19.668 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 06:35:19 smithi099 sudo[65075]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T06:35:19.669 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 06:35:19 smithi099 sudo[65075]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T06:35:19.669 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 06:35:19 smithi099 sudo[65075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T06:35:19.669 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 06:35:19 smithi099 sudo[65075]: pam_unix(sudo:session): session closed for user root 2024-09-19T06:35:19.956 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 06:35:19 smithi099 sudo[65078]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T06:35:19.956 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 06:35:19 smithi099 sudo[65078]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T06:35:19.956 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 06:35:19 smithi099 sudo[65078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T06:35:19.956 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 06:35:19 smithi099 sudo[65078]: pam_unix(sudo:session): session closed for user root 2024-09-19T06:35:19.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:19 smithi099 ceph-mon[27651]: pgmap v78: 1 pgs: 1 unknown; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-19T06:35:19.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:19 smithi099 ceph-mon[27651]: from='client.? 172.21.15.117:0/2309399099' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:35:19.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:19 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:35:19.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:19 smithi099 ceph-mon[27651]: mgrmap e19: smithi099.pgvkqi(active, since 2m), standbys: smithi117.ssmkcf 2024-09-19T06:35:19.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:19 smithi099 ceph-mon[27651]: osdmap e24: 4 total, 3 up, 4 in 2024-09-19T06:35:19.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:19 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:35:19.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:19 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:35:20.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:19 smithi117 ceph-mon[34564]: pgmap v78: 1 pgs: 1 unknown; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-19T06:35:20.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:19 smithi117 ceph-mon[34564]: from='client.? 172.21.15.117:0/2309399099' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:35:20.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:19 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:35:20.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:19 smithi117 ceph-mon[34564]: mgrmap e19: smithi099.pgvkqi(active, since 2m), standbys: smithi117.ssmkcf 2024-09-19T06:35:20.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:19 smithi117 ceph-mon[34564]: osdmap e24: 4 total, 3 up, 4 in 2024-09-19T06:35:20.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:19 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:35:20.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:19 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:35:20.413 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:20 smithi099 sudo[65081]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T06:35:20.413 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:20 smithi099 sudo[65081]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T06:35:20.413 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:20 smithi099 sudo[65081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T06:35:20.413 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:20 smithi099 sudo[65081]: pam_unix(sudo:session): session closed for user root 2024-09-19T06:35:20.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:20 smithi099 sudo[65084]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T06:35:20.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:20 smithi099 sudo[65084]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T06:35:20.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:20 smithi099 sudo[65084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T06:35:20.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:20 smithi099 sudo[65084]: pam_unix(sudo:session): session closed for user root 2024-09-19T06:35:20.920 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:20 smithi117 sudo[38642]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T06:35:20.920 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:20 smithi117 sudo[38642]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T06:35:20.920 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:20 smithi117 sudo[38642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T06:35:20.920 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:20 smithi117 sudo[38642]: pam_unix(sudo:session): session closed for user root 2024-09-19T06:35:21.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:20 smithi099 ceph-mon[27651]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T06:35:21.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:20 smithi099 ceph-mon[27651]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T06:35:21.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:20 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mon metadata", "id": "smithi099"}]: dispatch 2024-09-19T06:35:21.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:20 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mon metadata", "id": "smithi117"}]: dispatch 2024-09-19T06:35:21.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:20 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mon metadata", "id": "smithi099"}]: dispatch 2024-09-19T06:35:21.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:20 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mon metadata", "id": "smithi117"}]: dispatch 2024-09-19T06:35:21.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:20 smithi117 sudo[38829]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T06:35:21.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:20 smithi117 sudo[38829]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T06:35:21.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:20 smithi117 sudo[38829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T06:35:21.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:20 smithi117 sudo[38829]: pam_unix(sudo:session): session closed for user root 2024-09-19T06:35:21.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:20 smithi117 ceph-mon[34564]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T06:35:21.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:20 smithi117 ceph-mon[34564]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T06:35:21.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:20 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mon metadata", "id": "smithi099"}]: dispatch 2024-09-19T06:35:21.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:20 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mon metadata", "id": "smithi117"}]: dispatch 2024-09-19T06:35:21.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:20 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mon metadata", "id": "smithi099"}]: dispatch 2024-09-19T06:35:21.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:20 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mon metadata", "id": "smithi117"}]: dispatch 2024-09-19T06:35:22.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:21 smithi099 ceph-mon[27651]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T06:35:22.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:21 smithi099 ceph-mon[27651]: pgmap v80: 1 pgs: 1 active+clean; 320 KiB data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-19T06:35:22.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:21 smithi099 ceph-mon[27651]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T06:35:22.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:21 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:35:22.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:21 smithi117 ceph-mon[34564]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T06:35:22.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:21 smithi117 ceph-mon[34564]: pgmap v80: 1 pgs: 1 active+clean; 320 KiB data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-19T06:35:22.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:21 smithi117 ceph-mon[34564]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T06:35:22.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:21 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:35:24.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:23 smithi117 ceph-mon[34564]: pgmap v81: 1 pgs: 1 active+clean; 320 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-09-19T06:35:24.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:23 smithi099 ceph-mon[27651]: pgmap v81: 1 pgs: 1 active+clean; 320 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-09-19T06:35:26.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:25 smithi099 ceph-mon[27651]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 5.2 KiB/s rd, 251 KiB/s wr, 17 op/s 2024-09-19T06:35:26.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:25 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T06:35:26.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:25 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:35:26.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:25 smithi099 ceph-mon[27651]: Deploying daemon osd.3 on smithi117 2024-09-19T06:35:26.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:25 smithi117 ceph-mon[34564]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 5.2 KiB/s rd, 251 KiB/s wr, 17 op/s 2024-09-19T06:35:26.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:25 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T06:35:26.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:25 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:35:26.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:25 smithi117 ceph-mon[34564]: Deploying daemon osd.3 on smithi117 2024-09-19T06:35:28.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:27 smithi117 ceph-mon[34564]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 3.8 KiB/s rd, 182 KiB/s wr, 12 op/s 2024-09-19T06:35:28.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:27 smithi099 ceph-mon[27651]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 3.8 KiB/s rd, 182 KiB/s wr, 12 op/s 2024-09-19T06:35:30.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:29 smithi099 ceph-mon[27651]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.9 KiB/s rd, 142 KiB/s wr, 9 op/s 2024-09-19T06:35:30.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:29 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:35:30.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:29 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:35:30.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:29 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:35:30.227 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:29 smithi117 ceph-mon[34564]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.9 KiB/s rd, 142 KiB/s wr, 9 op/s 2024-09-19T06:35:30.227 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:29 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:35:30.227 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:29 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:35:30.227 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:29 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:35:32.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:31 smithi099 ceph-mon[27651]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.4 KiB/s rd, 117 KiB/s wr, 8 op/s 2024-09-19T06:35:32.225 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:31 smithi117 ceph-mon[34564]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.4 KiB/s rd, 117 KiB/s wr, 8 op/s 2024-09-19T06:35:33.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:33.456+0000 7f6ff77fe640 1 -- 172.21.15.117:0/1339175234 <== mgr.14206 v2:172.21.15.99:6800/886909451 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f7010111160 con 0x7f6ff806ecc0 2024-09-19T06:35:33.458 INFO:teuthology.orchestra.run.smithi117.stdout:Created osd(s) 3 on host 'smithi117' 2024-09-19T06:35:33.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:33.458+0000 7f70151eb640 1 -- 172.21.15.117:0/1339175234 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f6ff806ecc0 msgr2=0x7f6ff8071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:35:33.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:33.458+0000 7f70151eb640 1 --2- 172.21.15.117:0/1339175234 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f6ff806ecc0 0x7f6ff8071170 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7004000c00 tx=0x7f7004035040 comp rx=0 tx=0).stop 2024-09-19T06:35:33.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:33.458+0000 7f70151eb640 1 -- 172.21.15.117:0/1339175234 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7010065bc0 msgr2=0x7f701010f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:35:33.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:33.458+0000 7f70151eb640 1 --2- 172.21.15.117:0/1339175234 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7010065bc0 0x7f701010f320 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f7000002a80 tx=0x7f7000004600 comp rx=0 tx=0).stop 2024-09-19T06:35:33.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:33.458+0000 7f70151eb640 1 -- 172.21.15.117:0/1339175234 shutdown_connections 2024-09-19T06:35:33.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:33.458+0000 7f70151eb640 1 --2- 172.21.15.117:0/1339175234 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f6ff806ecc0 0x7f6ff8071170 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:35:33.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:33.458+0000 7f70151eb640 1 --2- 172.21.15.117:0/1339175234 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7010101b00 0x7f701010f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:35:33.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:33.458+0000 7f70151eb640 1 --2- 172.21.15.117:0/1339175234 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7010065bc0 0x7f701010f320 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:35:33.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:33.458+0000 7f70151eb640 1 -- 172.21.15.117:0/1339175234 >> 172.21.15.117:0/1339175234 conn(0x7f70100f6c10 msgr2=0x7f70100f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:35:33.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:33.458+0000 7f70151eb640 1 -- 172.21.15.117:0/1339175234 shutdown_connections 2024-09-19T06:35:33.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:33.458+0000 7f70151eb640 1 -- 172.21.15.117:0/1339175234 wait complete. 2024-09-19T06:35:34.045 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:33 smithi117 ceph-mon[34564]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-09-19T06:35:34.045 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:33 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:35:34.045 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:33 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:35:34.046 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:33 smithi117 ceph-mon[34564]: from='osd.3 [v2:172.21.15.117:6800/1478846960,v1:172.21.15.117:6801/1478846960]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T06:35:34.046 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:33 smithi117 ceph-mon[34564]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T06:35:34.075 DEBUG:teuthology.orchestra.run.smithi117:osd.3> sudo journalctl -f -n 0 -u ceph-a73eb958-7650-11ef-bceb-c7b262605968@osd.3.service 2024-09-19T06:35:34.078 INFO:tasks.cephadm:Deploying osd.4 on smithi117 with /dev/vg_nvme/lv_3... 2024-09-19T06:35:34.078 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T06:35:34.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:33 smithi099 ceph-mon[27651]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-09-19T06:35:34.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:33 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:35:34.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:33 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:35:34.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:33 smithi099 ceph-mon[27651]: from='osd.3 [v2:172.21.15.117:6800/1478846960,v1:172.21.15.117:6801/1478846960]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T06:35:34.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:33 smithi099 ceph-mon[27651]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T06:35:34.377 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi117/config 2024-09-19T06:35:35.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:35 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:35:35.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:35 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:35:35.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:35 smithi099 ceph-mon[27651]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T06:35:35.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:35 smithi099 ceph-mon[27651]: osdmap e25: 4 total, 3 up, 4 in 2024-09-19T06:35:35.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:35 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:35:35.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:35 smithi099 ceph-mon[27651]: from='osd.3 [v2:172.21.15.117:6800/1478846960,v1:172.21.15.117:6801/1478846960]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-19T06:35:35.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:35 smithi099 ceph-mon[27651]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-19T06:35:35.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:35 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:35:35.471 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:35 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:35:35.471 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:35 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:35:35.472 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:35 smithi117 ceph-mon[34564]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T06:35:35.472 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:35 smithi117 ceph-mon[34564]: osdmap e25: 4 total, 3 up, 4 in 2024-09-19T06:35:35.472 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:35 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:35:35.472 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:35 smithi117 ceph-mon[34564]: from='osd.3 [v2:172.21.15.117:6800/1478846960,v1:172.21.15.117:6801/1478846960]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-19T06:35:35.472 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:35 smithi117 ceph-mon[34564]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-19T06:35:35.472 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:35 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:35:35.812 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 06:35:35 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-3[40034]: 2024-09-19T06:35:35.469+0000 7f5e5dcbc640 -1 osd.3 0 waiting for initial osdmap 2024-09-19T06:35:35.812 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 06:35:35 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-3[40034]: 2024-09-19T06:35:35.475+0000 7f5e572f0640 -1 osd.3 26 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:35:36.424 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:36 smithi117 ceph-mon[34564]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-19T06:35:36.424 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:36 smithi117 ceph-mon[34564]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2024-09-19T06:35:36.424 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:36 smithi117 ceph-mon[34564]: osdmap e26: 4 total, 3 up, 4 in 2024-09-19T06:35:36.424 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:36 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:35:36.425 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:36 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:35:36.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:36 smithi099 ceph-mon[27651]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-19T06:35:36.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:36 smithi099 ceph-mon[27651]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2024-09-19T06:35:36.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:36 smithi099 ceph-mon[27651]: osdmap e26: 4 total, 3 up, 4 in 2024-09-19T06:35:36.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:36 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:35:36.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:36 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:35:37.757 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:37 smithi117 ceph-mon[34564]: purged_snaps scrub starts 2024-09-19T06:35:37.757 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:37 smithi117 ceph-mon[34564]: purged_snaps scrub ok 2024-09-19T06:35:37.757 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:37 smithi117 ceph-mon[34564]: osd.3 [v2:172.21.15.117:6800/1478846960,v1:172.21.15.117:6801/1478846960] boot 2024-09-19T06:35:37.757 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:37 smithi117 ceph-mon[34564]: osdmap e27: 4 total, 4 up, 4 in 2024-09-19T06:35:37.757 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:37 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:35:37.757 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:37 smithi117 ceph-mon[34564]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-19T06:35:37.761 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:35:37.781 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi117:vg_nvme/lv_3 2024-09-19T06:35:37.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:37 smithi099 ceph-mon[27651]: purged_snaps scrub starts 2024-09-19T06:35:37.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:37 smithi099 ceph-mon[27651]: purged_snaps scrub ok 2024-09-19T06:35:37.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:37 smithi099 ceph-mon[27651]: osd.3 [v2:172.21.15.117:6800/1478846960,v1:172.21.15.117:6801/1478846960] boot 2024-09-19T06:35:37.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:37 smithi099 ceph-mon[27651]: osdmap e27: 4 total, 4 up, 4 in 2024-09-19T06:35:37.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:37 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:35:37.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:37 smithi099 ceph-mon[27651]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-19T06:35:38.276 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi117/config 2024-09-19T06:35:38.671 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:38 smithi117 ceph-mon[34564]: osdmap e28: 4 total, 4 up, 4 in 2024-09-19T06:35:38.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:38 smithi099 ceph-mon[27651]: osdmap e28: 4 total, 4 up, 4 in 2024-09-19T06:35:39.534 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:39 smithi117 ceph-mon[34564]: osdmap e29: 4 total, 4 up, 4 in 2024-09-19T06:35:39.534 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:39 smithi117 ceph-mon[34564]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-19T06:35:39.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:39 smithi099 ceph-mon[27651]: osdmap e29: 4 total, 4 up, 4 in 2024-09-19T06:35:39.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:39 smithi099 ceph-mon[27651]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-19T06:35:40.436 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:40.433+0000 7f8c61149640 1 -- 172.21.15.117:0/3144081252 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c5c0fd820 msgr2=0x7f8c5c0fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:35:40.436 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:40.433+0000 7f8c61149640 1 --2- 172.21.15.117:0/3144081252 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c5c0fd820 0x7f8c5c0fdc90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8c500048d0 tx=0x7f8c50009da0 comp rx=0 tx=0).stop 2024-09-19T06:35:40.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:40.434+0000 7f8c61149640 1 -- 172.21.15.117:0/3144081252 shutdown_connections 2024-09-19T06:35:40.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:40.434+0000 7f8c61149640 1 --2- 172.21.15.117:0/3144081252 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c5c0fd820 0x7f8c5c0fdc90 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:35:40.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:40.434+0000 7f8c61149640 1 --2- 172.21.15.117:0/3144081252 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c5c0fc550 0x7f8c5c0fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:35:40.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:40.434+0000 7f8c61149640 1 -- 172.21.15.117:0/3144081252 >> 172.21.15.117:0/3144081252 conn(0x7f8c5c0f7d30 msgr2=0x7f8c5c0fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:35:40.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:40.434+0000 7f8c61149640 1 -- 172.21.15.117:0/3144081252 shutdown_connections 2024-09-19T06:35:40.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:40.434+0000 7f8c61149640 1 -- 172.21.15.117:0/3144081252 wait complete. 2024-09-19T06:35:40.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:40.434+0000 7f8c61149640 1 Processor -- start 2024-09-19T06:35:40.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:40.434+0000 7f8c61149640 1 -- start start 2024-09-19T06:35:40.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:40.434+0000 7f8c61149640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c5c0fc550 0x7f8c5c071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:35:40.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:40.434+0000 7f8c61149640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c5c0fd820 0x7f8c5c06fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:35:40.437 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:40.434+0000 7f8c61149640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5c070080 con 0x7f8c5c0fd820 2024-09-19T06:35:40.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:40.434+0000 7f8c61149640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5c0701c0 con 0x7f8c5c0fc550 2024-09-19T06:35:40.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:40.434+0000 7f8c5ad9d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c5c0fc550 0x7f8c5c071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:35:40.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:40.435+0000 7f8c5ad9d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c5c0fc550 0x7f8c5c071570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:38014/0 (socket says 172.21.15.117:38014) 2024-09-19T06:35:40.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:40.435+0000 7f8c5ad9d640 1 -- 172.21.15.117:0/767853383 learned_addr learned my addr 172.21.15.117:0/767853383 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T06:35:40.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:40.435+0000 7f8c5a59c640 1 --2- 172.21.15.117:0/767853383 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c5c0fd820 0x7f8c5c06fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:35:40.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:40.435+0000 7f8c5ad9d640 1 -- 172.21.15.117:0/767853383 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c5c0fd820 msgr2=0x7f8c5c06fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:35:40.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:40.435+0000 7f8c5ad9d640 1 --2- 172.21.15.117:0/767853383 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c5c0fd820 0x7f8c5c06fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:35:40.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:40.435+0000 7f8c5ad9d640 1 -- 172.21.15.117:0/767853383 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c50005040 con 0x7f8c5c0fc550 2024-09-19T06:35:40.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:40.435+0000 7f8c5ad9d640 1 --2- 172.21.15.117:0/767853383 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c5c0fc550 0x7f8c5c071570 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c00b790 tx=0x7f8c4c0091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:35:40.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:40.435+0000 7f8c437fe640 1 -- 172.21.15.117:0/767853383 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c4c00c700 con 0x7f8c5c0fc550 2024-09-19T06:35:40.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:40.435+0000 7f8c437fe640 1 -- 172.21.15.117:0/767853383 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8c4c00cd00 con 0x7f8c5c0fc550 2024-09-19T06:35:40.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:40.435+0000 7f8c61149640 1 -- 172.21.15.117:0/767853383 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c5c0704a0 con 0x7f8c5c0fc550 2024-09-19T06:35:40.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:40.435+0000 7f8c437fe640 1 -- 172.21.15.117:0/767853383 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c4c015e80 con 0x7f8c5c0fc550 2024-09-19T06:35:40.438 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:40.435+0000 7f8c61149640 1 -- 172.21.15.117:0/767853383 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c5c115130 con 0x7f8c5c0fc550 2024-09-19T06:35:40.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:40.436+0000 7f8c61149640 1 -- 172.21.15.117:0/767853383 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c5c0fb9b0 con 0x7f8c5c0fc550 2024-09-19T06:35:40.439 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:40.437+0000 7f8c437fe640 1 -- 172.21.15.117:0/767853383 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f8c4c012070 con 0x7f8c5c0fc550 2024-09-19T06:35:40.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:40.437+0000 7f8c437fe640 1 --2- 172.21.15.117:0/767853383 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f8c4406ed60 0x7f8c44071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:35:40.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:40.437+0000 7f8c437fe640 1 -- 172.21.15.117:0/767853383 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 3770+0+0 (secure 0 0 0) 0x7f8c4c08d370 con 0x7f8c5c0fc550 2024-09-19T06:35:40.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:40.438+0000 7f8c5a59c640 1 --2- 172.21.15.117:0/767853383 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f8c4406ed60 0x7f8c44071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:35:40.440 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:40.438+0000 7f8c5a59c640 1 --2- 172.21.15.117:0/767853383 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f8c4406ed60 0x7f8c44071210 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8c50000c00 tx=0x7f8c50035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:35:40.443 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:40.442+0000 7f8c437fe640 1 -- 172.21.15.117:0/767853383 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f8c4c05ab30 con 0x7f8c5c0fc550 2024-09-19T06:35:40.608 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:40.607+0000 7f8c61149640 1 -- 172.21.15.117:0/767853383 --> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f8c5c101c40 con 0x7f8c4406ed60 2024-09-19T06:35:40.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:40 smithi099 ceph-mon[27651]: Detected new or changed devices on smithi117 2024-09-19T06:35:40.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:40 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:35:40.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:40 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:35:40.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:40 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:35:40.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:40 smithi099 ceph-mon[27651]: Adjusting osd_memory_target on smithi117 to 15936M 2024-09-19T06:35:40.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:40 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:35:40.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:40 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:35:40.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:40 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:35:40.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:40 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:35:40.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:40 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:35:40.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:40 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:35:40.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:40 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:35:40.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:40 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:35:41.007 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:40 smithi117 ceph-mon[34564]: Detected new or changed devices on smithi117 2024-09-19T06:35:41.007 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:40 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:35:41.007 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:40 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:35:41.007 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:40 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:35:41.007 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:40 smithi117 ceph-mon[34564]: Adjusting osd_memory_target on smithi117 to 15936M 2024-09-19T06:35:41.007 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:40 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:35:41.007 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:40 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:35:41.008 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:40 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:35:41.008 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:40 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:35:41.008 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:40 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:35:41.008 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:40 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:35:41.008 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:40 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:35:41.008 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:40 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:35:41.905 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:41 smithi117 ceph-mon[34564]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 114 KiB/s, 0 objects/s recovering 2024-09-19T06:35:41.905 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:41 smithi117 ceph-mon[34564]: from='client.24159 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:35:41.905 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:41 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:35:41.905 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:41 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:35:41.905 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:41 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:35:41.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:41 smithi099 ceph-mon[27651]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 114 KiB/s, 0 objects/s recovering 2024-09-19T06:35:41.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:41 smithi099 ceph-mon[27651]: from='client.24159 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:35:41.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:41 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:35:41.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:41 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:35:41.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:41 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:35:43.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:43 smithi117 ceph-mon[34564]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 95 KiB/s, 0 objects/s recovering 2024-09-19T06:35:43.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:43 smithi117 ceph-mon[34564]: from='client.? 172.21.15.117:0/193213269' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2652320e-b3aa-4361-81fb-53dfaf76638e"}]: dispatch 2024-09-19T06:35:43.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:43 smithi117 ceph-mon[34564]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2652320e-b3aa-4361-81fb-53dfaf76638e"}]: dispatch 2024-09-19T06:35:43.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:43 smithi117 ceph-mon[34564]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2652320e-b3aa-4361-81fb-53dfaf76638e"}]': finished 2024-09-19T06:35:43.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:43 smithi117 ceph-mon[34564]: osdmap e30: 5 total, 4 up, 5 in 2024-09-19T06:35:43.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:43 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:35:43.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:43 smithi117 ceph-mon[34564]: from='client.? 172.21.15.117:0/1739496887' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:35:43.847 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:43 smithi099 ceph-mon[27651]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 95 KiB/s, 0 objects/s recovering 2024-09-19T06:35:43.847 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:43 smithi099 ceph-mon[27651]: from='client.? 172.21.15.117:0/193213269' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2652320e-b3aa-4361-81fb-53dfaf76638e"}]: dispatch 2024-09-19T06:35:43.847 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:43 smithi099 ceph-mon[27651]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2652320e-b3aa-4361-81fb-53dfaf76638e"}]: dispatch 2024-09-19T06:35:43.847 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:43 smithi099 ceph-mon[27651]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2652320e-b3aa-4361-81fb-53dfaf76638e"}]': finished 2024-09-19T06:35:43.847 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:43 smithi099 ceph-mon[27651]: osdmap e30: 5 total, 4 up, 5 in 2024-09-19T06:35:43.847 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:43 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:35:43.848 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:43 smithi099 ceph-mon[27651]: from='client.? 172.21.15.117:0/1739496887' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:35:45.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:45 smithi099 ceph-mon[27651]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-09-19T06:35:46.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:45 smithi117 ceph-mon[34564]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-09-19T06:35:47.906 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:47 smithi117 ceph-mon[34564]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T06:35:47.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:47 smithi099 ceph-mon[27651]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T06:35:49.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:49 smithi117 ceph-mon[34564]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T06:35:49.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:49 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:35:49.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:49 smithi099 ceph-mon[27651]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T06:35:49.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:49 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:35:50.813 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:50 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T06:35:50.813 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:50 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:35:50.813 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:50 smithi117 ceph-mon[34564]: Deploying daemon osd.4 on smithi117 2024-09-19T06:35:50.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:50 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T06:35:50.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:50 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:35:50.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:50 smithi099 ceph-mon[27651]: Deploying daemon osd.4 on smithi117 2024-09-19T06:35:51.705 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:51 smithi117 ceph-mon[34564]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-19T06:35:51.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:51 smithi099 ceph-mon[27651]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-19T06:35:53.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:53 smithi099 ceph-mon[27651]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-19T06:35:54.053 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:53 smithi117 ceph-mon[34564]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-19T06:35:54.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:54 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:35:54.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:54 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:35:54.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:54 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:35:54.985 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:54 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:35:54.985 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:54 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:35:54.985 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:54 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:35:55.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:55 smithi099 ceph-mon[27651]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-19T06:35:55.979 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:55 smithi117 ceph-mon[34564]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-19T06:35:57.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:57 smithi099 ceph-mon[27651]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-19T06:35:58.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:57 smithi117 ceph-mon[34564]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-19T06:35:58.261 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:58.259+0000 7f8c437fe640 1 -- 172.21.15.117:0/767853383 <== mgr.14206 v2:172.21.15.99:6800/886909451 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f8c5c101c40 con 0x7f8c4406ed60 2024-09-19T06:35:58.261 INFO:teuthology.orchestra.run.smithi117.stdout:Created osd(s) 4 on host 'smithi117' 2024-09-19T06:35:58.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:58.262+0000 7f8c61149640 1 -- 172.21.15.117:0/767853383 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f8c4406ed60 msgr2=0x7f8c44071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:35:58.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:58.262+0000 7f8c61149640 1 --2- 172.21.15.117:0/767853383 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f8c4406ed60 0x7f8c44071210 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8c50000c00 tx=0x7f8c50035040 comp rx=0 tx=0).stop 2024-09-19T06:35:58.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:58.262+0000 7f8c61149640 1 -- 172.21.15.117:0/767853383 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c5c0fc550 msgr2=0x7f8c5c071570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:35:58.263 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:58.262+0000 7f8c61149640 1 --2- 172.21.15.117:0/767853383 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c5c0fc550 0x7f8c5c071570 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c00b790 tx=0x7f8c4c0091d0 comp rx=0 tx=0).stop 2024-09-19T06:35:58.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:58.262+0000 7f8c61149640 1 -- 172.21.15.117:0/767853383 shutdown_connections 2024-09-19T06:35:58.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:58.262+0000 7f8c61149640 1 --2- 172.21.15.117:0/767853383 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f8c4406ed60 0x7f8c44071210 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:35:58.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:58.262+0000 7f8c61149640 1 --2- 172.21.15.117:0/767853383 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c5c0fd820 0x7f8c5c06fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:35:58.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:58.262+0000 7f8c61149640 1 --2- 172.21.15.117:0/767853383 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c5c0fc550 0x7f8c5c071570 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:35:58.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:58.262+0000 7f8c61149640 1 -- 172.21.15.117:0/767853383 >> 172.21.15.117:0/767853383 conn(0x7f8c5c0f7d30 msgr2=0x7f8c5c0f9480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:35:58.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:58.262+0000 7f8c61149640 1 -- 172.21.15.117:0/767853383 shutdown_connections 2024-09-19T06:35:58.264 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:35:58.262+0000 7f8c61149640 1 -- 172.21.15.117:0/767853383 wait complete. 2024-09-19T06:35:59.060 DEBUG:teuthology.orchestra.run.smithi117:osd.4> sudo journalctl -f -n 0 -u ceph-a73eb958-7650-11ef-bceb-c7b262605968@osd.4.service 2024-09-19T06:35:59.062 INFO:tasks.cephadm:Deploying osd.5 on smithi117 with /dev/vg_nvme/lv_2... 2024-09-19T06:35:59.062 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T06:35:59.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:59 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:35:59.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:59 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:35:59.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:59 smithi117 ceph-mon[34564]: from='osd.4 [v2:172.21.15.117:6808/2126129691,v1:172.21.15.117:6809/2126129691]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T06:35:59.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:59 smithi117 ceph-mon[34564]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T06:35:59.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:59 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:35:59.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:35:59 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:35:59.355 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi117/config 2024-09-19T06:35:59.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:59 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:35:59.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:59 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:35:59.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:59 smithi099 ceph-mon[27651]: from='osd.4 [v2:172.21.15.117:6808/2126129691,v1:172.21.15.117:6809/2126129691]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T06:35:59.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:59 smithi099 ceph-mon[27651]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T06:35:59.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:59 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:35:59.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:35:59 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:36:00.429 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:00 smithi117 ceph-mon[34564]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-19T06:36:00.429 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:00 smithi117 ceph-mon[34564]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T06:36:00.429 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:00 smithi117 ceph-mon[34564]: osdmap e31: 5 total, 4 up, 5 in 2024-09-19T06:36:00.429 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:00 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:36:00.429 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:00 smithi117 ceph-mon[34564]: from='osd.4 [v2:172.21.15.117:6808/2126129691,v1:172.21.15.117:6809/2126129691]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-19T06:36:00.429 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:00 smithi117 ceph-mon[34564]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-19T06:36:00.429 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 06:36:00 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-4[46532]: 2024-09-19T06:36:00.272+0000 7f9fb1c22640 -1 osd.4 0 waiting for initial osdmap 2024-09-19T06:36:00.429 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 06:36:00 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-4[46532]: 2024-09-19T06:36:00.280+0000 7f9faaa55640 -1 osd.4 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:36:00.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:00 smithi099 ceph-mon[27651]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-19T06:36:00.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:00 smithi099 ceph-mon[27651]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T06:36:00.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:00 smithi099 ceph-mon[27651]: osdmap e31: 5 total, 4 up, 5 in 2024-09-19T06:36:00.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:00 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:36:00.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:00 smithi099 ceph-mon[27651]: from='osd.4 [v2:172.21.15.117:6808/2126129691,v1:172.21.15.117:6809/2126129691]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-19T06:36:00.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:00 smithi099 ceph-mon[27651]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-19T06:36:01.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:01 smithi117 ceph-mon[34564]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2024-09-19T06:36:01.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:01 smithi117 ceph-mon[34564]: osdmap e32: 5 total, 4 up, 5 in 2024-09-19T06:36:01.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:01 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:36:01.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:01 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:36:01.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:01 smithi117 ceph-mon[34564]: osd.4 [v2:172.21.15.117:6808/2126129691,v1:172.21.15.117:6809/2126129691] boot 2024-09-19T06:36:01.563 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:01 smithi117 ceph-mon[34564]: osdmap e33: 5 total, 5 up, 5 in 2024-09-19T06:36:01.563 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:01 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:36:01.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:01 smithi099 ceph-mon[27651]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2024-09-19T06:36:01.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:01 smithi099 ceph-mon[27651]: osdmap e32: 5 total, 4 up, 5 in 2024-09-19T06:36:01.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:01 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:36:01.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:01 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:36:01.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:01 smithi099 ceph-mon[27651]: osd.4 [v2:172.21.15.117:6808/2126129691,v1:172.21.15.117:6809/2126129691] boot 2024-09-19T06:36:01.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:01 smithi099 ceph-mon[27651]: osdmap e33: 5 total, 5 up, 5 in 2024-09-19T06:36:01.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:01 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:36:02.163 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-19T06:36:02.187 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi117:vg_nvme/lv_2 2024-09-19T06:36:02.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:02 smithi117 ceph-mon[34564]: purged_snaps scrub starts 2024-09-19T06:36:02.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:02 smithi117 ceph-mon[34564]: purged_snaps scrub ok 2024-09-19T06:36:02.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:02 smithi117 ceph-mon[34564]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-19T06:36:02.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:02 smithi099 ceph-mon[27651]: purged_snaps scrub starts 2024-09-19T06:36:02.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:02 smithi099 ceph-mon[27651]: purged_snaps scrub ok 2024-09-19T06:36:02.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:02 smithi099 ceph-mon[27651]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-19T06:36:03.148 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi117/config 2024-09-19T06:36:03.523 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:03 smithi117 ceph-mon[34564]: osdmap e34: 5 total, 5 up, 5 in 2024-09-19T06:36:03.551 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:03 smithi099 ceph-mon[27651]: osdmap e34: 5 total, 5 up, 5 in 2024-09-19T06:36:04.444 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:04 smithi117 ceph-mon[34564]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-19T06:36:04.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:04 smithi099 ceph-mon[27651]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-19T06:36:05.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:05 smithi117 ceph-mon[34564]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-19T06:36:05.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:05 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:36:05.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:05 smithi117 ceph-mon[34564]: Detected new or changed devices on smithi117 2024-09-19T06:36:05.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:05 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:36:05.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:05 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:36:05.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:05 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:36:05.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:05 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:36:05.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:05 smithi117 ceph-mon[34564]: Adjusting osd_memory_target on smithi117 to 7968M 2024-09-19T06:36:05.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:05 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:36:05.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:05 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:36:05.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:05 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:36:05.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:05 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:36:05.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:05 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:36:05.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:05 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:36:05.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:05 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:36:05.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:05 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:36:05.366 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:05.346+0000 7fb58a04d640 1 -- 172.21.15.117:0/2531377601 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb584065c40 msgr2=0x7fb5840ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:05.366 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:05.346+0000 7fb58a04d640 1 --2- 172.21.15.117:0/2531377601 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb584065c40 0x7fb5840ff140 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb5740048d0 tx=0x7fb574009da0 comp rx=0 tx=0).stop 2024-09-19T06:36:05.366 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:05.346+0000 7fb58a04d640 1 -- 172.21.15.117:0/2531377601 shutdown_connections 2024-09-19T06:36:05.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:05.346+0000 7fb58a04d640 1 --2- 172.21.15.117:0/2531377601 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5840ff680 0x7fb584101a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:05.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:05.346+0000 7fb58a04d640 1 --2- 172.21.15.117:0/2531377601 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb584065c40 0x7fb5840ff140 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:05.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:05.346+0000 7fb58a04d640 1 -- 172.21.15.117:0/2531377601 >> 172.21.15.117:0/2531377601 conn(0x7fb5840f6c10 msgr2=0x7fb5840f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:36:05.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:05.346+0000 7fb58a04d640 1 -- 172.21.15.117:0/2531377601 shutdown_connections 2024-09-19T06:36:05.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:05.346+0000 7fb58a04d640 1 -- 172.21.15.117:0/2531377601 wait complete. 2024-09-19T06:36:05.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:05.346+0000 7fb58a04d640 1 Processor -- start 2024-09-19T06:36:05.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:05.346+0000 7fb58a04d640 1 -- start start 2024-09-19T06:36:05.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:05.347+0000 7fb58a04d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb584065c40 0x7fb58410d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:05.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:05.347+0000 7fb58a04d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5840ff680 0x7fb58410d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:05.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:05.347+0000 7fb58a04d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb58410dca0 con 0x7fb584065c40 2024-09-19T06:36:05.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:05.347+0000 7fb58a04d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb58410e470 con 0x7fb5840ff680 2024-09-19T06:36:05.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:05.347+0000 7fb57bfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5840ff680 0x7fb58410d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:05.367 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:05.347+0000 7fb57bfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5840ff680 0x7fb58410d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:57940/0 (socket says 172.21.15.117:57940) 2024-09-19T06:36:05.368 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:05.347+0000 7fb57bfff640 1 -- 172.21.15.117:0/2721427295 learned_addr learned my addr 172.21.15.117:0/2721427295 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T06:36:05.368 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:05.347+0000 7fb5837fe640 1 --2- 172.21.15.117:0/2721427295 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb584065c40 0x7fb58410d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:05.368 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:05.347+0000 7fb57bfff640 1 -- 172.21.15.117:0/2721427295 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb584065c40 msgr2=0x7fb58410d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:05.368 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:05.347+0000 7fb57bfff640 1 --2- 172.21.15.117:0/2721427295 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb584065c40 0x7fb58410d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:05.368 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:05.347+0000 7fb57bfff640 1 -- 172.21.15.117:0/2721427295 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb574005040 con 0x7fb5840ff680 2024-09-19T06:36:05.368 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:05.347+0000 7fb57bfff640 1 --2- 172.21.15.117:0/2721427295 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5840ff680 0x7fb58410d650 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb56c002a50 tx=0x7fb56c004600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:36:05.368 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:05.347+0000 7fb580ff9640 1 -- 172.21.15.117:0/2721427295 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb56c007c30 con 0x7fb5840ff680 2024-09-19T06:36:05.368 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:05.347+0000 7fb580ff9640 1 -- 172.21.15.117:0/2721427295 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb56c00f040 con 0x7fb5840ff680 2024-09-19T06:36:05.368 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:05.347+0000 7fb58a04d640 1 -- 172.21.15.117:0/2721427295 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb58410e700 con 0x7fb5840ff680 2024-09-19T06:36:05.368 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:05.347+0000 7fb580ff9640 1 -- 172.21.15.117:0/2721427295 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb56c00da10 con 0x7fb5840ff680 2024-09-19T06:36:05.368 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:05.347+0000 7fb58a04d640 1 -- 172.21.15.117:0/2721427295 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb58410eca0 con 0x7fb5840ff680 2024-09-19T06:36:05.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:05.348+0000 7fb58a04d640 1 -- 172.21.15.117:0/2721427295 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5840fa890 con 0x7fb5840ff680 2024-09-19T06:36:05.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:05.349+0000 7fb580ff9640 1 -- 172.21.15.117:0/2721427295 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fb56c00dc80 con 0x7fb5840ff680 2024-09-19T06:36:05.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:05.349+0000 7fb580ff9640 1 --2- 172.21.15.117:0/2721427295 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fb57006ed50 0x7fb570071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:05.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:05.349+0000 7fb580ff9640 1 -- 172.21.15.117:0/2721427295 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4202+0+0 (secure 0 0 0) 0x7fb56c08d450 con 0x7fb5840ff680 2024-09-19T06:36:05.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:05.350+0000 7fb5837fe640 1 --2- 172.21.15.117:0/2721427295 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fb57006ed50 0x7fb570071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:05.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:05.350+0000 7fb5837fe640 1 --2- 172.21.15.117:0/2721427295 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fb57006ed50 0x7fb570071200 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb574000c00 tx=0x7fb574035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:36:05.369 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:05.353+0000 7fb580ff9640 1 -- 172.21.15.117:0/2721427295 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fb56c04d2a0 con 0x7fb5840ff680 2024-09-19T06:36:05.519 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:05.518+0000 7fb58a04d640 1 -- 172.21.15.117:0/2721427295 --> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fb58410efd0 con 0x7fb57006ed50 2024-09-19T06:36:05.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:05 smithi099 ceph-mon[27651]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-19T06:36:05.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:05 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:36:05.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:05 smithi099 ceph-mon[27651]: Detected new or changed devices on smithi117 2024-09-19T06:36:05.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:05 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:36:05.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:05 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:36:05.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:05 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:36:05.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:05 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:36:05.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:05 smithi099 ceph-mon[27651]: Adjusting osd_memory_target on smithi117 to 7968M 2024-09-19T06:36:05.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:05 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:36:05.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:05 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:36:05.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:05 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:36:05.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:05 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:36:05.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:05 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:36:05.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:05 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:36:05.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:05 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:36:05.708 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:05 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:36:06.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:06 smithi117 ceph-mon[34564]: from='client.24177 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:36:06.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:06 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:36:06.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:06 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:36:06.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:06 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:36:06.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:06 smithi099 ceph-mon[27651]: from='client.24177 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:36:06.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:06 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T06:36:06.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:06 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T06:36:06.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:06 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:36:07.555 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:07 smithi117 ceph-mon[34564]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-19T06:36:07.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:07 smithi099 ceph-mon[27651]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-19T06:36:08.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:08 smithi117 ceph-mon[34564]: from='client.? 172.21.15.117:0/174597551' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2f82c5e1-1d76-42c2-bbeb-3a94e672d4c1"}]: dispatch 2024-09-19T06:36:08.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:08 smithi117 ceph-mon[34564]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2f82c5e1-1d76-42c2-bbeb-3a94e672d4c1"}]: dispatch 2024-09-19T06:36:08.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:08 smithi117 ceph-mon[34564]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2f82c5e1-1d76-42c2-bbeb-3a94e672d4c1"}]': finished 2024-09-19T06:36:08.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:08 smithi117 ceph-mon[34564]: osdmap e35: 6 total, 5 up, 6 in 2024-09-19T06:36:08.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:08 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:36:08.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:08 smithi099 ceph-mon[27651]: from='client.? 172.21.15.117:0/174597551' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2f82c5e1-1d76-42c2-bbeb-3a94e672d4c1"}]: dispatch 2024-09-19T06:36:08.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:08 smithi099 ceph-mon[27651]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2f82c5e1-1d76-42c2-bbeb-3a94e672d4c1"}]: dispatch 2024-09-19T06:36:08.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:08 smithi099 ceph-mon[27651]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2f82c5e1-1d76-42c2-bbeb-3a94e672d4c1"}]': finished 2024-09-19T06:36:08.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:08 smithi099 ceph-mon[27651]: osdmap e35: 6 total, 5 up, 6 in 2024-09-19T06:36:08.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:08 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:36:09.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:09 smithi099 ceph-mon[27651]: from='client.? 172.21.15.117:0/2506115642' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:36:09.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:09 smithi099 ceph-mon[27651]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-19T06:36:09.811 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:09 smithi117 ceph-mon[34564]: from='client.? 172.21.15.117:0/2506115642' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T06:36:09.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:09 smithi117 ceph-mon[34564]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-19T06:36:11.811 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:11 smithi117 ceph-mon[34564]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-19T06:36:11.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:11 smithi099 ceph-mon[27651]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-19T06:36:13.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:13 smithi117 ceph-mon[34564]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-19T06:36:13.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:13 smithi099 ceph-mon[27651]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-19T06:36:15.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:15 smithi117 ceph-mon[34564]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-19T06:36:15.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:15 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T06:36:15.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:15 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:36:15.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:15 smithi117 ceph-mon[34564]: Deploying daemon osd.5 on smithi117 2024-09-19T06:36:15.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:15 smithi099 ceph-mon[27651]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-19T06:36:15.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:15 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T06:36:15.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:15 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:36:15.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:15 smithi099 ceph-mon[27651]: Deploying daemon osd.5 on smithi117 2024-09-19T06:36:17.633 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:17 smithi117 ceph-mon[34564]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-19T06:36:17.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:17 smithi099 ceph-mon[27651]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-19T06:36:19.932 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:19 smithi117 ceph-mon[34564]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-19T06:36:19.932 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:19 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:36:19.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:19 smithi099 ceph-mon[27651]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-19T06:36:19.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:19 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:36:20.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:20 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:36:20.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:20 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:36:20.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:20 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:36:21.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:20 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:36:21.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:20 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:36:21.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:20 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:36:21.811 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:21 smithi117 ceph-mon[34564]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-19T06:36:21.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:21 smithi099 ceph-mon[27651]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-19T06:36:23.416 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:23.415+0000 7fb580ff9640 1 -- 172.21.15.117:0/2721427295 <== mgr.14206 v2:172.21.15.99:6800/886909451 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fb58410efd0 con 0x7fb57006ed50 2024-09-19T06:36:23.417 INFO:teuthology.orchestra.run.smithi117.stdout:Created osd(s) 5 on host 'smithi117' 2024-09-19T06:36:23.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:23.417+0000 7fb58a04d640 1 -- 172.21.15.117:0/2721427295 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fb57006ed50 msgr2=0x7fb570071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:23.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:23.417+0000 7fb58a04d640 1 --2- 172.21.15.117:0/2721427295 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fb57006ed50 0x7fb570071200 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb574000c00 tx=0x7fb574035040 comp rx=0 tx=0).stop 2024-09-19T06:36:23.418 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:23.417+0000 7fb58a04d640 1 -- 172.21.15.117:0/2721427295 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5840ff680 msgr2=0x7fb58410d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:23.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:23.417+0000 7fb58a04d640 1 --2- 172.21.15.117:0/2721427295 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5840ff680 0x7fb58410d650 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb56c002a50 tx=0x7fb56c004600 comp rx=0 tx=0).stop 2024-09-19T06:36:23.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:23.417+0000 7fb58a04d640 1 -- 172.21.15.117:0/2721427295 shutdown_connections 2024-09-19T06:36:23.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:23.417+0000 7fb58a04d640 1 --2- 172.21.15.117:0/2721427295 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fb57006ed50 0x7fb570071200 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:23.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:23.417+0000 7fb58a04d640 1 --2- 172.21.15.117:0/2721427295 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5840ff680 0x7fb58410d650 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:23.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:23.417+0000 7fb58a04d640 1 --2- 172.21.15.117:0/2721427295 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb584065c40 0x7fb58410d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:23.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:23.417+0000 7fb58a04d640 1 -- 172.21.15.117:0/2721427295 >> 172.21.15.117:0/2721427295 conn(0x7fb5840f6c10 msgr2=0x7fb5840f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:36:23.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:23.417+0000 7fb58a04d640 1 -- 172.21.15.117:0/2721427295 shutdown_connections 2024-09-19T06:36:23.419 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:23.417+0000 7fb58a04d640 1 -- 172.21.15.117:0/2721427295 wait complete. 2024-09-19T06:36:23.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:23 smithi099 ceph-mon[27651]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-19T06:36:23.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:23 smithi099 ceph-mon[27651]: from='osd.5 [v2:172.21.15.117:6816/2126888000,v1:172.21.15.117:6817/2126888000]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T06:36:23.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:23 smithi099 ceph-mon[27651]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T06:36:23.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:23 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:36:23.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:23 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:36:23.975 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:23 smithi117 ceph-mon[34564]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-19T06:36:23.975 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:23 smithi117 ceph-mon[34564]: from='osd.5 [v2:172.21.15.117:6816/2126888000,v1:172.21.15.117:6817/2126888000]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T06:36:23.975 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:23 smithi117 ceph-mon[34564]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T06:36:23.975 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:23 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:36:23.975 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:23 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:36:24.000 DEBUG:teuthology.orchestra.run.smithi117:osd.5> sudo journalctl -f -n 0 -u ceph-a73eb958-7650-11ef-bceb-c7b262605968@osd.5.service 2024-09-19T06:36:24.003 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-09-19T06:36:24.003 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T06:36:24.259 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T06:36:24.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:24 smithi099 ceph-mon[27651]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T06:36:24.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:24 smithi099 ceph-mon[27651]: osdmap e36: 6 total, 5 up, 6 in 2024-09-19T06:36:24.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:24 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:36:24.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:24 smithi099 ceph-mon[27651]: from='osd.5 [v2:172.21.15.117:6816/2126888000,v1:172.21.15.117:6817/2126888000]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-19T06:36:24.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:24 smithi099 ceph-mon[27651]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-19T06:36:24.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:24 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:36:24.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:24 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:36:24.976 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:24 smithi117 ceph-mon[34564]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T06:36:24.976 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:24 smithi117 ceph-mon[34564]: osdmap e36: 6 total, 5 up, 6 in 2024-09-19T06:36:24.976 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:24 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:36:24.976 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:24 smithi117 ceph-mon[34564]: from='osd.5 [v2:172.21.15.117:6816/2126888000,v1:172.21.15.117:6817/2126888000]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-19T06:36:24.976 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:24 smithi117 ceph-mon[34564]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-19T06:36:24.976 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:24 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:36:24.976 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:24 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:36:24.977 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:36:24 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5[52951]: 2024-09-19T06:36:24.703+0000 7fd52debe640 -1 osd.5 0 waiting for initial osdmap 2024-09-19T06:36:24.977 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:36:24 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5[52951]: 2024-09-19T06:36:24.711+0000 7fd5294f6640 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:36:25.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:25.903+0000 7ff2cdf82640 1 -- 172.21.15.99:0/377847350 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff2c80fd840 msgr2=0x7ff2c80fdcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:25.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:25.903+0000 7ff2cdf82640 1 --2- 172.21.15.99:0/377847350 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff2c80fd840 0x7ff2c80fdcb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff2b00048d0 tx=0x7ff2b0009da0 comp rx=0 tx=0).stop 2024-09-19T06:36:25.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:25.903+0000 7ff2cdf82640 1 -- 172.21.15.99:0/377847350 shutdown_connections 2024-09-19T06:36:25.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:25.903+0000 7ff2cdf82640 1 --2- 172.21.15.99:0/377847350 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff2c80fd840 0x7ff2c80fdcb0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:25.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:25.903+0000 7ff2cdf82640 1 --2- 172.21.15.99:0/377847350 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2c80fc570 0x7ff2c80fc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:25.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:25.903+0000 7ff2cdf82640 1 -- 172.21.15.99:0/377847350 >> 172.21.15.99:0/377847350 conn(0x7ff2c80f7d30 msgr2=0x7ff2c80fa160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:36:25.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:25.903+0000 7ff2cdf82640 1 -- 172.21.15.99:0/377847350 shutdown_connections 2024-09-19T06:36:25.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:25.903+0000 7ff2cdf82640 1 -- 172.21.15.99:0/377847350 wait complete. 2024-09-19T06:36:25.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:25.903+0000 7ff2cdf82640 1 Processor -- start 2024-09-19T06:36:25.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:25.904+0000 7ff2cdf82640 1 -- start start 2024-09-19T06:36:25.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:25.904+0000 7ff2cdf82640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2c80fc570 0x7ff2c810d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:25.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:25.904+0000 7ff2cdf82640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff2c80fd840 0x7ff2c810d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:25.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:25.904+0000 7ff2cdf82640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c810dc10 con 0x7ff2c80fd840 2024-09-19T06:36:25.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:25.904+0000 7ff2cdf82640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c810e430 con 0x7ff2c80fc570 2024-09-19T06:36:25.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:25.904+0000 7ff2beffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff2c80fd840 0x7ff2c810d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:25.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:25.904+0000 7ff2beffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff2c80fd840 0x7ff2c810d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42392/0 (socket says 172.21.15.99:42392) 2024-09-19T06:36:25.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:25.904+0000 7ff2beffd640 1 -- 172.21.15.99:0/651137786 learned_addr learned my addr 172.21.15.99:0/651137786 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:36:25.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:25.904+0000 7ff2c77fe640 1 --2- 172.21.15.99:0/651137786 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2c80fc570 0x7ff2c810d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:25.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:25.904+0000 7ff2beffd640 1 -- 172.21.15.99:0/651137786 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2c80fc570 msgr2=0x7ff2c810d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:25.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:25.904+0000 7ff2beffd640 1 --2- 172.21.15.99:0/651137786 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2c80fc570 0x7ff2c810d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:25.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:25.904+0000 7ff2beffd640 1 -- 172.21.15.99:0/651137786 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2b0005040 con 0x7ff2c80fd840 2024-09-19T06:36:25.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:25.904+0000 7ff2beffd640 1 --2- 172.21.15.99:0/651137786 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff2c80fd840 0x7ff2c810d5c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff2b00043d0 tx=0x7ff2b0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:36:25.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:25.905+0000 7ff2c4ff9640 1 -- 172.21.15.99:0/651137786 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2b0038070 con 0x7ff2c80fd840 2024-09-19T06:36:25.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:25.905+0000 7ff2cdf82640 1 -- 172.21.15.99:0/651137786 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2c810e660 con 0x7ff2c80fd840 2024-09-19T06:36:25.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:25.905+0000 7ff2c4ff9640 1 -- 172.21.15.99:0/651137786 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff2b002ae90 con 0x7ff2c80fd840 2024-09-19T06:36:25.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:25.905+0000 7ff2c4ff9640 1 -- 172.21.15.99:0/651137786 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2b003e670 con 0x7ff2c80fd840 2024-09-19T06:36:25.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:25.905+0000 7ff2cdf82640 1 -- 172.21.15.99:0/651137786 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2c810ec00 con 0x7ff2c80fd840 2024-09-19T06:36:25.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:25.906+0000 7ff2cdf82640 1 -- 172.21.15.99:0/651137786 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2c80fb9d0 con 0x7ff2c80fd840 2024-09-19T06:36:25.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:25.906+0000 7ff2c4ff9640 1 -- 172.21.15.99:0/651137786 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7ff2b0030020 con 0x7ff2c80fd840 2024-09-19T06:36:25.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:25.907+0000 7ff2c4ff9640 1 --2- 172.21.15.99:0/651137786 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7ff2b406ed60 0x7ff2b4071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:25.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:25.907+0000 7ff2c4ff9640 1 -- 172.21.15.99:0/651137786 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7ff2b00ae030 con 0x7ff2c80fd840 2024-09-19T06:36:25.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:25.907+0000 7ff2c77fe640 1 --2- 172.21.15.99:0/651137786 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7ff2b406ed60 0x7ff2b4071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:25.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:25.907+0000 7ff2c77fe640 1 --2- 172.21.15.99:0/651137786 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7ff2b406ed60 0x7ff2b4071210 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff2b8009fd0 tx=0x7ff2b800b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:36:25.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:25.911+0000 7ff2c4ff9640 1 -- 172.21.15.99:0/651137786 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ff2b007b540 con 0x7ff2c80fd840 2024-09-19T06:36:25.979 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:25 smithi117 ceph-mon[34564]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-19T06:36:25.979 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:25 smithi117 ceph-mon[34564]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2024-09-19T06:36:25.979 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:25 smithi117 ceph-mon[34564]: osdmap e37: 6 total, 5 up, 6 in 2024-09-19T06:36:25.979 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:25 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:36:25.979 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:25 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:36:26.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:26.068+0000 7ff2cdf82640 1 -- 172.21.15.99:0/651137786 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7ff2c810ee50 con 0x7ff2c80fd840 2024-09-19T06:36:26.070 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:25 smithi099 ceph-mon[27651]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-19T06:36:26.070 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:25 smithi099 ceph-mon[27651]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2024-09-19T06:36:26.070 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:25 smithi099 ceph-mon[27651]: osdmap e37: 6 total, 5 up, 6 in 2024-09-19T06:36:26.071 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:25 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:36:26.071 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:25 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:36:26.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:26.069+0000 7ff2c4ff9640 1 -- 172.21.15.99:0/651137786 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v38) v1 ==== 74+0+130 (secure 0 0 0) 0x7ff2b007aee0 con 0x7ff2c80fd840 2024-09-19T06:36:26.071 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:36:26.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:26.071+0000 7ff2cdf82640 1 -- 172.21.15.99:0/651137786 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7ff2b406ed60 msgr2=0x7ff2b4071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:26.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:26.071+0000 7ff2cdf82640 1 --2- 172.21.15.99:0/651137786 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7ff2b406ed60 0x7ff2b4071210 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff2b8009fd0 tx=0x7ff2b800b040 comp rx=0 tx=0).stop 2024-09-19T06:36:26.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:26.071+0000 7ff2cdf82640 1 -- 172.21.15.99:0/651137786 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff2c80fd840 msgr2=0x7ff2c810d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:26.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:26.071+0000 7ff2cdf82640 1 --2- 172.21.15.99:0/651137786 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff2c80fd840 0x7ff2c810d5c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff2b00043d0 tx=0x7ff2b0009da0 comp rx=0 tx=0).stop 2024-09-19T06:36:26.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:26.071+0000 7ff2cdf82640 1 -- 172.21.15.99:0/651137786 shutdown_connections 2024-09-19T06:36:26.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:26.072+0000 7ff2cdf82640 1 --2- 172.21.15.99:0/651137786 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7ff2b406ed60 0x7ff2b4071210 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:26.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:26.072+0000 7ff2cdf82640 1 --2- 172.21.15.99:0/651137786 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff2c80fd840 0x7ff2c810d5c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:26.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:26.072+0000 7ff2cdf82640 1 --2- 172.21.15.99:0/651137786 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2c80fc570 0x7ff2c810d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:26.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:26.072+0000 7ff2cdf82640 1 -- 172.21.15.99:0/651137786 >> 172.21.15.99:0/651137786 conn(0x7ff2c80f7d30 msgr2=0x7ff2c80f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:36:26.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:26.072+0000 7ff2cdf82640 1 -- 172.21.15.99:0/651137786 shutdown_connections 2024-09-19T06:36:26.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:26.072+0000 7ff2cdf82640 1 -- 172.21.15.99:0/651137786 wait complete. 2024-09-19T06:36:26.681 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":38,"num_osds":6,"num_up_osds":6,"osd_up_since":1726727785,"num_in_osds":6,"osd_in_since":1726727767,"num_remapped_pgs":0} 2024-09-19T06:36:26.682 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T06:36:26.945 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T06:36:26.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:26 smithi099 ceph-mon[27651]: purged_snaps scrub starts 2024-09-19T06:36:26.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:26 smithi099 ceph-mon[27651]: purged_snaps scrub ok 2024-09-19T06:36:26.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:26 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:36:26.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:26 smithi099 ceph-mon[27651]: osd.5 [v2:172.21.15.117:6816/2126888000,v1:172.21.15.117:6817/2126888000] boot 2024-09-19T06:36:26.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:26 smithi099 ceph-mon[27651]: osdmap e38: 6 total, 6 up, 6 in 2024-09-19T06:36:26.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:26 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:36:26.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:26 smithi099 ceph-mon[27651]: from='client.? 172.21.15.99:0/651137786' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T06:36:27.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:26 smithi117 ceph-mon[34564]: purged_snaps scrub starts 2024-09-19T06:36:27.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:26 smithi117 ceph-mon[34564]: purged_snaps scrub ok 2024-09-19T06:36:27.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:26 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:36:27.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:26 smithi117 ceph-mon[34564]: osd.5 [v2:172.21.15.117:6816/2126888000,v1:172.21.15.117:6817/2126888000] boot 2024-09-19T06:36:27.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:26 smithi117 ceph-mon[34564]: osdmap e38: 6 total, 6 up, 6 in 2024-09-19T06:36:27.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:26 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:36:27.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:26 smithi117 ceph-mon[34564]: from='client.? 172.21.15.99:0/651137786' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T06:36:27.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:27 smithi117 ceph-mon[34564]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-19T06:36:27.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:27 smithi117 ceph-mon[34564]: osdmap e39: 6 total, 6 up, 6 in 2024-09-19T06:36:27.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:27 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:36:27.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:27 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:36:27.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:27 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:36:27.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:27 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:36:27.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:27 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:36:27.813 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:27 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:36:27.813 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:27 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:36:27.813 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:27 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:36:27.813 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:27 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:36:27.813 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:27 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:36:27.813 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:27 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:36:27.813 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:27 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:36:27.813 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:27 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:36:27.994 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:27 smithi099 ceph-mon[27651]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-19T06:36:27.994 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:27 smithi099 ceph-mon[27651]: osdmap e39: 6 total, 6 up, 6 in 2024-09-19T06:36:27.994 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:27 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:36:27.994 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:27 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:36:27.994 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:27 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:36:27.994 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:27 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:36:27.994 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:27 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:36:27.995 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:27 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:36:27.995 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:27 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:36:27.995 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:27 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:36:27.995 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:27 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:36:27.995 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:27 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:36:27.995 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:27 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:36:27.995 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:27 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:36:27.995 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:27 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:36:28.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:28.488+0000 7f806f977640 1 -- 172.21.15.99:0/1214254800 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80680fcf80 msgr2=0x7f80680fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:28.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:28.488+0000 7f806f977640 1 --2- 172.21.15.99:0/1214254800 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80680fcf80 0x7f80680fd3d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f80580048d0 tx=0x7f8058009da0 comp rx=0 tx=0).stop 2024-09-19T06:36:28.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:28.488+0000 7f806f977640 1 -- 172.21.15.99:0/1214254800 shutdown_connections 2024-09-19T06:36:28.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:28.488+0000 7f806f977640 1 --2- 172.21.15.99:0/1214254800 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80680fcf80 0x7f80680fd3d0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:28.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:28.488+0000 7f806f977640 1 --2- 172.21.15.99:0/1214254800 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80680fb810 0x7f80680fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:28.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:28.488+0000 7f806f977640 1 -- 172.21.15.99:0/1214254800 >> 172.21.15.99:0/1214254800 conn(0x7f80680723b0 msgr2=0x7f80680727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:36:28.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:28.488+0000 7f806f977640 1 -- 172.21.15.99:0/1214254800 shutdown_connections 2024-09-19T06:36:28.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:28.488+0000 7f806f977640 1 -- 172.21.15.99:0/1214254800 wait complete. 2024-09-19T06:36:28.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:28.489+0000 7f806f977640 1 Processor -- start 2024-09-19T06:36:28.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:28.489+0000 7f806f977640 1 -- start start 2024-09-19T06:36:28.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:28.489+0000 7f806f977640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80680fb810 0x7f80681120d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:28.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:28.489+0000 7f806f977640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80680fcf80 0x7f8068112610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:28.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:28.489+0000 7f806f977640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8068112c10 con 0x7f80680fcf80 2024-09-19T06:36:28.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:28.489+0000 7f806f977640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f806810c050 con 0x7f80680fb810 2024-09-19T06:36:28.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:28.489+0000 7f806cf12640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80680fcf80 0x7f8068112610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:28.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:28.489+0000 7f806cf12640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80680fcf80 0x7f8068112610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42406/0 (socket says 172.21.15.99:42406) 2024-09-19T06:36:28.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:28.489+0000 7f806cf12640 1 -- 172.21.15.99:0/3870605473 learned_addr learned my addr 172.21.15.99:0/3870605473 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:36:28.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:28.489+0000 7f806d713640 1 --2- 172.21.15.99:0/3870605473 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80680fb810 0x7f80681120d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:28.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:28.490+0000 7f806cf12640 1 -- 172.21.15.99:0/3870605473 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80680fb810 msgr2=0x7f80681120d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:28.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:28.490+0000 7f806cf12640 1 --2- 172.21.15.99:0/3870605473 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80680fb810 0x7f80681120d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:28.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:28.490+0000 7f806cf12640 1 -- 172.21.15.99:0/3870605473 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8058005040 con 0x7f80680fcf80 2024-09-19T06:36:28.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:28.490+0000 7f806d713640 1 --2- 172.21.15.99:0/3870605473 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80680fb810 0x7f80681120d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:36:28.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:28.490+0000 7f806cf12640 1 --2- 172.21.15.99:0/3870605473 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80680fcf80 0x7f8068112610 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8058000c00 tx=0x7f8058009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:36:28.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:28.490+0000 7f805dffb640 1 -- 172.21.15.99:0/3870605473 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8058038070 con 0x7f80680fcf80 2024-09-19T06:36:28.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:28.490+0000 7f805dffb640 1 -- 172.21.15.99:0/3870605473 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f805802ade0 con 0x7f80680fcf80 2024-09-19T06:36:28.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:28.490+0000 7f806f977640 1 -- 172.21.15.99:0/3870605473 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f806810c2d0 con 0x7f80680fcf80 2024-09-19T06:36:28.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:28.490+0000 7f805dffb640 1 -- 172.21.15.99:0/3870605473 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f805802c7b0 con 0x7f80680fcf80 2024-09-19T06:36:28.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:28.490+0000 7f806f977640 1 -- 172.21.15.99:0/3870605473 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f806810c810 con 0x7f80680fcf80 2024-09-19T06:36:28.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:28.491+0000 7f806f977640 1 -- 172.21.15.99:0/3870605473 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80680fcbc0 con 0x7f80680fcf80 2024-09-19T06:36:28.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:28.492+0000 7f805dffb640 1 -- 172.21.15.99:0/3870605473 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f8058030020 con 0x7f80680fcf80 2024-09-19T06:36:28.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:28.492+0000 7f805dffb640 1 --2- 172.21.15.99:0/3870605473 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f805406ed60 0x7f8054071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:28.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:28.492+0000 7f805dffb640 1 -- 172.21.15.99:0/3870605473 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f80580ae300 con 0x7f80680fcf80 2024-09-19T06:36:28.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:28.492+0000 7f806d713640 1 --2- 172.21.15.99:0/3870605473 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f805406ed60 0x7f8054071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:28.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:28.492+0000 7f806d713640 1 --2- 172.21.15.99:0/3870605473 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f805406ed60 0x7f8054071210 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f80640049d0 tx=0x7f806400b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:36:28.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:28.496+0000 7f805dffb640 1 -- 172.21.15.99:0/3870605473 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f805807b760 con 0x7f80680fcf80 2024-09-19T06:36:28.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:28.654+0000 7f806f977640 1 -- 172.21.15.99:0/3870605473 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f806810d740 con 0x7f80680fcf80 2024-09-19T06:36:28.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:28.655+0000 7f805dffb640 1 -- 172.21.15.99:0/3870605473 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+11083 (secure 0 0 0) 0x7f805807b100 con 0x7f80680fcf80 2024-09-19T06:36:28.656 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:36:28.656 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":39,"fsid":"a73eb958-7650-11ef-bceb-c7b262605968","created":"2024-09-19T06:31:07.865401+0000","modified":"2024-09-19T06:36:26.713103+0000","last_up_change":"2024-09-19T06:36:25.705325+0000","last_in_change":"2024-09-19T06:36:07.858135+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:35:16.794581+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"161a5999-8f1e-47b7-8539-3fb969206f5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":223723623},{"type":"v1","addr":"172.21.15.99:6803","nonce":223723623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":223723623},{"type":"v1","addr":"172.21.15.99:6805","nonce":223723623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":223723623},{"type":"v1","addr":"172.21.15.99:6809","nonce":223723623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":223723623},{"type":"v1","addr":"172.21.15.99:6807","nonce":223723623}]},"public_addr":"172.21.15.99:6803/223723623","cluster_addr":"172.21.15.99:6805/223723623","heartbeat_back_addr":"172.21.15.99:6809/223723623","heartbeat_front_addr":"172.21.15.99:6807/223723623","state":["exists","up"]},{"osd":1,"uuid":"daad89b4-7ead-4cc7-bf89-ac6d22dba93b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1205097168},{"type":"v1","addr":"172.21.15.99:6811","nonce":1205097168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":1205097168},{"type":"v1","addr":"172.21.15.99:6813","nonce":1205097168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1205097168},{"type":"v1","addr":"172.21.15.99:6817","nonce":1205097168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1205097168},{"type":"v1","addr":"172.21.15.99:6815","nonce":1205097168}]},"public_addr":"172.21.15.99:6811/1205097168","cluster_addr":"172.21.15.99:6813/1205097168","heartbeat_back_addr":"172.21.15.99:6817/1205097168","heartbeat_front_addr":"172.21.15.99:6815/1205097168","state":["exists","up"]},{"osd":2,"uuid":"87dd834e-36dc-48da-8d88-982e9a794e14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1219926965},{"type":"v1","addr":"172.21.15.99:6819","nonce":1219926965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":1219926965},{"type":"v1","addr":"172.21.15.99:6821","nonce":1219926965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":1219926965},{"type":"v1","addr":"172.21.15.99:6825","nonce":1219926965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":1219926965},{"type":"v1","addr":"172.21.15.99:6823","nonce":1219926965}]},"public_addr":"172.21.15.99:6819/1219926965","cluster_addr":"172.21.15.99:6821/1219926965","heartbeat_back_addr":"172.21.15.99:6825/1219926965","heartbeat_front_addr":"172.21.15.99:6823/1219926965","state":["exists","up"]},{"osd":3,"uuid":"e55ff802-be59-4865-924a-46b72ed0f978","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":1478846960},{"type":"v1","addr":"172.21.15.117:6801","nonce":1478846960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":1478846960},{"type":"v1","addr":"172.21.15.117:6803","nonce":1478846960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":1478846960},{"type":"v1","addr":"172.21.15.117:6807","nonce":1478846960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":1478846960},{"type":"v1","addr":"172.21.15.117:6805","nonce":1478846960}]},"public_addr":"172.21.15.117:6801/1478846960","cluster_addr":"172.21.15.117:6803/1478846960","heartbeat_back_addr":"172.21.15.117:6807/1478846960","heartbeat_front_addr":"172.21.15.117:6805/1478846960","state":["exists","up"]},{"osd":4,"uuid":"2652320e-b3aa-4361-81fb-53dfaf76638e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":2126129691},{"type":"v1","addr":"172.21.15.117:6809","nonce":2126129691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2126129691},{"type":"v1","addr":"172.21.15.117:6811","nonce":2126129691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2126129691},{"type":"v1","addr":"172.21.15.117:6815","nonce":2126129691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":2126129691},{"type":"v1","addr":"172.21.15.117:6813","nonce":2126129691}]},"public_addr":"172.21.15.117:6809/2126129691","cluster_addr":"172.21.15.117:6811/2126129691","heartbeat_back_addr":"172.21.15.117:6815/2126129691","heartbeat_front_addr":"172.21.15.117:6813/2126129691","state":["exists","up"]},{"osd":5,"uuid":"2f82c5e1-1d76-42c2-bbeb-3a94e672d4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2126888000},{"type":"v1","addr":"172.21.15.117:6817","nonce":2126888000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2126888000},{"type":"v1","addr":"172.21.15.117:6819","nonce":2126888000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2126888000},{"type":"v1","addr":"172.21.15.117:6823","nonce":2126888000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2126888000},{"type":"v1","addr":"172.21.15.117:6821","nonce":2126888000}]},"public_addr":"172.21.15.117:6817/2126888000","cluster_addr":"172.21.15.117:6819/2126888000","heartbeat_back_addr":"172.21.15.117:6823/2126888000","heartbeat_front_addr":"172.21.15.117:6821/2126888000","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:34:19.431244+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:34:45.757937+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:35:12.931408+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:35:34.718746+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:35:59.471231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:24.384004+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.99:0/294185414":"2024-09-20T06:33:04.480906+0000","172.21.15.99:6801/2333024932":"2024-09-20T06:33:04.480906+0000","172.21.15.99:0/1304237604":"2024-09-20T06:31:28.226981+0000","172.21.15.99:0/1060821876":"2024-09-20T06:33:04.480906+0000","172.21.15.99:0/2540279353":"2024-09-20T06:31:28.226981+0000","172.21.15.99:6801/3677321821":"2024-09-20T06:31:28.226981+0000","172.21.15.99:0/354724072":"2024-09-20T06:31:28.226981+0000","172.21.15.99:6800/3738534523":"2024-09-20T06:32:05.259470+0000","172.21.15.99:0/1529455887":"2024-09-20T06:32:05.259470+0000","172.21.15.99:6801/3738534523":"2024-09-20T06:32:05.259470+0000","172.21.15.99:0/3847616959":"2024-09-20T06:32:05.259470+0000","172.21.15.99:0/1023918254":"2024-09-20T06:32:05.259470+0000","172.21.15.99:0/1213923731":"2024-09-20T06:33:04.480906+0000","172.21.15.99:6800/3677321821":"2024-09-20T06:31:28.226981+0000","172.21.15.99:6800/2333024932":"2024-09-20T06:33:04.480906+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:36:28.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:28.656+0000 7f806f977640 1 -- 172.21.15.99:0/3870605473 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f805406ed60 msgr2=0x7f8054071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:28.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:28.656+0000 7f806f977640 1 --2- 172.21.15.99:0/3870605473 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f805406ed60 0x7f8054071210 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f80640049d0 tx=0x7f806400b040 comp rx=0 tx=0).stop 2024-09-19T06:36:28.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:28.656+0000 7f806f977640 1 -- 172.21.15.99:0/3870605473 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80680fcf80 msgr2=0x7f8068112610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:28.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:28.656+0000 7f806f977640 1 --2- 172.21.15.99:0/3870605473 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80680fcf80 0x7f8068112610 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8058000c00 tx=0x7f8058009da0 comp rx=0 tx=0).stop 2024-09-19T06:36:28.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:28.656+0000 7f806f977640 1 -- 172.21.15.99:0/3870605473 shutdown_connections 2024-09-19T06:36:28.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:28.656+0000 7f806f977640 1 --2- 172.21.15.99:0/3870605473 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f805406ed60 0x7f8054071210 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:28.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:28.656+0000 7f806f977640 1 --2- 172.21.15.99:0/3870605473 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f80680fcf80 0x7f8068112610 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:28.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:28.656+0000 7f806f977640 1 --2- 172.21.15.99:0/3870605473 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80680fb810 0x7f80681120d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:28.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:28.656+0000 7f806f977640 1 -- 172.21.15.99:0/3870605473 >> 172.21.15.99:0/3870605473 conn(0x7f80680723b0 msgr2=0x7f80680fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:36:28.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:28.657+0000 7f806f977640 1 -- 172.21.15.99:0/3870605473 shutdown_connections 2024-09-19T06:36:28.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:28.657+0000 7f806f977640 1 -- 172.21.15.99:0/3870605473 wait complete. 2024-09-19T06:36:28.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:28 smithi099 ceph-mon[27651]: Detected new or changed devices on smithi117 2024-09-19T06:36:28.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:28 smithi099 ceph-mon[27651]: Adjusting osd_memory_target on smithi117 to 5312M 2024-09-19T06:36:28.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:28 smithi099 ceph-mon[27651]: from='client.? 172.21.15.99:0/3870605473' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:36:29.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:28 smithi117 ceph-mon[34564]: Detected new or changed devices on smithi117 2024-09-19T06:36:29.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:28 smithi117 ceph-mon[34564]: Adjusting osd_memory_target on smithi117 to 5312M 2024-09-19T06:36:29.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:28 smithi117 ceph-mon[34564]: from='client.? 172.21.15.99:0/3870605473' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:36:29.264 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T06:35:16.794581+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-09-19T06:36:29.264 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-19T06:36:29.509 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T06:36:29.943 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:29 smithi099 ceph-mon[27651]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:36:30.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:29 smithi117 ceph-mon[34564]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:36:31.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:31.159+0000 7f5cfaf97640 1 -- 172.21.15.99:0/3751305691 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5cf40fac80 msgr2=0x7f5cf40fb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:31.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:31.159+0000 7f5cfaf97640 1 --2- 172.21.15.99:0/3751305691 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5cf40fac80 0x7f5cf40fb0f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5ce40048d0 tx=0x7f5ce4009da0 comp rx=0 tx=0).stop 2024-09-19T06:36:31.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:31.159+0000 7f5cfaf97640 1 -- 172.21.15.99:0/3751305691 shutdown_connections 2024-09-19T06:36:31.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:31.159+0000 7f5cfaf97640 1 --2- 172.21.15.99:0/3751305691 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5cf40fac80 0x7f5cf40fb0f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:31.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:31.159+0000 7f5cfaf97640 1 --2- 172.21.15.99:0/3751305691 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5cf4102620 0x7f5cf41029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:31.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:31.159+0000 7f5cfaf97640 1 -- 172.21.15.99:0/3751305691 >> 172.21.15.99:0/3751305691 conn(0x7f5cf4070ce0 msgr2=0x7f5cf40710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:36:31.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:31.159+0000 7f5cfaf97640 1 -- 172.21.15.99:0/3751305691 shutdown_connections 2024-09-19T06:36:31.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:31.159+0000 7f5cfaf97640 1 -- 172.21.15.99:0/3751305691 wait complete. 2024-09-19T06:36:31.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:31.160+0000 7f5cfaf97640 1 Processor -- start 2024-09-19T06:36:31.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:31.160+0000 7f5cfaf97640 1 -- start start 2024-09-19T06:36:31.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:31.160+0000 7f5cfaf97640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5cf40fac80 0x7f5cf41131e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:31.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:31.160+0000 7f5cfaf97640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5cf4102620 0x7f5cf4113720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:31.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:31.160+0000 7f5cfaf97640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf4113d20 con 0x7f5cf40fac80 2024-09-19T06:36:31.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:31.160+0000 7f5cfaf97640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf410d160 con 0x7f5cf4102620 2024-09-19T06:36:31.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:31.160+0000 7f5cf8d33640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5cf40fac80 0x7f5cf41131e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:31.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:31.160+0000 7f5cf8d33640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5cf40fac80 0x7f5cf41131e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42420/0 (socket says 172.21.15.99:42420) 2024-09-19T06:36:31.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:31.160+0000 7f5cf8d33640 1 -- 172.21.15.99:0/596346483 learned_addr learned my addr 172.21.15.99:0/596346483 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:36:31.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:31.161+0000 7f5cebfff640 1 --2- 172.21.15.99:0/596346483 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5cf4102620 0x7f5cf4113720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:31.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:31.161+0000 7f5cf8d33640 1 -- 172.21.15.99:0/596346483 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5cf4102620 msgr2=0x7f5cf4113720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:31.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:31.161+0000 7f5cf8d33640 1 --2- 172.21.15.99:0/596346483 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5cf4102620 0x7f5cf4113720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:31.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:31.161+0000 7f5cf8d33640 1 -- 172.21.15.99:0/596346483 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ce4005040 con 0x7f5cf40fac80 2024-09-19T06:36:31.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:31.161+0000 7f5cebfff640 1 --2- 172.21.15.99:0/596346483 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5cf4102620 0x7f5cf4113720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:36:31.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:31.161+0000 7f5cf8d33640 1 --2- 172.21.15.99:0/596346483 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5cf40fac80 0x7f5cf41131e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5cf000c790 tx=0x7f5cf00043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:36:31.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:31.161+0000 7f5ce97fa640 1 -- 172.21.15.99:0/596346483 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5cf000a820 con 0x7f5cf40fac80 2024-09-19T06:36:31.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:31.161+0000 7f5ce97fa640 1 -- 172.21.15.99:0/596346483 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5cf000ae20 con 0x7f5cf40fac80 2024-09-19T06:36:31.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:31.161+0000 7f5cfaf97640 1 -- 172.21.15.99:0/596346483 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cf410d440 con 0x7f5cf40fac80 2024-09-19T06:36:31.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:31.161+0000 7f5ce97fa640 1 -- 172.21.15.99:0/596346483 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5cf00113a0 con 0x7f5cf40fac80 2024-09-19T06:36:31.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:31.161+0000 7f5cfaf97640 1 -- 172.21.15.99:0/596346483 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cf410d9b0 con 0x7f5cf40fac80 2024-09-19T06:36:31.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:31.162+0000 7f5cfaf97640 1 -- 172.21.15.99:0/596346483 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cf40657b0 con 0x7f5cf40fac80 2024-09-19T06:36:31.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:31.163+0000 7f5ce97fa640 1 -- 172.21.15.99:0/596346483 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f5cf0012400 con 0x7f5cf40fac80 2024-09-19T06:36:31.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:31.163+0000 7f5ce97fa640 1 --2- 172.21.15.99:0/596346483 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f5cdc06ed60 0x7f5cdc071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:31.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:31.163+0000 7f5ce97fa640 1 -- 172.21.15.99:0/596346483 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f5cf008deb0 con 0x7f5cf40fac80 2024-09-19T06:36:31.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:31.163+0000 7f5cebfff640 1 --2- 172.21.15.99:0/596346483 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f5cdc06ed60 0x7f5cdc071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:31.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:31.164+0000 7f5cebfff640 1 --2- 172.21.15.99:0/596346483 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f5cdc06ed60 0x7f5cdc071210 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5cf40f8f90 tx=0x7f5ce4035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:36:31.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:31.167+0000 7f5ce97fa640 1 -- 172.21.15.99:0/596346483 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f5cf005b430 con 0x7f5cf40fac80 2024-09-19T06:36:31.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:31.323+0000 7f5cfaf97640 1 -- 172.21.15.99:0/596346483 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5cf404b720 con 0x7f5cf40fac80 2024-09-19T06:36:31.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:31.323+0000 7f5ce97fa640 1 -- 172.21.15.99:0/596346483 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5cf000a980 con 0x7f5cf40fac80 2024-09-19T06:36:31.325 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-09-19T06:36:31.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:31.325+0000 7f5cfaf97640 1 -- 172.21.15.99:0/596346483 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f5cdc06ed60 msgr2=0x7f5cdc071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:31.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:31.325+0000 7f5cfaf97640 1 --2- 172.21.15.99:0/596346483 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f5cdc06ed60 0x7f5cdc071210 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5cf40f8f90 tx=0x7f5ce4035040 comp rx=0 tx=0).stop 2024-09-19T06:36:31.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:31.325+0000 7f5cfaf97640 1 -- 172.21.15.99:0/596346483 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5cf40fac80 msgr2=0x7f5cf41131e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:31.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:31.325+0000 7f5cfaf97640 1 --2- 172.21.15.99:0/596346483 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5cf40fac80 0x7f5cf41131e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5cf000c790 tx=0x7f5cf00043c0 comp rx=0 tx=0).stop 2024-09-19T06:36:31.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:31.325+0000 7f5cfaf97640 1 -- 172.21.15.99:0/596346483 shutdown_connections 2024-09-19T06:36:31.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:31.325+0000 7f5cfaf97640 1 --2- 172.21.15.99:0/596346483 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f5cdc06ed60 0x7f5cdc071210 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:31.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:31.326+0000 7f5cfaf97640 1 --2- 172.21.15.99:0/596346483 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5cf4102620 0x7f5cf4113720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:31.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:31.326+0000 7f5cfaf97640 1 --2- 172.21.15.99:0/596346483 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5cf40fac80 0x7f5cf41131e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:31.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:31.326+0000 7f5cfaf97640 1 -- 172.21.15.99:0/596346483 >> 172.21.15.99:0/596346483 conn(0x7f5cf4070ce0 msgr2=0x7f5cf4105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:36:31.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:31.326+0000 7f5cfaf97640 1 -- 172.21.15.99:0/596346483 shutdown_connections 2024-09-19T06:36:31.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:31.326+0000 7f5cfaf97640 1 -- 172.21.15.99:0/596346483 wait complete. 2024-09-19T06:36:31.895 INFO:tasks.cephadm:Setting up client nodes... 2024-09-19T06:36:31.895 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-19T06:36:31.917 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:31 smithi099 ceph-mon[27651]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:36:31.917 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:31 smithi099 ceph-mon[27651]: from='client.? 172.21.15.99:0/596346483' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T06:36:32.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:31 smithi117 ceph-mon[34564]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:36:32.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:31 smithi117 ceph-mon[34564]: from='client.? 172.21.15.99:0/596346483' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T06:36:32.135 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T06:36:33.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:33.814+0000 7f3df9026640 1 -- 172.21.15.99:0/3048021291 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3df40fc550 msgr2=0x7f3df40fc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:33.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:33.814+0000 7f3df9026640 1 --2- 172.21.15.99:0/3048021291 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3df40fc550 0x7f3df40fc960 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3de40048d0 tx=0x7f3de4009da0 comp rx=0 tx=0).stop 2024-09-19T06:36:33.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:33.814+0000 7f3df9026640 1 -- 172.21.15.99:0/3048021291 shutdown_connections 2024-09-19T06:36:33.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:33.814+0000 7f3df9026640 1 --2- 172.21.15.99:0/3048021291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3df40fd820 0x7f3df40fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:33.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:33.814+0000 7f3df9026640 1 --2- 172.21.15.99:0/3048021291 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3df40fc550 0x7f3df40fc960 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:33.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:33.814+0000 7f3df9026640 1 -- 172.21.15.99:0/3048021291 >> 172.21.15.99:0/3048021291 conn(0x7f3df40f7d10 msgr2=0x7f3df40fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:36:33.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:33.814+0000 7f3df9026640 1 -- 172.21.15.99:0/3048021291 shutdown_connections 2024-09-19T06:36:33.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:33.814+0000 7f3df9026640 1 -- 172.21.15.99:0/3048021291 wait complete. 2024-09-19T06:36:33.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:33.815+0000 7f3df9026640 1 Processor -- start 2024-09-19T06:36:33.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:33.815+0000 7f3df9026640 1 -- start start 2024-09-19T06:36:33.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:33.815+0000 7f3df9026640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3df40fc550 0x7f3df410d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:33.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:33.815+0000 7f3df9026640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3df40fd820 0x7f3df410d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:33.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:33.815+0000 7f3df9026640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df410dc10 con 0x7f3df40fc550 2024-09-19T06:36:33.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:33.815+0000 7f3df9026640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df410e430 con 0x7f3df40fd820 2024-09-19T06:36:33.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:33.815+0000 7f3df2d9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3df40fc550 0x7f3df410d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:33.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:33.815+0000 7f3df2d9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3df40fc550 0x7f3df410d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42438/0 (socket says 172.21.15.99:42438) 2024-09-19T06:36:33.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:33.815+0000 7f3df2d9d640 1 -- 172.21.15.99:0/2335008180 learned_addr learned my addr 172.21.15.99:0/2335008180 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:36:33.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:33.815+0000 7f3df259c640 1 --2- 172.21.15.99:0/2335008180 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3df40fd820 0x7f3df410d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:33.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:33.816+0000 7f3df2d9d640 1 -- 172.21.15.99:0/2335008180 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3df40fd820 msgr2=0x7f3df410d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:33.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:33.816+0000 7f3df2d9d640 1 --2- 172.21.15.99:0/2335008180 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3df40fd820 0x7f3df410d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:33.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:33.816+0000 7f3df2d9d640 1 -- 172.21.15.99:0/2335008180 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de4005040 con 0x7f3df40fc550 2024-09-19T06:36:33.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:33.816+0000 7f3df2d9d640 1 --2- 172.21.15.99:0/2335008180 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3df40fc550 0x7f3df410d080 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3de40043d0 tx=0x7f3de4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:36:33.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:33.816+0000 7f3ddb7fe640 1 -- 172.21.15.99:0/2335008180 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3de4038070 con 0x7f3df40fc550 2024-09-19T06:36:33.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:33.816+0000 7f3df9026640 1 -- 172.21.15.99:0/2335008180 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3df410e660 con 0x7f3df40fc550 2024-09-19T06:36:33.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:33.816+0000 7f3ddb7fe640 1 -- 172.21.15.99:0/2335008180 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3de402ae90 con 0x7f3df40fc550 2024-09-19T06:36:33.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:33.816+0000 7f3ddb7fe640 1 -- 172.21.15.99:0/2335008180 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3de403e670 con 0x7f3df40fc550 2024-09-19T06:36:33.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:33.816+0000 7f3df9026640 1 -- 172.21.15.99:0/2335008180 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3df410ec00 con 0x7f3df40fc550 2024-09-19T06:36:33.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:33.817+0000 7f3df9026640 1 -- 172.21.15.99:0/2335008180 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3df40fb9b0 con 0x7f3df40fc550 2024-09-19T06:36:33.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:33.818+0000 7f3ddb7fe640 1 -- 172.21.15.99:0/2335008180 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f3de4030020 con 0x7f3df40fc550 2024-09-19T06:36:33.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:33.818+0000 7f3ddb7fe640 1 --2- 172.21.15.99:0/2335008180 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f3ddc06ed60 0x7f3ddc071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:33.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:33.818+0000 7f3ddb7fe640 1 -- 172.21.15.99:0/2335008180 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f3de40ae040 con 0x7f3df40fc550 2024-09-19T06:36:33.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:33.818+0000 7f3df259c640 1 --2- 172.21.15.99:0/2335008180 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f3ddc06ed60 0x7f3ddc071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:33.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:33.818+0000 7f3df259c640 1 --2- 172.21.15.99:0/2335008180 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f3ddc06ed60 0x7f3ddc071210 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3df410ce30 tx=0x7f3de800b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:36:33.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:33.822+0000 7f3ddb7fe640 1 -- 172.21.15.99:0/2335008180 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f3de407b550 con 0x7f3df40fc550 2024-09-19T06:36:33.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:33 smithi099 ceph-mon[27651]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:36:34.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:34.039+0000 7f3df9026640 1 -- 172.21.15.99:0/2335008180 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f3df404b720 con 0x7f3df40fc550 2024-09-19T06:36:34.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:34.043+0000 7f3ddb7fe640 1 -- 172.21.15.99:0/2335008180 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v14) v1 ==== 170+0+59 (secure 0 0 0) 0x7f3de407aef0 con 0x7f3df40fc550 2024-09-19T06:36:34.045 INFO:teuthology.orchestra.run.smithi099.stdout:[client.0] 2024-09-19T06:36:34.045 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQByxutmy311AhAAOQAhKJQcILwuo5GUO8h5aw== 2024-09-19T06:36:34.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:34.045+0000 7f3df9026640 1 -- 172.21.15.99:0/2335008180 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f3ddc06ed60 msgr2=0x7f3ddc071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:34.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:34.045+0000 7f3df9026640 1 --2- 172.21.15.99:0/2335008180 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f3ddc06ed60 0x7f3ddc071210 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3df410ce30 tx=0x7f3de800b040 comp rx=0 tx=0).stop 2024-09-19T06:36:34.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:34.045+0000 7f3df9026640 1 -- 172.21.15.99:0/2335008180 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3df40fc550 msgr2=0x7f3df410d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:34.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:34.045+0000 7f3df9026640 1 --2- 172.21.15.99:0/2335008180 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3df40fc550 0x7f3df410d080 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3de40043d0 tx=0x7f3de4009da0 comp rx=0 tx=0).stop 2024-09-19T06:36:34.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:34.045+0000 7f3df9026640 1 -- 172.21.15.99:0/2335008180 shutdown_connections 2024-09-19T06:36:34.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:34.045+0000 7f3df9026640 1 --2- 172.21.15.99:0/2335008180 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f3ddc06ed60 0x7f3ddc071210 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:34.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:34.045+0000 7f3df9026640 1 --2- 172.21.15.99:0/2335008180 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3df40fd820 0x7f3df410d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:34.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:34.045+0000 7f3df9026640 1 --2- 172.21.15.99:0/2335008180 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3df40fc550 0x7f3df410d080 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:34.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:34.045+0000 7f3df9026640 1 -- 172.21.15.99:0/2335008180 >> 172.21.15.99:0/2335008180 conn(0x7f3df40f7d10 msgr2=0x7f3df40f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:36:34.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:34.045+0000 7f3df9026640 1 -- 172.21.15.99:0/2335008180 shutdown_connections 2024-09-19T06:36:34.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:34.045+0000 7f3df9026640 1 -- 172.21.15.99:0/2335008180 wait complete. 2024-09-19T06:36:34.064 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:33 smithi117 ceph-mon[34564]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:36:34.677 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-19T06:36:34.677 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-19T06:36:34.677 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-19T06:36:34.755 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-19T06:36:34.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:34 smithi099 ceph-mon[27651]: from='client.? 172.21.15.99:0/2335008180' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T06:36:34.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:34 smithi099 ceph-mon[27651]: from='client.? 172.21.15.99:0/2335008180' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T06:36:34.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:34 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:36:35.012 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi117/config 2024-09-19T06:36:35.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:34 smithi117 ceph-mon[34564]: from='client.? 172.21.15.99:0/2335008180' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T06:36:35.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:34 smithi117 ceph-mon[34564]: from='client.? 172.21.15.99:0/2335008180' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T06:36:35.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:34 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:36:36.262 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:36 smithi117 ceph-mon[34564]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:36:36.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:36 smithi099 ceph-mon[27651]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:36:36.473 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:36.472+0000 7ffaf68c2640 1 -- 172.21.15.117:0/2105954350 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffaf00fb430 msgr2=0x7ffaf00fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:36.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:36.472+0000 7ffaf68c2640 1 --2- 172.21.15.117:0/2105954350 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffaf00fb430 0x7ffaf00fb840 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ffae00048d0 tx=0x7ffae0009da0 comp rx=0 tx=0).stop 2024-09-19T06:36:36.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:36.472+0000 7ffaf68c2640 1 -- 172.21.15.117:0/2105954350 shutdown_connections 2024-09-19T06:36:36.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:36.472+0000 7ffaf68c2640 1 --2- 172.21.15.117:0/2105954350 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffaf00fc700 0x7ffaf00fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:36.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:36.472+0000 7ffaf68c2640 1 --2- 172.21.15.117:0/2105954350 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffaf00fb430 0x7ffaf00fb840 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:36.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:36.472+0000 7ffaf68c2640 1 -- 172.21.15.117:0/2105954350 >> 172.21.15.117:0/2105954350 conn(0x7ffaf00f6bf0 msgr2=0x7ffaf00f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:36:36.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:36.472+0000 7ffaf68c2640 1 -- 172.21.15.117:0/2105954350 shutdown_connections 2024-09-19T06:36:36.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:36.472+0000 7ffaf68c2640 1 -- 172.21.15.117:0/2105954350 wait complete. 2024-09-19T06:36:36.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:36.472+0000 7ffaf68c2640 1 Processor -- start 2024-09-19T06:36:36.474 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:36.473+0000 7ffaf68c2640 1 -- start start 2024-09-19T06:36:36.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:36.473+0000 7ffaf68c2640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffaf00fb430 0x7ffaf010d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:36.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:36.473+0000 7ffaf68c2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffaf00fc700 0x7ffaf010d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:36.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:36.473+0000 7ffaf68c2640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf010dbc0 con 0x7ffaf00fb430 2024-09-19T06:36:36.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:36.473+0000 7ffaf68c2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf010e3e0 con 0x7ffaf00fc700 2024-09-19T06:36:36.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:36.473+0000 7ffaef7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffaf00fc700 0x7ffaf010d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:36.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:36.473+0000 7ffaef7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffaf00fc700 0x7ffaf010d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:56206/0 (socket says 172.21.15.117:56206) 2024-09-19T06:36:36.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:36.473+0000 7ffaef7fe640 1 -- 172.21.15.117:0/4065113116 learned_addr learned my addr 172.21.15.117:0/4065113116 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-19T06:36:36.476 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:36.473+0000 7ffaeffff640 1 --2- 172.21.15.117:0/4065113116 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffaf00fb430 0x7ffaf010d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:36.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:36.473+0000 7ffaef7fe640 1 -- 172.21.15.117:0/4065113116 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffaf00fb430 msgr2=0x7ffaf010d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:36.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:36.473+0000 7ffaef7fe640 1 --2- 172.21.15.117:0/4065113116 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffaf00fb430 0x7ffaf010d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:36.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:36.473+0000 7ffaef7fe640 1 -- 172.21.15.117:0/4065113116 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffae0005040 con 0x7ffaf00fc700 2024-09-19T06:36:36.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:36.473+0000 7ffaef7fe640 1 --2- 172.21.15.117:0/4065113116 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffaf00fc700 0x7ffaf010d570 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ffae4002a50 tx=0x7ffae4004600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:36:36.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:36.474+0000 7ffaecff9640 1 -- 172.21.15.117:0/4065113116 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffae4007c30 con 0x7ffaf00fc700 2024-09-19T06:36:36.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:36.474+0000 7ffaecff9640 1 -- 172.21.15.117:0/4065113116 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ffae400f040 con 0x7ffaf00fc700 2024-09-19T06:36:36.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:36.474+0000 7ffaecff9640 1 -- 172.21.15.117:0/4065113116 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffae400dad0 con 0x7ffaf00fc700 2024-09-19T06:36:36.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:36.474+0000 7ffaf68c2640 1 -- 172.21.15.117:0/4065113116 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaf010e670 con 0x7ffaf00fc700 2024-09-19T06:36:36.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:36.474+0000 7ffaf68c2640 1 -- 172.21.15.117:0/4065113116 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaf010ec10 con 0x7ffaf00fc700 2024-09-19T06:36:36.477 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:36.475+0000 7ffaf68c2640 1 -- 172.21.15.117:0/4065113116 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaf00fa890 con 0x7ffaf00fc700 2024-09-19T06:36:36.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:36.475+0000 7ffaecff9640 1 -- 172.21.15.117:0/4065113116 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7ffae400dc30 con 0x7ffaf00fc700 2024-09-19T06:36:36.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:36.475+0000 7ffaecff9640 1 --2- 172.21.15.117:0/4065113116 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7ffad806ed60 0x7ffad8071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:36.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:36.476+0000 7ffaecff9640 1 -- 172.21.15.117:0/4065113116 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7ffae408dbc0 con 0x7ffaf00fc700 2024-09-19T06:36:36.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:36.476+0000 7ffaeffff640 1 --2- 172.21.15.117:0/4065113116 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7ffad806ed60 0x7ffad8071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:36.478 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:36.476+0000 7ffaeffff640 1 --2- 172.21.15.117:0/4065113116 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7ffad806ed60 0x7ffad8071210 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ffae000b020 tx=0x7ffae0035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:36:36.481 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:36.480+0000 7ffaecff9640 1 -- 172.21.15.117:0/4065113116 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ffae405b0a0 con 0x7ffaf00fc700 2024-09-19T06:36:36.697 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:36.696+0000 7ffaf68c2640 1 -- 172.21.15.117:0/4065113116 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7ffaf0103f70 con 0x7ffaf00fc700 2024-09-19T06:36:36.702 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:36.701+0000 7ffaecff9640 1 -- 172.21.15.117:0/4065113116 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v15) v1 ==== 170+0+59 (secure 0 0 0) 0x7ffae405aa40 con 0x7ffaf00fc700 2024-09-19T06:36:36.702 INFO:teuthology.orchestra.run.smithi117.stdout:[client.1] 2024-09-19T06:36:36.703 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQB0xutmJmWbKRAA2w6jlnZSsSCsAHbwtn/g7g== 2024-09-19T06:36:36.705 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:36.703+0000 7ffaf68c2640 1 -- 172.21.15.117:0/4065113116 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7ffad806ed60 msgr2=0x7ffad8071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:36.705 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:36.703+0000 7ffaf68c2640 1 --2- 172.21.15.117:0/4065113116 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7ffad806ed60 0x7ffad8071210 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ffae000b020 tx=0x7ffae0035040 comp rx=0 tx=0).stop 2024-09-19T06:36:36.705 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:36.703+0000 7ffaf68c2640 1 -- 172.21.15.117:0/4065113116 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffaf00fc700 msgr2=0x7ffaf010d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:36.705 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:36.703+0000 7ffaf68c2640 1 --2- 172.21.15.117:0/4065113116 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffaf00fc700 0x7ffaf010d570 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ffae4002a50 tx=0x7ffae4004600 comp rx=0 tx=0).stop 2024-09-19T06:36:36.705 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:36.703+0000 7ffaf68c2640 1 -- 172.21.15.117:0/4065113116 shutdown_connections 2024-09-19T06:36:36.706 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:36.703+0000 7ffaf68c2640 1 --2- 172.21.15.117:0/4065113116 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7ffad806ed60 0x7ffad8071210 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:36.706 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:36.703+0000 7ffaf68c2640 1 --2- 172.21.15.117:0/4065113116 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffaf00fc700 0x7ffaf010d570 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:36.706 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:36.703+0000 7ffaf68c2640 1 --2- 172.21.15.117:0/4065113116 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffaf00fb430 0x7ffaf010d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:36.706 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:36.703+0000 7ffaf68c2640 1 -- 172.21.15.117:0/4065113116 >> 172.21.15.117:0/4065113116 conn(0x7ffaf00f6bf0 msgr2=0x7ffaf0065680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:36:36.706 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:36.703+0000 7ffaf68c2640 1 -- 172.21.15.117:0/4065113116 shutdown_connections 2024-09-19T06:36:36.706 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:36:36.703+0000 7ffaf68c2640 1 -- 172.21.15.117:0/4065113116 wait complete. 2024-09-19T06:36:37.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:37 smithi117 ceph-mon[34564]: from='client.? 172.21.15.117:0/4065113116' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T06:36:37.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:37 smithi117 ceph-mon[34564]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T06:36:37.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:37 smithi117 ceph-mon[34564]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T06:36:37.341 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-19T06:36:37.341 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-09-19T06:36:37.341 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-19T06:36:37.380 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-19T06:36:37.380 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-19T06:36:37.380 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-19T06:36:37.406 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:37 smithi099 ceph-mon[27651]: from='client.? 172.21.15.117:0/4065113116' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T06:36:37.406 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:37 smithi099 ceph-mon[27651]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T06:36:37.406 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:37 smithi099 ceph-mon[27651]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T06:36:37.644 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T06:36:38.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:38 smithi117 ceph-mon[34564]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:36:38.426 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:38 smithi099 ceph-mon[27651]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:36:39.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:39.271+0000 7f16216d4640 1 -- 172.21.15.99:0/1803416265 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f161c102550 msgr2=0x7f161c102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:39.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:39.271+0000 7f16216d4640 1 --2- 172.21.15.99:0/1803416265 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f161c102550 0x7f161c102920 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f160c0048d0 tx=0x7f160c009da0 comp rx=0 tx=0).stop 2024-09-19T06:36:39.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:39.271+0000 7f16216d4640 1 -- 172.21.15.99:0/1803416265 shutdown_connections 2024-09-19T06:36:39.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:39.271+0000 7f16216d4640 1 --2- 172.21.15.99:0/1803416265 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f161c102ef0 0x7f161c0fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:39.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:39.271+0000 7f16216d4640 1 --2- 172.21.15.99:0/1803416265 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f161c102550 0x7f161c102920 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:39.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:39.271+0000 7f16216d4640 1 -- 172.21.15.99:0/1803416265 >> 172.21.15.99:0/1803416265 conn(0x7f161c0f80f0 msgr2=0x7f161c0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:36:39.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:39.271+0000 7f16216d4640 1 -- 172.21.15.99:0/1803416265 shutdown_connections 2024-09-19T06:36:39.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:39.271+0000 7f16216d4640 1 -- 172.21.15.99:0/1803416265 wait complete. 2024-09-19T06:36:39.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:39.272+0000 7f16216d4640 1 Processor -- start 2024-09-19T06:36:39.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:39.272+0000 7f16216d4640 1 -- start start 2024-09-19T06:36:39.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:39.272+0000 7f16216d4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f161c102550 0x7f161c113540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:39.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:39.272+0000 7f16216d4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f161c102ef0 0x7f161c113a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:39.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:39.272+0000 7f16216d4640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f161c1140d0 con 0x7f161c102550 2024-09-19T06:36:39.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:39.272+0000 7f16216d4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f161c10d4e0 con 0x7f161c102ef0 2024-09-19T06:36:39.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:39.272+0000 7f161affd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f161c102550 0x7f161c113540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:39.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:39.272+0000 7f161affd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f161c102550 0x7f161c113540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38896/0 (socket says 172.21.15.99:38896) 2024-09-19T06:36:39.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:39.272+0000 7f161affd640 1 -- 172.21.15.99:0/3651307306 learned_addr learned my addr 172.21.15.99:0/3651307306 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:36:39.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:39.272+0000 7f161a7fc640 1 --2- 172.21.15.99:0/3651307306 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f161c102ef0 0x7f161c113a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:39.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:39.272+0000 7f161affd640 1 -- 172.21.15.99:0/3651307306 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f161c102ef0 msgr2=0x7f161c113a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:39.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:39.272+0000 7f161affd640 1 --2- 172.21.15.99:0/3651307306 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f161c102ef0 0x7f161c113a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:39.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:39.272+0000 7f161affd640 1 -- 172.21.15.99:0/3651307306 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f160c005040 con 0x7f161c102550 2024-09-19T06:36:39.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:39.272+0000 7f161affd640 1 --2- 172.21.15.99:0/3651307306 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f161c102550 0x7f161c113540 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f160c003080 tx=0x7f160c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:36:39.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:39.273+0000 7f16037fe640 1 -- 172.21.15.99:0/3651307306 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f160c038070 con 0x7f161c102550 2024-09-19T06:36:39.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:39.273+0000 7f16037fe640 1 -- 172.21.15.99:0/3651307306 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f160c0097e0 con 0x7f161c102550 2024-09-19T06:36:39.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:39.273+0000 7f16216d4640 1 -- 172.21.15.99:0/3651307306 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f161c10d760 con 0x7f161c102550 2024-09-19T06:36:39.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:39.273+0000 7f16037fe640 1 -- 172.21.15.99:0/3651307306 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f160c03d420 con 0x7f161c102550 2024-09-19T06:36:39.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:39.273+0000 7f16216d4640 1 -- 172.21.15.99:0/3651307306 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f161c10dca0 con 0x7f161c102550 2024-09-19T06:36:39.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:39.274+0000 7f16216d4640 1 -- 172.21.15.99:0/3651307306 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f161c0fdcd0 con 0x7f161c102550 2024-09-19T06:36:39.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:39.274+0000 7f16037fe640 1 -- 172.21.15.99:0/3651307306 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f160c030020 con 0x7f161c102550 2024-09-19T06:36:39.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:39.275+0000 7f16037fe640 1 --2- 172.21.15.99:0/3651307306 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f160406ed60 0x7f1604071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:39.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:39.275+0000 7f161a7fc640 1 --2- 172.21.15.99:0/3651307306 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f160406ed60 0x7f1604071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:39.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:39.275+0000 7f16037fe640 1 -- 172.21.15.99:0/3651307306 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f160c0ae470 con 0x7f161c102550 2024-09-19T06:36:39.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:39.275+0000 7f161a7fc640 1 --2- 172.21.15.99:0/3651307306 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f160406ed60 0x7f1604071210 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f161c10e7c0 tx=0x7f1610009040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:36:39.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:39.279+0000 7f16037fe640 1 -- 172.21.15.99:0/3651307306 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f160c07b8d0 con 0x7f161c102550 2024-09-19T06:36:39.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:39.471+0000 7f16216d4640 1 -- 172.21.15.99:0/3651307306 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f161c04b720 con 0x7f161c102550 2024-09-19T06:36:39.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:39.474+0000 7f16037fe640 1 -- 172.21.15.99:0/3651307306 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+176710 (secure 0 0 0) 0x7f160c07b270 con 0x7f161c102550 2024-09-19T06:36:39.478 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:36:39.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:39.477+0000 7f16216d4640 1 -- 172.21.15.99:0/3651307306 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f160406ed60 msgr2=0x7f1604071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:39.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:39.477+0000 7f16216d4640 1 --2- 172.21.15.99:0/3651307306 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f160406ed60 0x7f1604071210 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f161c10e7c0 tx=0x7f1610009040 comp rx=0 tx=0).stop 2024-09-19T06:36:39.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:39.477+0000 7f16216d4640 1 -- 172.21.15.99:0/3651307306 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f161c102550 msgr2=0x7f161c113540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:39.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:39.477+0000 7f16216d4640 1 --2- 172.21.15.99:0/3651307306 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f161c102550 0x7f161c113540 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f160c003080 tx=0x7f160c009da0 comp rx=0 tx=0).stop 2024-09-19T06:36:39.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:39.477+0000 7f16216d4640 1 -- 172.21.15.99:0/3651307306 shutdown_connections 2024-09-19T06:36:39.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:39.477+0000 7f16216d4640 1 --2- 172.21.15.99:0/3651307306 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f160406ed60 0x7f1604071210 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:39.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:39.477+0000 7f16216d4640 1 --2- 172.21.15.99:0/3651307306 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f161c102ef0 0x7f161c113a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:39.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:39.477+0000 7f16216d4640 1 --2- 172.21.15.99:0/3651307306 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f161c102550 0x7f161c113540 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:39.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:39.477+0000 7f16216d4640 1 -- 172.21.15.99:0/3651307306 >> 172.21.15.99:0/3651307306 conn(0x7f161c0f80f0 msgr2=0x7f161c0f9160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:36:39.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:39.477+0000 7f16216d4640 1 -- 172.21.15.99:0/3651307306 shutdown_connections 2024-09-19T06:36:39.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:39.477+0000 7f16216d4640 1 -- 172.21.15.99:0/3651307306 wait complete. 2024-09-19T06:36:40.186 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":19,"flags":0,"active_gid":14206,"active_name":"smithi099.pgvkqi","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":886909451},{"type":"v1","addr":"172.21.15.99:6801","nonce":886909451}]},"active_addr":"172.21.15.99:6801/886909451","active_change":"2024-09-19T06:33:04.481025+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":14224,"name":"smithi117.ssmkcf","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.99:8443/","prometheus":"http://172.21.15.99:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.99:0","nonce":2555968755}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.99:0","nonce":3333547531}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.99:0","nonce":2624442023}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.99:0","nonce":1101178780}]}]} 2024-09-19T06:36:40.193 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-19T06:36:40.193 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-19T06:36:40.193 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T06:36:40.251 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:40 smithi099 ceph-mon[27651]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:36:40.251 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:40 smithi099 ceph-mon[27651]: from='client.? 172.21.15.99:0/3651307306' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T06:36:40.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:40 smithi117 ceph-mon[34564]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:36:40.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:40 smithi117 ceph-mon[34564]: from='client.? 172.21.15.99:0/3651307306' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T06:36:40.471 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T06:36:42.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:42.120+0000 7fdaf480a640 1 -- 172.21.15.99:0/2274868248 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdaf00fcf80 msgr2=0x7fdaf00fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:42.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:42.120+0000 7fdaf480a640 1 --2- 172.21.15.99:0/2274868248 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdaf00fcf80 0x7fdaf00fd3d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fdae40048d0 tx=0x7fdae4009da0 comp rx=0 tx=0).stop 2024-09-19T06:36:42.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:42.120+0000 7fdaf480a640 1 -- 172.21.15.99:0/2274868248 shutdown_connections 2024-09-19T06:36:42.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:42.120+0000 7fdaf480a640 1 --2- 172.21.15.99:0/2274868248 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdaf00fcf80 0x7fdaf00fd3d0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:42.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:42.120+0000 7fdaf480a640 1 --2- 172.21.15.99:0/2274868248 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdaf00fb810 0x7fdaf00fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:42.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:42.120+0000 7fdaf480a640 1 -- 172.21.15.99:0/2274868248 >> 172.21.15.99:0/2274868248 conn(0x7fdaf00723b0 msgr2=0x7fdaf00727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:36:42.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:42.120+0000 7fdaf480a640 1 -- 172.21.15.99:0/2274868248 shutdown_connections 2024-09-19T06:36:42.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:42.120+0000 7fdaf480a640 1 -- 172.21.15.99:0/2274868248 wait complete. 2024-09-19T06:36:42.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:42.120+0000 7fdaf480a640 1 Processor -- start 2024-09-19T06:36:42.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:42.120+0000 7fdaf480a640 1 -- start start 2024-09-19T06:36:42.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:42.120+0000 7fdaf480a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdaf00fb810 0x7fdaf010e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:42.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:42.120+0000 7fdaf480a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdaf00fcf80 0x7fdaf010e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:42.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:42.120+0000 7fdaf480a640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf010eed0 con 0x7fdaf00fcf80 2024-09-19T06:36:42.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:42.120+0000 7fdaf480a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf010f040 con 0x7fdaf00fb810 2024-09-19T06:36:42.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:42.120+0000 7fdaedd9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdaf00fcf80 0x7fdaf010e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:42.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:42.121+0000 7fdaedd9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdaf00fcf80 0x7fdaf010e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38906/0 (socket says 172.21.15.99:38906) 2024-09-19T06:36:42.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:42.121+0000 7fdaedd9b640 1 -- 172.21.15.99:0/2608064743 learned_addr learned my addr 172.21.15.99:0/2608064743 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:36:42.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:42.121+0000 7fdaee59c640 1 --2- 172.21.15.99:0/2608064743 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdaf00fb810 0x7fdaf010e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:42.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:42.121+0000 7fdaedd9b640 1 -- 172.21.15.99:0/2608064743 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdaf00fb810 msgr2=0x7fdaf010e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:42.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:42.121+0000 7fdaedd9b640 1 --2- 172.21.15.99:0/2608064743 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdaf00fb810 0x7fdaf010e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:42.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:42.121+0000 7fdaedd9b640 1 -- 172.21.15.99:0/2608064743 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae4005040 con 0x7fdaf00fcf80 2024-09-19T06:36:42.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:42.121+0000 7fdaee59c640 1 --2- 172.21.15.99:0/2608064743 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdaf00fb810 0x7fdaf010e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:36:42.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:42.121+0000 7fdaedd9b640 1 --2- 172.21.15.99:0/2608064743 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdaf00fcf80 0x7fdaf010e900 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fdae4003080 tx=0x7fdae4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:36:42.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:42.121+0000 7fdadeffd640 1 -- 172.21.15.99:0/2608064743 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdae4038070 con 0x7fdaf00fcf80 2024-09-19T06:36:42.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:42.121+0000 7fdadeffd640 1 -- 172.21.15.99:0/2608064743 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fdae40097e0 con 0x7fdaf00fcf80 2024-09-19T06:36:42.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:42.121+0000 7fdaf480a640 1 -- 172.21.15.99:0/2608064743 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaf01172f0 con 0x7fdaf00fcf80 2024-09-19T06:36:42.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:42.121+0000 7fdadeffd640 1 -- 172.21.15.99:0/2608064743 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdae403d420 con 0x7fdaf00fcf80 2024-09-19T06:36:42.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:42.121+0000 7fdaf480a640 1 -- 172.21.15.99:0/2608064743 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaf0117780 con 0x7fdaf00fcf80 2024-09-19T06:36:42.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:42.122+0000 7fdaf480a640 1 -- 172.21.15.99:0/2608064743 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaf00fcbc0 con 0x7fdaf00fcf80 2024-09-19T06:36:42.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:42.122+0000 7fdadeffd640 1 -- 172.21.15.99:0/2608064743 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fdae4030020 con 0x7fdaf00fcf80 2024-09-19T06:36:42.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:42.123+0000 7fdadeffd640 1 --2- 172.21.15.99:0/2608064743 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fdad806ed60 0x7fdad8071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:42.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:42.123+0000 7fdadeffd640 1 -- 172.21.15.99:0/2608064743 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fdae40ae2b0 con 0x7fdaf00fcf80 2024-09-19T06:36:42.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:42.123+0000 7fdaee59c640 1 --2- 172.21.15.99:0/2608064743 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fdad806ed60 0x7fdad8071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:42.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:42.123+0000 7fdaee59c640 1 --2- 172.21.15.99:0/2608064743 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fdad806ed60 0x7fdad8071210 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdae0001370 tx=0x7fdae00096a0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:36:42.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:42.127+0000 7fdadeffd640 1 -- 172.21.15.99:0/2608064743 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fdae407b790 con 0x7fdaf00fcf80 2024-09-19T06:36:42.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:42 smithi099 ceph-mon[27651]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:36:42.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:42.283+0000 7fdaf480a640 1 -- 172.21.15.99:0/2608064743 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdaf0065750 con 0x7fdaf00fcf80 2024-09-19T06:36:42.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:42.284+0000 7fdadeffd640 1 -- 172.21.15.99:0/2608064743 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+11083 (secure 0 0 0) 0x7fdae407b130 con 0x7fdaf00fcf80 2024-09-19T06:36:42.285 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:36:42.286 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":39,"fsid":"a73eb958-7650-11ef-bceb-c7b262605968","created":"2024-09-19T06:31:07.865401+0000","modified":"2024-09-19T06:36:26.713103+0000","last_up_change":"2024-09-19T06:36:25.705325+0000","last_in_change":"2024-09-19T06:36:07.858135+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:35:16.794581+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"161a5999-8f1e-47b7-8539-3fb969206f5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":223723623},{"type":"v1","addr":"172.21.15.99:6803","nonce":223723623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":223723623},{"type":"v1","addr":"172.21.15.99:6805","nonce":223723623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":223723623},{"type":"v1","addr":"172.21.15.99:6809","nonce":223723623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":223723623},{"type":"v1","addr":"172.21.15.99:6807","nonce":223723623}]},"public_addr":"172.21.15.99:6803/223723623","cluster_addr":"172.21.15.99:6805/223723623","heartbeat_back_addr":"172.21.15.99:6809/223723623","heartbeat_front_addr":"172.21.15.99:6807/223723623","state":["exists","up"]},{"osd":1,"uuid":"daad89b4-7ead-4cc7-bf89-ac6d22dba93b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1205097168},{"type":"v1","addr":"172.21.15.99:6811","nonce":1205097168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":1205097168},{"type":"v1","addr":"172.21.15.99:6813","nonce":1205097168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1205097168},{"type":"v1","addr":"172.21.15.99:6817","nonce":1205097168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1205097168},{"type":"v1","addr":"172.21.15.99:6815","nonce":1205097168}]},"public_addr":"172.21.15.99:6811/1205097168","cluster_addr":"172.21.15.99:6813/1205097168","heartbeat_back_addr":"172.21.15.99:6817/1205097168","heartbeat_front_addr":"172.21.15.99:6815/1205097168","state":["exists","up"]},{"osd":2,"uuid":"87dd834e-36dc-48da-8d88-982e9a794e14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1219926965},{"type":"v1","addr":"172.21.15.99:6819","nonce":1219926965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":1219926965},{"type":"v1","addr":"172.21.15.99:6821","nonce":1219926965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":1219926965},{"type":"v1","addr":"172.21.15.99:6825","nonce":1219926965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":1219926965},{"type":"v1","addr":"172.21.15.99:6823","nonce":1219926965}]},"public_addr":"172.21.15.99:6819/1219926965","cluster_addr":"172.21.15.99:6821/1219926965","heartbeat_back_addr":"172.21.15.99:6825/1219926965","heartbeat_front_addr":"172.21.15.99:6823/1219926965","state":["exists","up"]},{"osd":3,"uuid":"e55ff802-be59-4865-924a-46b72ed0f978","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":1478846960},{"type":"v1","addr":"172.21.15.117:6801","nonce":1478846960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":1478846960},{"type":"v1","addr":"172.21.15.117:6803","nonce":1478846960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":1478846960},{"type":"v1","addr":"172.21.15.117:6807","nonce":1478846960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":1478846960},{"type":"v1","addr":"172.21.15.117:6805","nonce":1478846960}]},"public_addr":"172.21.15.117:6801/1478846960","cluster_addr":"172.21.15.117:6803/1478846960","heartbeat_back_addr":"172.21.15.117:6807/1478846960","heartbeat_front_addr":"172.21.15.117:6805/1478846960","state":["exists","up"]},{"osd":4,"uuid":"2652320e-b3aa-4361-81fb-53dfaf76638e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":2126129691},{"type":"v1","addr":"172.21.15.117:6809","nonce":2126129691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2126129691},{"type":"v1","addr":"172.21.15.117:6811","nonce":2126129691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2126129691},{"type":"v1","addr":"172.21.15.117:6815","nonce":2126129691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":2126129691},{"type":"v1","addr":"172.21.15.117:6813","nonce":2126129691}]},"public_addr":"172.21.15.117:6809/2126129691","cluster_addr":"172.21.15.117:6811/2126129691","heartbeat_back_addr":"172.21.15.117:6815/2126129691","heartbeat_front_addr":"172.21.15.117:6813/2126129691","state":["exists","up"]},{"osd":5,"uuid":"2f82c5e1-1d76-42c2-bbeb-3a94e672d4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2126888000},{"type":"v1","addr":"172.21.15.117:6817","nonce":2126888000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2126888000},{"type":"v1","addr":"172.21.15.117:6819","nonce":2126888000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2126888000},{"type":"v1","addr":"172.21.15.117:6823","nonce":2126888000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2126888000},{"type":"v1","addr":"172.21.15.117:6821","nonce":2126888000}]},"public_addr":"172.21.15.117:6817/2126888000","cluster_addr":"172.21.15.117:6819/2126888000","heartbeat_back_addr":"172.21.15.117:6823/2126888000","heartbeat_front_addr":"172.21.15.117:6821/2126888000","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:34:19.431244+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:34:45.757937+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:35:12.931408+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:35:34.718746+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:35:59.471231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:24.384004+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.99:0/294185414":"2024-09-20T06:33:04.480906+0000","172.21.15.99:6801/2333024932":"2024-09-20T06:33:04.480906+0000","172.21.15.99:0/1304237604":"2024-09-20T06:31:28.226981+0000","172.21.15.99:0/1060821876":"2024-09-20T06:33:04.480906+0000","172.21.15.99:0/2540279353":"2024-09-20T06:31:28.226981+0000","172.21.15.99:6801/3677321821":"2024-09-20T06:31:28.226981+0000","172.21.15.99:0/354724072":"2024-09-20T06:31:28.226981+0000","172.21.15.99:6800/3738534523":"2024-09-20T06:32:05.259470+0000","172.21.15.99:0/1529455887":"2024-09-20T06:32:05.259470+0000","172.21.15.99:6801/3738534523":"2024-09-20T06:32:05.259470+0000","172.21.15.99:0/3847616959":"2024-09-20T06:32:05.259470+0000","172.21.15.99:0/1023918254":"2024-09-20T06:32:05.259470+0000","172.21.15.99:0/1213923731":"2024-09-20T06:33:04.480906+0000","172.21.15.99:6800/3677321821":"2024-09-20T06:31:28.226981+0000","172.21.15.99:6800/2333024932":"2024-09-20T06:33:04.480906+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:36:42.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:42.286+0000 7fdaf480a640 1 -- 172.21.15.99:0/2608064743 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fdad806ed60 msgr2=0x7fdad8071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:42.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:42.286+0000 7fdaf480a640 1 --2- 172.21.15.99:0/2608064743 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fdad806ed60 0x7fdad8071210 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdae0001370 tx=0x7fdae00096a0 comp rx=0 tx=0).stop 2024-09-19T06:36:42.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:42.286+0000 7fdaf480a640 1 -- 172.21.15.99:0/2608064743 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdaf00fcf80 msgr2=0x7fdaf010e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:42.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:42.286+0000 7fdaf480a640 1 --2- 172.21.15.99:0/2608064743 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdaf00fcf80 0x7fdaf010e900 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fdae4003080 tx=0x7fdae4009da0 comp rx=0 tx=0).stop 2024-09-19T06:36:42.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:42.286+0000 7fdaf480a640 1 -- 172.21.15.99:0/2608064743 shutdown_connections 2024-09-19T06:36:42.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:42.286+0000 7fdaf480a640 1 --2- 172.21.15.99:0/2608064743 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fdad806ed60 0x7fdad8071210 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:42.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:42.286+0000 7fdaf480a640 1 --2- 172.21.15.99:0/2608064743 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdaf00fcf80 0x7fdaf010e900 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:42.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:42.286+0000 7fdaf480a640 1 --2- 172.21.15.99:0/2608064743 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdaf00fb810 0x7fdaf010e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:42.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:42.286+0000 7fdaf480a640 1 -- 172.21.15.99:0/2608064743 >> 172.21.15.99:0/2608064743 conn(0x7fdaf00723b0 msgr2=0x7fdaf00fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:36:42.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:42.286+0000 7fdaf480a640 1 -- 172.21.15.99:0/2608064743 shutdown_connections 2024-09-19T06:36:42.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:42.286+0000 7fdaf480a640 1 -- 172.21.15.99:0/2608064743 wait complete. 2024-09-19T06:36:42.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:42 smithi117 ceph-mon[34564]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:36:42.908 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-19T06:36:42.908 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T06:36:43.192 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T06:36:43.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:43 smithi099 ceph-mon[27651]: from='client.? 172.21.15.99:0/2608064743' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:36:43.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:43 smithi117 ceph-mon[34564]: from='client.? 172.21.15.99:0/2608064743' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:36:44.329 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:44 smithi099 ceph-mon[27651]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:36:44.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:44 smithi117 ceph-mon[34564]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:36:44.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:44.734+0000 7f7f1a7ce640 1 -- 172.21.15.99:0/2559316935 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f140fb810 msgr2=0x7f7f140fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:44.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:44.734+0000 7f7f1a7ce640 1 --2- 172.21.15.99:0/2559316935 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f140fb810 0x7f7f140fbbe0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7f040048d0 tx=0x7f7f04009da0 comp rx=0 tx=0).stop 2024-09-19T06:36:44.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:44.734+0000 7f7f1a7ce640 1 -- 172.21.15.99:0/2559316935 shutdown_connections 2024-09-19T06:36:44.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:44.734+0000 7f7f1a7ce640 1 --2- 172.21.15.99:0/2559316935 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f140fcf80 0x7f7f140fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:44.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:44.734+0000 7f7f1a7ce640 1 --2- 172.21.15.99:0/2559316935 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f140fb810 0x7f7f140fbbe0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:44.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:44.734+0000 7f7f1a7ce640 1 -- 172.21.15.99:0/2559316935 >> 172.21.15.99:0/2559316935 conn(0x7f7f140723b0 msgr2=0x7f7f140727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:36:44.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:44.734+0000 7f7f1a7ce640 1 -- 172.21.15.99:0/2559316935 shutdown_connections 2024-09-19T06:36:44.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:44.734+0000 7f7f1a7ce640 1 -- 172.21.15.99:0/2559316935 wait complete. 2024-09-19T06:36:44.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:44.735+0000 7f7f1a7ce640 1 Processor -- start 2024-09-19T06:36:44.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:44.735+0000 7f7f1a7ce640 1 -- start start 2024-09-19T06:36:44.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:44.735+0000 7f7f1a7ce640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f140fb810 0x7f7f14112100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:44.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:44.735+0000 7f7f1a7ce640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f140fcf80 0x7f7f14112640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:44.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:44.735+0000 7f7f1a7ce640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f14112cd0 con 0x7f7f140fcf80 2024-09-19T06:36:44.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:44.735+0000 7f7f1a7ce640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1410c080 con 0x7f7f140fb810 2024-09-19T06:36:44.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:44.735+0000 7f7f0bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f140fcf80 0x7f7f14112640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:44.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:44.735+0000 7f7f0bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f140fcf80 0x7f7f14112640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38922/0 (socket says 172.21.15.99:38922) 2024-09-19T06:36:44.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:44.735+0000 7f7f0bfff640 1 -- 172.21.15.99:0/3632265450 learned_addr learned my addr 172.21.15.99:0/3632265450 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:36:44.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:44.735+0000 7f7f13fff640 1 --2- 172.21.15.99:0/3632265450 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f140fb810 0x7f7f14112100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:44.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:44.735+0000 7f7f0bfff640 1 -- 172.21.15.99:0/3632265450 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f140fb810 msgr2=0x7f7f14112100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:44.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:44.735+0000 7f7f0bfff640 1 --2- 172.21.15.99:0/3632265450 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f140fb810 0x7f7f14112100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:44.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:44.735+0000 7f7f0bfff640 1 -- 172.21.15.99:0/3632265450 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f04005040 con 0x7f7f140fcf80 2024-09-19T06:36:44.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:44.735+0000 7f7f0bfff640 1 --2- 172.21.15.99:0/3632265450 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f140fcf80 0x7f7f14112640 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7efc00b790 tx=0x7f7efc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:36:44.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:44.736+0000 7f7f117fa640 1 -- 172.21.15.99:0/3632265450 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7efc00c700 con 0x7f7f140fcf80 2024-09-19T06:36:44.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:44.736+0000 7f7f1a7ce640 1 -- 172.21.15.99:0/3632265450 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f1410c360 con 0x7f7f140fcf80 2024-09-19T06:36:44.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:44.736+0000 7f7f117fa640 1 -- 172.21.15.99:0/3632265450 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7efc00cd00 con 0x7f7f140fcf80 2024-09-19T06:36:44.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:44.736+0000 7f7f117fa640 1 -- 172.21.15.99:0/3632265450 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7efc015e80 con 0x7f7f140fcf80 2024-09-19T06:36:44.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:44.736+0000 7f7f1a7ce640 1 -- 172.21.15.99:0/3632265450 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f1410c880 con 0x7f7f140fcf80 2024-09-19T06:36:44.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:44.737+0000 7f7f1a7ce640 1 -- 172.21.15.99:0/3632265450 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f140fcbc0 con 0x7f7f140fcf80 2024-09-19T06:36:44.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:44.737+0000 7f7f117fa640 1 -- 172.21.15.99:0/3632265450 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f7efc012070 con 0x7f7f140fcf80 2024-09-19T06:36:44.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:44.738+0000 7f7f117fa640 1 --2- 172.21.15.99:0/3632265450 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f7f0006ed60 0x7f7f00071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:44.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:44.738+0000 7f7f117fa640 1 -- 172.21.15.99:0/3632265450 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f7efc08d6b0 con 0x7f7f140fcf80 2024-09-19T06:36:44.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:44.738+0000 7f7f13fff640 1 --2- 172.21.15.99:0/3632265450 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f7f0006ed60 0x7f7f00071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:44.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:44.738+0000 7f7f13fff640 1 --2- 172.21.15.99:0/3632265450 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f7f0006ed60 0x7f7f00071210 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7f04009ac0 tx=0x7f7f04035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:36:44.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:44.742+0000 7f7f117fa640 1 -- 172.21.15.99:0/3632265450 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f7efc05ab10 con 0x7f7f140fcf80 2024-09-19T06:36:44.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:44.896+0000 7f7f1a7ce640 1 -- 172.21.15.99:0/3632265450 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7f1410d770 con 0x7f7f140fcf80 2024-09-19T06:36:44.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:44.896+0000 7f7f117fa640 1 -- 172.21.15.99:0/3632265450 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+11083 (secure 0 0 0) 0x7f7efc05a4b0 con 0x7f7f140fcf80 2024-09-19T06:36:44.898 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:36:44.898 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":39,"fsid":"a73eb958-7650-11ef-bceb-c7b262605968","created":"2024-09-19T06:31:07.865401+0000","modified":"2024-09-19T06:36:26.713103+0000","last_up_change":"2024-09-19T06:36:25.705325+0000","last_in_change":"2024-09-19T06:36:07.858135+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T06:35:16.794581+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"161a5999-8f1e-47b7-8539-3fb969206f5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":223723623},{"type":"v1","addr":"172.21.15.99:6803","nonce":223723623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":223723623},{"type":"v1","addr":"172.21.15.99:6805","nonce":223723623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":223723623},{"type":"v1","addr":"172.21.15.99:6809","nonce":223723623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":223723623},{"type":"v1","addr":"172.21.15.99:6807","nonce":223723623}]},"public_addr":"172.21.15.99:6803/223723623","cluster_addr":"172.21.15.99:6805/223723623","heartbeat_back_addr":"172.21.15.99:6809/223723623","heartbeat_front_addr":"172.21.15.99:6807/223723623","state":["exists","up"]},{"osd":1,"uuid":"daad89b4-7ead-4cc7-bf89-ac6d22dba93b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":1205097168},{"type":"v1","addr":"172.21.15.99:6811","nonce":1205097168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":1205097168},{"type":"v1","addr":"172.21.15.99:6813","nonce":1205097168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":1205097168},{"type":"v1","addr":"172.21.15.99:6817","nonce":1205097168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":1205097168},{"type":"v1","addr":"172.21.15.99:6815","nonce":1205097168}]},"public_addr":"172.21.15.99:6811/1205097168","cluster_addr":"172.21.15.99:6813/1205097168","heartbeat_back_addr":"172.21.15.99:6817/1205097168","heartbeat_front_addr":"172.21.15.99:6815/1205097168","state":["exists","up"]},{"osd":2,"uuid":"87dd834e-36dc-48da-8d88-982e9a794e14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":1219926965},{"type":"v1","addr":"172.21.15.99:6819","nonce":1219926965}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":1219926965},{"type":"v1","addr":"172.21.15.99:6821","nonce":1219926965}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":1219926965},{"type":"v1","addr":"172.21.15.99:6825","nonce":1219926965}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":1219926965},{"type":"v1","addr":"172.21.15.99:6823","nonce":1219926965}]},"public_addr":"172.21.15.99:6819/1219926965","cluster_addr":"172.21.15.99:6821/1219926965","heartbeat_back_addr":"172.21.15.99:6825/1219926965","heartbeat_front_addr":"172.21.15.99:6823/1219926965","state":["exists","up"]},{"osd":3,"uuid":"e55ff802-be59-4865-924a-46b72ed0f978","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":1478846960},{"type":"v1","addr":"172.21.15.117:6801","nonce":1478846960}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":1478846960},{"type":"v1","addr":"172.21.15.117:6803","nonce":1478846960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":1478846960},{"type":"v1","addr":"172.21.15.117:6807","nonce":1478846960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":1478846960},{"type":"v1","addr":"172.21.15.117:6805","nonce":1478846960}]},"public_addr":"172.21.15.117:6801/1478846960","cluster_addr":"172.21.15.117:6803/1478846960","heartbeat_back_addr":"172.21.15.117:6807/1478846960","heartbeat_front_addr":"172.21.15.117:6805/1478846960","state":["exists","up"]},{"osd":4,"uuid":"2652320e-b3aa-4361-81fb-53dfaf76638e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":2126129691},{"type":"v1","addr":"172.21.15.117:6809","nonce":2126129691}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2126129691},{"type":"v1","addr":"172.21.15.117:6811","nonce":2126129691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2126129691},{"type":"v1","addr":"172.21.15.117:6815","nonce":2126129691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":2126129691},{"type":"v1","addr":"172.21.15.117:6813","nonce":2126129691}]},"public_addr":"172.21.15.117:6809/2126129691","cluster_addr":"172.21.15.117:6811/2126129691","heartbeat_back_addr":"172.21.15.117:6815/2126129691","heartbeat_front_addr":"172.21.15.117:6813/2126129691","state":["exists","up"]},{"osd":5,"uuid":"2f82c5e1-1d76-42c2-bbeb-3a94e672d4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":2126888000},{"type":"v1","addr":"172.21.15.117:6817","nonce":2126888000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":2126888000},{"type":"v1","addr":"172.21.15.117:6819","nonce":2126888000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":2126888000},{"type":"v1","addr":"172.21.15.117:6823","nonce":2126888000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":2126888000},{"type":"v1","addr":"172.21.15.117:6821","nonce":2126888000}]},"public_addr":"172.21.15.117:6817/2126888000","cluster_addr":"172.21.15.117:6819/2126888000","heartbeat_back_addr":"172.21.15.117:6823/2126888000","heartbeat_front_addr":"172.21.15.117:6821/2126888000","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:34:19.431244+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:34:45.757937+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:35:12.931408+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:35:34.718746+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:35:59.471231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T06:36:24.384004+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.99:0/294185414":"2024-09-20T06:33:04.480906+0000","172.21.15.99:6801/2333024932":"2024-09-20T06:33:04.480906+0000","172.21.15.99:0/1304237604":"2024-09-20T06:31:28.226981+0000","172.21.15.99:0/1060821876":"2024-09-20T06:33:04.480906+0000","172.21.15.99:0/2540279353":"2024-09-20T06:31:28.226981+0000","172.21.15.99:6801/3677321821":"2024-09-20T06:31:28.226981+0000","172.21.15.99:0/354724072":"2024-09-20T06:31:28.226981+0000","172.21.15.99:6800/3738534523":"2024-09-20T06:32:05.259470+0000","172.21.15.99:0/1529455887":"2024-09-20T06:32:05.259470+0000","172.21.15.99:6801/3738534523":"2024-09-20T06:32:05.259470+0000","172.21.15.99:0/3847616959":"2024-09-20T06:32:05.259470+0000","172.21.15.99:0/1023918254":"2024-09-20T06:32:05.259470+0000","172.21.15.99:0/1213923731":"2024-09-20T06:33:04.480906+0000","172.21.15.99:6800/3677321821":"2024-09-20T06:31:28.226981+0000","172.21.15.99:6800/2333024932":"2024-09-20T06:33:04.480906+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T06:36:44.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:44.898+0000 7f7f1a7ce640 1 -- 172.21.15.99:0/3632265450 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f7f0006ed60 msgr2=0x7f7f00071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:44.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:44.898+0000 7f7f1a7ce640 1 --2- 172.21.15.99:0/3632265450 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f7f0006ed60 0x7f7f00071210 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7f04009ac0 tx=0x7f7f04035040 comp rx=0 tx=0).stop 2024-09-19T06:36:44.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:44.898+0000 7f7f1a7ce640 1 -- 172.21.15.99:0/3632265450 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f140fcf80 msgr2=0x7f7f14112640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:44.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:44.898+0000 7f7f1a7ce640 1 --2- 172.21.15.99:0/3632265450 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f140fcf80 0x7f7f14112640 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7efc00b790 tx=0x7f7efc0091d0 comp rx=0 tx=0).stop 2024-09-19T06:36:44.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:44.898+0000 7f7f1a7ce640 1 -- 172.21.15.99:0/3632265450 shutdown_connections 2024-09-19T06:36:44.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:44.898+0000 7f7f1a7ce640 1 --2- 172.21.15.99:0/3632265450 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f7f0006ed60 0x7f7f00071210 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:44.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:44.898+0000 7f7f1a7ce640 1 --2- 172.21.15.99:0/3632265450 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f140fcf80 0x7f7f14112640 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:44.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:44.898+0000 7f7f1a7ce640 1 --2- 172.21.15.99:0/3632265450 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f140fb810 0x7f7f14112100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:44.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:44.898+0000 7f7f1a7ce640 1 -- 172.21.15.99:0/3632265450 >> 172.21.15.99:0/3632265450 conn(0x7f7f140723b0 msgr2=0x7f7f140fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:36:44.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:44.898+0000 7f7f1a7ce640 1 -- 172.21.15.99:0/3632265450 shutdown_connections 2024-09-19T06:36:44.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:44.898+0000 7f7f1a7ce640 1 -- 172.21.15.99:0/3632265450 wait complete. 2024-09-19T06:36:45.329 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:45 smithi099 ceph-mon[27651]: from='client.? 172.21.15.99:0/3632265450' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:36:45.557 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-19T06:36:45.557 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-19T06:36:45.557 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-19T06:36:45.558 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-19T06:36:45.558 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-19T06:36:45.559 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-19T06:36:45.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:45 smithi117 ceph-mon[34564]: from='client.? 172.21.15.99:0/3632265450' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T06:36:45.847 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T06:36:45.854 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T06:36:46.236 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:46 smithi099 ceph-mon[27651]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:36:46.463 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:46 smithi117 ceph-mon[34564]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:36:48.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:48 smithi117 ceph-mon[34564]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:36:48.325 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:48 smithi099 ceph-mon[27651]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:36:48.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:48.526+0000 7f8053c43640 1 -- 172.21.15.99:0/4092118550 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f804c0fcf80 msgr2=0x7f804c0fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:48.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:48.526+0000 7f8053c43640 1 --2- 172.21.15.99:0/4092118550 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f804c0fcf80 0x7f804c0fd3d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f80480048d0 tx=0x7f8048009da0 comp rx=0 tx=0).stop 2024-09-19T06:36:48.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:48.526+0000 7f8053c43640 1 -- 172.21.15.99:0/4092118550 shutdown_connections 2024-09-19T06:36:48.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:48.526+0000 7f8053c43640 1 --2- 172.21.15.99:0/4092118550 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f804c0fcf80 0x7f804c0fd3d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:48.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:48.526+0000 7f8053c43640 1 --2- 172.21.15.99:0/4092118550 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f804c0fb810 0x7f804c0fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:48.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:48.526+0000 7f8053c43640 1 -- 172.21.15.99:0/4092118550 >> 172.21.15.99:0/4092118550 conn(0x7f804c0723b0 msgr2=0x7f804c0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:36:48.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:48.526+0000 7f8053c43640 1 -- 172.21.15.99:0/4092118550 shutdown_connections 2024-09-19T06:36:48.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:48.526+0000 7f8053c43640 1 -- 172.21.15.99:0/4092118550 wait complete. 2024-09-19T06:36:48.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:48.527+0000 7f8053c43640 1 Processor -- start 2024-09-19T06:36:48.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:48.527+0000 7f8053c43640 1 -- start start 2024-09-19T06:36:48.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:48.527+0000 7f8053c43640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f804c0fb810 0x7f804c10e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:48.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:48.527+0000 7f8053c43640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f804c0fcf80 0x7f804c10e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:48.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:48.527+0000 7f8053c43640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f804c10ed50 con 0x7f804c0fb810 2024-09-19T06:36:48.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:48.527+0000 7f8053c43640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f804c10eec0 con 0x7f804c0fcf80 2024-09-19T06:36:48.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:48.527+0000 7f80519df640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f804c0fb810 0x7f804c10e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:48.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:48.527+0000 7f80519df640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f804c0fb810 0x7f804c10e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:37424/0 (socket says 172.21.15.99:37424) 2024-09-19T06:36:48.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:48.527+0000 7f80519df640 1 -- 172.21.15.99:0/2818728041 learned_addr learned my addr 172.21.15.99:0/2818728041 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:36:48.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:48.527+0000 7f80511de640 1 --2- 172.21.15.99:0/2818728041 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f804c0fcf80 0x7f804c10e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:48.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:48.527+0000 7f80519df640 1 -- 172.21.15.99:0/2818728041 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f804c0fcf80 msgr2=0x7f804c10e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:48.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:48.527+0000 7f80519df640 1 --2- 172.21.15.99:0/2818728041 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f804c0fcf80 0x7f804c10e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:48.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:48.527+0000 7f80519df640 1 -- 172.21.15.99:0/2818728041 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8048005040 con 0x7f804c0fb810 2024-09-19T06:36:48.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:48.528+0000 7f80519df640 1 --2- 172.21.15.99:0/2818728041 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f804c0fb810 0x7f804c10e2d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f803c00eb70 tx=0x7f803c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:36:48.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:48.528+0000 7f80427fc640 1 -- 172.21.15.99:0/2818728041 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f803c007c30 con 0x7f804c0fb810 2024-09-19T06:36:48.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:48.528+0000 7f80427fc640 1 -- 172.21.15.99:0/2818728041 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f803c00f040 con 0x7f804c0fb810 2024-09-19T06:36:48.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:48.528+0000 7f8053c43640 1 -- 172.21.15.99:0/2818728041 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f804c1171a0 con 0x7f804c0fb810 2024-09-19T06:36:48.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:48.528+0000 7f80427fc640 1 -- 172.21.15.99:0/2818728041 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f803c00ca60 con 0x7f804c0fb810 2024-09-19T06:36:48.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:48.528+0000 7f8053c43640 1 -- 172.21.15.99:0/2818728041 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f804c1176b0 con 0x7f804c0fb810 2024-09-19T06:36:48.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:48.529+0000 7f8053c43640 1 -- 172.21.15.99:0/2818728041 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f804c0fae90 con 0x7f804c0fb810 2024-09-19T06:36:48.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:48.529+0000 7f80427fc640 1 -- 172.21.15.99:0/2818728041 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f803c00cbc0 con 0x7f804c0fb810 2024-09-19T06:36:48.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:48.530+0000 7f80427fc640 1 --2- 172.21.15.99:0/2818728041 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f803806ed60 0x7f8038071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:48.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:48.530+0000 7f80427fc640 1 -- 172.21.15.99:0/2818728041 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f803c08db10 con 0x7f804c0fb810 2024-09-19T06:36:48.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:48.530+0000 7f80511de640 1 --2- 172.21.15.99:0/2818728041 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f803806ed60 0x7f8038071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:48.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:48.530+0000 7f80427fc640 1 --2- 172.21.15.99:0/2818728041 >> [v2:172.21.15.99:6802/223723623,v1:172.21.15.99:6803/223723623] conn(0x7f8038074ae0 0x7f8038076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:48.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:48.530+0000 7f80427fc640 1 -- 172.21.15.99:0/2818728041 --> [v2:172.21.15.99:6802/223723623,v1:172.21.15.99:6803/223723623] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f80380775a0 con 0x7f8038074ae0 2024-09-19T06:36:48.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:48.530+0000 7f80427fc640 1 -- 172.21.15.99:0/2818728041 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f803c092220 con 0x7f804c0fb810 2024-09-19T06:36:48.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:48.530+0000 7f80521e0640 1 --2- 172.21.15.99:0/2818728041 >> [v2:172.21.15.99:6802/223723623,v1:172.21.15.99:6803/223723623] conn(0x7f8038074ae0 0x7f8038076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:48.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:48.530+0000 7f80511de640 1 --2- 172.21.15.99:0/2818728041 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f803806ed60 0x7f8038071210 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f804c0659e0 tx=0x7f8048035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:36:48.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:48.530+0000 7f80521e0640 1 --2- 172.21.15.99:0/2818728041 >> [v2:172.21.15.99:6802/223723623,v1:172.21.15.99:6803/223723623] conn(0x7f8038074ae0 0x7f8038076ef0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:36:48.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:48.531+0000 7f80427fc640 1 -- 172.21.15.99:0/2818728041 <== osd.0 v2:172.21.15.99:6802/223723623 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f80380775a0 con 0x7f8038074ae0 2024-09-19T06:36:48.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:48.544+0000 7f8053c43640 1 -- 172.21.15.99:0/2818728041 --> [v2:172.21.15.99:6802/223723623,v1:172.21.15.99:6803/223723623] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f804c0fcbc0 con 0x7f8038074ae0 2024-09-19T06:36:48.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:48.545+0000 7f80427fc640 1 -- 172.21.15.99:0/2818728041 <== osd.0 v2:172.21.15.99:6802/223723623 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f804c0fcbc0 con 0x7f8038074ae0 2024-09-19T06:36:48.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:48.545+0000 7f8053c43640 1 -- 172.21.15.99:0/2818728041 >> [v2:172.21.15.99:6802/223723623,v1:172.21.15.99:6803/223723623] conn(0x7f8038074ae0 msgr2=0x7f8038076ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:48.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:48.545+0000 7f8053c43640 1 --2- 172.21.15.99:0/2818728041 >> [v2:172.21.15.99:6802/223723623,v1:172.21.15.99:6803/223723623] conn(0x7f8038074ae0 0x7f8038076ef0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:48.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:48.545+0000 7f8053c43640 1 -- 172.21.15.99:0/2818728041 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f803806ed60 msgr2=0x7f8038071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:48.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:48.545+0000 7f8053c43640 1 --2- 172.21.15.99:0/2818728041 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f803806ed60 0x7f8038071210 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f804c0659e0 tx=0x7f8048035040 comp rx=0 tx=0).stop 2024-09-19T06:36:48.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:48.545+0000 7f8053c43640 1 -- 172.21.15.99:0/2818728041 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f804c0fb810 msgr2=0x7f804c10e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:48.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:48.545+0000 7f8053c43640 1 --2- 172.21.15.99:0/2818728041 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f804c0fb810 0x7f804c10e2d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f803c00eb70 tx=0x7f803c00b040 comp rx=0 tx=0).stop 2024-09-19T06:36:48.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:48.545+0000 7f8053c43640 1 -- 172.21.15.99:0/2818728041 shutdown_connections 2024-09-19T06:36:48.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:48.545+0000 7f8053c43640 1 --2- 172.21.15.99:0/2818728041 >> [v2:172.21.15.99:6802/223723623,v1:172.21.15.99:6803/223723623] conn(0x7f8038074ae0 0x7f8038076ef0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:48.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:48.545+0000 7f8053c43640 1 --2- 172.21.15.99:0/2818728041 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f803806ed60 0x7f8038071210 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:48.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:48.545+0000 7f8053c43640 1 --2- 172.21.15.99:0/2818728041 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f804c0fcf80 0x7f804c10e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:48.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:48.545+0000 7f8053c43640 1 --2- 172.21.15.99:0/2818728041 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f804c0fb810 0x7f804c10e2d0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:48.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:48.545+0000 7f8053c43640 1 -- 172.21.15.99:0/2818728041 >> 172.21.15.99:0/2818728041 conn(0x7f804c0723b0 msgr2=0x7f804c0fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:36:48.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:48.545+0000 7f8053c43640 1 -- 172.21.15.99:0/2818728041 shutdown_connections 2024-09-19T06:36:48.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:48.546+0000 7f8053c43640 1 -- 172.21.15.99:0/2818728041 wait complete. 2024-09-19T06:36:49.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:49.163+0000 7f6e4c0f3640 1 -- 172.21.15.99:0/2625147062 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e440fcf80 msgr2=0x7f6e440fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:49.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:49.163+0000 7f6e4c0f3640 1 --2- 172.21.15.99:0/2625147062 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e440fcf80 0x7f6e440fd3d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6e340048d0 tx=0x7f6e34009da0 comp rx=0 tx=0).stop 2024-09-19T06:36:49.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:49.163+0000 7f6e4c0f3640 1 -- 172.21.15.99:0/2625147062 shutdown_connections 2024-09-19T06:36:49.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:49.163+0000 7f6e4c0f3640 1 --2- 172.21.15.99:0/2625147062 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e440fcf80 0x7f6e440fd3d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:49.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:49.163+0000 7f6e4c0f3640 1 --2- 172.21.15.99:0/2625147062 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6e440fb810 0x7f6e440fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:49.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:49.163+0000 7f6e4c0f3640 1 -- 172.21.15.99:0/2625147062 >> 172.21.15.99:0/2625147062 conn(0x7f6e440723b0 msgr2=0x7f6e440727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:36:49.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:49.164+0000 7f6e4c0f3640 1 -- 172.21.15.99:0/2625147062 shutdown_connections 2024-09-19T06:36:49.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:49.164+0000 7f6e4c0f3640 1 -- 172.21.15.99:0/2625147062 wait complete. 2024-09-19T06:36:49.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:49.164+0000 7f6e4c0f3640 1 Processor -- start 2024-09-19T06:36:49.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:49.164+0000 7f6e4c0f3640 1 -- start start 2024-09-19T06:36:49.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:49.164+0000 7f6e4c0f3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e440fb810 0x7f6e441120b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:49.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:49.165+0000 7f6e4c0f3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6e440fcf80 0x7f6e441125f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:49.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:49.165+0000 7f6e4c0f3640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e44112bf0 con 0x7f6e440fb810 2024-09-19T06:36:49.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:49.165+0000 7f6e4c0f3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4410c030 con 0x7f6e440fcf80 2024-09-19T06:36:49.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:49.165+0000 7f6e49e8f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e440fb810 0x7f6e441120b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:49.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:49.165+0000 7f6e49e8f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e440fb810 0x7f6e441120b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:37442/0 (socket says 172.21.15.99:37442) 2024-09-19T06:36:49.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:49.165+0000 7f6e49e8f640 1 -- 172.21.15.99:0/2845499382 learned_addr learned my addr 172.21.15.99:0/2845499382 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:36:49.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:49.165+0000 7f6e4968e640 1 --2- 172.21.15.99:0/2845499382 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6e440fcf80 0x7f6e441125f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:49.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:49.165+0000 7f6e49e8f640 1 -- 172.21.15.99:0/2845499382 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6e440fcf80 msgr2=0x7f6e441125f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:49.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:49.165+0000 7f6e49e8f640 1 --2- 172.21.15.99:0/2845499382 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6e440fcf80 0x7f6e441125f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:49.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:49.165+0000 7f6e49e8f640 1 -- 172.21.15.99:0/2845499382 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e34005040 con 0x7f6e440fb810 2024-09-19T06:36:49.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:49.165+0000 7f6e49e8f640 1 --2- 172.21.15.99:0/2845499382 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e440fb810 0x7f6e441120b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6e4000c830 tx=0x7f6e40004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:36:49.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:49.165+0000 7f6e3a7fc640 1 -- 172.21.15.99:0/2845499382 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e4000a850 con 0x7f6e440fb810 2024-09-19T06:36:49.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:49.165+0000 7f6e3a7fc640 1 -- 172.21.15.99:0/2845499382 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6e4000ae50 con 0x7f6e440fb810 2024-09-19T06:36:49.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:49.165+0000 7f6e4c0f3640 1 -- 172.21.15.99:0/2845499382 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e4410c310 con 0x7f6e440fb810 2024-09-19T06:36:49.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:49.165+0000 7f6e3a7fc640 1 -- 172.21.15.99:0/2845499382 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e400113a0 con 0x7f6e440fb810 2024-09-19T06:36:49.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:49.165+0000 7f6e4c0f3640 1 -- 172.21.15.99:0/2845499382 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e4410c880 con 0x7f6e440fb810 2024-09-19T06:36:49.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:49.166+0000 7f6e4c0f3640 1 -- 172.21.15.99:0/2845499382 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6e4410cdc0 con 0x7f6e440fb810 2024-09-19T06:36:49.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:49.167+0000 7f6e3a7fc640 1 -- 172.21.15.99:0/2845499382 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f6e40012400 con 0x7f6e440fb810 2024-09-19T06:36:49.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:49.167+0000 7f6e3a7fc640 1 --2- 172.21.15.99:0/2845499382 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f6e3006ed60 0x7f6e30071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:49.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:49.167+0000 7f6e4968e640 1 --2- 172.21.15.99:0/2845499382 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f6e3006ed60 0x7f6e30071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:49.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:49.167+0000 7f6e3a7fc640 1 -- 172.21.15.99:0/2845499382 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f6e4008e080 con 0x7f6e440fb810 2024-09-19T06:36:49.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:49.167+0000 7f6e3a7fc640 1 --2- 172.21.15.99:0/2845499382 >> [v2:172.21.15.99:6818/1219926965,v1:172.21.15.99:6819/1219926965] conn(0x7f6e30074ae0 0x7f6e30076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:49.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:49.167+0000 7f6e3a7fc640 1 -- 172.21.15.99:0/2845499382 --> [v2:172.21.15.99:6818/1219926965,v1:172.21.15.99:6819/1219926965] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6e300775a0 con 0x7f6e30074ae0 2024-09-19T06:36:49.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:49.167+0000 7f6e3a7fc640 1 -- 172.21.15.99:0/2845499382 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e40090670 con 0x7f6e440fb810 2024-09-19T06:36:49.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:49.168+0000 7f6e4a690640 1 --2- 172.21.15.99:0/2845499382 >> [v2:172.21.15.99:6818/1219926965,v1:172.21.15.99:6819/1219926965] conn(0x7f6e30074ae0 0x7f6e30076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:49.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:49.168+0000 7f6e4968e640 1 --2- 172.21.15.99:0/2845499382 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f6e3006ed60 0x7f6e30071210 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6e440fe4b0 tx=0x7f6e34035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:36:49.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:49.168+0000 7f6e4a690640 1 --2- 172.21.15.99:0/2845499382 >> [v2:172.21.15.99:6818/1219926965,v1:172.21.15.99:6819/1219926965] conn(0x7f6e30074ae0 0x7f6e30076ef0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:36:49.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:49.168+0000 7f6e3a7fc640 1 -- 172.21.15.99:0/2845499382 <== osd.2 v2:172.21.15.99:6818/1219926965 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f6e300775a0 con 0x7f6e30074ae0 2024-09-19T06:36:49.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:49.181+0000 7f6e4c0f3640 1 -- 172.21.15.99:0/2845499382 --> [v2:172.21.15.99:6818/1219926965,v1:172.21.15.99:6819/1219926965] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6e440fcbc0 con 0x7f6e30074ae0 2024-09-19T06:36:49.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:49.181+0000 7f6e3a7fc640 1 -- 172.21.15.99:0/2845499382 <== osd.2 v2:172.21.15.99:6818/1219926965 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6e440fcbc0 con 0x7f6e30074ae0 2024-09-19T06:36:49.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:49.181+0000 7f6e4c0f3640 1 -- 172.21.15.99:0/2845499382 >> [v2:172.21.15.99:6818/1219926965,v1:172.21.15.99:6819/1219926965] conn(0x7f6e30074ae0 msgr2=0x7f6e30076ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:49.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:49.181+0000 7f6e4c0f3640 1 --2- 172.21.15.99:0/2845499382 >> [v2:172.21.15.99:6818/1219926965,v1:172.21.15.99:6819/1219926965] conn(0x7f6e30074ae0 0x7f6e30076ef0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:49.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:49.181+0000 7f6e4c0f3640 1 -- 172.21.15.99:0/2845499382 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f6e3006ed60 msgr2=0x7f6e30071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:49.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:49.181+0000 7f6e4c0f3640 1 --2- 172.21.15.99:0/2845499382 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f6e3006ed60 0x7f6e30071210 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6e440fe4b0 tx=0x7f6e34035040 comp rx=0 tx=0).stop 2024-09-19T06:36:49.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:49.181+0000 7f6e4c0f3640 1 -- 172.21.15.99:0/2845499382 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e440fb810 msgr2=0x7f6e441120b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:49.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:49.181+0000 7f6e4c0f3640 1 --2- 172.21.15.99:0/2845499382 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e440fb810 0x7f6e441120b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6e4000c830 tx=0x7f6e40004430 comp rx=0 tx=0).stop 2024-09-19T06:36:49.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:49.181+0000 7f6e4c0f3640 1 -- 172.21.15.99:0/2845499382 shutdown_connections 2024-09-19T06:36:49.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:49.181+0000 7f6e4c0f3640 1 --2- 172.21.15.99:0/2845499382 >> [v2:172.21.15.99:6818/1219926965,v1:172.21.15.99:6819/1219926965] conn(0x7f6e30074ae0 0x7f6e30076ef0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:49.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:49.181+0000 7f6e4c0f3640 1 --2- 172.21.15.99:0/2845499382 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f6e3006ed60 0x7f6e30071210 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:49.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:49.181+0000 7f6e4c0f3640 1 --2- 172.21.15.99:0/2845499382 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6e440fcf80 0x7f6e441125f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:49.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:49.181+0000 7f6e4c0f3640 1 --2- 172.21.15.99:0/2845499382 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e440fb810 0x7f6e441120b0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:49.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:49.181+0000 7f6e4c0f3640 1 -- 172.21.15.99:0/2845499382 >> 172.21.15.99:0/2845499382 conn(0x7f6e440723b0 msgr2=0x7f6e440fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:36:49.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:49.181+0000 7f6e4c0f3640 1 -- 172.21.15.99:0/2845499382 shutdown_connections 2024-09-19T06:36:49.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:49.182+0000 7f6e4c0f3640 1 -- 172.21.15.99:0/2845499382 wait complete. 2024-09-19T06:36:49.933 INFO:teuthology.orchestra.run.smithi099.stdout:38654705696 2024-09-19T06:36:49.934 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-19T06:36:49.988 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T06:36:49.989 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T06:36:49.990 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T06:36:50.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:50 smithi099 ceph-mon[27651]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:36:50.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:50 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:36:50.491 INFO:teuthology.orchestra.run.smithi099.stdout:81604378646 2024-09-19T06:36:50.491 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-19T06:36:50.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:50 smithi117 ceph-mon[34564]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:36:50.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:50 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:36:50.637 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T06:36:52.183 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T06:36:52.279 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:52 smithi099 ceph-mon[27651]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:36:52.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:52 smithi117 ceph-mon[34564]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:36:54.426 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:54 smithi099 ceph-mon[27651]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:36:54.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:54 smithi117 ceph-mon[34564]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:36:55.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:55.317+0000 7f7b1822a640 1 -- 172.21.15.99:0/221870566 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b100fbd90 msgr2=0x7f7b100fc200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:55.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:55.317+0000 7f7b1822a640 1 --2- 172.21.15.99:0/221870566 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b100fbd90 0x7f7b100fc200 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7b040048d0 tx=0x7f7b04009da0 comp rx=0 tx=0).stop 2024-09-19T06:36:55.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:55.317+0000 7f7b1822a640 1 -- 172.21.15.99:0/221870566 shutdown_connections 2024-09-19T06:36:55.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:55.317+0000 7f7b1822a640 1 --2- 172.21.15.99:0/221870566 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b100fbd90 0x7f7b100fc200 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:55.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:55.317+0000 7f7b1822a640 1 --2- 172.21.15.99:0/221870566 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b10100410 0x7f7b101007e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:55.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:55.317+0000 7f7b1822a640 1 -- 172.21.15.99:0/221870566 >> 172.21.15.99:0/221870566 conn(0x7f7b10070ce0 msgr2=0x7f7b100710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:36:55.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:55.317+0000 7f7b1822a640 1 -- 172.21.15.99:0/221870566 shutdown_connections 2024-09-19T06:36:55.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:55.317+0000 7f7b1822a640 1 -- 172.21.15.99:0/221870566 wait complete. 2024-09-19T06:36:55.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:55.317+0000 7f7b1822a640 1 Processor -- start 2024-09-19T06:36:55.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:55.317+0000 7f7b1822a640 1 -- start start 2024-09-19T06:36:55.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:55.318+0000 7f7b1822a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b100fbd90 0x7f7b10113270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:55.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:55.318+0000 7f7b1822a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b10100410 0x7f7b101137b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:55.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:55.318+0000 7f7b1822a640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b10113e40 con 0x7f7b100fbd90 2024-09-19T06:36:55.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:55.318+0000 7f7b1822a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1010d1f0 con 0x7f7b10100410 2024-09-19T06:36:55.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:55.318+0000 7f7b15fc6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b100fbd90 0x7f7b10113270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:55.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:55.318+0000 7f7b15fc6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b100fbd90 0x7f7b10113270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56498/0 (socket says 172.21.15.99:56498) 2024-09-19T06:36:55.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:55.318+0000 7f7b15fc6640 1 -- 172.21.15.99:0/3715141930 learned_addr learned my addr 172.21.15.99:0/3715141930 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:36:55.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:55.318+0000 7f7b157c5640 1 --2- 172.21.15.99:0/3715141930 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b10100410 0x7f7b101137b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:55.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:55.318+0000 7f7b15fc6640 1 -- 172.21.15.99:0/3715141930 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b10100410 msgr2=0x7f7b101137b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:55.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:55.318+0000 7f7b15fc6640 1 --2- 172.21.15.99:0/3715141930 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b10100410 0x7f7b101137b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:55.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:55.318+0000 7f7b15fc6640 1 -- 172.21.15.99:0/3715141930 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b04005040 con 0x7f7b100fbd90 2024-09-19T06:36:55.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:55.318+0000 7f7b15fc6640 1 --2- 172.21.15.99:0/3715141930 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b100fbd90 0x7f7b10113270 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c00b790 tx=0x7f7b0c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:36:55.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:55.318+0000 7f7b027fc640 1 -- 172.21.15.99:0/3715141930 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b0c00c700 con 0x7f7b100fbd90 2024-09-19T06:36:55.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:55.318+0000 7f7b027fc640 1 -- 172.21.15.99:0/3715141930 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7b0c00cd00 con 0x7f7b100fbd90 2024-09-19T06:36:55.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:55.318+0000 7f7b027fc640 1 -- 172.21.15.99:0/3715141930 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b0c015e70 con 0x7f7b100fbd90 2024-09-19T06:36:55.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:55.318+0000 7f7b1822a640 1 -- 172.21.15.99:0/3715141930 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b1010d4d0 con 0x7f7b100fbd90 2024-09-19T06:36:55.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:55.318+0000 7f7b1822a640 1 -- 172.21.15.99:0/3715141930 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b1010d9c0 con 0x7f7b100fbd90 2024-09-19T06:36:55.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:55.319+0000 7f7b1822a640 1 -- 172.21.15.99:0/3715141930 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7b1010df00 con 0x7f7b100fbd90 2024-09-19T06:36:55.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:55.320+0000 7f7b027fc640 1 -- 172.21.15.99:0/3715141930 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f7b0c012070 con 0x7f7b100fbd90 2024-09-19T06:36:55.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:55.320+0000 7f7b027fc640 1 --2- 172.21.15.99:0/3715141930 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f7afc06ed60 0x7f7afc071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:55.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:55.320+0000 7f7b157c5640 1 --2- 172.21.15.99:0/3715141930 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f7afc06ed60 0x7f7afc071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:55.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:55.320+0000 7f7b027fc640 1 -- 172.21.15.99:0/3715141930 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f7b0c08d930 con 0x7f7b100fbd90 2024-09-19T06:36:55.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:55.320+0000 7f7b027fc640 1 --2- 172.21.15.99:0/3715141930 >> [v2:172.21.15.117:6800/1478846960,v1:172.21.15.117:6801/1478846960] conn(0x7f7afc074ae0 0x7f7afc076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:55.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:55.320+0000 7f7b027fc640 1 -- 172.21.15.99:0/3715141930 --> [v2:172.21.15.117:6800/1478846960,v1:172.21.15.117:6801/1478846960] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7afc0775a0 con 0x7f7afc074ae0 2024-09-19T06:36:55.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:55.320+0000 7f7b027fc640 1 -- 172.21.15.99:0/3715141930 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7b0c092220 con 0x7f7b100fbd90 2024-09-19T06:36:55.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:55.321+0000 7f7b157c5640 1 --2- 172.21.15.99:0/3715141930 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f7afc06ed60 0x7f7afc071210 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7b10101930 tx=0x7f7b04035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:36:55.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:55.321+0000 7f7b167c7640 1 --2- 172.21.15.99:0/3715141930 >> [v2:172.21.15.117:6800/1478846960,v1:172.21.15.117:6801/1478846960] conn(0x7f7afc074ae0 0x7f7afc076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:55.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:55.321+0000 7f7b167c7640 1 --2- 172.21.15.99:0/3715141930 >> [v2:172.21.15.117:6800/1478846960,v1:172.21.15.117:6801/1478846960] conn(0x7f7afc074ae0 0x7f7afc076ef0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:36:55.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:55.322+0000 7f7b027fc640 1 -- 172.21.15.99:0/3715141930 <== osd.3 v2:172.21.15.117:6800/1478846960 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f7afc0775a0 con 0x7f7afc074ae0 2024-09-19T06:36:55.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:55.334+0000 7f7b1822a640 1 -- 172.21.15.99:0/3715141930 --> [v2:172.21.15.117:6800/1478846960,v1:172.21.15.117:6801/1478846960] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7b100fcda0 con 0x7f7afc074ae0 2024-09-19T06:36:55.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:55.335+0000 7f7b027fc640 1 -- 172.21.15.99:0/3715141930 <== osd.3 v2:172.21.15.117:6800/1478846960 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f7b100fcda0 con 0x7f7afc074ae0 2024-09-19T06:36:55.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:55.335+0000 7f7b1822a640 1 -- 172.21.15.99:0/3715141930 >> [v2:172.21.15.117:6800/1478846960,v1:172.21.15.117:6801/1478846960] conn(0x7f7afc074ae0 msgr2=0x7f7afc076ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:55.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:55.335+0000 7f7b1822a640 1 --2- 172.21.15.99:0/3715141930 >> [v2:172.21.15.117:6800/1478846960,v1:172.21.15.117:6801/1478846960] conn(0x7f7afc074ae0 0x7f7afc076ef0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:55.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:55.335+0000 7f7b1822a640 1 -- 172.21.15.99:0/3715141930 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f7afc06ed60 msgr2=0x7f7afc071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:55.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:55.335+0000 7f7b1822a640 1 --2- 172.21.15.99:0/3715141930 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f7afc06ed60 0x7f7afc071210 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7b10101930 tx=0x7f7b04035040 comp rx=0 tx=0).stop 2024-09-19T06:36:55.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:55.335+0000 7f7b1822a640 1 -- 172.21.15.99:0/3715141930 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b100fbd90 msgr2=0x7f7b10113270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:55.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:55.335+0000 7f7b1822a640 1 --2- 172.21.15.99:0/3715141930 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b100fbd90 0x7f7b10113270 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c00b790 tx=0x7f7b0c0091d0 comp rx=0 tx=0).stop 2024-09-19T06:36:55.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:55.335+0000 7f7b1822a640 1 -- 172.21.15.99:0/3715141930 shutdown_connections 2024-09-19T06:36:55.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:55.335+0000 7f7b1822a640 1 --2- 172.21.15.99:0/3715141930 >> [v2:172.21.15.117:6800/1478846960,v1:172.21.15.117:6801/1478846960] conn(0x7f7afc074ae0 0x7f7afc076ef0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:55.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:55.335+0000 7f7b1822a640 1 --2- 172.21.15.99:0/3715141930 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f7afc06ed60 0x7f7afc071210 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:55.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:55.335+0000 7f7b1822a640 1 --2- 172.21.15.99:0/3715141930 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b10100410 0x7f7b101137b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:55.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:55.335+0000 7f7b1822a640 1 --2- 172.21.15.99:0/3715141930 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b100fbd90 0x7f7b10113270 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:55.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:55.335+0000 7f7b1822a640 1 -- 172.21.15.99:0/3715141930 >> 172.21.15.99:0/3715141930 conn(0x7f7b10070ce0 msgr2=0x7f7b100fb510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:36:55.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:55.335+0000 7f7b1822a640 1 -- 172.21.15.99:0/3715141930 shutdown_connections 2024-09-19T06:36:55.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:55.335+0000 7f7b1822a640 1 -- 172.21.15.99:0/3715141930 wait complete. 2024-09-19T06:36:56.022 INFO:teuthology.orchestra.run.smithi099.stdout:115964117010 2024-09-19T06:36:56.023 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-19T06:36:56.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:56.183+0000 7f7f11819640 1 -- 172.21.15.99:0/2643761975 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f0c1014b0 msgr2=0x7f7f0c101880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:56.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:56.183+0000 7f7f11819640 1 --2- 172.21.15.99:0/2643761975 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f0c1014b0 0x7f7f0c101880 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7efc0048d0 tx=0x7f7efc009da0 comp rx=0 tx=0).stop 2024-09-19T06:36:56.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:56.183+0000 7f7f11819640 1 -- 172.21.15.99:0/2643761975 shutdown_connections 2024-09-19T06:36:56.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:56.183+0000 7f7f11819640 1 --2- 172.21.15.99:0/2643761975 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f0c0fb470 0x7f7f0c0fb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:56.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:56.183+0000 7f7f11819640 1 --2- 172.21.15.99:0/2643761975 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f0c1014b0 0x7f7f0c101880 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:56.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:56.183+0000 7f7f11819640 1 -- 172.21.15.99:0/2643761975 >> 172.21.15.99:0/2643761975 conn(0x7f7f0c0f7030 msgr2=0x7f7f0c0f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:36:56.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:56.183+0000 7f7f11819640 1 -- 172.21.15.99:0/2643761975 shutdown_connections 2024-09-19T06:36:56.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:56.183+0000 7f7f11819640 1 -- 172.21.15.99:0/2643761975 wait complete. 2024-09-19T06:36:56.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:56.184+0000 7f7f11819640 1 Processor -- start 2024-09-19T06:36:56.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:56.184+0000 7f7f11819640 1 -- start start 2024-09-19T06:36:56.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:56.184+0000 7f7f11819640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f0c0fb470 0x7f7f0c10e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:56.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:56.184+0000 7f7f11819640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f0c1014b0 0x7f7f0c10e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:56.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:56.184+0000 7f7f11819640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0c10ec80 con 0x7f7f0c1014b0 2024-09-19T06:36:56.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:56.184+0000 7f7f11819640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0c10edf0 con 0x7f7f0c0fb470 2024-09-19T06:36:56.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:56.184+0000 7f7f0a7fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f0c1014b0 0x7f7f0c10e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:56.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:56.185+0000 7f7f0a7fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f0c1014b0 0x7f7f0c10e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56528/0 (socket says 172.21.15.99:56528) 2024-09-19T06:36:56.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:56.185+0000 7f7f0a7fc640 1 -- 172.21.15.99:0/892583844 learned_addr learned my addr 172.21.15.99:0/892583844 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:36:56.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:56.185+0000 7f7f0affd640 1 --2- 172.21.15.99:0/892583844 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f0c0fb470 0x7f7f0c10e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:56.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:56.185+0000 7f7f0a7fc640 1 -- 172.21.15.99:0/892583844 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f0c0fb470 msgr2=0x7f7f0c10e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:56.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:56.185+0000 7f7f0a7fc640 1 --2- 172.21.15.99:0/892583844 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f0c0fb470 0x7f7f0c10e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:56.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:56.185+0000 7f7f0a7fc640 1 -- 172.21.15.99:0/892583844 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7efc005040 con 0x7f7f0c1014b0 2024-09-19T06:36:56.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:56.185+0000 7f7f0a7fc640 1 --2- 172.21.15.99:0/892583844 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f0c1014b0 0x7f7f0c10e680 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7f0000c830 tx=0x7f7f00004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:36:56.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:56.185+0000 7f7ef37fe640 1 -- 172.21.15.99:0/892583844 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f0000a7d0 con 0x7f7f0c1014b0 2024-09-19T06:36:56.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:56.185+0000 7f7ef37fe640 1 -- 172.21.15.99:0/892583844 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7f0000add0 con 0x7f7f0c1014b0 2024-09-19T06:36:56.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:56.185+0000 7f7f11819640 1 -- 172.21.15.99:0/892583844 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f0c1171b0 con 0x7f7f0c1014b0 2024-09-19T06:36:56.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:56.185+0000 7f7ef37fe640 1 -- 172.21.15.99:0/892583844 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f000113a0 con 0x7f7f0c1014b0 2024-09-19T06:36:56.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:56.185+0000 7f7f11819640 1 -- 172.21.15.99:0/892583844 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f0c1176f0 con 0x7f7f0c1014b0 2024-09-19T06:36:56.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:56.186+0000 7f7f11819640 1 -- 172.21.15.99:0/892583844 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f0c0fcbb0 con 0x7f7f0c1014b0 2024-09-19T06:36:56.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:56.187+0000 7f7ef37fe640 1 -- 172.21.15.99:0/892583844 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f7f00012400 con 0x7f7f0c1014b0 2024-09-19T06:36:56.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:56.187+0000 7f7ef37fe640 1 --2- 172.21.15.99:0/892583844 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f7ef406ed60 0x7f7ef4071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:56.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:56.188+0000 7f7ef37fe640 1 -- 172.21.15.99:0/892583844 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f7f0008df20 con 0x7f7f0c1014b0 2024-09-19T06:36:56.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:56.188+0000 7f7f0affd640 1 --2- 172.21.15.99:0/892583844 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f7ef406ed60 0x7f7ef4071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:56.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:56.188+0000 7f7f0affd640 1 --2- 172.21.15.99:0/892583844 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f7ef406ed60 0x7f7ef4071210 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7efc009ac0 tx=0x7f7efc035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:36:56.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:56.193+0000 7f7ef37fe640 1 -- 172.21.15.99:0/892583844 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f7f0005b4c0 con 0x7f7f0c1014b0 2024-09-19T06:36:56.297 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:56 smithi099 ceph-mon[27651]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:36:56.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:56.359+0000 7f7f11819640 1 -- 172.21.15.99:0/892583844 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7f0c0fac30 con 0x7f7f0c1014b0 2024-09-19T06:36:56.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:56.359+0000 7f7ef37fe640 1 -- 172.21.15.99:0/892583844 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7f0005ae60 con 0x7f7f0c1014b0 2024-09-19T06:36:56.361 INFO:teuthology.orchestra.run.smithi099.stdout:38654705697 2024-09-19T06:36:56.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:56.361+0000 7f7f11819640 1 -- 172.21.15.99:0/892583844 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f7ef406ed60 msgr2=0x7f7ef4071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:56.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:56.361+0000 7f7f11819640 1 --2- 172.21.15.99:0/892583844 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f7ef406ed60 0x7f7ef4071210 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7efc009ac0 tx=0x7f7efc035040 comp rx=0 tx=0).stop 2024-09-19T06:36:56.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:56.361+0000 7f7f11819640 1 -- 172.21.15.99:0/892583844 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f0c1014b0 msgr2=0x7f7f0c10e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:56.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:56.361+0000 7f7f11819640 1 --2- 172.21.15.99:0/892583844 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f0c1014b0 0x7f7f0c10e680 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7f0000c830 tx=0x7f7f00004430 comp rx=0 tx=0).stop 2024-09-19T06:36:56.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:56.361+0000 7f7f11819640 1 -- 172.21.15.99:0/892583844 shutdown_connections 2024-09-19T06:36:56.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:56.361+0000 7f7f11819640 1 --2- 172.21.15.99:0/892583844 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f7ef406ed60 0x7f7ef4071210 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:56.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:56.361+0000 7f7f11819640 1 --2- 172.21.15.99:0/892583844 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f0c1014b0 0x7f7f0c10e680 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:56.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:56.361+0000 7f7f11819640 1 --2- 172.21.15.99:0/892583844 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f0c0fb470 0x7f7f0c10e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:56.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:56.361+0000 7f7f11819640 1 -- 172.21.15.99:0/892583844 >> 172.21.15.99:0/892583844 conn(0x7f7f0c0f7030 msgr2=0x7f7f0c0f88e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:36:56.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:56.361+0000 7f7f11819640 1 -- 172.21.15.99:0/892583844 shutdown_connections 2024-09-19T06:36:56.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:56.361+0000 7f7f11819640 1 -- 172.21.15.99:0/892583844 wait complete. 2024-09-19T06:36:56.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:56 smithi117 ceph-mon[34564]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:36:57.276 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T06:36:57.373 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:57 smithi099 ceph-mon[27651]: from='client.? 172.21.15.99:0/892583844' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T06:36:57.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:57 smithi117 ceph-mon[34564]: from='client.? 172.21.15.99:0/892583844' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T06:36:57.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:57.944+0000 7fecd75a3640 1 -- 172.21.15.99:0/264664538 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fecd00fac80 msgr2=0x7fecd00fb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:57.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:57.944+0000 7fecd75a3640 1 --2- 172.21.15.99:0/264664538 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fecd00fac80 0x7fecd00fb0f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fecc00048d0 tx=0x7fecc0009da0 comp rx=0 tx=0).stop 2024-09-19T06:36:57.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:57.944+0000 7fecd75a3640 1 -- 172.21.15.99:0/264664538 shutdown_connections 2024-09-19T06:36:57.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:57.944+0000 7fecd75a3640 1 --2- 172.21.15.99:0/264664538 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fecd00fac80 0x7fecd00fb0f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:57.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:57.944+0000 7fecd75a3640 1 --2- 172.21.15.99:0/264664538 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fecd0102620 0x7fecd01029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:57.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:57.944+0000 7fecd75a3640 1 -- 172.21.15.99:0/264664538 >> 172.21.15.99:0/264664538 conn(0x7fecd0070ce0 msgr2=0x7fecd00710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:36:57.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:57.944+0000 7fecd75a3640 1 -- 172.21.15.99:0/264664538 shutdown_connections 2024-09-19T06:36:57.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:57.944+0000 7fecd75a3640 1 -- 172.21.15.99:0/264664538 wait complete. 2024-09-19T06:36:57.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:57.945+0000 7fecd75a3640 1 Processor -- start 2024-09-19T06:36:57.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:57.945+0000 7fecd75a3640 1 -- start start 2024-09-19T06:36:57.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:57.945+0000 7fecd75a3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fecd00fac80 0x7fecd0115410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:57.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:57.945+0000 7fecd75a3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fecd0102620 0x7fecd0115950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:57.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:57.945+0000 7fecd75a3640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd0115fe0 con 0x7fecd0102620 2024-09-19T06:36:57.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:57.945+0000 7fecd75a3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd010f3d0 con 0x7fecd00fac80 2024-09-19T06:36:57.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:57.945+0000 7fecd4b3e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fecd0102620 0x7fecd0115950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:57.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:57.945+0000 7fecd4b3e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fecd0102620 0x7fecd0115950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56542/0 (socket says 172.21.15.99:56542) 2024-09-19T06:36:57.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:57.945+0000 7fecd4b3e640 1 -- 172.21.15.99:0/4290412430 learned_addr learned my addr 172.21.15.99:0/4290412430 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:36:57.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:57.945+0000 7fecd4b3e640 1 -- 172.21.15.99:0/4290412430 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fecd00fac80 msgr2=0x7fecd0115410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:57.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:57.945+0000 7fecd533f640 1 --2- 172.21.15.99:0/4290412430 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fecd00fac80 0x7fecd0115410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:57.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:57.945+0000 7fecd4b3e640 1 --2- 172.21.15.99:0/4290412430 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fecd00fac80 0x7fecd0115410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:57.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:57.945+0000 7fecd4b3e640 1 -- 172.21.15.99:0/4290412430 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecc0005040 con 0x7fecd0102620 2024-09-19T06:36:57.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:57.945+0000 7fecd533f640 1 --2- 172.21.15.99:0/4290412430 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fecd00fac80 0x7fecd0115410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:36:57.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:57.946+0000 7fecd4b3e640 1 --2- 172.21.15.99:0/4290412430 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fecd0102620 0x7fecd0115950 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fecc0003080 tx=0x7fecc0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:36:57.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:57.946+0000 7fecc5ffb640 1 -- 172.21.15.99:0/4290412430 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fecc0038070 con 0x7fecd0102620 2024-09-19T06:36:57.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:57.946+0000 7fecc5ffb640 1 -- 172.21.15.99:0/4290412430 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fecc002ade0 con 0x7fecd0102620 2024-09-19T06:36:57.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:57.946+0000 7fecd75a3640 1 -- 172.21.15.99:0/4290412430 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecd010f650 con 0x7fecd0102620 2024-09-19T06:36:57.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:57.946+0000 7fecc5ffb640 1 -- 172.21.15.99:0/4290412430 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fecc002c880 con 0x7fecd0102620 2024-09-19T06:36:57.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:57.946+0000 7fecd75a3640 1 -- 172.21.15.99:0/4290412430 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecd010fab0 con 0x7fecd0102620 2024-09-19T06:36:57.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:57.947+0000 7fecd75a3640 1 -- 172.21.15.99:0/4290412430 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fecd010fff0 con 0x7fecd0102620 2024-09-19T06:36:57.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:57.947+0000 7fecc5ffb640 1 -- 172.21.15.99:0/4290412430 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fecc0030020 con 0x7fecd0102620 2024-09-19T06:36:57.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:57.948+0000 7fecc5ffb640 1 --2- 172.21.15.99:0/4290412430 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fecbc06ed50 0x7fecbc071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:57.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:57.948+0000 7fecc5ffb640 1 -- 172.21.15.99:0/4290412430 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fecc00ae4e0 con 0x7fecd0102620 2024-09-19T06:36:57.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:57.948+0000 7fecd533f640 1 --2- 172.21.15.99:0/4290412430 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fecbc06ed50 0x7fecbc071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:57.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:57.948+0000 7fecc5ffb640 1 --2- 172.21.15.99:0/4290412430 >> [v2:172.21.15.117:6808/2126129691,v1:172.21.15.117:6809/2126129691] conn(0x7fecbc074ad0 0x7fecbc076ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:36:57.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:57.948+0000 7fecc5ffb640 1 -- 172.21.15.99:0/4290412430 --> [v2:172.21.15.117:6808/2126129691,v1:172.21.15.117:6809/2126129691] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fecbc077590 con 0x7fecbc074ad0 2024-09-19T06:36:57.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:57.948+0000 7fecc5ffb640 1 -- 172.21.15.99:0/4290412430 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fecc00ae8c0 con 0x7fecd0102620 2024-09-19T06:36:57.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:57.948+0000 7fecd533f640 1 --2- 172.21.15.99:0/4290412430 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fecbc06ed50 0x7fecbc071200 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7feccc006fd0 tx=0x7feccc008040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:36:57.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:57.948+0000 7fecd5b40640 1 --2- 172.21.15.99:0/4290412430 >> [v2:172.21.15.117:6808/2126129691,v1:172.21.15.117:6809/2126129691] conn(0x7fecbc074ad0 0x7fecbc076ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:36:57.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:57.949+0000 7fecd5b40640 1 --2- 172.21.15.99:0/4290412430 >> [v2:172.21.15.117:6808/2126129691,v1:172.21.15.117:6809/2126129691] conn(0x7fecbc074ad0 0x7fecbc076ee0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:36:57.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:57.950+0000 7fecc5ffb640 1 -- 172.21.15.99:0/4290412430 <== osd.4 v2:172.21.15.117:6808/2126129691 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fecbc077590 con 0x7fecbc074ad0 2024-09-19T06:36:57.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:57.962+0000 7fecd75a3640 1 -- 172.21.15.99:0/4290412430 --> [v2:172.21.15.117:6808/2126129691,v1:172.21.15.117:6809/2126129691] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fecd005de10 con 0x7fecbc074ad0 2024-09-19T06:36:57.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:57.962+0000 7fecc5ffb640 1 -- 172.21.15.99:0/4290412430 <== osd.4 v2:172.21.15.117:6808/2126129691 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fecd005de10 con 0x7fecbc074ad0 2024-09-19T06:36:57.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:57.963+0000 7fecd75a3640 1 -- 172.21.15.99:0/4290412430 >> [v2:172.21.15.117:6808/2126129691,v1:172.21.15.117:6809/2126129691] conn(0x7fecbc074ad0 msgr2=0x7fecbc076ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:57.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:57.963+0000 7fecd75a3640 1 --2- 172.21.15.99:0/4290412430 >> [v2:172.21.15.117:6808/2126129691,v1:172.21.15.117:6809/2126129691] conn(0x7fecbc074ad0 0x7fecbc076ee0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:57.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:57.963+0000 7fecd75a3640 1 -- 172.21.15.99:0/4290412430 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fecbc06ed50 msgr2=0x7fecbc071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:57.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:57.963+0000 7fecd75a3640 1 --2- 172.21.15.99:0/4290412430 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fecbc06ed50 0x7fecbc071200 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7feccc006fd0 tx=0x7feccc008040 comp rx=0 tx=0).stop 2024-09-19T06:36:57.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:57.963+0000 7fecd75a3640 1 -- 172.21.15.99:0/4290412430 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fecd0102620 msgr2=0x7fecd0115950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:36:57.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:57.963+0000 7fecd75a3640 1 --2- 172.21.15.99:0/4290412430 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fecd0102620 0x7fecd0115950 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fecc0003080 tx=0x7fecc0009da0 comp rx=0 tx=0).stop 2024-09-19T06:36:57.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:57.963+0000 7fecd75a3640 1 -- 172.21.15.99:0/4290412430 shutdown_connections 2024-09-19T06:36:57.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:57.963+0000 7fecd75a3640 1 --2- 172.21.15.99:0/4290412430 >> [v2:172.21.15.117:6808/2126129691,v1:172.21.15.117:6809/2126129691] conn(0x7fecbc074ad0 0x7fecbc076ee0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:57.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:57.963+0000 7fecd75a3640 1 --2- 172.21.15.99:0/4290412430 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fecbc06ed50 0x7fecbc071200 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:57.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:57.963+0000 7fecd75a3640 1 --2- 172.21.15.99:0/4290412430 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fecd0102620 0x7fecd0115950 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:57.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:57.963+0000 7fecd75a3640 1 --2- 172.21.15.99:0/4290412430 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fecd00fac80 0x7fecd0115410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:36:57.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:57.963+0000 7fecd75a3640 1 -- 172.21.15.99:0/4290412430 >> 172.21.15.99:0/4290412430 conn(0x7fecd0070ce0 msgr2=0x7fecd0103360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:36:57.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:57.963+0000 7fecd75a3640 1 -- 172.21.15.99:0/4290412430 shutdown_connections 2024-09-19T06:36:57.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:36:57.963+0000 7fecd75a3640 1 -- 172.21.15.99:0/4290412430 wait complete. 2024-09-19T06:36:58.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:36:58 smithi099 ceph-mon[27651]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:36:58.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:36:58 smithi117 ceph-mon[34564]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:36:58.882 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705696 got 38654705697 for osd.0 2024-09-19T06:36:58.882 DEBUG:teuthology.parallel:result is None 2024-09-19T06:36:59.780 INFO:teuthology.orchestra.run.smithi099.stdout:141733920782 2024-09-19T06:36:59.781 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-19T06:37:00.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:00.116+0000 7f86b7f9d640 1 -- 172.21.15.99:0/645053288 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86b01014c0 msgr2=0x7f86b0101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:00.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:00.116+0000 7f86b7f9d640 1 --2- 172.21.15.99:0/645053288 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86b01014c0 0x7f86b0101890 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f86ac0048d0 tx=0x7f86ac009da0 comp rx=0 tx=0).stop 2024-09-19T06:37:00.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:00.116+0000 7f86b7f9d640 1 -- 172.21.15.99:0/645053288 shutdown_connections 2024-09-19T06:37:00.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:00.116+0000 7f86b7f9d640 1 --2- 172.21.15.99:0/645053288 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86b00fb480 0x7f86b00fb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:00.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:00.116+0000 7f86b7f9d640 1 --2- 172.21.15.99:0/645053288 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86b01014c0 0x7f86b0101890 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:00.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:00.116+0000 7f86b7f9d640 1 -- 172.21.15.99:0/645053288 >> 172.21.15.99:0/645053288 conn(0x7f86b00f7000 msgr2=0x7f86b00f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:00.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:00.117+0000 7f86b7f9d640 1 -- 172.21.15.99:0/645053288 shutdown_connections 2024-09-19T06:37:00.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:00.117+0000 7f86b7f9d640 1 -- 172.21.15.99:0/645053288 wait complete. 2024-09-19T06:37:00.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:00.117+0000 7f86b7f9d640 1 Processor -- start 2024-09-19T06:37:00.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:00.117+0000 7f86b7f9d640 1 -- start start 2024-09-19T06:37:00.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:00.117+0000 7f86b7f9d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86b00fb480 0x7f86b01120a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:00.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:00.117+0000 7f86b7f9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86b01014c0 0x7f86b01125e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:00.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:00.117+0000 7f86b7f9d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b0112be0 con 0x7f86b01014c0 2024-09-19T06:37:00.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:00.117+0000 7f86b7f9d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b010c020 con 0x7f86b00fb480 2024-09-19T06:37:00.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:00.118+0000 7f86b5538640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86b01014c0 0x7f86b01125e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:00.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:00.118+0000 7f86b5538640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86b01014c0 0x7f86b01125e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56564/0 (socket says 172.21.15.99:56564) 2024-09-19T06:37:00.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:00.118+0000 7f86b5538640 1 -- 172.21.15.99:0/1576637295 learned_addr learned my addr 172.21.15.99:0/1576637295 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:37:00.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:00.118+0000 7f86b5d39640 1 --2- 172.21.15.99:0/1576637295 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86b00fb480 0x7f86b01120a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:00.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:00.118+0000 7f86b5538640 1 -- 172.21.15.99:0/1576637295 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86b00fb480 msgr2=0x7f86b01120a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:00.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:00.118+0000 7f86b5538640 1 --2- 172.21.15.99:0/1576637295 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86b00fb480 0x7f86b01120a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:00.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:00.118+0000 7f86b5538640 1 -- 172.21.15.99:0/1576637295 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86ac005040 con 0x7f86b01014c0 2024-09-19T06:37:00.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:00.118+0000 7f86b5d39640 1 --2- 172.21.15.99:0/1576637295 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86b00fb480 0x7f86b01120a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:37:00.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:00.118+0000 7f86b5538640 1 --2- 172.21.15.99:0/1576637295 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86b01014c0 0x7f86b01125e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f86a000c830 tx=0x7f86a0004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:00.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:00.118+0000 7f86a67fc640 1 -- 172.21.15.99:0/1576637295 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f86a000a850 con 0x7f86b01014c0 2024-09-19T06:37:00.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:00.118+0000 7f86a67fc640 1 -- 172.21.15.99:0/1576637295 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f86a000ae50 con 0x7f86b01014c0 2024-09-19T06:37:00.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:00.118+0000 7f86b7f9d640 1 -- 172.21.15.99:0/1576637295 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86b010c300 con 0x7f86b01014c0 2024-09-19T06:37:00.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:00.118+0000 7f86a67fc640 1 -- 172.21.15.99:0/1576637295 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f86a00113a0 con 0x7f86b01014c0 2024-09-19T06:37:00.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:00.118+0000 7f86b7f9d640 1 -- 172.21.15.99:0/1576637295 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86b010c8a0 con 0x7f86b01014c0 2024-09-19T06:37:00.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:00.119+0000 7f86b7f9d640 1 -- 172.21.15.99:0/1576637295 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f86b010ce30 con 0x7f86b01014c0 2024-09-19T06:37:00.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:00.120+0000 7f86a67fc640 1 -- 172.21.15.99:0/1576637295 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f86a0012400 con 0x7f86b01014c0 2024-09-19T06:37:00.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:00.120+0000 7f86a67fc640 1 --2- 172.21.15.99:0/1576637295 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f869c06ed60 0x7f869c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:00.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:00.120+0000 7f86b5d39640 1 --2- 172.21.15.99:0/1576637295 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f869c06ed60 0x7f869c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:00.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:00.120+0000 7f86a67fc640 1 -- 172.21.15.99:0/1576637295 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f86a008df50 con 0x7f86b01014c0 2024-09-19T06:37:00.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:00.120+0000 7f86a67fc640 1 --2- 172.21.15.99:0/1576637295 >> [v2:172.21.15.117:6816/2126888000,v1:172.21.15.117:6817/2126888000] conn(0x7f869c074ae0 0x7f869c076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:00.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:00.120+0000 7f86a67fc640 1 -- 172.21.15.99:0/1576637295 --> [v2:172.21.15.117:6816/2126888000,v1:172.21.15.117:6817/2126888000] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f869c0775a0 con 0x7f869c074ae0 2024-09-19T06:37:00.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:00.120+0000 7f86a67fc640 1 -- 172.21.15.99:0/1576637295 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f86a0090560 con 0x7f86b01014c0 2024-09-19T06:37:00.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:00.120+0000 7f86b5d39640 1 --2- 172.21.15.99:0/1576637295 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f869c06ed60 0x7f869c071210 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f86ac007ac0 tx=0x7f86ac035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:00.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:00.120+0000 7f86b653a640 1 --2- 172.21.15.99:0/1576637295 >> [v2:172.21.15.117:6816/2126888000,v1:172.21.15.117:6817/2126888000] conn(0x7f869c074ae0 0x7f869c076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:00.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:00.121+0000 7f86b653a640 1 --2- 172.21.15.99:0/1576637295 >> [v2:172.21.15.117:6816/2126888000,v1:172.21.15.117:6817/2126888000] conn(0x7f869c074ae0 0x7f869c076ef0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:00.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:00.122+0000 7f86a67fc640 1 -- 172.21.15.99:0/1576637295 <== osd.5 v2:172.21.15.117:6816/2126888000 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f869c0775a0 con 0x7f869c074ae0 2024-09-19T06:37:00.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:00.134+0000 7f86b7f9d640 1 -- 172.21.15.99:0/1576637295 --> [v2:172.21.15.117:6816/2126888000,v1:172.21.15.117:6817/2126888000] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f86b00f9200 con 0x7f869c074ae0 2024-09-19T06:37:00.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:00.135+0000 7f86a67fc640 1 -- 172.21.15.99:0/1576637295 <== osd.5 v2:172.21.15.117:6816/2126888000 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f86b00f9200 con 0x7f869c074ae0 2024-09-19T06:37:00.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:00.135+0000 7f86b7f9d640 1 -- 172.21.15.99:0/1576637295 >> [v2:172.21.15.117:6816/2126888000,v1:172.21.15.117:6817/2126888000] conn(0x7f869c074ae0 msgr2=0x7f869c076ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:00.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:00.135+0000 7f86b7f9d640 1 --2- 172.21.15.99:0/1576637295 >> [v2:172.21.15.117:6816/2126888000,v1:172.21.15.117:6817/2126888000] conn(0x7f869c074ae0 0x7f869c076ef0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:00.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:00.135+0000 7f86b7f9d640 1 -- 172.21.15.99:0/1576637295 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f869c06ed60 msgr2=0x7f869c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:00.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:00.135+0000 7f86b7f9d640 1 --2- 172.21.15.99:0/1576637295 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f869c06ed60 0x7f869c071210 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f86ac007ac0 tx=0x7f86ac035040 comp rx=0 tx=0).stop 2024-09-19T06:37:00.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:00.135+0000 7f86b7f9d640 1 -- 172.21.15.99:0/1576637295 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86b01014c0 msgr2=0x7f86b01125e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:00.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:00.135+0000 7f86b7f9d640 1 --2- 172.21.15.99:0/1576637295 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86b01014c0 0x7f86b01125e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f86a000c830 tx=0x7f86a0004430 comp rx=0 tx=0).stop 2024-09-19T06:37:00.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:00.135+0000 7f86b7f9d640 1 -- 172.21.15.99:0/1576637295 shutdown_connections 2024-09-19T06:37:00.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:00.135+0000 7f86b7f9d640 1 --2- 172.21.15.99:0/1576637295 >> [v2:172.21.15.117:6816/2126888000,v1:172.21.15.117:6817/2126888000] conn(0x7f869c074ae0 0x7f869c076ef0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:00.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:00.135+0000 7f86b7f9d640 1 --2- 172.21.15.99:0/1576637295 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f869c06ed60 0x7f869c071210 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:00.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:00.135+0000 7f86b7f9d640 1 --2- 172.21.15.99:0/1576637295 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86b01014c0 0x7f86b01125e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:00.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:00.135+0000 7f86b7f9d640 1 --2- 172.21.15.99:0/1576637295 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86b00fb480 0x7f86b01120a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:00.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:00.135+0000 7f86b7f9d640 1 -- 172.21.15.99:0/1576637295 >> 172.21.15.99:0/1576637295 conn(0x7f86b00f7000 msgr2=0x7f86b00f88b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:00.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:00.135+0000 7f86b7f9d640 1 -- 172.21.15.99:0/1576637295 shutdown_connections 2024-09-19T06:37:00.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:00.135+0000 7f86b7f9d640 1 -- 172.21.15.99:0/1576637295 wait complete. 2024-09-19T06:37:00.443 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:00 smithi099 ceph-mon[27651]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:37:00.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:00 smithi117 ceph-mon[34564]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:37:00.851 INFO:teuthology.orchestra.run.smithi099.stdout:163208757258 2024-09-19T06:37:00.851 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-19T06:37:02.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:02 smithi117 ceph-mon[34564]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:37:02.453 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:02 smithi099 ceph-mon[27651]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:37:02.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:02.329+0000 7f8c1a429640 1 -- 172.21.15.99:0/3045504912 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c141014c0 msgr2=0x7f8c14101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:02.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:02.329+0000 7f8c1a429640 1 --2- 172.21.15.99:0/3045504912 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c141014c0 0x7f8c14101890 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8c040048d0 tx=0x7f8c04009da0 comp rx=0 tx=0).stop 2024-09-19T06:37:02.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:02.329+0000 7f8c1a429640 1 -- 172.21.15.99:0/3045504912 shutdown_connections 2024-09-19T06:37:02.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:02.329+0000 7f8c1a429640 1 --2- 172.21.15.99:0/3045504912 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c140fb480 0x7f8c140fb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:02.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:02.329+0000 7f8c1a429640 1 --2- 172.21.15.99:0/3045504912 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c141014c0 0x7f8c14101890 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:02.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:02.329+0000 7f8c1a429640 1 -- 172.21.15.99:0/3045504912 >> 172.21.15.99:0/3045504912 conn(0x7f8c140f7000 msgr2=0x7f8c140f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:02.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:02.329+0000 7f8c1a429640 1 -- 172.21.15.99:0/3045504912 shutdown_connections 2024-09-19T06:37:02.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:02.329+0000 7f8c1a429640 1 -- 172.21.15.99:0/3045504912 wait complete. 2024-09-19T06:37:02.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:02.330+0000 7f8c1a429640 1 Processor -- start 2024-09-19T06:37:02.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:02.330+0000 7f8c1a429640 1 -- start start 2024-09-19T06:37:02.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:02.330+0000 7f8c1a429640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c140fb480 0x7f8c14115430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:02.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:02.330+0000 7f8c1a429640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c141014c0 0x7f8c14115970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:02.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:02.330+0000 7f8c1a429640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c14115f70 con 0x7f8c140fb480 2024-09-19T06:37:02.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:02.330+0000 7f8c1a429640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c141160e0 con 0x7f8c141014c0 2024-09-19T06:37:02.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:02.330+0000 7f8c13fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c140fb480 0x7f8c14115430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:02.575 INFO:teuthology.orchestra.run.smithi099.stdout:81604378648 2024-09-19T06:37:02.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:02.330+0000 7f8c13fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c140fb480 0x7f8c14115430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56582/0 (socket says 172.21.15.99:56582) 2024-09-19T06:37:02.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:02.330+0000 7f8c13fff640 1 -- 172.21.15.99:0/351670123 learned_addr learned my addr 172.21.15.99:0/351670123 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:37:02.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:02.330+0000 7f8c137fe640 1 --2- 172.21.15.99:0/351670123 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c141014c0 0x7f8c14115970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:02.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:02.331+0000 7f8c137fe640 1 -- 172.21.15.99:0/351670123 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c140fb480 msgr2=0x7f8c14115430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:02.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:02.331+0000 7f8c137fe640 1 --2- 172.21.15.99:0/351670123 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c140fb480 0x7f8c14115430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:02.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:02.331+0000 7f8c137fe640 1 -- 172.21.15.99:0/351670123 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c04005040 con 0x7f8c141014c0 2024-09-19T06:37:02.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:02.331+0000 7f8c13fff640 1 --2- 172.21.15.99:0/351670123 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c140fb480 0x7f8c14115430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:37:02.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:02.331+0000 7f8c137fe640 1 --2- 172.21.15.99:0/351670123 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c141014c0 0x7f8c14115970 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8c080027d0 tx=0x7f8c08009f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:02.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:02.331+0000 7f8c10ff9640 1 -- 172.21.15.99:0/351670123 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c08007a20 con 0x7f8c141014c0 2024-09-19T06:37:02.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:02.331+0000 7f8c1a429640 1 -- 172.21.15.99:0/351670123 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c1410f560 con 0x7f8c141014c0 2024-09-19T06:37:02.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:02.332+0000 7f8c10ff9640 1 -- 172.21.15.99:0/351670123 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8c0800f040 con 0x7f8c141014c0 2024-09-19T06:37:02.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:02.332+0000 7f8c1a429640 1 -- 172.21.15.99:0/351670123 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c1410fa80 con 0x7f8c141014c0 2024-09-19T06:37:02.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:02.332+0000 7f8c10ff9640 1 -- 172.21.15.99:0/351670123 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c08009470 con 0x7f8c141014c0 2024-09-19T06:37:02.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:02.332+0000 7f8c1a429640 1 -- 172.21.15.99:0/351670123 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c140fcbc0 con 0x7f8c141014c0 2024-09-19T06:37:02.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:02.333+0000 7f8c10ff9640 1 -- 172.21.15.99:0/351670123 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f8c080096e0 con 0x7f8c141014c0 2024-09-19T06:37:02.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:02.333+0000 7f8c10ff9640 1 --2- 172.21.15.99:0/351670123 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f8bfc06ed60 0x7f8bfc071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:02.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:02.334+0000 7f8c10ff9640 1 -- 172.21.15.99:0/351670123 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f8c0808d500 con 0x7f8c141014c0 2024-09-19T06:37:02.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:02.334+0000 7f8c13fff640 1 --2- 172.21.15.99:0/351670123 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f8bfc06ed60 0x7f8bfc071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:02.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:02.334+0000 7f8c13fff640 1 --2- 172.21.15.99:0/351670123 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f8bfc06ed60 0x7f8bfc071210 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8c04004540 tx=0x7f8c04035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:02.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:02.338+0000 7f8c10ff9640 1 -- 172.21.15.99:0/351670123 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f8c0804d2a0 con 0x7f8c141014c0 2024-09-19T06:37:02.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:02.500+0000 7f8c1a429640 1 -- 172.21.15.99:0/351670123 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8c14108490 con 0x7f8c141014c0 2024-09-19T06:37:02.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:02.500+0000 7f8c10ff9640 1 -- 172.21.15.99:0/351670123 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8c0805aa10 con 0x7f8c141014c0 2024-09-19T06:37:02.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:02.502+0000 7f8c1a429640 1 -- 172.21.15.99:0/351670123 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f8bfc06ed60 msgr2=0x7f8bfc071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:02.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:02.502+0000 7f8c1a429640 1 --2- 172.21.15.99:0/351670123 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f8bfc06ed60 0x7f8bfc071210 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8c04004540 tx=0x7f8c04035040 comp rx=0 tx=0).stop 2024-09-19T06:37:02.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:02.502+0000 7f8c1a429640 1 -- 172.21.15.99:0/351670123 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c141014c0 msgr2=0x7f8c14115970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:02.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:02.502+0000 7f8c1a429640 1 --2- 172.21.15.99:0/351670123 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c141014c0 0x7f8c14115970 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8c080027d0 tx=0x7f8c08009f70 comp rx=0 tx=0).stop 2024-09-19T06:37:02.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:02.502+0000 7f8c1a429640 1 -- 172.21.15.99:0/351670123 shutdown_connections 2024-09-19T06:37:02.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:02.502+0000 7f8c1a429640 1 --2- 172.21.15.99:0/351670123 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f8bfc06ed60 0x7f8bfc071210 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:02.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:02.502+0000 7f8c1a429640 1 --2- 172.21.15.99:0/351670123 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c141014c0 0x7f8c14115970 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:02.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:02.502+0000 7f8c1a429640 1 --2- 172.21.15.99:0/351670123 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c140fb480 0x7f8c14115430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:02.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:02.502+0000 7f8c1a429640 1 -- 172.21.15.99:0/351670123 >> 172.21.15.99:0/351670123 conn(0x7f8c140f7000 msgr2=0x7f8c14065a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:02.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:02.502+0000 7f8c1a429640 1 -- 172.21.15.99:0/351670123 shutdown_connections 2024-09-19T06:37:02.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:02.502+0000 7f8c1a429640 1 -- 172.21.15.99:0/351670123 wait complete. 2024-09-19T06:37:02.798 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T06:37:03.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:03 smithi099 ceph-mon[27651]: from='client.? 172.21.15.99:0/351670123' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T06:37:03.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:03 smithi117 ceph-mon[34564]: from='client.? 172.21.15.99:0/351670123' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T06:37:03.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:03.212+0000 7f0d664d0640 1 -- 172.21.15.99:0/1255041994 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d600fb4a0 msgr2=0x7f0d600fb910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:03.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:03.212+0000 7f0d664d0640 1 --2- 172.21.15.99:0/1255041994 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d600fb4a0 0x7f0d600fb910 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0d540048d0 tx=0x7f0d54009da0 comp rx=0 tx=0).stop 2024-09-19T06:37:03.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:03.212+0000 7f0d664d0640 1 -- 172.21.15.99:0/1255041994 shutdown_connections 2024-09-19T06:37:03.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:03.212+0000 7f0d664d0640 1 --2- 172.21.15.99:0/1255041994 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d600fb4a0 0x7f0d600fb910 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:03.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:03.212+0000 7f0d664d0640 1 --2- 172.21.15.99:0/1255041994 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d601014e0 0x7f0d601018b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:03.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:03.212+0000 7f0d664d0640 1 -- 172.21.15.99:0/1255041994 >> 172.21.15.99:0/1255041994 conn(0x7f0d600f7060 msgr2=0x7f0d600f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:03.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:03.212+0000 7f0d664d0640 1 -- 172.21.15.99:0/1255041994 shutdown_connections 2024-09-19T06:37:03.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:03.212+0000 7f0d664d0640 1 -- 172.21.15.99:0/1255041994 wait complete. 2024-09-19T06:37:03.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:03.212+0000 7f0d664d0640 1 Processor -- start 2024-09-19T06:37:03.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:03.212+0000 7f0d664d0640 1 -- start start 2024-09-19T06:37:03.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:03.213+0000 7f0d664d0640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d600fb4a0 0x7f0d601153f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:03.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:03.213+0000 7f0d664d0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d601014e0 0x7f0d60115930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:03.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:03.213+0000 7f0d664d0640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d60115f30 con 0x7f0d600fb4a0 2024-09-19T06:37:03.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:03.213+0000 7f0d664d0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d601160a0 con 0x7f0d601014e0 2024-09-19T06:37:03.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:03.213+0000 7f0d5ffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d600fb4a0 0x7f0d601153f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:03.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:03.213+0000 7f0d5ffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d600fb4a0 0x7f0d601153f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56608/0 (socket says 172.21.15.99:56608) 2024-09-19T06:37:03.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:03.213+0000 7f0d5ffff640 1 -- 172.21.15.99:0/3722569103 learned_addr learned my addr 172.21.15.99:0/3722569103 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:37:03.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:03.213+0000 7f0d5f7fe640 1 --2- 172.21.15.99:0/3722569103 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d601014e0 0x7f0d60115930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:03.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:03.213+0000 7f0d5ffff640 1 -- 172.21.15.99:0/3722569103 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d601014e0 msgr2=0x7f0d60115930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:03.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:03.213+0000 7f0d5ffff640 1 --2- 172.21.15.99:0/3722569103 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d601014e0 0x7f0d60115930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:03.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:03.213+0000 7f0d5ffff640 1 -- 172.21.15.99:0/3722569103 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d54005040 con 0x7f0d600fb4a0 2024-09-19T06:37:03.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:03.213+0000 7f0d5f7fe640 1 --2- 172.21.15.99:0/3722569103 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d601014e0 0x7f0d60115930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:37:03.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:03.213+0000 7f0d5ffff640 1 --2- 172.21.15.99:0/3722569103 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d600fb4a0 0x7f0d601153f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0d50002a50 tx=0x7f0d50004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:03.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:03.213+0000 7f0d5cff9640 1 -- 172.21.15.99:0/3722569103 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d50007c30 con 0x7f0d600fb4a0 2024-09-19T06:37:03.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:03.213+0000 7f0d664d0640 1 -- 172.21.15.99:0/3722569103 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d6010f520 con 0x7f0d600fb4a0 2024-09-19T06:37:03.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:03.213+0000 7f0d664d0640 1 -- 172.21.15.99:0/3722569103 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d6010fa40 con 0x7f0d600fb4a0 2024-09-19T06:37:03.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:03.214+0000 7f0d5cff9640 1 -- 172.21.15.99:0/3722569103 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0d5000f040 con 0x7f0d600fb4a0 2024-09-19T06:37:03.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:03.214+0000 7f0d5cff9640 1 -- 172.21.15.99:0/3722569103 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d500094d0 con 0x7f0d600fb4a0 2024-09-19T06:37:03.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:03.214+0000 7f0d664d0640 1 -- 172.21.15.99:0/3722569103 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0d6010ffb0 con 0x7f0d600fb4a0 2024-09-19T06:37:03.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:03.215+0000 7f0d5cff9640 1 -- 172.21.15.99:0/3722569103 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f0d50009630 con 0x7f0d600fb4a0 2024-09-19T06:37:03.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:03.215+0000 7f0d5cff9640 1 --2- 172.21.15.99:0/3722569103 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f0d4806ed60 0x7f0d48071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:03.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:03.216+0000 7f0d5cff9640 1 -- 172.21.15.99:0/3722569103 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f0d5008ddd0 con 0x7f0d600fb4a0 2024-09-19T06:37:03.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:03.216+0000 7f0d5f7fe640 1 --2- 172.21.15.99:0/3722569103 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f0d4806ed60 0x7f0d48071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:03.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:03.216+0000 7f0d5cff9640 1 --2- 172.21.15.99:0/3722569103 >> [v2:172.21.15.99:6810/1205097168,v1:172.21.15.99:6811/1205097168] conn(0x7f0d48074ae0 0x7f0d48076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:03.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:03.216+0000 7f0d5cff9640 1 -- 172.21.15.99:0/3722569103 --> [v2:172.21.15.99:6810/1205097168,v1:172.21.15.99:6811/1205097168] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0d480775a0 con 0x7f0d48074ae0 2024-09-19T06:37:03.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:03.216+0000 7f0d5cff9640 1 -- 172.21.15.99:0/3722569103 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d50093430 con 0x7f0d600fb4a0 2024-09-19T06:37:03.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:03.216+0000 7f0d64a6d640 1 --2- 172.21.15.99:0/3722569103 >> [v2:172.21.15.99:6810/1205097168,v1:172.21.15.99:6811/1205097168] conn(0x7f0d48074ae0 0x7f0d48076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:03.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:03.216+0000 7f0d5f7fe640 1 --2- 172.21.15.99:0/3722569103 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f0d4806ed60 0x7f0d48071210 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0d5400b020 tx=0x7f0d54009da0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:03.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:03.216+0000 7f0d64a6d640 1 --2- 172.21.15.99:0/3722569103 >> [v2:172.21.15.99:6810/1205097168,v1:172.21.15.99:6811/1205097168] conn(0x7f0d48074ae0 0x7f0d48076ef0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:03.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:03.217+0000 7f0d5cff9640 1 -- 172.21.15.99:0/3722569103 <== osd.1 v2:172.21.15.99:6810/1205097168 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f0d480775a0 con 0x7f0d48074ae0 2024-09-19T06:37:03.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:03.237+0000 7f0d664d0640 1 -- 172.21.15.99:0/3722569103 --> [v2:172.21.15.99:6810/1205097168,v1:172.21.15.99:6811/1205097168] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0d600fcbe0 con 0x7f0d48074ae0 2024-09-19T06:37:03.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:03.237+0000 7f0d5cff9640 1 -- 172.21.15.99:0/3722569103 <== osd.1 v2:172.21.15.99:6810/1205097168 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0d600fcbe0 con 0x7f0d48074ae0 2024-09-19T06:37:03.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:03.238+0000 7f0d664d0640 1 -- 172.21.15.99:0/3722569103 >> [v2:172.21.15.99:6810/1205097168,v1:172.21.15.99:6811/1205097168] conn(0x7f0d48074ae0 msgr2=0x7f0d48076ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:03.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:03.238+0000 7f0d664d0640 1 --2- 172.21.15.99:0/3722569103 >> [v2:172.21.15.99:6810/1205097168,v1:172.21.15.99:6811/1205097168] conn(0x7f0d48074ae0 0x7f0d48076ef0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:03.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:03.238+0000 7f0d664d0640 1 -- 172.21.15.99:0/3722569103 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f0d4806ed60 msgr2=0x7f0d48071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:03.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:03.238+0000 7f0d664d0640 1 --2- 172.21.15.99:0/3722569103 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f0d4806ed60 0x7f0d48071210 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0d5400b020 tx=0x7f0d54009da0 comp rx=0 tx=0).stop 2024-09-19T06:37:03.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:03.238+0000 7f0d664d0640 1 -- 172.21.15.99:0/3722569103 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d600fb4a0 msgr2=0x7f0d601153f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:03.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:03.238+0000 7f0d664d0640 1 --2- 172.21.15.99:0/3722569103 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d600fb4a0 0x7f0d601153f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0d50002a50 tx=0x7f0d50004600 comp rx=0 tx=0).stop 2024-09-19T06:37:03.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:03.238+0000 7f0d664d0640 1 -- 172.21.15.99:0/3722569103 shutdown_connections 2024-09-19T06:37:03.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:03.238+0000 7f0d664d0640 1 --2- 172.21.15.99:0/3722569103 >> [v2:172.21.15.99:6810/1205097168,v1:172.21.15.99:6811/1205097168] conn(0x7f0d48074ae0 0x7f0d48076ef0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:03.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:03.238+0000 7f0d664d0640 1 --2- 172.21.15.99:0/3722569103 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f0d4806ed60 0x7f0d48071210 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:03.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:03.238+0000 7f0d664d0640 1 --2- 172.21.15.99:0/3722569103 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d601014e0 0x7f0d60115930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:03.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:03.238+0000 7f0d664d0640 1 --2- 172.21.15.99:0/3722569103 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d600fb4a0 0x7f0d601153f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:03.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:03.238+0000 7f0d664d0640 1 -- 172.21.15.99:0/3722569103 >> 172.21.15.99:0/3722569103 conn(0x7f0d600f7060 msgr2=0x7f0d600f7ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:03.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:03.238+0000 7f0d664d0640 1 -- 172.21.15.99:0/3722569103 shutdown_connections 2024-09-19T06:37:03.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:03.238+0000 7f0d664d0640 1 -- 172.21.15.99:0/3722569103 wait complete. 2024-09-19T06:37:03.888 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T06:37:03.888 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T06:37:04.272 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:04 smithi099 ceph-mon[27651]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:37:04.391 INFO:teuthology.orchestra.run.smithi099.stdout:60129542174 2024-09-19T06:37:04.392 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-19T06:37:04.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:04 smithi117 ceph-mon[34564]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:37:05.184 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378646 got 81604378648 for osd.2 2024-09-19T06:37:05.184 DEBUG:teuthology.parallel:result is None 2024-09-19T06:37:05.193 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T06:37:05.450 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:05 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:37:05.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:05 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:37:06.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:06 smithi099 ceph-mon[27651]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:37:06.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:06 smithi117 ceph-mon[34564]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:37:07.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:07.061+0000 7f6d3417d640 1 -- 172.21.15.99:0/491569044 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6d2c102ed0 msgr2=0x7f6d2c0fc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:07.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:07.061+0000 7f6d3417d640 1 --2- 172.21.15.99:0/491569044 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6d2c102ed0 0x7f6d2c0fc590 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6d200048d0 tx=0x7f6d20009da0 comp rx=0 tx=0).stop 2024-09-19T06:37:07.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:07.061+0000 7f6d3417d640 1 -- 172.21.15.99:0/491569044 shutdown_connections 2024-09-19T06:37:07.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:07.061+0000 7f6d3417d640 1 --2- 172.21.15.99:0/491569044 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6d2c102ed0 0x7f6d2c0fc590 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:07.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:07.061+0000 7f6d3417d640 1 --2- 172.21.15.99:0/491569044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d2c102530 0x7f6d2c102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:07.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:07.061+0000 7f6d3417d640 1 -- 172.21.15.99:0/491569044 >> 172.21.15.99:0/491569044 conn(0x7f6d2c0f80f0 msgr2=0x7f6d2c0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:07.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:07.061+0000 7f6d3417d640 1 -- 172.21.15.99:0/491569044 shutdown_connections 2024-09-19T06:37:07.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:07.061+0000 7f6d3417d640 1 -- 172.21.15.99:0/491569044 wait complete. 2024-09-19T06:37:07.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:07.061+0000 7f6d3417d640 1 Processor -- start 2024-09-19T06:37:07.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:07.061+0000 7f6d3417d640 1 -- start start 2024-09-19T06:37:07.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:07.062+0000 7f6d3417d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d2c102530 0x7f6d2c1132b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:07.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:07.062+0000 7f6d3417d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6d2c102ed0 0x7f6d2c1137f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:07.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:07.062+0000 7f6d3417d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2c113e80 con 0x7f6d2c102ed0 2024-09-19T06:37:07.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:07.062+0000 7f6d3417d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2c10d230 con 0x7f6d2c102530 2024-09-19T06:37:07.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:07.062+0000 7f6d31718640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6d2c102ed0 0x7f6d2c1137f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:07.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:07.062+0000 7f6d31718640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6d2c102ed0 0x7f6d2c1137f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50824/0 (socket says 172.21.15.99:50824) 2024-09-19T06:37:07.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:07.062+0000 7f6d31718640 1 -- 172.21.15.99:0/2779380626 learned_addr learned my addr 172.21.15.99:0/2779380626 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:37:07.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:07.062+0000 7f6d31f19640 1 --2- 172.21.15.99:0/2779380626 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d2c102530 0x7f6d2c1132b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:07.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:07.062+0000 7f6d31718640 1 -- 172.21.15.99:0/2779380626 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d2c102530 msgr2=0x7f6d2c1132b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:07.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:07.062+0000 7f6d31718640 1 --2- 172.21.15.99:0/2779380626 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d2c102530 0x7f6d2c1132b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:07.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:07.062+0000 7f6d31718640 1 -- 172.21.15.99:0/2779380626 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d20005040 con 0x7f6d2c102ed0 2024-09-19T06:37:07.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:07.062+0000 7f6d31f19640 1 --2- 172.21.15.99:0/2779380626 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d2c102530 0x7f6d2c1132b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:37:07.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:07.062+0000 7f6d31718640 1 --2- 172.21.15.99:0/2779380626 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6d2c102ed0 0x7f6d2c1137f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6d20003080 tx=0x7f6d20009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:07.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:07.062+0000 7f6d2a7fc640 1 -- 172.21.15.99:0/2779380626 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d20038070 con 0x7f6d2c102ed0 2024-09-19T06:37:07.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:07.062+0000 7f6d3417d640 1 -- 172.21.15.99:0/2779380626 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d2c10d4b0 con 0x7f6d2c102ed0 2024-09-19T06:37:07.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:07.062+0000 7f6d2a7fc640 1 -- 172.21.15.99:0/2779380626 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6d20009760 con 0x7f6d2c102ed0 2024-09-19T06:37:07.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:07.062+0000 7f6d2a7fc640 1 -- 172.21.15.99:0/2779380626 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d2003d420 con 0x7f6d2c102ed0 2024-09-19T06:37:07.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:07.062+0000 7f6d3417d640 1 -- 172.21.15.99:0/2779380626 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d2c10d970 con 0x7f6d2c102ed0 2024-09-19T06:37:07.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:07.063+0000 7f6d3417d640 1 -- 172.21.15.99:0/2779380626 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d2c0fdcb0 con 0x7f6d2c102ed0 2024-09-19T06:37:07.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:07.064+0000 7f6d2a7fc640 1 -- 172.21.15.99:0/2779380626 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f6d20030020 con 0x7f6d2c102ed0 2024-09-19T06:37:07.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:07.064+0000 7f6d2a7fc640 1 --2- 172.21.15.99:0/2779380626 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f6d1406ed50 0x7f6d14071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:07.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:07.065+0000 7f6d2a7fc640 1 -- 172.21.15.99:0/2779380626 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f6d200ae360 con 0x7f6d2c102ed0 2024-09-19T06:37:07.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:07.065+0000 7f6d31f19640 1 --2- 172.21.15.99:0/2779380626 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f6d1406ed50 0x7f6d14071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:07.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:07.065+0000 7f6d31f19640 1 --2- 172.21.15.99:0/2779380626 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f6d1406ed50 0x7f6d14071200 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6d24006fd0 tx=0x7f6d24008040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:07.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:07.069+0000 7f6d2a7fc640 1 -- 172.21.15.99:0/2779380626 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f6d2007b7c0 con 0x7f6d2c102ed0 2024-09-19T06:37:07.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:07.231+0000 7f6d3417d640 1 -- 172.21.15.99:0/2779380626 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6d2c109620 con 0x7f6d2c102ed0 2024-09-19T06:37:07.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:07.231+0000 7f6d2a7fc640 1 -- 172.21.15.99:0/2779380626 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6d2007b160 con 0x7f6d2c102ed0 2024-09-19T06:37:07.233 INFO:teuthology.orchestra.run.smithi099.stdout:115964117013 2024-09-19T06:37:07.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:07.233+0000 7f6d3417d640 1 -- 172.21.15.99:0/2779380626 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f6d1406ed50 msgr2=0x7f6d14071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:07.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:07.233+0000 7f6d3417d640 1 --2- 172.21.15.99:0/2779380626 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f6d1406ed50 0x7f6d14071200 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6d24006fd0 tx=0x7f6d24008040 comp rx=0 tx=0).stop 2024-09-19T06:37:07.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:07.233+0000 7f6d3417d640 1 -- 172.21.15.99:0/2779380626 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6d2c102ed0 msgr2=0x7f6d2c1137f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:07.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:07.233+0000 7f6d3417d640 1 --2- 172.21.15.99:0/2779380626 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6d2c102ed0 0x7f6d2c1137f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6d20003080 tx=0x7f6d20009da0 comp rx=0 tx=0).stop 2024-09-19T06:37:07.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:07.233+0000 7f6d3417d640 1 -- 172.21.15.99:0/2779380626 shutdown_connections 2024-09-19T06:37:07.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:07.233+0000 7f6d3417d640 1 --2- 172.21.15.99:0/2779380626 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f6d1406ed50 0x7f6d14071200 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:07.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:07.233+0000 7f6d3417d640 1 --2- 172.21.15.99:0/2779380626 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6d2c102ed0 0x7f6d2c1137f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:07.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:07.233+0000 7f6d3417d640 1 --2- 172.21.15.99:0/2779380626 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d2c102530 0x7f6d2c1132b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:07.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:07.233+0000 7f6d3417d640 1 -- 172.21.15.99:0/2779380626 >> 172.21.15.99:0/2779380626 conn(0x7f6d2c0f80f0 msgr2=0x7f6d2c0f9130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:07.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:07.234+0000 7f6d3417d640 1 -- 172.21.15.99:0/2779380626 shutdown_connections 2024-09-19T06:37:07.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:07.234+0000 7f6d3417d640 1 -- 172.21.15.99:0/2779380626 wait complete. 2024-09-19T06:37:08.153 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:08 smithi099 ceph-mon[27651]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:37:08.153 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:08 smithi099 ceph-mon[27651]: from='client.? 172.21.15.99:0/2779380626' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T06:37:08.178 INFO:tasks.cephadm.ceph_manager.ceph:need seq 115964117010 got 115964117013 for osd.3 2024-09-19T06:37:08.178 DEBUG:teuthology.parallel:result is None 2024-09-19T06:37:08.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:08 smithi117 ceph-mon[34564]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:37:08.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:08 smithi117 ceph-mon[34564]: from='client.? 172.21.15.99:0/2779380626' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T06:37:09.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:09.676+0000 7f186715f640 1 -- 172.21.15.99:0/3202470602 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f18600fac80 msgr2=0x7f18600fb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:09.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:09.676+0000 7f186715f640 1 --2- 172.21.15.99:0/3202470602 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f18600fac80 0x7f18600fb0f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f18500048d0 tx=0x7f1850009da0 comp rx=0 tx=0).stop 2024-09-19T06:37:09.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:09.676+0000 7f186715f640 1 -- 172.21.15.99:0/3202470602 shutdown_connections 2024-09-19T06:37:09.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:09.676+0000 7f186715f640 1 --2- 172.21.15.99:0/3202470602 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f18600fac80 0x7f18600fb0f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:09.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:09.676+0000 7f186715f640 1 --2- 172.21.15.99:0/3202470602 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1860102620 0x7f18601029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:09.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:09.676+0000 7f186715f640 1 -- 172.21.15.99:0/3202470602 >> 172.21.15.99:0/3202470602 conn(0x7f1860070ce0 msgr2=0x7f18600710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:09.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:09.676+0000 7f186715f640 1 -- 172.21.15.99:0/3202470602 shutdown_connections 2024-09-19T06:37:09.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:09.676+0000 7f186715f640 1 -- 172.21.15.99:0/3202470602 wait complete. 2024-09-19T06:37:09.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:09.677+0000 7f186715f640 1 Processor -- start 2024-09-19T06:37:09.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:09.677+0000 7f186715f640 1 -- start start 2024-09-19T06:37:09.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:09.677+0000 7f186715f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18600fac80 0x7f18601131e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:09.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:09.677+0000 7f186715f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1860102620 0x7f1860113720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:09.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:09.677+0000 7f186715f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1860113d20 con 0x7f1860102620 2024-09-19T06:37:09.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:09.677+0000 7f186715f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f186010d160 con 0x7f18600fac80 2024-09-19T06:37:09.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:09.677+0000 7f1857fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1860102620 0x7f1860113720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:09.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:09.677+0000 7f1857fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1860102620 0x7f1860113720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50838/0 (socket says 172.21.15.99:50838) 2024-09-19T06:37:09.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:09.677+0000 7f1857fff640 1 -- 172.21.15.99:0/1981965870 learned_addr learned my addr 172.21.15.99:0/1981965870 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:37:09.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:09.677+0000 7f1864efb640 1 --2- 172.21.15.99:0/1981965870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18600fac80 0x7f18601131e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:09.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:09.677+0000 7f1857fff640 1 -- 172.21.15.99:0/1981965870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18600fac80 msgr2=0x7f18601131e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:09.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:09.677+0000 7f1857fff640 1 --2- 172.21.15.99:0/1981965870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18600fac80 0x7f18601131e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:09.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:09.677+0000 7f1857fff640 1 -- 172.21.15.99:0/1981965870 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1850005040 con 0x7f1860102620 2024-09-19T06:37:09.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:09.677+0000 7f1864efb640 1 --2- 172.21.15.99:0/1981965870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18600fac80 0x7f18601131e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:37:09.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:09.678+0000 7f1857fff640 1 --2- 172.21.15.99:0/1981965870 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1860102620 0x7f1860113720 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1850000c00 tx=0x7f1850009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:09.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:09.678+0000 7f18557fa640 1 -- 172.21.15.99:0/1981965870 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1850038070 con 0x7f1860102620 2024-09-19T06:37:09.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:09.678+0000 7f18557fa640 1 -- 172.21.15.99:0/1981965870 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f185002ade0 con 0x7f1860102620 2024-09-19T06:37:09.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:09.678+0000 7f186715f640 1 -- 172.21.15.99:0/1981965870 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f186010d3e0 con 0x7f1860102620 2024-09-19T06:37:09.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:09.678+0000 7f18557fa640 1 -- 172.21.15.99:0/1981965870 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f185002c7e0 con 0x7f1860102620 2024-09-19T06:37:09.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:09.678+0000 7f186715f640 1 -- 172.21.15.99:0/1981965870 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f186010d920 con 0x7f1860102620 2024-09-19T06:37:09.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:09.679+0000 7f186715f640 1 -- 172.21.15.99:0/1981965870 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18600657b0 con 0x7f1860102620 2024-09-19T06:37:09.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:09.679+0000 7f18557fa640 1 -- 172.21.15.99:0/1981965870 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f1850030020 con 0x7f1860102620 2024-09-19T06:37:09.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:09.680+0000 7f18557fa640 1 --2- 172.21.15.99:0/1981965870 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f184806ed60 0x7f1848071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:09.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:09.680+0000 7f18557fa640 1 -- 172.21.15.99:0/1981965870 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f18500ada00 con 0x7f1860102620 2024-09-19T06:37:09.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:09.680+0000 7f1864efb640 1 --2- 172.21.15.99:0/1981965870 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f184806ed60 0x7f1848071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:09.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:09.680+0000 7f1864efb640 1 --2- 172.21.15.99:0/1981965870 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f184806ed60 0x7f1848071210 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f185c007fd0 tx=0x7f185c009e90 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:09.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:09.684+0000 7f18557fa640 1 -- 172.21.15.99:0/1981965870 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f185007af90 con 0x7f1860102620 2024-09-19T06:37:09.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:09.845+0000 7f186715f640 1 -- 172.21.15.99:0/1981965870 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1860109590 con 0x7f1860102620 2024-09-19T06:37:09.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:09.845+0000 7f18557fa640 1 -- 172.21.15.99:0/1981965870 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f185007a930 con 0x7f1860102620 2024-09-19T06:37:09.847 INFO:teuthology.orchestra.run.smithi099.stdout:60129542175 2024-09-19T06:37:09.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:09.847+0000 7f186715f640 1 -- 172.21.15.99:0/1981965870 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f184806ed60 msgr2=0x7f1848071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:09.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:09.847+0000 7f186715f640 1 --2- 172.21.15.99:0/1981965870 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f184806ed60 0x7f1848071210 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f185c007fd0 tx=0x7f185c009e90 comp rx=0 tx=0).stop 2024-09-19T06:37:09.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:09.847+0000 7f186715f640 1 -- 172.21.15.99:0/1981965870 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1860102620 msgr2=0x7f1860113720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:09.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:09.847+0000 7f186715f640 1 --2- 172.21.15.99:0/1981965870 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1860102620 0x7f1860113720 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1850000c00 tx=0x7f1850009da0 comp rx=0 tx=0).stop 2024-09-19T06:37:09.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:09.847+0000 7f186715f640 1 -- 172.21.15.99:0/1981965870 shutdown_connections 2024-09-19T06:37:09.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:09.847+0000 7f186715f640 1 --2- 172.21.15.99:0/1981965870 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f184806ed60 0x7f1848071210 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:09.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:09.847+0000 7f186715f640 1 --2- 172.21.15.99:0/1981965870 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1860102620 0x7f1860113720 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:09.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:09.847+0000 7f186715f640 1 --2- 172.21.15.99:0/1981965870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18600fac80 0x7f18601131e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:09.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:09.847+0000 7f186715f640 1 -- 172.21.15.99:0/1981965870 >> 172.21.15.99:0/1981965870 conn(0x7f1860070ce0 msgr2=0x7f1860105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:09.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:09.847+0000 7f186715f640 1 -- 172.21.15.99:0/1981965870 shutdown_connections 2024-09-19T06:37:09.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:09.847+0000 7f186715f640 1 -- 172.21.15.99:0/1981965870 wait complete. 2024-09-19T06:37:10.359 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:10 smithi099 ceph-mon[27651]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:37:10.359 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:10 smithi099 ceph-mon[27651]: from='client.? 172.21.15.99:0/1981965870' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T06:37:10.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:10 smithi117 ceph-mon[34564]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:37:10.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:10 smithi117 ceph-mon[34564]: from='client.? 172.21.15.99:0/1981965870' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T06:37:10.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:10.622+0000 7f194a309640 1 -- 172.21.15.99:0/530557549 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1944102f20 msgr2=0x7f19440fc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:10.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:10.622+0000 7f194a309640 1 --2- 172.21.15.99:0/530557549 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1944102f20 0x7f19440fc5e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f19380048d0 tx=0x7f1938009da0 comp rx=0 tx=0).stop 2024-09-19T06:37:10.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:10.622+0000 7f194a309640 1 -- 172.21.15.99:0/530557549 shutdown_connections 2024-09-19T06:37:10.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:10.622+0000 7f194a309640 1 --2- 172.21.15.99:0/530557549 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1944102f20 0x7f19440fc5e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:10.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:10.622+0000 7f194a309640 1 --2- 172.21.15.99:0/530557549 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1944102580 0x7f1944102950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:10.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:10.622+0000 7f194a309640 1 -- 172.21.15.99:0/530557549 >> 172.21.15.99:0/530557549 conn(0x7f19440f81a0 msgr2=0x7f19440fa5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:10.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:10.622+0000 7f194a309640 1 -- 172.21.15.99:0/530557549 shutdown_connections 2024-09-19T06:37:10.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:10.622+0000 7f194a309640 1 -- 172.21.15.99:0/530557549 wait complete. 2024-09-19T06:37:10.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:10.623+0000 7f194a309640 1 Processor -- start 2024-09-19T06:37:10.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:10.623+0000 7f194a309640 1 -- start start 2024-09-19T06:37:10.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:10.623+0000 7f194a309640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1944102580 0x7f194406fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:10.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:10.623+0000 7f194a309640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1944102f20 0x7f194406ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:10.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:10.623+0000 7f194a309640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1944070520 con 0x7f1944102580 2024-09-19T06:37:10.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:10.623+0000 7f194a309640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1944070690 con 0x7f1944102f20 2024-09-19T06:37:10.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:10.623+0000 7f1943fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1944102580 0x7f194406fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:10.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:10.623+0000 7f1943fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1944102580 0x7f194406fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50864/0 (socket says 172.21.15.99:50864) 2024-09-19T06:37:10.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:10.623+0000 7f1943fff640 1 -- 172.21.15.99:0/427561656 learned_addr learned my addr 172.21.15.99:0/427561656 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:37:10.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:10.623+0000 7f19437fe640 1 --2- 172.21.15.99:0/427561656 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1944102f20 0x7f194406ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:10.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:10.623+0000 7f1943fff640 1 -- 172.21.15.99:0/427561656 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1944102f20 msgr2=0x7f194406ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:10.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:10.623+0000 7f1943fff640 1 --2- 172.21.15.99:0/427561656 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1944102f20 0x7f194406ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:10.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:10.623+0000 7f1943fff640 1 -- 172.21.15.99:0/427561656 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1938005040 con 0x7f1944102580 2024-09-19T06:37:10.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:10.623+0000 7f1943fff640 1 --2- 172.21.15.99:0/427561656 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1944102580 0x7f194406fa10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f193400b790 tx=0x7f19340091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:10.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:10.624+0000 7f1940ff9640 1 -- 172.21.15.99:0/427561656 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f193400c700 con 0x7f1944102580 2024-09-19T06:37:10.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:10.624+0000 7f1940ff9640 1 -- 172.21.15.99:0/427561656 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f193400cd00 con 0x7f1944102580 2024-09-19T06:37:10.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:10.624+0000 7f194a309640 1 -- 172.21.15.99:0/427561656 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19441195c0 con 0x7f1944102580 2024-09-19T06:37:10.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:10.624+0000 7f1940ff9640 1 -- 172.21.15.99:0/427561656 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1934015e70 con 0x7f1944102580 2024-09-19T06:37:10.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:10.624+0000 7f194a309640 1 -- 172.21.15.99:0/427561656 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19441199b0 con 0x7f1944102580 2024-09-19T06:37:10.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:10.625+0000 7f194a309640 1 -- 172.21.15.99:0/427561656 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19440fdd00 con 0x7f1944102580 2024-09-19T06:37:10.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:10.625+0000 7f1940ff9640 1 -- 172.21.15.99:0/427561656 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f1934012070 con 0x7f1944102580 2024-09-19T06:37:10.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:10.625+0000 7f1940ff9640 1 --2- 172.21.15.99:0/427561656 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f192c06ed60 0x7f192c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:10.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:10.626+0000 7f1940ff9640 1 -- 172.21.15.99:0/427561656 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f193408d930 con 0x7f1944102580 2024-09-19T06:37:10.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:10.626+0000 7f19437fe640 1 --2- 172.21.15.99:0/427561656 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f192c06ed60 0x7f192c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:10.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:10.626+0000 7f19437fe640 1 --2- 172.21.15.99:0/427561656 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f192c06ed60 0x7f192c071210 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1938000c00 tx=0x7f1938035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:10.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:10.630+0000 7f1940ff9640 1 -- 172.21.15.99:0/427561656 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f193405ae10 con 0x7f1944102580 2024-09-19T06:37:10.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:10.788+0000 7f194a309640 1 -- 172.21.15.99:0/427561656 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f1944071100 con 0x7f1944102580 2024-09-19T06:37:10.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:10.788+0000 7f1940ff9640 1 -- 172.21.15.99:0/427561656 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f193405a7b0 con 0x7f1944102580 2024-09-19T06:37:10.790 INFO:teuthology.orchestra.run.smithi099.stdout:163208757260 2024-09-19T06:37:10.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:10.790+0000 7f194a309640 1 -- 172.21.15.99:0/427561656 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f192c06ed60 msgr2=0x7f192c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:10.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:10.790+0000 7f194a309640 1 --2- 172.21.15.99:0/427561656 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f192c06ed60 0x7f192c071210 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1938000c00 tx=0x7f1938035040 comp rx=0 tx=0).stop 2024-09-19T06:37:10.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:10.790+0000 7f194a309640 1 -- 172.21.15.99:0/427561656 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1944102580 msgr2=0x7f194406fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:10.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:10.790+0000 7f194a309640 1 --2- 172.21.15.99:0/427561656 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1944102580 0x7f194406fa10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f193400b790 tx=0x7f19340091d0 comp rx=0 tx=0).stop 2024-09-19T06:37:10.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:10.790+0000 7f194a309640 1 -- 172.21.15.99:0/427561656 shutdown_connections 2024-09-19T06:37:10.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:10.790+0000 7f194a309640 1 --2- 172.21.15.99:0/427561656 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f192c06ed60 0x7f192c071210 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:10.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:10.790+0000 7f194a309640 1 --2- 172.21.15.99:0/427561656 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1944102f20 0x7f194406ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:10.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:10.790+0000 7f194a309640 1 --2- 172.21.15.99:0/427561656 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1944102580 0x7f194406fa10 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:10.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:10.790+0000 7f194a309640 1 -- 172.21.15.99:0/427561656 >> 172.21.15.99:0/427561656 conn(0x7f19440f81a0 msgr2=0x7f19440f91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:10.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:10.790+0000 7f194a309640 1 -- 172.21.15.99:0/427561656 shutdown_connections 2024-09-19T06:37:10.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:10.790+0000 7f194a309640 1 -- 172.21.15.99:0/427561656 wait complete. 2024-09-19T06:37:11.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:11 smithi099 ceph-mon[27651]: from='client.? 172.21.15.99:0/427561656' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T06:37:11.495 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757258 got 163208757260 for osd.5 2024-09-19T06:37:11.495 DEBUG:teuthology.parallel:result is None 2024-09-19T06:37:11.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:11 smithi117 ceph-mon[34564]: from='client.? 172.21.15.99:0/427561656' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T06:37:11.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:11.662+0000 7f445f7f4640 1 -- 172.21.15.99:0/3816599582 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44580fb490 msgr2=0x7f44580fb900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:11.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:11.662+0000 7f445f7f4640 1 --2- 172.21.15.99:0/3816599582 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44580fb490 0x7f44580fb900 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f44480048d0 tx=0x7f4448009da0 comp rx=0 tx=0).stop 2024-09-19T06:37:11.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:11.662+0000 7f445f7f4640 1 -- 172.21.15.99:0/3816599582 shutdown_connections 2024-09-19T06:37:11.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:11.662+0000 7f445f7f4640 1 --2- 172.21.15.99:0/3816599582 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44580fb490 0x7f44580fb900 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:11.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:11.662+0000 7f445f7f4640 1 --2- 172.21.15.99:0/3816599582 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f44581014d0 0x7f44581018a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:11.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:11.662+0000 7f445f7f4640 1 -- 172.21.15.99:0/3816599582 >> 172.21.15.99:0/3816599582 conn(0x7f44580f7050 msgr2=0x7f44580f9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:11.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:11.662+0000 7f445f7f4640 1 -- 172.21.15.99:0/3816599582 shutdown_connections 2024-09-19T06:37:11.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:11.662+0000 7f445f7f4640 1 -- 172.21.15.99:0/3816599582 wait complete. 2024-09-19T06:37:11.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:11.663+0000 7f445f7f4640 1 Processor -- start 2024-09-19T06:37:11.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:11.663+0000 7f445f7f4640 1 -- start start 2024-09-19T06:37:11.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:11.663+0000 7f445f7f4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f44580fb490 0x7f445810e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:11.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:11.663+0000 7f445f7f4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44581014d0 0x7f445810e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:11.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:11.663+0000 7f445f7f4640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f445810ed10 con 0x7f44581014d0 2024-09-19T06:37:11.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:11.663+0000 7f445f7f4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f445810ee80 con 0x7f44580fb490 2024-09-19T06:37:11.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:11.663+0000 7f445cd8f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44581014d0 0x7f445810e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:11.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:11.663+0000 7f445cd8f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44581014d0 0x7f445810e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50888/0 (socket says 172.21.15.99:50888) 2024-09-19T06:37:11.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:11.663+0000 7f445cd8f640 1 -- 172.21.15.99:0/1196796688 learned_addr learned my addr 172.21.15.99:0/1196796688 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:37:11.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:11.663+0000 7f445d590640 1 --2- 172.21.15.99:0/1196796688 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f44580fb490 0x7f445810e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:11.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:11.663+0000 7f445cd8f640 1 -- 172.21.15.99:0/1196796688 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f44580fb490 msgr2=0x7f445810e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:11.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:11.663+0000 7f445cd8f640 1 --2- 172.21.15.99:0/1196796688 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f44580fb490 0x7f445810e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:11.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:11.663+0000 7f445cd8f640 1 -- 172.21.15.99:0/1196796688 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4448005040 con 0x7f44581014d0 2024-09-19T06:37:11.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:11.663+0000 7f445cd8f640 1 --2- 172.21.15.99:0/1196796688 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44581014d0 0x7f445810e6c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4448000c00 tx=0x7f4448009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:11.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:11.664+0000 7f444dffb640 1 -- 172.21.15.99:0/1196796688 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4448038070 con 0x7f44581014d0 2024-09-19T06:37:11.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:11.664+0000 7f444dffb640 1 -- 172.21.15.99:0/1196796688 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f444802ade0 con 0x7f44581014d0 2024-09-19T06:37:11.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:11.664+0000 7f445f7f4640 1 -- 172.21.15.99:0/1196796688 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44581171f0 con 0x7f44581014d0 2024-09-19T06:37:11.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:11.664+0000 7f444dffb640 1 -- 172.21.15.99:0/1196796688 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f444802c7e0 con 0x7f44581014d0 2024-09-19T06:37:11.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:11.664+0000 7f445f7f4640 1 -- 172.21.15.99:0/1196796688 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4458117650 con 0x7f44581014d0 2024-09-19T06:37:11.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:11.665+0000 7f445f7f4640 1 -- 172.21.15.99:0/1196796688 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44580fcbd0 con 0x7f44581014d0 2024-09-19T06:37:11.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:11.665+0000 7f444dffb640 1 -- 172.21.15.99:0/1196796688 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f4448030020 con 0x7f44581014d0 2024-09-19T06:37:11.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:11.666+0000 7f444dffb640 1 --2- 172.21.15.99:0/1196796688 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f444406ed60 0x7f4444071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:11.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:11.666+0000 7f444dffb640 1 -- 172.21.15.99:0/1196796688 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f44480adad0 con 0x7f44581014d0 2024-09-19T06:37:11.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:11.666+0000 7f445d590640 1 --2- 172.21.15.99:0/1196796688 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f444406ed60 0x7f4444071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:11.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:11.666+0000 7f445d590640 1 --2- 172.21.15.99:0/1196796688 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f444406ed60 0x7f4444071210 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4454004ed0 tx=0x7f445400b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:11.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:11.670+0000 7f444dffb640 1 -- 172.21.15.99:0/1196796688 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f444807afe0 con 0x7f44581014d0 2024-09-19T06:37:11.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:11.826+0000 7f445f7f4640 1 -- 172.21.15.99:0/1196796688 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f445804b720 con 0x7f44581014d0 2024-09-19T06:37:11.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:11.827+0000 7f444dffb640 1 -- 172.21.15.99:0/1196796688 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f444807a980 con 0x7f44581014d0 2024-09-19T06:37:11.828 INFO:teuthology.orchestra.run.smithi099.stdout:141733920784 2024-09-19T06:37:11.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:11.828+0000 7f445f7f4640 1 -- 172.21.15.99:0/1196796688 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f444406ed60 msgr2=0x7f4444071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:11.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:11.828+0000 7f445f7f4640 1 --2- 172.21.15.99:0/1196796688 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f444406ed60 0x7f4444071210 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4454004ed0 tx=0x7f445400b040 comp rx=0 tx=0).stop 2024-09-19T06:37:11.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:11.829+0000 7f445f7f4640 1 -- 172.21.15.99:0/1196796688 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44581014d0 msgr2=0x7f445810e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:11.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:11.829+0000 7f445f7f4640 1 --2- 172.21.15.99:0/1196796688 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44581014d0 0x7f445810e6c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4448000c00 tx=0x7f4448009da0 comp rx=0 tx=0).stop 2024-09-19T06:37:11.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:11.829+0000 7f445f7f4640 1 -- 172.21.15.99:0/1196796688 shutdown_connections 2024-09-19T06:37:11.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:11.829+0000 7f445f7f4640 1 --2- 172.21.15.99:0/1196796688 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f444406ed60 0x7f4444071210 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:11.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:11.829+0000 7f445f7f4640 1 --2- 172.21.15.99:0/1196796688 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44581014d0 0x7f445810e6c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:11.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:11.829+0000 7f445f7f4640 1 --2- 172.21.15.99:0/1196796688 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f44580fb490 0x7f445810e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:11.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:11.829+0000 7f445f7f4640 1 -- 172.21.15.99:0/1196796688 >> 172.21.15.99:0/1196796688 conn(0x7f44580f7050 msgr2=0x7f44580f8950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:11.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:11.829+0000 7f445f7f4640 1 -- 172.21.15.99:0/1196796688 shutdown_connections 2024-09-19T06:37:11.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:11.829+0000 7f445f7f4640 1 -- 172.21.15.99:0/1196796688 wait complete. 2024-09-19T06:37:12.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:12 smithi117 ceph-mon[34564]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:37:12.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:12 smithi117 ceph-mon[34564]: from='client.? 172.21.15.99:0/1196796688' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T06:37:12.411 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:12 smithi099 ceph-mon[27651]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:37:12.411 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:12 smithi099 ceph-mon[27651]: from='client.? 172.21.15.99:0/1196796688' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T06:37:12.412 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542174 got 60129542175 for osd.1 2024-09-19T06:37:12.412 DEBUG:teuthology.parallel:result is None 2024-09-19T06:37:13.017 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920782 got 141733920784 for osd.4 2024-09-19T06:37:13.017 DEBUG:teuthology.parallel:result is None 2024-09-19T06:37:13.017 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T06:37:13.018 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T06:37:13.269 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T06:37:14.303 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:14 smithi099 ceph-mon[27651]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:37:14.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:14 smithi117 ceph-mon[34564]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:37:14.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:14.889+0000 7f838324a640 1 -- 172.21.15.99:0/3868126860 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f837c102620 msgr2=0x7f837c1029f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:14.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:14.889+0000 7f838324a640 1 --2- 172.21.15.99:0/3868126860 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f837c102620 0x7f837c1029f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f83700048d0 tx=0x7f8370009da0 comp rx=0 tx=0).stop 2024-09-19T06:37:14.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:14.889+0000 7f838324a640 1 -- 172.21.15.99:0/3868126860 shutdown_connections 2024-09-19T06:37:14.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:14.889+0000 7f838324a640 1 --2- 172.21.15.99:0/3868126860 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f837c0fac80 0x7f837c0fb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:14.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:14.889+0000 7f838324a640 1 --2- 172.21.15.99:0/3868126860 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f837c102620 0x7f837c1029f0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:14.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:14.889+0000 7f838324a640 1 -- 172.21.15.99:0/3868126860 >> 172.21.15.99:0/3868126860 conn(0x7f837c070ce0 msgr2=0x7f837c0710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:14.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:14.889+0000 7f838324a640 1 -- 172.21.15.99:0/3868126860 shutdown_connections 2024-09-19T06:37:14.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:14.889+0000 7f838324a640 1 -- 172.21.15.99:0/3868126860 wait complete. 2024-09-19T06:37:14.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:14.890+0000 7f838324a640 1 Processor -- start 2024-09-19T06:37:14.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:14.890+0000 7f838324a640 1 -- start start 2024-09-19T06:37:14.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:14.890+0000 7f838324a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f837c0fac80 0x7f837c1131c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:14.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:14.890+0000 7f838324a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f837c102620 0x7f837c113700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:14.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:14.891+0000 7f838324a640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f837c113d00 con 0x7f837c0fac80 2024-09-19T06:37:14.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:14.891+0000 7f838324a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f837c10d140 con 0x7f837c102620 2024-09-19T06:37:14.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:14.891+0000 7f8380fe6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f837c0fac80 0x7f837c1131c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:14.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:14.891+0000 7f8380fe6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f837c0fac80 0x7f837c1131c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50906/0 (socket says 172.21.15.99:50906) 2024-09-19T06:37:14.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:14.891+0000 7f8380fe6640 1 -- 172.21.15.99:0/2211701237 learned_addr learned my addr 172.21.15.99:0/2211701237 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:37:14.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:14.891+0000 7f837bfff640 1 --2- 172.21.15.99:0/2211701237 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f837c102620 0x7f837c113700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:14.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:14.891+0000 7f8380fe6640 1 -- 172.21.15.99:0/2211701237 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f837c102620 msgr2=0x7f837c113700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:14.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:14.891+0000 7f8380fe6640 1 --2- 172.21.15.99:0/2211701237 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f837c102620 0x7f837c113700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:14.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:14.891+0000 7f8380fe6640 1 -- 172.21.15.99:0/2211701237 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8370005040 con 0x7f837c0fac80 2024-09-19T06:37:14.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:14.891+0000 7f8380fe6640 1 --2- 172.21.15.99:0/2211701237 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f837c0fac80 0x7f837c1131c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8370003080 tx=0x7f8370009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:14.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:14.891+0000 7f83797fa640 1 -- 172.21.15.99:0/2211701237 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8370038070 con 0x7f837c0fac80 2024-09-19T06:37:14.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:14.891+0000 7f83797fa640 1 -- 172.21.15.99:0/2211701237 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f83700097e0 con 0x7f837c0fac80 2024-09-19T06:37:14.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:14.891+0000 7f838324a640 1 -- 172.21.15.99:0/2211701237 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f837c10d3c0 con 0x7f837c0fac80 2024-09-19T06:37:14.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:14.891+0000 7f83797fa640 1 -- 172.21.15.99:0/2211701237 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f837003d420 con 0x7f837c0fac80 2024-09-19T06:37:14.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:14.892+0000 7f838324a640 1 -- 172.21.15.99:0/2211701237 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f837c10d900 con 0x7f837c0fac80 2024-09-19T06:37:14.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:14.892+0000 7f838324a640 1 -- 172.21.15.99:0/2211701237 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f837c0657b0 con 0x7f837c0fac80 2024-09-19T06:37:14.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:14.893+0000 7f83797fa640 1 -- 172.21.15.99:0/2211701237 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f8370030020 con 0x7f837c0fac80 2024-09-19T06:37:14.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:14.893+0000 7f83797fa640 1 --2- 172.21.15.99:0/2211701237 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f836c06ed60 0x7f836c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:14.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:14.893+0000 7f83797fa640 1 -- 172.21.15.99:0/2211701237 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f83700ae370 con 0x7f837c0fac80 2024-09-19T06:37:14.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:14.893+0000 7f837bfff640 1 --2- 172.21.15.99:0/2211701237 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f836c06ed60 0x7f836c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:14.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:14.894+0000 7f837bfff640 1 --2- 172.21.15.99:0/2211701237 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f836c06ed60 0x7f836c071210 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f837c10ea80 tx=0x7f8368004330 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:14.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:14.898+0000 7f83797fa640 1 -- 172.21.15.99:0/2211701237 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f837007b7d0 con 0x7f837c0fac80 2024-09-19T06:37:15.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:15.048+0000 7f838324a640 1 -- 172.21.15.99:0/2211701237 --> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f837c04b720 con 0x7f836c06ed60 2024-09-19T06:37:15.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:15.050+0000 7f83797fa640 1 -- 172.21.15.99:0/2211701237 <== mgr.14206 v2:172.21.15.99:6800/886909451 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27974 (secure 0 0 0) 0x7f837c04b720 con 0x7f836c06ed60 2024-09-19T06:37:15.075 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:37:15.075 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-09-19T06:37:15.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:15.052+0000 7f838324a640 1 -- 172.21.15.99:0/2211701237 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f836c06ed60 msgr2=0x7f836c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:15.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:15.052+0000 7f838324a640 1 --2- 172.21.15.99:0/2211701237 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f836c06ed60 0x7f836c071210 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f837c10ea80 tx=0x7f8368004330 comp rx=0 tx=0).stop 2024-09-19T06:37:15.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:15.052+0000 7f838324a640 1 -- 172.21.15.99:0/2211701237 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f837c0fac80 msgr2=0x7f837c1131c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:15.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:15.052+0000 7f838324a640 1 --2- 172.21.15.99:0/2211701237 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f837c0fac80 0x7f837c1131c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8370003080 tx=0x7f8370009da0 comp rx=0 tx=0).stop 2024-09-19T06:37:15.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:15.052+0000 7f838324a640 1 -- 172.21.15.99:0/2211701237 shutdown_connections 2024-09-19T06:37:15.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:15.052+0000 7f838324a640 1 --2- 172.21.15.99:0/2211701237 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f836c06ed60 0x7f836c071210 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:15.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:15.052+0000 7f838324a640 1 --2- 172.21.15.99:0/2211701237 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f837c102620 0x7f837c113700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:15.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:15.052+0000 7f838324a640 1 --2- 172.21.15.99:0/2211701237 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f837c0fac80 0x7f837c1131c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:15.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:15.052+0000 7f838324a640 1 -- 172.21.15.99:0/2211701237 >> 172.21.15.99:0/2211701237 conn(0x7f837c070ce0 msgr2=0x7f837c105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:15.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:15.052+0000 7f838324a640 1 -- 172.21.15.99:0/2211701237 shutdown_connections 2024-09-19T06:37:15.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:15.052+0000 7f838324a640 1 -- 172.21.15.99:0/2211701237 wait complete. 2024-09-19T06:37:15.717 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":152,"stamp":"2024-09-19T06:37:14.527442+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1787984,"kb_used_data":3828,"kb_used_omap":9,"kb_used_meta":1784054,"kb_avail":560682928,"statfs":{"total":575970213888,"available":574139318272,"internally_reserved":0,"allocated":3919872,"data_stored":2576994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10224,"internal_metadata":1826871312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001996"},"pg_stats":[{"pgid":"1.0","version":"24'72","reported_seq":130,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T06:36:25.968224+0000","last_change":"2024-09-19T06:36:01.269558+0000","last_active":"2024-09-19T06:36:25.968224+0000","last_peered":"2024-09-19T06:36:25.968224+0000","last_clean":"2024-09-19T06:36:25.968224+0000","last_became_active":"2024-09-19T06:36:01.269280+0000","last_became_peered":"2024-09-19T06:36:01.269280+0000","last_unstale":"2024-09-19T06:36:25.968224+0000","last_undegraded":"2024-09-19T06:36:25.968224+0000","last_fullsized":"2024-09-19T06:36:25.968224+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:35:16.811425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:35:16.811425+0000","last_clean_scrub_stamp":"2024-09-19T06:35:16.811425+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:36:52.513838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":38,"seq":163208757261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297704,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447448,"statfs":{"total":95995035648,"available":95690186752,"internally_reserved":0,"allocated":356352,"data_stored":134315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]}]},{"osd":4,"up_from":33,"seq":141733920785,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297708,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447444,"statfs":{"total":95995035648,"available":95690182656,"internally_reserved":0,"allocated":356352,"data_stored":134315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 19 06:37:01 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.17499999999999999,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":1.956,"5min":1.956,"15min":1.956},"last":0.502}]},{"osd":1,"last update":"Thu Sep 19 06:37:01 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":0.48799999999999999}]},{"osd":2,"last update":"Thu Sep 19 06:37:01 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.839,"5min":1.839,"15min":1.839},"last":0.53500000000000003}]},{"osd":3,"last update":"Thu Sep 19 06:37:01 2024","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.33900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]}]},{"osd":3,"up_from":27,"seq":115964117014,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298288,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446864,"statfs":{"total":95995035648,"available":95689588736,"internally_reserved":0,"allocated":950272,"data_stored":724683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 19 06:36:38 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.44500000000000001}]},{"osd":1,"last update":"Thu Sep 19 06:36:38 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.505},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.57599999999999996}]},{"osd":2,"last update":"Thu Sep 19 06:36:38 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.58999999999999997}]},{"osd":4,"last update":"Thu Sep 19 06:37:02 2024","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.38500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]}]},{"osd":2,"up_from":19,"seq":81604378651,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297708,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447444,"statfs":{"total":95995035648,"available":95690182656,"internally_reserved":0,"allocated":356352,"data_stored":134315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 19 06:36:18 2024","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"last":0.247},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"last":0.27500000000000002}]},{"osd":1,"last update":"Thu Sep 19 06:36:18 2024","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.30399999999999999}]},{"osd":3,"last update":"Thu Sep 19 06:36:38 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.46500000000000002}]},{"osd":4,"last update":"Thu Sep 19 06:37:03 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.44900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542177,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298288,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446864,"statfs":{"total":95995035648,"available":95689588736,"internally_reserved":0,"allocated":950272,"data_stored":724683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 19 06:36:53 2024","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.29699999999999999,"15min":0.29199999999999998},"min":{"1min":0.20799999999999999,"5min":0.188,"15min":0.188},"max":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.23899999999999999},{"interface":"front","average":{"1min":0.32000000000000001,"5min":0.314,"15min":0.313},"min":{"1min":0.223,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"last":0.28299999999999997}]},{"osd":2,"last update":"Thu Sep 19 06:36:19 2024","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.309}]},{"osd":3,"last update":"Thu Sep 19 06:36:40 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.60999999999999999}]},{"osd":4,"last update":"Thu Sep 19 06:37:04 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.436},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.56299999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]}]},{"osd":0,"up_from":9,"seq":38654705701,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298288,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446864,"statfs":{"total":95995035648,"available":95689588736,"internally_reserved":0,"allocated":950272,"data_stored":724683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Sep 19 06:36:54 2024","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.32100000000000001,"15min":0.32100000000000001},"min":{"1min":0.217,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.47099999999999997,"5min":0.5,"15min":0.5},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.313,"5min":0.32600000000000001,"15min":0.32800000000000001},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.41199999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"last":0.23200000000000001}]},{"osd":2,"last update":"Thu Sep 19 06:36:18 2024","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.247},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"last":0.27100000000000002}]},{"osd":3,"last update":"Thu Sep 19 06:36:36 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.314},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.376}]},{"osd":4,"last update":"Thu Sep 19 06:37:01 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.40799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T06:37:15.718 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T06:37:15.963 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T06:37:16.403 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:16 smithi099 ceph-mon[27651]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:37:16.403 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:16 smithi099 ceph-mon[27651]: from='client.14422 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:37:16.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:16 smithi117 ceph-mon[34564]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:37:16.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:16 smithi117 ceph-mon[34564]: from='client.14422 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:37:17.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:17.595+0000 7fbb3b641640 1 -- 172.21.15.99:0/888594892 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb340fabe0 msgr2=0x7fbb340fb030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:17.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:17.595+0000 7fbb3b641640 1 --2- 172.21.15.99:0/888594892 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb340fabe0 0x7fbb340fb030 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbb240048d0 tx=0x7fbb24009da0 comp rx=0 tx=0).stop 2024-09-19T06:37:17.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:17.595+0000 7fbb3b641640 1 -- 172.21.15.99:0/888594892 shutdown_connections 2024-09-19T06:37:17.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:17.595+0000 7fbb3b641640 1 --2- 172.21.15.99:0/888594892 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb340fabe0 0x7fbb340fb030 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:17.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:17.595+0000 7fbb3b641640 1 --2- 172.21.15.99:0/888594892 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb340fe460 0x7fbb340fe830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:17.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:17.595+0000 7fbb3b641640 1 -- 172.21.15.99:0/888594892 >> 172.21.15.99:0/888594892 conn(0x7fbb34071b00 msgr2=0x7fbb34071f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:17.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:17.595+0000 7fbb3b641640 1 -- 172.21.15.99:0/888594892 shutdown_connections 2024-09-19T06:37:17.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:17.595+0000 7fbb3b641640 1 -- 172.21.15.99:0/888594892 wait complete. 2024-09-19T06:37:17.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:17.596+0000 7fbb3b641640 1 Processor -- start 2024-09-19T06:37:17.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:17.596+0000 7fbb3b641640 1 -- start start 2024-09-19T06:37:17.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:17.596+0000 7fbb3b641640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb340fabe0 0x7fbb34113170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:17.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:17.596+0000 7fbb3b641640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb340fe460 0x7fbb341136b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:17.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:17.596+0000 7fbb3b641640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb34113cb0 con 0x7fbb340fabe0 2024-09-19T06:37:17.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:17.596+0000 7fbb3b641640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3410d0f0 con 0x7fbb340fe460 2024-09-19T06:37:17.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:17.596+0000 7fbb393dd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb340fabe0 0x7fbb34113170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:17.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:17.596+0000 7fbb393dd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb340fabe0 0x7fbb34113170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60098/0 (socket says 172.21.15.99:60098) 2024-09-19T06:37:17.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:17.596+0000 7fbb393dd640 1 -- 172.21.15.99:0/293966512 learned_addr learned my addr 172.21.15.99:0/293966512 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:37:17.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:17.596+0000 7fbb393dd640 1 -- 172.21.15.99:0/293966512 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb340fe460 msgr2=0x7fbb341136b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:17.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:17.596+0000 7fbb393dd640 1 --2- 172.21.15.99:0/293966512 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb340fe460 0x7fbb341136b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:17.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:17.596+0000 7fbb393dd640 1 -- 172.21.15.99:0/293966512 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb24005040 con 0x7fbb340fabe0 2024-09-19T06:37:17.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:17.597+0000 7fbb393dd640 1 --2- 172.21.15.99:0/293966512 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb340fabe0 0x7fbb34113170 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fbb3000cb10 tx=0x7fbb30007f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:17.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:17.597+0000 7fbb29ffb640 1 -- 172.21.15.99:0/293966512 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb30004200 con 0x7fbb340fabe0 2024-09-19T06:37:17.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:17.597+0000 7fbb29ffb640 1 -- 172.21.15.99:0/293966512 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fbb3000acc0 con 0x7fbb340fabe0 2024-09-19T06:37:17.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:17.597+0000 7fbb3b641640 1 -- 172.21.15.99:0/293966512 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb3410d3d0 con 0x7fbb340fabe0 2024-09-19T06:37:17.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:17.597+0000 7fbb29ffb640 1 -- 172.21.15.99:0/293966512 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb30003dc0 con 0x7fbb340fabe0 2024-09-19T06:37:17.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:17.597+0000 7fbb3b641640 1 -- 172.21.15.99:0/293966512 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb3410d970 con 0x7fbb340fabe0 2024-09-19T06:37:17.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:17.598+0000 7fbb3b641640 1 -- 172.21.15.99:0/293966512 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb34064d50 con 0x7fbb340fabe0 2024-09-19T06:37:17.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:17.598+0000 7fbb29ffb640 1 -- 172.21.15.99:0/293966512 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fbb3000a820 con 0x7fbb340fabe0 2024-09-19T06:37:17.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:17.599+0000 7fbb29ffb640 1 --2- 172.21.15.99:0/293966512 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fbb2006ed60 0x7fbb20071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:17.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:17.599+0000 7fbb29ffb640 1 -- 172.21.15.99:0/293966512 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fbb3008e560 con 0x7fbb340fabe0 2024-09-19T06:37:17.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:17.599+0000 7fbb38bdc640 1 --2- 172.21.15.99:0/293966512 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fbb2006ed60 0x7fbb20071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:17.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:17.599+0000 7fbb38bdc640 1 --2- 172.21.15.99:0/293966512 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fbb2006ed60 0x7fbb20071210 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbb2402a530 tx=0x7fbb24009da0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:17.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:17.603+0000 7fbb29ffb640 1 -- 172.21.15.99:0/293966512 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fbb3005b9c0 con 0x7fbb340fabe0 2024-09-19T06:37:17.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:17.757+0000 7fbb3b641640 1 -- 172.21.15.99:0/293966512 --> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbb3410e840 con 0x7fbb2006ed60 2024-09-19T06:37:17.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:17.758+0000 7fbb29ffb640 1 -- 172.21.15.99:0/293966512 <== mgr.14206 v2:172.21.15.99:6800/886909451 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27974 (secure 0 0 0) 0x7fbb3410e840 con 0x7fbb2006ed60 2024-09-19T06:37:17.760 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:37:17.760 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-09-19T06:37:17.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:17.760+0000 7fbb3b641640 1 -- 172.21.15.99:0/293966512 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fbb2006ed60 msgr2=0x7fbb20071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:17.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:17.760+0000 7fbb3b641640 1 --2- 172.21.15.99:0/293966512 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fbb2006ed60 0x7fbb20071210 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbb2402a530 tx=0x7fbb24009da0 comp rx=0 tx=0).stop 2024-09-19T06:37:17.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:17.760+0000 7fbb3b641640 1 -- 172.21.15.99:0/293966512 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb340fabe0 msgr2=0x7fbb34113170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:17.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:17.760+0000 7fbb3b641640 1 --2- 172.21.15.99:0/293966512 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb340fabe0 0x7fbb34113170 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fbb3000cb10 tx=0x7fbb30007f00 comp rx=0 tx=0).stop 2024-09-19T06:37:17.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:17.760+0000 7fbb3b641640 1 -- 172.21.15.99:0/293966512 shutdown_connections 2024-09-19T06:37:17.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:17.760+0000 7fbb3b641640 1 --2- 172.21.15.99:0/293966512 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fbb2006ed60 0x7fbb20071210 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:17.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:17.760+0000 7fbb3b641640 1 --2- 172.21.15.99:0/293966512 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbb340fe460 0x7fbb341136b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:17.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:17.760+0000 7fbb3b641640 1 --2- 172.21.15.99:0/293966512 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb340fabe0 0x7fbb34113170 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:17.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:17.760+0000 7fbb3b641640 1 -- 172.21.15.99:0/293966512 >> 172.21.15.99:0/293966512 conn(0x7fbb34071b00 msgr2=0x7fbb340f99e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:17.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:17.760+0000 7fbb3b641640 1 -- 172.21.15.99:0/293966512 shutdown_connections 2024-09-19T06:37:17.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:17.760+0000 7fbb3b641640 1 -- 172.21.15.99:0/293966512 wait complete. 2024-09-19T06:37:18.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:18 smithi099 ceph-mon[27651]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:37:18.493 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":153,"stamp":"2024-09-19T06:37:16.527692+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1787984,"kb_used_data":3828,"kb_used_omap":9,"kb_used_meta":1784054,"kb_avail":560682928,"statfs":{"total":575970213888,"available":574139318272,"internally_reserved":0,"allocated":3919872,"data_stored":2576994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10224,"internal_metadata":1826871312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001953"},"pg_stats":[{"pgid":"1.0","version":"24'72","reported_seq":130,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-19T06:36:25.968224+0000","last_change":"2024-09-19T06:36:01.269558+0000","last_active":"2024-09-19T06:36:25.968224+0000","last_peered":"2024-09-19T06:36:25.968224+0000","last_clean":"2024-09-19T06:36:25.968224+0000","last_became_active":"2024-09-19T06:36:01.269280+0000","last_became_peered":"2024-09-19T06:36:01.269280+0000","last_unstale":"2024-09-19T06:36:25.968224+0000","last_undegraded":"2024-09-19T06:36:25.968224+0000","last_fullsized":"2024-09-19T06:36:25.968224+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T06:35:16.811425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T06:35:16.811425+0000","last_clean_scrub_stamp":"2024-09-19T06:35:16.811425+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:36:52.513838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":38,"seq":163208757261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297704,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447448,"statfs":{"total":95995035648,"available":95690186752,"internally_reserved":0,"allocated":356352,"data_stored":134315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]}]},{"osd":4,"up_from":33,"seq":141733920786,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297708,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447444,"statfs":{"total":95995035648,"available":95690182656,"internally_reserved":0,"allocated":356352,"data_stored":134315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 19 06:37:01 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.17499999999999999,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":1.956,"5min":1.956,"15min":1.956},"last":0.42999999999999999}]},{"osd":1,"last update":"Thu Sep 19 06:37:01 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":0.41199999999999998}]},{"osd":2,"last update":"Thu Sep 19 06:37:01 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.839,"5min":1.839,"15min":1.839},"last":0.39100000000000001}]},{"osd":3,"last update":"Thu Sep 19 06:37:01 2024","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.29499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]}]},{"osd":3,"up_from":27,"seq":115964117015,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298288,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446864,"statfs":{"total":95995035648,"available":95689588736,"internally_reserved":0,"allocated":950272,"data_stored":724683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 19 06:36:38 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.59999999999999998}]},{"osd":1,"last update":"Thu Sep 19 06:36:38 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.504},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.58499999999999996}]},{"osd":2,"last update":"Thu Sep 19 06:36:38 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.67200000000000004}]},{"osd":4,"last update":"Thu Sep 19 06:37:02 2024","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.432},{"interface":"front","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.45500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]}]},{"osd":2,"up_from":19,"seq":81604378652,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297708,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447444,"statfs":{"total":95995035648,"available":95690182656,"internally_reserved":0,"allocated":356352,"data_stored":134315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 19 06:36:18 2024","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"last":0.28599999999999998}]},{"osd":1,"last update":"Thu Sep 19 06:36:18 2024","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.32000000000000001}]},{"osd":3,"last update":"Thu Sep 19 06:36:38 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.498},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.51200000000000001}]},{"osd":4,"last update":"Thu Sep 19 06:37:03 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.48099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542177,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298288,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446864,"statfs":{"total":95995035648,"available":95689588736,"internally_reserved":0,"allocated":950272,"data_stored":724683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 19 06:36:53 2024","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.29699999999999999,"15min":0.29199999999999998},"min":{"1min":0.20799999999999999,"5min":0.188,"15min":0.188},"max":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.23899999999999999},{"interface":"front","average":{"1min":0.32000000000000001,"5min":0.314,"15min":0.313},"min":{"1min":0.223,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"last":0.28299999999999997}]},{"osd":2,"last update":"Thu Sep 19 06:36:19 2024","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.309}]},{"osd":3,"last update":"Thu Sep 19 06:36:40 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.60999999999999999}]},{"osd":4,"last update":"Thu Sep 19 06:37:04 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.436},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.56299999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]}]},{"osd":0,"up_from":9,"seq":38654705701,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298288,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446864,"statfs":{"total":95995035648,"available":95689588736,"internally_reserved":0,"allocated":950272,"data_stored":724683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Sep 19 06:36:54 2024","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.32100000000000001,"15min":0.32100000000000001},"min":{"1min":0.217,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.47099999999999997,"5min":0.5,"15min":0.5},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.313,"5min":0.32600000000000001,"15min":0.32800000000000001},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.41199999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"last":0.23200000000000001}]},{"osd":2,"last update":"Thu Sep 19 06:36:18 2024","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.247},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"last":0.27100000000000002}]},{"osd":3,"last update":"Thu Sep 19 06:36:36 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.314},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.376}]},{"osd":4,"last update":"Thu Sep 19 06:37:01 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.40799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T06:37:18.494 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T06:37:18.494 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-19T06:37:18.495 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-19T06:37:18.495 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-19T06:37:18.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:18 smithi117 ceph-mon[34564]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:37:18.737 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T06:37:19.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:19 smithi099 ceph-mon[27651]: from='client.14426 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:37:19.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:19 smithi117 ceph-mon[34564]: from='client.14426 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T06:37:20.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:20.231+0000 7fc3565f2640 1 -- 172.21.15.99:0/2100708766 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc350102550 msgr2=0x7fc350102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:20.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:20.231+0000 7fc3565f2640 1 --2- 172.21.15.99:0/2100708766 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc350102550 0x7fc350102920 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc3400048d0 tx=0x7fc340009da0 comp rx=0 tx=0).stop 2024-09-19T06:37:20.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:20.231+0000 7fc3565f2640 1 -- 172.21.15.99:0/2100708766 shutdown_connections 2024-09-19T06:37:20.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:20.231+0000 7fc3565f2640 1 --2- 172.21.15.99:0/2100708766 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc350102ef0 0x7fc3500fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:20.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:20.231+0000 7fc3565f2640 1 --2- 172.21.15.99:0/2100708766 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc350102550 0x7fc350102920 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:20.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:20.231+0000 7fc3565f2640 1 -- 172.21.15.99:0/2100708766 >> 172.21.15.99:0/2100708766 conn(0x7fc3500f80f0 msgr2=0x7fc3500fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:20.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:20.231+0000 7fc3565f2640 1 -- 172.21.15.99:0/2100708766 shutdown_connections 2024-09-19T06:37:20.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:20.231+0000 7fc3565f2640 1 -- 172.21.15.99:0/2100708766 wait complete. 2024-09-19T06:37:20.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:20.232+0000 7fc3565f2640 1 Processor -- start 2024-09-19T06:37:20.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:20.232+0000 7fc3565f2640 1 -- start start 2024-09-19T06:37:20.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:20.232+0000 7fc3565f2640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc350102550 0x7fc35006fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:20.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:20.232+0000 7fc3565f2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc350102ef0 0x7fc35006ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:20.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:20.232+0000 7fc3565f2640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc350070490 con 0x7fc350102550 2024-09-19T06:37:20.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:20.232+0000 7fc3565f2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc350070600 con 0x7fc350102ef0 2024-09-19T06:37:20.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:20.232+0000 7fc34ffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc350102550 0x7fc35006fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:20.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:20.232+0000 7fc34ffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc350102550 0x7fc35006fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60120/0 (socket says 172.21.15.99:60120) 2024-09-19T06:37:20.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:20.232+0000 7fc34ffff640 1 -- 172.21.15.99:0/891865943 learned_addr learned my addr 172.21.15.99:0/891865943 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:37:20.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:20.232+0000 7fc347fff640 1 --2- 172.21.15.99:0/891865943 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc350102ef0 0x7fc35006ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:20.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:20.232+0000 7fc34ffff640 1 -- 172.21.15.99:0/891865943 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc350102ef0 msgr2=0x7fc35006ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:20.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:20.232+0000 7fc34ffff640 1 --2- 172.21.15.99:0/891865943 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc350102ef0 0x7fc35006ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:20.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:20.232+0000 7fc34ffff640 1 -- 172.21.15.99:0/891865943 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc340005040 con 0x7fc350102550 2024-09-19T06:37:20.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:20.233+0000 7fc34ffff640 1 --2- 172.21.15.99:0/891865943 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc350102550 0x7fc35006fa10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc340000c00 tx=0x7fc340009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:20.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:20.233+0000 7fc34d7fa640 1 -- 172.21.15.99:0/891865943 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc340038070 con 0x7fc350102550 2024-09-19T06:37:20.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:20.233+0000 7fc3565f2640 1 -- 172.21.15.99:0/891865943 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc350070830 con 0x7fc350102550 2024-09-19T06:37:20.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:20.233+0000 7fc34d7fa640 1 -- 172.21.15.99:0/891865943 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc34002ade0 con 0x7fc350102550 2024-09-19T06:37:20.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:20.233+0000 7fc34d7fa640 1 -- 172.21.15.99:0/891865943 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc34002c7e0 con 0x7fc350102550 2024-09-19T06:37:20.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:20.233+0000 7fc3565f2640 1 -- 172.21.15.99:0/891865943 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc350119bc0 con 0x7fc350102550 2024-09-19T06:37:20.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:20.234+0000 7fc3565f2640 1 -- 172.21.15.99:0/891865943 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3500fdcd0 con 0x7fc350102550 2024-09-19T06:37:20.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:20.234+0000 7fc34d7fa640 1 -- 172.21.15.99:0/891865943 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fc340030020 con 0x7fc350102550 2024-09-19T06:37:20.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:20.235+0000 7fc34d7fa640 1 --2- 172.21.15.99:0/891865943 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fc33c06ed60 0x7fc33c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:20.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:20.235+0000 7fc34d7fa640 1 -- 172.21.15.99:0/891865943 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fc3400adad0 con 0x7fc350102550 2024-09-19T06:37:20.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:20.235+0000 7fc347fff640 1 --2- 172.21.15.99:0/891865943 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fc33c06ed60 0x7fc33c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:20.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:20.235+0000 7fc347fff640 1 --2- 172.21.15.99:0/891865943 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fc33c06ed60 0x7fc33c071210 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc338007fd0 tx=0x7fc338009e90 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:20.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:20.239+0000 7fc34d7fa640 1 -- 172.21.15.99:0/891865943 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fc34007afe0 con 0x7fc350102550 2024-09-19T06:37:20.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:20.427+0000 7fc3565f2640 1 -- 172.21.15.99:0/891865943 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fc3500fbd50 con 0x7fc350102550 2024-09-19T06:37:20.430 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:20 smithi099 ceph-mon[27651]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:37:20.430 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:20 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:37:20.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:20.427+0000 7fc34d7fa640 1 -- 172.21.15.99:0/891865943 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fc34007a980 con 0x7fc350102550 2024-09-19T06:37:20.430 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:37:20.430 INFO:teuthology.orchestra.run.smithi099.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-19T06:37:20.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:20.429+0000 7fc3565f2640 1 -- 172.21.15.99:0/891865943 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fc33c06ed60 msgr2=0x7fc33c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:20.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:20.429+0000 7fc3565f2640 1 --2- 172.21.15.99:0/891865943 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fc33c06ed60 0x7fc33c071210 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc338007fd0 tx=0x7fc338009e90 comp rx=0 tx=0).stop 2024-09-19T06:37:20.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:20.430+0000 7fc3565f2640 1 -- 172.21.15.99:0/891865943 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc350102550 msgr2=0x7fc35006fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:20.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:20.430+0000 7fc3565f2640 1 --2- 172.21.15.99:0/891865943 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc350102550 0x7fc35006fa10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc340000c00 tx=0x7fc340009da0 comp rx=0 tx=0).stop 2024-09-19T06:37:20.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:20.430+0000 7fc3565f2640 1 -- 172.21.15.99:0/891865943 shutdown_connections 2024-09-19T06:37:20.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:20.430+0000 7fc3565f2640 1 --2- 172.21.15.99:0/891865943 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fc33c06ed60 0x7fc33c071210 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:20.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:20.430+0000 7fc3565f2640 1 --2- 172.21.15.99:0/891865943 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc350102ef0 0x7fc35006ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:20.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:20.430+0000 7fc3565f2640 1 --2- 172.21.15.99:0/891865943 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc350102550 0x7fc35006fa10 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:20.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:20.430+0000 7fc3565f2640 1 -- 172.21.15.99:0/891865943 >> 172.21.15.99:0/891865943 conn(0x7fc3500f80f0 msgr2=0x7fc3500f9160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:20.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:20.430+0000 7fc3565f2640 1 -- 172.21.15.99:0/891865943 shutdown_connections 2024-09-19T06:37:20.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:20.430+0000 7fc3565f2640 1 -- 172.21.15.99:0/891865943 wait complete. 2024-09-19T06:37:20.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:20 smithi117 ceph-mon[34564]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:37:20.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:20 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:37:21.229 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-19T06:37:21.229 INFO:tasks.cephadm:Setup complete, yielding 2024-09-19T06:37:21.230 INFO:teuthology.run_tasks:Running task print... 2024-09-19T06:37:21.239 INFO:teuthology.task.print:**** done end installing quincy cephadm ... 2024-09-19T06:37:21.239 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T06:37:21.256 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi099.front.sepia.ceph.com 2024-09-19T06:37:21.257 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-09-19T06:37:21.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:21 smithi099 ceph-mon[27651]: from='client.? 172.21.15.99:0/891865943' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T06:37:21.504 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T06:37:21.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:21 smithi117 ceph-mon[34564]: from='client.? 172.21.15.99:0/891865943' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T06:37:22.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:22 smithi099 ceph-mon[27651]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:37:22.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:22 smithi117 ceph-mon[34564]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:37:23.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:23.100+0000 7f7f21061640 1 -- 172.21.15.99:0/737730622 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f1c0fc550 msgr2=0x7f7f1c0fc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:23.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:23.100+0000 7f7f21061640 1 --2- 172.21.15.99:0/737730622 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f1c0fc550 0x7f7f1c0fc960 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c0048d0 tx=0x7f7f0c009da0 comp rx=0 tx=0).stop 2024-09-19T06:37:23.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:23.100+0000 7f7f21061640 1 -- 172.21.15.99:0/737730622 shutdown_connections 2024-09-19T06:37:23.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:23.100+0000 7f7f21061640 1 --2- 172.21.15.99:0/737730622 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f1c0fd820 0x7f7f1c0fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:23.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:23.100+0000 7f7f21061640 1 --2- 172.21.15.99:0/737730622 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f1c0fc550 0x7f7f1c0fc960 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:23.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:23.100+0000 7f7f21061640 1 -- 172.21.15.99:0/737730622 >> 172.21.15.99:0/737730622 conn(0x7f7f1c0f7d30 msgr2=0x7f7f1c0fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:23.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:23.100+0000 7f7f21061640 1 -- 172.21.15.99:0/737730622 shutdown_connections 2024-09-19T06:37:23.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:23.100+0000 7f7f21061640 1 -- 172.21.15.99:0/737730622 wait complete. 2024-09-19T06:37:23.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:23.101+0000 7f7f21061640 1 Processor -- start 2024-09-19T06:37:23.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:23.101+0000 7f7f21061640 1 -- start start 2024-09-19T06:37:23.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:23.101+0000 7f7f21061640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f1c0fc550 0x7f7f1c071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:23.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:23.101+0000 7f7f21061640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f1c0fd820 0x7f7f1c06fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:23.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:23.101+0000 7f7f21061640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1c06fff0 con 0x7f7f1c0fc550 2024-09-19T06:37:23.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:23.101+0000 7f7f21061640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1c070130 con 0x7f7f1c0fd820 2024-09-19T06:37:23.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:23.101+0000 7f7f1ad9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f1c0fc550 0x7f7f1c071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:23.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:23.101+0000 7f7f1ad9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f1c0fc550 0x7f7f1c071570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60140/0 (socket says 172.21.15.99:60140) 2024-09-19T06:37:23.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:23.101+0000 7f7f1ad9d640 1 -- 172.21.15.99:0/3379810586 learned_addr learned my addr 172.21.15.99:0/3379810586 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:37:23.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:23.101+0000 7f7f1a59c640 1 --2- 172.21.15.99:0/3379810586 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f1c0fd820 0x7f7f1c06fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:23.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:23.102+0000 7f7f1ad9d640 1 -- 172.21.15.99:0/3379810586 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f1c0fd820 msgr2=0x7f7f1c06fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:23.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:23.102+0000 7f7f1ad9d640 1 --2- 172.21.15.99:0/3379810586 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f1c0fd820 0x7f7f1c06fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:23.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:23.102+0000 7f7f1ad9d640 1 -- 172.21.15.99:0/3379810586 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f0c005040 con 0x7f7f1c0fc550 2024-09-19T06:37:23.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:23.102+0000 7f7f1ad9d640 1 --2- 172.21.15.99:0/3379810586 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f1c0fc550 0x7f7f1c071570 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c003080 tx=0x7f7f0c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:23.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:23.102+0000 7f7f037fe640 1 -- 172.21.15.99:0/3379810586 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f0c038070 con 0x7f7f1c0fc550 2024-09-19T06:37:23.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:23.102+0000 7f7f037fe640 1 -- 172.21.15.99:0/3379810586 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7f0c02abd0 con 0x7f7f1c0fc550 2024-09-19T06:37:23.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:23.102+0000 7f7f21061640 1 -- 172.21.15.99:0/3379810586 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f1c0703b0 con 0x7f7f1c0fc550 2024-09-19T06:37:23.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:23.102+0000 7f7f037fe640 1 -- 172.21.15.99:0/3379810586 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f0c03e670 con 0x7f7f1c0fc550 2024-09-19T06:37:23.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:23.102+0000 7f7f21061640 1 -- 172.21.15.99:0/3379810586 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f1c1150d0 con 0x7f7f1c0fc550 2024-09-19T06:37:23.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:23.103+0000 7f7f21061640 1 -- 172.21.15.99:0/3379810586 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f1c04b720 con 0x7f7f1c0fc550 2024-09-19T06:37:23.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:23.104+0000 7f7f037fe640 1 -- 172.21.15.99:0/3379810586 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f7f0c030020 con 0x7f7f1c0fc550 2024-09-19T06:37:23.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:23.104+0000 7f7f037fe640 1 --2- 172.21.15.99:0/3379810586 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f7f0406ed60 0x7f7f04071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:23.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:23.104+0000 7f7f037fe640 1 -- 172.21.15.99:0/3379810586 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f7f0c0ae250 con 0x7f7f1c0fc550 2024-09-19T06:37:23.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:23.104+0000 7f7f1a59c640 1 --2- 172.21.15.99:0/3379810586 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f7f0406ed60 0x7f7f04071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:23.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:23.105+0000 7f7f1a59c640 1 --2- 172.21.15.99:0/3379810586 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f7f0406ed60 0x7f7f04071210 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7f10004c40 tx=0x7f7f10009040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:23.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:23.108+0000 7f7f037fe640 1 -- 172.21.15.99:0/3379810586 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f7f0c07b6b0 con 0x7f7f1c0fc550 2024-09-19T06:37:23.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:23.265+0000 7f7f21061640 1 -- 172.21.15.99:0/3379810586 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7f7f1c070540 con 0x7f7f1c0fc550 2024-09-19T06:37:23.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:23.270+0000 7f7f037fe640 1 -- 172.21.15.99:0/3379810586 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v20)=0 v20) v1 ==== 143+0+0 (secure 0 0 0) 0x7f7f1c070540 con 0x7f7f1c0fc550 2024-09-19T06:37:23.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:23.272+0000 7f7f21061640 1 -- 172.21.15.99:0/3379810586 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f7f0406ed60 msgr2=0x7f7f04071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:23.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:23.272+0000 7f7f21061640 1 --2- 172.21.15.99:0/3379810586 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f7f0406ed60 0x7f7f04071210 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7f10004c40 tx=0x7f7f10009040 comp rx=0 tx=0).stop 2024-09-19T06:37:23.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:23.272+0000 7f7f21061640 1 -- 172.21.15.99:0/3379810586 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f1c0fc550 msgr2=0x7f7f1c071570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:23.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:23.272+0000 7f7f21061640 1 --2- 172.21.15.99:0/3379810586 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f1c0fc550 0x7f7f1c071570 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c003080 tx=0x7f7f0c009da0 comp rx=0 tx=0).stop 2024-09-19T06:37:23.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:23.272+0000 7f7f21061640 1 -- 172.21.15.99:0/3379810586 shutdown_connections 2024-09-19T06:37:23.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:23.272+0000 7f7f21061640 1 --2- 172.21.15.99:0/3379810586 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f7f0406ed60 0x7f7f04071210 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:23.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:23.272+0000 7f7f21061640 1 --2- 172.21.15.99:0/3379810586 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f1c0fd820 0x7f7f1c06fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:23.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:23.272+0000 7f7f21061640 1 --2- 172.21.15.99:0/3379810586 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f1c0fc550 0x7f7f1c071570 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:23.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:23.272+0000 7f7f21061640 1 -- 172.21.15.99:0/3379810586 >> 172.21.15.99:0/3379810586 conn(0x7f7f1c0f7d30 msgr2=0x7f7f1c0f9510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:23.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:23.272+0000 7f7f21061640 1 -- 172.21.15.99:0/3379810586 shutdown_connections 2024-09-19T06:37:23.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:23.272+0000 7f7f21061640 1 -- 172.21.15.99:0/3379810586 wait complete. 2024-09-19T06:37:23.887 INFO:teuthology.run_tasks:Running task print... 2024-09-19T06:37:23.897 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-09-19T06:37:23.897 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T06:37:23.905 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi099.front.sepia.ceph.com 2024-09-19T06:37:23.906 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- bash -c 'ceph orch status' 2024-09-19T06:37:24.161 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T06:37:24.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:24 smithi117 ceph-mon[34564]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:37:24.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:24 smithi117 ceph-mon[34564]: from='client.? 172.21.15.99:0/3379810586' entity='client.admin' 2024-09-19T06:37:24.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:24 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:37:24.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:24 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:37:24.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:24 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:37:24.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:24 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:37:24.617 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:24 smithi099 ceph-mon[27651]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:37:24.617 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:24 smithi099 ceph-mon[27651]: from='client.? 172.21.15.99:0/3379810586' entity='client.admin' 2024-09-19T06:37:24.617 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:24 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:37:24.617 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:24 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:37:24.617 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:24 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:37:24.617 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:24 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:37:25.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:25.816+0000 7f3100bc7640 1 -- 172.21.15.99:0/1337434177 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f30fc0fdbb0 msgr2=0x7f30fc0fdfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:25.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:25.816+0000 7f3100bc7640 1 --2- 172.21.15.99:0/1337434177 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f30fc0fdbb0 0x7f30fc0fdfc0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f30f40048d0 tx=0x7f30f4009da0 comp rx=0 tx=0).stop 2024-09-19T06:37:25.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:25.816+0000 7f3100bc7640 1 -- 172.21.15.99:0/1337434177 shutdown_connections 2024-09-19T06:37:25.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:25.816+0000 7f3100bc7640 1 --2- 172.21.15.99:0/1337434177 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30fc0fe500 0x7f30fc0fa660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:25.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:25.816+0000 7f3100bc7640 1 --2- 172.21.15.99:0/1337434177 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f30fc0fdbb0 0x7f30fc0fdfc0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:25.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:25.816+0000 7f3100bc7640 1 -- 172.21.15.99:0/1337434177 >> 172.21.15.99:0/1337434177 conn(0x7f30fc0f63b0 msgr2=0x7f30fc0f87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:25.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:25.816+0000 7f3100bc7640 1 -- 172.21.15.99:0/1337434177 shutdown_connections 2024-09-19T06:37:25.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:25.817+0000 7f3100bc7640 1 -- 172.21.15.99:0/1337434177 wait complete. 2024-09-19T06:37:25.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:25.817+0000 7f3100bc7640 1 Processor -- start 2024-09-19T06:37:25.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:25.817+0000 7f3100bc7640 1 -- start start 2024-09-19T06:37:25.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:25.817+0000 7f3100bc7640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f30fc0fdbb0 0x7f30fc10d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:25.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:25.817+0000 7f3100bc7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30fc0fe500 0x7f30fc10d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:25.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:25.817+0000 7f3100bc7640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30fc10dc70 con 0x7f30fc0fdbb0 2024-09-19T06:37:25.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:25.817+0000 7f3100bc7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30fc10e440 con 0x7f30fc0fe500 2024-09-19T06:37:25.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:25.817+0000 7f30fa59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f30fc0fdbb0 0x7f30fc10d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:25.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:25.817+0000 7f30fa59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f30fc0fdbb0 0x7f30fc10d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56448/0 (socket says 172.21.15.99:56448) 2024-09-19T06:37:25.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:25.817+0000 7f30fa59c640 1 -- 172.21.15.99:0/3539610516 learned_addr learned my addr 172.21.15.99:0/3539610516 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:37:25.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:25.817+0000 7f30fa59c640 1 -- 172.21.15.99:0/3539610516 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30fc0fe500 msgr2=0x7f30fc10d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:25.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:25.817+0000 7f30f9d9b640 1 --2- 172.21.15.99:0/3539610516 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30fc0fe500 0x7f30fc10d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:25.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:25.818+0000 7f30fa59c640 1 --2- 172.21.15.99:0/3539610516 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30fc0fe500 0x7f30fc10d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:25.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:25.818+0000 7f30fa59c640 1 -- 172.21.15.99:0/3539610516 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f4005040 con 0x7f30fc0fdbb0 2024-09-19T06:37:25.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:25.818+0000 7f30fa59c640 1 --2- 172.21.15.99:0/3539610516 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f30fc0fdbb0 0x7f30fc10d0e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f30f4003080 tx=0x7f30f4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:25.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:25.818+0000 7f30eaffd640 1 -- 172.21.15.99:0/3539610516 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30f4038070 con 0x7f30fc0fdbb0 2024-09-19T06:37:25.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:25.818+0000 7f30eaffd640 1 -- 172.21.15.99:0/3539610516 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f30f402abd0 con 0x7f30fc0fdbb0 2024-09-19T06:37:25.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:25.818+0000 7f3100bc7640 1 -- 172.21.15.99:0/3539610516 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30fc10e670 con 0x7f30fc0fdbb0 2024-09-19T06:37:25.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:25.818+0000 7f30eaffd640 1 -- 172.21.15.99:0/3539610516 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30f403e670 con 0x7f30fc0fdbb0 2024-09-19T06:37:25.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:25.818+0000 7f3100bc7640 1 -- 172.21.15.99:0/3539610516 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30fc10ec10 con 0x7f30fc0fdbb0 2024-09-19T06:37:25.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:25.819+0000 7f3100bc7640 1 -- 172.21.15.99:0/3539610516 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30fc0fa050 con 0x7f30fc0fdbb0 2024-09-19T06:37:25.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:25.819+0000 7f30eaffd640 1 -- 172.21.15.99:0/3539610516 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f30f4030020 con 0x7f30fc0fdbb0 2024-09-19T06:37:25.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:25.820+0000 7f30eaffd640 1 --2- 172.21.15.99:0/3539610516 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f30e406ed60 0x7f30e4071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:25.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:25.820+0000 7f30eaffd640 1 -- 172.21.15.99:0/3539610516 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f30f40ae250 con 0x7f30fc0fdbb0 2024-09-19T06:37:25.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:25.820+0000 7f30f9d9b640 1 --2- 172.21.15.99:0/3539610516 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f30e406ed60 0x7f30e4071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:25.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:25.820+0000 7f30f9d9b640 1 --2- 172.21.15.99:0/3539610516 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f30e406ed60 0x7f30e4071210 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f30f0007fd0 tx=0x7f30f0009040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:25.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:25.824+0000 7f30eaffd640 1 -- 172.21.15.99:0/3539610516 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f30f407b6b0 con 0x7f30fc0fdbb0 2024-09-19T06:37:25.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:25.990+0000 7f3100bc7640 1 -- 172.21.15.99:0/3539610516 --> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f30fc10ef40 con 0x7f30e406ed60 2024-09-19T06:37:25.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:25.992+0000 7f30eaffd640 1 -- 172.21.15.99:0/3539610516 <== mgr.14206 v2:172.21.15.99:6800/886909451 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f30fc10ef40 con 0x7f30e406ed60 2024-09-19T06:37:25.993 INFO:teuthology.orchestra.run.smithi099.stdout:Backend: cephadm 2024-09-19T06:37:25.993 INFO:teuthology.orchestra.run.smithi099.stdout:Available: Yes 2024-09-19T06:37:25.993 INFO:teuthology.orchestra.run.smithi099.stdout:Paused: No 2024-09-19T06:37:25.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:25.993+0000 7f3100bc7640 1 -- 172.21.15.99:0/3539610516 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f30e406ed60 msgr2=0x7f30e4071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:25.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:25.993+0000 7f3100bc7640 1 --2- 172.21.15.99:0/3539610516 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f30e406ed60 0x7f30e4071210 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f30f0007fd0 tx=0x7f30f0009040 comp rx=0 tx=0).stop 2024-09-19T06:37:25.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:25.993+0000 7f3100bc7640 1 -- 172.21.15.99:0/3539610516 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f30fc0fdbb0 msgr2=0x7f30fc10d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:25.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:25.993+0000 7f3100bc7640 1 --2- 172.21.15.99:0/3539610516 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f30fc0fdbb0 0x7f30fc10d0e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f30f4003080 tx=0x7f30f4009da0 comp rx=0 tx=0).stop 2024-09-19T06:37:25.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:25.994+0000 7f3100bc7640 1 -- 172.21.15.99:0/3539610516 shutdown_connections 2024-09-19T06:37:25.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:25.994+0000 7f3100bc7640 1 --2- 172.21.15.99:0/3539610516 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f30e406ed60 0x7f30e4071210 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:25.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:25.994+0000 7f3100bc7640 1 --2- 172.21.15.99:0/3539610516 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30fc0fe500 0x7f30fc10d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:25.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:25.994+0000 7f3100bc7640 1 --2- 172.21.15.99:0/3539610516 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f30fc0fdbb0 0x7f30fc10d0e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:25.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:25.994+0000 7f3100bc7640 1 -- 172.21.15.99:0/3539610516 >> 172.21.15.99:0/3539610516 conn(0x7f30fc0f63b0 msgr2=0x7f30fc0f7b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:25.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:25.994+0000 7f3100bc7640 1 -- 172.21.15.99:0/3539610516 shutdown_connections 2024-09-19T06:37:25.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:25.994+0000 7f3100bc7640 1 -- 172.21.15.99:0/3539610516 wait complete. 2024-09-19T06:37:26.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:26 smithi117 ceph-mon[34564]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:37:26.680 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:26 smithi099 ceph-mon[27651]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:37:26.705 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-19T06:37:26.948 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T06:37:27.400 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:27 smithi099 ceph-mon[27651]: from='client.14438 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:37:27.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:27 smithi117 ceph-mon[34564]: from='client.14438 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:37:28.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:28.493+0000 7fb28db97640 1 -- 172.21.15.99:0/2755744428 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb2880fb430 msgr2=0x7fb2880fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:28.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:28.493+0000 7fb28db97640 1 --2- 172.21.15.99:0/2755744428 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb2880fb430 0x7fb2880fb840 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb2780048d0 tx=0x7fb278009da0 comp rx=0 tx=0).stop 2024-09-19T06:37:28.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:28.493+0000 7fb28db97640 1 -- 172.21.15.99:0/2755744428 shutdown_connections 2024-09-19T06:37:28.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:28.493+0000 7fb28db97640 1 --2- 172.21.15.99:0/2755744428 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2880fc700 0x7fb2880fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:28.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:28.493+0000 7fb28db97640 1 --2- 172.21.15.99:0/2755744428 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb2880fb430 0x7fb2880fb840 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:28.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:28.493+0000 7fb28db97640 1 -- 172.21.15.99:0/2755744428 >> 172.21.15.99:0/2755744428 conn(0x7fb2880f6c10 msgr2=0x7fb2880f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:28.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:28.493+0000 7fb28db97640 1 -- 172.21.15.99:0/2755744428 shutdown_connections 2024-09-19T06:37:28.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:28.493+0000 7fb28db97640 1 -- 172.21.15.99:0/2755744428 wait complete. 2024-09-19T06:37:28.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:28.493+0000 7fb28db97640 1 Processor -- start 2024-09-19T06:37:28.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:28.493+0000 7fb28db97640 1 -- start start 2024-09-19T06:37:28.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:28.494+0000 7fb28db97640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2880fb430 0x7fb28810bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:28.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:28.494+0000 7fb28db97640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb2880fc700 0x7fb28810c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:28.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:28.494+0000 7fb28db97640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb28810cb10 con 0x7fb2880fc700 2024-09-19T06:37:28.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:28.494+0000 7fb28db97640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb28810d330 con 0x7fb2880fb430 2024-09-19T06:37:28.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:28.494+0000 7fb27ffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb2880fc700 0x7fb28810c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:28.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:28.494+0000 7fb27ffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb2880fc700 0x7fb28810c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56468/0 (socket says 172.21.15.99:56468) 2024-09-19T06:37:28.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:28.494+0000 7fb27ffff640 1 -- 172.21.15.99:0/1777328421 learned_addr learned my addr 172.21.15.99:0/1777328421 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:37:28.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:28.494+0000 7fb2877fe640 1 --2- 172.21.15.99:0/1777328421 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2880fb430 0x7fb28810bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:28.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:28.494+0000 7fb27ffff640 1 -- 172.21.15.99:0/1777328421 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2880fb430 msgr2=0x7fb28810bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:28.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:28.494+0000 7fb27ffff640 1 --2- 172.21.15.99:0/1777328421 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2880fb430 0x7fb28810bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:28.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:28.494+0000 7fb27ffff640 1 -- 172.21.15.99:0/1777328421 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb278005040 con 0x7fb2880fc700 2024-09-19T06:37:28.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:28.494+0000 7fb27ffff640 1 --2- 172.21.15.99:0/1777328421 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb2880fc700 0x7fb28810c4c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb27000fce0 tx=0x7fb270004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:28.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:28.494+0000 7fb284ff9640 1 -- 172.21.15.99:0/1777328421 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb27000de30 con 0x7fb2880fc700 2024-09-19T06:37:28.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:28.494+0000 7fb28db97640 1 -- 172.21.15.99:0/1777328421 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb28810d560 con 0x7fb2880fc700 2024-09-19T06:37:28.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:28.494+0000 7fb284ff9640 1 -- 172.21.15.99:0/1777328421 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb2700090d0 con 0x7fb2880fc700 2024-09-19T06:37:28.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:28.494+0000 7fb284ff9640 1 -- 172.21.15.99:0/1777328421 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2700126a0 con 0x7fb2880fc700 2024-09-19T06:37:28.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:28.494+0000 7fb28db97640 1 -- 172.21.15.99:0/1777328421 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb28810db00 con 0x7fb2880fc700 2024-09-19T06:37:28.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:28.495+0000 7fb28db97640 1 -- 172.21.15.99:0/1777328421 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2880fa890 con 0x7fb2880fc700 2024-09-19T06:37:28.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:28.496+0000 7fb284ff9640 1 -- 172.21.15.99:0/1777328421 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fb270009240 con 0x7fb2880fc700 2024-09-19T06:37:28.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:28.496+0000 7fb284ff9640 1 --2- 172.21.15.99:0/1777328421 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fb27406ed60 0x7fb274071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:28.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:28.496+0000 7fb284ff9640 1 -- 172.21.15.99:0/1777328421 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fb270090300 con 0x7fb2880fc700 2024-09-19T06:37:28.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:28.497+0000 7fb2877fe640 1 --2- 172.21.15.99:0/1777328421 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fb27406ed60 0x7fb274071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:28.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:28.497+0000 7fb2877fe640 1 --2- 172.21.15.99:0/1777328421 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fb27406ed60 0x7fb274071210 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb27800b020 tx=0x7fb278035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:28.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:28.501+0000 7fb284ff9640 1 -- 172.21.15.99:0/1777328421 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fb27005d810 con 0x7fb2880fc700 2024-09-19T06:37:28.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:28 smithi117 ceph-mon[34564]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:37:28.665 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:28 smithi099 ceph-mon[27651]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:37:28.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:28.664+0000 7fb28db97640 1 -- 172.21.15.99:0/1777328421 --> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb28810de30 con 0x7fb27406ed60 2024-09-19T06:37:28.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:28.672+0000 7fb284ff9640 1 -- 172.21.15.99:0/1777328421 <== mgr.14206 v2:172.21.15.99:6800/886909451 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2826 (secure 0 0 0) 0x7fb28810de30 con 0x7fb27406ed60 2024-09-19T06:37:28.673 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T06:37:28.673 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.smithi099 smithi099 *:9093,9094 running (3m) 2m ago 4m 26.2M - 0.25.0 c8568f914cd2 586edf6f2401 2024-09-19T06:37:28.673 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi099 smithi099 running (5m) 2m ago 5m 6895k - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 216ce2ef7f1e 2024-09-19T06:37:28.673 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi117 smithi117 running (4m) 64s ago 4m 6899k - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 b4c328bdec52 2024-09-19T06:37:28.673 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.smithi099 smithi099 *:3000 running (3m) 2m ago 4m 78.3M - 9.4.7 954c08fa6188 94ad8b9b7c91 2024-09-19T06:37:28.674 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi099.pgvkqi smithi099 *:9283,8765,8443 running (6m) 2m ago 6m 437M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 8e7ecb77f4cd 2024-09-19T06:37:28.674 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi117.ssmkcf smithi117 *:8443,9283 running (4m) 64s ago 4m 402M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 785113b1da28 2024-09-19T06:37:28.674 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi099 smithi099 running (6m) 2m ago 6m 44.1M 2048M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 7375c241d067 2024-09-19T06:37:28.674 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi117 smithi117 running (4m) 64s ago 4m 38.4M 2048M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 bd4854d5213e 2024-09-19T06:37:28.674 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi099 smithi099 *:9100 running (5m) 2m ago 5m 13.9M - 1.5.0 0da6a335fe13 09c786facf49 2024-09-19T06:37:28.674 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi117 smithi117 *:9100 running (4m) 64s ago 4m 16.7M - 1.5.0 0da6a335fe13 04f52626cbca 2024-09-19T06:37:28.674 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (3m) 2m ago 3m 36.8M 4288M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 cf8d3dd4a987 2024-09-19T06:37:28.674 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (2m) 2m ago 2m 35.5M 4288M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 bc5b04b8bf9f 2024-09-19T06:37:28.674 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (2m) 2m ago 2m 11.4M 4288M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 cedc7e3698d8 2024-09-19T06:37:28.674 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi117 running (119s) 64s ago 118s 39.4M 5312M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 5984ed999c91 2024-09-19T06:37:28.674 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi117 running (94s) 64s ago 94s 36.8M 5312M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 6a2fc0c51c05 2024-09-19T06:37:28.674 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi117 running (69s) 64s ago 69s 12.2M 5312M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 39dcb7dbf0e3 2024-09-19T06:37:28.674 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.smithi099 smithi099 *:9095 running (3m) 2m ago 4m 38.0M - 2.43.0 a07b618ecd1d 82e83626cde9 2024-09-19T06:37:28.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:28.674+0000 7fb28db97640 1 -- 172.21.15.99:0/1777328421 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fb27406ed60 msgr2=0x7fb274071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:28.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:28.674+0000 7fb28db97640 1 --2- 172.21.15.99:0/1777328421 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fb27406ed60 0x7fb274071210 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb27800b020 tx=0x7fb278035040 comp rx=0 tx=0).stop 2024-09-19T06:37:28.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:28.674+0000 7fb28db97640 1 -- 172.21.15.99:0/1777328421 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb2880fc700 msgr2=0x7fb28810c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:28.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:28.674+0000 7fb28db97640 1 --2- 172.21.15.99:0/1777328421 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb2880fc700 0x7fb28810c4c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb27000fce0 tx=0x7fb270004600 comp rx=0 tx=0).stop 2024-09-19T06:37:28.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:28.674+0000 7fb28db97640 1 -- 172.21.15.99:0/1777328421 shutdown_connections 2024-09-19T06:37:28.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:28.674+0000 7fb28db97640 1 --2- 172.21.15.99:0/1777328421 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fb27406ed60 0x7fb274071210 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:28.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:28.674+0000 7fb28db97640 1 --2- 172.21.15.99:0/1777328421 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb2880fc700 0x7fb28810c4c0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:28.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:28.674+0000 7fb28db97640 1 --2- 172.21.15.99:0/1777328421 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb2880fb430 0x7fb28810bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:28.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:28.674+0000 7fb28db97640 1 -- 172.21.15.99:0/1777328421 >> 172.21.15.99:0/1777328421 conn(0x7fb2880f6c10 msgr2=0x7fb2880f83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:28.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:28.674+0000 7fb28db97640 1 -- 172.21.15.99:0/1777328421 shutdown_connections 2024-09-19T06:37:28.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:28.674+0000 7fb28db97640 1 -- 172.21.15.99:0/1777328421 wait complete. 2024-09-19T06:37:29.365 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-19T06:37:29.621 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T06:37:30.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:30 smithi117 ceph-mon[34564]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:37:30.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:30 smithi117 ceph-mon[34564]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:37:30.609 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:30 smithi099 ceph-mon[27651]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:37:30.610 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:30 smithi099 ceph-mon[27651]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:37:31.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:31.216+0000 7ff882e58640 1 -- 172.21.15.99:0/120461150 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff87c0fb430 msgr2=0x7ff87c0fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:31.216+0000 7ff882e58640 1 --2- 172.21.15.99:0/120461150 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff87c0fb430 0x7ff87c0fb840 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff8700048d0 tx=0x7ff870009da0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:31.216+0000 7ff882e58640 1 -- 172.21.15.99:0/120461150 shutdown_connections 2024-09-19T06:37:31.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:31.216+0000 7ff882e58640 1 --2- 172.21.15.99:0/120461150 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff87c0fc700 0x7ff87c0fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:31.216+0000 7ff882e58640 1 --2- 172.21.15.99:0/120461150 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff87c0fb430 0x7ff87c0fb840 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:31.216+0000 7ff882e58640 1 -- 172.21.15.99:0/120461150 >> 172.21.15.99:0/120461150 conn(0x7ff87c0f6c10 msgr2=0x7ff87c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:31.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:31.216+0000 7ff882e58640 1 -- 172.21.15.99:0/120461150 shutdown_connections 2024-09-19T06:37:31.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:31.216+0000 7ff882e58640 1 -- 172.21.15.99:0/120461150 wait complete. 2024-09-19T06:37:31.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:31.217+0000 7ff882e58640 1 Processor -- start 2024-09-19T06:37:31.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:31.217+0000 7ff882e58640 1 -- start start 2024-09-19T06:37:31.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:31.217+0000 7ff882e58640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff87c0fb430 0x7ff87c10d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:31.217+0000 7ff882e58640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff87c0fc700 0x7ff87c10d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:31.217+0000 7ff882e58640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff87c10dc30 con 0x7ff87c0fb430 2024-09-19T06:37:31.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:31.217+0000 7ff882e58640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff87c10e450 con 0x7ff87c0fc700 2024-09-19T06:37:31.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:31.217+0000 7ff880bf4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff87c0fb430 0x7ff87c10d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:31.217+0000 7ff880bf4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff87c0fb430 0x7ff87c10d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56476/0 (socket says 172.21.15.99:56476) 2024-09-19T06:37:31.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:31.217+0000 7ff880bf4640 1 -- 172.21.15.99:0/3176686053 learned_addr learned my addr 172.21.15.99:0/3176686053 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:37:31.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:31.218+0000 7ff880bf4640 1 -- 172.21.15.99:0/3176686053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff87c0fc700 msgr2=0x7ff87c10d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:31.218+0000 7ff87bfff640 1 --2- 172.21.15.99:0/3176686053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff87c0fc700 0x7ff87c10d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:31.218+0000 7ff880bf4640 1 --2- 172.21.15.99:0/3176686053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff87c0fc700 0x7ff87c10d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:31.218+0000 7ff880bf4640 1 -- 172.21.15.99:0/3176686053 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff870005040 con 0x7ff87c0fb430 2024-09-19T06:37:31.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:31.218+0000 7ff87bfff640 1 --2- 172.21.15.99:0/3176686053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff87c0fc700 0x7ff87c10d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:37:31.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:31.218+0000 7ff880bf4640 1 --2- 172.21.15.99:0/3176686053 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff87c0fb430 0x7ff87c10d0a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff8700043d0 tx=0x7ff870009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:31.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:31.218+0000 7ff8797fa640 1 -- 172.21.15.99:0/3176686053 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff870038070 con 0x7ff87c0fb430 2024-09-19T06:37:31.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:31.218+0000 7ff882e58640 1 -- 172.21.15.99:0/3176686053 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff87c10e680 con 0x7ff87c0fb430 2024-09-19T06:37:31.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:31.218+0000 7ff8797fa640 1 -- 172.21.15.99:0/3176686053 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff87002ae90 con 0x7ff87c0fb430 2024-09-19T06:37:31.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:31.218+0000 7ff8797fa640 1 -- 172.21.15.99:0/3176686053 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff87003e670 con 0x7ff87c0fb430 2024-09-19T06:37:31.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:31.218+0000 7ff882e58640 1 -- 172.21.15.99:0/3176686053 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff87c10ec20 con 0x7ff87c0fb430 2024-09-19T06:37:31.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:31.219+0000 7ff882e58640 1 -- 172.21.15.99:0/3176686053 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff87c0fa890 con 0x7ff87c0fb430 2024-09-19T06:37:31.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:31.220+0000 7ff8797fa640 1 -- 172.21.15.99:0/3176686053 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7ff870030020 con 0x7ff87c0fb430 2024-09-19T06:37:31.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:31.220+0000 7ff8797fa640 1 --2- 172.21.15.99:0/3176686053 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7ff86c06ed60 0x7ff86c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:31.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:31.220+0000 7ff8797fa640 1 -- 172.21.15.99:0/3176686053 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7ff8700ae0e0 con 0x7ff87c0fb430 2024-09-19T06:37:31.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:31.220+0000 7ff87bfff640 1 --2- 172.21.15.99:0/3176686053 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7ff86c06ed60 0x7ff86c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:31.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:31.220+0000 7ff87bfff640 1 --2- 172.21.15.99:0/3176686053 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7ff86c06ed60 0x7ff86c071210 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff87c10ce50 tx=0x7ff86800b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:31.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:31.224+0000 7ff8797fa640 1 -- 172.21.15.99:0/3176686053 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ff87007b540 con 0x7ff87c0fb430 2024-09-19T06:37:31.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:31.384+0000 7ff882e58640 1 -- 172.21.15.99:0/3176686053 --> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7ff87c103fe0 con 0x7ff86c06ed60 2024-09-19T06:37:31.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:31.388+0000 7ff8797fa640 1 -- 172.21.15.99:0/3176686053 <== mgr.14206 v2:172.21.15.99:6800/886909451 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1170 (secure 0 0 0) 0x7ff87c103fe0 con 0x7ff86c06ed60 2024-09-19T06:37:31.389 INFO:teuthology.orchestra.run.smithi099.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-19T06:37:31.390 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager ?:9093,9094 1/1 2m ago 5m count:1 2024-09-19T06:37:31.390 INFO:teuthology.orchestra.run.smithi099.stdout:crash 2/2 2m ago 5m * 2024-09-19T06:37:31.390 INFO:teuthology.orchestra.run.smithi099.stdout:grafana ?:3000 1/1 2m ago 5m count:1 2024-09-19T06:37:31.390 INFO:teuthology.orchestra.run.smithi099.stdout:mgr 2/2 2m ago 5m count:2 2024-09-19T06:37:31.390 INFO:teuthology.orchestra.run.smithi099.stdout:mon 2/2 2m ago 4m smithi099:172.21.15.99=smithi099;smithi117:172.21.15.117=smithi117;count:2 2024-09-19T06:37:31.390 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter ?:9100 2/2 2m ago 5m * 2024-09-19T06:37:31.390 INFO:teuthology.orchestra.run.smithi099.stdout:osd 6 2m ago - 2024-09-19T06:37:31.390 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus ?:9095 1/1 2m ago 5m count:1 2024-09-19T06:37:31.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:31.390+0000 7ff882e58640 1 -- 172.21.15.99:0/3176686053 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7ff86c06ed60 msgr2=0x7ff86c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:31.390+0000 7ff882e58640 1 --2- 172.21.15.99:0/3176686053 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7ff86c06ed60 0x7ff86c071210 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff87c10ce50 tx=0x7ff86800b040 comp rx=0 tx=0).stop 2024-09-19T06:37:31.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:31.390+0000 7ff882e58640 1 -- 172.21.15.99:0/3176686053 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff87c0fb430 msgr2=0x7ff87c10d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:31.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:31.390+0000 7ff882e58640 1 --2- 172.21.15.99:0/3176686053 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff87c0fb430 0x7ff87c10d0a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff8700043d0 tx=0x7ff870009da0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:31.390+0000 7ff882e58640 1 -- 172.21.15.99:0/3176686053 shutdown_connections 2024-09-19T06:37:31.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:31.390+0000 7ff882e58640 1 --2- 172.21.15.99:0/3176686053 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7ff86c06ed60 0x7ff86c071210 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:31.390+0000 7ff882e58640 1 --2- 172.21.15.99:0/3176686053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff87c0fc700 0x7ff87c10d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:31.390+0000 7ff882e58640 1 --2- 172.21.15.99:0/3176686053 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff87c0fb430 0x7ff87c10d0a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:31.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:31.390+0000 7ff882e58640 1 -- 172.21.15.99:0/3176686053 >> 172.21.15.99:0/3176686053 conn(0x7ff87c0f6c10 msgr2=0x7ff87c0f8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:31.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:31.390+0000 7ff882e58640 1 -- 172.21.15.99:0/3176686053 shutdown_connections 2024-09-19T06:37:31.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:31.390+0000 7ff882e58640 1 -- 172.21.15.99:0/3176686053 wait complete. 2024-09-19T06:37:32.178 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-19T06:37:32.426 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T06:37:32.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:32 smithi099 ceph-mon[27651]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:37:32.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:32 smithi117 ceph-mon[34564]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:37:33.470 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:33 smithi099 ceph-mon[27651]: from='client.14446 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:37:33.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:33 smithi117 ceph-mon[34564]: from='client.14446 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:37:33.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:33.958+0000 7fc94bd02640 1 -- 172.21.15.99:0/2219033479 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9440fe500 msgr2=0x7fc9440fa660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:33.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:33.958+0000 7fc94bd02640 1 --2- 172.21.15.99:0/2219033479 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9440fe500 0x7fc9440fa660 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc9400048d0 tx=0x7fc940009da0 comp rx=0 tx=0).stop 2024-09-19T06:37:33.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:33.958+0000 7fc94bd02640 1 -- 172.21.15.99:0/2219033479 shutdown_connections 2024-09-19T06:37:33.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:33.958+0000 7fc94bd02640 1 --2- 172.21.15.99:0/2219033479 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9440fe500 0x7fc9440fa660 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:33.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:33.958+0000 7fc94bd02640 1 --2- 172.21.15.99:0/2219033479 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9440fdbb0 0x7fc9440fdfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:33.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:33.958+0000 7fc94bd02640 1 -- 172.21.15.99:0/2219033479 >> 172.21.15.99:0/2219033479 conn(0x7fc9440f63b0 msgr2=0x7fc9440f87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:33.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:33.958+0000 7fc94bd02640 1 -- 172.21.15.99:0/2219033479 shutdown_connections 2024-09-19T06:37:33.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:33.958+0000 7fc94bd02640 1 -- 172.21.15.99:0/2219033479 wait complete. 2024-09-19T06:37:33.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:33.958+0000 7fc94bd02640 1 Processor -- start 2024-09-19T06:37:33.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:33.959+0000 7fc94bd02640 1 -- start start 2024-09-19T06:37:33.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:33.959+0000 7fc94bd02640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9440fdbb0 0x7fc94410d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:33.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:33.959+0000 7fc94bd02640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9440fe500 0x7fc94410d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:33.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:33.959+0000 7fc94bd02640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc94410e4d0 con 0x7fc9440fdbb0 2024-09-19T06:37:33.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:33.959+0000 7fc94bd02640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc94410e640 con 0x7fc9440fe500 2024-09-19T06:37:33.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:33.959+0000 7fc949a9e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9440fdbb0 0x7fc94410d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:33.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:33.959+0000 7fc949a9e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9440fdbb0 0x7fc94410d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56490/0 (socket says 172.21.15.99:56490) 2024-09-19T06:37:33.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:33.959+0000 7fc949a9e640 1 -- 172.21.15.99:0/3160033384 learned_addr learned my addr 172.21.15.99:0/3160033384 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:37:33.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:33.959+0000 7fc949a9e640 1 -- 172.21.15.99:0/3160033384 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9440fe500 msgr2=0x7fc94410d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:33.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:33.959+0000 7fc94929d640 1 --2- 172.21.15.99:0/3160033384 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9440fe500 0x7fc94410d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:33.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:33.959+0000 7fc949a9e640 1 --2- 172.21.15.99:0/3160033384 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9440fe500 0x7fc94410d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:33.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:33.959+0000 7fc949a9e640 1 -- 172.21.15.99:0/3160033384 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc940005040 con 0x7fc9440fdbb0 2024-09-19T06:37:33.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:33.959+0000 7fc949a9e640 1 --2- 172.21.15.99:0/3160033384 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9440fdbb0 0x7fc94410d120 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc93400b790 tx=0x7fc9340091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:33.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:33.959+0000 7fc93a7fc640 1 -- 172.21.15.99:0/3160033384 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc93400c700 con 0x7fc9440fdbb0 2024-09-19T06:37:33.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:33.959+0000 7fc93a7fc640 1 -- 172.21.15.99:0/3160033384 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc93400cd00 con 0x7fc9440fdbb0 2024-09-19T06:37:33.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:33.959+0000 7fc94bd02640 1 -- 172.21.15.99:0/3160033384 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc94410e920 con 0x7fc9440fdbb0 2024-09-19T06:37:33.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:33.959+0000 7fc93a7fc640 1 -- 172.21.15.99:0/3160033384 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc934015e70 con 0x7fc9440fdbb0 2024-09-19T06:37:33.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:33.959+0000 7fc94bd02640 1 -- 172.21.15.99:0/3160033384 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc94410ee40 con 0x7fc9440fdbb0 2024-09-19T06:37:33.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:33.960+0000 7fc94bd02640 1 -- 172.21.15.99:0/3160033384 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc944105810 con 0x7fc9440fdbb0 2024-09-19T06:37:33.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:33.961+0000 7fc93a7fc640 1 -- 172.21.15.99:0/3160033384 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fc934012070 con 0x7fc9440fdbb0 2024-09-19T06:37:33.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:33.961+0000 7fc93a7fc640 1 --2- 172.21.15.99:0/3160033384 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fc93006ed60 0x7fc930071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:33.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:33.961+0000 7fc93a7fc640 1 -- 172.21.15.99:0/3160033384 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fc93408d9c0 con 0x7fc9440fdbb0 2024-09-19T06:37:33.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:33.961+0000 7fc94929d640 1 --2- 172.21.15.99:0/3160033384 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fc93006ed60 0x7fc930071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:33.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:33.962+0000 7fc94929d640 1 --2- 172.21.15.99:0/3160033384 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fc93006ed60 0x7fc930071210 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc940000c00 tx=0x7fc940009da0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:33.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:33.965+0000 7fc93a7fc640 1 -- 172.21.15.99:0/3160033384 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fc93405ae20 con 0x7fc9440fdbb0 2024-09-19T06:37:34.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:34.124+0000 7fc94bd02640 1 -- 172.21.15.99:0/3160033384 --> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fc94410f0c0 con 0x7fc93006ed60 2024-09-19T06:37:34.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:34.126+0000 7fc93a7fc640 1 -- 172.21.15.99:0/3160033384 <== mgr.14206 v2:172.21.15.99:6800/886909451 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+148 (secure 0 0 0) 0x7fc94410f0c0 con 0x7fc93006ed60 2024-09-19T06:37:34.127 INFO:teuthology.orchestra.run.smithi099.stdout:HOST ADDR LABELS STATUS 2024-09-19T06:37:34.127 INFO:teuthology.orchestra.run.smithi099.stdout:smithi099 172.21.15.99 2024-09-19T06:37:34.127 INFO:teuthology.orchestra.run.smithi099.stdout:smithi117 172.21.15.117 2024-09-19T06:37:34.127 INFO:teuthology.orchestra.run.smithi099.stdout:2 hosts in cluster 2024-09-19T06:37:34.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:34.127+0000 7fc94bd02640 1 -- 172.21.15.99:0/3160033384 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fc93006ed60 msgr2=0x7fc930071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:34.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:34.127+0000 7fc94bd02640 1 --2- 172.21.15.99:0/3160033384 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fc93006ed60 0x7fc930071210 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc940000c00 tx=0x7fc940009da0 comp rx=0 tx=0).stop 2024-09-19T06:37:34.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:34.127+0000 7fc94bd02640 1 -- 172.21.15.99:0/3160033384 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9440fdbb0 msgr2=0x7fc94410d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:34.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:34.127+0000 7fc94bd02640 1 --2- 172.21.15.99:0/3160033384 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9440fdbb0 0x7fc94410d120 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc93400b790 tx=0x7fc9340091d0 comp rx=0 tx=0).stop 2024-09-19T06:37:34.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:34.128+0000 7fc94bd02640 1 -- 172.21.15.99:0/3160033384 shutdown_connections 2024-09-19T06:37:34.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:34.128+0000 7fc94bd02640 1 --2- 172.21.15.99:0/3160033384 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fc93006ed60 0x7fc930071210 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:34.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:34.128+0000 7fc94bd02640 1 --2- 172.21.15.99:0/3160033384 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc9440fe500 0x7fc94410d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:34.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:34.128+0000 7fc94bd02640 1 --2- 172.21.15.99:0/3160033384 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc9440fdbb0 0x7fc94410d120 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:34.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:34.128+0000 7fc94bd02640 1 -- 172.21.15.99:0/3160033384 >> 172.21.15.99:0/3160033384 conn(0x7fc9440f63b0 msgr2=0x7fc9440f7b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:34.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:34.128+0000 7fc94bd02640 1 -- 172.21.15.99:0/3160033384 shutdown_connections 2024-09-19T06:37:34.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:34.128+0000 7fc94bd02640 1 -- 172.21.15.99:0/3160033384 wait complete. 2024-09-19T06:37:34.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:34 smithi099 ceph-mon[27651]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:37:34.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:34 smithi117 ceph-mon[34564]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:37:34.828 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-19T06:37:35.073 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T06:37:35.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:35 smithi099 ceph-mon[27651]: from='client.14450 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:37:35.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:35 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:37:35.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:35 smithi117 ceph-mon[34564]: from='client.14450 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:37:35.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:35 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:37:36.519 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:36 smithi099 ceph-mon[27651]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:37:36.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:36 smithi117 ceph-mon[34564]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:37:36.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:36.723+0000 7f7c56ff4640 1 -- 172.21.15.99:0/3257949492 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7c500ff700 msgr2=0x7f7c50101ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:36.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:36.723+0000 7f7c56ff4640 1 --2- 172.21.15.99:0/3257949492 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7c500ff700 0x7f7c50101ae0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c0048d0 tx=0x7f7c3c009da0 comp rx=0 tx=0).stop 2024-09-19T06:37:36.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:36.723+0000 7f7c56ff4640 1 -- 172.21.15.99:0/3257949492 shutdown_connections 2024-09-19T06:37:36.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:36.723+0000 7f7c56ff4640 1 --2- 172.21.15.99:0/3257949492 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7c500ff700 0x7f7c50101ae0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:36.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:36.723+0000 7f7c56ff4640 1 --2- 172.21.15.99:0/3257949492 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c500666b0 0x7f7c500ff1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:36.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:36.723+0000 7f7c56ff4640 1 -- 172.21.15.99:0/3257949492 >> 172.21.15.99:0/3257949492 conn(0x7f7c500f6c10 msgr2=0x7f7c500f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:36.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:36.723+0000 7f7c56ff4640 1 -- 172.21.15.99:0/3257949492 shutdown_connections 2024-09-19T06:37:36.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:36.723+0000 7f7c56ff4640 1 -- 172.21.15.99:0/3257949492 wait complete. 2024-09-19T06:37:36.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:36.724+0000 7f7c56ff4640 1 Processor -- start 2024-09-19T06:37:36.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:36.724+0000 7f7c56ff4640 1 -- start start 2024-09-19T06:37:36.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:36.724+0000 7f7c56ff4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c500666b0 0x7f7c5010d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:36.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:36.724+0000 7f7c56ff4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7c500ff700 0x7f7c5010d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:36.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:36.724+0000 7f7c56ff4640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5010e560 con 0x7f7c500ff700 2024-09-19T06:37:36.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:36.724+0000 7f7c56ff4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5010e6d0 con 0x7f7c500666b0 2024-09-19T06:37:36.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:36.724+0000 7f7c4ffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7c500ff700 0x7f7c5010d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:36.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:36.724+0000 7f7c4ffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7c500ff700 0x7f7c5010d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:39178/0 (socket says 172.21.15.99:39178) 2024-09-19T06:37:36.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:36.724+0000 7f7c4ffff640 1 -- 172.21.15.99:0/710793168 learned_addr learned my addr 172.21.15.99:0/710793168 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:37:36.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:36.724+0000 7f7c54d90640 1 --2- 172.21.15.99:0/710793168 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c500666b0 0x7f7c5010d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:36.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:36.725+0000 7f7c4ffff640 1 -- 172.21.15.99:0/710793168 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c500666b0 msgr2=0x7f7c5010d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:36.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:36.725+0000 7f7c4ffff640 1 --2- 172.21.15.99:0/710793168 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c500666b0 0x7f7c5010d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:36.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:36.725+0000 7f7c4ffff640 1 -- 172.21.15.99:0/710793168 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c3c005040 con 0x7f7c500ff700 2024-09-19T06:37:36.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:36.725+0000 7f7c4ffff640 1 --2- 172.21.15.99:0/710793168 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7c500ff700 0x7f7c5010d740 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c0048a0 tx=0x7f7c3c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:36.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:36.725+0000 7f7c4d7fa640 1 -- 172.21.15.99:0/710793168 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c3c038070 con 0x7f7c500ff700 2024-09-19T06:37:36.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:36.725+0000 7f7c4d7fa640 1 -- 172.21.15.99:0/710793168 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7c3c009740 con 0x7f7c500ff700 2024-09-19T06:37:36.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:36.725+0000 7f7c56ff4640 1 -- 172.21.15.99:0/710793168 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c5010e950 con 0x7f7c500ff700 2024-09-19T06:37:36.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:36.725+0000 7f7c4d7fa640 1 -- 172.21.15.99:0/710793168 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c3c03db50 con 0x7f7c500ff700 2024-09-19T06:37:36.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:36.725+0000 7f7c56ff4640 1 -- 172.21.15.99:0/710793168 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c5010ee10 con 0x7f7c500ff700 2024-09-19T06:37:36.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:36.726+0000 7f7c56ff4640 1 -- 172.21.15.99:0/710793168 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c500fa8b0 con 0x7f7c500ff700 2024-09-19T06:37:36.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:36.726+0000 7f7c4d7fa640 1 -- 172.21.15.99:0/710793168 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f7c3c030020 con 0x7f7c500ff700 2024-09-19T06:37:36.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:36.727+0000 7f7c4d7fa640 1 --2- 172.21.15.99:0/710793168 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f7c4006ed60 0x7f7c40071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:36.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:36.727+0000 7f7c54d90640 1 --2- 172.21.15.99:0/710793168 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f7c4006ed60 0x7f7c40071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:36.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:36.727+0000 7f7c4d7fa640 1 -- 172.21.15.99:0/710793168 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f7c3c0ae840 con 0x7f7c500ff700 2024-09-19T06:37:36.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:36.727+0000 7f7c54d90640 1 --2- 172.21.15.99:0/710793168 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f7c4006ed60 0x7f7c40071210 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7c50066410 tx=0x7f7c44009120 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:36.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:36.731+0000 7f7c4d7fa640 1 -- 172.21.15.99:0/710793168 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f7c3c07bd20 con 0x7f7c500ff700 2024-09-19T06:37:36.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:36.890+0000 7f7c56ff4640 1 -- 172.21.15.99:0/710793168 --> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f7c5010f080 con 0x7f7c4006ed60 2024-09-19T06:37:36.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:36.892+0000 7f7c4d7fa640 1 -- 172.21.15.99:0/710793168 <== mgr.14206 v2:172.21.15.99:6800/886909451 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+399 (secure 0 0 0) 0x7f7c5010f080 con 0x7f7c4006ed60 2024-09-19T06:37:36.894 INFO:teuthology.orchestra.run.smithi099.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-19T06:37:36.894 INFO:teuthology.orchestra.run.smithi099.stdout:smithi099 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT62040101400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-19T06:37:36.894 INFO:teuthology.orchestra.run.smithi099.stdout:smithi117 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400V6400BGN 372G No 69s ago Has a FileSystem, LVM detected 2024-09-19T06:37:36.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:36.894+0000 7f7c56ff4640 1 -- 172.21.15.99:0/710793168 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f7c4006ed60 msgr2=0x7f7c40071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:36.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:36.894+0000 7f7c56ff4640 1 --2- 172.21.15.99:0/710793168 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f7c4006ed60 0x7f7c40071210 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7c50066410 tx=0x7f7c44009120 comp rx=0 tx=0).stop 2024-09-19T06:37:36.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:36.894+0000 7f7c56ff4640 1 -- 172.21.15.99:0/710793168 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7c500ff700 msgr2=0x7f7c5010d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:36.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:36.894+0000 7f7c56ff4640 1 --2- 172.21.15.99:0/710793168 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7c500ff700 0x7f7c5010d740 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c0048a0 tx=0x7f7c3c009da0 comp rx=0 tx=0).stop 2024-09-19T06:37:36.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:36.894+0000 7f7c56ff4640 1 -- 172.21.15.99:0/710793168 shutdown_connections 2024-09-19T06:37:36.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:36.894+0000 7f7c56ff4640 1 --2- 172.21.15.99:0/710793168 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f7c4006ed60 0x7f7c40071210 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:36.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:36.894+0000 7f7c56ff4640 1 --2- 172.21.15.99:0/710793168 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7c500ff700 0x7f7c5010d740 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:36.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:36.894+0000 7f7c56ff4640 1 --2- 172.21.15.99:0/710793168 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7c500666b0 0x7f7c5010d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:36.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:36.894+0000 7f7c56ff4640 1 -- 172.21.15.99:0/710793168 >> 172.21.15.99:0/710793168 conn(0x7f7c500f6c10 msgr2=0x7f7c500f7030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:36.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:36.895+0000 7f7c56ff4640 1 -- 172.21.15.99:0/710793168 shutdown_connections 2024-09-19T06:37:36.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:36.895+0000 7f7c56ff4640 1 -- 172.21.15.99:0/710793168 wait complete. 2024-09-19T06:37:37.593 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:37 smithi099 ceph-mon[27651]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:37:37.593 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:37 smithi099 ceph-mon[27651]: from='client.14454 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:37:37.617 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T06:37:37.628 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi099.front.sepia.ceph.com 2024-09-19T06:37:37.628 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-09-19T06:37:37.811 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:37 smithi117 ceph-mon[34564]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:37:37.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:37 smithi117 ceph-mon[34564]: from='client.14454 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:37:37.872 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T06:37:39.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:39.348+0000 7f228224d640 1 -- 172.21.15.99:0/3363016510 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f227c0fe500 msgr2=0x7f227c0fa660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:39.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:39.348+0000 7f228224d640 1 --2- 172.21.15.99:0/3363016510 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f227c0fe500 0x7f227c0fa660 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f22700048d0 tx=0x7f2270009da0 comp rx=0 tx=0).stop 2024-09-19T06:37:39.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:39.348+0000 7f228224d640 1 -- 172.21.15.99:0/3363016510 shutdown_connections 2024-09-19T06:37:39.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:39.348+0000 7f228224d640 1 --2- 172.21.15.99:0/3363016510 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f227c0fe500 0x7f227c0fa660 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:39.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:39.348+0000 7f228224d640 1 --2- 172.21.15.99:0/3363016510 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f227c0fdbb0 0x7f227c0fdfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:39.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:39.348+0000 7f228224d640 1 -- 172.21.15.99:0/3363016510 >> 172.21.15.99:0/3363016510 conn(0x7f227c0f63b0 msgr2=0x7f227c0f87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:39.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:39.348+0000 7f228224d640 1 -- 172.21.15.99:0/3363016510 shutdown_connections 2024-09-19T06:37:39.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:39.348+0000 7f228224d640 1 -- 172.21.15.99:0/3363016510 wait complete. 2024-09-19T06:37:39.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:39.349+0000 7f228224d640 1 Processor -- start 2024-09-19T06:37:39.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:39.349+0000 7f228224d640 1 -- start start 2024-09-19T06:37:39.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:39.349+0000 7f228224d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f227c0fdbb0 0x7f227c10d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:39.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:39.349+0000 7f228224d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f227c0fe500 0x7f227c10d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:39.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:39.349+0000 7f228224d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f227c10dc40 con 0x7f227c0fe500 2024-09-19T06:37:39.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:39.349+0000 7f228224d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f227c10e460 con 0x7f227c0fdbb0 2024-09-19T06:37:39.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:39.349+0000 7f227affd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f227c0fe500 0x7f227c10d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:39.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:39.349+0000 7f227affd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f227c0fe500 0x7f227c10d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:39198/0 (socket says 172.21.15.99:39198) 2024-09-19T06:37:39.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:39.349+0000 7f227affd640 1 -- 172.21.15.99:0/636791037 learned_addr learned my addr 172.21.15.99:0/636791037 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:37:39.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:39.349+0000 7f227b7fe640 1 --2- 172.21.15.99:0/636791037 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f227c0fdbb0 0x7f227c10d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:39.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:39.349+0000 7f227affd640 1 -- 172.21.15.99:0/636791037 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f227c0fdbb0 msgr2=0x7f227c10d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:39.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:39.349+0000 7f227affd640 1 --2- 172.21.15.99:0/636791037 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f227c0fdbb0 0x7f227c10d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:39.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:39.349+0000 7f227affd640 1 -- 172.21.15.99:0/636791037 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2270005040 con 0x7f227c0fe500 2024-09-19T06:37:39.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:39.349+0000 7f227b7fe640 1 --2- 172.21.15.99:0/636791037 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f227c0fdbb0 0x7f227c10d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:37:39.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:39.350+0000 7f227affd640 1 --2- 172.21.15.99:0/636791037 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f227c0fe500 0x7f227c10d5f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f22700048a0 tx=0x7f2270009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:39.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:39.350+0000 7f2263fff640 1 -- 172.21.15.99:0/636791037 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2270038070 con 0x7f227c0fe500 2024-09-19T06:37:39.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:39.350+0000 7f2263fff640 1 -- 172.21.15.99:0/636791037 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f227002abd0 con 0x7f227c0fe500 2024-09-19T06:37:39.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:39.350+0000 7f228224d640 1 -- 172.21.15.99:0/636791037 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f227c10e690 con 0x7f227c0fe500 2024-09-19T06:37:39.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:39.350+0000 7f2263fff640 1 -- 172.21.15.99:0/636791037 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2270033640 con 0x7f227c0fe500 2024-09-19T06:37:39.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:39.350+0000 7f228224d640 1 -- 172.21.15.99:0/636791037 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f227c10ec30 con 0x7f227c0fe500 2024-09-19T06:37:39.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:39.351+0000 7f228224d640 1 -- 172.21.15.99:0/636791037 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f227c0fa050 con 0x7f227c0fe500 2024-09-19T06:37:39.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:39.351+0000 7f2263fff640 1 -- 172.21.15.99:0/636791037 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f2270030020 con 0x7f227c0fe500 2024-09-19T06:37:39.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:39.352+0000 7f2263fff640 1 --2- 172.21.15.99:0/636791037 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f226406ed60 0x7f2264071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:39.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:39.352+0000 7f2263fff640 1 -- 172.21.15.99:0/636791037 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f22700ae100 con 0x7f227c0fe500 2024-09-19T06:37:39.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:39.352+0000 7f227b7fe640 1 --2- 172.21.15.99:0/636791037 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f226406ed60 0x7f2264071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:39.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:39.352+0000 7f227b7fe640 1 --2- 172.21.15.99:0/636791037 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f226406ed60 0x7f2264071210 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f226c0041d0 tx=0x7f226c009040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:39.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:39.356+0000 7f2263fff640 1 -- 172.21.15.99:0/636791037 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f227007b5e0 con 0x7f227c0fe500 2024-09-19T06:37:39.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:39.534+0000 7f228224d640 1 -- 172.21.15.99:0/636791037 --> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f227c10ef60 con 0x7f226406ed60 2024-09-19T06:37:39.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:39 smithi099 ceph-mon[27651]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:37:40.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:39 smithi117 ceph-mon[34564]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:37:40.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:40.856+0000 7f2263fff640 1 -- 172.21.15.99:0/636791037 <== mgr.14206 v2:172.21.15.99:6800/886909451 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f227c10ef60 con 0x7f226406ed60 2024-09-19T06:37:40.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:40.858+0000 7f228224d640 1 -- 172.21.15.99:0/636791037 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f226406ed60 msgr2=0x7f2264071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:40.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:40.858+0000 7f228224d640 1 --2- 172.21.15.99:0/636791037 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f226406ed60 0x7f2264071210 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f226c0041d0 tx=0x7f226c009040 comp rx=0 tx=0).stop 2024-09-19T06:37:40.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:40.858+0000 7f228224d640 1 -- 172.21.15.99:0/636791037 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f227c0fe500 msgr2=0x7f227c10d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:40.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:40.858+0000 7f228224d640 1 --2- 172.21.15.99:0/636791037 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f227c0fe500 0x7f227c10d5f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f22700048a0 tx=0x7f2270009da0 comp rx=0 tx=0).stop 2024-09-19T06:37:40.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:40.858+0000 7f228224d640 1 -- 172.21.15.99:0/636791037 shutdown_connections 2024-09-19T06:37:40.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:40.858+0000 7f228224d640 1 --2- 172.21.15.99:0/636791037 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f226406ed60 0x7f2264071210 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:40.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:40.858+0000 7f228224d640 1 --2- 172.21.15.99:0/636791037 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f227c0fe500 0x7f227c10d5f0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:40.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:40.858+0000 7f228224d640 1 --2- 172.21.15.99:0/636791037 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f227c0fdbb0 0x7f227c10d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:40.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:40.858+0000 7f228224d640 1 -- 172.21.15.99:0/636791037 >> 172.21.15.99:0/636791037 conn(0x7f227c0f63b0 msgr2=0x7f227c0f7b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:40.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:40.858+0000 7f228224d640 1 -- 172.21.15.99:0/636791037 shutdown_connections 2024-09-19T06:37:40.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:40.858+0000 7f228224d640 1 -- 172.21.15.99:0/636791037 wait complete. 2024-09-19T06:37:41.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:40 smithi117 ceph-mon[34564]: from='client.14458 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:37:41.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:40 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-19T06:37:41.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:40 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-19T06:37:41.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:40 smithi117 ceph-mon[34564]: osdmap e40: 6 total, 6 up, 6 in 2024-09-19T06:37:41.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:40 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-19T06:37:41.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:40 smithi099 ceph-mon[27651]: from='client.14458 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:37:41.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:40 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-19T06:37:41.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:40 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-19T06:37:41.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:40 smithi099 ceph-mon[27651]: osdmap e40: 6 total, 6 up, 6 in 2024-09-19T06:37:41.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:40 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-19T06:37:41.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:40 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-mon-smithi099[27647]: 2024-09-19T06:37:40.837+0000 7fb967e82640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T06:37:41.534 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-19T06:37:42.053 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:41 smithi099 ceph-mon[27651]: pgmap v166: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:37:42.053 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:41 smithi099 ceph-mon[27651]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T06:37:42.053 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:41 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-19T06:37:42.053 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:41 smithi099 ceph-mon[27651]: osdmap e41: 6 total, 6 up, 6 in 2024-09-19T06:37:42.053 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:41 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-19T06:37:42.054 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:41 smithi099 ceph-mon[27651]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T06:37:42.054 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:41 smithi099 ceph-mon[27651]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-19T06:37:42.054 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:41 smithi099 ceph-mon[27651]: osdmap e42: 6 total, 6 up, 6 in 2024-09-19T06:37:42.054 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:41 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-19T06:37:42.054 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:41 smithi099 ceph-mon[27651]: fsmap cephfs:0 2024-09-19T06:37:42.054 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:41 smithi099 ceph-mon[27651]: Saving service mds.cephfs spec with placement count:4 2024-09-19T06:37:42.054 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:41 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:37:42.054 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:41 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:37:42.054 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:41 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:37:42.054 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:41 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:37:42.054 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:41 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:37:42.054 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:41 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi099.obarqf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:37:42.054 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:41 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi099.obarqf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:37:42.055 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:41 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:37:42.055 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:41 smithi099 ceph-mon[27651]: Deploying daemon mds.cephfs.smithi099.obarqf on smithi099 2024-09-19T06:37:42.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:41 smithi117 ceph-mon[34564]: pgmap v166: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:37:42.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:41 smithi117 ceph-mon[34564]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T06:37:42.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:41 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-19T06:37:42.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:41 smithi117 ceph-mon[34564]: osdmap e41: 6 total, 6 up, 6 in 2024-09-19T06:37:42.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:41 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-19T06:37:42.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:41 smithi117 ceph-mon[34564]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T06:37:42.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:41 smithi117 ceph-mon[34564]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-19T06:37:42.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:41 smithi117 ceph-mon[34564]: osdmap e42: 6 total, 6 up, 6 in 2024-09-19T06:37:42.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:41 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-19T06:37:42.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:41 smithi117 ceph-mon[34564]: fsmap cephfs:0 2024-09-19T06:37:42.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:41 smithi117 ceph-mon[34564]: Saving service mds.cephfs spec with placement count:4 2024-09-19T06:37:42.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:41 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:37:42.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:41 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:37:42.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:41 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:37:42.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:41 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:37:42.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:41 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:37:42.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:41 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi099.obarqf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:37:42.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:41 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi099.obarqf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:37:42.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:41 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:37:42.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:41 smithi117 ceph-mon[34564]: Deploying daemon mds.cephfs.smithi099.obarqf on smithi099 2024-09-19T06:37:42.761 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T06:37:42.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:42 smithi099 ceph-mon[27651]: osdmap e43: 6 total, 6 up, 6 in 2024-09-19T06:37:43.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:42 smithi117 ceph-mon[34564]: osdmap e43: 6 total, 6 up, 6 in 2024-09-19T06:37:43.939 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:43 smithi099 ceph-mon[27651]: pgmap v170: 65 pgs: 21 active+clean, 28 creating+peering, 16 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:37:43.939 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:43 smithi099 ceph-mon[27651]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-19T06:37:43.939 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:43 smithi099 ceph-mon[27651]: osdmap e44: 6 total, 6 up, 6 in 2024-09-19T06:37:44.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:43 smithi117 ceph-mon[34564]: pgmap v170: 65 pgs: 21 active+clean, 28 creating+peering, 16 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:37:44.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:43 smithi117 ceph-mon[34564]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-19T06:37:44.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:43 smithi117 ceph-mon[34564]: osdmap e44: 6 total, 6 up, 6 in 2024-09-19T06:37:44.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:44.629+0000 7fba0e22f640 1 -- 172.21.15.99:0/196262264 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba080fc570 msgr2=0x7fba080fc980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:44.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:44.629+0000 7fba0e22f640 1 --2- 172.21.15.99:0/196262264 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba080fc570 0x7fba080fc980 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8009c50 tx=0x7fb9f8004d10 comp rx=0 tx=0).stop 2024-09-19T06:37:44.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:44.629+0000 7fba0e22f640 1 -- 172.21.15.99:0/196262264 shutdown_connections 2024-09-19T06:37:44.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:44.629+0000 7fba0e22f640 1 --2- 172.21.15.99:0/196262264 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba080fd840 0x7fba080fdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:44.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:44.629+0000 7fba0e22f640 1 --2- 172.21.15.99:0/196262264 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba080fc570 0x7fba080fc980 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:44.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:44.629+0000 7fba0e22f640 1 -- 172.21.15.99:0/196262264 >> 172.21.15.99:0/196262264 conn(0x7fba080f7d30 msgr2=0x7fba080fa160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:44.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:44.629+0000 7fba0e22f640 1 -- 172.21.15.99:0/196262264 shutdown_connections 2024-09-19T06:37:44.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:44.629+0000 7fba0e22f640 1 -- 172.21.15.99:0/196262264 wait complete. 2024-09-19T06:37:44.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:44.630+0000 7fba0e22f640 1 Processor -- start 2024-09-19T06:37:44.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:44.630+0000 7fba0e22f640 1 -- start start 2024-09-19T06:37:44.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:44.630+0000 7fba0e22f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba080fc570 0x7fba0810d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:44.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:44.630+0000 7fba0e22f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba080fd840 0x7fba0810d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:44.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:44.630+0000 7fba0e22f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba0810dc20 con 0x7fba080fc570 2024-09-19T06:37:44.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:44.630+0000 7fba0e22f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba0810e440 con 0x7fba080fd840 2024-09-19T06:37:44.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:44.631+0000 7fba077fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba080fc570 0x7fba0810d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:44.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:44.631+0000 7fba077fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba080fc570 0x7fba0810d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:39212/0 (socket says 172.21.15.99:39212) 2024-09-19T06:37:44.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:44.631+0000 7fba077fe640 1 -- 172.21.15.99:0/3009864739 learned_addr learned my addr 172.21.15.99:0/3009864739 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:37:44.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:44.631+0000 7fba06ffd640 1 --2- 172.21.15.99:0/3009864739 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba080fd840 0x7fba0810d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:44.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:44.631+0000 7fba077fe640 1 -- 172.21.15.99:0/3009864739 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba080fd840 msgr2=0x7fba0810d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:44.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:44.631+0000 7fba077fe640 1 --2- 172.21.15.99:0/3009864739 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba080fd840 0x7fba0810d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:44.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:44.631+0000 7fba077fe640 1 -- 172.21.15.99:0/3009864739 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f80098b0 con 0x7fba080fc570 2024-09-19T06:37:44.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:44.631+0000 7fba077fe640 1 --2- 172.21.15.99:0/3009864739 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba080fc570 0x7fba0810d090 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8004a30 tx=0x7fb9f8004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:44.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:44.631+0000 7fb9fffff640 1 -- 172.21.15.99:0/3009864739 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9f8032850 con 0x7fba080fc570 2024-09-19T06:37:44.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:44.631+0000 7fb9fffff640 1 -- 172.21.15.99:0/3009864739 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb9f8009710 con 0x7fba080fc570 2024-09-19T06:37:44.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:44.631+0000 7fba0e22f640 1 -- 172.21.15.99:0/3009864739 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba0810e670 con 0x7fba080fc570 2024-09-19T06:37:44.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:44.631+0000 7fb9fffff640 1 -- 172.21.15.99:0/3009864739 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9f803dc20 con 0x7fba080fc570 2024-09-19T06:37:44.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:44.631+0000 7fba0e22f640 1 -- 172.21.15.99:0/3009864739 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba0810ec10 con 0x7fba080fc570 2024-09-19T06:37:44.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:44.632+0000 7fba0e22f640 1 -- 172.21.15.99:0/3009864739 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba080fb9d0 con 0x7fba080fc570 2024-09-19T06:37:44.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:44.633+0000 7fb9fffff640 1 -- 172.21.15.99:0/3009864739 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fb9f802f030 con 0x7fba080fc570 2024-09-19T06:37:44.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:44.633+0000 7fb9fffff640 1 --2- 172.21.15.99:0/3009864739 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fb9f406ed60 0x7fb9f4071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:44.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:44.633+0000 7fb9fffff640 1 -- 172.21.15.99:0/3009864739 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fb9f80af6f0 con 0x7fba080fc570 2024-09-19T06:37:44.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:44.633+0000 7fba06ffd640 1 --2- 172.21.15.99:0/3009864739 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fb9f406ed60 0x7fb9f4071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:44.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:44.634+0000 7fba06ffd640 1 --2- 172.21.15.99:0/3009864739 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fb9f406ed60 0x7fb9f4071210 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fba0810ce40 tx=0x7fb9f0004330 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:44.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:44.637+0000 7fb9fffff640 1 -- 172.21.15.99:0/3009864739 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fb9f807c890 con 0x7fba080fc570 2024-09-19T06:37:44.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:44.832+0000 7fba0e22f640 1 -- 172.21.15.99:0/3009864739 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fba0810eec0 con 0x7fba080fc570 2024-09-19T06:37:44.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:44.832+0000 7fb9fffff640 1 -- 172.21.15.99:0/3009864739 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) v1 ==== 75+0+1076 (secure 0 0 0) 0x7fb9f807c230 con 0x7fba080fc570 2024-09-19T06:37:44.834 INFO:teuthology.orchestra.run.smithi099.stdout:e2 2024-09-19T06:37:44.834 INFO:teuthology.orchestra.run.smithi099.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T06:37:44.834 INFO:teuthology.orchestra.run.smithi099.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T06:37:44.834 INFO:teuthology.orchestra.run.smithi099.stdout:legacy client fscid: 1 2024-09-19T06:37:44.834 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:37:44.834 INFO:teuthology.orchestra.run.smithi099.stdout:Filesystem 'cephfs' (1) 2024-09-19T06:37:44.834 INFO:teuthology.orchestra.run.smithi099.stdout:fs_name cephfs 2024-09-19T06:37:44.834 INFO:teuthology.orchestra.run.smithi099.stdout:epoch 2 2024-09-19T06:37:44.834 INFO:teuthology.orchestra.run.smithi099.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-19T06:37:44.834 INFO:teuthology.orchestra.run.smithi099.stdout:created 2024-09-19T06:37:40.838146+0000 2024-09-19T06:37:44.834 INFO:teuthology.orchestra.run.smithi099.stdout:modified 2024-09-19T06:37:40.838205+0000 2024-09-19T06:37:44.834 INFO:teuthology.orchestra.run.smithi099.stdout:tableserver 0 2024-09-19T06:37:44.835 INFO:teuthology.orchestra.run.smithi099.stdout:root 0 2024-09-19T06:37:44.835 INFO:teuthology.orchestra.run.smithi099.stdout:session_timeout 60 2024-09-19T06:37:44.835 INFO:teuthology.orchestra.run.smithi099.stdout:session_autoclose 300 2024-09-19T06:37:44.835 INFO:teuthology.orchestra.run.smithi099.stdout:max_file_size 1099511627776 2024-09-19T06:37:44.835 INFO:teuthology.orchestra.run.smithi099.stdout:required_client_features {} 2024-09-19T06:37:44.835 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure 0 2024-09-19T06:37:44.835 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure_osd_epoch 0 2024-09-19T06:37:44.835 INFO:teuthology.orchestra.run.smithi099.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T06:37:44.835 INFO:teuthology.orchestra.run.smithi099.stdout:max_mds 1 2024-09-19T06:37:44.835 INFO:teuthology.orchestra.run.smithi099.stdout:in 2024-09-19T06:37:44.835 INFO:teuthology.orchestra.run.smithi099.stdout:up {} 2024-09-19T06:37:44.835 INFO:teuthology.orchestra.run.smithi099.stdout:failed 2024-09-19T06:37:44.835 INFO:teuthology.orchestra.run.smithi099.stdout:damaged 2024-09-19T06:37:44.835 INFO:teuthology.orchestra.run.smithi099.stdout:stopped 2024-09-19T06:37:44.836 INFO:teuthology.orchestra.run.smithi099.stdout:data_pools [3] 2024-09-19T06:37:44.836 INFO:teuthology.orchestra.run.smithi099.stdout:metadata_pool 2 2024-09-19T06:37:44.836 INFO:teuthology.orchestra.run.smithi099.stdout:inline_data disabled 2024-09-19T06:37:44.836 INFO:teuthology.orchestra.run.smithi099.stdout:balancer 2024-09-19T06:37:44.836 INFO:teuthology.orchestra.run.smithi099.stdout:standby_count_wanted 0 2024-09-19T06:37:44.836 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:37:44.836 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:37:44.837 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 2 2024-09-19T06:37:44.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:44.834+0000 7fba0e22f640 1 -- 172.21.15.99:0/3009864739 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fb9f406ed60 msgr2=0x7fb9f4071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:44.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:44.834+0000 7fba0e22f640 1 --2- 172.21.15.99:0/3009864739 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fb9f406ed60 0x7fb9f4071210 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fba0810ce40 tx=0x7fb9f0004330 comp rx=0 tx=0).stop 2024-09-19T06:37:44.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:44.834+0000 7fba0e22f640 1 -- 172.21.15.99:0/3009864739 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba080fc570 msgr2=0x7fba0810d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:44.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:44.834+0000 7fba0e22f640 1 --2- 172.21.15.99:0/3009864739 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba080fc570 0x7fba0810d090 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8004a30 tx=0x7fb9f8004d10 comp rx=0 tx=0).stop 2024-09-19T06:37:44.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:44.834+0000 7fba0e22f640 1 -- 172.21.15.99:0/3009864739 shutdown_connections 2024-09-19T06:37:44.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:44.834+0000 7fba0e22f640 1 --2- 172.21.15.99:0/3009864739 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fb9f406ed60 0x7fb9f4071210 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:44.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:44.834+0000 7fba0e22f640 1 --2- 172.21.15.99:0/3009864739 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba080fd840 0x7fba0810d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:44.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:44.834+0000 7fba0e22f640 1 --2- 172.21.15.99:0/3009864739 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba080fc570 0x7fba0810d090 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:44.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:44.834+0000 7fba0e22f640 1 -- 172.21.15.99:0/3009864739 >> 172.21.15.99:0/3009864739 conn(0x7fba080f7d30 msgr2=0x7fba080f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:44.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:44.834+0000 7fba0e22f640 1 -- 172.21.15.99:0/3009864739 shutdown_connections 2024-09-19T06:37:44.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:44.834+0000 7fba0e22f640 1 -- 172.21.15.99:0/3009864739 wait complete. 2024-09-19T06:37:45.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:44 smithi099 ceph-mon[27651]: from='client.? 172.21.15.99:0/3009864739' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:37:45.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:44 smithi117 ceph-mon[34564]: from='client.? 172.21.15.99:0/3009864739' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:37:45.586 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T06:37:45.595 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi099.front.sepia.ceph.com 2024-09-19T06:37:45.596 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs max_mds 2' 2024-09-19T06:37:45.845 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T06:37:46.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:45 smithi117 ceph-mon[34564]: pgmap v172: 65 pgs: 33 active+clean, 28 creating+peering, 4 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:37:46.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:45 smithi117 ceph-mon[34564]: mds.? [v2:172.21.15.99:6826/3597497125,v1:172.21.15.99:6827/3597497125] up:boot 2024-09-19T06:37:46.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:45 smithi117 ceph-mon[34564]: daemon mds.cephfs.smithi099.obarqf assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-19T06:37:46.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:45 smithi117 ceph-mon[34564]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T06:37:46.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:45 smithi117 ceph-mon[34564]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-19T06:37:46.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:45 smithi117 ceph-mon[34564]: Cluster is now healthy 2024-09-19T06:37:46.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:45 smithi117 ceph-mon[34564]: fsmap cephfs:0 1 up:standby 2024-09-19T06:37:46.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:45 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi099.obarqf"}]: dispatch 2024-09-19T06:37:46.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:45 smithi117 ceph-mon[34564]: fsmap cephfs:1 {0=cephfs.smithi099.obarqf=up:creating} 2024-09-19T06:37:46.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:45 smithi117 ceph-mon[34564]: daemon mds.cephfs.smithi099.obarqf is now active in filesystem cephfs as rank 0 2024-09-19T06:37:46.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:45 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:37:46.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:45 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:37:46.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:45 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:37:46.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:45 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi117.nooexo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:37:46.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:45 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi117.nooexo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:37:46.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:45 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:37:46.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:45 smithi117 ceph-mon[34564]: Deploying daemon mds.cephfs.smithi117.nooexo on smithi117 2024-09-19T06:37:46.154 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:45 smithi099 ceph-mon[27651]: pgmap v172: 65 pgs: 33 active+clean, 28 creating+peering, 4 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:37:46.155 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:45 smithi099 ceph-mon[27651]: mds.? [v2:172.21.15.99:6826/3597497125,v1:172.21.15.99:6827/3597497125] up:boot 2024-09-19T06:37:46.155 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:45 smithi099 ceph-mon[27651]: daemon mds.cephfs.smithi099.obarqf assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-19T06:37:46.155 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:45 smithi099 ceph-mon[27651]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T06:37:46.155 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:45 smithi099 ceph-mon[27651]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-19T06:37:46.155 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:45 smithi099 ceph-mon[27651]: Cluster is now healthy 2024-09-19T06:37:46.155 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:45 smithi099 ceph-mon[27651]: fsmap cephfs:0 1 up:standby 2024-09-19T06:37:46.155 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:45 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi099.obarqf"}]: dispatch 2024-09-19T06:37:46.155 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:45 smithi099 ceph-mon[27651]: fsmap cephfs:1 {0=cephfs.smithi099.obarqf=up:creating} 2024-09-19T06:37:46.155 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:45 smithi099 ceph-mon[27651]: daemon mds.cephfs.smithi099.obarqf is now active in filesystem cephfs as rank 0 2024-09-19T06:37:46.155 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:45 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:37:46.155 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:45 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:37:46.155 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:45 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:37:46.155 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:45 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi117.nooexo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:37:46.156 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:45 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi117.nooexo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:37:46.156 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:45 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:37:46.156 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:45 smithi099 ceph-mon[27651]: Deploying daemon mds.cephfs.smithi117.nooexo on smithi117 2024-09-19T06:37:47.148 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:46 smithi099 ceph-mon[27651]: mds.? [v2:172.21.15.99:6826/3597497125,v1:172.21.15.99:6827/3597497125] up:active 2024-09-19T06:37:47.148 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:46 smithi099 ceph-mon[27651]: fsmap cephfs:1 {0=cephfs.smithi099.obarqf=up:active} 2024-09-19T06:37:47.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:46 smithi117 ceph-mon[34564]: mds.? [v2:172.21.15.99:6826/3597497125,v1:172.21.15.99:6827/3597497125] up:active 2024-09-19T06:37:47.161 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:46 smithi117 ceph-mon[34564]: fsmap cephfs:1 {0=cephfs.smithi099.obarqf=up:active} 2024-09-19T06:37:47.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:47.470+0000 7fe66d697640 1 -- 172.21.15.99:0/350838575 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe6680fd7f0 msgr2=0x7fe6680fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:47.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:47.470+0000 7fe66d697640 1 --2- 172.21.15.99:0/350838575 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe6680fd7f0 0x7fe6680fdc60 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe65c0048d0 tx=0x7fe65c009da0 comp rx=0 tx=0).stop 2024-09-19T06:37:47.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:47.470+0000 7fe66d697640 1 -- 172.21.15.99:0/350838575 shutdown_connections 2024-09-19T06:37:47.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:47.470+0000 7fe66d697640 1 --2- 172.21.15.99:0/350838575 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe6680fd7f0 0x7fe6680fdc60 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:47.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:47.470+0000 7fe66d697640 1 --2- 172.21.15.99:0/350838575 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6680fc520 0x7fe6680fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:47.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:47.470+0000 7fe66d697640 1 -- 172.21.15.99:0/350838575 >> 172.21.15.99:0/350838575 conn(0x7fe6680f7ce0 msgr2=0x7fe6680fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:47.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:47.470+0000 7fe66d697640 1 -- 172.21.15.99:0/350838575 shutdown_connections 2024-09-19T06:37:47.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:47.470+0000 7fe66d697640 1 -- 172.21.15.99:0/350838575 wait complete. 2024-09-19T06:37:47.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:47.470+0000 7fe66d697640 1 Processor -- start 2024-09-19T06:37:47.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:47.471+0000 7fe66d697640 1 -- start start 2024-09-19T06:37:47.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:47.471+0000 7fe66d697640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6680fc520 0x7fe668071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:47.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:47.471+0000 7fe66d697640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe6680fd7f0 0x7fe66806fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:47.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:47.471+0000 7fe66d697640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe66806fff0 con 0x7fe6680fd7f0 2024-09-19T06:37:47.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:47.471+0000 7fe66d697640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe668070130 con 0x7fe6680fc520 2024-09-19T06:37:47.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:47.471+0000 7fe6667fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe6680fd7f0 0x7fe66806fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:47.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:47.471+0000 7fe6667fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe6680fd7f0 0x7fe66806fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50138/0 (socket says 172.21.15.99:50138) 2024-09-19T06:37:47.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:47.471+0000 7fe6667fc640 1 -- 172.21.15.99:0/4225580812 learned_addr learned my addr 172.21.15.99:0/4225580812 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:37:47.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:47.471+0000 7fe666ffd640 1 --2- 172.21.15.99:0/4225580812 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6680fc520 0x7fe668071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:47.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:47.471+0000 7fe6667fc640 1 -- 172.21.15.99:0/4225580812 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6680fc520 msgr2=0x7fe668071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:47.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:47.471+0000 7fe6667fc640 1 --2- 172.21.15.99:0/4225580812 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6680fc520 0x7fe668071570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:47.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:47.471+0000 7fe6667fc640 1 -- 172.21.15.99:0/4225580812 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe65c005040 con 0x7fe6680fd7f0 2024-09-19T06:37:47.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:47.471+0000 7fe666ffd640 1 --2- 172.21.15.99:0/4225580812 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6680fc520 0x7fe668071570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:37:47.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:47.471+0000 7fe6667fc640 1 --2- 172.21.15.99:0/4225580812 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe6680fd7f0 0x7fe66806fa60 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe65c0043d0 tx=0x7fe65c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:47.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:47.472+0000 7fe64f7fe640 1 -- 172.21.15.99:0/4225580812 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe65c038070 con 0x7fe6680fd7f0 2024-09-19T06:37:47.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:47.472+0000 7fe66d697640 1 -- 172.21.15.99:0/4225580812 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6680703b0 con 0x7fe6680fd7f0 2024-09-19T06:37:47.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:47.472+0000 7fe64f7fe640 1 -- 172.21.15.99:0/4225580812 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe65c02ae90 con 0x7fe6680fd7f0 2024-09-19T06:37:47.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:47.472+0000 7fe64f7fe640 1 -- 172.21.15.99:0/4225580812 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe65c03e670 con 0x7fe6680fd7f0 2024-09-19T06:37:47.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:47.472+0000 7fe66d697640 1 -- 172.21.15.99:0/4225580812 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6681150d0 con 0x7fe6680fd7f0 2024-09-19T06:37:47.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:47.473+0000 7fe66d697640 1 -- 172.21.15.99:0/4225580812 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe66804b720 con 0x7fe6680fd7f0 2024-09-19T06:37:47.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:47.473+0000 7fe64f7fe640 1 -- 172.21.15.99:0/4225580812 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fe65c030020 con 0x7fe6680fd7f0 2024-09-19T06:37:47.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:47.474+0000 7fe64f7fe640 1 --2- 172.21.15.99:0/4225580812 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fe65006ed60 0x7fe650071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:47.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:47.474+0000 7fe64f7fe640 1 -- 172.21.15.99:0/4225580812 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fe65c0ae380 con 0x7fe6680fd7f0 2024-09-19T06:37:47.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:47.474+0000 7fe666ffd640 1 --2- 172.21.15.99:0/4225580812 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fe65006ed60 0x7fe650071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:47.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:47.474+0000 7fe666ffd640 1 --2- 172.21.15.99:0/4225580812 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fe65006ed60 0x7fe650071210 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe668071320 tx=0x7fe65800b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:47.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:47.478+0000 7fe64f7fe640 1 -- 172.21.15.99:0/4225580812 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fe65c07b550 con 0x7fe6680fd7f0 2024-09-19T06:37:47.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:47.679+0000 7fe66d697640 1 -- 172.21.15.99:0/4225580812 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) v1 -- 0x7fe668070540 con 0x7fe6680fd7f0 2024-09-19T06:37:47.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:47.726+0000 7fe64f7fe640 1 -- 172.21.15.99:0/4225580812 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v6) v1 ==== 105+0+0 (secure 0 0 0) 0x7fe668070540 con 0x7fe6680fd7f0 2024-09-19T06:37:47.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:47.728+0000 7fe66d697640 1 -- 172.21.15.99:0/4225580812 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fe65006ed60 msgr2=0x7fe650071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:47.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:47.728+0000 7fe66d697640 1 --2- 172.21.15.99:0/4225580812 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fe65006ed60 0x7fe650071210 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe668071320 tx=0x7fe65800b040 comp rx=0 tx=0).stop 2024-09-19T06:37:47.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:47.728+0000 7fe66d697640 1 -- 172.21.15.99:0/4225580812 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe6680fd7f0 msgr2=0x7fe66806fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:47.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:47.728+0000 7fe66d697640 1 --2- 172.21.15.99:0/4225580812 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe6680fd7f0 0x7fe66806fa60 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe65c0043d0 tx=0x7fe65c009da0 comp rx=0 tx=0).stop 2024-09-19T06:37:47.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:47.728+0000 7fe66d697640 1 -- 172.21.15.99:0/4225580812 shutdown_connections 2024-09-19T06:37:47.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:47.728+0000 7fe66d697640 1 --2- 172.21.15.99:0/4225580812 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fe65006ed60 0x7fe650071210 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:47.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:47.728+0000 7fe66d697640 1 --2- 172.21.15.99:0/4225580812 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe6680fd7f0 0x7fe66806fa60 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:47.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:47.728+0000 7fe66d697640 1 --2- 172.21.15.99:0/4225580812 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6680fc520 0x7fe668071570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:47.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:47.728+0000 7fe66d697640 1 -- 172.21.15.99:0/4225580812 >> 172.21.15.99:0/4225580812 conn(0x7fe6680f7ce0 msgr2=0x7fe6680f9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:47.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:47.729+0000 7fe66d697640 1 -- 172.21.15.99:0/4225580812 shutdown_connections 2024-09-19T06:37:47.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:47.729+0000 7fe66d697640 1 -- 172.21.15.99:0/4225580812 wait complete. 2024-09-19T06:37:48.090 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:47 smithi099 ceph-mon[27651]: pgmap v173: 65 pgs: 51 active+clean, 14 creating+peering; 578 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 716 B/s wr, 5 op/s 2024-09-19T06:37:48.090 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:47 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:37:48.090 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:47 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:37:48.091 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:47 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:37:48.091 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:47 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi099.xehbxe", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:37:48.091 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:47 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi099.xehbxe", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:37:48.091 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:47 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:37:48.091 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:47 smithi099 ceph-mon[27651]: from='client.? 172.21.15.99:0/4225580812' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-09-19T06:37:48.091 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:47 smithi099 ceph-mon[27651]: daemon mds.cephfs.smithi117.nooexo assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-19T06:37:48.091 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:47 smithi099 ceph-mon[27651]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-09-19T06:37:48.092 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:47 smithi099 ceph-mon[27651]: mds.? [v2:172.21.15.117:6824/2367330767,v1:172.21.15.117:6825/2367330767] up:boot 2024-09-19T06:37:48.092 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:47 smithi099 ceph-mon[27651]: from='client.? 172.21.15.99:0/4225580812' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-09-19T06:37:48.092 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:47 smithi099 ceph-mon[27651]: fsmap cephfs:2 {0=cephfs.smithi099.obarqf=up:active,1=cephfs.smithi117.nooexo=up:creating} 2024-09-19T06:37:48.092 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:47 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi117.nooexo"}]: dispatch 2024-09-19T06:37:48.092 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:47 smithi099 ceph-mon[27651]: daemon mds.cephfs.smithi117.nooexo is now active in filesystem cephfs as rank 1 2024-09-19T06:37:48.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:47 smithi117 ceph-mon[34564]: pgmap v173: 65 pgs: 51 active+clean, 14 creating+peering; 578 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 716 B/s wr, 5 op/s 2024-09-19T06:37:48.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:47 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:37:48.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:47 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:37:48.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:47 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:37:48.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:47 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi099.xehbxe", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:37:48.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:47 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi099.xehbxe", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:37:48.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:47 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:37:48.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:47 smithi117 ceph-mon[34564]: from='client.? 172.21.15.99:0/4225580812' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-09-19T06:37:48.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:47 smithi117 ceph-mon[34564]: daemon mds.cephfs.smithi117.nooexo assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-19T06:37:48.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:47 smithi117 ceph-mon[34564]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-09-19T06:37:48.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:47 smithi117 ceph-mon[34564]: mds.? [v2:172.21.15.117:6824/2367330767,v1:172.21.15.117:6825/2367330767] up:boot 2024-09-19T06:37:48.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:47 smithi117 ceph-mon[34564]: from='client.? 172.21.15.99:0/4225580812' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-09-19T06:37:48.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:47 smithi117 ceph-mon[34564]: fsmap cephfs:2 {0=cephfs.smithi099.obarqf=up:active,1=cephfs.smithi117.nooexo=up:creating} 2024-09-19T06:37:48.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:47 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi117.nooexo"}]: dispatch 2024-09-19T06:37:48.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:47 smithi117 ceph-mon[34564]: daemon mds.cephfs.smithi117.nooexo is now active in filesystem cephfs as rank 1 2024-09-19T06:37:48.675 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T06:37:48.687 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi099.front.sepia.ceph.com 2024-09-19T06:37:48.688 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs allow_standby_replay false' 2024-09-19T06:37:48.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:48 smithi099 ceph-mon[27651]: Deploying daemon mds.cephfs.smithi099.xehbxe on smithi099 2024-09-19T06:37:48.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:48 smithi099 ceph-mon[27651]: mds.? [v2:172.21.15.117:6824/2367330767,v1:172.21.15.117:6825/2367330767] up:active 2024-09-19T06:37:48.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:48 smithi099 ceph-mon[27651]: fsmap cephfs:2 {0=cephfs.smithi099.obarqf=up:active,1=cephfs.smithi117.nooexo=up:active} 2024-09-19T06:37:49.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:48 smithi117 ceph-mon[34564]: Deploying daemon mds.cephfs.smithi099.xehbxe on smithi099 2024-09-19T06:37:49.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:48 smithi117 ceph-mon[34564]: mds.? [v2:172.21.15.117:6824/2367330767,v1:172.21.15.117:6825/2367330767] up:active 2024-09-19T06:37:49.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:48 smithi117 ceph-mon[34564]: fsmap cephfs:2 {0=cephfs.smithi099.obarqf=up:active,1=cephfs.smithi117.nooexo=up:active} 2024-09-19T06:37:49.607 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T06:37:50.019 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:49 smithi099 ceph-mon[27651]: pgmap v174: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s wr, 5 op/s 2024-09-19T06:37:50.020 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:49 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:37:50.020 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:49 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:37:50.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:49 smithi117 ceph-mon[34564]: pgmap v174: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s wr, 5 op/s 2024-09-19T06:37:50.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:49 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:37:50.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:49 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:37:51.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:51.466+0000 7f071ad37640 1 -- 172.21.15.99:0/3357399455 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f07140fdbb0 msgr2=0x7f07140fdfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:51.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:51.466+0000 7f071ad37640 1 --2- 172.21.15.99:0/3357399455 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f07140fdbb0 0x7f07140fdfc0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f07080048d0 tx=0x7f0708009da0 comp rx=0 tx=0).stop 2024-09-19T06:37:51.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:51.466+0000 7f071ad37640 1 -- 172.21.15.99:0/3357399455 shutdown_connections 2024-09-19T06:37:51.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:51.466+0000 7f071ad37640 1 --2- 172.21.15.99:0/3357399455 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07140fe500 0x7f07140fa660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:51.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:51.466+0000 7f071ad37640 1 --2- 172.21.15.99:0/3357399455 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f07140fdbb0 0x7f07140fdfc0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:51.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:51.466+0000 7f071ad37640 1 -- 172.21.15.99:0/3357399455 >> 172.21.15.99:0/3357399455 conn(0x7f07140f63b0 msgr2=0x7f07140f87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:51.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:51.466+0000 7f071ad37640 1 -- 172.21.15.99:0/3357399455 shutdown_connections 2024-09-19T06:37:51.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:51.466+0000 7f071ad37640 1 -- 172.21.15.99:0/3357399455 wait complete. 2024-09-19T06:37:51.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:51.467+0000 7f071ad37640 1 Processor -- start 2024-09-19T06:37:51.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:51.467+0000 7f071ad37640 1 -- start start 2024-09-19T06:37:51.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:51.467+0000 7f071ad37640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07140fdbb0 0x7f071410d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:51.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:51.467+0000 7f071ad37640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f07140fe500 0x7f071410d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:51.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:51.467+0000 7f071ad37640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f071410dc30 con 0x7f07140fe500 2024-09-19T06:37:51.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:51.467+0000 7f071ad37640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f071410e450 con 0x7f07140fdbb0 2024-09-19T06:37:51.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:51.467+0000 7f0713fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f07140fe500 0x7f071410d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:51.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:51.467+0000 7f0713fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f07140fe500 0x7f071410d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50168/0 (socket says 172.21.15.99:50168) 2024-09-19T06:37:51.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:51.467+0000 7f0713fff640 1 -- 172.21.15.99:0/3481168530 learned_addr learned my addr 172.21.15.99:0/3481168530 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:37:51.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:51.467+0000 7f0718ad3640 1 --2- 172.21.15.99:0/3481168530 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07140fdbb0 0x7f071410d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:51.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:51.468+0000 7f0713fff640 1 -- 172.21.15.99:0/3481168530 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07140fdbb0 msgr2=0x7f071410d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:51.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:51.468+0000 7f0713fff640 1 --2- 172.21.15.99:0/3481168530 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07140fdbb0 0x7f071410d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:51.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:51.468+0000 7f0713fff640 1 -- 172.21.15.99:0/3481168530 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0708005040 con 0x7f07140fe500 2024-09-19T06:37:51.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:51.468+0000 7f0713fff640 1 --2- 172.21.15.99:0/3481168530 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f07140fe500 0x7f071410d5e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f070000c760 tx=0x7f07000043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:51.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:51.468+0000 7f07117fa640 1 -- 172.21.15.99:0/3481168530 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f070000a710 con 0x7f07140fe500 2024-09-19T06:37:51.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:51.468+0000 7f071ad37640 1 -- 172.21.15.99:0/3481168530 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f071410e6e0 con 0x7f07140fe500 2024-09-19T06:37:51.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:51.468+0000 7f07117fa640 1 -- 172.21.15.99:0/3481168530 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f070000ad10 con 0x7f07140fe500 2024-09-19T06:37:51.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:51.468+0000 7f07117fa640 1 -- 172.21.15.99:0/3481168530 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07000113a0 con 0x7f07140fe500 2024-09-19T06:37:51.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:51.468+0000 7f071ad37640 1 -- 172.21.15.99:0/3481168530 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f071410ec80 con 0x7f07140fe500 2024-09-19T06:37:51.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:51.469+0000 7f071ad37640 1 -- 172.21.15.99:0/3481168530 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07140fa050 con 0x7f07140fe500 2024-09-19T06:37:51.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:51.470+0000 7f07117fa640 1 -- 172.21.15.99:0/3481168530 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f070000a870 con 0x7f07140fe500 2024-09-19T06:37:51.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:51.470+0000 7f07117fa640 1 --2- 172.21.15.99:0/3481168530 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f070406ed60 0x7f0704071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:51.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:51.470+0000 7f07117fa640 1 -- 172.21.15.99:0/3481168530 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f070008e1e0 con 0x7f07140fe500 2024-09-19T06:37:51.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:51.470+0000 7f0718ad3640 1 --2- 172.21.15.99:0/3481168530 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f070406ed60 0x7f0704071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:51.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:51.470+0000 7f0718ad3640 1 --2- 172.21.15.99:0/3481168530 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f070406ed60 0x7f0704071210 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0708000c00 tx=0x7f0708035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:51.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:51.474+0000 7f07117fa640 1 -- 172.21.15.99:0/3481168530 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f070005b380 con 0x7f07140fe500 2024-09-19T06:37:51.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:51.669+0000 7f071ad37640 1 -- 172.21.15.99:0/3481168530 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f071404b720 con 0x7f07140fe500 2024-09-19T06:37:51.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:51.892+0000 7f07117fa640 1 -- 172.21.15.99:0/3481168530 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0700055e60 con 0x7f07140fe500 2024-09-19T06:37:51.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:51.895+0000 7f071ad37640 1 -- 172.21.15.99:0/3481168530 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f070406ed60 msgr2=0x7f0704071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:51.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:51.895+0000 7f071ad37640 1 --2- 172.21.15.99:0/3481168530 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f070406ed60 0x7f0704071210 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0708000c00 tx=0x7f0708035040 comp rx=0 tx=0).stop 2024-09-19T06:37:51.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:51.895+0000 7f071ad37640 1 -- 172.21.15.99:0/3481168530 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f07140fe500 msgr2=0x7f071410d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:51.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:51.895+0000 7f071ad37640 1 --2- 172.21.15.99:0/3481168530 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f07140fe500 0x7f071410d5e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f070000c760 tx=0x7f07000043c0 comp rx=0 tx=0).stop 2024-09-19T06:37:51.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:51.895+0000 7f071ad37640 1 -- 172.21.15.99:0/3481168530 shutdown_connections 2024-09-19T06:37:51.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:51.895+0000 7f071ad37640 1 --2- 172.21.15.99:0/3481168530 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f070406ed60 0x7f0704071210 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:51.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:51.895+0000 7f071ad37640 1 --2- 172.21.15.99:0/3481168530 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f07140fe500 0x7f071410d5e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:51.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:51.895+0000 7f071ad37640 1 --2- 172.21.15.99:0/3481168530 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07140fdbb0 0x7f071410d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:51.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:51.895+0000 7f071ad37640 1 -- 172.21.15.99:0/3481168530 >> 172.21.15.99:0/3481168530 conn(0x7f07140f63b0 msgr2=0x7f07140f7b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:51.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:51.895+0000 7f071ad37640 1 -- 172.21.15.99:0/3481168530 shutdown_connections 2024-09-19T06:37:51.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:51.895+0000 7f071ad37640 1 -- 172.21.15.99:0/3481168530 wait complete. 2024-09-19T06:37:51.934 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:51 smithi099 ceph-mon[27651]: pgmap v175: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s wr, 5 op/s 2024-09-19T06:37:51.934 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:51 smithi099 ceph-mon[27651]: from='client.? 172.21.15.99:0/3481168530' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-09-19T06:37:51.934 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:51 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:37:51.934 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:51 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:37:51.934 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:51 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:37:51.934 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:51 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi117.bheqzh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:37:51.934 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:51 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi117.bheqzh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:37:51.934 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:51 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:37:52.181 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:51 smithi117 ceph-mon[34564]: pgmap v175: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s wr, 5 op/s 2024-09-19T06:37:52.181 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:51 smithi117 ceph-mon[34564]: from='client.? 172.21.15.99:0/3481168530' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-09-19T06:37:52.181 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:51 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:37:52.181 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:51 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:37:52.182 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:51 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:37:52.182 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:51 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi117.bheqzh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:37:52.182 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:51 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi117.bheqzh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T06:37:52.182 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:51 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:37:52.485 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T06:37:52.494 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi099.front.sepia.ceph.com 2024-09-19T06:37:52.494 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs inline_data false' 2024-09-19T06:37:52.741 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T06:37:53.182 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:52 smithi117 ceph-mon[34564]: Deploying daemon mds.cephfs.smithi117.bheqzh on smithi117 2024-09-19T06:37:53.182 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:52 smithi117 ceph-mon[34564]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-09-19T06:37:53.182 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:52 smithi117 ceph-mon[34564]: Cluster is now healthy 2024-09-19T06:37:53.182 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:52 smithi117 ceph-mon[34564]: mds.? [v2:172.21.15.99:6828/1508711176,v1:172.21.15.99:6829/1508711176] up:boot 2024-09-19T06:37:53.182 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:52 smithi117 ceph-mon[34564]: from='client.? 172.21.15.99:0/3481168530' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-09-19T06:37:53.182 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:52 smithi117 ceph-mon[34564]: fsmap cephfs:2 {0=cephfs.smithi099.obarqf=up:active,1=cephfs.smithi117.nooexo=up:active} 1 up:standby 2024-09-19T06:37:53.182 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:52 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi099.xehbxe"}]: dispatch 2024-09-19T06:37:53.204 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:52 smithi099 ceph-mon[27651]: Deploying daemon mds.cephfs.smithi117.bheqzh on smithi117 2024-09-19T06:37:53.204 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:52 smithi099 ceph-mon[27651]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-09-19T06:37:53.205 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:52 smithi099 ceph-mon[27651]: Cluster is now healthy 2024-09-19T06:37:53.205 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:52 smithi099 ceph-mon[27651]: mds.? [v2:172.21.15.99:6828/1508711176,v1:172.21.15.99:6829/1508711176] up:boot 2024-09-19T06:37:53.205 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:52 smithi099 ceph-mon[27651]: from='client.? 172.21.15.99:0/3481168530' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-09-19T06:37:53.205 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:52 smithi099 ceph-mon[27651]: fsmap cephfs:2 {0=cephfs.smithi099.obarqf=up:active,1=cephfs.smithi117.nooexo=up:active} 1 up:standby 2024-09-19T06:37:53.205 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:52 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi099.xehbxe"}]: dispatch 2024-09-19T06:37:54.081 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:53 smithi099 ceph-mon[27651]: pgmap v176: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s wr, 8 op/s 2024-09-19T06:37:54.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:54.284+0000 7efcf96dc640 1 -- 172.21.15.99:0/470517657 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efcf40fd820 msgr2=0x7efcf40fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:54.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:54.284+0000 7efcf96dc640 1 --2- 172.21.15.99:0/470517657 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efcf40fd820 0x7efcf40fdc90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7efce80048d0 tx=0x7efce8009da0 comp rx=0 tx=0).stop 2024-09-19T06:37:54.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:54.284+0000 7efcf96dc640 1 -- 172.21.15.99:0/470517657 shutdown_connections 2024-09-19T06:37:54.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:54.284+0000 7efcf96dc640 1 --2- 172.21.15.99:0/470517657 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efcf40fd820 0x7efcf40fdc90 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:54.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:54.284+0000 7efcf96dc640 1 --2- 172.21.15.99:0/470517657 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcf40fc550 0x7efcf40fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:54.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:54.284+0000 7efcf96dc640 1 -- 172.21.15.99:0/470517657 >> 172.21.15.99:0/470517657 conn(0x7efcf40f7d30 msgr2=0x7efcf40fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:54.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:54.284+0000 7efcf96dc640 1 -- 172.21.15.99:0/470517657 shutdown_connections 2024-09-19T06:37:54.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:54.284+0000 7efcf96dc640 1 -- 172.21.15.99:0/470517657 wait complete. 2024-09-19T06:37:54.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:54.285+0000 7efcf96dc640 1 Processor -- start 2024-09-19T06:37:54.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:54.285+0000 7efcf96dc640 1 -- start start 2024-09-19T06:37:54.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:54.285+0000 7efcf96dc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efcf40fc550 0x7efcf410d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:54.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:54.285+0000 7efcf96dc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcf40fd820 0x7efcf410d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:54.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:54.285+0000 7efcf96dc640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf410dc20 con 0x7efcf40fc550 2024-09-19T06:37:54.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:54.285+0000 7efcf96dc640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf410e440 con 0x7efcf40fd820 2024-09-19T06:37:54.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:54.285+0000 7efcf2ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efcf40fc550 0x7efcf410d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:54.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:54.285+0000 7efcf2ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efcf40fc550 0x7efcf410d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50214/0 (socket says 172.21.15.99:50214) 2024-09-19T06:37:54.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:54.285+0000 7efcf27fc640 1 --2- 172.21.15.99:0/4280080822 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcf40fd820 0x7efcf410d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:54.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:54.285+0000 7efcf2ffd640 1 -- 172.21.15.99:0/4280080822 learned_addr learned my addr 172.21.15.99:0/4280080822 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:37:54.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:54.286+0000 7efcf2ffd640 1 -- 172.21.15.99:0/4280080822 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcf40fd820 msgr2=0x7efcf410d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:54.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:54.286+0000 7efcf2ffd640 1 --2- 172.21.15.99:0/4280080822 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcf40fd820 0x7efcf410d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:54.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:54.286+0000 7efcf2ffd640 1 -- 172.21.15.99:0/4280080822 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce8005040 con 0x7efcf40fc550 2024-09-19T06:37:54.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:54.286+0000 7efcf2ffd640 1 --2- 172.21.15.99:0/4280080822 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efcf40fc550 0x7efcf410d090 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7efce4002a50 tx=0x7efce4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:54.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:54.286+0000 7efcdb7fe640 1 -- 172.21.15.99:0/4280080822 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efce4007c30 con 0x7efcf40fc550 2024-09-19T06:37:54.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:54.286+0000 7efcdb7fe640 1 -- 172.21.15.99:0/4280080822 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7efce400f040 con 0x7efcf40fc550 2024-09-19T06:37:54.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:54.286+0000 7efcf96dc640 1 -- 172.21.15.99:0/4280080822 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcf410e6d0 con 0x7efcf40fc550 2024-09-19T06:37:54.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:54.286+0000 7efcdb7fe640 1 -- 172.21.15.99:0/4280080822 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efce400da10 con 0x7efcf40fc550 2024-09-19T06:37:54.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:54.286+0000 7efcf96dc640 1 -- 172.21.15.99:0/4280080822 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcf410ec70 con 0x7efcf40fc550 2024-09-19T06:37:54.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:54.287+0000 7efcf96dc640 1 -- 172.21.15.99:0/4280080822 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcf40fb9b0 con 0x7efcf40fc550 2024-09-19T06:37:54.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:54.288+0000 7efcdb7fe640 1 -- 172.21.15.99:0/4280080822 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7efce400dc80 con 0x7efcf40fc550 2024-09-19T06:37:54.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:54.288+0000 7efcdb7fe640 1 --2- 172.21.15.99:0/4280080822 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7efcdc06ed60 0x7efcdc071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:54.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:54.288+0000 7efcdb7fe640 1 -- 172.21.15.99:0/4280080822 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5464+0+0 (secure 0 0 0) 0x7efce408d940 con 0x7efcf40fc550 2024-09-19T06:37:54.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:54.288+0000 7efcf27fc640 1 --2- 172.21.15.99:0/4280080822 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7efcdc06ed60 0x7efcdc071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:54.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:54.289+0000 7efcf27fc640 1 --2- 172.21.15.99:0/4280080822 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7efcdc06ed60 0x7efcdc071210 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7efcf410ce40 tx=0x7efce8035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:54.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:54.293+0000 7efcdb7fe640 1 -- 172.21.15.99:0/4280080822 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7efce404d2a0 con 0x7efcf40fc550 2024-09-19T06:37:54.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:53 smithi117 ceph-mon[34564]: pgmap v176: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s wr, 8 op/s 2024-09-19T06:37:54.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:54.504+0000 7efcf96dc640 1 -- 172.21.15.99:0/4280080822 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"} v 0) v1 -- 0x7efcf404b720 con 0x7efcf40fc550 2024-09-19T06:37:54.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:54.896+0000 7efcdb7fe640 1 -- 172.21.15.99:0/4280080822 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]=0 inline data disabled v9) v1 ==== 133+0+0 (secure 0 0 0) 0x7efce405abd0 con 0x7efcf40fc550 2024-09-19T06:37:54.898 INFO:teuthology.orchestra.run.smithi099.stderr:inline data disabled 2024-09-19T06:37:54.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:54.899+0000 7efcf96dc640 1 -- 172.21.15.99:0/4280080822 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7efcdc06ed60 msgr2=0x7efcdc071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:54.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:54.899+0000 7efcf96dc640 1 --2- 172.21.15.99:0/4280080822 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7efcdc06ed60 0x7efcdc071210 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7efcf410ce40 tx=0x7efce8035040 comp rx=0 tx=0).stop 2024-09-19T06:37:54.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:54.899+0000 7efcf96dc640 1 -- 172.21.15.99:0/4280080822 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efcf40fc550 msgr2=0x7efcf410d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:54.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:54.899+0000 7efcf96dc640 1 --2- 172.21.15.99:0/4280080822 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efcf40fc550 0x7efcf410d090 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7efce4002a50 tx=0x7efce4004600 comp rx=0 tx=0).stop 2024-09-19T06:37:54.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:54.899+0000 7efcf96dc640 1 -- 172.21.15.99:0/4280080822 shutdown_connections 2024-09-19T06:37:54.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:54.899+0000 7efcf96dc640 1 --2- 172.21.15.99:0/4280080822 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7efcdc06ed60 0x7efcdc071210 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:54.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:54.899+0000 7efcf96dc640 1 --2- 172.21.15.99:0/4280080822 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcf40fd820 0x7efcf410d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:54.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:54.899+0000 7efcf96dc640 1 --2- 172.21.15.99:0/4280080822 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efcf40fc550 0x7efcf410d090 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:54.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:54.899+0000 7efcf96dc640 1 -- 172.21.15.99:0/4280080822 >> 172.21.15.99:0/4280080822 conn(0x7efcf40f7d30 msgr2=0x7efcf40f94f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:54.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:54.899+0000 7efcf96dc640 1 -- 172.21.15.99:0/4280080822 shutdown_connections 2024-09-19T06:37:54.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:54.899+0000 7efcf96dc640 1 -- 172.21.15.99:0/4280080822 wait complete. 2024-09-19T06:37:55.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:55 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:37:55.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:55 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:37:55.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:55 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:37:55.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:55 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:37:55.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:55 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:37:55.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:55 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:37:55.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:55 smithi099 ceph-mon[27651]: from='client.? 172.21.15.99:0/4280080822' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-09-19T06:37:55.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:55 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:37:55.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:55 smithi099 ceph-mon[27651]: mds.? [v2:172.21.15.117:6826/4072877365,v1:172.21.15.117:6827/4072877365] up:boot 2024-09-19T06:37:55.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:55 smithi099 ceph-mon[27651]: from='client.? 172.21.15.99:0/4280080822' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-09-19T06:37:55.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:55 smithi099 ceph-mon[27651]: fsmap cephfs:2 {0=cephfs.smithi099.obarqf=up:active,1=cephfs.smithi117.nooexo=up:active} 2 up:standby 2024-09-19T06:37:55.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:55 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi117.bheqzh"}]: dispatch 2024-09-19T06:37:55.510 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T06:37:55.520 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi099.front.sepia.ceph.com 2024-09-19T06:37:55.521 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-19T06:37:55.558 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:55 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:37:55.558 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:55 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:37:55.559 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:55 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:37:55.559 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:55 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:37:55.559 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:55 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:37:55.559 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:55 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:37:55.559 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:55 smithi117 ceph-mon[34564]: from='client.? 172.21.15.99:0/4280080822' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-09-19T06:37:55.559 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:55 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:37:55.559 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:55 smithi117 ceph-mon[34564]: mds.? [v2:172.21.15.117:6826/4072877365,v1:172.21.15.117:6827/4072877365] up:boot 2024-09-19T06:37:55.559 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:55 smithi117 ceph-mon[34564]: from='client.? 172.21.15.99:0/4280080822' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-09-19T06:37:55.559 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:55 smithi117 ceph-mon[34564]: fsmap cephfs:2 {0=cephfs.smithi099.obarqf=up:active,1=cephfs.smithi117.nooexo=up:active} 2 up:standby 2024-09-19T06:37:55.559 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:55 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi117.bheqzh"}]: dispatch 2024-09-19T06:37:55.902 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T06:37:56.275 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:56 smithi099 ceph-mon[27651]: pgmap v177: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s wr, 7 op/s 2024-09-19T06:37:56.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:56 smithi117 ceph-mon[34564]: pgmap v177: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s wr, 7 op/s 2024-09-19T06:37:57.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:57 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:37:57.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:57 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:37:57.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:57 smithi099 ceph-mon[27651]: mds.? [v2:172.21.15.99:6828/1508711176,v1:172.21.15.99:6829/1508711176] up:standby 2024-09-19T06:37:57.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:57 smithi099 ceph-mon[27651]: mds.? [v2:172.21.15.117:6824/2367330767,v1:172.21.15.117:6825/2367330767] up:active 2024-09-19T06:37:57.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:57 smithi099 ceph-mon[27651]: Dropping low affinity active daemon mds.cephfs.smithi099.obarqf in favor of higher affinity standby. 2024-09-19T06:37:57.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:57 smithi099 ceph-mon[27651]: Replacing daemon mds.cephfs.smithi099.obarqf as rank 0 with standby daemon mds.cephfs.smithi099.xehbxe 2024-09-19T06:37:57.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:57 smithi099 ceph-mon[27651]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T06:37:57.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:57 smithi099 ceph-mon[27651]: fsmap cephfs:2 {0=cephfs.smithi099.obarqf=up:active,1=cephfs.smithi117.nooexo=up:active} 2 up:standby 2024-09-19T06:37:57.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:57 smithi099 ceph-mon[27651]: osdmap e45: 6 total, 6 up, 6 in 2024-09-19T06:37:57.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:57 smithi099 ceph-mon[27651]: fsmap cephfs:2/2 {0=cephfs.smithi099.xehbxe=up:replay,1=cephfs.smithi117.nooexo=up:active} 1 up:standby 2024-09-19T06:37:57.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:57 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:37:57.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:57 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:37:57.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:57 smithi117 ceph-mon[34564]: mds.? [v2:172.21.15.99:6828/1508711176,v1:172.21.15.99:6829/1508711176] up:standby 2024-09-19T06:37:57.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:57 smithi117 ceph-mon[34564]: mds.? [v2:172.21.15.117:6824/2367330767,v1:172.21.15.117:6825/2367330767] up:active 2024-09-19T06:37:57.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:57 smithi117 ceph-mon[34564]: Dropping low affinity active daemon mds.cephfs.smithi099.obarqf in favor of higher affinity standby. 2024-09-19T06:37:57.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:57 smithi117 ceph-mon[34564]: Replacing daemon mds.cephfs.smithi099.obarqf as rank 0 with standby daemon mds.cephfs.smithi099.xehbxe 2024-09-19T06:37:57.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:57 smithi117 ceph-mon[34564]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T06:37:57.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:57 smithi117 ceph-mon[34564]: fsmap cephfs:2 {0=cephfs.smithi099.obarqf=up:active,1=cephfs.smithi117.nooexo=up:active} 2 up:standby 2024-09-19T06:37:57.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:57 smithi117 ceph-mon[34564]: osdmap e45: 6 total, 6 up, 6 in 2024-09-19T06:37:57.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:57 smithi117 ceph-mon[34564]: fsmap cephfs:2/2 {0=cephfs.smithi099.xehbxe=up:replay,1=cephfs.smithi117.nooexo=up:active} 1 up:standby 2024-09-19T06:37:58.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:58.238+0000 7f8324799640 1 -- 172.21.15.99:0/472249811 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f831c0fb430 msgr2=0x7f831c0fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:58.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:58.238+0000 7f8324799640 1 --2- 172.21.15.99:0/472249811 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f831c0fb430 0x7f831c0fb840 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f83180048d0 tx=0x7f8318009da0 comp rx=0 tx=0).stop 2024-09-19T06:37:58.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:58.238+0000 7f8324799640 1 -- 172.21.15.99:0/472249811 shutdown_connections 2024-09-19T06:37:58.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:58.238+0000 7f8324799640 1 --2- 172.21.15.99:0/472249811 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f831c0fc700 0x7f831c0fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:58.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:58.238+0000 7f8324799640 1 --2- 172.21.15.99:0/472249811 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f831c0fb430 0x7f831c0fb840 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:58.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:58.238+0000 7f8324799640 1 -- 172.21.15.99:0/472249811 >> 172.21.15.99:0/472249811 conn(0x7f831c0f6c10 msgr2=0x7f831c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:58.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:58.238+0000 7f8324799640 1 -- 172.21.15.99:0/472249811 shutdown_connections 2024-09-19T06:37:58.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:58.238+0000 7f8324799640 1 -- 172.21.15.99:0/472249811 wait complete. 2024-09-19T06:37:58.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:58.239+0000 7f8324799640 1 Processor -- start 2024-09-19T06:37:58.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:58.239+0000 7f8324799640 1 -- start start 2024-09-19T06:37:58.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:58.239+0000 7f8324799640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f831c0fb430 0x7f831c10fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:58.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:58.239+0000 7f8324799640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f831c0fc700 0x7f831c1122f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:58.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:58.239+0000 7f8324799640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f831c065c60 con 0x7f831c0fc700 2024-09-19T06:37:58.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:58.239+0000 7f8324799640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f831c065dd0 con 0x7f831c0fb430 2024-09-19T06:37:58.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:58.239+0000 7f8321d34640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f831c0fc700 0x7f831c1122f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:58.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:58.239+0000 7f8321d34640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f831c0fc700 0x7f831c1122f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49312/0 (socket says 172.21.15.99:49312) 2024-09-19T06:37:58.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:58.239+0000 7f8321d34640 1 -- 172.21.15.99:0/88358926 learned_addr learned my addr 172.21.15.99:0/88358926 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:37:58.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:58.239+0000 7f8322535640 1 --2- 172.21.15.99:0/88358926 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f831c0fb430 0x7f831c10fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:58.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:58.240+0000 7f8321d34640 1 -- 172.21.15.99:0/88358926 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f831c0fb430 msgr2=0x7f831c10fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:58.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:58.240+0000 7f8321d34640 1 --2- 172.21.15.99:0/88358926 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f831c0fb430 0x7f831c10fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:58.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:58.240+0000 7f8321d34640 1 -- 172.21.15.99:0/88358926 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8318005040 con 0x7f831c0fc700 2024-09-19T06:37:58.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:58.240+0000 7f8321d34640 1 --2- 172.21.15.99:0/88358926 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f831c0fc700 0x7f831c1122f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f830c002a80 tx=0x7f830c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:58.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:58.240+0000 7f8312ffd640 1 -- 172.21.15.99:0/88358926 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f830c007c30 con 0x7f831c0fc700 2024-09-19T06:37:58.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:58.240+0000 7f8312ffd640 1 -- 172.21.15.99:0/88358926 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f830c00f040 con 0x7f831c0fc700 2024-09-19T06:37:58.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:58.240+0000 7f8324799640 1 -- 172.21.15.99:0/88358926 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f831c112890 con 0x7f831c0fc700 2024-09-19T06:37:58.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:58.240+0000 7f8312ffd640 1 -- 172.21.15.99:0/88358926 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f830c00dab0 con 0x7f831c0fc700 2024-09-19T06:37:58.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:58.240+0000 7f8324799640 1 -- 172.21.15.99:0/88358926 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f831c112d80 con 0x7f831c0fc700 2024-09-19T06:37:58.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:58.241+0000 7f8324799640 1 -- 172.21.15.99:0/88358926 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f831c0fa890 con 0x7f831c0fc700 2024-09-19T06:37:58.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:58.242+0000 7f8312ffd640 1 -- 172.21.15.99:0/88358926 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f830c00dc10 con 0x7f831c0fc700 2024-09-19T06:37:58.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:58.242+0000 7f8312ffd640 1 --2- 172.21.15.99:0/88358926 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f830806ed60 0x7f8308071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:37:58.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:58.242+0000 7f8312ffd640 1 -- 172.21.15.99:0/88358926 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f830c08da50 con 0x7f831c0fc700 2024-09-19T06:37:58.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:58.242+0000 7f8322535640 1 --2- 172.21.15.99:0/88358926 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f830806ed60 0x7f8308071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:37:58.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:58.243+0000 7f8322535640 1 --2- 172.21.15.99:0/88358926 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f830806ed60 0x7f8308071210 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8318000c00 tx=0x7f8318035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:37:58.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:58.247+0000 7f8312ffd640 1 -- 172.21.15.99:0/88358926 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f830c04d2a0 con 0x7f831c0fc700 2024-09-19T06:37:58.421 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:58 smithi099 ceph-mon[27651]: pgmap v178: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s wr, 7 op/s 2024-09-19T06:37:58.422 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:58 smithi099 ceph-mon[27651]: mds.? [v2:172.21.15.99:6828/1508711176,v1:172.21.15.99:6829/1508711176] up:resolve 2024-09-19T06:37:58.422 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:58 smithi099 ceph-mon[27651]: mds.? [v2:172.21.15.99:6826/388324528,v1:172.21.15.99:6827/388324528] up:boot 2024-09-19T06:37:58.422 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:58 smithi099 ceph-mon[27651]: fsmap cephfs:2/2 {0=cephfs.smithi099.xehbxe=up:resolve,1=cephfs.smithi117.nooexo=up:active} 2 up:standby 2024-09-19T06:37:58.422 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:58 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi099.obarqf"}]: dispatch 2024-09-19T06:37:58.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:58.442+0000 7f8324799640 1 -- 172.21.15.99:0/88358926 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f831c04b720 con 0x7f831c0fc700 2024-09-19T06:37:58.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:58.443+0000 7f8312ffd640 1 -- 172.21.15.99:0/88358926 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 12 v12) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f830c05abd0 con 0x7f831c0fc700 2024-09-19T06:37:58.444 INFO:teuthology.orchestra.run.smithi099.stdout:e12 2024-09-19T06:37:58.444 INFO:teuthology.orchestra.run.smithi099.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T06:37:58.445 INFO:teuthology.orchestra.run.smithi099.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T06:37:58.445 INFO:teuthology.orchestra.run.smithi099.stdout:legacy client fscid: 1 2024-09-19T06:37:58.445 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:37:58.445 INFO:teuthology.orchestra.run.smithi099.stdout:Filesystem 'cephfs' (1) 2024-09-19T06:37:58.445 INFO:teuthology.orchestra.run.smithi099.stdout:fs_name cephfs 2024-09-19T06:37:58.445 INFO:teuthology.orchestra.run.smithi099.stdout:epoch 12 2024-09-19T06:37:58.445 INFO:teuthology.orchestra.run.smithi099.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-19T06:37:58.445 INFO:teuthology.orchestra.run.smithi099.stdout:created 2024-09-19T06:37:40.838146+0000 2024-09-19T06:37:58.445 INFO:teuthology.orchestra.run.smithi099.stdout:modified 2024-09-19T06:37:57.551999+0000 2024-09-19T06:37:58.445 INFO:teuthology.orchestra.run.smithi099.stdout:tableserver 0 2024-09-19T06:37:58.445 INFO:teuthology.orchestra.run.smithi099.stdout:root 0 2024-09-19T06:37:58.445 INFO:teuthology.orchestra.run.smithi099.stdout:session_timeout 60 2024-09-19T06:37:58.445 INFO:teuthology.orchestra.run.smithi099.stdout:session_autoclose 300 2024-09-19T06:37:58.446 INFO:teuthology.orchestra.run.smithi099.stdout:max_file_size 1099511627776 2024-09-19T06:37:58.446 INFO:teuthology.orchestra.run.smithi099.stdout:required_client_features {} 2024-09-19T06:37:58.446 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure 0 2024-09-19T06:37:58.446 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure_osd_epoch 45 2024-09-19T06:37:58.446 INFO:teuthology.orchestra.run.smithi099.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T06:37:58.446 INFO:teuthology.orchestra.run.smithi099.stdout:max_mds 2 2024-09-19T06:37:58.446 INFO:teuthology.orchestra.run.smithi099.stdout:in 0,1 2024-09-19T06:37:58.446 INFO:teuthology.orchestra.run.smithi099.stdout:up {0=14482,1=24269} 2024-09-19T06:37:58.446 INFO:teuthology.orchestra.run.smithi099.stdout:failed 2024-09-19T06:37:58.446 INFO:teuthology.orchestra.run.smithi099.stdout:damaged 2024-09-19T06:37:58.446 INFO:teuthology.orchestra.run.smithi099.stdout:stopped 2024-09-19T06:37:58.446 INFO:teuthology.orchestra.run.smithi099.stdout:data_pools [3] 2024-09-19T06:37:58.446 INFO:teuthology.orchestra.run.smithi099.stdout:metadata_pool 2 2024-09-19T06:37:58.447 INFO:teuthology.orchestra.run.smithi099.stdout:inline_data disabled 2024-09-19T06:37:58.447 INFO:teuthology.orchestra.run.smithi099.stdout:balancer 2024-09-19T06:37:58.447 INFO:teuthology.orchestra.run.smithi099.stdout:standby_count_wanted 1 2024-09-19T06:37:58.447 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.xehbxe{0:14482} state up:resolve seq 3 join_fscid=1 addr [v2:172.21.15.99:6828/1508711176,v1:172.21.15.99:6829/1508711176] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T06:37:58.447 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.nooexo{1:24269} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.117:6824/2367330767,v1:172.21.15.117:6825/2367330767] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T06:37:58.447 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:37:58.447 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:37:58.447 INFO:teuthology.orchestra.run.smithi099.stdout:Standby daemons: 2024-09-19T06:37:58.447 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:37:58.447 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.obarqf{-1:14490} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6826/388324528,v1:172.21.15.99:6827/388324528] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T06:37:58.447 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.bheqzh{-1:24283} state up:standby seq 1 addr [v2:172.21.15.117:6826/4072877365,v1:172.21.15.117:6827/4072877365] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T06:37:58.448 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 12 2024-09-19T06:37:58.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:58.445+0000 7f8324799640 1 -- 172.21.15.99:0/88358926 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f830806ed60 msgr2=0x7f8308071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:58.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:58.445+0000 7f8324799640 1 --2- 172.21.15.99:0/88358926 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f830806ed60 0x7f8308071210 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8318000c00 tx=0x7f8318035040 comp rx=0 tx=0).stop 2024-09-19T06:37:58.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:58.445+0000 7f8324799640 1 -- 172.21.15.99:0/88358926 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f831c0fc700 msgr2=0x7f831c1122f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:37:58.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:58.445+0000 7f8324799640 1 --2- 172.21.15.99:0/88358926 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f831c0fc700 0x7f831c1122f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f830c002a80 tx=0x7f830c004600 comp rx=0 tx=0).stop 2024-09-19T06:37:58.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:58.445+0000 7f8324799640 1 -- 172.21.15.99:0/88358926 shutdown_connections 2024-09-19T06:37:58.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:58.445+0000 7f8324799640 1 --2- 172.21.15.99:0/88358926 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f830806ed60 0x7f8308071210 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:58.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:58.445+0000 7f8324799640 1 --2- 172.21.15.99:0/88358926 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f831c0fc700 0x7f831c1122f0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:58.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:58.445+0000 7f8324799640 1 --2- 172.21.15.99:0/88358926 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f831c0fb430 0x7f831c10fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:37:58.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:58.445+0000 7f8324799640 1 -- 172.21.15.99:0/88358926 >> 172.21.15.99:0/88358926 conn(0x7f831c0f6c10 msgr2=0x7f831c0f83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:37:58.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:58.445+0000 7f8324799640 1 -- 172.21.15.99:0/88358926 shutdown_connections 2024-09-19T06:37:58.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:37:58.445+0000 7f8324799640 1 -- 172.21.15.99:0/88358926 wait complete. 2024-09-19T06:37:58.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:58 smithi117 ceph-mon[34564]: pgmap v178: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s wr, 7 op/s 2024-09-19T06:37:58.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:58 smithi117 ceph-mon[34564]: mds.? [v2:172.21.15.99:6828/1508711176,v1:172.21.15.99:6829/1508711176] up:resolve 2024-09-19T06:37:58.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:58 smithi117 ceph-mon[34564]: mds.? [v2:172.21.15.99:6826/388324528,v1:172.21.15.99:6827/388324528] up:boot 2024-09-19T06:37:58.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:58 smithi117 ceph-mon[34564]: fsmap cephfs:2/2 {0=cephfs.smithi099.xehbxe=up:resolve,1=cephfs.smithi117.nooexo=up:active} 2 up:standby 2024-09-19T06:37:58.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:58 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi099.obarqf"}]: dispatch 2024-09-19T06:37:59.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:59 smithi117 ceph-mon[34564]: from='client.? 172.21.15.99:0/88358926' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:37:59.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:59 smithi117 ceph-mon[34564]: mds.? [v2:172.21.15.99:6828/1508711176,v1:172.21.15.99:6829/1508711176] up:reconnect 2024-09-19T06:37:59.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:59 smithi117 ceph-mon[34564]: mds.? [v2:172.21.15.117:6826/4072877365,v1:172.21.15.117:6827/4072877365] up:standby 2024-09-19T06:37:59.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:37:59 smithi117 ceph-mon[34564]: fsmap cephfs:2/2 {0=cephfs.smithi099.xehbxe=up:reconnect,1=cephfs.smithi117.nooexo=up:active} 2 up:standby 2024-09-19T06:37:59.584 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:59 smithi099 ceph-mon[27651]: from='client.? 172.21.15.99:0/88358926' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:37:59.584 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:59 smithi099 ceph-mon[27651]: mds.? [v2:172.21.15.99:6828/1508711176,v1:172.21.15.99:6829/1508711176] up:reconnect 2024-09-19T06:37:59.584 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:59 smithi099 ceph-mon[27651]: mds.? [v2:172.21.15.117:6826/4072877365,v1:172.21.15.117:6827/4072877365] up:standby 2024-09-19T06:37:59.584 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:37:59 smithi099 ceph-mon[27651]: fsmap cephfs:2/2 {0=cephfs.smithi099.xehbxe=up:reconnect,1=cephfs.smithi117.nooexo=up:active} 2 up:standby 2024-09-19T06:37:59.608 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-09-19T06:38:00.279 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T06:38:00.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:38:00 smithi117 ceph-mon[34564]: pgmap v180: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 204 B/s rd, 1.3 KiB/s wr, 4 op/s 2024-09-19T06:38:00.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:38:00 smithi117 ceph-mon[34564]: mds.? [v2:172.21.15.99:6828/1508711176,v1:172.21.15.99:6829/1508711176] up:rejoin 2024-09-19T06:38:00.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:38:00 smithi117 ceph-mon[34564]: fsmap cephfs:2/2 {0=cephfs.smithi099.xehbxe=up:rejoin,1=cephfs.smithi117.nooexo=up:active} 2 up:standby 2024-09-19T06:38:00.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:38:00 smithi117 ceph-mon[34564]: daemon mds.cephfs.smithi099.xehbxe is now active in filesystem cephfs as rank 0 2024-09-19T06:38:00.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:38:00 smithi099 ceph-mon[27651]: pgmap v180: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 204 B/s rd, 1.3 KiB/s wr, 4 op/s 2024-09-19T06:38:00.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:38:00 smithi099 ceph-mon[27651]: mds.? [v2:172.21.15.99:6828/1508711176,v1:172.21.15.99:6829/1508711176] up:rejoin 2024-09-19T06:38:00.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:38:00 smithi099 ceph-mon[27651]: fsmap cephfs:2/2 {0=cephfs.smithi099.xehbxe=up:rejoin,1=cephfs.smithi117.nooexo=up:active} 2 up:standby 2024-09-19T06:38:00.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:38:00 smithi099 ceph-mon[27651]: daemon mds.cephfs.smithi099.xehbxe is now active in filesystem cephfs as rank 0 2024-09-19T06:38:01.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:38:01 smithi117 ceph-mon[34564]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T06:38:01.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:38:01 smithi117 ceph-mon[34564]: Cluster is now healthy 2024-09-19T06:38:01.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:38:01 smithi117 ceph-mon[34564]: mds.? [v2:172.21.15.99:6828/1508711176,v1:172.21.15.99:6829/1508711176] up:active 2024-09-19T06:38:01.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:38:01 smithi117 ceph-mon[34564]: fsmap cephfs:2 {0=cephfs.smithi099.xehbxe=up:active,1=cephfs.smithi117.nooexo=up:active} 2 up:standby 2024-09-19T06:38:01.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:38:01 smithi099 ceph-mon[27651]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T06:38:01.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:38:01 smithi099 ceph-mon[27651]: Cluster is now healthy 2024-09-19T06:38:01.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:38:01 smithi099 ceph-mon[27651]: mds.? [v2:172.21.15.99:6828/1508711176,v1:172.21.15.99:6829/1508711176] up:active 2024-09-19T06:38:01.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:38:01 smithi099 ceph-mon[27651]: fsmap cephfs:2 {0=cephfs.smithi099.xehbxe=up:active,1=cephfs.smithi117.nooexo=up:active} 2 up:standby 2024-09-19T06:38:02.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:02.469+0000 7f6a4a7c4640 1 -- 172.21.15.99:0/1713428444 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a440fc530 msgr2=0x7f6a440fc940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:02.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:02.469+0000 7f6a4a7c4640 1 --2- 172.21.15.99:0/1713428444 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a440fc530 0x7f6a440fc940 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6a340048d0 tx=0x7f6a34009da0 comp rx=0 tx=0).stop 2024-09-19T06:38:02.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:02.469+0000 7f6a4a7c4640 1 -- 172.21.15.99:0/1713428444 shutdown_connections 2024-09-19T06:38:02.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:02.469+0000 7f6a4a7c4640 1 --2- 172.21.15.99:0/1713428444 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a440fd800 0x7f6a440fdc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:02.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:02.469+0000 7f6a4a7c4640 1 --2- 172.21.15.99:0/1713428444 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a440fc530 0x7f6a440fc940 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:02.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:02.469+0000 7f6a4a7c4640 1 -- 172.21.15.99:0/1713428444 >> 172.21.15.99:0/1713428444 conn(0x7f6a440f7d10 msgr2=0x7f6a440fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:02.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:02.469+0000 7f6a4a7c4640 1 -- 172.21.15.99:0/1713428444 shutdown_connections 2024-09-19T06:38:02.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:02.469+0000 7f6a4a7c4640 1 -- 172.21.15.99:0/1713428444 wait complete. 2024-09-19T06:38:02.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:02.470+0000 7f6a4a7c4640 1 Processor -- start 2024-09-19T06:38:02.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:02.470+0000 7f6a4a7c4640 1 -- start start 2024-09-19T06:38:02.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:02.470+0000 7f6a4a7c4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a440fc530 0x7f6a4410d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:02.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:02.470+0000 7f6a4a7c4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a440fd800 0x7f6a4410d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:02.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:02.470+0000 7f6a4a7c4640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4410dc20 con 0x7f6a440fc530 2024-09-19T06:38:02.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:02.470+0000 7f6a4a7c4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4410e440 con 0x7f6a440fd800 2024-09-19T06:38:02.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:02.470+0000 7f6a43fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a440fc530 0x7f6a4410d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:02.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:02.470+0000 7f6a43fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a440fc530 0x7f6a4410d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49320/0 (socket says 172.21.15.99:49320) 2024-09-19T06:38:02.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:02.470+0000 7f6a43fff640 1 -- 172.21.15.99:0/2094964373 learned_addr learned my addr 172.21.15.99:0/2094964373 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:38:02.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:02.470+0000 7f6a437fe640 1 --2- 172.21.15.99:0/2094964373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a440fd800 0x7f6a4410d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:02.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:02.470+0000 7f6a43fff640 1 -- 172.21.15.99:0/2094964373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a440fd800 msgr2=0x7f6a4410d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:02.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:02.470+0000 7f6a43fff640 1 --2- 172.21.15.99:0/2094964373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a440fd800 0x7f6a4410d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:02.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:02.470+0000 7f6a43fff640 1 -- 172.21.15.99:0/2094964373 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a34005040 con 0x7f6a440fc530 2024-09-19T06:38:02.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:02.471+0000 7f6a43fff640 1 --2- 172.21.15.99:0/2094964373 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a440fc530 0x7f6a4410d090 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6a340043d0 tx=0x7f6a34009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:02.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:02.471+0000 7f6a40ff9640 1 -- 172.21.15.99:0/2094964373 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a34038070 con 0x7f6a440fc530 2024-09-19T06:38:02.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:02.471+0000 7f6a40ff9640 1 -- 172.21.15.99:0/2094964373 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6a3402ae90 con 0x7f6a440fc530 2024-09-19T06:38:02.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:02.471+0000 7f6a40ff9640 1 -- 172.21.15.99:0/2094964373 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a3403e670 con 0x7f6a440fc530 2024-09-19T06:38:02.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:02.471+0000 7f6a4a7c4640 1 -- 172.21.15.99:0/2094964373 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a4410e670 con 0x7f6a440fc530 2024-09-19T06:38:02.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:02.471+0000 7f6a4a7c4640 1 -- 172.21.15.99:0/2094964373 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a4410ec10 con 0x7f6a440fc530 2024-09-19T06:38:02.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:02.472+0000 7f6a4a7c4640 1 -- 172.21.15.99:0/2094964373 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a440fb990 con 0x7f6a440fc530 2024-09-19T06:38:02.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:02.472+0000 7f6a40ff9640 1 -- 172.21.15.99:0/2094964373 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f6a34030020 con 0x7f6a440fc530 2024-09-19T06:38:02.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:02.473+0000 7f6a40ff9640 1 --2- 172.21.15.99:0/2094964373 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f6a2c06ed60 0x7f6a2c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:02.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:02.473+0000 7f6a40ff9640 1 -- 172.21.15.99:0/2094964373 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f6a340ae300 con 0x7f6a440fc530 2024-09-19T06:38:02.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:02.473+0000 7f6a437fe640 1 --2- 172.21.15.99:0/2094964373 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f6a2c06ed60 0x7f6a2c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:02.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:02.473+0000 7f6a437fe640 1 --2- 172.21.15.99:0/2094964373 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f6a2c06ed60 0x7f6a2c071210 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6a4410ce40 tx=0x7f6a3800b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:02.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:02.477+0000 7f6a40ff9640 1 -- 172.21.15.99:0/2094964373 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f6a3407b500 con 0x7f6a440fc530 2024-09-19T06:38:02.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:38:02 smithi117 ceph-mon[34564]: pgmap v181: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 614 B/s rd, 716 B/s wr, 3 op/s 2024-09-19T06:38:02.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:02.683+0000 7f6a4a7c4640 1 -- 172.21.15.99:0/2094964373 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6a4404b720 con 0x7f6a440fc530 2024-09-19T06:38:02.685 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:38:02 smithi099 ceph-mon[27651]: pgmap v181: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 614 B/s rd, 716 B/s wr, 3 op/s 2024-09-19T06:38:02.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:02.684+0000 7f6a40ff9640 1 -- 172.21.15.99:0/2094964373 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4706 (secure 0 0 0) 0x7f6a3407aea0 con 0x7f6a440fc530 2024-09-19T06:38:02.686 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 15 2024-09-19T06:38:02.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:02.686+0000 7f6a4a7c4640 1 -- 172.21.15.99:0/2094964373 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f6a2c06ed60 msgr2=0x7f6a2c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:02.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:02.686+0000 7f6a4a7c4640 1 --2- 172.21.15.99:0/2094964373 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f6a2c06ed60 0x7f6a2c071210 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6a4410ce40 tx=0x7f6a3800b040 comp rx=0 tx=0).stop 2024-09-19T06:38:02.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:02.686+0000 7f6a4a7c4640 1 -- 172.21.15.99:0/2094964373 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a440fc530 msgr2=0x7f6a4410d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:02.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:02.686+0000 7f6a4a7c4640 1 --2- 172.21.15.99:0/2094964373 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a440fc530 0x7f6a4410d090 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6a340043d0 tx=0x7f6a34009da0 comp rx=0 tx=0).stop 2024-09-19T06:38:02.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:02.686+0000 7f6a4a7c4640 1 -- 172.21.15.99:0/2094964373 shutdown_connections 2024-09-19T06:38:02.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:02.686+0000 7f6a4a7c4640 1 --2- 172.21.15.99:0/2094964373 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f6a2c06ed60 0x7f6a2c071210 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:02.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:02.686+0000 7f6a4a7c4640 1 --2- 172.21.15.99:0/2094964373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a440fd800 0x7f6a4410d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:02.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:02.686+0000 7f6a4a7c4640 1 --2- 172.21.15.99:0/2094964373 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a440fc530 0x7f6a4410d090 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:02.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:02.686+0000 7f6a4a7c4640 1 -- 172.21.15.99:0/2094964373 >> 172.21.15.99:0/2094964373 conn(0x7f6a440f7d10 msgr2=0x7f6a440f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:02.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:02.687+0000 7f6a4a7c4640 1 -- 172.21.15.99:0/2094964373 shutdown_connections 2024-09-19T06:38:02.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:02.687+0000 7f6a4a7c4640 1 -- 172.21.15.99:0/2094964373 wait complete. 2024-09-19T06:38:02.697 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-09-19T06:38:03.329 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-09-19T06:38:03.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:38:03 smithi117 ceph-mon[34564]: pgmap v182: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.8 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-19T06:38:03.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:38:03 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:38:03.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:38:03 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:38:03.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:38:03 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:38:03.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:38:03 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:38:03.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:38:03 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:38:03.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:38:03 smithi117 ceph-mon[34564]: from='client.? 172.21.15.99:0/2094964373' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:38:03.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:38:03 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:38:03.861 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:38:03 smithi099 ceph-mon[27651]: pgmap v182: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.8 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-19T06:38:03.862 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:38:03 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:38:03.862 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:38:03 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:38:03.862 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:38:03 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:38:03.862 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:38:03 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:38:03.862 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:38:03 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:38:03.862 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:38:03 smithi099 ceph-mon[27651]: from='client.? 172.21.15.99:0/2094964373' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:38:03.862 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:38:03 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:38:04.153 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T06:38:05.644 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:38:05 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:38:05.644 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:38:05 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:38:05.644 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:38:05 smithi099 ceph-mon[27651]: pgmap v183: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.1 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-19T06:38:05.644 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:38:05 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:38:05.644 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:38:05 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:38:05.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:38:05 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:38:05.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:38:05 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:38:05.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:38:05 smithi117 ceph-mon[34564]: pgmap v183: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.1 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-19T06:38:05.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:38:05 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:38:05.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:38:05 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:38:05.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:05.836+0000 7f8947f06640 1 -- 172.21.15.99:0/4077223529 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89400fc740 msgr2=0x7f89400fcbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:05.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:05.837+0000 7f8947f06640 1 --2- 172.21.15.99:0/4077223529 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89400fc740 0x7f89400fcbb0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f89340048d0 tx=0x7f8934009da0 comp rx=0 tx=0).stop 2024-09-19T06:38:05.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:05.837+0000 7f8947f06640 1 -- 172.21.15.99:0/4077223529 shutdown_connections 2024-09-19T06:38:05.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:05.837+0000 7f8947f06640 1 --2- 172.21.15.99:0/4077223529 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89400fc740 0x7f89400fcbb0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:05.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:05.837+0000 7f8947f06640 1 --2- 172.21.15.99:0/4077223529 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89400fb470 0x7f89400fb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:05.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:05.837+0000 7f8947f06640 1 -- 172.21.15.99:0/4077223529 >> 172.21.15.99:0/4077223529 conn(0x7f89400f6c30 msgr2=0x7f89400f9060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:05.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:05.837+0000 7f8947f06640 1 -- 172.21.15.99:0/4077223529 shutdown_connections 2024-09-19T06:38:05.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:05.837+0000 7f8947f06640 1 -- 172.21.15.99:0/4077223529 wait complete. 2024-09-19T06:38:05.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:05.837+0000 7f8947f06640 1 Processor -- start 2024-09-19T06:38:05.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:05.837+0000 7f8947f06640 1 -- start start 2024-09-19T06:38:05.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:05.837+0000 7f8947f06640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89400fb470 0x7f894010fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:05.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:05.837+0000 7f8947f06640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89400fc740 0x7f8940112360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:05.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:05.837+0000 7f8947f06640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8940066750 con 0x7f89400fb470 2024-09-19T06:38:05.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:05.837+0000 7f8947f06640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89400668c0 con 0x7f89400fc740 2024-09-19T06:38:05.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:05.837+0000 7f8945ca2640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89400fb470 0x7f894010fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:05.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:05.837+0000 7f8945ca2640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89400fb470 0x7f894010fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56724/0 (socket says 172.21.15.99:56724) 2024-09-19T06:38:05.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:05.837+0000 7f8945ca2640 1 -- 172.21.15.99:0/2724714610 learned_addr learned my addr 172.21.15.99:0/2724714610 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:38:05.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:05.838+0000 7f89454a1640 1 --2- 172.21.15.99:0/2724714610 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89400fc740 0x7f8940112360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:05.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:05.838+0000 7f8945ca2640 1 -- 172.21.15.99:0/2724714610 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89400fc740 msgr2=0x7f8940112360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:05.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:05.838+0000 7f8945ca2640 1 --2- 172.21.15.99:0/2724714610 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89400fc740 0x7f8940112360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:05.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:05.838+0000 7f8945ca2640 1 -- 172.21.15.99:0/2724714610 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8934005040 con 0x7f89400fb470 2024-09-19T06:38:05.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:05.838+0000 7f8945ca2640 1 --2- 172.21.15.99:0/2724714610 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89400fb470 0x7f894010fe10 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8938002a50 tx=0x7f8938004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:05.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:05.838+0000 7f893e7fc640 1 -- 172.21.15.99:0/2724714610 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8938007c30 con 0x7f89400fb470 2024-09-19T06:38:05.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:05.838+0000 7f893e7fc640 1 -- 172.21.15.99:0/2724714610 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f893800f040 con 0x7f89400fb470 2024-09-19T06:38:05.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:05.838+0000 7f893e7fc640 1 -- 172.21.15.99:0/2724714610 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f893800da10 con 0x7f89400fb470 2024-09-19T06:38:05.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:05.838+0000 7f8947f06640 1 -- 172.21.15.99:0/2724714610 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8940112900 con 0x7f89400fb470 2024-09-19T06:38:05.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:05.838+0000 7f8947f06640 1 -- 172.21.15.99:0/2724714610 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8940112e70 con 0x7f89400fb470 2024-09-19T06:38:05.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:05.839+0000 7f8947f06640 1 -- 172.21.15.99:0/2724714610 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89400fa8d0 con 0x7f89400fb470 2024-09-19T06:38:05.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:05.840+0000 7f893e7fc640 1 -- 172.21.15.99:0/2724714610 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f893800dbb0 con 0x7f89400fb470 2024-09-19T06:38:05.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:05.840+0000 7f893e7fc640 1 --2- 172.21.15.99:0/2724714610 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f892806ed60 0x7f8928071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:05.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:05.840+0000 7f893e7fc640 1 -- 172.21.15.99:0/2724714610 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f893808d890 con 0x7f89400fb470 2024-09-19T06:38:05.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:05.840+0000 7f89454a1640 1 --2- 172.21.15.99:0/2724714610 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f892806ed60 0x7f8928071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:05.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:05.841+0000 7f89454a1640 1 --2- 172.21.15.99:0/2724714610 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f892806ed60 0x7f8928071210 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8934007ac0 tx=0x7f8934035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:05.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:05.845+0000 7f893e7fc640 1 -- 172.21.15.99:0/2724714610 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f893804d2a0 con 0x7f89400fb470 2024-09-19T06:38:06.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:06.068+0000 7f8947f06640 1 -- 172.21.15.99:0/2724714610 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7f894004b720 con 0x7f89400fb470 2024-09-19T06:38:06.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:06.068+0000 7f893e7fc640 1 -- 172.21.15.99:0/2724714610 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v15) v1 ==== 78+0+100 (secure 0 0 0) 0x7f893805ab50 con 0x7f89400fb470 2024-09-19T06:38:06.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:06.070+0000 7f8947f06640 1 -- 172.21.15.99:0/2724714610 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f892806ed60 msgr2=0x7f8928071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:06.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:06.070+0000 7f8947f06640 1 --2- 172.21.15.99:0/2724714610 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f892806ed60 0x7f8928071210 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8934007ac0 tx=0x7f8934035040 comp rx=0 tx=0).stop 2024-09-19T06:38:06.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:06.070+0000 7f8947f06640 1 -- 172.21.15.99:0/2724714610 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89400fb470 msgr2=0x7f894010fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:06.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:06.070+0000 7f8947f06640 1 --2- 172.21.15.99:0/2724714610 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89400fb470 0x7f894010fe10 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8938002a50 tx=0x7f8938004600 comp rx=0 tx=0).stop 2024-09-19T06:38:06.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:06.070+0000 7f8947f06640 1 -- 172.21.15.99:0/2724714610 shutdown_connections 2024-09-19T06:38:06.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:06.070+0000 7f8947f06640 1 --2- 172.21.15.99:0/2724714610 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f892806ed60 0x7f8928071210 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:06.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:06.070+0000 7f8947f06640 1 --2- 172.21.15.99:0/2724714610 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89400fc740 0x7f8940112360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:06.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:06.070+0000 7f8947f06640 1 --2- 172.21.15.99:0/2724714610 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89400fb470 0x7f894010fe10 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:06.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:06.070+0000 7f8947f06640 1 -- 172.21.15.99:0/2724714610 >> 172.21.15.99:0/2724714610 conn(0x7f89400f6c30 msgr2=0x7f89400f83d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:06.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:06.070+0000 7f8947f06640 1 -- 172.21.15.99:0/2724714610 shutdown_connections 2024-09-19T06:38:06.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:06.070+0000 7f8947f06640 1 -- 172.21.15.99:0/2724714610 wait complete. 2024-09-19T06:38:06.080 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-09-19T06:38:06.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:38:06 smithi099 ceph-mon[27651]: from='client.? 172.21.15.99:0/2724714610' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-19T06:38:06.811 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:38:06 smithi117 ceph-mon[34564]: from='client.? 172.21.15.99:0/2724714610' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-19T06:38:06.883 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-09-19T06:38:07.473 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T06:38:07.689 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:38:07 smithi099 ceph-mon[27651]: pgmap v184: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.1 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-19T06:38:07.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:38:07 smithi117 ceph-mon[34564]: pgmap v184: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.1 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-19T06:38:07.958 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T06:38:09.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:38:09 smithi099 ceph-mon[27651]: pgmap v185: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.2 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-19T06:38:10.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:38:09 smithi117 ceph-mon[34564]: pgmap v185: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.2 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-19T06:38:10.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:10.857+0000 7f20aaab8640 1 -- 172.21.15.99:0/1834776748 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f20a40fcf80 msgr2=0x7f20a40fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:10.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:10.857+0000 7f20aaab8640 1 --2- 172.21.15.99:0/1834776748 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f20a40fcf80 0x7f20a40fd3d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f2098009c50 tx=0x7f2098004d10 comp rx=0 tx=0).stop 2024-09-19T06:38:10.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:10.858+0000 7f20aaab8640 1 -- 172.21.15.99:0/1834776748 shutdown_connections 2024-09-19T06:38:10.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:10.858+0000 7f20aaab8640 1 --2- 172.21.15.99:0/1834776748 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f20a40fcf80 0x7f20a40fd3d0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:10.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:10.858+0000 7f20aaab8640 1 --2- 172.21.15.99:0/1834776748 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20a40fb810 0x7f20a40fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:10.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:10.858+0000 7f20aaab8640 1 -- 172.21.15.99:0/1834776748 >> 172.21.15.99:0/1834776748 conn(0x7f20a40723b0 msgr2=0x7f20a40727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:10.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:10.858+0000 7f20aaab8640 1 -- 172.21.15.99:0/1834776748 shutdown_connections 2024-09-19T06:38:10.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:10.858+0000 7f20aaab8640 1 -- 172.21.15.99:0/1834776748 wait complete. 2024-09-19T06:38:10.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:10.858+0000 7f20aaab8640 1 Processor -- start 2024-09-19T06:38:10.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:10.858+0000 7f20aaab8640 1 -- start start 2024-09-19T06:38:10.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:10.858+0000 7f20aaab8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f20a40fb810 0x7f20a410e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:10.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:10.858+0000 7f20aaab8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20a40fcf80 0x7f20a410e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:10.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:10.858+0000 7f20aaab8640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a410ee80 con 0x7f20a40fb810 2024-09-19T06:38:10.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:10.858+0000 7f20aaab8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a410eff0 con 0x7f20a40fcf80 2024-09-19T06:38:10.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:10.859+0000 7f20a8854640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f20a40fb810 0x7f20a410e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:10.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:10.859+0000 7f20a8854640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f20a40fb810 0x7f20a410e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56742/0 (socket says 172.21.15.99:56742) 2024-09-19T06:38:10.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:10.859+0000 7f20a8854640 1 -- 172.21.15.99:0/3353680813 learned_addr learned my addr 172.21.15.99:0/3353680813 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:38:10.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:10.859+0000 7f20a3fff640 1 --2- 172.21.15.99:0/3353680813 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20a40fcf80 0x7f20a410e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:10.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:10.859+0000 7f20a8854640 1 -- 172.21.15.99:0/3353680813 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20a40fcf80 msgr2=0x7f20a410e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:10.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:10.859+0000 7f20a8854640 1 --2- 172.21.15.99:0/3353680813 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20a40fcf80 0x7f20a410e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:10.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:10.859+0000 7f20a8854640 1 -- 172.21.15.99:0/3353680813 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20980098b0 con 0x7f20a40fb810 2024-09-19T06:38:10.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:10.859+0000 7f20a8854640 1 --2- 172.21.15.99:0/3353680813 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f20a40fb810 0x7f20a410e240 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f209400b790 tx=0x7f20940091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:10.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:10.859+0000 7f20a17fa640 1 -- 172.21.15.99:0/3353680813 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f209400c700 con 0x7f20a40fb810 2024-09-19T06:38:10.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:10.859+0000 7f20a17fa640 1 -- 172.21.15.99:0/3353680813 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f209400cd00 con 0x7f20a40fb810 2024-09-19T06:38:10.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:10.859+0000 7f20a17fa640 1 -- 172.21.15.99:0/3353680813 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2094015e70 con 0x7f20a40fb810 2024-09-19T06:38:10.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:10.859+0000 7f20aaab8640 1 -- 172.21.15.99:0/3353680813 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20a4117370 con 0x7f20a40fb810 2024-09-19T06:38:10.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:10.859+0000 7f20aaab8640 1 -- 172.21.15.99:0/3353680813 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20a4117860 con 0x7f20a40fb810 2024-09-19T06:38:10.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:10.861+0000 7f20aaab8640 1 -- 172.21.15.99:0/3353680813 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20a40fcbc0 con 0x7f20a40fb810 2024-09-19T06:38:10.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:10.861+0000 7f20a17fa640 1 -- 172.21.15.99:0/3353680813 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f2094012070 con 0x7f20a40fb810 2024-09-19T06:38:10.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:10.862+0000 7f20a17fa640 1 --2- 172.21.15.99:0/3353680813 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f208c06ed60 0x7f208c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:10.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:10.862+0000 7f20a3fff640 1 --2- 172.21.15.99:0/3353680813 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f208c06ed60 0x7f208c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:10.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:10.862+0000 7f20a17fa640 1 -- 172.21.15.99:0/3353680813 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f209408dc20 con 0x7f20a40fb810 2024-09-19T06:38:10.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:10.862+0000 7f20a3fff640 1 --2- 172.21.15.99:0/3353680813 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f208c06ed60 0x7f208c071210 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2098009c20 tx=0x7f2098004d10 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:10.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:10.866+0000 7f20a17fa640 1 -- 172.21.15.99:0/3353680813 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f209405ad70 con 0x7f20a40fb810 2024-09-19T06:38:11.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:11.055+0000 7f20aaab8640 1 -- 172.21.15.99:0/3353680813 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f20a4072ec0 con 0x7f20a40fb810 2024-09-19T06:38:11.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:11.056+0000 7f20a17fa640 1 -- 172.21.15.99:0/3353680813 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4706 (secure 0 0 0) 0x7f209405a710 con 0x7f20a40fb810 2024-09-19T06:38:11.057 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:38:11.057 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14490,"name":"cephfs.smithi099.obarqf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6827/388324528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":388324528},{"type":"v1","addr":"172.21.15.99:6827","nonce":388324528}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24283,"name":"cephfs.smithi117.bheqzh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.117:6827/4072877365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":4072877365},{"type":"v1","addr":"172.21.15.117:6827","nonce":4072877365}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:40.838146+0000","modified":"2024-09-19T06:38:00.560320+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":45,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14482,"mds_1":24269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14482":{"gid":14482,"name":"cephfs.smithi099.xehbxe","rank":0,"incarnation":11,"state":"up:active","state_seq":6,"addr":"172.21.15.99:6829/1508711176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1508711176},{"type":"v1","addr":"172.21.15.99:6829","nonce":1508711176}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24269":{"gid":24269,"name":"cephfs.smithi117.nooexo","rank":1,"incarnation":6,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6825/2367330767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":2367330767},{"type":"v1","addr":"172.21.15.117:6825","nonce":2367330767}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-09-19T06:38:11.058 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 15 2024-09-19T06:38:11.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:11.057+0000 7f20aaab8640 1 -- 172.21.15.99:0/3353680813 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f208c06ed60 msgr2=0x7f208c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:11.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:11.057+0000 7f20aaab8640 1 --2- 172.21.15.99:0/3353680813 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f208c06ed60 0x7f208c071210 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2098009c20 tx=0x7f2098004d10 comp rx=0 tx=0).stop 2024-09-19T06:38:11.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:11.057+0000 7f20aaab8640 1 -- 172.21.15.99:0/3353680813 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f20a40fb810 msgr2=0x7f20a410e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:11.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:11.057+0000 7f20aaab8640 1 --2- 172.21.15.99:0/3353680813 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f20a40fb810 0x7f20a410e240 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f209400b790 tx=0x7f20940091d0 comp rx=0 tx=0).stop 2024-09-19T06:38:11.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:11.057+0000 7f20aaab8640 1 -- 172.21.15.99:0/3353680813 shutdown_connections 2024-09-19T06:38:11.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:11.057+0000 7f20aaab8640 1 --2- 172.21.15.99:0/3353680813 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f208c06ed60 0x7f208c071210 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:11.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:11.057+0000 7f20aaab8640 1 --2- 172.21.15.99:0/3353680813 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20a40fcf80 0x7f20a410e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:11.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:11.057+0000 7f20aaab8640 1 --2- 172.21.15.99:0/3353680813 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f20a40fb810 0x7f20a410e240 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:11.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:11.057+0000 7f20aaab8640 1 -- 172.21.15.99:0/3353680813 >> 172.21.15.99:0/3353680813 conn(0x7f20a40723b0 msgr2=0x7f20a40fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:11.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:11.058+0000 7f20aaab8640 1 -- 172.21.15.99:0/3353680813 shutdown_connections 2024-09-19T06:38:11.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:11.058+0000 7f20aaab8640 1 -- 172.21.15.99:0/3353680813 wait complete. 2024-09-19T06:38:11.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:38:11 smithi099 ceph-mon[27651]: pgmap v186: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-19T06:38:11.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:38:11 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:38:11.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:38:11 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:38:11.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:38:11 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:38:11.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:38:11 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:38:11.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:38:11 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:38:11.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:38:11 smithi099 ceph-mon[27651]: from='client.? 172.21.15.99:0/3353680813' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:38:11.786 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 15, 'max_mds': 2, 'flags': 18} 2024-09-19T06:38:11.787 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-19T06:38:11.819 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-19T06:38:11.819 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}} 2024-09-19T06:38:11.819 INFO:tasks.ceph_fuse:client.0 config is {} 2024-09-19T06:38:11.819 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-19T06:38:11.820 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T06:38:11.820 INFO:tasks.ceph_fuse:client.1 config is {} 2024-09-19T06:38:11.820 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-19T06:38:11.820 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-19T06:38:11.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:38:11.821 DEBUG:teuthology.orchestra.run.smithi099:> ip netns list 2024-09-19T06:38:11.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:38:11.839 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link delete ceph-brx 2024-09-19T06:38:11.906 INFO:teuthology.orchestra.run.smithi099.stderr:Cannot find device "ceph-brx" 2024-09-19T06:38:11.907 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T06:38:11.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:38:11.908 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2024-09-19T06:38:11.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:38:11.928 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link delete ceph-brx 2024-09-19T06:38:11.966 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:38:11 smithi117 ceph-mon[34564]: pgmap v186: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.1 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-19T06:38:11.966 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:38:11 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:38:11.966 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:38:11 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:38:11.966 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:38:11 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:38:11.966 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:38:11 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:38:11.966 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:38:11 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:38:11.967 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:38:11 smithi117 ceph-mon[34564]: from='client.? 172.21.15.99:0/3353680813' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T06:38:12.001 INFO:teuthology.orchestra.run.smithi117.stderr:Cannot find device "ceph-brx" 2024-09-19T06:38:12.002 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T06:38:12.002 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-19T06:38:12.002 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-19T06:38:12.003 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-19T06:38:12.243 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T06:38:13.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:13.745+0000 7fe434459640 1 -- 172.21.15.99:0/3198743757 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe42c064fe0 msgr2=0x7fe42c065430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:13.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:13.745+0000 7fe434459640 1 --2- 172.21.15.99:0/3198743757 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe42c064fe0 0x7fe42c065430 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe4200048d0 tx=0x7fe420009da0 comp rx=0 tx=0).stop 2024-09-19T06:38:13.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:13.745+0000 7fe434459640 1 -- 172.21.15.99:0/3198743757 shutdown_connections 2024-09-19T06:38:13.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:13.745+0000 7fe434459640 1 --2- 172.21.15.99:0/3198743757 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe42c064fe0 0x7fe42c065430 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:13.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:13.745+0000 7fe434459640 1 --2- 172.21.15.99:0/3198743757 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe42c0fe450 0x7fe42c0fe820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:13.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:13.745+0000 7fe434459640 1 -- 172.21.15.99:0/3198743757 >> 172.21.15.99:0/3198743757 conn(0x7fe42c0723b0 msgr2=0x7fe42c0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:13.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:13.745+0000 7fe434459640 1 -- 172.21.15.99:0/3198743757 shutdown_connections 2024-09-19T06:38:13.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:13.745+0000 7fe434459640 1 -- 172.21.15.99:0/3198743757 wait complete. 2024-09-19T06:38:13.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:13.745+0000 7fe434459640 1 Processor -- start 2024-09-19T06:38:13.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:13.745+0000 7fe434459640 1 -- start start 2024-09-19T06:38:13.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:13.746+0000 7fe434459640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe42c064fe0 0x7fe42c113270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:13.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:13.746+0000 7fe434459640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe42c0fe450 0x7fe42c1137b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:13.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:13.746+0000 7fe434459640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe42c113e40 con 0x7fe42c064fe0 2024-09-19T06:38:13.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:13.746+0000 7fe434459640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe42c10d1f0 con 0x7fe42c0fe450 2024-09-19T06:38:13.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:13.746+0000 7fe4321f5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe42c064fe0 0x7fe42c113270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:13.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:13.746+0000 7fe4321f5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe42c064fe0 0x7fe42c113270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56760/0 (socket says 172.21.15.99:56760) 2024-09-19T06:38:13.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:13.746+0000 7fe4321f5640 1 -- 172.21.15.99:0/1020579108 learned_addr learned my addr 172.21.15.99:0/1020579108 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:38:13.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:13.746+0000 7fe4319f4640 1 --2- 172.21.15.99:0/1020579108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe42c0fe450 0x7fe42c1137b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:13.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:13.746+0000 7fe4321f5640 1 -- 172.21.15.99:0/1020579108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe42c0fe450 msgr2=0x7fe42c1137b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:13.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:13.746+0000 7fe4321f5640 1 --2- 172.21.15.99:0/1020579108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe42c0fe450 0x7fe42c1137b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:13.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:13.746+0000 7fe4321f5640 1 -- 172.21.15.99:0/1020579108 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe420005040 con 0x7fe42c064fe0 2024-09-19T06:38:13.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:13.746+0000 7fe4321f5640 1 --2- 172.21.15.99:0/1020579108 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe42c064fe0 0x7fe42c113270 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe41c00bbb0 tx=0x7fe41c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:13.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:13.746+0000 7fe42affd640 1 -- 172.21.15.99:0/1020579108 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe41c00c9c0 con 0x7fe42c064fe0 2024-09-19T06:38:13.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:13.746+0000 7fe42affd640 1 -- 172.21.15.99:0/1020579108 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe41c0092e0 con 0x7fe42c064fe0 2024-09-19T06:38:13.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:13.746+0000 7fe434459640 1 -- 172.21.15.99:0/1020579108 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe42c10d4d0 con 0x7fe42c064fe0 2024-09-19T06:38:13.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:13.746+0000 7fe42affd640 1 -- 172.21.15.99:0/1020579108 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe41c007640 con 0x7fe42c064fe0 2024-09-19T06:38:13.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:13.746+0000 7fe434459640 1 -- 172.21.15.99:0/1020579108 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe42c10d9c0 con 0x7fe42c064fe0 2024-09-19T06:38:13.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:13.747+0000 7fe434459640 1 -- 172.21.15.99:0/1020579108 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe42c0fdce0 con 0x7fe42c064fe0 2024-09-19T06:38:13.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:13.748+0000 7fe42affd640 1 -- 172.21.15.99:0/1020579108 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fe41c012070 con 0x7fe42c064fe0 2024-09-19T06:38:13.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:13.748+0000 7fe42affd640 1 --2- 172.21.15.99:0/1020579108 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fe41406ed60 0x7fe414071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:13.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:13.749+0000 7fe42affd640 1 -- 172.21.15.99:0/1020579108 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fe41c08e360 con 0x7fe42c064fe0 2024-09-19T06:38:13.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:13.749+0000 7fe4319f4640 1 --2- 172.21.15.99:0/1020579108 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fe41406ed60 0x7fe414071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:13.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:13.749+0000 7fe4319f4640 1 --2- 172.21.15.99:0/1020579108 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fe41406ed60 0x7fe414071210 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe42c0f8760 tx=0x7fe420035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:13.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:13.753+0000 7fe42affd640 1 -- 172.21.15.99:0/1020579108 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fe41c05b430 con 0x7fe42c064fe0 2024-09-19T06:38:13.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:13.945+0000 7fe434459640 1 -- 172.21.15.99:0/1020579108 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe42c04b780 con 0x7fe42c064fe0 2024-09-19T06:38:13.946 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:38:13 smithi099 ceph-mon[27651]: pgmap v187: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.7 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-19T06:38:13.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:13.945+0000 7fe42affd640 1 -- 172.21.15.99:0/1020579108 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+83 (secure 0 0 0) 0x7fe41c05add0 con 0x7fe42c064fe0 2024-09-19T06:38:13.947 INFO:teuthology.orchestra.run.smithi099.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-19T06:38:13.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:13.947+0000 7fe434459640 1 -- 172.21.15.99:0/1020579108 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fe41406ed60 msgr2=0x7fe414071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:13.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:13.947+0000 7fe434459640 1 --2- 172.21.15.99:0/1020579108 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fe41406ed60 0x7fe414071210 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe42c0f8760 tx=0x7fe420035040 comp rx=0 tx=0).stop 2024-09-19T06:38:13.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:13.947+0000 7fe434459640 1 -- 172.21.15.99:0/1020579108 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe42c064fe0 msgr2=0x7fe42c113270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:13.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:13.947+0000 7fe434459640 1 --2- 172.21.15.99:0/1020579108 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe42c064fe0 0x7fe42c113270 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe41c00bbb0 tx=0x7fe41c009840 comp rx=0 tx=0).stop 2024-09-19T06:38:13.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:13.947+0000 7fe434459640 1 -- 172.21.15.99:0/1020579108 shutdown_connections 2024-09-19T06:38:13.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:13.947+0000 7fe434459640 1 --2- 172.21.15.99:0/1020579108 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fe41406ed60 0x7fe414071210 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:13.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:13.947+0000 7fe434459640 1 --2- 172.21.15.99:0/1020579108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe42c0fe450 0x7fe42c1137b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:13.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:13.947+0000 7fe434459640 1 --2- 172.21.15.99:0/1020579108 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe42c064fe0 0x7fe42c113270 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:13.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:13.947+0000 7fe434459640 1 -- 172.21.15.99:0/1020579108 >> 172.21.15.99:0/1020579108 conn(0x7fe42c0723b0 msgr2=0x7fe42c0fa2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:13.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:13.947+0000 7fe434459640 1 -- 172.21.15.99:0/1020579108 shutdown_connections 2024-09-19T06:38:13.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:13.947+0000 7fe434459640 1 -- 172.21.15.99:0/1020579108 wait complete. 2024-09-19T06:38:14.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:38:13 smithi117 ceph-mon[34564]: pgmap v187: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.7 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-19T06:38:14.583 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-19T06:38:14.583 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T06:38:14.583 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi099.front.sepia.ceph.com 2024-09-19T06:38:14.583 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-19T06:38:14.583 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T06:38:14.583 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-19T06:38:14.584 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T06:38:14.584 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T06:38:14.584 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T06:38:14.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:38:14.584 DEBUG:teuthology.orchestra.run.smithi099:> ip addr 2024-09-19T06:38:14.600 INFO:teuthology.orchestra.run.smithi099.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T06:38:14.600 INFO:teuthology.orchestra.run.smithi099.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T06:38:14.601 INFO:teuthology.orchestra.run.smithi099.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T06:38:14.601 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-19T06:38:14.601 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 ::1/128 scope host 2024-09-19T06:38:14.601 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-19T06:38:14.601 INFO:teuthology.orchestra.run.smithi099.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T06:38:14.601 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:d8:a2:10 brd ff:ff:ff:ff:ff:ff 2024-09-19T06:38:14.601 INFO:teuthology.orchestra.run.smithi099.stdout: altname enp7s0f0 2024-09-19T06:38:14.601 INFO:teuthology.orchestra.run.smithi099.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T06:38:14.601 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:d8:a2:11 brd ff:ff:ff:ff:ff:ff 2024-09-19T06:38:14.601 INFO:teuthology.orchestra.run.smithi099.stdout: altname enp7s0f1 2024-09-19T06:38:14.601 INFO:teuthology.orchestra.run.smithi099.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T06:38:14.601 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:8f:d8:02 brd ff:ff:ff:ff:ff:ff 2024-09-19T06:38:14.601 INFO:teuthology.orchestra.run.smithi099.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T06:38:14.601 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:8f:d8:03 brd ff:ff:ff:ff:ff:ff 2024-09-19T06:38:14.602 INFO:teuthology.orchestra.run.smithi099.stdout: inet 172.21.15.99/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-19T06:38:14.602 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft 42357sec preferred_lft 42357sec 2024-09-19T06:38:14.602 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::ec4:7aff:fe8f:d803/64 scope link noprefixroute 2024-09-19T06:38:14.602 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-09-19T06:38:14.603 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-19T06:38:14.603 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T06:38:14.603 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-09-19T06:38:14.603 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link add name ceph-brx type bridge 2024-09-19T06:38:14.603 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip addr flush dev ceph-brx 2024-09-19T06:38:14.604 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link set ceph-brx up 2024-09-19T06:38:14.604 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-19T06:38:14.604 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-09-19T06:38:14.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T06:38:14.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:38:14.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:38:14.810 DEBUG:teuthology.orchestra.run.smithi099:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T06:38:14.835 INFO:teuthology.orchestra.run.smithi099.stdout:1 2024-09-19T06:38:14.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:38:14.836 DEBUG:teuthology.orchestra.run.smithi099:> route 2024-09-19T06:38:14.906 INFO:teuthology.orchestra.run.smithi099.stdout:Kernel IP routing table 2024-09-19T06:38:14.906 INFO:teuthology.orchestra.run.smithi099.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T06:38:14.906 INFO:teuthology.orchestra.run.smithi099.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-19T06:38:14.907 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-19T06:38:14.907 INFO:teuthology.orchestra.run.smithi099.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T06:38:14.907 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T06:38:14.907 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-09-19T06:38:14.907 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-19T06:38:14.907 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-19T06:38:14.908 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-19T06:38:14.908 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-09-19T06:38:14.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:38:14 smithi099 ceph-mon[27651]: from='client.? 172.21.15.99:0/1020579108' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T06:38:14.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T06:38:15.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:38:14 smithi117 ceph-mon[34564]: from='client.? 172.21.15.99:0/1020579108' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T06:38:15.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:38:15.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:38:15.205 DEBUG:teuthology.orchestra.run.smithi099:> ip netns list 2024-09-19T06:38:15.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:38:15.261 DEBUG:teuthology.orchestra.run.smithi099:> ip netns list-id 2024-09-19T06:38:15.316 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T06:38:15.317 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-09-19T06:38:15.317 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T06:38:15.317 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-19T06:38:15.317 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-09-19T06:38:15.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T06:38:15.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:38:15.432 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-19T06:38:15.432 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T06:38:15.432 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-09-19T06:38:15.432 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-19T06:38:15.433 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-19T06:38:15.433 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-19T06:38:15.433 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-19T06:38:15.433 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-19T06:38:15.433 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-09-19T06:38:15.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T06:38:15.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:38:15.563 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T06:38:15.563 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-09-19T06:38:15.563 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link set brx.0 up 2024-09-19T06:38:15.563 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link set dev brx.0 master ceph-brx 2024-09-19T06:38:15.563 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-09-19T06:38:15.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T06:38:15.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:38:15.638 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-19T06:38:15.638 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T06:38:15.638 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-19T06:38:15.653 INFO:teuthology.orchestra.run.smithi099.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-19T06:38:15.653 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T06:38:15.653 DEBUG:teuthology.orchestra.run.smithi099:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-19T06:38:15.704 DEBUG:teuthology.orchestra.run.smithi099:> sudo modprobe fuse 2024-09-19T06:38:15.770 DEBUG:teuthology.orchestra.run.smithi099:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T06:38:15.828 INFO:teuthology.orchestra.run.smithi099.stdout:/proc 2024-09-19T06:38:15.828 INFO:teuthology.orchestra.run.smithi099.stdout:/sys 2024-09-19T06:38:15.828 INFO:teuthology.orchestra.run.smithi099.stdout:/dev 2024-09-19T06:38:15.828 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/kernel/security 2024-09-19T06:38:15.828 INFO:teuthology.orchestra.run.smithi099.stdout:/dev/shm 2024-09-19T06:38:15.828 INFO:teuthology.orchestra.run.smithi099.stdout:/dev/pts 2024-09-19T06:38:15.828 INFO:teuthology.orchestra.run.smithi099.stdout:/run 2024-09-19T06:38:15.828 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/fs/cgroup 2024-09-19T06:38:15.828 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/fs/pstore 2024-09-19T06:38:15.828 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/fs/bpf 2024-09-19T06:38:15.828 INFO:teuthology.orchestra.run.smithi099.stdout:/ 2024-09-19T06:38:15.829 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/fs/selinux 2024-09-19T06:38:15.829 INFO:teuthology.orchestra.run.smithi099.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T06:38:15.829 INFO:teuthology.orchestra.run.smithi099.stdout:/dev/mqueue 2024-09-19T06:38:15.829 INFO:teuthology.orchestra.run.smithi099.stdout:/dev/hugepages 2024-09-19T06:38:15.829 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/kernel/debug 2024-09-19T06:38:15.829 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/kernel/tracing 2024-09-19T06:38:15.829 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/fs/fuse/connections 2024-09-19T06:38:15.829 INFO:teuthology.orchestra.run.smithi099.stdout:/run/credentials/systemd-sysctl.service 2024-09-19T06:38:15.829 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/kernel/config 2024-09-19T06:38:15.829 INFO:teuthology.orchestra.run.smithi099.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-19T06:38:15.829 INFO:teuthology.orchestra.run.smithi099.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-19T06:38:15.829 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/nfs/rpc_pipefs 2024-09-19T06:38:15.830 INFO:teuthology.orchestra.run.smithi099.stdout:/run/user/1000 2024-09-19T06:38:15.830 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/ceph 2024-09-19T06:38:15.830 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/containers/storage/overlay 2024-09-19T06:38:15.830 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/containers/storage/overlay/efc110a15716154fbcc22f9bda598032b1ee2362239402d9dbdfc2e436243c2e/merged 2024-09-19T06:38:15.830 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/containers/storage/overlay/57c799be1ae693afd3837849ab4ee9cb2813b34e22c33e173a3b81d1e107a877/merged 2024-09-19T06:38:15.830 INFO:teuthology.orchestra.run.smithi099.stdout:/run/user/0 2024-09-19T06:38:15.830 INFO:teuthology.orchestra.run.smithi099.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T06:38:15.830 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/containers/storage/overlay/b56070322d4d2f5a294ec8b0cafc43b4278d7b0252b8a5d0f07caabc372fcfab/merged 2024-09-19T06:38:15.830 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/containers/storage/overlay/878cdce4d6b4b81e0d646e84f93e7ea1f440d28fdfb6d960f62011da9b44e5e2/merged 2024-09-19T06:38:15.830 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/containers/storage/overlay/1edf63cd6cbc37a93deb1ae83aa22daf9f5e84975dd79a655e57438d6b6ab0c8/merged 2024-09-19T06:38:15.830 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/containers/storage/overlay/f12dd01600fa12204ae05a812ad742b6b8298805527f5bd570eb79ffe9401691/merged 2024-09-19T06:38:15.830 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/containers/storage/overlay/08c4a81c686588380c7159569beb6aae18d425ad3f1d3d2924f9fed830d13438/merged 2024-09-19T06:38:15.830 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/containers/storage/overlay/fba15a1f121a27c1d93b1b168572b2543e8aa1117e8349e148fb5e06b190aaef/merged 2024-09-19T06:38:15.831 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/containers/storage/overlay/6432f5c9dc65180a639dac02a0546140b96ac719571fd44413645fe35d4deff7/merged 2024-09-19T06:38:15.831 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/containers/storage/overlay/28ece96cace670f0f4e7815f9a30bec88dfcb35f87fcd182a482f5cb21324387/merged 2024-09-19T06:38:15.831 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/containers/storage/overlay/5a8010e03878c0fd7a2e0c2b046d69a68d98f266c55c09b748f80facd65dbc6d/merged 2024-09-19T06:38:15.831 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/containers/storage/overlay/7b8a21fc4bec74602a596d97f881a7ac5c99908fc3552351af6668708bac80b7/merged 2024-09-19T06:38:15.831 INFO:teuthology.orchestra.run.smithi099.stdout:/run/netns 2024-09-19T06:38:15.831 INFO:teuthology.orchestra.run.smithi099.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T06:38:15.831 INFO:teuthology.orchestra.run.smithi099.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T06:38:15.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:38:15.832 DEBUG:teuthology.orchestra.run.smithi099:> ls /sys/fs/fuse/connections 2024-09-19T06:38:15.883 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-19T06:38:15.883 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-19T06:38:15.926 DEBUG:teuthology.orchestra.run.smithi099:> sudo modprobe fuse 2024-09-19T06:38:15.944 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:38:15 smithi099 ceph-mon[27651]: pgmap v188: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s rd, 0 B/s wr, 0 op/s 2024-09-19T06:38:15.949 DEBUG:teuthology.orchestra.run.smithi099:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T06:38:16.006 INFO:teuthology.orchestra.run.smithi099.stdout:/proc 2024-09-19T06:38:16.006 INFO:teuthology.orchestra.run.smithi099.stdout:/sys 2024-09-19T06:38:16.007 INFO:teuthology.orchestra.run.smithi099.stdout:/dev 2024-09-19T06:38:16.007 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/kernel/security 2024-09-19T06:38:16.007 INFO:teuthology.orchestra.run.smithi099.stdout:/dev/shm 2024-09-19T06:38:16.007 INFO:teuthology.orchestra.run.smithi099.stdout:/dev/pts 2024-09-19T06:38:16.007 INFO:teuthology.orchestra.run.smithi099.stdout:/run 2024-09-19T06:38:16.007 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/fs/cgroup 2024-09-19T06:38:16.007 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/fs/pstore 2024-09-19T06:38:16.007 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/fs/bpf 2024-09-19T06:38:16.007 INFO:teuthology.orchestra.run.smithi099.stdout:/ 2024-09-19T06:38:16.007 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/fs/selinux 2024-09-19T06:38:16.007 INFO:teuthology.orchestra.run.smithi099.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T06:38:16.007 INFO:teuthology.orchestra.run.smithi099.stdout:/dev/mqueue 2024-09-19T06:38:16.008 INFO:teuthology.orchestra.run.smithi099.stdout:/dev/hugepages 2024-09-19T06:38:16.008 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/kernel/debug 2024-09-19T06:38:16.008 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/kernel/tracing 2024-09-19T06:38:16.008 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/fs/fuse/connections 2024-09-19T06:38:16.008 INFO:teuthology.orchestra.run.smithi099.stdout:/run/credentials/systemd-sysctl.service 2024-09-19T06:38:16.008 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/kernel/config 2024-09-19T06:38:16.008 INFO:teuthology.orchestra.run.smithi099.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-19T06:38:16.008 INFO:teuthology.orchestra.run.smithi099.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-19T06:38:16.008 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/nfs/rpc_pipefs 2024-09-19T06:38:16.008 INFO:teuthology.orchestra.run.smithi099.stdout:/run/user/1000 2024-09-19T06:38:16.008 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/ceph 2024-09-19T06:38:16.008 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/containers/storage/overlay 2024-09-19T06:38:16.009 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/containers/storage/overlay/efc110a15716154fbcc22f9bda598032b1ee2362239402d9dbdfc2e436243c2e/merged 2024-09-19T06:38:16.009 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/containers/storage/overlay/57c799be1ae693afd3837849ab4ee9cb2813b34e22c33e173a3b81d1e107a877/merged 2024-09-19T06:38:16.009 INFO:teuthology.orchestra.run.smithi099.stdout:/run/user/0 2024-09-19T06:38:16.009 INFO:teuthology.orchestra.run.smithi099.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T06:38:16.009 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/containers/storage/overlay/b56070322d4d2f5a294ec8b0cafc43b4278d7b0252b8a5d0f07caabc372fcfab/merged 2024-09-19T06:38:16.009 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/containers/storage/overlay/878cdce4d6b4b81e0d646e84f93e7ea1f440d28fdfb6d960f62011da9b44e5e2/merged 2024-09-19T06:38:16.009 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/containers/storage/overlay/1edf63cd6cbc37a93deb1ae83aa22daf9f5e84975dd79a655e57438d6b6ab0c8/merged 2024-09-19T06:38:16.009 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/containers/storage/overlay/f12dd01600fa12204ae05a812ad742b6b8298805527f5bd570eb79ffe9401691/merged 2024-09-19T06:38:16.009 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/containers/storage/overlay/08c4a81c686588380c7159569beb6aae18d425ad3f1d3d2924f9fed830d13438/merged 2024-09-19T06:38:16.009 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/containers/storage/overlay/fba15a1f121a27c1d93b1b168572b2543e8aa1117e8349e148fb5e06b190aaef/merged 2024-09-19T06:38:16.009 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/containers/storage/overlay/6432f5c9dc65180a639dac02a0546140b96ac719571fd44413645fe35d4deff7/merged 2024-09-19T06:38:16.009 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/containers/storage/overlay/28ece96cace670f0f4e7815f9a30bec88dfcb35f87fcd182a482f5cb21324387/merged 2024-09-19T06:38:16.009 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/containers/storage/overlay/5a8010e03878c0fd7a2e0c2b046d69a68d98f266c55c09b748f80facd65dbc6d/merged 2024-09-19T06:38:16.010 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/containers/storage/overlay/7b8a21fc4bec74602a596d97f881a7ac5c99908fc3552351af6668708bac80b7/merged 2024-09-19T06:38:16.010 INFO:teuthology.orchestra.run.smithi099.stdout:/run/netns 2024-09-19T06:38:16.010 INFO:teuthology.orchestra.run.smithi099.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T06:38:16.010 INFO:teuthology.orchestra.run.smithi099.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T06:38:16.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:38:16.010 DEBUG:teuthology.orchestra.run.smithi099:> ls /sys/fs/fuse/connections 2024-09-19T06:38:16.017 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi099.stderr:2024-09-19T06:38:16.016+0000 7f881a6c8300 -1 init, newargv = 0x558126dcc440 newargc=15 2024-09-19T06:38:16.017 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi099.stderr:ceph-fuse[73869]: starting ceph client 2024-09-19T06:38:16.025 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi099.stderr:ceph-fuse[73869]: starting fuse 2024-09-19T06:38:16.033 INFO:teuthology.orchestra.run.smithi099.stdout:126 2024-09-19T06:38:16.033 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [126] 2024-09-19T06:38:16.033 DEBUG:teuthology.orchestra.run.smithi099:> sudo stdin-killer -- python3 -c ' 2024-09-19T06:38:16.033 DEBUG:teuthology.orchestra.run.smithi099:> import glob 2024-09-19T06:38:16.033 DEBUG:teuthology.orchestra.run.smithi099:> import re 2024-09-19T06:38:16.034 DEBUG:teuthology.orchestra.run.smithi099:> import os 2024-09-19T06:38:16.034 DEBUG:teuthology.orchestra.run.smithi099:> import subprocess 2024-09-19T06:38:16.034 DEBUG:teuthology.orchestra.run.smithi099:> 2024-09-19T06:38:16.034 DEBUG:teuthology.orchestra.run.smithi099:> def _find_admin_socket(client_name): 2024-09-19T06:38:16.034 DEBUG:teuthology.orchestra.run.smithi099:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-19T06:38:16.034 DEBUG:teuthology.orchestra.run.smithi099:> files = glob.glob(asok_path) 2024-09-19T06:38:16.034 DEBUG:teuthology.orchestra.run.smithi099:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-19T06:38:16.034 DEBUG:teuthology.orchestra.run.smithi099:> 2024-09-19T06:38:16.034 DEBUG:teuthology.orchestra.run.smithi099:> # Given a non-glob path, it better be there 2024-09-19T06:38:16.034 DEBUG:teuthology.orchestra.run.smithi099:> if "*" not in asok_path: 2024-09-19T06:38:16.034 DEBUG:teuthology.orchestra.run.smithi099:> assert(len(files) == 1) 2024-09-19T06:38:16.034 DEBUG:teuthology.orchestra.run.smithi099:> return files[0] 2024-09-19T06:38:16.034 DEBUG:teuthology.orchestra.run.smithi099:> 2024-09-19T06:38:16.034 DEBUG:teuthology.orchestra.run.smithi099:> for f in files: 2024-09-19T06:38:16.034 DEBUG:teuthology.orchestra.run.smithi099:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-19T06:38:16.035 DEBUG:teuthology.orchestra.run.smithi099:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-19T06:38:16.035 DEBUG:teuthology.orchestra.run.smithi099:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-19T06:38:16.035 DEBUG:teuthology.orchestra.run.smithi099:> contents = proc_f.read() 2024-09-19T06:38:16.035 DEBUG:teuthology.orchestra.run.smithi099:> if mountpoint in contents: 2024-09-19T06:38:16.035 DEBUG:teuthology.orchestra.run.smithi099:> return f 2024-09-19T06:38:16.035 DEBUG:teuthology.orchestra.run.smithi099:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-19T06:38:16.035 DEBUG:teuthology.orchestra.run.smithi099:> 2024-09-19T06:38:16.035 DEBUG:teuthology.orchestra.run.smithi099:> print(_find_admin_socket("client.0")) 2024-09-19T06:38:16.035 DEBUG:teuthology.orchestra.run.smithi099:> ' 2024-09-19T06:38:16.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:38:15 smithi117 ceph-mon[34564]: pgmap v188: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s rd, 0 B/s wr, 0 op/s 2024-09-19T06:38:16.150 INFO:teuthology.orchestra.run.smithi099.stdout:/var/run/ceph/ceph-client.0.73869.asok 2024-09-19T06:38:16.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:38:16.160 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.73869.asok 2024-09-19T06:38:16.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:38:16.160 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.73869.asok status 2024-09-19T06:38:16.288 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:38:16.288 INFO:teuthology.orchestra.run.smithi099.stdout: "metadata": { 2024-09-19T06:38:16.288 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_sha1": "6e06d1e002b6603c076b9260a58131a040dabe75", 2024-09-19T06:38:16.288 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_version": "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)", 2024-09-19T06:38:16.288 INFO:teuthology.orchestra.run.smithi099.stdout: "entity_id": "0", 2024-09-19T06:38:16.289 INFO:teuthology.orchestra.run.smithi099.stdout: "hostname": "smithi099", 2024-09-19T06:38:16.289 INFO:teuthology.orchestra.run.smithi099.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-19T06:38:16.289 INFO:teuthology.orchestra.run.smithi099.stdout: "pid": "73869", 2024-09-19T06:38:16.289 INFO:teuthology.orchestra.run.smithi099.stdout: "root": "/" 2024-09-19T06:38:16.289 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:38:16.289 INFO:teuthology.orchestra.run.smithi099.stdout: "dentry_count": 0, 2024-09-19T06:38:16.289 INFO:teuthology.orchestra.run.smithi099.stdout: "dentry_pinned_count": 0, 2024-09-19T06:38:16.289 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 14514, 2024-09-19T06:38:16.289 INFO:teuthology.orchestra.run.smithi099.stdout: "inst": { 2024-09-19T06:38:16.289 INFO:teuthology.orchestra.run.smithi099.stdout: "name": { 2024-09-19T06:38:16.289 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "client", 2024-09-19T06:38:16.289 INFO:teuthology.orchestra.run.smithi099.stdout: "num": 14514 2024-09-19T06:38:16.289 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:38:16.289 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": { 2024-09-19T06:38:16.290 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-19T06:38:16.290 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "192.168.0.1:0", 2024-09-19T06:38:16.290 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3783729462 2024-09-19T06:38:16.290 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T06:38:16.290 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:38:16.290 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": { 2024-09-19T06:38:16.290 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-19T06:38:16.290 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "192.168.0.1:0", 2024-09-19T06:38:16.290 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3783729462 2024-09-19T06:38:16.290 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:38:16.290 INFO:teuthology.orchestra.run.smithi099.stdout: "inst_str": "client.14514 192.168.0.1:0/3783729462", 2024-09-19T06:38:16.290 INFO:teuthology.orchestra.run.smithi099.stdout: "addr_str": "192.168.0.1:0/3783729462", 2024-09-19T06:38:16.290 INFO:teuthology.orchestra.run.smithi099.stdout: "inode_count": 1, 2024-09-19T06:38:16.291 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_epoch": 15, 2024-09-19T06:38:16.291 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_epoch": 45, 2024-09-19T06:38:16.291 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_epoch_barrier": 0, 2024-09-19T06:38:16.291 INFO:teuthology.orchestra.run.smithi099.stdout: "blocklisted": false, 2024-09-19T06:38:16.291 INFO:teuthology.orchestra.run.smithi099.stdout: "fs_name": "cephfs" 2024-09-19T06:38:16.291 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:38:16.296 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-19T06:38:16.297 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-19T06:38:16.540 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T06:38:17.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:38:17 smithi099 ceph-mon[27651]: pgmap v189: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-19T06:38:18.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:38:17 smithi117 ceph-mon[34564]: pgmap v189: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-19T06:38:18.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:18.182+0000 7f5e207e9640 1 -- 172.21.15.99:0/3167165768 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e180fac80 msgr2=0x7f5e180fb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:18.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:18.182+0000 7f5e207e9640 1 --2- 172.21.15.99:0/3167165768 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e180fac80 0x7f5e180fb0f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5e140048d0 tx=0x7f5e14009da0 comp rx=0 tx=0).stop 2024-09-19T06:38:18.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:18.182+0000 7f5e207e9640 1 -- 172.21.15.99:0/3167165768 shutdown_connections 2024-09-19T06:38:18.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:18.182+0000 7f5e207e9640 1 --2- 172.21.15.99:0/3167165768 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e180fac80 0x7f5e180fb0f0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:18.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:18.182+0000 7f5e207e9640 1 --2- 172.21.15.99:0/3167165768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e18102620 0x7f5e181029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:18.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:18.182+0000 7f5e207e9640 1 -- 172.21.15.99:0/3167165768 >> 172.21.15.99:0/3167165768 conn(0x7f5e18070ce0 msgr2=0x7f5e180710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:18.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:18.182+0000 7f5e207e9640 1 -- 172.21.15.99:0/3167165768 shutdown_connections 2024-09-19T06:38:18.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:18.182+0000 7f5e207e9640 1 -- 172.21.15.99:0/3167165768 wait complete. 2024-09-19T06:38:18.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:18.183+0000 7f5e207e9640 1 Processor -- start 2024-09-19T06:38:18.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:18.183+0000 7f5e207e9640 1 -- start start 2024-09-19T06:38:18.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:18.183+0000 7f5e207e9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e180fac80 0x7f5e18113220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:18.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:18.183+0000 7f5e207e9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e18102620 0x7f5e18113760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:18.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:18.183+0000 7f5e207e9640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e18113df0 con 0x7f5e18102620 2024-09-19T06:38:18.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:18.183+0000 7f5e207e9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1810d1a0 con 0x7f5e180fac80 2024-09-19T06:38:18.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:18.183+0000 7f5e1dd84640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e18102620 0x7f5e18113760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:18.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:18.183+0000 7f5e1dd84640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e18102620 0x7f5e18113760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52856/0 (socket says 172.21.15.99:52856) 2024-09-19T06:38:18.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:18.183+0000 7f5e1dd84640 1 -- 172.21.15.99:0/516770517 learned_addr learned my addr 172.21.15.99:0/516770517 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:38:18.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:18.183+0000 7f5e1e585640 1 --2- 172.21.15.99:0/516770517 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e180fac80 0x7f5e18113220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:18.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:18.183+0000 7f5e1dd84640 1 -- 172.21.15.99:0/516770517 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e180fac80 msgr2=0x7f5e18113220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:18.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:18.183+0000 7f5e1dd84640 1 --2- 172.21.15.99:0/516770517 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e180fac80 0x7f5e18113220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:18.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:18.183+0000 7f5e1dd84640 1 -- 172.21.15.99:0/516770517 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e14005040 con 0x7f5e18102620 2024-09-19T06:38:18.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:18.184+0000 7f5e1dd84640 1 --2- 172.21.15.99:0/516770517 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e18102620 0x7f5e18113760 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5e14003080 tx=0x7f5e14009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:18.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:18.184+0000 7f5e0effd640 1 -- 172.21.15.99:0/516770517 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e14038070 con 0x7f5e18102620 2024-09-19T06:38:18.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:18.184+0000 7f5e0effd640 1 -- 172.21.15.99:0/516770517 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5e140097e0 con 0x7f5e18102620 2024-09-19T06:38:18.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:18.184+0000 7f5e207e9640 1 -- 172.21.15.99:0/516770517 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e1810d420 con 0x7f5e18102620 2024-09-19T06:38:18.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:18.184+0000 7f5e0effd640 1 -- 172.21.15.99:0/516770517 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e1403d420 con 0x7f5e18102620 2024-09-19T06:38:18.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:18.184+0000 7f5e207e9640 1 -- 172.21.15.99:0/516770517 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e1810d8e0 con 0x7f5e18102620 2024-09-19T06:38:18.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:18.185+0000 7f5e207e9640 1 -- 172.21.15.99:0/516770517 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e180657b0 con 0x7f5e18102620 2024-09-19T06:38:18.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:18.185+0000 7f5e0effd640 1 -- 172.21.15.99:0/516770517 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f5e14030020 con 0x7f5e18102620 2024-09-19T06:38:18.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:18.186+0000 7f5e0effd640 1 --2- 172.21.15.99:0/516770517 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f5e0406ed60 0x7f5e04071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:18.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:18.186+0000 7f5e0effd640 1 -- 172.21.15.99:0/516770517 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f5e140ae700 con 0x7f5e18102620 2024-09-19T06:38:18.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:18.186+0000 7f5e1e585640 1 --2- 172.21.15.99:0/516770517 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f5e0406ed60 0x7f5e04071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:18.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:18.186+0000 7f5e1e585640 1 --2- 172.21.15.99:0/516770517 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f5e0406ed60 0x7f5e04071210 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5e08009b50 tx=0x7f5e08009120 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:18.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:18.190+0000 7f5e0effd640 1 -- 172.21.15.99:0/516770517 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f5e1407b7d0 con 0x7f5e18102620 2024-09-19T06:38:18.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:18.380+0000 7f5e207e9640 1 -- 172.21.15.99:0/516770517 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5e181095f0 con 0x7f5e18102620 2024-09-19T06:38:18.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:18.381+0000 7f5e0effd640 1 -- 172.21.15.99:0/516770517 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+83 (secure 0 0 0) 0x7f5e1407b170 con 0x7f5e18102620 2024-09-19T06:38:18.382 INFO:teuthology.orchestra.run.smithi099.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-19T06:38:18.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:18.383+0000 7f5e207e9640 1 -- 172.21.15.99:0/516770517 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f5e0406ed60 msgr2=0x7f5e04071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:18.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:18.383+0000 7f5e207e9640 1 --2- 172.21.15.99:0/516770517 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f5e0406ed60 0x7f5e04071210 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5e08009b50 tx=0x7f5e08009120 comp rx=0 tx=0).stop 2024-09-19T06:38:18.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:18.383+0000 7f5e207e9640 1 -- 172.21.15.99:0/516770517 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e18102620 msgr2=0x7f5e18113760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:18.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:18.383+0000 7f5e207e9640 1 --2- 172.21.15.99:0/516770517 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e18102620 0x7f5e18113760 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5e14003080 tx=0x7f5e14009da0 comp rx=0 tx=0).stop 2024-09-19T06:38:18.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:18.383+0000 7f5e207e9640 1 -- 172.21.15.99:0/516770517 shutdown_connections 2024-09-19T06:38:18.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:18.383+0000 7f5e207e9640 1 --2- 172.21.15.99:0/516770517 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f5e0406ed60 0x7f5e04071210 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:18.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:18.383+0000 7f5e207e9640 1 --2- 172.21.15.99:0/516770517 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e18102620 0x7f5e18113760 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:18.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:18.383+0000 7f5e207e9640 1 --2- 172.21.15.99:0/516770517 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e180fac80 0x7f5e18113220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:18.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:18.383+0000 7f5e207e9640 1 -- 172.21.15.99:0/516770517 >> 172.21.15.99:0/516770517 conn(0x7f5e18070ce0 msgr2=0x7f5e18105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:18.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:18.384+0000 7f5e207e9640 1 -- 172.21.15.99:0/516770517 shutdown_connections 2024-09-19T06:38:18.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:18.384+0000 7f5e207e9640 1 -- 172.21.15.99:0/516770517 wait complete. 2024-09-19T06:38:18.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:38:18 smithi099 ceph-mon[27651]: from='client.? 172.21.15.99:0/516770517' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T06:38:19.006 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-19T06:38:19.006 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T06:38:19.006 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi117.front.sepia.ceph.com 2024-09-19T06:38:19.006 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-19T06:38:19.006 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-19T06:38:19.006 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-19T06:38:19.006 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T06:38:19.007 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T06:38:19.007 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-19T06:38:19.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:38:19.007 DEBUG:teuthology.orchestra.run.smithi117:> ip addr 2024-09-19T06:38:19.024 INFO:teuthology.orchestra.run.smithi117.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T06:38:19.024 INFO:teuthology.orchestra.run.smithi117.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T06:38:19.024 INFO:teuthology.orchestra.run.smithi117.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T06:38:19.024 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-09-19T06:38:19.024 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 ::1/128 scope host 2024-09-19T06:38:19.025 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-09-19T06:38:19.025 INFO:teuthology.orchestra.run.smithi117.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T06:38:19.025 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8a brd ff:ff:ff:ff:ff:ff 2024-09-19T06:38:19.025 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f0 2024-09-19T06:38:19.025 INFO:teuthology.orchestra.run.smithi117.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T06:38:19.025 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8b brd ff:ff:ff:ff:ff:ff 2024-09-19T06:38:19.025 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f1 2024-09-19T06:38:19.025 INFO:teuthology.orchestra.run.smithi117.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T06:38:19.025 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:62 brd ff:ff:ff:ff:ff:ff 2024-09-19T06:38:19.025 INFO:teuthology.orchestra.run.smithi117.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T06:38:19.025 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:63 brd ff:ff:ff:ff:ff:ff 2024-09-19T06:38:19.025 INFO:teuthology.orchestra.run.smithi117.stdout: inet 172.21.15.117/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-19T06:38:19.026 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft 42360sec preferred_lft 42360sec 2024-09-19T06:38:19.026 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::ec4:7aff:fe8f:4463/64 scope link noprefixroute 2024-09-19T06:38:19.026 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-09-19T06:38:19.026 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-19T06:38:19.026 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T06:38:19.026 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-09-19T06:38:19.026 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link add name ceph-brx type bridge 2024-09-19T06:38:19.026 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip addr flush dev ceph-brx 2024-09-19T06:38:19.026 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set ceph-brx up 2024-09-19T06:38:19.026 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-19T06:38:19.027 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-09-19T06:38:19.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:38:18 smithi117 ceph-mon[34564]: from='client.? 172.21.15.99:0/516770517' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T06:38:19.110 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:38:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T06:38:19.212 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:38:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:38:19.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:38:19.219 DEBUG:teuthology.orchestra.run.smithi117:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T06:38:19.243 INFO:teuthology.orchestra.run.smithi117.stdout:1 2024-09-19T06:38:19.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:38:19.245 DEBUG:teuthology.orchestra.run.smithi117:> route 2024-09-19T06:38:19.316 INFO:teuthology.orchestra.run.smithi117.stdout:Kernel IP routing table 2024-09-19T06:38:19.316 INFO:teuthology.orchestra.run.smithi117.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T06:38:19.316 INFO:teuthology.orchestra.run.smithi117.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-19T06:38:19.316 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-19T06:38:19.316 INFO:teuthology.orchestra.run.smithi117.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T06:38:19.317 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T06:38:19.317 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-09-19T06:38:19.317 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-19T06:38:19.317 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-19T06:38:19.317 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-19T06:38:19.317 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-09-19T06:38:19.404 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:38:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T06:38:19.599 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:38:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:38:19.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:38:19.606 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2024-09-19T06:38:19.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:38:19.623 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list-id 2024-09-19T06:38:19.678 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T06:38:19.679 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-09-19T06:38:19.679 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-19T06:38:19.679 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-19T06:38:19.679 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-09-19T06:38:19.767 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:38:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T06:38:19.791 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:38:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:38:19.797 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-19T06:38:19.798 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T06:38:19.798 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-09-19T06:38:19.798 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-19T06:38:19.798 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-19T06:38:19.798 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-19T06:38:19.798 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-19T06:38:19.799 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-19T06:38:19.799 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-09-19T06:38:19.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:38:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T06:38:19.922 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:38:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:38:19.928 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T06:38:19.928 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-09-19T06:38:19.928 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set brx.0 up 2024-09-19T06:38:19.928 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set dev brx.0 master ceph-brx 2024-09-19T06:38:19.929 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-09-19T06:38:19.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:38:19 smithi099 ceph-mon[27651]: pgmap v190: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-19T06:38:19.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:38:19 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:38:19.976 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:38:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T06:38:19.984 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:38:19 smithi117 ceph-mon[34564]: pgmap v190: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-19T06:38:19.984 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:38:19 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:38:19.998 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:38:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:38:20.006 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-19T06:38:20.006 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T06:38:20.006 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-19T06:38:20.021 INFO:teuthology.orchestra.run.smithi117.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-19T06:38:20.021 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T06:38:20.021 DEBUG:teuthology.orchestra.run.smithi117:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-19T06:38:20.076 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2024-09-19T06:38:20.141 DEBUG:teuthology.orchestra.run.smithi117:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T06:38:20.199 INFO:teuthology.orchestra.run.smithi117.stdout:/proc 2024-09-19T06:38:20.199 INFO:teuthology.orchestra.run.smithi117.stdout:/sys 2024-09-19T06:38:20.199 INFO:teuthology.orchestra.run.smithi117.stdout:/dev 2024-09-19T06:38:20.199 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/security 2024-09-19T06:38:20.199 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/shm 2024-09-19T06:38:20.199 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/pts 2024-09-19T06:38:20.199 INFO:teuthology.orchestra.run.smithi117.stdout:/run 2024-09-19T06:38:20.199 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/cgroup 2024-09-19T06:38:20.199 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/pstore 2024-09-19T06:38:20.200 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/bpf 2024-09-19T06:38:20.200 INFO:teuthology.orchestra.run.smithi117.stdout:/ 2024-09-19T06:38:20.200 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/selinux 2024-09-19T06:38:20.200 INFO:teuthology.orchestra.run.smithi117.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T06:38:20.200 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/mqueue 2024-09-19T06:38:20.200 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/hugepages 2024-09-19T06:38:20.200 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/debug 2024-09-19T06:38:20.200 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/tracing 2024-09-19T06:38:20.200 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/fuse/connections 2024-09-19T06:38:20.200 INFO:teuthology.orchestra.run.smithi117.stdout:/run/credentials/systemd-sysctl.service 2024-09-19T06:38:20.200 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/config 2024-09-19T06:38:20.200 INFO:teuthology.orchestra.run.smithi117.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-19T06:38:20.201 INFO:teuthology.orchestra.run.smithi117.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-19T06:38:20.201 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/nfs/rpc_pipefs 2024-09-19T06:38:20.201 INFO:teuthology.orchestra.run.smithi117.stdout:/run/user/1000 2024-09-19T06:38:20.201 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph 2024-09-19T06:38:20.201 INFO:teuthology.orchestra.run.smithi117.stdout:/run/user/0 2024-09-19T06:38:20.201 INFO:teuthology.orchestra.run.smithi117.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T06:38:20.201 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/containers/storage/overlay 2024-09-19T06:38:20.201 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/containers/storage/overlay/559985cc51daa2516b1bd42aecf048c2c456073fda24c09d0e406ccdfb4d26b9/merged 2024-09-19T06:38:20.201 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/containers/storage/overlay/f78454a1cbe22f3c1a66f5ff7e9f9ea7211c7bf28fa5e9b526c873bfe86f4a2c/merged 2024-09-19T06:38:20.201 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/containers/storage/overlay/18d182e457fe7d3b677dc8064e38a40cbedafe08275ebad6a67650132bde6904/merged 2024-09-19T06:38:20.201 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/containers/storage/overlay/00a862e8806a1c7e2b6cd20b9efcbd5cd634b11df24df0dbef01481f154d3df7/merged 2024-09-19T06:38:20.201 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/containers/storage/overlay/44ebb9e08bbca2256889e143cb482624e9bda903b1527f0a5bd41d13ce965580/merged 2024-09-19T06:38:20.202 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/containers/storage/overlay/20c39d8f472cb37c1023264306077eac5f3a323fadd08c9c7a3a92235291088a/merged 2024-09-19T06:38:20.202 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/containers/storage/overlay/8c4dfc6b1ff1cd617e889ef414b1a58eebb6e3195807e53469149fe40083c799/merged 2024-09-19T06:38:20.202 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/containers/storage/overlay/2da471b1979df812d2b8d2c61dbe006f3af6bd5b52ee9613b6999fa2c93c02d9/merged 2024-09-19T06:38:20.202 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/containers/storage/overlay/9d3dc2676d7d28d4014ae91d6f89fddb884406c1b3843fc794dd3399bc3435cb/merged 2024-09-19T06:38:20.202 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns 2024-09-19T06:38:20.202 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-19T06:38:20.202 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-19T06:38:20.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:38:20.203 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2024-09-19T06:38:20.255 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-19T06:38:20.255 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-19T06:38:20.297 DEBUG:teuthology.orchestra.run.smithi117:> sudo modprobe fuse 2024-09-19T06:38:20.322 DEBUG:teuthology.orchestra.run.smithi117:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T06:38:20.378 INFO:teuthology.orchestra.run.smithi117.stdout:/proc 2024-09-19T06:38:20.378 INFO:teuthology.orchestra.run.smithi117.stdout:/sys 2024-09-19T06:38:20.378 INFO:teuthology.orchestra.run.smithi117.stdout:/dev 2024-09-19T06:38:20.378 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/security 2024-09-19T06:38:20.378 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/shm 2024-09-19T06:38:20.379 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/pts 2024-09-19T06:38:20.379 INFO:teuthology.orchestra.run.smithi117.stdout:/run 2024-09-19T06:38:20.379 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/cgroup 2024-09-19T06:38:20.379 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/pstore 2024-09-19T06:38:20.379 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/bpf 2024-09-19T06:38:20.379 INFO:teuthology.orchestra.run.smithi117.stdout:/ 2024-09-19T06:38:20.379 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/selinux 2024-09-19T06:38:20.379 INFO:teuthology.orchestra.run.smithi117.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T06:38:20.379 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/mqueue 2024-09-19T06:38:20.379 INFO:teuthology.orchestra.run.smithi117.stdout:/dev/hugepages 2024-09-19T06:38:20.379 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/debug 2024-09-19T06:38:20.379 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/tracing 2024-09-19T06:38:20.379 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/fs/fuse/connections 2024-09-19T06:38:20.380 INFO:teuthology.orchestra.run.smithi117.stdout:/run/credentials/systemd-sysctl.service 2024-09-19T06:38:20.380 INFO:teuthology.orchestra.run.smithi117.stdout:/sys/kernel/config 2024-09-19T06:38:20.380 INFO:teuthology.orchestra.run.smithi117.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-19T06:38:20.380 INFO:teuthology.orchestra.run.smithi117.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-19T06:38:20.380 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/nfs/rpc_pipefs 2024-09-19T06:38:20.380 INFO:teuthology.orchestra.run.smithi117.stdout:/run/user/1000 2024-09-19T06:38:20.380 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/ceph 2024-09-19T06:38:20.380 INFO:teuthology.orchestra.run.smithi117.stdout:/run/user/0 2024-09-19T06:38:20.380 INFO:teuthology.orchestra.run.smithi117.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T06:38:20.380 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/containers/storage/overlay 2024-09-19T06:38:20.380 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/containers/storage/overlay/559985cc51daa2516b1bd42aecf048c2c456073fda24c09d0e406ccdfb4d26b9/merged 2024-09-19T06:38:20.381 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/containers/storage/overlay/f78454a1cbe22f3c1a66f5ff7e9f9ea7211c7bf28fa5e9b526c873bfe86f4a2c/merged 2024-09-19T06:38:20.381 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/containers/storage/overlay/18d182e457fe7d3b677dc8064e38a40cbedafe08275ebad6a67650132bde6904/merged 2024-09-19T06:38:20.381 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/containers/storage/overlay/00a862e8806a1c7e2b6cd20b9efcbd5cd634b11df24df0dbef01481f154d3df7/merged 2024-09-19T06:38:20.381 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/containers/storage/overlay/44ebb9e08bbca2256889e143cb482624e9bda903b1527f0a5bd41d13ce965580/merged 2024-09-19T06:38:20.381 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/containers/storage/overlay/20c39d8f472cb37c1023264306077eac5f3a323fadd08c9c7a3a92235291088a/merged 2024-09-19T06:38:20.381 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/containers/storage/overlay/8c4dfc6b1ff1cd617e889ef414b1a58eebb6e3195807e53469149fe40083c799/merged 2024-09-19T06:38:20.381 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/containers/storage/overlay/2da471b1979df812d2b8d2c61dbe006f3af6bd5b52ee9613b6999fa2c93c02d9/merged 2024-09-19T06:38:20.381 INFO:teuthology.orchestra.run.smithi117.stdout:/var/lib/containers/storage/overlay/9d3dc2676d7d28d4014ae91d6f89fddb884406c1b3843fc794dd3399bc3435cb/merged 2024-09-19T06:38:20.381 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns 2024-09-19T06:38:20.381 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-19T06:38:20.381 INFO:teuthology.orchestra.run.smithi117.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-19T06:38:20.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:38:20.382 DEBUG:teuthology.orchestra.run.smithi117:> ls /sys/fs/fuse/connections 2024-09-19T06:38:20.397 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:2024-09-19T06:38:20.393+0000 7f71552c8300 -1 init, newargv = 0x562db2647ba0 newargc=15 2024-09-19T06:38:20.398 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:ceph-fuse[59084]: starting ceph client 2024-09-19T06:38:20.400 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi117.stderr:ceph-fuse[59084]: starting fuse 2024-09-19T06:38:20.413 INFO:teuthology.orchestra.run.smithi117.stdout:117 2024-09-19T06:38:20.413 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [117] 2024-09-19T06:38:20.413 DEBUG:teuthology.orchestra.run.smithi117:> sudo stdin-killer -- python3 -c ' 2024-09-19T06:38:20.414 DEBUG:teuthology.orchestra.run.smithi117:> import glob 2024-09-19T06:38:20.414 DEBUG:teuthology.orchestra.run.smithi117:> import re 2024-09-19T06:38:20.414 DEBUG:teuthology.orchestra.run.smithi117:> import os 2024-09-19T06:38:20.414 DEBUG:teuthology.orchestra.run.smithi117:> import subprocess 2024-09-19T06:38:20.414 DEBUG:teuthology.orchestra.run.smithi117:> 2024-09-19T06:38:20.414 DEBUG:teuthology.orchestra.run.smithi117:> def _find_admin_socket(client_name): 2024-09-19T06:38:20.414 DEBUG:teuthology.orchestra.run.smithi117:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-19T06:38:20.414 DEBUG:teuthology.orchestra.run.smithi117:> files = glob.glob(asok_path) 2024-09-19T06:38:20.414 DEBUG:teuthology.orchestra.run.smithi117:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-19T06:38:20.414 DEBUG:teuthology.orchestra.run.smithi117:> 2024-09-19T06:38:20.414 DEBUG:teuthology.orchestra.run.smithi117:> # Given a non-glob path, it better be there 2024-09-19T06:38:20.415 DEBUG:teuthology.orchestra.run.smithi117:> if "*" not in asok_path: 2024-09-19T06:38:20.415 DEBUG:teuthology.orchestra.run.smithi117:> assert(len(files) == 1) 2024-09-19T06:38:20.415 DEBUG:teuthology.orchestra.run.smithi117:> return files[0] 2024-09-19T06:38:20.415 DEBUG:teuthology.orchestra.run.smithi117:> 2024-09-19T06:38:20.415 DEBUG:teuthology.orchestra.run.smithi117:> for f in files: 2024-09-19T06:38:20.415 DEBUG:teuthology.orchestra.run.smithi117:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-19T06:38:20.415 DEBUG:teuthology.orchestra.run.smithi117:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-19T06:38:20.415 DEBUG:teuthology.orchestra.run.smithi117:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-19T06:38:20.415 DEBUG:teuthology.orchestra.run.smithi117:> contents = proc_f.read() 2024-09-19T06:38:20.415 DEBUG:teuthology.orchestra.run.smithi117:> if mountpoint in contents: 2024-09-19T06:38:20.415 DEBUG:teuthology.orchestra.run.smithi117:> return f 2024-09-19T06:38:20.416 DEBUG:teuthology.orchestra.run.smithi117:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-19T06:38:20.416 DEBUG:teuthology.orchestra.run.smithi117:> 2024-09-19T06:38:20.416 DEBUG:teuthology.orchestra.run.smithi117:> print(_find_admin_socket("client.1")) 2024-09-19T06:38:20.416 DEBUG:teuthology.orchestra.run.smithi117:> ' 2024-09-19T06:38:20.530 INFO:teuthology.orchestra.run.smithi117.stdout:/var/run/ceph/ceph-client.1.59084.asok 2024-09-19T06:38:20.533 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-19T06:38:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T06:38:20.541 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.59084.asok 2024-09-19T06:38:20.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:38:20.542 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.59084.asok status 2024-09-19T06:38:20.669 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-09-19T06:38:20.669 INFO:teuthology.orchestra.run.smithi117.stdout: "metadata": { 2024-09-19T06:38:20.669 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_sha1": "6e06d1e002b6603c076b9260a58131a040dabe75", 2024-09-19T06:38:20.669 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_version": "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)", 2024-09-19T06:38:20.669 INFO:teuthology.orchestra.run.smithi117.stdout: "entity_id": "1", 2024-09-19T06:38:20.669 INFO:teuthology.orchestra.run.smithi117.stdout: "hostname": "smithi117", 2024-09-19T06:38:20.669 INFO:teuthology.orchestra.run.smithi117.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-19T06:38:20.669 INFO:teuthology.orchestra.run.smithi117.stdout: "pid": "59084", 2024-09-19T06:38:20.670 INFO:teuthology.orchestra.run.smithi117.stdout: "root": "/" 2024-09-19T06:38:20.670 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-19T06:38:20.670 INFO:teuthology.orchestra.run.smithi117.stdout: "dentry_count": 0, 2024-09-19T06:38:20.670 INFO:teuthology.orchestra.run.smithi117.stdout: "dentry_pinned_count": 0, 2024-09-19T06:38:20.670 INFO:teuthology.orchestra.run.smithi117.stdout: "id": 24315, 2024-09-19T06:38:20.670 INFO:teuthology.orchestra.run.smithi117.stdout: "inst": { 2024-09-19T06:38:20.670 INFO:teuthology.orchestra.run.smithi117.stdout: "name": { 2024-09-19T06:38:20.670 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "client", 2024-09-19T06:38:20.670 INFO:teuthology.orchestra.run.smithi117.stdout: "num": 24315 2024-09-19T06:38:20.670 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-19T06:38:20.670 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": { 2024-09-19T06:38:20.670 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "v1", 2024-09-19T06:38:20.670 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": "192.168.0.1:0", 2024-09-19T06:38:20.671 INFO:teuthology.orchestra.run.smithi117.stdout: "nonce": 2424309154 2024-09-19T06:38:20.671 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-19T06:38:20.671 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-19T06:38:20.671 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": { 2024-09-19T06:38:20.671 INFO:teuthology.orchestra.run.smithi117.stdout: "type": "v1", 2024-09-19T06:38:20.671 INFO:teuthology.orchestra.run.smithi117.stdout: "addr": "192.168.0.1:0", 2024-09-19T06:38:20.671 INFO:teuthology.orchestra.run.smithi117.stdout: "nonce": 2424309154 2024-09-19T06:38:20.671 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-19T06:38:20.671 INFO:teuthology.orchestra.run.smithi117.stdout: "inst_str": "client.24315 192.168.0.1:0/2424309154", 2024-09-19T06:38:20.671 INFO:teuthology.orchestra.run.smithi117.stdout: "addr_str": "192.168.0.1:0/2424309154", 2024-09-19T06:38:20.671 INFO:teuthology.orchestra.run.smithi117.stdout: "inode_count": 1, 2024-09-19T06:38:20.672 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_epoch": 15, 2024-09-19T06:38:20.672 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_epoch": 45, 2024-09-19T06:38:20.672 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_epoch_barrier": 0, 2024-09-19T06:38:20.672 INFO:teuthology.orchestra.run.smithi117.stdout: "blocklisted": false, 2024-09-19T06:38:20.672 INFO:teuthology.orchestra.run.smithi117.stdout: "fs_name": "cephfs" 2024-09-19T06:38:20.672 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-09-19T06:38:20.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:38:20.677 DEBUG:teuthology.orchestra.run.smithi099:> stat --file-system '--printf=%T 2024-09-19T06:38:20.677 DEBUG:teuthology.orchestra.run.smithi099:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-19T06:38:20.697 INFO:teuthology.orchestra.run.smithi099.stdout:fuseblk 2024-09-19T06:38:20.698 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-19T06:38:20.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:38:20.698 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-19T06:38:20.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:38:20.772 DEBUG:teuthology.orchestra.run.smithi117:> stat --file-system '--printf=%T 2024-09-19T06:38:20.772 DEBUG:teuthology.orchestra.run.smithi117:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-19T06:38:20.788 INFO:teuthology.orchestra.run.smithi117.stdout:fuseblk 2024-09-19T06:38:20.788 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-19T06:38:20.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T06:38:20.788 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-19T06:38:21.621 INFO:teuthology.run_tasks:Running task print... 2024-09-19T06:38:21.634 INFO:teuthology.task.print:**** done client 2024-09-19T06:38:21.634 INFO:teuthology.run_tasks:Running task parallel... 2024-09-19T06:38:21.658 INFO:teuthology.task.parallel:starting parallel... 2024-09-19T06:38:21.658 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-19T06:38:21.659 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-19T06:38:21.660 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi099.front.sepia.ceph.com 2024-09-19T06:38:21.660 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -e sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-09-19T06:38:21.661 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-19T06:38:21.661 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-09-19T06:38:21.668 INFO:tasks.workunit:Pulling workunits from ref 6fad5dd73c93545e52f57f681e140a9c3529c11e 2024-09-19T06:38:21.669 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-19T06:38:21.669 INFO:tasks.workunit:timeout=3h 2024-09-19T06:38:21.669 INFO:tasks.workunit:cleanup=True 2024-09-19T06:38:21.669 DEBUG:teuthology.orchestra.run.smithi099:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-19T06:38:21.690 INFO:teuthology.orchestra.run.smithi099.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-19T06:38:21.690 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-19T06:38:21.690 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 7eh/126d Inode: 1 Links: 2 2024-09-19T06:38:21.690 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:38:21.690 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-19T06:38:21.690 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-19T06:38:21.690 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-09-19 06:37:44.862882503 +0000 2024-09-19T06:38:21.690 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-09-19 06:38:20.768077583 +0000 2024-09-19T06:38:21.690 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: - 2024-09-19T06:38:21.691 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-19T06:38:21.691 DEBUG:teuthology.orchestra.run.smithi099:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-19T06:38:21.761 DEBUG:teuthology.orchestra.run.smithi117:> stat -- /home/ubuntu/cephtest/mnt.1 2024-09-19T06:38:21.781 INFO:teuthology.orchestra.run.smithi117.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-09-19T06:38:21.781 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-19T06:38:21.781 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 75h/117d Inode: 1 Links: 3 2024-09-19T06:38:21.781 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T06:38:21.781 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-19T06:38:21.781 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-19T06:38:21.781 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-09-19 06:38:21.754783507 +0000 2024-09-19T06:38:21.781 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-09-19 06:38:21.754783507 +0000 2024-09-19T06:38:21.782 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: - 2024-09-19T06:38:21.782 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-09-19T06:38:21.782 DEBUG:teuthology.orchestra.run.smithi117:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-09-19T06:38:21.855 DEBUG:teuthology.orchestra.run.smithi099:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6fad5dd73c93545e52f57f681e140a9c3529c11e 2024-09-19T06:38:21.856 DEBUG:teuthology.orchestra.run.smithi117:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 6fad5dd73c93545e52f57f681e140a9c3529c11e 2024-09-19T06:38:21.873 INFO:tasks.workunit.client.0.smithi099.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-19T06:38:21.913 INFO:tasks.workunit.client.1.smithi117.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-09-19T06:38:21.930 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T06:38:21.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:38:21 smithi099 ceph-mon[27651]: pgmap v191: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-09-19T06:38:21.966 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:38:21 smithi117 ceph-mon[34564]: pgmap v191: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-09-19T06:38:23.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:23.511+0000 7f0bae7a7640 1 -- 172.21.15.99:0/492698891 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ba80fb430 msgr2=0x7f0ba80fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:23.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:23.511+0000 7f0bae7a7640 1 --2- 172.21.15.99:0/492698891 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ba80fb430 0x7f0ba80fb840 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0b980048d0 tx=0x7f0b98009da0 comp rx=0 tx=0).stop 2024-09-19T06:38:23.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:23.511+0000 7f0bae7a7640 1 -- 172.21.15.99:0/492698891 shutdown_connections 2024-09-19T06:38:23.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:23.511+0000 7f0bae7a7640 1 --2- 172.21.15.99:0/492698891 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ba80fc700 0x7f0ba80fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:23.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:23.511+0000 7f0bae7a7640 1 --2- 172.21.15.99:0/492698891 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ba80fb430 0x7f0ba80fb840 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:23.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:23.511+0000 7f0bae7a7640 1 -- 172.21.15.99:0/492698891 >> 172.21.15.99:0/492698891 conn(0x7f0ba80f6c10 msgr2=0x7f0ba80f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:23.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:23.511+0000 7f0bae7a7640 1 -- 172.21.15.99:0/492698891 shutdown_connections 2024-09-19T06:38:23.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:23.511+0000 7f0bae7a7640 1 -- 172.21.15.99:0/492698891 wait complete. 2024-09-19T06:38:23.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:23.511+0000 7f0bae7a7640 1 Processor -- start 2024-09-19T06:38:23.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:23.512+0000 7f0bae7a7640 1 -- start start 2024-09-19T06:38:23.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:23.512+0000 7f0bae7a7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ba80fb430 0x7f0ba810aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:23.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:23.512+0000 7f0bae7a7640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ba80fc700 0x7f0ba810b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:23.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:23.512+0000 7f0bae7a7640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba810c160 con 0x7f0ba80fc700 2024-09-19T06:38:23.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:23.512+0000 7f0bae7a7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba810c2d0 con 0x7f0ba80fb430 2024-09-19T06:38:23.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:23.512+0000 7f0ba77fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ba80fc700 0x7f0ba810b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:23.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:23.512+0000 7f0ba77fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ba80fc700 0x7f0ba810b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52878/0 (socket says 172.21.15.99:52878) 2024-09-19T06:38:23.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:23.512+0000 7f0ba77fe640 1 -- 172.21.15.99:0/3748558610 learned_addr learned my addr 172.21.15.99:0/3748558610 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:38:23.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:23.512+0000 7f0ba7fff640 1 --2- 172.21.15.99:0/3748558610 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ba80fb430 0x7f0ba810aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:23.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:23.512+0000 7f0ba77fe640 1 -- 172.21.15.99:0/3748558610 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ba80fb430 msgr2=0x7f0ba810aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:23.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:23.512+0000 7f0ba77fe640 1 --2- 172.21.15.99:0/3748558610 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ba80fb430 0x7f0ba810aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:23.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:23.512+0000 7f0ba77fe640 1 -- 172.21.15.99:0/3748558610 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b98005040 con 0x7f0ba80fc700 2024-09-19T06:38:23.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:23.512+0000 7f0ba77fe640 1 --2- 172.21.15.99:0/3748558610 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ba80fc700 0x7f0ba810b430 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c00c830 tx=0x7f0b9c004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:23.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:23.512+0000 7f0ba4ff9640 1 -- 172.21.15.99:0/3748558610 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b9c00a850 con 0x7f0ba80fc700 2024-09-19T06:38:23.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:23.512+0000 7f0ba4ff9640 1 -- 172.21.15.99:0/3748558610 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0b9c00ae50 con 0x7f0ba80fc700 2024-09-19T06:38:23.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:23.512+0000 7f0bae7a7640 1 -- 172.21.15.99:0/3748558610 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ba810c5b0 con 0x7f0ba80fc700 2024-09-19T06:38:23.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:23.512+0000 7f0ba4ff9640 1 -- 172.21.15.99:0/3748558610 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b9c0113a0 con 0x7f0ba80fc700 2024-09-19T06:38:23.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:23.512+0000 7f0bae7a7640 1 -- 172.21.15.99:0/3748558610 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ba810cb50 con 0x7f0ba80fc700 2024-09-19T06:38:23.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:23.513+0000 7f0bae7a7640 1 -- 172.21.15.99:0/3748558610 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ba80fa890 con 0x7f0ba80fc700 2024-09-19T06:38:23.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:23.514+0000 7f0ba4ff9640 1 -- 172.21.15.99:0/3748558610 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f0b9c012400 con 0x7f0ba80fc700 2024-09-19T06:38:23.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:23.514+0000 7f0ba4ff9640 1 --2- 172.21.15.99:0/3748558610 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f0b90070f50 0x7f0b90073400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:23.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:23.514+0000 7f0ba7fff640 1 --2- 172.21.15.99:0/3748558610 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f0b90070f50 0x7f0b90073400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:23.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:23.514+0000 7f0ba4ff9640 1 -- 172.21.15.99:0/3748558610 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f0b9c08e2e0 con 0x7f0ba80fc700 2024-09-19T06:38:23.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:23.515+0000 7f0ba7fff640 1 --2- 172.21.15.99:0/3748558610 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f0b90070f50 0x7f0b90073400 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0b98007ac0 tx=0x7f0b98035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:23.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:23.518+0000 7f0ba4ff9640 1 -- 172.21.15.99:0/3748558610 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f0b9c05b590 con 0x7f0ba80fc700 2024-09-19T06:38:23.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:23.674+0000 7f0bae7a7640 1 -- 172.21.15.99:0/3748558610 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f0ba804b720 con 0x7f0ba80fc700 2024-09-19T06:38:23.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:23.674+0000 7f0ba4ff9640 1 -- 172.21.15.99:0/3748558610 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v21)=0 v21) v1 ==== 155+0+0 (secure 0 0 0) 0x7f0b9c05af30 con 0x7f0ba80fc700 2024-09-19T06:38:23.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:23.676+0000 7f0bae7a7640 1 -- 172.21.15.99:0/3748558610 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f0b90070f50 msgr2=0x7f0b90073400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:23.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:23.676+0000 7f0bae7a7640 1 --2- 172.21.15.99:0/3748558610 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f0b90070f50 0x7f0b90073400 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0b98007ac0 tx=0x7f0b98035040 comp rx=0 tx=0).stop 2024-09-19T06:38:23.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:23.676+0000 7f0bae7a7640 1 -- 172.21.15.99:0/3748558610 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ba80fc700 msgr2=0x7f0ba810b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:23.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:23.676+0000 7f0bae7a7640 1 --2- 172.21.15.99:0/3748558610 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ba80fc700 0x7f0ba810b430 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c00c830 tx=0x7f0b9c004430 comp rx=0 tx=0).stop 2024-09-19T06:38:23.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:23.676+0000 7f0bae7a7640 1 -- 172.21.15.99:0/3748558610 shutdown_connections 2024-09-19T06:38:23.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:23.676+0000 7f0bae7a7640 1 --2- 172.21.15.99:0/3748558610 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f0b90070f50 0x7f0b90073400 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:23.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:23.676+0000 7f0bae7a7640 1 --2- 172.21.15.99:0/3748558610 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ba80fc700 0x7f0ba810b430 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:23.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:23.676+0000 7f0bae7a7640 1 --2- 172.21.15.99:0/3748558610 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ba80fb430 0x7f0ba810aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:23.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:23.676+0000 7f0bae7a7640 1 -- 172.21.15.99:0/3748558610 >> 172.21.15.99:0/3748558610 conn(0x7f0ba80f6c10 msgr2=0x7f0ba80f8400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:23.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:23.676+0000 7f0bae7a7640 1 -- 172.21.15.99:0/3748558610 shutdown_connections 2024-09-19T06:38:23.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:23.676+0000 7f0bae7a7640 1 -- 172.21.15.99:0/3748558610 wait complete. 2024-09-19T06:38:23.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:38:23 smithi099 ceph-mon[27651]: pgmap v192: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-19T06:38:24.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:38:23 smithi117 ceph-mon[34564]: pgmap v192: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-19T06:38:24.252 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -e sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-09-19T06:38:24.540 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T06:38:25.907 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:38:25 smithi099 ceph-mon[27651]: pgmap v193: 65 pgs: 65 active+clean; 582 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-09-19T06:38:26.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:38:25 smithi117 ceph-mon[34564]: pgmap v193: 65 pgs: 65 active+clean; 582 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-09-19T06:38:26.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:26.100+0000 7f6ecdba9640 1 -- 172.21.15.99:0/4164802590 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ec80fdb70 msgr2=0x7f6ec80fdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:26.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:26.100+0000 7f6ecdba9640 1 --2- 172.21.15.99:0/4164802590 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ec80fdb70 0x7f6ec80fdf80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6eb8009c50 tx=0x7f6eb8004d10 comp rx=0 tx=0).stop 2024-09-19T06:38:26.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:26.100+0000 7f6ecdba9640 1 -- 172.21.15.99:0/4164802590 shutdown_connections 2024-09-19T06:38:26.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:26.100+0000 7f6ecdba9640 1 --2- 172.21.15.99:0/4164802590 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ec80fe4c0 0x7f6ec80fa620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:26.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:26.100+0000 7f6ecdba9640 1 --2- 172.21.15.99:0/4164802590 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ec80fdb70 0x7f6ec80fdf80 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:26.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:26.100+0000 7f6ecdba9640 1 -- 172.21.15.99:0/4164802590 >> 172.21.15.99:0/4164802590 conn(0x7f6ec80f6390 msgr2=0x7f6ec80f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:26.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:26.100+0000 7f6ecdba9640 1 -- 172.21.15.99:0/4164802590 shutdown_connections 2024-09-19T06:38:26.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:26.100+0000 7f6ecdba9640 1 -- 172.21.15.99:0/4164802590 wait complete. 2024-09-19T06:38:26.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:26.100+0000 7f6ecdba9640 1 Processor -- start 2024-09-19T06:38:26.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:26.101+0000 7f6ecdba9640 1 -- start start 2024-09-19T06:38:26.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:26.101+0000 7f6ecdba9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ec80fdb70 0x7f6ec810d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:26.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:26.101+0000 7f6ecdba9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ec80fe4c0 0x7f6ec810d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:26.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:26.101+0000 7f6ecdba9640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec810dc20 con 0x7f6ec80fe4c0 2024-09-19T06:38:26.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:26.101+0000 7f6ecdba9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec810e440 con 0x7f6ec80fdb70 2024-09-19T06:38:26.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:26.101+0000 7f6ec6ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ec80fe4c0 0x7f6ec810d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:26.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:26.101+0000 7f6ec6ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ec80fe4c0 0x7f6ec810d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47098/0 (socket says 172.21.15.99:47098) 2024-09-19T06:38:26.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:26.101+0000 7f6ec6ffd640 1 -- 172.21.15.99:0/3974597736 learned_addr learned my addr 172.21.15.99:0/3974597736 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:38:26.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:26.101+0000 7f6ec77fe640 1 --2- 172.21.15.99:0/3974597736 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ec80fdb70 0x7f6ec810d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:26.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:26.101+0000 7f6ec6ffd640 1 -- 172.21.15.99:0/3974597736 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ec80fdb70 msgr2=0x7f6ec810d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:26.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:26.101+0000 7f6ec6ffd640 1 --2- 172.21.15.99:0/3974597736 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ec80fdb70 0x7f6ec810d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:26.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:26.101+0000 7f6ec6ffd640 1 -- 172.21.15.99:0/3974597736 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb80098b0 con 0x7f6ec80fe4c0 2024-09-19T06:38:26.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:26.101+0000 7f6ec77fe640 1 --2- 172.21.15.99:0/3974597736 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ec80fdb70 0x7f6ec810d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:38:26.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:26.101+0000 7f6ec6ffd640 1 --2- 172.21.15.99:0/3974597736 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ec80fe4c0 0x7f6ec810d5d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f6eb0002870 tx=0x7f6eb0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:26.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:26.102+0000 7f6ebffff640 1 -- 172.21.15.99:0/3974597736 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6eb0007c30 con 0x7f6ec80fe4c0 2024-09-19T06:38:26.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:26.102+0000 7f6ecdba9640 1 -- 172.21.15.99:0/3974597736 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ec810e6d0 con 0x7f6ec80fe4c0 2024-09-19T06:38:26.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:26.102+0000 7f6ebffff640 1 -- 172.21.15.99:0/3974597736 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6eb000f040 con 0x7f6ec80fe4c0 2024-09-19T06:38:26.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:26.102+0000 7f6ebffff640 1 -- 172.21.15.99:0/3974597736 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6eb00095b0 con 0x7f6ec80fe4c0 2024-09-19T06:38:26.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:26.102+0000 7f6ecdba9640 1 -- 172.21.15.99:0/3974597736 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ec810ec70 con 0x7f6ec80fe4c0 2024-09-19T06:38:26.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:26.103+0000 7f6ecdba9640 1 -- 172.21.15.99:0/3974597736 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ec80fa010 con 0x7f6ec80fe4c0 2024-09-19T06:38:26.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:26.103+0000 7f6ebffff640 1 -- 172.21.15.99:0/3974597736 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f6eb0009710 con 0x7f6ec80fe4c0 2024-09-19T06:38:26.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:26.104+0000 7f6ebffff640 1 --2- 172.21.15.99:0/3974597736 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f6eb406ed60 0x7f6eb4071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:26.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:26.104+0000 7f6ebffff640 1 -- 172.21.15.99:0/3974597736 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f6eb008d9c0 con 0x7f6ec80fe4c0 2024-09-19T06:38:26.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:26.104+0000 7f6ec77fe640 1 --2- 172.21.15.99:0/3974597736 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f6eb406ed60 0x7f6eb4071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:26.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:26.104+0000 7f6ec77fe640 1 --2- 172.21.15.99:0/3974597736 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f6eb406ed60 0x7f6eb4071210 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6eb8000f80 tx=0x7f6eb8004d10 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:26.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:26.108+0000 7f6ebffff640 1 -- 172.21.15.99:0/3974597736 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f6eb004d2a0 con 0x7f6ec80fe4c0 2024-09-19T06:38:26.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:26.266+0000 7f6ecdba9640 1 -- 172.21.15.99:0/3974597736 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f6ec804b720 con 0x7f6ec80fe4c0 2024-09-19T06:38:26.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:26.267+0000 7f6ebffff640 1 -- 172.21.15.99:0/3974597736 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v21)=0 v21) v1 ==== 163+0+0 (secure 0 0 0) 0x7f6eb005a610 con 0x7f6ec80fe4c0 2024-09-19T06:38:26.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:26.269+0000 7f6ecdba9640 1 -- 172.21.15.99:0/3974597736 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f6eb406ed60 msgr2=0x7f6eb4071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:26.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:26.269+0000 7f6ecdba9640 1 --2- 172.21.15.99:0/3974597736 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f6eb406ed60 0x7f6eb4071210 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6eb8000f80 tx=0x7f6eb8004d10 comp rx=0 tx=0).stop 2024-09-19T06:38:26.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:26.269+0000 7f6ecdba9640 1 -- 172.21.15.99:0/3974597736 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ec80fe4c0 msgr2=0x7f6ec810d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:26.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:26.269+0000 7f6ecdba9640 1 --2- 172.21.15.99:0/3974597736 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ec80fe4c0 0x7f6ec810d5d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f6eb0002870 tx=0x7f6eb0004600 comp rx=0 tx=0).stop 2024-09-19T06:38:26.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:26.269+0000 7f6ecdba9640 1 -- 172.21.15.99:0/3974597736 shutdown_connections 2024-09-19T06:38:26.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:26.269+0000 7f6ecdba9640 1 --2- 172.21.15.99:0/3974597736 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f6eb406ed60 0x7f6eb4071210 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:26.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:26.269+0000 7f6ecdba9640 1 --2- 172.21.15.99:0/3974597736 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6ec80fe4c0 0x7f6ec810d5d0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:26.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:26.269+0000 7f6ecdba9640 1 --2- 172.21.15.99:0/3974597736 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6ec80fdb70 0x7f6ec810d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:26.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:26.269+0000 7f6ecdba9640 1 -- 172.21.15.99:0/3974597736 >> 172.21.15.99:0/3974597736 conn(0x7f6ec80f6390 msgr2=0x7f6ec80f7b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:26.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:26.269+0000 7f6ecdba9640 1 -- 172.21.15.99:0/3974597736 shutdown_connections 2024-09-19T06:38:26.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:26.269+0000 7f6ecdba9640 1 -- 172.21.15.99:0/3974597736 wait complete. 2024-09-19T06:38:26.952 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -e sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 -- bash -c 'ceph config set global log_to_journald false --force' 2024-09-19T06:38:27.198 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T06:38:27.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:38:27 smithi099 ceph-mon[27651]: pgmap v194: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2024-09-19T06:38:28.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:38:27 smithi117 ceph-mon[34564]: pgmap v194: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2024-09-19T06:38:28.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:28.782+0000 7fcf15745640 1 -- 172.21.15.99:0/2044386803 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf100ff690 msgr2=0x7fcf10101a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:28.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:28.782+0000 7fcf15745640 1 --2- 172.21.15.99:0/2044386803 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf100ff690 0x7fcf10101a70 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fcf040048d0 tx=0x7fcf04009da0 comp rx=0 tx=0).stop 2024-09-19T06:38:28.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:28.782+0000 7fcf15745640 1 -- 172.21.15.99:0/2044386803 shutdown_connections 2024-09-19T06:38:28.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:28.782+0000 7fcf15745640 1 --2- 172.21.15.99:0/2044386803 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf100ff690 0x7fcf10101a70 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:28.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:28.782+0000 7fcf15745640 1 --2- 172.21.15.99:0/2044386803 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf10066770 0x7fcf100ff150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:28.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:28.782+0000 7fcf15745640 1 -- 172.21.15.99:0/2044386803 >> 172.21.15.99:0/2044386803 conn(0x7fcf100f6c00 msgr2=0x7fcf100f9030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:28.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:28.782+0000 7fcf15745640 1 -- 172.21.15.99:0/2044386803 shutdown_connections 2024-09-19T06:38:28.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:28.782+0000 7fcf15745640 1 -- 172.21.15.99:0/2044386803 wait complete. 2024-09-19T06:38:28.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:28.783+0000 7fcf15745640 1 Processor -- start 2024-09-19T06:38:28.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:28.783+0000 7fcf15745640 1 -- start start 2024-09-19T06:38:28.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:28.783+0000 7fcf15745640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf10066770 0x7fcf1010d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:28.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:28.783+0000 7fcf15745640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf100ff690 0x7fcf1010d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:28.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:28.783+0000 7fcf15745640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1010e4d0 con 0x7fcf100ff690 2024-09-19T06:38:28.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:28.783+0000 7fcf15745640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1010e640 con 0x7fcf10066770 2024-09-19T06:38:28.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:28.783+0000 7fcf0e7fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf100ff690 0x7fcf1010d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:28.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:28.783+0000 7fcf0e7fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf100ff690 0x7fcf1010d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47108/0 (socket says 172.21.15.99:47108) 2024-09-19T06:38:28.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:28.783+0000 7fcf0e7fc640 1 -- 172.21.15.99:0/2954437178 learned_addr learned my addr 172.21.15.99:0/2954437178 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:38:28.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:28.783+0000 7fcf0effd640 1 --2- 172.21.15.99:0/2954437178 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf10066770 0x7fcf1010d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:28.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:28.783+0000 7fcf0e7fc640 1 -- 172.21.15.99:0/2954437178 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf10066770 msgr2=0x7fcf1010d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:28.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:28.783+0000 7fcf0e7fc640 1 --2- 172.21.15.99:0/2954437178 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf10066770 0x7fcf1010d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:28.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:28.783+0000 7fcf0e7fc640 1 -- 172.21.15.99:0/2954437178 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf04005040 con 0x7fcf100ff690 2024-09-19T06:38:28.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:28.783+0000 7fcf0e7fc640 1 --2- 172.21.15.99:0/2954437178 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf100ff690 0x7fcf1010d660 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fcf04003080 tx=0x7fcf04009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:28.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:28.784+0000 7fcef77fe640 1 -- 172.21.15.99:0/2954437178 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf04038070 con 0x7fcf100ff690 2024-09-19T06:38:28.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:28.784+0000 7fcf15745640 1 -- 172.21.15.99:0/2954437178 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf1010e8c0 con 0x7fcf100ff690 2024-09-19T06:38:28.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:28.784+0000 7fcef77fe640 1 -- 172.21.15.99:0/2954437178 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fcf0402abd0 con 0x7fcf100ff690 2024-09-19T06:38:28.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:28.784+0000 7fcef77fe640 1 -- 172.21.15.99:0/2954437178 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf0403e670 con 0x7fcf100ff690 2024-09-19T06:38:28.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:28.784+0000 7fcf15745640 1 -- 172.21.15.99:0/2954437178 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf1010ede0 con 0x7fcf100ff690 2024-09-19T06:38:28.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:28.785+0000 7fcf15745640 1 -- 172.21.15.99:0/2954437178 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf100fa8a0 con 0x7fcf100ff690 2024-09-19T06:38:28.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:28.786+0000 7fcef77fe640 1 -- 172.21.15.99:0/2954437178 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fcf04030020 con 0x7fcf100ff690 2024-09-19T06:38:28.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:28.786+0000 7fcef77fe640 1 --2- 172.21.15.99:0/2954437178 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fcef806ed60 0x7fcef8071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:28.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:28.786+0000 7fcef77fe640 1 -- 172.21.15.99:0/2954437178 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fcf040ae6d0 con 0x7fcf100ff690 2024-09-19T06:38:28.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:28.786+0000 7fcf0effd640 1 --2- 172.21.15.99:0/2954437178 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fcef806ed60 0x7fcef8071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:28.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:28.787+0000 7fcf0effd640 1 --2- 172.21.15.99:0/2954437178 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fcef806ed60 0x7fcef8071210 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fcf00006fd0 tx=0x7fcf00008040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:28.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:28.790+0000 7fcef77fe640 1 -- 172.21.15.99:0/2954437178 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fcf0407b700 con 0x7fcf100ff690 2024-09-19T06:38:28.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:28.949+0000 7fcf15745640 1 -- 172.21.15.99:0/2954437178 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7fcf1004b720 con 0x7fcf100ff690 2024-09-19T06:38:28.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:28.950+0000 7fcef77fe640 1 -- 172.21.15.99:0/2954437178 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v21)=0 v21) v1 ==== 135+0+0 (secure 0 0 0) 0x7fcf0407b0a0 con 0x7fcf100ff690 2024-09-19T06:38:28.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:28.952+0000 7fcf15745640 1 -- 172.21.15.99:0/2954437178 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fcef806ed60 msgr2=0x7fcef8071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:28.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:28.952+0000 7fcf15745640 1 --2- 172.21.15.99:0/2954437178 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fcef806ed60 0x7fcef8071210 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fcf00006fd0 tx=0x7fcf00008040 comp rx=0 tx=0).stop 2024-09-19T06:38:28.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:28.952+0000 7fcf15745640 1 -- 172.21.15.99:0/2954437178 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf100ff690 msgr2=0x7fcf1010d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:28.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:28.952+0000 7fcf15745640 1 --2- 172.21.15.99:0/2954437178 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf100ff690 0x7fcf1010d660 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fcf04003080 tx=0x7fcf04009da0 comp rx=0 tx=0).stop 2024-09-19T06:38:28.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:28.952+0000 7fcf15745640 1 -- 172.21.15.99:0/2954437178 shutdown_connections 2024-09-19T06:38:28.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:28.952+0000 7fcf15745640 1 --2- 172.21.15.99:0/2954437178 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fcef806ed60 0x7fcef8071210 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:28.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:28.952+0000 7fcf15745640 1 --2- 172.21.15.99:0/2954437178 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf100ff690 0x7fcf1010d660 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:28.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:28.952+0000 7fcf15745640 1 --2- 172.21.15.99:0/2954437178 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf10066770 0x7fcf1010d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:28.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:28.952+0000 7fcf15745640 1 -- 172.21.15.99:0/2954437178 >> 172.21.15.99:0/2954437178 conn(0x7fcf100f6c00 msgr2=0x7fcf100f7020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:28.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:28.952+0000 7fcf15745640 1 -- 172.21.15.99:0/2954437178 shutdown_connections 2024-09-19T06:38:28.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:28.952+0000 7fcf15745640 1 -- 172.21.15.99:0/2954437178 wait complete. 2024-09-19T06:38:29.609 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -e sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr' 2024-09-19T06:38:29.872 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T06:38:29.887 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:38:29 smithi099 ceph-mon[27651]: pgmap v195: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-09-19T06:38:30.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:38:29 smithi117 ceph-mon[34564]: pgmap v195: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-09-19T06:38:31.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:31.474+0000 7fd5979c4640 1 -- 172.21.15.99:0/3826872462 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5900fd7f0 msgr2=0x7fd5900fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:31.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:31.474+0000 7fd5979c4640 1 --2- 172.21.15.99:0/3826872462 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5900fd7f0 0x7fd5900fdc60 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd5840048d0 tx=0x7fd584009da0 comp rx=0 tx=0).stop 2024-09-19T06:38:31.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:31.474+0000 7fd5979c4640 1 -- 172.21.15.99:0/3826872462 shutdown_connections 2024-09-19T06:38:31.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:31.474+0000 7fd5979c4640 1 --2- 172.21.15.99:0/3826872462 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5900fd7f0 0x7fd5900fdc60 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:31.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:31.474+0000 7fd5979c4640 1 --2- 172.21.15.99:0/3826872462 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5900fc520 0x7fd5900fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:31.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:31.474+0000 7fd5979c4640 1 -- 172.21.15.99:0/3826872462 >> 172.21.15.99:0/3826872462 conn(0x7fd5900f7ce0 msgr2=0x7fd5900fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:38:31.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:31.474+0000 7fd5979c4640 1 -- 172.21.15.99:0/3826872462 shutdown_connections 2024-09-19T06:38:31.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:31.474+0000 7fd5979c4640 1 -- 172.21.15.99:0/3826872462 wait complete. 2024-09-19T06:38:31.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:31.474+0000 7fd5979c4640 1 Processor -- start 2024-09-19T06:38:31.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:31.474+0000 7fd5979c4640 1 -- start start 2024-09-19T06:38:31.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:31.474+0000 7fd5979c4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5900fc520 0x7fd590071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:31.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:31.474+0000 7fd5979c4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5900fd7f0 0x7fd59006fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:31.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:31.474+0000 7fd5979c4640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd59006fff0 con 0x7fd5900fc520 2024-09-19T06:38:31.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:31.474+0000 7fd5979c4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd590070130 con 0x7fd5900fd7f0 2024-09-19T06:38:31.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:31.475+0000 7fd595760640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5900fc520 0x7fd590071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:31.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:31.475+0000 7fd595760640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5900fc520 0x7fd590071570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47120/0 (socket says 172.21.15.99:47120) 2024-09-19T06:38:31.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:31.475+0000 7fd595760640 1 -- 172.21.15.99:0/3444493920 learned_addr learned my addr 172.21.15.99:0/3444493920 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:38:31.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:31.475+0000 7fd594f5f640 1 --2- 172.21.15.99:0/3444493920 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5900fd7f0 0x7fd59006fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:31.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:31.475+0000 7fd595760640 1 -- 172.21.15.99:0/3444493920 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5900fd7f0 msgr2=0x7fd59006fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:38:31.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:31.475+0000 7fd595760640 1 --2- 172.21.15.99:0/3444493920 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5900fd7f0 0x7fd59006fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:38:31.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:31.475+0000 7fd595760640 1 -- 172.21.15.99:0/3444493920 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd584005040 con 0x7fd5900fc520 2024-09-19T06:38:31.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:31.475+0000 7fd595760640 1 --2- 172.21.15.99:0/3444493920 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5900fc520 0x7fd590071570 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd58000cb10 tx=0x7fd580007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:31.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:31.475+0000 7fd58dffb640 1 -- 172.21.15.99:0/3444493920 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd580004200 con 0x7fd5900fc520 2024-09-19T06:38:31.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:31.475+0000 7fd58dffb640 1 -- 172.21.15.99:0/3444493920 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd58000acc0 con 0x7fd5900fc520 2024-09-19T06:38:31.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:31.475+0000 7fd5979c4640 1 -- 172.21.15.99:0/3444493920 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd590070410 con 0x7fd5900fc520 2024-09-19T06:38:31.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:31.475+0000 7fd58dffb640 1 -- 172.21.15.99:0/3444493920 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd580003cd0 con 0x7fd5900fc520 2024-09-19T06:38:31.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:31.475+0000 7fd5979c4640 1 -- 172.21.15.99:0/3444493920 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5901150a0 con 0x7fd5900fc520 2024-09-19T06:38:31.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:31.476+0000 7fd5979c4640 1 -- 172.21.15.99:0/3444493920 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5900fb980 con 0x7fd5900fc520 2024-09-19T06:38:31.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:31.477+0000 7fd58dffb640 1 -- 172.21.15.99:0/3444493920 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fd58000a820 con 0x7fd5900fc520 2024-09-19T06:38:31.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:31.477+0000 7fd58dffb640 1 --2- 172.21.15.99:0/3444493920 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fd57806ed60 0x7fd578071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:38:31.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:31.477+0000 7fd594f5f640 1 --2- 172.21.15.99:0/3444493920 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fd57806ed60 0x7fd578071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:38:31.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:31.477+0000 7fd58dffb640 1 -- 172.21.15.99:0/3444493920 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fd58008e860 con 0x7fd5900fc520 2024-09-19T06:38:31.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:31.478+0000 7fd594f5f640 1 --2- 172.21.15.99:0/3444493920 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fd57806ed60 0x7fd578071210 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd584007ac0 tx=0x7fd584035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:38:31.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:31.481+0000 7fd58dffb640 1 -- 172.21.15.99:0/3444493920 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fd58005b9b0 con 0x7fd5900fc520 2024-09-19T06:38:31.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:38:31.653+0000 7fd5979c4640 1 -- 172.21.15.99:0/3444493920 --> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961", "daemon_types": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7fd590101b90 con 0x7fd57806ed60 2024-09-19T06:38:31.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:38:31 smithi099 ceph-mon[27651]: pgmap v196: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-09-19T06:38:31.966 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:38:31 smithi117 ceph-mon[34564]: pgmap v196: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-09-19T06:38:32.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:38:32 smithi099 ceph-mon[27651]: from='client.14536 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:38:33.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:38:32 smithi117 ceph-mon[34564]: from='client.14536 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:38:33.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:38:33 smithi099 ceph-mon[27651]: pgmap v197: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-09-19T06:38:34.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:38:33 smithi117 ceph-mon[34564]: pgmap v197: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-09-19T06:38:34.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:38:34 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:38:35.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:38:34 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:38:35.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:38:35 smithi099 ceph-mon[27651]: pgmap v198: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-09-19T06:38:36.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:38:35 smithi117 ceph-mon[34564]: pgmap v198: 65 pgs: 65 active+clean; 587 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-09-19T06:38:37.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:38:37 smithi099 ceph-mon[27651]: pgmap v199: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2024-09-19T06:38:38.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:38:37 smithi117 ceph-mon[34564]: pgmap v199: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2024-09-19T06:38:40.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:38:39 smithi117 ceph-mon[34564]: pgmap v200: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-09-19T06:38:40.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:38:39 smithi099 ceph-mon[27651]: pgmap v200: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-09-19T06:38:41.965 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:38:41 smithi117 ceph-mon[34564]: pgmap v201: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-09-19T06:38:42.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:38:41 smithi099 ceph-mon[27651]: pgmap v201: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-09-19T06:38:43.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:38:43 smithi099 ceph-mon[27651]: pgmap v202: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-19T06:38:44.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:38:43 smithi117 ceph-mon[34564]: pgmap v202: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-19T06:38:46.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:38:45 smithi117 ceph-mon[34564]: pgmap v203: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-19T06:38:46.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:38:45 smithi099 ceph-mon[27651]: pgmap v203: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-19T06:38:48.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:38:47 smithi117 ceph-mon[34564]: pgmap v204: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-19T06:38:48.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:38:47 smithi099 ceph-mon[27651]: pgmap v204: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-19T06:38:50.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:38:49 smithi117 ceph-mon[34564]: pgmap v205: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:38:50.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:38:49 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:38:50.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:38:49 smithi099 ceph-mon[27651]: pgmap v205: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:38:50.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:38:49 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:38:52.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:38:51 smithi117 ceph-mon[34564]: pgmap v206: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:38:52.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:38:51 smithi099 ceph-mon[27651]: pgmap v206: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:38:54.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:38:53 smithi117 ceph-mon[34564]: pgmap v207: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:38:54.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:38:53 smithi099 ceph-mon[27651]: pgmap v207: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:38:56.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:38:55 smithi117 ceph-mon[34564]: pgmap v208: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:38:56.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:38:55 smithi099 ceph-mon[27651]: pgmap v208: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:38:58.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:38:57 smithi117 ceph-mon[34564]: pgmap v209: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:38:58.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:38:57 smithi099 ceph-mon[27651]: pgmap v209: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:39:00.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:38:59 smithi117 ceph-mon[34564]: pgmap v210: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:39:00.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:38:59 smithi099 ceph-mon[27651]: pgmap v210: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:39:02.045 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:01 smithi099 ceph-mon[27651]: pgmap v211: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:39:02.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:01 smithi117 ceph-mon[34564]: pgmap v211: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:39:02.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:02.079+0000 7fd58dffb640 1 -- 172.21.15.99:0/3444493920 <== mgr.14206 v2:172.21.15.99:6800/886909451 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7fd590101b90 con 0x7fd57806ed60 2024-09-19T06:39:02.081 INFO:teuthology.orchestra.run.smithi099.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:39:02.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:02.082+0000 7fd5979c4640 1 -- 172.21.15.99:0/3444493920 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fd57806ed60 msgr2=0x7fd578071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:02.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:02.082+0000 7fd5979c4640 1 --2- 172.21.15.99:0/3444493920 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fd57806ed60 0x7fd578071210 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd584007ac0 tx=0x7fd584035040 comp rx=0 tx=0).stop 2024-09-19T06:39:02.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:02.083+0000 7fd5979c4640 1 -- 172.21.15.99:0/3444493920 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5900fc520 msgr2=0x7fd590071570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:02.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:02.083+0000 7fd5979c4640 1 --2- 172.21.15.99:0/3444493920 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5900fc520 0x7fd590071570 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd58000cb10 tx=0x7fd580007ee0 comp rx=0 tx=0).stop 2024-09-19T06:39:02.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:02.083+0000 7fd5979c4640 1 -- 172.21.15.99:0/3444493920 shutdown_connections 2024-09-19T06:39:02.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:02.083+0000 7fd5979c4640 1 --2- 172.21.15.99:0/3444493920 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fd57806ed60 0x7fd578071210 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:02.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:02.083+0000 7fd5979c4640 1 --2- 172.21.15.99:0/3444493920 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5900fd7f0 0x7fd59006fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:02.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:02.083+0000 7fd5979c4640 1 --2- 172.21.15.99:0/3444493920 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5900fc520 0x7fd590071570 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:02.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:02.083+0000 7fd5979c4640 1 -- 172.21.15.99:0/3444493920 >> 172.21.15.99:0/3444493920 conn(0x7fd5900f7ce0 msgr2=0x7fd5900f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:02.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:02.083+0000 7fd5979c4640 1 -- 172.21.15.99:0/3444493920 shutdown_connections 2024-09-19T06:39:02.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:02.083+0000 7fd5979c4640 1 -- 172.21.15.99:0/3444493920 wait complete. 2024-09-19T06:39:02.808 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -e sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-09-19T06:39:03.086 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:03 smithi099 ceph-mon[27651]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:39:03.086 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:03 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:39:03.086 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:03 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:39:03.188 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T06:39:03.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:03 smithi117 ceph-mon[34564]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:39:03.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:03 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:39:03.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:03 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:39:04.346 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:04 smithi099 ceph-mon[27651]: pgmap v212: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:39:04.346 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:04 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:39:04.346 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:04 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:39:04.346 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:04 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:39:04.346 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:04 smithi099 ceph-mon[27651]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:39:04.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:04 smithi117 ceph-mon[34564]: pgmap v212: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:39:04.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:04 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:39:04.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:04 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:39:04.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:04 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:39:04.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:04 smithi117 ceph-mon[34564]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:39:05.372 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:05 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:39:05.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.500+0000 7fbffc0a3640 1 -- 172.21.15.99:0/488453534 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbff40fc700 msgr2=0x7fbff40fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:05.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.500+0000 7fbffc0a3640 1 --2- 172.21.15.99:0/488453534 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbff40fc700 0x7fbff40fcb70 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fbfe40048d0 tx=0x7fbfe4009da0 comp rx=0 tx=0).stop 2024-09-19T06:39:05.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.501+0000 7fbffc0a3640 1 -- 172.21.15.99:0/488453534 shutdown_connections 2024-09-19T06:39:05.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.501+0000 7fbffc0a3640 1 --2- 172.21.15.99:0/488453534 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbff40fc700 0x7fbff40fcb70 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:05.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.501+0000 7fbffc0a3640 1 --2- 172.21.15.99:0/488453534 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbff40fb430 0x7fbff40fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:05.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.501+0000 7fbffc0a3640 1 -- 172.21.15.99:0/488453534 >> 172.21.15.99:0/488453534 conn(0x7fbff40f6c10 msgr2=0x7fbff40f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:05.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.501+0000 7fbffc0a3640 1 -- 172.21.15.99:0/488453534 shutdown_connections 2024-09-19T06:39:05.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.501+0000 7fbffc0a3640 1 -- 172.21.15.99:0/488453534 wait complete. 2024-09-19T06:39:05.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.502+0000 7fbffc0a3640 1 Processor -- start 2024-09-19T06:39:05.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.502+0000 7fbffc0a3640 1 -- start start 2024-09-19T06:39:05.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.502+0000 7fbffc0a3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbff40fb430 0x7fbff410aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:05.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.502+0000 7fbffc0a3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbff40fc700 0x7fbff410b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:05.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.502+0000 7fbffc0a3640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff410c140 con 0x7fbff40fc700 2024-09-19T06:39:05.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.502+0000 7fbffc0a3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff410c2b0 con 0x7fbff40fb430 2024-09-19T06:39:05.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.503+0000 7fbff9e3f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbff40fb430 0x7fbff410aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:05.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.503+0000 7fbff9e3f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbff40fb430 0x7fbff410aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.99:45036/0 (socket says 172.21.15.99:45036) 2024-09-19T06:39:05.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.503+0000 7fbff9e3f640 1 -- 172.21.15.99:0/2533530988 learned_addr learned my addr 172.21.15.99:0/2533530988 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:39:05.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.503+0000 7fbff9e3f640 1 -- 172.21.15.99:0/2533530988 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbff40fc700 msgr2=0x7fbff410b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:05.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.503+0000 7fbff9e3f640 1 --2- 172.21.15.99:0/2533530988 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbff40fc700 0x7fbff410b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:05.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.503+0000 7fbff9e3f640 1 -- 172.21.15.99:0/2533530988 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe4005040 con 0x7fbff40fb430 2024-09-19T06:39:05.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.504+0000 7fbff9e3f640 1 --2- 172.21.15.99:0/2533530988 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbff40fb430 0x7fbff410aed0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fbff000eb70 tx=0x7fbff000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:05.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.504+0000 7fbfea7fc640 1 -- 172.21.15.99:0/2533530988 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbff0007c30 con 0x7fbff40fb430 2024-09-19T06:39:05.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.504+0000 7fbffc0a3640 1 -- 172.21.15.99:0/2533530988 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbff410c530 con 0x7fbff40fb430 2024-09-19T06:39:05.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.504+0000 7fbfea7fc640 1 -- 172.21.15.99:0/2533530988 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fbff000f040 con 0x7fbff40fb430 2024-09-19T06:39:05.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.504+0000 7fbffc0a3640 1 -- 172.21.15.99:0/2533530988 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbff410cad0 con 0x7fbff40fb430 2024-09-19T06:39:05.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.505+0000 7fbfea7fc640 1 -- 172.21.15.99:0/2533530988 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbff0009550 con 0x7fbff40fb430 2024-09-19T06:39:05.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.506+0000 7fbffc0a3640 1 -- 172.21.15.99:0/2533530988 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbff40fa890 con 0x7fbff40fb430 2024-09-19T06:39:05.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.506+0000 7fbfea7fc640 1 -- 172.21.15.99:0/2533530988 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fbff0009840 con 0x7fbff40fb430 2024-09-19T06:39:05.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.506+0000 7fbfea7fc640 1 --2- 172.21.15.99:0/2533530988 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fbfe006ed50 0x7fbfe0071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:05.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.507+0000 7fbff963e640 1 --2- 172.21.15.99:0/2533530988 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fbfe006ed50 0x7fbfe0071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:05.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.507+0000 7fbfea7fc640 1 -- 172.21.15.99:0/2533530988 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fbff008de70 con 0x7fbff40fb430 2024-09-19T06:39:05.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.507+0000 7fbff963e640 1 --2- 172.21.15.99:0/2533530988 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fbfe006ed50 0x7fbfe0071200 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbfe402f040 tx=0x7fbfe4009da0 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:05.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.516+0000 7fbfea7fc640 1 -- 172.21.15.99:0/2533530988 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fbff004e2a0 con 0x7fbff40fb430 2024-09-19T06:39:05.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:05 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:39:05.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.697+0000 7fbffc0a3640 1 -- 172.21.15.99:0/2533530988 --> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbff410ce00 con 0x7fbfe006ed50 2024-09-19T06:39:05.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.699+0000 7fbfea7fc640 1 -- 172.21.15.99:0/2533530988 <== mgr.14206 v2:172.21.15.99:6800/886909451 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+351 (secure 0 0 0) 0x7fbff410ce00 con 0x7fbfe006ed50 2024-09-19T06:39:05.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.701+0000 7fbffc0a3640 1 -- 172.21.15.99:0/2533530988 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fbfe006ed50 msgr2=0x7fbfe0071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:05.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.701+0000 7fbffc0a3640 1 --2- 172.21.15.99:0/2533530988 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fbfe006ed50 0x7fbfe0071200 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbfe402f040 tx=0x7fbfe4009da0 comp rx=0 tx=0).stop 2024-09-19T06:39:05.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.701+0000 7fbffc0a3640 1 -- 172.21.15.99:0/2533530988 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbff40fb430 msgr2=0x7fbff410aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:05.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.701+0000 7fbffc0a3640 1 --2- 172.21.15.99:0/2533530988 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbff40fb430 0x7fbff410aed0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fbff000eb70 tx=0x7fbff000b040 comp rx=0 tx=0).stop 2024-09-19T06:39:05.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.702+0000 7fbffc0a3640 1 -- 172.21.15.99:0/2533530988 shutdown_connections 2024-09-19T06:39:05.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.702+0000 7fbffc0a3640 1 --2- 172.21.15.99:0/2533530988 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fbfe006ed50 0x7fbfe0071200 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:05.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.702+0000 7fbffc0a3640 1 --2- 172.21.15.99:0/2533530988 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbff40fc700 0x7fbff410b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:05.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.702+0000 7fbffc0a3640 1 --2- 172.21.15.99:0/2533530988 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbff40fb430 0x7fbff410aed0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:05.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.702+0000 7fbffc0a3640 1 -- 172.21.15.99:0/2533530988 >> 172.21.15.99:0/2533530988 conn(0x7fbff40f6c10 msgr2=0x7fbff40f83f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:05.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.702+0000 7fbffc0a3640 1 -- 172.21.15.99:0/2533530988 shutdown_connections 2024-09-19T06:39:05.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.702+0000 7fbffc0a3640 1 -- 172.21.15.99:0/2533530988 wait complete. 2024-09-19T06:39:05.716 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-09-19T06:39:05.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.823+0000 7f1592f07640 1 -- 172.21.15.99:0/1256802239 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f158c0fc6f0 msgr2=0x7f158c0fcb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:05.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.823+0000 7f1592f07640 1 --2- 172.21.15.99:0/1256802239 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f158c0fc6f0 0x7f158c0fcb60 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f15780048d0 tx=0x7f1578009da0 comp rx=0 tx=0).stop 2024-09-19T06:39:05.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.823+0000 7f1592f07640 1 -- 172.21.15.99:0/1256802239 shutdown_connections 2024-09-19T06:39:05.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.823+0000 7f1592f07640 1 --2- 172.21.15.99:0/1256802239 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f158c0fc6f0 0x7f158c0fcb60 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:05.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.823+0000 7f1592f07640 1 --2- 172.21.15.99:0/1256802239 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f158c0fb420 0x7f158c0fb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:05.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.823+0000 7f1592f07640 1 -- 172.21.15.99:0/1256802239 >> 172.21.15.99:0/1256802239 conn(0x7f158c0f6c00 msgr2=0x7f158c0f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:05.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.823+0000 7f1592f07640 1 -- 172.21.15.99:0/1256802239 shutdown_connections 2024-09-19T06:39:05.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.823+0000 7f1592f07640 1 -- 172.21.15.99:0/1256802239 wait complete. 2024-09-19T06:39:05.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.824+0000 7f1592f07640 1 Processor -- start 2024-09-19T06:39:05.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.824+0000 7f1592f07640 1 -- start start 2024-09-19T06:39:05.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.825+0000 7f1592f07640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f158c0fb420 0x7f158c10bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:05.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.825+0000 7f1592f07640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f158c0fc6f0 0x7f158c10c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:05.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.825+0000 7f1592f07640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f158c10c9a0 con 0x7f158c0fb420 2024-09-19T06:39:05.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.825+0000 7f1592f07640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f158c10d0e0 con 0x7f158c0fc6f0 2024-09-19T06:39:05.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.825+0000 7f1590ca3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f158c0fb420 0x7f158c10bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:05.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.825+0000 7f1590ca3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f158c0fb420 0x7f158c10bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:44172/0 (socket says 172.21.15.99:44172) 2024-09-19T06:39:05.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.825+0000 7f1590ca3640 1 -- 172.21.15.99:0/957341561 learned_addr learned my addr 172.21.15.99:0/957341561 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:39:05.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.825+0000 7f158bfff640 1 --2- 172.21.15.99:0/957341561 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f158c0fc6f0 0x7f158c10c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:05.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.826+0000 7f1590ca3640 1 -- 172.21.15.99:0/957341561 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f158c0fc6f0 msgr2=0x7f158c10c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:05.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.826+0000 7f1590ca3640 1 --2- 172.21.15.99:0/957341561 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f158c0fc6f0 0x7f158c10c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:05.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.826+0000 7f1590ca3640 1 -- 172.21.15.99:0/957341561 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1578005040 con 0x7f158c0fb420 2024-09-19T06:39:05.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.826+0000 7f1590ca3640 1 --2- 172.21.15.99:0/957341561 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f158c0fb420 0x7f158c10bde0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f158000eb70 tx=0x7f158000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:05.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.826+0000 7f15897fa640 1 -- 172.21.15.99:0/957341561 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1580007c30 con 0x7f158c0fb420 2024-09-19T06:39:05.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.826+0000 7f15897fa640 1 -- 172.21.15.99:0/957341561 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f158000f040 con 0x7f158c0fb420 2024-09-19T06:39:05.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.826+0000 7f15897fa640 1 -- 172.21.15.99:0/957341561 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f15800094e0 con 0x7f158c0fb420 2024-09-19T06:39:05.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.827+0000 7f1592f07640 1 -- 172.21.15.99:0/957341561 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f158c10d300 con 0x7f158c0fb420 2024-09-19T06:39:05.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.827+0000 7f1592f07640 1 -- 172.21.15.99:0/957341561 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f158c10d820 con 0x7f158c0fb420 2024-09-19T06:39:05.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.828+0000 7f1592f07640 1 -- 172.21.15.99:0/957341561 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f158c0fa880 con 0x7f158c0fb420 2024-09-19T06:39:05.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.830+0000 7f15897fa640 1 -- 172.21.15.99:0/957341561 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f1580009640 con 0x7f158c0fb420 2024-09-19T06:39:05.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.830+0000 7f15897fa640 1 --2- 172.21.15.99:0/957341561 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f157c06ed60 0x7f157c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:05.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.831+0000 7f15897fa640 1 -- 172.21.15.99:0/957341561 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f158008df60 con 0x7f158c0fb420 2024-09-19T06:39:05.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.831+0000 7f158bfff640 1 --2- 172.21.15.99:0/957341561 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f157c06ed60 0x7f157c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:05.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.831+0000 7f158bfff640 1 --2- 172.21.15.99:0/957341561 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f157c06ed60 0x7f157c071210 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f158c10bb90 tx=0x7f1578035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:05.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:05.834+0000 7f15897fa640 1 -- 172.21.15.99:0/957341561 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f158005b2c0 con 0x7f158c0fb420 2024-09-19T06:39:06.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.095+0000 7f1592f07640 1 -- 172.21.15.99:0/957341561 --> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f158c10dda0 con 0x7f157c06ed60 2024-09-19T06:39:06.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.097+0000 7f15897fa640 1 -- 172.21.15.99:0/957341561 <== mgr.14206 v2:172.21.15.99:6800/886909451 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+351 (secure 0 0 0) 0x7f158c10dda0 con 0x7f157c06ed60 2024-09-19T06:39:06.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.099+0000 7f1592f07640 1 -- 172.21.15.99:0/957341561 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f157c06ed60 msgr2=0x7f157c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:06.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.099+0000 7f1592f07640 1 --2- 172.21.15.99:0/957341561 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f157c06ed60 0x7f157c071210 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f158c10bb90 tx=0x7f1578035040 comp rx=0 tx=0).stop 2024-09-19T06:39:06.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.099+0000 7f1592f07640 1 -- 172.21.15.99:0/957341561 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f158c0fb420 msgr2=0x7f158c10bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:06.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.099+0000 7f1592f07640 1 --2- 172.21.15.99:0/957341561 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f158c0fb420 0x7f158c10bde0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f158000eb70 tx=0x7f158000b040 comp rx=0 tx=0).stop 2024-09-19T06:39:06.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.099+0000 7f1592f07640 1 -- 172.21.15.99:0/957341561 shutdown_connections 2024-09-19T06:39:06.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.100+0000 7f1592f07640 1 --2- 172.21.15.99:0/957341561 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f157c06ed60 0x7f157c071210 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:06.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.100+0000 7f1592f07640 1 --2- 172.21.15.99:0/957341561 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f158c0fc6f0 0x7f158c10c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:06.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.100+0000 7f1592f07640 1 --2- 172.21.15.99:0/957341561 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f158c0fb420 0x7f158c10bde0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:06.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.100+0000 7f1592f07640 1 -- 172.21.15.99:0/957341561 >> 172.21.15.99:0/957341561 conn(0x7f158c0f6c00 msgr2=0x7f158c0f8200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:06.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.100+0000 7f1592f07640 1 -- 172.21.15.99:0/957341561 shutdown_connections 2024-09-19T06:39:06.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.100+0000 7f1592f07640 1 -- 172.21.15.99:0/957341561 wait complete. 2024-09-19T06:39:06.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.190+0000 7f9e248f1640 1 -- 172.21.15.99:0/4249039095 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9e200fd4b0 msgr2=0x7f9e20103e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:06.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.191+0000 7f9e248f1640 1 --2- 172.21.15.99:0/4249039095 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9e200fd4b0 0x7f9e20103e20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9e14004900 tx=0x7f9e14009da0 comp rx=0 tx=0).stop 2024-09-19T06:39:06.195 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:06 smithi099 ceph-mon[27651]: pgmap v213: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:39:06.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.193+0000 7f9e248f1640 1 -- 172.21.15.99:0/4249039095 shutdown_connections 2024-09-19T06:39:06.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.193+0000 7f9e248f1640 1 --2- 172.21.15.99:0/4249039095 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9e200fd4b0 0x7f9e20103e20 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:06.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.193+0000 7f9e248f1640 1 --2- 172.21.15.99:0/4249039095 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e200fcb60 0x7f9e200fcf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:06.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.193+0000 7f9e248f1640 1 -- 172.21.15.99:0/4249039095 >> 172.21.15.99:0/4249039095 conn(0x7f9e200f6390 msgr2=0x7f9e200f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:06.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.193+0000 7f9e248f1640 1 -- 172.21.15.99:0/4249039095 shutdown_connections 2024-09-19T06:39:06.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.193+0000 7f9e248f1640 1 -- 172.21.15.99:0/4249039095 wait complete. 2024-09-19T06:39:06.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.194+0000 7f9e248f1640 1 Processor -- start 2024-09-19T06:39:06.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.194+0000 7f9e248f1640 1 -- start start 2024-09-19T06:39:06.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.194+0000 7f9e248f1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e200fcb60 0x7f9e2010f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:06.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.194+0000 7f9e248f1640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9e200fd4b0 0x7f9e2010f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:06.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.194+0000 7f9e248f1640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2010fed0 con 0x7f9e200fd4b0 2024-09-19T06:39:06.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.194+0000 7f9e248f1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e20110650 con 0x7f9e200fcb60 2024-09-19T06:39:06.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.195+0000 7f9e1dd9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9e200fd4b0 0x7f9e2010f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:06.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.195+0000 7f9e1dd9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9e200fd4b0 0x7f9e2010f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:44180/0 (socket says 172.21.15.99:44180) 2024-09-19T06:39:06.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.195+0000 7f9e1dd9b640 1 -- 172.21.15.99:0/3812165408 learned_addr learned my addr 172.21.15.99:0/3812165408 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:39:06.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.195+0000 7f9e1e59c640 1 --2- 172.21.15.99:0/3812165408 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e200fcb60 0x7f9e2010f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:06.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.195+0000 7f9e1dd9b640 1 -- 172.21.15.99:0/3812165408 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e200fcb60 msgr2=0x7f9e2010f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:06.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.195+0000 7f9e1dd9b640 1 --2- 172.21.15.99:0/3812165408 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e200fcb60 0x7f9e2010f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:06.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.195+0000 7f9e1dd9b640 1 -- 172.21.15.99:0/3812165408 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e14005040 con 0x7f9e200fd4b0 2024-09-19T06:39:06.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.196+0000 7f9e1dd9b640 1 --2- 172.21.15.99:0/3812165408 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9e200fd4b0 0x7f9e2010f880 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9e14009450 tx=0x7f9e14009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:06.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.196+0000 7f9e0effd640 1 -- 172.21.15.99:0/3812165408 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e14038070 con 0x7f9e200fd4b0 2024-09-19T06:39:06.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.196+0000 7f9e248f1640 1 -- 172.21.15.99:0/3812165408 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e20110880 con 0x7f9e200fd4b0 2024-09-19T06:39:06.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.196+0000 7f9e0effd640 1 -- 172.21.15.99:0/3812165408 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9e1402ae80 con 0x7f9e200fd4b0 2024-09-19T06:39:06.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.196+0000 7f9e248f1640 1 -- 172.21.15.99:0/3812165408 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e20110e20 con 0x7f9e200fd4b0 2024-09-19T06:39:06.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.196+0000 7f9e0effd640 1 -- 172.21.15.99:0/3812165408 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e1403e430 con 0x7f9e200fd4b0 2024-09-19T06:39:06.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.199+0000 7f9e0effd640 1 -- 172.21.15.99:0/3812165408 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f9e14030020 con 0x7f9e200fd4b0 2024-09-19T06:39:06.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.199+0000 7f9e0cff9640 1 -- 172.21.15.99:0/3812165408 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e04005210 con 0x7f9e200fd4b0 2024-09-19T06:39:06.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.199+0000 7f9e0effd640 1 --2- 172.21.15.99:0/3812165408 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f9e0806ee20 0x7f9e080712d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:06.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.199+0000 7f9e0effd640 1 -- 172.21.15.99:0/3812165408 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f9e140ae270 con 0x7f9e200fd4b0 2024-09-19T06:39:06.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.199+0000 7f9e1e59c640 1 --2- 172.21.15.99:0/3812165408 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f9e0806ee20 0x7f9e080712d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:06.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.200+0000 7f9e1e59c640 1 --2- 172.21.15.99:0/3812165408 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f9e0806ee20 0x7f9e080712d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9e10009af0 tx=0x7f9e1000b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:06.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.205+0000 7f9e0effd640 1 -- 172.21.15.99:0/3812165408 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f9e1407b560 con 0x7f9e200fd4b0 2024-09-19T06:39:06.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.536+0000 7f9e0cff9640 1 -- 172.21.15.99:0/3812165408 --> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9e04000bc0 con 0x7f9e0806ee20 2024-09-19T06:39:06.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.545+0000 7f9e0effd640 1 -- 172.21.15.99:0/3812165408 <== mgr.14206 v2:172.21.15.99:6800/886909451 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f9e04000bc0 con 0x7f9e0806ee20 2024-09-19T06:39:06.548 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T06:39:06.548 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.smithi099 smithi099 *:9093,9094 running (5m) 55s ago 6m 25.3M - 0.25.0 c8568f914cd2 586edf6f2401 2024-09-19T06:39:06.548 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi099 smithi099 running (6m) 55s ago 6m 6895k - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 216ce2ef7f1e 2024-09-19T06:39:06.548 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi117 smithi117 running (5m) 61s ago 5m 6899k - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 b4c328bdec52 2024-09-19T06:39:06.548 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.smithi099 smithi099 *:3000 running (5m) 55s ago 6m 86.9M - 9.4.7 954c08fa6188 94ad8b9b7c91 2024-09-19T06:39:06.548 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.obarqf smithi099 running (82s) 55s ago 81s 10.8M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 e36c9b74004b 2024-09-19T06:39:06.549 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.xehbxe smithi099 running (75s) 55s ago 74s 17.3M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 d09eb3d306ae 2024-09-19T06:39:06.549 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.bheqzh smithi117 running (72s) 61s ago 72s 12.5M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 21253e27fdd3 2024-09-19T06:39:06.549 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.nooexo smithi117 running (79s) 61s ago 79s 14.7M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 ad1faeb3343c 2024-09-19T06:39:06.549 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi099.pgvkqi smithi099 *:9283,8765,8443 running (7m) 55s ago 7m 448M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 8e7ecb77f4cd 2024-09-19T06:39:06.549 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi117.ssmkcf smithi117 *:8443,9283 running (5m) 61s ago 5m 402M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 785113b1da28 2024-09-19T06:39:06.549 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi099 smithi099 running (7m) 55s ago 7m 49.4M 2048M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 7375c241d067 2024-09-19T06:39:06.549 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi117 smithi117 running (5m) 61s ago 5m 36.1M 2048M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 bd4854d5213e 2024-09-19T06:39:06.549 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi099 smithi099 *:9100 running (6m) 55s ago 6m 14.6M - 1.5.0 0da6a335fe13 09c786facf49 2024-09-19T06:39:06.549 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi117 smithi117 *:9100 running (5m) 61s ago 5m 16.9M - 1.5.0 0da6a335fe13 04f52626cbca 2024-09-19T06:39:06.549 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (4m) 55s ago 4m 46.0M 4288M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 cf8d3dd4a987 2024-09-19T06:39:06.549 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (4m) 55s ago 4m 45.1M 4288M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 bc5b04b8bf9f 2024-09-19T06:39:06.549 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (3m) 55s ago 3m 43.3M 4288M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 cedc7e3698d8 2024-09-19T06:39:06.549 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi117 running (3m) 61s ago 3m 45.6M 5312M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 5984ed999c91 2024-09-19T06:39:06.550 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi117 running (3m) 61s ago 3m 41.5M 5312M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 6a2fc0c51c05 2024-09-19T06:39:06.550 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi117 running (2m) 61s ago 2m 42.4M 5312M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 39dcb7dbf0e3 2024-09-19T06:39:06.550 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.smithi099 smithi099 *:9095 running (5m) 55s ago 6m 54.2M - 2.43.0 a07b618ecd1d 82e83626cde9 2024-09-19T06:39:06.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.547+0000 7f9e0cff9640 1 -- 172.21.15.99:0/3812165408 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f9e0806ee20 msgr2=0x7f9e080712d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:06.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.547+0000 7f9e0cff9640 1 --2- 172.21.15.99:0/3812165408 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f9e0806ee20 0x7f9e080712d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9e10009af0 tx=0x7f9e1000b040 comp rx=0 tx=0).stop 2024-09-19T06:39:06.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.547+0000 7f9e0cff9640 1 -- 172.21.15.99:0/3812165408 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9e200fd4b0 msgr2=0x7f9e2010f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:06.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.547+0000 7f9e0cff9640 1 --2- 172.21.15.99:0/3812165408 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9e200fd4b0 0x7f9e2010f880 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9e14009450 tx=0x7f9e14009da0 comp rx=0 tx=0).stop 2024-09-19T06:39:06.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.547+0000 7f9e0cff9640 1 -- 172.21.15.99:0/3812165408 shutdown_connections 2024-09-19T06:39:06.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.547+0000 7f9e0cff9640 1 --2- 172.21.15.99:0/3812165408 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f9e0806ee20 0x7f9e080712d0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:06.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.547+0000 7f9e0cff9640 1 --2- 172.21.15.99:0/3812165408 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9e200fd4b0 0x7f9e2010f880 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:06.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.547+0000 7f9e0cff9640 1 --2- 172.21.15.99:0/3812165408 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e200fcb60 0x7f9e2010f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:06.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.547+0000 7f9e0cff9640 1 -- 172.21.15.99:0/3812165408 >> 172.21.15.99:0/3812165408 conn(0x7f9e200f6390 msgr2=0x7f9e200f6760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:06.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.548+0000 7f9e0cff9640 1 -- 172.21.15.99:0/3812165408 shutdown_connections 2024-09-19T06:39:06.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.549+0000 7f9e0cff9640 1 -- 172.21.15.99:0/3812165408 wait complete. 2024-09-19T06:39:06.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:06 smithi117 ceph-mon[34564]: pgmap v213: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:39:06.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.665+0000 7fa5c67fc640 1 -- 172.21.15.99:0/3401597321 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5bc032610 con 0x7fa5c80fc700 2024-09-19T06:39:06.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.665+0000 7fa5cdbda640 1 -- 172.21.15.99:0/3401597321 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5c80fc700 msgr2=0x7fa5c80fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:06.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.665+0000 7fa5cdbda640 1 --2- 172.21.15.99:0/3401597321 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5c80fc700 0x7fa5c80fcb70 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc0048d0 tx=0x7fa5bc009da0 comp rx=0 tx=0).stop 2024-09-19T06:39:06.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.666+0000 7fa5cdbda640 1 -- 172.21.15.99:0/3401597321 shutdown_connections 2024-09-19T06:39:06.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.666+0000 7fa5cdbda640 1 --2- 172.21.15.99:0/3401597321 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5c80fc700 0x7fa5c80fcb70 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:06.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.666+0000 7fa5cdbda640 1 --2- 172.21.15.99:0/3401597321 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5c80fb430 0x7fa5c80fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:06.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.666+0000 7fa5cdbda640 1 -- 172.21.15.99:0/3401597321 >> 172.21.15.99:0/3401597321 conn(0x7fa5c80f6c10 msgr2=0x7fa5c80f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:06.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.666+0000 7fa5cdbda640 1 -- 172.21.15.99:0/3401597321 shutdown_connections 2024-09-19T06:39:06.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.666+0000 7fa5cdbda640 1 -- 172.21.15.99:0/3401597321 wait complete. 2024-09-19T06:39:06.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.667+0000 7fa5cdbda640 1 Processor -- start 2024-09-19T06:39:06.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.667+0000 7fa5cdbda640 1 -- start start 2024-09-19T06:39:06.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.667+0000 7fa5cdbda640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5c80fb430 0x7fa5c810fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:06.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.667+0000 7fa5cdbda640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5c80fc700 0x7fa5c81120e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:06.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.667+0000 7fa5cdbda640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c8065c60 con 0x7fa5c80fb430 2024-09-19T06:39:06.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.667+0000 7fa5cdbda640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c8065dd0 con 0x7fa5c80fc700 2024-09-19T06:39:06.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.667+0000 7fa5c6ffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5c80fc700 0x7fa5c81120e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:06.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.667+0000 7fa5c6ffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5c80fc700 0x7fa5c81120e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.99:45068/0 (socket says 172.21.15.99:45068) 2024-09-19T06:39:06.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.667+0000 7fa5c6ffd640 1 -- 172.21.15.99:0/646827163 learned_addr learned my addr 172.21.15.99:0/646827163 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:39:06.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.668+0000 7fa5c77fe640 1 --2- 172.21.15.99:0/646827163 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5c80fb430 0x7fa5c810fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:06.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.668+0000 7fa5c6ffd640 1 -- 172.21.15.99:0/646827163 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5c80fb430 msgr2=0x7fa5c810fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:06.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.668+0000 7fa5c6ffd640 1 --2- 172.21.15.99:0/646827163 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5c80fb430 0x7fa5c810fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:06.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.668+0000 7fa5c6ffd640 1 -- 172.21.15.99:0/646827163 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5bc005040 con 0x7fa5c80fc700 2024-09-19T06:39:06.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.668+0000 7fa5c77fe640 1 --2- 172.21.15.99:0/646827163 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5c80fb430 0x7fa5c810fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:39:06.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.668+0000 7fa5c6ffd640 1 --2- 172.21.15.99:0/646827163 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5c80fc700 0x7fa5c81120e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc003080 tx=0x7fa5bc009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:06.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.668+0000 7fa5affff640 1 -- 172.21.15.99:0/646827163 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5bc038070 con 0x7fa5c80fc700 2024-09-19T06:39:06.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.668+0000 7fa5affff640 1 -- 172.21.15.99:0/646827163 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa5bc004290 con 0x7fa5c80fc700 2024-09-19T06:39:06.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.668+0000 7fa5cdbda640 1 -- 172.21.15.99:0/646827163 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5c8112620 con 0x7fa5c80fc700 2024-09-19T06:39:06.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.668+0000 7fa5affff640 1 -- 172.21.15.99:0/646827163 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5bc02c070 con 0x7fa5c80fc700 2024-09-19T06:39:06.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.668+0000 7fa5cdbda640 1 -- 172.21.15.99:0/646827163 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5c81129f0 con 0x7fa5c80fc700 2024-09-19T06:39:06.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.670+0000 7fa5cdbda640 1 -- 172.21.15.99:0/646827163 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5c80fa890 con 0x7fa5c80fc700 2024-09-19T06:39:06.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.671+0000 7fa5affff640 1 -- 172.21.15.99:0/646827163 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fa5bc030020 con 0x7fa5c80fc700 2024-09-19T06:39:06.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.671+0000 7fa5affff640 1 --2- 172.21.15.99:0/646827163 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fa5b006ed60 0x7fa5b0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:06.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.671+0000 7fa5affff640 1 -- 172.21.15.99:0/646827163 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fa5bc0ae1b0 con 0x7fa5c80fc700 2024-09-19T06:39:06.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.671+0000 7fa5c77fe640 1 --2- 172.21.15.99:0/646827163 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fa5b006ed60 0x7fa5b0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:06.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.672+0000 7fa5c77fe640 1 --2- 172.21.15.99:0/646827163 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fa5b006ed60 0x7fa5b0071210 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa5c8065950 tx=0x7fa5b800b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:06.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:06.679+0000 7fa5affff640 1 -- 172.21.15.99:0/646827163 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fa5bc07b300 con 0x7fa5c80fc700 2024-09-19T06:39:07.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:07.129+0000 7fa5cdbda640 1 -- 172.21.15.99:0/646827163 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa5c8103e30 con 0x7fa5c80fc700 2024-09-19T06:39:07.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:07.130+0000 7fa5affff640 1 -- 172.21.15.99:0/646827163 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+643 (secure 0 0 0) 0x7fa5bc07aca0 con 0x7fa5c80fc700 2024-09-19T06:39:07.131 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:39:07.131 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-09-19T06:39:07.131 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 2 2024-09-19T06:39:07.132 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:39:07.132 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-09-19T06:39:07.132 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 2 2024-09-19T06:39:07.132 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:39:07.132 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-09-19T06:39:07.132 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 6 2024-09-19T06:39:07.132 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:39:07.132 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": { 2024-09-19T06:39:07.133 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 4 2024-09-19T06:39:07.133 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:39:07.133 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-09-19T06:39:07.133 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 14 2024-09-19T06:39:07.133 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T06:39:07.133 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:39:07.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:07.132+0000 7fa5cdbda640 1 -- 172.21.15.99:0/646827163 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fa5b006ed60 msgr2=0x7fa5b0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:07.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:07.132+0000 7fa5cdbda640 1 --2- 172.21.15.99:0/646827163 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fa5b006ed60 0x7fa5b0071210 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa5c8065950 tx=0x7fa5b800b040 comp rx=0 tx=0).stop 2024-09-19T06:39:07.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:07.132+0000 7fa5cdbda640 1 -- 172.21.15.99:0/646827163 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5c80fc700 msgr2=0x7fa5c81120e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:07.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:07.132+0000 7fa5cdbda640 1 --2- 172.21.15.99:0/646827163 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5c80fc700 0x7fa5c81120e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc003080 tx=0x7fa5bc009da0 comp rx=0 tx=0).stop 2024-09-19T06:39:07.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:07.132+0000 7fa5cdbda640 1 -- 172.21.15.99:0/646827163 shutdown_connections 2024-09-19T06:39:07.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:07.132+0000 7fa5cdbda640 1 --2- 172.21.15.99:0/646827163 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7fa5b006ed60 0x7fa5b0071210 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:07.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:07.132+0000 7fa5cdbda640 1 --2- 172.21.15.99:0/646827163 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5c80fc700 0x7fa5c81120e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:07.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:07.132+0000 7fa5cdbda640 1 --2- 172.21.15.99:0/646827163 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5c80fb430 0x7fa5c810fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:07.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:07.132+0000 7fa5cdbda640 1 -- 172.21.15.99:0/646827163 >> 172.21.15.99:0/646827163 conn(0x7fa5c80f6c10 msgr2=0x7fa5c80f8180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:07.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:07.132+0000 7fa5cdbda640 1 -- 172.21.15.99:0/646827163 shutdown_connections 2024-09-19T06:39:07.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:07.132+0000 7fa5cdbda640 1 -- 172.21.15.99:0/646827163 wait complete. 2024-09-19T06:39:07.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:07.214+0000 7f32d37f4640 1 -- 172.21.15.99:0/1466501175 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32cc0fb430 msgr2=0x7f32cc0fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:07.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:07.214+0000 7f32d37f4640 1 --2- 172.21.15.99:0/1466501175 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32cc0fb430 0x7f32cc0fb840 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f32c80048d0 tx=0x7f32c8009da0 comp rx=0 tx=0).stop 2024-09-19T06:39:07.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:07.214+0000 7f32d37f4640 1 -- 172.21.15.99:0/1466501175 shutdown_connections 2024-09-19T06:39:07.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:07.214+0000 7f32d37f4640 1 --2- 172.21.15.99:0/1466501175 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32cc0fc700 0x7f32cc0fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:07.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:07.214+0000 7f32d37f4640 1 --2- 172.21.15.99:0/1466501175 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32cc0fb430 0x7f32cc0fb840 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:07.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:07.214+0000 7f32d37f4640 1 -- 172.21.15.99:0/1466501175 >> 172.21.15.99:0/1466501175 conn(0x7f32cc0f6c10 msgr2=0x7f32cc0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:07.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:07.214+0000 7f32d37f4640 1 -- 172.21.15.99:0/1466501175 shutdown_connections 2024-09-19T06:39:07.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:07.214+0000 7f32d37f4640 1 -- 172.21.15.99:0/1466501175 wait complete. 2024-09-19T06:39:07.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:07.215+0000 7f32d37f4640 1 Processor -- start 2024-09-19T06:39:07.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:07.215+0000 7f32d37f4640 1 -- start start 2024-09-19T06:39:07.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:07.215+0000 7f32d37f4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32cc0fb430 0x7f32cc10bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:07.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:07.215+0000 7f32d37f4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32cc0fc700 0x7f32cc10c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:07.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:07.215+0000 7f32d37f4640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32cc10cb10 con 0x7f32cc0fb430 2024-09-19T06:39:07.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:07.215+0000 7f32d37f4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32cc10d330 con 0x7f32cc0fc700 2024-09-19T06:39:07.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:07.215+0000 7f32d1590640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32cc0fb430 0x7f32cc10bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:07.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:07.215+0000 7f32d1590640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32cc0fb430 0x7f32cc10bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:44234/0 (socket says 172.21.15.99:44234) 2024-09-19T06:39:07.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:07.215+0000 7f32d1590640 1 -- 172.21.15.99:0/3368228984 learned_addr learned my addr 172.21.15.99:0/3368228984 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:39:07.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:07.215+0000 7f32d0d8f640 1 --2- 172.21.15.99:0/3368228984 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32cc0fc700 0x7f32cc10c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:07.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:07.215+0000 7f32d1590640 1 -- 172.21.15.99:0/3368228984 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32cc0fc700 msgr2=0x7f32cc10c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:07.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:07.216+0000 7f32d1590640 1 --2- 172.21.15.99:0/3368228984 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32cc0fc700 0x7f32cc10c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:07.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:07.216+0000 7f32d1590640 1 -- 172.21.15.99:0/3368228984 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32c8005040 con 0x7f32cc0fb430 2024-09-19T06:39:07.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:07.216+0000 7f32d1590640 1 --2- 172.21.15.99:0/3368228984 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32cc0fb430 0x7f32cc10bf80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f32c80048a0 tx=0x7f32c8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:07.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:07.216+0000 7f32c1ffb640 1 -- 172.21.15.99:0/3368228984 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32c8038070 con 0x7f32cc0fb430 2024-09-19T06:39:07.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:07.216+0000 7f32c1ffb640 1 -- 172.21.15.99:0/3368228984 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f32c8004290 con 0x7f32cc0fb430 2024-09-19T06:39:07.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:07.216+0000 7f32d37f4640 1 -- 172.21.15.99:0/3368228984 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32cc10d560 con 0x7f32cc0fb430 2024-09-19T06:39:07.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:07.216+0000 7f32c1ffb640 1 -- 172.21.15.99:0/3368228984 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32c8033660 con 0x7f32cc0fb430 2024-09-19T06:39:07.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:07.217+0000 7f32d37f4640 1 -- 172.21.15.99:0/3368228984 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32cc10db00 con 0x7f32cc0fb430 2024-09-19T06:39:07.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:07.218+0000 7f32d37f4640 1 -- 172.21.15.99:0/3368228984 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32cc0fa890 con 0x7f32cc0fb430 2024-09-19T06:39:07.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:07.219+0000 7f32c1ffb640 1 -- 172.21.15.99:0/3368228984 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f32c8030020 con 0x7f32cc0fb430 2024-09-19T06:39:07.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:07.220+0000 7f32c1ffb640 1 --2- 172.21.15.99:0/3368228984 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f32b806ed60 0x7f32b8071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:07.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:07.220+0000 7f32d0d8f640 1 --2- 172.21.15.99:0/3368228984 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f32b806ed60 0x7f32b8071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:07.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:07.220+0000 7f32c1ffb640 1 -- 172.21.15.99:0/3368228984 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f32c80adbc0 con 0x7f32cc0fb430 2024-09-19T06:39:07.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:07.220+0000 7f32d0d8f640 1 --2- 172.21.15.99:0/3368228984 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f32b806ed60 0x7f32b8071210 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f32cc10bd30 tx=0x7f32bc00b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:07.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:07.229+0000 7f32c1ffb640 1 -- 172.21.15.99:0/3368228984 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f32c807adc0 con 0x7f32cc0fb430 2024-09-19T06:39:07.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:07.403+0000 7f32d37f4640 1 -- 172.21.15.99:0/3368228984 --> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f32cc10df10 con 0x7f32b806ed60 2024-09-19T06:39:07.405 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:07 smithi099 ceph-mon[27651]: from='client.24329 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:39:07.405 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:07 smithi099 ceph-mon[27651]: from='client.14542 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:39:07.405 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:07 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:39:07.405 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:07 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:39:07.405 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:07 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:39:07.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:07.405+0000 7f32c1ffb640 1 -- 172.21.15.99:0/3368228984 <== mgr.14206 v2:172.21.15.99:6800/886909451 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f32cc10df10 con 0x7f32b806ed60 2024-09-19T06:39:07.407 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:39:07.407 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T06:39:07.407 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": true, 2024-09-19T06:39:07.407 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-19T06:39:07.407 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [], 2024-09-19T06:39:07.407 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": "0/2 daemons upgraded", 2024-09-19T06:39:07.407 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e image on host smithi117", 2024-09-19T06:39:07.407 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-09-19T06:39:07.407 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:39:07.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:07.408+0000 7f32d37f4640 1 -- 172.21.15.99:0/3368228984 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f32b806ed60 msgr2=0x7f32b8071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:07.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:07.408+0000 7f32d37f4640 1 --2- 172.21.15.99:0/3368228984 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f32b806ed60 0x7f32b8071210 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f32cc10bd30 tx=0x7f32bc00b040 comp rx=0 tx=0).stop 2024-09-19T06:39:07.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:07.408+0000 7f32d37f4640 1 -- 172.21.15.99:0/3368228984 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32cc0fb430 msgr2=0x7f32cc10bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:07.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:07.408+0000 7f32d37f4640 1 --2- 172.21.15.99:0/3368228984 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32cc0fb430 0x7f32cc10bf80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f32c80048a0 tx=0x7f32c8009da0 comp rx=0 tx=0).stop 2024-09-19T06:39:07.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:07.408+0000 7f32d37f4640 1 -- 172.21.15.99:0/3368228984 shutdown_connections 2024-09-19T06:39:07.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:07.408+0000 7f32d37f4640 1 --2- 172.21.15.99:0/3368228984 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f32b806ed60 0x7f32b8071210 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:07.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:07.408+0000 7f32d37f4640 1 --2- 172.21.15.99:0/3368228984 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32cc0fc700 0x7f32cc10c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:07.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:07.408+0000 7f32d37f4640 1 --2- 172.21.15.99:0/3368228984 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32cc0fb430 0x7f32cc10bf80 secure :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f32c80048a0 tx=0x7f32c8009da0 comp rx=0 tx=0).stop 2024-09-19T06:39:07.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:07.408+0000 7f32d37f4640 1 -- 172.21.15.99:0/3368228984 >> 172.21.15.99:0/3368228984 conn(0x7f32cc0f6c10 msgr2=0x7f32cc0f83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:07.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:07.409+0000 7f32d37f4640 1 -- 172.21.15.99:0/3368228984 shutdown_connections 2024-09-19T06:39:07.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:07.409+0000 7f32d37f4640 1 -- 172.21.15.99:0/3368228984 wait complete. 2024-09-19T06:39:07.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:07 smithi117 ceph-mon[34564]: from='client.24329 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:39:07.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:07 smithi117 ceph-mon[34564]: from='client.14542 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:39:07.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:07 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:39:07.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:07 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:39:07.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:07 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:39:08.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:08 smithi099 ceph-mon[27651]: from='client.14546 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:39:08.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:08 smithi099 ceph-mon[27651]: pgmap v214: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:39:08.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:08 smithi099 ceph-mon[27651]: Upgrade: Target is version 19.1.1-361-g2f599a46 (unknown) 2024-09-19T06:39:08.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:08 smithi099 ceph-mon[27651]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, digests ['quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e'] 2024-09-19T06:39:08.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:08 smithi099 ceph-mon[27651]: Upgrade: Need to upgrade myself (mgr.smithi099.pgvkqi) 2024-09-19T06:39:08.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:08 smithi099 ceph-mon[27651]: from='client.? 172.21.15.99:0/646827163' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:39:08.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:08 smithi099 ceph-mon[27651]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e on smithi117 2024-09-19T06:39:08.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:08 smithi117 ceph-mon[34564]: from='client.14546 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:39:08.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:08 smithi117 ceph-mon[34564]: pgmap v214: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:39:08.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:08 smithi117 ceph-mon[34564]: Upgrade: Target is version 19.1.1-361-g2f599a46 (unknown) 2024-09-19T06:39:08.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:08 smithi117 ceph-mon[34564]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, digests ['quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e'] 2024-09-19T06:39:08.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:08 smithi117 ceph-mon[34564]: Upgrade: Need to upgrade myself (mgr.smithi099.pgvkqi) 2024-09-19T06:39:08.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:08 smithi117 ceph-mon[34564]: from='client.? 172.21.15.99:0/646827163' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:39:08.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:08 smithi117 ceph-mon[34564]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e on smithi117 2024-09-19T06:39:09.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:09 smithi099 ceph-mon[27651]: from='client.14552 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:39:09.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:09 smithi117 ceph-mon[34564]: from='client.14552 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:39:10.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:10 smithi099 ceph-mon[27651]: pgmap v215: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:39:10.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:10 smithi117 ceph-mon[34564]: pgmap v215: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:39:12.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:12 smithi117 ceph-mon[34564]: pgmap v216: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:39:12.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:12 smithi099 ceph-mon[27651]: pgmap v216: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:39:14.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:14 smithi099 ceph-mon[27651]: pgmap v217: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:39:14.565 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:14 smithi117 ceph-mon[34564]: pgmap v217: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:39:16.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:16 smithi099 ceph-mon[27651]: pgmap v218: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:39:16.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:16 smithi117 ceph-mon[34564]: pgmap v218: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:39:18.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:18 smithi099 ceph-mon[27651]: pgmap v219: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:39:18.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:18 smithi117 ceph-mon[34564]: pgmap v219: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:39:20.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:20 smithi099 ceph-mon[27651]: pgmap v220: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:39:20.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:20 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:39:20.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:20 smithi117 ceph-mon[34564]: pgmap v220: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:39:20.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:20 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:39:22.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:22 smithi117 ceph-mon[34564]: pgmap v221: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:39:22.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:22 smithi099 ceph-mon[27651]: pgmap v221: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:39:22.552 INFO:tasks.workunit.client.1.smithi117.stderr:Updating files: 88% (11376/12896) Updating files: 89% (11478/12896) Updating files: 90% (11607/12896) Updating files: 91% (11736/12896) Updating files: 92% (11865/12896) Updating files: 93% (11994/12896) Updating files: 94% (12123/12896) Updating files: 95% (12252/12896) Updating files: 96% (12381/12896) Updating files: 97% (12510/12896) Updating files: 98% (12639/12896) Updating files: 99% (12768/12896) Updating files: 100% (12896/12896) Updating files: 100% (12896/12896), done. 2024-09-19T06:39:23.354 INFO:tasks.workunit.client.1.smithi117.stderr:Note: switching to '6fad5dd73c93545e52f57f681e140a9c3529c11e'. 2024-09-19T06:39:23.354 INFO:tasks.workunit.client.1.smithi117.stderr: 2024-09-19T06:39:23.354 INFO:tasks.workunit.client.1.smithi117.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-19T06:39:23.354 INFO:tasks.workunit.client.1.smithi117.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-19T06:39:23.354 INFO:tasks.workunit.client.1.smithi117.stderr:state without impacting any branches by switching back to a branch. 2024-09-19T06:39:23.355 INFO:tasks.workunit.client.1.smithi117.stderr: 2024-09-19T06:39:23.355 INFO:tasks.workunit.client.1.smithi117.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-19T06:39:23.355 INFO:tasks.workunit.client.1.smithi117.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-19T06:39:23.355 INFO:tasks.workunit.client.1.smithi117.stderr: 2024-09-19T06:39:23.355 INFO:tasks.workunit.client.1.smithi117.stderr: git switch -c 2024-09-19T06:39:23.355 INFO:tasks.workunit.client.1.smithi117.stderr: 2024-09-19T06:39:23.355 INFO:tasks.workunit.client.1.smithi117.stderr:Or undo this operation with: 2024-09-19T06:39:23.356 INFO:tasks.workunit.client.1.smithi117.stderr: 2024-09-19T06:39:23.356 INFO:tasks.workunit.client.1.smithi117.stderr: git switch - 2024-09-19T06:39:23.356 INFO:tasks.workunit.client.1.smithi117.stderr: 2024-09-19T06:39:23.356 INFO:tasks.workunit.client.1.smithi117.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-19T06:39:23.356 INFO:tasks.workunit.client.1.smithi117.stderr: 2024-09-19T06:39:23.356 INFO:tasks.workunit.client.1.smithi117.stderr:HEAD is now at 6fad5dd73c9 Merge pull request #59812 from neha-ojha/wip-rtd-squid 2024-09-19T06:39:23.359 DEBUG:teuthology.orchestra.run.smithi117:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-09-19T06:39:23.425 INFO:tasks.workunit.client.1.smithi117.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-19T06:39:23.428 INFO:tasks.workunit.client.1.smithi117.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-19T06:39:23.428 INFO:tasks.workunit.client.1.smithi117.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-19T06:39:24.084 INFO:tasks.workunit.client.1.smithi117.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-19T06:39:24.182 INFO:tasks.workunit.client.1.smithi117.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-19T06:39:24.182 INFO:tasks.workunit.client.0.smithi099.stderr:Note: switching to '6fad5dd73c93545e52f57f681e140a9c3529c11e'. 2024-09-19T06:39:24.183 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-19T06:39:24.183 INFO:tasks.workunit.client.0.smithi099.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-19T06:39:24.183 INFO:tasks.workunit.client.0.smithi099.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-19T06:39:24.183 INFO:tasks.workunit.client.0.smithi099.stderr:state without impacting any branches by switching back to a branch. 2024-09-19T06:39:24.183 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-19T06:39:24.183 INFO:tasks.workunit.client.0.smithi099.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-19T06:39:24.183 INFO:tasks.workunit.client.0.smithi099.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-19T06:39:24.183 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-19T06:39:24.183 INFO:tasks.workunit.client.0.smithi099.stderr: git switch -c 2024-09-19T06:39:24.183 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-19T06:39:24.183 INFO:tasks.workunit.client.0.smithi099.stderr:Or undo this operation with: 2024-09-19T06:39:24.183 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-19T06:39:24.183 INFO:tasks.workunit.client.0.smithi099.stderr: git switch - 2024-09-19T06:39:24.184 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-19T06:39:24.184 INFO:tasks.workunit.client.0.smithi099.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-19T06:39:24.184 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-19T06:39:24.184 INFO:tasks.workunit.client.0.smithi099.stderr:HEAD is now at 6fad5dd73c9 Merge pull request #59812 from neha-ojha/wip-rtd-squid 2024-09-19T06:39:24.184 DEBUG:teuthology.orchestra.run.smithi099:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-19T06:39:24.203 INFO:tasks.workunit.client.1.smithi117.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-19T06:39:24.204 INFO:tasks.workunit.client.1.smithi117.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-19T06:39:24.204 INFO:tasks.workunit.client.1.smithi117.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-19T06:39:24.222 INFO:tasks.workunit.client.0.smithi099.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-19T06:39:24.224 INFO:tasks.workunit.client.0.smithi099.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T06:39:24.224 INFO:tasks.workunit.client.0.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-19T06:39:24.245 INFO:tasks.workunit.client.1.smithi117.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-19T06:39:24.249 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-19T06:39:24.249 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-09-19T06:39:24.315 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-09-19T06:39:24.318 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-19T06:39:24.318 DEBUG:teuthology.orchestra.run.smithi117:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6fad5dd73c93545e52f57f681e140a9c3529c11e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-09-19T06:39:24.389 INFO:tasks.workunit.client.1.smithi117.stderr:+ mkdir -p fsstress 2024-09-19T06:39:24.392 INFO:tasks.workunit.client.1.smithi117.stderr:+ pushd fsstress 2024-09-19T06:39:24.393 INFO:tasks.workunit.client.1.smithi117.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-19T06:39:24.394 INFO:tasks.workunit.client.1.smithi117.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-19T06:39:24.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:24 smithi099 ceph-mon[27651]: pgmap v222: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:39:24.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:24 smithi117 ceph-mon[34564]: pgmap v222: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:39:26.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:26 smithi099 ceph-mon[27651]: pgmap v223: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:39:26.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:26 smithi117 ceph-mon[34564]: pgmap v223: 65 pgs: 65 active+clean; 590 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:39:28.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:28 smithi099 ceph-mon[27651]: pgmap v224: 65 pgs: 65 active+clean; 601 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2024-09-19T06:39:28.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:28 smithi117 ceph-mon[34564]: pgmap v224: 65 pgs: 65 active+clean; 601 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2024-09-19T06:39:28.641 INFO:tasks.workunit.client.0.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-19T06:39:28.953 INFO:tasks.workunit.client.0.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-19T06:39:29.043 INFO:tasks.workunit.client.0.smithi099.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T06:39:29.044 INFO:tasks.workunit.client.0.smithi099.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T06:39:29.045 INFO:tasks.workunit.client.0.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-19T06:39:29.160 INFO:tasks.workunit.client.0.smithi099.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T06:39:29.164 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-19T06:39:29.164 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-19T06:39:29.221 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-09-19T06:39:29.222 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-19T06:39:29.223 DEBUG:teuthology.orchestra.run.smithi099:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6fad5dd73c93545e52f57f681e140a9c3529c11e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-09-19T06:39:29.287 INFO:tasks.workunit.client.0.smithi099.stderr:+ mkdir -p fsstress 2024-09-19T06:39:29.289 INFO:tasks.workunit.client.0.smithi099.stderr:+ pushd fsstress 2024-09-19T06:39:29.290 INFO:tasks.workunit.client.0.smithi099.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-19T06:39:29.291 INFO:tasks.workunit.client.0.smithi099.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-19T06:39:30.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:30 smithi099 ceph-mon[27651]: pgmap v225: 65 pgs: 65 active+clean; 601 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2024-09-19T06:39:30.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:30 smithi117 ceph-mon[34564]: pgmap v225: 65 pgs: 65 active+clean; 601 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2024-09-19T06:39:32.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:32 smithi117 ceph-mon[34564]: pgmap v226: 65 pgs: 65 active+clean; 601 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 0 op/s 2024-09-19T06:39:32.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:32 smithi099 ceph-mon[27651]: pgmap v226: 65 pgs: 65 active+clean; 601 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 0 op/s 2024-09-19T06:39:34.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:34 smithi099 ceph-mon[27651]: pgmap v227: 65 pgs: 65 active+clean; 615 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s wr, 0 op/s 2024-09-19T06:39:34.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:34 smithi117 ceph-mon[34564]: pgmap v227: 65 pgs: 65 active+clean; 615 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s wr, 0 op/s 2024-09-19T06:39:35.383 INFO:tasks.workunit.client.1.smithi117.stderr:+ tar xzf ltp-full.tgz 2024-09-19T06:39:35.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:35 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:39:35.541 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:35 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:39:36.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:36 smithi099 ceph-mon[27651]: pgmap v228: 65 pgs: 65 active+clean; 4.6 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 344 KiB/s wr, 0 op/s 2024-09-19T06:39:36.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:36 smithi117 ceph-mon[34564]: pgmap v228: 65 pgs: 65 active+clean; 4.6 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 344 KiB/s wr, 0 op/s 2024-09-19T06:39:37.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.502+0000 7f6150ecb640 1 -- 172.21.15.99:0/3880729395 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f614c0fd7f0 msgr2=0x7f614c0fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:37.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.502+0000 7f6150ecb640 1 --2- 172.21.15.99:0/3880729395 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f614c0fd7f0 0x7f614c0fdc60 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f61400048d0 tx=0x7f6140009da0 comp rx=0 tx=0).stop 2024-09-19T06:39:37.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.503+0000 7f6150ecb640 1 -- 172.21.15.99:0/3880729395 shutdown_connections 2024-09-19T06:39:37.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.503+0000 7f6150ecb640 1 --2- 172.21.15.99:0/3880729395 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f614c0fd7f0 0x7f614c0fdc60 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:37.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.503+0000 7f6150ecb640 1 --2- 172.21.15.99:0/3880729395 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f614c0fc520 0x7f614c0fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:37.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.503+0000 7f6150ecb640 1 -- 172.21.15.99:0/3880729395 >> 172.21.15.99:0/3880729395 conn(0x7f614c0f7ce0 msgr2=0x7f614c0fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:37.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.503+0000 7f6150ecb640 1 -- 172.21.15.99:0/3880729395 shutdown_connections 2024-09-19T06:39:37.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.503+0000 7f6150ecb640 1 -- 172.21.15.99:0/3880729395 wait complete. 2024-09-19T06:39:37.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.503+0000 7f6150ecb640 1 Processor -- start 2024-09-19T06:39:37.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.503+0000 7f6150ecb640 1 -- start start 2024-09-19T06:39:37.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.503+0000 7f6150ecb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f614c0fc520 0x7f614c10d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:37.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.503+0000 7f6150ecb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f614c0fd7f0 0x7f614c10d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:37.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.503+0000 7f6150ecb640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f614c10dbf0 con 0x7f614c0fd7f0 2024-09-19T06:39:37.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.503+0000 7f6150ecb640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f614c10e410 con 0x7f614c0fc520 2024-09-19T06:39:37.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.504+0000 7f614a59c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f614c0fc520 0x7f614c10d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:37.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.504+0000 7f6149d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f614c0fd7f0 0x7f614c10d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:37.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.504+0000 7f614a59c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f614c0fc520 0x7f614c10d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.99:56768/0 (socket says 172.21.15.99:56768) 2024-09-19T06:39:37.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.504+0000 7f6149d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f614c0fd7f0 0x7f614c10d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54088/0 (socket says 172.21.15.99:54088) 2024-09-19T06:39:37.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.504+0000 7f614a59c640 1 -- 172.21.15.99:0/2822611042 learned_addr learned my addr 172.21.15.99:0/2822611042 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:39:37.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.504+0000 7f6149d9b640 1 -- 172.21.15.99:0/2822611042 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f614c0fc520 msgr2=0x7f614c10d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:37.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.504+0000 7f6149d9b640 1 --2- 172.21.15.99:0/2822611042 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f614c0fc520 0x7f614c10d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:37.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.504+0000 7f6149d9b640 1 -- 172.21.15.99:0/2822611042 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6140005040 con 0x7f614c0fd7f0 2024-09-19T06:39:37.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.504+0000 7f6149d9b640 1 --2- 172.21.15.99:0/2822611042 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f614c0fd7f0 0x7f614c10d5a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f61400043d0 tx=0x7f6140009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:37.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.504+0000 7f613affd640 1 -- 172.21.15.99:0/2822611042 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f614003c070 con 0x7f614c0fd7f0 2024-09-19T06:39:37.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.504+0000 7f613affd640 1 -- 172.21.15.99:0/2822611042 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f614002ae90 con 0x7f614c0fd7f0 2024-09-19T06:39:37.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.504+0000 7f613affd640 1 -- 172.21.15.99:0/2822611042 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f614002c330 con 0x7f614c0fd7f0 2024-09-19T06:39:37.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.504+0000 7f6150ecb640 1 -- 172.21.15.99:0/2822611042 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f614c10e640 con 0x7f614c0fd7f0 2024-09-19T06:39:37.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.504+0000 7f6150ecb640 1 -- 172.21.15.99:0/2822611042 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f614c10eb60 con 0x7f614c0fd7f0 2024-09-19T06:39:37.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.506+0000 7f6150ecb640 1 -- 172.21.15.99:0/2822611042 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f614c0fb980 con 0x7f614c0fd7f0 2024-09-19T06:39:37.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.506+0000 7f613affd640 1 -- 172.21.15.99:0/2822611042 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f6140030020 con 0x7f614c0fd7f0 2024-09-19T06:39:37.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.507+0000 7f613affd640 1 --2- 172.21.15.99:0/2822611042 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f613406ed60 0x7f6134071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:37.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.507+0000 7f613affd640 1 -- 172.21.15.99:0/2822611042 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f61400b2670 con 0x7f614c0fd7f0 2024-09-19T06:39:37.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.507+0000 7f614a59c640 1 --2- 172.21.15.99:0/2822611042 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f613406ed60 0x7f6134071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:37.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.507+0000 7f614a59c640 1 --2- 172.21.15.99:0/2822611042 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f613406ed60 0x7f6134071210 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f613c010210 tx=0x7f613c00b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:37.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.512+0000 7f613affd640 1 -- 172.21.15.99:0/2822611042 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f614007f870 con 0x7f614c0fd7f0 2024-09-19T06:39:37.590 INFO:tasks.workunit.client.0.smithi099.stderr:+ tar xzf ltp-full.tgz 2024-09-19T06:39:37.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.768+0000 7f6150ecb640 1 -- 172.21.15.99:0/2822611042 --> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f614c10eee0 con 0x7f613406ed60 2024-09-19T06:39:37.770 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:37 smithi099 ceph-mon[27651]: pgmap v229: 65 pgs: 65 active+clean; 6.3 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 493 KiB/s wr, 12 op/s 2024-09-19T06:39:37.770 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:37 smithi099 ceph-mon[27651]: Upgrade: Updating mgr.smithi117.ssmkcf 2024-09-19T06:39:37.770 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:37 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:39:37.770 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:37 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi117.ssmkcf", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T06:39:37.770 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:37 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T06:39:37.770 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:37 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:39:37.770 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:37 smithi099 ceph-mon[27651]: Deploying daemon mgr.smithi117.ssmkcf on smithi117 2024-09-19T06:39:37.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.770+0000 7f613affd640 1 -- 172.21.15.99:0/2822611042 <== mgr.14206 v2:172.21.15.99:6800/886909451 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7f614c10eee0 con 0x7f613406ed60 2024-09-19T06:39:37.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.773+0000 7f6150ecb640 1 -- 172.21.15.99:0/2822611042 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f613406ed60 msgr2=0x7f6134071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:37.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.773+0000 7f6150ecb640 1 --2- 172.21.15.99:0/2822611042 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f613406ed60 0x7f6134071210 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f613c010210 tx=0x7f613c00b040 comp rx=0 tx=0).stop 2024-09-19T06:39:37.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.773+0000 7f6150ecb640 1 -- 172.21.15.99:0/2822611042 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f614c0fd7f0 msgr2=0x7f614c10d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:37.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.773+0000 7f6150ecb640 1 --2- 172.21.15.99:0/2822611042 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f614c0fd7f0 0x7f614c10d5a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f61400043d0 tx=0x7f6140009da0 comp rx=0 tx=0).stop 2024-09-19T06:39:37.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.774+0000 7f6150ecb640 1 -- 172.21.15.99:0/2822611042 shutdown_connections 2024-09-19T06:39:37.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.774+0000 7f6150ecb640 1 --2- 172.21.15.99:0/2822611042 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f613406ed60 0x7f6134071210 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:37.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.774+0000 7f6150ecb640 1 --2- 172.21.15.99:0/2822611042 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f614c0fd7f0 0x7f614c10d5a0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:37.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.774+0000 7f6150ecb640 1 --2- 172.21.15.99:0/2822611042 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f614c0fc520 0x7f614c10d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:37.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.774+0000 7f6150ecb640 1 -- 172.21.15.99:0/2822611042 >> 172.21.15.99:0/2822611042 conn(0x7f614c0f7ce0 msgr2=0x7f614c0f94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:37.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.774+0000 7f6150ecb640 1 -- 172.21.15.99:0/2822611042 shutdown_connections 2024-09-19T06:39:37.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.774+0000 7f6150ecb640 1 -- 172.21.15.99:0/2822611042 wait complete. 2024-09-19T06:39:37.787 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-09-19T06:39:37.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.887+0000 7f282c9d4640 1 -- 172.21.15.99:0/3788123020 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28280fdba0 msgr2=0x7f28280fdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:37.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.887+0000 7f282c9d4640 1 --2- 172.21.15.99:0/3788123020 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28280fdba0 0x7f28280fdfb0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f28180048d0 tx=0x7f2818009da0 comp rx=0 tx=0).stop 2024-09-19T06:39:37.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.887+0000 7f282c9d4640 1 -- 172.21.15.99:0/3788123020 shutdown_connections 2024-09-19T06:39:37.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.887+0000 7f282c9d4640 1 --2- 172.21.15.99:0/3788123020 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28280fe4f0 0x7f28280fa650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:37.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.887+0000 7f282c9d4640 1 --2- 172.21.15.99:0/3788123020 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28280fdba0 0x7f28280fdfb0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:37.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.887+0000 7f282c9d4640 1 -- 172.21.15.99:0/3788123020 >> 172.21.15.99:0/3788123020 conn(0x7f28280f6380 msgr2=0x7f28280f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:37.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.887+0000 7f282c9d4640 1 -- 172.21.15.99:0/3788123020 shutdown_connections 2024-09-19T06:39:37.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.887+0000 7f282c9d4640 1 -- 172.21.15.99:0/3788123020 wait complete. 2024-09-19T06:39:37.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.888+0000 7f282c9d4640 1 Processor -- start 2024-09-19T06:39:37.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.888+0000 7f282c9d4640 1 -- start start 2024-09-19T06:39:37.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.888+0000 7f282c9d4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28280fdba0 0x7f28281136c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:37.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.888+0000 7f282c9d4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28280fe4f0 0x7f2828113c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:37.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.888+0000 7f282c9d4640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2828114250 con 0x7f28280fe4f0 2024-09-19T06:39:37.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.888+0000 7f282c9d4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2828114a70 con 0x7f28280fdba0 2024-09-19T06:39:37.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.888+0000 7f2825d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28280fe4f0 0x7f2828113c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:37.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.888+0000 7f2825d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28280fe4f0 0x7f2828113c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54112/0 (socket says 172.21.15.99:54112) 2024-09-19T06:39:37.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.888+0000 7f2825d9b640 1 -- 172.21.15.99:0/2320797510 learned_addr learned my addr 172.21.15.99:0/2320797510 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:39:37.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.888+0000 7f282659c640 1 --2- 172.21.15.99:0/2320797510 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28280fdba0 0x7f28281136c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:37.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.888+0000 7f2825d9b640 1 -- 172.21.15.99:0/2320797510 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28280fdba0 msgr2=0x7f28281136c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:37.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.888+0000 7f2825d9b640 1 --2- 172.21.15.99:0/2320797510 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28280fdba0 0x7f28281136c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:37.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.889+0000 7f2825d9b640 1 -- 172.21.15.99:0/2320797510 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f281c005040 con 0x7f28280fe4f0 2024-09-19T06:39:37.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.889+0000 7f282659c640 1 --2- 172.21.15.99:0/2320797510 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28280fdba0 0x7f28281136c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:39:37.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.889+0000 7f2825d9b640 1 --2- 172.21.15.99:0/2320797510 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28280fe4f0 0x7f2828113c00 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f281c0093d0 tx=0x7f281c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:37.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.889+0000 7f2816ffd640 1 -- 172.21.15.99:0/2320797510 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f281c017070 con 0x7f28280fe4f0 2024-09-19T06:39:37.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.889+0000 7f282c9d4640 1 -- 172.21.15.99:0/2320797510 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2818005040 con 0x7f28280fe4f0 2024-09-19T06:39:37.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.889+0000 7f282c9d4640 1 -- 172.21.15.99:0/2320797510 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28281150b0 con 0x7f28280fe4f0 2024-09-19T06:39:37.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.889+0000 7f2816ffd640 1 -- 172.21.15.99:0/2320797510 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f281c00f040 con 0x7f28280fe4f0 2024-09-19T06:39:37.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.890+0000 7f2816ffd640 1 -- 172.21.15.99:0/2320797510 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f281c013b40 con 0x7f28280fe4f0 2024-09-19T06:39:37.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.890+0000 7f282c9d4640 1 -- 172.21.15.99:0/2320797510 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2808005210 con 0x7f28280fe4f0 2024-09-19T06:39:37.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.892+0000 7f2816ffd640 1 -- 172.21.15.99:0/2320797510 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f281c00e930 con 0x7f28280fe4f0 2024-09-19T06:39:37.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.892+0000 7f2816ffd640 1 --2- 172.21.15.99:0/2320797510 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f281006ed60 0x7f2810071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:37.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.892+0000 7f2816ffd640 1 -- 172.21.15.99:0/2320797510 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f281c08ec40 con 0x7f28280fe4f0 2024-09-19T06:39:37.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.893+0000 7f282659c640 1 --2- 172.21.15.99:0/2320797510 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f281006ed60 0x7f2810071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:37.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.893+0000 7f282659c640 1 --2- 172.21.15.99:0/2320797510 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f281006ed60 0x7f2810071210 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2818000c00 tx=0x7f2818035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:37.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:37.897+0000 7f2816ffd640 1 -- 172.21.15.99:0/2320797510 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f281c05be30 con 0x7f28280fe4f0 2024-09-19T06:39:38.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:37 smithi117 ceph-mon[34564]: pgmap v229: 65 pgs: 65 active+clean; 6.3 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 493 KiB/s wr, 12 op/s 2024-09-19T06:39:38.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:37 smithi117 ceph-mon[34564]: Upgrade: Updating mgr.smithi117.ssmkcf 2024-09-19T06:39:38.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:37 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:39:38.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:37 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi117.ssmkcf", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T06:39:38.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:37 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T06:39:38.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:37 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:39:38.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:37 smithi117 ceph-mon[34564]: Deploying daemon mgr.smithi117.ssmkcf on smithi117 2024-09-19T06:39:38.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.163+0000 7f282c9d4640 1 -- 172.21.15.99:0/2320797510 --> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2808000bc0 con 0x7f281006ed60 2024-09-19T06:39:38.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.165+0000 7f2816ffd640 1 -- 172.21.15.99:0/2320797510 <== mgr.14206 v2:172.21.15.99:6800/886909451 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7f2808000bc0 con 0x7f281006ed60 2024-09-19T06:39:38.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.167+0000 7f282c9d4640 1 -- 172.21.15.99:0/2320797510 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f281006ed60 msgr2=0x7f2810071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:38.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.167+0000 7f282c9d4640 1 --2- 172.21.15.99:0/2320797510 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f281006ed60 0x7f2810071210 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2818000c00 tx=0x7f2818035040 comp rx=0 tx=0).stop 2024-09-19T06:39:38.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.168+0000 7f282c9d4640 1 -- 172.21.15.99:0/2320797510 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28280fe4f0 msgr2=0x7f2828113c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:38.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.168+0000 7f282c9d4640 1 --2- 172.21.15.99:0/2320797510 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28280fe4f0 0x7f2828113c00 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f281c0093d0 tx=0x7f281c009da0 comp rx=0 tx=0).stop 2024-09-19T06:39:38.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.168+0000 7f282c9d4640 1 -- 172.21.15.99:0/2320797510 shutdown_connections 2024-09-19T06:39:38.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.168+0000 7f282c9d4640 1 --2- 172.21.15.99:0/2320797510 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f281006ed60 0x7f2810071210 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:38.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.168+0000 7f282c9d4640 1 --2- 172.21.15.99:0/2320797510 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28280fe4f0 0x7f2828113c00 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:38.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.168+0000 7f282c9d4640 1 --2- 172.21.15.99:0/2320797510 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28280fdba0 0x7f28281136c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:38.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.168+0000 7f282c9d4640 1 -- 172.21.15.99:0/2320797510 >> 172.21.15.99:0/2320797510 conn(0x7f28280f6380 msgr2=0x7f28280f7aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:38.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.168+0000 7f282c9d4640 1 -- 172.21.15.99:0/2320797510 shutdown_connections 2024-09-19T06:39:38.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.168+0000 7f282c9d4640 1 -- 172.21.15.99:0/2320797510 wait complete. 2024-09-19T06:39:38.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.274+0000 7f1b884e0640 1 -- 172.21.15.99:0/1778933472 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b80103e50 msgr2=0x7f1b801042c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:38.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.274+0000 7f1b884e0640 1 --2- 172.21.15.99:0/1778933472 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b80103e50 0x7f1b801042c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1b70004810 tx=0x7f1b70009da0 comp rx=0 tx=0).stop 2024-09-19T06:39:38.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.274+0000 7f1b884e0640 1 -- 172.21.15.99:0/1778933472 shutdown_connections 2024-09-19T06:39:38.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.274+0000 7f1b884e0640 1 --2- 172.21.15.99:0/1778933472 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b80103e50 0x7f1b801042c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:38.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.274+0000 7f1b884e0640 1 --2- 172.21.15.99:0/1778933472 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1b80102b80 0x7f1b80102f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:38.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.274+0000 7f1b884e0640 1 -- 172.21.15.99:0/1778933472 >> 172.21.15.99:0/1778933472 conn(0x7f1b80071d90 msgr2=0x7f1b800741a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:38.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.274+0000 7f1b884e0640 1 -- 172.21.15.99:0/1778933472 shutdown_connections 2024-09-19T06:39:38.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.274+0000 7f1b884e0640 1 -- 172.21.15.99:0/1778933472 wait complete. 2024-09-19T06:39:38.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.275+0000 7f1b884e0640 1 Processor -- start 2024-09-19T06:39:38.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.275+0000 7f1b884e0640 1 -- start start 2024-09-19T06:39:38.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.275+0000 7f1b884e0640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1b80102b80 0x7f1b80113450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:38.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.275+0000 7f1b884e0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b80103e50 0x7f1b80113990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:38.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.275+0000 7f1b884e0640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b80113fe0 con 0x7f1b80102b80 2024-09-19T06:39:38.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.275+0000 7f1b884e0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b80114800 con 0x7f1b80103e50 2024-09-19T06:39:38.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.275+0000 7f1b85a7b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b80103e50 0x7f1b80113990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:38.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.275+0000 7f1b85a7b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b80103e50 0x7f1b80113990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.99:56802/0 (socket says 172.21.15.99:56802) 2024-09-19T06:39:38.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.275+0000 7f1b85a7b640 1 -- 172.21.15.99:0/3343715536 learned_addr learned my addr 172.21.15.99:0/3343715536 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:39:38.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.276+0000 7f1b8627c640 1 --2- 172.21.15.99:0/3343715536 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1b80102b80 0x7f1b80113450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:38.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.276+0000 7f1b85a7b640 1 -- 172.21.15.99:0/3343715536 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1b80102b80 msgr2=0x7f1b80113450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:38.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.276+0000 7f1b85a7b640 1 --2- 172.21.15.99:0/3343715536 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1b80102b80 0x7f1b80113450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:38.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.276+0000 7f1b85a7b640 1 -- 172.21.15.99:0/3343715536 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b70005040 con 0x7f1b80103e50 2024-09-19T06:39:38.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.276+0000 7f1b85a7b640 1 --2- 172.21.15.99:0/3343715536 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b80103e50 0x7f1b80113990 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1b70004730 tx=0x7f1b70009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:38.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.276+0000 7f1b76ffd640 1 -- 172.21.15.99:0/3343715536 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b70038070 con 0x7f1b80103e50 2024-09-19T06:39:38.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.276+0000 7f1b76ffd640 1 -- 172.21.15.99:0/3343715536 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1b7002adc0 con 0x7f1b80103e50 2024-09-19T06:39:38.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.276+0000 7f1b884e0640 1 -- 172.21.15.99:0/3343715536 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b80114a30 con 0x7f1b80103e50 2024-09-19T06:39:38.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.276+0000 7f1b76ffd640 1 -- 172.21.15.99:0/3343715536 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b700339c0 con 0x7f1b80103e50 2024-09-19T06:39:38.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.276+0000 7f1b884e0640 1 -- 172.21.15.99:0/3343715536 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b80114ef0 con 0x7f1b80103e50 2024-09-19T06:39:38.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.278+0000 7f1b884e0640 1 -- 172.21.15.99:0/3343715536 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b80075a10 con 0x7f1b80103e50 2024-09-19T06:39:38.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.279+0000 7f1b76ffd640 1 -- 172.21.15.99:0/3343715536 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f1b70030020 con 0x7f1b80103e50 2024-09-19T06:39:38.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.279+0000 7f1b76ffd640 1 --2- 172.21.15.99:0/3343715536 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f1b6c06ed60 0x7f1b6c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:38.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.279+0000 7f1b76ffd640 1 -- 172.21.15.99:0/3343715536 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f1b700ae2c0 con 0x7f1b80103e50 2024-09-19T06:39:38.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.279+0000 7f1b8627c640 1 --2- 172.21.15.99:0/3343715536 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f1b6c06ed60 0x7f1b6c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:38.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.280+0000 7f1b8627c640 1 --2- 172.21.15.99:0/3343715536 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f1b6c06ed60 0x7f1b6c071210 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c0049b0 tx=0x7f1b7c00b040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:38.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.285+0000 7f1b76ffd640 1 -- 172.21.15.99:0/3343715536 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f1b7007b370 con 0x7f1b80103e50 2024-09-19T06:39:38.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.525+0000 7f1b884e0640 1 -- 172.21.15.99:0/3343715536 --> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1b80115200 con 0x7f1b6c06ed60 2024-09-19T06:39:38.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.540+0000 7f1b76ffd640 1 -- 172.21.15.99:0/3343715536 <== mgr.14206 v2:172.21.15.99:6800/886909451 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3542 (secure 0 0 0) 0x7f1b80115200 con 0x7f1b6c06ed60 2024-09-19T06:39:38.542 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T06:39:38.542 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.smithi099 smithi099 *:9093,9094 running (5m) 87s ago 7m 25.3M - 0.25.0 c8568f914cd2 586edf6f2401 2024-09-19T06:39:38.542 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi099 smithi099 running (7m) 87s ago 7m 6895k - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 216ce2ef7f1e 2024-09-19T06:39:38.542 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi117 smithi117 running (6m) 93s ago 6m 6899k - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 b4c328bdec52 2024-09-19T06:39:38.542 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.smithi099 smithi099 *:3000 running (5m) 87s ago 6m 86.9M - 9.4.7 954c08fa6188 94ad8b9b7c91 2024-09-19T06:39:38.542 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.obarqf smithi099 running (114s) 87s ago 113s 10.8M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 e36c9b74004b 2024-09-19T06:39:38.542 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.xehbxe smithi099 running (107s) 87s ago 106s 17.3M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 d09eb3d306ae 2024-09-19T06:39:38.542 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.bheqzh smithi117 running (104s) 93s ago 104s 12.5M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 21253e27fdd3 2024-09-19T06:39:38.542 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.nooexo smithi117 running (111s) 93s ago 111s 14.7M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 ad1faeb3343c 2024-09-19T06:39:38.542 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi099.pgvkqi smithi099 *:9283,8765,8443 running (8m) 87s ago 8m 448M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 8e7ecb77f4cd 2024-09-19T06:39:38.542 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi117.ssmkcf smithi117 *:8443,9283 running (6m) 93s ago 6m 402M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 785113b1da28 2024-09-19T06:39:38.542 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi099 smithi099 running (8m) 87s ago 8m 49.4M 2048M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 7375c241d067 2024-09-19T06:39:38.543 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi117 smithi117 running (6m) 93s ago 6m 36.1M 2048M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 bd4854d5213e 2024-09-19T06:39:38.543 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi099 smithi099 *:9100 running (7m) 87s ago 7m 14.6M - 1.5.0 0da6a335fe13 09c786facf49 2024-09-19T06:39:38.543 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi117 smithi117 *:9100 running (6m) 93s ago 6m 16.9M - 1.5.0 0da6a335fe13 04f52626cbca 2024-09-19T06:39:38.543 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (5m) 87s ago 5m 46.0M 4288M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 cf8d3dd4a987 2024-09-19T06:39:38.543 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (4m) 87s ago 4m 45.1M 4288M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 bc5b04b8bf9f 2024-09-19T06:39:38.543 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (4m) 87s ago 4m 43.3M 4288M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 cedc7e3698d8 2024-09-19T06:39:38.543 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi117 running (4m) 93s ago 4m 45.6M 5312M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 5984ed999c91 2024-09-19T06:39:38.543 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi117 running (3m) 93s ago 3m 41.5M 5312M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 6a2fc0c51c05 2024-09-19T06:39:38.543 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi117 running (3m) 93s ago 3m 42.4M 5312M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 39dcb7dbf0e3 2024-09-19T06:39:38.543 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.smithi099 smithi099 *:9095 running (5m) 87s ago 6m 54.2M - 2.43.0 a07b618ecd1d 82e83626cde9 2024-09-19T06:39:38.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.543+0000 7f1b884e0640 1 -- 172.21.15.99:0/3343715536 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f1b6c06ed60 msgr2=0x7f1b6c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:38.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.543+0000 7f1b884e0640 1 --2- 172.21.15.99:0/3343715536 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f1b6c06ed60 0x7f1b6c071210 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c0049b0 tx=0x7f1b7c00b040 comp rx=0 tx=0).stop 2024-09-19T06:39:38.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.543+0000 7f1b884e0640 1 -- 172.21.15.99:0/3343715536 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b80103e50 msgr2=0x7f1b80113990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:38.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.543+0000 7f1b884e0640 1 --2- 172.21.15.99:0/3343715536 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b80103e50 0x7f1b80113990 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1b70004730 tx=0x7f1b70009da0 comp rx=0 tx=0).stop 2024-09-19T06:39:38.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.543+0000 7f1b884e0640 1 -- 172.21.15.99:0/3343715536 shutdown_connections 2024-09-19T06:39:38.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.543+0000 7f1b884e0640 1 --2- 172.21.15.99:0/3343715536 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f1b6c06ed60 0x7f1b6c071210 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:38.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.543+0000 7f1b884e0640 1 --2- 172.21.15.99:0/3343715536 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b80103e50 0x7f1b80113990 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:38.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.543+0000 7f1b884e0640 1 --2- 172.21.15.99:0/3343715536 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1b80102b80 0x7f1b80113450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:38.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.543+0000 7f1b884e0640 1 -- 172.21.15.99:0/3343715536 >> 172.21.15.99:0/3343715536 conn(0x7f1b80071d90 msgr2=0x7f1b800732c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:38.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.543+0000 7f1b884e0640 1 -- 172.21.15.99:0/3343715536 shutdown_connections 2024-09-19T06:39:38.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.543+0000 7f1b884e0640 1 -- 172.21.15.99:0/3343715536 wait complete. 2024-09-19T06:39:38.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.647+0000 7f2875aa3640 1 -- 172.21.15.99:0/4288823269 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28700fdb70 msgr2=0x7f28700fdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:38.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.647+0000 7f2875aa3640 1 --2- 172.21.15.99:0/4288823269 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28700fdb70 0x7f28700fdf80 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f28600048d0 tx=0x7f2860009da0 comp rx=0 tx=0).stop 2024-09-19T06:39:38.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.647+0000 7f2875aa3640 1 -- 172.21.15.99:0/4288823269 shutdown_connections 2024-09-19T06:39:38.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.647+0000 7f2875aa3640 1 --2- 172.21.15.99:0/4288823269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28700fe4c0 0x7f28700fa620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:38.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.647+0000 7f2875aa3640 1 --2- 172.21.15.99:0/4288823269 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28700fdb70 0x7f28700fdf80 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:38.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.647+0000 7f2875aa3640 1 -- 172.21.15.99:0/4288823269 >> 172.21.15.99:0/4288823269 conn(0x7f28700f6390 msgr2=0x7f28700f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:38.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.647+0000 7f2875aa3640 1 -- 172.21.15.99:0/4288823269 shutdown_connections 2024-09-19T06:39:38.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.647+0000 7f2875aa3640 1 -- 172.21.15.99:0/4288823269 wait complete. 2024-09-19T06:39:38.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.647+0000 7f2875aa3640 1 Processor -- start 2024-09-19T06:39:38.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.648+0000 7f2875aa3640 1 -- start start 2024-09-19T06:39:38.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.648+0000 7f2875aa3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28700fdb70 0x7f287010f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:38.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.648+0000 7f2875aa3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28700fe4c0 0x7f287010f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:38.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.648+0000 7f2875aa3640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287010fe40 con 0x7f28700fe4c0 2024-09-19T06:39:38.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.648+0000 7f2875aa3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2870110660 con 0x7f28700fdb70 2024-09-19T06:39:38.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.648+0000 7f286effd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28700fe4c0 0x7f287010f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:38.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.648+0000 7f286f7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28700fdb70 0x7f287010f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:38.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.648+0000 7f286f7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28700fdb70 0x7f287010f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.99:56822/0 (socket says 172.21.15.99:56822) 2024-09-19T06:39:38.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.648+0000 7f286f7fe640 1 -- 172.21.15.99:0/2525133657 learned_addr learned my addr 172.21.15.99:0/2525133657 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:39:38.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.649+0000 7f286effd640 1 -- 172.21.15.99:0/2525133657 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28700fdb70 msgr2=0x7f287010f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:38.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.649+0000 7f286effd640 1 --2- 172.21.15.99:0/2525133657 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28700fdb70 0x7f287010f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:38.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.649+0000 7f286effd640 1 -- 172.21.15.99:0/2525133657 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2860005040 con 0x7f28700fe4c0 2024-09-19T06:39:38.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.649+0000 7f286f7fe640 1 --2- 172.21.15.99:0/2525133657 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28700fdb70 0x7f287010f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:39:38.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.649+0000 7f286effd640 1 --2- 172.21.15.99:0/2525133657 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28700fe4c0 0x7f287010f7f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2870064eb0 tx=0x7f286400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:38.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.650+0000 7f2857fff640 1 -- 172.21.15.99:0/2525133657 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2864007c30 con 0x7f28700fe4c0 2024-09-19T06:39:38.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.650+0000 7f2875aa3640 1 -- 172.21.15.99:0/2525133657 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2870110890 con 0x7f28700fe4c0 2024-09-19T06:39:38.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.650+0000 7f2857fff640 1 -- 172.21.15.99:0/2525133657 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f286400f040 con 0x7f28700fe4c0 2024-09-19T06:39:38.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.650+0000 7f2875aa3640 1 -- 172.21.15.99:0/2525133657 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2870110e30 con 0x7f28700fe4c0 2024-09-19T06:39:38.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.650+0000 7f2857fff640 1 -- 172.21.15.99:0/2525133657 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f286400ca70 con 0x7f28700fe4c0 2024-09-19T06:39:38.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.651+0000 7f2875aa3640 1 -- 172.21.15.99:0/2525133657 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28700fa010 con 0x7f28700fe4c0 2024-09-19T06:39:38.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.652+0000 7f2857fff640 1 -- 172.21.15.99:0/2525133657 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f286400cbd0 con 0x7f28700fe4c0 2024-09-19T06:39:38.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.653+0000 7f2857fff640 1 --2- 172.21.15.99:0/2525133657 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f285806edc0 0x7f2858071270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:38.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.653+0000 7f2857fff640 1 -- 172.21.15.99:0/2525133657 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f286408dd30 con 0x7f28700fe4c0 2024-09-19T06:39:38.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.653+0000 7f286f7fe640 1 --2- 172.21.15.99:0/2525133657 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f285806edc0 0x7f2858071270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:38.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.654+0000 7f286f7fe640 1 --2- 172.21.15.99:0/2525133657 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f285806edc0 0x7f2858071270 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2860000c00 tx=0x7f2860035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:38.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:38.660+0000 7f2857fff640 1 -- 172.21.15.99:0/2525133657 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f286405aeb0 con 0x7f28700fe4c0 2024-09-19T06:39:38.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:38 smithi099 ceph-mon[27651]: from='client.14556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:39:38.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:38 smithi099 ceph-mon[27651]: from='client.14560 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:39:39.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:39.007+0000 7f2875aa3640 1 -- 172.21.15.99:0/2525133657 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f287004b720 con 0x7f28700fe4c0 2024-09-19T06:39:39.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:39.007+0000 7f2857fff640 1 -- 172.21.15.99:0/2525133657 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+643 (secure 0 0 0) 0x7f286405a850 con 0x7f28700fe4c0 2024-09-19T06:39:39.009 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:39:39.010 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-09-19T06:39:39.010 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 2 2024-09-19T06:39:39.010 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:39:39.010 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-09-19T06:39:39.010 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 2 2024-09-19T06:39:39.010 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:39:39.010 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-09-19T06:39:39.011 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 6 2024-09-19T06:39:39.011 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:39:39.011 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": { 2024-09-19T06:39:39.011 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 4 2024-09-19T06:39:39.011 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:39:39.011 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-09-19T06:39:39.011 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 14 2024-09-19T06:39:39.011 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T06:39:39.012 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:39:39.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:39.010+0000 7f2875aa3640 1 -- 172.21.15.99:0/2525133657 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f285806edc0 msgr2=0x7f2858071270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:39.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:39.010+0000 7f2875aa3640 1 --2- 172.21.15.99:0/2525133657 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f285806edc0 0x7f2858071270 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2860000c00 tx=0x7f2860035040 comp rx=0 tx=0).stop 2024-09-19T06:39:39.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:39.010+0000 7f2875aa3640 1 -- 172.21.15.99:0/2525133657 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28700fe4c0 msgr2=0x7f287010f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:39.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:39.010+0000 7f2875aa3640 1 --2- 172.21.15.99:0/2525133657 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28700fe4c0 0x7f287010f7f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2870064eb0 tx=0x7f286400b040 comp rx=0 tx=0).stop 2024-09-19T06:39:39.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:39.010+0000 7f2875aa3640 1 -- 172.21.15.99:0/2525133657 shutdown_connections 2024-09-19T06:39:39.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:39.010+0000 7f2875aa3640 1 --2- 172.21.15.99:0/2525133657 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7f285806edc0 0x7f2858071270 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:39.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:39.010+0000 7f2875aa3640 1 --2- 172.21.15.99:0/2525133657 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28700fe4c0 0x7f287010f7f0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:39.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:39.010+0000 7f2875aa3640 1 --2- 172.21.15.99:0/2525133657 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28700fdb70 0x7f287010f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:39.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:39.010+0000 7f2875aa3640 1 -- 172.21.15.99:0/2525133657 >> 172.21.15.99:0/2525133657 conn(0x7f28700f6390 msgr2=0x7f28700f96c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:39.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:39.010+0000 7f2875aa3640 1 -- 172.21.15.99:0/2525133657 shutdown_connections 2024-09-19T06:39:39.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:39.010+0000 7f2875aa3640 1 -- 172.21.15.99:0/2525133657 wait complete. 2024-09-19T06:39:39.015 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:38 smithi117 ceph-mon[34564]: from='client.14556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:39:39.015 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:38 smithi117 ceph-mon[34564]: from='client.14560 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:39:39.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:39.121+0000 7ff3b31b4640 1 -- 172.21.15.99:0/1300579722 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff3ac0fb430 msgr2=0x7ff3ac0fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:39.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:39.121+0000 7ff3b31b4640 1 --2- 172.21.15.99:0/1300579722 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff3ac0fb430 0x7ff3ac0fb840 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff3a00048d0 tx=0x7ff3a0009da0 comp rx=0 tx=0).stop 2024-09-19T06:39:39.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:39.121+0000 7ff3b31b4640 1 -- 172.21.15.99:0/1300579722 shutdown_connections 2024-09-19T06:39:39.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:39.121+0000 7ff3b31b4640 1 --2- 172.21.15.99:0/1300579722 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff3ac0fc700 0x7ff3ac0fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:39.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:39.121+0000 7ff3b31b4640 1 --2- 172.21.15.99:0/1300579722 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff3ac0fb430 0x7ff3ac0fb840 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:39.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:39.121+0000 7ff3b31b4640 1 -- 172.21.15.99:0/1300579722 >> 172.21.15.99:0/1300579722 conn(0x7ff3ac0f6c10 msgr2=0x7ff3ac0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:39.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:39.121+0000 7ff3b31b4640 1 -- 172.21.15.99:0/1300579722 shutdown_connections 2024-09-19T06:39:39.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:39.121+0000 7ff3b31b4640 1 -- 172.21.15.99:0/1300579722 wait complete. 2024-09-19T06:39:39.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:39.121+0000 7ff3b31b4640 1 Processor -- start 2024-09-19T06:39:39.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:39.121+0000 7ff3b31b4640 1 -- start start 2024-09-19T06:39:39.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:39.122+0000 7ff3b31b4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff3ac0fb430 0x7ff3ac1121c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:39.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:39.122+0000 7ff3b31b4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff3ac0fc700 0x7ff3ac114710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:39.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:39.122+0000 7ff3b31b4640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3ac10dc70 con 0x7ff3ac0fc700 2024-09-19T06:39:39.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:39.122+0000 7ff3b31b4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3ac065bd0 con 0x7ff3ac0fb430 2024-09-19T06:39:39.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:39.122+0000 7ff3abfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff3ac0fc700 0x7ff3ac114710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:39.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:39.122+0000 7ff3abfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff3ac0fc700 0x7ff3ac114710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54180/0 (socket says 172.21.15.99:54180) 2024-09-19T06:39:39.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:39.122+0000 7ff3abfff640 1 -- 172.21.15.99:0/3468874969 learned_addr learned my addr 172.21.15.99:0/3468874969 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:39:39.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:39.122+0000 7ff3b0f50640 1 --2- 172.21.15.99:0/3468874969 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff3ac0fb430 0x7ff3ac1121c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:39.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:39.122+0000 7ff3abfff640 1 -- 172.21.15.99:0/3468874969 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff3ac0fb430 msgr2=0x7ff3ac1121c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:39.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:39.122+0000 7ff3abfff640 1 --2- 172.21.15.99:0/3468874969 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff3ac0fb430 0x7ff3ac1121c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:39.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:39.122+0000 7ff3abfff640 1 -- 172.21.15.99:0/3468874969 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3a0005040 con 0x7ff3ac0fc700 2024-09-19T06:39:39.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:39.122+0000 7ff3b0f50640 1 --2- 172.21.15.99:0/3468874969 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff3ac0fb430 0x7ff3ac1121c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:39:39.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:39.123+0000 7ff3abfff640 1 --2- 172.21.15.99:0/3468874969 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff3ac0fc700 0x7ff3ac114710 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff39800eb70 tx=0x7ff39800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:39.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:39.123+0000 7ff3a97fa640 1 -- 172.21.15.99:0/3468874969 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff398007c30 con 0x7ff3ac0fc700 2024-09-19T06:39:39.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:39.123+0000 7ff3b31b4640 1 -- 172.21.15.99:0/3468874969 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3ac065e50 con 0x7ff3ac0fc700 2024-09-19T06:39:39.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:39.123+0000 7ff3a97fa640 1 -- 172.21.15.99:0/3468874969 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff39800f040 con 0x7ff3ac0fc700 2024-09-19T06:39:39.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:39.123+0000 7ff3a97fa640 1 -- 172.21.15.99:0/3468874969 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff398009470 con 0x7ff3ac0fc700 2024-09-19T06:39:39.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:39.123+0000 7ff3b31b4640 1 -- 172.21.15.99:0/3468874969 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3ac114fb0 con 0x7ff3ac0fc700 2024-09-19T06:39:39.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:39.124+0000 7ff3b31b4640 1 -- 172.21.15.99:0/3468874969 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3ac04b720 con 0x7ff3ac0fc700 2024-09-19T06:39:39.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:39.126+0000 7ff3a97fa640 1 -- 172.21.15.99:0/3468874969 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7ff3980096e0 con 0x7ff3ac0fc700 2024-09-19T06:39:39.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:39.126+0000 7ff3a97fa640 1 --2- 172.21.15.99:0/3468874969 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7ff39c06ed50 0x7ff39c071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:39:39.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:39.126+0000 7ff3a97fa640 1 -- 172.21.15.99:0/3468874969 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5550+0+0 (secure 0 0 0) 0x7ff39808e1c0 con 0x7ff3ac0fc700 2024-09-19T06:39:39.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:39.126+0000 7ff3b0f50640 1 --2- 172.21.15.99:0/3468874969 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7ff39c06ed50 0x7ff39c071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:39:39.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:39.127+0000 7ff3b0f50640 1 --2- 172.21.15.99:0/3468874969 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7ff39c06ed50 0x7ff39c071200 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff3a000b020 tx=0x7ff3a0035040 comp rx=0 tx=0).ready entity=mgr.14206 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:39:39.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:39.131+0000 7ff3a97fa640 1 -- 172.21.15.99:0/3468874969 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ff39805b480 con 0x7ff3ac0fc700 2024-09-19T06:39:39.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:39.396+0000 7ff3b31b4640 1 -- 172.21.15.99:0/3468874969 --> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff3ac100b60 con 0x7ff39c06ed50 2024-09-19T06:39:39.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:39.397+0000 7ff3a97fa640 1 -- 172.21.15.99:0/3468874969 <== mgr.14206 v2:172.21.15.99:6800/886909451 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7ff3ac100b60 con 0x7ff39c06ed50 2024-09-19T06:39:39.399 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:39:39.399 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T06:39:39.399 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": true, 2024-09-19T06:39:39.399 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-19T06:39:39.399 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [], 2024-09-19T06:39:39.399 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": "0/2 daemons upgraded", 2024-09-19T06:39:39.399 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "Currently upgrading mgr daemons", 2024-09-19T06:39:39.399 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-09-19T06:39:39.399 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:39:39.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:39.399+0000 7ff3b31b4640 1 -- 172.21.15.99:0/3468874969 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7ff39c06ed50 msgr2=0x7ff39c071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:39.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:39.399+0000 7ff3b31b4640 1 --2- 172.21.15.99:0/3468874969 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7ff39c06ed50 0x7ff39c071200 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff3a000b020 tx=0x7ff3a0035040 comp rx=0 tx=0).stop 2024-09-19T06:39:39.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:39.399+0000 7ff3b31b4640 1 -- 172.21.15.99:0/3468874969 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff3ac0fc700 msgr2=0x7ff3ac114710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:39:39.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:39.399+0000 7ff3b31b4640 1 --2- 172.21.15.99:0/3468874969 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff3ac0fc700 0x7ff3ac114710 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff39800eb70 tx=0x7ff39800b040 comp rx=0 tx=0).stop 2024-09-19T06:39:39.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:39.400+0000 7ff3b31b4640 1 -- 172.21.15.99:0/3468874969 shutdown_connections 2024-09-19T06:39:39.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:39.400+0000 7ff3b31b4640 1 --2- 172.21.15.99:0/3468874969 >> [v2:172.21.15.99:6800/886909451,v1:172.21.15.99:6801/886909451] conn(0x7ff39c06ed50 0x7ff39c071200 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:39.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:39.400+0000 7ff3b31b4640 1 --2- 172.21.15.99:0/3468874969 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff3ac0fc700 0x7ff3ac114710 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:39.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:39.400+0000 7ff3b31b4640 1 --2- 172.21.15.99:0/3468874969 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff3ac0fb430 0x7ff3ac1121c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:39:39.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:39.400+0000 7ff3b31b4640 1 -- 172.21.15.99:0/3468874969 >> 172.21.15.99:0/3468874969 conn(0x7ff3ac0f6c10 msgr2=0x7ff3ac0f83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:39:39.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:39.400+0000 7ff3b31b4640 1 -- 172.21.15.99:0/3468874969 shutdown_connections 2024-09-19T06:39:39.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:39:39.400+0000 7ff3b31b4640 1 -- 172.21.15.99:0/3468874969 wait complete. 2024-09-19T06:39:39.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:39 smithi117 ceph-mon[34564]: from='client.24357 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:39:39.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:39 smithi117 ceph-mon[34564]: pgmap v230: 65 pgs: 65 active+clean; 15 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s wr, 31 op/s 2024-09-19T06:39:39.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:39 smithi117 ceph-mon[34564]: from='client.? 172.21.15.99:0/2525133657' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:39:40.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:39 smithi099 ceph-mon[27651]: from='client.24357 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:39:40.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:39 smithi099 ceph-mon[27651]: pgmap v230: 65 pgs: 65 active+clean; 15 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s wr, 31 op/s 2024-09-19T06:39:40.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:39 smithi099 ceph-mon[27651]: from='client.? 172.21.15.99:0/2525133657' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:39:41.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:40 smithi117 ceph-mon[34564]: from='client.14570 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:39:41.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:40 smithi099 ceph-mon[27651]: from='client.14570 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:39:42.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:41 smithi117 ceph-mon[34564]: pgmap v231: 65 pgs: 65 active+clean; 18 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s wr, 52 op/s 2024-09-19T06:39:42.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:41 smithi099 ceph-mon[27651]: pgmap v231: 65 pgs: 65 active+clean; 18 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s wr, 52 op/s 2024-09-19T06:39:42.849 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:42 smithi117 ceph-mon[34564]: fsmap cephfs:2 {0=cephfs.smithi099.xehbxe=up:active,1=cephfs.smithi117.nooexo=up:active} 2 up:standby 2024-09-19T06:39:43.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:42 smithi099 ceph-mon[27651]: fsmap cephfs:2 {0=cephfs.smithi099.xehbxe=up:active,1=cephfs.smithi117.nooexo=up:active} 2 up:standby 2024-09-19T06:39:43.800 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:43 smithi117 ceph-mon[34564]: pgmap v232: 65 pgs: 65 active+clean; 35 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 3.0 MiB/s wr, 248 op/s 2024-09-19T06:39:43.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:43 smithi099 ceph-mon[27651]: pgmap v232: 65 pgs: 65 active+clean; 35 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 3.0 MiB/s wr, 248 op/s 2024-09-19T06:39:45.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:45 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:39:45.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:45 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:39:45.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:45 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:39:45.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:45 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:39:45.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:45 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:39:45.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:45 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:39:46.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:46 smithi117 ceph-mon[34564]: pgmap v233: 65 pgs: 65 active+clean; 41 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 3.5 MiB/s wr, 286 op/s 2024-09-19T06:39:46.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:46 smithi099 ceph-mon[27651]: pgmap v233: 65 pgs: 65 active+clean; 41 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 3.5 MiB/s wr, 286 op/s 2024-09-19T06:39:48.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:48 smithi117 ceph-mon[34564]: pgmap v234: 65 pgs: 65 active+clean; 50 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 4.0 MiB/s wr, 373 op/s 2024-09-19T06:39:48.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:48 smithi099 ceph-mon[27651]: pgmap v234: 65 pgs: 65 active+clean; 50 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 4.0 MiB/s wr, 373 op/s 2024-09-19T06:39:50.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:50 smithi117 ceph-mon[34564]: pgmap v235: 65 pgs: 65 active+clean; 59 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 4.7 MiB/s wr, 447 op/s 2024-09-19T06:39:50.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:50 smithi117 ceph-mon[34564]: Standby manager daemon smithi117.ssmkcf restarted 2024-09-19T06:39:50.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:50 smithi117 ceph-mon[34564]: Standby manager daemon smithi117.ssmkcf started 2024-09-19T06:39:50.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:50 smithi117 ceph-mon[34564]: from='mgr.? 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi117.ssmkcf/crt"}]: dispatch 2024-09-19T06:39:50.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:50 smithi117 ceph-mon[34564]: from='mgr.? 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T06:39:50.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:50 smithi117 ceph-mon[34564]: from='mgr.? 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi117.ssmkcf/key"}]: dispatch 2024-09-19T06:39:50.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:50 smithi117 ceph-mon[34564]: from='mgr.? 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T06:39:50.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:50 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:39:50.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:50 smithi099 ceph-mon[27651]: pgmap v235: 65 pgs: 65 active+clean; 59 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 4.7 MiB/s wr, 447 op/s 2024-09-19T06:39:50.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:50 smithi099 ceph-mon[27651]: Standby manager daemon smithi117.ssmkcf restarted 2024-09-19T06:39:50.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:50 smithi099 ceph-mon[27651]: Standby manager daemon smithi117.ssmkcf started 2024-09-19T06:39:50.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:50 smithi099 ceph-mon[27651]: from='mgr.? 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi117.ssmkcf/crt"}]: dispatch 2024-09-19T06:39:50.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:50 smithi099 ceph-mon[27651]: from='mgr.? 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T06:39:50.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:50 smithi099 ceph-mon[27651]: from='mgr.? 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi117.ssmkcf/key"}]: dispatch 2024-09-19T06:39:50.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:50 smithi099 ceph-mon[27651]: from='mgr.? 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T06:39:50.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:50 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:39:51.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:51 smithi117 ceph-mon[34564]: mgrmap e20: smithi099.pgvkqi(active, since 6m), standbys: smithi117.ssmkcf 2024-09-19T06:39:51.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:51 smithi099 ceph-mon[27651]: mgrmap e20: smithi099.pgvkqi(active, since 6m), standbys: smithi117.ssmkcf 2024-09-19T06:39:52.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:52 smithi117 ceph-mon[34564]: pgmap v236: 65 pgs: 65 active+clean; 63 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 4.3 MiB/s wr, 460 op/s 2024-09-19T06:39:52.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:52 smithi099 ceph-mon[27651]: pgmap v236: 65 pgs: 65 active+clean; 63 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 4.3 MiB/s wr, 460 op/s 2024-09-19T06:39:54.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:54 smithi117 ceph-mon[34564]: pgmap v237: 65 pgs: 65 active+clean; 86 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 6.0 MiB/s wr, 623 op/s 2024-09-19T06:39:54.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:54 smithi099 ceph-mon[27651]: pgmap v237: 65 pgs: 65 active+clean; 86 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 6.0 MiB/s wr, 623 op/s 2024-09-19T06:39:56.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:56 smithi117 ceph-mon[34564]: pgmap v238: 65 pgs: 65 active+clean; 91 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 4.9 MiB/s wr, 460 op/s 2024-09-19T06:39:56.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:56 smithi099 ceph-mon[27651]: pgmap v238: 65 pgs: 65 active+clean; 91 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 4.9 MiB/s wr, 460 op/s 2024-09-19T06:39:58.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:39:58 smithi117 ceph-mon[34564]: pgmap v239: 65 pgs: 65 active+clean; 103 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 5.5 MiB/s wr, 515 op/s 2024-09-19T06:39:58.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:39:58 smithi099 ceph-mon[27651]: pgmap v239: 65 pgs: 65 active+clean; 103 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 5.5 MiB/s wr, 515 op/s 2024-09-19T06:40:00.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:00 smithi117 ceph-mon[34564]: pgmap v240: 65 pgs: 65 active+clean; 107 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 5.0 MiB/s wr, 525 op/s 2024-09-19T06:40:00.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:00 smithi117 ceph-mon[34564]: overall HEALTH_OK 2024-09-19T06:40:00.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:00 smithi099 ceph-mon[27651]: pgmap v240: 65 pgs: 65 active+clean; 107 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 5.0 MiB/s wr, 525 op/s 2024-09-19T06:40:00.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:00 smithi099 ceph-mon[27651]: overall HEALTH_OK 2024-09-19T06:40:02.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:02 smithi117 ceph-mon[34564]: pgmap v241: 65 pgs: 65 active+clean; 110 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 4.6 MiB/s wr, 473 op/s 2024-09-19T06:40:02.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:02 smithi099 ceph-mon[27651]: pgmap v241: 65 pgs: 65 active+clean; 110 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 4.6 MiB/s wr, 473 op/s 2024-09-19T06:40:04.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:04 smithi099 ceph-mon[27651]: pgmap v242: 65 pgs: 65 active+clean; 127 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 5.6 MiB/s wr, 594 op/s 2024-09-19T06:40:04.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:04 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:40:04.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:04 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:40:04.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:04 smithi117 ceph-mon[34564]: pgmap v242: 65 pgs: 65 active+clean; 127 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 5.6 MiB/s wr, 594 op/s 2024-09-19T06:40:04.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:04 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:40:04.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:04 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:40:05.350 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:05 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:40:05.350 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:05 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:40:05.350 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:05 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:40:05.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:05 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:40:05.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:05 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:40:05.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:05 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:40:06.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:06 smithi117 ceph-mon[34564]: pgmap v243: 65 pgs: 65 active+clean; 129 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 3.8 MiB/s wr, 437 op/s 2024-09-19T06:40:06.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:06 smithi099 ceph-mon[27651]: pgmap v243: 65 pgs: 65 active+clean; 129 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 3.8 MiB/s wr, 437 op/s 2024-09-19T06:40:08.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:08 smithi099 ceph-mon[27651]: pgmap v244: 65 pgs: 65 active+clean; 137 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 4.2 MiB/s wr, 487 op/s 2024-09-19T06:40:08.547 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:08 smithi117 ceph-mon[34564]: pgmap v244: 65 pgs: 65 active+clean; 137 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 4.2 MiB/s wr, 487 op/s 2024-09-19T06:40:09.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:09.523+0000 7fcb7432e640 1 -- 172.21.15.99:0/1947825685 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb6c0715d0 msgr2=0x7fcb6c06fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:09.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:09.523+0000 7fcb7432e640 1 --2- 172.21.15.99:0/1947825685 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb6c0715d0 0x7fcb6c06fb00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fcb68004810 tx=0x7fcb68009da0 comp rx=0 tx=0).stop 2024-09-19T06:40:09.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:09.524+0000 7fcb7432e640 1 -- 172.21.15.99:0/1947825685 shutdown_connections 2024-09-19T06:40:09.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:09.524+0000 7fcb7432e640 1 --2- 172.21.15.99:0/1947825685 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcb6c070040 0x7fcb6c0704b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:09.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:09.524+0000 7fcb7432e640 1 --2- 172.21.15.99:0/1947825685 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb6c0715d0 0x7fcb6c06fb00 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:09.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:09.524+0000 7fcb7432e640 1 -- 172.21.15.99:0/1947825685 >> 172.21.15.99:0/1947825685 conn(0x7fcb6c0f7d30 msgr2=0x7fcb6c0fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:09.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:09.524+0000 7fcb7432e640 1 -- 172.21.15.99:0/1947825685 shutdown_connections 2024-09-19T06:40:09.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:09.524+0000 7fcb7432e640 1 -- 172.21.15.99:0/1947825685 wait complete. 2024-09-19T06:40:09.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:09.525+0000 7fcb7432e640 1 Processor -- start 2024-09-19T06:40:09.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:09.525+0000 7fcb7432e640 1 -- start start 2024-09-19T06:40:09.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:09.525+0000 7fcb7432e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb6c070040 0x7fcb6c1134a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:09.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:09.525+0000 7fcb7432e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcb6c0715d0 0x7fcb6c1139e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:09.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:09.525+0000 7fcb7432e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6c114030 con 0x7fcb6c0715d0 2024-09-19T06:40:09.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:09.525+0000 7fcb7432e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6c114850 con 0x7fcb6c070040 2024-09-19T06:40:09.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:09.525+0000 7fcb720ca640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb6c070040 0x7fcb6c1134a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:09.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:09.525+0000 7fcb718c9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcb6c0715d0 0x7fcb6c1139e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:09.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:09.525+0000 7fcb720ca640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb6c070040 0x7fcb6c1134a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.99:55670/0 (socket says 172.21.15.99:55670) 2024-09-19T06:40:09.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:09.526+0000 7fcb720ca640 1 -- 172.21.15.99:0/1681427429 learned_addr learned my addr 172.21.15.99:0/1681427429 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:40:09.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:09.526+0000 7fcb720ca640 1 -- 172.21.15.99:0/1681427429 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcb6c0715d0 msgr2=0x7fcb6c1139e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:09.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:09.526+0000 7fcb720ca640 1 --2- 172.21.15.99:0/1681427429 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcb6c0715d0 0x7fcb6c1139e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:09.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:09.526+0000 7fcb720ca640 1 -- 172.21.15.99:0/1681427429 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb68005040 con 0x7fcb6c070040 2024-09-19T06:40:09.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:09.526+0000 7fcb720ca640 1 --2- 172.21.15.99:0/1681427429 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb6c070040 0x7fcb6c1134a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fcb6802a4a0 tx=0x7fcb68009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:09.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:09.526+0000 7fcb62ffd640 1 -- 172.21.15.99:0/1681427429 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb68038070 con 0x7fcb6c070040 2024-09-19T06:40:09.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:09.526+0000 7fcb62ffd640 1 -- 172.21.15.99:0/1681427429 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fcb680096e0 con 0x7fcb6c070040 2024-09-19T06:40:09.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:09.526+0000 7fcb62ffd640 1 -- 172.21.15.99:0/1681427429 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb6803d960 con 0x7fcb6c070040 2024-09-19T06:40:09.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:09.527+0000 7fcb7432e640 1 -- 172.21.15.99:0/1681427429 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb6c114a80 con 0x7fcb6c070040 2024-09-19T06:40:09.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:09.527+0000 7fcb7432e640 1 -- 172.21.15.99:0/1681427429 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb6c114f00 con 0x7fcb6c070040 2024-09-19T06:40:09.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:09.528+0000 7fcb62ffd640 1 -- 172.21.15.99:0/1681427429 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 21) v1 ==== 45992+0+0 (secure 0 0 0) 0x7fcb68030020 con 0x7fcb6c070040 2024-09-19T06:40:09.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:09.528+0000 7fcb7432e640 1 -- 172.21.15.99:0/1681427429 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb6c0fb9b0 con 0x7fcb6c070040 2024-09-19T06:40:09.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:09.529+0000 7fcb62ffd640 1 -- 172.21.15.99:0/1681427429 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fcb6806cca0 con 0x7fcb6c070040 2024-09-19T06:40:09.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:09.540+0000 7fcb62ffd640 1 -- 172.21.15.99:0/1681427429 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fcb68032d50 con 0x7fcb6c070040 2024-09-19T06:40:10.080 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:09 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:40:10.080 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:09 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:40:10.080 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:09 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:40:10.080 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:09 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:40:10.080 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:09 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:40:10.081 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:09 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:40:10.081 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:09 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mgr fail", "who": "smithi099.pgvkqi"}]: dispatch 2024-09-19T06:40:10.081 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:09 smithi117 ceph-mon[34564]: Activating manager daemon smithi117.ssmkcf 2024-09-19T06:40:10.081 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:09 smithi117 ceph-mon[34564]: osdmap e46: 6 total, 6 up, 6 in 2024-09-19T06:40:10.081 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:09 smithi117 ceph-mon[34564]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "mgr fail", "who": "smithi099.pgvkqi"}]': finished 2024-09-19T06:40:10.081 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:09 smithi117 ceph-mon[34564]: mgrmap e21: smithi117.ssmkcf(active, starting, since 0.00675994s) 2024-09-19T06:40:10.081 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:09 smithi117 ceph-mon[34564]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "mon metadata", "id": "smithi099"}]: dispatch 2024-09-19T06:40:10.081 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:09 smithi117 ceph-mon[34564]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "mon metadata", "id": "smithi117"}]: dispatch 2024-09-19T06:40:10.081 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:09 smithi117 ceph-mon[34564]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi099.xehbxe"}]: dispatch 2024-09-19T06:40:10.081 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:09 smithi117 ceph-mon[34564]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi099.obarqf"}]: dispatch 2024-09-19T06:40:10.081 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:09 smithi117 ceph-mon[34564]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi117.nooexo"}]: dispatch 2024-09-19T06:40:10.081 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:09 smithi117 ceph-mon[34564]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi117.bheqzh"}]: dispatch 2024-09-19T06:40:10.081 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:09 smithi117 ceph-mon[34564]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "mgr metadata", "who": "smithi117.ssmkcf", "id": "smithi117.ssmkcf"}]: dispatch 2024-09-19T06:40:10.082 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:09 smithi117 ceph-mon[34564]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:40:10.082 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:09 smithi117 ceph-mon[34564]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:40:10.082 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:09 smithi117 ceph-mon[34564]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:40:10.082 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:09 smithi117 ceph-mon[34564]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:40:10.082 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:09 smithi117 ceph-mon[34564]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:40:10.082 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:09 smithi117 ceph-mon[34564]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:40:10.082 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:09 smithi117 ceph-mon[34564]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T06:40:10.082 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:09 smithi117 ceph-mon[34564]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T06:40:10.082 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:09 smithi117 ceph-mon[34564]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T06:40:10.082 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:09 smithi117 ceph-mon[34564]: Manager daemon smithi117.ssmkcf is now available 2024-09-19T06:40:10.082 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:09 smithi117 ceph-mon[34564]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:40:10.082 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:09 smithi117 ceph-mon[34564]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:40:10.082 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:09 smithi117 ceph-mon[34564]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:40:10.083 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:09 smithi117 ceph-mon[34564]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:40:10.083 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:09 smithi117 ceph-mon[34564]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:40:10.083 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:09 smithi117 ceph-mon[34564]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi117.ssmkcf/mirror_snapshot_schedule"}]: dispatch 2024-09-19T06:40:10.083 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:09 smithi117 ceph-mon[34564]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi117.ssmkcf/mirror_snapshot_schedule"}]: dispatch 2024-09-19T06:40:10.083 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:09 smithi117 ceph-mon[34564]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi117.ssmkcf/trash_purge_schedule"}]: dispatch 2024-09-19T06:40:10.083 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:09 smithi117 ceph-mon[34564]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi117.ssmkcf/trash_purge_schedule"}]: dispatch 2024-09-19T06:40:10.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.079+0000 7fcb62ffd640 1 -- 172.21.15.99:0/1681427429 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mgrmap(e 22) v1 ==== 46119+0+0 (secure 0 0 0) 0x7fcb6802fd70 con 0x7fcb6c070040 2024-09-19T06:40:10.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.080+0000 7fcb62ffd640 1 --2- 172.21.15.99:0/1681427429 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7fcb5803df50 0x7fcb58040330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:10.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.080+0000 7fcb62ffd640 1 -- 172.21.15.99:0/1681427429 --> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcb58040870 con 0x7fcb5803df50 2024-09-19T06:40:10.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.083+0000 7fcb718c9640 1 --2- 172.21.15.99:0/1681427429 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7fcb5803df50 0x7fcb58040330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:10.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.084+0000 7fcb718c9640 1 --2- 172.21.15.99:0/1681427429 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7fcb5803df50 0x7fcb58040330 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c113250 tx=0x7fcb5c00b040 comp rx=0 tx=0).ready entity=mgr.24369 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:10.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.086+0000 7fcb62ffd640 1 -- 172.21.15.99:0/1681427429 <== mgr.24369 v2:172.21.15.117:6828/1735340892 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7fcb58040870 con 0x7fcb5803df50 2024-09-19T06:40:10.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.090+0000 7fcb7432e640 1 -- 172.21.15.99:0/1681427429 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7fcb5803df50 msgr2=0x7fcb58040330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:10.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.090+0000 7fcb7432e640 1 --2- 172.21.15.99:0/1681427429 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7fcb5803df50 0x7fcb58040330 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c113250 tx=0x7fcb5c00b040 comp rx=0 tx=0).stop 2024-09-19T06:40:10.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.090+0000 7fcb7432e640 1 -- 172.21.15.99:0/1681427429 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb6c070040 msgr2=0x7fcb6c1134a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:10.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.090+0000 7fcb7432e640 1 --2- 172.21.15.99:0/1681427429 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb6c070040 0x7fcb6c1134a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fcb6802a4a0 tx=0x7fcb68009da0 comp rx=0 tx=0).stop 2024-09-19T06:40:10.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.090+0000 7fcb7432e640 1 -- 172.21.15.99:0/1681427429 shutdown_connections 2024-09-19T06:40:10.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.090+0000 7fcb7432e640 1 --2- 172.21.15.99:0/1681427429 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7fcb5803df50 0x7fcb58040330 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:10.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.090+0000 7fcb7432e640 1 --2- 172.21.15.99:0/1681427429 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcb6c0715d0 0x7fcb6c1139e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:10.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.090+0000 7fcb7432e640 1 --2- 172.21.15.99:0/1681427429 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb6c070040 0x7fcb6c1134a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:10.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.090+0000 7fcb7432e640 1 -- 172.21.15.99:0/1681427429 >> 172.21.15.99:0/1681427429 conn(0x7fcb6c0f7d30 msgr2=0x7fcb6c0f9300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:10.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.090+0000 7fcb7432e640 1 -- 172.21.15.99:0/1681427429 shutdown_connections 2024-09-19T06:40:10.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.090+0000 7fcb7432e640 1 -- 172.21.15.99:0/1681427429 wait complete. 2024-09-19T06:40:10.105 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-09-19T06:40:10.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:09 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:40:10.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:09 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:40:10.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:09 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:40:10.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:09 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:40:10.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:09 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:40:10.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:09 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:40:10.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:09 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mgr fail", "who": "smithi099.pgvkqi"}]: dispatch 2024-09-19T06:40:10.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:09 smithi099 ceph-mon[27651]: Activating manager daemon smithi117.ssmkcf 2024-09-19T06:40:10.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:09 smithi099 ceph-mon[27651]: osdmap e46: 6 total, 6 up, 6 in 2024-09-19T06:40:10.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:09 smithi099 ceph-mon[27651]: from='mgr.14206 172.21.15.99:0/3988715518' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "mgr fail", "who": "smithi099.pgvkqi"}]': finished 2024-09-19T06:40:10.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:09 smithi099 ceph-mon[27651]: mgrmap e21: smithi117.ssmkcf(active, starting, since 0.00675994s) 2024-09-19T06:40:10.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:09 smithi099 ceph-mon[27651]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "mon metadata", "id": "smithi099"}]: dispatch 2024-09-19T06:40:10.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:09 smithi099 ceph-mon[27651]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "mon metadata", "id": "smithi117"}]: dispatch 2024-09-19T06:40:10.208 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:09 smithi099 ceph-mon[27651]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi099.xehbxe"}]: dispatch 2024-09-19T06:40:10.208 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:09 smithi099 ceph-mon[27651]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi099.obarqf"}]: dispatch 2024-09-19T06:40:10.208 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:09 smithi099 ceph-mon[27651]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi117.nooexo"}]: dispatch 2024-09-19T06:40:10.208 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:09 smithi099 ceph-mon[27651]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi117.bheqzh"}]: dispatch 2024-09-19T06:40:10.208 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:09 smithi099 ceph-mon[27651]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "mgr metadata", "who": "smithi117.ssmkcf", "id": "smithi117.ssmkcf"}]: dispatch 2024-09-19T06:40:10.208 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:09 smithi099 ceph-mon[27651]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:40:10.208 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:09 smithi099 ceph-mon[27651]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:40:10.208 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:09 smithi099 ceph-mon[27651]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:40:10.208 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:09 smithi099 ceph-mon[27651]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:40:10.208 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:09 smithi099 ceph-mon[27651]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:40:10.208 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:09 smithi099 ceph-mon[27651]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:40:10.208 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:09 smithi099 ceph-mon[27651]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T06:40:10.208 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:09 smithi099 ceph-mon[27651]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T06:40:10.209 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:09 smithi099 ceph-mon[27651]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T06:40:10.209 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:09 smithi099 ceph-mon[27651]: Manager daemon smithi117.ssmkcf is now available 2024-09-19T06:40:10.209 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:09 smithi099 ceph-mon[27651]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:40:10.209 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:09 smithi099 ceph-mon[27651]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:40:10.209 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:09 smithi099 ceph-mon[27651]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:40:10.209 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:09 smithi099 ceph-mon[27651]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:40:10.209 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:09 smithi099 ceph-mon[27651]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:40:10.209 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:09 smithi099 ceph-mon[27651]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi117.ssmkcf/mirror_snapshot_schedule"}]: dispatch 2024-09-19T06:40:10.209 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:09 smithi099 ceph-mon[27651]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi117.ssmkcf/mirror_snapshot_schedule"}]: dispatch 2024-09-19T06:40:10.209 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:09 smithi099 ceph-mon[27651]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi117.ssmkcf/trash_purge_schedule"}]: dispatch 2024-09-19T06:40:10.209 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:09 smithi099 ceph-mon[27651]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi117.ssmkcf/trash_purge_schedule"}]: dispatch 2024-09-19T06:40:10.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.214+0000 7f25b8866640 1 -- 172.21.15.99:0/1886533711 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f25b4065be0 msgr2=0x7f25b40ff1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:10.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.214+0000 7f25b8866640 1 --2- 172.21.15.99:0/1886533711 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f25b4065be0 0x7f25b40ff1a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f25a40048d0 tx=0x7f25a4009da0 comp rx=0 tx=0).stop 2024-09-19T06:40:10.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.214+0000 7f25b8866640 1 -- 172.21.15.99:0/1886533711 shutdown_connections 2024-09-19T06:40:10.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.214+0000 7f25b8866640 1 --2- 172.21.15.99:0/1886533711 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25b40ff6e0 0x7f25b4101ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:10.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.214+0000 7f25b8866640 1 --2- 172.21.15.99:0/1886533711 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f25b4065be0 0x7f25b40ff1a0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:10.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.214+0000 7f25b8866640 1 -- 172.21.15.99:0/1886533711 >> 172.21.15.99:0/1886533711 conn(0x7f25b40f6c10 msgr2=0x7f25b40f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:10.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.215+0000 7f25b8866640 1 -- 172.21.15.99:0/1886533711 shutdown_connections 2024-09-19T06:40:10.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.215+0000 7f25b8866640 1 -- 172.21.15.99:0/1886533711 wait complete. 2024-09-19T06:40:10.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.215+0000 7f25b8866640 1 Processor -- start 2024-09-19T06:40:10.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.215+0000 7f25b8866640 1 -- start start 2024-09-19T06:40:10.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.216+0000 7f25b8866640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f25b4065be0 0x7f25b4113530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:10.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.216+0000 7f25b8866640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25b40ff6e0 0x7f25b4113a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:10.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.216+0000 7f25b8866640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b41140c0 con 0x7f25b4065be0 2024-09-19T06:40:10.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.216+0000 7f25b8866640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b41148e0 con 0x7f25b40ff6e0 2024-09-19T06:40:10.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.216+0000 7f25b259c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f25b4065be0 0x7f25b4113530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:10.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.216+0000 7f25b259c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f25b4065be0 0x7f25b4113530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56182/0 (socket says 172.21.15.99:56182) 2024-09-19T06:40:10.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.216+0000 7f25b259c640 1 -- 172.21.15.99:0/2047565948 learned_addr learned my addr 172.21.15.99:0/2047565948 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:40:10.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.216+0000 7f25b1d9b640 1 --2- 172.21.15.99:0/2047565948 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25b40ff6e0 0x7f25b4113a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:10.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.217+0000 7f25b259c640 1 -- 172.21.15.99:0/2047565948 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25b40ff6e0 msgr2=0x7f25b4113a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:10.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.217+0000 7f25b259c640 1 --2- 172.21.15.99:0/2047565948 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25b40ff6e0 0x7f25b4113a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:10.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.217+0000 7f25b259c640 1 -- 172.21.15.99:0/2047565948 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a4005040 con 0x7f25b4065be0 2024-09-19T06:40:10.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.217+0000 7f25b259c640 1 --2- 172.21.15.99:0/2047565948 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f25b4065be0 0x7f25b4113530 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f25a40043d0 tx=0x7f25a4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:10.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.217+0000 7f25a2ffd640 1 -- 172.21.15.99:0/2047565948 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25a4038070 con 0x7f25b4065be0 2024-09-19T06:40:10.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.217+0000 7f25a2ffd640 1 -- 172.21.15.99:0/2047565948 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f25a4032b50 con 0x7f25b4065be0 2024-09-19T06:40:10.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.217+0000 7f25b8866640 1 -- 172.21.15.99:0/2047565948 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25b4114b10 con 0x7f25b4065be0 2024-09-19T06:40:10.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.217+0000 7f25a2ffd640 1 -- 172.21.15.99:0/2047565948 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25a4033b00 con 0x7f25b4065be0 2024-09-19T06:40:10.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.217+0000 7f25b8866640 1 -- 172.21.15.99:0/2047565948 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25b4114fd0 con 0x7f25b4065be0 2024-09-19T06:40:10.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.219+0000 7f25a2ffd640 1 -- 172.21.15.99:0/2047565948 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 22) v1 ==== 46119+0+0 (secure 0 0 0) 0x7f25a4030020 con 0x7f25b4065be0 2024-09-19T06:40:10.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.219+0000 7f25b8866640 1 -- 172.21.15.99:0/2047565948 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25b40fa890 con 0x7f25b4065be0 2024-09-19T06:40:10.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.219+0000 7f25a2ffd640 1 --2- 172.21.15.99:0/2047565948 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7f259c038ca0 0x7f259c03b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:10.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.219+0000 7f25a2ffd640 1 -- 172.21.15.99:0/2047565948 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f25a406c900 con 0x7f25b4065be0 2024-09-19T06:40:10.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.219+0000 7f25b1d9b640 1 --2- 172.21.15.99:0/2047565948 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7f259c038ca0 0x7f259c03b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:10.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.220+0000 7f25b1d9b640 1 --2- 172.21.15.99:0/2047565948 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7f259c038ca0 0x7f259c03b150 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f25b41132e0 tx=0x7f25a800b040 comp rx=0 tx=0).ready entity=mgr.24369 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:10.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.228+0000 7f25a2ffd640 1 -- 172.21.15.99:0/2047565948 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f25a40302d0 con 0x7f25b4065be0 2024-09-19T06:40:10.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.501+0000 7f25b8866640 1 -- 172.21.15.99:0/2047565948 --> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f25b41153a0 con 0x7f259c038ca0 2024-09-19T06:40:10.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.518+0000 7f25a2ffd640 1 -- 172.21.15.99:0/2047565948 <== mgr.24369 v2:172.21.15.117:6828/1735340892 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f25b41153a0 con 0x7f259c038ca0 2024-09-19T06:40:10.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.520+0000 7f25b8866640 1 -- 172.21.15.99:0/2047565948 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7f259c038ca0 msgr2=0x7f259c03b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:10.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.520+0000 7f25b8866640 1 --2- 172.21.15.99:0/2047565948 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7f259c038ca0 0x7f259c03b150 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f25b41132e0 tx=0x7f25a800b040 comp rx=0 tx=0).stop 2024-09-19T06:40:10.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.520+0000 7f25b8866640 1 -- 172.21.15.99:0/2047565948 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f25b4065be0 msgr2=0x7f25b4113530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:10.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.520+0000 7f25b8866640 1 --2- 172.21.15.99:0/2047565948 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f25b4065be0 0x7f25b4113530 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f25a40043d0 tx=0x7f25a4009da0 comp rx=0 tx=0).stop 2024-09-19T06:40:10.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.520+0000 7f25b8866640 1 -- 172.21.15.99:0/2047565948 shutdown_connections 2024-09-19T06:40:10.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.520+0000 7f25b8866640 1 --2- 172.21.15.99:0/2047565948 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7f259c038ca0 0x7f259c03b150 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:10.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.520+0000 7f25b8866640 1 --2- 172.21.15.99:0/2047565948 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25b40ff6e0 0x7f25b4113a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:10.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.520+0000 7f25b8866640 1 --2- 172.21.15.99:0/2047565948 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f25b4065be0 0x7f25b4113530 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:10.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.520+0000 7f25b8866640 1 -- 172.21.15.99:0/2047565948 >> 172.21.15.99:0/2047565948 conn(0x7f25b40f6c10 msgr2=0x7f25b40fb1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:10.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.520+0000 7f25b8866640 1 -- 172.21.15.99:0/2047565948 shutdown_connections 2024-09-19T06:40:10.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.520+0000 7f25b8866640 1 -- 172.21.15.99:0/2047565948 wait complete. 2024-09-19T06:40:10.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.615+0000 7f633d206640 1 -- 172.21.15.99:0/1794474971 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63380fd7f0 msgr2=0x7f63380fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:10.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.615+0000 7f633d206640 1 --2- 172.21.15.99:0/1794474971 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63380fd7f0 0x7f63380fdc60 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f632c0048d0 tx=0x7f632c009da0 comp rx=0 tx=0).stop 2024-09-19T06:40:10.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.615+0000 7f633d206640 1 -- 172.21.15.99:0/1794474971 shutdown_connections 2024-09-19T06:40:10.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.615+0000 7f633d206640 1 --2- 172.21.15.99:0/1794474971 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63380fd7f0 0x7f63380fdc60 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:10.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.615+0000 7f633d206640 1 --2- 172.21.15.99:0/1794474971 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63380fc520 0x7f63380fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:10.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.615+0000 7f633d206640 1 -- 172.21.15.99:0/1794474971 >> 172.21.15.99:0/1794474971 conn(0x7f63380f7ce0 msgr2=0x7f63380fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:10.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.615+0000 7f633d206640 1 -- 172.21.15.99:0/1794474971 shutdown_connections 2024-09-19T06:40:10.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.615+0000 7f633d206640 1 -- 172.21.15.99:0/1794474971 wait complete. 2024-09-19T06:40:10.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.616+0000 7f633d206640 1 Processor -- start 2024-09-19T06:40:10.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.616+0000 7f633d206640 1 -- start start 2024-09-19T06:40:10.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.616+0000 7f633d206640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63380fc520 0x7f6338113680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:10.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.616+0000 7f633d206640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63380fd7f0 0x7f6338113bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:10.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.616+0000 7f633d206640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6338114210 con 0x7f63380fd7f0 2024-09-19T06:40:10.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.616+0000 7f633d206640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6338114a30 con 0x7f63380fc520 2024-09-19T06:40:10.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.616+0000 7f633659c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63380fd7f0 0x7f6338113bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:10.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.616+0000 7f633659c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63380fd7f0 0x7f6338113bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56192/0 (socket says 172.21.15.99:56192) 2024-09-19T06:40:10.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.616+0000 7f633659c640 1 -- 172.21.15.99:0/2409835851 learned_addr learned my addr 172.21.15.99:0/2409835851 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:40:10.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.616+0000 7f6336d9d640 1 --2- 172.21.15.99:0/2409835851 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63380fc520 0x7f6338113680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:10.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.617+0000 7f633659c640 1 -- 172.21.15.99:0/2409835851 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63380fc520 msgr2=0x7f6338113680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:10.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.617+0000 7f633659c640 1 --2- 172.21.15.99:0/2409835851 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63380fc520 0x7f6338113680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:10.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.617+0000 7f633659c640 1 -- 172.21.15.99:0/2409835851 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f632c005040 con 0x7f63380fd7f0 2024-09-19T06:40:10.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.617+0000 7f633659c640 1 --2- 172.21.15.99:0/2409835851 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63380fd7f0 0x7f6338113bc0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f632c0043d0 tx=0x7f632c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:10.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.617+0000 7f631f7fe640 1 -- 172.21.15.99:0/2409835851 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f632c038070 con 0x7f63380fd7f0 2024-09-19T06:40:10.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.617+0000 7f633d206640 1 -- 172.21.15.99:0/2409835851 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6338114c60 con 0x7f63380fd7f0 2024-09-19T06:40:10.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.617+0000 7f631f7fe640 1 -- 172.21.15.99:0/2409835851 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f632c02ae90 con 0x7f63380fd7f0 2024-09-19T06:40:10.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.617+0000 7f631f7fe640 1 -- 172.21.15.99:0/2409835851 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f632c03e670 con 0x7f63380fd7f0 2024-09-19T06:40:10.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.617+0000 7f633d206640 1 -- 172.21.15.99:0/2409835851 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6338115200 con 0x7f63380fd7f0 2024-09-19T06:40:10.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.619+0000 7f633d206640 1 -- 172.21.15.99:0/2409835851 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63380fb980 con 0x7f63380fd7f0 2024-09-19T06:40:10.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.619+0000 7f631f7fe640 1 -- 172.21.15.99:0/2409835851 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 22) v1 ==== 46119+0+0 (secure 0 0 0) 0x7f632c030020 con 0x7f63380fd7f0 2024-09-19T06:40:10.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.619+0000 7f631f7fe640 1 --2- 172.21.15.99:0/2409835851 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7f6320038ca0 0x7f632003b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:10.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.619+0000 7f631f7fe640 1 -- 172.21.15.99:0/2409835851 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f632c06ca20 con 0x7f63380fd7f0 2024-09-19T06:40:10.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.619+0000 7f6336d9d640 1 --2- 172.21.15.99:0/2409835851 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7f6320038ca0 0x7f632003b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:10.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.621+0000 7f6336d9d640 1 --2- 172.21.15.99:0/2409835851 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7f6320038ca0 0x7f632003b150 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6328004eb0 tx=0x7f632800b040 comp rx=0 tx=0).ready entity=mgr.24369 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:10.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.624+0000 7f631f7fe640 1 -- 172.21.15.99:0/2409835851 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f632c02c3a0 con 0x7f63380fd7f0 2024-09-19T06:40:10.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.884+0000 7f633d206640 1 -- 172.21.15.99:0/2409835851 --> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6338115420 con 0x7f6320038ca0 2024-09-19T06:40:10.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.905+0000 7f631f7fe640 1 -- 172.21.15.99:0/2409835851 <== mgr.24369 v2:172.21.15.117:6828/1735340892 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f6338115420 con 0x7f6320038ca0 2024-09-19T06:40:10.906 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T06:40:10.907 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.smithi099 smithi099 *:9093,9094 running (6m) 2m ago 7m 25.3M - 0.25.0 c8568f914cd2 586edf6f2401 2024-09-19T06:40:10.907 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi099 smithi099 running (7m) 2m ago 7m 6895k - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 216ce2ef7f1e 2024-09-19T06:40:10.907 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi117 smithi117 running (6m) 6s ago 6m 6899k - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 b4c328bdec52 2024-09-19T06:40:10.907 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.smithi099 smithi099 *:3000 running (6m) 2m ago 7m 86.9M - 9.4.7 954c08fa6188 94ad8b9b7c91 2024-09-19T06:40:10.907 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.obarqf smithi099 running (2m) 2m ago 2m 10.8M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 e36c9b74004b 2024-09-19T06:40:10.907 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.xehbxe smithi099 running (2m) 2m ago 2m 17.3M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 d09eb3d306ae 2024-09-19T06:40:10.907 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.bheqzh smithi117 running (2m) 6s ago 2m 13.0M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 21253e27fdd3 2024-09-19T06:40:10.907 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.nooexo smithi117 running (2m) 6s ago 2m 25.8M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 ad1faeb3343c 2024-09-19T06:40:10.907 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi099.pgvkqi smithi099 *:9283,8765,8443 running (8m) 2m ago 8m 448M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 8e7ecb77f4cd 2024-09-19T06:40:10.907 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi117.ssmkcf smithi117 *:8443,9283 running (30s) 6s ago 6m 106M - 19.1.1-361-g2f599a46 d2baa855c067 e6f8e1afc98a 2024-09-19T06:40:10.907 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi099 smithi099 running (8m) 2m ago 9m 49.4M 2048M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 7375c241d067 2024-09-19T06:40:10.907 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi117 smithi117 running (6m) 6s ago 6m 36.9M 2048M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 bd4854d5213e 2024-09-19T06:40:10.907 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi099 smithi099 *:9100 running (7m) 2m ago 7m 14.6M - 1.5.0 0da6a335fe13 09c786facf49 2024-09-19T06:40:10.908 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi117 smithi117 *:9100 running (6m) 6s ago 6m 16.8M - 1.5.0 0da6a335fe13 04f52626cbca 2024-09-19T06:40:10.908 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (5m) 2m ago 5m 46.0M 4288M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 cf8d3dd4a987 2024-09-19T06:40:10.908 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (5m) 2m ago 5m 45.1M 4288M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 bc5b04b8bf9f 2024-09-19T06:40:10.908 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (5m) 2m ago 5m 43.3M 4288M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 cedc7e3698d8 2024-09-19T06:40:10.908 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi117 running (4m) 6s ago 4m 76.5M 5312M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 5984ed999c91 2024-09-19T06:40:10.908 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi117 running (4m) 6s ago 4m 72.7M 5312M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 6a2fc0c51c05 2024-09-19T06:40:10.908 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi117 running (3m) 6s ago 3m 70.5M 5312M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 39dcb7dbf0e3 2024-09-19T06:40:10.908 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.smithi099 smithi099 *:9095 running (6m) 2m ago 7m 54.2M - 2.43.0 a07b618ecd1d 82e83626cde9 2024-09-19T06:40:10.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.908+0000 7f633d206640 1 -- 172.21.15.99:0/2409835851 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7f6320038ca0 msgr2=0x7f632003b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:10.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.908+0000 7f633d206640 1 --2- 172.21.15.99:0/2409835851 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7f6320038ca0 0x7f632003b150 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6328004eb0 tx=0x7f632800b040 comp rx=0 tx=0).stop 2024-09-19T06:40:10.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.908+0000 7f633d206640 1 -- 172.21.15.99:0/2409835851 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63380fd7f0 msgr2=0x7f6338113bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:10.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.908+0000 7f633d206640 1 --2- 172.21.15.99:0/2409835851 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63380fd7f0 0x7f6338113bc0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f632c0043d0 tx=0x7f632c009da0 comp rx=0 tx=0).stop 2024-09-19T06:40:10.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.908+0000 7f633d206640 1 -- 172.21.15.99:0/2409835851 shutdown_connections 2024-09-19T06:40:10.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.908+0000 7f633d206640 1 --2- 172.21.15.99:0/2409835851 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7f6320038ca0 0x7f632003b150 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:10.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.908+0000 7f633d206640 1 --2- 172.21.15.99:0/2409835851 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63380fd7f0 0x7f6338113bc0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:10.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.908+0000 7f633d206640 1 --2- 172.21.15.99:0/2409835851 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63380fc520 0x7f6338113680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:10.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.908+0000 7f633d206640 1 -- 172.21.15.99:0/2409835851 >> 172.21.15.99:0/2409835851 conn(0x7f63380f7ce0 msgr2=0x7f63380f9310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:10.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.908+0000 7f633d206640 1 -- 172.21.15.99:0/2409835851 shutdown_connections 2024-09-19T06:40:10.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:10.908+0000 7f633d206640 1 -- 172.21.15.99:0/2409835851 wait complete. 2024-09-19T06:40:11.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.017+0000 7fedf8c46640 1 -- 172.21.15.99:0/484700873 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fedf40fb440 msgr2=0x7fedf40fb850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:11.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.017+0000 7fedf8c46640 1 --2- 172.21.15.99:0/484700873 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fedf40fb440 0x7fedf40fb850 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fede40048d0 tx=0x7fede4009da0 comp rx=0 tx=0).stop 2024-09-19T06:40:11.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.017+0000 7fedf8c46640 1 -- 172.21.15.99:0/484700873 shutdown_connections 2024-09-19T06:40:11.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.017+0000 7fedf8c46640 1 --2- 172.21.15.99:0/484700873 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fedf40fc710 0x7fedf40fcb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:11.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.017+0000 7fedf8c46640 1 --2- 172.21.15.99:0/484700873 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fedf40fb440 0x7fedf40fb850 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:11.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.017+0000 7fedf8c46640 1 -- 172.21.15.99:0/484700873 >> 172.21.15.99:0/484700873 conn(0x7fedf40f6c20 msgr2=0x7fedf40f9030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:11.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.018+0000 7fedf8c46640 1 -- 172.21.15.99:0/484700873 shutdown_connections 2024-09-19T06:40:11.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.018+0000 7fedf8c46640 1 -- 172.21.15.99:0/484700873 wait complete. 2024-09-19T06:40:11.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.019+0000 7fedf8c46640 1 Processor -- start 2024-09-19T06:40:11.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.019+0000 7fedf8c46640 1 -- start start 2024-09-19T06:40:11.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.019+0000 7fedf8c46640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fedf40fb440 0x7fedf410bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:11.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.019+0000 7fedf8c46640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fedf40fc710 0x7fedf410c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:11.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.019+0000 7fedf8c46640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf410cb50 con 0x7fedf40fc710 2024-09-19T06:40:11.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.019+0000 7fedf8c46640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf410d370 con 0x7fedf40fb440 2024-09-19T06:40:11.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.020+0000 7fedf259c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fedf40fb440 0x7fedf410bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:11.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.020+0000 7fedf1d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fedf40fc710 0x7fedf410c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:11.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.020+0000 7fedf1d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fedf40fc710 0x7fedf410c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56214/0 (socket says 172.21.15.99:56214) 2024-09-19T06:40:11.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.020+0000 7fedf1d9b640 1 -- 172.21.15.99:0/3817682507 learned_addr learned my addr 172.21.15.99:0/3817682507 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:40:11.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.020+0000 7fedf259c640 1 -- 172.21.15.99:0/3817682507 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fedf40fc710 msgr2=0x7fedf410c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:11.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.020+0000 7fedf259c640 1 --2- 172.21.15.99:0/3817682507 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fedf40fc710 0x7fedf410c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:11.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.020+0000 7fedf259c640 1 -- 172.21.15.99:0/3817682507 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fede8005040 con 0x7fedf40fb440 2024-09-19T06:40:11.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.020+0000 7fedf1d9b640 1 --2- 172.21.15.99:0/3817682507 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fedf40fc710 0x7fedf410c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:40:11.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.020+0000 7fedf259c640 1 --2- 172.21.15.99:0/3817682507 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fedf40fb440 0x7fedf410bfc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fede40048d0 tx=0x7fede4009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:11.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.020+0000 7fede2ffd640 1 -- 172.21.15.99:0/3817682507 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fede4038070 con 0x7fedf40fb440 2024-09-19T06:40:11.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.021+0000 7fedf8c46640 1 -- 172.21.15.99:0/3817682507 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fede4005040 con 0x7fedf40fb440 2024-09-19T06:40:11.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.021+0000 7fede2ffd640 1 -- 172.21.15.99:0/3817682507 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fede402ae90 con 0x7fedf40fb440 2024-09-19T06:40:11.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.021+0000 7fedf8c46640 1 -- 172.21.15.99:0/3817682507 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedf410d950 con 0x7fedf40fb440 2024-09-19T06:40:11.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.021+0000 7fede2ffd640 1 -- 172.21.15.99:0/3817682507 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fede403e430 con 0x7fedf40fb440 2024-09-19T06:40:11.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.022+0000 7fedf8c46640 1 -- 172.21.15.99:0/3817682507 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedf40fa8a0 con 0x7fedf40fb440 2024-09-19T06:40:11.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.022+0000 7fede2ffd640 1 -- 172.21.15.99:0/3817682507 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 22) v1 ==== 46119+0+0 (secure 0 0 0) 0x7fede4030020 con 0x7fedf40fb440 2024-09-19T06:40:11.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.023+0000 7fede2ffd640 1 --2- 172.21.15.99:0/3817682507 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7feddc038ca0 0x7feddc03b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:11.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.023+0000 7fede2ffd640 1 -- 172.21.15.99:0/3817682507 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fede406c720 con 0x7fedf40fb440 2024-09-19T06:40:11.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.023+0000 7fedf1d9b640 1 --2- 172.21.15.99:0/3817682507 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7feddc038ca0 0x7feddc03b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:11.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.024+0000 7fedf1d9b640 1 --2- 172.21.15.99:0/3817682507 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7feddc038ca0 0x7feddc03b150 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fedf410bd70 tx=0x7fede800b040 comp rx=0 tx=0).ready entity=mgr.24369 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:11.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.030+0000 7fede2ffd640 1 -- 172.21.15.99:0/3817682507 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7fede4033e60 con 0x7fedf40fb440 2024-09-19T06:40:11.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:11 smithi099 ceph-mon[27651]: Checking for cert/key for grafana.smithi099 2024-09-19T06:40:11.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:11 smithi099 ceph-mon[27651]: Migrating grafana.smithi099 cert to cert store 2024-09-19T06:40:11.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:11 smithi099 ceph-mon[27651]: Migrating grafana.smithi099 key to cert store 2024-09-19T06:40:11.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:11 smithi099 ceph-mon[27651]: mgrmap e22: smithi117.ssmkcf(active, since 1.03582s) 2024-09-19T06:40:11.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:11 smithi099 ceph-mon[27651]: from='client.24381 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:40:11.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:11 smithi099 ceph-mon[27651]: pgmap v3: 65 pgs: 65 active+clean; 168 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:40:11.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:11 smithi099 ceph-mon[27651]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:40:11.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:11 smithi099 ceph-mon[27651]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:40:11.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.445+0000 7fedf8c46640 1 -- 172.21.15.99:0/3817682507 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fedf410dda0 con 0x7fedf40fb440 2024-09-19T06:40:11.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.446+0000 7fede2ffd640 1 -- 172.21.15.99:0/3817682507 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+747 (secure 0 0 0) 0x7fede403d390 con 0x7fedf40fb440 2024-09-19T06:40:11.448 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:40:11.448 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-09-19T06:40:11.448 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 2 2024-09-19T06:40:11.448 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:40:11.448 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-09-19T06:40:11.448 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 1 2024-09-19T06:40:11.448 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:40:11.449 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-09-19T06:40:11.449 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 6 2024-09-19T06:40:11.449 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:40:11.449 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": { 2024-09-19T06:40:11.449 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 4 2024-09-19T06:40:11.449 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:40:11.449 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-09-19T06:40:11.449 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 12, 2024-09-19T06:40:11.449 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 1 2024-09-19T06:40:11.450 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T06:40:11.450 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:40:11.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.449+0000 7fedf8c46640 1 -- 172.21.15.99:0/3817682507 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7feddc038ca0 msgr2=0x7feddc03b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:11.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.449+0000 7fedf8c46640 1 --2- 172.21.15.99:0/3817682507 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7feddc038ca0 0x7feddc03b150 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fedf410bd70 tx=0x7fede800b040 comp rx=0 tx=0).stop 2024-09-19T06:40:11.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.449+0000 7fedf8c46640 1 -- 172.21.15.99:0/3817682507 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fedf40fb440 msgr2=0x7fedf410bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:11.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.449+0000 7fedf8c46640 1 --2- 172.21.15.99:0/3817682507 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fedf40fb440 0x7fedf410bfc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fede40048d0 tx=0x7fede4009da0 comp rx=0 tx=0).stop 2024-09-19T06:40:11.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.449+0000 7fedf8c46640 1 -- 172.21.15.99:0/3817682507 shutdown_connections 2024-09-19T06:40:11.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.449+0000 7fedf8c46640 1 --2- 172.21.15.99:0/3817682507 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7feddc038ca0 0x7feddc03b150 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:11.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.449+0000 7fedf8c46640 1 --2- 172.21.15.99:0/3817682507 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fedf40fc710 0x7fedf410c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:11.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.449+0000 7fedf8c46640 1 --2- 172.21.15.99:0/3817682507 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fedf40fb440 0x7fedf410bfc0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:11.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.449+0000 7fedf8c46640 1 -- 172.21.15.99:0/3817682507 >> 172.21.15.99:0/3817682507 conn(0x7fedf40f6c20 msgr2=0x7fedf40f8690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:11.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.450+0000 7fedf8c46640 1 -- 172.21.15.99:0/3817682507 shutdown_connections 2024-09-19T06:40:11.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.450+0000 7fedf8c46640 1 -- 172.21.15.99:0/3817682507 wait complete. 2024-09-19T06:40:11.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:11 smithi117 ceph-mon[34564]: Checking for cert/key for grafana.smithi099 2024-09-19T06:40:11.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:11 smithi117 ceph-mon[34564]: Migrating grafana.smithi099 cert to cert store 2024-09-19T06:40:11.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:11 smithi117 ceph-mon[34564]: Migrating grafana.smithi099 key to cert store 2024-09-19T06:40:11.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:11 smithi117 ceph-mon[34564]: mgrmap e22: smithi117.ssmkcf(active, since 1.03582s) 2024-09-19T06:40:11.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:11 smithi117 ceph-mon[34564]: from='client.24381 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:40:11.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:11 smithi117 ceph-mon[34564]: pgmap v3: 65 pgs: 65 active+clean; 168 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:40:11.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:11 smithi117 ceph-mon[34564]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:40:11.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:11 smithi117 ceph-mon[34564]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:40:11.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.565+0000 7ff234614640 1 -- 172.21.15.99:0/2635738102 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff22c0fc700 msgr2=0x7ff22c0fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:11.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.565+0000 7ff234614640 1 --2- 172.21.15.99:0/2635738102 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff22c0fc700 0x7ff22c0fcb70 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff21c0048d0 tx=0x7ff21c009da0 comp rx=0 tx=0).stop 2024-09-19T06:40:11.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.565+0000 7ff234614640 1 -- 172.21.15.99:0/2635738102 shutdown_connections 2024-09-19T06:40:11.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.565+0000 7ff234614640 1 --2- 172.21.15.99:0/2635738102 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff22c0fc700 0x7ff22c0fcb70 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:11.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.565+0000 7ff234614640 1 --2- 172.21.15.99:0/2635738102 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff22c0fb430 0x7ff22c0fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:11.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.565+0000 7ff234614640 1 -- 172.21.15.99:0/2635738102 >> 172.21.15.99:0/2635738102 conn(0x7ff22c0f6c10 msgr2=0x7ff22c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:11.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.565+0000 7ff234614640 1 -- 172.21.15.99:0/2635738102 shutdown_connections 2024-09-19T06:40:11.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.565+0000 7ff234614640 1 -- 172.21.15.99:0/2635738102 wait complete. 2024-09-19T06:40:11.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.566+0000 7ff234614640 1 Processor -- start 2024-09-19T06:40:11.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.566+0000 7ff234614640 1 -- start start 2024-09-19T06:40:11.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.566+0000 7ff234614640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff22c0fb430 0x7ff22c10bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:11.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.566+0000 7ff234614640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff22c0fc700 0x7ff22c10c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:11.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.566+0000 7ff234614640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff22c10cb10 con 0x7ff22c0fb430 2024-09-19T06:40:11.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.566+0000 7ff234614640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff22c10d330 con 0x7ff22c0fc700 2024-09-19T06:40:11.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.566+0000 7ff2323b0640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff22c0fb430 0x7ff22c10bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:11.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.566+0000 7ff231baf640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff22c0fc700 0x7ff22c10c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:11.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.566+0000 7ff2323b0640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff22c0fb430 0x7ff22c10bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56230/0 (socket says 172.21.15.99:56230) 2024-09-19T06:40:11.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.566+0000 7ff231baf640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff22c0fc700 0x7ff22c10c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.99:55722/0 (socket says 172.21.15.99:55722) 2024-09-19T06:40:11.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.566+0000 7ff2323b0640 1 -- 172.21.15.99:0/536448764 learned_addr learned my addr 172.21.15.99:0/536448764 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:40:11.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.566+0000 7ff2323b0640 1 -- 172.21.15.99:0/536448764 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff22c0fc700 msgr2=0x7ff22c10c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:11.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.566+0000 7ff2323b0640 1 --2- 172.21.15.99:0/536448764 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff22c0fc700 0x7ff22c10c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:11.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.567+0000 7ff2323b0640 1 -- 172.21.15.99:0/536448764 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff21c005040 con 0x7ff22c0fb430 2024-09-19T06:40:11.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.567+0000 7ff2323b0640 1 --2- 172.21.15.99:0/536448764 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff22c0fb430 0x7ff22c10bf80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff22800eb70 tx=0x7ff22800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:11.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.567+0000 7ff222ffd640 1 -- 172.21.15.99:0/536448764 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff228007c30 con 0x7ff22c0fb430 2024-09-19T06:40:11.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.567+0000 7ff234614640 1 -- 172.21.15.99:0/536448764 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff22c10d5b0 con 0x7ff22c0fb430 2024-09-19T06:40:11.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.567+0000 7ff222ffd640 1 -- 172.21.15.99:0/536448764 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff22800f040 con 0x7ff22c0fb430 2024-09-19T06:40:11.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.567+0000 7ff222ffd640 1 -- 172.21.15.99:0/536448764 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff22800ca60 con 0x7ff22c0fb430 2024-09-19T06:40:11.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.567+0000 7ff234614640 1 -- 172.21.15.99:0/536448764 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff22c10dad0 con 0x7ff22c0fb430 2024-09-19T06:40:11.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.568+0000 7ff234614640 1 -- 172.21.15.99:0/536448764 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff22c0fa890 con 0x7ff22c0fb430 2024-09-19T06:40:11.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.569+0000 7ff222ffd640 1 -- 172.21.15.99:0/536448764 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 22) v1 ==== 46119+0+0 (secure 0 0 0) 0x7ff22800cbc0 con 0x7ff22c0fb430 2024-09-19T06:40:11.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.569+0000 7ff222ffd640 1 --2- 172.21.15.99:0/536448764 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7ff218038ca0 0x7ff21803b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:11.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.569+0000 7ff222ffd640 1 -- 172.21.15.99:0/536448764 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7ff22804c470 con 0x7ff22c0fb430 2024-09-19T06:40:11.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.569+0000 7ff231baf640 1 --2- 172.21.15.99:0/536448764 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7ff218038ca0 0x7ff21803b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:11.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.570+0000 7ff231baf640 1 --2- 172.21.15.99:0/536448764 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7ff218038ca0 0x7ff21803b150 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff21c007ac0 tx=0x7ff21c039040 comp rx=0 tx=0).ready entity=mgr.24369 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:11.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.574+0000 7ff222ffd640 1 -- 172.21.15.99:0/536448764 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7ff228012930 con 0x7ff22c0fb430 2024-09-19T06:40:11.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.979+0000 7ff234614640 1 -- 172.21.15.99:0/536448764 --> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff22c10de80 con 0x7ff218038ca0 2024-09-19T06:40:11.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.993+0000 7ff222ffd640 1 -- 172.21.15.99:0/536448764 <== mgr.24369 v2:172.21.15.117:6828/1735340892 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7ff22c10de80 con 0x7ff218038ca0 2024-09-19T06:40:11.995 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:40:11.995 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T06:40:11.995 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": true, 2024-09-19T06:40:11.995 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-19T06:40:11.995 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [], 2024-09-19T06:40:11.995 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": "1/2 daemons upgraded", 2024-09-19T06:40:11.995 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "", 2024-09-19T06:40:11.995 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-09-19T06:40:11.995 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:40:11.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.996+0000 7ff234614640 1 -- 172.21.15.99:0/536448764 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7ff218038ca0 msgr2=0x7ff21803b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:11.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.996+0000 7ff234614640 1 --2- 172.21.15.99:0/536448764 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7ff218038ca0 0x7ff21803b150 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff21c007ac0 tx=0x7ff21c039040 comp rx=0 tx=0).stop 2024-09-19T06:40:11.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.996+0000 7ff234614640 1 -- 172.21.15.99:0/536448764 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff22c0fb430 msgr2=0x7ff22c10bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:11.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.996+0000 7ff234614640 1 --2- 172.21.15.99:0/536448764 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff22c0fb430 0x7ff22c10bf80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff22800eb70 tx=0x7ff22800b040 comp rx=0 tx=0).stop 2024-09-19T06:40:11.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.997+0000 7ff234614640 1 -- 172.21.15.99:0/536448764 shutdown_connections 2024-09-19T06:40:11.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.997+0000 7ff234614640 1 --2- 172.21.15.99:0/536448764 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7ff218038ca0 0x7ff21803b150 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:11.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.997+0000 7ff234614640 1 --2- 172.21.15.99:0/536448764 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff22c0fc700 0x7ff22c10c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:11.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.997+0000 7ff234614640 1 --2- 172.21.15.99:0/536448764 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff22c0fb430 0x7ff22c10bf80 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:11.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.997+0000 7ff234614640 1 -- 172.21.15.99:0/536448764 >> 172.21.15.99:0/536448764 conn(0x7ff22c0f6c10 msgr2=0x7ff22c0f83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:11.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.997+0000 7ff234614640 1 -- 172.21.15.99:0/536448764 shutdown_connections 2024-09-19T06:40:11.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:11.998+0000 7ff234614640 1 -- 172.21.15.99:0/536448764 wait complete. 2024-09-19T06:40:12.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:12 smithi099 ceph-mon[27651]: Deploying cephadm binary to smithi117 2024-09-19T06:40:12.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:12 smithi099 ceph-mon[27651]: Deploying cephadm binary to smithi099 2024-09-19T06:40:12.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:12 smithi099 ceph-mon[27651]: from='client.14600 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:40:12.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:12 smithi099 ceph-mon[27651]: from='client.14604 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:40:12.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:12 smithi099 ceph-mon[27651]: pgmap v4: 65 pgs: 65 active+clean; 168 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:40:12.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:12 smithi099 ceph-mon[27651]: from='client.? 172.21.15.99:0/3817682507' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:40:12.237 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:12 smithi117 ceph-mon[34564]: Deploying cephadm binary to smithi117 2024-09-19T06:40:12.237 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:12 smithi117 ceph-mon[34564]: Deploying cephadm binary to smithi099 2024-09-19T06:40:12.238 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:12 smithi117 ceph-mon[34564]: from='client.14600 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:40:12.238 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:12 smithi117 ceph-mon[34564]: from='client.14604 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:40:12.238 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:12 smithi117 ceph-mon[34564]: pgmap v4: 65 pgs: 65 active+clean; 168 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:40:12.238 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:12 smithi117 ceph-mon[34564]: from='client.? 172.21.15.99:0/3817682507' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:40:13.266 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:13 smithi099 ceph-mon[27651]: [19/Sep/2024:06:40:11] ENGINE Bus STARTING 2024-09-19T06:40:13.267 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:13 smithi099 ceph-mon[27651]: from='client.14612 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:40:13.267 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:13 smithi099 ceph-mon[27651]: [19/Sep/2024:06:40:12] ENGINE Serving on http://172.21.15.117:8765 2024-09-19T06:40:13.267 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:13 smithi099 ceph-mon[27651]: mgrmap e23: smithi117.ssmkcf(active, since 3s) 2024-09-19T06:40:13.377 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:13 smithi117 ceph-mon[34564]: [19/Sep/2024:06:40:11] ENGINE Bus STARTING 2024-09-19T06:40:13.377 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:13 smithi117 ceph-mon[34564]: from='client.14612 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:40:13.377 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:13 smithi117 ceph-mon[34564]: [19/Sep/2024:06:40:12] ENGINE Serving on http://172.21.15.117:8765 2024-09-19T06:40:13.377 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:13 smithi117 ceph-mon[34564]: mgrmap e23: smithi117.ssmkcf(active, since 3s) 2024-09-19T06:40:14.256 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:14 smithi099 ceph-mon[27651]: [19/Sep/2024:06:40:12] ENGINE Serving on https://172.21.15.117:7150 2024-09-19T06:40:14.256 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:14 smithi099 ceph-mon[27651]: [19/Sep/2024:06:40:12] ENGINE Bus STARTED 2024-09-19T06:40:14.256 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:14 smithi099 ceph-mon[27651]: [19/Sep/2024:06:40:12] ENGINE Error in HTTPServer.serve 2024-09-19T06:40:14.256 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Traceback (most recent call last): 2024-09-19T06:40:14.256 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T06:40:14.256 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: self._connections.run(self.expiration_interval) 2024-09-19T06:40:14.256 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T06:40:14.256 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: self._run(expiration_interval) 2024-09-19T06:40:14.257 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T06:40:14.257 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T06:40:14.257 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T06:40:14.257 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T06:40:14.257 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T06:40:14.257 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: s = self.context.wrap_socket( 2024-09-19T06:40:14.257 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T06:40:14.257 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: return self.sslsocket_class._create( 2024-09-19T06:40:14.257 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T06:40:14.257 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: self.do_handshake() 2024-09-19T06:40:14.257 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T06:40:14.257 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: self._sslobj.do_handshake() 2024-09-19T06:40:14.257 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T06:40:14.257 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:14 smithi099 ceph-mon[27651]: pgmap v5: 65 pgs: 65 active+clean; 168 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:40:14.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:14 smithi117 ceph-mon[34564]: [19/Sep/2024:06:40:12] ENGINE Serving on https://172.21.15.117:7150 2024-09-19T06:40:14.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:14 smithi117 ceph-mon[34564]: [19/Sep/2024:06:40:12] ENGINE Bus STARTED 2024-09-19T06:40:14.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:14 smithi117 ceph-mon[34564]: [19/Sep/2024:06:40:12] ENGINE Error in HTTPServer.serve 2024-09-19T06:40:14.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: Traceback (most recent call last): 2024-09-19T06:40:14.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T06:40:14.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: self._connections.run(self.expiration_interval) 2024-09-19T06:40:14.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T06:40:14.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: self._run(expiration_interval) 2024-09-19T06:40:14.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T06:40:14.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T06:40:14.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T06:40:14.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T06:40:14.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T06:40:14.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: s = self.context.wrap_socket( 2024-09-19T06:40:14.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T06:40:14.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: return self.sslsocket_class._create( 2024-09-19T06:40:14.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T06:40:14.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: self.do_handshake() 2024-09-19T06:40:14.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T06:40:14.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: self._sslobj.do_handshake() 2024-09-19T06:40:14.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T06:40:14.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:14 smithi117 ceph-mon[34564]: pgmap v5: 65 pgs: 65 active+clean; 168 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:40:15.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:15 smithi099 ceph-mon[27651]: mgrmap e24: smithi117.ssmkcf(active, since 5s) 2024-09-19T06:40:15.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:15 smithi117 ceph-mon[34564]: mgrmap e24: smithi117.ssmkcf(active, since 5s) 2024-09-19T06:40:16.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:16 smithi099 ceph-mon[27651]: pgmap v6: 65 pgs: 65 active+clean; 168 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:40:16.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:16 smithi099 ceph-mon[27651]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:40:16.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:16 smithi099 ceph-mon[27651]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:40:16.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:16 smithi099 ceph-mon[27651]: Standby manager daemon smithi099.pgvkqi started 2024-09-19T06:40:16.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:16 smithi099 ceph-mon[27651]: from='mgr.? 172.21.15.99:0/3996420526' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi099.pgvkqi/crt"}]: dispatch 2024-09-19T06:40:16.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:16 smithi099 ceph-mon[27651]: from='mgr.? 172.21.15.99:0/3996420526' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T06:40:16.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:16 smithi099 ceph-mon[27651]: from='mgr.? 172.21.15.99:0/3996420526' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi099.pgvkqi/key"}]: dispatch 2024-09-19T06:40:16.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:16 smithi099 ceph-mon[27651]: from='mgr.? 172.21.15.99:0/3996420526' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T06:40:16.427 INFO:tasks.workunit.client.1.smithi117.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-19T06:40:16.434 INFO:tasks.workunit.client.1.smithi117.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-19T06:40:16.434 INFO:tasks.workunit.client.1.smithi117.stderr:+ make 2024-09-19T06:40:16.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:16 smithi117 ceph-mon[34564]: pgmap v6: 65 pgs: 65 active+clean; 168 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:40:16.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:16 smithi117 ceph-mon[34564]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:40:16.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:16 smithi117 ceph-mon[34564]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:40:16.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:16 smithi117 ceph-mon[34564]: Standby manager daemon smithi099.pgvkqi started 2024-09-19T06:40:16.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:16 smithi117 ceph-mon[34564]: from='mgr.? 172.21.15.99:0/3996420526' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi099.pgvkqi/crt"}]: dispatch 2024-09-19T06:40:16.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:16 smithi117 ceph-mon[34564]: from='mgr.? 172.21.15.99:0/3996420526' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T06:40:16.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:16 smithi117 ceph-mon[34564]: from='mgr.? 172.21.15.99:0/3996420526' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi099.pgvkqi/key"}]: dispatch 2024-09-19T06:40:16.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:16 smithi117 ceph-mon[34564]: from='mgr.? 172.21.15.99:0/3996420526' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T06:40:16.642 INFO:tasks.workunit.client.1.smithi117.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-19T06:40:17.329 INFO:tasks.workunit.client.1.smithi117.stderr:++ readlink -f fsstress 2024-09-19T06:40:17.331 INFO:tasks.workunit.client.1.smithi117.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-19T06:40:17.331 INFO:tasks.workunit.client.1.smithi117.stderr:+ popd 2024-09-19T06:40:17.332 INFO:tasks.workunit.client.1.smithi117.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-19T06:40:17.332 INFO:tasks.workunit.client.1.smithi117.stderr:+ popd 2024-09-19T06:40:17.333 INFO:tasks.workunit.client.1.smithi117.stdout:~/cephtest/mnt.1/client.1/tmp 2024-09-19T06:40:17.333 INFO:tasks.workunit.client.1.smithi117.stderr:++ mktemp -d -p . 2024-09-19T06:40:17.335 INFO:tasks.workunit.client.1.smithi117.stderr:+ T=./tmp.EsLok3Sz2E 2024-09-19T06:40:17.336 INFO:tasks.workunit.client.1.smithi117.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.EsLok3Sz2E -l 1 -n 1000 -p 10 -v 2024-09-19T06:40:17.339 INFO:tasks.workunit.client.1.smithi117.stdout:seed = 1726933903 2024-09-19T06:40:17.343 INFO:tasks.workunit.client.1.smithi117.stdout:0/0: dread - no filename 2024-09-19T06:40:17.343 INFO:tasks.workunit.client.1.smithi117.stdout:0/1: truncate - no filename 2024-09-19T06:40:17.343 INFO:tasks.workunit.client.1.smithi117.stdout:0/2: link - no file 2024-09-19T06:40:17.343 INFO:tasks.workunit.client.1.smithi117.stdout:0/3: chown . 34 1 2024-09-19T06:40:17.344 INFO:tasks.workunit.client.1.smithi117.stdout:0/4: rename - no filename 2024-09-19T06:40:17.344 INFO:tasks.workunit.client.1.smithi117.stdout:0/5: write - no filename 2024-09-19T06:40:17.344 INFO:tasks.workunit.client.1.smithi117.stdout:0/6: dread - no filename 2024-09-19T06:40:17.344 INFO:tasks.workunit.client.1.smithi117.stdout:0/7: dwrite - no filename 2024-09-19T06:40:17.344 INFO:tasks.workunit.client.1.smithi117.stdout:0/8: chown . 34191 1 2024-09-19T06:40:17.345 INFO:tasks.workunit.client.1.smithi117.stdout:1/0: rename - no filename 2024-09-19T06:40:17.345 INFO:tasks.workunit.client.1.smithi117.stdout:0/9: getdents . 0 2024-09-19T06:40:17.345 INFO:tasks.workunit.client.1.smithi117.stdout:0/10: unlink - no file 2024-09-19T06:40:17.346 INFO:tasks.workunit.client.1.smithi117.stdout:0/11: write - no filename 2024-09-19T06:40:17.346 INFO:tasks.workunit.client.1.smithi117.stdout:2/0: dread - no filename 2024-09-19T06:40:17.347 INFO:tasks.workunit.client.1.smithi117.stdout:1/1: getdents . 0 2024-09-19T06:40:17.347 INFO:tasks.workunit.client.1.smithi117.stdout:1/2: truncate - no filename 2024-09-19T06:40:17.348 INFO:tasks.workunit.client.1.smithi117.stdout:0/12: creat f0 x:0 0 0 2024-09-19T06:40:17.348 INFO:tasks.workunit.client.1.smithi117.stdout:2/1: mkdir d0 0 2024-09-19T06:40:17.349 INFO:tasks.workunit.client.1.smithi117.stdout:2/2: link - no file 2024-09-19T06:40:17.349 INFO:tasks.workunit.client.1.smithi117.stdout:2/3: write - no filename 2024-09-19T06:40:17.350 INFO:tasks.workunit.client.1.smithi117.stdout:0/13: dread - f0 zero size 2024-09-19T06:40:17.350 INFO:tasks.workunit.client.1.smithi117.stdout:3/0: write - no filename 2024-09-19T06:40:17.350 INFO:tasks.workunit.client.1.smithi117.stdout:3/1: dwrite - no filename 2024-09-19T06:40:17.350 INFO:tasks.workunit.client.1.smithi117.stdout:3/2: truncate - no filename 2024-09-19T06:40:17.351 INFO:tasks.workunit.client.1.smithi117.stdout:3/3: dread - no filename 2024-09-19T06:40:17.351 INFO:tasks.workunit.client.1.smithi117.stdout:1/3: symlink l0 0 2024-09-19T06:40:17.351 INFO:tasks.workunit.client.1.smithi117.stdout:1/4: readlink l0 0 2024-09-19T06:40:17.352 INFO:tasks.workunit.client.1.smithi117.stdout:2/4: symlink d0/l1 0 2024-09-19T06:40:17.352 INFO:tasks.workunit.client.1.smithi117.stdout:3/4: chown . 30 1 2024-09-19T06:40:17.352 INFO:tasks.workunit.client.1.smithi117.stdout:3/5: readlink - no filename 2024-09-19T06:40:17.352 INFO:tasks.workunit.client.1.smithi117.stdout:3/6: dwrite - no filename 2024-09-19T06:40:17.352 INFO:tasks.workunit.client.1.smithi117.stdout:4/0: unlink - no file 2024-09-19T06:40:17.353 INFO:tasks.workunit.client.1.smithi117.stdout:4/1: write - no filename 2024-09-19T06:40:17.353 INFO:tasks.workunit.client.1.smithi117.stdout:4/2: write - no filename 2024-09-19T06:40:17.353 INFO:tasks.workunit.client.1.smithi117.stdout:4/3: write - no filename 2024-09-19T06:40:17.353 INFO:tasks.workunit.client.1.smithi117.stdout:4/4: dread - no filename 2024-09-19T06:40:17.353 INFO:tasks.workunit.client.1.smithi117.stdout:4/5: dread - no filename 2024-09-19T06:40:17.354 INFO:tasks.workunit.client.1.smithi117.stdout:1/5: creat f1 x:0 0 0 2024-09-19T06:40:17.355 INFO:tasks.workunit.client.1.smithi117.stdout:0/14: creat f1 x:0 0 0 2024-09-19T06:40:17.355 INFO:tasks.workunit.client.1.smithi117.stdout:0/15: write f0 [855461,71833] 0 2024-09-19T06:40:17.356 INFO:tasks.workunit.client.1.smithi117.stdout:0/16: write f0 [365516,67709] 0 2024-09-19T06:40:17.358 INFO:tasks.workunit.client.1.smithi117.stdout:3/7: mkdir d0 0 2024-09-19T06:40:17.359 INFO:tasks.workunit.client.1.smithi117.stdout:4/6: creat f0 x:0 0 0 2024-09-19T06:40:17.359 INFO:tasks.workunit.client.1.smithi117.stdout:4/7: readlink - no filename 2024-09-19T06:40:17.361 INFO:tasks.workunit.client.1.smithi117.stdout:6/0: dwrite - no filename 2024-09-19T06:40:17.362 INFO:tasks.workunit.client.1.smithi117.stdout:5/0: creat f0 x:0 0 0 2024-09-19T06:40:17.363 INFO:tasks.workunit.client.1.smithi117.stdout:4/8: creat f1 x:0 0 0 2024-09-19T06:40:17.364 INFO:tasks.workunit.client.1.smithi117.stdout:2/5: link d0/l1 d0/l2 0 2024-09-19T06:40:17.365 INFO:tasks.workunit.client.1.smithi117.stdout:5/1: chown f0 5828 1 2024-09-19T06:40:17.365 INFO:tasks.workunit.client.1.smithi117.stdout:7/0: dread - no filename 2024-09-19T06:40:17.366 INFO:tasks.workunit.client.1.smithi117.stdout:4/9: symlink l2 0 2024-09-19T06:40:17.369 INFO:tasks.workunit.client.1.smithi117.stdout:3/8: creat d0/f1 x:0 0 0 2024-09-19T06:40:17.370 INFO:tasks.workunit.client.1.smithi117.stdout:6/1: creat f0 x:0 0 0 2024-09-19T06:40:17.373 INFO:tasks.workunit.client.1.smithi117.stdout:7/1: mknod c0 0 2024-09-19T06:40:17.373 INFO:tasks.workunit.client.1.smithi117.stdout:7/2: write - no filename 2024-09-19T06:40:17.373 INFO:tasks.workunit.client.1.smithi117.stdout:7/3: dwrite - no filename 2024-09-19T06:40:17.373 INFO:tasks.workunit.client.1.smithi117.stdout:7/4: dread - no filename 2024-09-19T06:40:17.374 INFO:tasks.workunit.client.1.smithi117.stdout:6/2: chown f0 93566 1 2024-09-19T06:40:17.376 INFO:tasks.workunit.client.1.smithi117.stdout:7/5: mkdir d1 0 2024-09-19T06:40:17.376 INFO:tasks.workunit.client.1.smithi117.stdout:3/9: write d0/f1 [263490,113374] 0 2024-09-19T06:40:17.377 INFO:tasks.workunit.client.1.smithi117.stdout:8/0: mknod c0 0 2024-09-19T06:40:17.377 INFO:tasks.workunit.client.1.smithi117.stdout:9/0: chown . 4111157 1 2024-09-19T06:40:17.377 INFO:tasks.workunit.client.1.smithi117.stdout:9/1: read - no filename 2024-09-19T06:40:17.377 INFO:tasks.workunit.client.1.smithi117.stdout:9/2: dread - no filename 2024-09-19T06:40:17.381 INFO:tasks.workunit.client.1.smithi117.stdout:6/3: chown f0 231960085 1 2024-09-19T06:40:17.382 INFO:tasks.workunit.client.1.smithi117.stdout:8/1: symlink l1 0 2024-09-19T06:40:17.382 INFO:tasks.workunit.client.1.smithi117.stdout:8/2: write - no filename 2024-09-19T06:40:17.382 INFO:tasks.workunit.client.1.smithi117.stdout:2/6: chown d0/l1 0 1 2024-09-19T06:40:17.382 INFO:tasks.workunit.client.1.smithi117.stdout:0/17: dwrite f1 [0,4194304] 0 2024-09-19T06:40:17.382 INFO:tasks.workunit.client.1.smithi117.stdout:3/10: write d0/f1 [791026,10128] 0 2024-09-19T06:40:17.383 INFO:tasks.workunit.client.1.smithi117.stdout:8/3: readlink l1 0 2024-09-19T06:40:17.383 INFO:tasks.workunit.client.1.smithi117.stdout:8/4: dread - no filename 2024-09-19T06:40:17.383 INFO:tasks.workunit.client.1.smithi117.stdout:8/5: rmdir - no directory 2024-09-19T06:40:17.383 INFO:tasks.workunit.client.1.smithi117.stdout:8/6: dread - no filename 2024-09-19T06:40:17.383 INFO:tasks.workunit.client.1.smithi117.stdout:7/6: symlink d1/l2 0 2024-09-19T06:40:17.383 INFO:tasks.workunit.client.1.smithi117.stdout:7/7: dwrite - no filename 2024-09-19T06:40:17.388 INFO:tasks.workunit.client.1.smithi117.stdout:6/4: write f0 [830399,24499] 0 2024-09-19T06:40:17.388 INFO:tasks.workunit.client.1.smithi117.stdout:0/18: write f1 [2968916,7586] 0 2024-09-19T06:40:17.388 INFO:tasks.workunit.client.1.smithi117.stdout:9/3: creat f0 x:0 0 0 2024-09-19T06:40:17.389 INFO:tasks.workunit.client.1.smithi117.stdout:3/11: symlink d0/l2 0 2024-09-19T06:40:17.390 INFO:tasks.workunit.client.1.smithi117.stdout:8/7: chown l1 7486 1 2024-09-19T06:40:17.390 INFO:tasks.workunit.client.1.smithi117.stdout:8/8: rmdir - no directory 2024-09-19T06:40:17.390 INFO:tasks.workunit.client.1.smithi117.stdout:8/9: dwrite - no filename 2024-09-19T06:40:17.390 INFO:tasks.workunit.client.1.smithi117.stdout:2/7: creat d0/f3 x:0 0 0 2024-09-19T06:40:17.392 INFO:tasks.workunit.client.1.smithi117.stdout:7/8: mkdir d1/d3 0 2024-09-19T06:40:17.393 INFO:tasks.workunit.client.1.smithi117.stdout:5/2: dwrite f0 [0,4194304] 0 2024-09-19T06:40:17.394 INFO:tasks.workunit.client.1.smithi117.stdout:7/9: chown d1/d3 70 1 2024-09-19T06:40:17.394 INFO:tasks.workunit.client.1.smithi117.stdout:7/10: read - no filename 2024-09-19T06:40:17.394 INFO:tasks.workunit.client.1.smithi117.stdout:7/11: dwrite - no filename 2024-09-19T06:40:17.394 INFO:tasks.workunit.client.1.smithi117.stdout:8/10: chown l1 23432 1 2024-09-19T06:40:17.398 INFO:tasks.workunit.client.1.smithi117.stdout:9/4: symlink l1 0 2024-09-19T06:40:17.398 INFO:tasks.workunit.client.1.smithi117.stdout:3/12: symlink d0/l3 0 2024-09-19T06:40:17.399 INFO:tasks.workunit.client.1.smithi117.stdout:8/11: symlink l2 0 2024-09-19T06:40:17.399 INFO:tasks.workunit.client.1.smithi117.stdout:0/19: dread f0 [0,4194304] 0 2024-09-19T06:40:17.401 INFO:tasks.workunit.client.1.smithi117.stdout:7/12: rename d1/l2 to d1/l4 0 2024-09-19T06:40:17.403 INFO:tasks.workunit.client.1.smithi117.stdout:9/5: mknod c2 0 2024-09-19T06:40:17.405 INFO:tasks.workunit.client.1.smithi117.stdout:9/6: readlink l1 0 2024-09-19T06:40:17.405 INFO:tasks.workunit.client.1.smithi117.stdout:0/20: read f0 [320561,114612] 0 2024-09-19T06:40:17.405 INFO:tasks.workunit.client.1.smithi117.stdout:3/13: unlink d0/l3 0 2024-09-19T06:40:17.413 INFO:tasks.workunit.client.1.smithi117.stdout:7/13: creat d1/d3/f5 x:0 0 0 2024-09-19T06:40:17.413 INFO:tasks.workunit.client.1.smithi117.stdout:5/3: dwrite f0 [0,4194304] 0 2024-09-19T06:40:17.416 INFO:tasks.workunit.client.1.smithi117.stdout:0/21: symlink l2 0 2024-09-19T06:40:17.417 INFO:tasks.workunit.client.1.smithi117.stdout:2/8: dwrite d0/f3 [0,4194304] 0 2024-09-19T06:40:17.417 INFO:tasks.workunit.client.1.smithi117.stdout:7/14: dread - d1/d3/f5 zero size 2024-09-19T06:40:17.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:17 smithi117 ceph-mon[34564]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:40:17.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:17 smithi117 ceph-mon[34564]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:40:17.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:17 smithi117 ceph-mon[34564]: mgrmap e25: smithi117.ssmkcf(active, since 7s), standbys: smithi099.pgvkqi 2024-09-19T06:40:17.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:17 smithi117 ceph-mon[34564]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "mgr metadata", "who": "smithi099.pgvkqi", "id": "smithi099.pgvkqi"}]: dispatch 2024-09-19T06:40:17.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:17 smithi117 ceph-mon[34564]: pgmap v7: 65 pgs: 65 active+clean; 192 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 3.6 MiB/s wr, 351 op/s 2024-09-19T06:40:17.580 INFO:tasks.workunit.client.1.smithi117.stdout:7/15: write d1/d3/f5 [656337,120872] 0 2024-09-19T06:40:17.580 INFO:tasks.workunit.client.1.smithi117.stdout:0/22: dread f0 [0,4194304] 0 2024-09-19T06:40:17.581 INFO:tasks.workunit.client.1.smithi117.stdout:0/23: chown f0 254873172 1 2024-09-19T06:40:17.582 INFO:tasks.workunit.client.1.smithi117.stdout:9/7: dwrite f0 [0,4194304] 0 2024-09-19T06:40:17.587 INFO:tasks.workunit.client.1.smithi117.stdout:1/6: getdents . 0 2024-09-19T06:40:17.589 INFO:tasks.workunit.client.1.smithi117.stdout:1/7: chown f1 1208214924 1 2024-09-19T06:40:17.589 INFO:tasks.workunit.client.1.smithi117.stdout:6/5: fsync f0 0 2024-09-19T06:40:17.591 INFO:tasks.workunit.client.1.smithi117.stdout:4/10: fsync f1 0 2024-09-19T06:40:17.592 INFO:tasks.workunit.client.1.smithi117.stdout:8/12: getdents . 0 2024-09-19T06:40:17.592 INFO:tasks.workunit.client.1.smithi117.stdout:8/13: write - no filename 2024-09-19T06:40:17.596 INFO:tasks.workunit.client.1.smithi117.stdout:6/6: read f0 [738666,114027] 0 2024-09-19T06:40:17.596 INFO:tasks.workunit.client.1.smithi117.stdout:6/7: rmdir - no directory 2024-09-19T06:40:17.598 INFO:tasks.workunit.client.1.smithi117.stdout:7/16: creat d1/d3/f6 x:0 0 0 2024-09-19T06:40:17.599 INFO:tasks.workunit.client.1.smithi117.stdout:1/8: symlink l2 0 2024-09-19T06:40:17.599 INFO:tasks.workunit.client.1.smithi117.stdout:0/24: fdatasync f0 0 2024-09-19T06:40:17.599 INFO:tasks.workunit.client.1.smithi117.stdout:6/8: chown f0 112 1 2024-09-19T06:40:17.600 INFO:tasks.workunit.client.1.smithi117.stdout:9/8: dwrite f0 [0,4194304] 0 2024-09-19T06:40:17.601 INFO:tasks.workunit.client.1.smithi117.stdout:8/14: creat f3 x:0 0 0 2024-09-19T06:40:17.602 INFO:tasks.workunit.client.1.smithi117.stdout:5/4: link f0 f1 0 2024-09-19T06:40:17.602 INFO:tasks.workunit.client.1.smithi117.stdout:1/9: write f1 [658993,61836] 0 2024-09-19T06:40:17.603 INFO:tasks.workunit.client.1.smithi117.stdout:7/17: rmdir d1/d3 39 2024-09-19T06:40:17.606 INFO:tasks.workunit.client.1.smithi117.stdout:6/9: mkdir d1 0 2024-09-19T06:40:17.608 INFO:tasks.workunit.client.1.smithi117.stdout:4/11: dwrite f0 [0,4194304] 0 2024-09-19T06:40:17.609 INFO:tasks.workunit.client.1.smithi117.stdout:9/9: mknod c3 0 2024-09-19T06:40:17.609 INFO:tasks.workunit.client.1.smithi117.stdout:2/9: getdents d0 0 2024-09-19T06:40:17.610 INFO:tasks.workunit.client.1.smithi117.stdout:6/10: truncate f0 1114863 0 2024-09-19T06:40:17.615 INFO:tasks.workunit.client.1.smithi117.stdout:7/18: write d1/d3/f5 [973520,105996] 0 2024-09-19T06:40:17.615 INFO:tasks.workunit.client.1.smithi117.stdout:4/12: mkdir d3 0 2024-09-19T06:40:17.615 INFO:tasks.workunit.client.1.smithi117.stdout:1/10: dread f1 [0,4194304] 0 2024-09-19T06:40:17.616 INFO:tasks.workunit.client.1.smithi117.stdout:9/10: mkdir d4 0 2024-09-19T06:40:17.617 INFO:tasks.workunit.client.1.smithi117.stdout:5/5: dread f1 [0,4194304] 0 2024-09-19T06:40:17.617 INFO:tasks.workunit.client.1.smithi117.stdout:2/10: symlink d0/l4 0 2024-09-19T06:40:17.619 INFO:tasks.workunit.client.1.smithi117.stdout:7/19: fsync d1/d3/f6 0 2024-09-19T06:40:17.621 INFO:tasks.workunit.client.1.smithi117.stdout:8/15: creat f4 x:0 0 0 2024-09-19T06:40:17.622 INFO:tasks.workunit.client.1.smithi117.stdout:5/6: creat f2 x:0 0 0 2024-09-19T06:40:17.623 INFO:tasks.workunit.client.1.smithi117.stdout:2/11: symlink d0/l5 0 2024-09-19T06:40:17.624 INFO:tasks.workunit.client.1.smithi117.stdout:1/11: write f1 [471106,108156] 0 2024-09-19T06:40:17.624 INFO:tasks.workunit.client.1.smithi117.stdout:1/12: rmdir - no directory 2024-09-19T06:40:17.625 INFO:tasks.workunit.client.1.smithi117.stdout:0/25: getdents . 0 2024-09-19T06:40:17.626 INFO:tasks.workunit.client.1.smithi117.stdout:5/7: chown f1 160879 1 2024-09-19T06:40:17.627 INFO:tasks.workunit.client.1.smithi117.stdout:6/11: dwrite f0 [0,4194304] 0 2024-09-19T06:40:17.629 INFO:tasks.workunit.client.1.smithi117.stdout:4/13: mkdir d3/d4 0 2024-09-19T06:40:17.631 INFO:tasks.workunit.client.1.smithi117.stdout:1/13: chown l0 42 1 2024-09-19T06:40:17.633 INFO:tasks.workunit.client.1.smithi117.stdout:0/26: creat f3 x:0 0 0 2024-09-19T06:40:17.636 INFO:tasks.workunit.client.1.smithi117.stdout:4/14: chown d3/d4 64 1 2024-09-19T06:40:17.637 INFO:tasks.workunit.client.1.smithi117.stdout:9/11: dwrite f0 [0,4194304] 0 2024-09-19T06:40:17.638 INFO:tasks.workunit.client.1.smithi117.stdout:5/8: rename f0 to f3 0 2024-09-19T06:40:17.641 INFO:tasks.workunit.client.1.smithi117.stdout:1/14: unlink l0 0 2024-09-19T06:40:17.643 INFO:tasks.workunit.client.1.smithi117.stdout:8/16: dwrite f4 [0,4194304] 0 2024-09-19T06:40:17.645 INFO:tasks.workunit.client.1.smithi117.stdout:8/17: rmdir - no directory 2024-09-19T06:40:17.645 INFO:tasks.workunit.client.1.smithi117.stdout:1/15: write f1 [1385451,50950] 0 2024-09-19T06:40:17.646 INFO:tasks.workunit.client.1.smithi117.stdout:4/15: rmdir d3 39 2024-09-19T06:40:17.649 INFO:tasks.workunit.client.1.smithi117.stdout:7/20: creat d1/f7 x:0 0 0 2024-09-19T06:40:17.649 INFO:tasks.workunit.client.1.smithi117.stdout:2/12: dread d0/f3 [0,4194304] 0 2024-09-19T06:40:17.650 INFO:tasks.workunit.client.1.smithi117.stdout:9/12: unlink l1 0 2024-09-19T06:40:17.650 INFO:tasks.workunit.client.1.smithi117.stdout:4/16: write f1 [828646,36534] 0 2024-09-19T06:40:17.654 INFO:tasks.workunit.client.1.smithi117.stdout:9/13: read f0 [380827,124805] 0 2024-09-19T06:40:17.655 INFO:tasks.workunit.client.1.smithi117.stdout:4/17: chown f0 8832 1 2024-09-19T06:40:17.658 INFO:tasks.workunit.client.1.smithi117.stdout:5/9: fdatasync f1 0 2024-09-19T06:40:17.658 INFO:tasks.workunit.client.1.smithi117.stdout:5/10: readlink - no filename 2024-09-19T06:40:17.659 INFO:tasks.workunit.client.1.smithi117.stdout:6/12: dwrite f0 [4194304,4194304] 0 2024-09-19T06:40:17.662 INFO:tasks.workunit.client.1.smithi117.stdout:2/13: chown d0/l2 52287407 1 2024-09-19T06:40:17.665 INFO:tasks.workunit.client.1.smithi117.stdout:5/11: symlink l4 0 2024-09-19T06:40:17.666 INFO:tasks.workunit.client.1.smithi117.stdout:7/21: mkdir d1/d8 0 2024-09-19T06:40:17.667 INFO:tasks.workunit.client.1.smithi117.stdout:0/27: dwrite f0 [0,4194304] 0 2024-09-19T06:40:17.668 INFO:tasks.workunit.client.1.smithi117.stdout:8/18: creat f5 x:0 0 0 2024-09-19T06:40:17.668 INFO:tasks.workunit.client.1.smithi117.stdout:9/14: creat d4/f5 x:0 0 0 2024-09-19T06:40:17.670 INFO:tasks.workunit.client.1.smithi117.stdout:1/16: getdents . 0 2024-09-19T06:40:17.671 INFO:tasks.workunit.client.1.smithi117.stdout:6/13: creat d1/f2 x:0 0 0 2024-09-19T06:40:17.674 INFO:tasks.workunit.client.1.smithi117.stdout:2/14: dread d0/f3 [0,4194304] 0 2024-09-19T06:40:17.674 INFO:tasks.workunit.client.1.smithi117.stdout:4/18: link f1 d3/d4/f5 0 2024-09-19T06:40:17.677 INFO:tasks.workunit.client.1.smithi117.stdout:7/22: dread d1/d3/f5 [0,4194304] 0 2024-09-19T06:40:17.678 INFO:tasks.workunit.client.1.smithi117.stdout:1/17: dread f1 [0,4194304] 0 2024-09-19T06:40:17.679 INFO:tasks.workunit.client.1.smithi117.stdout:6/14: mkdir d1/d3 0 2024-09-19T06:40:17.680 INFO:tasks.workunit.client.1.smithi117.stdout:2/15: creat d0/f6 x:0 0 0 2024-09-19T06:40:17.681 INFO:tasks.workunit.client.1.smithi117.stdout:5/12: write f1 [805734,4434] 0 2024-09-19T06:40:17.682 INFO:tasks.workunit.client.1.smithi117.stdout:5/13: readlink l4 0 2024-09-19T06:40:17.682 INFO:tasks.workunit.client.1.smithi117.stdout:4/19: creat d3/d4/f6 x:0 0 0 2024-09-19T06:40:17.682 INFO:tasks.workunit.client.1.smithi117.stdout:1/18: dread f1 [0,4194304] 0 2024-09-19T06:40:17.683 INFO:tasks.workunit.client.1.smithi117.stdout:7/23: symlink d1/l9 0 2024-09-19T06:40:17.684 INFO:tasks.workunit.client.1.smithi117.stdout:7/24: truncate d1/f7 939893 0 2024-09-19T06:40:17.685 INFO:tasks.workunit.client.1.smithi117.stdout:0/28: rename f1 to f4 0 2024-09-19T06:40:17.686 INFO:tasks.workunit.client.1.smithi117.stdout:9/15: write f0 [5186330,28409] 0 2024-09-19T06:40:17.687 INFO:tasks.workunit.client.1.smithi117.stdout:9/16: dread - d4/f5 zero size 2024-09-19T06:40:17.688 INFO:tasks.workunit.client.1.smithi117.stdout:4/20: unlink l2 0 2024-09-19T06:40:17.689 INFO:tasks.workunit.client.1.smithi117.stdout:6/15: unlink d1/f2 0 2024-09-19T06:40:17.689 INFO:tasks.workunit.client.1.smithi117.stdout:1/19: mkdir d3 0 2024-09-19T06:40:17.691 INFO:tasks.workunit.client.1.smithi117.stdout:0/29: chown l2 0 1 2024-09-19T06:40:17.691 INFO:tasks.workunit.client.1.smithi117.stdout:9/17: symlink d4/l6 0 2024-09-19T06:40:17.693 INFO:tasks.workunit.client.1.smithi117.stdout:9/18: write f0 [3021052,8297] 0 2024-09-19T06:40:17.696 INFO:tasks.workunit.client.1.smithi117.stdout:6/16: symlink d1/d3/l4 0 2024-09-19T06:40:17.697 INFO:tasks.workunit.client.1.smithi117.stdout:7/25: rename d1/f7 to d1/fa 0 2024-09-19T06:40:17.699 INFO:tasks.workunit.client.1.smithi117.stdout:9/19: creat d4/f7 x:0 0 0 2024-09-19T06:40:17.699 INFO:tasks.workunit.client.1.smithi117.stdout:5/14: getdents . 0 2024-09-19T06:40:17.701 INFO:tasks.workunit.client.1.smithi117.stdout:0/30: dwrite f0 [0,4194304] 0 2024-09-19T06:40:17.701 INFO:tasks.workunit.client.1.smithi117.stdout:7/26: truncate d1/d3/f6 227952 0 2024-09-19T06:40:17.702 INFO:tasks.workunit.client.1.smithi117.stdout:5/15: write f1 [2406991,130724] 0 2024-09-19T06:40:17.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:17 smithi099 ceph-mon[27651]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:40:17.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:17 smithi099 ceph-mon[27651]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:40:17.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:17 smithi099 ceph-mon[27651]: mgrmap e25: smithi117.ssmkcf(active, since 7s), standbys: smithi099.pgvkqi 2024-09-19T06:40:17.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:17 smithi099 ceph-mon[27651]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "mgr metadata", "who": "smithi099.pgvkqi", "id": "smithi099.pgvkqi"}]: dispatch 2024-09-19T06:40:17.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:17 smithi099 ceph-mon[27651]: pgmap v7: 65 pgs: 65 active+clean; 192 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 3.6 MiB/s wr, 351 op/s 2024-09-19T06:40:17.707 INFO:tasks.workunit.client.1.smithi117.stdout:2/16: truncate d0/f3 3432906 0 2024-09-19T06:40:17.708 INFO:tasks.workunit.client.1.smithi117.stdout:6/17: dread f0 [4194304,4194304] 0 2024-09-19T06:40:17.712 INFO:tasks.workunit.client.1.smithi117.stdout:7/27: write d1/fa [1125088,125070] 0 2024-09-19T06:40:17.712 INFO:tasks.workunit.client.1.smithi117.stdout:2/17: mkdir d0/d7 0 2024-09-19T06:40:17.716 INFO:tasks.workunit.client.1.smithi117.stdout:9/20: dread f0 [0,4194304] 0 2024-09-19T06:40:17.716 INFO:tasks.workunit.client.1.smithi117.stdout:6/18: write f0 [3447157,50585] 0 2024-09-19T06:40:17.717 INFO:tasks.workunit.client.1.smithi117.stdout:5/16: dwrite f3 [0,4194304] 0 2024-09-19T06:40:17.717 INFO:tasks.workunit.client.1.smithi117.stdout:7/28: write d1/d3/f5 [1001678,93789] 0 2024-09-19T06:40:17.719 INFO:tasks.workunit.client.1.smithi117.stdout:0/31: dread f0 [0,4194304] 0 2024-09-19T06:40:17.724 INFO:tasks.workunit.client.1.smithi117.stdout:9/21: mkdir d4/d8 0 2024-09-19T06:40:17.724 INFO:tasks.workunit.client.1.smithi117.stdout:0/32: truncate f3 94174 0 2024-09-19T06:40:17.727 INFO:tasks.workunit.client.1.smithi117.stdout:7/29: rename c0 to d1/cb 0 2024-09-19T06:40:17.729 INFO:tasks.workunit.client.1.smithi117.stdout:6/19: dwrite f0 [0,4194304] 0 2024-09-19T06:40:17.732 INFO:tasks.workunit.client.1.smithi117.stdout:7/30: unlink d1/d3/f5 0 2024-09-19T06:40:17.734 INFO:tasks.workunit.client.1.smithi117.stdout:9/22: dwrite d4/f7 [0,4194304] 0 2024-09-19T06:40:17.735 INFO:tasks.workunit.client.1.smithi117.stdout:6/20: mkdir d1/d5 0 2024-09-19T06:40:17.738 INFO:tasks.workunit.client.1.smithi117.stdout:7/31: write d1/fa [1681159,129395] 0 2024-09-19T06:40:17.738 INFO:tasks.workunit.client.1.smithi117.stdout:9/23: creat d4/f9 x:0 0 0 2024-09-19T06:40:17.744 INFO:tasks.workunit.client.1.smithi117.stdout:5/17: truncate f3 1125296 0 2024-09-19T06:40:17.745 INFO:tasks.workunit.client.1.smithi117.stdout:5/18: dread - f2 zero size 2024-09-19T06:40:17.746 INFO:tasks.workunit.client.1.smithi117.stdout:9/24: rename d4/l6 to d4/la 0 2024-09-19T06:40:17.746 INFO:tasks.workunit.client.1.smithi117.stdout:2/18: dwrite d0/f3 [0,4194304] 0 2024-09-19T06:40:17.748 INFO:tasks.workunit.client.1.smithi117.stdout:9/25: write d4/f9 [54067,123115] 0 2024-09-19T06:40:17.748 INFO:tasks.workunit.client.1.smithi117.stdout:5/19: mknod c5 0 2024-09-19T06:40:17.748 INFO:tasks.workunit.client.1.smithi117.stdout:2/19: chown d0/f6 657717 1 2024-09-19T06:40:17.749 INFO:tasks.workunit.client.1.smithi117.stdout:2/20: dread - d0/f6 zero size 2024-09-19T06:40:17.749 INFO:tasks.workunit.client.1.smithi117.stdout:7/32: rename d1/d3 to d1/d8/dc 0 2024-09-19T06:40:17.751 INFO:tasks.workunit.client.1.smithi117.stdout:5/20: mknod c6 0 2024-09-19T06:40:17.753 INFO:tasks.workunit.client.1.smithi117.stdout:9/26: unlink d4/f5 0 2024-09-19T06:40:17.754 INFO:tasks.workunit.client.1.smithi117.stdout:7/33: creat d1/d8/fd x:0 0 0 2024-09-19T06:40:17.755 INFO:tasks.workunit.client.1.smithi117.stdout:5/21: mknod c7 0 2024-09-19T06:40:17.760 INFO:tasks.workunit.client.1.smithi117.stdout:2/21: dwrite d0/f6 [0,4194304] 0 2024-09-19T06:40:17.760 INFO:tasks.workunit.client.1.smithi117.stdout:7/34: rename d1/d8/fd to d1/d8/dc/fe 0 2024-09-19T06:40:17.762 INFO:tasks.workunit.client.1.smithi117.stdout:2/22: rmdir d0 39 2024-09-19T06:40:17.763 INFO:tasks.workunit.client.1.smithi117.stdout:7/35: write d1/d8/dc/f6 [155698,10424] 0 2024-09-19T06:40:17.763 INFO:tasks.workunit.client.1.smithi117.stdout:6/21: fsync f0 0 2024-09-19T06:40:17.765 INFO:tasks.workunit.client.1.smithi117.stdout:6/22: write f0 [1476488,29238] 0 2024-09-19T06:40:17.766 INFO:tasks.workunit.client.1.smithi117.stdout:2/23: creat d0/d7/f8 x:0 0 0 2024-09-19T06:40:17.767 INFO:tasks.workunit.client.1.smithi117.stdout:7/36: chown d1/d8/dc/fe 4 1 2024-09-19T06:40:17.768 INFO:tasks.workunit.client.1.smithi117.stdout:7/37: dread - d1/d8/dc/fe zero size 2024-09-19T06:40:17.768 INFO:tasks.workunit.client.1.smithi117.stdout:6/23: rename d1/d3/l4 to d1/d3/l6 0 2024-09-19T06:40:17.770 INFO:tasks.workunit.client.1.smithi117.stdout:2/24: creat d0/f9 x:0 0 0 2024-09-19T06:40:17.774 INFO:tasks.workunit.client.1.smithi117.stdout:2/25: mknod d0/d7/ca 0 2024-09-19T06:40:17.775 INFO:tasks.workunit.client.1.smithi117.stdout:2/26: dread - d0/d7/f8 zero size 2024-09-19T06:40:17.777 INFO:tasks.workunit.client.1.smithi117.stdout:5/22: dwrite f3 [0,4194304] 0 2024-09-19T06:40:17.777 INFO:tasks.workunit.client.1.smithi117.stdout:5/23: stat c5 0 2024-09-19T06:40:17.778 INFO:tasks.workunit.client.1.smithi117.stdout:9/27: truncate d4/f7 2663600 0 2024-09-19T06:40:17.781 INFO:tasks.workunit.client.1.smithi117.stdout:5/24: symlink l8 0 2024-09-19T06:40:17.784 INFO:tasks.workunit.client.1.smithi117.stdout:9/28: creat d4/d8/fb x:0 0 0 2024-09-19T06:40:17.785 INFO:tasks.workunit.client.1.smithi117.stdout:9/29: chown d4 14792 1 2024-09-19T06:40:17.786 INFO:tasks.workunit.client.1.smithi117.stdout:6/24: rename d1/d3/l6 to d1/d5/l7 0 2024-09-19T06:40:17.787 INFO:tasks.workunit.client.1.smithi117.stdout:2/27: dwrite d0/d7/f8 [0,4194304] 0 2024-09-19T06:40:17.788 INFO:tasks.workunit.client.1.smithi117.stdout:2/28: chown d0/f9 209 1 2024-09-19T06:40:17.789 INFO:tasks.workunit.client.1.smithi117.stdout:5/25: dread f1 [0,4194304] 0 2024-09-19T06:40:17.798 INFO:tasks.workunit.client.1.smithi117.stdout:9/30: truncate f0 1698175 0 2024-09-19T06:40:17.799 INFO:tasks.workunit.client.1.smithi117.stdout:9/31: stat d4/f9 0 2024-09-19T06:40:17.799 INFO:tasks.workunit.client.1.smithi117.stdout:2/29: dwrite d0/f9 [0,4194304] 0 2024-09-19T06:40:17.800 INFO:tasks.workunit.client.1.smithi117.stdout:9/32: dread - d4/d8/fb zero size 2024-09-19T06:40:17.801 INFO:tasks.workunit.client.1.smithi117.stdout:2/30: creat d0/fb x:0 0 0 2024-09-19T06:40:17.802 INFO:tasks.workunit.client.1.smithi117.stdout:9/33: symlink d4/d8/lc 0 2024-09-19T06:40:17.803 INFO:tasks.workunit.client.1.smithi117.stdout:2/31: mknod d0/d7/cc 0 2024-09-19T06:40:17.803 INFO:tasks.workunit.client.1.smithi117.stdout:9/34: creat d4/fd x:0 0 0 2024-09-19T06:40:17.804 INFO:tasks.workunit.client.1.smithi117.stdout:9/35: chown d4 36032785 1 2024-09-19T06:40:17.805 INFO:tasks.workunit.client.1.smithi117.stdout:9/36: dread - d4/d8/fb zero size 2024-09-19T06:40:17.811 INFO:tasks.workunit.client.1.smithi117.stdout:5/26: fdatasync f3 0 2024-09-19T06:40:17.815 INFO:tasks.workunit.client.1.smithi117.stdout:2/32: dwrite d0/f9 [0,4194304] 0 2024-09-19T06:40:17.819 INFO:tasks.workunit.client.1.smithi117.stdout:9/37: dwrite d4/d8/fb [0,4194304] 0 2024-09-19T06:40:17.824 INFO:tasks.workunit.client.1.smithi117.stdout:5/27: dwrite f3 [0,4194304] 0 2024-09-19T06:40:17.825 INFO:tasks.workunit.client.1.smithi117.stdout:5/28: chown f1 1313124 1 2024-09-19T06:40:17.826 INFO:tasks.workunit.client.1.smithi117.stdout:9/38: link d4/f7 d4/d8/fe 0 2024-09-19T06:40:17.827 INFO:tasks.workunit.client.1.smithi117.stdout:2/33: dwrite d0/d7/f8 [0,4194304] 0 2024-09-19T06:40:17.828 INFO:tasks.workunit.client.1.smithi117.stdout:5/29: mknod c9 0 2024-09-19T06:40:17.830 INFO:tasks.workunit.client.1.smithi117.stdout:9/39: mkdir d4/df 0 2024-09-19T06:40:17.834 INFO:tasks.workunit.client.1.smithi117.stdout:9/40: mknod d4/c10 0 2024-09-19T06:40:17.835 INFO:tasks.workunit.client.1.smithi117.stdout:5/30: rename c5 to ca 0 2024-09-19T06:40:17.836 INFO:tasks.workunit.client.1.smithi117.stdout:2/34: dread d0/f9 [0,4194304] 0 2024-09-19T06:40:17.837 INFO:tasks.workunit.client.1.smithi117.stdout:5/31: write f3 [1902963,112865] 0 2024-09-19T06:40:17.842 INFO:tasks.workunit.client.1.smithi117.stdout:9/41: link d4/d8/lc d4/df/l11 0 2024-09-19T06:40:17.843 INFO:tasks.workunit.client.1.smithi117.stdout:2/35: getdents d0/d7 0 2024-09-19T06:40:17.846 INFO:tasks.workunit.client.1.smithi117.stdout:2/36: unlink d0/f3 0 2024-09-19T06:40:17.848 INFO:tasks.workunit.client.1.smithi117.stdout:2/37: creat d0/fd x:0 0 0 2024-09-19T06:40:17.850 INFO:tasks.workunit.client.1.smithi117.stdout:2/38: truncate d0/fd 500069 0 2024-09-19T06:40:17.851 INFO:tasks.workunit.client.1.smithi117.stdout:2/39: readlink d0/l5 0 2024-09-19T06:40:17.851 INFO:tasks.workunit.client.1.smithi117.stdout:9/42: dwrite d4/f9 [0,4194304] 0 2024-09-19T06:40:17.856 INFO:tasks.workunit.client.1.smithi117.stdout:2/40: mknod d0/d7/ce 0 2024-09-19T06:40:17.857 INFO:tasks.workunit.client.1.smithi117.stdout:2/41: write d0/fb [60694,30597] 0 2024-09-19T06:40:17.860 INFO:tasks.workunit.client.1.smithi117.stdout:2/42: creat d0/ff x:0 0 0 2024-09-19T06:40:17.861 INFO:tasks.workunit.client.1.smithi117.stdout:2/43: write d0/fd [83084,28239] 0 2024-09-19T06:40:17.863 INFO:tasks.workunit.client.1.smithi117.stdout:2/44: symlink d0/l10 0 2024-09-19T06:40:17.865 INFO:tasks.workunit.client.1.smithi117.stdout:2/45: creat d0/d7/f11 x:0 0 0 2024-09-19T06:40:17.867 INFO:tasks.workunit.client.1.smithi117.stdout:2/46: mkdir d0/d12 0 2024-09-19T06:40:17.869 INFO:tasks.workunit.client.1.smithi117.stdout:2/47: creat d0/d12/f13 x:0 0 0 2024-09-19T06:40:17.871 INFO:tasks.workunit.client.1.smithi117.stdout:5/32: fsync f1 0 2024-09-19T06:40:17.872 INFO:tasks.workunit.client.1.smithi117.stdout:2/48: symlink d0/d7/l14 0 2024-09-19T06:40:17.872 INFO:tasks.workunit.client.1.smithi117.stdout:5/33: truncate f2 203089 0 2024-09-19T06:40:17.873 INFO:tasks.workunit.client.1.smithi117.stdout:5/34: stat l8 0 2024-09-19T06:40:17.875 INFO:tasks.workunit.client.1.smithi117.stdout:5/35: stat ca 0 2024-09-19T06:40:17.875 INFO:tasks.workunit.client.1.smithi117.stdout:2/49: rename d0/d7/l14 to d0/d7/l15 0 2024-09-19T06:40:17.877 INFO:tasks.workunit.client.1.smithi117.stdout:5/36: dread f2 [0,4194304] 0 2024-09-19T06:40:17.878 INFO:tasks.workunit.client.1.smithi117.stdout:5/37: mknod cb 0 2024-09-19T06:40:17.885 INFO:tasks.workunit.client.1.smithi117.stdout:2/50: dwrite d0/f9 [0,4194304] 0 2024-09-19T06:40:17.887 INFO:tasks.workunit.client.1.smithi117.stdout:9/43: dwrite f0 [0,4194304] 0 2024-09-19T06:40:17.889 INFO:tasks.workunit.client.1.smithi117.stdout:2/51: unlink d0/d7/f11 0 2024-09-19T06:40:17.892 INFO:tasks.workunit.client.1.smithi117.stdout:9/44: readlink d4/d8/lc 0 2024-09-19T06:40:17.892 INFO:tasks.workunit.client.1.smithi117.stdout:2/52: creat d0/d7/f16 x:0 0 0 2024-09-19T06:40:17.894 INFO:tasks.workunit.client.1.smithi117.stdout:2/53: dread d0/fb [0,4194304] 0 2024-09-19T06:40:17.895 INFO:tasks.workunit.client.1.smithi117.stdout:9/45: rename d4/f9 to d4/f12 0 2024-09-19T06:40:17.895 INFO:tasks.workunit.client.1.smithi117.stdout:2/54: fdatasync d0/d12/f13 0 2024-09-19T06:40:17.898 INFO:tasks.workunit.client.1.smithi117.stdout:9/46: mknod d4/c13 0 2024-09-19T06:40:17.901 INFO:tasks.workunit.client.1.smithi117.stdout:9/47: dread d4/d8/fb [0,4194304] 0 2024-09-19T06:40:18.144 INFO:tasks.workunit.client.1.smithi117.stdout:9/48: truncate d4/f7 2078829 0 2024-09-19T06:40:18.149 INFO:tasks.workunit.client.1.smithi117.stdout:2/55: truncate d0/d7/f8 1388137 0 2024-09-19T06:40:18.152 INFO:tasks.workunit.client.1.smithi117.stdout:2/56: link d0/d7/l15 d0/d7/l17 0 2024-09-19T06:40:18.153 INFO:tasks.workunit.client.1.smithi117.stdout:2/57: mknod d0/d12/c18 0 2024-09-19T06:40:18.153 INFO:tasks.workunit.client.1.smithi117.stdout:2/58: chown d0/d7/ca 127033 1 2024-09-19T06:40:18.154 INFO:tasks.workunit.client.1.smithi117.stdout:2/59: creat d0/d7/f19 x:0 0 0 2024-09-19T06:40:18.155 INFO:tasks.workunit.client.1.smithi117.stdout:2/60: stat d0/l5 0 2024-09-19T06:40:18.159 INFO:tasks.workunit.client.1.smithi117.stdout:2/61: unlink d0/d7/l15 0 2024-09-19T06:40:18.160 INFO:tasks.workunit.client.1.smithi117.stdout:9/49: dread d4/d8/fe [0,4194304] 0 2024-09-19T06:40:18.161 INFO:tasks.workunit.client.1.smithi117.stdout:2/62: dread d0/fb [0,4194304] 0 2024-09-19T06:40:18.162 INFO:tasks.workunit.client.1.smithi117.stdout:9/50: symlink d4/d8/l14 0 2024-09-19T06:40:18.163 INFO:tasks.workunit.client.1.smithi117.stdout:2/63: write d0/d12/f13 [302067,77958] 0 2024-09-19T06:40:18.163 INFO:tasks.workunit.client.1.smithi117.stdout:9/51: chown d4/d8/fb 13597 1 2024-09-19T06:40:18.165 INFO:tasks.workunit.client.1.smithi117.stdout:9/52: creat d4/d8/f15 x:0 0 0 2024-09-19T06:40:18.166 INFO:tasks.workunit.client.1.smithi117.stdout:2/64: rename d0/l2 to d0/d12/l1a 0 2024-09-19T06:40:18.167 INFO:tasks.workunit.client.1.smithi117.stdout:2/65: write d0/ff [911622,69704] 0 2024-09-19T06:40:18.170 INFO:tasks.workunit.client.1.smithi117.stdout:9/53: dread d4/d8/fb [0,4194304] 0 2024-09-19T06:40:18.172 INFO:tasks.workunit.client.1.smithi117.stdout:9/54: write d4/f12 [1366136,83963] 0 2024-09-19T06:40:18.177 INFO:tasks.workunit.client.1.smithi117.stdout:9/55: fsync d4/f12 0 2024-09-19T06:40:18.178 INFO:tasks.workunit.client.1.smithi117.stdout:9/56: read d4/d8/fb [2312237,102951] 0 2024-09-19T06:40:18.180 INFO:tasks.workunit.client.1.smithi117.stdout:9/57: write d4/d8/f15 [599401,72257] 0 2024-09-19T06:40:18.181 INFO:tasks.workunit.client.1.smithi117.stdout:9/58: chown d4/df 1358788984 1 2024-09-19T06:40:18.184 INFO:tasks.workunit.client.1.smithi117.stdout:2/66: dwrite d0/fb [0,4194304] 0 2024-09-19T06:40:18.302 INFO:tasks.workunit.client.1.smithi117.stdout:2/67: unlink d0/l10 0 2024-09-19T06:40:18.302 INFO:tasks.workunit.client.1.smithi117.stdout:2/68: creat d0/f1b x:0 0 0 2024-09-19T06:40:18.303 INFO:tasks.workunit.client.1.smithi117.stdout:2/69: write d0/f1b [739741,39407] 0 2024-09-19T06:40:18.307 INFO:tasks.workunit.client.1.smithi117.stdout:2/70: creat d0/d7/f1c x:0 0 0 2024-09-19T06:40:18.308 INFO:tasks.workunit.client.1.smithi117.stdout:2/71: write d0/fb [745681,103249] 0 2024-09-19T06:40:18.368 INFO:tasks.workunit.client.1.smithi117.stdout:2/72: read - d0/d7/f19 zero size 2024-09-19T06:40:18.371 INFO:tasks.workunit.client.1.smithi117.stdout:2/73: dread d0/d12/f13 [0,4194304] 0 2024-09-19T06:40:18.372 INFO:tasks.workunit.client.1.smithi117.stdout:2/74: rmdir d0/d12 39 2024-09-19T06:40:18.375 INFO:tasks.workunit.client.1.smithi117.stdout:2/75: mknod d0/d7/c1d 0 2024-09-19T06:40:18.377 INFO:tasks.workunit.client.1.smithi117.stdout:2/76: getdents d0 0 2024-09-19T06:40:19.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:18 smithi099 ceph-mon[27651]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:40:19.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:18 smithi099 ceph-mon[27651]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:40:19.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:18 smithi099 ceph-mon[27651]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:40:19.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:18 smithi099 ceph-mon[27651]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:40:19.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:18 smithi099 ceph-mon[27651]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:40:19.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:18 smithi099 ceph-mon[27651]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:40:19.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:18 smithi099 ceph-mon[27651]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:40:19.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:18 smithi099 ceph-mon[27651]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:40:19.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:18 smithi099 ceph-mon[27651]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:40:19.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:18 smithi099 ceph-mon[27651]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:40:19.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:18 smithi099 ceph-mon[27651]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:40:19.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:18 smithi117 ceph-mon[34564]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:40:19.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:18 smithi117 ceph-mon[34564]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:40:19.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:18 smithi117 ceph-mon[34564]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:40:19.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:18 smithi117 ceph-mon[34564]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:40:19.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:18 smithi117 ceph-mon[34564]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:40:19.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:18 smithi117 ceph-mon[34564]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:40:19.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:18 smithi117 ceph-mon[34564]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:40:19.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:18 smithi117 ceph-mon[34564]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:40:19.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:18 smithi117 ceph-mon[34564]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:40:19.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:18 smithi117 ceph-mon[34564]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:40:19.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:18 smithi117 ceph-mon[34564]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:40:20.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:19 smithi099 ceph-mon[27651]: Adjusting osd_memory_target on smithi099 to 1557M 2024-09-19T06:40:20.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:19 smithi099 ceph-mon[27651]: pgmap v8: 65 pgs: 65 active+clean; 192 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 2.8 MiB/s wr, 272 op/s 2024-09-19T06:40:20.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:19 smithi117 ceph-mon[34564]: Adjusting osd_memory_target on smithi099 to 1557M 2024-09-19T06:40:20.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:19 smithi117 ceph-mon[34564]: pgmap v8: 65 pgs: 65 active+clean; 192 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 2.8 MiB/s wr, 272 op/s 2024-09-19T06:40:22.261 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:22 smithi117 ceph-mon[34564]: pgmap v9: 65 pgs: 65 active+clean; 278 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 412 KiB/s rd, 15 MiB/s wr, 370 op/s 2024-09-19T06:40:22.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:22 smithi099 ceph-mon[27651]: pgmap v9: 65 pgs: 65 active+clean; 278 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 412 KiB/s rd, 15 MiB/s wr, 370 op/s 2024-09-19T06:40:22.966 INFO:tasks.workunit.client.0.smithi099.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-19T06:40:22.974 INFO:tasks.workunit.client.0.smithi099.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-19T06:40:22.974 INFO:tasks.workunit.client.0.smithi099.stderr:+ make 2024-09-19T06:40:23.058 INFO:tasks.workunit.client.0.smithi099.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-19T06:40:23.412 INFO:tasks.workunit.client.0.smithi099.stderr:++ readlink -f fsstress 2024-09-19T06:40:23.413 INFO:tasks.workunit.client.0.smithi099.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-19T06:40:23.413 INFO:tasks.workunit.client.0.smithi099.stderr:+ popd 2024-09-19T06:40:23.414 INFO:tasks.workunit.client.0.smithi099.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-19T06:40:23.414 INFO:tasks.workunit.client.0.smithi099.stderr:+ popd 2024-09-19T06:40:23.415 INFO:tasks.workunit.client.0.smithi099.stdout:~/cephtest/mnt.0/client.0/tmp 2024-09-19T06:40:23.415 INFO:tasks.workunit.client.0.smithi099.stderr:++ mktemp -d -p . 2024-09-19T06:40:23.417 INFO:tasks.workunit.client.0.smithi099.stderr:+ T=./tmp.U6D5mw6kxU 2024-09-19T06:40:23.417 INFO:tasks.workunit.client.0.smithi099.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.U6D5mw6kxU -l 1 -n 1000 -p 10 -v 2024-09-19T06:40:23.420 INFO:tasks.workunit.client.0.smithi099.stdout:seed = 1726852793 2024-09-19T06:40:23.423 INFO:tasks.workunit.client.0.smithi099.stdout:0/0: stat - no entries 2024-09-19T06:40:23.423 INFO:tasks.workunit.client.0.smithi099.stdout:0/1: unlink - no file 2024-09-19T06:40:23.423 INFO:tasks.workunit.client.0.smithi099.stdout:0/2: write - no filename 2024-09-19T06:40:23.423 INFO:tasks.workunit.client.0.smithi099.stdout:0/3: unlink - no file 2024-09-19T06:40:23.423 INFO:tasks.workunit.client.0.smithi099.stdout:0/4: rename - no filename 2024-09-19T06:40:23.423 INFO:tasks.workunit.client.0.smithi099.stdout:0/5: write - no filename 2024-09-19T06:40:23.425 INFO:tasks.workunit.client.0.smithi099.stdout:1/0: dwrite - no filename 2024-09-19T06:40:23.425 INFO:tasks.workunit.client.0.smithi099.stdout:1/1: read - no filename 2024-09-19T06:40:23.425 INFO:tasks.workunit.client.0.smithi099.stdout:1/2: read - no filename 2024-09-19T06:40:23.425 INFO:tasks.workunit.client.0.smithi099.stdout:1/3: dread - no filename 2024-09-19T06:40:23.425 INFO:tasks.workunit.client.0.smithi099.stdout:1/4: dwrite - no filename 2024-09-19T06:40:23.425 INFO:tasks.workunit.client.0.smithi099.stdout:1/5: readlink - no filename 2024-09-19T06:40:23.425 INFO:tasks.workunit.client.0.smithi099.stdout:0/6: mkdir d0 0 2024-09-19T06:40:23.426 INFO:tasks.workunit.client.0.smithi099.stdout:1/6: mkdir d0 0 2024-09-19T06:40:23.426 INFO:tasks.workunit.client.0.smithi099.stdout:1/7: fsync - no filename 2024-09-19T06:40:23.427 INFO:tasks.workunit.client.0.smithi099.stdout:0/7: mknod d0/c1 0 2024-09-19T06:40:23.427 INFO:tasks.workunit.client.0.smithi099.stdout:0/8: dread - no filename 2024-09-19T06:40:23.427 INFO:tasks.workunit.client.0.smithi099.stdout:0/9: write - no filename 2024-09-19T06:40:23.427 INFO:tasks.workunit.client.0.smithi099.stdout:3/0: fdatasync - no filename 2024-09-19T06:40:23.429 INFO:tasks.workunit.client.0.smithi099.stdout:1/8: symlink d0/l1 0 2024-09-19T06:40:23.429 INFO:tasks.workunit.client.0.smithi099.stdout:1/9: stat d0/l1 0 2024-09-19T06:40:23.429 INFO:tasks.workunit.client.0.smithi099.stdout:1/10: stat d0 0 2024-09-19T06:40:23.430 INFO:tasks.workunit.client.0.smithi099.stdout:0/10: rename d0/c1 to d0/c2 0 2024-09-19T06:40:23.430 INFO:tasks.workunit.client.0.smithi099.stdout:0/11: readlink - no filename 2024-09-19T06:40:23.430 INFO:tasks.workunit.client.0.smithi099.stdout:5/0: truncate - no filename 2024-09-19T06:40:23.430 INFO:tasks.workunit.client.0.smithi099.stdout:5/1: dread - no filename 2024-09-19T06:40:23.431 INFO:tasks.workunit.client.0.smithi099.stdout:1/11: rename d0/l1 to d0/l2 0 2024-09-19T06:40:23.431 INFO:tasks.workunit.client.0.smithi099.stdout:1/12: dread - no filename 2024-09-19T06:40:23.431 INFO:tasks.workunit.client.0.smithi099.stdout:1/13: truncate - no filename 2024-09-19T06:40:23.431 INFO:tasks.workunit.client.0.smithi099.stdout:3/1: getdents . 0 2024-09-19T06:40:23.431 INFO:tasks.workunit.client.0.smithi099.stdout:3/2: dread - no filename 2024-09-19T06:40:23.432 INFO:tasks.workunit.client.0.smithi099.stdout:0/12: creat d0/f3 x:0 0 0 2024-09-19T06:40:23.432 INFO:tasks.workunit.client.0.smithi099.stdout:4/0: mknod c0 0 2024-09-19T06:40:23.432 INFO:tasks.workunit.client.0.smithi099.stdout:4/1: dwrite - no filename 2024-09-19T06:40:23.432 INFO:tasks.workunit.client.0.smithi099.stdout:4/2: dread - no filename 2024-09-19T06:40:23.432 INFO:tasks.workunit.client.0.smithi099.stdout:4/3: write - no filename 2024-09-19T06:40:23.432 INFO:tasks.workunit.client.0.smithi099.stdout:4/4: readlink - no filename 2024-09-19T06:40:23.433 INFO:tasks.workunit.client.0.smithi099.stdout:6/0: dwrite - no filename 2024-09-19T06:40:23.433 INFO:tasks.workunit.client.0.smithi099.stdout:4/5: symlink l1 0 2024-09-19T06:40:23.433 INFO:tasks.workunit.client.0.smithi099.stdout:4/6: dread - no filename 2024-09-19T06:40:23.434 INFO:tasks.workunit.client.0.smithi099.stdout:5/2: mknod c0 0 2024-09-19T06:40:23.434 INFO:tasks.workunit.client.0.smithi099.stdout:5/3: rmdir - no directory 2024-09-19T06:40:23.435 INFO:tasks.workunit.client.0.smithi099.stdout:3/3: symlink l0 0 2024-09-19T06:40:23.436 INFO:tasks.workunit.client.0.smithi099.stdout:5/4: mknod c1 0 2024-09-19T06:40:23.436 INFO:tasks.workunit.client.0.smithi099.stdout:5/5: dread - no filename 2024-09-19T06:40:23.438 INFO:tasks.workunit.client.0.smithi099.stdout:4/7: rename c0 to c2 0 2024-09-19T06:40:23.439 INFO:tasks.workunit.client.0.smithi099.stdout:6/1: symlink l0 0 2024-09-19T06:40:23.439 INFO:tasks.workunit.client.0.smithi099.stdout:8/0: read - no filename 2024-09-19T06:40:23.440 INFO:tasks.workunit.client.0.smithi099.stdout:8/1: write - no filename 2024-09-19T06:40:23.440 INFO:tasks.workunit.client.0.smithi099.stdout:0/13: dwrite d0/f3 [0,4194304] 0 2024-09-19T06:40:23.440 INFO:tasks.workunit.client.0.smithi099.stdout:3/4: creat f1 x:0 0 0 2024-09-19T06:40:23.443 INFO:tasks.workunit.client.0.smithi099.stdout:5/6: rename c1 to c2 0 2024-09-19T06:40:23.445 INFO:tasks.workunit.client.0.smithi099.stdout:9/0: link - no file 2024-09-19T06:40:23.447 INFO:tasks.workunit.client.0.smithi099.stdout:6/2: unlink l0 0 2024-09-19T06:40:23.448 INFO:tasks.workunit.client.0.smithi099.stdout:6/3: read - no filename 2024-09-19T06:40:23.448 INFO:tasks.workunit.client.0.smithi099.stdout:6/4: dread - no filename 2024-09-19T06:40:23.449 INFO:tasks.workunit.client.0.smithi099.stdout:7/0: creat f0 x:0 0 0 2024-09-19T06:40:23.449 INFO:tasks.workunit.client.0.smithi099.stdout:7/1: dread - f0 zero size 2024-09-19T06:40:23.450 INFO:tasks.workunit.client.0.smithi099.stdout:3/5: symlink l2 0 2024-09-19T06:40:23.451 INFO:tasks.workunit.client.0.smithi099.stdout:3/6: write f1 [823763,107540] 0 2024-09-19T06:40:23.451 INFO:tasks.workunit.client.0.smithi099.stdout:3/7: truncate f1 1564095 0 2024-09-19T06:40:23.452 INFO:tasks.workunit.client.0.smithi099.stdout:5/7: mkdir d3 0 2024-09-19T06:40:23.453 INFO:tasks.workunit.client.0.smithi099.stdout:6/5: mkdir d1 0 2024-09-19T06:40:23.453 INFO:tasks.workunit.client.0.smithi099.stdout:6/6: dwrite - no filename 2024-09-19T06:40:23.454 INFO:tasks.workunit.client.0.smithi099.stdout:8/2: mknod c0 0 2024-09-19T06:40:23.454 INFO:tasks.workunit.client.0.smithi099.stdout:8/3: dread - no filename 2024-09-19T06:40:23.457 INFO:tasks.workunit.client.0.smithi099.stdout:0/14: rename d0/c2 to d0/c4 0 2024-09-19T06:40:23.461 INFO:tasks.workunit.client.0.smithi099.stdout:5/8: symlink d3/l4 0 2024-09-19T06:40:23.461 INFO:tasks.workunit.client.0.smithi099.stdout:5/9: fsync - no filename 2024-09-19T06:40:23.463 INFO:tasks.workunit.client.0.smithi099.stdout:6/7: mkdir d1/d2 0 2024-09-19T06:40:23.465 INFO:tasks.workunit.client.0.smithi099.stdout:1/14: link d0/l2 d0/l3 0 2024-09-19T06:40:23.467 INFO:tasks.workunit.client.0.smithi099.stdout:5/10: creat d3/f5 x:0 0 0 2024-09-19T06:40:23.467 INFO:tasks.workunit.client.0.smithi099.stdout:4/8: chown c2 2281911 1 2024-09-19T06:40:23.468 INFO:tasks.workunit.client.0.smithi099.stdout:4/9: dwrite - no filename 2024-09-19T06:40:23.469 INFO:tasks.workunit.client.0.smithi099.stdout:7/2: fsync f0 0 2024-09-19T06:40:23.469 INFO:tasks.workunit.client.0.smithi099.stdout:8/4: link c0 c1 0 2024-09-19T06:40:23.469 INFO:tasks.workunit.client.0.smithi099.stdout:8/5: dwrite - no filename 2024-09-19T06:40:23.470 INFO:tasks.workunit.client.0.smithi099.stdout:8/6: dwrite - no filename 2024-09-19T06:40:23.470 INFO:tasks.workunit.client.0.smithi099.stdout:7/3: chown f0 139651 1 2024-09-19T06:40:23.470 INFO:tasks.workunit.client.0.smithi099.stdout:3/8: getdents . 0 2024-09-19T06:40:23.470 INFO:tasks.workunit.client.0.smithi099.stdout:7/4: truncate f0 866068 0 2024-09-19T06:40:23.471 INFO:tasks.workunit.client.0.smithi099.stdout:5/11: symlink d3/l6 0 2024-09-19T06:40:23.471 INFO:tasks.workunit.client.0.smithi099.stdout:5/12: dread - d3/f5 zero size 2024-09-19T06:40:23.472 INFO:tasks.workunit.client.0.smithi099.stdout:4/10: mknod c3 0 2024-09-19T06:40:23.472 INFO:tasks.workunit.client.0.smithi099.stdout:6/8: symlink d1/d2/l3 0 2024-09-19T06:40:23.473 INFO:tasks.workunit.client.0.smithi099.stdout:7/5: dread f0 [0,4194304] 0 2024-09-19T06:40:23.473 INFO:tasks.workunit.client.0.smithi099.stdout:7/6: stat f0 0 2024-09-19T06:40:23.474 INFO:tasks.workunit.client.0.smithi099.stdout:3/9: rename l2 to l3 0 2024-09-19T06:40:23.474 INFO:tasks.workunit.client.0.smithi099.stdout:7/7: dread f0 [0,4194304] 0 2024-09-19T06:40:23.475 INFO:tasks.workunit.client.0.smithi099.stdout:7/8: read f0 [573581,113202] 0 2024-09-19T06:40:23.475 INFO:tasks.workunit.client.0.smithi099.stdout:5/13: mkdir d3/d7 0 2024-09-19T06:40:23.477 INFO:tasks.workunit.client.0.smithi099.stdout:4/11: mknod c4 0 2024-09-19T06:40:23.477 INFO:tasks.workunit.client.0.smithi099.stdout:4/12: rmdir - no directory 2024-09-19T06:40:23.477 INFO:tasks.workunit.client.0.smithi099.stdout:4/13: dread - no filename 2024-09-19T06:40:23.478 INFO:tasks.workunit.client.0.smithi099.stdout:4/14: write - no filename 2024-09-19T06:40:23.478 INFO:tasks.workunit.client.0.smithi099.stdout:5/14: write d3/f5 [430610,44494] 0 2024-09-19T06:40:23.478 INFO:tasks.workunit.client.0.smithi099.stdout:0/15: rename d0/c4 to d0/c5 0 2024-09-19T06:40:23.480 INFO:tasks.workunit.client.0.smithi099.stdout:6/9: unlink d1/d2/l3 0 2024-09-19T06:40:23.480 INFO:tasks.workunit.client.0.smithi099.stdout:7/9: dread f0 [0,4194304] 0 2024-09-19T06:40:23.480 INFO:tasks.workunit.client.0.smithi099.stdout:8/7: chown c1 145414633 1 2024-09-19T06:40:23.480 INFO:tasks.workunit.client.0.smithi099.stdout:8/8: fdatasync - no filename 2024-09-19T06:40:23.480 INFO:tasks.workunit.client.0.smithi099.stdout:8/9: write - no filename 2024-09-19T06:40:23.481 INFO:tasks.workunit.client.0.smithi099.stdout:8/10: write - no filename 2024-09-19T06:40:23.481 INFO:tasks.workunit.client.0.smithi099.stdout:8/11: dwrite - no filename 2024-09-19T06:40:23.481 INFO:tasks.workunit.client.0.smithi099.stdout:8/12: dread - no filename 2024-09-19T06:40:23.481 INFO:tasks.workunit.client.0.smithi099.stdout:4/15: creat f5 x:0 0 0 2024-09-19T06:40:23.481 INFO:tasks.workunit.client.0.smithi099.stdout:0/16: write d0/f3 [878857,3273] 0 2024-09-19T06:40:23.483 INFO:tasks.workunit.client.0.smithi099.stdout:3/10: dread f1 [0,4194304] 0 2024-09-19T06:40:23.483 INFO:tasks.workunit.client.0.smithi099.stdout:8/13: chown c1 95 1 2024-09-19T06:40:23.484 INFO:tasks.workunit.client.0.smithi099.stdout:8/14: write - no filename 2024-09-19T06:40:23.484 INFO:tasks.workunit.client.0.smithi099.stdout:8/15: dread - no filename 2024-09-19T06:40:23.484 INFO:tasks.workunit.client.0.smithi099.stdout:8/16: write - no filename 2024-09-19T06:40:23.484 INFO:tasks.workunit.client.0.smithi099.stdout:5/15: mknod d3/d7/c8 0 2024-09-19T06:40:23.484 INFO:tasks.workunit.client.0.smithi099.stdout:6/10: symlink d1/l4 0 2024-09-19T06:40:23.485 INFO:tasks.workunit.client.0.smithi099.stdout:6/11: fsync - no filename 2024-09-19T06:40:23.485 INFO:tasks.workunit.client.0.smithi099.stdout:7/10: dread f0 [0,4194304] 0 2024-09-19T06:40:23.485 INFO:tasks.workunit.client.0.smithi099.stdout:4/16: unlink c4 0 2024-09-19T06:40:23.485 INFO:tasks.workunit.client.0.smithi099.stdout:4/17: chown c2 12810 1 2024-09-19T06:40:23.485 INFO:tasks.workunit.client.0.smithi099.stdout:8/17: unlink c0 0 2024-09-19T06:40:23.486 INFO:tasks.workunit.client.0.smithi099.stdout:3/11: creat f4 x:0 0 0 2024-09-19T06:40:23.487 INFO:tasks.workunit.client.0.smithi099.stdout:3/12: chown f4 4140211 1 2024-09-19T06:40:23.487 INFO:tasks.workunit.client.0.smithi099.stdout:5/16: creat d3/f9 x:0 0 0 2024-09-19T06:40:23.488 INFO:tasks.workunit.client.0.smithi099.stdout:4/18: rename c2 to c6 0 2024-09-19T06:40:23.489 INFO:tasks.workunit.client.0.smithi099.stdout:8/18: creat f2 x:0 0 0 2024-09-19T06:40:23.490 INFO:tasks.workunit.client.0.smithi099.stdout:3/13: creat f5 x:0 0 0 2024-09-19T06:40:23.491 INFO:tasks.workunit.client.0.smithi099.stdout:6/12: rename d1/d2 to d1/d5 0 2024-09-19T06:40:23.495 INFO:tasks.workunit.client.0.smithi099.stdout:7/11: getdents . 0 2024-09-19T06:40:23.496 INFO:tasks.workunit.client.0.smithi099.stdout:5/17: dwrite d3/f9 [0,4194304] 0 2024-09-19T06:40:23.496 INFO:tasks.workunit.client.0.smithi099.stdout:6/13: mknod d1/c6 0 2024-09-19T06:40:23.496 INFO:tasks.workunit.client.0.smithi099.stdout:6/14: dread - no filename 2024-09-19T06:40:23.496 INFO:tasks.workunit.client.0.smithi099.stdout:6/15: read - no filename 2024-09-19T06:40:23.496 INFO:tasks.workunit.client.0.smithi099.stdout:6/16: write - no filename 2024-09-19T06:40:23.497 INFO:tasks.workunit.client.0.smithi099.stdout:6/17: dwrite - no filename 2024-09-19T06:40:23.497 INFO:tasks.workunit.client.0.smithi099.stdout:6/18: truncate - no filename 2024-09-19T06:40:23.499 INFO:tasks.workunit.client.0.smithi099.stdout:3/14: dread f1 [0,4194304] 0 2024-09-19T06:40:23.500 INFO:tasks.workunit.client.0.smithi099.stdout:6/19: readlink d1/l4 0 2024-09-19T06:40:23.501 INFO:tasks.workunit.client.0.smithi099.stdout:7/12: unlink f0 0 2024-09-19T06:40:23.502 INFO:tasks.workunit.client.0.smithi099.stdout:5/18: chown d3/l6 740 1 2024-09-19T06:40:23.505 INFO:tasks.workunit.client.0.smithi099.stdout:4/19: dwrite f5 [0,4194304] 0 2024-09-19T06:40:23.506 INFO:tasks.workunit.client.0.smithi099.stdout:4/20: readlink l1 0 2024-09-19T06:40:23.507 INFO:tasks.workunit.client.0.smithi099.stdout:3/15: unlink f1 0 2024-09-19T06:40:23.508 INFO:tasks.workunit.client.0.smithi099.stdout:8/19: dwrite f2 [0,4194304] 0 2024-09-19T06:40:23.508 INFO:tasks.workunit.client.0.smithi099.stdout:7/13: creat f1 x:0 0 0 2024-09-19T06:40:23.509 INFO:tasks.workunit.client.0.smithi099.stdout:3/16: stat f5 0 2024-09-19T06:40:23.509 INFO:tasks.workunit.client.0.smithi099.stdout:6/20: symlink d1/d5/l7 0 2024-09-19T06:40:23.510 INFO:tasks.workunit.client.0.smithi099.stdout:6/21: truncate - no filename 2024-09-19T06:40:23.510 INFO:tasks.workunit.client.0.smithi099.stdout:3/17: readlink l0 0 2024-09-19T06:40:23.511 INFO:tasks.workunit.client.0.smithi099.stdout:7/14: write f1 [211979,31209] 0 2024-09-19T06:40:23.511 INFO:tasks.workunit.client.0.smithi099.stdout:4/21: symlink l7 0 2024-09-19T06:40:23.511 INFO:tasks.workunit.client.0.smithi099.stdout:5/19: dread d3/f5 [0,4194304] 0 2024-09-19T06:40:23.513 INFO:tasks.workunit.client.0.smithi099.stdout:4/22: chown f5 3 1 2024-09-19T06:40:23.513 INFO:tasks.workunit.client.0.smithi099.stdout:3/18: write f5 [124191,91390] 0 2024-09-19T06:40:23.514 INFO:tasks.workunit.client.0.smithi099.stdout:4/23: read f5 [2905261,73034] 0 2024-09-19T06:40:23.516 INFO:tasks.workunit.client.0.smithi099.stdout:3/19: write f5 [1254099,126516] 0 2024-09-19T06:40:23.517 INFO:tasks.workunit.client.0.smithi099.stdout:3/20: write f5 [735663,130237] 0 2024-09-19T06:40:23.519 INFO:tasks.workunit.client.0.smithi099.stdout:5/20: creat d3/d7/fa x:0 0 0 2024-09-19T06:40:23.519 INFO:tasks.workunit.client.0.smithi099.stdout:5/21: chown d3 391245068 1 2024-09-19T06:40:23.519 INFO:tasks.workunit.client.0.smithi099.stdout:8/20: creat f3 x:0 0 0 2024-09-19T06:40:23.520 INFO:tasks.workunit.client.0.smithi099.stdout:7/15: creat f2 x:0 0 0 2024-09-19T06:40:23.520 INFO:tasks.workunit.client.0.smithi099.stdout:7/16: fdatasync f2 0 2024-09-19T06:40:23.521 INFO:tasks.workunit.client.0.smithi099.stdout:4/24: symlink l8 0 2024-09-19T06:40:23.523 INFO:tasks.workunit.client.0.smithi099.stdout:3/21: chown l3 1 1 2024-09-19T06:40:23.523 INFO:tasks.workunit.client.0.smithi099.stdout:3/22: truncate f4 93759 0 2024-09-19T06:40:23.524 INFO:tasks.workunit.client.0.smithi099.stdout:3/23: write f4 [286539,78431] 0 2024-09-19T06:40:23.525 INFO:tasks.workunit.client.0.smithi099.stdout:5/22: creat d3/d7/fb x:0 0 0 2024-09-19T06:40:23.527 INFO:tasks.workunit.client.0.smithi099.stdout:5/23: write d3/d7/fb [172233,72326] 0 2024-09-19T06:40:23.527 INFO:tasks.workunit.client.0.smithi099.stdout:6/22: link d1/c6 d1/d5/c8 0 2024-09-19T06:40:23.527 INFO:tasks.workunit.client.0.smithi099.stdout:5/24: readlink d3/l4 0 2024-09-19T06:40:23.528 INFO:tasks.workunit.client.0.smithi099.stdout:8/21: mkdir d4 0 2024-09-19T06:40:23.532 INFO:tasks.workunit.client.0.smithi099.stdout:3/24: getdents . 0 2024-09-19T06:40:23.533 INFO:tasks.workunit.client.0.smithi099.stdout:8/22: getdents d4 0 2024-09-19T06:40:23.534 INFO:tasks.workunit.client.0.smithi099.stdout:3/25: chown l0 15 1 2024-09-19T06:40:23.535 INFO:tasks.workunit.client.0.smithi099.stdout:7/17: getdents . 0 2024-09-19T06:40:23.536 INFO:tasks.workunit.client.0.smithi099.stdout:4/25: dwrite f5 [0,4194304] 0 2024-09-19T06:40:23.537 INFO:tasks.workunit.client.0.smithi099.stdout:6/23: getdents d1/d5 0 2024-09-19T06:40:23.538 INFO:tasks.workunit.client.0.smithi099.stdout:3/26: unlink f5 0 2024-09-19T06:40:23.540 INFO:tasks.workunit.client.0.smithi099.stdout:7/18: symlink l3 0 2024-09-19T06:40:23.540 INFO:tasks.workunit.client.0.smithi099.stdout:5/25: dwrite d3/d7/fb [0,4194304] 0 2024-09-19T06:40:23.542 INFO:tasks.workunit.client.0.smithi099.stdout:4/26: mknod c9 0 2024-09-19T06:40:23.544 INFO:tasks.workunit.client.0.smithi099.stdout:7/19: creat f4 x:0 0 0 2024-09-19T06:40:23.544 INFO:tasks.workunit.client.0.smithi099.stdout:3/27: dread f4 [0,4194304] 0 2024-09-19T06:40:23.544 INFO:tasks.workunit.client.0.smithi099.stdout:5/26: mknod d3/cc 0 2024-09-19T06:40:23.545 INFO:tasks.workunit.client.0.smithi099.stdout:4/27: symlink la 0 2024-09-19T06:40:23.546 INFO:tasks.workunit.client.0.smithi099.stdout:8/23: dread f2 [0,4194304] 0 2024-09-19T06:40:23.547 INFO:tasks.workunit.client.0.smithi099.stdout:3/28: creat f6 x:0 0 0 2024-09-19T06:40:23.547 INFO:tasks.workunit.client.0.smithi099.stdout:5/27: mknod d3/cd 0 2024-09-19T06:40:23.548 INFO:tasks.workunit.client.0.smithi099.stdout:7/20: creat f5 x:0 0 0 2024-09-19T06:40:23.549 INFO:tasks.workunit.client.0.smithi099.stdout:7/21: read - f4 zero size 2024-09-19T06:40:23.549 INFO:tasks.workunit.client.0.smithi099.stdout:7/22: rmdir - no directory 2024-09-19T06:40:23.549 INFO:tasks.workunit.client.0.smithi099.stdout:4/28: creat fb x:0 0 0 2024-09-19T06:40:23.550 INFO:tasks.workunit.client.0.smithi099.stdout:4/29: write f5 [2195414,69134] 0 2024-09-19T06:40:23.550 INFO:tasks.workunit.client.0.smithi099.stdout:3/29: mkdir d7 0 2024-09-19T06:40:23.551 INFO:tasks.workunit.client.0.smithi099.stdout:3/30: truncate f4 420954 0 2024-09-19T06:40:23.551 INFO:tasks.workunit.client.0.smithi099.stdout:5/28: symlink d3/le 0 2024-09-19T06:40:23.552 INFO:tasks.workunit.client.0.smithi099.stdout:7/23: creat f6 x:0 0 0 2024-09-19T06:40:23.553 INFO:tasks.workunit.client.0.smithi099.stdout:8/24: symlink d4/l5 0 2024-09-19T06:40:23.553 INFO:tasks.workunit.client.0.smithi099.stdout:7/24: write f1 [1031835,59855] 0 2024-09-19T06:40:23.555 INFO:tasks.workunit.client.0.smithi099.stdout:5/29: creat d3/d7/ff x:0 0 0 2024-09-19T06:40:23.556 INFO:tasks.workunit.client.0.smithi099.stdout:5/30: readlink d3/l4 0 2024-09-19T06:40:23.556 INFO:tasks.workunit.client.0.smithi099.stdout:7/25: mkdir d7 0 2024-09-19T06:40:23.557 INFO:tasks.workunit.client.0.smithi099.stdout:5/31: write d3/d7/ff [120558,55359] 0 2024-09-19T06:40:23.557 INFO:tasks.workunit.client.0.smithi099.stdout:4/30: rename c6 to cc 0 2024-09-19T06:40:23.558 INFO:tasks.workunit.client.0.smithi099.stdout:5/32: write d3/d7/fa [705452,33358] 0 2024-09-19T06:40:23.558 INFO:tasks.workunit.client.0.smithi099.stdout:7/26: creat d7/f8 x:0 0 0 2024-09-19T06:40:23.561 INFO:tasks.workunit.client.0.smithi099.stdout:7/27: creat d7/f9 x:0 0 0 2024-09-19T06:40:23.563 INFO:tasks.workunit.client.0.smithi099.stdout:7/28: creat d7/fa x:0 0 0 2024-09-19T06:40:23.564 INFO:tasks.workunit.client.0.smithi099.stdout:3/31: fsync f6 0 2024-09-19T06:40:23.565 INFO:tasks.workunit.client.0.smithi099.stdout:7/29: mknod d7/cb 0 2024-09-19T06:40:23.567 INFO:tasks.workunit.client.0.smithi099.stdout:7/30: truncate f5 774778 0 2024-09-19T06:40:23.567 INFO:tasks.workunit.client.0.smithi099.stdout:5/33: dwrite d3/d7/ff [0,4194304] 0 2024-09-19T06:40:23.570 INFO:tasks.workunit.client.0.smithi099.stdout:7/31: mkdir d7/dc 0 2024-09-19T06:40:23.570 INFO:tasks.workunit.client.0.smithi099.stdout:5/34: creat d3/d7/f10 x:0 0 0 2024-09-19T06:40:23.575 INFO:tasks.workunit.client.0.smithi099.stdout:3/32: dwrite f4 [0,4194304] 0 2024-09-19T06:40:23.577 INFO:tasks.workunit.client.0.smithi099.stdout:3/33: dread - f6 zero size 2024-09-19T06:40:23.577 INFO:tasks.workunit.client.0.smithi099.stdout:5/35: dread d3/d7/fa [0,4194304] 0 2024-09-19T06:40:23.577 INFO:tasks.workunit.client.0.smithi099.stdout:3/34: stat f6 0 2024-09-19T06:40:23.577 INFO:tasks.workunit.client.0.smithi099.stdout:7/32: fsync d7/fa 0 2024-09-19T06:40:23.579 INFO:tasks.workunit.client.0.smithi099.stdout:5/36: creat d3/d7/f11 x:0 0 0 2024-09-19T06:40:23.579 INFO:tasks.workunit.client.0.smithi099.stdout:7/33: mkdir d7/dd 0 2024-09-19T06:40:23.580 INFO:tasks.workunit.client.0.smithi099.stdout:7/34: truncate d7/fa 241009 0 2024-09-19T06:40:23.582 INFO:tasks.workunit.client.0.smithi099.stdout:7/35: read - d7/f9 zero size 2024-09-19T06:40:23.585 INFO:tasks.workunit.client.0.smithi099.stdout:7/36: mkdir d7/dc/de 0 2024-09-19T06:40:23.587 INFO:tasks.workunit.client.0.smithi099.stdout:7/37: write f4 [150586,81973] 0 2024-09-19T06:40:23.588 INFO:tasks.workunit.client.0.smithi099.stdout:3/35: dwrite f4 [0,4194304] 0 2024-09-19T06:40:23.591 INFO:tasks.workunit.client.0.smithi099.stdout:7/38: creat d7/ff x:0 0 0 2024-09-19T06:40:23.593 INFO:tasks.workunit.client.0.smithi099.stdout:5/37: dwrite d3/d7/ff [4194304,4194304] 0 2024-09-19T06:40:23.596 INFO:tasks.workunit.client.0.smithi099.stdout:7/39: creat d7/dd/f10 x:0 0 0 2024-09-19T06:40:23.609 INFO:tasks.workunit.client.0.smithi099.stdout:3/36: fdatasync f4 0 2024-09-19T06:40:23.609 INFO:tasks.workunit.client.0.smithi099.stdout:5/38: truncate d3/f9 101195 0 2024-09-19T06:40:23.610 INFO:tasks.workunit.client.0.smithi099.stdout:5/39: chown d3/cc 268067722 1 2024-09-19T06:40:23.610 INFO:tasks.workunit.client.0.smithi099.stdout:7/40: truncate f5 705596 0 2024-09-19T06:40:23.611 INFO:tasks.workunit.client.0.smithi099.stdout:3/37: creat d7/f8 x:0 0 0 2024-09-19T06:40:23.611 INFO:tasks.workunit.client.0.smithi099.stdout:5/40: symlink d3/d7/l12 0 2024-09-19T06:40:23.612 INFO:tasks.workunit.client.0.smithi099.stdout:5/41: dread - d3/d7/f11 zero size 2024-09-19T06:40:23.612 INFO:tasks.workunit.client.0.smithi099.stdout:7/41: unlink d7/dd/f10 0 2024-09-19T06:40:23.617 INFO:tasks.workunit.client.0.smithi099.stdout:3/38: dwrite f4 [0,4194304] 0 2024-09-19T06:40:23.618 INFO:tasks.workunit.client.0.smithi099.stdout:7/42: rmdir d7 39 2024-09-19T06:40:23.619 INFO:tasks.workunit.client.0.smithi099.stdout:3/39: unlink l3 0 2024-09-19T06:40:23.621 INFO:tasks.workunit.client.0.smithi099.stdout:3/40: read f4 [3240022,97201] 0 2024-09-19T06:40:23.624 INFO:tasks.workunit.client.0.smithi099.stdout:3/41: write f6 [86892,67678] 0 2024-09-19T06:40:23.625 INFO:tasks.workunit.client.0.smithi099.stdout:5/42: dwrite d3/d7/fa [0,4194304] 0 2024-09-19T06:40:23.628 INFO:tasks.workunit.client.0.smithi099.stdout:5/43: symlink d3/l13 0 2024-09-19T06:40:23.630 INFO:tasks.workunit.client.0.smithi099.stdout:7/43: dwrite f6 [0,4194304] 0 2024-09-19T06:40:23.630 INFO:tasks.workunit.client.0.smithi099.stdout:3/42: getdents d7 0 2024-09-19T06:40:23.632 INFO:tasks.workunit.client.0.smithi099.stdout:7/44: write f6 [2647616,25295] 0 2024-09-19T06:40:23.633 INFO:tasks.workunit.client.0.smithi099.stdout:3/43: fdatasync f6 0 2024-09-19T06:40:23.635 INFO:tasks.workunit.client.0.smithi099.stdout:3/44: rmdir d7 39 2024-09-19T06:40:23.637 INFO:tasks.workunit.client.0.smithi099.stdout:3/45: fdatasync f4 0 2024-09-19T06:40:23.638 INFO:tasks.workunit.client.0.smithi099.stdout:3/46: readlink l0 0 2024-09-19T06:40:23.639 INFO:tasks.workunit.client.0.smithi099.stdout:5/44: dwrite d3/d7/fa [0,4194304] 0 2024-09-19T06:40:23.639 INFO:tasks.workunit.client.0.smithi099.stdout:7/45: rmdir d7/dc/de 0 2024-09-19T06:40:23.639 INFO:tasks.workunit.client.0.smithi099.stdout:3/47: chown f4 483488500 1 2024-09-19T06:40:23.640 INFO:tasks.workunit.client.0.smithi099.stdout:5/45: read d3/d7/ff [7946816,77900] 0 2024-09-19T06:40:23.640 INFO:tasks.workunit.client.0.smithi099.stdout:3/48: truncate f6 1135808 0 2024-09-19T06:40:23.640 INFO:tasks.workunit.client.0.smithi099.stdout:7/46: write d7/f8 [895523,66949] 0 2024-09-19T06:40:23.641 INFO:tasks.workunit.client.0.smithi099.stdout:3/49: readlink l0 0 2024-09-19T06:40:23.641 INFO:tasks.workunit.client.0.smithi099.stdout:5/46: fdatasync d3/d7/f10 0 2024-09-19T06:40:23.642 INFO:tasks.workunit.client.0.smithi099.stdout:7/47: chown d7/f9 911465 1 2024-09-19T06:40:23.643 INFO:tasks.workunit.client.0.smithi099.stdout:5/47: mkdir d3/d14 0 2024-09-19T06:40:23.644 INFO:tasks.workunit.client.0.smithi099.stdout:7/48: rename d7/cb to d7/c11 0 2024-09-19T06:40:23.645 INFO:tasks.workunit.client.0.smithi099.stdout:3/50: mknod d7/c9 0 2024-09-19T06:40:23.647 INFO:tasks.workunit.client.0.smithi099.stdout:5/48: creat d3/d14/f15 x:0 0 0 2024-09-19T06:40:23.647 INFO:tasks.workunit.client.0.smithi099.stdout:5/49: readlink d3/le 0 2024-09-19T06:40:23.649 INFO:tasks.workunit.client.0.smithi099.stdout:3/51: dread f4 [0,4194304] 0 2024-09-19T06:40:23.654 INFO:tasks.workunit.client.0.smithi099.stdout:3/52: link f6 d7/fa 0 2024-09-19T06:40:23.655 INFO:tasks.workunit.client.0.smithi099.stdout:5/50: dwrite d3/d7/fa [0,4194304] 0 2024-09-19T06:40:23.656 INFO:tasks.workunit.client.0.smithi099.stdout:3/53: mknod d7/cb 0 2024-09-19T06:40:23.659 INFO:tasks.workunit.client.0.smithi099.stdout:7/49: link d7/c11 d7/c12 0 2024-09-19T06:40:23.659 INFO:tasks.workunit.client.0.smithi099.stdout:3/54: write f6 [1228243,94870] 0 2024-09-19T06:40:23.660 INFO:tasks.workunit.client.0.smithi099.stdout:7/50: chown d7/ff 0 1 2024-09-19T06:40:23.660 INFO:tasks.workunit.client.0.smithi099.stdout:3/55: chown d7/f8 14 1 2024-09-19T06:40:23.664 INFO:tasks.workunit.client.0.smithi099.stdout:5/51: dread d3/d7/ff [0,4194304] 0 2024-09-19T06:40:23.665 INFO:tasks.workunit.client.0.smithi099.stdout:5/52: write d3/d7/fb [1790484,126077] 0 2024-09-19T06:40:23.665 INFO:tasks.workunit.client.0.smithi099.stdout:7/51: mknod d7/dd/c13 0 2024-09-19T06:40:23.667 INFO:tasks.workunit.client.0.smithi099.stdout:5/53: mkdir d3/d16 0 2024-09-19T06:40:23.667 INFO:tasks.workunit.client.0.smithi099.stdout:7/52: mknod d7/dd/c14 0 2024-09-19T06:40:23.670 INFO:tasks.workunit.client.0.smithi099.stdout:7/53: creat d7/f15 x:0 0 0 2024-09-19T06:40:23.671 INFO:tasks.workunit.client.0.smithi099.stdout:3/56: dwrite d7/fa [0,4194304] 0 2024-09-19T06:40:23.672 INFO:tasks.workunit.client.0.smithi099.stdout:7/54: creat d7/dc/f16 x:0 0 0 2024-09-19T06:40:23.674 INFO:tasks.workunit.client.0.smithi099.stdout:3/57: unlink d7/f8 0 2024-09-19T06:40:23.675 INFO:tasks.workunit.client.0.smithi099.stdout:5/54: dwrite d3/d7/fb [0,4194304] 0 2024-09-19T06:40:23.676 INFO:tasks.workunit.client.0.smithi099.stdout:7/55: creat d7/f17 x:0 0 0 2024-09-19T06:40:23.676 INFO:tasks.workunit.client.0.smithi099.stdout:3/58: creat d7/fc x:0 0 0 2024-09-19T06:40:23.679 INFO:tasks.workunit.client.0.smithi099.stdout:7/56: rename l3 to d7/dd/l18 0 2024-09-19T06:40:23.680 INFO:tasks.workunit.client.0.smithi099.stdout:5/55: getdents d3/d16 0 2024-09-19T06:40:23.680 INFO:tasks.workunit.client.0.smithi099.stdout:7/57: rename d7 to d7/d19 22 2024-09-19T06:40:23.680 INFO:tasks.workunit.client.0.smithi099.stdout:3/59: dread f6 [0,4194304] 0 2024-09-19T06:40:23.682 INFO:tasks.workunit.client.0.smithi099.stdout:5/56: symlink d3/d14/l17 0 2024-09-19T06:40:23.682 INFO:tasks.workunit.client.0.smithi099.stdout:7/58: chown d7/c11 528136849 1 2024-09-19T06:40:23.683 INFO:tasks.workunit.client.0.smithi099.stdout:5/57: readlink d3/d7/l12 0 2024-09-19T06:40:23.684 INFO:tasks.workunit.client.0.smithi099.stdout:5/58: creat d3/f18 x:0 0 0 2024-09-19T06:40:23.685 INFO:tasks.workunit.client.0.smithi099.stdout:3/60: dread d7/fa [0,4194304] 0 2024-09-19T06:40:23.686 INFO:tasks.workunit.client.0.smithi099.stdout:3/61: chown d7/fa 1 1 2024-09-19T06:40:23.687 INFO:tasks.workunit.client.0.smithi099.stdout:5/59: symlink d3/l19 0 2024-09-19T06:40:23.688 INFO:tasks.workunit.client.0.smithi099.stdout:5/60: chown d3/f5 0 1 2024-09-19T06:40:23.694 INFO:tasks.workunit.client.0.smithi099.stdout:3/62: dwrite f6 [0,4194304] 0 2024-09-19T06:40:23.695 INFO:tasks.workunit.client.0.smithi099.stdout:5/61: getdents d3 0 2024-09-19T06:40:23.696 INFO:tasks.workunit.client.0.smithi099.stdout:3/63: rmdir d7 39 2024-09-19T06:40:23.699 INFO:tasks.workunit.client.0.smithi099.stdout:7/59: dwrite f5 [0,4194304] 0 2024-09-19T06:40:23.699 INFO:tasks.workunit.client.0.smithi099.stdout:3/64: write d7/fa [2446523,42789] 0 2024-09-19T06:40:23.700 INFO:tasks.workunit.client.0.smithi099.stdout:7/60: chown d7/f15 671 1 2024-09-19T06:40:23.702 INFO:tasks.workunit.client.0.smithi099.stdout:7/61: symlink d7/l1a 0 2024-09-19T06:40:23.702 INFO:tasks.workunit.client.0.smithi099.stdout:5/62: getdents d3 0 2024-09-19T06:40:23.706 INFO:tasks.workunit.client.0.smithi099.stdout:5/63: unlink d3/f18 0 2024-09-19T06:40:23.709 INFO:tasks.workunit.client.0.smithi099.stdout:5/64: dread - d3/d14/f15 zero size 2024-09-19T06:40:23.709 INFO:tasks.workunit.client.0.smithi099.stdout:3/65: dwrite d7/fa [0,4194304] 0 2024-09-19T06:40:23.714 INFO:tasks.workunit.client.0.smithi099.stdout:7/62: dwrite d7/f9 [0,4194304] 0 2024-09-19T06:40:23.717 INFO:tasks.workunit.client.0.smithi099.stdout:7/63: mknod d7/c1b 0 2024-09-19T06:40:23.717 INFO:tasks.workunit.client.0.smithi099.stdout:5/65: write d3/f9 [543842,129912] 0 2024-09-19T06:40:23.719 INFO:tasks.workunit.client.0.smithi099.stdout:7/64: read f6 [548042,40984] 0 2024-09-19T06:40:23.720 INFO:tasks.workunit.client.0.smithi099.stdout:3/66: dwrite f4 [4194304,4194304] 0 2024-09-19T06:40:23.723 INFO:tasks.workunit.client.0.smithi099.stdout:5/66: write d3/f9 [994034,66942] 0 2024-09-19T06:40:23.725 INFO:tasks.workunit.client.0.smithi099.stdout:5/67: write d3/d7/fa [158273,58225] 0 2024-09-19T06:40:23.725 INFO:tasks.workunit.client.0.smithi099.stdout:3/67: rename f4 to d7/fd 0 2024-09-19T06:40:23.726 INFO:tasks.workunit.client.0.smithi099.stdout:5/68: chown d3/d7/fb 0 1 2024-09-19T06:40:23.727 INFO:tasks.workunit.client.0.smithi099.stdout:7/65: dread f5 [0,4194304] 0 2024-09-19T06:40:23.729 INFO:tasks.workunit.client.0.smithi099.stdout:7/66: mkdir d7/d1c 0 2024-09-19T06:40:23.729 INFO:tasks.workunit.client.0.smithi099.stdout:5/69: read d3/f9 [746980,5958] 0 2024-09-19T06:40:23.732 INFO:tasks.workunit.client.0.smithi099.stdout:7/67: mknod d7/dc/c1d 0 2024-09-19T06:40:23.732 INFO:tasks.workunit.client.0.smithi099.stdout:7/68: read f5 [618219,36853] 0 2024-09-19T06:40:23.745 INFO:tasks.workunit.client.0.smithi099.stdout:7/69: truncate d7/fa 1245981 0 2024-09-19T06:40:23.746 INFO:tasks.workunit.client.0.smithi099.stdout:7/70: dread - f2 zero size 2024-09-19T06:40:23.749 INFO:tasks.workunit.client.0.smithi099.stdout:5/70: write d3/d7/ff [2183164,38151] 0 2024-09-19T06:40:23.796 INFO:tasks.workunit.client.0.smithi099.stdout:7/71: creat d7/dc/f1e x:0 0 0 2024-09-19T06:40:23.796 INFO:tasks.workunit.client.0.smithi099.stdout:5/71: symlink d3/l1a 0 2024-09-19T06:40:23.797 INFO:tasks.workunit.client.0.smithi099.stdout:7/72: mkdir d7/dc/d1f 0 2024-09-19T06:40:23.798 INFO:tasks.workunit.client.0.smithi099.stdout:7/73: write f1 [891319,68446] 0 2024-09-19T06:40:23.798 INFO:tasks.workunit.client.0.smithi099.stdout:5/72: rename d3/d14/l17 to d3/l1b 0 2024-09-19T06:40:23.802 INFO:tasks.workunit.client.0.smithi099.stdout:5/73: dread d3/d7/fb [0,4194304] 0 2024-09-19T06:40:23.803 INFO:tasks.workunit.client.0.smithi099.stdout:5/74: creat d3/d7/f1c x:0 0 0 2024-09-19T06:40:23.855 INFO:tasks.workunit.client.0.smithi099.stdout:5/75: rmdir d3/d14 39 2024-09-19T06:40:23.856 INFO:tasks.workunit.client.0.smithi099.stdout:5/76: chown d3/f9 1 1 2024-09-19T06:40:23.873 INFO:tasks.workunit.client.0.smithi099.stdout:5/77: link d3/l6 d3/l1d 0 2024-09-19T06:40:23.875 INFO:tasks.workunit.client.0.smithi099.stdout:5/78: symlink d3/d14/l1e 0 2024-09-19T06:40:23.876 INFO:tasks.workunit.client.0.smithi099.stdout:5/79: unlink d3/d14/f15 0 2024-09-19T06:40:23.882 INFO:tasks.workunit.client.0.smithi099.stdout:5/80: dwrite d3/d7/f11 [0,4194304] 0 2024-09-19T06:40:23.884 INFO:tasks.workunit.client.0.smithi099.stdout:5/81: chown d3/l1d 280008677 1 2024-09-19T06:40:24.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:24 smithi099 ceph-mon[27651]: pgmap v10: 65 pgs: 65 active+clean; 278 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 377 KiB/s rd, 14 MiB/s wr, 338 op/s 2024-09-19T06:40:24.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:24 smithi117 ceph-mon[34564]: pgmap v10: 65 pgs: 65 active+clean; 278 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 377 KiB/s rd, 14 MiB/s wr, 338 op/s 2024-09-19T06:40:24.757 INFO:tasks.workunit.client.1.smithi117.stdout:3/14: sync 2024-09-19T06:40:24.761 INFO:tasks.workunit.client.1.smithi117.stdout:3/15: getdents d0 0 2024-09-19T06:40:24.766 INFO:tasks.workunit.client.1.smithi117.stdout:3/16: dread d0/f1 [0,4194304] 0 2024-09-19T06:40:24.768 INFO:tasks.workunit.client.1.smithi117.stdout:3/17: getdents d0 0 2024-09-19T06:40:24.768 INFO:tasks.workunit.client.1.smithi117.stdout:3/18: readlink d0/l2 0 2024-09-19T06:40:24.770 INFO:tasks.workunit.client.1.smithi117.stdout:3/19: mknod d0/c4 0 2024-09-19T06:40:24.772 INFO:tasks.workunit.client.1.smithi117.stdout:3/20: write d0/f1 [1049128,93858] 0 2024-09-19T06:40:24.776 INFO:tasks.workunit.client.1.smithi117.stdout:3/21: dread d0/f1 [0,4194304] 0 2024-09-19T06:40:24.777 INFO:tasks.workunit.client.1.smithi117.stdout:3/22: chown d0/l2 46511010 1 2024-09-19T06:40:24.777 INFO:tasks.workunit.client.1.smithi117.stdout:3/23: chown d0/f1 81939 1 2024-09-19T06:40:24.780 INFO:tasks.workunit.client.1.smithi117.stdout:3/24: link d0/l2 d0/l5 0 2024-09-19T06:40:24.781 INFO:tasks.workunit.client.1.smithi117.stdout:3/25: dread d0/f1 [0,4194304] 0 2024-09-19T06:40:24.781 INFO:tasks.workunit.client.1.smithi117.stdout:3/26: stat d0 0 2024-09-19T06:40:24.782 INFO:tasks.workunit.client.1.smithi117.stdout:3/27: chown d0/c4 6478 1 2024-09-19T06:40:24.783 INFO:tasks.workunit.client.1.smithi117.stdout:3/28: readlink d0/l5 0 2024-09-19T06:40:24.784 INFO:tasks.workunit.client.1.smithi117.stdout:3/29: fsync d0/f1 0 2024-09-19T06:40:24.787 INFO:tasks.workunit.client.1.smithi117.stdout:3/30: creat d0/f6 x:0 0 0 2024-09-19T06:40:24.806 INFO:tasks.workunit.client.1.smithi117.stdout:4/21: sync 2024-09-19T06:40:24.806 INFO:tasks.workunit.client.1.smithi117.stdout:8/19: sync 2024-09-19T06:40:24.806 INFO:tasks.workunit.client.1.smithi117.stdout:0/33: sync 2024-09-19T06:40:24.806 INFO:tasks.workunit.client.1.smithi117.stdout:1/20: sync 2024-09-19T06:40:24.807 INFO:tasks.workunit.client.1.smithi117.stdout:9/59: sync 2024-09-19T06:40:24.807 INFO:tasks.workunit.client.1.smithi117.stdout:7/38: sync 2024-09-19T06:40:24.807 INFO:tasks.workunit.client.1.smithi117.stdout:2/77: sync 2024-09-19T06:40:24.807 INFO:tasks.workunit.client.1.smithi117.stdout:5/38: sync 2024-09-19T06:40:24.807 INFO:tasks.workunit.client.1.smithi117.stdout:6/25: sync 2024-09-19T06:40:24.807 INFO:tasks.workunit.client.1.smithi117.stdout:9/60: readlink d4/d8/l14 0 2024-09-19T06:40:24.808 INFO:tasks.workunit.client.1.smithi117.stdout:0/34: fsync f0 0 2024-09-19T06:40:24.808 INFO:tasks.workunit.client.1.smithi117.stdout:5/39: fsync f1 0 2024-09-19T06:40:24.810 INFO:tasks.workunit.client.1.smithi117.stdout:6/26: readlink d1/d5/l7 0 2024-09-19T06:40:24.811 INFO:tasks.workunit.client.1.smithi117.stdout:4/22: fsync d3/d4/f5 0 2024-09-19T06:40:24.812 INFO:tasks.workunit.client.1.smithi117.stdout:6/27: stat d1/d5/l7 0 2024-09-19T06:40:24.812 INFO:tasks.workunit.client.1.smithi117.stdout:2/78: mkdir d0/d7/d1e 0 2024-09-19T06:40:24.813 INFO:tasks.workunit.client.1.smithi117.stdout:2/79: chown d0/fd 240940571 1 2024-09-19T06:40:24.813 INFO:tasks.workunit.client.1.smithi117.stdout:5/40: mknod cc 0 2024-09-19T06:40:24.814 INFO:tasks.workunit.client.1.smithi117.stdout:2/80: chown d0/l4 346701 1 2024-09-19T06:40:24.816 INFO:tasks.workunit.client.1.smithi117.stdout:1/21: symlink d3/l4 0 2024-09-19T06:40:24.817 INFO:tasks.workunit.client.1.smithi117.stdout:1/22: stat l2 0 2024-09-19T06:40:24.817 INFO:tasks.workunit.client.1.smithi117.stdout:4/23: dread d3/d4/f5 [0,4194304] 0 2024-09-19T06:40:24.818 INFO:tasks.workunit.client.1.smithi117.stdout:5/41: symlink ld 0 2024-09-19T06:40:24.822 INFO:tasks.workunit.client.1.smithi117.stdout:6/28: write f0 [8239810,79469] 0 2024-09-19T06:40:24.822 INFO:tasks.workunit.client.1.smithi117.stdout:4/24: unlink f0 0 2024-09-19T06:40:24.823 INFO:tasks.workunit.client.1.smithi117.stdout:7/39: link d1/d8/dc/f6 d1/d8/dc/ff 0 2024-09-19T06:40:24.827 INFO:tasks.workunit.client.1.smithi117.stdout:5/42: fdatasync f2 0 2024-09-19T06:40:24.829 INFO:tasks.workunit.client.1.smithi117.stdout:1/23: truncate f1 1494464 0 2024-09-19T06:40:24.829 INFO:tasks.workunit.client.1.smithi117.stdout:7/40: chown d1/d8/dc/fe 320905 1 2024-09-19T06:40:24.830 INFO:tasks.workunit.client.1.smithi117.stdout:8/20: dwrite f5 [0,4194304] 0 2024-09-19T06:40:24.832 INFO:tasks.workunit.client.1.smithi117.stdout:4/25: rename d3/d4/f5 to d3/f7 0 2024-09-19T06:40:24.832 INFO:tasks.workunit.client.1.smithi117.stdout:7/41: stat d1/d8/dc 0 2024-09-19T06:40:24.836 INFO:tasks.workunit.client.1.smithi117.stdout:9/61: dwrite d4/d8/fe [0,4194304] 0 2024-09-19T06:40:24.837 INFO:tasks.workunit.client.1.smithi117.stdout:1/24: creat d3/f5 x:0 0 0 2024-09-19T06:40:24.840 INFO:tasks.workunit.client.1.smithi117.stdout:4/26: dread - d3/d4/f6 zero size 2024-09-19T06:40:24.842 INFO:tasks.workunit.client.1.smithi117.stdout:6/29: dwrite f0 [4194304,4194304] 0 2024-09-19T06:40:24.843 INFO:tasks.workunit.client.1.smithi117.stdout:9/62: chown d4/d8/fb 0 1 2024-09-19T06:40:24.844 INFO:tasks.workunit.client.1.smithi117.stdout:1/25: symlink d3/l6 0 2024-09-19T06:40:24.845 INFO:tasks.workunit.client.1.smithi117.stdout:6/30: write f0 [4502244,43315] 0 2024-09-19T06:40:24.848 INFO:tasks.workunit.client.1.smithi117.stdout:1/26: fsync d3/f5 0 2024-09-19T06:40:24.849 INFO:tasks.workunit.client.1.smithi117.stdout:2/81: dwrite d0/d7/f19 [0,4194304] 0 2024-09-19T06:40:24.851 INFO:tasks.workunit.client.1.smithi117.stdout:8/21: creat f6 x:0 0 0 2024-09-19T06:40:24.854 INFO:tasks.workunit.client.1.smithi117.stdout:4/27: write d3/f7 [1781707,109824] 0 2024-09-19T06:40:24.855 INFO:tasks.workunit.client.1.smithi117.stdout:5/43: getdents . 0 2024-09-19T06:40:24.856 INFO:tasks.workunit.client.1.smithi117.stdout:5/44: read f3 [1973960,95454] 0 2024-09-19T06:40:24.856 INFO:tasks.workunit.client.1.smithi117.stdout:4/28: truncate f1 2301943 0 2024-09-19T06:40:24.859 INFO:tasks.workunit.client.1.smithi117.stdout:7/42: rename d1/cb to d1/c10 0 2024-09-19T06:40:24.860 INFO:tasks.workunit.client.1.smithi117.stdout:1/27: mknod d3/c7 0 2024-09-19T06:40:24.860 INFO:tasks.workunit.client.1.smithi117.stdout:6/31: dread f0 [0,4194304] 0 2024-09-19T06:40:24.862 INFO:tasks.workunit.client.1.smithi117.stdout:2/82: mknod d0/d7/d1e/c1f 0 2024-09-19T06:40:24.863 INFO:tasks.workunit.client.1.smithi117.stdout:7/43: mknod d1/d8/c11 0 2024-09-19T06:40:24.864 INFO:tasks.workunit.client.1.smithi117.stdout:6/32: mkdir d1/d5/d8 0 2024-09-19T06:40:24.866 INFO:tasks.workunit.client.1.smithi117.stdout:8/22: rename l1 to l7 0 2024-09-19T06:40:24.870 INFO:tasks.workunit.client.1.smithi117.stdout:4/29: dwrite f1 [0,4194304] 0 2024-09-19T06:40:24.873 INFO:tasks.workunit.client.1.smithi117.stdout:9/63: write d4/d8/fb [4887022,29473] 0 2024-09-19T06:40:24.874 INFO:tasks.workunit.client.1.smithi117.stdout:6/33: truncate f0 4174996 0 2024-09-19T06:40:24.876 INFO:tasks.workunit.client.1.smithi117.stdout:9/64: chown d4/df/l11 13 1 2024-09-19T06:40:24.877 INFO:tasks.workunit.client.1.smithi117.stdout:4/30: truncate d3/d4/f6 474213 0 2024-09-19T06:40:24.877 INFO:tasks.workunit.client.1.smithi117.stdout:4/31: readlink - no filename 2024-09-19T06:40:24.877 INFO:tasks.workunit.client.1.smithi117.stdout:5/45: write f1 [5041152,53289] 0 2024-09-19T06:40:24.881 INFO:tasks.workunit.client.1.smithi117.stdout:2/83: write d0/fb [982076,106620] 0 2024-09-19T06:40:24.882 INFO:tasks.workunit.client.1.smithi117.stdout:4/32: read d3/f7 [3877519,36145] 0 2024-09-19T06:40:24.882 INFO:tasks.workunit.client.1.smithi117.stdout:5/46: mknod ce 0 2024-09-19T06:40:24.882 INFO:tasks.workunit.client.1.smithi117.stdout:8/23: dwrite f5 [0,4194304] 0 2024-09-19T06:40:24.885 INFO:tasks.workunit.client.1.smithi117.stdout:9/65: mkdir d4/df/d16 0 2024-09-19T06:40:24.887 INFO:tasks.workunit.client.1.smithi117.stdout:2/84: unlink d0/l5 0 2024-09-19T06:40:24.887 INFO:tasks.workunit.client.1.smithi117.stdout:4/33: chown f1 0 1 2024-09-19T06:40:24.888 INFO:tasks.workunit.client.1.smithi117.stdout:5/47: creat ff x:0 0 0 2024-09-19T06:40:24.889 INFO:tasks.workunit.client.1.smithi117.stdout:9/66: mkdir d4/d17 0 2024-09-19T06:40:24.895 INFO:tasks.workunit.client.1.smithi117.stdout:6/34: truncate f0 4691598 0 2024-09-19T06:40:24.895 INFO:tasks.workunit.client.1.smithi117.stdout:1/28: dwrite f1 [0,4194304] 0 2024-09-19T06:40:24.896 INFO:tasks.workunit.client.1.smithi117.stdout:9/67: fsync d4/d8/fb 0 2024-09-19T06:40:24.900 INFO:tasks.workunit.client.1.smithi117.stdout:7/44: dwrite d1/d8/dc/ff [0,4194304] 0 2024-09-19T06:40:24.911 INFO:tasks.workunit.client.1.smithi117.stdout:1/29: readlink d3/l4 0 2024-09-19T06:40:24.911 INFO:tasks.workunit.client.1.smithi117.stdout:8/24: dread f5 [0,4194304] 0 2024-09-19T06:40:24.911 INFO:tasks.workunit.client.1.smithi117.stdout:6/35: creat d1/d3/f9 x:0 0 0 2024-09-19T06:40:24.916 INFO:tasks.workunit.client.1.smithi117.stdout:5/48: dwrite f3 [4194304,4194304] 0 2024-09-19T06:40:24.917 INFO:tasks.workunit.client.1.smithi117.stdout:1/30: write d3/f5 [478469,103871] 0 2024-09-19T06:40:24.917 INFO:tasks.workunit.client.1.smithi117.stdout:2/85: mkdir d0/d7/d1e/d20 0 2024-09-19T06:40:24.918 INFO:tasks.workunit.client.1.smithi117.stdout:8/25: rename f5 to f8 0 2024-09-19T06:40:24.919 INFO:tasks.workunit.client.1.smithi117.stdout:1/31: chown d3 3753530 1 2024-09-19T06:40:24.919 INFO:tasks.workunit.client.1.smithi117.stdout:2/86: chown d0 426 1 2024-09-19T06:40:24.919 INFO:tasks.workunit.client.1.smithi117.stdout:6/36: truncate d1/d3/f9 870726 0 2024-09-19T06:40:24.922 INFO:tasks.workunit.client.1.smithi117.stdout:8/26: symlink l9 0 2024-09-19T06:40:24.923 INFO:tasks.workunit.client.1.smithi117.stdout:9/68: dwrite d4/f7 [0,4194304] 0 2024-09-19T06:40:24.923 INFO:tasks.workunit.client.1.smithi117.stdout:7/45: link d1/l4 d1/l12 0 2024-09-19T06:40:24.924 INFO:tasks.workunit.client.1.smithi117.stdout:4/34: dwrite d3/f7 [0,4194304] 0 2024-09-19T06:40:24.979 INFO:tasks.workunit.client.1.smithi117.stdout:2/87: mknod d0/d7/c21 0 2024-09-19T06:40:24.979 INFO:tasks.workunit.client.1.smithi117.stdout:9/69: write f0 [152507,123507] 0 2024-09-19T06:40:24.980 INFO:tasks.workunit.client.1.smithi117.stdout:7/46: chown d1/l12 5933649 1 2024-09-19T06:40:24.980 INFO:tasks.workunit.client.1.smithi117.stdout:1/32: dread f1 [0,4194304] 0 2024-09-19T06:40:24.982 INFO:tasks.workunit.client.1.smithi117.stdout:9/70: mkdir d4/d18 0 2024-09-19T06:40:24.982 INFO:tasks.workunit.client.1.smithi117.stdout:7/47: chown d1/d8/c11 2686581 1 2024-09-19T06:40:24.982 INFO:tasks.workunit.client.1.smithi117.stdout:4/35: truncate d3/d4/f6 948329 0 2024-09-19T06:40:24.982 INFO:tasks.workunit.client.1.smithi117.stdout:2/88: mknod d0/c22 0 2024-09-19T06:40:24.983 INFO:tasks.workunit.client.1.smithi117.stdout:1/33: mknod d3/c8 0 2024-09-19T06:40:24.985 INFO:tasks.workunit.client.1.smithi117.stdout:9/71: creat d4/f19 x:0 0 0 2024-09-19T06:40:24.985 INFO:tasks.workunit.client.1.smithi117.stdout:8/27: truncate f8 2408217 0 2024-09-19T06:40:24.985 INFO:tasks.workunit.client.1.smithi117.stdout:4/36: creat d3/d4/f8 x:0 0 0 2024-09-19T06:40:24.987 INFO:tasks.workunit.client.1.smithi117.stdout:1/34: creat d3/f9 x:0 0 0 2024-09-19T06:40:24.989 INFO:tasks.workunit.client.1.smithi117.stdout:2/89: rmdir d0/d7/d1e 39 2024-09-19T06:40:24.989 INFO:tasks.workunit.client.1.smithi117.stdout:8/28: truncate f3 1005348 0 2024-09-19T06:40:24.990 INFO:tasks.workunit.client.1.smithi117.stdout:7/48: dread d1/d8/dc/f6 [0,4194304] 0 2024-09-19T06:40:24.991 INFO:tasks.workunit.client.1.smithi117.stdout:6/37: dwrite f0 [4194304,4194304] 0 2024-09-19T06:40:24.993 INFO:tasks.workunit.client.1.smithi117.stdout:9/72: symlink d4/df/d16/l1a 0 2024-09-19T06:40:24.993 INFO:tasks.workunit.client.1.smithi117.stdout:1/35: mknod d3/ca 0 2024-09-19T06:40:24.995 INFO:tasks.workunit.client.1.smithi117.stdout:4/37: unlink d3/d4/f6 0 2024-09-19T06:40:24.996 INFO:tasks.workunit.client.1.smithi117.stdout:4/38: stat d3/d4/f8 0 2024-09-19T06:40:24.997 INFO:tasks.workunit.client.1.smithi117.stdout:6/38: symlink d1/la 0 2024-09-19T06:40:24.997 INFO:tasks.workunit.client.1.smithi117.stdout:2/90: mknod d0/c23 0 2024-09-19T06:40:24.997 INFO:tasks.workunit.client.1.smithi117.stdout:4/39: write f1 [3582602,97085] 0 2024-09-19T06:40:24.998 INFO:tasks.workunit.client.1.smithi117.stdout:8/29: symlink la 0 2024-09-19T06:40:25.002 INFO:tasks.workunit.client.1.smithi117.stdout:7/49: rename d1/fa to d1/f13 0 2024-09-19T06:40:25.003 INFO:tasks.workunit.client.1.smithi117.stdout:2/91: symlink d0/d7/l24 0 2024-09-19T06:40:25.004 INFO:tasks.workunit.client.1.smithi117.stdout:8/30: mknod cb 0 2024-09-19T06:40:25.005 INFO:tasks.workunit.client.1.smithi117.stdout:4/40: dwrite d3/d4/f8 [0,4194304] 0 2024-09-19T06:40:25.007 INFO:tasks.workunit.client.1.smithi117.stdout:1/36: getdents d3 0 2024-09-19T06:40:25.008 INFO:tasks.workunit.client.1.smithi117.stdout:8/31: mknod cc 0 2024-09-19T06:40:25.008 INFO:tasks.workunit.client.1.smithi117.stdout:8/32: rmdir - no directory 2024-09-19T06:40:25.008 INFO:tasks.workunit.client.1.smithi117.stdout:4/41: creat d3/d4/f9 x:0 0 0 2024-09-19T06:40:25.010 INFO:tasks.workunit.client.1.smithi117.stdout:2/92: symlink d0/d7/d1e/l25 0 2024-09-19T06:40:25.014 INFO:tasks.workunit.client.1.smithi117.stdout:9/73: truncate d4/d8/fe 410022 0 2024-09-19T06:40:25.015 INFO:tasks.workunit.client.1.smithi117.stdout:2/93: symlink d0/l26 0 2024-09-19T06:40:25.016 INFO:tasks.workunit.client.1.smithi117.stdout:9/74: symlink d4/df/l1b 0 2024-09-19T06:40:25.016 INFO:tasks.workunit.client.1.smithi117.stdout:9/75: stat d4/fd 0 2024-09-19T06:40:25.017 INFO:tasks.workunit.client.1.smithi117.stdout:1/37: dwrite f1 [0,4194304] 0 2024-09-19T06:40:25.018 INFO:tasks.workunit.client.1.smithi117.stdout:1/38: chown d3/c7 20 1 2024-09-19T06:40:25.021 INFO:tasks.workunit.client.1.smithi117.stdout:9/76: mkdir d4/d1c 0 2024-09-19T06:40:25.022 INFO:tasks.workunit.client.1.smithi117.stdout:4/42: truncate d3/f7 659434 0 2024-09-19T06:40:25.027 INFO:tasks.workunit.client.1.smithi117.stdout:4/43: creat d3/d4/fa x:0 0 0 2024-09-19T06:40:25.029 INFO:tasks.workunit.client.1.smithi117.stdout:9/77: dread d4/d8/f15 [0,4194304] 0 2024-09-19T06:40:25.029 INFO:tasks.workunit.client.1.smithi117.stdout:7/50: dwrite d1/d8/dc/fe [0,4194304] 0 2024-09-19T06:40:25.030 INFO:tasks.workunit.client.1.smithi117.stdout:1/39: dwrite f1 [4194304,4194304] 0 2024-09-19T06:40:25.032 INFO:tasks.workunit.client.1.smithi117.stdout:1/40: symlink d3/lb 0 2024-09-19T06:40:25.033 INFO:tasks.workunit.client.1.smithi117.stdout:9/78: unlink d4/df/d16/l1a 0 2024-09-19T06:40:25.044 INFO:tasks.workunit.client.1.smithi117.stdout:4/44: dwrite d3/d4/fa [0,4194304] 0 2024-09-19T06:40:25.044 INFO:tasks.workunit.client.1.smithi117.stdout:7/51: dread d1/d8/dc/ff [0,4194304] 0 2024-09-19T06:40:25.050 INFO:tasks.workunit.client.1.smithi117.stdout:7/52: mknod d1/c14 0 2024-09-19T06:40:25.051 INFO:tasks.workunit.client.1.smithi117.stdout:2/94: dwrite d0/d7/f16 [0,4194304] 0 2024-09-19T06:40:25.053 INFO:tasks.workunit.client.1.smithi117.stdout:1/41: dwrite d3/f9 [0,4194304] 0 2024-09-19T06:40:25.057 INFO:tasks.workunit.client.1.smithi117.stdout:7/53: unlink d1/c10 0 2024-09-19T06:40:25.058 INFO:tasks.workunit.client.1.smithi117.stdout:1/42: rename d3/l4 to d3/lc 0 2024-09-19T06:40:25.059 INFO:tasks.workunit.client.1.smithi117.stdout:2/95: creat d0/d12/f27 x:0 0 0 2024-09-19T06:40:25.060 INFO:tasks.workunit.client.1.smithi117.stdout:7/54: chown d1/f13 0 1 2024-09-19T06:40:25.063 INFO:tasks.workunit.client.1.smithi117.stdout:7/55: fdatasync d1/f13 0 2024-09-19T06:40:25.067 INFO:tasks.workunit.client.1.smithi117.stdout:7/56: unlink d1/c14 0 2024-09-19T06:40:25.069 INFO:tasks.workunit.client.1.smithi117.stdout:2/96: dwrite d0/d12/f27 [0,4194304] 0 2024-09-19T06:40:25.069 INFO:tasks.workunit.client.1.smithi117.stdout:7/57: fsync d1/d8/dc/f6 0 2024-09-19T06:40:25.071 INFO:tasks.workunit.client.1.smithi117.stdout:2/97: creat d0/d12/f28 x:0 0 0 2024-09-19T06:40:25.079 INFO:tasks.workunit.client.1.smithi117.stdout:9/79: dwrite d4/d8/fe [0,4194304] 0 2024-09-19T06:40:25.079 INFO:tasks.workunit.client.1.smithi117.stdout:7/58: write d1/f13 [2836056,120012] 0 2024-09-19T06:40:25.082 INFO:tasks.workunit.client.1.smithi117.stdout:9/80: creat d4/d18/f1d x:0 0 0 2024-09-19T06:40:25.083 INFO:tasks.workunit.client.1.smithi117.stdout:7/59: symlink d1/l15 0 2024-09-19T06:40:25.083 INFO:tasks.workunit.client.1.smithi117.stdout:9/81: dread - d4/f19 zero size 2024-09-19T06:40:25.084 INFO:tasks.workunit.client.1.smithi117.stdout:7/60: write d1/f13 [1879998,16565] 0 2024-09-19T06:40:25.088 INFO:tasks.workunit.client.1.smithi117.stdout:7/61: creat d1/d8/f16 x:0 0 0 2024-09-19T06:40:25.093 INFO:tasks.workunit.client.1.smithi117.stdout:9/82: truncate d4/f7 1118933 0 2024-09-19T06:40:25.095 INFO:tasks.workunit.client.1.smithi117.stdout:7/62: getdents d1/d8 0 2024-09-19T06:40:25.097 INFO:tasks.workunit.client.1.smithi117.stdout:4/45: dwrite d3/f7 [0,4194304] 0 2024-09-19T06:40:25.099 INFO:tasks.workunit.client.1.smithi117.stdout:7/63: write d1/d8/dc/ff [850394,29497] 0 2024-09-19T06:40:25.100 INFO:tasks.workunit.client.1.smithi117.stdout:4/46: write f1 [2016758,91587] 0 2024-09-19T06:40:25.101 INFO:tasks.workunit.client.1.smithi117.stdout:2/98: dwrite d0/d12/f13 [0,4194304] 0 2024-09-19T06:40:25.102 INFO:tasks.workunit.client.1.smithi117.stdout:3/31: sync 2024-09-19T06:40:25.103 INFO:tasks.workunit.client.1.smithi117.stdout:4/47: mkdir d3/db 0 2024-09-19T06:40:25.104 INFO:tasks.workunit.client.1.smithi117.stdout:3/32: fdatasync d0/f6 0 2024-09-19T06:40:25.106 INFO:tasks.workunit.client.1.smithi117.stdout:9/83: dread d4/f12 [0,4194304] 0 2024-09-19T06:40:25.106 INFO:tasks.workunit.client.1.smithi117.stdout:4/48: read d3/d4/f8 [1979285,25318] 0 2024-09-19T06:40:25.107 INFO:tasks.workunit.client.1.smithi117.stdout:3/33: chown d0/f6 37124681 1 2024-09-19T06:40:25.108 INFO:tasks.workunit.client.1.smithi117.stdout:9/84: stat d4/f12 0 2024-09-19T06:40:25.108 INFO:tasks.workunit.client.1.smithi117.stdout:4/49: read d3/f7 [1089591,120807] 0 2024-09-19T06:40:25.109 INFO:tasks.workunit.client.1.smithi117.stdout:2/99: mkdir d0/d7/d29 0 2024-09-19T06:40:25.110 INFO:tasks.workunit.client.1.smithi117.stdout:3/34: chown d0/f6 196850444 1 2024-09-19T06:40:25.111 INFO:tasks.workunit.client.1.smithi117.stdout:4/50: getdents d3/db 0 2024-09-19T06:40:25.112 INFO:tasks.workunit.client.1.smithi117.stdout:2/100: write d0/d12/f27 [3320889,85458] 0 2024-09-19T06:40:25.113 INFO:tasks.workunit.client.1.smithi117.stdout:7/64: dwrite d1/d8/dc/ff [0,4194304] 0 2024-09-19T06:40:25.114 INFO:tasks.workunit.client.1.smithi117.stdout:4/51: symlink d3/d4/lc 0 2024-09-19T06:40:25.116 INFO:tasks.workunit.client.1.smithi117.stdout:3/35: getdents d0 0 2024-09-19T06:40:25.116 INFO:tasks.workunit.client.1.smithi117.stdout:3/36: fsync d0/f6 0 2024-09-19T06:40:25.117 INFO:tasks.workunit.client.1.smithi117.stdout:4/52: creat d3/d4/fd x:0 0 0 2024-09-19T06:40:25.117 INFO:tasks.workunit.client.1.smithi117.stdout:7/65: symlink d1/l17 0 2024-09-19T06:40:25.118 INFO:tasks.workunit.client.1.smithi117.stdout:2/101: rename d0/d7/f19 to d0/f2a 0 2024-09-19T06:40:25.119 INFO:tasks.workunit.client.1.smithi117.stdout:7/66: read d1/d8/dc/f6 [1231445,130065] 0 2024-09-19T06:40:25.119 INFO:tasks.workunit.client.1.smithi117.stdout:3/37: symlink d0/l7 0 2024-09-19T06:40:25.120 INFO:tasks.workunit.client.1.smithi117.stdout:4/53: mkdir d3/de 0 2024-09-19T06:40:25.120 INFO:tasks.workunit.client.1.smithi117.stdout:7/67: write d1/f13 [3083211,33438] 0 2024-09-19T06:40:25.121 INFO:tasks.workunit.client.1.smithi117.stdout:7/68: chown d1/l15 279168 1 2024-09-19T06:40:25.122 INFO:tasks.workunit.client.1.smithi117.stdout:3/38: mkdir d0/d8 0 2024-09-19T06:40:25.125 INFO:tasks.workunit.client.1.smithi117.stdout:3/39: mkdir d0/d9 0 2024-09-19T06:40:25.125 INFO:tasks.workunit.client.1.smithi117.stdout:4/54: creat d3/db/ff x:0 0 0 2024-09-19T06:40:25.129 INFO:tasks.workunit.client.1.smithi117.stdout:7/69: rename d1/d8/dc/fe to d1/f18 0 2024-09-19T06:40:25.129 INFO:tasks.workunit.client.1.smithi117.stdout:4/55: fsync f1 0 2024-09-19T06:40:25.131 INFO:tasks.workunit.client.1.smithi117.stdout:3/40: link d0/l5 d0/la 0 2024-09-19T06:40:25.133 INFO:tasks.workunit.client.1.smithi117.stdout:4/56: rename d3/d4/fa to d3/de/f10 0 2024-09-19T06:40:25.135 INFO:tasks.workunit.client.1.smithi117.stdout:7/70: dread d1/f18 [0,4194304] 0 2024-09-19T06:40:25.136 INFO:tasks.workunit.client.1.smithi117.stdout:4/57: creat d3/db/f11 x:0 0 0 2024-09-19T06:40:25.139 INFO:tasks.workunit.client.1.smithi117.stdout:2/102: write d0/f9 [3646938,129080] 0 2024-09-19T06:40:25.142 INFO:tasks.workunit.client.1.smithi117.stdout:4/58: rename d3/db/f11 to d3/de/f12 0 2024-09-19T06:40:25.144 INFO:tasks.workunit.client.1.smithi117.stdout:3/41: dwrite d0/f1 [0,4194304] 0 2024-09-19T06:40:25.146 INFO:tasks.workunit.client.1.smithi117.stdout:9/85: dwrite d4/d8/f15 [0,4194304] 0 2024-09-19T06:40:25.147 INFO:tasks.workunit.client.1.smithi117.stdout:3/42: dread - d0/f6 zero size 2024-09-19T06:40:25.150 INFO:tasks.workunit.client.1.smithi117.stdout:2/103: creat d0/f2b x:0 0 0 2024-09-19T06:40:25.151 INFO:tasks.workunit.client.1.smithi117.stdout:7/71: dwrite d1/f18 [0,4194304] 0 2024-09-19T06:40:25.154 INFO:tasks.workunit.client.1.smithi117.stdout:2/104: write d0/f2a [2396954,119905] 0 2024-09-19T06:40:25.156 INFO:tasks.workunit.client.1.smithi117.stdout:3/43: link d0/f1 d0/fb 0 2024-09-19T06:40:25.157 INFO:tasks.workunit.client.1.smithi117.stdout:9/86: getdents d4/df/d16 0 2024-09-19T06:40:25.157 INFO:tasks.workunit.client.1.smithi117.stdout:4/59: dread d3/de/f10 [0,4194304] 0 2024-09-19T06:40:25.157 INFO:tasks.workunit.client.1.smithi117.stdout:2/105: creat d0/d12/f2c x:0 0 0 2024-09-19T06:40:25.158 INFO:tasks.workunit.client.1.smithi117.stdout:4/60: readlink d3/d4/lc 0 2024-09-19T06:40:25.158 INFO:tasks.workunit.client.1.smithi117.stdout:2/106: stat d0/f2a 0 2024-09-19T06:40:25.160 INFO:tasks.workunit.client.1.smithi117.stdout:3/44: creat d0/d9/fc x:0 0 0 2024-09-19T06:40:25.160 INFO:tasks.workunit.client.1.smithi117.stdout:3/45: dread - d0/f6 zero size 2024-09-19T06:40:25.161 INFO:tasks.workunit.client.1.smithi117.stdout:9/87: creat d4/d17/f1e x:0 0 0 2024-09-19T06:40:25.161 INFO:tasks.workunit.client.1.smithi117.stdout:3/46: read d0/fb [2558932,23539] 0 2024-09-19T06:40:25.162 INFO:tasks.workunit.client.1.smithi117.stdout:4/61: mkdir d3/db/d13 0 2024-09-19T06:40:25.164 INFO:tasks.workunit.client.1.smithi117.stdout:3/47: link d0/f1 d0/d9/fd 0 2024-09-19T06:40:25.165 INFO:tasks.workunit.client.1.smithi117.stdout:2/107: creat d0/d7/f2d x:0 0 0 2024-09-19T06:40:25.169 INFO:tasks.workunit.client.1.smithi117.stdout:2/108: read d0/f6 [1756759,52989] 0 2024-09-19T06:40:25.170 INFO:tasks.workunit.client.1.smithi117.stdout:9/88: dwrite d4/d17/f1e [0,4194304] 0 2024-09-19T06:40:25.172 INFO:tasks.workunit.client.1.smithi117.stdout:7/72: truncate d1/d8/dc/f6 3441883 0 2024-09-19T06:40:25.172 INFO:tasks.workunit.client.1.smithi117.stdout:4/62: dread f1 [0,4194304] 0 2024-09-19T06:40:25.175 INFO:tasks.workunit.client.1.smithi117.stdout:9/89: fsync d4/f12 0 2024-09-19T06:40:25.175 INFO:tasks.workunit.client.1.smithi117.stdout:4/63: fsync d3/d4/fd 0 2024-09-19T06:40:25.178 INFO:tasks.workunit.client.1.smithi117.stdout:4/64: dread - d3/de/f12 zero size 2024-09-19T06:40:25.179 INFO:tasks.workunit.client.1.smithi117.stdout:3/48: dwrite d0/fb [0,4194304] 0 2024-09-19T06:40:25.183 INFO:tasks.workunit.client.1.smithi117.stdout:4/65: mkdir d3/d4/d14 0 2024-09-19T06:40:25.184 INFO:tasks.workunit.client.1.smithi117.stdout:3/49: rename d0/l7 to d0/d8/le 0 2024-09-19T06:40:25.184 INFO:tasks.workunit.client.1.smithi117.stdout:9/90: fdatasync d4/d17/f1e 0 2024-09-19T06:40:25.184 INFO:tasks.workunit.client.1.smithi117.stdout:4/66: write f1 [3225857,24342] 0 2024-09-19T06:40:25.185 INFO:tasks.workunit.client.1.smithi117.stdout:9/91: fsync f0 0 2024-09-19T06:40:25.186 INFO:tasks.workunit.client.1.smithi117.stdout:4/67: dread - d3/de/f12 zero size 2024-09-19T06:40:25.186 INFO:tasks.workunit.client.1.smithi117.stdout:3/50: dread - d0/d9/fc zero size 2024-09-19T06:40:25.189 INFO:tasks.workunit.client.1.smithi117.stdout:4/68: write d3/d4/f9 [590651,56880] 0 2024-09-19T06:40:25.194 INFO:tasks.workunit.client.1.smithi117.stdout:7/73: dwrite d1/d8/dc/f6 [0,4194304] 0 2024-09-19T06:40:25.194 INFO:tasks.workunit.client.1.smithi117.stdout:4/69: rename d3/d4/fd to d3/de/f15 0 2024-09-19T06:40:25.195 INFO:tasks.workunit.client.1.smithi117.stdout:9/92: dread d4/d8/f15 [0,4194304] 0 2024-09-19T06:40:25.196 INFO:tasks.workunit.client.1.smithi117.stdout:7/74: chown d1/l9 8165517 1 2024-09-19T06:40:25.197 INFO:tasks.workunit.client.1.smithi117.stdout:4/70: write d3/f7 [1282185,69905] 0 2024-09-19T06:40:25.199 INFO:tasks.workunit.client.1.smithi117.stdout:7/75: read d1/f18 [2945869,93635] 0 2024-09-19T06:40:25.200 INFO:tasks.workunit.client.1.smithi117.stdout:3/51: dwrite d0/f1 [4194304,4194304] 0 2024-09-19T06:40:25.204 INFO:tasks.workunit.client.1.smithi117.stdout:9/93: rename d4/d17/f1e to d4/d1c/f1f 0 2024-09-19T06:40:25.205 INFO:tasks.workunit.client.1.smithi117.stdout:7/76: mknod d1/c19 0 2024-09-19T06:40:25.206 INFO:tasks.workunit.client.1.smithi117.stdout:7/77: write d1/d8/dc/f6 [299949,78210] 0 2024-09-19T06:40:25.206 INFO:tasks.workunit.client.1.smithi117.stdout:4/71: link d3/f7 d3/d4/f16 0 2024-09-19T06:40:25.207 INFO:tasks.workunit.client.1.smithi117.stdout:9/94: mkdir d4/d20 0 2024-09-19T06:40:25.209 INFO:tasks.workunit.client.1.smithi117.stdout:9/95: creat d4/d17/f21 x:0 0 0 2024-09-19T06:40:25.210 INFO:tasks.workunit.client.1.smithi117.stdout:9/96: fdatasync d4/d18/f1d 0 2024-09-19T06:40:25.210 INFO:tasks.workunit.client.1.smithi117.stdout:4/72: creat d3/d4/d14/f17 x:0 0 0 2024-09-19T06:40:25.210 INFO:tasks.workunit.client.1.smithi117.stdout:9/97: chown d4 252 1 2024-09-19T06:40:25.211 INFO:tasks.workunit.client.1.smithi117.stdout:4/73: truncate d3/d4/f9 1581672 0 2024-09-19T06:40:25.212 INFO:tasks.workunit.client.1.smithi117.stdout:9/98: chown d4/la 439 1 2024-09-19T06:40:25.215 INFO:tasks.workunit.client.1.smithi117.stdout:9/99: dread d4/f12 [0,4194304] 0 2024-09-19T06:40:25.217 INFO:tasks.workunit.client.1.smithi117.stdout:9/100: write d4/d8/f15 [4271339,58882] 0 2024-09-19T06:40:25.218 INFO:tasks.workunit.client.1.smithi117.stdout:4/74: getdents d3/de 0 2024-09-19T06:40:25.221 INFO:tasks.workunit.client.1.smithi117.stdout:4/75: getdents d3/db/d13 0 2024-09-19T06:40:25.221 INFO:tasks.workunit.client.1.smithi117.stdout:9/101: dread d4/d1c/f1f [0,4194304] 0 2024-09-19T06:40:25.222 INFO:tasks.workunit.client.1.smithi117.stdout:9/102: mknod d4/d18/c22 0 2024-09-19T06:40:25.224 INFO:tasks.workunit.client.1.smithi117.stdout:4/76: truncate d3/f7 2654542 0 2024-09-19T06:40:25.224 INFO:tasks.workunit.client.1.smithi117.stdout:4/77: write d3/db/ff [348601,81516] 0 2024-09-19T06:40:25.226 INFO:tasks.workunit.client.1.smithi117.stdout:4/78: creat d3/d4/f18 x:0 0 0 2024-09-19T06:40:25.226 INFO:tasks.workunit.client.1.smithi117.stdout:9/103: link c3 d4/c23 0 2024-09-19T06:40:25.227 INFO:tasks.workunit.client.1.smithi117.stdout:9/104: chown d4/d17/f21 2012068 1 2024-09-19T06:40:25.228 INFO:tasks.workunit.client.1.smithi117.stdout:9/105: creat d4/f24 x:0 0 0 2024-09-19T06:40:25.229 INFO:tasks.workunit.client.1.smithi117.stdout:9/106: read - d4/d17/f21 zero size 2024-09-19T06:40:25.232 INFO:tasks.workunit.client.1.smithi117.stdout:4/79: dwrite d3/de/f10 [0,4194304] 0 2024-09-19T06:40:25.233 INFO:tasks.workunit.client.1.smithi117.stdout:4/80: dread - d3/d4/f18 zero size 2024-09-19T06:40:25.234 INFO:tasks.workunit.client.1.smithi117.stdout:4/81: dread - d3/de/f15 zero size 2024-09-19T06:40:25.234 INFO:tasks.workunit.client.1.smithi117.stdout:9/107: dread d4/d8/fb [0,4194304] 0 2024-09-19T06:40:25.243 INFO:tasks.workunit.client.1.smithi117.stdout:9/108: dwrite d4/f19 [0,4194304] 0 2024-09-19T06:40:25.244 INFO:tasks.workunit.client.1.smithi117.stdout:4/82: dwrite d3/d4/f8 [0,4194304] 0 2024-09-19T06:40:25.247 INFO:tasks.workunit.client.1.smithi117.stdout:4/83: read d3/de/f10 [3153261,6604] 0 2024-09-19T06:40:25.251 INFO:tasks.workunit.client.1.smithi117.stdout:0/35: sync 2024-09-19T06:40:25.252 INFO:tasks.workunit.client.1.smithi117.stdout:5/49: sync 2024-09-19T06:40:25.255 INFO:tasks.workunit.client.1.smithi117.stdout:5/50: symlink l10 0 2024-09-19T06:40:25.256 INFO:tasks.workunit.client.1.smithi117.stdout:9/109: dwrite d4/f19 [0,4194304] 0 2024-09-19T06:40:25.257 INFO:tasks.workunit.client.1.smithi117.stdout:0/36: symlink l5 0 2024-09-19T06:40:25.257 INFO:tasks.workunit.client.1.smithi117.stdout:5/51: dread f2 [0,4194304] 0 2024-09-19T06:40:25.258 INFO:tasks.workunit.client.1.smithi117.stdout:5/52: stat c9 0 2024-09-19T06:40:25.259 INFO:tasks.workunit.client.1.smithi117.stdout:9/110: symlink d4/df/d16/l25 0 2024-09-19T06:40:25.260 INFO:tasks.workunit.client.1.smithi117.stdout:9/111: chown d4/df/l1b 282 1 2024-09-19T06:40:25.264 INFO:tasks.workunit.client.1.smithi117.stdout:9/112: link d4/d8/fb d4/df/d16/f26 0 2024-09-19T06:40:25.265 INFO:tasks.workunit.client.1.smithi117.stdout:9/113: truncate d4/d17/f21 31621 0 2024-09-19T06:40:25.267 INFO:tasks.workunit.client.1.smithi117.stdout:9/114: unlink d4/d8/f15 0 2024-09-19T06:40:25.268 INFO:tasks.workunit.client.1.smithi117.stdout:4/84: truncate f1 2496631 0 2024-09-19T06:40:25.271 INFO:tasks.workunit.client.1.smithi117.stdout:0/37: write f3 [377137,104472] 0 2024-09-19T06:40:25.271 INFO:tasks.workunit.client.1.smithi117.stdout:9/115: symlink d4/d20/l27 0 2024-09-19T06:40:25.274 INFO:tasks.workunit.client.1.smithi117.stdout:9/116: unlink d4/d20/l27 0 2024-09-19T06:40:25.278 INFO:tasks.workunit.client.1.smithi117.stdout:5/53: dwrite f2 [0,4194304] 0 2024-09-19T06:40:25.280 INFO:tasks.workunit.client.1.smithi117.stdout:0/38: dread f4 [0,4194304] 0 2024-09-19T06:40:25.281 INFO:tasks.workunit.client.1.smithi117.stdout:5/54: write f2 [1224586,56273] 0 2024-09-19T06:40:25.284 INFO:tasks.workunit.client.1.smithi117.stdout:0/39: write f4 [4951687,70588] 0 2024-09-19T06:40:25.285 INFO:tasks.workunit.client.1.smithi117.stdout:0/40: readlink l5 0 2024-09-19T06:40:25.285 INFO:tasks.workunit.client.1.smithi117.stdout:5/55: unlink ld 0 2024-09-19T06:40:25.288 INFO:tasks.workunit.client.1.smithi117.stdout:9/117: dwrite d4/f24 [0,4194304] 0 2024-09-19T06:40:25.288 INFO:tasks.workunit.client.1.smithi117.stdout:0/41: write f4 [5615898,1649] 0 2024-09-19T06:40:25.288 INFO:tasks.workunit.client.1.smithi117.stdout:5/56: mknod c11 0 2024-09-19T06:40:25.290 INFO:tasks.workunit.client.1.smithi117.stdout:5/57: write f2 [1505076,52934] 0 2024-09-19T06:40:25.290 INFO:tasks.workunit.client.1.smithi117.stdout:9/118: chown d4/la 3 1 2024-09-19T06:40:25.291 INFO:tasks.workunit.client.1.smithi117.stdout:4/85: dwrite f1 [0,4194304] 0 2024-09-19T06:40:25.293 INFO:tasks.workunit.client.1.smithi117.stdout:5/58: write f1 [291365,129435] 0 2024-09-19T06:40:25.295 INFO:tasks.workunit.client.1.smithi117.stdout:0/42: fsync f4 0 2024-09-19T06:40:25.295 INFO:tasks.workunit.client.1.smithi117.stdout:4/86: symlink d3/d4/l19 0 2024-09-19T06:40:25.296 INFO:tasks.workunit.client.1.smithi117.stdout:5/59: symlink l12 0 2024-09-19T06:40:25.298 INFO:tasks.workunit.client.1.smithi117.stdout:9/119: link f0 d4/d1c/f28 0 2024-09-19T06:40:25.300 INFO:tasks.workunit.client.1.smithi117.stdout:9/120: symlink d4/d8/l29 0 2024-09-19T06:40:25.301 INFO:tasks.workunit.client.1.smithi117.stdout:9/121: dread - d4/d18/f1d zero size 2024-09-19T06:40:25.304 INFO:tasks.workunit.client.1.smithi117.stdout:9/122: fdatasync d4/f7 0 2024-09-19T06:40:25.305 INFO:tasks.workunit.client.1.smithi117.stdout:5/60: dwrite ff [0,4194304] 0 2024-09-19T06:40:25.306 INFO:tasks.workunit.client.1.smithi117.stdout:5/61: write f1 [5240123,54408] 0 2024-09-19T06:40:25.307 INFO:tasks.workunit.client.1.smithi117.stdout:9/123: write d4/d1c/f1f [4149743,128256] 0 2024-09-19T06:40:25.309 INFO:tasks.workunit.client.1.smithi117.stdout:5/62: symlink l13 0 2024-09-19T06:40:25.309 INFO:tasks.workunit.client.1.smithi117.stdout:9/124: mknod d4/df/c2a 0 2024-09-19T06:40:25.311 INFO:tasks.workunit.client.1.smithi117.stdout:9/125: chown d4/df/d16/l25 13944194 1 2024-09-19T06:40:25.313 INFO:tasks.workunit.client.1.smithi117.stdout:5/63: dread f2 [0,4194304] 0 2024-09-19T06:40:25.315 INFO:tasks.workunit.client.1.smithi117.stdout:5/64: symlink l14 0 2024-09-19T06:40:25.315 INFO:tasks.workunit.client.1.smithi117.stdout:5/65: chown c6 660 1 2024-09-19T06:40:25.315 INFO:tasks.workunit.client.1.smithi117.stdout:5/66: fsync f1 0 2024-09-19T06:40:25.317 INFO:tasks.workunit.client.1.smithi117.stdout:4/87: truncate f1 1295258 0 2024-09-19T06:40:25.322 INFO:tasks.workunit.client.1.smithi117.stdout:5/67: dwrite f3 [4194304,4194304] 0 2024-09-19T06:40:25.323 INFO:tasks.workunit.client.1.smithi117.stdout:5/68: read f3 [1723881,74281] 0 2024-09-19T06:40:25.324 INFO:tasks.workunit.client.1.smithi117.stdout:9/126: dwrite d4/fd [0,4194304] 0 2024-09-19T06:40:25.325 INFO:tasks.workunit.client.1.smithi117.stdout:5/69: chown ff 71524 1 2024-09-19T06:40:25.326 INFO:tasks.workunit.client.1.smithi117.stdout:4/88: dread d3/f7 [0,4194304] 0 2024-09-19T06:40:25.327 INFO:tasks.workunit.client.1.smithi117.stdout:5/70: mknod c15 0 2024-09-19T06:40:25.328 INFO:tasks.workunit.client.1.smithi117.stdout:9/127: mknod d4/df/c2b 0 2024-09-19T06:40:25.329 INFO:tasks.workunit.client.1.smithi117.stdout:4/89: write d3/de/f15 [334196,114895] 0 2024-09-19T06:40:25.329 INFO:tasks.workunit.client.1.smithi117.stdout:5/71: symlink l16 0 2024-09-19T06:40:25.330 INFO:tasks.workunit.client.1.smithi117.stdout:9/128: fdatasync d4/f12 0 2024-09-19T06:40:25.330 INFO:tasks.workunit.client.1.smithi117.stdout:9/129: chown d4/c10 60943 1 2024-09-19T06:40:25.333 INFO:tasks.workunit.client.1.smithi117.stdout:5/72: mkdir d17 0 2024-09-19T06:40:25.335 INFO:tasks.workunit.client.1.smithi117.stdout:5/73: symlink d17/l18 0 2024-09-19T06:40:25.338 INFO:tasks.workunit.client.1.smithi117.stdout:5/74: creat d17/f19 x:0 0 0 2024-09-19T06:40:25.339 INFO:tasks.workunit.client.1.smithi117.stdout:4/90: dwrite f1 [0,4194304] 0 2024-09-19T06:40:25.339 INFO:tasks.workunit.client.1.smithi117.stdout:9/130: dwrite d4/f19 [0,4194304] 0 2024-09-19T06:40:25.340 INFO:tasks.workunit.client.1.smithi117.stdout:5/75: chown l10 534 1 2024-09-19T06:40:25.340 INFO:tasks.workunit.client.1.smithi117.stdout:4/91: dread - d3/de/f12 zero size 2024-09-19T06:40:25.341 INFO:tasks.workunit.client.1.smithi117.stdout:9/131: read d4/d1c/f28 [171609,14197] 0 2024-09-19T06:40:25.343 INFO:tasks.workunit.client.1.smithi117.stdout:4/92: mknod d3/c1a 0 2024-09-19T06:40:25.345 INFO:tasks.workunit.client.1.smithi117.stdout:9/132: fsync d4/df/d16/f26 0 2024-09-19T06:40:25.345 INFO:tasks.workunit.client.1.smithi117.stdout:5/76: truncate f1 4209912 0 2024-09-19T06:40:25.346 INFO:tasks.workunit.client.1.smithi117.stdout:4/93: mkdir d3/d1b 0 2024-09-19T06:40:25.347 INFO:tasks.workunit.client.1.smithi117.stdout:9/133: mknod d4/df/c2c 0 2024-09-19T06:40:25.348 INFO:tasks.workunit.client.1.smithi117.stdout:4/94: creat d3/de/f1c x:0 0 0 2024-09-19T06:40:25.349 INFO:tasks.workunit.client.1.smithi117.stdout:9/134: unlink d4/c13 0 2024-09-19T06:40:25.353 INFO:tasks.workunit.client.1.smithi117.stdout:4/95: link d3/d4/f9 d3/db/d13/f1d 0 2024-09-19T06:40:25.355 INFO:tasks.workunit.client.1.smithi117.stdout:4/96: read d3/d4/f9 [328911,44328] 0 2024-09-19T06:40:25.356 INFO:tasks.workunit.client.1.smithi117.stdout:4/97: dread - d3/de/f1c zero size 2024-09-19T06:40:25.357 INFO:tasks.workunit.client.1.smithi117.stdout:9/135: dwrite d4/f12 [4194304,4194304] 0 2024-09-19T06:40:25.358 INFO:tasks.workunit.client.1.smithi117.stdout:4/98: symlink d3/de/l1e 0 2024-09-19T06:40:25.358 INFO:tasks.workunit.client.1.smithi117.stdout:4/99: stat d3/d1b 0 2024-09-19T06:40:25.360 INFO:tasks.workunit.client.1.smithi117.stdout:9/136: unlink d4/df/c2a 0 2024-09-19T06:40:25.363 INFO:tasks.workunit.client.1.smithi117.stdout:4/100: dread d3/de/f10 [0,4194304] 0 2024-09-19T06:40:25.368 INFO:tasks.workunit.client.1.smithi117.stdout:9/137: dwrite d4/d17/f21 [0,4194304] 0 2024-09-19T06:40:25.370 INFO:tasks.workunit.client.1.smithi117.stdout:9/138: chown d4/d8/l29 154709 1 2024-09-19T06:40:25.372 INFO:tasks.workunit.client.1.smithi117.stdout:4/101: dwrite d3/f7 [0,4194304] 0 2024-09-19T06:40:25.375 INFO:tasks.workunit.client.1.smithi117.stdout:5/77: dread f3 [0,4194304] 0 2024-09-19T06:40:25.375 INFO:tasks.workunit.client.1.smithi117.stdout:5/78: readlink l4 0 2024-09-19T06:40:25.375 INFO:tasks.workunit.client.1.smithi117.stdout:5/79: stat cc 0 2024-09-19T06:40:25.376 INFO:tasks.workunit.client.1.smithi117.stdout:4/102: dread d3/f7 [0,4194304] 0 2024-09-19T06:40:25.377 INFO:tasks.workunit.client.1.smithi117.stdout:5/80: symlink d17/l1a 0 2024-09-19T06:40:25.378 INFO:tasks.workunit.client.1.smithi117.stdout:5/81: mkdir d17/d1b 0 2024-09-19T06:40:25.384 INFO:tasks.workunit.client.1.smithi117.stdout:4/103: dwrite d3/d4/d14/f17 [0,4194304] 0 2024-09-19T06:40:25.384 INFO:tasks.workunit.client.1.smithi117.stdout:5/82: link l16 d17/d1b/l1c 0 2024-09-19T06:40:25.384 INFO:tasks.workunit.client.1.smithi117.stdout:5/83: stat d17/d1b 0 2024-09-19T06:40:25.385 INFO:tasks.workunit.client.1.smithi117.stdout:4/104: creat d3/db/f1f x:0 0 0 2024-09-19T06:40:25.386 INFO:tasks.workunit.client.1.smithi117.stdout:4/105: fdatasync d3/de/f15 0 2024-09-19T06:40:25.401 INFO:tasks.workunit.client.1.smithi117.stdout:4/106: fsync d3/d4/f16 0 2024-09-19T06:40:25.402 INFO:tasks.workunit.client.1.smithi117.stdout:4/107: mkdir d3/db/d20 0 2024-09-19T06:40:25.403 INFO:tasks.workunit.client.1.smithi117.stdout:4/108: mkdir d3/d4/d21 0 2024-09-19T06:40:25.404 INFO:tasks.workunit.client.1.smithi117.stdout:4/109: rmdir d3/db/d13 39 2024-09-19T06:40:25.407 INFO:tasks.workunit.client.1.smithi117.stdout:6/39: sync 2024-09-19T06:40:25.407 INFO:tasks.workunit.client.1.smithi117.stdout:8/33: sync 2024-09-19T06:40:25.407 INFO:tasks.workunit.client.1.smithi117.stdout:4/110: link d3/d4/lc d3/d4/d14/l22 0 2024-09-19T06:40:25.407 INFO:tasks.workunit.client.1.smithi117.stdout:6/40: fsync d1/d3/f9 0 2024-09-19T06:40:25.413 INFO:tasks.workunit.client.1.smithi117.stdout:8/34: write f4 [765120,82484] 0 2024-09-19T06:40:25.415 INFO:tasks.workunit.client.1.smithi117.stdout:8/35: fsync f8 0 2024-09-19T06:40:25.418 INFO:tasks.workunit.client.1.smithi117.stdout:8/36: mkdir dd 0 2024-09-19T06:40:25.418 INFO:tasks.workunit.client.1.smithi117.stdout:6/41: dwrite d1/d3/f9 [0,4194304] 0 2024-09-19T06:40:25.419 INFO:tasks.workunit.client.1.smithi117.stdout:6/42: chown d1 0 1 2024-09-19T06:40:25.419 INFO:tasks.workunit.client.1.smithi117.stdout:6/43: readlink d1/la 0 2024-09-19T06:40:25.421 INFO:tasks.workunit.client.1.smithi117.stdout:6/44: mkdir d1/db 0 2024-09-19T06:40:25.421 INFO:tasks.workunit.client.1.smithi117.stdout:8/37: getdents dd 0 2024-09-19T06:40:25.422 INFO:tasks.workunit.client.1.smithi117.stdout:8/38: fdatasync f6 0 2024-09-19T06:40:25.423 INFO:tasks.workunit.client.1.smithi117.stdout:6/45: creat d1/d3/fc x:0 0 0 2024-09-19T06:40:25.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:25 smithi099 ceph-mon[27651]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:40:25.466 INFO:tasks.workunit.client.1.smithi117.stdout:6/46: link d1/d3/f9 d1/d3/fd 0 2024-09-19T06:40:25.469 INFO:tasks.workunit.client.1.smithi117.stdout:8/39: dwrite f4 [4194304,4194304] 0 2024-09-19T06:40:25.470 INFO:tasks.workunit.client.1.smithi117.stdout:6/47: write d1/d3/f9 [1378159,26909] 0 2024-09-19T06:40:25.471 INFO:tasks.workunit.client.1.smithi117.stdout:6/48: write f0 [6192270,19951] 0 2024-09-19T06:40:25.473 INFO:tasks.workunit.client.1.smithi117.stdout:6/49: unlink f0 0 2024-09-19T06:40:25.475 INFO:tasks.workunit.client.1.smithi117.stdout:8/40: rmdir dd 0 2024-09-19T06:40:25.479 INFO:tasks.workunit.client.1.smithi117.stdout:6/50: link d1/d3/f9 d1/d5/fe 0 2024-09-19T06:40:25.479 INFO:tasks.workunit.client.1.smithi117.stdout:8/41: symlink le 0 2024-09-19T06:40:25.480 INFO:tasks.workunit.client.1.smithi117.stdout:6/51: write d1/d3/fc [563469,69871] 0 2024-09-19T06:40:25.482 INFO:tasks.workunit.client.1.smithi117.stdout:6/52: creat d1/d3/ff x:0 0 0 2024-09-19T06:40:25.487 INFO:tasks.workunit.client.1.smithi117.stdout:6/53: truncate d1/d3/f9 2737201 0 2024-09-19T06:40:25.487 INFO:tasks.workunit.client.1.smithi117.stdout:6/54: chown d1 28770735 1 2024-09-19T06:40:25.492 INFO:tasks.workunit.client.1.smithi117.stdout:6/55: rename d1/d5/fe to d1/db/f10 0 2024-09-19T06:40:25.493 INFO:tasks.workunit.client.1.smithi117.stdout:6/56: chown d1/la 0 1 2024-09-19T06:40:25.493 INFO:tasks.workunit.client.1.smithi117.stdout:8/42: dwrite f8 [0,4194304] 0 2024-09-19T06:40:25.494 INFO:tasks.workunit.client.1.smithi117.stdout:8/43: chown cc 699355145 1 2024-09-19T06:40:25.496 INFO:tasks.workunit.client.1.smithi117.stdout:8/44: readlink l2 0 2024-09-19T06:40:25.496 INFO:tasks.workunit.client.1.smithi117.stdout:6/57: truncate d1/d3/f9 3140876 0 2024-09-19T06:40:25.504 INFO:tasks.workunit.client.1.smithi117.stdout:3/52: sync 2024-09-19T06:40:25.504 INFO:tasks.workunit.client.1.smithi117.stdout:1/43: sync 2024-09-19T06:40:25.504 INFO:tasks.workunit.client.1.smithi117.stdout:2/109: sync 2024-09-19T06:40:25.504 INFO:tasks.workunit.client.1.smithi117.stdout:6/58: dwrite d1/d3/ff [0,4194304] 0 2024-09-19T06:40:25.507 INFO:tasks.workunit.client.1.smithi117.stdout:1/44: creat d3/fd x:0 0 0 2024-09-19T06:40:25.508 INFO:tasks.workunit.client.1.smithi117.stdout:6/59: creat d1/db/f11 x:0 0 0 2024-09-19T06:40:25.513 INFO:tasks.workunit.client.1.smithi117.stdout:2/110: creat d0/d7/f2e x:0 0 0 2024-09-19T06:40:25.513 INFO:tasks.workunit.client.1.smithi117.stdout:1/45: creat d3/fe x:0 0 0 2024-09-19T06:40:25.514 INFO:tasks.workunit.client.1.smithi117.stdout:2/111: mkdir d0/d12/d2f 0 2024-09-19T06:40:25.515 INFO:tasks.workunit.client.1.smithi117.stdout:8/45: dwrite f3 [0,4194304] 0 2024-09-19T06:40:25.515 INFO:tasks.workunit.client.1.smithi117.stdout:1/46: mknod d3/cf 0 2024-09-19T06:40:25.523 INFO:tasks.workunit.client.1.smithi117.stdout:1/47: write f1 [8736112,79859] 0 2024-09-19T06:40:25.525 INFO:tasks.workunit.client.1.smithi117.stdout:6/60: write d1/d3/fd [265941,55273] 0 2024-09-19T06:40:25.526 INFO:tasks.workunit.client.1.smithi117.stdout:3/53: dwrite d0/f6 [0,4194304] 0 2024-09-19T06:40:25.526 INFO:tasks.workunit.client.1.smithi117.stdout:8/46: creat ff x:0 0 0 2024-09-19T06:40:25.528 INFO:tasks.workunit.client.1.smithi117.stdout:8/47: fsync f4 0 2024-09-19T06:40:25.530 INFO:tasks.workunit.client.1.smithi117.stdout:3/54: readlink d0/l5 0 2024-09-19T06:40:25.530 INFO:tasks.workunit.client.1.smithi117.stdout:6/61: chown d1/db/f10 124626 1 2024-09-19T06:40:25.532 INFO:tasks.workunit.client.1.smithi117.stdout:8/48: unlink f6 0 2024-09-19T06:40:25.533 INFO:tasks.workunit.client.1.smithi117.stdout:8/49: readlink le 0 2024-09-19T06:40:25.534 INFO:tasks.workunit.client.1.smithi117.stdout:6/62: write d1/db/f10 [2447586,101381] 0 2024-09-19T06:40:25.534 INFO:tasks.workunit.client.1.smithi117.stdout:2/112: dwrite d0/f9 [0,4194304] 0 2024-09-19T06:40:25.535 INFO:tasks.workunit.client.1.smithi117.stdout:3/55: mkdir d0/d9/df 0 2024-09-19T06:40:25.539 INFO:tasks.workunit.client.1.smithi117.stdout:1/48: dwrite d3/f5 [0,4194304] 0 2024-09-19T06:40:25.539 INFO:tasks.workunit.client.1.smithi117.stdout:8/50: mknod c10 0 2024-09-19T06:40:25.540 INFO:tasks.workunit.client.1.smithi117.stdout:8/51: rmdir - no directory 2024-09-19T06:40:25.543 INFO:tasks.workunit.client.1.smithi117.stdout:1/49: creat d3/f10 x:0 0 0 2024-09-19T06:40:25.545 INFO:tasks.workunit.client.1.smithi117.stdout:8/52: creat f11 x:0 0 0 2024-09-19T06:40:25.546 INFO:tasks.workunit.client.1.smithi117.stdout:8/53: readlink la 0 2024-09-19T06:40:25.546 INFO:tasks.workunit.client.1.smithi117.stdout:1/50: write d3/fd [294379,39404] 0 2024-09-19T06:40:25.550 INFO:tasks.workunit.client.1.smithi117.stdout:3/56: truncate d0/fb 5865249 0 2024-09-19T06:40:25.550 INFO:tasks.workunit.client.1.smithi117.stdout:6/63: dwrite d1/d3/ff [0,4194304] 0 2024-09-19T06:40:25.551 INFO:tasks.workunit.client.1.smithi117.stdout:2/113: dwrite d0/d12/f28 [0,4194304] 0 2024-09-19T06:40:25.551 INFO:tasks.workunit.client.1.smithi117.stdout:1/51: write d3/f10 [723309,67498] 0 2024-09-19T06:40:25.553 INFO:tasks.workunit.client.1.smithi117.stdout:6/64: write d1/d3/ff [3343532,121381] 0 2024-09-19T06:40:25.555 INFO:tasks.workunit.client.1.smithi117.stdout:3/57: unlink d0/c4 0 2024-09-19T06:40:25.558 INFO:tasks.workunit.client.1.smithi117.stdout:8/54: truncate f4 3812217 0 2024-09-19T06:40:25.560 INFO:tasks.workunit.client.1.smithi117.stdout:6/65: creat d1/d3/f12 x:0 0 0 2024-09-19T06:40:25.561 INFO:tasks.workunit.client.1.smithi117.stdout:6/66: write d1/d3/f12 [532286,7507] 0 2024-09-19T06:40:25.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:25 smithi117 ceph-mon[34564]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:40:25.564 INFO:tasks.workunit.client.1.smithi117.stdout:3/58: getdents d0/d9 0 2024-09-19T06:40:25.565 INFO:tasks.workunit.client.1.smithi117.stdout:3/59: read - d0/d9/fc zero size 2024-09-19T06:40:25.567 INFO:tasks.workunit.client.1.smithi117.stdout:1/52: fsync d3/f10 0 2024-09-19T06:40:25.567 INFO:tasks.workunit.client.1.smithi117.stdout:3/60: fdatasync d0/fb 0 2024-09-19T06:40:25.568 INFO:tasks.workunit.client.1.smithi117.stdout:1/53: symlink d3/l11 0 2024-09-19T06:40:25.568 INFO:tasks.workunit.client.1.smithi117.stdout:1/54: read f1 [2126545,71820] 0 2024-09-19T06:40:25.569 INFO:tasks.workunit.client.1.smithi117.stdout:3/61: creat d0/d8/f10 x:0 0 0 2024-09-19T06:40:25.570 INFO:tasks.workunit.client.1.smithi117.stdout:3/62: write d0/d8/f10 [613757,48610] 0 2024-09-19T06:40:25.570 INFO:tasks.workunit.client.1.smithi117.stdout:1/55: creat d3/f12 x:0 0 0 2024-09-19T06:40:25.571 INFO:tasks.workunit.client.1.smithi117.stdout:1/56: creat d3/f13 x:0 0 0 2024-09-19T06:40:25.572 INFO:tasks.workunit.client.1.smithi117.stdout:3/63: symlink d0/d9/l11 0 2024-09-19T06:40:25.572 INFO:tasks.workunit.client.1.smithi117.stdout:1/57: chown d3/lc 3 1 2024-09-19T06:40:25.573 INFO:tasks.workunit.client.1.smithi117.stdout:3/64: creat d0/f12 x:0 0 0 2024-09-19T06:40:25.579 INFO:tasks.workunit.client.1.smithi117.stdout:8/55: fsync f4 0 2024-09-19T06:40:25.580 INFO:tasks.workunit.client.1.smithi117.stdout:3/65: dread d0/d9/fd [4194304,4194304] 0 2024-09-19T06:40:25.580 INFO:tasks.workunit.client.1.smithi117.stdout:8/56: dread - ff zero size 2024-09-19T06:40:25.580 INFO:tasks.workunit.client.1.smithi117.stdout:1/58: dwrite d3/f9 [0,4194304] 0 2024-09-19T06:40:25.582 INFO:tasks.workunit.client.1.smithi117.stdout:1/59: fdatasync d3/f10 0 2024-09-19T06:40:25.582 INFO:tasks.workunit.client.1.smithi117.stdout:6/67: truncate d1/d3/fd 2640129 0 2024-09-19T06:40:25.584 INFO:tasks.workunit.client.1.smithi117.stdout:7/78: sync 2024-09-19T06:40:25.584 INFO:tasks.workunit.client.1.smithi117.stdout:0/43: sync 2024-09-19T06:40:25.585 INFO:tasks.workunit.client.1.smithi117.stdout:3/66: creat d0/f13 x:0 0 0 2024-09-19T06:40:25.585 INFO:tasks.workunit.client.1.smithi117.stdout:6/68: fdatasync d1/db/f11 0 2024-09-19T06:40:25.586 INFO:tasks.workunit.client.1.smithi117.stdout:1/60: write d3/fd [500829,31730] 0 2024-09-19T06:40:25.589 INFO:tasks.workunit.client.1.smithi117.stdout:3/67: write d0/d8/f10 [275932,60454] 0 2024-09-19T06:40:25.589 INFO:tasks.workunit.client.1.smithi117.stdout:2/114: dwrite d0/ff [0,4194304] 0 2024-09-19T06:40:25.591 INFO:tasks.workunit.client.1.smithi117.stdout:8/57: dread f8 [0,4194304] 0 2024-09-19T06:40:25.592 INFO:tasks.workunit.client.1.smithi117.stdout:7/79: rename d1/f13 to d1/d8/f1a 0 2024-09-19T06:40:25.596 INFO:tasks.workunit.client.1.smithi117.stdout:1/61: dwrite d3/f5 [0,4194304] 0 2024-09-19T06:40:25.596 INFO:tasks.workunit.client.1.smithi117.stdout:0/44: creat f6 x:0 0 0 2024-09-19T06:40:25.598 INFO:tasks.workunit.client.1.smithi117.stdout:6/69: dread d1/d3/f9 [0,4194304] 0 2024-09-19T06:40:25.599 INFO:tasks.workunit.client.1.smithi117.stdout:9/139: sync 2024-09-19T06:40:25.599 INFO:tasks.workunit.client.1.smithi117.stdout:4/111: sync 2024-09-19T06:40:25.599 INFO:tasks.workunit.client.1.smithi117.stdout:5/84: sync 2024-09-19T06:40:25.600 INFO:tasks.workunit.client.1.smithi117.stdout:4/112: chown d3/db/f1f 2751 1 2024-09-19T06:40:25.603 INFO:tasks.workunit.client.1.smithi117.stdout:1/62: creat d3/f14 x:0 0 0 2024-09-19T06:40:25.603 INFO:tasks.workunit.client.1.smithi117.stdout:2/115: mknod d0/c30 0 2024-09-19T06:40:25.603 INFO:tasks.workunit.client.1.smithi117.stdout:6/70: dread d1/db/f10 [0,4194304] 0 2024-09-19T06:40:25.605 INFO:tasks.workunit.client.1.smithi117.stdout:6/71: chown d1/d3 1443427 1 2024-09-19T06:40:25.608 INFO:tasks.workunit.client.1.smithi117.stdout:6/72: fsync d1/db/f11 0 2024-09-19T06:40:25.609 INFO:tasks.workunit.client.1.smithi117.stdout:3/68: write d0/fb [5960997,8769] 0 2024-09-19T06:40:25.612 INFO:tasks.workunit.client.1.smithi117.stdout:8/58: creat f12 x:0 0 0 2024-09-19T06:40:25.613 INFO:tasks.workunit.client.1.smithi117.stdout:9/140: dwrite d4/d1c/f1f [4194304,4194304] 0 2024-09-19T06:40:25.613 INFO:tasks.workunit.client.1.smithi117.stdout:7/80: dwrite d1/d8/f1a [0,4194304] 0 2024-09-19T06:40:25.615 INFO:tasks.workunit.client.1.smithi117.stdout:4/113: rename d3/d4/d21 to d3/db/d23 0 2024-09-19T06:40:25.615 INFO:tasks.workunit.client.1.smithi117.stdout:8/59: truncate ff 69727 0 2024-09-19T06:40:25.618 INFO:tasks.workunit.client.1.smithi117.stdout:1/63: link d3/c7 d3/c15 0 2024-09-19T06:40:25.618 INFO:tasks.workunit.client.1.smithi117.stdout:2/116: link d0/f6 d0/d7/d1e/f31 0 2024-09-19T06:40:25.619 INFO:tasks.workunit.client.1.smithi117.stdout:5/85: getdents d17 0 2024-09-19T06:40:25.619 INFO:tasks.workunit.client.1.smithi117.stdout:0/45: truncate f3 181482 0 2024-09-19T06:40:25.620 INFO:tasks.workunit.client.1.smithi117.stdout:1/64: write d3/f5 [3463559,98439] 0 2024-09-19T06:40:25.621 INFO:tasks.workunit.client.1.smithi117.stdout:7/81: write d1/f18 [3688409,7406] 0 2024-09-19T06:40:25.623 INFO:tasks.workunit.client.1.smithi117.stdout:9/141: creat d4/d8/f2d x:0 0 0 2024-09-19T06:40:25.625 INFO:tasks.workunit.client.1.smithi117.stdout:8/60: unlink c10 0 2024-09-19T06:40:25.626 INFO:tasks.workunit.client.1.smithi117.stdout:4/114: symlink d3/l24 0 2024-09-19T06:40:25.629 INFO:tasks.workunit.client.1.smithi117.stdout:1/65: symlink d3/l16 0 2024-09-19T06:40:25.629 INFO:tasks.workunit.client.1.smithi117.stdout:7/82: mknod d1/d8/dc/c1b 0 2024-09-19T06:40:25.630 INFO:tasks.workunit.client.1.smithi117.stdout:8/61: fsync f4 0 2024-09-19T06:40:25.631 INFO:tasks.workunit.client.1.smithi117.stdout:0/46: mknod c7 0 2024-09-19T06:40:25.631 INFO:tasks.workunit.client.1.smithi117.stdout:7/83: chown d1/d8 213 1 2024-09-19T06:40:25.632 INFO:tasks.workunit.client.1.smithi117.stdout:6/73: dwrite d1/d3/fd [0,4194304] 0 2024-09-19T06:40:25.633 INFO:tasks.workunit.client.1.smithi117.stdout:8/62: chown la 828207000 1 2024-09-19T06:40:25.639 INFO:tasks.workunit.client.1.smithi117.stdout:9/142: fsync d4/d8/f2d 0 2024-09-19T06:40:25.641 INFO:tasks.workunit.client.1.smithi117.stdout:6/74: symlink d1/l13 0 2024-09-19T06:40:25.641 INFO:tasks.workunit.client.1.smithi117.stdout:7/84: mkdir d1/d8/dc/d1c 0 2024-09-19T06:40:25.643 INFO:tasks.workunit.client.1.smithi117.stdout:4/115: dwrite d3/de/f15 [0,4194304] 0 2024-09-19T06:40:25.644 INFO:tasks.workunit.client.1.smithi117.stdout:3/69: truncate d0/f1 4316146 0 2024-09-19T06:40:25.644 INFO:tasks.workunit.client.1.smithi117.stdout:6/75: chown d1/l13 3161319 1 2024-09-19T06:40:25.644 INFO:tasks.workunit.client.1.smithi117.stdout:8/63: mknod c13 0 2024-09-19T06:40:25.645 INFO:tasks.workunit.client.1.smithi117.stdout:0/47: dread f4 [4194304,4194304] 0 2024-09-19T06:40:25.645 INFO:tasks.workunit.client.1.smithi117.stdout:9/143: mknod d4/d8/c2e 0 2024-09-19T06:40:25.646 INFO:tasks.workunit.client.1.smithi117.stdout:5/86: truncate f3 1585640 0 2024-09-19T06:40:25.646 INFO:tasks.workunit.client.1.smithi117.stdout:8/64: chown f12 16977041 1 2024-09-19T06:40:25.647 INFO:tasks.workunit.client.1.smithi117.stdout:8/65: readlink l2 0 2024-09-19T06:40:25.648 INFO:tasks.workunit.client.1.smithi117.stdout:1/66: dwrite d3/f5 [0,4194304] 0 2024-09-19T06:40:25.651 INFO:tasks.workunit.client.1.smithi117.stdout:7/85: dread d1/d8/f1a [0,4194304] 0 2024-09-19T06:40:25.653 INFO:tasks.workunit.client.1.smithi117.stdout:8/66: mknod c14 0 2024-09-19T06:40:25.657 INFO:tasks.workunit.client.1.smithi117.stdout:5/87: dwrite f2 [0,4194304] 0 2024-09-19T06:40:25.659 INFO:tasks.workunit.client.1.smithi117.stdout:8/67: dread f3 [0,4194304] 0 2024-09-19T06:40:25.659 INFO:tasks.workunit.client.1.smithi117.stdout:8/68: rmdir - no directory 2024-09-19T06:40:25.659 INFO:tasks.workunit.client.1.smithi117.stdout:8/69: rmdir - no directory 2024-09-19T06:40:25.661 INFO:tasks.workunit.client.1.smithi117.stdout:3/70: getdents d0/d8 0 2024-09-19T06:40:25.661 INFO:tasks.workunit.client.1.smithi117.stdout:5/88: mknod d17/c1d 0 2024-09-19T06:40:25.662 INFO:tasks.workunit.client.1.smithi117.stdout:0/48: read f3 [24565,36406] 0 2024-09-19T06:40:25.662 INFO:tasks.workunit.client.1.smithi117.stdout:7/86: mknod d1/d8/dc/d1c/c1d 0 2024-09-19T06:40:25.664 INFO:tasks.workunit.client.1.smithi117.stdout:0/49: symlink l8 0 2024-09-19T06:40:25.665 INFO:tasks.workunit.client.1.smithi117.stdout:5/89: symlink d17/d1b/l1e 0 2024-09-19T06:40:25.666 INFO:tasks.workunit.client.1.smithi117.stdout:0/50: fsync f3 0 2024-09-19T06:40:25.667 INFO:tasks.workunit.client.1.smithi117.stdout:7/87: creat d1/f1e x:0 0 0 2024-09-19T06:40:25.669 INFO:tasks.workunit.client.1.smithi117.stdout:0/51: fdatasync f0 0 2024-09-19T06:40:25.671 INFO:tasks.workunit.client.1.smithi117.stdout:7/88: write d1/d8/f1a [476434,99753] 0 2024-09-19T06:40:25.673 INFO:tasks.workunit.client.1.smithi117.stdout:5/90: link d17/l1a d17/l1f 0 2024-09-19T06:40:25.676 INFO:tasks.workunit.client.1.smithi117.stdout:0/52: creat f9 x:0 0 0 2024-09-19T06:40:25.678 INFO:tasks.workunit.client.1.smithi117.stdout:7/89: link d1/d8/f16 d1/d8/f1f 0 2024-09-19T06:40:25.680 INFO:tasks.workunit.client.1.smithi117.stdout:7/90: read d1/d8/dc/f6 [2499455,23047] 0 2024-09-19T06:40:25.680 INFO:tasks.workunit.client.1.smithi117.stdout:0/53: unlink f9 0 2024-09-19T06:40:25.680 INFO:tasks.workunit.client.1.smithi117.stdout:0/54: dread - f6 zero size 2024-09-19T06:40:25.683 INFO:tasks.workunit.client.1.smithi117.stdout:7/91: creat d1/d8/dc/f20 x:0 0 0 2024-09-19T06:40:25.685 INFO:tasks.workunit.client.1.smithi117.stdout:0/55: mknod ca 0 2024-09-19T06:40:25.687 INFO:tasks.workunit.client.1.smithi117.stdout:0/56: mknod cb 0 2024-09-19T06:40:25.689 INFO:tasks.workunit.client.1.smithi117.stdout:7/92: rename d1/f18 to d1/f21 0 2024-09-19T06:40:25.691 INFO:tasks.workunit.client.1.smithi117.stdout:0/57: unlink cb 0 2024-09-19T06:40:25.691 INFO:tasks.workunit.client.1.smithi117.stdout:0/58: chown f4 190 1 2024-09-19T06:40:25.693 INFO:tasks.workunit.client.1.smithi117.stdout:0/59: dread f3 [0,4194304] 0 2024-09-19T06:40:25.693 INFO:tasks.workunit.client.1.smithi117.stdout:7/93: creat d1/d8/dc/d1c/f22 x:0 0 0 2024-09-19T06:40:25.696 INFO:tasks.workunit.client.1.smithi117.stdout:7/94: mknod d1/d8/dc/c23 0 2024-09-19T06:40:25.697 INFO:tasks.workunit.client.1.smithi117.stdout:0/60: mknod cc 0 2024-09-19T06:40:25.697 INFO:tasks.workunit.client.1.smithi117.stdout:0/61: read - f6 zero size 2024-09-19T06:40:25.697 INFO:tasks.workunit.client.1.smithi117.stdout:0/62: rmdir - no directory 2024-09-19T06:40:25.701 INFO:tasks.workunit.client.1.smithi117.stdout:0/63: creat fd x:0 0 0 2024-09-19T06:40:25.702 INFO:tasks.workunit.client.1.smithi117.stdout:5/91: write f1 [900448,7061] 0 2024-09-19T06:40:25.704 INFO:tasks.workunit.client.1.smithi117.stdout:7/95: rename d1/d8/dc to d1/d8/d24 0 2024-09-19T06:40:25.705 INFO:tasks.workunit.client.1.smithi117.stdout:5/92: symlink d17/d1b/l20 0 2024-09-19T06:40:25.706 INFO:tasks.workunit.client.1.smithi117.stdout:0/64: rename cc to ce 0 2024-09-19T06:40:25.706 INFO:tasks.workunit.client.1.smithi117.stdout:5/93: dread - d17/f19 zero size 2024-09-19T06:40:25.706 INFO:tasks.workunit.client.1.smithi117.stdout:3/71: dwrite d0/d9/fd [0,4194304] 0 2024-09-19T06:40:25.707 INFO:tasks.workunit.client.1.smithi117.stdout:0/65: truncate f6 1011385 0 2024-09-19T06:40:25.707 INFO:tasks.workunit.client.1.smithi117.stdout:3/72: dread d0/d9/fd [4194304,4194304] 0 2024-09-19T06:40:25.708 INFO:tasks.workunit.client.1.smithi117.stdout:7/96: mknod d1/c25 0 2024-09-19T06:40:25.709 INFO:tasks.workunit.client.1.smithi117.stdout:5/94: creat d17/f21 x:0 0 0 2024-09-19T06:40:25.709 INFO:tasks.workunit.client.1.smithi117.stdout:7/97: read - d1/d8/f16 zero size 2024-09-19T06:40:25.710 INFO:tasks.workunit.client.1.smithi117.stdout:3/73: creat d0/f14 x:0 0 0 2024-09-19T06:40:25.712 INFO:tasks.workunit.client.1.smithi117.stdout:0/66: symlink lf 0 2024-09-19T06:40:25.712 INFO:tasks.workunit.client.1.smithi117.stdout:7/98: mkdir d1/d8/d24/d26 0 2024-09-19T06:40:25.716 INFO:tasks.workunit.client.1.smithi117.stdout:5/95: dwrite f2 [0,4194304] 0 2024-09-19T06:40:25.717 INFO:tasks.workunit.client.1.smithi117.stdout:7/99: rename d1/f21 to d1/d8/d24/d1c/f27 0 2024-09-19T06:40:25.718 INFO:tasks.workunit.client.1.smithi117.stdout:3/74: rmdir d0/d9/df 0 2024-09-19T06:40:25.721 INFO:tasks.workunit.client.1.smithi117.stdout:3/75: creat d0/f15 x:0 0 0 2024-09-19T06:40:25.725 INFO:tasks.workunit.client.1.smithi117.stdout:3/76: creat d0/d8/f16 x:0 0 0 2024-09-19T06:40:25.726 INFO:tasks.workunit.client.1.smithi117.stdout:5/96: dwrite d17/f21 [0,4194304] 0 2024-09-19T06:40:25.726 INFO:tasks.workunit.client.1.smithi117.stdout:7/100: dread d1/d8/f1a [0,4194304] 0 2024-09-19T06:40:25.726 INFO:tasks.workunit.client.1.smithi117.stdout:3/77: chown d0/l5 1 1 2024-09-19T06:40:25.729 INFO:tasks.workunit.client.1.smithi117.stdout:3/78: rmdir d0/d9 39 2024-09-19T06:40:25.730 INFO:tasks.workunit.client.1.smithi117.stdout:0/67: dwrite f0 [0,4194304] 0 2024-09-19T06:40:25.730 INFO:tasks.workunit.client.1.smithi117.stdout:7/101: creat d1/d8/d24/d1c/f28 x:0 0 0 2024-09-19T06:40:25.732 INFO:tasks.workunit.client.1.smithi117.stdout:3/79: rmdir d0/d9 39 2024-09-19T06:40:25.732 INFO:tasks.workunit.client.1.smithi117.stdout:5/97: dread ff [0,4194304] 0 2024-09-19T06:40:25.734 INFO:tasks.workunit.client.1.smithi117.stdout:5/98: read - d17/f19 zero size 2024-09-19T06:40:25.736 INFO:tasks.workunit.client.1.smithi117.stdout:3/80: symlink d0/d9/l17 0 2024-09-19T06:40:25.737 INFO:tasks.workunit.client.1.smithi117.stdout:5/99: chown d17/d1b/l1c 5387 1 2024-09-19T06:40:25.737 INFO:tasks.workunit.client.1.smithi117.stdout:3/81: write d0/f15 [147333,82719] 0 2024-09-19T06:40:25.738 INFO:tasks.workunit.client.1.smithi117.stdout:7/102: dread d1/d8/d24/f6 [0,4194304] 0 2024-09-19T06:40:25.739 INFO:tasks.workunit.client.1.smithi117.stdout:3/82: truncate d0/d8/f10 934265 0 2024-09-19T06:40:25.740 INFO:tasks.workunit.client.1.smithi117.stdout:5/100: dread f1 [0,4194304] 0 2024-09-19T06:40:25.740 INFO:tasks.workunit.client.1.smithi117.stdout:3/83: readlink d0/d9/l17 0 2024-09-19T06:40:25.741 INFO:tasks.workunit.client.1.smithi117.stdout:7/103: truncate d1/d8/d24/f6 1621979 0 2024-09-19T06:40:25.742 INFO:tasks.workunit.client.1.smithi117.stdout:5/101: creat d17/f22 x:0 0 0 2024-09-19T06:40:25.744 INFO:tasks.workunit.client.1.smithi117.stdout:7/104: rename d1/d8/d24/c23 to d1/d8/d24/d1c/c29 0 2024-09-19T06:40:25.747 INFO:tasks.workunit.client.1.smithi117.stdout:3/84: dwrite d0/d9/fd [0,4194304] 0 2024-09-19T06:40:25.754 INFO:tasks.workunit.client.1.smithi117.stdout:5/102: fdatasync d17/f21 0 2024-09-19T06:40:25.756 INFO:tasks.workunit.client.1.smithi117.stdout:3/85: dwrite d0/d8/f10 [0,4194304] 0 2024-09-19T06:40:25.756 INFO:tasks.workunit.client.1.smithi117.stdout:5/103: write f3 [1378858,13672] 0 2024-09-19T06:40:25.758 INFO:tasks.workunit.client.1.smithi117.stdout:3/86: truncate d0/d9/fc 96986 0 2024-09-19T06:40:25.759 INFO:tasks.workunit.client.1.smithi117.stdout:5/104: symlink d17/l23 0 2024-09-19T06:40:25.762 INFO:tasks.workunit.client.1.smithi117.stdout:5/105: write d17/f19 [798430,118309] 0 2024-09-19T06:40:25.768 INFO:tasks.workunit.client.1.smithi117.stdout:7/105: dwrite d1/d8/d24/f6 [0,4194304] 0 2024-09-19T06:40:25.768 INFO:tasks.workunit.client.1.smithi117.stdout:5/106: creat d17/d1b/f24 x:0 0 0 2024-09-19T06:40:25.771 INFO:tasks.workunit.client.1.smithi117.stdout:3/87: dwrite d0/f1 [0,4194304] 0 2024-09-19T06:40:25.773 INFO:tasks.workunit.client.1.smithi117.stdout:3/88: fsync d0/f12 0 2024-09-19T06:40:25.775 INFO:tasks.workunit.client.1.smithi117.stdout:5/107: mknod d17/d1b/c25 0 2024-09-19T06:40:25.778 INFO:tasks.workunit.client.1.smithi117.stdout:7/106: chown d1/d8/d24/d1c/c29 329163649 1 2024-09-19T06:40:25.779 INFO:tasks.workunit.client.1.smithi117.stdout:7/107: chown d1/d8/f1a 4037 1 2024-09-19T06:40:25.781 INFO:tasks.workunit.client.1.smithi117.stdout:3/89: creat d0/f18 x:0 0 0 2024-09-19T06:40:25.781 INFO:tasks.workunit.client.1.smithi117.stdout:3/90: chown d0/f6 195726310 1 2024-09-19T06:40:25.782 INFO:tasks.workunit.client.1.smithi117.stdout:7/108: creat d1/d8/f2a x:0 0 0 2024-09-19T06:40:25.785 INFO:tasks.workunit.client.1.smithi117.stdout:5/108: getdents d17 0 2024-09-19T06:40:25.785 INFO:tasks.workunit.client.1.smithi117.stdout:7/109: symlink d1/d8/d24/d1c/l2b 0 2024-09-19T06:40:25.788 INFO:tasks.workunit.client.1.smithi117.stdout:7/110: creat d1/d8/f2c x:0 0 0 2024-09-19T06:40:25.790 INFO:tasks.workunit.client.1.smithi117.stdout:3/91: dwrite d0/f18 [0,4194304] 0 2024-09-19T06:40:25.797 INFO:tasks.workunit.client.1.smithi117.stdout:7/111: link d1/l4 d1/d8/d24/d26/l2d 0 2024-09-19T06:40:25.798 INFO:tasks.workunit.client.1.smithi117.stdout:5/109: dwrite d17/f19 [0,4194304] 0 2024-09-19T06:40:25.799 INFO:tasks.workunit.client.1.smithi117.stdout:7/112: truncate d1/d8/d24/f20 203753 0 2024-09-19T06:40:25.800 INFO:tasks.workunit.client.1.smithi117.stdout:5/110: chown d17/d1b/l1c 49 1 2024-09-19T06:40:25.800 INFO:tasks.workunit.client.1.smithi117.stdout:7/113: dread - d1/d8/f2a zero size 2024-09-19T06:40:25.802 INFO:tasks.workunit.client.1.smithi117.stdout:5/111: creat d17/f26 x:0 0 0 2024-09-19T06:40:25.803 INFO:tasks.workunit.client.1.smithi117.stdout:3/92: rmdir d0 39 2024-09-19T06:40:25.803 INFO:tasks.workunit.client.1.smithi117.stdout:5/112: dread - d17/f22 zero size 2024-09-19T06:40:25.809 INFO:tasks.workunit.client.1.smithi117.stdout:3/93: mkdir d0/d19 0 2024-09-19T06:40:25.811 INFO:tasks.workunit.client.1.smithi117.stdout:3/94: creat d0/d8/f1a x:0 0 0 2024-09-19T06:40:25.812 INFO:tasks.workunit.client.1.smithi117.stdout:5/113: dwrite d17/f21 [4194304,4194304] 0 2024-09-19T06:40:25.812 INFO:tasks.workunit.client.1.smithi117.stdout:7/114: truncate d1/d8/d24/ff 2715696 0 2024-09-19T06:40:25.814 INFO:tasks.workunit.client.1.smithi117.stdout:5/114: write f1 [1283678,66620] 0 2024-09-19T06:40:25.814 INFO:tasks.workunit.client.1.smithi117.stdout:7/115: dread - d1/d8/d24/d1c/f28 zero size 2024-09-19T06:40:25.817 INFO:tasks.workunit.client.1.smithi117.stdout:5/115: write ff [60911,114104] 0 2024-09-19T06:40:25.821 INFO:tasks.workunit.client.1.smithi117.stdout:5/116: symlink d17/l27 0 2024-09-19T06:40:25.822 INFO:tasks.workunit.client.1.smithi117.stdout:3/95: link d0/d8/le d0/d9/l1b 0 2024-09-19T06:40:25.823 INFO:tasks.workunit.client.1.smithi117.stdout:3/96: chown d0/l2 131739 1 2024-09-19T06:40:25.823 INFO:tasks.workunit.client.1.smithi117.stdout:3/97: chown d0/f12 0 1 2024-09-19T06:40:25.824 INFO:tasks.workunit.client.1.smithi117.stdout:5/117: creat d17/d1b/f28 x:0 0 0 2024-09-19T06:40:25.824 INFO:tasks.workunit.client.1.smithi117.stdout:7/116: read d1/d8/d24/f6 [2040682,7599] 0 2024-09-19T06:40:25.825 INFO:tasks.workunit.client.1.smithi117.stdout:3/98: fdatasync d0/d8/f10 0 2024-09-19T06:40:25.826 INFO:tasks.workunit.client.1.smithi117.stdout:5/118: unlink f2 0 2024-09-19T06:40:25.828 INFO:tasks.workunit.client.1.smithi117.stdout:3/99: mkdir d0/d9/d1c 0 2024-09-19T06:40:25.829 INFO:tasks.workunit.client.1.smithi117.stdout:7/117: mknod d1/c2e 0 2024-09-19T06:40:25.829 INFO:tasks.workunit.client.1.smithi117.stdout:3/100: chown d0/f12 488733 1 2024-09-19T06:40:25.830 INFO:tasks.workunit.client.1.smithi117.stdout:5/119: rename d17/d1b/c25 to d17/d1b/c29 0 2024-09-19T06:40:25.831 INFO:tasks.workunit.client.1.smithi117.stdout:7/118: creat d1/d8/d24/d26/f2f x:0 0 0 2024-09-19T06:40:25.832 INFO:tasks.workunit.client.1.smithi117.stdout:5/120: write d17/f21 [985594,84642] 0 2024-09-19T06:40:25.833 INFO:tasks.workunit.client.1.smithi117.stdout:5/121: read f1 [1478589,56144] 0 2024-09-19T06:40:25.834 INFO:tasks.workunit.client.1.smithi117.stdout:7/119: read - d1/d8/d24/d1c/f28 zero size 2024-09-19T06:40:25.836 INFO:tasks.workunit.client.1.smithi117.stdout:7/120: chown d1/d8/d24/d1c/c29 21 1 2024-09-19T06:40:25.837 INFO:tasks.workunit.client.1.smithi117.stdout:5/122: write d17/d1b/f24 [77906,35905] 0 2024-09-19T06:40:25.837 INFO:tasks.workunit.client.1.smithi117.stdout:3/101: dwrite d0/f14 [0,4194304] 0 2024-09-19T06:40:25.837 INFO:tasks.workunit.client.1.smithi117.stdout:7/121: fdatasync d1/d8/f2c 0 2024-09-19T06:40:25.839 INFO:tasks.workunit.client.1.smithi117.stdout:7/122: write d1/d8/f2a [677465,88886] 0 2024-09-19T06:40:25.841 INFO:tasks.workunit.client.1.smithi117.stdout:5/123: readlink d17/l1f 0 2024-09-19T06:40:25.842 INFO:tasks.workunit.client.1.smithi117.stdout:5/124: truncate d17/f26 143786 0 2024-09-19T06:40:25.843 INFO:tasks.workunit.client.1.smithi117.stdout:3/102: dread d0/f15 [0,4194304] 0 2024-09-19T06:40:25.844 INFO:tasks.workunit.client.1.smithi117.stdout:5/125: rename c11 to d17/c2a 0 2024-09-19T06:40:25.847 INFO:tasks.workunit.client.1.smithi117.stdout:7/123: rename d1/d8/d24/d26/l2d to d1/d8/d24/d26/l30 0 2024-09-19T06:40:25.848 INFO:tasks.workunit.client.1.smithi117.stdout:7/124: dread - d1/d8/f1f zero size 2024-09-19T06:40:25.849 INFO:tasks.workunit.client.1.smithi117.stdout:7/125: write d1/d8/d24/f20 [1202973,17425] 0 2024-09-19T06:40:25.850 INFO:tasks.workunit.client.1.smithi117.stdout:7/126: stat d1/l15 0 2024-09-19T06:40:25.851 INFO:tasks.workunit.client.1.smithi117.stdout:3/103: getdents d0/d8 0 2024-09-19T06:40:25.852 INFO:tasks.workunit.client.1.smithi117.stdout:7/127: write d1/d8/d24/f20 [377204,55754] 0 2024-09-19T06:40:25.852 INFO:tasks.workunit.client.1.smithi117.stdout:5/126: link d17/l1f d17/l2b 0 2024-09-19T06:40:25.853 INFO:tasks.workunit.client.1.smithi117.stdout:3/104: write d0/d8/f10 [61886,117572] 0 2024-09-19T06:40:25.857 INFO:tasks.workunit.client.1.smithi117.stdout:3/105: dread d0/d8/f10 [0,4194304] 0 2024-09-19T06:40:25.858 INFO:tasks.workunit.client.1.smithi117.stdout:3/106: chown d0/f13 936305 1 2024-09-19T06:40:25.858 INFO:tasks.workunit.client.1.smithi117.stdout:7/128: link d1/d8/f1f d1/d8/d24/f31 0 2024-09-19T06:40:25.859 INFO:tasks.workunit.client.1.smithi117.stdout:5/127: truncate d17/f19 1741216 0 2024-09-19T06:40:25.863 INFO:tasks.workunit.client.1.smithi117.stdout:3/107: dread d0/f6 [0,4194304] 0 2024-09-19T06:40:25.863 INFO:tasks.workunit.client.1.smithi117.stdout:7/129: dread d1/d8/d24/f20 [0,4194304] 0 2024-09-19T06:40:25.864 INFO:tasks.workunit.client.1.smithi117.stdout:5/128: link cb d17/c2c 0 2024-09-19T06:40:25.866 INFO:tasks.workunit.client.1.smithi117.stdout:3/108: creat d0/d9/d1c/f1d x:0 0 0 2024-09-19T06:40:25.867 INFO:tasks.workunit.client.1.smithi117.stdout:7/130: write d1/d8/d24/ff [2299813,113617] 0 2024-09-19T06:40:25.869 INFO:tasks.workunit.client.1.smithi117.stdout:7/131: symlink d1/d8/d24/d26/l32 0 2024-09-19T06:40:25.869 INFO:tasks.workunit.client.1.smithi117.stdout:3/109: creat d0/f1e x:0 0 0 2024-09-19T06:40:25.870 INFO:tasks.workunit.client.1.smithi117.stdout:3/110: truncate d0/f6 4554142 0 2024-09-19T06:40:25.871 INFO:tasks.workunit.client.1.smithi117.stdout:3/111: write d0/f13 [1037084,12392] 0 2024-09-19T06:40:25.871 INFO:tasks.workunit.client.1.smithi117.stdout:5/129: truncate ff 1733562 0 2024-09-19T06:40:25.874 INFO:tasks.workunit.client.1.smithi117.stdout:5/130: mknod d17/d1b/c2d 0 2024-09-19T06:40:25.874 INFO:tasks.workunit.client.1.smithi117.stdout:7/132: link d1/l4 d1/l33 0 2024-09-19T06:40:25.875 INFO:tasks.workunit.client.1.smithi117.stdout:7/133: fsync d1/d8/f2a 0 2024-09-19T06:40:25.876 INFO:tasks.workunit.client.1.smithi117.stdout:5/131: mkdir d17/d2e 0 2024-09-19T06:40:25.878 INFO:tasks.workunit.client.1.smithi117.stdout:7/134: symlink d1/l34 0 2024-09-19T06:40:25.878 INFO:tasks.workunit.client.1.smithi117.stdout:5/132: dread d17/f26 [0,4194304] 0 2024-09-19T06:40:25.878 INFO:tasks.workunit.client.1.smithi117.stdout:3/112: dwrite d0/f1 [0,4194304] 0 2024-09-19T06:40:25.881 INFO:tasks.workunit.client.1.smithi117.stdout:5/133: mkdir d17/d2f 0 2024-09-19T06:40:25.883 INFO:tasks.workunit.client.1.smithi117.stdout:7/135: mkdir d1/d8/d24/d1c/d35 0 2024-09-19T06:40:25.884 INFO:tasks.workunit.client.1.smithi117.stdout:5/134: write d17/f21 [6844833,44142] 0 2024-09-19T06:40:25.885 INFO:tasks.workunit.client.1.smithi117.stdout:7/136: symlink d1/d8/l36 0 2024-09-19T06:40:25.886 INFO:tasks.workunit.client.1.smithi117.stdout:5/135: mknod d17/d2f/c30 0 2024-09-19T06:40:25.887 INFO:tasks.workunit.client.1.smithi117.stdout:7/137: creat d1/d8/d24/d26/f37 x:0 0 0 2024-09-19T06:40:25.887 INFO:tasks.workunit.client.1.smithi117.stdout:7/138: fdatasync d1/f1e 0 2024-09-19T06:40:25.894 INFO:tasks.workunit.client.1.smithi117.stdout:5/136: dwrite f1 [0,4194304] 0 2024-09-19T06:40:25.896 INFO:tasks.workunit.client.1.smithi117.stdout:7/139: dwrite d1/d8/d24/ff [0,4194304] 0 2024-09-19T06:40:25.897 INFO:tasks.workunit.client.1.smithi117.stdout:5/137: mknod d17/d2f/c31 0 2024-09-19T06:40:25.899 INFO:tasks.workunit.client.1.smithi117.stdout:5/138: dread d17/f26 [0,4194304] 0 2024-09-19T06:40:25.907 INFO:tasks.workunit.client.1.smithi117.stdout:5/139: dwrite d17/d1b/f24 [0,4194304] 0 2024-09-19T06:40:25.910 INFO:tasks.workunit.client.1.smithi117.stdout:5/140: creat d17/d2e/f32 x:0 0 0 2024-09-19T06:40:25.911 INFO:tasks.workunit.client.1.smithi117.stdout:5/141: creat d17/d2e/f33 x:0 0 0 2024-09-19T06:40:25.918 INFO:tasks.workunit.client.1.smithi117.stdout:5/142: dwrite d17/d2e/f32 [0,4194304] 0 2024-09-19T06:40:25.923 INFO:tasks.workunit.client.1.smithi117.stdout:5/143: dread d17/f21 [0,4194304] 0 2024-09-19T06:40:25.924 INFO:tasks.workunit.client.1.smithi117.stdout:5/144: truncate d17/f22 272956 0 2024-09-19T06:40:25.928 INFO:tasks.workunit.client.1.smithi117.stdout:5/145: dread d17/f21 [0,4194304] 0 2024-09-19T06:40:25.929 INFO:tasks.workunit.client.1.smithi117.stdout:5/146: write d17/d2e/f33 [303287,87503] 0 2024-09-19T06:40:25.930 INFO:tasks.workunit.client.1.smithi117.stdout:5/147: write d17/d2e/f33 [841568,129997] 0 2024-09-19T06:40:25.931 INFO:tasks.workunit.client.1.smithi117.stdout:5/148: fsync d17/f22 0 2024-09-19T06:40:25.934 INFO:tasks.workunit.client.1.smithi117.stdout:5/149: dread f3 [0,4194304] 0 2024-09-19T06:40:25.935 INFO:tasks.workunit.client.1.smithi117.stdout:5/150: truncate d17/d2e/f33 1036114 0 2024-09-19T06:40:25.943 INFO:tasks.workunit.client.1.smithi117.stdout:5/151: truncate d17/d2e/f33 786587 0 2024-09-19T06:40:25.945 INFO:tasks.workunit.client.1.smithi117.stdout:5/152: rename l16 to d17/d2e/l34 0 2024-09-19T06:40:26.101 INFO:tasks.workunit.client.1.smithi117.stdout:2/117: sync 2024-09-19T06:40:26.103 INFO:tasks.workunit.client.1.smithi117.stdout:2/118: mkdir d0/d12/d32 0 2024-09-19T06:40:26.104 INFO:tasks.workunit.client.1.smithi117.stdout:2/119: readlink d0/d7/l17 0 2024-09-19T06:40:26.106 INFO:tasks.workunit.client.1.smithi117.stdout:2/120: rename d0/d7/f2e to d0/d12/d32/f33 0 2024-09-19T06:40:26.108 INFO:tasks.workunit.client.1.smithi117.stdout:2/121: creat d0/f34 x:0 0 0 2024-09-19T06:40:26.109 INFO:tasks.workunit.client.1.smithi117.stdout:2/122: mkdir d0/d7/d29/d35 0 2024-09-19T06:40:26.110 INFO:tasks.workunit.client.1.smithi117.stdout:2/123: dread - d0/d12/f2c zero size 2024-09-19T06:40:26.111 INFO:tasks.workunit.client.1.smithi117.stdout:2/124: symlink d0/d7/d29/d35/l36 0 2024-09-19T06:40:26.149 INFO:tasks.workunit.client.1.smithi117.stdout:4/116: sync 2024-09-19T06:40:26.149 INFO:tasks.workunit.client.1.smithi117.stdout:9/144: sync 2024-09-19T06:40:26.149 INFO:tasks.workunit.client.1.smithi117.stdout:0/68: sync 2024-09-19T06:40:26.149 INFO:tasks.workunit.client.1.smithi117.stdout:1/67: sync 2024-09-19T06:40:26.149 INFO:tasks.workunit.client.1.smithi117.stdout:6/76: sync 2024-09-19T06:40:26.149 INFO:tasks.workunit.client.1.smithi117.stdout:8/70: sync 2024-09-19T06:40:26.150 INFO:tasks.workunit.client.1.smithi117.stdout:1/68: write d3/fd [127654,110209] 0 2024-09-19T06:40:26.152 INFO:tasks.workunit.client.1.smithi117.stdout:9/145: rename d4/d18/f1d to d4/df/f2f 0 2024-09-19T06:40:26.153 INFO:tasks.workunit.client.1.smithi117.stdout:4/117: symlink d3/d1b/l25 0 2024-09-19T06:40:26.154 INFO:tasks.workunit.client.1.smithi117.stdout:0/69: link f6 f10 0 2024-09-19T06:40:26.154 INFO:tasks.workunit.client.1.smithi117.stdout:9/146: symlink d4/d20/l30 0 2024-09-19T06:40:26.156 INFO:tasks.workunit.client.1.smithi117.stdout:9/147: creat d4/d8/f31 x:0 0 0 2024-09-19T06:40:26.157 INFO:tasks.workunit.client.1.smithi117.stdout:0/70: mkdir d11 0 2024-09-19T06:40:26.157 INFO:tasks.workunit.client.1.smithi117.stdout:8/71: dwrite f3 [4194304,4194304] 0 2024-09-19T06:40:26.162 INFO:tasks.workunit.client.1.smithi117.stdout:4/118: dwrite d3/de/f1c [0,4194304] 0 2024-09-19T06:40:26.163 INFO:tasks.workunit.client.1.smithi117.stdout:9/148: dread d4/f19 [0,4194304] 0 2024-09-19T06:40:26.164 INFO:tasks.workunit.client.1.smithi117.stdout:9/149: read d4/f19 [2855518,30904] 0 2024-09-19T06:40:26.168 INFO:tasks.workunit.client.1.smithi117.stdout:8/72: creat f15 x:0 0 0 2024-09-19T06:40:26.168 INFO:tasks.workunit.client.1.smithi117.stdout:4/119: symlink d3/db/d13/l26 0 2024-09-19T06:40:26.169 INFO:tasks.workunit.client.1.smithi117.stdout:0/71: fsync f6 0 2024-09-19T06:40:26.170 INFO:tasks.workunit.client.1.smithi117.stdout:9/150: rename d4/df/d16/l25 to d4/d17/l32 0 2024-09-19T06:40:26.171 INFO:tasks.workunit.client.1.smithi117.stdout:9/151: readlink d4/df/l11 0 2024-09-19T06:40:26.172 INFO:tasks.workunit.client.1.smithi117.stdout:6/77: truncate d1/d3/ff 420883 0 2024-09-19T06:40:26.172 INFO:tasks.workunit.client.1.smithi117.stdout:8/73: dread f8 [0,4194304] 0 2024-09-19T06:40:26.173 INFO:tasks.workunit.client.1.smithi117.stdout:8/74: chown f8 1857 1 2024-09-19T06:40:26.174 INFO:tasks.workunit.client.1.smithi117.stdout:4/120: symlink d3/db/l27 0 2024-09-19T06:40:26.176 INFO:tasks.workunit.client.1.smithi117.stdout:0/72: creat d11/f12 x:0 0 0 2024-09-19T06:40:26.177 INFO:tasks.workunit.client.1.smithi117.stdout:4/121: mkdir d3/d28 0 2024-09-19T06:40:26.179 INFO:tasks.workunit.client.1.smithi117.stdout:4/122: mkdir d3/db/d20/d29 0 2024-09-19T06:40:26.184 INFO:tasks.workunit.client.1.smithi117.stdout:4/123: dwrite d3/de/f15 [0,4194304] 0 2024-09-19T06:40:26.189 INFO:tasks.workunit.client.1.smithi117.stdout:6/78: dwrite d1/d3/ff [0,4194304] 0 2024-09-19T06:40:26.190 INFO:tasks.workunit.client.1.smithi117.stdout:4/124: dread d3/de/f15 [0,4194304] 0 2024-09-19T06:40:26.191 INFO:tasks.workunit.client.1.smithi117.stdout:6/79: rmdir d1/d3 39 2024-09-19T06:40:26.193 INFO:tasks.workunit.client.1.smithi117.stdout:4/125: mkdir d3/d28/d2a 0 2024-09-19T06:40:26.196 INFO:tasks.workunit.client.1.smithi117.stdout:6/80: mkdir d1/d14 0 2024-09-19T06:40:26.196 INFO:tasks.workunit.client.1.smithi117.stdout:4/126: write d3/db/f1f [569758,77160] 0 2024-09-19T06:40:26.198 INFO:tasks.workunit.client.1.smithi117.stdout:4/127: creat d3/f2b x:0 0 0 2024-09-19T06:40:26.198 INFO:tasks.workunit.client.1.smithi117.stdout:6/81: read d1/d3/fc [435484,84922] 0 2024-09-19T06:40:26.199 INFO:tasks.workunit.client.1.smithi117.stdout:6/82: fdatasync d1/db/f10 0 2024-09-19T06:40:26.199 INFO:tasks.workunit.client.1.smithi117.stdout:6/83: chown d1 13802 1 2024-09-19T06:40:26.199 INFO:tasks.workunit.client.1.smithi117.stdout:6/84: chown d1/d3/f12 516525 1 2024-09-19T06:40:26.203 INFO:tasks.workunit.client.1.smithi117.stdout:6/85: fdatasync d1/d3/f12 0 2024-09-19T06:40:26.203 INFO:tasks.workunit.client.1.smithi117.stdout:4/128: mknod d3/d28/d2a/c2c 0 2024-09-19T06:40:26.203 INFO:tasks.workunit.client.1.smithi117.stdout:6/86: unlink d1/d3/ff 0 2024-09-19T06:40:26.203 INFO:tasks.workunit.client.1.smithi117.stdout:6/87: chown d1/la 2 1 2024-09-19T06:40:26.203 INFO:tasks.workunit.client.1.smithi117.stdout:6/88: fsync d1/db/f10 0 2024-09-19T06:40:26.203 INFO:tasks.workunit.client.1.smithi117.stdout:4/129: truncate d3/db/d13/f1d 405584 0 2024-09-19T06:40:26.204 INFO:tasks.workunit.client.1.smithi117.stdout:4/130: dread - d3/f2b zero size 2024-09-19T06:40:26.205 INFO:tasks.workunit.client.1.smithi117.stdout:6/89: creat d1/d14/f15 x:0 0 0 2024-09-19T06:40:26.205 INFO:tasks.workunit.client.1.smithi117.stdout:6/90: fdatasync d1/d3/f12 0 2024-09-19T06:40:26.208 INFO:tasks.workunit.client.1.smithi117.stdout:6/91: rename d1/db/f10 to d1/d5/f16 0 2024-09-19T06:40:26.208 INFO:tasks.workunit.client.1.smithi117.stdout:6/92: readlink d1/d5/l7 0 2024-09-19T06:40:26.210 INFO:tasks.workunit.client.1.smithi117.stdout:6/93: creat d1/d3/f17 x:0 0 0 2024-09-19T06:40:26.211 INFO:tasks.workunit.client.1.smithi117.stdout:6/94: write d1/d3/f9 [62142,23237] 0 2024-09-19T06:40:26.212 INFO:tasks.workunit.client.1.smithi117.stdout:6/95: write d1/db/f11 [623713,30083] 0 2024-09-19T06:40:26.215 INFO:tasks.workunit.client.1.smithi117.stdout:6/96: fsync d1/d3/fc 0 2024-09-19T06:40:26.215 INFO:tasks.workunit.client.1.smithi117.stdout:4/131: truncate d3/db/f1f 487950 0 2024-09-19T06:40:26.216 INFO:tasks.workunit.client.1.smithi117.stdout:4/132: chown d3/d1b/l25 83111339 1 2024-09-19T06:40:26.217 INFO:tasks.workunit.client.1.smithi117.stdout:4/133: mknod d3/d1b/c2d 0 2024-09-19T06:40:26.218 INFO:tasks.workunit.client.1.smithi117.stdout:4/134: symlink d3/db/d20/d29/l2e 0 2024-09-19T06:40:26.220 INFO:tasks.workunit.client.1.smithi117.stdout:4/135: rename d3/d4/f16 to d3/d4/f2f 0 2024-09-19T06:40:26.226 INFO:tasks.workunit.client.1.smithi117.stdout:4/136: dwrite d3/db/ff [0,4194304] 0 2024-09-19T06:40:26.228 INFO:tasks.workunit.client.1.smithi117.stdout:4/137: mknod d3/d28/c30 0 2024-09-19T06:40:26.230 INFO:tasks.workunit.client.1.smithi117.stdout:4/138: creat d3/db/d20/d29/f31 x:0 0 0 2024-09-19T06:40:26.231 INFO:tasks.workunit.client.1.smithi117.stdout:4/139: stat d3/db/d20/d29/l2e 0 2024-09-19T06:40:26.232 INFO:tasks.workunit.client.1.smithi117.stdout:4/140: write d3/db/d20/d29/f31 [242023,96363] 0 2024-09-19T06:40:26.232 INFO:tasks.workunit.client.1.smithi117.stdout:4/141: chown f1 120278348 1 2024-09-19T06:40:26.235 INFO:tasks.workunit.client.1.smithi117.stdout:4/142: creat d3/d28/d2a/f32 x:0 0 0 2024-09-19T06:40:26.236 INFO:tasks.workunit.client.1.smithi117.stdout:4/143: write d3/de/f12 [961761,101735] 0 2024-09-19T06:40:26.236 INFO:tasks.workunit.client.1.smithi117.stdout:5/153: sync 2024-09-19T06:40:26.236 INFO:tasks.workunit.client.1.smithi117.stdout:7/140: sync 2024-09-19T06:40:26.236 INFO:tasks.workunit.client.1.smithi117.stdout:3/113: sync 2024-09-19T06:40:26.238 INFO:tasks.workunit.client.1.smithi117.stdout:5/154: symlink d17/d2f/l35 0 2024-09-19T06:40:26.238 INFO:tasks.workunit.client.1.smithi117.stdout:7/141: symlink d1/l38 0 2024-09-19T06:40:26.240 INFO:tasks.workunit.client.1.smithi117.stdout:7/142: dread - d1/d8/d24/d26/f2f zero size 2024-09-19T06:40:26.240 INFO:tasks.workunit.client.1.smithi117.stdout:5/155: symlink d17/d2e/l36 0 2024-09-19T06:40:26.241 INFO:tasks.workunit.client.1.smithi117.stdout:7/143: chown d1/d8/d24/d1c/l2b 0 1 2024-09-19T06:40:26.242 INFO:tasks.workunit.client.1.smithi117.stdout:4/144: dwrite d3/d28/d2a/f32 [0,4194304] 0 2024-09-19T06:40:26.248 INFO:tasks.workunit.client.1.smithi117.stdout:5/156: dwrite d17/f22 [0,4194304] 0 2024-09-19T06:40:26.251 INFO:tasks.workunit.client.1.smithi117.stdout:7/144: dwrite d1/d8/d24/f20 [0,4194304] 0 2024-09-19T06:40:26.253 INFO:tasks.workunit.client.1.smithi117.stdout:7/145: read d1/d8/d24/ff [2611070,44326] 0 2024-09-19T06:40:26.255 INFO:tasks.workunit.client.1.smithi117.stdout:7/146: read d1/d8/f2a [216392,39035] 0 2024-09-19T06:40:26.258 INFO:tasks.workunit.client.1.smithi117.stdout:5/157: dwrite f1 [0,4194304] 0 2024-09-19T06:40:26.258 INFO:tasks.workunit.client.1.smithi117.stdout:7/147: creat d1/d8/f39 x:0 0 0 2024-09-19T06:40:26.261 INFO:tasks.workunit.client.1.smithi117.stdout:5/158: rename d17/d2e/l34 to d17/d1b/l37 0 2024-09-19T06:40:26.262 INFO:tasks.workunit.client.1.smithi117.stdout:5/159: creat d17/d1b/f38 x:0 0 0 2024-09-19T06:40:26.264 INFO:tasks.workunit.client.1.smithi117.stdout:7/148: rename d1/d8/f1f to d1/d8/d24/f3a 0 2024-09-19T06:40:26.293 INFO:tasks.workunit.client.1.smithi117.stdout:2/125: sync 2024-09-19T06:40:26.324 INFO:tasks.workunit.client.1.smithi117.stdout:6/97: write d1/d3/fc [163256,51526] 0 2024-09-19T06:40:26.329 INFO:tasks.workunit.client.1.smithi117.stdout:6/98: dread d1/d3/f9 [0,4194304] 0 2024-09-19T06:40:26.329 INFO:tasks.workunit.client.1.smithi117.stdout:4/145: dread d3/db/d13/f1d [0,4194304] 0 2024-09-19T06:40:26.333 INFO:tasks.workunit.client.1.smithi117.stdout:3/114: truncate d0/f6 4524271 0 2024-09-19T06:40:26.333 INFO:tasks.workunit.client.1.smithi117.stdout:6/99: chown d1/d5/l7 15524 1 2024-09-19T06:40:26.335 INFO:tasks.workunit.client.1.smithi117.stdout:5/160: rmdir d17/d1b 39 2024-09-19T06:40:26.335 INFO:tasks.workunit.client.1.smithi117.stdout:7/149: getdents d1/d8 0 2024-09-19T06:40:26.371 INFO:tasks.workunit.client.1.smithi117.stdout:4/146: dwrite d3/db/f1f [0,4194304] 0 2024-09-19T06:40:26.372 INFO:tasks.workunit.client.1.smithi117.stdout:7/150: mknod d1/c3b 0 2024-09-19T06:40:26.372 INFO:tasks.workunit.client.1.smithi117.stdout:3/115: dwrite d0/f13 [0,4194304] 0 2024-09-19T06:40:26.373 INFO:tasks.workunit.client.1.smithi117.stdout:6/100: dwrite d1/db/f11 [0,4194304] 0 2024-09-19T06:40:26.380 INFO:tasks.workunit.client.1.smithi117.stdout:4/147: write d3/d4/f2f [1753420,73058] 0 2024-09-19T06:40:26.380 INFO:tasks.workunit.client.1.smithi117.stdout:2/126: dwrite d0/fd [0,4194304] 0 2024-09-19T06:40:26.384 INFO:tasks.workunit.client.1.smithi117.stdout:4/148: fdatasync d3/d4/f8 0 2024-09-19T06:40:26.384 INFO:tasks.workunit.client.1.smithi117.stdout:6/101: rename d1/db/f11 to d1/f18 0 2024-09-19T06:40:26.384 INFO:tasks.workunit.client.1.smithi117.stdout:2/127: chown d0/f34 1709160628 1 2024-09-19T06:40:26.394 INFO:tasks.workunit.client.1.smithi117.stdout:6/102: write d1/d5/f16 [3720324,116295] 0 2024-09-19T06:40:26.395 INFO:tasks.workunit.client.1.smithi117.stdout:2/128: mkdir d0/d7/d1e/d20/d37 0 2024-09-19T06:40:26.397 INFO:tasks.workunit.client.1.smithi117.stdout:7/151: dwrite d1/d8/f39 [0,4194304] 0 2024-09-19T06:40:26.397 INFO:tasks.workunit.client.1.smithi117.stdout:3/116: dwrite d0/d8/f10 [4194304,4194304] 0 2024-09-19T06:40:26.417 INFO:tasks.workunit.client.1.smithi117.stdout:1/69: sync 2024-09-19T06:40:26.417 INFO:tasks.workunit.client.1.smithi117.stdout:4/149: dwrite d3/db/f1f [4194304,4194304] 0 2024-09-19T06:40:26.417 INFO:tasks.workunit.client.1.smithi117.stdout:3/117: write d0/d9/fd [3529445,14808] 0 2024-09-19T06:40:26.417 INFO:tasks.workunit.client.1.smithi117.stdout:1/70: stat d3/lc 0 2024-09-19T06:40:26.417 INFO:tasks.workunit.client.1.smithi117.stdout:4/150: dread d3/d4/f9 [0,4194304] 0 2024-09-19T06:40:26.417 INFO:tasks.workunit.client.1.smithi117.stdout:1/71: stat l2 0 2024-09-19T06:40:26.417 INFO:tasks.workunit.client.1.smithi117.stdout:8/75: sync 2024-09-19T06:40:26.417 INFO:tasks.workunit.client.1.smithi117.stdout:0/73: sync 2024-09-19T06:40:26.418 INFO:tasks.workunit.client.1.smithi117.stdout:7/152: truncate d1/d8/d24/f3a 305226 0 2024-09-19T06:40:26.418 INFO:tasks.workunit.client.1.smithi117.stdout:9/152: sync 2024-09-19T06:40:26.418 INFO:tasks.workunit.client.1.smithi117.stdout:3/118: chown d0/f6 18 1 2024-09-19T06:40:26.418 INFO:tasks.workunit.client.1.smithi117.stdout:9/153: unlink d4/d18/c22 0 2024-09-19T06:40:26.418 INFO:tasks.workunit.client.1.smithi117.stdout:4/151: mknod d3/db/c33 0 2024-09-19T06:40:26.418 INFO:tasks.workunit.client.1.smithi117.stdout:6/103: dread d1/f18 [0,4194304] 0 2024-09-19T06:40:26.418 INFO:tasks.workunit.client.1.smithi117.stdout:7/153: getdents d1/d8/d24/d1c/d35 0 2024-09-19T06:40:26.419 INFO:tasks.workunit.client.1.smithi117.stdout:8/76: getdents . 0 2024-09-19T06:40:26.419 INFO:tasks.workunit.client.1.smithi117.stdout:4/152: symlink d3/d28/l34 0 2024-09-19T06:40:26.419 INFO:tasks.workunit.client.1.smithi117.stdout:9/154: truncate d4/f7 1265070 0 2024-09-19T06:40:26.420 INFO:tasks.workunit.client.1.smithi117.stdout:8/77: fsync f3 0 2024-09-19T06:40:26.420 INFO:tasks.workunit.client.1.smithi117.stdout:6/104: write d1/d3/f9 [2355873,52691] 0 2024-09-19T06:40:26.420 INFO:tasks.workunit.client.1.smithi117.stdout:8/78: rmdir - no directory 2024-09-19T06:40:26.420 INFO:tasks.workunit.client.1.smithi117.stdout:8/79: stat f4 0 2024-09-19T06:40:26.421 INFO:tasks.workunit.client.1.smithi117.stdout:9/155: creat d4/f33 x:0 0 0 2024-09-19T06:40:26.421 INFO:tasks.workunit.client.1.smithi117.stdout:8/80: stat le 0 2024-09-19T06:40:26.422 INFO:tasks.workunit.client.1.smithi117.stdout:0/74: dwrite f4 [4194304,4194304] 0 2024-09-19T06:40:26.423 INFO:tasks.workunit.client.1.smithi117.stdout:9/156: stat d4/d8/lc 0 2024-09-19T06:40:26.423 INFO:tasks.workunit.client.1.smithi117.stdout:8/81: fdatasync ff 0 2024-09-19T06:40:26.426 INFO:tasks.workunit.client.1.smithi117.stdout:8/82: mknod c16 0 2024-09-19T06:40:26.427 INFO:tasks.workunit.client.1.smithi117.stdout:3/119: dwrite d0/f1 [4194304,4194304] 0 2024-09-19T06:40:26.427 INFO:tasks.workunit.client.1.smithi117.stdout:2/129: write d0/d7/d1e/f31 [2584229,60600] 0 2024-09-19T06:40:26.428 INFO:tasks.workunit.client.1.smithi117.stdout:6/105: dread d1/d3/fc [0,4194304] 0 2024-09-19T06:40:26.432 INFO:tasks.workunit.client.1.smithi117.stdout:8/83: truncate ff 996695 0 2024-09-19T06:40:26.433 INFO:tasks.workunit.client.1.smithi117.stdout:3/120: write d0/f13 [4888916,122003] 0 2024-09-19T06:40:26.433 INFO:tasks.workunit.client.1.smithi117.stdout:8/84: stat ff 0 2024-09-19T06:40:26.436 INFO:tasks.workunit.client.1.smithi117.stdout:4/153: dwrite d3/d4/f8 [0,4194304] 0 2024-09-19T06:40:26.437 INFO:tasks.workunit.client.1.smithi117.stdout:3/121: dread d0/f15 [0,4194304] 0 2024-09-19T06:40:26.437 INFO:tasks.workunit.client.1.smithi117.stdout:9/157: getdents d4/d8 0 2024-09-19T06:40:26.439 INFO:tasks.workunit.client.1.smithi117.stdout:8/85: dread ff [0,4194304] 0 2024-09-19T06:40:26.442 INFO:tasks.workunit.client.1.smithi117.stdout:4/154: chown d3/de/f10 323 1 2024-09-19T06:40:26.443 INFO:tasks.workunit.client.1.smithi117.stdout:3/122: chown d0/f15 537582 1 2024-09-19T06:40:26.447 INFO:tasks.workunit.client.1.smithi117.stdout:8/86: symlink l17 0 2024-09-19T06:40:26.447 INFO:tasks.workunit.client.1.smithi117.stdout:0/75: dwrite f3 [0,4194304] 0 2024-09-19T06:40:26.449 INFO:tasks.workunit.client.1.smithi117.stdout:6/106: dwrite d1/f18 [4194304,4194304] 0 2024-09-19T06:40:26.453 INFO:tasks.workunit.client.1.smithi117.stdout:3/123: creat d0/f1f x:0 0 0 2024-09-19T06:40:26.455 INFO:tasks.workunit.client.1.smithi117.stdout:4/155: dread d3/db/ff [0,4194304] 0 2024-09-19T06:40:26.455 INFO:tasks.workunit.client.1.smithi117.stdout:9/158: link d4/df/l1b d4/df/d16/l34 0 2024-09-19T06:40:26.455 INFO:tasks.workunit.client.1.smithi117.stdout:0/76: mkdir d11/d13 0 2024-09-19T06:40:26.456 INFO:tasks.workunit.client.1.smithi117.stdout:9/159: stat d4/fd 0 2024-09-19T06:40:26.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:26 smithi099 ceph-mon[27651]: pgmap v11: 65 pgs: 65 active+clean; 278 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 377 KiB/s rd, 14 MiB/s wr, 338 op/s 2024-09-19T06:40:26.457 INFO:tasks.workunit.client.1.smithi117.stdout:0/77: chown c7 684049 1 2024-09-19T06:40:26.459 INFO:tasks.workunit.client.1.smithi117.stdout:0/78: read - d11/f12 zero size 2024-09-19T06:40:26.459 INFO:tasks.workunit.client.1.smithi117.stdout:8/87: rename le to l18 0 2024-09-19T06:40:26.459 INFO:tasks.workunit.client.1.smithi117.stdout:6/107: dread d1/d3/f9 [0,4194304] 0 2024-09-19T06:40:26.460 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:26 smithi117 ceph-mon[34564]: pgmap v11: 65 pgs: 65 active+clean; 278 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 377 KiB/s rd, 14 MiB/s wr, 338 op/s 2024-09-19T06:40:26.471 INFO:tasks.workunit.client.1.smithi117.stdout:2/130: dwrite d0/d7/f8 [0,4194304] 0 2024-09-19T06:40:26.473 INFO:tasks.workunit.client.1.smithi117.stdout:3/124: getdents d0 0 2024-09-19T06:40:26.473 INFO:tasks.workunit.client.1.smithi117.stdout:4/156: truncate d3/de/f1c 3780236 0 2024-09-19T06:40:26.474 INFO:tasks.workunit.client.1.smithi117.stdout:8/88: creat f19 x:0 0 0 2024-09-19T06:40:26.474 INFO:tasks.workunit.client.1.smithi117.stdout:0/79: mkdir d11/d13/d14 0 2024-09-19T06:40:26.475 INFO:tasks.workunit.client.1.smithi117.stdout:2/131: rmdir d0/d7/d29/d35 39 2024-09-19T06:40:26.476 INFO:tasks.workunit.client.1.smithi117.stdout:3/125: truncate d0/f12 327279 0 2024-09-19T06:40:26.476 INFO:tasks.workunit.client.1.smithi117.stdout:6/108: getdents d1/d5/d8 0 2024-09-19T06:40:26.477 INFO:tasks.workunit.client.1.smithi117.stdout:8/89: readlink l7 0 2024-09-19T06:40:26.477 INFO:tasks.workunit.client.1.smithi117.stdout:4/157: write d3/db/f1f [6338703,73393] 0 2024-09-19T06:40:26.477 INFO:tasks.workunit.client.1.smithi117.stdout:2/132: rename d0 to d0/d7/d1e/d38 22 2024-09-19T06:40:26.480 INFO:tasks.workunit.client.1.smithi117.stdout:0/80: mknod d11/d13/c15 0 2024-09-19T06:40:26.480 INFO:tasks.workunit.client.1.smithi117.stdout:2/133: fdatasync d0/d12/f13 0 2024-09-19T06:40:26.481 INFO:tasks.workunit.client.1.smithi117.stdout:0/81: chown c7 36 1 2024-09-19T06:40:26.482 INFO:tasks.workunit.client.1.smithi117.stdout:4/158: mkdir d3/db/d20/d35 0 2024-09-19T06:40:26.488 INFO:tasks.workunit.client.1.smithi117.stdout:3/126: dwrite d0/f1 [4194304,4194304] 0 2024-09-19T06:40:26.488 INFO:tasks.workunit.client.1.smithi117.stdout:8/90: creat f1a x:0 0 0 2024-09-19T06:40:26.488 INFO:tasks.workunit.client.1.smithi117.stdout:4/159: chown d3/d4/d14/l22 5 1 2024-09-19T06:40:26.489 INFO:tasks.workunit.client.1.smithi117.stdout:6/109: dread d1/f18 [0,4194304] 0 2024-09-19T06:40:26.490 INFO:tasks.workunit.client.1.smithi117.stdout:0/82: mkdir d11/d13/d14/d16 0 2024-09-19T06:40:26.492 INFO:tasks.workunit.client.1.smithi117.stdout:3/127: unlink d0/l5 0 2024-09-19T06:40:26.493 INFO:tasks.workunit.client.1.smithi117.stdout:8/91: fsync f11 0 2024-09-19T06:40:26.494 INFO:tasks.workunit.client.1.smithi117.stdout:4/160: rmdir d3/db/d20/d29 39 2024-09-19T06:40:26.495 INFO:tasks.workunit.client.1.smithi117.stdout:8/92: chown f12 581692 1 2024-09-19T06:40:26.495 INFO:tasks.workunit.client.1.smithi117.stdout:3/128: rmdir d0 39 2024-09-19T06:40:26.498 INFO:tasks.workunit.client.1.smithi117.stdout:0/83: dread f10 [0,4194304] 0 2024-09-19T06:40:26.499 INFO:tasks.workunit.client.1.smithi117.stdout:8/93: mknod c1b 0 2024-09-19T06:40:26.500 INFO:tasks.workunit.client.1.smithi117.stdout:4/161: creat d3/db/d20/f36 x:0 0 0 2024-09-19T06:40:26.502 INFO:tasks.workunit.client.1.smithi117.stdout:3/129: chown d0/f1e 65 1 2024-09-19T06:40:26.503 INFO:tasks.workunit.client.1.smithi117.stdout:0/84: rename f6 to d11/d13/f17 0 2024-09-19T06:40:26.504 INFO:tasks.workunit.client.1.smithi117.stdout:8/94: unlink cb 0 2024-09-19T06:40:26.505 INFO:tasks.workunit.client.1.smithi117.stdout:6/110: dwrite d1/d3/fc [0,4194304] 0 2024-09-19T06:40:26.505 INFO:tasks.workunit.client.1.smithi117.stdout:4/162: symlink d3/db/l37 0 2024-09-19T06:40:26.506 INFO:tasks.workunit.client.1.smithi117.stdout:3/130: fdatasync d0/d9/d1c/f1d 0 2024-09-19T06:40:26.506 INFO:tasks.workunit.client.1.smithi117.stdout:2/134: dread d0/d7/f16 [0,4194304] 0 2024-09-19T06:40:26.506 INFO:tasks.workunit.client.1.smithi117.stdout:0/85: rename l8 to d11/l18 0 2024-09-19T06:40:26.507 INFO:tasks.workunit.client.1.smithi117.stdout:8/95: symlink l1c 0 2024-09-19T06:40:26.508 INFO:tasks.workunit.client.1.smithi117.stdout:6/111: fsync d1/d3/f9 0 2024-09-19T06:40:26.510 INFO:tasks.workunit.client.1.smithi117.stdout:6/112: write d1/d5/f16 [4495754,12265] 0 2024-09-19T06:40:26.510 INFO:tasks.workunit.client.1.smithi117.stdout:0/86: chown f10 3 1 2024-09-19T06:40:26.513 INFO:tasks.workunit.client.1.smithi117.stdout:8/96: mkdir d1d 0 2024-09-19T06:40:26.513 INFO:tasks.workunit.client.1.smithi117.stdout:4/163: link d3/c1a d3/db/d23/c38 0 2024-09-19T06:40:26.515 INFO:tasks.workunit.client.1.smithi117.stdout:0/87: creat d11/f19 x:0 0 0 2024-09-19T06:40:26.516 INFO:tasks.workunit.client.1.smithi117.stdout:0/88: chown d11/d13/c15 0 1 2024-09-19T06:40:26.517 INFO:tasks.workunit.client.1.smithi117.stdout:6/113: dread d1/d3/fd [0,4194304] 0 2024-09-19T06:40:26.517 INFO:tasks.workunit.client.1.smithi117.stdout:3/131: link d0/f15 d0/d8/f20 0 2024-09-19T06:40:26.517 INFO:tasks.workunit.client.1.smithi117.stdout:8/97: getdents d1d 0 2024-09-19T06:40:26.517 INFO:tasks.workunit.client.1.smithi117.stdout:4/164: mkdir d3/db/d20/d29/d39 0 2024-09-19T06:40:26.518 INFO:tasks.workunit.client.1.smithi117.stdout:3/132: chown d0/d9/l17 61146291 1 2024-09-19T06:40:26.519 INFO:tasks.workunit.client.1.smithi117.stdout:8/98: read ff [683622,92242] 0 2024-09-19T06:40:26.520 INFO:tasks.workunit.client.1.smithi117.stdout:6/114: creat d1/d5/d8/f19 x:0 0 0 2024-09-19T06:40:26.522 INFO:tasks.workunit.client.1.smithi117.stdout:3/133: creat d0/d9/f21 x:0 0 0 2024-09-19T06:40:26.525 INFO:tasks.workunit.client.1.smithi117.stdout:2/135: truncate d0/f6 880102 0 2024-09-19T06:40:26.525 INFO:tasks.workunit.client.1.smithi117.stdout:0/89: dwrite f3 [0,4194304] 0 2024-09-19T06:40:26.526 INFO:tasks.workunit.client.1.smithi117.stdout:3/134: dread d0/d9/fc [0,4194304] 0 2024-09-19T06:40:26.527 INFO:tasks.workunit.client.1.smithi117.stdout:4/165: creat d3/db/f3a x:0 0 0 2024-09-19T06:40:26.532 INFO:tasks.workunit.client.1.smithi117.stdout:6/115: dread d1/f18 [0,4194304] 0 2024-09-19T06:40:26.533 INFO:tasks.workunit.client.1.smithi117.stdout:3/135: fdatasync d0/d8/f20 0 2024-09-19T06:40:26.533 INFO:tasks.workunit.client.1.smithi117.stdout:4/166: write d3/db/d20/f36 [267071,24718] 0 2024-09-19T06:40:26.533 INFO:tasks.workunit.client.1.smithi117.stdout:0/90: creat d11/d13/d14/d16/f1a x:0 0 0 2024-09-19T06:40:26.535 INFO:tasks.workunit.client.1.smithi117.stdout:2/136: rename d0/d7/l24 to d0/d7/d29/d35/l39 0 2024-09-19T06:40:26.541 INFO:tasks.workunit.client.1.smithi117.stdout:2/137: unlink d0/f34 0 2024-09-19T06:40:26.541 INFO:tasks.workunit.client.1.smithi117.stdout:5/161: sync 2024-09-19T06:40:26.543 INFO:tasks.workunit.client.1.smithi117.stdout:3/136: truncate d0/f6 5070830 0 2024-09-19T06:40:26.543 INFO:tasks.workunit.client.1.smithi117.stdout:8/99: dwrite ff [0,4194304] 0 2024-09-19T06:40:26.544 INFO:tasks.workunit.client.1.smithi117.stdout:6/116: dread d1/f18 [0,4194304] 0 2024-09-19T06:40:26.545 INFO:tasks.workunit.client.1.smithi117.stdout:5/162: write f1 [497739,46753] 0 2024-09-19T06:40:26.545 INFO:tasks.workunit.client.1.smithi117.stdout:8/100: fdatasync f1a 0 2024-09-19T06:40:26.550 INFO:tasks.workunit.client.1.smithi117.stdout:6/117: chown d1/d3/fc 33005321 1 2024-09-19T06:40:26.550 INFO:tasks.workunit.client.1.smithi117.stdout:4/167: getdents d3/db/d13 0 2024-09-19T06:40:26.553 INFO:tasks.workunit.client.1.smithi117.stdout:0/91: dwrite f4 [4194304,4194304] 0 2024-09-19T06:40:26.554 INFO:tasks.workunit.client.1.smithi117.stdout:2/138: symlink d0/d7/d1e/d20/l3a 0 2024-09-19T06:40:26.555 INFO:tasks.workunit.client.1.smithi117.stdout:8/101: read - f15 zero size 2024-09-19T06:40:26.556 INFO:tasks.workunit.client.1.smithi117.stdout:5/163: symlink d17/d2e/l39 0 2024-09-19T06:40:26.556 INFO:tasks.workunit.client.1.smithi117.stdout:6/118: rmdir d1/d3 39 2024-09-19T06:40:26.557 INFO:tasks.workunit.client.1.smithi117.stdout:8/102: dread - f19 zero size 2024-09-19T06:40:26.564 INFO:tasks.workunit.client.1.smithi117.stdout:6/119: creat d1/d14/f1a x:0 0 0 2024-09-19T06:40:26.564 INFO:tasks.workunit.client.1.smithi117.stdout:4/168: link d3/db/c33 d3/d4/d14/c3b 0 2024-09-19T06:40:26.567 INFO:tasks.workunit.client.1.smithi117.stdout:3/137: getdents d0/d9/d1c 0 2024-09-19T06:40:26.570 INFO:tasks.workunit.client.1.smithi117.stdout:5/164: dread d17/d2e/f33 [0,4194304] 0 2024-09-19T06:40:26.571 INFO:tasks.workunit.client.1.smithi117.stdout:8/103: mkdir d1d/d1e 0 2024-09-19T06:40:26.572 INFO:tasks.workunit.client.1.smithi117.stdout:3/138: chown d0/d8/f20 49893871 1 2024-09-19T06:40:26.572 INFO:tasks.workunit.client.1.smithi117.stdout:2/139: dwrite d0/d7/f2d [0,4194304] 0 2024-09-19T06:40:26.572 INFO:tasks.workunit.client.1.smithi117.stdout:0/92: dwrite d11/f19 [0,4194304] 0 2024-09-19T06:40:26.574 INFO:tasks.workunit.client.1.smithi117.stdout:4/169: unlink d3/d28/d2a/f32 0 2024-09-19T06:40:26.578 INFO:tasks.workunit.client.1.smithi117.stdout:1/72: sync 2024-09-19T06:40:26.578 INFO:tasks.workunit.client.1.smithi117.stdout:9/160: sync 2024-09-19T06:40:26.578 INFO:tasks.workunit.client.1.smithi117.stdout:7/154: sync 2024-09-19T06:40:26.584 INFO:tasks.workunit.client.1.smithi117.stdout:0/93: mkdir d11/d13/d1b 0 2024-09-19T06:40:26.585 INFO:tasks.workunit.client.1.smithi117.stdout:8/104: write f8 [79935,13118] 0 2024-09-19T06:40:26.586 INFO:tasks.workunit.client.1.smithi117.stdout:0/94: chown l2 2 1 2024-09-19T06:40:26.588 INFO:tasks.workunit.client.1.smithi117.stdout:4/170: creat d3/db/d13/f3c x:0 0 0 2024-09-19T06:40:26.588 INFO:tasks.workunit.client.1.smithi117.stdout:8/105: write ff [5067662,80560] 0 2024-09-19T06:40:26.589 INFO:tasks.workunit.client.1.smithi117.stdout:3/139: dwrite d0/d8/f1a [0,4194304] 0 2024-09-19T06:40:26.590 INFO:tasks.workunit.client.1.smithi117.stdout:4/171: dread - d3/f2b zero size 2024-09-19T06:40:26.590 INFO:tasks.workunit.client.1.smithi117.stdout:3/140: stat d0/f1e 0 2024-09-19T06:40:26.590 INFO:tasks.workunit.client.1.smithi117.stdout:9/161: truncate f0 3968494 0 2024-09-19T06:40:26.590 INFO:tasks.workunit.client.1.smithi117.stdout:1/73: creat d3/f17 x:0 0 0 2024-09-19T06:40:26.591 INFO:tasks.workunit.client.1.smithi117.stdout:6/120: rmdir d1/db 0 2024-09-19T06:40:26.592 INFO:tasks.workunit.client.1.smithi117.stdout:4/172: fsync d3/d4/f2f 0 2024-09-19T06:40:26.594 INFO:tasks.workunit.client.1.smithi117.stdout:1/74: chown d3/l6 3 1 2024-09-19T06:40:26.594 INFO:tasks.workunit.client.1.smithi117.stdout:6/121: unlink d1/la 0 2024-09-19T06:40:26.595 INFO:tasks.workunit.client.1.smithi117.stdout:4/173: read d3/f7 [2569970,73934] 0 2024-09-19T06:40:26.605 INFO:tasks.workunit.client.1.smithi117.stdout:1/75: mkdir d3/d18 0 2024-09-19T06:40:26.608 INFO:tasks.workunit.client.1.smithi117.stdout:1/76: truncate d3/fd 1073429 0 2024-09-19T06:40:26.609 INFO:tasks.workunit.client.1.smithi117.stdout:4/174: symlink d3/l3d 0 2024-09-19T06:40:26.615 INFO:tasks.workunit.client.1.smithi117.stdout:7/155: link d1/d8/f16 d1/f3c 0 2024-09-19T06:40:26.617 INFO:tasks.workunit.client.1.smithi117.stdout:6/122: link d1/d3/fd d1/f1b 0 2024-09-19T06:40:26.617 INFO:tasks.workunit.client.1.smithi117.stdout:5/165: dwrite ff [0,4194304] 0 2024-09-19T06:40:26.618 INFO:tasks.workunit.client.1.smithi117.stdout:4/175: rename d3/d4/d14/c3b to d3/db/d20/d35/c3e 0 2024-09-19T06:40:26.623 INFO:tasks.workunit.client.1.smithi117.stdout:1/77: dwrite d3/f17 [0,4194304] 0 2024-09-19T06:40:26.626 INFO:tasks.workunit.client.1.smithi117.stdout:6/123: dread d1/d5/f16 [0,4194304] 0 2024-09-19T06:40:26.628 INFO:tasks.workunit.client.1.smithi117.stdout:9/162: dread d4/d8/fb [0,4194304] 0 2024-09-19T06:40:26.634 INFO:tasks.workunit.client.1.smithi117.stdout:2/140: dread d0/fb [0,4194304] 0 2024-09-19T06:40:26.634 INFO:tasks.workunit.client.1.smithi117.stdout:2/141: stat d0/d12/d32 0 2024-09-19T06:40:26.636 INFO:tasks.workunit.client.1.smithi117.stdout:4/176: mknod d3/de/c3f 0 2024-09-19T06:40:26.636 INFO:tasks.workunit.client.1.smithi117.stdout:8/106: dread f4 [0,4194304] 0 2024-09-19T06:40:26.639 INFO:tasks.workunit.client.1.smithi117.stdout:4/177: dread d3/db/d20/f36 [0,4194304] 0 2024-09-19T06:40:26.640 INFO:tasks.workunit.client.1.smithi117.stdout:4/178: truncate d3/db/f3a 522975 0 2024-09-19T06:40:26.643 INFO:tasks.workunit.client.1.smithi117.stdout:7/156: creat d1/d8/d24/d1c/d35/f3d x:0 0 0 2024-09-19T06:40:26.645 INFO:tasks.workunit.client.1.smithi117.stdout:5/166: mkdir d17/d1b/d3a 0 2024-09-19T06:40:26.646 INFO:tasks.workunit.client.1.smithi117.stdout:5/167: chown f1 20 1 2024-09-19T06:40:26.646 INFO:tasks.workunit.client.1.smithi117.stdout:1/78: mknod d3/d18/c19 0 2024-09-19T06:40:26.652 INFO:tasks.workunit.client.1.smithi117.stdout:7/157: mkdir d1/d8/d24/d26/d3e 0 2024-09-19T06:40:26.652 INFO:tasks.workunit.client.1.smithi117.stdout:1/79: dwrite d3/f14 [0,4194304] 0 2024-09-19T06:40:26.655 INFO:tasks.workunit.client.1.smithi117.stdout:8/107: creat d1d/d1e/f1f x:0 0 0 2024-09-19T06:40:26.656 INFO:tasks.workunit.client.1.smithi117.stdout:5/168: unlink c15 0 2024-09-19T06:40:26.657 INFO:tasks.workunit.client.1.smithi117.stdout:7/158: dread d1/d8/d24/f6 [0,4194304] 0 2024-09-19T06:40:26.659 INFO:tasks.workunit.client.1.smithi117.stdout:5/169: dread d17/d1b/f24 [0,4194304] 0 2024-09-19T06:40:26.662 INFO:tasks.workunit.client.1.smithi117.stdout:1/80: symlink d3/d18/l1a 0 2024-09-19T06:40:26.662 INFO:tasks.workunit.client.1.smithi117.stdout:5/170: dread ff [0,4194304] 0 2024-09-19T06:40:26.663 INFO:tasks.workunit.client.1.smithi117.stdout:5/171: fdatasync d17/d1b/f28 0 2024-09-19T06:40:26.663 INFO:tasks.workunit.client.1.smithi117.stdout:8/108: unlink l17 0 2024-09-19T06:40:26.664 INFO:tasks.workunit.client.1.smithi117.stdout:8/109: chown l1c 4 1 2024-09-19T06:40:26.667 INFO:tasks.workunit.client.1.smithi117.stdout:2/142: getdents d0/d7/d1e/d20 0 2024-09-19T06:40:26.668 INFO:tasks.workunit.client.1.smithi117.stdout:2/143: truncate d0/fd 5146709 0 2024-09-19T06:40:26.668 INFO:tasks.workunit.client.1.smithi117.stdout:2/144: stat d0/c23 0 2024-09-19T06:40:26.669 INFO:tasks.workunit.client.1.smithi117.stdout:8/110: symlink d1d/d1e/l20 0 2024-09-19T06:40:26.671 INFO:tasks.workunit.client.1.smithi117.stdout:6/124: truncate d1/f1b 1543261 0 2024-09-19T06:40:26.672 INFO:tasks.workunit.client.1.smithi117.stdout:6/125: dread - d1/d3/f17 zero size 2024-09-19T06:40:26.673 INFO:tasks.workunit.client.1.smithi117.stdout:9/163: truncate d4/f12 8384236 0 2024-09-19T06:40:26.673 INFO:tasks.workunit.client.1.smithi117.stdout:8/111: dread ff [0,4194304] 0 2024-09-19T06:40:26.673 INFO:tasks.workunit.client.1.smithi117.stdout:8/112: dread - d1d/d1e/f1f zero size 2024-09-19T06:40:26.674 INFO:tasks.workunit.client.1.smithi117.stdout:1/81: link d3/f13 d3/f1b 0 2024-09-19T06:40:26.674 INFO:tasks.workunit.client.1.smithi117.stdout:8/113: truncate f1a 51330 0 2024-09-19T06:40:26.675 INFO:tasks.workunit.client.1.smithi117.stdout:7/159: mkdir d1/d3f 0 2024-09-19T06:40:26.675 INFO:tasks.workunit.client.1.smithi117.stdout:8/114: readlink d1d/d1e/l20 0 2024-09-19T06:40:26.676 INFO:tasks.workunit.client.1.smithi117.stdout:8/115: chown ff 0 1 2024-09-19T06:40:26.676 INFO:tasks.workunit.client.1.smithi117.stdout:8/116: fsync f8 0 2024-09-19T06:40:26.677 INFO:tasks.workunit.client.1.smithi117.stdout:9/164: readlink d4/df/l1b 0 2024-09-19T06:40:26.678 INFO:tasks.workunit.client.1.smithi117.stdout:1/82: dread d3/fd [0,4194304] 0 2024-09-19T06:40:26.679 INFO:tasks.workunit.client.1.smithi117.stdout:1/83: truncate d3/f10 1073629 0 2024-09-19T06:40:26.680 INFO:tasks.workunit.client.1.smithi117.stdout:1/84: write d3/f9 [655496,65947] 0 2024-09-19T06:40:26.681 INFO:tasks.workunit.client.1.smithi117.stdout:8/117: dread f4 [0,4194304] 0 2024-09-19T06:40:26.682 INFO:tasks.workunit.client.1.smithi117.stdout:4/179: truncate d3/db/f1f 6422931 0 2024-09-19T06:40:26.688 INFO:tasks.workunit.client.1.smithi117.stdout:1/85: rename d3/f17 to d3/f1c 0 2024-09-19T06:40:26.689 INFO:tasks.workunit.client.1.smithi117.stdout:6/126: creat d1/f1c x:0 0 0 2024-09-19T06:40:26.690 INFO:tasks.workunit.client.1.smithi117.stdout:4/180: creat d3/d4/f40 x:0 0 0 2024-09-19T06:40:26.696 INFO:tasks.workunit.client.1.smithi117.stdout:6/127: dread d1/d3/fc [0,4194304] 0 2024-09-19T06:40:26.696 INFO:tasks.workunit.client.1.smithi117.stdout:1/86: mknod d3/c1d 0 2024-09-19T06:40:26.699 INFO:tasks.workunit.client.1.smithi117.stdout:4/181: dwrite d3/db/d13/f3c [0,4194304] 0 2024-09-19T06:40:26.699 INFO:tasks.workunit.client.1.smithi117.stdout:5/172: truncate d17/d1b/f24 1304871 0 2024-09-19T06:40:26.703 INFO:tasks.workunit.client.1.smithi117.stdout:8/118: link l9 d1d/d1e/l21 0 2024-09-19T06:40:26.704 INFO:tasks.workunit.client.1.smithi117.stdout:8/119: readlink l1c 0 2024-09-19T06:40:26.704 INFO:tasks.workunit.client.1.smithi117.stdout:5/173: dread f1 [0,4194304] 0 2024-09-19T06:40:26.705 INFO:tasks.workunit.client.1.smithi117.stdout:5/174: chown c7 21 1 2024-09-19T06:40:26.705 INFO:tasks.workunit.client.1.smithi117.stdout:4/182: mkdir d3/d41 0 2024-09-19T06:40:26.707 INFO:tasks.workunit.client.1.smithi117.stdout:2/145: dwrite d0/f1b [0,4194304] 0 2024-09-19T06:40:26.710 INFO:tasks.workunit.client.1.smithi117.stdout:8/120: symlink d1d/d1e/l22 0 2024-09-19T06:40:26.710 INFO:tasks.workunit.client.1.smithi117.stdout:9/165: write d4/df/d16/f26 [761062,64447] 0 2024-09-19T06:40:26.711 INFO:tasks.workunit.client.1.smithi117.stdout:8/121: read - f12 zero size 2024-09-19T06:40:26.711 INFO:tasks.workunit.client.1.smithi117.stdout:8/122: fdatasync f1a 0 2024-09-19T06:40:26.713 INFO:tasks.workunit.client.1.smithi117.stdout:6/128: creat d1/f1d x:0 0 0 2024-09-19T06:40:26.718 INFO:tasks.workunit.client.1.smithi117.stdout:9/166: rename d4/d17/f21 to d4/d1c/f35 0 2024-09-19T06:40:26.718 INFO:tasks.workunit.client.1.smithi117.stdout:9/167: stat d4/df/c2b 0 2024-09-19T06:40:26.719 INFO:tasks.workunit.client.1.smithi117.stdout:4/183: truncate d3/f7 732196 0 2024-09-19T06:40:26.720 INFO:tasks.workunit.client.1.smithi117.stdout:6/129: dwrite d1/d3/f17 [0,4194304] 0 2024-09-19T06:40:26.720 INFO:tasks.workunit.client.1.smithi117.stdout:7/160: truncate d1/d8/f39 2304854 0 2024-09-19T06:40:26.721 INFO:tasks.workunit.client.1.smithi117.stdout:6/130: read - d1/d14/f15 zero size 2024-09-19T06:40:26.723 INFO:tasks.workunit.client.1.smithi117.stdout:9/168: rmdir d4/df 39 2024-09-19T06:40:26.725 INFO:tasks.workunit.client.1.smithi117.stdout:2/146: rmdir d0/d7/d1e/d20/d37 0 2024-09-19T06:40:26.727 INFO:tasks.workunit.client.1.smithi117.stdout:4/184: rename d3/d4/l19 to d3/de/l42 0 2024-09-19T06:40:26.728 INFO:tasks.workunit.client.1.smithi117.stdout:4/185: write d3/d4/f8 [656225,95534] 0 2024-09-19T06:40:26.730 INFO:tasks.workunit.client.1.smithi117.stdout:6/131: mknod d1/d5/c1e 0 2024-09-19T06:40:26.732 INFO:tasks.workunit.client.1.smithi117.stdout:2/147: symlink d0/d7/d29/d35/l3b 0 2024-09-19T06:40:26.737 INFO:tasks.workunit.client.1.smithi117.stdout:9/169: fsync d4/d1c/f28 0 2024-09-19T06:40:26.737 INFO:tasks.workunit.client.1.smithi117.stdout:1/87: dwrite d3/f1b [0,4194304] 0 2024-09-19T06:40:26.737 INFO:tasks.workunit.client.1.smithi117.stdout:1/88: fsync d3/f10 0 2024-09-19T06:40:26.741 INFO:tasks.workunit.client.1.smithi117.stdout:8/123: write f4 [2104390,101793] 0 2024-09-19T06:40:26.743 INFO:tasks.workunit.client.1.smithi117.stdout:1/89: dread d3/f14 [0,4194304] 0 2024-09-19T06:40:26.744 INFO:tasks.workunit.client.1.smithi117.stdout:9/170: mkdir d4/d1c/d36 0 2024-09-19T06:40:26.746 INFO:tasks.workunit.client.1.smithi117.stdout:7/161: getdents d1/d8/d24 0 2024-09-19T06:40:26.747 INFO:tasks.workunit.client.1.smithi117.stdout:4/186: creat d3/db/f43 x:0 0 0 2024-09-19T06:40:26.749 INFO:tasks.workunit.client.1.smithi117.stdout:8/124: chown c13 17226548 1 2024-09-19T06:40:26.753 INFO:tasks.workunit.client.1.smithi117.stdout:7/162: readlink d1/l12 0 2024-09-19T06:40:26.753 INFO:tasks.workunit.client.1.smithi117.stdout:7/163: stat d1/l9 0 2024-09-19T06:40:26.753 INFO:tasks.workunit.client.1.smithi117.stdout:4/187: symlink d3/l44 0 2024-09-19T06:40:26.756 INFO:tasks.workunit.client.1.smithi117.stdout:6/132: rename d1/d5/f16 to d1/d3/f1f 0 2024-09-19T06:40:26.758 INFO:tasks.workunit.client.1.smithi117.stdout:9/171: mkdir d4/d1c/d36/d37 0 2024-09-19T06:40:26.759 INFO:tasks.workunit.client.1.smithi117.stdout:4/188: mkdir d3/db/d20/d35/d45 0 2024-09-19T06:40:26.760 INFO:tasks.workunit.client.1.smithi117.stdout:7/164: getdents d1/d3f 0 2024-09-19T06:40:26.761 INFO:tasks.workunit.client.1.smithi117.stdout:4/189: chown d3/db/d20/d29 19325122 1 2024-09-19T06:40:26.761 INFO:tasks.workunit.client.1.smithi117.stdout:8/125: link l7 d1d/d1e/l23 0 2024-09-19T06:40:26.762 INFO:tasks.workunit.client.1.smithi117.stdout:1/90: dwrite d3/f1b [4194304,4194304] 0 2024-09-19T06:40:26.763 INFO:tasks.workunit.client.1.smithi117.stdout:9/172: mknod d4/d1c/d36/d37/c38 0 2024-09-19T06:40:26.764 INFO:tasks.workunit.client.1.smithi117.stdout:8/126: read f4 [2508076,78827] 0 2024-09-19T06:40:26.766 INFO:tasks.workunit.client.1.smithi117.stdout:8/127: dread - f11 zero size 2024-09-19T06:40:26.767 INFO:tasks.workunit.client.1.smithi117.stdout:7/165: unlink d1/d8/d24/d1c/c29 0 2024-09-19T06:40:26.768 INFO:tasks.workunit.client.1.smithi117.stdout:6/133: dwrite d1/d14/f15 [0,4194304] 0 2024-09-19T06:40:26.769 INFO:tasks.workunit.client.1.smithi117.stdout:2/148: dwrite d0/f6 [0,4194304] 0 2024-09-19T06:40:26.769 INFO:tasks.workunit.client.1.smithi117.stdout:6/134: stat d1/d14/f1a 0 2024-09-19T06:40:26.770 INFO:tasks.workunit.client.1.smithi117.stdout:9/173: truncate d4/df/f2f 208235 0 2024-09-19T06:40:26.771 INFO:tasks.workunit.client.1.smithi117.stdout:2/149: write d0/f9 [1597905,69586] 0 2024-09-19T06:40:26.771 INFO:tasks.workunit.client.1.smithi117.stdout:2/150: truncate d0/fd 5602838 0 2024-09-19T06:40:26.776 INFO:tasks.workunit.client.1.smithi117.stdout:4/190: symlink d3/db/d20/d35/d45/l46 0 2024-09-19T06:40:26.779 INFO:tasks.workunit.client.1.smithi117.stdout:4/191: dread d3/db/d13/f1d [0,4194304] 0 2024-09-19T06:40:26.779 INFO:tasks.workunit.client.1.smithi117.stdout:7/166: dread d1/d8/d24/f31 [0,4194304] 0 2024-09-19T06:40:26.780 INFO:tasks.workunit.client.1.smithi117.stdout:2/151: dwrite d0/d7/f2d [0,4194304] 0 2024-09-19T06:40:26.780 INFO:tasks.workunit.client.1.smithi117.stdout:7/167: readlink d1/l34 0 2024-09-19T06:40:26.781 INFO:tasks.workunit.client.1.smithi117.stdout:6/135: creat d1/d3/f20 x:0 0 0 2024-09-19T06:40:26.787 INFO:tasks.workunit.client.1.smithi117.stdout:9/174: creat d4/d1c/d36/d37/f39 x:0 0 0 2024-09-19T06:40:26.787 INFO:tasks.workunit.client.1.smithi117.stdout:9/175: readlink d4/d8/l29 0 2024-09-19T06:40:26.789 INFO:tasks.workunit.client.1.smithi117.stdout:4/192: dread d3/de/f12 [0,4194304] 0 2024-09-19T06:40:26.790 INFO:tasks.workunit.client.1.smithi117.stdout:2/152: creat d0/d12/f3c x:0 0 0 2024-09-19T06:40:26.791 INFO:tasks.workunit.client.1.smithi117.stdout:7/168: mknod d1/d8/d24/d1c/c40 0 2024-09-19T06:40:26.791 INFO:tasks.workunit.client.1.smithi117.stdout:2/153: fdatasync d0/f9 0 2024-09-19T06:40:26.792 INFO:tasks.workunit.client.1.smithi117.stdout:1/91: link d3/l6 d3/d18/l1e 0 2024-09-19T06:40:26.794 INFO:tasks.workunit.client.1.smithi117.stdout:7/169: chown d1/d8/d24/d26/f37 2680219 1 2024-09-19T06:40:26.794 INFO:tasks.workunit.client.1.smithi117.stdout:1/92: write d3/f12 [923343,60708] 0 2024-09-19T06:40:26.795 INFO:tasks.workunit.client.1.smithi117.stdout:4/193: creat d3/db/f47 x:0 0 0 2024-09-19T06:40:26.796 INFO:tasks.workunit.client.1.smithi117.stdout:2/154: mkdir d0/d7/d29/d35/d3d 0 2024-09-19T06:40:26.797 INFO:tasks.workunit.client.1.smithi117.stdout:7/170: fsync d1/f3c 0 2024-09-19T06:40:26.798 INFO:tasks.workunit.client.1.smithi117.stdout:1/93: creat d3/d18/f1f x:0 0 0 2024-09-19T06:40:26.799 INFO:tasks.workunit.client.1.smithi117.stdout:7/171: chown d1/l38 14233767 1 2024-09-19T06:40:26.801 INFO:tasks.workunit.client.1.smithi117.stdout:2/155: mkdir d0/d7/d1e/d20/d3e 0 2024-09-19T06:40:26.801 INFO:tasks.workunit.client.1.smithi117.stdout:8/128: dwrite ff [0,4194304] 0 2024-09-19T06:40:26.804 INFO:tasks.workunit.client.1.smithi117.stdout:8/129: readlink l9 0 2024-09-19T06:40:26.807 INFO:tasks.workunit.client.1.smithi117.stdout:7/172: symlink d1/d8/d24/d1c/d35/l41 0 2024-09-19T06:40:26.807 INFO:tasks.workunit.client.1.smithi117.stdout:1/94: link d3/l16 d3/d18/l20 0 2024-09-19T06:40:26.809 INFO:tasks.workunit.client.1.smithi117.stdout:2/156: symlink d0/l3f 0 2024-09-19T06:40:26.810 INFO:tasks.workunit.client.1.smithi117.stdout:4/194: dwrite d3/d4/f40 [0,4194304] 0 2024-09-19T06:40:26.813 INFO:tasks.workunit.client.1.smithi117.stdout:7/173: dread - d1/d8/f2c zero size 2024-09-19T06:40:26.816 INFO:tasks.workunit.client.1.smithi117.stdout:1/95: creat d3/d18/f21 x:0 0 0 2024-09-19T06:40:26.819 INFO:tasks.workunit.client.1.smithi117.stdout:4/195: unlink d3/db/l27 0 2024-09-19T06:40:26.820 INFO:tasks.workunit.client.1.smithi117.stdout:7/174: chown d1/d8/d24/d1c/d35/f3d 80394 1 2024-09-19T06:40:26.820 INFO:tasks.workunit.client.1.smithi117.stdout:8/130: dwrite f12 [0,4194304] 0 2024-09-19T06:40:26.820 INFO:tasks.workunit.client.1.smithi117.stdout:1/96: mkdir d3/d22 0 2024-09-19T06:40:26.821 INFO:tasks.workunit.client.1.smithi117.stdout:2/157: creat d0/d12/d2f/f40 x:0 0 0 2024-09-19T06:40:26.822 INFO:tasks.workunit.client.1.smithi117.stdout:4/196: mknod d3/d28/d2a/c48 0 2024-09-19T06:40:26.822 INFO:tasks.workunit.client.1.smithi117.stdout:9/176: dread d4/d1c/f35 [0,4194304] 0 2024-09-19T06:40:26.823 INFO:tasks.workunit.client.1.smithi117.stdout:8/131: readlink d1d/d1e/l20 0 2024-09-19T06:40:26.824 INFO:tasks.workunit.client.1.smithi117.stdout:7/175: rmdir d1/d8 39 2024-09-19T06:40:26.826 INFO:tasks.workunit.client.1.smithi117.stdout:8/132: chown cc 484470514 1 2024-09-19T06:40:26.828 INFO:tasks.workunit.client.1.smithi117.stdout:1/97: dread d3/f1b [0,4194304] 0 2024-09-19T06:40:26.829 INFO:tasks.workunit.client.1.smithi117.stdout:1/98: chown d3/f14 1812538597 1 2024-09-19T06:40:26.829 INFO:tasks.workunit.client.1.smithi117.stdout:6/136: truncate d1/d14/f15 914112 0 2024-09-19T06:40:26.830 INFO:tasks.workunit.client.1.smithi117.stdout:9/177: symlink d4/d1c/d36/d37/l3a 0 2024-09-19T06:40:26.832 INFO:tasks.workunit.client.1.smithi117.stdout:2/158: link d0/d12/f2c d0/d7/d1e/f41 0 2024-09-19T06:40:26.833 INFO:tasks.workunit.client.1.smithi117.stdout:8/133: creat d1d/f24 x:0 0 0 2024-09-19T06:40:26.834 INFO:tasks.workunit.client.1.smithi117.stdout:7/176: mknod d1/d8/c42 0 2024-09-19T06:40:26.834 INFO:tasks.workunit.client.1.smithi117.stdout:1/99: mkdir d3/d18/d23 0 2024-09-19T06:40:26.835 INFO:tasks.workunit.client.1.smithi117.stdout:4/197: link d3/d4/f9 d3/db/d20/d29/f49 0 2024-09-19T06:40:26.837 INFO:tasks.workunit.client.1.smithi117.stdout:6/137: mknod d1/d5/d8/c21 0 2024-09-19T06:40:26.837 INFO:tasks.workunit.client.1.smithi117.stdout:4/198: dread d3/d4/f9 [0,4194304] 0 2024-09-19T06:40:26.838 INFO:tasks.workunit.client.1.smithi117.stdout:2/159: mknod d0/d7/d1e/d20/c42 0 2024-09-19T06:40:26.838 INFO:tasks.workunit.client.1.smithi117.stdout:6/138: chown d1/f1c 8186 1 2024-09-19T06:40:26.838 INFO:tasks.workunit.client.1.smithi117.stdout:8/134: mknod d1d/d1e/c25 0 2024-09-19T06:40:26.839 INFO:tasks.workunit.client.1.smithi117.stdout:7/177: dread d1/d8/d24/f20 [0,4194304] 0 2024-09-19T06:40:26.918 INFO:tasks.workunit.client.1.smithi117.stdout:0/95: sync 2024-09-19T06:40:26.948 INFO:tasks.workunit.client.1.smithi117.stdout:8/135: truncate f19 670104 0 2024-09-19T06:40:26.949 INFO:tasks.workunit.client.1.smithi117.stdout:0/96: write d11/f12 [308931,27851] 0 2024-09-19T06:40:27.032 INFO:tasks.workunit.client.1.smithi117.stdout:3/141: sync 2024-09-19T06:40:27.033 INFO:tasks.workunit.client.1.smithi117.stdout:5/175: sync 2024-09-19T06:40:27.110 INFO:tasks.workunit.client.1.smithi117.stdout:1/100: sync 2024-09-19T06:40:27.228 INFO:tasks.workunit.client.1.smithi117.stdout:8/136: chown f3 130 1 2024-09-19T06:40:27.229 INFO:tasks.workunit.client.1.smithi117.stdout:9/178: creat d4/f3b x:0 0 0 2024-09-19T06:40:27.229 INFO:tasks.workunit.client.1.smithi117.stdout:9/179: readlink d4/d20/l30 0 2024-09-19T06:40:27.232 INFO:tasks.workunit.client.1.smithi117.stdout:3/142: symlink d0/d9/l22 0 2024-09-19T06:40:27.233 INFO:tasks.workunit.client.1.smithi117.stdout:4/199: mkdir d3/db/d20/d4a 0 2024-09-19T06:40:27.234 INFO:tasks.workunit.client.1.smithi117.stdout:2/160: creat d0/d7/d29/d35/d3d/f43 x:0 0 0 2024-09-19T06:40:27.236 INFO:tasks.workunit.client.1.smithi117.stdout:6/139: link d1/d3/f20 d1/d3/f22 0 2024-09-19T06:40:27.236 INFO:tasks.workunit.client.1.smithi117.stdout:8/137: creat d1d/f26 x:0 0 0 2024-09-19T06:40:27.237 INFO:tasks.workunit.client.1.smithi117.stdout:6/140: chown d1/f18 0 1 2024-09-19T06:40:27.240 INFO:tasks.workunit.client.1.smithi117.stdout:1/101: link d3/f13 d3/d18/f24 0 2024-09-19T06:40:27.240 INFO:tasks.workunit.client.1.smithi117.stdout:2/161: dwrite d0/d7/f8 [4194304,4194304] 0 2024-09-19T06:40:27.244 INFO:tasks.workunit.client.1.smithi117.stdout:8/138: rmdir d1d/d1e 39 2024-09-19T06:40:27.246 INFO:tasks.workunit.client.1.smithi117.stdout:6/141: unlink d1/d5/d8/c21 0 2024-09-19T06:40:27.246 INFO:tasks.workunit.client.1.smithi117.stdout:0/97: dwrite f10 [0,4194304] 0 2024-09-19T06:40:27.246 INFO:tasks.workunit.client.1.smithi117.stdout:3/143: truncate d0/f6 1950169 0 2024-09-19T06:40:27.248 INFO:tasks.workunit.client.1.smithi117.stdout:4/200: link d3/f2b d3/de/f4b 0 2024-09-19T06:40:27.248 INFO:tasks.workunit.client.1.smithi117.stdout:7/178: link d1/l33 d1/l43 0 2024-09-19T06:40:27.250 INFO:tasks.workunit.client.1.smithi117.stdout:2/162: rename d0/d12/f13 to d0/d7/d1e/d20/f44 0 2024-09-19T06:40:27.251 INFO:tasks.workunit.client.1.smithi117.stdout:9/180: fsync d4/df/f2f 0 2024-09-19T06:40:27.253 INFO:tasks.workunit.client.1.smithi117.stdout:6/142: creat d1/d14/f23 x:0 0 0 2024-09-19T06:40:27.253 INFO:tasks.workunit.client.1.smithi117.stdout:2/163: chown d0/d7/f8 14357 1 2024-09-19T06:40:27.254 INFO:tasks.workunit.client.1.smithi117.stdout:0/98: mknod d11/d13/c1c 0 2024-09-19T06:40:27.255 INFO:tasks.workunit.client.1.smithi117.stdout:5/176: dwrite d17/f19 [0,4194304] 0 2024-09-19T06:40:27.255 INFO:tasks.workunit.client.1.smithi117.stdout:7/179: mkdir d1/d8/d24/d26/d44 0 2024-09-19T06:40:27.258 INFO:tasks.workunit.client.1.smithi117.stdout:3/144: symlink d0/l23 0 2024-09-19T06:40:27.258 INFO:tasks.workunit.client.1.smithi117.stdout:0/99: write d11/f12 [1285401,90981] 0 2024-09-19T06:40:27.260 INFO:tasks.workunit.client.1.smithi117.stdout:0/100: chown d11/d13/d1b 2330516 1 2024-09-19T06:40:27.260 INFO:tasks.workunit.client.1.smithi117.stdout:8/139: dread f4 [0,4194304] 0 2024-09-19T06:40:27.260 INFO:tasks.workunit.client.1.smithi117.stdout:2/164: rmdir d0/d7/d29/d35/d3d 39 2024-09-19T06:40:27.261 INFO:tasks.workunit.client.1.smithi117.stdout:6/143: fsync d1/d3/fc 0 2024-09-19T06:40:27.263 INFO:tasks.workunit.client.1.smithi117.stdout:7/180: write d1/d8/f1a [1562273,110898] 0 2024-09-19T06:40:27.264 INFO:tasks.workunit.client.1.smithi117.stdout:7/181: read d1/d8/f16 [203614,90951] 0 2024-09-19T06:40:27.264 INFO:tasks.workunit.client.1.smithi117.stdout:3/145: truncate d0/f12 719875 0 2024-09-19T06:40:27.265 INFO:tasks.workunit.client.1.smithi117.stdout:3/146: chown d0/d9/l17 7398383 1 2024-09-19T06:40:27.266 INFO:tasks.workunit.client.1.smithi117.stdout:7/182: dread d1/d8/d24/f3a [0,4194304] 0 2024-09-19T06:40:27.266 INFO:tasks.workunit.client.1.smithi117.stdout:2/165: creat d0/d12/d2f/f45 x:0 0 0 2024-09-19T06:40:27.267 INFO:tasks.workunit.client.1.smithi117.stdout:3/147: write d0/d8/f16 [568271,57111] 0 2024-09-19T06:40:27.268 INFO:tasks.workunit.client.1.smithi117.stdout:0/101: rename f10 to d11/d13/d14/f1d 0 2024-09-19T06:40:27.270 INFO:tasks.workunit.client.1.smithi117.stdout:0/102: write fd [338632,79619] 0 2024-09-19T06:40:27.271 INFO:tasks.workunit.client.1.smithi117.stdout:3/148: write d0/f18 [830599,74168] 0 2024-09-19T06:40:27.273 INFO:tasks.workunit.client.1.smithi117.stdout:7/183: truncate d1/d8/d24/d1c/f28 637358 0 2024-09-19T06:40:27.274 INFO:tasks.workunit.client.1.smithi117.stdout:0/103: creat d11/d13/d14/d16/f1e x:0 0 0 2024-09-19T06:40:27.276 INFO:tasks.workunit.client.1.smithi117.stdout:2/166: rename d0/d12/c18 to d0/d7/d29/d35/d3d/c46 0 2024-09-19T06:40:27.278 INFO:tasks.workunit.client.1.smithi117.stdout:4/201: dread d3/de/f10 [0,4194304] 0 2024-09-19T06:40:27.279 INFO:tasks.workunit.client.1.smithi117.stdout:0/104: rename d11/d13/c15 to d11/d13/d14/d16/c1f 0 2024-09-19T06:40:27.279 INFO:tasks.workunit.client.1.smithi117.stdout:5/177: fdatasync d17/f19 0 2024-09-19T06:40:27.280 INFO:tasks.workunit.client.1.smithi117.stdout:3/149: mkdir d0/d24 0 2024-09-19T06:40:27.280 INFO:tasks.workunit.client.1.smithi117.stdout:6/144: rmdir d1 39 2024-09-19T06:40:27.281 INFO:tasks.workunit.client.1.smithi117.stdout:3/150: dread - d0/d9/d1c/f1d zero size 2024-09-19T06:40:27.284 INFO:tasks.workunit.client.1.smithi117.stdout:5/178: mkdir d17/d2f/d3b 0 2024-09-19T06:40:27.286 INFO:tasks.workunit.client.1.smithi117.stdout:3/151: mknod d0/d9/c25 0 2024-09-19T06:40:27.286 INFO:tasks.workunit.client.1.smithi117.stdout:9/181: truncate d4/f24 2988930 0 2024-09-19T06:40:27.286 INFO:tasks.workunit.client.1.smithi117.stdout:7/184: link d1/d8/d24/d1c/c1d d1/d8/d24/c45 0 2024-09-19T06:40:27.287 INFO:tasks.workunit.client.1.smithi117.stdout:9/182: write d4/d1c/d36/d37/f39 [577913,113457] 0 2024-09-19T06:40:27.289 INFO:tasks.workunit.client.1.smithi117.stdout:6/145: mknod d1/d5/c24 0 2024-09-19T06:40:27.291 INFO:tasks.workunit.client.1.smithi117.stdout:6/146: dread d1/d14/f15 [0,4194304] 0 2024-09-19T06:40:27.291 INFO:tasks.workunit.client.1.smithi117.stdout:5/179: mkdir d17/d1b/d3a/d3c 0 2024-09-19T06:40:27.291 INFO:tasks.workunit.client.1.smithi117.stdout:7/185: creat d1/d8/d24/d1c/f46 x:0 0 0 2024-09-19T06:40:27.294 INFO:tasks.workunit.client.1.smithi117.stdout:4/202: link d3/de/f1c d3/db/d20/d35/f4c 0 2024-09-19T06:40:27.296 INFO:tasks.workunit.client.1.smithi117.stdout:6/147: mkdir d1/d3/d25 0 2024-09-19T06:40:27.296 INFO:tasks.workunit.client.1.smithi117.stdout:2/167: fsync d0/fd 0 2024-09-19T06:40:27.296 INFO:tasks.workunit.client.1.smithi117.stdout:6/148: dread - d1/d3/f22 zero size 2024-09-19T06:40:27.297 INFO:tasks.workunit.client.1.smithi117.stdout:7/186: creat d1/d8/f47 x:0 0 0 2024-09-19T06:40:27.297 INFO:tasks.workunit.client.1.smithi117.stdout:7/187: chown d1/d3f 872165480 1 2024-09-19T06:40:27.298 INFO:tasks.workunit.client.1.smithi117.stdout:0/105: getdents d11/d13/d14/d16 0 2024-09-19T06:40:27.298 INFO:tasks.workunit.client.1.smithi117.stdout:7/188: readlink d1/l38 0 2024-09-19T06:40:27.299 INFO:tasks.workunit.client.1.smithi117.stdout:7/189: chown d1/d8/d24/d1c/f27 97724 1 2024-09-19T06:40:27.299 INFO:tasks.workunit.client.1.smithi117.stdout:7/190: chown d1 3127515 1 2024-09-19T06:40:27.303 INFO:tasks.workunit.client.1.smithi117.stdout:4/203: creat d3/d1b/f4d x:0 0 0 2024-09-19T06:40:27.303 INFO:tasks.workunit.client.1.smithi117.stdout:5/180: creat d17/d1b/d3a/d3c/f3d x:0 0 0 2024-09-19T06:40:27.305 INFO:tasks.workunit.client.1.smithi117.stdout:0/106: dread d11/d13/d14/f1d [0,4194304] 0 2024-09-19T06:40:27.306 INFO:tasks.workunit.client.1.smithi117.stdout:9/183: getdents d4/d1c 0 2024-09-19T06:40:27.307 INFO:tasks.workunit.client.1.smithi117.stdout:4/204: mknod d3/d1b/c4e 0 2024-09-19T06:40:27.308 INFO:tasks.workunit.client.1.smithi117.stdout:5/181: creat d17/d1b/d3a/f3e x:0 0 0 2024-09-19T06:40:27.308 INFO:tasks.workunit.client.1.smithi117.stdout:7/191: getdents d1/d8/d24/d26/d3e 0 2024-09-19T06:40:27.309 INFO:tasks.workunit.client.1.smithi117.stdout:2/168: truncate d0/d7/f8 5250357 0 2024-09-19T06:40:27.310 INFO:tasks.workunit.client.1.smithi117.stdout:9/184: rmdir d4/d17 39 2024-09-19T06:40:27.312 INFO:tasks.workunit.client.1.smithi117.stdout:0/107: mkdir d11/d13/d1b/d20 0 2024-09-19T06:40:27.313 INFO:tasks.workunit.client.1.smithi117.stdout:2/169: creat d0/d7/d1e/d20/f47 x:0 0 0 2024-09-19T06:40:27.313 INFO:tasks.workunit.client.1.smithi117.stdout:9/185: creat d4/d18/f3c x:0 0 0 2024-09-19T06:40:27.314 INFO:tasks.workunit.client.1.smithi117.stdout:5/182: mkdir d17/d2f/d3b/d3f 0 2024-09-19T06:40:27.316 INFO:tasks.workunit.client.1.smithi117.stdout:9/186: write d4/d1c/d36/d37/f39 [740354,115019] 0 2024-09-19T06:40:27.317 INFO:tasks.workunit.client.1.smithi117.stdout:0/108: mknod d11/d13/c21 0 2024-09-19T06:40:27.317 INFO:tasks.workunit.client.1.smithi117.stdout:7/192: getdents d1/d3f 0 2024-09-19T06:40:27.317 INFO:tasks.workunit.client.1.smithi117.stdout:5/183: write d17/d2e/f32 [25551,74363] 0 2024-09-19T06:40:27.321 INFO:tasks.workunit.client.1.smithi117.stdout:7/193: chown d1/c2e 2029114 1 2024-09-19T06:40:27.321 INFO:tasks.workunit.client.1.smithi117.stdout:9/187: creat d4/d1c/f3d x:0 0 0 2024-09-19T06:40:27.323 INFO:tasks.workunit.client.1.smithi117.stdout:0/109: creat d11/d13/f22 x:0 0 0 2024-09-19T06:40:27.323 INFO:tasks.workunit.client.1.smithi117.stdout:5/184: creat d17/d1b/f40 x:0 0 0 2024-09-19T06:40:27.324 INFO:tasks.workunit.client.1.smithi117.stdout:0/110: fsync fd 0 2024-09-19T06:40:27.325 INFO:tasks.workunit.client.1.smithi117.stdout:9/188: write d4/f33 [989948,77391] 0 2024-09-19T06:40:27.326 INFO:tasks.workunit.client.1.smithi117.stdout:5/185: fdatasync ff 0 2024-09-19T06:40:27.327 INFO:tasks.workunit.client.1.smithi117.stdout:4/205: dwrite d3/d4/f9 [0,4194304] 0 2024-09-19T06:40:27.327 INFO:tasks.workunit.client.1.smithi117.stdout:2/170: dwrite d0/d7/d29/d35/d3d/f43 [0,4194304] 0 2024-09-19T06:40:27.328 INFO:tasks.workunit.client.1.smithi117.stdout:0/111: dread - d11/d13/f22 zero size 2024-09-19T06:40:27.329 INFO:tasks.workunit.client.1.smithi117.stdout:5/186: chown c9 31 1 2024-09-19T06:40:27.331 INFO:tasks.workunit.client.1.smithi117.stdout:0/112: fdatasync d11/d13/d14/d16/f1e 0 2024-09-19T06:40:27.332 INFO:tasks.workunit.client.1.smithi117.stdout:9/189: fdatasync d4/f24 0 2024-09-19T06:40:27.334 INFO:tasks.workunit.client.1.smithi117.stdout:2/171: creat d0/d7/d1e/d20/f48 x:0 0 0 2024-09-19T06:40:27.334 INFO:tasks.workunit.client.1.smithi117.stdout:2/172: fsync d0/d12/f28 0 2024-09-19T06:40:27.335 INFO:tasks.workunit.client.1.smithi117.stdout:0/113: symlink d11/d13/d1b/l23 0 2024-09-19T06:40:27.336 INFO:tasks.workunit.client.1.smithi117.stdout:7/194: truncate d1/d8/d24/f6 3155925 0 2024-09-19T06:40:27.341 INFO:tasks.workunit.client.1.smithi117.stdout:4/206: mkdir d3/db/d20/d29/d39/d4f 0 2024-09-19T06:40:27.344 INFO:tasks.workunit.client.1.smithi117.stdout:7/195: mkdir d1/d8/d48 0 2024-09-19T06:40:27.344 INFO:tasks.workunit.client.1.smithi117.stdout:2/173: dwrite d0/f2b [0,4194304] 0 2024-09-19T06:40:27.345 INFO:tasks.workunit.client.1.smithi117.stdout:5/187: creat d17/f41 x:0 0 0 2024-09-19T06:40:27.349 INFO:tasks.workunit.client.1.smithi117.stdout:0/114: dwrite fd [0,4194304] 0 2024-09-19T06:40:27.350 INFO:tasks.workunit.client.1.smithi117.stdout:2/174: fdatasync d0/d12/f3c 0 2024-09-19T06:40:27.352 INFO:tasks.workunit.client.1.smithi117.stdout:9/190: dwrite d4/f24 [0,4194304] 0 2024-09-19T06:40:27.356 INFO:tasks.workunit.client.1.smithi117.stdout:0/115: chown d11/d13/c21 685 1 2024-09-19T06:40:27.356 INFO:tasks.workunit.client.1.smithi117.stdout:7/196: getdents d1 0 2024-09-19T06:40:27.359 INFO:tasks.workunit.client.1.smithi117.stdout:9/191: creat d4/d18/f3e x:0 0 0 2024-09-19T06:40:27.359 INFO:tasks.workunit.client.1.smithi117.stdout:2/175: symlink d0/d7/l49 0 2024-09-19T06:40:27.361 INFO:tasks.workunit.client.1.smithi117.stdout:0/116: read d11/f12 [1157018,76715] 0 2024-09-19T06:40:27.365 INFO:tasks.workunit.client.1.smithi117.stdout:5/188: dwrite d17/d1b/d3a/d3c/f3d [0,4194304] 0 2024-09-19T06:40:27.368 INFO:tasks.workunit.client.1.smithi117.stdout:4/207: link d3/d1b/c2d d3/d28/d2a/c50 0 2024-09-19T06:40:27.369 INFO:tasks.workunit.client.1.smithi117.stdout:7/197: mkdir d1/d8/d24/d49 0 2024-09-19T06:40:27.369 INFO:tasks.workunit.client.1.smithi117.stdout:9/192: rmdir d4/d1c/d36/d37 39 2024-09-19T06:40:27.371 INFO:tasks.workunit.client.1.smithi117.stdout:7/198: read - d1/d8/d24/d26/f2f zero size 2024-09-19T06:40:27.373 INFO:tasks.workunit.client.1.smithi117.stdout:5/189: symlink d17/d2e/l42 0 2024-09-19T06:40:27.373 INFO:tasks.workunit.client.1.smithi117.stdout:2/176: rename d0/d12/d32/f33 to d0/d7/d1e/d20/d3e/f4a 0 2024-09-19T06:40:27.375 INFO:tasks.workunit.client.1.smithi117.stdout:9/193: symlink d4/d20/l3f 0 2024-09-19T06:40:27.375 INFO:tasks.workunit.client.1.smithi117.stdout:4/208: write d3/de/f10 [2513777,114882] 0 2024-09-19T06:40:27.375 INFO:tasks.workunit.client.1.smithi117.stdout:7/199: mkdir d1/d4a 0 2024-09-19T06:40:27.382 INFO:tasks.workunit.client.1.smithi117.stdout:5/190: dread d17/f22 [0,4194304] 0 2024-09-19T06:40:27.383 INFO:tasks.workunit.client.1.smithi117.stdout:0/117: rmdir d11/d13/d1b/d20 0 2024-09-19T06:40:27.385 INFO:tasks.workunit.client.1.smithi117.stdout:9/194: symlink d4/df/l40 0 2024-09-19T06:40:27.385 INFO:tasks.workunit.client.1.smithi117.stdout:4/209: write d3/db/ff [5167044,70940] 0 2024-09-19T06:40:27.386 INFO:tasks.workunit.client.1.smithi117.stdout:5/191: symlink d17/d2e/l43 0 2024-09-19T06:40:27.391 INFO:tasks.workunit.client.1.smithi117.stdout:4/210: unlink d3/db/d20/d29/f49 0 2024-09-19T06:40:27.391 INFO:tasks.workunit.client.1.smithi117.stdout:4/211: chown d3 5919 1 2024-09-19T06:40:27.391 INFO:tasks.workunit.client.1.smithi117.stdout:5/192: rmdir d17/d2f 39 2024-09-19T06:40:27.394 INFO:tasks.workunit.client.1.smithi117.stdout:9/195: unlink d4/f12 0 2024-09-19T06:40:27.395 INFO:tasks.workunit.client.1.smithi117.stdout:2/177: truncate d0/f6 3872897 0 2024-09-19T06:40:27.399 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:27 smithi117 ceph-mon[34564]: pgmap v12: 65 pgs: 65 active+clean; 392 MiB data, 2.9 GiB used, 533 GiB / 536 GiB avail; 752 KiB/s rd, 29 MiB/s wr, 432 op/s 2024-09-19T06:40:27.400 INFO:tasks.workunit.client.1.smithi117.stdout:0/118: getdents d11 0 2024-09-19T06:40:27.400 INFO:tasks.workunit.client.1.smithi117.stdout:5/193: creat d17/d2f/d3b/f44 x:0 0 0 2024-09-19T06:40:27.402 INFO:tasks.workunit.client.1.smithi117.stdout:7/200: symlink d1/d8/d24/d49/l4b 0 2024-09-19T06:40:27.403 INFO:tasks.workunit.client.1.smithi117.stdout:9/196: dread d4/d1c/d36/d37/f39 [0,4194304] 0 2024-09-19T06:40:27.405 INFO:tasks.workunit.client.1.smithi117.stdout:0/119: write d11/d13/d14/d16/f1a [373448,122955] 0 2024-09-19T06:40:27.407 INFO:tasks.workunit.client.1.smithi117.stdout:4/212: read d3/db/d13/f1d [109836,93319] 0 2024-09-19T06:40:27.407 INFO:tasks.workunit.client.1.smithi117.stdout:0/120: read d11/d13/d14/d16/f1a [213633,69271] 0 2024-09-19T06:40:27.408 INFO:tasks.workunit.client.0.smithi099.stdout:2/0: sync 2024-09-19T06:40:27.409 INFO:tasks.workunit.client.1.smithi117.stdout:5/194: write d17/f22 [879713,53561] 0 2024-09-19T06:40:27.410 INFO:tasks.workunit.client.1.smithi117.stdout:9/197: unlink d4/fd 0 2024-09-19T06:40:27.410 INFO:tasks.workunit.client.1.smithi117.stdout:9/198: readlink d4/df/d16/l34 0 2024-09-19T06:40:27.412 INFO:tasks.workunit.client.0.smithi099.stdout:2/1: creat f0 x:0 0 0 2024-09-19T06:40:27.413 INFO:tasks.workunit.client.1.smithi117.stdout:4/213: rmdir d3/d1b 39 2024-09-19T06:40:27.414 INFO:tasks.workunit.client.0.smithi099.stdout:2/2: mkdir d1 0 2024-09-19T06:40:27.414 INFO:tasks.workunit.client.1.smithi117.stdout:9/199: write d4/f24 [346969,81816] 0 2024-09-19T06:40:27.415 INFO:tasks.workunit.client.0.smithi099.stdout:2/3: truncate f0 514861 0 2024-09-19T06:40:27.416 INFO:tasks.workunit.client.1.smithi117.stdout:7/201: creat d1/f4c x:0 0 0 2024-09-19T06:40:27.418 INFO:tasks.workunit.client.0.smithi099.stdout:2/4: mkdir d1/d2 0 2024-09-19T06:40:27.419 INFO:tasks.workunit.client.1.smithi117.stdout:9/200: fsync d4/f24 0 2024-09-19T06:40:27.420 INFO:tasks.workunit.client.0.smithi099.stdout:2/5: mknod d1/c3 0 2024-09-19T06:40:27.421 INFO:tasks.workunit.client.1.smithi117.stdout:2/178: dread d0/f2a [0,4194304] 0 2024-09-19T06:40:27.421 INFO:tasks.workunit.client.1.smithi117.stdout:4/214: mkdir d3/de/d51 0 2024-09-19T06:40:27.421 INFO:tasks.workunit.client.0.smithi099.stdout:2/6: write f0 [1010960,43250] 0 2024-09-19T06:40:27.421 INFO:tasks.workunit.client.0.smithi099.stdout:2/7: chown f0 5075 1 2024-09-19T06:40:27.422 INFO:tasks.workunit.client.1.smithi117.stdout:0/121: dwrite fd [0,4194304] 0 2024-09-19T06:40:27.426 INFO:tasks.workunit.client.1.smithi117.stdout:4/215: readlink d3/de/l1e 0 2024-09-19T06:40:27.428 INFO:tasks.workunit.client.1.smithi117.stdout:0/122: mknod d11/d13/c24 0 2024-09-19T06:40:27.429 INFO:tasks.workunit.client.1.smithi117.stdout:0/123: chown f4 67 1 2024-09-19T06:40:27.429 INFO:tasks.workunit.client.0.smithi099.stdout:2/8: fsync f0 0 2024-09-19T06:40:27.430 INFO:tasks.workunit.client.1.smithi117.stdout:9/201: creat d4/d1c/f41 x:0 0 0 2024-09-19T06:40:27.431 INFO:tasks.workunit.client.1.smithi117.stdout:5/195: dwrite d17/d2e/f32 [0,4194304] 0 2024-09-19T06:40:27.431 INFO:tasks.workunit.client.1.smithi117.stdout:7/202: creat d1/d3f/f4d x:0 0 0 2024-09-19T06:40:27.434 INFO:tasks.workunit.client.1.smithi117.stdout:9/202: dread - d4/d18/f3c zero size 2024-09-19T06:40:27.438 INFO:tasks.workunit.client.1.smithi117.stdout:5/196: rmdir d17/d2f/d3b/d3f 0 2024-09-19T06:40:27.441 INFO:tasks.workunit.client.1.smithi117.stdout:2/179: dwrite d0/d7/d1e/d20/f48 [0,4194304] 0 2024-09-19T06:40:27.442 INFO:tasks.workunit.client.1.smithi117.stdout:9/203: creat d4/d1c/d36/d37/f42 x:0 0 0 2024-09-19T06:40:27.446 INFO:tasks.workunit.client.1.smithi117.stdout:7/203: unlink d1/d8/d24/d1c/d35/f3d 0 2024-09-19T06:40:27.447 INFO:tasks.workunit.client.1.smithi117.stdout:9/204: symlink d4/df/d16/l43 0 2024-09-19T06:40:27.449 INFO:tasks.workunit.client.1.smithi117.stdout:4/216: dwrite d3/f2b [0,4194304] 0 2024-09-19T06:40:27.449 INFO:tasks.workunit.client.1.smithi117.stdout:0/124: dread d11/d13/d14/f1d [0,4194304] 0 2024-09-19T06:40:27.450 INFO:tasks.workunit.client.1.smithi117.stdout:2/180: fdatasync d0/d7/f1c 0 2024-09-19T06:40:27.451 INFO:tasks.workunit.client.1.smithi117.stdout:0/125: readlink d11/l18 0 2024-09-19T06:40:27.451 INFO:tasks.workunit.client.1.smithi117.stdout:5/197: dread f3 [0,4194304] 0 2024-09-19T06:40:27.452 INFO:tasks.workunit.client.1.smithi117.stdout:4/217: fsync d3/db/f3a 0 2024-09-19T06:40:27.452 INFO:tasks.workunit.client.1.smithi117.stdout:7/204: write d1/d8/d24/d1c/f46 [906715,123992] 0 2024-09-19T06:40:27.455 INFO:tasks.workunit.client.1.smithi117.stdout:2/181: creat d0/d12/d32/f4b x:0 0 0 2024-09-19T06:40:27.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:27 smithi099 ceph-mon[27651]: pgmap v12: 65 pgs: 65 active+clean; 392 MiB data, 2.9 GiB used, 533 GiB / 536 GiB avail; 752 KiB/s rd, 29 MiB/s wr, 432 op/s 2024-09-19T06:40:27.456 INFO:tasks.workunit.client.1.smithi117.stdout:4/218: symlink d3/d4/d14/l52 0 2024-09-19T06:40:27.473 INFO:tasks.workunit.client.1.smithi117.stdout:7/205: creat d1/d8/d24/d1c/f4e x:0 0 0 2024-09-19T06:40:27.473 INFO:tasks.workunit.client.1.smithi117.stdout:9/205: getdents d4/d17 0 2024-09-19T06:40:27.473 INFO:tasks.workunit.client.1.smithi117.stdout:5/198: dread ff [0,4194304] 0 2024-09-19T06:40:27.474 INFO:tasks.workunit.client.1.smithi117.stdout:2/182: dread d0/fd [4194304,4194304] 0 2024-09-19T06:40:27.475 INFO:tasks.workunit.client.1.smithi117.stdout:7/206: readlink d1/d8/d24/d1c/d35/l41 0 2024-09-19T06:40:27.475 INFO:tasks.workunit.client.1.smithi117.stdout:2/183: fsync d0/f9 0 2024-09-19T06:40:27.476 INFO:tasks.workunit.client.1.smithi117.stdout:7/207: write d1/d8/d24/d1c/f46 [1652642,27757] 0 2024-09-19T06:40:27.484 INFO:tasks.workunit.client.1.smithi117.stdout:9/206: rename d4/d1c/f3d to d4/f44 0 2024-09-19T06:40:27.485 INFO:tasks.workunit.client.1.smithi117.stdout:4/219: write d3/db/d20/d35/f4c [3189122,128158] 0 2024-09-19T06:40:27.488 INFO:tasks.workunit.client.1.smithi117.stdout:5/199: rename d17/d1b/l37 to d17/d1b/d3a/l45 0 2024-09-19T06:40:27.489 INFO:tasks.workunit.client.1.smithi117.stdout:4/220: creat d3/db/d20/d29/d39/f53 x:0 0 0 2024-09-19T06:40:27.490 INFO:tasks.workunit.client.1.smithi117.stdout:2/184: dwrite d0/d12/d32/f4b [0,4194304] 0 2024-09-19T06:40:27.491 INFO:tasks.workunit.client.1.smithi117.stdout:5/200: write d17/d1b/f40 [1004057,64040] 0 2024-09-19T06:40:27.492 INFO:tasks.workunit.client.1.smithi117.stdout:2/185: chown d0/l26 180 1 2024-09-19T06:40:27.492 INFO:tasks.workunit.client.1.smithi117.stdout:9/207: getdents d4/d18 0 2024-09-19T06:40:27.494 INFO:tasks.workunit.client.1.smithi117.stdout:7/208: dread d1/d8/d24/f20 [0,4194304] 0 2024-09-19T06:40:27.496 INFO:tasks.workunit.client.1.smithi117.stdout:4/221: truncate d3/db/d13/f1d 4281764 0 2024-09-19T06:40:27.496 INFO:tasks.workunit.client.1.smithi117.stdout:9/208: write d4/d1c/f1f [3815854,17471] 0 2024-09-19T06:40:27.498 INFO:tasks.workunit.client.1.smithi117.stdout:7/209: mkdir d1/d8/d24/d1c/d35/d4f 0 2024-09-19T06:40:27.499 INFO:tasks.workunit.client.1.smithi117.stdout:7/210: stat d1/d8/d24/d26/f37 0 2024-09-19T06:40:27.500 INFO:tasks.workunit.client.1.smithi117.stdout:2/186: rename d0/d7/d1e/d20/f47 to d0/f4c 0 2024-09-19T06:40:27.500 INFO:tasks.workunit.client.1.smithi117.stdout:9/209: fdatasync d4/f19 0 2024-09-19T06:40:27.502 INFO:tasks.workunit.client.1.smithi117.stdout:9/210: readlink d4/df/l40 0 2024-09-19T06:40:27.502 INFO:tasks.workunit.client.1.smithi117.stdout:5/201: dwrite f3 [0,4194304] 0 2024-09-19T06:40:27.503 INFO:tasks.workunit.client.1.smithi117.stdout:4/222: rename d3/d4/f8 to d3/db/d23/f54 0 2024-09-19T06:40:27.504 INFO:tasks.workunit.client.1.smithi117.stdout:5/202: mkdir d17/d1b/d3a/d3c/d46 0 2024-09-19T06:40:27.508 INFO:tasks.workunit.client.1.smithi117.stdout:5/203: unlink d17/d1b/l20 0 2024-09-19T06:40:27.509 INFO:tasks.workunit.client.1.smithi117.stdout:2/187: link d0/d7/d1e/c1f d0/d7/d29/d35/c4d 0 2024-09-19T06:40:27.510 INFO:tasks.workunit.client.1.smithi117.stdout:9/211: dwrite d4/d1c/d36/d37/f42 [0,4194304] 0 2024-09-19T06:40:27.511 INFO:tasks.workunit.client.1.smithi117.stdout:9/212: fsync d4/d1c/f1f 0 2024-09-19T06:40:27.511 INFO:tasks.workunit.client.1.smithi117.stdout:7/211: rename d1/d8/d24/ff to d1/f50 0 2024-09-19T06:40:27.512 INFO:tasks.workunit.client.1.smithi117.stdout:7/212: fsync d1/d8/d24/d1c/f4e 0 2024-09-19T06:40:27.513 INFO:tasks.workunit.client.1.smithi117.stdout:7/213: truncate d1/d8/d24/d1c/f22 453831 0 2024-09-19T06:40:27.515 INFO:tasks.workunit.client.1.smithi117.stdout:7/214: write d1/d8/d24/d1c/f28 [272713,101552] 0 2024-09-19T06:40:27.565 INFO:tasks.workunit.client.1.smithi117.stdout:2/188: mknod d0/d7/d1e/c4e 0 2024-09-19T06:40:27.566 INFO:tasks.workunit.client.1.smithi117.stdout:2/189: fsync d0/d7/f2d 0 2024-09-19T06:40:27.568 INFO:tasks.workunit.client.1.smithi117.stdout:9/213: creat d4/d20/f45 x:0 0 0 2024-09-19T06:40:27.570 INFO:tasks.workunit.client.1.smithi117.stdout:4/223: link d3/db/d23/c38 d3/db/d20/d35/c55 0 2024-09-19T06:40:27.570 INFO:tasks.workunit.client.1.smithi117.stdout:7/215: dread d1/d8/d24/d1c/f28 [0,4194304] 0 2024-09-19T06:40:27.571 INFO:tasks.workunit.client.1.smithi117.stdout:5/204: symlink d17/d1b/d3a/d3c/d46/l47 0 2024-09-19T06:40:27.572 INFO:tasks.workunit.client.1.smithi117.stdout:9/214: truncate f0 618893 0 2024-09-19T06:40:27.573 INFO:tasks.workunit.client.1.smithi117.stdout:7/216: fdatasync d1/d8/d24/f3a 0 2024-09-19T06:40:27.574 INFO:tasks.workunit.client.1.smithi117.stdout:7/217: write d1/d8/f2c [468179,19011] 0 2024-09-19T06:40:27.574 INFO:tasks.workunit.client.1.smithi117.stdout:2/190: link d0/d7/d1e/d20/d3e/f4a d0/d12/d32/f4f 0 2024-09-19T06:40:27.575 INFO:tasks.workunit.client.1.smithi117.stdout:5/205: rename d17/d1b/f40 to d17/d1b/f48 0 2024-09-19T06:40:27.576 INFO:tasks.workunit.client.1.smithi117.stdout:2/191: readlink d0/d7/d1e/l25 0 2024-09-19T06:40:27.576 INFO:tasks.workunit.client.1.smithi117.stdout:9/215: dread d4/d1c/f35 [0,4194304] 0 2024-09-19T06:40:27.577 INFO:tasks.workunit.client.1.smithi117.stdout:2/192: read d0/d7/d29/d35/d3d/f43 [3263726,93766] 0 2024-09-19T06:40:27.577 INFO:tasks.workunit.client.1.smithi117.stdout:4/224: rename d3/db/f1f to d3/d4/d14/f56 0 2024-09-19T06:40:27.577 INFO:tasks.workunit.client.1.smithi117.stdout:7/218: mknod d1/d8/d24/d49/c51 0 2024-09-19T06:40:27.579 INFO:tasks.workunit.client.1.smithi117.stdout:9/216: mkdir d4/d1c/d46 0 2024-09-19T06:40:27.580 INFO:tasks.workunit.client.1.smithi117.stdout:4/225: creat d3/db/d23/f57 x:0 0 0 2024-09-19T06:40:27.581 INFO:tasks.workunit.client.1.smithi117.stdout:2/193: creat d0/d7/d1e/d20/d3e/f50 x:0 0 0 2024-09-19T06:40:27.581 INFO:tasks.workunit.client.1.smithi117.stdout:9/217: truncate d4/d1c/f35 4373924 0 2024-09-19T06:40:27.582 INFO:tasks.workunit.client.1.smithi117.stdout:7/219: creat d1/d8/d24/d49/f52 x:0 0 0 2024-09-19T06:40:27.583 INFO:tasks.workunit.client.1.smithi117.stdout:2/194: fsync d0/ff 0 2024-09-19T06:40:27.585 INFO:tasks.workunit.client.1.smithi117.stdout:5/206: dwrite d17/f26 [0,4194304] 0 2024-09-19T06:40:27.587 INFO:tasks.workunit.client.1.smithi117.stdout:9/218: fsync d4/d20/f45 0 2024-09-19T06:40:27.587 INFO:tasks.workunit.client.1.smithi117.stdout:7/220: mknod d1/d8/d24/d1c/d35/c53 0 2024-09-19T06:40:27.588 INFO:tasks.workunit.client.1.smithi117.stdout:2/195: fsync d0/f2a 0 2024-09-19T06:40:27.589 INFO:tasks.workunit.client.1.smithi117.stdout:7/221: chown d1/d8/d24/d26/d44 934 1 2024-09-19T06:40:27.594 INFO:tasks.workunit.client.1.smithi117.stdout:7/222: creat d1/d8/f54 x:0 0 0 2024-09-19T06:40:27.595 INFO:tasks.workunit.client.1.smithi117.stdout:2/196: fsync d0/d7/d1e/d20/f44 0 2024-09-19T06:40:27.598 INFO:tasks.workunit.client.1.smithi117.stdout:5/207: dwrite d17/f41 [0,4194304] 0 2024-09-19T06:40:27.601 INFO:tasks.workunit.client.1.smithi117.stdout:4/226: dwrite d3/db/d23/f54 [0,4194304] 0 2024-09-19T06:40:27.601 INFO:tasks.workunit.client.1.smithi117.stdout:7/223: mkdir d1/d8/d24/d1c/d55 0 2024-09-19T06:40:27.602 INFO:tasks.workunit.client.1.smithi117.stdout:9/219: dwrite d4/d8/fb [0,4194304] 0 2024-09-19T06:40:27.602 INFO:tasks.workunit.client.1.smithi117.stdout:5/208: mkdir d17/d2e/d49 0 2024-09-19T06:40:27.605 INFO:tasks.workunit.client.1.smithi117.stdout:2/197: getdents d0/d12/d32 0 2024-09-19T06:40:27.607 INFO:tasks.workunit.client.1.smithi117.stdout:4/227: unlink d3/db/d20/d29/l2e 0 2024-09-19T06:40:27.612 INFO:tasks.workunit.client.1.smithi117.stdout:5/209: creat d17/d1b/d3a/d3c/d46/f4a x:0 0 0 2024-09-19T06:40:27.613 INFO:tasks.workunit.client.1.smithi117.stdout:4/228: mknod d3/d4/c58 0 2024-09-19T06:40:27.615 INFO:tasks.workunit.client.1.smithi117.stdout:7/224: rename d1/l4 to d1/d8/d24/d1c/d35/d4f/l56 0 2024-09-19T06:40:27.616 INFO:tasks.workunit.client.1.smithi117.stdout:7/225: write d1/d3f/f4d [551391,63463] 0 2024-09-19T06:40:27.617 INFO:tasks.workunit.client.1.smithi117.stdout:4/229: mknod d3/d28/d2a/c59 0 2024-09-19T06:40:27.617 INFO:tasks.workunit.client.1.smithi117.stdout:7/226: read d1/d8/f2a [260546,60450] 0 2024-09-19T06:40:27.618 INFO:tasks.workunit.client.0.smithi099.stdout:9/1: sync 2024-09-19T06:40:27.618 INFO:tasks.workunit.client.0.smithi099.stdout:9/2: dwrite - no filename 2024-09-19T06:40:27.619 INFO:tasks.workunit.client.0.smithi099.stdout:9/3: read - no filename 2024-09-19T06:40:27.619 INFO:tasks.workunit.client.0.smithi099.stdout:9/4: stat - no entries 2024-09-19T06:40:27.619 INFO:tasks.workunit.client.0.smithi099.stdout:9/5: truncate - no filename 2024-09-19T06:40:27.619 INFO:tasks.workunit.client.0.smithi099.stdout:9/6: write - no filename 2024-09-19T06:40:27.619 INFO:tasks.workunit.client.1.smithi117.stdout:2/198: rename d0/f1b to d0/d12/d2f/f51 0 2024-09-19T06:40:27.619 INFO:tasks.workunit.client.1.smithi117.stdout:9/220: dread f0 [0,4194304] 0 2024-09-19T06:40:27.621 INFO:tasks.workunit.client.0.smithi099.stdout:9/7: symlink l0 0 2024-09-19T06:40:27.623 INFO:tasks.workunit.client.0.smithi099.stdout:9/8: mknod c1 0 2024-09-19T06:40:27.624 INFO:tasks.workunit.client.1.smithi117.stdout:2/199: read - d0/d7/d1e/d20/d3e/f4a zero size 2024-09-19T06:40:27.628 INFO:tasks.workunit.client.1.smithi117.stdout:2/200: symlink d0/d12/d32/l52 0 2024-09-19T06:40:27.630 INFO:tasks.workunit.client.1.smithi117.stdout:7/227: dwrite d1/d8/d24/d49/f52 [0,4194304] 0 2024-09-19T06:40:27.630 INFO:tasks.workunit.client.1.smithi117.stdout:4/230: dwrite d3/db/d20/d29/f31 [0,4194304] 0 2024-09-19T06:40:27.635 INFO:tasks.workunit.client.1.smithi117.stdout:7/228: fdatasync d1/f50 0 2024-09-19T06:40:27.636 INFO:tasks.workunit.client.1.smithi117.stdout:4/231: creat d3/d1b/f5a x:0 0 0 2024-09-19T06:40:27.637 INFO:tasks.workunit.client.0.smithi099.stdout:9/9: getdents . 0 2024-09-19T06:40:27.639 INFO:tasks.workunit.client.1.smithi117.stdout:7/229: creat d1/d3f/f57 x:0 0 0 2024-09-19T06:40:27.639 INFO:tasks.workunit.client.1.smithi117.stdout:2/201: dread d0/d7/f8 [0,4194304] 0 2024-09-19T06:40:27.640 INFO:tasks.workunit.client.0.smithi099.stdout:9/10: rename c1 to c2 0 2024-09-19T06:40:27.640 INFO:tasks.workunit.client.0.smithi099.stdout:9/11: readlink l0 0 2024-09-19T06:40:27.641 INFO:tasks.workunit.client.1.smithi117.stdout:2/202: write d0/d7/d1e/d20/d3e/f50 [18947,113033] 0 2024-09-19T06:40:27.642 INFO:tasks.workunit.client.1.smithi117.stdout:7/230: dread - d1/f1e zero size 2024-09-19T06:40:27.646 INFO:tasks.workunit.client.1.smithi117.stdout:2/203: link d0/d12/d2f/f51 d0/d7/d29/f53 0 2024-09-19T06:40:27.647 INFO:tasks.workunit.client.1.smithi117.stdout:2/204: dread - d0/d12/d2f/f45 zero size 2024-09-19T06:40:27.647 INFO:tasks.workunit.client.1.smithi117.stdout:2/205: fdatasync d0/d12/d32/f4b 0 2024-09-19T06:40:27.649 INFO:tasks.workunit.client.1.smithi117.stdout:2/206: mknod d0/d7/c54 0 2024-09-19T06:40:27.651 INFO:tasks.workunit.client.1.smithi117.stdout:2/207: truncate d0/d12/d2f/f40 537581 0 2024-09-19T06:40:27.651 INFO:tasks.workunit.client.1.smithi117.stdout:4/232: truncate d3/de/f10 2477822 0 2024-09-19T06:40:27.653 INFO:tasks.workunit.client.1.smithi117.stdout:4/233: mknod d3/db/d13/c5b 0 2024-09-19T06:40:27.653 INFO:tasks.workunit.client.0.smithi099.stdout:9/12: link c2 c3 0 2024-09-19T06:40:27.654 INFO:tasks.workunit.client.0.smithi099.stdout:9/13: truncate - no filename 2024-09-19T06:40:27.654 INFO:tasks.workunit.client.0.smithi099.stdout:9/14: dread - no filename 2024-09-19T06:40:27.654 INFO:tasks.workunit.client.0.smithi099.stdout:9/15: rmdir - no directory 2024-09-19T06:40:27.654 INFO:tasks.workunit.client.1.smithi117.stdout:4/234: fdatasync d3/db/d23/f57 0 2024-09-19T06:40:27.654 INFO:tasks.workunit.client.1.smithi117.stdout:2/208: creat d0/d7/f55 x:0 0 0 2024-09-19T06:40:27.655 INFO:tasks.workunit.client.1.smithi117.stdout:9/221: dread d4/d1c/f1f [0,4194304] 0 2024-09-19T06:40:27.655 INFO:tasks.workunit.client.1.smithi117.stdout:7/231: write d1/d8/d24/f20 [4148090,120544] 0 2024-09-19T06:40:27.656 INFO:tasks.workunit.client.1.smithi117.stdout:2/209: stat d0/f6 0 2024-09-19T06:40:27.657 INFO:tasks.workunit.client.0.smithi099.stdout:9/16: link c2 c4 0 2024-09-19T06:40:27.658 INFO:tasks.workunit.client.0.smithi099.stdout:9/17: mkdir d5 0 2024-09-19T06:40:27.660 INFO:tasks.workunit.client.1.smithi117.stdout:7/232: creat d1/d8/f58 x:0 0 0 2024-09-19T06:40:27.661 INFO:tasks.workunit.client.0.smithi099.stdout:9/18: rmdir d5 0 2024-09-19T06:40:27.661 INFO:tasks.workunit.client.0.smithi099.stdout:9/19: truncate - no filename 2024-09-19T06:40:27.662 INFO:tasks.workunit.client.1.smithi117.stdout:4/235: creat d3/db/f5c x:0 0 0 2024-09-19T06:40:27.662 INFO:tasks.workunit.client.1.smithi117.stdout:9/222: dread d4/d1c/f1f [0,4194304] 0 2024-09-19T06:40:27.662 INFO:tasks.workunit.client.1.smithi117.stdout:7/233: write d1/d8/f1a [3089358,9593] 0 2024-09-19T06:40:27.662 INFO:tasks.workunit.client.1.smithi117.stdout:2/210: mknod d0/d7/c56 0 2024-09-19T06:40:27.663 INFO:tasks.workunit.client.1.smithi117.stdout:9/223: read - d4/d18/f3c zero size 2024-09-19T06:40:27.663 INFO:tasks.workunit.client.1.smithi117.stdout:2/211: write d0/ff [205311,25068] 0 2024-09-19T06:40:27.663 INFO:tasks.workunit.client.0.smithi099.stdout:9/20: rename c3 to c6 0 2024-09-19T06:40:27.664 INFO:tasks.workunit.client.0.smithi099.stdout:9/21: dread - no filename 2024-09-19T06:40:27.664 INFO:tasks.workunit.client.0.smithi099.stdout:9/22: write - no filename 2024-09-19T06:40:27.664 INFO:tasks.workunit.client.0.smithi099.stdout:9/23: dwrite - no filename 2024-09-19T06:40:27.664 INFO:tasks.workunit.client.1.smithi117.stdout:4/236: creat d3/db/d20/d35/d45/f5d x:0 0 0 2024-09-19T06:40:27.665 INFO:tasks.workunit.client.1.smithi117.stdout:9/224: creat d4/d1c/d46/f47 x:0 0 0 2024-09-19T06:40:27.666 INFO:tasks.workunit.client.0.smithi099.stdout:9/24: link l0 l7 0 2024-09-19T06:40:27.666 INFO:tasks.workunit.client.0.smithi099.stdout:9/25: fsync - no filename 2024-09-19T06:40:27.666 INFO:tasks.workunit.client.1.smithi117.stdout:2/212: creat d0/d7/d29/d35/d3d/f57 x:0 0 0 2024-09-19T06:40:27.667 INFO:tasks.workunit.client.1.smithi117.stdout:7/234: getdents d1/d8/d24/d1c/d55 0 2024-09-19T06:40:27.667 INFO:tasks.workunit.client.1.smithi117.stdout:4/237: unlink d3/db/d20/d29/d39/f53 0 2024-09-19T06:40:27.668 INFO:tasks.workunit.client.0.smithi099.stdout:9/26: chown c4 11613587 1 2024-09-19T06:40:27.668 INFO:tasks.workunit.client.1.smithi117.stdout:2/213: rmdir d0/d12/d32 39 2024-09-19T06:40:27.669 INFO:tasks.workunit.client.1.smithi117.stdout:4/238: creat d3/d28/d2a/f5e x:0 0 0 2024-09-19T06:40:27.670 INFO:tasks.workunit.client.1.smithi117.stdout:9/225: dread d4/f24 [0,4194304] 0 2024-09-19T06:40:27.670 INFO:tasks.workunit.client.1.smithi117.stdout:7/235: creat d1/d8/d24/d1c/d55/f59 x:0 0 0 2024-09-19T06:40:27.671 INFO:tasks.workunit.client.0.smithi099.stdout:9/27: link l0 l8 0 2024-09-19T06:40:27.671 INFO:tasks.workunit.client.0.smithi099.stdout:9/28: fsync - no filename 2024-09-19T06:40:27.672 INFO:tasks.workunit.client.1.smithi117.stdout:4/239: readlink d3/d28/l34 0 2024-09-19T06:40:27.672 INFO:tasks.workunit.client.1.smithi117.stdout:4/240: dread - d3/db/f5c zero size 2024-09-19T06:40:27.672 INFO:tasks.workunit.client.1.smithi117.stdout:2/214: mkdir d0/d7/d58 0 2024-09-19T06:40:27.672 INFO:tasks.workunit.client.1.smithi117.stdout:7/236: readlink d1/l43 0 2024-09-19T06:40:27.672 INFO:tasks.workunit.client.1.smithi117.stdout:9/226: creat d4/d1c/f48 x:0 0 0 2024-09-19T06:40:27.673 INFO:tasks.workunit.client.0.smithi099.stdout:9/29: creat f9 x:0 0 0 2024-09-19T06:40:27.673 INFO:tasks.workunit.client.0.smithi099.stdout:9/30: dread - f9 zero size 2024-09-19T06:40:27.673 INFO:tasks.workunit.client.1.smithi117.stdout:7/237: readlink d1/l12 0 2024-09-19T06:40:27.673 INFO:tasks.workunit.client.1.smithi117.stdout:2/215: symlink d0/l59 0 2024-09-19T06:40:27.674 INFO:tasks.workunit.client.1.smithi117.stdout:9/227: creat d4/d1c/d46/f49 x:0 0 0 2024-09-19T06:40:27.675 INFO:tasks.workunit.client.0.smithi099.stdout:9/31: rename f9 to fa 0 2024-09-19T06:40:27.676 INFO:tasks.workunit.client.1.smithi117.stdout:7/238: dread d1/d8/f2c [0,4194304] 0 2024-09-19T06:40:27.676 INFO:tasks.workunit.client.1.smithi117.stdout:9/228: symlink d4/l4a 0 2024-09-19T06:40:27.677 INFO:tasks.workunit.client.0.smithi099.stdout:9/32: chown l0 169 1 2024-09-19T06:40:27.678 INFO:tasks.workunit.client.1.smithi117.stdout:2/216: getdents d0/d7/d1e/d20 0 2024-09-19T06:40:27.678 INFO:tasks.workunit.client.0.smithi099.stdout:9/33: creat fb x:0 0 0 2024-09-19T06:40:27.679 INFO:tasks.workunit.client.1.smithi117.stdout:7/239: symlink d1/d8/d24/d26/l5a 0 2024-09-19T06:40:27.679 INFO:tasks.workunit.client.0.smithi099.stdout:9/34: dread - fb zero size 2024-09-19T06:40:27.680 INFO:tasks.workunit.client.1.smithi117.stdout:9/229: symlink d4/l4b 0 2024-09-19T06:40:27.680 INFO:tasks.workunit.client.0.smithi099.stdout:9/35: truncate fb 161327 0 2024-09-19T06:40:27.681 INFO:tasks.workunit.client.0.smithi099.stdout:9/36: symlink lc 0 2024-09-19T06:40:27.682 INFO:tasks.workunit.client.1.smithi117.stdout:7/240: creat d1/d8/d24/d1c/d35/d4f/f5b x:0 0 0 2024-09-19T06:40:27.683 INFO:tasks.workunit.client.0.smithi099.stdout:9/37: mkdir dd 0 2024-09-19T06:40:27.684 INFO:tasks.workunit.client.1.smithi117.stdout:9/230: symlink d4/d8/l4c 0 2024-09-19T06:40:27.684 INFO:tasks.workunit.client.0.smithi099.stdout:9/38: read fb [116114,65326] 0 2024-09-19T06:40:27.685 INFO:tasks.workunit.client.1.smithi117.stdout:2/217: dwrite d0/d7/d1e/d20/f44 [0,4194304] 0 2024-09-19T06:40:27.686 INFO:tasks.workunit.client.0.smithi099.stdout:9/39: write fa [523043,30884] 0 2024-09-19T06:40:27.689 INFO:tasks.workunit.client.0.smithi099.stdout:9/40: creat dd/fe x:0 0 0 2024-09-19T06:40:27.689 INFO:tasks.workunit.client.0.smithi099.stdout:1/15: sync 2024-09-19T06:40:27.691 INFO:tasks.workunit.client.0.smithi099.stdout:1/16: mknod d0/c4 0 2024-09-19T06:40:27.692 INFO:tasks.workunit.client.0.smithi099.stdout:1/17: chown d0 726387596 1 2024-09-19T06:40:27.692 INFO:tasks.workunit.client.0.smithi099.stdout:9/41: mkdir dd/df 0 2024-09-19T06:40:27.693 INFO:tasks.workunit.client.1.smithi117.stdout:9/231: dwrite d4/d18/f3c [0,4194304] 0 2024-09-19T06:40:27.696 INFO:tasks.workunit.client.0.smithi099.stdout:1/18: creat d0/f5 x:0 0 0 2024-09-19T06:40:27.697 INFO:tasks.workunit.client.0.smithi099.stdout:1/19: write d0/f5 [595964,51511] 0 2024-09-19T06:40:27.697 INFO:tasks.workunit.client.0.smithi099.stdout:1/20: stat d0 0 2024-09-19T06:40:27.698 INFO:tasks.workunit.client.0.smithi099.stdout:9/42: chown c4 3 1 2024-09-19T06:40:27.699 INFO:tasks.workunit.client.0.smithi099.stdout:1/21: write d0/f5 [1191019,89312] 0 2024-09-19T06:40:27.699 INFO:tasks.workunit.client.0.smithi099.stdout:1/22: chown d0/f5 18780265 1 2024-09-19T06:40:27.707 INFO:tasks.workunit.client.0.smithi099.stdout:9/43: dwrite dd/fe [0,4194304] 0 2024-09-19T06:40:27.708 INFO:tasks.workunit.client.1.smithi117.stdout:2/218: write d0/d7/d1e/d20/d3e/f4a [630685,26476] 0 2024-09-19T06:40:27.712 INFO:tasks.workunit.client.1.smithi117.stdout:2/219: mknod d0/d7/d29/d35/d3d/c5a 0 2024-09-19T06:40:27.713 INFO:tasks.workunit.client.0.smithi099.stdout:9/44: dread dd/fe [0,4194304] 0 2024-09-19T06:40:27.713 INFO:tasks.workunit.client.1.smithi117.stdout:7/241: dwrite d1/d8/d24/d1c/f28 [0,4194304] 0 2024-09-19T06:40:27.714 INFO:tasks.workunit.client.1.smithi117.stdout:2/220: write d0/d7/f55 [362076,124589] 0 2024-09-19T06:40:27.715 INFO:tasks.workunit.client.0.smithi099.stdout:1/23: rmdir d0 39 2024-09-19T06:40:27.716 INFO:tasks.workunit.client.1.smithi117.stdout:7/242: read d1/d8/d24/d1c/f22 [393839,35442] 0 2024-09-19T06:40:27.717 INFO:tasks.workunit.client.1.smithi117.stdout:7/243: write d1/f1e [457863,30227] 0 2024-09-19T06:40:27.718 INFO:tasks.workunit.client.0.smithi099.stdout:1/24: write d0/f5 [1374509,116865] 0 2024-09-19T06:40:27.719 INFO:tasks.workunit.client.1.smithi117.stdout:2/221: mknod d0/d7/d1e/c5b 0 2024-09-19T06:40:27.720 INFO:tasks.workunit.client.0.smithi099.stdout:9/45: rmdir dd/df 0 2024-09-19T06:40:27.720 INFO:tasks.workunit.client.0.smithi099.stdout:9/46: chown dd 18822 1 2024-09-19T06:40:27.722 INFO:tasks.workunit.client.0.smithi099.stdout:1/25: chown d0/l3 9 1 2024-09-19T06:40:27.722 INFO:tasks.workunit.client.0.smithi099.stdout:9/47: truncate dd/fe 4419857 0 2024-09-19T06:40:27.722 INFO:tasks.workunit.client.0.smithi099.stdout:1/26: chown d0 1240793 1 2024-09-19T06:40:27.722 INFO:tasks.workunit.client.1.smithi117.stdout:2/222: symlink d0/d7/d58/l5c 0 2024-09-19T06:40:27.723 INFO:tasks.workunit.client.0.smithi099.stdout:1/27: write d0/f5 [2530161,95532] 0 2024-09-19T06:40:27.723 INFO:tasks.workunit.client.0.smithi099.stdout:9/48: stat l0 0 2024-09-19T06:40:27.724 INFO:tasks.workunit.client.0.smithi099.stdout:1/28: chown d0/c4 6 1 2024-09-19T06:40:27.726 INFO:tasks.workunit.client.0.smithi099.stdout:1/29: creat d0/f6 x:0 0 0 2024-09-19T06:40:27.727 INFO:tasks.workunit.client.0.smithi099.stdout:1/30: rename d0 to d0/d7 22 2024-09-19T06:40:27.729 INFO:tasks.workunit.client.0.smithi099.stdout:1/31: creat d0/f8 x:0 0 0 2024-09-19T06:40:27.731 INFO:tasks.workunit.client.0.smithi099.stdout:9/49: dwrite fa [0,4194304] 0 2024-09-19T06:40:27.735 INFO:tasks.workunit.client.0.smithi099.stdout:9/50: getdents dd 0 2024-09-19T06:40:27.737 INFO:tasks.workunit.client.0.smithi099.stdout:9/51: mkdir dd/d10 0 2024-09-19T06:40:27.741 INFO:tasks.workunit.client.0.smithi099.stdout:1/32: dread d0/f5 [0,4194304] 0 2024-09-19T06:40:27.741 INFO:tasks.workunit.client.0.smithi099.stdout:1/33: chown d0/l3 0 1 2024-09-19T06:40:27.743 INFO:tasks.workunit.client.0.smithi099.stdout:1/34: creat d0/f9 x:0 0 0 2024-09-19T06:40:27.745 INFO:tasks.workunit.client.0.smithi099.stdout:1/35: write d0/f5 [2763266,12260] 0 2024-09-19T06:40:27.747 INFO:tasks.workunit.client.0.smithi099.stdout:1/36: mkdir d0/da 0 2024-09-19T06:40:27.747 INFO:tasks.workunit.client.0.smithi099.stdout:9/52: fsync dd/fe 0 2024-09-19T06:40:27.747 INFO:tasks.workunit.client.0.smithi099.stdout:1/37: read - d0/f9 zero size 2024-09-19T06:40:27.748 INFO:tasks.workunit.client.1.smithi117.stdout:2/223: dread d0/ff [0,4194304] 0 2024-09-19T06:40:27.749 INFO:tasks.workunit.client.1.smithi117.stdout:2/224: stat d0/l26 0 2024-09-19T06:40:27.749 INFO:tasks.workunit.client.0.smithi099.stdout:9/53: dread fb [0,4194304] 0 2024-09-19T06:40:27.749 INFO:tasks.workunit.client.0.smithi099.stdout:1/38: mkdir d0/db 0 2024-09-19T06:40:27.750 INFO:tasks.workunit.client.1.smithi117.stdout:2/225: truncate d0/d7/d29/d35/d3d/f57 827190 0 2024-09-19T06:40:27.751 INFO:tasks.workunit.client.0.smithi099.stdout:1/39: creat d0/da/fc x:0 0 0 2024-09-19T06:40:27.752 INFO:tasks.workunit.client.0.smithi099.stdout:1/40: write d0/f8 [517444,122336] 0 2024-09-19T06:40:27.752 INFO:tasks.workunit.client.0.smithi099.stdout:9/54: write fb [17961,56180] 0 2024-09-19T06:40:27.753 INFO:tasks.workunit.client.0.smithi099.stdout:9/55: read fb [87511,36422] 0 2024-09-19T06:40:27.755 INFO:tasks.workunit.client.0.smithi099.stdout:9/56: creat dd/d10/f11 x:0 0 0 2024-09-19T06:40:27.755 INFO:tasks.workunit.client.0.smithi099.stdout:9/57: chown l8 690 1 2024-09-19T06:40:27.757 INFO:tasks.workunit.client.0.smithi099.stdout:9/58: getdents dd 0 2024-09-19T06:40:27.758 INFO:tasks.workunit.client.0.smithi099.stdout:9/59: write fb [603296,86164] 0 2024-09-19T06:40:27.759 INFO:tasks.workunit.client.0.smithi099.stdout:9/60: write fb [885251,44193] 0 2024-09-19T06:40:27.760 INFO:tasks.workunit.client.0.smithi099.stdout:9/61: write fb [109774,72772] 0 2024-09-19T06:40:27.765 INFO:tasks.workunit.client.0.smithi099.stdout:9/62: dwrite fa [0,4194304] 0 2024-09-19T06:40:27.767 INFO:tasks.workunit.client.0.smithi099.stdout:9/63: mknod dd/d10/c12 0 2024-09-19T06:40:27.768 INFO:tasks.workunit.client.0.smithi099.stdout:9/64: mkdir dd/d10/d13 0 2024-09-19T06:40:27.774 INFO:tasks.workunit.client.0.smithi099.stdout:9/65: dwrite fa [0,4194304] 0 2024-09-19T06:40:27.775 INFO:tasks.workunit.client.0.smithi099.stdout:9/66: stat dd/fe 0 2024-09-19T06:40:27.779 INFO:tasks.workunit.client.0.smithi099.stdout:9/67: rename c2 to dd/c14 0 2024-09-19T06:40:27.789 INFO:tasks.workunit.client.1.smithi117.stdout:1/102: sync 2024-09-19T06:40:27.791 INFO:tasks.workunit.client.1.smithi117.stdout:1/103: mknod d3/d18/d23/c25 0 2024-09-19T06:40:27.793 INFO:tasks.workunit.client.1.smithi117.stdout:1/104: rename d3/d18/d23/c25 to d3/d22/c26 0 2024-09-19T06:40:27.795 INFO:tasks.workunit.client.1.smithi117.stdout:1/105: symlink d3/d18/d23/l27 0 2024-09-19T06:40:27.797 INFO:tasks.workunit.client.1.smithi117.stdout:1/106: rename d3/fe to d3/d18/d23/f28 0 2024-09-19T06:40:27.799 INFO:tasks.workunit.client.1.smithi117.stdout:1/107: unlink d3/f12 0 2024-09-19T06:40:27.800 INFO:tasks.workunit.client.1.smithi117.stdout:1/108: truncate d3/d18/d23/f28 306475 0 2024-09-19T06:40:27.800 INFO:tasks.workunit.client.1.smithi117.stdout:1/109: chown d3/d18/f24 290326934 1 2024-09-19T06:40:27.804 INFO:tasks.workunit.client.0.smithi099.stdout:9/68: rmdir dd/d10 39 2024-09-19T06:40:27.805 INFO:tasks.workunit.client.1.smithi117.stdout:1/110: getdents d3/d22 0 2024-09-19T06:40:27.806 INFO:tasks.workunit.client.1.smithi117.stdout:1/111: write d3/d18/f1f [326776,48786] 0 2024-09-19T06:40:27.808 INFO:tasks.workunit.client.1.smithi117.stdout:1/112: truncate d3/f1b 5694812 0 2024-09-19T06:40:27.809 INFO:tasks.workunit.client.1.smithi117.stdout:1/113: fsync d3/f5 0 2024-09-19T06:40:27.817 INFO:tasks.workunit.client.1.smithi117.stdout:1/114: truncate d3/d18/f24 506115 0 2024-09-19T06:40:27.818 INFO:tasks.workunit.client.1.smithi117.stdout:1/115: chown d3/f10 29311051 1 2024-09-19T06:40:27.819 INFO:tasks.workunit.client.1.smithi117.stdout:1/116: symlink d3/d22/l29 0 2024-09-19T06:40:27.820 INFO:tasks.workunit.client.1.smithi117.stdout:1/117: read d3/f14 [1650941,15110] 0 2024-09-19T06:40:27.822 INFO:tasks.workunit.client.1.smithi117.stdout:1/118: creat d3/d22/f2a x:0 0 0 2024-09-19T06:40:27.827 INFO:tasks.workunit.client.1.smithi117.stdout:1/119: write d3/d18/f24 [1379669,11182] 0 2024-09-19T06:40:27.829 INFO:tasks.workunit.client.1.smithi117.stdout:1/120: symlink d3/d18/d23/l2b 0 2024-09-19T06:40:27.832 INFO:tasks.workunit.client.1.smithi117.stdout:1/121: rmdir d3/d18 39 2024-09-19T06:40:27.833 INFO:tasks.workunit.client.1.smithi117.stdout:1/122: chown d3/d18/c19 15 1 2024-09-19T06:40:27.839 INFO:tasks.workunit.client.1.smithi117.stdout:1/123: dwrite d3/f1b [0,4194304] 0 2024-09-19T06:40:27.843 INFO:tasks.workunit.client.1.smithi117.stdout:1/124: write f1 [3830356,103947] 0 2024-09-19T06:40:27.844 INFO:tasks.workunit.client.1.smithi117.stdout:1/125: chown d3/d18/f24 2751279 1 2024-09-19T06:40:27.844 INFO:tasks.workunit.client.1.smithi117.stdout:1/126: readlink d3/lc 0 2024-09-19T06:40:27.847 INFO:tasks.workunit.client.1.smithi117.stdout:1/127: dread d3/d18/f1f [0,4194304] 0 2024-09-19T06:40:27.847 INFO:tasks.workunit.client.1.smithi117.stdout:1/128: chown d3/c8 20 1 2024-09-19T06:40:27.849 INFO:tasks.workunit.client.1.smithi117.stdout:1/129: symlink d3/d18/l2c 0 2024-09-19T06:40:27.853 INFO:tasks.workunit.client.0.smithi099.stdout:8/25: sync 2024-09-19T06:40:27.853 INFO:tasks.workunit.client.0.smithi099.stdout:7/74: sync 2024-09-19T06:40:27.854 INFO:tasks.workunit.client.0.smithi099.stdout:6/24: sync 2024-09-19T06:40:27.854 INFO:tasks.workunit.client.0.smithi099.stdout:6/25: truncate - no filename 2024-09-19T06:40:27.854 INFO:tasks.workunit.client.0.smithi099.stdout:0/17: sync 2024-09-19T06:40:27.854 INFO:tasks.workunit.client.0.smithi099.stdout:6/26: truncate - no filename 2024-09-19T06:40:27.854 INFO:tasks.workunit.client.0.smithi099.stdout:6/27: dwrite - no filename 2024-09-19T06:40:27.854 INFO:tasks.workunit.client.0.smithi099.stdout:0/18: readlink - no filename 2024-09-19T06:40:27.854 INFO:tasks.workunit.client.0.smithi099.stdout:3/68: sync 2024-09-19T06:40:27.854 INFO:tasks.workunit.client.0.smithi099.stdout:4/31: sync 2024-09-19T06:40:27.855 INFO:tasks.workunit.client.1.smithi117.stdout:1/130: dwrite d3/f10 [0,4194304] 0 2024-09-19T06:40:27.855 INFO:tasks.workunit.client.0.smithi099.stdout:4/32: dread - fb zero size 2024-09-19T06:40:27.855 INFO:tasks.workunit.client.0.smithi099.stdout:3/69: write f6 [4166707,12326] 0 2024-09-19T06:40:27.855 INFO:tasks.workunit.client.1.smithi117.stdout:1/131: dread - d3/d22/f2a zero size 2024-09-19T06:40:27.859 INFO:tasks.workunit.client.1.smithi117.stdout:1/132: rename d3/fd to d3/d18/d23/f2d 0 2024-09-19T06:40:27.861 INFO:tasks.workunit.client.0.smithi099.stdout:3/70: dwrite d7/fc [0,4194304] 0 2024-09-19T06:40:27.862 INFO:tasks.workunit.client.1.smithi117.stdout:1/133: creat d3/f2e x:0 0 0 2024-09-19T06:40:27.863 INFO:tasks.workunit.client.1.smithi117.stdout:1/134: chown d3/d18/l1a 1598 1 2024-09-19T06:40:27.863 INFO:tasks.workunit.client.1.smithi117.stdout:1/135: chown d3/f5 0 1 2024-09-19T06:40:27.866 INFO:tasks.workunit.client.1.smithi117.stdout:1/136: unlink d3/f1c 0 2024-09-19T06:40:27.868 INFO:tasks.workunit.client.1.smithi117.stdout:1/137: mkdir d3/d22/d2f 0 2024-09-19T06:40:27.870 INFO:tasks.workunit.client.1.smithi117.stdout:1/138: mknod d3/c30 0 2024-09-19T06:40:27.876 INFO:tasks.workunit.client.1.smithi117.stdout:1/139: dwrite d3/f13 [0,4194304] 0 2024-09-19T06:40:27.881 INFO:tasks.workunit.client.1.smithi117.stdout:1/140: rename d3/c7 to d3/d18/d23/c31 0 2024-09-19T06:40:27.882 INFO:tasks.workunit.client.1.smithi117.stdout:1/141: chown d3/d18/f21 5 1 2024-09-19T06:40:27.890 INFO:tasks.workunit.client.1.smithi117.stdout:1/142: fdatasync d3/d18/f24 0 2024-09-19T06:40:27.891 INFO:tasks.workunit.client.1.smithi117.stdout:1/143: fdatasync d3/d18/f24 0 2024-09-19T06:40:27.894 INFO:tasks.workunit.client.1.smithi117.stdout:1/144: rename d3/d18/f21 to d3/f32 0 2024-09-19T06:40:27.894 INFO:tasks.workunit.client.1.smithi117.stdout:1/145: readlink d3/d18/l2c 0 2024-09-19T06:40:27.895 INFO:tasks.workunit.client.1.smithi117.stdout:1/146: creat d3/d22/f33 x:0 0 0 2024-09-19T06:40:27.896 INFO:tasks.workunit.client.1.smithi117.stdout:1/147: stat d3/f13 0 2024-09-19T06:40:27.897 INFO:tasks.workunit.client.1.smithi117.stdout:1/148: creat d3/d18/d23/f34 x:0 0 0 2024-09-19T06:40:27.902 INFO:tasks.workunit.client.1.smithi117.stdout:1/149: dwrite d3/f9 [0,4194304] 0 2024-09-19T06:40:27.908 INFO:tasks.workunit.client.1.smithi117.stdout:1/150: truncate d3/f13 2437084 0 2024-09-19T06:40:27.909 INFO:tasks.workunit.client.1.smithi117.stdout:8/140: sync 2024-09-19T06:40:27.909 INFO:tasks.workunit.client.1.smithi117.stdout:3/152: sync 2024-09-19T06:40:27.909 INFO:tasks.workunit.client.1.smithi117.stdout:0/126: sync 2024-09-19T06:40:27.910 INFO:tasks.workunit.client.1.smithi117.stdout:6/149: sync 2024-09-19T06:40:27.910 INFO:tasks.workunit.client.1.smithi117.stdout:1/151: write d3/f32 [430814,60918] 0 2024-09-19T06:40:27.911 INFO:tasks.workunit.client.1.smithi117.stdout:6/150: write d1/d14/f1a [801995,28343] 0 2024-09-19T06:40:27.911 INFO:tasks.workunit.client.1.smithi117.stdout:0/127: chown ce 1399015939 1 2024-09-19T06:40:27.912 INFO:tasks.workunit.client.1.smithi117.stdout:1/152: fsync d3/f5 0 2024-09-19T06:40:27.912 INFO:tasks.workunit.client.1.smithi117.stdout:3/153: fsync d0/fb 0 2024-09-19T06:40:27.913 INFO:tasks.workunit.client.1.smithi117.stdout:1/153: readlink d3/d18/l2c 0 2024-09-19T06:40:27.913 INFO:tasks.workunit.client.1.smithi117.stdout:0/128: chown fd 1 1 2024-09-19T06:40:27.914 INFO:tasks.workunit.client.1.smithi117.stdout:6/151: write d1/d5/d8/f19 [857876,74305] 0 2024-09-19T06:40:27.916 INFO:tasks.workunit.client.1.smithi117.stdout:1/154: truncate d3/d22/f2a 940825 0 2024-09-19T06:40:27.916 INFO:tasks.workunit.client.1.smithi117.stdout:0/129: symlink d11/d13/d14/l25 0 2024-09-19T06:40:27.917 INFO:tasks.workunit.client.1.smithi117.stdout:1/155: rename d3/d18 to d3/d18/d23/d35 22 2024-09-19T06:40:27.917 INFO:tasks.workunit.client.1.smithi117.stdout:6/152: fdatasync d1/d14/f15 0 2024-09-19T06:40:27.918 INFO:tasks.workunit.client.1.smithi117.stdout:3/154: symlink d0/d19/l26 0 2024-09-19T06:40:27.919 INFO:tasks.workunit.client.1.smithi117.stdout:0/130: truncate d11/d13/d14/d16/f1e 701546 0 2024-09-19T06:40:27.919 INFO:tasks.workunit.client.1.smithi117.stdout:8/141: truncate f12 4138369 0 2024-09-19T06:40:27.920 INFO:tasks.workunit.client.1.smithi117.stdout:3/155: readlink d0/d8/le 0 2024-09-19T06:40:27.921 INFO:tasks.workunit.client.1.smithi117.stdout:1/156: mknod d3/d18/d23/c36 0 2024-09-19T06:40:27.922 INFO:tasks.workunit.client.1.smithi117.stdout:6/153: getdents d1/d3/d25 0 2024-09-19T06:40:27.923 INFO:tasks.workunit.client.1.smithi117.stdout:0/131: creat d11/d13/d14/d16/f26 x:0 0 0 2024-09-19T06:40:27.924 INFO:tasks.workunit.client.1.smithi117.stdout:1/157: symlink d3/d22/d2f/l37 0 2024-09-19T06:40:27.925 INFO:tasks.workunit.client.1.smithi117.stdout:8/142: getdents d1d/d1e 0 2024-09-19T06:40:27.930 INFO:tasks.workunit.client.1.smithi117.stdout:1/158: creat d3/f38 x:0 0 0 2024-09-19T06:40:27.932 INFO:tasks.workunit.client.1.smithi117.stdout:1/159: readlink d3/lb 0 2024-09-19T06:40:27.933 INFO:tasks.workunit.client.1.smithi117.stdout:6/154: dwrite d1/d3/f12 [0,4194304] 0 2024-09-19T06:40:27.935 INFO:tasks.workunit.client.0.smithi099.stdout:2/9: sync 2024-09-19T06:40:27.935 INFO:tasks.workunit.client.0.smithi099.stdout:1/41: sync 2024-09-19T06:40:27.935 INFO:tasks.workunit.client.0.smithi099.stdout:5/82: sync 2024-09-19T06:40:27.936 INFO:tasks.workunit.client.0.smithi099.stdout:1/42: dread - d0/f6 zero size 2024-09-19T06:40:27.937 INFO:tasks.workunit.client.0.smithi099.stdout:5/83: truncate d3/d7/f11 4249776 0 2024-09-19T06:40:27.938 INFO:tasks.workunit.client.1.smithi117.stdout:1/160: mknod d3/d18/d23/c39 0 2024-09-19T06:40:27.938 INFO:tasks.workunit.client.1.smithi117.stdout:6/155: symlink d1/l26 0 2024-09-19T06:40:27.939 INFO:tasks.workunit.client.1.smithi117.stdout:0/132: dwrite d11/d13/d14/f1d [4194304,4194304] 0 2024-09-19T06:40:27.941 INFO:tasks.workunit.client.1.smithi117.stdout:0/133: chown f0 114641 1 2024-09-19T06:40:27.942 INFO:tasks.workunit.client.1.smithi117.stdout:8/143: dwrite f3 [4194304,4194304] 0 2024-09-19T06:40:27.943 INFO:tasks.workunit.client.1.smithi117.stdout:3/156: dread d0/f1 [4194304,4194304] 0 2024-09-19T06:40:27.948 INFO:tasks.workunit.client.0.smithi099.stdout:8/26: creat d4/f6 x:0 0 0 2024-09-19T06:40:27.952 INFO:tasks.workunit.client.0.smithi099.stdout:3/71: rename d7/cb to d7/ce 0 2024-09-19T06:40:27.953 INFO:tasks.workunit.client.1.smithi117.stdout:0/134: dread d11/d13/d14/d16/f1e [0,4194304] 0 2024-09-19T06:40:27.954 INFO:tasks.workunit.client.0.smithi099.stdout:2/10: symlink d1/l4 0 2024-09-19T06:40:27.954 INFO:tasks.workunit.client.1.smithi117.stdout:6/156: dwrite d1/d3/f17 [0,4194304] 0 2024-09-19T06:40:27.954 INFO:tasks.workunit.client.1.smithi117.stdout:1/161: dread d3/f14 [0,4194304] 0 2024-09-19T06:40:27.955 INFO:tasks.workunit.client.0.smithi099.stdout:7/75: link d7/fa d7/f20 0 2024-09-19T06:40:27.955 INFO:tasks.workunit.client.0.smithi099.stdout:9/69: dwrite dd/d10/f11 [0,4194304] 0 2024-09-19T06:40:27.957 INFO:tasks.workunit.client.0.smithi099.stdout:9/70: write dd/fe [1841746,28686] 0 2024-09-19T06:40:27.957 INFO:tasks.workunit.client.0.smithi099.stdout:8/27: mknod d4/c7 0 2024-09-19T06:40:27.958 INFO:tasks.workunit.client.0.smithi099.stdout:8/28: fsync f3 0 2024-09-19T06:40:27.959 INFO:tasks.workunit.client.0.smithi099.stdout:5/84: mkdir d3/d1f 0 2024-09-19T06:40:27.959 INFO:tasks.workunit.client.0.smithi099.stdout:5/85: chown d3/l19 6 1 2024-09-19T06:40:27.960 INFO:tasks.workunit.client.1.smithi117.stdout:1/162: write d3/f32 [6079,68759] 0 2024-09-19T06:40:27.961 INFO:tasks.workunit.client.1.smithi117.stdout:0/135: mkdir d11/d13/d1b/d27 0 2024-09-19T06:40:27.962 INFO:tasks.workunit.client.0.smithi099.stdout:5/86: write d3/d7/f1c [625495,113100] 0 2024-09-19T06:40:27.962 INFO:tasks.workunit.client.1.smithi117.stdout:3/157: dwrite d0/f1e [0,4194304] 0 2024-09-19T06:40:27.962 INFO:tasks.workunit.client.0.smithi099.stdout:7/76: rmdir d7/dd 39 2024-09-19T06:40:27.963 INFO:tasks.workunit.client.1.smithi117.stdout:0/136: dread - d11/d13/f22 zero size 2024-09-19T06:40:27.964 INFO:tasks.workunit.client.1.smithi117.stdout:6/157: mkdir d1/d5/d8/d27 0 2024-09-19T06:40:27.965 INFO:tasks.workunit.client.1.smithi117.stdout:8/144: dwrite f11 [0,4194304] 0 2024-09-19T06:40:27.968 INFO:tasks.workunit.client.0.smithi099.stdout:8/29: creat d4/f8 x:0 0 0 2024-09-19T06:40:27.968 INFO:tasks.workunit.client.0.smithi099.stdout:2/11: mkdir d1/d2/d5 0 2024-09-19T06:40:27.969 INFO:tasks.workunit.client.0.smithi099.stdout:4/33: link cc cd 0 2024-09-19T06:40:27.969 INFO:tasks.workunit.client.1.smithi117.stdout:0/137: write d11/f19 [2197293,83425] 0 2024-09-19T06:40:27.969 INFO:tasks.workunit.client.1.smithi117.stdout:6/158: rename d1 to d1/d5/d28 22 2024-09-19T06:40:27.971 INFO:tasks.workunit.client.0.smithi099.stdout:2/12: unlink d1/c3 0 2024-09-19T06:40:27.973 INFO:tasks.workunit.client.0.smithi099.stdout:7/77: dread f1 [0,4194304] 0 2024-09-19T06:40:27.973 INFO:tasks.workunit.client.0.smithi099.stdout:7/78: dread - f2 zero size 2024-09-19T06:40:27.975 INFO:tasks.workunit.client.1.smithi117.stdout:8/145: dread - d1d/d1e/f1f zero size 2024-09-19T06:40:27.975 INFO:tasks.workunit.client.0.smithi099.stdout:4/34: mknod ce 0 2024-09-19T06:40:27.976 INFO:tasks.workunit.client.1.smithi117.stdout:3/158: mknod d0/c27 0 2024-09-19T06:40:27.977 INFO:tasks.workunit.client.1.smithi117.stdout:6/159: stat d1/f18 0 2024-09-19T06:40:27.977 INFO:tasks.workunit.client.0.smithi099.stdout:5/87: creat d3/d1f/f20 x:0 0 0 2024-09-19T06:40:27.978 INFO:tasks.workunit.client.0.smithi099.stdout:5/88: chown d3/cc 1 1 2024-09-19T06:40:27.978 INFO:tasks.workunit.client.0.smithi099.stdout:4/35: creat ff x:0 0 0 2024-09-19T06:40:27.979 INFO:tasks.workunit.client.1.smithi117.stdout:6/160: dread - d1/d3/f20 zero size 2024-09-19T06:40:27.979 INFO:tasks.workunit.client.1.smithi117.stdout:0/138: dread d11/d13/d14/d16/f1e [0,4194304] 0 2024-09-19T06:40:27.979 INFO:tasks.workunit.client.0.smithi099.stdout:2/13: dread f0 [0,4194304] 0 2024-09-19T06:40:27.980 INFO:tasks.workunit.client.1.smithi117.stdout:3/159: creat d0/d9/d1c/f28 x:0 0 0 2024-09-19T06:40:27.980 INFO:tasks.workunit.client.0.smithi099.stdout:5/89: fdatasync d3/d1f/f20 0 2024-09-19T06:40:27.980 INFO:tasks.workunit.client.0.smithi099.stdout:9/71: rename c4 to dd/c15 0 2024-09-19T06:40:27.981 INFO:tasks.workunit.client.0.smithi099.stdout:4/36: read - ff zero size 2024-09-19T06:40:27.981 INFO:tasks.workunit.client.1.smithi117.stdout:1/163: dwrite d3/f10 [0,4194304] 0 2024-09-19T06:40:27.981 INFO:tasks.workunit.client.0.smithi099.stdout:7/79: dread f5 [0,4194304] 0 2024-09-19T06:40:27.981 INFO:tasks.workunit.client.0.smithi099.stdout:5/90: chown d3/d14 1 1 2024-09-19T06:40:27.982 INFO:tasks.workunit.client.1.smithi117.stdout:0/139: readlink d11/d13/d1b/l23 0 2024-09-19T06:40:27.982 INFO:tasks.workunit.client.1.smithi117.stdout:0/140: truncate fd 4765403 0 2024-09-19T06:40:27.982 INFO:tasks.workunit.client.0.smithi099.stdout:5/91: stat d3/d16 0 2024-09-19T06:40:27.983 INFO:tasks.workunit.client.0.smithi099.stdout:4/37: truncate fb 931978 0 2024-09-19T06:40:27.983 INFO:tasks.workunit.client.0.smithi099.stdout:2/14: unlink f0 0 2024-09-19T06:40:27.984 INFO:tasks.workunit.client.1.smithi117.stdout:6/161: mknod d1/d14/c29 0 2024-09-19T06:40:27.984 INFO:tasks.workunit.client.1.smithi117.stdout:8/146: creat d1d/f27 x:0 0 0 2024-09-19T06:40:27.987 INFO:tasks.workunit.client.1.smithi117.stdout:6/162: chown d1/d3/f20 6891 1 2024-09-19T06:40:27.988 INFO:tasks.workunit.client.0.smithi099.stdout:4/38: creat f10 x:0 0 0 2024-09-19T06:40:27.988 INFO:tasks.workunit.client.1.smithi117.stdout:0/141: read f0 [492039,121006] 0 2024-09-19T06:40:27.989 INFO:tasks.workunit.client.0.smithi099.stdout:9/72: dwrite dd/d10/f11 [0,4194304] 0 2024-09-19T06:40:27.990 INFO:tasks.workunit.client.0.smithi099.stdout:5/92: write d3/d7/fb [4402134,33784] 0 2024-09-19T06:40:27.991 INFO:tasks.workunit.client.1.smithi117.stdout:1/164: dwrite d3/f2e [0,4194304] 0 2024-09-19T06:40:27.993 INFO:tasks.workunit.client.1.smithi117.stdout:3/160: link d0/d9/c25 d0/d19/c29 0 2024-09-19T06:40:27.993 INFO:tasks.workunit.client.1.smithi117.stdout:0/142: mkdir d11/d13/d28 0 2024-09-19T06:40:27.994 INFO:tasks.workunit.client.0.smithi099.stdout:4/39: creat f11 x:0 0 0 2024-09-19T06:40:27.994 INFO:tasks.workunit.client.1.smithi117.stdout:1/165: chown d3/f38 5 1 2024-09-19T06:40:27.994 INFO:tasks.workunit.client.0.smithi099.stdout:4/40: stat f5 0 2024-09-19T06:40:27.995 INFO:tasks.workunit.client.0.smithi099.stdout:2/15: mkdir d1/d2/d5/d6 0 2024-09-19T06:40:27.997 INFO:tasks.workunit.client.0.smithi099.stdout:2/16: chown d1/d2/d5 12643 1 2024-09-19T06:40:27.997 INFO:tasks.workunit.client.0.smithi099.stdout:5/93: dread d3/d7/f1c [0,4194304] 0 2024-09-19T06:40:27.998 INFO:tasks.workunit.client.1.smithi117.stdout:0/143: write d11/d13/d14/d16/f26 [519234,11991] 0 2024-09-19T06:40:27.999 INFO:tasks.workunit.client.1.smithi117.stdout:1/166: mkdir d3/d18/d23/d3a 0 2024-09-19T06:40:28.001 INFO:tasks.workunit.client.1.smithi117.stdout:8/147: dwrite f8 [0,4194304] 0 2024-09-19T06:40:28.003 INFO:tasks.workunit.client.1.smithi117.stdout:1/167: chown d3/d22/f33 53 1 2024-09-19T06:40:28.003 INFO:tasks.workunit.client.1.smithi117.stdout:8/148: chown ff 398 1 2024-09-19T06:40:28.005 INFO:tasks.workunit.client.1.smithi117.stdout:8/149: chown d1d/f27 15418551 1 2024-09-19T06:40:28.006 INFO:tasks.workunit.client.1.smithi117.stdout:1/168: symlink d3/d18/d23/l3b 0 2024-09-19T06:40:28.006 INFO:tasks.workunit.client.0.smithi099.stdout:2/17: symlink d1/d2/d5/d6/l7 0 2024-09-19T06:40:28.007 INFO:tasks.workunit.client.1.smithi117.stdout:0/144: creat d11/d13/d1b/d27/f29 x:0 0 0 2024-09-19T06:40:28.008 INFO:tasks.workunit.client.1.smithi117.stdout:3/161: dwrite d0/d8/f1a [0,4194304] 0 2024-09-19T06:40:28.008 INFO:tasks.workunit.client.0.smithi099.stdout:5/94: dwrite d3/d1f/f20 [0,4194304] 0 2024-09-19T06:40:28.011 INFO:tasks.workunit.client.1.smithi117.stdout:1/169: dread d3/d18/f1f [0,4194304] 0 2024-09-19T06:40:28.011 INFO:tasks.workunit.client.1.smithi117.stdout:8/150: mknod d1d/c28 0 2024-09-19T06:40:28.012 INFO:tasks.workunit.client.1.smithi117.stdout:3/162: dread - d0/f1f zero size 2024-09-19T06:40:28.012 INFO:tasks.workunit.client.0.smithi099.stdout:2/18: mkdir d1/d2/d5/d8 0 2024-09-19T06:40:28.013 INFO:tasks.workunit.client.1.smithi117.stdout:0/145: unlink d11/l18 0 2024-09-19T06:40:28.014 INFO:tasks.workunit.client.0.smithi099.stdout:5/95: creat d3/d1f/f21 x:0 0 0 2024-09-19T06:40:28.014 INFO:tasks.workunit.client.0.smithi099.stdout:5/96: rename d3 to d3/d7/d22 22 2024-09-19T06:40:28.015 INFO:tasks.workunit.client.1.smithi117.stdout:1/170: unlink d3/d18/f1f 0 2024-09-19T06:40:28.015 INFO:tasks.workunit.client.0.smithi099.stdout:5/97: fsync d3/d7/fb 0 2024-09-19T06:40:28.015 INFO:tasks.workunit.client.1.smithi117.stdout:1/171: chown f1 0 1 2024-09-19T06:40:28.017 INFO:tasks.workunit.client.1.smithi117.stdout:8/151: mkdir d1d/d1e/d29 0 2024-09-19T06:40:28.017 INFO:tasks.workunit.client.0.smithi099.stdout:2/19: mkdir d1/d2/d5/d8/d9 0 2024-09-19T06:40:28.017 INFO:tasks.workunit.client.0.smithi099.stdout:2/20: fdatasync - no filename 2024-09-19T06:40:28.020 INFO:tasks.workunit.client.1.smithi117.stdout:3/163: mknod d0/d24/c2a 0 2024-09-19T06:40:28.022 INFO:tasks.workunit.client.0.smithi099.stdout:5/98: creat d3/d7/f23 x:0 0 0 2024-09-19T06:40:28.022 INFO:tasks.workunit.client.0.smithi099.stdout:2/21: creat d1/d2/d5/d8/fa x:0 0 0 2024-09-19T06:40:28.024 INFO:tasks.workunit.client.1.smithi117.stdout:6/163: dread d1/d3/f1f [0,4194304] 0 2024-09-19T06:40:28.024 INFO:tasks.workunit.client.1.smithi117.stdout:3/164: rmdir d0 39 2024-09-19T06:40:28.024 INFO:tasks.workunit.client.1.smithi117.stdout:6/164: readlink d1/l13 0 2024-09-19T06:40:28.024 INFO:tasks.workunit.client.0.smithi099.stdout:5/99: symlink d3/d14/l24 0 2024-09-19T06:40:28.026 INFO:tasks.workunit.client.1.smithi117.stdout:8/152: mkdir d1d/d2a 0 2024-09-19T06:40:28.026 INFO:tasks.workunit.client.1.smithi117.stdout:8/153: read - d1d/d1e/f1f zero size 2024-09-19T06:40:28.027 INFO:tasks.workunit.client.1.smithi117.stdout:6/165: symlink d1/d5/d8/d27/l2a 0 2024-09-19T06:40:28.028 INFO:tasks.workunit.client.1.smithi117.stdout:0/146: read d11/d13/d14/d16/f26 [347908,100850] 0 2024-09-19T06:40:28.028 INFO:tasks.workunit.client.0.smithi099.stdout:5/100: creat d3/f25 x:0 0 0 2024-09-19T06:40:28.029 INFO:tasks.workunit.client.0.smithi099.stdout:5/101: dread - d3/d7/f23 zero size 2024-09-19T06:40:28.030 INFO:tasks.workunit.client.1.smithi117.stdout:8/154: rename ff to d1d/d1e/d29/f2b 0 2024-09-19T06:40:28.030 INFO:tasks.workunit.client.0.smithi099.stdout:5/102: dread - d3/d7/f23 zero size 2024-09-19T06:40:28.030 INFO:tasks.workunit.client.1.smithi117.stdout:1/172: dread d3/d18/d23/f2d [0,4194304] 0 2024-09-19T06:40:28.030 INFO:tasks.workunit.client.1.smithi117.stdout:3/165: truncate d0/d9/d1c/f1d 411562 0 2024-09-19T06:40:28.031 INFO:tasks.workunit.client.1.smithi117.stdout:8/155: truncate f11 5063082 0 2024-09-19T06:40:28.032 INFO:tasks.workunit.client.0.smithi099.stdout:5/103: creat d3/d7/f26 x:0 0 0 2024-09-19T06:40:28.032 INFO:tasks.workunit.client.1.smithi117.stdout:6/166: rename d1/f1c to d1/d14/f2b 0 2024-09-19T06:40:28.033 INFO:tasks.workunit.client.0.smithi099.stdout:6/28: sync 2024-09-19T06:40:28.033 INFO:tasks.workunit.client.0.smithi099.stdout:6/29: dread - no filename 2024-09-19T06:40:28.036 INFO:tasks.workunit.client.0.smithi099.stdout:6/30: creat d1/f9 x:0 0 0 2024-09-19T06:40:28.036 INFO:tasks.workunit.client.1.smithi117.stdout:1/173: write d3/d18/d23/f28 [916637,45316] 0 2024-09-19T06:40:28.044 INFO:tasks.workunit.client.1.smithi117.stdout:1/174: creat d3/f3c x:0 0 0 2024-09-19T06:40:28.044 INFO:tasks.workunit.client.1.smithi117.stdout:0/147: dwrite d11/d13/d1b/d27/f29 [0,4194304] 0 2024-09-19T06:40:28.044 INFO:tasks.workunit.client.1.smithi117.stdout:3/166: dwrite d0/f1e [0,4194304] 0 2024-09-19T06:40:28.045 INFO:tasks.workunit.client.1.smithi117.stdout:8/156: dread f11 [0,4194304] 0 2024-09-19T06:40:28.047 INFO:tasks.workunit.client.1.smithi117.stdout:8/157: write d1d/d1e/f1f [762134,70585] 0 2024-09-19T06:40:28.047 INFO:tasks.workunit.client.1.smithi117.stdout:3/167: mkdir d0/d19/d2b 0 2024-09-19T06:40:28.050 INFO:tasks.workunit.client.1.smithi117.stdout:1/175: creat d3/d22/d2f/f3d x:0 0 0 2024-09-19T06:40:28.051 INFO:tasks.workunit.client.1.smithi117.stdout:1/176: write f1 [5742328,91886] 0 2024-09-19T06:40:28.052 INFO:tasks.workunit.client.1.smithi117.stdout:3/168: creat d0/d24/f2c x:0 0 0 2024-09-19T06:40:28.053 INFO:tasks.workunit.client.1.smithi117.stdout:3/169: fdatasync d0/d9/f21 0 2024-09-19T06:40:28.055 INFO:tasks.workunit.client.1.smithi117.stdout:8/158: rename f8 to d1d/d1e/f2c 0 2024-09-19T06:40:28.056 INFO:tasks.workunit.client.1.smithi117.stdout:0/148: mknod d11/d13/d28/c2a 0 2024-09-19T06:40:28.057 INFO:tasks.workunit.client.1.smithi117.stdout:6/167: write d1/d3/f20 [778441,127637] 0 2024-09-19T06:40:28.058 INFO:tasks.workunit.client.1.smithi117.stdout:0/149: write d11/f19 [4150956,63261] 0 2024-09-19T06:40:28.061 INFO:tasks.workunit.client.1.smithi117.stdout:1/177: rename d3/d18/c19 to d3/d22/d2f/c3e 0 2024-09-19T06:40:28.063 INFO:tasks.workunit.client.1.smithi117.stdout:3/170: mkdir d0/d19/d2b/d2d 0 2024-09-19T06:40:28.066 INFO:tasks.workunit.client.1.smithi117.stdout:3/171: symlink d0/d19/d2b/d2d/l2e 0 2024-09-19T06:40:28.067 INFO:tasks.workunit.client.1.smithi117.stdout:0/150: dwrite f3 [0,4194304] 0 2024-09-19T06:40:28.069 INFO:tasks.workunit.client.1.smithi117.stdout:1/178: dwrite f1 [4194304,4194304] 0 2024-09-19T06:40:28.071 INFO:tasks.workunit.client.1.smithi117.stdout:3/172: creat d0/d24/f2f x:0 0 0 2024-09-19T06:40:28.072 INFO:tasks.workunit.client.1.smithi117.stdout:1/179: creat d3/d18/f3f x:0 0 0 2024-09-19T06:40:28.076 INFO:tasks.workunit.client.1.smithi117.stdout:3/173: rename d0/f1f to d0/d19/d2b/f30 0 2024-09-19T06:40:28.077 INFO:tasks.workunit.client.1.smithi117.stdout:3/174: write d0/d24/f2c [927595,53792] 0 2024-09-19T06:40:28.077 INFO:tasks.workunit.client.1.smithi117.stdout:1/180: creat d3/f40 x:0 0 0 2024-09-19T06:40:28.078 INFO:tasks.workunit.client.1.smithi117.stdout:8/159: write f4 [3999229,20624] 0 2024-09-19T06:40:28.079 INFO:tasks.workunit.client.1.smithi117.stdout:1/181: fdatasync d3/d22/f2a 0 2024-09-19T06:40:28.080 INFO:tasks.workunit.client.1.smithi117.stdout:6/168: write d1/d3/fc [562553,121357] 0 2024-09-19T06:40:28.082 INFO:tasks.workunit.client.1.smithi117.stdout:1/182: mknod d3/d22/c41 0 2024-09-19T06:40:28.083 INFO:tasks.workunit.client.1.smithi117.stdout:1/183: truncate d3/f10 4194588 0 2024-09-19T06:40:28.084 INFO:tasks.workunit.client.1.smithi117.stdout:6/169: write d1/f18 [840217,5848] 0 2024-09-19T06:40:28.086 INFO:tasks.workunit.client.1.smithi117.stdout:3/175: getdents d0/d9 0 2024-09-19T06:40:28.086 INFO:tasks.workunit.client.1.smithi117.stdout:1/184: truncate d3/d18/d23/f34 1042285 0 2024-09-19T06:40:28.087 INFO:tasks.workunit.client.1.smithi117.stdout:6/170: unlink d1/d3/f22 0 2024-09-19T06:40:28.087 INFO:tasks.workunit.client.1.smithi117.stdout:1/185: chown d3/d18/l1a 52 1 2024-09-19T06:40:28.088 INFO:tasks.workunit.client.1.smithi117.stdout:3/176: chown d0/la 32173 1 2024-09-19T06:40:28.090 INFO:tasks.workunit.client.1.smithi117.stdout:1/186: mknod d3/d22/c42 0 2024-09-19T06:40:28.092 INFO:tasks.workunit.client.1.smithi117.stdout:1/187: mknod d3/d18/d23/c43 0 2024-09-19T06:40:28.093 INFO:tasks.workunit.client.1.smithi117.stdout:6/171: link d1/d5/c24 d1/d3/d25/c2c 0 2024-09-19T06:40:28.094 INFO:tasks.workunit.client.1.smithi117.stdout:1/188: write d3/d22/d2f/f3d [230977,129344] 0 2024-09-19T06:40:28.094 INFO:tasks.workunit.client.1.smithi117.stdout:6/172: chown d1/d5/l7 1 1 2024-09-19T06:40:28.097 INFO:tasks.workunit.client.1.smithi117.stdout:1/189: mknod d3/d18/d23/d3a/c44 0 2024-09-19T06:40:28.098 INFO:tasks.workunit.client.1.smithi117.stdout:8/160: truncate d1d/d1e/d29/f2b 1341843 0 2024-09-19T06:40:28.099 INFO:tasks.workunit.client.1.smithi117.stdout:8/161: fdatasync f4 0 2024-09-19T06:40:28.100 INFO:tasks.workunit.client.1.smithi117.stdout:1/190: creat d3/d18/d23/f45 x:0 0 0 2024-09-19T06:40:28.100 INFO:tasks.workunit.client.1.smithi117.stdout:8/162: chown cc 1 1 2024-09-19T06:40:28.101 INFO:tasks.workunit.client.1.smithi117.stdout:1/191: fdatasync d3/f2e 0 2024-09-19T06:40:28.101 INFO:tasks.workunit.client.0.smithi099.stdout:1/43: sync 2024-09-19T06:40:28.102 INFO:tasks.workunit.client.1.smithi117.stdout:3/177: truncate d0/f14 3595789 0 2024-09-19T06:40:28.102 INFO:tasks.workunit.client.1.smithi117.stdout:6/173: dwrite d1/d5/d8/f19 [0,4194304] 0 2024-09-19T06:40:28.103 INFO:tasks.workunit.client.1.smithi117.stdout:1/192: creat d3/d22/f46 x:0 0 0 2024-09-19T06:40:28.104 INFO:tasks.workunit.client.1.smithi117.stdout:1/193: dread - d3/d22/f46 zero size 2024-09-19T06:40:28.105 INFO:tasks.workunit.client.1.smithi117.stdout:8/163: creat d1d/d1e/d29/f2d x:0 0 0 2024-09-19T06:40:28.105 INFO:tasks.workunit.client.0.smithi099.stdout:1/44: rename d0/da to d0/db/dd 0 2024-09-19T06:40:28.105 INFO:tasks.workunit.client.0.smithi099.stdout:1/45: stat d0/l3 0 2024-09-19T06:40:28.106 INFO:tasks.workunit.client.0.smithi099.stdout:1/46: chown d0/c4 64610107 1 2024-09-19T06:40:28.106 INFO:tasks.workunit.client.1.smithi117.stdout:3/178: creat d0/d19/d2b/f31 x:0 0 0 2024-09-19T06:40:28.108 INFO:tasks.workunit.client.0.smithi099.stdout:1/47: rmdir d0/db 39 2024-09-19T06:40:28.109 INFO:tasks.workunit.client.0.smithi099.stdout:7/80: fsync d7/fa 0 2024-09-19T06:40:28.110 INFO:tasks.workunit.client.0.smithi099.stdout:0/19: truncate d0/f3 155679 0 2024-09-19T06:40:28.112 INFO:tasks.workunit.client.0.smithi099.stdout:7/81: read d7/f8 [827847,28968] 0 2024-09-19T06:40:28.116 INFO:tasks.workunit.client.1.smithi117.stdout:8/164: dwrite f3 [4194304,4194304] 0 2024-09-19T06:40:28.116 INFO:tasks.workunit.client.1.smithi117.stdout:1/194: dwrite f1 [0,4194304] 0 2024-09-19T06:40:28.117 INFO:tasks.workunit.client.0.smithi099.stdout:1/48: dwrite d0/f5 [0,4194304] 0 2024-09-19T06:40:28.117 INFO:tasks.workunit.client.0.smithi099.stdout:8/30: rmdir d4 39 2024-09-19T06:40:28.120 INFO:tasks.workunit.client.0.smithi099.stdout:3/72: truncate d7/fa 2594955 0 2024-09-19T06:40:28.120 INFO:tasks.workunit.client.1.smithi117.stdout:8/165: creat d1d/d1e/d29/f2e x:0 0 0 2024-09-19T06:40:28.122 INFO:tasks.workunit.client.1.smithi117.stdout:8/166: chown d1d/d1e/d29 360 1 2024-09-19T06:40:28.124 INFO:tasks.workunit.client.0.smithi099.stdout:7/82: link d7/fa d7/dc/d1f/f21 0 2024-09-19T06:40:28.125 INFO:tasks.workunit.client.0.smithi099.stdout:7/83: dread - d7/dc/f16 zero size 2024-09-19T06:40:28.126 INFO:tasks.workunit.client.0.smithi099.stdout:7/84: chown d7/f20 7099118 1 2024-09-19T06:40:28.128 INFO:tasks.workunit.client.1.smithi117.stdout:3/179: dwrite d0/d19/d2b/f30 [0,4194304] 0 2024-09-19T06:40:28.130 INFO:tasks.workunit.client.0.smithi099.stdout:3/73: creat d7/ff x:0 0 0 2024-09-19T06:40:28.130 INFO:tasks.workunit.client.0.smithi099.stdout:8/31: creat d4/f9 x:0 0 0 2024-09-19T06:40:28.131 INFO:tasks.workunit.client.0.smithi099.stdout:0/20: link d0/c5 d0/c6 0 2024-09-19T06:40:28.131 INFO:tasks.workunit.client.0.smithi099.stdout:8/32: fsync d4/f6 0 2024-09-19T06:40:28.131 INFO:tasks.workunit.client.1.smithi117.stdout:1/195: dwrite d3/f5 [4194304,4194304] 0 2024-09-19T06:40:28.132 INFO:tasks.workunit.client.0.smithi099.stdout:9/73: getdents dd 0 2024-09-19T06:40:28.132 INFO:tasks.workunit.client.1.smithi117.stdout:1/196: chown d3/d18/d23/c39 126 1 2024-09-19T06:40:28.133 INFO:tasks.workunit.client.0.smithi099.stdout:8/33: write d4/f9 [349547,105107] 0 2024-09-19T06:40:28.134 INFO:tasks.workunit.client.0.smithi099.stdout:3/74: creat d7/f10 x:0 0 0 2024-09-19T06:40:28.135 INFO:tasks.workunit.client.1.smithi117.stdout:3/180: read d0/f15 [229945,116691] 0 2024-09-19T06:40:28.136 INFO:tasks.workunit.client.0.smithi099.stdout:0/21: creat d0/f7 x:0 0 0 2024-09-19T06:40:28.137 INFO:tasks.workunit.client.1.smithi117.stdout:1/197: creat d3/d18/d23/d3a/f47 x:0 0 0 2024-09-19T06:40:28.138 INFO:tasks.workunit.client.0.smithi099.stdout:9/74: creat dd/f16 x:0 0 0 2024-09-19T06:40:28.139 INFO:tasks.workunit.client.1.smithi117.stdout:1/198: chown d3/cf 1 1 2024-09-19T06:40:28.140 INFO:tasks.workunit.client.1.smithi117.stdout:3/181: creat d0/d9/d1c/f32 x:0 0 0 2024-09-19T06:40:28.140 INFO:tasks.workunit.client.0.smithi099.stdout:8/34: write f2 [165687,82605] 0 2024-09-19T06:40:28.142 INFO:tasks.workunit.client.1.smithi117.stdout:6/174: write d1/d3/f20 [1397646,29523] 0 2024-09-19T06:40:28.142 INFO:tasks.workunit.client.0.smithi099.stdout:3/75: symlink d7/l11 0 2024-09-19T06:40:28.142 INFO:tasks.workunit.client.1.smithi117.stdout:3/182: write d0/d24/f2c [897276,110403] 0 2024-09-19T06:40:28.145 INFO:tasks.workunit.client.0.smithi099.stdout:8/35: creat d4/fa x:0 0 0 2024-09-19T06:40:28.145 INFO:tasks.workunit.client.1.smithi117.stdout:6/175: mknod d1/d14/c2d 0 2024-09-19T06:40:28.147 INFO:tasks.workunit.client.0.smithi099.stdout:0/22: dwrite d0/f7 [0,4194304] 0 2024-09-19T06:40:28.147 INFO:tasks.workunit.client.0.smithi099.stdout:9/75: mknod dd/c17 0 2024-09-19T06:40:28.149 INFO:tasks.workunit.client.0.smithi099.stdout:2/22: fsync d1/d2/d5/d8/fa 0 2024-09-19T06:40:28.150 INFO:tasks.workunit.client.0.smithi099.stdout:2/23: dread - d1/d2/d5/d8/fa zero size 2024-09-19T06:40:28.151 INFO:tasks.workunit.client.0.smithi099.stdout:8/36: rename d4/f8 to d4/fb 0 2024-09-19T06:40:28.152 INFO:tasks.workunit.client.1.smithi117.stdout:3/183: dwrite d0/d19/d2b/f30 [0,4194304] 0 2024-09-19T06:40:28.153 INFO:tasks.workunit.client.0.smithi099.stdout:3/76: dwrite d7/fc [0,4194304] 0 2024-09-19T06:40:28.153 INFO:tasks.workunit.client.0.smithi099.stdout:8/37: dread - d4/f6 zero size 2024-09-19T06:40:28.154 INFO:tasks.workunit.client.0.smithi099.stdout:2/24: write d1/d2/d5/d8/fa [840008,108750] 0 2024-09-19T06:40:28.154 INFO:tasks.workunit.client.1.smithi117.stdout:6/176: dread d1/d5/d8/f19 [0,4194304] 0 2024-09-19T06:40:28.155 INFO:tasks.workunit.client.0.smithi099.stdout:8/38: read - d4/fb zero size 2024-09-19T06:40:28.155 INFO:tasks.workunit.client.0.smithi099.stdout:0/23: symlink d0/l8 0 2024-09-19T06:40:28.156 INFO:tasks.workunit.client.1.smithi117.stdout:6/177: write d1/d3/f17 [5209279,47437] 0 2024-09-19T06:40:28.156 INFO:tasks.workunit.client.0.smithi099.stdout:5/104: rmdir d3/d7 39 2024-09-19T06:40:28.156 INFO:tasks.workunit.client.0.smithi099.stdout:0/24: rename d0 to d0/d9 22 2024-09-19T06:40:28.157 INFO:tasks.workunit.client.1.smithi117.stdout:6/178: write d1/d3/f17 [3396992,130741] 0 2024-09-19T06:40:28.158 INFO:tasks.workunit.client.0.smithi099.stdout:6/31: rmdir d1 39 2024-09-19T06:40:28.159 INFO:tasks.workunit.client.1.smithi117.stdout:3/184: symlink d0/d19/d2b/l33 0 2024-09-19T06:40:28.160 INFO:tasks.workunit.client.0.smithi099.stdout:8/39: mknod d4/cc 0 2024-09-19T06:40:28.161 INFO:tasks.workunit.client.0.smithi099.stdout:3/77: dread d7/fd [4194304,4194304] 0 2024-09-19T06:40:28.163 INFO:tasks.workunit.client.1.smithi117.stdout:6/179: creat d1/d14/f2e x:0 0 0 2024-09-19T06:40:28.164 INFO:tasks.workunit.client.1.smithi117.stdout:3/185: mknod d0/d19/d2b/c34 0 2024-09-19T06:40:28.166 INFO:tasks.workunit.client.1.smithi117.stdout:8/167: truncate d1d/d1e/d29/f2b 1720291 0 2024-09-19T06:40:28.167 INFO:tasks.workunit.client.0.smithi099.stdout:9/76: creat dd/d10/d13/f18 x:0 0 0 2024-09-19T06:40:28.168 INFO:tasks.workunit.client.1.smithi117.stdout:8/168: dread - f15 zero size 2024-09-19T06:40:28.169 INFO:tasks.workunit.client.1.smithi117.stdout:6/180: chown d1/d3/d25/c2c 3 1 2024-09-19T06:40:28.169 INFO:tasks.workunit.client.1.smithi117.stdout:5/210: sync 2024-09-19T06:40:28.170 INFO:tasks.workunit.client.0.smithi099.stdout:6/32: dread - d1/f9 zero size 2024-09-19T06:40:28.171 INFO:tasks.workunit.client.0.smithi099.stdout:6/33: readlink d1/l4 0 2024-09-19T06:40:28.172 INFO:tasks.workunit.client.0.smithi099.stdout:6/34: readlink d1/l4 0 2024-09-19T06:40:28.172 INFO:tasks.workunit.client.0.smithi099.stdout:2/25: symlink d1/d2/d5/d8/d9/lb 0 2024-09-19T06:40:28.172 INFO:tasks.workunit.client.1.smithi117.stdout:8/169: chown l2 1668 1 2024-09-19T06:40:28.173 INFO:tasks.workunit.client.0.smithi099.stdout:6/35: readlink d1/l4 0 2024-09-19T06:40:28.175 INFO:tasks.workunit.client.0.smithi099.stdout:6/36: dread - d1/f9 zero size 2024-09-19T06:40:28.175 INFO:tasks.workunit.client.0.smithi099.stdout:5/105: dwrite d3/d7/f23 [0,4194304] 0 2024-09-19T06:40:28.176 INFO:tasks.workunit.client.0.smithi099.stdout:5/106: fdatasync d3/d1f/f21 0 2024-09-19T06:40:28.176 INFO:tasks.workunit.client.1.smithi117.stdout:3/186: dwrite d0/d24/f2c [0,4194304] 0 2024-09-19T06:40:28.177 INFO:tasks.workunit.client.0.smithi099.stdout:6/37: fdatasync d1/f9 0 2024-09-19T06:40:28.181 INFO:tasks.workunit.client.0.smithi099.stdout:5/107: write d3/d7/f26 [147551,44792] 0 2024-09-19T06:40:28.182 INFO:tasks.workunit.client.0.smithi099.stdout:7/85: truncate d7/dc/d1f/f21 585703 0 2024-09-19T06:40:28.183 INFO:tasks.workunit.client.0.smithi099.stdout:9/77: creat dd/f19 x:0 0 0 2024-09-19T06:40:28.183 INFO:tasks.workunit.client.1.smithi117.stdout:3/187: creat d0/d19/f35 x:0 0 0 2024-09-19T06:40:28.184 INFO:tasks.workunit.client.0.smithi099.stdout:6/38: symlink d1/d5/la 0 2024-09-19T06:40:28.184 INFO:tasks.workunit.client.1.smithi117.stdout:1/199: dwrite d3/f14 [0,4194304] 0 2024-09-19T06:40:28.187 INFO:tasks.workunit.client.1.smithi117.stdout:6/181: dread d1/d3/f12 [0,4194304] 0 2024-09-19T06:40:28.187 INFO:tasks.workunit.client.0.smithi099.stdout:2/26: dwrite d1/d2/d5/d8/fa [0,4194304] 0 2024-09-19T06:40:28.188 INFO:tasks.workunit.client.0.smithi099.stdout:7/86: dread f1 [0,4194304] 0 2024-09-19T06:40:28.189 INFO:tasks.workunit.client.1.smithi117.stdout:1/200: unlink d3/d18/d23/l27 0 2024-09-19T06:40:28.191 INFO:tasks.workunit.client.0.smithi099.stdout:6/39: mknod d1/d5/cb 0 2024-09-19T06:40:28.191 INFO:tasks.workunit.client.1.smithi117.stdout:3/188: mkdir d0/d9/d1c/d36 0 2024-09-19T06:40:28.194 INFO:tasks.workunit.client.0.smithi099.stdout:6/40: dread - d1/f9 zero size 2024-09-19T06:40:28.197 INFO:tasks.workunit.client.1.smithi117.stdout:3/189: rmdir d0/d8 39 2024-09-19T06:40:28.199 INFO:tasks.workunit.client.1.smithi117.stdout:3/190: fdatasync d0/d9/d1c/f32 0 2024-09-19T06:40:28.199 INFO:tasks.workunit.client.0.smithi099.stdout:9/78: dwrite fa [0,4194304] 0 2024-09-19T06:40:28.200 INFO:tasks.workunit.client.0.smithi099.stdout:7/87: unlink d7/dd/c13 0 2024-09-19T06:40:28.201 INFO:tasks.workunit.client.1.smithi117.stdout:1/201: dread d3/f32 [0,4194304] 0 2024-09-19T06:40:28.201 INFO:tasks.workunit.client.0.smithi099.stdout:9/79: fdatasync dd/d10/d13/f18 0 2024-09-19T06:40:28.202 INFO:tasks.workunit.client.0.smithi099.stdout:5/108: getdents d3/d7 0 2024-09-19T06:40:28.204 INFO:tasks.workunit.client.1.smithi117.stdout:8/170: dwrite d1d/d1e/d29/f2b [0,4194304] 0 2024-09-19T06:40:28.205 INFO:tasks.workunit.client.0.smithi099.stdout:9/80: write dd/d10/d13/f18 [931429,112456] 0 2024-09-19T06:40:28.205 INFO:tasks.workunit.client.1.smithi117.stdout:1/202: write d3/f9 [2920986,81014] 0 2024-09-19T06:40:28.207 INFO:tasks.workunit.client.0.smithi099.stdout:3/78: dread f6 [0,4194304] 0 2024-09-19T06:40:28.210 INFO:tasks.workunit.client.1.smithi117.stdout:3/191: read d0/d8/f20 [58756,108728] 0 2024-09-19T06:40:28.211 INFO:tasks.workunit.client.0.smithi099.stdout:6/41: dwrite d1/f9 [0,4194304] 0 2024-09-19T06:40:28.212 INFO:tasks.workunit.client.0.smithi099.stdout:9/81: creat dd/d10/d13/f1a x:0 0 0 2024-09-19T06:40:28.213 INFO:tasks.workunit.client.1.smithi117.stdout:3/192: readlink d0/d8/le 0 2024-09-19T06:40:28.214 INFO:tasks.workunit.client.0.smithi099.stdout:5/109: link d3/f25 d3/f27 0 2024-09-19T06:40:28.214 INFO:tasks.workunit.client.0.smithi099.stdout:2/27: fdatasync d1/d2/d5/d8/fa 0 2024-09-19T06:40:28.214 INFO:tasks.workunit.client.0.smithi099.stdout:9/82: chown fb 0 1 2024-09-19T06:40:28.217 INFO:tasks.workunit.client.0.smithi099.stdout:5/110: stat d3/le 0 2024-09-19T06:40:28.217 INFO:tasks.workunit.client.0.smithi099.stdout:7/88: link d7/dd/c14 d7/c22 0 2024-09-19T06:40:28.218 INFO:tasks.workunit.client.0.smithi099.stdout:5/111: stat c0 0 2024-09-19T06:40:28.218 INFO:tasks.workunit.client.0.smithi099.stdout:4/41: sync 2024-09-19T06:40:28.219 INFO:tasks.workunit.client.0.smithi099.stdout:2/28: read d1/d2/d5/d8/fa [2834911,117991] 0 2024-09-19T06:40:28.220 INFO:tasks.workunit.client.0.smithi099.stdout:4/42: chown c3 1992750776 1 2024-09-19T06:40:28.221 INFO:tasks.workunit.client.1.smithi117.stdout:3/193: dwrite d0/d9/fd [0,4194304] 0 2024-09-19T06:40:28.222 INFO:tasks.workunit.client.0.smithi099.stdout:3/79: dwrite d7/ff [0,4194304] 0 2024-09-19T06:40:28.222 INFO:tasks.workunit.client.0.smithi099.stdout:4/43: chown la 1756 1 2024-09-19T06:40:28.222 INFO:tasks.workunit.client.0.smithi099.stdout:0/25: truncate d0/f3 873447 0 2024-09-19T06:40:28.223 INFO:tasks.workunit.client.1.smithi117.stdout:5/211: dread d17/d1b/d3a/d3c/f3d [0,4194304] 0 2024-09-19T06:40:28.223 INFO:tasks.workunit.client.0.smithi099.stdout:5/112: truncate d3/d7/f10 483127 0 2024-09-19T06:40:28.224 INFO:tasks.workunit.client.0.smithi099.stdout:5/113: write d3/d7/f10 [426963,34994] 0 2024-09-19T06:40:28.225 INFO:tasks.workunit.client.0.smithi099.stdout:4/44: mkdir d12 0 2024-09-19T06:40:28.226 INFO:tasks.workunit.client.0.smithi099.stdout:7/89: rmdir d7/d1c 0 2024-09-19T06:40:28.229 INFO:tasks.workunit.client.0.smithi099.stdout:7/90: truncate d7/ff 475457 0 2024-09-19T06:40:28.230 INFO:tasks.workunit.client.1.smithi117.stdout:5/212: link f3 d17/d1b/d3a/f4b 0 2024-09-19T06:40:28.231 INFO:tasks.workunit.client.1.smithi117.stdout:3/194: dwrite d0/f18 [4194304,4194304] 0 2024-09-19T06:40:28.231 INFO:tasks.workunit.client.0.smithi099.stdout:3/80: dwrite d7/f10 [0,4194304] 0 2024-09-19T06:40:28.232 INFO:tasks.workunit.client.0.smithi099.stdout:3/81: readlink d7/l11 0 2024-09-19T06:40:28.235 INFO:tasks.workunit.client.0.smithi099.stdout:0/26: unlink d0/c6 0 2024-09-19T06:40:28.236 INFO:tasks.workunit.client.0.smithi099.stdout:7/91: creat d7/dc/f23 x:0 0 0 2024-09-19T06:40:28.238 INFO:tasks.workunit.client.1.smithi117.stdout:5/213: write d17/d2e/f33 [1348223,121657] 0 2024-09-19T06:40:28.239 INFO:tasks.workunit.client.0.smithi099.stdout:4/45: mknod d12/c13 0 2024-09-19T06:40:28.239 INFO:tasks.workunit.client.0.smithi099.stdout:5/114: creat d3/d16/f28 x:0 0 0 2024-09-19T06:40:28.239 INFO:tasks.workunit.client.0.smithi099.stdout:3/82: creat d7/f12 x:0 0 0 2024-09-19T06:40:28.240 INFO:tasks.workunit.client.1.smithi117.stdout:3/195: dread d0/f1e [0,4194304] 0 2024-09-19T06:40:28.240 INFO:tasks.workunit.client.1.smithi117.stdout:5/214: write d17/d1b/d3a/d3c/f3d [171537,86406] 0 2024-09-19T06:40:28.241 INFO:tasks.workunit.client.0.smithi099.stdout:2/29: dwrite d1/d2/d5/d8/fa [0,4194304] 0 2024-09-19T06:40:28.242 INFO:tasks.workunit.client.0.smithi099.stdout:7/92: mknod d7/c24 0 2024-09-19T06:40:28.243 INFO:tasks.workunit.client.0.smithi099.stdout:4/46: symlink d12/l14 0 2024-09-19T06:40:28.243 INFO:tasks.workunit.client.1.smithi117.stdout:5/215: chown ff 12 1 2024-09-19T06:40:28.244 INFO:tasks.workunit.client.0.smithi099.stdout:5/115: mknod d3/d16/c29 0 2024-09-19T06:40:28.245 INFO:tasks.workunit.client.1.smithi117.stdout:1/203: rmdir d3/d18/d23 39 2024-09-19T06:40:28.247 INFO:tasks.workunit.client.1.smithi117.stdout:3/196: dwrite d0/f1e [0,4194304] 0 2024-09-19T06:40:28.248 INFO:tasks.workunit.client.0.smithi099.stdout:4/47: mknod d12/c15 0 2024-09-19T06:40:28.249 INFO:tasks.workunit.client.0.smithi099.stdout:5/116: fdatasync d3/f27 0 2024-09-19T06:40:28.254 INFO:tasks.workunit.client.1.smithi117.stdout:1/204: creat d3/d18/f48 x:0 0 0 2024-09-19T06:40:28.256 INFO:tasks.workunit.client.0.smithi099.stdout:5/117: mkdir d3/d2a 0 2024-09-19T06:40:28.257 INFO:tasks.workunit.client.1.smithi117.stdout:8/171: dwrite d1d/d1e/d29/f2b [4194304,4194304] 0 2024-09-19T06:40:28.257 INFO:tasks.workunit.client.1.smithi117.stdout:1/205: chown d3/f10 481496 1 2024-09-19T06:40:28.258 INFO:tasks.workunit.client.0.smithi099.stdout:5/118: creat d3/d16/f2b x:0 0 0 2024-09-19T06:40:28.259 INFO:tasks.workunit.client.1.smithi117.stdout:3/197: dwrite d0/fb [0,4194304] 0 2024-09-19T06:40:28.259 INFO:tasks.workunit.client.1.smithi117.stdout:8/172: chown d1d/d1e/l22 53579198 1 2024-09-19T06:40:28.260 INFO:tasks.workunit.client.0.smithi099.stdout:5/119: fdatasync d3/f5 0 2024-09-19T06:40:28.261 INFO:tasks.workunit.client.1.smithi117.stdout:3/198: fsync d0/d9/d1c/f28 0 2024-09-19T06:40:28.261 INFO:tasks.workunit.client.1.smithi117.stdout:1/206: unlink d3/f40 0 2024-09-19T06:40:28.262 INFO:tasks.workunit.client.0.smithi099.stdout:5/120: dread d3/d7/f1c [0,4194304] 0 2024-09-19T06:40:28.263 INFO:tasks.workunit.client.1.smithi117.stdout:3/199: truncate d0/d9/d1c/f28 435378 0 2024-09-19T06:40:28.263 INFO:tasks.workunit.client.0.smithi099.stdout:5/121: fsync d3/d1f/f20 0 2024-09-19T06:40:28.265 INFO:tasks.workunit.client.1.smithi117.stdout:8/173: creat d1d/d2a/f2f x:0 0 0 2024-09-19T06:40:28.265 INFO:tasks.workunit.client.1.smithi117.stdout:1/207: symlink d3/d22/l49 0 2024-09-19T06:40:28.267 INFO:tasks.workunit.client.0.smithi099.stdout:5/122: creat d3/d2a/f2c x:0 0 0 2024-09-19T06:40:28.269 INFO:tasks.workunit.client.1.smithi117.stdout:8/174: rename d1d/d1e/l21 to d1d/d1e/d29/l30 0 2024-09-19T06:40:28.272 INFO:tasks.workunit.client.0.smithi099.stdout:9/83: rmdir dd/d10/d13 39 2024-09-19T06:40:28.272 INFO:tasks.workunit.client.1.smithi117.stdout:8/175: unlink c1b 0 2024-09-19T06:40:28.276 INFO:tasks.workunit.client.1.smithi117.stdout:8/176: mkdir d1d/d31 0 2024-09-19T06:40:28.276 INFO:tasks.workunit.client.1.smithi117.stdout:1/208: dwrite d3/f32 [0,4194304] 0 2024-09-19T06:40:28.278 INFO:tasks.workunit.client.1.smithi117.stdout:8/177: creat d1d/d1e/f32 x:0 0 0 2024-09-19T06:40:28.279 INFO:tasks.workunit.client.1.smithi117.stdout:1/209: symlink d3/d22/d2f/l4a 0 2024-09-19T06:40:28.280 INFO:tasks.workunit.client.0.smithi099.stdout:9/84: dread dd/d10/d13/f18 [0,4194304] 0 2024-09-19T06:40:28.280 INFO:tasks.workunit.client.0.smithi099.stdout:0/27: rmdir d0 39 2024-09-19T06:40:28.280 INFO:tasks.workunit.client.1.smithi117.stdout:1/210: chown d3/f10 7 1 2024-09-19T06:40:28.281 INFO:tasks.workunit.client.0.smithi099.stdout:9/85: stat dd/d10/d13 0 2024-09-19T06:40:28.281 INFO:tasks.workunit.client.0.smithi099.stdout:9/86: fsync fa 0 2024-09-19T06:40:28.283 INFO:tasks.workunit.client.0.smithi099.stdout:7/93: getdents d7/dc 0 2024-09-19T06:40:28.285 INFO:tasks.workunit.client.1.smithi117.stdout:5/216: fdatasync d17/d1b/d3a/d3c/f3d 0 2024-09-19T06:40:28.287 INFO:tasks.workunit.client.0.smithi099.stdout:0/28: chown d0/f3 310194551 1 2024-09-19T06:40:28.287 INFO:tasks.workunit.client.1.smithi117.stdout:8/178: dwrite d1d/d1e/d29/f2e [0,4194304] 0 2024-09-19T06:40:28.287 INFO:tasks.workunit.client.1.smithi117.stdout:1/211: dread d3/f14 [0,4194304] 0 2024-09-19T06:40:28.289 INFO:tasks.workunit.client.0.smithi099.stdout:7/94: rename f1 to d7/f25 0 2024-09-19T06:40:28.291 INFO:tasks.workunit.client.0.smithi099.stdout:9/87: dwrite dd/f16 [0,4194304] 0 2024-09-19T06:40:28.292 INFO:tasks.workunit.client.0.smithi099.stdout:0/29: creat d0/fa x:0 0 0 2024-09-19T06:40:28.293 INFO:tasks.workunit.client.1.smithi117.stdout:1/212: dread d3/f9 [0,4194304] 0 2024-09-19T06:40:28.295 INFO:tasks.workunit.client.0.smithi099.stdout:3/83: truncate d7/f10 1124453 0 2024-09-19T06:40:28.298 INFO:tasks.workunit.client.0.smithi099.stdout:2/30: truncate d1/d2/d5/d8/fa 4155449 0 2024-09-19T06:40:28.298 INFO:tasks.workunit.client.0.smithi099.stdout:4/48: truncate fb 308482 0 2024-09-19T06:40:28.298 INFO:tasks.workunit.client.0.smithi099.stdout:0/30: fsync d0/f3 0 2024-09-19T06:40:28.299 INFO:tasks.workunit.client.1.smithi117.stdout:3/200: truncate d0/d8/f1a 2728528 0 2024-09-19T06:40:28.299 INFO:tasks.workunit.client.1.smithi117.stdout:5/217: link d17/l23 d17/d2f/d3b/l4c 0 2024-09-19T06:40:28.302 INFO:tasks.workunit.client.0.smithi099.stdout:4/49: write f5 [3281655,58989] 0 2024-09-19T06:40:28.302 INFO:tasks.workunit.client.0.smithi099.stdout:4/50: fsync ff 0 2024-09-19T06:40:28.303 INFO:tasks.workunit.client.1.smithi117.stdout:5/218: mknod d17/d2f/c4d 0 2024-09-19T06:40:28.303 INFO:tasks.workunit.client.0.smithi099.stdout:5/123: dwrite d3/f27 [0,4194304] 0 2024-09-19T06:40:28.306 INFO:tasks.workunit.client.1.smithi117.stdout:1/213: mknod d3/d18/d23/d3a/c4b 0 2024-09-19T06:40:28.307 INFO:tasks.workunit.client.1.smithi117.stdout:1/214: fsync d3/d22/d2f/f3d 0 2024-09-19T06:40:28.307 INFO:tasks.workunit.client.1.smithi117.stdout:1/215: fsync f1 0 2024-09-19T06:40:28.308 INFO:tasks.workunit.client.0.smithi099.stdout:7/95: creat d7/f26 x:0 0 0 2024-09-19T06:40:28.308 INFO:tasks.workunit.client.0.smithi099.stdout:0/31: mkdir d0/db 0 2024-09-19T06:40:28.310 INFO:tasks.workunit.client.0.smithi099.stdout:5/124: symlink d3/d1f/l2d 0 2024-09-19T06:40:28.310 INFO:tasks.workunit.client.1.smithi117.stdout:3/201: link d0/l23 d0/d8/l37 0 2024-09-19T06:40:28.312 INFO:tasks.workunit.client.1.smithi117.stdout:1/216: creat d3/f4c x:0 0 0 2024-09-19T06:40:28.312 INFO:tasks.workunit.client.0.smithi099.stdout:0/32: fdatasync d0/f7 0 2024-09-19T06:40:28.313 INFO:tasks.workunit.client.0.smithi099.stdout:4/51: chown fb 16 1 2024-09-19T06:40:28.313 INFO:tasks.workunit.client.0.smithi099.stdout:9/88: dwrite dd/d10/d13/f18 [0,4194304] 0 2024-09-19T06:40:28.313 INFO:tasks.workunit.client.1.smithi117.stdout:3/202: creat d0/d19/f38 x:0 0 0 2024-09-19T06:40:28.315 INFO:tasks.workunit.client.0.smithi099.stdout:0/33: write d0/fa [537047,54585] 0 2024-09-19T06:40:28.315 INFO:tasks.workunit.client.0.smithi099.stdout:7/96: symlink d7/dc/d1f/l27 0 2024-09-19T06:40:28.316 INFO:tasks.workunit.client.1.smithi117.stdout:3/203: creat d0/d9/d1c/f39 x:0 0 0 2024-09-19T06:40:28.316 INFO:tasks.workunit.client.1.smithi117.stdout:8/179: write f12 [2765315,36279] 0 2024-09-19T06:40:28.317 INFO:tasks.workunit.client.0.smithi099.stdout:9/89: mknod dd/d10/d13/c1b 0 2024-09-19T06:40:28.318 INFO:tasks.workunit.client.1.smithi117.stdout:3/204: symlink d0/d9/l3a 0 2024-09-19T06:40:28.319 INFO:tasks.workunit.client.0.smithi099.stdout:9/90: write fb [2666,14915] 0 2024-09-19T06:40:28.320 INFO:tasks.workunit.client.1.smithi117.stdout:8/180: symlink d1d/d1e/d29/l33 0 2024-09-19T06:40:28.321 INFO:tasks.workunit.client.0.smithi099.stdout:9/91: stat l7 0 2024-09-19T06:40:28.321 INFO:tasks.workunit.client.1.smithi117.stdout:3/205: chown d0/f1e 4893490 1 2024-09-19T06:40:28.321 INFO:tasks.workunit.client.0.smithi099.stdout:7/97: mknod d7/dc/d1f/c28 0 2024-09-19T06:40:28.322 INFO:tasks.workunit.client.1.smithi117.stdout:1/217: dwrite d3/d22/d2f/f3d [0,4194304] 0 2024-09-19T06:40:28.322 INFO:tasks.workunit.client.0.smithi099.stdout:9/92: readlink l8 0 2024-09-19T06:40:28.325 INFO:tasks.workunit.client.0.smithi099.stdout:9/93: chown fa 562962851 1 2024-09-19T06:40:28.325 INFO:tasks.workunit.client.0.smithi099.stdout:0/34: creat d0/db/fc x:0 0 0 2024-09-19T06:40:28.326 INFO:tasks.workunit.client.1.smithi117.stdout:1/218: unlink d3/cf 0 2024-09-19T06:40:28.327 INFO:tasks.workunit.client.1.smithi117.stdout:1/219: dread - d3/f4c zero size 2024-09-19T06:40:28.328 INFO:tasks.workunit.client.0.smithi099.stdout:4/52: dwrite f10 [0,4194304] 0 2024-09-19T06:40:28.328 INFO:tasks.workunit.client.0.smithi099.stdout:9/94: read - dd/f19 zero size 2024-09-19T06:40:28.329 INFO:tasks.workunit.client.0.smithi099.stdout:1/49: sync 2024-09-19T06:40:28.329 INFO:tasks.workunit.client.0.smithi099.stdout:6/42: sync 2024-09-19T06:40:28.329 INFO:tasks.workunit.client.0.smithi099.stdout:8/40: sync 2024-09-19T06:40:28.329 INFO:tasks.workunit.client.1.smithi117.stdout:8/181: fdatasync f12 0 2024-09-19T06:40:28.331 INFO:tasks.workunit.client.0.smithi099.stdout:2/31: dread d1/d2/d5/d8/fa [0,4194304] 0 2024-09-19T06:40:28.331 INFO:tasks.workunit.client.1.smithi117.stdout:8/182: mknod d1d/d2a/c34 0 2024-09-19T06:40:28.332 INFO:tasks.workunit.client.0.smithi099.stdout:1/50: read - d0/f6 zero size 2024-09-19T06:40:28.333 INFO:tasks.workunit.client.0.smithi099.stdout:2/32: stat d1/d2/d5/d8 0 2024-09-19T06:40:28.335 INFO:tasks.workunit.client.1.smithi117.stdout:1/220: dread d3/d22/f2a [0,4194304] 0 2024-09-19T06:40:28.335 INFO:tasks.workunit.client.1.smithi117.stdout:8/183: symlink d1d/d2a/l35 0 2024-09-19T06:40:28.336 INFO:tasks.workunit.client.0.smithi099.stdout:9/95: write dd/d10/d13/f18 [5077507,59899] 0 2024-09-19T06:40:28.336 INFO:tasks.workunit.client.1.smithi117.stdout:8/184: write f12 [2960160,125629] 0 2024-09-19T06:40:28.340 INFO:tasks.workunit.client.1.smithi117.stdout:8/185: dread - d1d/d1e/d29/f2d zero size 2024-09-19T06:40:28.341 INFO:tasks.workunit.client.1.smithi117.stdout:3/206: getdents d0/d9/d1c 0 2024-09-19T06:40:28.341 INFO:tasks.workunit.client.0.smithi099.stdout:5/125: truncate d3/d7/ff 932083 0 2024-09-19T06:40:28.341 INFO:tasks.workunit.client.1.smithi117.stdout:3/207: chown d0/d9/l22 2 1 2024-09-19T06:40:28.342 INFO:tasks.workunit.client.0.smithi099.stdout:1/51: fsync d0/f6 0 2024-09-19T06:40:28.342 INFO:tasks.workunit.client.1.smithi117.stdout:3/208: write d0/d9/f21 [856369,34244] 0 2024-09-19T06:40:28.343 INFO:tasks.workunit.client.1.smithi117.stdout:1/221: rename d3/d18/d23/c43 to d3/d18/d23/c4d 0 2024-09-19T06:40:28.344 INFO:tasks.workunit.client.1.smithi117.stdout:1/222: write d3/d22/f33 [511605,32050] 0 2024-09-19T06:40:28.345 INFO:tasks.workunit.client.0.smithi099.stdout:3/84: dwrite f6 [0,4194304] 0 2024-09-19T06:40:28.345 INFO:tasks.workunit.client.1.smithi117.stdout:3/209: mknod d0/d19/d2b/d2d/c3b 0 2024-09-19T06:40:28.346 INFO:tasks.workunit.client.0.smithi099.stdout:9/96: write dd/d10/d13/f18 [938795,43036] 0 2024-09-19T06:40:28.346 INFO:tasks.workunit.client.1.smithi117.stdout:8/186: creat d1d/d31/f36 x:0 0 0 2024-09-19T06:40:28.348 INFO:tasks.workunit.client.1.smithi117.stdout:3/210: mknod d0/d8/c3c 0 2024-09-19T06:40:28.350 INFO:tasks.workunit.client.0.smithi099.stdout:3/85: fsync d7/ff 0 2024-09-19T06:40:28.350 INFO:tasks.workunit.client.0.smithi099.stdout:9/97: truncate fb 1965201 0 2024-09-19T06:40:28.350 INFO:tasks.workunit.client.0.smithi099.stdout:5/126: chown d3/d14/l24 83270780 1 2024-09-19T06:40:28.350 INFO:tasks.workunit.client.1.smithi117.stdout:8/187: mknod d1d/d31/c37 0 2024-09-19T06:40:28.351 INFO:tasks.workunit.client.1.smithi117.stdout:8/188: chown f3 463 1 2024-09-19T06:40:28.352 INFO:tasks.workunit.client.0.smithi099.stdout:7/98: rename d7/dc to d7/dd/d29 0 2024-09-19T06:40:28.353 INFO:tasks.workunit.client.0.smithi099.stdout:9/98: read dd/d10/f11 [2330483,78063] 0 2024-09-19T06:40:28.353 INFO:tasks.workunit.client.1.smithi117.stdout:8/189: unlink c16 0 2024-09-19T06:40:28.353 INFO:tasks.workunit.client.0.smithi099.stdout:0/35: creat d0/db/fd x:0 0 0 2024-09-19T06:40:28.354 INFO:tasks.workunit.client.0.smithi099.stdout:8/41: unlink d4/fb 0 2024-09-19T06:40:28.354 INFO:tasks.workunit.client.0.smithi099.stdout:6/43: dwrite d1/f9 [0,4194304] 0 2024-09-19T06:40:28.355 INFO:tasks.workunit.client.1.smithi117.stdout:3/211: mkdir d0/d3d 0 2024-09-19T06:40:28.356 INFO:tasks.workunit.client.1.smithi117.stdout:8/190: symlink d1d/d2a/l38 0 2024-09-19T06:40:28.357 INFO:tasks.workunit.client.1.smithi117.stdout:3/212: creat d0/d19/f3e x:0 0 0 2024-09-19T06:40:28.357 INFO:tasks.workunit.client.0.smithi099.stdout:4/53: creat d12/f16 x:0 0 0 2024-09-19T06:40:28.358 INFO:tasks.workunit.client.0.smithi099.stdout:8/42: truncate f3 482730 0 2024-09-19T06:40:28.358 INFO:tasks.workunit.client.1.smithi117.stdout:8/191: write f15 [760519,61306] 0 2024-09-19T06:40:28.359 INFO:tasks.workunit.client.0.smithi099.stdout:2/33: dread d1/d2/d5/d8/fa [0,4194304] 0 2024-09-19T06:40:28.360 INFO:tasks.workunit.client.1.smithi117.stdout:3/213: dread - d0/d9/d1c/f32 zero size 2024-09-19T06:40:28.360 INFO:tasks.workunit.client.1.smithi117.stdout:3/214: chown d0/d19/l26 666 1 2024-09-19T06:40:28.362 INFO:tasks.workunit.client.1.smithi117.stdout:8/192: unlink d1d/d2a/l35 0 2024-09-19T06:40:28.363 INFO:tasks.workunit.client.1.smithi117.stdout:8/193: chown d1d/f27 900614 1 2024-09-19T06:40:28.364 INFO:tasks.workunit.client.0.smithi099.stdout:5/127: creat d3/d2a/f2e x:0 0 0 2024-09-19T06:40:28.364 INFO:tasks.workunit.client.0.smithi099.stdout:7/99: dread f5 [0,4194304] 0 2024-09-19T06:40:28.364 INFO:tasks.workunit.client.0.smithi099.stdout:5/128: chown d3/d2a 294829568 1 2024-09-19T06:40:28.365 INFO:tasks.workunit.client.1.smithi117.stdout:1/223: truncate d3/f10 3101073 0 2024-09-19T06:40:28.366 INFO:tasks.workunit.client.1.smithi117.stdout:8/194: mknod d1d/d31/c39 0 2024-09-19T06:40:28.366 INFO:tasks.workunit.client.1.smithi117.stdout:1/224: dread - d3/d22/f46 zero size 2024-09-19T06:40:28.366 INFO:tasks.workunit.client.0.smithi099.stdout:6/44: mknod d1/d5/cc 0 2024-09-19T06:40:28.367 INFO:tasks.workunit.client.1.smithi117.stdout:3/215: rename d0/d8/l37 to d0/d9/d1c/l3f 0 2024-09-19T06:40:28.368 INFO:tasks.workunit.client.0.smithi099.stdout:4/54: rename l1 to d12/l17 0 2024-09-19T06:40:28.368 INFO:tasks.workunit.client.0.smithi099.stdout:5/129: write d3/d7/f10 [725254,17979] 0 2024-09-19T06:40:28.369 INFO:tasks.workunit.client.1.smithi117.stdout:1/225: unlink d3/d18/d23/l2b 0 2024-09-19T06:40:28.369 INFO:tasks.workunit.client.0.smithi099.stdout:1/52: mknod d0/db/ce 0 2024-09-19T06:40:28.369 INFO:tasks.workunit.client.1.smithi117.stdout:1/226: write d3/f38 [100968,1148] 0 2024-09-19T06:40:28.370 INFO:tasks.workunit.client.0.smithi099.stdout:3/86: link d7/f12 d7/f13 0 2024-09-19T06:40:28.371 INFO:tasks.workunit.client.0.smithi099.stdout:9/99: mknod dd/c1c 0 2024-09-19T06:40:28.373 INFO:tasks.workunit.client.1.smithi117.stdout:8/195: dwrite d1d/d1e/d29/f2b [0,4194304] 0 2024-09-19T06:40:28.374 INFO:tasks.workunit.client.1.smithi117.stdout:8/196: dread - d1d/d1e/d29/f2d zero size 2024-09-19T06:40:28.374 INFO:tasks.workunit.client.0.smithi099.stdout:0/36: unlink d0/db/fd 0 2024-09-19T06:40:28.375 INFO:tasks.workunit.client.0.smithi099.stdout:8/43: dwrite d4/f6 [0,4194304] 0 2024-09-19T06:40:28.375 INFO:tasks.workunit.client.0.smithi099.stdout:6/45: creat d1/fd x:0 0 0 2024-09-19T06:40:28.384 INFO:tasks.workunit.client.1.smithi117.stdout:8/197: rename f11 to d1d/f3a 0 2024-09-19T06:40:28.386 INFO:tasks.workunit.client.1.smithi117.stdout:8/198: mkdir d1d/d1e/d3b 0 2024-09-19T06:40:28.388 INFO:tasks.workunit.client.1.smithi117.stdout:8/199: dread f15 [0,4194304] 0 2024-09-19T06:40:28.400 INFO:tasks.workunit.client.1.smithi117.stdout:8/200: truncate d1d/d1e/d29/f2e 1877246 0 2024-09-19T06:40:28.400 INFO:tasks.workunit.client.1.smithi117.stdout:3/216: dwrite d0/d8/f1a [0,4194304] 0 2024-09-19T06:40:28.401 INFO:tasks.workunit.client.1.smithi117.stdout:8/201: read - d1d/d31/f36 zero size 2024-09-19T06:40:28.402 INFO:tasks.workunit.client.1.smithi117.stdout:3/217: dread - d0/d19/f35 zero size 2024-09-19T06:40:28.404 INFO:tasks.workunit.client.1.smithi117.stdout:3/218: chown d0/l2 210173387 1 2024-09-19T06:40:28.405 INFO:tasks.workunit.client.0.smithi099.stdout:7/100: rename d7/f20 to d7/dd/d29/d1f/f2a 0 2024-09-19T06:40:28.407 INFO:tasks.workunit.client.1.smithi117.stdout:3/219: fdatasync d0/d8/f20 0 2024-09-19T06:40:28.409 INFO:tasks.workunit.client.0.smithi099.stdout:6/46: creat d1/fe x:0 0 0 2024-09-19T06:40:28.410 INFO:tasks.workunit.client.0.smithi099.stdout:2/34: dwrite d1/d2/d5/d8/fa [0,4194304] 0 2024-09-19T06:40:28.410 INFO:tasks.workunit.client.1.smithi117.stdout:3/220: mkdir d0/d9/d1c/d36/d40 0 2024-09-19T06:40:28.414 INFO:tasks.workunit.client.0.smithi099.stdout:1/53: dwrite d0/f5 [0,4194304] 0 2024-09-19T06:40:28.414 INFO:tasks.workunit.client.1.smithi117.stdout:3/221: creat d0/d19/f41 x:0 0 0 2024-09-19T06:40:28.415 INFO:tasks.workunit.client.0.smithi099.stdout:4/55: dwrite d12/f16 [0,4194304] 0 2024-09-19T06:40:28.418 INFO:tasks.workunit.client.0.smithi099.stdout:5/130: truncate d3/d7/f11 1001726 0 2024-09-19T06:40:28.421 INFO:tasks.workunit.client.1.smithi117.stdout:3/222: dwrite d0/d8/f1a [0,4194304] 0 2024-09-19T06:40:28.422 INFO:tasks.workunit.client.0.smithi099.stdout:6/47: symlink d1/d5/lf 0 2024-09-19T06:40:28.423 INFO:tasks.workunit.client.1.smithi117.stdout:3/223: fsync d0/f18 0 2024-09-19T06:40:28.423 INFO:tasks.workunit.client.0.smithi099.stdout:1/54: dread - d0/f6 zero size 2024-09-19T06:40:28.423 INFO:tasks.workunit.client.0.smithi099.stdout:0/37: dwrite d0/fa [0,4194304] 0 2024-09-19T06:40:28.424 INFO:tasks.workunit.client.0.smithi099.stdout:4/56: read - f11 zero size 2024-09-19T06:40:28.424 INFO:tasks.workunit.client.0.smithi099.stdout:5/131: fdatasync d3/d7/f23 0 2024-09-19T06:40:28.425 INFO:tasks.workunit.client.1.smithi117.stdout:3/224: write d0/d8/f1a [2799202,29579] 0 2024-09-19T06:40:28.425 INFO:tasks.workunit.client.0.smithi099.stdout:9/100: dwrite dd/d10/d13/f1a [0,4194304] 0 2024-09-19T06:40:28.425 INFO:tasks.workunit.client.0.smithi099.stdout:8/44: dwrite f3 [0,4194304] 0 2024-09-19T06:40:28.427 INFO:tasks.workunit.client.0.smithi099.stdout:2/35: mkdir d1/d2/d5/d8/dc 0 2024-09-19T06:40:28.431 INFO:tasks.workunit.client.1.smithi117.stdout:3/225: link d0/f1e d0/d9/d1c/f42 0 2024-09-19T06:40:28.431 INFO:tasks.workunit.client.1.smithi117.stdout:3/226: chown d0/d9/l22 8 1 2024-09-19T06:40:28.432 INFO:tasks.workunit.client.0.smithi099.stdout:5/132: dread d3/f5 [0,4194304] 0 2024-09-19T06:40:28.432 INFO:tasks.workunit.client.0.smithi099.stdout:7/101: dread d7/fa [0,4194304] 0 2024-09-19T06:40:28.432 INFO:tasks.workunit.client.0.smithi099.stdout:6/48: creat d1/f10 x:0 0 0 2024-09-19T06:40:28.432 INFO:tasks.workunit.client.0.smithi099.stdout:9/101: write fa [5174260,57823] 0 2024-09-19T06:40:28.433 INFO:tasks.workunit.client.1.smithi117.stdout:3/227: readlink d0/d9/l22 0 2024-09-19T06:40:28.433 INFO:tasks.workunit.client.0.smithi099.stdout:6/49: fsync d1/fe 0 2024-09-19T06:40:28.434 INFO:tasks.workunit.client.1.smithi117.stdout:4/241: sync 2024-09-19T06:40:28.435 INFO:tasks.workunit.client.0.smithi099.stdout:4/57: creat d12/f18 x:0 0 0 2024-09-19T06:40:28.436 INFO:tasks.workunit.client.1.smithi117.stdout:8/202: truncate d1d/d1e/d29/f2b 8009377 0 2024-09-19T06:40:28.437 INFO:tasks.workunit.client.0.smithi099.stdout:0/38: creat d0/db/fe x:0 0 0 2024-09-19T06:40:28.437 INFO:tasks.workunit.client.1.smithi117.stdout:4/242: mkdir d3/d4/d5f 0 2024-09-19T06:40:28.438 INFO:tasks.workunit.client.0.smithi099.stdout:9/102: symlink dd/d10/d13/l1d 0 2024-09-19T06:40:28.439 INFO:tasks.workunit.client.0.smithi099.stdout:6/50: symlink d1/l11 0 2024-09-19T06:40:28.440 INFO:tasks.workunit.client.1.smithi117.stdout:3/228: dwrite d0/d24/f2f [0,4194304] 0 2024-09-19T06:40:28.441 INFO:tasks.workunit.client.0.smithi099.stdout:4/58: mknod d12/c19 0 2024-09-19T06:40:28.441 INFO:tasks.workunit.client.0.smithi099.stdout:5/133: truncate d3/d16/f28 1041430 0 2024-09-19T06:40:28.442 INFO:tasks.workunit.client.1.smithi117.stdout:3/229: dread - d0/d19/f3e zero size 2024-09-19T06:40:28.442 INFO:tasks.workunit.client.0.smithi099.stdout:2/36: dread d1/d2/d5/d8/fa [0,4194304] 0 2024-09-19T06:40:28.442 INFO:tasks.workunit.client.1.smithi117.stdout:8/203: mknod d1d/d1e/d3b/c3c 0 2024-09-19T06:40:28.442 INFO:tasks.workunit.client.0.smithi099.stdout:4/59: read - f11 zero size 2024-09-19T06:40:28.445 INFO:tasks.workunit.client.1.smithi117.stdout:4/243: truncate d3/d4/f9 1421051 0 2024-09-19T06:40:28.446 INFO:tasks.workunit.client.1.smithi117.stdout:3/230: rename d0/f1 to d0/d19/d2b/d2d/f43 0 2024-09-19T06:40:28.447 INFO:tasks.workunit.client.0.smithi099.stdout:0/39: symlink d0/lf 0 2024-09-19T06:40:28.447 INFO:tasks.workunit.client.0.smithi099.stdout:2/37: chown d1/d2/d5/d6 3909 1 2024-09-19T06:40:28.447 INFO:tasks.workunit.client.0.smithi099.stdout:6/51: mkdir d1/d12 0 2024-09-19T06:40:28.448 INFO:tasks.workunit.client.0.smithi099.stdout:5/134: truncate d3/d16/f28 1945615 0 2024-09-19T06:40:28.448 INFO:tasks.workunit.client.1.smithi117.stdout:8/204: symlink d1d/l3d 0 2024-09-19T06:40:28.449 INFO:tasks.workunit.client.1.smithi117.stdout:4/244: chown d3/d4/d14/f56 28990751 1 2024-09-19T06:40:28.450 INFO:tasks.workunit.client.1.smithi117.stdout:3/231: symlink d0/d8/l44 0 2024-09-19T06:40:28.451 INFO:tasks.workunit.client.1.smithi117.stdout:3/232: write d0/d9/d1c/f39 [358275,28712] 0 2024-09-19T06:40:28.451 INFO:tasks.workunit.client.1.smithi117.stdout:8/205: creat d1d/d1e/f3e x:0 0 0 2024-09-19T06:40:28.451 INFO:tasks.workunit.client.0.smithi099.stdout:1/55: rename d0/l2 to d0/lf 0 2024-09-19T06:40:28.452 INFO:tasks.workunit.client.0.smithi099.stdout:9/103: dwrite dd/f16 [0,4194304] 0 2024-09-19T06:40:28.454 INFO:tasks.workunit.client.0.smithi099.stdout:1/56: fsync d0/f8 0 2024-09-19T06:40:28.454 INFO:tasks.workunit.client.0.smithi099.stdout:0/40: write d0/db/fe [355443,4138] 0 2024-09-19T06:40:28.454 INFO:tasks.workunit.client.0.smithi099.stdout:4/60: creat d12/f1a x:0 0 0 2024-09-19T06:40:28.455 INFO:tasks.workunit.client.1.smithi117.stdout:3/233: symlink d0/d8/l45 0 2024-09-19T06:40:28.456 INFO:tasks.workunit.client.1.smithi117.stdout:3/234: readlink d0/d9/l3a 0 2024-09-19T06:40:28.459 INFO:tasks.workunit.client.0.smithi099.stdout:2/38: unlink d1/d2/d5/d8/d9/lb 0 2024-09-19T06:40:28.459 INFO:tasks.workunit.client.0.smithi099.stdout:7/102: getdents d7/dd/d29/d1f 0 2024-09-19T06:40:28.460 INFO:tasks.workunit.client.1.smithi117.stdout:8/206: dwrite d1d/d1e/f32 [0,4194304] 0 2024-09-19T06:40:28.460 INFO:tasks.workunit.client.1.smithi117.stdout:8/207: write f3 [3476618,31470] 0 2024-09-19T06:40:28.461 INFO:tasks.workunit.client.1.smithi117.stdout:8/208: write f19 [669525,53327] 0 2024-09-19T06:40:28.462 INFO:tasks.workunit.client.0.smithi099.stdout:4/61: mkdir d12/d1b 0 2024-09-19T06:40:28.463 INFO:tasks.workunit.client.1.smithi117.stdout:8/209: truncate d1d/d1e/d29/f2d 866065 0 2024-09-19T06:40:28.465 INFO:tasks.workunit.client.1.smithi117.stdout:3/235: link d0/d8/f10 d0/d19/d2b/d2d/f46 0 2024-09-19T06:40:28.465 INFO:tasks.workunit.client.1.smithi117.stdout:8/210: write d1d/d1e/d29/f2d [1704251,90348] 0 2024-09-19T06:40:28.468 INFO:tasks.workunit.client.0.smithi099.stdout:5/135: dwrite d3/f5 [0,4194304] 0 2024-09-19T06:40:28.468 INFO:tasks.workunit.client.1.smithi117.stdout:8/211: mkdir d1d/d2a/d3f 0 2024-09-19T06:40:28.469 INFO:tasks.workunit.client.0.smithi099.stdout:7/103: truncate d7/dd/d29/f16 536502 0 2024-09-19T06:40:28.470 INFO:tasks.workunit.client.1.smithi117.stdout:3/236: unlink d0/d19/d2b/f30 0 2024-09-19T06:40:28.471 INFO:tasks.workunit.client.0.smithi099.stdout:6/52: dwrite d1/f9 [0,4194304] 0 2024-09-19T06:40:28.471 INFO:tasks.workunit.client.0.smithi099.stdout:7/104: chown d7/dd 0 1 2024-09-19T06:40:28.472 INFO:tasks.workunit.client.0.smithi099.stdout:0/41: truncate d0/f7 3406924 0 2024-09-19T06:40:28.472 INFO:tasks.workunit.client.0.smithi099.stdout:1/57: dread d0/f5 [0,4194304] 0 2024-09-19T06:40:28.473 INFO:tasks.workunit.client.1.smithi117.stdout:3/237: mknod d0/d19/d2b/d2d/c47 0 2024-09-19T06:40:28.474 INFO:tasks.workunit.client.1.smithi117.stdout:3/238: stat d0/la 0 2024-09-19T06:40:28.474 INFO:tasks.workunit.client.0.smithi099.stdout:6/53: readlink d1/l11 0 2024-09-19T06:40:28.474 INFO:tasks.workunit.client.0.smithi099.stdout:2/39: mkdir d1/d2/d5/d8/dd 0 2024-09-19T06:40:28.474 INFO:tasks.workunit.client.0.smithi099.stdout:7/105: stat d7/fa 0 2024-09-19T06:40:28.474 INFO:tasks.workunit.client.0.smithi099.stdout:4/62: mkdir d12/d1b/d1c 0 2024-09-19T06:40:28.475 INFO:tasks.workunit.client.0.smithi099.stdout:7/106: readlink d7/dd/d29/d1f/l27 0 2024-09-19T06:40:28.477 INFO:tasks.workunit.client.0.smithi099.stdout:1/58: chown d0/f8 2 1 2024-09-19T06:40:28.477 INFO:tasks.workunit.client.0.smithi099.stdout:5/136: mkdir d3/d16/d2f 0 2024-09-19T06:40:28.477 INFO:tasks.workunit.client.0.smithi099.stdout:1/59: stat d0/f5 0 2024-09-19T06:40:28.477 INFO:tasks.workunit.client.1.smithi117.stdout:3/239: mkdir d0/d3d/d48 0 2024-09-19T06:40:28.478 INFO:tasks.workunit.client.0.smithi099.stdout:1/60: write d0/f6 [183648,2066] 0 2024-09-19T06:40:28.478 INFO:tasks.workunit.client.1.smithi117.stdout:4/245: getdents d3/d4 0 2024-09-19T06:40:28.478 INFO:tasks.workunit.client.1.smithi117.stdout:3/240: dread - d0/d19/d2b/f31 zero size 2024-09-19T06:40:28.481 INFO:tasks.workunit.client.1.smithi117.stdout:3/241: write d0/d9/d1c/f32 [763088,13865] 0 2024-09-19T06:40:28.481 INFO:tasks.workunit.client.0.smithi099.stdout:0/42: symlink d0/db/l10 0 2024-09-19T06:40:28.483 INFO:tasks.workunit.client.0.smithi099.stdout:7/107: mknod d7/dd/c2b 0 2024-09-19T06:40:28.485 INFO:tasks.workunit.client.0.smithi099.stdout:1/61: rename d0/c4 to d0/db/c10 0 2024-09-19T06:40:28.485 INFO:tasks.workunit.client.0.smithi099.stdout:5/137: creat d3/d16/f30 x:0 0 0 2024-09-19T06:40:28.486 INFO:tasks.workunit.client.0.smithi099.stdout:1/62: chown d0/db 451 1 2024-09-19T06:40:28.486 INFO:tasks.workunit.client.0.smithi099.stdout:4/63: dread d12/f16 [0,4194304] 0 2024-09-19T06:40:28.487 INFO:tasks.workunit.client.0.smithi099.stdout:7/108: fsync d7/f25 0 2024-09-19T06:40:28.487 INFO:tasks.workunit.client.0.smithi099.stdout:6/54: dread d1/f9 [0,4194304] 0 2024-09-19T06:40:28.489 INFO:tasks.workunit.client.1.smithi117.stdout:4/246: dwrite d3/de/f15 [4194304,4194304] 0 2024-09-19T06:40:28.489 INFO:tasks.workunit.client.0.smithi099.stdout:4/64: truncate f11 130086 0 2024-09-19T06:40:28.490 INFO:tasks.workunit.client.0.smithi099.stdout:2/40: write d1/d2/d5/d8/fa [4125756,43594] 0 2024-09-19T06:40:28.490 INFO:tasks.workunit.client.0.smithi099.stdout:0/43: creat d0/f11 x:0 0 0 2024-09-19T06:40:28.490 INFO:tasks.workunit.client.1.smithi117.stdout:4/247: write d3/d1b/f5a [808634,103299] 0 2024-09-19T06:40:28.492 INFO:tasks.workunit.client.0.smithi099.stdout:5/138: rename d3/f5 to d3/d1f/f31 0 2024-09-19T06:40:28.492 INFO:tasks.workunit.client.1.smithi117.stdout:4/248: truncate d3/db/f3a 1566700 0 2024-09-19T06:40:28.492 INFO:tasks.workunit.client.1.smithi117.stdout:3/242: rename d0/d19/d2b/d2d to d0/d9/d49 0 2024-09-19T06:40:28.493 INFO:tasks.workunit.client.0.smithi099.stdout:4/65: write ff [490740,115990] 0 2024-09-19T06:40:28.493 INFO:tasks.workunit.client.0.smithi099.stdout:6/55: truncate d1/fe 418083 0 2024-09-19T06:40:28.494 INFO:tasks.workunit.client.1.smithi117.stdout:4/249: write d3/db/d23/f54 [3845744,50403] 0 2024-09-19T06:40:28.495 INFO:tasks.workunit.client.0.smithi099.stdout:0/44: rename d0/fa to d0/f12 0 2024-09-19T06:40:28.496 INFO:tasks.workunit.client.0.smithi099.stdout:4/66: truncate f10 4549753 0 2024-09-19T06:40:28.497 INFO:tasks.workunit.client.1.smithi117.stdout:3/243: mknod d0/d9/d1c/c4a 0 2024-09-19T06:40:28.497 INFO:tasks.workunit.client.1.smithi117.stdout:9/232: sync 2024-09-19T06:40:28.498 INFO:tasks.workunit.client.0.smithi099.stdout:4/67: stat d12/f16 0 2024-09-19T06:40:28.498 INFO:tasks.workunit.client.0.smithi099.stdout:2/41: mknod d1/d2/d5/ce 0 2024-09-19T06:40:28.499 INFO:tasks.workunit.client.0.smithi099.stdout:7/109: dread f5 [0,4194304] 0 2024-09-19T06:40:28.502 INFO:tasks.workunit.client.0.smithi099.stdout:5/139: dread d3/d7/fa [0,4194304] 0 2024-09-19T06:40:28.502 INFO:tasks.workunit.client.1.smithi117.stdout:3/244: rename d0/d9/l3a to d0/d9/d1c/l4b 0 2024-09-19T06:40:28.502 INFO:tasks.workunit.client.0.smithi099.stdout:0/45: mkdir d0/db/d13 0 2024-09-19T06:40:28.504 INFO:tasks.workunit.client.0.smithi099.stdout:6/56: creat d1/d5/f13 x:0 0 0 2024-09-19T06:40:28.505 INFO:tasks.workunit.client.1.smithi117.stdout:3/245: creat d0/d8/f4c x:0 0 0 2024-09-19T06:40:28.506 INFO:tasks.workunit.client.1.smithi117.stdout:3/246: dread d0/f15 [0,4194304] 0 2024-09-19T06:40:28.509 INFO:tasks.workunit.client.1.smithi117.stdout:3/247: rename d0/d8/l44 to d0/d3d/l4d 0 2024-09-19T06:40:28.510 INFO:tasks.workunit.client.1.smithi117.stdout:3/248: dread d0/d8/f20 [0,4194304] 0 2024-09-19T06:40:28.516 INFO:tasks.workunit.client.1.smithi117.stdout:3/249: chown d0/d3d/l4d 552124 1 2024-09-19T06:40:28.516 INFO:tasks.workunit.client.1.smithi117.stdout:4/250: dwrite d3/d4/d14/f56 [0,4194304] 0 2024-09-19T06:40:28.517 INFO:tasks.workunit.client.1.smithi117.stdout:9/233: dwrite d4/d1c/d36/d37/f39 [0,4194304] 0 2024-09-19T06:40:28.520 INFO:tasks.workunit.client.1.smithi117.stdout:3/250: mkdir d0/d9/d4e 0 2024-09-19T06:40:28.531 INFO:tasks.workunit.client.1.smithi117.stdout:9/234: dwrite d4/d1c/d36/d37/f39 [0,4194304] 0 2024-09-19T06:40:28.531 INFO:tasks.workunit.client.1.smithi117.stdout:4/251: dwrite d3/db/f43 [0,4194304] 0 2024-09-19T06:40:28.532 INFO:tasks.workunit.client.1.smithi117.stdout:9/235: chown d4/d18 825 1 2024-09-19T06:40:28.533 INFO:tasks.workunit.client.0.smithi099.stdout:4/68: rename d12/c19 to d12/d1b/c1d 0 2024-09-19T06:40:28.534 INFO:tasks.workunit.client.1.smithi117.stdout:9/236: symlink d4/d18/l4d 0 2024-09-19T06:40:28.534 INFO:tasks.workunit.client.1.smithi117.stdout:4/252: getdents d3/d4/d5f 0 2024-09-19T06:40:28.536 INFO:tasks.workunit.client.0.smithi099.stdout:4/69: dread f10 [0,4194304] 0 2024-09-19T06:40:28.538 INFO:tasks.workunit.client.1.smithi117.stdout:9/237: read - d4/d1c/f41 zero size 2024-09-19T06:40:28.539 INFO:tasks.workunit.client.1.smithi117.stdout:9/238: read - d4/d1c/d46/f47 zero size 2024-09-19T06:40:28.539 INFO:tasks.workunit.client.1.smithi117.stdout:4/253: read - d3/db/d20/d35/d45/f5d zero size 2024-09-19T06:40:28.539 INFO:tasks.workunit.client.0.smithi099.stdout:6/57: creat d1/d5/f14 x:0 0 0 2024-09-19T06:40:28.540 INFO:tasks.workunit.client.0.smithi099.stdout:1/63: getdents d0 0 2024-09-19T06:40:28.540 INFO:tasks.workunit.client.1.smithi117.stdout:9/239: chown d4/df/d16/l34 111919775 1 2024-09-19T06:40:28.541 INFO:tasks.workunit.client.0.smithi099.stdout:6/58: truncate d1/fd 444080 0 2024-09-19T06:40:28.541 INFO:tasks.workunit.client.1.smithi117.stdout:4/254: write d3/db/d23/f57 [268635,114190] 0 2024-09-19T06:40:28.544 INFO:tasks.workunit.client.1.smithi117.stdout:9/240: mknod d4/d20/c4e 0 2024-09-19T06:40:28.545 INFO:tasks.workunit.client.1.smithi117.stdout:9/241: dread - d4/f3b zero size 2024-09-19T06:40:28.545 INFO:tasks.workunit.client.1.smithi117.stdout:4/255: creat d3/d4/d14/f60 x:0 0 0 2024-09-19T06:40:28.545 INFO:tasks.workunit.client.0.smithi099.stdout:2/42: link d1/d2/d5/d8/fa d1/d2/d5/d8/d9/ff 0 2024-09-19T06:40:28.545 INFO:tasks.workunit.client.0.smithi099.stdout:0/46: getdents d0/db/d13 0 2024-09-19T06:40:28.547 INFO:tasks.workunit.client.1.smithi117.stdout:9/242: rmdir d4/d1c/d46 39 2024-09-19T06:40:28.548 INFO:tasks.workunit.client.0.smithi099.stdout:6/59: symlink d1/l15 0 2024-09-19T06:40:28.548 INFO:tasks.workunit.client.0.smithi099.stdout:4/70: mknod d12/d1b/d1c/c1e 0 2024-09-19T06:40:28.549 INFO:tasks.workunit.client.1.smithi117.stdout:3/251: dwrite d0/d9/d49/f46 [0,4194304] 0 2024-09-19T06:40:28.551 INFO:tasks.workunit.client.0.smithi099.stdout:2/43: dread d1/d2/d5/d8/fa [0,4194304] 0 2024-09-19T06:40:28.551 INFO:tasks.workunit.client.0.smithi099.stdout:7/110: rename f6 to d7/f2c 0 2024-09-19T06:40:28.552 INFO:tasks.workunit.client.0.smithi099.stdout:2/44: chown d1/d2/d5/ce 119 1 2024-09-19T06:40:28.552 INFO:tasks.workunit.client.0.smithi099.stdout:2/45: rename d1 to d1/d10 22 2024-09-19T06:40:28.554 INFO:tasks.workunit.client.1.smithi117.stdout:9/243: rename d4/d1c/f48 to d4/d1c/d36/f4f 0 2024-09-19T06:40:28.555 INFO:tasks.workunit.client.0.smithi099.stdout:4/71: rmdir d12/d1b/d1c 39 2024-09-19T06:40:28.557 INFO:tasks.workunit.client.0.smithi099.stdout:7/111: write f5 [4322491,94345] 0 2024-09-19T06:40:28.557 INFO:tasks.workunit.client.0.smithi099.stdout:1/64: getdents d0 0 2024-09-19T06:40:28.558 INFO:tasks.workunit.client.0.smithi099.stdout:6/60: mknod d1/d12/c16 0 2024-09-19T06:40:28.558 INFO:tasks.workunit.client.1.smithi117.stdout:9/244: dread d4/f24 [0,4194304] 0 2024-09-19T06:40:28.559 INFO:tasks.workunit.client.0.smithi099.stdout:2/46: fdatasync d1/d2/d5/d8/fa 0 2024-09-19T06:40:28.560 INFO:tasks.workunit.client.1.smithi117.stdout:3/252: getdents d0/d8 0 2024-09-19T06:40:28.562 INFO:tasks.workunit.client.1.smithi117.stdout:9/245: creat d4/d20/f50 x:0 0 0 2024-09-19T06:40:28.562 INFO:tasks.workunit.client.0.smithi099.stdout:5/140: write d3/d7/ff [122585,84109] 0 2024-09-19T06:40:28.563 INFO:tasks.workunit.client.1.smithi117.stdout:9/246: chown d4/f44 29643 1 2024-09-19T06:40:28.563 INFO:tasks.workunit.client.1.smithi117.stdout:9/247: stat f0 0 2024-09-19T06:40:28.563 INFO:tasks.workunit.client.0.smithi099.stdout:4/72: chown cd 108458640 1 2024-09-19T06:40:28.564 INFO:tasks.workunit.client.0.smithi099.stdout:0/47: dwrite d0/f12 [0,4194304] 0 2024-09-19T06:40:28.566 INFO:tasks.workunit.client.0.smithi099.stdout:2/47: creat d1/d2/d5/d8/f11 x:0 0 0 2024-09-19T06:40:28.567 INFO:tasks.workunit.client.0.smithi099.stdout:1/65: dread d0/f8 [0,4194304] 0 2024-09-19T06:40:28.567 INFO:tasks.workunit.client.0.smithi099.stdout:4/73: chown c9 15303 1 2024-09-19T06:40:28.569 INFO:tasks.workunit.client.1.smithi117.stdout:9/248: getdents d4/d1c/d36 0 2024-09-19T06:40:28.569 INFO:tasks.workunit.client.0.smithi099.stdout:0/48: creat d0/db/f14 x:0 0 0 2024-09-19T06:40:28.570 INFO:tasks.workunit.client.0.smithi099.stdout:6/61: dwrite d1/f10 [0,4194304] 0 2024-09-19T06:40:28.572 INFO:tasks.workunit.client.0.smithi099.stdout:6/62: write d1/fe [356215,24597] 0 2024-09-19T06:40:28.574 INFO:tasks.workunit.client.0.smithi099.stdout:1/66: creat d0/db/f11 x:0 0 0 2024-09-19T06:40:28.575 INFO:tasks.workunit.client.0.smithi099.stdout:5/141: getdents d3/d1f 0 2024-09-19T06:40:28.578 INFO:tasks.workunit.client.0.smithi099.stdout:1/67: mkdir d0/d12 0 2024-09-19T06:40:28.579 INFO:tasks.workunit.client.1.smithi117.stdout:4/256: dread d3/d4/f40 [0,4194304] 0 2024-09-19T06:40:28.580 INFO:tasks.workunit.client.1.smithi117.stdout:3/253: dwrite d0/f15 [0,4194304] 0 2024-09-19T06:40:28.580 INFO:tasks.workunit.client.1.smithi117.stdout:4/257: chown d3/d4/d14/l22 613168 1 2024-09-19T06:40:28.581 INFO:tasks.workunit.client.1.smithi117.stdout:4/258: fsync d3/de/f15 0 2024-09-19T06:40:28.581 INFO:tasks.workunit.client.1.smithi117.stdout:3/254: read - d0/d19/f41 zero size 2024-09-19T06:40:28.582 INFO:tasks.workunit.client.0.smithi099.stdout:2/48: dwrite d1/d2/d5/d8/fa [0,4194304] 0 2024-09-19T06:40:28.582 INFO:tasks.workunit.client.0.smithi099.stdout:0/49: getdents d0 0 2024-09-19T06:40:28.582 INFO:tasks.workunit.client.1.smithi117.stdout:3/255: readlink d0/d3d/l4d 0 2024-09-19T06:40:28.583 INFO:tasks.workunit.client.1.smithi117.stdout:3/256: chown d0/d8/f1a 411583242 1 2024-09-19T06:40:28.584 INFO:tasks.workunit.client.0.smithi099.stdout:3/87: sync 2024-09-19T06:40:28.584 INFO:tasks.workunit.client.1.smithi117.stdout:4/259: mknod d3/d4/d14/c61 0 2024-09-19T06:40:28.584 INFO:tasks.workunit.client.1.smithi117.stdout:3/257: dread - d0/d19/f41 zero size 2024-09-19T06:40:28.589 INFO:tasks.workunit.client.0.smithi099.stdout:2/49: chown d1/d2/d5 2899347 1 2024-09-19T06:40:28.589 INFO:tasks.workunit.client.1.smithi117.stdout:3/258: truncate d0/f14 15355 0 2024-09-19T06:40:28.590 INFO:tasks.workunit.client.1.smithi117.stdout:4/260: dwrite d3/db/f3a [0,4194304] 0 2024-09-19T06:40:28.591 INFO:tasks.workunit.client.0.smithi099.stdout:5/142: dread d3/d16/f28 [0,4194304] 0 2024-09-19T06:40:28.591 INFO:tasks.workunit.client.0.smithi099.stdout:3/88: chown d7/f12 5518516 1 2024-09-19T06:40:28.591 INFO:tasks.workunit.client.0.smithi099.stdout:2/50: stat d1/d2/d5/d8 0 2024-09-19T06:40:28.592 INFO:tasks.workunit.client.1.smithi117.stdout:3/259: dread d0/f12 [0,4194304] 0 2024-09-19T06:40:28.593 INFO:tasks.workunit.client.0.smithi099.stdout:6/63: dwrite d1/f9 [0,4194304] 0 2024-09-19T06:40:28.593 INFO:tasks.workunit.client.1.smithi117.stdout:3/260: write d0/f18 [6606021,111766] 0 2024-09-19T06:40:28.595 INFO:tasks.workunit.client.0.smithi099.stdout:2/51: write d1/d2/d5/d8/d9/ff [1091757,108634] 0 2024-09-19T06:40:28.598 INFO:tasks.workunit.client.1.smithi117.stdout:3/261: creat d0/d3d/f4f x:0 0 0 2024-09-19T06:40:28.598 INFO:tasks.workunit.client.0.smithi099.stdout:6/64: mknod d1/d12/c17 0 2024-09-19T06:40:28.600 INFO:tasks.workunit.client.0.smithi099.stdout:0/50: dread d0/f12 [0,4194304] 0 2024-09-19T06:40:28.600 INFO:tasks.workunit.client.0.smithi099.stdout:6/65: write d1/d5/f14 [4679,51470] 0 2024-09-19T06:40:28.602 INFO:tasks.workunit.client.0.smithi099.stdout:0/51: chown d0/db/fc 54481774 1 2024-09-19T06:40:28.603 INFO:tasks.workunit.client.0.smithi099.stdout:0/52: write d0/db/fc [4744,50074] 0 2024-09-19T06:40:28.604 INFO:tasks.workunit.client.0.smithi099.stdout:0/53: readlink d0/db/l10 0 2024-09-19T06:40:28.605 INFO:tasks.workunit.client.0.smithi099.stdout:2/52: link d1/d2/d5/d8/f11 d1/d2/f12 0 2024-09-19T06:40:28.605 INFO:tasks.workunit.client.1.smithi117.stdout:9/249: dread d4/d1c/f35 [0,4194304] 0 2024-09-19T06:40:28.607 INFO:tasks.workunit.client.0.smithi099.stdout:6/66: rmdir d1/d5 39 2024-09-19T06:40:28.609 INFO:tasks.workunit.client.0.smithi099.stdout:5/143: getdents d3/d16 0 2024-09-19T06:40:28.610 INFO:tasks.workunit.client.0.smithi099.stdout:5/144: write d3/d1f/f21 [164901,81720] 0 2024-09-19T06:40:28.611 INFO:tasks.workunit.client.0.smithi099.stdout:0/54: mknod d0/db/c15 0 2024-09-19T06:40:28.612 INFO:tasks.workunit.client.0.smithi099.stdout:0/55: write d0/db/fc [457026,118324] 0 2024-09-19T06:40:28.613 INFO:tasks.workunit.client.0.smithi099.stdout:6/67: write d1/d5/f14 [360128,93154] 0 2024-09-19T06:40:28.613 INFO:tasks.workunit.client.1.smithi117.stdout:9/250: dwrite d4/d8/fe [0,4194304] 0 2024-09-19T06:40:28.614 INFO:tasks.workunit.client.0.smithi099.stdout:5/145: creat d3/d2a/f32 x:0 0 0 2024-09-19T06:40:28.615 INFO:tasks.workunit.client.0.smithi099.stdout:5/146: dread - d3/d2a/f2e zero size 2024-09-19T06:40:28.615 INFO:tasks.workunit.client.0.smithi099.stdout:0/56: dread d0/db/fe [0,4194304] 0 2024-09-19T06:40:28.615 INFO:tasks.workunit.client.0.smithi099.stdout:5/147: readlink d3/l4 0 2024-09-19T06:40:28.616 INFO:tasks.workunit.client.0.smithi099.stdout:5/148: write d3/d2a/f2e [848341,4652] 0 2024-09-19T06:40:28.617 INFO:tasks.workunit.client.1.smithi117.stdout:9/251: creat d4/f51 x:0 0 0 2024-09-19T06:40:28.620 INFO:tasks.workunit.client.0.smithi099.stdout:0/57: dread d0/f3 [0,4194304] 0 2024-09-19T06:40:28.623 INFO:tasks.workunit.client.0.smithi099.stdout:6/68: link d1/l11 d1/l18 0 2024-09-19T06:40:28.626 INFO:tasks.workunit.client.0.smithi099.stdout:4/74: dwrite fb [0,4194304] 0 2024-09-19T06:40:28.629 INFO:tasks.workunit.client.0.smithi099.stdout:6/69: creat d1/f19 x:0 0 0 2024-09-19T06:40:28.630 INFO:tasks.workunit.client.0.smithi099.stdout:5/149: dwrite d3/f25 [0,4194304] 0 2024-09-19T06:40:28.631 INFO:tasks.workunit.client.0.smithi099.stdout:4/75: creat d12/d1b/d1c/f1f x:0 0 0 2024-09-19T06:40:28.632 INFO:tasks.workunit.client.0.smithi099.stdout:6/70: dread - d1/d5/f13 zero size 2024-09-19T06:40:28.632 INFO:tasks.workunit.client.0.smithi099.stdout:5/150: stat d3/l4 0 2024-09-19T06:40:28.637 INFO:tasks.workunit.client.0.smithi099.stdout:5/151: rename d3/l1a to d3/d16/l33 0 2024-09-19T06:40:28.637 INFO:tasks.workunit.client.0.smithi099.stdout:4/76: link cd d12/d1b/c20 0 2024-09-19T06:40:28.639 INFO:tasks.workunit.client.0.smithi099.stdout:4/77: read fb [685725,122875] 0 2024-09-19T06:40:28.639 INFO:tasks.workunit.client.0.smithi099.stdout:5/152: mkdir d3/d16/d2f/d34 0 2024-09-19T06:40:28.641 INFO:tasks.workunit.client.0.smithi099.stdout:6/71: dwrite d1/fe [0,4194304] 0 2024-09-19T06:40:28.643 INFO:tasks.workunit.client.0.smithi099.stdout:5/153: creat d3/d14/f35 x:0 0 0 2024-09-19T06:40:28.644 INFO:tasks.workunit.client.0.smithi099.stdout:6/72: mknod d1/d5/c1a 0 2024-09-19T06:40:28.645 INFO:tasks.workunit.client.0.smithi099.stdout:6/73: chown d1/f19 49138674 1 2024-09-19T06:40:28.646 INFO:tasks.workunit.client.0.smithi099.stdout:4/78: dread f5 [0,4194304] 0 2024-09-19T06:40:28.646 INFO:tasks.workunit.client.0.smithi099.stdout:6/74: chown d1/d12/c16 178204088 1 2024-09-19T06:40:28.647 INFO:tasks.workunit.client.1.smithi117.stdout:4/261: write d3/d4/f9 [257241,35098] 0 2024-09-19T06:40:28.648 INFO:tasks.workunit.client.0.smithi099.stdout:5/154: mknod d3/c36 0 2024-09-19T06:40:28.652 INFO:tasks.workunit.client.0.smithi099.stdout:3/89: truncate d7/f10 883588 0 2024-09-19T06:40:28.653 INFO:tasks.workunit.client.1.smithi117.stdout:4/262: dwrite d3/f2b [0,4194304] 0 2024-09-19T06:40:28.656 INFO:tasks.workunit.client.1.smithi117.stdout:4/263: write d3/db/d20/d35/d45/f5d [985309,94774] 0 2024-09-19T06:40:28.657 INFO:tasks.workunit.client.0.smithi099.stdout:6/75: dwrite d1/f9 [0,4194304] 0 2024-09-19T06:40:28.658 INFO:tasks.workunit.client.0.smithi099.stdout:5/155: dwrite d3/f27 [0,4194304] 0 2024-09-19T06:40:28.659 INFO:tasks.workunit.client.0.smithi099.stdout:4/79: rename c9 to d12/d1b/c21 0 2024-09-19T06:40:28.659 INFO:tasks.workunit.client.1.smithi117.stdout:4/264: creat d3/d1b/f62 x:0 0 0 2024-09-19T06:40:28.661 INFO:tasks.workunit.client.1.smithi117.stdout:4/265: mkdir d3/d1b/d63 0 2024-09-19T06:40:28.662 INFO:tasks.workunit.client.1.smithi117.stdout:4/266: write d3/d4/f18 [918079,38385] 0 2024-09-19T06:40:28.664 INFO:tasks.workunit.client.1.smithi117.stdout:4/267: write d3/db/f43 [4399335,91482] 0 2024-09-19T06:40:28.666 INFO:tasks.workunit.client.0.smithi099.stdout:0/58: truncate d0/f12 4065071 0 2024-09-19T06:40:28.667 INFO:tasks.workunit.client.0.smithi099.stdout:3/90: getdents d7 0 2024-09-19T06:40:28.669 INFO:tasks.workunit.client.0.smithi099.stdout:3/91: readlink d7/l11 0 2024-09-19T06:40:28.670 INFO:tasks.workunit.client.0.smithi099.stdout:3/92: dread - d7/f12 zero size 2024-09-19T06:40:28.672 INFO:tasks.workunit.client.0.smithi099.stdout:5/156: rename d3/f27 to d3/f37 0 2024-09-19T06:40:28.673 INFO:tasks.workunit.client.1.smithi117.stdout:4/268: dwrite d3/d4/f40 [0,4194304] 0 2024-09-19T06:40:28.673 INFO:tasks.workunit.client.0.smithi099.stdout:5/157: chown d3/d14 0 1 2024-09-19T06:40:28.674 INFO:tasks.workunit.client.0.smithi099.stdout:4/80: dwrite fb [4194304,4194304] 0 2024-09-19T06:40:28.675 INFO:tasks.workunit.client.1.smithi117.stdout:4/269: symlink d3/db/d20/d29/l64 0 2024-09-19T06:40:28.678 INFO:tasks.workunit.client.1.smithi117.stdout:4/270: mkdir d3/d65 0 2024-09-19T06:40:28.678 INFO:tasks.workunit.client.0.smithi099.stdout:5/158: creat d3/d14/f38 x:0 0 0 2024-09-19T06:40:28.681 INFO:tasks.workunit.client.0.smithi099.stdout:4/81: symlink d12/d1b/l22 0 2024-09-19T06:40:28.682 INFO:tasks.workunit.client.0.smithi099.stdout:5/159: symlink d3/l39 0 2024-09-19T06:40:28.684 INFO:tasks.workunit.client.0.smithi099.stdout:4/82: symlink d12/d1b/d1c/l23 0 2024-09-19T06:40:28.685 INFO:tasks.workunit.client.0.smithi099.stdout:5/160: mknod d3/d1f/c3a 0 2024-09-19T06:40:28.687 INFO:tasks.workunit.client.0.smithi099.stdout:5/161: creat d3/d7/f3b x:0 0 0 2024-09-19T06:40:28.688 INFO:tasks.workunit.client.0.smithi099.stdout:4/83: unlink cc 0 2024-09-19T06:40:28.696 INFO:tasks.workunit.client.0.smithi099.stdout:5/162: dwrite d3/d7/fb [0,4194304] 0 2024-09-19T06:40:28.696 INFO:tasks.workunit.client.0.smithi099.stdout:4/84: mkdir d12/d1b/d24 0 2024-09-19T06:40:28.697 INFO:tasks.workunit.client.0.smithi099.stdout:4/85: write d12/f1a [363805,47630] 0 2024-09-19T06:40:28.701 INFO:tasks.workunit.client.0.smithi099.stdout:5/163: unlink d3/d1f/f31 0 2024-09-19T06:40:28.705 INFO:tasks.workunit.client.0.smithi099.stdout:3/93: write d7/f10 [538174,53283] 0 2024-09-19T06:40:28.706 INFO:tasks.workunit.client.0.smithi099.stdout:3/94: readlink l0 0 2024-09-19T06:40:28.706 INFO:tasks.workunit.client.0.smithi099.stdout:4/86: creat d12/d1b/d1c/f25 x:0 0 0 2024-09-19T06:40:28.708 INFO:tasks.workunit.client.1.smithi117.stdout:3/262: dwrite d0/f14 [0,4194304] 0 2024-09-19T06:40:28.710 INFO:tasks.workunit.client.0.smithi099.stdout:4/87: fdatasync ff 0 2024-09-19T06:40:28.712 INFO:tasks.workunit.client.0.smithi099.stdout:3/95: creat d7/f14 x:0 0 0 2024-09-19T06:40:28.713 INFO:tasks.workunit.client.0.smithi099.stdout:0/59: dwrite d0/f7 [0,4194304] 0 2024-09-19T06:40:28.715 INFO:tasks.workunit.client.0.smithi099.stdout:0/60: chown d0/db/l10 12189027 1 2024-09-19T06:40:28.717 INFO:tasks.workunit.client.0.smithi099.stdout:5/164: dwrite d3/f25 [0,4194304] 0 2024-09-19T06:40:28.717 INFO:tasks.workunit.client.0.smithi099.stdout:0/61: dread d0/f3 [0,4194304] 0 2024-09-19T06:40:28.719 INFO:tasks.workunit.client.0.smithi099.stdout:3/96: unlink d7/ce 0 2024-09-19T06:40:28.719 INFO:tasks.workunit.client.0.smithi099.stdout:4/88: creat d12/d1b/d1c/f26 x:0 0 0 2024-09-19T06:40:28.722 INFO:tasks.workunit.client.0.smithi099.stdout:3/97: chown f6 1869890751 1 2024-09-19T06:40:28.722 INFO:tasks.workunit.client.0.smithi099.stdout:3/98: read - d7/f14 zero size 2024-09-19T06:40:28.722 INFO:tasks.workunit.client.0.smithi099.stdout:3/99: readlink l0 0 2024-09-19T06:40:28.727 INFO:tasks.workunit.client.0.smithi099.stdout:5/165: mkdir d3/d16/d2f/d34/d3c 0 2024-09-19T06:40:28.728 INFO:tasks.workunit.client.0.smithi099.stdout:4/89: link d12/f18 d12/d1b/d24/f27 0 2024-09-19T06:40:28.729 INFO:tasks.workunit.client.0.smithi099.stdout:3/100: link d7/f14 d7/f15 0 2024-09-19T06:40:28.730 INFO:tasks.workunit.client.0.smithi099.stdout:3/101: stat d7/f13 0 2024-09-19T06:40:28.732 INFO:tasks.workunit.client.0.smithi099.stdout:5/166: dread d3/d7/fa [0,4194304] 0 2024-09-19T06:40:28.736 INFO:tasks.workunit.client.0.smithi099.stdout:5/167: getdents d3/d7 0 2024-09-19T06:40:28.736 INFO:tasks.workunit.client.0.smithi099.stdout:4/90: dwrite d12/d1b/d1c/f26 [0,4194304] 0 2024-09-19T06:40:28.739 INFO:tasks.workunit.client.0.smithi099.stdout:5/168: symlink d3/d16/l3d 0 2024-09-19T06:40:28.739 INFO:tasks.workunit.client.0.smithi099.stdout:5/169: dread - d3/d14/f35 zero size 2024-09-19T06:40:28.740 INFO:tasks.workunit.client.0.smithi099.stdout:4/91: mknod d12/d1b/c28 0 2024-09-19T06:40:28.745 INFO:tasks.workunit.client.0.smithi099.stdout:4/92: rmdir d12/d1b 39 2024-09-19T06:40:28.745 INFO:tasks.workunit.client.0.smithi099.stdout:5/170: symlink d3/d16/d2f/d34/d3c/l3e 0 2024-09-19T06:40:28.747 INFO:tasks.workunit.client.1.smithi117.stdout:3/263: dread d0/f13 [0,4194304] 0 2024-09-19T06:40:28.747 INFO:tasks.workunit.client.0.smithi099.stdout:5/171: mknod d3/d7/c3f 0 2024-09-19T06:40:28.747 INFO:tasks.workunit.client.1.smithi117.stdout:3/264: chown d0/f18 2801 1 2024-09-19T06:40:28.749 INFO:tasks.workunit.client.0.smithi099.stdout:5/172: symlink d3/d1f/l40 0 2024-09-19T06:40:28.749 INFO:tasks.workunit.client.1.smithi117.stdout:3/265: creat d0/d9/f50 x:0 0 0 2024-09-19T06:40:28.750 INFO:tasks.workunit.client.1.smithi117.stdout:3/266: stat d0/d24/f2f 0 2024-09-19T06:40:28.751 INFO:tasks.workunit.client.0.smithi099.stdout:3/102: getdents d7 0 2024-09-19T06:40:28.752 INFO:tasks.workunit.client.0.smithi099.stdout:5/173: rename d3/d16/l3d to d3/d16/d2f/d34/l41 0 2024-09-19T06:40:28.756 INFO:tasks.workunit.client.1.smithi117.stdout:3/267: write d0/d9/fc [1024896,84051] 0 2024-09-19T06:40:28.756 INFO:tasks.workunit.client.0.smithi099.stdout:5/174: rename d3/d14/l24 to d3/d16/l42 0 2024-09-19T06:40:28.757 INFO:tasks.workunit.client.0.smithi099.stdout:0/62: write d0/f12 [2557134,74377] 0 2024-09-19T06:40:28.759 INFO:tasks.workunit.client.0.smithi099.stdout:3/103: truncate d7/fa 2803547 0 2024-09-19T06:40:28.759 INFO:tasks.workunit.client.0.smithi099.stdout:0/63: write d0/db/f14 [682307,130039] 0 2024-09-19T06:40:28.760 INFO:tasks.workunit.client.0.smithi099.stdout:5/175: fsync d3/d16/f28 0 2024-09-19T06:40:28.761 INFO:tasks.workunit.client.0.smithi099.stdout:3/104: mkdir d7/d16 0 2024-09-19T06:40:28.761 INFO:tasks.workunit.client.0.smithi099.stdout:3/105: readlink l0 0 2024-09-19T06:40:28.763 INFO:tasks.workunit.client.0.smithi099.stdout:0/64: rename d0/lf to d0/db/d13/l16 0 2024-09-19T06:40:28.763 INFO:tasks.workunit.client.1.smithi117.stdout:3/268: dwrite d0/d3d/f4f [0,4194304] 0 2024-09-19T06:40:28.765 INFO:tasks.workunit.client.1.smithi117.stdout:3/269: symlink d0/d9/d1c/l51 0 2024-09-19T06:40:28.767 INFO:tasks.workunit.client.0.smithi099.stdout:5/176: dwrite d3/f25 [0,4194304] 0 2024-09-19T06:40:28.767 INFO:tasks.workunit.client.1.smithi117.stdout:3/270: symlink d0/d8/l52 0 2024-09-19T06:40:28.768 INFO:tasks.workunit.client.0.smithi099.stdout:8/45: sync 2024-09-19T06:40:28.768 INFO:tasks.workunit.client.0.smithi099.stdout:9/104: sync 2024-09-19T06:40:28.768 INFO:tasks.workunit.client.0.smithi099.stdout:5/177: chown d3/d7 11256 1 2024-09-19T06:40:28.770 INFO:tasks.workunit.client.0.smithi099.stdout:0/65: mkdir d0/d17 0 2024-09-19T06:40:28.772 INFO:tasks.workunit.client.0.smithi099.stdout:9/105: creat dd/d10/d13/f1e x:0 0 0 2024-09-19T06:40:28.774 INFO:tasks.workunit.client.0.smithi099.stdout:0/66: rmdir d0/db/d13 39 2024-09-19T06:40:28.775 INFO:tasks.workunit.client.1.smithi117.stdout:3/271: dwrite d0/fb [0,4194304] 0 2024-09-19T06:40:28.775 INFO:tasks.workunit.client.0.smithi099.stdout:0/67: fdatasync d0/f7 0 2024-09-19T06:40:28.777 INFO:tasks.workunit.client.0.smithi099.stdout:0/68: stat d0/l8 0 2024-09-19T06:40:28.780 INFO:tasks.workunit.client.1.smithi117.stdout:3/272: unlink d0/d9/d1c/f32 0 2024-09-19T06:40:28.781 INFO:tasks.workunit.client.1.smithi117.stdout:3/273: readlink d0/d19/l26 0 2024-09-19T06:40:28.782 INFO:tasks.workunit.client.1.smithi117.stdout:3/274: rmdir d0/d9/d1c/d36 39 2024-09-19T06:40:28.784 INFO:tasks.workunit.client.0.smithi099.stdout:9/106: getdents dd/d10 0 2024-09-19T06:40:28.786 INFO:tasks.workunit.client.1.smithi117.stdout:3/275: mkdir d0/d9/d1c/d53 0 2024-09-19T06:40:28.788 INFO:tasks.workunit.client.0.smithi099.stdout:5/178: dwrite d3/d7/f1c [0,4194304] 0 2024-09-19T06:40:28.788 INFO:tasks.workunit.client.0.smithi099.stdout:3/106: dwrite d7/f14 [0,4194304] 0 2024-09-19T06:40:28.793 INFO:tasks.workunit.client.0.smithi099.stdout:8/46: truncate f3 3776861 0 2024-09-19T06:40:28.793 INFO:tasks.workunit.client.0.smithi099.stdout:9/107: creat dd/f1f x:0 0 0 2024-09-19T06:40:28.793 INFO:tasks.workunit.client.0.smithi099.stdout:3/107: chown f6 481 1 2024-09-19T06:40:28.794 INFO:tasks.workunit.client.1.smithi117.stdout:3/276: dwrite d0/f13 [0,4194304] 0 2024-09-19T06:40:28.795 INFO:tasks.workunit.client.0.smithi099.stdout:0/69: dwrite d0/db/fc [0,4194304] 0 2024-09-19T06:40:28.795 INFO:tasks.workunit.client.0.smithi099.stdout:5/179: mknod d3/d16/c43 0 2024-09-19T06:40:28.795 INFO:tasks.workunit.client.0.smithi099.stdout:8/47: stat c1 0 2024-09-19T06:40:28.797 INFO:tasks.workunit.client.0.smithi099.stdout:3/108: fdatasync d7/fc 0 2024-09-19T06:40:28.798 INFO:tasks.workunit.client.0.smithi099.stdout:8/48: fsync d4/f9 0 2024-09-19T06:40:28.799 INFO:tasks.workunit.client.0.smithi099.stdout:0/70: write d0/f12 [4655565,35114] 0 2024-09-19T06:40:28.799 INFO:tasks.workunit.client.0.smithi099.stdout:3/109: fsync d7/f10 0 2024-09-19T06:40:28.800 INFO:tasks.workunit.client.0.smithi099.stdout:8/49: fdatasync d4/f9 0 2024-09-19T06:40:28.801 INFO:tasks.workunit.client.1.smithi117.stdout:3/277: dread d0/f14 [0,4194304] 0 2024-09-19T06:40:28.802 INFO:tasks.workunit.client.1.smithi117.stdout:3/278: write d0/d9/d1c/f1d [879053,58158] 0 2024-09-19T06:40:28.804 INFO:tasks.workunit.client.0.smithi099.stdout:5/180: rename d3/l39 to d3/d16/l44 0 2024-09-19T06:40:28.805 INFO:tasks.workunit.client.1.smithi117.stdout:3/279: creat d0/d19/f54 x:0 0 0 2024-09-19T06:40:28.811 INFO:tasks.workunit.client.0.smithi099.stdout:8/50: creat d4/fd x:0 0 0 2024-09-19T06:40:28.813 INFO:tasks.workunit.client.1.smithi117.stdout:3/280: dwrite d0/d9/d49/f43 [0,4194304] 0 2024-09-19T06:40:28.814 INFO:tasks.workunit.client.0.smithi099.stdout:9/108: dwrite dd/d10/d13/f1e [0,4194304] 0 2024-09-19T06:40:28.817 INFO:tasks.workunit.client.1.smithi117.stdout:3/281: mknod d0/d9/c55 0 2024-09-19T06:40:28.820 INFO:tasks.workunit.client.0.smithi099.stdout:3/110: dwrite d7/f15 [4194304,4194304] 0 2024-09-19T06:40:28.821 INFO:tasks.workunit.client.0.smithi099.stdout:5/181: creat d3/d2a/f45 x:0 0 0 2024-09-19T06:40:28.822 INFO:tasks.workunit.client.0.smithi099.stdout:9/109: symlink dd/d10/l20 0 2024-09-19T06:40:28.822 INFO:tasks.workunit.client.0.smithi099.stdout:5/182: write d3/d14/f38 [592038,103442] 0 2024-09-19T06:40:28.823 INFO:tasks.workunit.client.0.smithi099.stdout:3/111: getdents d7/d16 0 2024-09-19T06:40:28.825 INFO:tasks.workunit.client.0.smithi099.stdout:3/112: read d7/fc [909430,68221] 0 2024-09-19T06:40:28.827 INFO:tasks.workunit.client.0.smithi099.stdout:9/110: dread fb [0,4194304] 0 2024-09-19T06:40:28.828 INFO:tasks.workunit.client.0.smithi099.stdout:3/113: write d7/fd [3573643,71402] 0 2024-09-19T06:40:28.828 INFO:tasks.workunit.client.0.smithi099.stdout:9/111: fsync fa 0 2024-09-19T06:40:28.830 INFO:tasks.workunit.client.0.smithi099.stdout:5/183: getdents d3/d14 0 2024-09-19T06:40:28.832 INFO:tasks.workunit.client.0.smithi099.stdout:5/184: dread d3/d7/ff [0,4194304] 0 2024-09-19T06:40:28.832 INFO:tasks.workunit.client.0.smithi099.stdout:3/114: dread d7/fc [0,4194304] 0 2024-09-19T06:40:28.834 INFO:tasks.workunit.client.0.smithi099.stdout:5/185: creat d3/d16/d2f/d34/d3c/f46 x:0 0 0 2024-09-19T06:40:28.835 INFO:tasks.workunit.client.0.smithi099.stdout:3/115: creat d7/d16/f17 x:0 0 0 2024-09-19T06:40:28.836 INFO:tasks.workunit.client.0.smithi099.stdout:5/186: dread d3/d7/f11 [0,4194304] 0 2024-09-19T06:40:28.837 INFO:tasks.workunit.client.0.smithi099.stdout:3/116: creat d7/f18 x:0 0 0 2024-09-19T06:40:28.839 INFO:tasks.workunit.client.0.smithi099.stdout:3/117: dread d7/f10 [0,4194304] 0 2024-09-19T06:40:28.840 INFO:tasks.workunit.client.0.smithi099.stdout:3/118: write d7/f14 [7895857,120398] 0 2024-09-19T06:40:28.851 INFO:tasks.workunit.client.1.smithi117.stdout:3/282: dwrite d0/f1e [4194304,4194304] 0 2024-09-19T06:40:28.853 INFO:tasks.workunit.client.1.smithi117.stdout:3/283: mknod d0/d3d/c56 0 2024-09-19T06:40:28.858 INFO:tasks.workunit.client.1.smithi117.stdout:3/284: creat d0/d9/d1c/d36/f57 x:0 0 0 2024-09-19T06:40:28.858 INFO:tasks.workunit.client.1.smithi117.stdout:3/285: fsync d0/f15 0 2024-09-19T06:40:28.860 INFO:tasks.workunit.client.1.smithi117.stdout:3/286: creat d0/d24/f58 x:0 0 0 2024-09-19T06:40:28.862 INFO:tasks.workunit.client.1.smithi117.stdout:3/287: unlink d0/d8/f16 0 2024-09-19T06:40:28.864 INFO:tasks.workunit.client.0.smithi099.stdout:3/119: truncate d7/f14 804691 0 2024-09-19T06:40:28.864 INFO:tasks.workunit.client.1.smithi117.stdout:3/288: dread d0/d9/d1c/f28 [0,4194304] 0 2024-09-19T06:40:28.866 INFO:tasks.workunit.client.0.smithi099.stdout:3/120: symlink d7/d16/l19 0 2024-09-19T06:40:28.866 INFO:tasks.workunit.client.0.smithi099.stdout:9/112: dread dd/d10/d13/f18 [0,4194304] 0 2024-09-19T06:40:28.868 INFO:tasks.workunit.client.0.smithi099.stdout:9/113: creat dd/d10/d13/f21 x:0 0 0 2024-09-19T06:40:28.870 INFO:tasks.workunit.client.0.smithi099.stdout:3/121: rmdir d7 39 2024-09-19T06:40:28.875 INFO:tasks.workunit.client.0.smithi099.stdout:9/114: dwrite dd/d10/d13/f21 [0,4194304] 0 2024-09-19T06:40:28.875 INFO:tasks.workunit.client.0.smithi099.stdout:3/122: link d7/ff d7/f1a 0 2024-09-19T06:40:28.878 INFO:tasks.workunit.client.0.smithi099.stdout:3/123: rename d7/fd to d7/d16/f1b 0 2024-09-19T06:40:28.879 INFO:tasks.workunit.client.0.smithi099.stdout:9/115: creat dd/f22 x:0 0 0 2024-09-19T06:40:28.879 INFO:tasks.workunit.client.0.smithi099.stdout:3/124: symlink d7/d16/l1c 0 2024-09-19T06:40:28.880 INFO:tasks.workunit.client.0.smithi099.stdout:3/125: write d7/ff [4679510,8970] 0 2024-09-19T06:40:28.883 INFO:tasks.workunit.client.0.smithi099.stdout:3/126: write d7/f15 [571482,108782] 0 2024-09-19T06:40:28.885 INFO:tasks.workunit.client.0.smithi099.stdout:9/116: rename dd/d10/c12 to dd/c23 0 2024-09-19T06:40:28.885 INFO:tasks.workunit.client.0.smithi099.stdout:3/127: unlink d7/c9 0 2024-09-19T06:40:28.888 INFO:tasks.workunit.client.0.smithi099.stdout:3/128: mkdir d7/d16/d1d 0 2024-09-19T06:40:28.888 INFO:tasks.workunit.client.0.smithi099.stdout:3/129: dread - d7/f18 zero size 2024-09-19T06:40:28.919 INFO:tasks.workunit.client.1.smithi117.stdout:7/244: sync 2024-09-19T06:40:28.954 INFO:tasks.workunit.client.0.smithi099.stdout:3/130: truncate d7/d16/f1b 3014873 0 2024-09-19T06:40:28.954 INFO:tasks.workunit.client.0.smithi099.stdout:9/117: readlink dd/d10/d13/l1d 0 2024-09-19T06:40:28.955 INFO:tasks.workunit.client.0.smithi099.stdout:9/118: chown dd/d10/d13/f1e 1770390 1 2024-09-19T06:40:28.955 INFO:tasks.workunit.client.0.smithi099.stdout:9/119: chown l7 9838559 1 2024-09-19T06:40:28.955 INFO:tasks.workunit.client.0.smithi099.stdout:9/120: stat dd/d10 0 2024-09-19T06:40:28.955 INFO:tasks.workunit.client.0.smithi099.stdout:3/131: fdatasync d7/fa 0 2024-09-19T06:40:28.956 INFO:tasks.workunit.client.0.smithi099.stdout:3/132: truncate d7/f10 1592833 0 2024-09-19T06:40:28.960 INFO:tasks.workunit.client.0.smithi099.stdout:9/121: dwrite dd/d10/d13/f21 [0,4194304] 0 2024-09-19T06:40:28.961 INFO:tasks.workunit.client.0.smithi099.stdout:3/133: write d7/f12 [956302,120265] 0 2024-09-19T06:40:29.009 INFO:tasks.workunit.client.0.smithi099.stdout:9/122: unlink dd/d10/d13/f1e 0 2024-09-19T06:40:29.011 INFO:tasks.workunit.client.0.smithi099.stdout:3/134: read d7/d16/f1b [1222965,62948] 0 2024-09-19T06:40:29.013 INFO:tasks.workunit.client.0.smithi099.stdout:3/135: symlink d7/d16/d1d/l1e 0 2024-09-19T06:40:29.015 INFO:tasks.workunit.client.0.smithi099.stdout:9/123: dwrite dd/d10/d13/f18 [0,4194304] 0 2024-09-19T06:40:29.015 INFO:tasks.workunit.client.0.smithi099.stdout:9/124: readlink lc 0 2024-09-19T06:40:29.016 INFO:tasks.workunit.client.0.smithi099.stdout:9/125: read dd/d10/d13/f21 [3658839,121592] 0 2024-09-19T06:40:29.020 INFO:tasks.workunit.client.0.smithi099.stdout:9/126: symlink dd/d10/l24 0 2024-09-19T06:40:29.020 INFO:tasks.workunit.client.0.smithi099.stdout:3/136: dwrite d7/f12 [0,4194304] 0 2024-09-19T06:40:29.021 INFO:tasks.workunit.client.0.smithi099.stdout:9/127: readlink l0 0 2024-09-19T06:40:29.021 INFO:tasks.workunit.client.0.smithi099.stdout:3/137: read d7/f1a [1450828,2894] 0 2024-09-19T06:40:29.025 INFO:tasks.workunit.client.0.smithi099.stdout:9/128: dread fb [0,4194304] 0 2024-09-19T06:40:29.028 INFO:tasks.workunit.client.0.smithi099.stdout:9/129: creat dd/d10/d13/f25 x:0 0 0 2024-09-19T06:40:29.028 INFO:tasks.workunit.client.0.smithi099.stdout:9/130: readlink dd/d10/l20 0 2024-09-19T06:40:29.035 INFO:tasks.workunit.client.0.smithi099.stdout:9/131: dwrite dd/d10/d13/f21 [0,4194304] 0 2024-09-19T06:40:29.037 INFO:tasks.workunit.client.0.smithi099.stdout:9/132: mknod dd/d10/c26 0 2024-09-19T06:40:29.038 INFO:tasks.workunit.client.0.smithi099.stdout:9/133: write dd/d10/d13/f1a [3308815,21059] 0 2024-09-19T06:40:29.038 INFO:tasks.workunit.client.0.smithi099.stdout:9/134: dread - dd/f1f zero size 2024-09-19T06:40:29.041 INFO:tasks.workunit.client.0.smithi099.stdout:9/135: mkdir dd/d10/d13/d27 0 2024-09-19T06:40:29.041 INFO:tasks.workunit.client.0.smithi099.stdout:9/136: dread - dd/f19 zero size 2024-09-19T06:40:29.044 INFO:tasks.workunit.client.0.smithi099.stdout:3/138: truncate d7/f14 267345 0 2024-09-19T06:40:29.044 INFO:tasks.workunit.client.0.smithi099.stdout:9/137: symlink dd/d10/d13/d27/l28 0 2024-09-19T06:40:29.045 INFO:tasks.workunit.client.0.smithi099.stdout:9/138: readlink l7 0 2024-09-19T06:40:29.045 INFO:tasks.workunit.client.0.smithi099.stdout:9/139: write fa [1071463,124900] 0 2024-09-19T06:40:29.046 INFO:tasks.workunit.client.0.smithi099.stdout:3/139: creat d7/d16/f1f x:0 0 0 2024-09-19T06:40:29.048 INFO:tasks.workunit.client.0.smithi099.stdout:9/140: mknod dd/d10/c29 0 2024-09-19T06:40:29.049 INFO:tasks.workunit.client.0.smithi099.stdout:9/141: write dd/f19 [696759,49030] 0 2024-09-19T06:40:29.049 INFO:tasks.workunit.client.0.smithi099.stdout:7/112: sync 2024-09-19T06:40:29.049 INFO:tasks.workunit.client.0.smithi099.stdout:1/68: sync 2024-09-19T06:40:29.050 INFO:tasks.workunit.client.0.smithi099.stdout:1/69: chown d0/f6 243 1 2024-09-19T06:40:29.050 INFO:tasks.workunit.client.0.smithi099.stdout:9/142: chown dd/d10/d13/d27/l28 0 1 2024-09-19T06:40:29.051 INFO:tasks.workunit.client.0.smithi099.stdout:7/113: mknod d7/c2d 0 2024-09-19T06:40:29.052 INFO:tasks.workunit.client.0.smithi099.stdout:9/143: readlink dd/d10/d13/l1d 0 2024-09-19T06:40:29.052 INFO:tasks.workunit.client.0.smithi099.stdout:3/140: dread d7/f1a [0,4194304] 0 2024-09-19T06:40:29.052 INFO:tasks.workunit.client.0.smithi099.stdout:1/70: mkdir d0/d12/d13 0 2024-09-19T06:40:29.053 INFO:tasks.workunit.client.0.smithi099.stdout:7/114: truncate d7/fa 308108 0 2024-09-19T06:40:29.053 INFO:tasks.workunit.client.0.smithi099.stdout:1/71: write d0/f6 [238107,49463] 0 2024-09-19T06:40:29.054 INFO:tasks.workunit.client.0.smithi099.stdout:3/141: mkdir d7/d16/d1d/d20 0 2024-09-19T06:40:29.055 INFO:tasks.workunit.client.0.smithi099.stdout:1/72: write d0/db/f11 [770351,24695] 0 2024-09-19T06:40:29.056 INFO:tasks.workunit.client.0.smithi099.stdout:1/73: dread - d0/db/dd/fc zero size 2024-09-19T06:40:29.056 INFO:tasks.workunit.client.0.smithi099.stdout:9/144: link dd/f16 dd/d10/d13/d27/f2a 0 2024-09-19T06:40:29.057 INFO:tasks.workunit.client.0.smithi099.stdout:3/142: fdatasync d7/fa 0 2024-09-19T06:40:29.058 INFO:tasks.workunit.client.0.smithi099.stdout:1/74: symlink d0/l14 0 2024-09-19T06:40:29.063 INFO:tasks.workunit.client.0.smithi099.stdout:9/145: rename l8 to dd/l2b 0 2024-09-19T06:40:29.064 INFO:tasks.workunit.client.0.smithi099.stdout:9/146: write dd/f22 [110262,16205] 0 2024-09-19T06:40:29.065 INFO:tasks.workunit.client.0.smithi099.stdout:1/75: link d0/f9 d0/db/dd/f15 0 2024-09-19T06:40:29.068 INFO:tasks.workunit.client.0.smithi099.stdout:1/76: creat d0/f16 x:0 0 0 2024-09-19T06:40:29.068 INFO:tasks.workunit.client.1.smithi117.stdout:2/226: sync 2024-09-19T06:40:29.069 INFO:tasks.workunit.client.0.smithi099.stdout:9/147: dread dd/d10/d13/d27/f2a [0,4194304] 0 2024-09-19T06:40:29.069 INFO:tasks.workunit.client.0.smithi099.stdout:1/77: chown d0/db/f11 48934 1 2024-09-19T06:40:29.069 INFO:tasks.workunit.client.0.smithi099.stdout:3/143: getdents d7 0 2024-09-19T06:40:29.070 INFO:tasks.workunit.client.1.smithi117.stdout:2/227: write d0/fd [23420,94523] 0 2024-09-19T06:40:29.071 INFO:tasks.workunit.client.0.smithi099.stdout:1/78: mkdir d0/d17 0 2024-09-19T06:40:29.073 INFO:tasks.workunit.client.0.smithi099.stdout:3/144: dread d7/f1a [0,4194304] 0 2024-09-19T06:40:29.073 INFO:tasks.workunit.client.0.smithi099.stdout:1/79: fdatasync d0/f9 0 2024-09-19T06:40:29.075 INFO:tasks.workunit.client.0.smithi099.stdout:1/80: write d0/db/dd/fc [979266,118840] 0 2024-09-19T06:40:29.078 INFO:tasks.workunit.client.0.smithi099.stdout:3/145: truncate d7/fc 644200 0 2024-09-19T06:40:29.079 INFO:tasks.workunit.client.0.smithi099.stdout:7/115: write d7/dd/d29/d1f/f2a [899895,115532] 0 2024-09-19T06:40:29.079 INFO:tasks.workunit.client.0.smithi099.stdout:3/146: readlink d7/l11 0 2024-09-19T06:40:29.080 INFO:tasks.workunit.client.0.smithi099.stdout:1/81: creat d0/db/dd/f18 x:0 0 0 2024-09-19T06:40:29.080 INFO:tasks.workunit.client.0.smithi099.stdout:3/147: write d7/d16/f17 [734127,15364] 0 2024-09-19T06:40:29.081 INFO:tasks.workunit.client.0.smithi099.stdout:7/116: mknod d7/dd/c2e 0 2024-09-19T06:40:29.083 INFO:tasks.workunit.client.0.smithi099.stdout:3/148: creat d7/d16/d1d/f21 x:0 0 0 2024-09-19T06:40:29.084 INFO:tasks.workunit.client.0.smithi099.stdout:1/82: dread d0/db/f11 [0,4194304] 0 2024-09-19T06:40:29.084 INFO:tasks.workunit.client.0.smithi099.stdout:7/117: rename d7/f17 to d7/dd/d29/f2f 0 2024-09-19T06:40:29.085 INFO:tasks.workunit.client.0.smithi099.stdout:1/83: chown d0/f5 14 1 2024-09-19T06:40:29.085 INFO:tasks.workunit.client.0.smithi099.stdout:7/118: rename d7/dd to d7/dd/d30 22 2024-09-19T06:40:29.086 INFO:tasks.workunit.client.0.smithi099.stdout:3/149: getdents d7 0 2024-09-19T06:40:29.086 INFO:tasks.workunit.client.0.smithi099.stdout:7/119: chown d7/dd/d29 3943040 1 2024-09-19T06:40:29.086 INFO:tasks.workunit.client.0.smithi099.stdout:3/150: chown d7/l11 378 1 2024-09-19T06:40:29.088 INFO:tasks.workunit.client.1.smithi117.stdout:2/228: dread d0/d12/f28 [0,4194304] 0 2024-09-19T06:40:29.090 INFO:tasks.workunit.client.0.smithi099.stdout:7/120: creat d7/f31 x:0 0 0 2024-09-19T06:40:29.091 INFO:tasks.workunit.client.0.smithi099.stdout:1/84: rmdir d0/db/dd 39 2024-09-19T06:40:29.095 INFO:tasks.workunit.client.0.smithi099.stdout:1/85: write d0/db/dd/f15 [532302,111466] 0 2024-09-19T06:40:29.100 INFO:tasks.workunit.client.0.smithi099.stdout:1/86: rename d0/db/dd/f15 to d0/db/f19 0 2024-09-19T06:40:29.101 INFO:tasks.workunit.client.0.smithi099.stdout:3/151: dwrite d7/fa [0,4194304] 0 2024-09-19T06:40:29.102 INFO:tasks.workunit.client.0.smithi099.stdout:7/121: dwrite d7/f2c [0,4194304] 0 2024-09-19T06:40:29.102 INFO:tasks.workunit.client.0.smithi099.stdout:1/87: creat d0/f1a x:0 0 0 2024-09-19T06:40:29.103 INFO:tasks.workunit.client.0.smithi099.stdout:1/88: write d0/f6 [135231,112116] 0 2024-09-19T06:40:29.109 INFO:tasks.workunit.client.0.smithi099.stdout:1/89: creat d0/d12/d13/f1b x:0 0 0 2024-09-19T06:40:29.109 INFO:tasks.workunit.client.0.smithi099.stdout:7/122: creat d7/f32 x:0 0 0 2024-09-19T06:40:29.110 INFO:tasks.workunit.client.0.smithi099.stdout:3/152: write d7/d16/f1b [1202413,120513] 0 2024-09-19T06:40:29.113 INFO:tasks.workunit.client.0.smithi099.stdout:7/123: creat d7/dd/d29/f33 x:0 0 0 2024-09-19T06:40:29.113 INFO:tasks.workunit.client.0.smithi099.stdout:1/90: symlink d0/d17/l1c 0 2024-09-19T06:40:29.114 INFO:tasks.workunit.client.0.smithi099.stdout:7/124: fdatasync d7/ff 0 2024-09-19T06:40:29.114 INFO:tasks.workunit.client.0.smithi099.stdout:3/153: creat d7/d16/d1d/f22 x:0 0 0 2024-09-19T06:40:29.115 INFO:tasks.workunit.client.0.smithi099.stdout:3/154: chown d7/f18 1698545 1 2024-09-19T06:40:29.117 INFO:tasks.workunit.client.0.smithi099.stdout:7/125: mkdir d7/dd/d29/d34 0 2024-09-19T06:40:29.119 INFO:tasks.workunit.client.0.smithi099.stdout:3/155: getdents d7 0 2024-09-19T06:40:29.120 INFO:tasks.workunit.client.0.smithi099.stdout:7/126: creat d7/dd/d29/d34/f35 x:0 0 0 2024-09-19T06:40:29.122 INFO:tasks.workunit.client.0.smithi099.stdout:7/127: symlink d7/dd/d29/d1f/l36 0 2024-09-19T06:40:29.123 INFO:tasks.workunit.client.0.smithi099.stdout:3/156: dread d7/f13 [0,4194304] 0 2024-09-19T06:40:29.128 INFO:tasks.workunit.client.0.smithi099.stdout:3/157: dwrite d7/d16/f17 [0,4194304] 0 2024-09-19T06:40:29.130 INFO:tasks.workunit.client.0.smithi099.stdout:3/158: write d7/f12 [3476376,82465] 0 2024-09-19T06:40:29.131 INFO:tasks.workunit.client.0.smithi099.stdout:3/159: read d7/f10 [1250332,80043] 0 2024-09-19T06:40:29.133 INFO:tasks.workunit.client.0.smithi099.stdout:3/160: mkdir d7/d23 0 2024-09-19T06:40:29.134 INFO:tasks.workunit.client.0.smithi099.stdout:6/76: sync 2024-09-19T06:40:29.134 INFO:tasks.workunit.client.0.smithi099.stdout:2/53: sync 2024-09-19T06:40:29.134 INFO:tasks.workunit.client.0.smithi099.stdout:1/91: rmdir d0/d12/d13 39 2024-09-19T06:40:29.144 INFO:tasks.workunit.client.0.smithi099.stdout:3/161: readlink d7/d16/l19 0 2024-09-19T06:40:29.145 INFO:tasks.workunit.client.0.smithi099.stdout:2/54: dread - d1/d2/f12 zero size 2024-09-19T06:40:29.148 INFO:tasks.workunit.client.0.smithi099.stdout:6/77: dread d1/fe [0,4194304] 0 2024-09-19T06:40:29.149 INFO:tasks.workunit.client.0.smithi099.stdout:1/92: rename d0/f8 to d0/db/dd/f1d 0 2024-09-19T06:40:29.149 INFO:tasks.workunit.client.0.smithi099.stdout:6/78: chown d1/d12 554491 1 2024-09-19T06:40:29.149 INFO:tasks.workunit.client.0.smithi099.stdout:6/79: chown d1 218 1 2024-09-19T06:40:29.153 INFO:tasks.workunit.client.0.smithi099.stdout:1/93: fdatasync d0/db/dd/fc 0 2024-09-19T06:40:29.153 INFO:tasks.workunit.client.0.smithi099.stdout:3/162: unlink d7/fc 0 2024-09-19T06:40:29.153 INFO:tasks.workunit.client.0.smithi099.stdout:1/94: stat d0/d17/l1c 0 2024-09-19T06:40:29.153 INFO:tasks.workunit.client.0.smithi099.stdout:6/80: mknod d1/c1b 0 2024-09-19T06:40:29.153 INFO:tasks.workunit.client.0.smithi099.stdout:1/95: symlink d0/db/l1e 0 2024-09-19T06:40:29.154 INFO:tasks.workunit.client.0.smithi099.stdout:3/163: getdents d7/d16/d1d/d20 0 2024-09-19T06:40:29.154 INFO:tasks.workunit.client.0.smithi099.stdout:6/81: symlink d1/l1c 0 2024-09-19T06:40:29.155 INFO:tasks.workunit.client.0.smithi099.stdout:1/96: dread d0/f6 [0,4194304] 0 2024-09-19T06:40:29.158 INFO:tasks.workunit.client.0.smithi099.stdout:6/82: creat d1/f1d x:0 0 0 2024-09-19T06:40:29.159 INFO:tasks.workunit.client.0.smithi099.stdout:1/97: creat d0/db/f1f x:0 0 0 2024-09-19T06:40:29.161 INFO:tasks.workunit.client.0.smithi099.stdout:1/98: write d0/f5 [279351,48380] 0 2024-09-19T06:40:29.161 INFO:tasks.workunit.client.0.smithi099.stdout:1/99: truncate d0/f9 1028263 0 2024-09-19T06:40:29.163 INFO:tasks.workunit.client.0.smithi099.stdout:6/83: link d1/d5/f13 d1/f1e 0 2024-09-19T06:40:29.165 INFO:tasks.workunit.client.0.smithi099.stdout:6/84: creat d1/d12/f1f x:0 0 0 2024-09-19T06:40:29.166 INFO:tasks.workunit.client.0.smithi099.stdout:3/164: write d7/f14 [1128544,46936] 0 2024-09-19T06:40:29.167 INFO:tasks.workunit.client.0.smithi099.stdout:6/85: read d1/f10 [627105,21561] 0 2024-09-19T06:40:29.172 INFO:tasks.workunit.client.0.smithi099.stdout:1/100: dwrite d0/d12/d13/f1b [0,4194304] 0 2024-09-19T06:40:29.177 INFO:tasks.workunit.client.0.smithi099.stdout:1/101: rename d0/d17/l1c to d0/l20 0 2024-09-19T06:40:29.179 INFO:tasks.workunit.client.0.smithi099.stdout:3/165: dwrite d7/f14 [0,4194304] 0 2024-09-19T06:40:29.180 INFO:tasks.workunit.client.0.smithi099.stdout:1/102: chown d0/d12/d13 201708 1 2024-09-19T06:40:29.181 INFO:tasks.workunit.client.0.smithi099.stdout:6/86: dwrite d1/d12/f1f [0,4194304] 0 2024-09-19T06:40:29.182 INFO:tasks.workunit.client.0.smithi099.stdout:1/103: write d0/f1a [725411,58139] 0 2024-09-19T06:40:29.185 INFO:tasks.workunit.client.0.smithi099.stdout:6/87: symlink d1/l20 0 2024-09-19T06:40:29.185 INFO:tasks.workunit.client.0.smithi099.stdout:6/88: fsync d1/fd 0 2024-09-19T06:40:29.186 INFO:tasks.workunit.client.0.smithi099.stdout:3/166: dread d7/f15 [0,4194304] 0 2024-09-19T06:40:29.192 INFO:tasks.workunit.client.0.smithi099.stdout:3/167: rename d7/f13 to d7/d16/d1d/f24 0 2024-09-19T06:40:29.194 INFO:tasks.workunit.client.0.smithi099.stdout:3/168: write d7/fa [3489258,69903] 0 2024-09-19T06:40:29.194 INFO:tasks.workunit.client.0.smithi099.stdout:1/104: dwrite d0/db/f19 [0,4194304] 0 2024-09-19T06:40:29.196 INFO:tasks.workunit.client.0.smithi099.stdout:1/105: creat d0/f21 x:0 0 0 2024-09-19T06:40:29.216 INFO:tasks.workunit.client.0.smithi099.stdout:4/93: sync 2024-09-19T06:40:29.216 INFO:tasks.workunit.client.0.smithi099.stdout:8/51: sync 2024-09-19T06:40:29.216 INFO:tasks.workunit.client.0.smithi099.stdout:5/187: sync 2024-09-19T06:40:29.216 INFO:tasks.workunit.client.0.smithi099.stdout:0/71: sync 2024-09-19T06:40:29.218 INFO:tasks.workunit.client.0.smithi099.stdout:0/72: stat d0/f12 0 2024-09-19T06:40:29.218 INFO:tasks.workunit.client.0.smithi099.stdout:4/94: stat d12/d1b 0 2024-09-19T06:40:29.218 INFO:tasks.workunit.client.0.smithi099.stdout:8/52: mkdir d4/de 0 2024-09-19T06:40:29.220 INFO:tasks.workunit.client.0.smithi099.stdout:5/188: mkdir d3/d7/d47 0 2024-09-19T06:40:29.220 INFO:tasks.workunit.client.0.smithi099.stdout:1/106: fdatasync d0/f9 0 2024-09-19T06:40:29.222 INFO:tasks.workunit.client.0.smithi099.stdout:8/53: write d4/fd [166048,71760] 0 2024-09-19T06:40:29.222 INFO:tasks.workunit.client.0.smithi099.stdout:0/73: symlink d0/l18 0 2024-09-19T06:40:29.223 INFO:tasks.workunit.client.0.smithi099.stdout:3/169: unlink d7/d16/d1d/f24 0 2024-09-19T06:40:29.224 INFO:tasks.workunit.client.0.smithi099.stdout:6/89: write d1/d5/f13 [324612,90810] 0 2024-09-19T06:40:29.224 INFO:tasks.workunit.client.1.smithi117.stdout:4/271: sync 2024-09-19T06:40:29.224 INFO:tasks.workunit.client.1.smithi117.stdout:0/151: sync 2024-09-19T06:40:29.224 INFO:tasks.workunit.client.1.smithi117.stdout:8/212: sync 2024-09-19T06:40:29.224 INFO:tasks.workunit.client.1.smithi117.stdout:9/252: sync 2024-09-19T06:40:29.224 INFO:tasks.workunit.client.1.smithi117.stdout:1/227: sync 2024-09-19T06:40:29.224 INFO:tasks.workunit.client.1.smithi117.stdout:5/219: sync 2024-09-19T06:40:29.224 INFO:tasks.workunit.client.1.smithi117.stdout:7/245: sync 2024-09-19T06:40:29.225 INFO:tasks.workunit.client.1.smithi117.stdout:6/182: sync 2024-09-19T06:40:29.225 INFO:tasks.workunit.client.1.smithi117.stdout:3/289: sync 2024-09-19T06:40:29.225 INFO:tasks.workunit.client.0.smithi099.stdout:8/54: write d4/fa [331192,113158] 0 2024-09-19T06:40:29.225 INFO:tasks.workunit.client.0.smithi099.stdout:0/74: chown d0/db/fc 65583807 1 2024-09-19T06:40:29.226 INFO:tasks.workunit.client.1.smithi117.stdout:8/213: dread - d1d/f27 zero size 2024-09-19T06:40:29.226 INFO:tasks.workunit.client.1.smithi117.stdout:3/290: readlink d0/l2 0 2024-09-19T06:40:29.227 INFO:tasks.workunit.client.1.smithi117.stdout:1/228: dread - d3/d18/d23/f45 zero size 2024-09-19T06:40:29.227 INFO:tasks.workunit.client.0.smithi099.stdout:4/95: creat d12/d1b/d24/f29 x:0 0 0 2024-09-19T06:40:29.228 INFO:tasks.workunit.client.0.smithi099.stdout:0/75: write d0/f7 [2737418,6749] 0 2024-09-19T06:40:29.228 INFO:tasks.workunit.client.0.smithi099.stdout:5/189: mknod d3/d14/c48 0 2024-09-19T06:40:29.228 INFO:tasks.workunit.client.1.smithi117.stdout:4/272: write d3/d1b/f5a [599406,69906] 0 2024-09-19T06:40:29.228 INFO:tasks.workunit.client.1.smithi117.stdout:7/246: symlink d1/d3f/l5c 0 2024-09-19T06:40:29.229 INFO:tasks.workunit.client.0.smithi099.stdout:1/107: rename d0/db/dd/fc to d0/d12/d13/f22 0 2024-09-19T06:40:29.229 INFO:tasks.workunit.client.1.smithi117.stdout:3/291: dread - d0/d9/d1c/d36/f57 zero size 2024-09-19T06:40:29.229 INFO:tasks.workunit.client.1.smithi117.stdout:5/220: mknod d17/d2f/d3b/c4e 0 2024-09-19T06:40:29.230 INFO:tasks.workunit.client.1.smithi117.stdout:0/152: chown d11/d13/d1b/l23 5940463 1 2024-09-19T06:40:29.231 INFO:tasks.workunit.client.1.smithi117.stdout:6/183: symlink d1/d5/d8/d27/l2f 0 2024-09-19T06:40:29.232 INFO:tasks.workunit.client.1.smithi117.stdout:0/153: mknod d11/c2b 0 2024-09-19T06:40:29.233 INFO:tasks.workunit.client.1.smithi117.stdout:5/221: chown d17/d2e/l42 0 1 2024-09-19T06:40:29.234 INFO:tasks.workunit.client.1.smithi117.stdout:1/229: mknod d3/d18/d23/d3a/c4e 0 2024-09-19T06:40:29.236 INFO:tasks.workunit.client.1.smithi117.stdout:3/292: write d0/d8/f10 [7509752,120090] 0 2024-09-19T06:40:29.236 INFO:tasks.workunit.client.1.smithi117.stdout:6/184: rmdir d1/d3 39 2024-09-19T06:40:29.237 INFO:tasks.workunit.client.1.smithi117.stdout:5/222: readlink d17/d2f/l35 0 2024-09-19T06:40:29.238 INFO:tasks.workunit.client.0.smithi099.stdout:4/96: write d12/d1b/d24/f29 [551835,9342] 0 2024-09-19T06:40:29.238 INFO:tasks.workunit.client.1.smithi117.stdout:0/154: write d11/f19 [2884418,92811] 0 2024-09-19T06:40:29.240 INFO:tasks.workunit.client.0.smithi099.stdout:5/190: creat d3/d16/d2f/d34/d3c/f49 x:0 0 0 2024-09-19T06:40:29.242 INFO:tasks.workunit.client.0.smithi099.stdout:1/108: creat d0/db/f23 x:0 0 0 2024-09-19T06:40:29.243 INFO:tasks.workunit.client.1.smithi117.stdout:9/253: dwrite d4/df/d16/f26 [0,4194304] 0 2024-09-19T06:40:29.243 INFO:tasks.workunit.client.1.smithi117.stdout:5/223: dread - d17/d1b/f28 zero size 2024-09-19T06:40:29.244 INFO:tasks.workunit.client.1.smithi117.stdout:7/247: getdents d1/d3f 0 2024-09-19T06:40:29.245 INFO:tasks.workunit.client.0.smithi099.stdout:4/97: creat d12/f2a x:0 0 0 2024-09-19T06:40:29.246 INFO:tasks.workunit.client.0.smithi099.stdout:5/191: symlink d3/d16/l4a 0 2024-09-19T06:40:29.246 INFO:tasks.workunit.client.1.smithi117.stdout:0/155: mkdir d11/d13/d14/d2c 0 2024-09-19T06:40:29.247 INFO:tasks.workunit.client.0.smithi099.stdout:1/109: rmdir d0/d12 39 2024-09-19T06:40:29.247 INFO:tasks.workunit.client.1.smithi117.stdout:8/214: dwrite d1d/f27 [0,4194304] 0 2024-09-19T06:40:29.248 INFO:tasks.workunit.client.1.smithi117.stdout:6/185: mkdir d1/d5/d8/d27/d30 0 2024-09-19T06:40:29.248 INFO:tasks.workunit.client.0.smithi099.stdout:8/55: dwrite d4/fa [0,4194304] 0 2024-09-19T06:40:29.249 INFO:tasks.workunit.client.0.smithi099.stdout:6/90: dwrite d1/f1e [0,4194304] 0 2024-09-19T06:40:29.254 INFO:tasks.workunit.client.1.smithi117.stdout:6/186: truncate d1/d14/f23 1022742 0 2024-09-19T06:40:29.256 INFO:tasks.workunit.client.1.smithi117.stdout:9/254: rename d4/d18 to d4/df/d52 0 2024-09-19T06:40:29.257 INFO:tasks.workunit.client.0.smithi099.stdout:4/98: dread - d12/d1b/d1c/f25 zero size 2024-09-19T06:40:29.257 INFO:tasks.workunit.client.0.smithi099.stdout:8/56: chown d4/f6 148 1 2024-09-19T06:40:29.257 INFO:tasks.workunit.client.0.smithi099.stdout:4/99: chown d12/c15 721235076 1 2024-09-19T06:40:29.257 INFO:tasks.workunit.client.0.smithi099.stdout:5/192: dread d3/d7/ff [0,4194304] 0 2024-09-19T06:40:29.257 INFO:tasks.workunit.client.0.smithi099.stdout:5/193: chown d3/f9 2 1 2024-09-19T06:40:29.258 INFO:tasks.workunit.client.0.smithi099.stdout:5/194: chown d3/d14/c48 547345 1 2024-09-19T06:40:29.258 INFO:tasks.workunit.client.1.smithi117.stdout:3/293: dwrite d0/d19/f35 [0,4194304] 0 2024-09-19T06:40:29.258 INFO:tasks.workunit.client.1.smithi117.stdout:9/255: chown f0 7740 1 2024-09-19T06:40:29.258 INFO:tasks.workunit.client.0.smithi099.stdout:1/110: dread d0/db/f19 [0,4194304] 0 2024-09-19T06:40:29.261 INFO:tasks.workunit.client.1.smithi117.stdout:4/273: truncate d3/db/d13/f1d 427947 0 2024-09-19T06:40:29.263 INFO:tasks.workunit.client.1.smithi117.stdout:8/215: creat d1d/f40 x:0 0 0 2024-09-19T06:40:29.263 INFO:tasks.workunit.client.1.smithi117.stdout:3/294: getdents d0/d9/d1c/d53 0 2024-09-19T06:40:29.264 INFO:tasks.workunit.client.0.smithi099.stdout:1/111: read d0/db/f19 [651887,113338] 0 2024-09-19T06:40:29.265 INFO:tasks.workunit.client.0.smithi099.stdout:4/100: fsync f5 0 2024-09-19T06:40:29.267 INFO:tasks.workunit.client.0.smithi099.stdout:1/112: dread d0/f6 [0,4194304] 0 2024-09-19T06:40:29.268 INFO:tasks.workunit.client.0.smithi099.stdout:4/101: dread - d12/d1b/d1c/f25 zero size 2024-09-19T06:40:29.269 INFO:tasks.workunit.client.0.smithi099.stdout:5/195: dwrite d3/d7/f10 [0,4194304] 0 2024-09-19T06:40:29.270 INFO:tasks.workunit.client.0.smithi099.stdout:5/196: fdatasync d3/d7/fb 0 2024-09-19T06:40:29.272 INFO:tasks.workunit.client.0.smithi099.stdout:8/57: link f3 d4/de/ff 0 2024-09-19T06:40:29.273 INFO:tasks.workunit.client.0.smithi099.stdout:4/102: write f11 [26658,129665] 0 2024-09-19T06:40:29.273 INFO:tasks.workunit.client.1.smithi117.stdout:4/274: dwrite d3/db/f47 [0,4194304] 0 2024-09-19T06:40:29.275 INFO:tasks.workunit.client.0.smithi099.stdout:4/103: fsync f5 0 2024-09-19T06:40:29.276 INFO:tasks.workunit.client.0.smithi099.stdout:1/113: dread d0/db/f19 [0,4194304] 0 2024-09-19T06:40:29.276 INFO:tasks.workunit.client.0.smithi099.stdout:7/128: sync 2024-09-19T06:40:29.277 INFO:tasks.workunit.client.0.smithi099.stdout:9/148: sync 2024-09-19T06:40:29.277 INFO:tasks.workunit.client.0.smithi099.stdout:2/55: sync 2024-09-19T06:40:29.277 INFO:tasks.workunit.client.1.smithi117.stdout:8/216: getdents d1d/d2a 0 2024-09-19T06:40:29.277 INFO:tasks.workunit.client.0.smithi099.stdout:5/197: link c0 d3/d16/d2f/d34/d3c/c4b 0 2024-09-19T06:40:29.278 INFO:tasks.workunit.client.1.smithi117.stdout:7/248: dread d1/f50 [0,4194304] 0 2024-09-19T06:40:29.278 INFO:tasks.workunit.client.1.smithi117.stdout:4/275: write d3/d28/d2a/f5e [261819,102200] 0 2024-09-19T06:40:29.279 INFO:tasks.workunit.client.0.smithi099.stdout:2/56: dread - d1/d2/f12 zero size 2024-09-19T06:40:29.279 INFO:tasks.workunit.client.1.smithi117.stdout:0/156: rmdir d11 39 2024-09-19T06:40:29.280 INFO:tasks.workunit.client.0.smithi099.stdout:7/129: creat d7/dd/f37 x:0 0 0 2024-09-19T06:40:29.280 INFO:tasks.workunit.client.0.smithi099.stdout:1/114: dread d0/db/dd/f1d [0,4194304] 0 2024-09-19T06:40:29.280 INFO:tasks.workunit.client.1.smithi117.stdout:3/295: dwrite d0/d9/d1c/f39 [0,4194304] 0 2024-09-19T06:40:29.281 INFO:tasks.workunit.client.0.smithi099.stdout:5/198: write d3/d7/f23 [1913155,84165] 0 2024-09-19T06:40:29.281 INFO:tasks.workunit.client.1.smithi117.stdout:5/224: write d17/d1b/d3a/f4b [2358562,127292] 0 2024-09-19T06:40:29.281 INFO:tasks.workunit.client.0.smithi099.stdout:4/104: symlink d12/d1b/l2b 0 2024-09-19T06:40:29.285 INFO:tasks.workunit.client.1.smithi117.stdout:0/157: symlink d11/d13/l2d 0 2024-09-19T06:40:29.286 INFO:tasks.workunit.client.1.smithi117.stdout:3/296: symlink d0/d3d/l59 0 2024-09-19T06:40:29.286 INFO:tasks.workunit.client.1.smithi117.stdout:7/249: creat d1/d4a/f5d x:0 0 0 2024-09-19T06:40:29.289 INFO:tasks.workunit.client.1.smithi117.stdout:8/217: creat d1d/d2a/d3f/f41 x:0 0 0 2024-09-19T06:40:29.289 INFO:tasks.workunit.client.1.smithi117.stdout:5/225: creat d17/d1b/d3a/d3c/d46/f4f x:0 0 0 2024-09-19T06:40:29.290 INFO:tasks.workunit.client.1.smithi117.stdout:3/297: rename d0/d19/f41 to d0/d3d/d48/f5a 0 2024-09-19T06:40:29.291 INFO:tasks.workunit.client.1.smithi117.stdout:0/158: write d11/d13/d1b/d27/f29 [4256548,124333] 0 2024-09-19T06:40:29.294 INFO:tasks.workunit.client.1.smithi117.stdout:3/298: write d0/d9/d49/f43 [7655797,79180] 0 2024-09-19T06:40:29.294 INFO:tasks.workunit.client.1.smithi117.stdout:5/226: read d17/d2e/f33 [494964,104872] 0 2024-09-19T06:40:29.295 INFO:tasks.workunit.client.1.smithi117.stdout:0/159: unlink c7 0 2024-09-19T06:40:29.295 INFO:tasks.workunit.client.1.smithi117.stdout:0/160: readlink lf 0 2024-09-19T06:40:29.296 INFO:tasks.workunit.client.1.smithi117.stdout:8/218: mknod d1d/c42 0 2024-09-19T06:40:29.297 INFO:tasks.workunit.client.1.smithi117.stdout:0/161: fdatasync fd 0 2024-09-19T06:40:29.298 INFO:tasks.workunit.client.1.smithi117.stdout:8/219: truncate d1d/f40 560199 0 2024-09-19T06:40:29.301 INFO:tasks.workunit.client.1.smithi117.stdout:5/227: truncate d17/d1b/d3a/d3c/d46/f4a 525725 0 2024-09-19T06:40:29.302 INFO:tasks.workunit.client.1.smithi117.stdout:8/220: creat d1d/d1e/d29/f43 x:0 0 0 2024-09-19T06:40:29.303 INFO:tasks.workunit.client.1.smithi117.stdout:5/228: write d17/d1b/f48 [57497,44852] 0 2024-09-19T06:40:29.303 INFO:tasks.workunit.client.1.smithi117.stdout:3/299: dwrite d0/fb [4194304,4194304] 0 2024-09-19T06:40:29.305 INFO:tasks.workunit.client.1.smithi117.stdout:5/229: dread - d17/d1b/f28 zero size 2024-09-19T06:40:29.306 INFO:tasks.workunit.client.1.smithi117.stdout:8/221: mknod d1d/d1e/c44 0 2024-09-19T06:40:29.310 INFO:tasks.workunit.client.1.smithi117.stdout:8/222: chown d1d/d1e/d29/f2d 2191964 1 2024-09-19T06:40:29.312 INFO:tasks.workunit.client.1.smithi117.stdout:5/230: rmdir d17/d2e/d49 0 2024-09-19T06:40:29.315 INFO:tasks.workunit.client.1.smithi117.stdout:3/300: dwrite d0/d8/f10 [4194304,4194304] 0 2024-09-19T06:40:29.319 INFO:tasks.workunit.client.1.smithi117.stdout:8/223: dwrite f19 [0,4194304] 0 2024-09-19T06:40:29.327 INFO:tasks.workunit.client.1.smithi117.stdout:3/301: dwrite d0/f15 [0,4194304] 0 2024-09-19T06:40:29.331 INFO:tasks.workunit.client.1.smithi117.stdout:4/276: write d3/d4/f2f [307001,74197] 0 2024-09-19T06:40:29.331 INFO:tasks.workunit.client.1.smithi117.stdout:3/302: write d0/d19/f54 [396518,11417] 0 2024-09-19T06:40:29.337 INFO:tasks.workunit.client.1.smithi117.stdout:3/303: unlink d0/f18 0 2024-09-19T06:40:29.337 INFO:tasks.workunit.client.1.smithi117.stdout:4/277: mkdir d3/d65/d66 0 2024-09-19T06:40:29.338 INFO:tasks.workunit.client.0.smithi099.stdout:4/105: dread - d12/f2a zero size 2024-09-19T06:40:29.339 INFO:tasks.workunit.client.1.smithi117.stdout:4/278: truncate d3/db/d13/f3c 4347543 0 2024-09-19T06:40:29.344 INFO:tasks.workunit.client.1.smithi117.stdout:4/279: write d3/de/f1c [2286939,126427] 0 2024-09-19T06:40:29.344 INFO:tasks.workunit.client.0.smithi099.stdout:9/149: rename dd/d10/d13 to dd/d2c 0 2024-09-19T06:40:29.345 INFO:tasks.workunit.client.0.smithi099.stdout:4/106: rename d12/d1b/d24 to d12/d1b/d24/d2c 22 2024-09-19T06:40:29.345 INFO:tasks.workunit.client.1.smithi117.stdout:0/162: dread f0 [0,4194304] 0 2024-09-19T06:40:29.346 INFO:tasks.workunit.client.0.smithi099.stdout:2/57: dread d1/d2/d5/d8/fa [0,4194304] 0 2024-09-19T06:40:29.347 INFO:tasks.workunit.client.0.smithi099.stdout:9/150: read dd/d2c/f1a [3609001,989] 0 2024-09-19T06:40:29.349 INFO:tasks.workunit.client.1.smithi117.stdout:4/280: creat d3/db/d20/d29/d39/f67 x:0 0 0 2024-09-19T06:40:29.349 INFO:tasks.workunit.client.1.smithi117.stdout:5/231: dread d17/f19 [0,4194304] 0 2024-09-19T06:40:29.350 INFO:tasks.workunit.client.1.smithi117.stdout:0/163: chown d11/d13/d14/f1d 1 1 2024-09-19T06:40:29.350 INFO:tasks.workunit.client.0.smithi099.stdout:1/115: dwrite d0/f9 [0,4194304] 0 2024-09-19T06:40:29.350 INFO:tasks.workunit.client.0.smithi099.stdout:4/107: chown d12/d1b/d1c/f26 0 1 2024-09-19T06:40:29.351 INFO:tasks.workunit.client.1.smithi117.stdout:3/304: dwrite d0/d3d/d48/f5a [0,4194304] 0 2024-09-19T06:40:29.351 INFO:tasks.workunit.client.1.smithi117.stdout:5/232: chown l14 8328321 1 2024-09-19T06:40:29.351 INFO:tasks.workunit.client.0.smithi099.stdout:2/58: mkdir d1/d2/d5/d13 0 2024-09-19T06:40:29.352 INFO:tasks.workunit.client.0.smithi099.stdout:4/108: stat d12/d1b/c28 0 2024-09-19T06:40:29.352 INFO:tasks.workunit.client.0.smithi099.stdout:5/199: dwrite d3/d2a/f2c [0,4194304] 0 2024-09-19T06:40:29.352 INFO:tasks.workunit.client.0.smithi099.stdout:1/116: fdatasync d0/db/f23 0 2024-09-19T06:40:29.352 INFO:tasks.workunit.client.0.smithi099.stdout:2/59: stat d1/d2/d5/d8/dd 0 2024-09-19T06:40:29.353 INFO:tasks.workunit.client.1.smithi117.stdout:4/281: chown d3/db/d20/f36 13784 1 2024-09-19T06:40:29.353 INFO:tasks.workunit.client.0.smithi099.stdout:2/60: dread - d1/d2/f12 zero size 2024-09-19T06:40:29.354 INFO:tasks.workunit.client.0.smithi099.stdout:5/200: creat d3/d2a/f4c x:0 0 0 2024-09-19T06:40:29.355 INFO:tasks.workunit.client.1.smithi117.stdout:5/233: write d17/d1b/f48 [2008951,18557] 0 2024-09-19T06:40:29.355 INFO:tasks.workunit.client.1.smithi117.stdout:8/224: write d1d/d1e/d29/f2e [1095582,123471] 0 2024-09-19T06:40:29.355 INFO:tasks.workunit.client.0.smithi099.stdout:5/201: write d3/d16/d2f/d34/d3c/f46 [847687,76998] 0 2024-09-19T06:40:29.356 INFO:tasks.workunit.client.0.smithi099.stdout:1/117: mkdir d0/d17/d24 0 2024-09-19T06:40:29.360 INFO:tasks.workunit.client.1.smithi117.stdout:3/305: unlink d0/d9/l1b 0 2024-09-19T06:40:29.361 INFO:tasks.workunit.client.1.smithi117.stdout:4/282: rename d3/d1b/f5a to d3/d28/d2a/f68 0 2024-09-19T06:40:29.361 INFO:tasks.workunit.client.1.smithi117.stdout:0/164: link d11/d13/f22 d11/d13/d28/f2e 0 2024-09-19T06:40:29.362 INFO:tasks.workunit.client.0.smithi099.stdout:5/202: creat d3/d7/f4d x:0 0 0 2024-09-19T06:40:29.362 INFO:tasks.workunit.client.1.smithi117.stdout:3/306: fsync d0/d9/f21 0 2024-09-19T06:40:29.366 INFO:tasks.workunit.client.0.smithi099.stdout:5/203: dread d3/f25 [0,4194304] 0 2024-09-19T06:40:29.366 INFO:tasks.workunit.client.1.smithi117.stdout:8/225: link f3 d1d/d2a/f45 0 2024-09-19T06:40:29.369 INFO:tasks.workunit.client.1.smithi117.stdout:3/307: write d0/d24/f2c [3202663,36226] 0 2024-09-19T06:40:29.374 INFO:tasks.workunit.client.1.smithi117.stdout:8/226: write d1d/d2a/d3f/f41 [158594,13828] 0 2024-09-19T06:40:29.375 INFO:tasks.workunit.client.0.smithi099.stdout:5/204: symlink d3/d7/d47/l4e 0 2024-09-19T06:40:29.376 INFO:tasks.workunit.client.0.smithi099.stdout:1/118: creat d0/db/f25 x:0 0 0 2024-09-19T06:40:29.376 INFO:tasks.workunit.client.0.smithi099.stdout:5/205: chown d3/d16/d2f/d34/d3c/f46 115896 1 2024-09-19T06:40:29.377 INFO:tasks.workunit.client.1.smithi117.stdout:8/227: read - d1d/d2a/f2f zero size 2024-09-19T06:40:29.377 INFO:tasks.workunit.client.0.smithi099.stdout:1/119: dread d0/f6 [0,4194304] 0 2024-09-19T06:40:29.378 INFO:tasks.workunit.client.0.smithi099.stdout:5/206: mkdir d3/d1f/d4f 0 2024-09-19T06:40:29.378 INFO:tasks.workunit.client.1.smithi117.stdout:4/283: dwrite d3/db/f43 [4194304,4194304] 0 2024-09-19T06:40:29.378 INFO:tasks.workunit.client.1.smithi117.stdout:0/165: dread d11/d13/d14/d16/f26 [0,4194304] 0 2024-09-19T06:40:29.379 INFO:tasks.workunit.client.1.smithi117.stdout:3/308: write d0/d8/f1a [3112970,123257] 0 2024-09-19T06:40:29.379 INFO:tasks.workunit.client.1.smithi117.stdout:5/234: dwrite d17/d1b/f28 [0,4194304] 0 2024-09-19T06:40:29.381 INFO:tasks.workunit.client.1.smithi117.stdout:5/235: stat d17/d2f/d3b/f44 0 2024-09-19T06:40:29.382 INFO:tasks.workunit.client.0.smithi099.stdout:5/207: dread d3/d1f/f20 [0,4194304] 0 2024-09-19T06:40:29.385 INFO:tasks.workunit.client.1.smithi117.stdout:3/309: write d0/d19/f35 [2445625,98631] 0 2024-09-19T06:40:29.386 INFO:tasks.workunit.client.0.smithi099.stdout:5/208: write d3/d14/f35 [293810,19413] 0 2024-09-19T06:40:29.386 INFO:tasks.workunit.client.1.smithi117.stdout:4/284: write d3/f2b [586994,79274] 0 2024-09-19T06:40:29.388 INFO:tasks.workunit.client.1.smithi117.stdout:5/236: chown d17/d2e/l36 896140790 1 2024-09-19T06:40:29.389 INFO:tasks.workunit.client.1.smithi117.stdout:8/228: mknod d1d/c46 0 2024-09-19T06:40:29.389 INFO:tasks.workunit.client.1.smithi117.stdout:0/166: creat d11/d13/d14/d2c/f2f x:0 0 0 2024-09-19T06:40:29.390 INFO:tasks.workunit.client.0.smithi099.stdout:5/209: dread - d3/d7/f3b zero size 2024-09-19T06:40:29.392 INFO:tasks.workunit.client.0.smithi099.stdout:1/120: dwrite d0/d12/d13/f22 [0,4194304] 0 2024-09-19T06:40:29.392 INFO:tasks.workunit.client.1.smithi117.stdout:4/285: rmdir d3/db/d20/d29 39 2024-09-19T06:40:29.392 INFO:tasks.workunit.client.1.smithi117.stdout:0/167: truncate d11/d13/f22 263923 0 2024-09-19T06:40:29.393 INFO:tasks.workunit.client.1.smithi117.stdout:3/310: mkdir d0/d9/d1c/d36/d40/d5b 0 2024-09-19T06:40:29.393 INFO:tasks.workunit.client.0.smithi099.stdout:4/109: dwrite d12/f18 [0,4194304] 0 2024-09-19T06:40:29.393 INFO:tasks.workunit.client.0.smithi099.stdout:5/210: dread - d3/d7/f4d zero size 2024-09-19T06:40:29.394 INFO:tasks.workunit.client.1.smithi117.stdout:5/237: creat d17/d2e/f50 x:0 0 0 2024-09-19T06:40:29.394 INFO:tasks.workunit.client.1.smithi117.stdout:4/286: fsync d3/db/d13/f3c 0 2024-09-19T06:40:29.395 INFO:tasks.workunit.client.1.smithi117.stdout:3/311: stat d0/d9/d1c/d53 0 2024-09-19T06:40:29.396 INFO:tasks.workunit.client.0.smithi099.stdout:5/211: readlink d3/l1b 0 2024-09-19T06:40:29.396 INFO:tasks.workunit.client.0.smithi099.stdout:1/121: dread d0/db/dd/f1d [0,4194304] 0 2024-09-19T06:40:29.396 INFO:tasks.workunit.client.1.smithi117.stdout:3/312: chown d0/d8/f4c 0 1 2024-09-19T06:40:29.396 INFO:tasks.workunit.client.1.smithi117.stdout:8/229: symlink d1d/d1e/d3b/l47 0 2024-09-19T06:40:29.397 INFO:tasks.workunit.client.0.smithi099.stdout:4/110: rmdir d12/d1b/d1c 39 2024-09-19T06:40:29.397 INFO:tasks.workunit.client.0.smithi099.stdout:5/212: chown d3/d16/d2f/d34/d3c/l3e 12548 1 2024-09-19T06:40:29.400 INFO:tasks.workunit.client.0.smithi099.stdout:4/111: write d12/d1b/d1c/f26 [1566077,81873] 0 2024-09-19T06:40:29.403 INFO:tasks.workunit.client.1.smithi117.stdout:8/230: chown l9 110 1 2024-09-19T06:40:29.403 INFO:tasks.workunit.client.0.smithi099.stdout:4/112: chown fb 0 1 2024-09-19T06:40:29.404 INFO:tasks.workunit.client.0.smithi099.stdout:5/213: dread d3/d7/f23 [0,4194304] 0 2024-09-19T06:40:29.404 INFO:tasks.workunit.client.1.smithi117.stdout:8/231: fdatasync d1d/d1e/f1f 0 2024-09-19T06:40:29.405 INFO:tasks.workunit.client.0.smithi099.stdout:5/214: truncate d3/d2a/f4c 251119 0 2024-09-19T06:40:29.406 INFO:tasks.workunit.client.1.smithi117.stdout:8/232: write d1d/d1e/d29/f2e [1913656,18213] 0 2024-09-19T06:40:29.406 INFO:tasks.workunit.client.1.smithi117.stdout:3/313: unlink d0/d19/d2b/f31 0 2024-09-19T06:40:29.407 INFO:tasks.workunit.client.1.smithi117.stdout:8/233: chown d1d/d2a 15718275 1 2024-09-19T06:40:29.408 INFO:tasks.workunit.client.0.smithi099.stdout:5/215: dread d3/d7/f26 [0,4194304] 0 2024-09-19T06:40:29.409 INFO:tasks.workunit.client.1.smithi117.stdout:4/287: creat d3/d41/f69 x:0 0 0 2024-09-19T06:40:29.409 INFO:tasks.workunit.client.1.smithi117.stdout:8/234: chown d1d/d1e/l20 0 1 2024-09-19T06:40:29.409 INFO:tasks.workunit.client.1.smithi117.stdout:4/288: dread - d3/d41/f69 zero size 2024-09-19T06:40:29.410 INFO:tasks.workunit.client.0.smithi099.stdout:5/216: mknod d3/d16/d2f/c50 0 2024-09-19T06:40:29.411 INFO:tasks.workunit.client.1.smithi117.stdout:4/289: write d3/db/d13/f3c [1829613,107430] 0 2024-09-19T06:40:29.411 INFO:tasks.workunit.client.0.smithi099.stdout:5/217: dread d3/d7/f26 [0,4194304] 0 2024-09-19T06:40:29.412 INFO:tasks.workunit.client.1.smithi117.stdout:3/314: rename d0/d9/f21 to d0/d24/f5c 0 2024-09-19T06:40:29.415 INFO:tasks.workunit.client.1.smithi117.stdout:8/235: rename d1d/d2a/d3f/f41 to d1d/d1e/d29/f48 0 2024-09-19T06:40:29.417 INFO:tasks.workunit.client.1.smithi117.stdout:8/236: write d1d/d1e/f1f [1614552,91088] 0 2024-09-19T06:40:29.417 INFO:tasks.workunit.client.0.smithi099.stdout:5/218: dwrite d3/d7/fb [0,4194304] 0 2024-09-19T06:40:29.418 INFO:tasks.workunit.client.1.smithi117.stdout:4/290: link d3/de/f15 d3/d4/d14/f6a 0 2024-09-19T06:40:29.422 INFO:tasks.workunit.client.0.smithi099.stdout:5/219: creat d3/d1f/f51 x:0 0 0 2024-09-19T06:40:29.425 INFO:tasks.workunit.client.1.smithi117.stdout:3/315: dwrite d0/d8/f10 [4194304,4194304] 0 2024-09-19T06:40:29.425 INFO:tasks.workunit.client.0.smithi099.stdout:5/220: mknod d3/d1f/d4f/c52 0 2024-09-19T06:40:29.427 INFO:tasks.workunit.client.0.smithi099.stdout:5/221: write d3/d2a/f2c [3867305,38466] 0 2024-09-19T06:40:29.427 INFO:tasks.workunit.client.1.smithi117.stdout:2/229: sync 2024-09-19T06:40:29.428 INFO:tasks.workunit.client.0.smithi099.stdout:5/222: read d3/d1f/f21 [214699,12214] 0 2024-09-19T06:40:29.428 INFO:tasks.workunit.client.1.smithi117.stdout:3/316: fdatasync d0/d19/f35 0 2024-09-19T06:40:29.429 INFO:tasks.workunit.client.0.smithi099.stdout:4/113: write f10 [3811839,87166] 0 2024-09-19T06:40:29.431 INFO:tasks.workunit.client.0.smithi099.stdout:5/223: symlink d3/d16/l53 0 2024-09-19T06:40:29.431 INFO:tasks.workunit.client.1.smithi117.stdout:5/238: write d17/d2e/f33 [1686507,49610] 0 2024-09-19T06:40:29.431 INFO:tasks.workunit.client.1.smithi117.stdout:8/237: dread d1d/d1e/f32 [0,4194304] 0 2024-09-19T06:40:29.433 INFO:tasks.workunit.client.0.smithi099.stdout:5/224: rmdir d3/d7 39 2024-09-19T06:40:29.433 INFO:tasks.workunit.client.1.smithi117.stdout:3/317: write d0/d9/d1c/d36/f57 [293151,99532] 0 2024-09-19T06:40:29.433 INFO:tasks.workunit.client.0.smithi099.stdout:5/225: chown d3/d1f/l2d 1004852 1 2024-09-19T06:40:29.434 INFO:tasks.workunit.client.1.smithi117.stdout:5/239: write d17/f22 [2901437,24882] 0 2024-09-19T06:40:29.436 INFO:tasks.workunit.client.0.smithi099.stdout:4/114: dread ff [0,4194304] 0 2024-09-19T06:40:29.438 INFO:tasks.workunit.client.1.smithi117.stdout:0/168: dread f3 [0,4194304] 0 2024-09-19T06:40:29.438 INFO:tasks.workunit.client.0.smithi099.stdout:5/226: rename d3/d16/l33 to d3/d1f/d4f/l54 0 2024-09-19T06:40:29.439 INFO:tasks.workunit.client.1.smithi117.stdout:8/238: creat d1d/d1e/d29/f49 x:0 0 0 2024-09-19T06:40:29.440 INFO:tasks.workunit.client.1.smithi117.stdout:4/291: dwrite d3/db/d13/f3c [0,4194304] 0 2024-09-19T06:40:29.441 INFO:tasks.workunit.client.1.smithi117.stdout:0/169: chown d11/d13/f17 109606206 1 2024-09-19T06:40:29.442 INFO:tasks.workunit.client.1.smithi117.stdout:3/318: creat d0/d9/d4e/f5d x:0 0 0 2024-09-19T06:40:29.443 INFO:tasks.workunit.client.1.smithi117.stdout:4/292: stat d3/d28/d2a/c59 0 2024-09-19T06:40:29.443 INFO:tasks.workunit.client.0.smithi099.stdout:4/115: getdents d12/d1b/d24 0 2024-09-19T06:40:29.444 INFO:tasks.workunit.client.1.smithi117.stdout:5/240: chown d17/d1b/d3a/l45 144120203 1 2024-09-19T06:40:29.445 INFO:tasks.workunit.client.1.smithi117.stdout:3/319: rmdir d0/d9/d1c 39 2024-09-19T06:40:29.446 INFO:tasks.workunit.client.0.smithi099.stdout:4/116: symlink d12/d1b/l2d 0 2024-09-19T06:40:29.448 INFO:tasks.workunit.client.1.smithi117.stdout:5/241: unlink d17/d1b/d3a/f4b 0 2024-09-19T06:40:29.448 INFO:tasks.workunit.client.0.smithi099.stdout:4/117: creat d12/d1b/d24/f2e x:0 0 0 2024-09-19T06:40:29.449 INFO:tasks.workunit.client.1.smithi117.stdout:8/239: creat d1d/f4a x:0 0 0 2024-09-19T06:40:29.449 INFO:tasks.workunit.client.1.smithi117.stdout:5/242: read - d17/d2f/d3b/f44 zero size 2024-09-19T06:40:29.453 INFO:tasks.workunit.client.0.smithi099.stdout:4/118: getdents d12/d1b/d1c 0 2024-09-19T06:40:29.453 INFO:tasks.workunit.client.1.smithi117.stdout:3/320: rename d0/d19/f35 to d0/f5e 0 2024-09-19T06:40:29.454 INFO:tasks.workunit.client.0.smithi099.stdout:4/119: chown d12/d1b/d24/f29 684376 1 2024-09-19T06:40:29.456 INFO:tasks.workunit.client.0.smithi099.stdout:4/120: symlink d12/d1b/l2f 0 2024-09-19T06:40:29.456 INFO:tasks.workunit.client.1.smithi117.stdout:5/243: link d17/d2f/d3b/l4c d17/d1b/d3a/d3c/l51 0 2024-09-19T06:40:29.458 INFO:tasks.workunit.client.1.smithi117.stdout:3/321: link d0/d9/c55 d0/d9/d1c/d36/d40/d5b/c5f 0 2024-09-19T06:40:29.458 INFO:tasks.workunit.client.0.smithi099.stdout:4/121: unlink d12/d1b/d1c/l23 0 2024-09-19T06:40:29.461 INFO:tasks.workunit.client.0.smithi099.stdout:4/122: unlink d12/f18 0 2024-09-19T06:40:29.464 INFO:tasks.workunit.client.0.smithi099.stdout:4/123: creat d12/f30 x:0 0 0 2024-09-19T06:40:29.464 INFO:tasks.workunit.client.0.smithi099.stdout:4/124: dread - d12/d1b/d1c/f25 zero size 2024-09-19T06:40:29.465 INFO:tasks.workunit.client.1.smithi117.stdout:5/244: dwrite d17/f26 [0,4194304] 0 2024-09-19T06:40:29.466 INFO:tasks.workunit.client.1.smithi117.stdout:3/322: dread d0/d9/d1c/f1d [0,4194304] 0 2024-09-19T06:40:29.467 INFO:tasks.workunit.client.0.smithi099.stdout:4/125: creat d12/d1b/d1c/f31 x:0 0 0 2024-09-19T06:40:29.468 INFO:tasks.workunit.client.1.smithi117.stdout:3/323: write d0/d9/fc [506996,99069] 0 2024-09-19T06:40:29.469 INFO:tasks.workunit.client.1.smithi117.stdout:5/245: unlink d17/d2e/f50 0 2024-09-19T06:40:29.469 INFO:tasks.workunit.client.0.smithi099.stdout:5/227: rmdir d3/d1f 39 2024-09-19T06:40:29.470 INFO:tasks.workunit.client.1.smithi117.stdout:0/170: dread d11/d13/d1b/d27/f29 [0,4194304] 0 2024-09-19T06:40:29.471 INFO:tasks.workunit.client.1.smithi117.stdout:2/230: truncate d0/d7/f16 2373202 0 2024-09-19T06:40:29.472 INFO:tasks.workunit.client.0.smithi099.stdout:4/126: dread d12/d1b/d24/f29 [0,4194304] 0 2024-09-19T06:40:29.473 INFO:tasks.workunit.client.1.smithi117.stdout:4/293: dread d3/db/d23/f54 [0,4194304] 0 2024-09-19T06:40:29.474 INFO:tasks.workunit.client.0.smithi099.stdout:4/127: write f10 [3640945,100887] 0 2024-09-19T06:40:29.475 INFO:tasks.workunit.client.1.smithi117.stdout:5/246: creat d17/d1b/d3a/d3c/f52 x:0 0 0 2024-09-19T06:40:29.475 INFO:tasks.workunit.client.1.smithi117.stdout:4/294: fsync d3/db/d23/f57 0 2024-09-19T06:40:29.477 INFO:tasks.workunit.client.1.smithi117.stdout:0/171: write f0 [4930855,57803] 0 2024-09-19T06:40:29.479 INFO:tasks.workunit.client.0.smithi099.stdout:5/228: dwrite d3/d16/d2f/d34/d3c/f49 [0,4194304] 0 2024-09-19T06:40:29.480 INFO:tasks.workunit.client.1.smithi117.stdout:3/324: creat d0/d9/d1c/f60 x:0 0 0 2024-09-19T06:40:29.482 INFO:tasks.workunit.client.1.smithi117.stdout:3/325: write d0/d9/d1c/d36/f57 [1231732,34440] 0 2024-09-19T06:40:29.482 INFO:tasks.workunit.client.0.smithi099.stdout:5/229: symlink d3/d14/l55 0 2024-09-19T06:40:29.483 INFO:tasks.workunit.client.1.smithi117.stdout:5/247: creat d17/d1b/d3a/d3c/f53 x:0 0 0 2024-09-19T06:40:29.484 INFO:tasks.workunit.client.1.smithi117.stdout:5/248: write d17/d2f/d3b/f44 [739340,115282] 0 2024-09-19T06:40:29.484 INFO:tasks.workunit.client.1.smithi117.stdout:4/295: mknod d3/d65/d66/c6b 0 2024-09-19T06:40:29.487 INFO:tasks.workunit.client.1.smithi117.stdout:4/296: rmdir d3/d65 39 2024-09-19T06:40:29.488 INFO:tasks.workunit.client.1.smithi117.stdout:2/231: link d0/d7/c21 d0/d7/d29/c5d 0 2024-09-19T06:40:29.488 INFO:tasks.workunit.client.1.smithi117.stdout:3/326: mknod d0/d9/d1c/c61 0 2024-09-19T06:40:29.488 INFO:tasks.workunit.client.0.smithi099.stdout:4/128: rename d12/d1b/d24 to d12/d32 0 2024-09-19T06:40:29.489 INFO:tasks.workunit.client.1.smithi117.stdout:5/249: chown d17/d2e/l42 0 1 2024-09-19T06:40:29.489 INFO:tasks.workunit.client.1.smithi117.stdout:5/250: read d17/f26 [1641455,115271] 0 2024-09-19T06:40:29.491 INFO:tasks.workunit.client.0.smithi099.stdout:4/129: symlink d12/d32/l33 0 2024-09-19T06:40:29.491 INFO:tasks.workunit.client.1.smithi117.stdout:0/172: dread d11/d13/d14/d16/f1a [0,4194304] 0 2024-09-19T06:40:29.492 INFO:tasks.workunit.client.1.smithi117.stdout:4/297: rename d3/d28/d2a/f68 to d3/db/d20/d29/d39/f6c 0 2024-09-19T06:40:29.494 INFO:tasks.workunit.client.1.smithi117.stdout:3/327: creat d0/f62 x:0 0 0 2024-09-19T06:40:29.494 INFO:tasks.workunit.client.1.smithi117.stdout:4/298: read d3/d28/d2a/f5e [129422,126202] 0 2024-09-19T06:40:29.494 INFO:tasks.workunit.client.1.smithi117.stdout:0/173: creat d11/d13/d14/d2c/f30 x:0 0 0 2024-09-19T06:40:29.495 INFO:tasks.workunit.client.1.smithi117.stdout:2/232: creat d0/f5e x:0 0 0 2024-09-19T06:40:29.496 INFO:tasks.workunit.client.0.smithi099.stdout:4/130: link d12/l17 d12/l34 0 2024-09-19T06:40:29.496 INFO:tasks.workunit.client.0.smithi099.stdout:3/170: sync 2024-09-19T06:40:29.496 INFO:tasks.workunit.client.0.smithi099.stdout:0/76: sync 2024-09-19T06:40:29.496 INFO:tasks.workunit.client.1.smithi117.stdout:3/328: write d0/d9/f50 [63652,123569] 0 2024-09-19T06:40:29.496 INFO:tasks.workunit.client.0.smithi099.stdout:5/230: write d3/f37 [1552066,10600] 0 2024-09-19T06:40:29.497 INFO:tasks.workunit.client.1.smithi117.stdout:4/299: unlink d3/f2b 0 2024-09-19T06:40:29.497 INFO:tasks.workunit.client.0.smithi099.stdout:5/231: dread - d3/d16/f30 zero size 2024-09-19T06:40:29.498 INFO:tasks.workunit.client.1.smithi117.stdout:4/300: readlink d3/db/d20/d29/l64 0 2024-09-19T06:40:29.499 INFO:tasks.workunit.client.1.smithi117.stdout:0/174: rename d11/d13/d14/d16/c1f to d11/d13/c31 0 2024-09-19T06:40:29.500 INFO:tasks.workunit.client.1.smithi117.stdout:3/329: chown d0/d9/d1c/l4b 10 1 2024-09-19T06:40:29.501 INFO:tasks.workunit.client.1.smithi117.stdout:3/330: stat d0/d9/fd 0 2024-09-19T06:40:29.502 INFO:tasks.workunit.client.1.smithi117.stdout:4/301: truncate d3/d4/f9 144730 0 2024-09-19T06:40:29.503 INFO:tasks.workunit.client.1.smithi117.stdout:2/233: rename d0/d7/f1c to d0/d7/d29/f5f 0 2024-09-19T06:40:29.505 INFO:tasks.workunit.client.0.smithi099.stdout:4/131: dwrite d12/f16 [0,4194304] 0 2024-09-19T06:40:29.505 INFO:tasks.workunit.client.0.smithi099.stdout:5/232: write d3/f9 [1285432,38008] 0 2024-09-19T06:40:29.506 INFO:tasks.workunit.client.1.smithi117.stdout:0/175: rename d11/d13/d14/d16/f1e to d11/d13/d14/d2c/f32 0 2024-09-19T06:40:29.506 INFO:tasks.workunit.client.0.smithi099.stdout:3/171: dwrite d7/f12 [4194304,4194304] 0 2024-09-19T06:40:29.507 INFO:tasks.workunit.client.1.smithi117.stdout:2/234: rmdir d0/d7/d1e 39 2024-09-19T06:40:29.509 INFO:tasks.workunit.client.0.smithi099.stdout:4/132: dread - d12/d1b/d1c/f31 zero size 2024-09-19T06:40:29.509 INFO:tasks.workunit.client.1.smithi117.stdout:2/235: truncate d0/d7/d29/d35/d3d/f57 1804238 0 2024-09-19T06:40:29.510 INFO:tasks.workunit.client.0.smithi099.stdout:4/133: dread - d12/d1b/d1c/f25 zero size 2024-09-19T06:40:29.510 INFO:tasks.workunit.client.0.smithi099.stdout:4/134: write f11 [1195770,97441] 0 2024-09-19T06:40:29.512 INFO:tasks.workunit.client.1.smithi117.stdout:0/176: unlink d11/d13/c1c 0 2024-09-19T06:40:29.514 INFO:tasks.workunit.client.1.smithi117.stdout:3/331: getdents d0/d19/d2b 0 2024-09-19T06:40:29.514 INFO:tasks.workunit.client.1.smithi117.stdout:3/332: chown d0/d24/f5c 0 1 2024-09-19T06:40:29.518 INFO:tasks.workunit.client.0.smithi099.stdout:5/233: dwrite d3/d7/f1c [0,4194304] 0 2024-09-19T06:40:29.521 INFO:tasks.workunit.client.0.smithi099.stdout:4/135: getdents d12/d32 0 2024-09-19T06:40:29.522 INFO:tasks.workunit.client.0.smithi099.stdout:4/136: truncate d12/f2a 340596 0 2024-09-19T06:40:29.523 INFO:tasks.workunit.client.0.smithi099.stdout:4/137: chown d12/f1a 15909234 1 2024-09-19T06:40:29.523 INFO:tasks.workunit.client.0.smithi099.stdout:5/234: rename d3/d16/d2f/d34/d3c/l3e to d3/d16/d2f/l56 0 2024-09-19T06:40:29.525 INFO:tasks.workunit.client.0.smithi099.stdout:5/235: write d3/d16/f2b [426570,18736] 0 2024-09-19T06:40:29.525 INFO:tasks.workunit.client.0.smithi099.stdout:4/138: truncate d12/d1b/d1c/f26 4945077 0 2024-09-19T06:40:29.526 INFO:tasks.workunit.client.1.smithi117.stdout:2/236: getdents d0/d12 0 2024-09-19T06:40:29.526 INFO:tasks.workunit.client.0.smithi099.stdout:5/236: write d3/d14/f38 [688328,42768] 0 2024-09-19T06:40:29.527 INFO:tasks.workunit.client.1.smithi117.stdout:3/333: creat d0/f63 x:0 0 0 2024-09-19T06:40:29.529 INFO:tasks.workunit.client.1.smithi117.stdout:0/177: getdents d11/d13/d1b/d27 0 2024-09-19T06:40:29.529 INFO:tasks.workunit.client.0.smithi099.stdout:5/237: symlink d3/d2a/l57 0 2024-09-19T06:40:29.530 INFO:tasks.workunit.client.1.smithi117.stdout:2/237: unlink d0/d7/l49 0 2024-09-19T06:40:29.531 INFO:tasks.workunit.client.0.smithi099.stdout:5/238: rmdir d3/d1f/d4f 39 2024-09-19T06:40:29.532 INFO:tasks.workunit.client.1.smithi117.stdout:2/238: write d0/d7/d29/d35/d3d/f57 [1063227,27031] 0 2024-09-19T06:40:29.533 INFO:tasks.workunit.client.1.smithi117.stdout:0/178: creat d11/d13/d14/f33 x:0 0 0 2024-09-19T06:40:29.535 INFO:tasks.workunit.client.1.smithi117.stdout:3/334: fsync d0/f6 0 2024-09-19T06:40:29.535 INFO:tasks.workunit.client.0.smithi099.stdout:5/239: chown d3/d1f/d4f/l54 8 1 2024-09-19T06:40:29.536 INFO:tasks.workunit.client.0.smithi099.stdout:4/139: dwrite d12/d32/f29 [0,4194304] 0 2024-09-19T06:40:29.537 INFO:tasks.workunit.client.1.smithi117.stdout:2/239: creat d0/d12/d2f/f60 x:0 0 0 2024-09-19T06:40:29.537 INFO:tasks.workunit.client.0.smithi099.stdout:3/172: write d7/f10 [2404577,76883] 0 2024-09-19T06:40:29.539 INFO:tasks.workunit.client.0.smithi099.stdout:5/240: rename d3/d14/f35 to d3/d16/f58 0 2024-09-19T06:40:29.539 INFO:tasks.workunit.client.0.smithi099.stdout:5/241: dread - d3/d2a/f45 zero size 2024-09-19T06:40:29.540 INFO:tasks.workunit.client.0.smithi099.stdout:3/173: symlink d7/d16/d1d/l25 0 2024-09-19T06:40:29.541 INFO:tasks.workunit.client.0.smithi099.stdout:4/140: creat d12/f35 x:0 0 0 2024-09-19T06:40:29.542 INFO:tasks.workunit.client.1.smithi117.stdout:4/302: read d3/d4/f9 [60341,99940] 0 2024-09-19T06:40:29.542 INFO:tasks.workunit.client.1.smithi117.stdout:3/335: mkdir d0/d8/d64 0 2024-09-19T06:40:29.543 INFO:tasks.workunit.client.1.smithi117.stdout:4/303: stat d3/db/d20/d35/d45/f5d 0 2024-09-19T06:40:29.543 INFO:tasks.workunit.client.0.smithi099.stdout:3/174: write f6 [1060379,12380] 0 2024-09-19T06:40:29.548 INFO:tasks.workunit.client.0.smithi099.stdout:4/141: symlink d12/d1b/l36 0 2024-09-19T06:40:29.548 INFO:tasks.workunit.client.0.smithi099.stdout:5/242: dread d3/d16/d2f/d34/d3c/f49 [0,4194304] 0 2024-09-19T06:40:29.550 INFO:tasks.workunit.client.1.smithi117.stdout:4/304: dwrite d3/db/ff [4194304,4194304] 0 2024-09-19T06:40:29.552 INFO:tasks.workunit.client.0.smithi099.stdout:4/142: rmdir d12/d1b/d1c 39 2024-09-19T06:40:29.553 INFO:tasks.workunit.client.1.smithi117.stdout:3/336: symlink d0/d9/d4e/l65 0 2024-09-19T06:40:29.555 INFO:tasks.workunit.client.0.smithi099.stdout:3/175: dwrite d7/f10 [0,4194304] 0 2024-09-19T06:40:29.555 INFO:tasks.workunit.client.0.smithi099.stdout:5/243: dread d3/d1f/f21 [0,4194304] 0 2024-09-19T06:40:29.556 INFO:tasks.workunit.client.1.smithi117.stdout:2/240: mkdir d0/d7/d29/d35/d61 0 2024-09-19T06:40:29.557 INFO:tasks.workunit.client.0.smithi099.stdout:4/143: mknod d12/d1b/d1c/c37 0 2024-09-19T06:40:29.559 INFO:tasks.workunit.client.0.smithi099.stdout:4/144: fsync d12/d1b/d1c/f31 0 2024-09-19T06:40:29.560 INFO:tasks.workunit.client.1.smithi117.stdout:3/337: dwrite d0/d24/f58 [0,4194304] 0 2024-09-19T06:40:29.564 INFO:tasks.workunit.client.1.smithi117.stdout:2/241: unlink d0/d12/f27 0 2024-09-19T06:40:29.570 INFO:tasks.workunit.client.0.smithi099.stdout:3/176: dwrite f6 [0,4194304] 0 2024-09-19T06:40:29.572 INFO:tasks.workunit.client.1.smithi117.stdout:3/338: getdents d0/d8 0 2024-09-19T06:40:29.572 INFO:tasks.workunit.client.1.smithi117.stdout:1/230: sync 2024-09-19T06:40:29.573 INFO:tasks.workunit.client.0.smithi099.stdout:5/244: dwrite d3/f37 [0,4194304] 0 2024-09-19T06:40:29.574 INFO:tasks.workunit.client.0.smithi099.stdout:4/145: dread d12/d32/f29 [0,4194304] 0 2024-09-19T06:40:29.575 INFO:tasks.workunit.client.1.smithi117.stdout:3/339: unlink d0/la 0 2024-09-19T06:40:29.575 INFO:tasks.workunit.client.1.smithi117.stdout:3/340: write d0/d19/f3e [223756,23416] 0 2024-09-19T06:40:29.576 INFO:tasks.workunit.client.1.smithi117.stdout:1/231: read d3/f2e [2800357,125746] 0 2024-09-19T06:40:29.576 INFO:tasks.workunit.client.1.smithi117.stdout:3/341: write d0/f15 [4725683,51776] 0 2024-09-19T06:40:29.578 INFO:tasks.workunit.client.1.smithi117.stdout:4/305: dread d3/de/f12 [0,4194304] 0 2024-09-19T06:40:29.578 INFO:tasks.workunit.client.1.smithi117.stdout:4/306: readlink d3/db/d13/l26 0 2024-09-19T06:40:29.580 INFO:tasks.workunit.client.0.smithi099.stdout:3/177: link d7/f12 d7/d23/f26 0 2024-09-19T06:40:29.580 INFO:tasks.workunit.client.1.smithi117.stdout:3/342: unlink d0/d24/f58 0 2024-09-19T06:40:29.583 INFO:tasks.workunit.client.0.smithi099.stdout:3/178: mknod d7/d16/d1d/c27 0 2024-09-19T06:40:29.584 INFO:tasks.workunit.client.1.smithi117.stdout:1/232: link d3/d18/f3f d3/d18/d23/f4f 0 2024-09-19T06:40:29.585 INFO:tasks.workunit.client.1.smithi117.stdout:3/343: dread d0/f13 [0,4194304] 0 2024-09-19T06:40:29.585 INFO:tasks.workunit.client.1.smithi117.stdout:1/233: chown d3/d18/d23/f34 53424544 1 2024-09-19T06:40:29.586 INFO:tasks.workunit.client.0.smithi099.stdout:5/245: dwrite d3/f9 [0,4194304] 0 2024-09-19T06:40:29.588 INFO:tasks.workunit.client.0.smithi099.stdout:5/246: write d3/d7/ff [1705664,47057] 0 2024-09-19T06:40:29.588 INFO:tasks.workunit.client.1.smithi117.stdout:3/344: creat d0/d8/d64/f66 x:0 0 0 2024-09-19T06:40:29.589 INFO:tasks.workunit.client.1.smithi117.stdout:4/307: dread d3/db/d20/f36 [0,4194304] 0 2024-09-19T06:40:29.591 INFO:tasks.workunit.client.0.smithi099.stdout:5/247: rename d3/l4 to d3/d14/l59 0 2024-09-19T06:40:29.592 INFO:tasks.workunit.client.1.smithi117.stdout:3/345: rename d0/d9/d4e/f5d to d0/d9/d1c/d36/d40/f67 0 2024-09-19T06:40:29.593 INFO:tasks.workunit.client.1.smithi117.stdout:4/308: mknod d3/db/d20/d29/d39/c6d 0 2024-09-19T06:40:29.594 INFO:tasks.workunit.client.1.smithi117.stdout:4/309: fsync d3/db/d13/f3c 0 2024-09-19T06:40:29.595 INFO:tasks.workunit.client.1.smithi117.stdout:4/310: fdatasync d3/db/d20/d35/d45/f5d 0 2024-09-19T06:40:29.600 INFO:tasks.workunit.client.0.smithi099.stdout:5/248: dwrite d3/d1f/f51 [0,4194304] 0 2024-09-19T06:40:29.603 INFO:tasks.workunit.client.0.smithi099.stdout:5/249: mknod d3/d2a/c5a 0 2024-09-19T06:40:29.603 INFO:tasks.workunit.client.1.smithi117.stdout:0/179: dwrite d11/d13/d14/d2c/f32 [0,4194304] 0 2024-09-19T06:40:29.604 INFO:tasks.workunit.client.1.smithi117.stdout:4/311: dwrite d3/db/ff [0,4194304] 0 2024-09-19T06:40:29.604 INFO:tasks.workunit.client.0.smithi099.stdout:5/250: write d3/d2a/f2e [1418045,130371] 0 2024-09-19T06:40:29.608 INFO:tasks.workunit.client.1.smithi117.stdout:4/312: chown d3/db/d13/f3c 1489 1 2024-09-19T06:40:29.609 INFO:tasks.workunit.client.1.smithi117.stdout:4/313: chown d3/db/d20/d35 47 1 2024-09-19T06:40:29.610 INFO:tasks.workunit.client.0.smithi099.stdout:3/179: getdents d7/d23 0 2024-09-19T06:40:29.610 INFO:tasks.workunit.client.0.smithi099.stdout:3/180: chown d7/d16/d1d/l25 202 1 2024-09-19T06:40:29.610 INFO:tasks.workunit.client.0.smithi099.stdout:3/181: read - d7/d16/d1d/f22 zero size 2024-09-19T06:40:29.610 INFO:tasks.workunit.client.0.smithi099.stdout:3/182: mkdir d7/d16/d28 0 2024-09-19T06:40:29.611 INFO:tasks.workunit.client.1.smithi117.stdout:1/234: truncate d3/f14 1796954 0 2024-09-19T06:40:29.611 INFO:tasks.workunit.client.1.smithi117.stdout:3/346: rename d0/d9/d1c/d36 to d0/d3d/d68 0 2024-09-19T06:40:29.612 INFO:tasks.workunit.client.1.smithi117.stdout:0/180: rmdir d11/d13/d14/d2c 39 2024-09-19T06:40:29.613 INFO:tasks.workunit.client.0.smithi099.stdout:3/183: truncate d7/f10 5024821 0 2024-09-19T06:40:29.613 INFO:tasks.workunit.client.0.smithi099.stdout:5/251: dwrite d3/d7/f23 [0,4194304] 0 2024-09-19T06:40:29.613 INFO:tasks.workunit.client.0.smithi099.stdout:3/184: stat d7/d16/d1d/d20 0 2024-09-19T06:40:29.613 INFO:tasks.workunit.client.1.smithi117.stdout:1/235: fdatasync d3/f5 0 2024-09-19T06:40:29.614 INFO:tasks.workunit.client.1.smithi117.stdout:1/236: chown d3/l11 138 1 2024-09-19T06:40:29.614 INFO:tasks.workunit.client.0.smithi099.stdout:5/252: truncate d3/d1f/f51 5072279 0 2024-09-19T06:40:29.616 INFO:tasks.workunit.client.1.smithi117.stdout:0/181: write d11/d13/d14/d2c/f2f [480084,43074] 0 2024-09-19T06:40:29.617 INFO:tasks.workunit.client.1.smithi117.stdout:4/314: mkdir d3/db/d20/d29/d39/d4f/d6e 0 2024-09-19T06:40:29.618 INFO:tasks.workunit.client.1.smithi117.stdout:1/237: rmdir d3/d22/d2f 39 2024-09-19T06:40:29.620 INFO:tasks.workunit.client.0.smithi099.stdout:5/253: dread d3/d16/f2b [0,4194304] 0 2024-09-19T06:40:29.620 INFO:tasks.workunit.client.1.smithi117.stdout:1/238: write d3/d18/d23/f34 [1058559,88012] 0 2024-09-19T06:40:29.621 INFO:tasks.workunit.client.1.smithi117.stdout:2/242: rename d0/d7/d29/d35/l39 to d0/d12/d2f/l62 0 2024-09-19T06:40:29.622 INFO:tasks.workunit.client.0.smithi099.stdout:5/254: creat d3/d1f/d4f/f5b x:0 0 0 2024-09-19T06:40:29.625 INFO:tasks.workunit.client.1.smithi117.stdout:1/239: symlink d3/d22/l50 0 2024-09-19T06:40:29.626 INFO:tasks.workunit.client.1.smithi117.stdout:4/315: getdents d3/d28 0 2024-09-19T06:40:29.627 INFO:tasks.workunit.client.0.smithi099.stdout:5/255: rename d3/d7/f23 to d3/d1f/d4f/f5c 0 2024-09-19T06:40:29.627 INFO:tasks.workunit.client.0.smithi099.stdout:5/256: chown d3/d2a/f32 8205878 1 2024-09-19T06:40:29.628 INFO:tasks.workunit.client.0.smithi099.stdout:5/257: readlink d3/d14/l1e 0 2024-09-19T06:40:29.629 INFO:tasks.workunit.client.1.smithi117.stdout:1/240: mkdir d3/d18/d23/d51 0 2024-09-19T06:40:29.629 INFO:tasks.workunit.client.1.smithi117.stdout:4/316: getdents d3/d28 0 2024-09-19T06:40:29.630 INFO:tasks.workunit.client.1.smithi117.stdout:2/243: dwrite d0/d7/d1e/d20/f44 [0,4194304] 0 2024-09-19T06:40:29.630 INFO:tasks.workunit.client.1.smithi117.stdout:1/241: write d3/f2e [4947264,2937] 0 2024-09-19T06:40:29.636 INFO:tasks.workunit.client.1.smithi117.stdout:4/317: rename d3/de/f15 to d3/db/d20/d4a/f6f 0 2024-09-19T06:40:29.636 INFO:tasks.workunit.client.1.smithi117.stdout:2/244: truncate d0/d7/f2d 4132236 0 2024-09-19T06:40:29.640 INFO:tasks.workunit.client.0.smithi099.stdout:5/258: fdatasync d3/d1f/f51 0 2024-09-19T06:40:29.642 INFO:tasks.workunit.client.1.smithi117.stdout:4/318: dwrite d3/d4/d14/f60 [0,4194304] 0 2024-09-19T06:40:29.643 INFO:tasks.workunit.client.1.smithi117.stdout:4/319: chown d3/db/d20/d35/d45/f5d 21027396 1 2024-09-19T06:40:29.644 INFO:tasks.workunit.client.1.smithi117.stdout:4/320: chown d3/db/f47 1353 1 2024-09-19T06:40:29.644 INFO:tasks.workunit.client.0.smithi099.stdout:5/259: dread d3/f25 [0,4194304] 0 2024-09-19T06:40:29.644 INFO:tasks.workunit.client.0.smithi099.stdout:5/260: readlink d3/d2a/l57 0 2024-09-19T06:40:29.646 INFO:tasks.workunit.client.1.smithi117.stdout:4/321: creat d3/db/d20/d35/f70 x:0 0 0 2024-09-19T06:40:29.647 INFO:tasks.workunit.client.1.smithi117.stdout:4/322: fdatasync d3/d4/d14/f17 0 2024-09-19T06:40:29.651 INFO:tasks.workunit.client.0.smithi099.stdout:5/261: dwrite d3/d7/f1c [0,4194304] 0 2024-09-19T06:40:29.653 INFO:tasks.workunit.client.0.smithi099.stdout:5/262: mknod d3/d16/c5d 0 2024-09-19T06:40:29.654 INFO:tasks.workunit.client.1.smithi117.stdout:4/323: link d3/d28/d2a/c50 d3/d65/d66/c71 0 2024-09-19T06:40:29.654 INFO:tasks.workunit.client.0.smithi099.stdout:5/263: read d3/d1f/f51 [4025693,121719] 0 2024-09-19T06:40:29.655 INFO:tasks.workunit.client.1.smithi117.stdout:3/347: truncate d0/f13 2314119 0 2024-09-19T06:40:29.657 INFO:tasks.workunit.client.0.smithi099.stdout:5/264: mkdir d3/d16/d5e 0 2024-09-19T06:40:29.658 INFO:tasks.workunit.client.1.smithi117.stdout:4/324: creat d3/db/d20/d29/d39/d4f/f72 x:0 0 0 2024-09-19T06:40:29.659 INFO:tasks.workunit.client.0.smithi099.stdout:5/265: chown d3/d16/d2f/d34/l41 1 1 2024-09-19T06:40:29.659 INFO:tasks.workunit.client.1.smithi117.stdout:3/348: creat d0/d19/f69 x:0 0 0 2024-09-19T06:40:29.660 INFO:tasks.workunit.client.1.smithi117.stdout:0/182: truncate d11/d13/d14/d2c/f2f 277194 0 2024-09-19T06:40:29.661 INFO:tasks.workunit.client.0.smithi099.stdout:5/266: creat d3/d2a/f5f x:0 0 0 2024-09-19T06:40:29.661 INFO:tasks.workunit.client.1.smithi117.stdout:4/325: mknod d3/db/d20/d29/d39/c73 0 2024-09-19T06:40:29.663 INFO:tasks.workunit.client.1.smithi117.stdout:0/183: creat d11/d13/d14/d16/f34 x:0 0 0 2024-09-19T06:40:29.664 INFO:tasks.workunit.client.1.smithi117.stdout:4/326: mknod d3/db/d20/d35/d45/c74 0 2024-09-19T06:40:29.665 INFO:tasks.workunit.client.1.smithi117.stdout:3/349: link d0/f1e d0/d8/d64/f6a 0 2024-09-19T06:40:29.666 INFO:tasks.workunit.client.0.smithi099.stdout:5/267: dwrite d3/d2a/f4c [0,4194304] 0 2024-09-19T06:40:29.667 INFO:tasks.workunit.client.0.smithi099.stdout:6/91: sync 2024-09-19T06:40:29.669 INFO:tasks.workunit.client.1.smithi117.stdout:4/327: truncate d3/db/d20/d29/d39/f6c 1357853 0 2024-09-19T06:40:29.669 INFO:tasks.workunit.client.0.smithi099.stdout:6/92: creat d1/d12/f21 x:0 0 0 2024-09-19T06:40:29.671 INFO:tasks.workunit.client.1.smithi117.stdout:1/242: dwrite d3/f13 [0,4194304] 0 2024-09-19T06:40:29.671 INFO:tasks.workunit.client.1.smithi117.stdout:1/243: readlink d3/d18/l2c 0 2024-09-19T06:40:29.672 INFO:tasks.workunit.client.1.smithi117.stdout:1/244: fsync d3/d18/d23/f28 0 2024-09-19T06:40:29.674 INFO:tasks.workunit.client.1.smithi117.stdout:1/245: truncate d3/f9 4857932 0 2024-09-19T06:40:29.683 INFO:tasks.workunit.client.0.smithi099.stdout:6/93: rename d1/d12/c17 to d1/d5/c22 0 2024-09-19T06:40:29.684 INFO:tasks.workunit.client.0.smithi099.stdout:5/268: dwrite d3/d7/f10 [0,4194304] 0 2024-09-19T06:40:29.685 INFO:tasks.workunit.client.0.smithi099.stdout:6/94: mknod d1/d12/c23 0 2024-09-19T06:40:29.687 INFO:tasks.workunit.client.1.smithi117.stdout:4/328: creat d3/d65/f75 x:0 0 0 2024-09-19T06:40:29.687 INFO:tasks.workunit.client.0.smithi099.stdout:5/269: rename d3/d16/c43 to d3/d14/c60 0 2024-09-19T06:40:29.688 INFO:tasks.workunit.client.1.smithi117.stdout:2/245: dwrite d0/d12/f2c [0,4194304] 0 2024-09-19T06:40:29.688 INFO:tasks.workunit.client.0.smithi099.stdout:6/95: mkdir d1/d5/d24 0 2024-09-19T06:40:29.690 INFO:tasks.workunit.client.1.smithi117.stdout:0/184: getdents d11/d13/d14/d2c 0 2024-09-19T06:40:29.691 INFO:tasks.workunit.client.0.smithi099.stdout:6/96: mkdir d1/d5/d24/d25 0 2024-09-19T06:40:29.692 INFO:tasks.workunit.client.1.smithi117.stdout:0/185: truncate d11/d13/d14/d16/f34 211391 0 2024-09-19T06:40:29.695 INFO:tasks.workunit.client.1.smithi117.stdout:1/246: link d3/f3c d3/d18/d23/f52 0 2024-09-19T06:40:29.695 INFO:tasks.workunit.client.1.smithi117.stdout:4/329: getdents d3/db/d20/d29/d39/d4f/d6e 0 2024-09-19T06:40:29.696 INFO:tasks.workunit.client.1.smithi117.stdout:2/246: getdents d0/d7/d29/d35/d61 0 2024-09-19T06:40:29.696 INFO:tasks.workunit.client.0.smithi099.stdout:6/97: dread d1/f1e [0,4194304] 0 2024-09-19T06:40:29.697 INFO:tasks.workunit.client.0.smithi099.stdout:6/98: readlink d1/l20 0 2024-09-19T06:40:29.697 INFO:tasks.workunit.client.1.smithi117.stdout:0/186: mkdir d11/d13/d14/d2c/d35 0 2024-09-19T06:40:29.697 INFO:tasks.workunit.client.0.smithi099.stdout:6/99: chown d1/f10 513579367 1 2024-09-19T06:40:29.697 INFO:tasks.workunit.client.0.smithi099.stdout:6/100: readlink d1/l15 0 2024-09-19T06:40:29.698 INFO:tasks.workunit.client.1.smithi117.stdout:2/247: dread d0/d12/d2f/f40 [0,4194304] 0 2024-09-19T06:40:29.701 INFO:tasks.workunit.client.1.smithi117.stdout:4/330: mknod d3/db/d20/c76 0 2024-09-19T06:40:29.703 INFO:tasks.workunit.client.0.smithi099.stdout:5/270: truncate d3/d14/f38 497368 0 2024-09-19T06:40:29.703 INFO:tasks.workunit.client.1.smithi117.stdout:0/187: creat d11/d13/d14/d2c/f36 x:0 0 0 2024-09-19T06:40:29.703 INFO:tasks.workunit.client.0.smithi099.stdout:5/271: dread - d3/d1f/d4f/f5b zero size 2024-09-19T06:40:29.705 INFO:tasks.workunit.client.1.smithi117.stdout:1/247: creat d3/d18/f53 x:0 0 0 2024-09-19T06:40:29.706 INFO:tasks.workunit.client.0.smithi099.stdout:5/272: creat d3/d7/d47/f61 x:0 0 0 2024-09-19T06:40:29.706 INFO:tasks.workunit.client.1.smithi117.stdout:9/256: sync 2024-09-19T06:40:29.706 INFO:tasks.workunit.client.1.smithi117.stdout:6/187: sync 2024-09-19T06:40:29.706 INFO:tasks.workunit.client.1.smithi117.stdout:7/250: sync 2024-09-19T06:40:29.708 INFO:tasks.workunit.client.1.smithi117.stdout:0/188: mkdir d11/d13/d1b/d27/d37 0 2024-09-19T06:40:29.709 INFO:tasks.workunit.client.0.smithi099.stdout:5/273: chown d3/d14/f38 1814 1 2024-09-19T06:40:29.710 INFO:tasks.workunit.client.1.smithi117.stdout:1/248: fdatasync d3/d18/d23/d3a/f47 0 2024-09-19T06:40:29.711 INFO:tasks.workunit.client.1.smithi117.stdout:0/189: write d11/d13/d14/f1d [8711720,18141] 0 2024-09-19T06:40:29.711 INFO:tasks.workunit.client.0.smithi099.stdout:6/101: truncate d1/fe 1235284 0 2024-09-19T06:40:29.712 INFO:tasks.workunit.client.1.smithi117.stdout:6/188: truncate d1/d14/f2b 542476 0 2024-09-19T06:40:29.712 INFO:tasks.workunit.client.1.smithi117.stdout:9/257: creat d4/d20/f53 x:0 0 0 2024-09-19T06:40:29.713 INFO:tasks.workunit.client.1.smithi117.stdout:6/189: fdatasync d1/f1d 0 2024-09-19T06:40:29.714 INFO:tasks.workunit.client.0.smithi099.stdout:5/274: creat d3/d16/d5e/f62 x:0 0 0 2024-09-19T06:40:29.714 INFO:tasks.workunit.client.1.smithi117.stdout:1/249: write d3/f38 [1138664,54733] 0 2024-09-19T06:40:29.716 INFO:tasks.workunit.client.0.smithi099.stdout:5/275: creat d3/d16/d5e/f63 x:0 0 0 2024-09-19T06:40:29.717 INFO:tasks.workunit.client.1.smithi117.stdout:0/190: fsync d11/d13/d1b/d27/f29 0 2024-09-19T06:40:29.719 INFO:tasks.workunit.client.1.smithi117.stdout:9/258: dread f0 [0,4194304] 0 2024-09-19T06:40:29.720 INFO:tasks.workunit.client.1.smithi117.stdout:2/248: getdents d0/d7/d1e 0 2024-09-19T06:40:29.720 INFO:tasks.workunit.client.0.smithi099.stdout:5/276: dread d3/d1f/f20 [0,4194304] 0 2024-09-19T06:40:29.722 INFO:tasks.workunit.client.0.smithi099.stdout:6/102: truncate d1/fe 1693169 0 2024-09-19T06:40:29.722 INFO:tasks.workunit.client.1.smithi117.stdout:3/350: dwrite d0/d9/d1c/f28 [0,4194304] 0 2024-09-19T06:40:29.724 INFO:tasks.workunit.client.1.smithi117.stdout:4/331: getdents d3/d65/d66 0 2024-09-19T06:40:29.725 INFO:tasks.workunit.client.1.smithi117.stdout:2/249: read d0/d12/d2f/f51 [4062339,91419] 0 2024-09-19T06:40:29.726 INFO:tasks.workunit.client.1.smithi117.stdout:9/259: dread - d4/d1c/d46/f49 zero size 2024-09-19T06:40:29.727 INFO:tasks.workunit.client.0.smithi099.stdout:6/103: dread d1/d5/f14 [0,4194304] 0 2024-09-19T06:40:29.728 INFO:tasks.workunit.client.0.smithi099.stdout:6/104: write d1/f1d [1029814,87119] 0 2024-09-19T06:40:29.730 INFO:tasks.workunit.client.0.smithi099.stdout:5/277: truncate d3/f25 2781326 0 2024-09-19T06:40:29.732 INFO:tasks.workunit.client.1.smithi117.stdout:4/332: dwrite d3/f7 [0,4194304] 0 2024-09-19T06:40:29.733 INFO:tasks.workunit.client.1.smithi117.stdout:4/333: readlink d3/d4/d14/l22 0 2024-09-19T06:40:29.734 INFO:tasks.workunit.client.0.smithi099.stdout:6/105: dread d1/f1e [0,4194304] 0 2024-09-19T06:40:29.736 INFO:tasks.workunit.client.1.smithi117.stdout:6/190: getdents d1 0 2024-09-19T06:40:29.737 INFO:tasks.workunit.client.1.smithi117.stdout:7/251: dread d1/d8/d24/d1c/f28 [0,4194304] 0 2024-09-19T06:40:29.737 INFO:tasks.workunit.client.1.smithi117.stdout:0/191: rmdir d11/d13/d14/d2c 39 2024-09-19T06:40:29.737 INFO:tasks.workunit.client.1.smithi117.stdout:6/191: chown d1/d14/f2b 6886378 1 2024-09-19T06:40:29.738 INFO:tasks.workunit.client.1.smithi117.stdout:6/192: chown d1/d5/d8/d27/l2a 6 1 2024-09-19T06:40:29.739 INFO:tasks.workunit.client.0.smithi099.stdout:6/106: mkdir d1/d26 0 2024-09-19T06:40:29.740 INFO:tasks.workunit.client.1.smithi117.stdout:6/193: read d1/f1b [273233,58794] 0 2024-09-19T06:40:29.741 INFO:tasks.workunit.client.1.smithi117.stdout:2/250: rename d0/d7/d29/f53 to d0/d12/d32/f63 0 2024-09-19T06:40:29.744 INFO:tasks.workunit.client.1.smithi117.stdout:7/252: rmdir d1/d3f 39 2024-09-19T06:40:29.745 INFO:tasks.workunit.client.0.smithi099.stdout:5/278: dwrite d3/d16/f28 [0,4194304] 0 2024-09-19T06:40:29.747 INFO:tasks.workunit.client.1.smithi117.stdout:0/192: truncate d11/d13/d14/d16/f1a 965949 0 2024-09-19T06:40:29.748 INFO:tasks.workunit.client.1.smithi117.stdout:0/193: readlink d11/d13/d14/l25 0 2024-09-19T06:40:29.749 INFO:tasks.workunit.client.1.smithi117.stdout:2/251: chown d0/l1 14036301 1 2024-09-19T06:40:29.750 INFO:tasks.workunit.client.1.smithi117.stdout:6/194: rename d1/d14/c2d to d1/d5/d8/d27/d30/c31 0 2024-09-19T06:40:29.751 INFO:tasks.workunit.client.1.smithi117.stdout:3/351: getdents d0/d9/d4e 0 2024-09-19T06:40:29.752 INFO:tasks.workunit.client.1.smithi117.stdout:7/253: dwrite d1/f1e [0,4194304] 0 2024-09-19T06:40:29.755 INFO:tasks.workunit.client.1.smithi117.stdout:9/260: getdents d4 0 2024-09-19T06:40:29.755 INFO:tasks.workunit.client.0.smithi099.stdout:6/107: truncate d1/f1e 2318502 0 2024-09-19T06:40:29.756 INFO:tasks.workunit.client.0.smithi099.stdout:5/279: truncate d3/d2a/f4c 3896278 0 2024-09-19T06:40:29.756 INFO:tasks.workunit.client.1.smithi117.stdout:1/250: write d3/d18/d23/f4f [779184,108034] 0 2024-09-19T06:40:29.757 INFO:tasks.workunit.client.1.smithi117.stdout:2/252: chown d0/d12/d2f/f40 519382472 1 2024-09-19T06:40:29.757 INFO:tasks.workunit.client.1.smithi117.stdout:2/253: readlink d0/l59 0 2024-09-19T06:40:29.757 INFO:tasks.workunit.client.0.smithi099.stdout:6/108: creat d1/d12/f27 x:0 0 0 2024-09-19T06:40:29.758 INFO:tasks.workunit.client.0.smithi099.stdout:5/280: fdatasync d3/d7/f26 0 2024-09-19T06:40:29.758 INFO:tasks.workunit.client.1.smithi117.stdout:3/352: mknod d0/d3d/d48/c6b 0 2024-09-19T06:40:29.760 INFO:tasks.workunit.client.0.smithi099.stdout:6/109: dread d1/d5/f14 [0,4194304] 0 2024-09-19T06:40:29.760 INFO:tasks.workunit.client.1.smithi117.stdout:3/353: stat d0/d9/d49/c47 0 2024-09-19T06:40:29.761 INFO:tasks.workunit.client.0.smithi099.stdout:6/110: dread - d1/f19 zero size 2024-09-19T06:40:29.761 INFO:tasks.workunit.client.1.smithi117.stdout:0/194: dread f0 [0,4194304] 0 2024-09-19T06:40:29.761 INFO:tasks.workunit.client.1.smithi117.stdout:7/254: unlink d1/d8/d24/d49/c51 0 2024-09-19T06:40:29.761 INFO:tasks.workunit.client.1.smithi117.stdout:9/261: mkdir d4/d1c/d54 0 2024-09-19T06:40:29.761 INFO:tasks.workunit.client.1.smithi117.stdout:8/240: sync 2024-09-19T06:40:29.762 INFO:tasks.workunit.client.1.smithi117.stdout:5/251: sync 2024-09-19T06:40:29.762 INFO:tasks.workunit.client.1.smithi117.stdout:1/251: unlink d3/d18/d23/c39 0 2024-09-19T06:40:29.764 INFO:tasks.workunit.client.1.smithi117.stdout:2/254: mkdir d0/d64 0 2024-09-19T06:40:29.767 INFO:tasks.workunit.client.1.smithi117.stdout:5/252: mknod d17/d2e/c54 0 2024-09-19T06:40:29.770 INFO:tasks.workunit.client.1.smithi117.stdout:6/195: rename d1/d5/d8/d27/d30 to d1/d5/d32 0 2024-09-19T06:40:29.770 INFO:tasks.workunit.client.0.smithi099.stdout:6/111: getdents d1/d5 0 2024-09-19T06:40:29.771 INFO:tasks.workunit.client.0.smithi099.stdout:6/112: write d1/d12/f1f [1573542,71127] 0 2024-09-19T06:40:29.772 INFO:tasks.workunit.client.1.smithi117.stdout:5/253: mkdir d17/d2e/d55 0 2024-09-19T06:40:29.772 INFO:tasks.workunit.client.0.smithi099.stdout:6/113: chown d1/d5/f14 7130253 1 2024-09-19T06:40:29.773 INFO:tasks.workunit.client.0.smithi099.stdout:5/281: link d3/f37 d3/d7/f64 0 2024-09-19T06:40:29.774 INFO:tasks.workunit.client.0.smithi099.stdout:6/114: rmdir d1 39 2024-09-19T06:40:29.775 INFO:tasks.workunit.client.1.smithi117.stdout:1/252: mknod d3/d18/d23/d51/c54 0 2024-09-19T06:40:29.775 INFO:tasks.workunit.client.1.smithi117.stdout:2/255: fsync d0/d7/d1e/d20/d3e/f50 0 2024-09-19T06:40:29.776 INFO:tasks.workunit.client.0.smithi099.stdout:5/282: mkdir d3/d16/d2f/d34/d3c/d65 0 2024-09-19T06:40:29.777 INFO:tasks.workunit.client.0.smithi099.stdout:5/283: chown d3/d1f/d4f 1 1 2024-09-19T06:40:29.778 INFO:tasks.workunit.client.0.smithi099.stdout:5/284: fsync d3/d16/f28 0 2024-09-19T06:40:29.778 INFO:tasks.workunit.client.1.smithi117.stdout:3/354: dwrite d0/d9/d49/f46 [0,4194304] 0 2024-09-19T06:40:29.778 INFO:tasks.workunit.client.0.smithi099.stdout:5/285: chown d3/d1f/c3a 220721 1 2024-09-19T06:40:29.779 INFO:tasks.workunit.client.1.smithi117.stdout:0/195: dwrite d11/d13/d1b/d27/f29 [0,4194304] 0 2024-09-19T06:40:29.781 INFO:tasks.workunit.client.0.smithi099.stdout:9/151: sync 2024-09-19T06:40:29.781 INFO:tasks.workunit.client.0.smithi099.stdout:8/58: sync 2024-09-19T06:40:29.781 INFO:tasks.workunit.client.0.smithi099.stdout:7/130: sync 2024-09-19T06:40:29.781 INFO:tasks.workunit.client.1.smithi117.stdout:4/334: dread d3/d4/d14/f17 [0,4194304] 0 2024-09-19T06:40:29.781 INFO:tasks.workunit.client.0.smithi099.stdout:5/286: unlink d3/d14/l1e 0 2024-09-19T06:40:29.782 INFO:tasks.workunit.client.1.smithi117.stdout:2/256: dread - d0/d7/d29/f5f zero size 2024-09-19T06:40:29.782 INFO:tasks.workunit.client.0.smithi099.stdout:8/59: write d4/fd [902118,47772] 0 2024-09-19T06:40:29.783 INFO:tasks.workunit.client.1.smithi117.stdout:0/196: write d11/f19 [5251041,95168] 0 2024-09-19T06:40:29.783 INFO:tasks.workunit.client.1.smithi117.stdout:3/355: symlink d0/d9/d4e/l6c 0 2024-09-19T06:40:29.784 INFO:tasks.workunit.client.0.smithi099.stdout:9/152: creat dd/d2c/f2d x:0 0 0 2024-09-19T06:40:29.785 INFO:tasks.workunit.client.0.smithi099.stdout:9/153: fdatasync dd/f19 0 2024-09-19T06:40:29.785 INFO:tasks.workunit.client.1.smithi117.stdout:4/335: write d3/db/f3a [2339325,99498] 0 2024-09-19T06:40:29.786 INFO:tasks.workunit.client.0.smithi099.stdout:6/115: link d1/d5/c8 d1/d5/c28 0 2024-09-19T06:40:29.786 INFO:tasks.workunit.client.1.smithi117.stdout:1/253: link d3/f4c d3/d18/d23/f55 0 2024-09-19T06:40:29.787 INFO:tasks.workunit.client.0.smithi099.stdout:9/154: truncate dd/f1f 330940 0 2024-09-19T06:40:29.788 INFO:tasks.workunit.client.0.smithi099.stdout:8/60: mkdir d4/de/d10 0 2024-09-19T06:40:29.789 INFO:tasks.workunit.client.1.smithi117.stdout:4/336: write d3/db/d20/d35/d45/f5d [1678138,116825] 0 2024-09-19T06:40:29.791 INFO:tasks.workunit.client.1.smithi117.stdout:4/337: truncate d3/d65/f75 65598 0 2024-09-19T06:40:29.791 INFO:tasks.workunit.client.1.smithi117.stdout:0/197: chown d11/d13/d14/d16/f1a 97120 1 2024-09-19T06:40:29.791 INFO:tasks.workunit.client.1.smithi117.stdout:3/356: creat d0/d9/d49/f6d x:0 0 0 2024-09-19T06:40:29.792 INFO:tasks.workunit.client.1.smithi117.stdout:4/338: readlink d3/d4/lc 0 2024-09-19T06:40:29.792 INFO:tasks.workunit.client.1.smithi117.stdout:2/257: mkdir d0/d7/d29/d35/d61/d65 0 2024-09-19T06:40:29.793 INFO:tasks.workunit.client.0.smithi099.stdout:8/61: chown f3 66273 1 2024-09-19T06:40:29.794 INFO:tasks.workunit.client.0.smithi099.stdout:7/131: rename d7/dd/l18 to d7/l38 0 2024-09-19T06:40:29.794 INFO:tasks.workunit.client.1.smithi117.stdout:1/254: truncate d3/f5 7383250 0 2024-09-19T06:40:29.795 INFO:tasks.workunit.client.1.smithi117.stdout:8/241: dread d1d/d1e/f2c [0,4194304] 0 2024-09-19T06:40:29.795 INFO:tasks.workunit.client.1.smithi117.stdout:0/198: mkdir d11/d13/d28/d38 0 2024-09-19T06:40:29.797 INFO:tasks.workunit.client.0.smithi099.stdout:6/116: rename d1/l15 to d1/d5/l29 0 2024-09-19T06:40:29.797 INFO:tasks.workunit.client.1.smithi117.stdout:8/242: fdatasync f12 0 2024-09-19T06:40:29.797 INFO:tasks.workunit.client.1.smithi117.stdout:0/199: chown d11/d13/d14/d16 24015 1 2024-09-19T06:40:29.798 INFO:tasks.workunit.client.0.smithi099.stdout:7/132: mkdir d7/d39 0 2024-09-19T06:40:29.800 INFO:tasks.workunit.client.1.smithi117.stdout:1/255: unlink d3/d18/d23/d51/c54 0 2024-09-19T06:40:29.800 INFO:tasks.workunit.client.0.smithi099.stdout:6/117: dread d1/fd [0,4194304] 0 2024-09-19T06:40:29.801 INFO:tasks.workunit.client.0.smithi099.stdout:7/133: symlink d7/d39/l3a 0 2024-09-19T06:40:29.801 INFO:tasks.workunit.client.1.smithi117.stdout:2/258: mkdir d0/d7/d29/d35/d61/d65/d66 0 2024-09-19T06:40:29.801 INFO:tasks.workunit.client.0.smithi099.stdout:8/62: dwrite d4/fd [0,4194304] 0 2024-09-19T06:40:29.802 INFO:tasks.workunit.client.1.smithi117.stdout:0/200: symlink d11/d13/d1b/d27/l39 0 2024-09-19T06:40:29.802 INFO:tasks.workunit.client.0.smithi099.stdout:7/134: write d7/f26 [277511,57544] 0 2024-09-19T06:40:29.804 INFO:tasks.workunit.client.1.smithi117.stdout:8/243: mkdir d1d/d2a/d3f/d4b 0 2024-09-19T06:40:29.805 INFO:tasks.workunit.client.0.smithi099.stdout:7/135: truncate d7/f9 4726875 0 2024-09-19T06:40:29.806 INFO:tasks.workunit.client.1.smithi117.stdout:4/339: dwrite d3/db/d23/f57 [0,4194304] 0 2024-09-19T06:40:29.806 INFO:tasks.workunit.client.0.smithi099.stdout:6/118: mkdir d1/d5/d24/d25/d2a 0 2024-09-19T06:40:29.807 INFO:tasks.workunit.client.1.smithi117.stdout:6/196: dread d1/f18 [0,4194304] 0 2024-09-19T06:40:29.807 INFO:tasks.workunit.client.1.smithi117.stdout:2/259: write d0/d7/f55 [230743,81049] 0 2024-09-19T06:40:29.808 INFO:tasks.workunit.client.0.smithi099.stdout:6/119: truncate d1/fd 1286019 0 2024-09-19T06:40:29.810 INFO:tasks.workunit.client.1.smithi117.stdout:8/244: mkdir d1d/d2a/d3f/d4c 0 2024-09-19T06:40:29.814 INFO:tasks.workunit.client.1.smithi117.stdout:3/357: dwrite d0/d3d/d68/d40/f67 [0,4194304] 0 2024-09-19T06:40:29.815 INFO:tasks.workunit.client.0.smithi099.stdout:6/120: fsync d1/d5/f13 0 2024-09-19T06:40:29.818 INFO:tasks.workunit.client.1.smithi117.stdout:0/201: fdatasync d11/d13/d14/d2c/f2f 0 2024-09-19T06:40:29.818 INFO:tasks.workunit.client.1.smithi117.stdout:6/197: truncate d1/d14/f15 1355957 0 2024-09-19T06:40:29.818 INFO:tasks.workunit.client.0.smithi099.stdout:6/121: truncate d1/f10 630898 0 2024-09-19T06:40:29.819 INFO:tasks.workunit.client.1.smithi117.stdout:8/245: creat d1d/d2a/d3f/f4d x:0 0 0 2024-09-19T06:40:29.820 INFO:tasks.workunit.client.1.smithi117.stdout:3/358: write d0/d8/f4c [43207,73784] 0 2024-09-19T06:40:29.821 INFO:tasks.workunit.client.0.smithi099.stdout:6/122: mkdir d1/d5/d24/d2b 0 2024-09-19T06:40:29.822 INFO:tasks.workunit.client.1.smithi117.stdout:4/340: mkdir d3/db/d20/d77 0 2024-09-19T06:40:29.823 INFO:tasks.workunit.client.0.smithi099.stdout:6/123: getdents d1/d26 0 2024-09-19T06:40:29.824 INFO:tasks.workunit.client.1.smithi117.stdout:1/256: rename d3/d18/d23/d3a to d3/d18/d56 0 2024-09-19T06:40:29.827 INFO:tasks.workunit.client.1.smithi117.stdout:0/202: creat d11/d13/d14/d16/f3a x:0 0 0 2024-09-19T06:40:29.827 INFO:tasks.workunit.client.1.smithi117.stdout:2/260: dwrite d0/f2b [4194304,4194304] 0 2024-09-19T06:40:29.827 INFO:tasks.workunit.client.1.smithi117.stdout:8/246: rmdir d1d/d1e/d3b 39 2024-09-19T06:40:29.828 INFO:tasks.workunit.client.0.smithi099.stdout:5/287: truncate d3/d7/fa 1583144 0 2024-09-19T06:40:29.828 INFO:tasks.workunit.client.0.smithi099.stdout:6/124: getdents d1/d12 0 2024-09-19T06:40:29.829 INFO:tasks.workunit.client.1.smithi117.stdout:6/198: truncate d1/f1b 402727 0 2024-09-19T06:40:29.834 INFO:tasks.workunit.client.0.smithi099.stdout:5/288: mknod d3/c66 0 2024-09-19T06:40:29.834 INFO:tasks.workunit.client.0.smithi099.stdout:9/155: dwrite dd/f16 [0,4194304] 0 2024-09-19T06:40:29.837 INFO:tasks.workunit.client.1.smithi117.stdout:1/257: chown d3/d22/d2f/l37 166 1 2024-09-19T06:40:29.837 INFO:tasks.workunit.client.1.smithi117.stdout:8/247: symlink d1d/d2a/d3f/l4e 0 2024-09-19T06:40:29.838 INFO:tasks.workunit.client.1.smithi117.stdout:6/199: symlink d1/d5/d32/l33 0 2024-09-19T06:40:29.838 INFO:tasks.workunit.client.0.smithi099.stdout:6/125: fdatasync d1/f10 0 2024-09-19T06:40:29.839 INFO:tasks.workunit.client.1.smithi117.stdout:0/203: rename d11/d13/d1b/l23 to d11/d13/d14/d2c/d35/l3b 0 2024-09-19T06:40:29.840 INFO:tasks.workunit.client.0.smithi099.stdout:9/156: dread dd/f1f [0,4194304] 0 2024-09-19T06:40:29.840 INFO:tasks.workunit.client.0.smithi099.stdout:7/136: read d7/f9 [4042687,52790] 0 2024-09-19T06:40:29.843 INFO:tasks.workunit.client.0.smithi099.stdout:7/137: chown d7/dd/f37 4 1 2024-09-19T06:40:29.844 INFO:tasks.workunit.client.1.smithi117.stdout:3/359: dwrite d0/d3d/d68/f57 [0,4194304] 0 2024-09-19T06:40:29.845 INFO:tasks.workunit.client.0.smithi099.stdout:5/289: dwrite d3/d16/f30 [0,4194304] 0 2024-09-19T06:40:29.848 INFO:tasks.workunit.client.1.smithi117.stdout:2/261: dread d0/f2a [0,4194304] 0 2024-09-19T06:40:29.848 INFO:tasks.workunit.client.1.smithi117.stdout:5/254: dwrite d17/d1b/f24 [0,4194304] 0 2024-09-19T06:40:29.848 INFO:tasks.workunit.client.0.smithi099.stdout:5/290: dread - d3/d2a/f32 zero size 2024-09-19T06:40:29.848 INFO:tasks.workunit.client.0.smithi099.stdout:6/126: mknod d1/d5/c2c 0 2024-09-19T06:40:29.849 INFO:tasks.workunit.client.1.smithi117.stdout:5/255: read - d17/d1b/d3a/f3e zero size 2024-09-19T06:40:29.854 INFO:tasks.workunit.client.0.smithi099.stdout:6/127: unlink d1/fd 0 2024-09-19T06:40:29.854 INFO:tasks.workunit.client.1.smithi117.stdout:0/204: mknod d11/d13/d14/d2c/c3c 0 2024-09-19T06:40:29.856 INFO:tasks.workunit.client.1.smithi117.stdout:0/205: chown d11/d13/d1b/d27/l39 212213 1 2024-09-19T06:40:29.856 INFO:tasks.workunit.client.1.smithi117.stdout:3/360: read d0/f13 [1307469,86906] 0 2024-09-19T06:40:29.857 INFO:tasks.workunit.client.0.smithi099.stdout:6/128: symlink d1/d5/l2d 0 2024-09-19T06:40:29.857 INFO:tasks.workunit.client.0.smithi099.stdout:5/291: getdents d3/d14 0 2024-09-19T06:40:29.861 INFO:tasks.workunit.client.0.smithi099.stdout:5/292: mknod d3/d7/c67 0 2024-09-19T06:40:29.861 INFO:tasks.workunit.client.1.smithi117.stdout:2/262: truncate d0/d7/d1e/f31 3491928 0 2024-09-19T06:40:29.863 INFO:tasks.workunit.client.1.smithi117.stdout:5/256: mknod d17/d1b/d3a/d3c/d46/c56 0 2024-09-19T06:40:29.864 INFO:tasks.workunit.client.1.smithi117.stdout:5/257: write d17/d1b/f48 [866149,96067] 0 2024-09-19T06:40:29.866 INFO:tasks.workunit.client.1.smithi117.stdout:0/206: write f0 [983759,16960] 0 2024-09-19T06:40:29.867 INFO:tasks.workunit.client.1.smithi117.stdout:3/361: unlink d0/d8/l52 0 2024-09-19T06:40:29.868 INFO:tasks.workunit.client.1.smithi117.stdout:2/263: unlink d0/d7/l17 0 2024-09-19T06:40:29.869 INFO:tasks.workunit.client.1.smithi117.stdout:5/258: creat d17/d1b/d3a/d3c/f57 x:0 0 0 2024-09-19T06:40:29.870 INFO:tasks.workunit.client.1.smithi117.stdout:1/258: getdents d3/d18/d23/d51 0 2024-09-19T06:40:29.870 INFO:tasks.workunit.client.1.smithi117.stdout:8/248: link d1d/d2a/d3f/l4e d1d/d1e/d3b/l4f 0 2024-09-19T06:40:29.870 INFO:tasks.workunit.client.1.smithi117.stdout:2/264: write d0/d7/d1e/d20/f44 [266577,106113] 0 2024-09-19T06:40:29.871 INFO:tasks.workunit.client.1.smithi117.stdout:5/259: stat d17/l1f 0 2024-09-19T06:40:29.871 INFO:tasks.workunit.client.1.smithi117.stdout:8/249: write f4 [851732,25053] 0 2024-09-19T06:40:29.871 INFO:tasks.workunit.client.1.smithi117.stdout:0/207: symlink d11/d13/d1b/d27/d37/l3d 0 2024-09-19T06:40:29.874 INFO:tasks.workunit.client.1.smithi117.stdout:2/265: chown d0/d7/d29/d35/d3d/c46 350751 1 2024-09-19T06:40:29.875 INFO:tasks.workunit.client.1.smithi117.stdout:5/260: mknod d17/c58 0 2024-09-19T06:40:29.875 INFO:tasks.workunit.client.1.smithi117.stdout:8/250: creat d1d/f50 x:0 0 0 2024-09-19T06:40:29.882 INFO:tasks.workunit.client.1.smithi117.stdout:5/261: dread d17/d2e/f33 [0,4194304] 0 2024-09-19T06:40:29.884 INFO:tasks.workunit.client.0.smithi099.stdout:5/293: write d3/d1f/f21 [62574,117087] 0 2024-09-19T06:40:29.885 INFO:tasks.workunit.client.1.smithi117.stdout:2/266: dwrite d0/d7/d1e/d20/d3e/f4a [0,4194304] 0 2024-09-19T06:40:29.887 INFO:tasks.workunit.client.1.smithi117.stdout:8/251: dwrite d1d/f40 [0,4194304] 0 2024-09-19T06:40:29.887 INFO:tasks.workunit.client.1.smithi117.stdout:4/341: truncate d3/db/d20/d35/d45/f5d 1779989 0 2024-09-19T06:40:29.890 INFO:tasks.workunit.client.1.smithi117.stdout:8/252: fsync d1d/d1e/d29/f2d 0 2024-09-19T06:40:29.890 INFO:tasks.workunit.client.0.smithi099.stdout:9/157: dwrite fb [0,4194304] 0 2024-09-19T06:40:29.891 INFO:tasks.workunit.client.0.smithi099.stdout:5/294: mkdir d3/d16/d5e/d68 0 2024-09-19T06:40:29.892 INFO:tasks.workunit.client.1.smithi117.stdout:4/342: unlink d3/f7 0 2024-09-19T06:40:29.892 INFO:tasks.workunit.client.1.smithi117.stdout:8/253: write d1d/f27 [3216863,2360] 0 2024-09-19T06:40:29.893 INFO:tasks.workunit.client.0.smithi099.stdout:7/138: dwrite d7/f8 [0,4194304] 0 2024-09-19T06:40:29.894 INFO:tasks.workunit.client.1.smithi117.stdout:4/343: write d3/db/f43 [3940727,6130] 0 2024-09-19T06:40:29.895 INFO:tasks.workunit.client.1.smithi117.stdout:2/267: dwrite d0/d12/d32/f4b [0,4194304] 0 2024-09-19T06:40:29.896 INFO:tasks.workunit.client.0.smithi099.stdout:5/295: fdatasync d3/d16/d5e/f63 0 2024-09-19T06:40:29.897 INFO:tasks.workunit.client.0.smithi099.stdout:3/185: sync 2024-09-19T06:40:29.897 INFO:tasks.workunit.client.0.smithi099.stdout:1/122: sync 2024-09-19T06:40:29.897 INFO:tasks.workunit.client.0.smithi099.stdout:4/146: sync 2024-09-19T06:40:29.897 INFO:tasks.workunit.client.0.smithi099.stdout:0/77: sync 2024-09-19T06:40:29.898 INFO:tasks.workunit.client.0.smithi099.stdout:2/61: sync 2024-09-19T06:40:29.904 INFO:tasks.workunit.client.0.smithi099.stdout:4/147: chown d12/d32 174 1 2024-09-19T06:40:29.906 INFO:tasks.workunit.client.0.smithi099.stdout:6/129: dwrite d1/fe [0,4194304] 0 2024-09-19T06:40:29.910 INFO:tasks.workunit.client.0.smithi099.stdout:1/123: fdatasync d0/d12/d13/f1b 0 2024-09-19T06:40:29.916 INFO:tasks.workunit.client.0.smithi099.stdout:6/130: mkdir d1/d5/d24/d2e 0 2024-09-19T06:40:29.920 INFO:tasks.workunit.client.0.smithi099.stdout:4/148: creat d12/f38 x:0 0 0 2024-09-19T06:40:29.924 INFO:tasks.workunit.client.0.smithi099.stdout:7/139: link d7/dd/d29/c1d d7/dd/c3b 0 2024-09-19T06:40:29.924 INFO:tasks.workunit.client.0.smithi099.stdout:8/63: sync 2024-09-19T06:40:29.928 INFO:tasks.workunit.client.0.smithi099.stdout:9/158: dwrite fa [0,4194304] 0 2024-09-19T06:40:29.928 INFO:tasks.workunit.client.0.smithi099.stdout:4/149: stat d12/d1b/d1c 0 2024-09-19T06:40:29.928 INFO:tasks.workunit.client.0.smithi099.stdout:0/78: dread d0/db/fc [0,4194304] 0 2024-09-19T06:40:29.931 INFO:tasks.workunit.client.0.smithi099.stdout:3/186: dwrite d7/d16/f1f [0,4194304] 0 2024-09-19T06:40:29.932 INFO:tasks.workunit.client.0.smithi099.stdout:6/131: truncate d1/d12/f27 91500 0 2024-09-19T06:40:29.935 INFO:tasks.workunit.client.0.smithi099.stdout:8/64: mkdir d4/d11 0 2024-09-19T06:40:29.937 INFO:tasks.workunit.client.0.smithi099.stdout:5/296: dwrite d3/d2a/f32 [0,4194304] 0 2024-09-19T06:40:29.937 INFO:tasks.workunit.client.0.smithi099.stdout:9/159: fsync dd/f1f 0 2024-09-19T06:40:29.943 INFO:tasks.workunit.client.0.smithi099.stdout:7/140: write d7/dd/d29/d34/f35 [637763,59241] 0 2024-09-19T06:40:29.944 INFO:tasks.workunit.client.0.smithi099.stdout:9/160: write dd/f22 [330467,98465] 0 2024-09-19T06:40:29.945 INFO:tasks.workunit.client.0.smithi099.stdout:3/187: creat d7/d23/f29 x:0 0 0 2024-09-19T06:40:29.945 INFO:tasks.workunit.client.0.smithi099.stdout:1/124: dread d0/d12/d13/f22 [0,4194304] 0 2024-09-19T06:40:29.946 INFO:tasks.workunit.client.0.smithi099.stdout:2/62: dwrite d1/d2/d5/d8/fa [0,4194304] 0 2024-09-19T06:40:29.946 INFO:tasks.workunit.client.0.smithi099.stdout:7/141: stat f4 0 2024-09-19T06:40:29.948 INFO:tasks.workunit.client.0.smithi099.stdout:4/150: truncate d12/d1b/d1c/f31 795111 0 2024-09-19T06:40:29.948 INFO:tasks.workunit.client.0.smithi099.stdout:6/132: symlink d1/d5/d24/d25/d2a/l2f 0 2024-09-19T06:40:29.949 INFO:tasks.workunit.client.0.smithi099.stdout:3/188: creat d7/d23/f2a x:0 0 0 2024-09-19T06:40:29.950 INFO:tasks.workunit.client.0.smithi099.stdout:1/125: mknod d0/d12/d13/c26 0 2024-09-19T06:40:29.951 INFO:tasks.workunit.client.0.smithi099.stdout:4/151: mkdir d12/d32/d39 0 2024-09-19T06:40:29.953 INFO:tasks.workunit.client.0.smithi099.stdout:7/142: creat d7/dd/d29/f3c x:0 0 0 2024-09-19T06:40:29.955 INFO:tasks.workunit.client.0.smithi099.stdout:1/126: readlink d0/l3 0 2024-09-19T06:40:29.955 INFO:tasks.workunit.client.0.smithi099.stdout:4/152: stat f5 0 2024-09-19T06:40:29.956 INFO:tasks.workunit.client.0.smithi099.stdout:3/189: rename d7/d16/d28 to d7/d16/d28/d2b 22 2024-09-19T06:40:29.956 INFO:tasks.workunit.client.0.smithi099.stdout:0/79: dwrite d0/f7 [0,4194304] 0 2024-09-19T06:40:29.958 INFO:tasks.workunit.client.0.smithi099.stdout:7/143: dread - d7/f15 zero size 2024-09-19T06:40:29.960 INFO:tasks.workunit.client.0.smithi099.stdout:6/133: creat d1/d5/d24/d25/d2a/f30 x:0 0 0 2024-09-19T06:40:29.961 INFO:tasks.workunit.client.0.smithi099.stdout:1/127: rmdir d0/d17 39 2024-09-19T06:40:29.961 INFO:tasks.workunit.client.0.smithi099.stdout:8/65: dread d4/fd [0,4194304] 0 2024-09-19T06:40:29.962 INFO:tasks.workunit.client.0.smithi099.stdout:7/144: stat d7/c2d 0 2024-09-19T06:40:29.962 INFO:tasks.workunit.client.0.smithi099.stdout:5/297: dwrite d3/d1f/d4f/f5c [4194304,4194304] 0 2024-09-19T06:40:29.968 INFO:tasks.workunit.client.0.smithi099.stdout:0/80: mknod d0/db/d13/c19 0 2024-09-19T06:40:29.970 INFO:tasks.workunit.client.0.smithi099.stdout:7/145: dread - d7/dd/d29/f3c zero size 2024-09-19T06:40:29.975 INFO:tasks.workunit.client.0.smithi099.stdout:1/128: write d0/db/f11 [466898,121054] 0 2024-09-19T06:40:29.976 INFO:tasks.workunit.client.0.smithi099.stdout:5/298: fdatasync d3/d7/fa 0 2024-09-19T06:40:29.977 INFO:tasks.workunit.client.0.smithi099.stdout:0/81: readlink d0/db/d13/l16 0 2024-09-19T06:40:29.980 INFO:tasks.workunit.client.0.smithi099.stdout:4/153: dwrite d12/f38 [0,4194304] 0 2024-09-19T06:40:29.980 INFO:tasks.workunit.client.0.smithi099.stdout:1/129: readlink d0/db/l1e 0 2024-09-19T06:40:29.981 INFO:tasks.workunit.client.0.smithi099.stdout:7/146: chown d7/dd/d29/d1f/f21 23960860 1 2024-09-19T06:40:29.981 INFO:tasks.workunit.client.0.smithi099.stdout:3/190: dwrite d7/fa [0,4194304] 0 2024-09-19T06:40:29.984 INFO:tasks.workunit.client.0.smithi099.stdout:4/154: fsync d12/d1b/d1c/f31 0 2024-09-19T06:40:29.984 INFO:tasks.workunit.client.0.smithi099.stdout:0/82: rmdir d0/db/d13 39 2024-09-19T06:40:29.985 INFO:tasks.workunit.client.0.smithi099.stdout:7/147: dread - d7/f32 zero size 2024-09-19T06:40:29.985 INFO:tasks.workunit.client.0.smithi099.stdout:8/66: dread d4/fd [0,4194304] 0 2024-09-19T06:40:29.986 INFO:tasks.workunit.client.0.smithi099.stdout:5/299: truncate d3/d7/f26 547356 0 2024-09-19T06:40:29.986 INFO:tasks.workunit.client.0.smithi099.stdout:6/134: dwrite d1/f1d [0,4194304] 0 2024-09-19T06:40:29.987 INFO:tasks.workunit.client.0.smithi099.stdout:3/191: chown d7/d16/d1d/f22 114825109 1 2024-09-19T06:40:29.987 INFO:tasks.workunit.client.1.smithi117.stdout:2/268: write d0/d12/f2c [892757,34285] 0 2024-09-19T06:40:29.987 INFO:tasks.workunit.client.1.smithi117.stdout:8/254: creat d1d/d1e/d29/f51 x:0 0 0 2024-09-19T06:40:29.988 INFO:tasks.workunit.client.0.smithi099.stdout:4/155: stat d12/d1b/d1c/f1f 0 2024-09-19T06:40:29.989 INFO:tasks.workunit.client.0.smithi099.stdout:6/135: chown d1/fe 692779 1 2024-09-19T06:40:29.989 INFO:tasks.workunit.client.1.smithi117.stdout:4/344: stat d3/de/l42 0 2024-09-19T06:40:29.989 INFO:tasks.workunit.client.1.smithi117.stdout:0/208: rmdir d11/d13 39 2024-09-19T06:40:29.991 INFO:tasks.workunit.client.0.smithi099.stdout:8/67: read d4/fd [3299680,93099] 0 2024-09-19T06:40:29.992 INFO:tasks.workunit.client.0.smithi099.stdout:8/68: stat c1 0 2024-09-19T06:40:29.993 INFO:tasks.workunit.client.1.smithi117.stdout:0/209: truncate fd 5810121 0 2024-09-19T06:40:29.994 INFO:tasks.workunit.client.0.smithi099.stdout:5/300: mknod d3/d7/c69 0 2024-09-19T06:40:29.994 INFO:tasks.workunit.client.1.smithi117.stdout:2/269: fsync d0/d12/d2f/f40 0 2024-09-19T06:40:29.995 INFO:tasks.workunit.client.1.smithi117.stdout:5/262: link d17/d1b/c29 d17/d1b/d3a/d3c/d46/c59 0 2024-09-19T06:40:29.996 INFO:tasks.workunit.client.0.smithi099.stdout:1/130: dread d0/d12/d13/f1b [0,4194304] 0 2024-09-19T06:40:29.997 INFO:tasks.workunit.client.1.smithi117.stdout:4/345: creat d3/d65/d66/f78 x:0 0 0 2024-09-19T06:40:29.997 INFO:tasks.workunit.client.1.smithi117.stdout:2/270: dread - d0/f5e zero size 2024-09-19T06:40:29.999 INFO:tasks.workunit.client.0.smithi099.stdout:8/69: creat d4/de/f12 x:0 0 0 2024-09-19T06:40:29.999 INFO:tasks.workunit.client.1.smithi117.stdout:1/259: dwrite d3/f4c [0,4194304] 0 2024-09-19T06:40:30.001 INFO:tasks.workunit.client.0.smithi099.stdout:8/70: readlink d4/l5 0 2024-09-19T06:40:30.002 INFO:tasks.workunit.client.0.smithi099.stdout:6/136: creat d1/d5/d24/d2e/f31 x:0 0 0 2024-09-19T06:40:30.002 INFO:tasks.workunit.client.0.smithi099.stdout:4/156: mknod d12/d32/d39/c3a 0 2024-09-19T06:40:30.003 INFO:tasks.workunit.client.1.smithi117.stdout:4/346: mkdir d3/db/d20/d35/d79 0 2024-09-19T06:40:30.004 INFO:tasks.workunit.client.1.smithi117.stdout:2/271: symlink d0/d7/d1e/d20/d3e/l67 0 2024-09-19T06:40:30.005 INFO:tasks.workunit.client.1.smithi117.stdout:1/260: symlink d3/l57 0 2024-09-19T06:40:30.006 INFO:tasks.workunit.client.0.smithi099.stdout:7/148: getdents d7 0 2024-09-19T06:40:30.006 INFO:tasks.workunit.client.0.smithi099.stdout:3/192: dwrite d7/d16/f1b [0,4194304] 0 2024-09-19T06:40:30.007 INFO:tasks.workunit.client.0.smithi099.stdout:1/131: symlink d0/db/l27 0 2024-09-19T06:40:30.007 INFO:tasks.workunit.client.1.smithi117.stdout:5/263: dread d17/f26 [0,4194304] 0 2024-09-19T06:40:30.007 INFO:tasks.workunit.client.0.smithi099.stdout:8/71: rename d4/fd to d4/f13 0 2024-09-19T06:40:30.010 INFO:tasks.workunit.client.0.smithi099.stdout:5/301: rmdir d3/d16/d5e/d68 0 2024-09-19T06:40:30.010 INFO:tasks.workunit.client.0.smithi099.stdout:8/72: chown d4/f9 1334 1 2024-09-19T06:40:30.011 INFO:tasks.workunit.client.0.smithi099.stdout:6/137: write d1/d12/f21 [200248,102254] 0 2024-09-19T06:40:30.012 INFO:tasks.workunit.client.0.smithi099.stdout:8/73: readlink d4/l5 0 2024-09-19T06:40:30.012 INFO:tasks.workunit.client.0.smithi099.stdout:7/149: dread - d7/dd/d29/f33 zero size 2024-09-19T06:40:30.018 INFO:tasks.workunit.client.0.smithi099.stdout:0/83: dwrite d0/db/fc [4194304,4194304] 0 2024-09-19T06:40:30.018 INFO:tasks.workunit.client.0.smithi099.stdout:5/302: read d3/d16/f28 [527294,30506] 0 2024-09-19T06:40:30.018 INFO:tasks.workunit.client.0.smithi099.stdout:0/84: read - d0/f11 zero size 2024-09-19T06:40:30.019 INFO:tasks.workunit.client.1.smithi117.stdout:1/261: mknod d3/d22/c58 0 2024-09-19T06:40:30.019 INFO:tasks.workunit.client.1.smithi117.stdout:4/347: truncate d3/d4/d14/f17 430348 0 2024-09-19T06:40:30.019 INFO:tasks.workunit.client.1.smithi117.stdout:5/264: creat d17/d2e/d55/f5a x:0 0 0 2024-09-19T06:40:30.020 INFO:tasks.workunit.client.0.smithi099.stdout:0/85: read d0/f12 [3115610,24862] 0 2024-09-19T06:40:30.020 INFO:tasks.workunit.client.0.smithi099.stdout:7/150: truncate d7/dd/d29/f16 1503256 0 2024-09-19T06:40:30.022 INFO:tasks.workunit.client.1.smithi117.stdout:5/265: symlink d17/d2f/d3b/l5b 0 2024-09-19T06:40:30.023 INFO:tasks.workunit.client.1.smithi117.stdout:2/272: rmdir d0 39 2024-09-19T06:40:30.024 INFO:tasks.workunit.client.1.smithi117.stdout:0/210: truncate d11/d13/d14/d16/f34 145740 0 2024-09-19T06:40:30.025 INFO:tasks.workunit.client.0.smithi099.stdout:0/86: truncate d0/f11 405403 0 2024-09-19T06:40:30.027 INFO:tasks.workunit.client.0.smithi099.stdout:4/157: dwrite d12/d32/f29 [0,4194304] 0 2024-09-19T06:40:30.027 INFO:tasks.workunit.client.0.smithi099.stdout:3/193: dwrite d7/d16/f1b [0,4194304] 0 2024-09-19T06:40:30.028 INFO:tasks.workunit.client.0.smithi099.stdout:3/194: fdatasync f6 0 2024-09-19T06:40:30.032 INFO:tasks.workunit.client.0.smithi099.stdout:4/158: write d12/f30 [107075,93808] 0 2024-09-19T06:40:30.036 INFO:tasks.workunit.client.0.smithi099.stdout:7/151: dread d7/dd/d29/f16 [0,4194304] 0 2024-09-19T06:40:30.036 INFO:tasks.workunit.client.0.smithi099.stdout:7/152: stat d7/l1a 0 2024-09-19T06:40:30.119 INFO:tasks.workunit.client.1.smithi117.stdout:4/348: dwrite d3/db/f47 [0,4194304] 0 2024-09-19T06:40:30.120 INFO:tasks.workunit.client.1.smithi117.stdout:0/211: read - d11/d13/d14/f33 zero size 2024-09-19T06:40:30.121 INFO:tasks.workunit.client.1.smithi117.stdout:1/262: write d3/d18/d23/f2d [495491,59969] 0 2024-09-19T06:40:30.121 INFO:tasks.workunit.client.1.smithi117.stdout:4/349: stat d3/de 0 2024-09-19T06:40:30.122 INFO:tasks.workunit.client.0.smithi099.stdout:6/138: link d1/d5/d24/d2e/f31 d1/d5/d24/d2e/f32 0 2024-09-19T06:40:30.125 INFO:tasks.workunit.client.1.smithi117.stdout:0/212: mkdir d11/d13/d14/d2c/d35/d3e 0 2024-09-19T06:40:30.127 INFO:tasks.workunit.client.1.smithi117.stdout:5/266: dwrite d17/f22 [0,4194304] 0 2024-09-19T06:40:30.127 INFO:tasks.workunit.client.0.smithi099.stdout:3/195: rmdir d7/d16 39 2024-09-19T06:40:30.129 INFO:tasks.workunit.client.0.smithi099.stdout:6/139: dwrite d1/f1d [4194304,4194304] 0 2024-09-19T06:40:30.132 INFO:tasks.workunit.client.1.smithi117.stdout:0/213: symlink d11/d13/d14/l3f 0 2024-09-19T06:40:30.134 INFO:tasks.workunit.client.1.smithi117.stdout:2/273: dwrite d0/d7/d1e/d20/d3e/f50 [0,4194304] 0 2024-09-19T06:40:30.135 INFO:tasks.workunit.client.1.smithi117.stdout:1/263: dread d3/d18/d23/f55 [0,4194304] 0 2024-09-19T06:40:30.136 INFO:tasks.workunit.client.1.smithi117.stdout:2/274: write d0/f5e [622263,29341] 0 2024-09-19T06:40:30.137 INFO:tasks.workunit.client.1.smithi117.stdout:0/214: creat d11/d13/d1b/d27/f40 x:0 0 0 2024-09-19T06:40:30.139 INFO:tasks.workunit.client.1.smithi117.stdout:2/275: truncate d0/f4c 570250 0 2024-09-19T06:40:30.139 INFO:tasks.workunit.client.1.smithi117.stdout:4/350: dread d3/db/d20/d35/d45/f5d [0,4194304] 0 2024-09-19T06:40:30.140 INFO:tasks.workunit.client.1.smithi117.stdout:0/215: stat d11/d13/d1b/d27/f29 0 2024-09-19T06:40:30.141 INFO:tasks.workunit.client.1.smithi117.stdout:1/264: getdents d3/d18/d23/d51 0 2024-09-19T06:40:30.141 INFO:tasks.workunit.client.1.smithi117.stdout:0/216: stat d11/d13/d28/c2a 0 2024-09-19T06:40:30.141 INFO:tasks.workunit.client.0.smithi099.stdout:4/159: sync 2024-09-19T06:40:30.141 INFO:tasks.workunit.client.0.smithi099.stdout:2/63: sync 2024-09-19T06:40:30.142 INFO:tasks.workunit.client.0.smithi099.stdout:1/132: sync 2024-09-19T06:40:30.142 INFO:tasks.workunit.client.0.smithi099.stdout:9/161: sync 2024-09-19T06:40:30.142 INFO:tasks.workunit.client.1.smithi117.stdout:5/267: dread d17/d2f/d3b/f44 [0,4194304] 0 2024-09-19T06:40:30.142 INFO:tasks.workunit.client.1.smithi117.stdout:0/217: write d11/d13/d1b/d27/f29 [5163914,63031] 0 2024-09-19T06:40:30.144 INFO:tasks.workunit.client.1.smithi117.stdout:5/268: chown d17/d1b/d3a/d3c/d46/c56 242516 1 2024-09-19T06:40:30.144 INFO:tasks.workunit.client.1.smithi117.stdout:4/351: mkdir d3/db/d20/d35/d7a 0 2024-09-19T06:40:30.144 INFO:tasks.workunit.client.0.smithi099.stdout:1/133: dread - d0/db/f1f zero size 2024-09-19T06:40:30.145 INFO:tasks.workunit.client.1.smithi117.stdout:4/352: chown d3/db/ff 6871005 1 2024-09-19T06:40:30.148 INFO:tasks.workunit.client.1.smithi117.stdout:4/353: read d3/db/d23/f57 [3914527,40822] 0 2024-09-19T06:40:30.149 INFO:tasks.workunit.client.1.smithi117.stdout:2/276: creat d0/d7/d29/f68 x:0 0 0 2024-09-19T06:40:30.152 INFO:tasks.workunit.client.1.smithi117.stdout:2/277: chown d0/d7/d29/d35/d3d 884 1 2024-09-19T06:40:30.152 INFO:tasks.workunit.client.0.smithi099.stdout:4/160: dwrite d12/f38 [0,4194304] 0 2024-09-19T06:40:30.153 INFO:tasks.workunit.client.0.smithi099.stdout:9/162: dwrite dd/f22 [0,4194304] 0 2024-09-19T06:40:30.154 INFO:tasks.workunit.client.1.smithi117.stdout:1/265: rename d3/l16 to d3/d22/d2f/l59 0 2024-09-19T06:40:30.154 INFO:tasks.workunit.client.1.smithi117.stdout:5/269: dwrite d17/f22 [0,4194304] 0 2024-09-19T06:40:30.156 INFO:tasks.workunit.client.1.smithi117.stdout:1/266: stat d3/f1b 0 2024-09-19T06:40:30.160 INFO:tasks.workunit.client.1.smithi117.stdout:4/354: dwrite d3/db/d20/d35/f4c [0,4194304] 0 2024-09-19T06:40:30.162 INFO:tasks.workunit.client.1.smithi117.stdout:4/355: fsync d3/d1b/f4d 0 2024-09-19T06:40:30.167 INFO:tasks.workunit.client.1.smithi117.stdout:5/270: dwrite d17/d1b/d3a/d3c/f3d [0,4194304] 0 2024-09-19T06:40:30.170 INFO:tasks.workunit.client.1.smithi117.stdout:1/267: read f1 [6355303,121079] 0 2024-09-19T06:40:30.174 INFO:tasks.workunit.client.0.smithi099.stdout:7/153: mknod d7/dd/d29/c3d 0 2024-09-19T06:40:30.176 INFO:tasks.workunit.client.0.smithi099.stdout:8/74: truncate d4/fa 2790556 0 2024-09-19T06:40:30.176 INFO:tasks.workunit.client.0.smithi099.stdout:8/75: stat d4/de/f12 0 2024-09-19T06:40:30.180 INFO:tasks.workunit.client.0.smithi099.stdout:5/303: creat d3/f6a x:0 0 0 2024-09-19T06:40:30.181 INFO:tasks.workunit.client.0.smithi099.stdout:0/87: rename d0/c5 to d0/d17/c1a 0 2024-09-19T06:40:30.181 INFO:tasks.workunit.client.1.smithi117.stdout:4/356: dwrite d3/db/f5c [0,4194304] 0 2024-09-19T06:40:30.183 INFO:tasks.workunit.client.1.smithi117.stdout:4/357: write d3/db/f3a [3063460,94243] 0 2024-09-19T06:40:30.184 INFO:tasks.workunit.client.0.smithi099.stdout:6/140: creat d1/d5/f33 x:0 0 0 2024-09-19T06:40:30.185 INFO:tasks.workunit.client.1.smithi117.stdout:1/268: dread d3/f1b [0,4194304] 0 2024-09-19T06:40:30.188 INFO:tasks.workunit.client.1.smithi117.stdout:4/358: unlink d3/d4/d14/l22 0 2024-09-19T06:40:30.188 INFO:tasks.workunit.client.0.smithi099.stdout:7/154: rmdir d7/dd/d29/d1f 39 2024-09-19T06:40:30.189 INFO:tasks.workunit.client.1.smithi117.stdout:0/218: dread f4 [4194304,4194304] 0 2024-09-19T06:40:30.189 INFO:tasks.workunit.client.1.smithi117.stdout:4/359: fsync d3/d65/f75 0 2024-09-19T06:40:30.190 INFO:tasks.workunit.client.0.smithi099.stdout:3/196: dwrite d7/d16/f1b [0,4194304] 0 2024-09-19T06:40:30.190 INFO:tasks.workunit.client.0.smithi099.stdout:8/76: mkdir d4/de/d14 0 2024-09-19T06:40:30.190 INFO:tasks.workunit.client.1.smithi117.stdout:1/269: rename d3/lc to d3/d18/d23/l5a 0 2024-09-19T06:40:30.190 INFO:tasks.workunit.client.1.smithi117.stdout:4/360: readlink d3/db/d13/l26 0 2024-09-19T06:40:30.191 INFO:tasks.workunit.client.1.smithi117.stdout:0/219: fdatasync f4 0 2024-09-19T06:40:30.192 INFO:tasks.workunit.client.1.smithi117.stdout:0/220: chown d11/f12 113034 1 2024-09-19T06:40:30.192 INFO:tasks.workunit.client.0.smithi099.stdout:0/88: rename d0/f12 to d0/f1b 0 2024-09-19T06:40:30.193 INFO:tasks.workunit.client.0.smithi099.stdout:0/89: chown d0/f7 74792 1 2024-09-19T06:40:30.194 INFO:tasks.workunit.client.0.smithi099.stdout:2/64: mknod d1/d2/d5/d8/dc/c14 0 2024-09-19T06:40:30.195 INFO:tasks.workunit.client.1.smithi117.stdout:4/361: getdents d3/d28 0 2024-09-19T06:40:30.195 INFO:tasks.workunit.client.0.smithi099.stdout:7/155: symlink d7/l3e 0 2024-09-19T06:40:30.196 INFO:tasks.workunit.client.0.smithi099.stdout:2/65: write d1/d2/d5/d8/fa [4925219,35636] 0 2024-09-19T06:40:30.196 INFO:tasks.workunit.client.0.smithi099.stdout:8/77: mknod d4/c15 0 2024-09-19T06:40:30.199 INFO:tasks.workunit.client.0.smithi099.stdout:0/90: creat d0/d17/f1c x:0 0 0 2024-09-19T06:40:30.200 INFO:tasks.workunit.client.0.smithi099.stdout:1/134: rename d0/db/l1e to d0/db/l28 0 2024-09-19T06:40:30.200 INFO:tasks.workunit.client.1.smithi117.stdout:0/221: dwrite d11/d13/d14/d2c/f2f [0,4194304] 0 2024-09-19T06:40:30.201 INFO:tasks.workunit.client.0.smithi099.stdout:0/91: read d0/f1b [3935655,15360] 0 2024-09-19T06:40:30.203 INFO:tasks.workunit.client.0.smithi099.stdout:0/92: dread d0/f11 [0,4194304] 0 2024-09-19T06:40:30.205 INFO:tasks.workunit.client.0.smithi099.stdout:6/141: rmdir d1/d26 0 2024-09-19T06:40:30.206 INFO:tasks.workunit.client.1.smithi117.stdout:0/222: mkdir d11/d13/d14/d41 0 2024-09-19T06:40:30.206 INFO:tasks.workunit.client.0.smithi099.stdout:6/142: write d1/d12/f21 [1266332,69670] 0 2024-09-19T06:40:30.209 INFO:tasks.workunit.client.1.smithi117.stdout:4/362: dwrite d3/db/d20/d29/d39/f67 [0,4194304] 0 2024-09-19T06:40:30.209 INFO:tasks.workunit.client.1.smithi117.stdout:2/278: dread d0/d7/f8 [0,4194304] 0 2024-09-19T06:40:30.210 INFO:tasks.workunit.client.1.smithi117.stdout:2/279: chown d0/d7/d58 516958887 1 2024-09-19T06:40:30.211 INFO:tasks.workunit.client.0.smithi099.stdout:0/93: dwrite d0/db/f14 [0,4194304] 0 2024-09-19T06:40:30.213 INFO:tasks.workunit.client.0.smithi099.stdout:6/143: dread d1/d5/f13 [0,4194304] 0 2024-09-19T06:40:30.213 INFO:tasks.workunit.client.0.smithi099.stdout:0/94: rename d0 to d0/d17/d1d 22 2024-09-19T06:40:30.213 INFO:tasks.workunit.client.0.smithi099.stdout:2/66: rmdir d1/d2/d5/d8/dd 0 2024-09-19T06:40:30.213 INFO:tasks.workunit.client.0.smithi099.stdout:1/135: creat d0/f29 x:0 0 0 2024-09-19T06:40:30.214 INFO:tasks.workunit.client.0.smithi099.stdout:6/144: write d1/d5/f13 [1485369,61531] 0 2024-09-19T06:40:30.215 INFO:tasks.workunit.client.0.smithi099.stdout:1/136: fdatasync d0/db/dd/f18 0 2024-09-19T06:40:30.216 INFO:tasks.workunit.client.0.smithi099.stdout:6/145: dread - d1/d5/d24/d2e/f32 zero size 2024-09-19T06:40:30.221 INFO:tasks.workunit.client.0.smithi099.stdout:0/95: creat d0/db/d13/f1e x:0 0 0 2024-09-19T06:40:30.221 INFO:tasks.workunit.client.0.smithi099.stdout:6/146: creat d1/d12/f34 x:0 0 0 2024-09-19T06:40:30.222 INFO:tasks.workunit.client.1.smithi117.stdout:4/363: getdents d3/d65 0 2024-09-19T06:40:30.222 INFO:tasks.workunit.client.1.smithi117.stdout:0/223: getdents d11/d13/d1b/d27/d37 0 2024-09-19T06:40:30.222 INFO:tasks.workunit.client.1.smithi117.stdout:2/280: link d0/l3f d0/l69 0 2024-09-19T06:40:30.222 INFO:tasks.workunit.client.1.smithi117.stdout:0/224: chown l2 18911858 1 2024-09-19T06:40:30.222 INFO:tasks.workunit.client.1.smithi117.stdout:0/225: chown d11/d13/d14/l3f 108794383 1 2024-09-19T06:40:30.223 INFO:tasks.workunit.client.1.smithi117.stdout:4/364: mkdir d3/db/d20/d4a/d7b 0 2024-09-19T06:40:30.223 INFO:tasks.workunit.client.0.smithi099.stdout:2/67: link d1/d2/d5/d8/d9/ff d1/f15 0 2024-09-19T06:40:30.224 INFO:tasks.workunit.client.1.smithi117.stdout:0/226: mkdir d11/d13/d1b/d27/d37/d42 0 2024-09-19T06:40:30.224 INFO:tasks.workunit.client.0.smithi099.stdout:2/68: fdatasync d1/d2/f12 0 2024-09-19T06:40:30.225 INFO:tasks.workunit.client.1.smithi117.stdout:2/281: creat d0/d7/d29/d35/f6a x:0 0 0 2024-09-19T06:40:30.229 INFO:tasks.workunit.client.0.smithi099.stdout:6/147: creat d1/f35 x:0 0 0 2024-09-19T06:40:30.230 INFO:tasks.workunit.client.1.smithi117.stdout:2/282: truncate d0/d7/d1e/f31 3957263 0 2024-09-19T06:40:30.232 INFO:tasks.workunit.client.1.smithi117.stdout:0/227: dwrite d11/d13/d14/d16/f3a [0,4194304] 0 2024-09-19T06:40:30.235 INFO:tasks.workunit.client.1.smithi117.stdout:0/228: write d11/f12 [28036,1364] 0 2024-09-19T06:40:30.235 INFO:tasks.workunit.client.1.smithi117.stdout:2/283: mkdir d0/d7/d29/d35/d61/d65/d66/d6b 0 2024-09-19T06:40:30.237 INFO:tasks.workunit.client.1.smithi117.stdout:0/229: creat d11/d13/d28/f43 x:0 0 0 2024-09-19T06:40:30.239 INFO:tasks.workunit.client.1.smithi117.stdout:0/230: mkdir d11/d13/d14/d2c/d44 0 2024-09-19T06:40:30.240 INFO:tasks.workunit.client.1.smithi117.stdout:2/284: link d0/d7/c56 d0/d7/d29/d35/d61/d65/d66/c6c 0 2024-09-19T06:40:30.240 INFO:tasks.workunit.client.0.smithi099.stdout:6/148: fsync d1/d5/f33 0 2024-09-19T06:40:30.243 INFO:tasks.workunit.client.1.smithi117.stdout:1/270: write d3/d22/d2f/f3d [4208938,90449] 0 2024-09-19T06:40:30.243 INFO:tasks.workunit.client.0.smithi099.stdout:0/96: getdents d0 0 2024-09-19T06:40:30.244 INFO:tasks.workunit.client.0.smithi099.stdout:6/149: mknod d1/c36 0 2024-09-19T06:40:30.245 INFO:tasks.workunit.client.0.smithi099.stdout:0/97: mkdir d0/db/d13/d1f 0 2024-09-19T06:40:30.246 INFO:tasks.workunit.client.0.smithi099.stdout:0/98: fsync d0/f7 0 2024-09-19T06:40:30.247 INFO:tasks.workunit.client.0.smithi099.stdout:9/163: write dd/d10/f11 [1606315,31412] 0 2024-09-19T06:40:30.248 INFO:tasks.workunit.client.0.smithi099.stdout:0/99: chown d0/db/f14 2 1 2024-09-19T06:40:30.250 INFO:tasks.workunit.client.0.smithi099.stdout:7/156: readlink d7/l38 0 2024-09-19T06:40:30.250 INFO:tasks.workunit.client.0.smithi099.stdout:6/150: dread d1/fe [0,4194304] 0 2024-09-19T06:40:30.251 INFO:tasks.workunit.client.1.smithi117.stdout:4/365: write d3/de/f10 [2660743,101232] 0 2024-09-19T06:40:30.251 INFO:tasks.workunit.client.0.smithi099.stdout:9/164: chown dd/c15 51 1 2024-09-19T06:40:30.252 INFO:tasks.workunit.client.0.smithi099.stdout:9/165: truncate dd/d2c/f25 587588 0 2024-09-19T06:40:30.253 INFO:tasks.workunit.client.0.smithi099.stdout:9/166: chown dd/c17 447 1 2024-09-19T06:40:30.254 INFO:tasks.workunit.client.1.smithi117.stdout:4/366: creat d3/d65/f7c x:0 0 0 2024-09-19T06:40:30.254 INFO:tasks.workunit.client.0.smithi099.stdout:0/100: rename d0/f7 to d0/db/d13/f20 0 2024-09-19T06:40:30.255 INFO:tasks.workunit.client.0.smithi099.stdout:3/197: truncate d7/d16/f17 3144657 0 2024-09-19T06:40:30.256 INFO:tasks.workunit.client.0.smithi099.stdout:3/198: chown d7/d16/d1d/f22 23531372 1 2024-09-19T06:40:30.256 INFO:tasks.workunit.client.0.smithi099.stdout:3/199: stat d7/d16/d1d/f21 0 2024-09-19T06:40:30.258 INFO:tasks.workunit.client.1.smithi117.stdout:4/367: getdents d3/d4 0 2024-09-19T06:40:30.259 INFO:tasks.workunit.client.0.smithi099.stdout:0/101: write d0/db/d13/f20 [2644485,108354] 0 2024-09-19T06:40:30.260 INFO:tasks.workunit.client.1.smithi117.stdout:0/231: dread d11/d13/f17 [0,4194304] 0 2024-09-19T06:40:30.261 INFO:tasks.workunit.client.1.smithi117.stdout:1/271: dread d3/f2e [0,4194304] 0 2024-09-19T06:40:30.262 INFO:tasks.workunit.client.0.smithi099.stdout:6/151: creat d1/d5/d24/d2b/f37 x:0 0 0 2024-09-19T06:40:30.263 INFO:tasks.workunit.client.1.smithi117.stdout:1/272: creat d3/d22/d2f/f5b x:0 0 0 2024-09-19T06:40:30.265 INFO:tasks.workunit.client.0.smithi099.stdout:3/200: unlink d7/d16/d1d/l25 0 2024-09-19T06:40:30.265 INFO:tasks.workunit.client.1.smithi117.stdout:1/273: write d3/d18/d23/f4f [1498893,19264] 0 2024-09-19T06:40:30.266 INFO:tasks.workunit.client.1.smithi117.stdout:0/232: rename f4 to d11/d13/d14/f45 0 2024-09-19T06:40:30.268 INFO:tasks.workunit.client.0.smithi099.stdout:2/69: truncate d1/d2/d5/d8/d9/ff 4910786 0 2024-09-19T06:40:30.269 INFO:tasks.workunit.client.0.smithi099.stdout:6/152: mkdir d1/d5/d38 0 2024-09-19T06:40:30.270 INFO:tasks.workunit.client.0.smithi099.stdout:6/153: read d1/d5/f13 [2203953,105561] 0 2024-09-19T06:40:30.270 INFO:tasks.workunit.client.1.smithi117.stdout:0/233: dread f3 [0,4194304] 0 2024-09-19T06:40:30.274 INFO:tasks.workunit.client.0.smithi099.stdout:2/70: symlink d1/d2/d5/d8/l16 0 2024-09-19T06:40:30.274 INFO:tasks.workunit.client.1.smithi117.stdout:0/234: creat d11/d13/d14/d2c/d35/d3e/f46 x:0 0 0 2024-09-19T06:40:30.276 INFO:tasks.workunit.client.1.smithi117.stdout:4/368: dwrite d3/db/d20/d4a/f6f [4194304,4194304] 0 2024-09-19T06:40:30.277 INFO:tasks.workunit.client.1.smithi117.stdout:0/235: creat d11/f47 x:0 0 0 2024-09-19T06:40:30.278 INFO:tasks.workunit.client.1.smithi117.stdout:9/262: sync 2024-09-19T06:40:30.278 INFO:tasks.workunit.client.1.smithi117.stdout:7/255: sync 2024-09-19T06:40:30.278 INFO:tasks.workunit.client.0.smithi099.stdout:9/167: getdents dd 0 2024-09-19T06:40:30.279 INFO:tasks.workunit.client.1.smithi117.stdout:0/236: chown d11/d13/d28/f43 1 1 2024-09-19T06:40:30.279 INFO:tasks.workunit.client.0.smithi099.stdout:8/78: dwrite d4/fa [0,4194304] 0 2024-09-19T06:40:30.280 INFO:tasks.workunit.client.0.smithi099.stdout:6/154: dwrite d1/d12/f21 [0,4194304] 0 2024-09-19T06:40:30.280 INFO:tasks.workunit.client.1.smithi117.stdout:0/237: dread f0 [4194304,4194304] 0 2024-09-19T06:40:30.281 INFO:tasks.workunit.client.0.smithi099.stdout:9/168: write dd/f19 [1344990,558] 0 2024-09-19T06:40:30.281 INFO:tasks.workunit.client.1.smithi117.stdout:4/369: rename d3/de to d3/d1b/d7d 0 2024-09-19T06:40:30.283 INFO:tasks.workunit.client.1.smithi117.stdout:9/263: mkdir d4/d8/d55 0 2024-09-19T06:40:30.284 INFO:tasks.workunit.client.0.smithi099.stdout:7/157: link d7/dd/d29/d1f/f2a d7/f3f 0 2024-09-19T06:40:30.285 INFO:tasks.workunit.client.1.smithi117.stdout:1/274: dread d3/f32 [0,4194304] 0 2024-09-19T06:40:30.285 INFO:tasks.workunit.client.1.smithi117.stdout:7/256: write d1/d8/f2c [586558,81066] 0 2024-09-19T06:40:30.285 INFO:tasks.workunit.client.1.smithi117.stdout:9/264: write d4/d8/fb [2920077,53142] 0 2024-09-19T06:40:30.287 INFO:tasks.workunit.client.1.smithi117.stdout:1/275: chown d3/d18/d23/c36 12265 1 2024-09-19T06:40:30.288 INFO:tasks.workunit.client.0.smithi099.stdout:0/102: link d0/db/d13/c19 d0/db/c21 0 2024-09-19T06:40:30.288 INFO:tasks.workunit.client.1.smithi117.stdout:0/238: rmdir d11/d13/d28 39 2024-09-19T06:40:30.288 INFO:tasks.workunit.client.0.smithi099.stdout:8/79: creat d4/de/f16 x:0 0 0 2024-09-19T06:40:30.290 INFO:tasks.workunit.client.1.smithi117.stdout:4/370: symlink d3/db/d20/d29/d39/d4f/d6e/l7e 0 2024-09-19T06:40:30.290 INFO:tasks.workunit.client.0.smithi099.stdout:6/155: readlink d1/l11 0 2024-09-19T06:40:30.291 INFO:tasks.workunit.client.0.smithi099.stdout:3/201: write d7/f1a [2722472,119180] 0 2024-09-19T06:40:30.292 INFO:tasks.workunit.client.0.smithi099.stdout:0/103: symlink d0/d17/l22 0 2024-09-19T06:40:30.293 INFO:tasks.workunit.client.0.smithi099.stdout:7/158: dread - d7/f31 zero size 2024-09-19T06:40:30.294 INFO:tasks.workunit.client.1.smithi117.stdout:9/265: mknod d4/d1c/c56 0 2024-09-19T06:40:30.295 INFO:tasks.workunit.client.1.smithi117.stdout:9/266: chown d4/df/l1b 939114 1 2024-09-19T06:40:30.297 INFO:tasks.workunit.client.1.smithi117.stdout:1/276: creat d3/f5c x:0 0 0 2024-09-19T06:40:30.297 INFO:tasks.workunit.client.1.smithi117.stdout:4/371: dread d3/db/d20/d35/f4c [0,4194304] 0 2024-09-19T06:40:30.297 INFO:tasks.workunit.client.0.smithi099.stdout:2/71: dwrite d1/f15 [0,4194304] 0 2024-09-19T06:40:30.298 INFO:tasks.workunit.client.1.smithi117.stdout:0/239: creat d11/f48 x:0 0 0 2024-09-19T06:40:30.298 INFO:tasks.workunit.client.0.smithi099.stdout:6/156: write d1/d5/f13 [948596,68943] 0 2024-09-19T06:40:30.302 INFO:tasks.workunit.client.0.smithi099.stdout:7/159: fdatasync d7/fa 0 2024-09-19T06:40:30.303 INFO:tasks.workunit.client.0.smithi099.stdout:3/202: fdatasync d7/d16/f17 0 2024-09-19T06:40:30.303 INFO:tasks.workunit.client.1.smithi117.stdout:4/372: creat d3/d4/d5f/f7f x:0 0 0 2024-09-19T06:40:30.303 INFO:tasks.workunit.client.1.smithi117.stdout:9/267: dwrite d4/d1c/f1f [4194304,4194304] 0 2024-09-19T06:40:30.306 INFO:tasks.workunit.client.0.smithi099.stdout:2/72: rename d1/l4 to d1/d2/d5/d8/dc/l17 0 2024-09-19T06:40:30.306 INFO:tasks.workunit.client.1.smithi117.stdout:0/240: creat d11/d13/d14/f49 x:0 0 0 2024-09-19T06:40:30.307 INFO:tasks.workunit.client.0.smithi099.stdout:0/104: creat d0/db/f23 x:0 0 0 2024-09-19T06:40:30.308 INFO:tasks.workunit.client.1.smithi117.stdout:0/241: write d11/d13/d14/d2c/f32 [4490076,50924] 0 2024-09-19T06:40:30.310 INFO:tasks.workunit.client.0.smithi099.stdout:6/157: unlink d1/d5/f13 0 2024-09-19T06:40:30.311 INFO:tasks.workunit.client.0.smithi099.stdout:6/158: dread - d1/d5/f33 zero size 2024-09-19T06:40:30.312 INFO:tasks.workunit.client.1.smithi117.stdout:9/268: rmdir d4/d20 39 2024-09-19T06:40:30.313 INFO:tasks.workunit.client.1.smithi117.stdout:4/373: mkdir d3/d65/d66/d80 0 2024-09-19T06:40:30.313 INFO:tasks.workunit.client.1.smithi117.stdout:0/242: fsync d11/f12 0 2024-09-19T06:40:30.315 INFO:tasks.workunit.client.1.smithi117.stdout:4/374: chown d3/d1b/d7d/l42 8112 1 2024-09-19T06:40:30.315 INFO:tasks.workunit.client.0.smithi099.stdout:7/160: dread - d7/dd/d29/f2f zero size 2024-09-19T06:40:30.316 INFO:tasks.workunit.client.1.smithi117.stdout:0/243: dread d11/d13/f22 [0,4194304] 0 2024-09-19T06:40:30.316 INFO:tasks.workunit.client.0.smithi099.stdout:0/105: dwrite d0/db/f23 [0,4194304] 0 2024-09-19T06:40:30.317 INFO:tasks.workunit.client.0.smithi099.stdout:6/159: creat d1/d12/f39 x:0 0 0 2024-09-19T06:40:30.319 INFO:tasks.workunit.client.0.smithi099.stdout:6/160: rmdir d1/d5/d24/d25 39 2024-09-19T06:40:30.320 INFO:tasks.workunit.client.0.smithi099.stdout:6/161: dread - d1/d12/f34 zero size 2024-09-19T06:40:30.322 INFO:tasks.workunit.client.1.smithi117.stdout:9/269: dwrite d4/f33 [0,4194304] 0 2024-09-19T06:40:30.325 INFO:tasks.workunit.client.1.smithi117.stdout:0/244: link d11/d13/d28/f43 d11/d13/d14/d16/f4a 0 2024-09-19T06:40:30.326 INFO:tasks.workunit.client.1.smithi117.stdout:9/270: chown d4/df/d52/f3e 0 1 2024-09-19T06:40:30.328 INFO:tasks.workunit.client.0.smithi099.stdout:2/73: dread d1/d2/d5/d8/fa [4194304,4194304] 0 2024-09-19T06:40:30.332 INFO:tasks.workunit.client.1.smithi117.stdout:9/271: symlink d4/d8/d55/l57 0 2024-09-19T06:40:30.332 INFO:tasks.workunit.client.1.smithi117.stdout:9/272: chown d4 8288 1 2024-09-19T06:40:30.334 INFO:tasks.workunit.client.0.smithi099.stdout:0/106: dwrite d0/f1b [0,4194304] 0 2024-09-19T06:40:30.334 INFO:tasks.workunit.client.1.smithi117.stdout:9/273: dread - d4/d20/f45 zero size 2024-09-19T06:40:30.334 INFO:tasks.workunit.client.0.smithi099.stdout:3/203: truncate d7/f1a 3147618 0 2024-09-19T06:40:30.335 INFO:tasks.workunit.client.0.smithi099.stdout:7/161: dwrite d7/f26 [0,4194304] 0 2024-09-19T06:40:30.335 INFO:tasks.workunit.client.1.smithi117.stdout:1/277: write d3/f3c [126853,110992] 0 2024-09-19T06:40:30.336 INFO:tasks.workunit.client.1.smithi117.stdout:9/274: dread - d4/d8/f2d zero size 2024-09-19T06:40:30.337 INFO:tasks.workunit.client.0.smithi099.stdout:6/162: dwrite d1/d12/f39 [0,4194304] 0 2024-09-19T06:40:30.341 INFO:tasks.workunit.client.1.smithi117.stdout:7/257: dread d1/d8/d24/d1c/f27 [0,4194304] 0 2024-09-19T06:40:30.341 INFO:tasks.workunit.client.1.smithi117.stdout:4/375: write d3/db/d20/f36 [300131,56298] 0 2024-09-19T06:40:30.341 INFO:tasks.workunit.client.1.smithi117.stdout:9/275: chown d4/c10 0 1 2024-09-19T06:40:30.341 INFO:tasks.workunit.client.1.smithi117.stdout:4/376: fdatasync d3/d1b/f4d 0 2024-09-19T06:40:30.344 INFO:tasks.workunit.client.1.smithi117.stdout:1/278: rename d3/d18/d23/f45 to d3/d18/d23/f5d 0 2024-09-19T06:40:30.346 INFO:tasks.workunit.client.0.smithi099.stdout:0/107: dwrite d0/f11 [0,4194304] 0 2024-09-19T06:40:30.347 INFO:tasks.workunit.client.1.smithi117.stdout:7/258: unlink d1/f3c 0 2024-09-19T06:40:30.349 INFO:tasks.workunit.client.1.smithi117.stdout:9/276: mkdir d4/d58 0 2024-09-19T06:40:30.350 INFO:tasks.workunit.client.1.smithi117.stdout:1/279: write d3/d18/d23/f5d [730014,84255] 0 2024-09-19T06:40:30.353 INFO:tasks.workunit.client.0.smithi099.stdout:6/163: stat d1/c36 0 2024-09-19T06:40:30.353 INFO:tasks.workunit.client.1.smithi117.stdout:9/277: write d4/d20/f50 [417228,101966] 0 2024-09-19T06:40:30.355 INFO:tasks.workunit.client.1.smithi117.stdout:4/377: getdents d3/db/d13 0 2024-09-19T06:40:30.357 INFO:tasks.workunit.client.0.smithi099.stdout:6/164: unlink d1/d5/c8 0 2024-09-19T06:40:30.357 INFO:tasks.workunit.client.1.smithi117.stdout:7/259: unlink d1/l33 0 2024-09-19T06:40:30.358 INFO:tasks.workunit.client.0.smithi099.stdout:6/165: stat d1/c36 0 2024-09-19T06:40:30.358 INFO:tasks.workunit.client.1.smithi117.stdout:9/278: readlink d4/l4a 0 2024-09-19T06:40:30.359 INFO:tasks.workunit.client.1.smithi117.stdout:1/280: creat d3/f5e x:0 0 0 2024-09-19T06:40:30.359 INFO:tasks.workunit.client.0.smithi099.stdout:6/166: dread - d1/f19 zero size 2024-09-19T06:40:30.359 INFO:tasks.workunit.client.0.smithi099.stdout:6/167: chown d1/d5/c1a 2 1 2024-09-19T06:40:30.365 INFO:tasks.workunit.client.1.smithi117.stdout:4/378: dwrite d3/d1b/d7d/f1c [4194304,4194304] 0 2024-09-19T06:40:30.366 INFO:tasks.workunit.client.1.smithi117.stdout:7/260: dread d1/d8/f2a [0,4194304] 0 2024-09-19T06:40:30.367 INFO:tasks.workunit.client.1.smithi117.stdout:7/261: fsync d1/d8/d24/d1c/d55/f59 0 2024-09-19T06:40:30.369 INFO:tasks.workunit.client.1.smithi117.stdout:4/379: rmdir d3/db/d20/d35/d7a 0 2024-09-19T06:40:30.371 INFO:tasks.workunit.client.1.smithi117.stdout:4/380: write d3/d41/f69 [663989,98648] 0 2024-09-19T06:40:30.371 INFO:tasks.workunit.client.0.smithi099.stdout:0/108: write d0/f11 [4531097,40308] 0 2024-09-19T06:40:30.374 INFO:tasks.workunit.client.0.smithi099.stdout:0/109: write d0/db/d13/f20 [1925386,79949] 0 2024-09-19T06:40:30.376 INFO:tasks.workunit.client.1.smithi117.stdout:7/262: link d1/d8/c42 d1/c5e 0 2024-09-19T06:40:30.377 INFO:tasks.workunit.client.1.smithi117.stdout:7/263: dread - d1/d8/d24/d1c/d55/f59 zero size 2024-09-19T06:40:30.377 INFO:tasks.workunit.client.0.smithi099.stdout:3/204: dwrite d7/d23/f26 [4194304,4194304] 0 2024-09-19T06:40:30.381 INFO:tasks.workunit.client.0.smithi099.stdout:0/110: dread d0/db/d13/f20 [0,4194304] 0 2024-09-19T06:40:30.381 INFO:tasks.workunit.client.1.smithi117.stdout:7/264: mkdir d1/d8/d48/d5f 0 2024-09-19T06:40:30.381 INFO:tasks.workunit.client.0.smithi099.stdout:5/304: sync 2024-09-19T06:40:30.381 INFO:tasks.workunit.client.0.smithi099.stdout:4/161: sync 2024-09-19T06:40:30.382 INFO:tasks.workunit.client.1.smithi117.stdout:1/281: truncate d3/f4c 811198 0 2024-09-19T06:40:30.383 INFO:tasks.workunit.client.1.smithi117.stdout:7/265: readlink d1/l38 0 2024-09-19T06:40:30.384 INFO:tasks.workunit.client.0.smithi099.stdout:0/111: creat d0/db/d13/d1f/f24 x:0 0 0 2024-09-19T06:40:30.384 INFO:tasks.workunit.client.1.smithi117.stdout:4/381: getdents d3/db/d20/d35 0 2024-09-19T06:40:30.385 INFO:tasks.workunit.client.1.smithi117.stdout:1/282: unlink d3/d18/d56/c4b 0 2024-09-19T06:40:30.386 INFO:tasks.workunit.client.0.smithi099.stdout:4/162: creat d12/d1b/f3b x:0 0 0 2024-09-19T06:40:30.389 INFO:tasks.workunit.client.1.smithi117.stdout:4/382: creat d3/db/f81 x:0 0 0 2024-09-19T06:40:30.389 INFO:tasks.workunit.client.1.smithi117.stdout:9/279: dread d4/d8/fe [0,4194304] 0 2024-09-19T06:40:30.390 INFO:tasks.workunit.client.0.smithi099.stdout:4/163: symlink d12/d1b/d1c/l3c 0 2024-09-19T06:40:30.390 INFO:tasks.workunit.client.1.smithi117.stdout:9/280: chown d4/d8/d55/l57 728540 1 2024-09-19T06:40:30.391 INFO:tasks.workunit.client.1.smithi117.stdout:4/383: chown d3/d4/d5f/f7f 264960 1 2024-09-19T06:40:30.392 INFO:tasks.workunit.client.0.smithi099.stdout:0/112: dwrite d0/db/d13/d1f/f24 [0,4194304] 0 2024-09-19T06:40:30.392 INFO:tasks.workunit.client.0.smithi099.stdout:0/113: readlink d0/l8 0 2024-09-19T06:40:30.392 INFO:tasks.workunit.client.1.smithi117.stdout:4/384: dread - d3/d65/f7c zero size 2024-09-19T06:40:30.392 INFO:tasks.workunit.client.1.smithi117.stdout:7/266: link d1/d8/d24/d1c/d35/d4f/l56 d1/d8/d24/d26/l60 0 2024-09-19T06:40:30.393 INFO:tasks.workunit.client.1.smithi117.stdout:7/267: dread - d1/d8/d24/d26/f2f zero size 2024-09-19T06:40:30.393 INFO:tasks.workunit.client.1.smithi117.stdout:4/385: symlink d3/d1b/l82 0 2024-09-19T06:40:30.395 INFO:tasks.workunit.client.1.smithi117.stdout:4/386: readlink d3/db/d20/d35/d45/l46 0 2024-09-19T06:40:30.396 INFO:tasks.workunit.client.1.smithi117.stdout:9/281: creat d4/d1c/f59 x:0 0 0 2024-09-19T06:40:30.399 INFO:tasks.workunit.client.1.smithi117.stdout:4/387: truncate d3/d4/f18 1196445 0 2024-09-19T06:40:30.400 INFO:tasks.workunit.client.1.smithi117.stdout:7/268: dwrite d1/d8/f2c [0,4194304] 0 2024-09-19T06:40:30.402 INFO:tasks.workunit.client.1.smithi117.stdout:4/388: mknod d3/db/d20/d35/c83 0 2024-09-19T06:40:30.405 INFO:tasks.workunit.client.1.smithi117.stdout:7/269: dread d1/d8/d24/d1c/f22 [0,4194304] 0 2024-09-19T06:40:30.414 INFO:tasks.workunit.client.0.smithi099.stdout:3/205: dread d7/d16/f17 [0,4194304] 0 2024-09-19T06:40:30.415 INFO:tasks.workunit.client.0.smithi099.stdout:3/206: write f6 [4062889,93202] 0 2024-09-19T06:40:30.420 INFO:tasks.workunit.client.1.smithi117.stdout:9/282: dread d4/d1c/d36/d37/f42 [0,4194304] 0 2024-09-19T06:40:30.448 INFO:tasks.workunit.client.1.smithi117.stdout:6/200: sync 2024-09-19T06:40:30.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:30 smithi099 ceph-mon[27651]: pgmap v13: 65 pgs: 65 active+clean; 392 MiB data, 2.9 GiB used, 533 GiB / 536 GiB avail; 735 KiB/s rd, 27 MiB/s wr, 228 op/s 2024-09-19T06:40:30.464 INFO:tasks.workunit.client.1.smithi117.stdout:4/389: mkdir d3/d1b/d63/d84 0 2024-09-19T06:40:30.464 INFO:tasks.workunit.client.1.smithi117.stdout:7/270: chown d1/d3f 1687255907 1 2024-09-19T06:40:30.465 INFO:tasks.workunit.client.0.smithi099.stdout:3/207: mknod d7/d23/c2c 0 2024-09-19T06:40:30.466 INFO:tasks.workunit.client.0.smithi099.stdout:4/164: creat d12/f3d x:0 0 0 2024-09-19T06:40:30.468 INFO:tasks.workunit.client.0.smithi099.stdout:3/208: creat d7/d16/d1d/d20/f2d x:0 0 0 2024-09-19T06:40:30.468 INFO:tasks.workunit.client.0.smithi099.stdout:0/114: write d0/db/fe [641385,57920] 0 2024-09-19T06:40:30.469 INFO:tasks.workunit.client.0.smithi099.stdout:0/115: read - d0/d17/f1c zero size 2024-09-19T06:40:30.470 INFO:tasks.workunit.client.0.smithi099.stdout:4/165: creat d12/d32/f3e x:0 0 0 2024-09-19T06:40:30.470 INFO:tasks.workunit.client.0.smithi099.stdout:3/209: symlink d7/d16/d1d/l2e 0 2024-09-19T06:40:30.471 INFO:tasks.workunit.client.0.smithi099.stdout:0/116: mknod d0/db/d13/c25 0 2024-09-19T06:40:30.472 INFO:tasks.workunit.client.0.smithi099.stdout:3/210: symlink d7/d23/l2f 0 2024-09-19T06:40:30.472 INFO:tasks.workunit.client.0.smithi099.stdout:4/166: mknod d12/c3f 0 2024-09-19T06:40:30.473 INFO:tasks.workunit.client.0.smithi099.stdout:3/211: creat d7/d16/d28/f30 x:0 0 0 2024-09-19T06:40:30.474 INFO:tasks.workunit.client.0.smithi099.stdout:4/167: creat d12/d32/d39/f40 x:0 0 0 2024-09-19T06:40:30.478 INFO:tasks.workunit.client.0.smithi099.stdout:0/117: dwrite d0/d17/f1c [0,4194304] 0 2024-09-19T06:40:30.482 INFO:tasks.workunit.client.0.smithi099.stdout:0/118: symlink d0/db/l26 0 2024-09-19T06:40:30.482 INFO:tasks.workunit.client.0.smithi099.stdout:4/168: dwrite fb [4194304,4194304] 0 2024-09-19T06:40:30.483 INFO:tasks.workunit.client.0.smithi099.stdout:0/119: stat d0/f3 0 2024-09-19T06:40:30.483 INFO:tasks.workunit.client.0.smithi099.stdout:0/120: fsync d0/db/fc 0 2024-09-19T06:40:30.488 INFO:tasks.workunit.client.0.smithi099.stdout:4/169: getdents d12/d1b 0 2024-09-19T06:40:30.489 INFO:tasks.workunit.client.0.smithi099.stdout:4/170: chown d12/f38 6 1 2024-09-19T06:40:30.491 INFO:tasks.workunit.client.0.smithi099.stdout:0/121: dwrite d0/db/d13/d1f/f24 [0,4194304] 0 2024-09-19T06:40:30.492 INFO:tasks.workunit.client.0.smithi099.stdout:4/171: unlink d12/c3f 0 2024-09-19T06:40:30.495 INFO:tasks.workunit.client.0.smithi099.stdout:4/172: unlink d12/f3d 0 2024-09-19T06:40:30.496 INFO:tasks.workunit.client.0.smithi099.stdout:0/122: mkdir d0/db/d27 0 2024-09-19T06:40:30.497 INFO:tasks.workunit.client.0.smithi099.stdout:0/123: write d0/f11 [3049578,128299] 0 2024-09-19T06:40:30.498 INFO:tasks.workunit.client.0.smithi099.stdout:0/124: fdatasync d0/db/f23 0 2024-09-19T06:40:30.499 INFO:tasks.workunit.client.0.smithi099.stdout:4/173: unlink d12/d1b/d1c/f1f 0 2024-09-19T06:40:30.503 INFO:tasks.workunit.client.0.smithi099.stdout:0/125: write d0/db/d13/f20 [1133273,58648] 0 2024-09-19T06:40:30.503 INFO:tasks.workunit.client.0.smithi099.stdout:4/174: mknod d12/d32/c41 0 2024-09-19T06:40:30.505 INFO:tasks.workunit.client.0.smithi099.stdout:0/126: creat d0/db/d13/d1f/f28 x:0 0 0 2024-09-19T06:40:30.505 INFO:tasks.workunit.client.0.smithi099.stdout:4/175: mkdir d12/d32/d42 0 2024-09-19T06:40:30.506 INFO:tasks.workunit.client.0.smithi099.stdout:0/127: mkdir d0/db/d13/d29 0 2024-09-19T06:40:30.507 INFO:tasks.workunit.client.0.smithi099.stdout:4/176: mknod d12/d32/d39/c43 0 2024-09-19T06:40:30.508 INFO:tasks.workunit.client.0.smithi099.stdout:4/177: creat d12/d1b/f44 x:0 0 0 2024-09-19T06:40:30.510 INFO:tasks.workunit.client.0.smithi099.stdout:4/178: symlink d12/d32/d42/l45 0 2024-09-19T06:40:30.511 INFO:tasks.workunit.client.0.smithi099.stdout:4/179: truncate d12/f2a 526907 0 2024-09-19T06:40:30.511 INFO:tasks.workunit.client.0.smithi099.stdout:3/212: dread d7/f14 [0,4194304] 0 2024-09-19T06:40:30.512 INFO:tasks.workunit.client.0.smithi099.stdout:3/213: fdatasync d7/f10 0 2024-09-19T06:40:30.513 INFO:tasks.workunit.client.0.smithi099.stdout:3/214: write d7/d16/f1f [1042734,67184] 0 2024-09-19T06:40:30.514 INFO:tasks.workunit.client.0.smithi099.stdout:0/128: fdatasync d0/db/d13/d1f/f24 0 2024-09-19T06:40:30.515 INFO:tasks.workunit.client.0.smithi099.stdout:1/137: sync 2024-09-19T06:40:30.517 INFO:tasks.workunit.client.0.smithi099.stdout:0/129: creat d0/f2a x:0 0 0 2024-09-19T06:40:30.518 INFO:tasks.workunit.client.0.smithi099.stdout:0/130: chown d0/d17 18734759 1 2024-09-19T06:40:30.520 INFO:tasks.workunit.client.0.smithi099.stdout:4/180: dwrite d12/f30 [0,4194304] 0 2024-09-19T06:40:30.522 INFO:tasks.workunit.client.0.smithi099.stdout:1/138: getdents d0 0 2024-09-19T06:40:30.522 INFO:tasks.workunit.client.0.smithi099.stdout:0/131: chown d0/l8 3 1 2024-09-19T06:40:30.523 INFO:tasks.workunit.client.1.smithi117.stdout:7/271: mknod d1/d8/d24/d26/d44/c61 0 2024-09-19T06:40:30.523 INFO:tasks.workunit.client.1.smithi117.stdout:7/272: chown d1/f50 2 1 2024-09-19T06:40:30.523 INFO:tasks.workunit.client.0.smithi099.stdout:3/215: dwrite d7/f12 [0,4194304] 0 2024-09-19T06:40:30.524 INFO:tasks.workunit.client.1.smithi117.stdout:7/273: dread - d1/d3f/f57 zero size 2024-09-19T06:40:30.525 INFO:tasks.workunit.client.0.smithi099.stdout:4/181: symlink d12/d32/d39/l46 0 2024-09-19T06:40:30.525 INFO:tasks.workunit.client.0.smithi099.stdout:0/132: read - d0/db/d13/d1f/f28 zero size 2024-09-19T06:40:30.525 INFO:tasks.workunit.client.0.smithi099.stdout:3/216: chown d7/fa 1201 1 2024-09-19T06:40:30.527 INFO:tasks.workunit.client.1.smithi117.stdout:4/390: creat d3/d1b/d7d/d51/f85 x:0 0 0 2024-09-19T06:40:30.528 INFO:tasks.workunit.client.0.smithi099.stdout:0/133: fdatasync d0/d17/f1c 0 2024-09-19T06:40:30.530 INFO:tasks.workunit.client.1.smithi117.stdout:9/283: truncate d4/f7 440742 0 2024-09-19T06:40:30.531 INFO:tasks.workunit.client.0.smithi099.stdout:1/139: mknod d0/db/c2a 0 2024-09-19T06:40:30.531 INFO:tasks.workunit.client.1.smithi117.stdout:7/274: chown d1/d8/d24/d26/l60 13397690 1 2024-09-19T06:40:30.531 INFO:tasks.workunit.client.0.smithi099.stdout:3/217: dread d7/d23/f26 [0,4194304] 0 2024-09-19T06:40:30.532 INFO:tasks.workunit.client.0.smithi099.stdout:1/140: read d0/d12/d13/f22 [627924,17384] 0 2024-09-19T06:40:30.533 INFO:tasks.workunit.client.0.smithi099.stdout:0/134: creat d0/db/d13/d1f/f2b x:0 0 0 2024-09-19T06:40:30.533 INFO:tasks.workunit.client.1.smithi117.stdout:9/284: write d4/df/d16/f26 [2473921,2088] 0 2024-09-19T06:40:30.533 INFO:tasks.workunit.client.0.smithi099.stdout:1/141: read d0/db/dd/f1d [206626,23449] 0 2024-09-19T06:40:30.534 INFO:tasks.workunit.client.1.smithi117.stdout:6/201: dwrite d1/d3/f1f [0,4194304] 0 2024-09-19T06:40:30.534 INFO:tasks.workunit.client.1.smithi117.stdout:9/285: readlink d4/l4a 0 2024-09-19T06:40:30.535 INFO:tasks.workunit.client.0.smithi099.stdout:1/142: truncate d0/db/f25 828222 0 2024-09-19T06:40:30.536 INFO:tasks.workunit.client.1.smithi117.stdout:6/202: readlink d1/d5/d8/d27/l2f 0 2024-09-19T06:40:30.536 INFO:tasks.workunit.client.1.smithi117.stdout:9/286: readlink d4/d1c/d36/d37/l3a 0 2024-09-19T06:40:30.537 INFO:tasks.workunit.client.1.smithi117.stdout:9/287: readlink d4/df/l1b 0 2024-09-19T06:40:30.537 INFO:tasks.workunit.client.0.smithi099.stdout:1/143: write d0/db/f1f [443071,11962] 0 2024-09-19T06:40:30.540 INFO:tasks.workunit.client.0.smithi099.stdout:4/182: rename c3 to d12/d32/c47 0 2024-09-19T06:40:30.540 INFO:tasks.workunit.client.0.smithi099.stdout:3/218: dwrite d7/f10 [0,4194304] 0 2024-09-19T06:40:30.541 INFO:tasks.workunit.client.0.smithi099.stdout:3/219: chown d7/d16/d1d/c27 102322 1 2024-09-19T06:40:30.543 INFO:tasks.workunit.client.0.smithi099.stdout:0/135: creat d0/db/d27/f2c x:0 0 0 2024-09-19T06:40:30.543 INFO:tasks.workunit.client.1.smithi117.stdout:7/275: link d1/d8/f39 d1/d8/d24/d49/f62 0 2024-09-19T06:40:30.545 INFO:tasks.workunit.client.1.smithi117.stdout:7/276: stat d1/d8/d48 0 2024-09-19T06:40:30.545 INFO:tasks.workunit.client.0.smithi099.stdout:3/220: unlink d7/d16/l19 0 2024-09-19T06:40:30.546 INFO:tasks.workunit.client.0.smithi099.stdout:0/136: dread - d0/db/d13/d1f/f28 zero size 2024-09-19T06:40:30.546 INFO:tasks.workunit.client.1.smithi117.stdout:6/203: dwrite d1/d3/f12 [0,4194304] 0 2024-09-19T06:40:30.546 INFO:tasks.workunit.client.1.smithi117.stdout:9/288: link d4/f19 d4/d1c/d54/f5a 0 2024-09-19T06:40:30.547 INFO:tasks.workunit.client.0.smithi099.stdout:1/144: dread d0/f6 [0,4194304] 0 2024-09-19T06:40:30.547 INFO:tasks.workunit.client.0.smithi099.stdout:3/221: write d7/d23/f29 [332326,61641] 0 2024-09-19T06:40:30.550 INFO:tasks.workunit.client.0.smithi099.stdout:4/183: creat d12/d32/f48 x:0 0 0 2024-09-19T06:40:30.550 INFO:tasks.workunit.client.1.smithi117.stdout:7/277: rename d1/l38 to d1/d8/d24/d26/d3e/l63 0 2024-09-19T06:40:30.551 INFO:tasks.workunit.client.1.smithi117.stdout:4/391: truncate d3/db/d20/d4a/f6f 3941064 0 2024-09-19T06:40:30.551 INFO:tasks.workunit.client.0.smithi099.stdout:3/222: rename d7/d16/d1d/f22 to d7/d16/d1d/d20/f31 0 2024-09-19T06:40:30.552 INFO:tasks.workunit.client.1.smithi117.stdout:9/289: symlink d4/d20/l5b 0 2024-09-19T06:40:30.554 INFO:tasks.workunit.client.0.smithi099.stdout:1/145: creat d0/d12/d13/f2b x:0 0 0 2024-09-19T06:40:30.555 INFO:tasks.workunit.client.1.smithi117.stdout:9/290: write d4/d1c/f41 [306233,34823] 0 2024-09-19T06:40:30.555 INFO:tasks.workunit.client.0.smithi099.stdout:3/223: creat d7/d23/f32 x:0 0 0 2024-09-19T06:40:30.555 INFO:tasks.workunit.client.1.smithi117.stdout:7/278: creat d1/d8/d24/d26/f64 x:0 0 0 2024-09-19T06:40:30.556 INFO:tasks.workunit.client.0.smithi099.stdout:1/146: rmdir d0/db 39 2024-09-19T06:40:30.557 INFO:tasks.workunit.client.1.smithi117.stdout:9/291: dread - d4/d1c/f59 zero size 2024-09-19T06:40:30.557 INFO:tasks.workunit.client.1.smithi117.stdout:6/204: dwrite d1/d14/f2e [0,4194304] 0 2024-09-19T06:40:30.558 INFO:tasks.workunit.client.1.smithi117.stdout:9/292: chown d4/df/d16/l34 1140052 1 2024-09-19T06:40:30.559 INFO:tasks.workunit.client.0.smithi099.stdout:4/184: unlink d12/d1b/f3b 0 2024-09-19T06:40:30.560 INFO:tasks.workunit.client.1.smithi117.stdout:6/205: mkdir d1/d3/d34 0 2024-09-19T06:40:30.561 INFO:tasks.workunit.client.1.smithi117.stdout:7/279: symlink d1/d8/d48/d5f/l65 0 2024-09-19T06:40:30.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:30 smithi117 ceph-mon[34564]: pgmap v13: 65 pgs: 65 active+clean; 392 MiB data, 2.9 GiB used, 533 GiB / 536 GiB avail; 735 KiB/s rd, 27 MiB/s wr, 228 op/s 2024-09-19T06:40:30.563 INFO:tasks.workunit.client.1.smithi117.stdout:4/392: creat d3/d1b/d7d/f86 x:0 0 0 2024-09-19T06:40:30.563 INFO:tasks.workunit.client.0.smithi099.stdout:4/185: unlink d12/f2a 0 2024-09-19T06:40:30.565 INFO:tasks.workunit.client.0.smithi099.stdout:1/147: fsync d0/db/f19 0 2024-09-19T06:40:30.566 INFO:tasks.workunit.client.1.smithi117.stdout:7/280: mknod d1/d8/d24/d49/c66 0 2024-09-19T06:40:30.566 INFO:tasks.workunit.client.0.smithi099.stdout:3/224: dwrite d7/d23/f29 [0,4194304] 0 2024-09-19T06:40:30.566 INFO:tasks.workunit.client.0.smithi099.stdout:4/186: stat d12/d1b/d1c/c37 0 2024-09-19T06:40:30.567 INFO:tasks.workunit.client.1.smithi117.stdout:4/393: symlink d3/d1b/d63/l87 0 2024-09-19T06:40:30.567 INFO:tasks.workunit.client.1.smithi117.stdout:7/281: chown d1/d8/d24/d1c/d35/d4f/f5b 1 1 2024-09-19T06:40:30.567 INFO:tasks.workunit.client.1.smithi117.stdout:9/293: link d4/df/l1b d4/df/l5c 0 2024-09-19T06:40:30.568 INFO:tasks.workunit.client.1.smithi117.stdout:4/394: fsync d3/db/ff 0 2024-09-19T06:40:30.569 INFO:tasks.workunit.client.0.smithi099.stdout:4/187: dread - d12/d32/d39/f40 zero size 2024-09-19T06:40:30.569 INFO:tasks.workunit.client.0.smithi099.stdout:1/148: creat d0/db/dd/f2c x:0 0 0 2024-09-19T06:40:30.569 INFO:tasks.workunit.client.1.smithi117.stdout:6/206: symlink d1/d3/d25/l35 0 2024-09-19T06:40:30.571 INFO:tasks.workunit.client.1.smithi117.stdout:7/282: chown d1/d8/c42 4464635 1 2024-09-19T06:40:30.572 INFO:tasks.workunit.client.0.smithi099.stdout:0/137: fsync d0/db/d27/f2c 0 2024-09-19T06:40:30.573 INFO:tasks.workunit.client.0.smithi099.stdout:1/149: unlink d0/db/f11 0 2024-09-19T06:40:30.574 INFO:tasks.workunit.client.1.smithi117.stdout:7/283: chown d1/d8/d24/d49/c66 471 1 2024-09-19T06:40:30.575 INFO:tasks.workunit.client.1.smithi117.stdout:4/395: rmdir d3/db/d20/d4a 39 2024-09-19T06:40:30.575 INFO:tasks.workunit.client.1.smithi117.stdout:7/284: write d1/f1e [1687641,19960] 0 2024-09-19T06:40:30.575 INFO:tasks.workunit.client.0.smithi099.stdout:4/188: symlink d12/l49 0 2024-09-19T06:40:30.577 INFO:tasks.workunit.client.1.smithi117.stdout:9/294: fsync d4/f7 0 2024-09-19T06:40:30.577 INFO:tasks.workunit.client.0.smithi099.stdout:3/225: dwrite d7/d23/f32 [0,4194304] 0 2024-09-19T06:40:30.578 INFO:tasks.workunit.client.1.smithi117.stdout:4/396: mkdir d3/d4/d5f/d88 0 2024-09-19T06:40:30.579 INFO:tasks.workunit.client.1.smithi117.stdout:6/207: dwrite d1/d3/f9 [0,4194304] 0 2024-09-19T06:40:30.579 INFO:tasks.workunit.client.0.smithi099.stdout:0/138: creat d0/db/d13/d29/f2d x:0 0 0 2024-09-19T06:40:30.581 INFO:tasks.workunit.client.1.smithi117.stdout:7/285: creat d1/d8/d24/d1c/f67 x:0 0 0 2024-09-19T06:40:30.587 INFO:tasks.workunit.client.1.smithi117.stdout:6/208: dread d1/d14/f2b [0,4194304] 0 2024-09-19T06:40:30.587 INFO:tasks.workunit.client.0.smithi099.stdout:3/226: read d7/f1a [1371825,89567] 0 2024-09-19T06:40:30.587 INFO:tasks.workunit.client.0.smithi099.stdout:4/189: dread d12/d32/f29 [0,4194304] 0 2024-09-19T06:40:30.587 INFO:tasks.workunit.client.0.smithi099.stdout:1/150: dwrite d0/d12/d13/f1b [0,4194304] 0 2024-09-19T06:40:30.588 INFO:tasks.workunit.client.1.smithi117.stdout:7/286: rename d1/d8/d24/d26/f64 to d1/d8/d24/d26/d44/f68 0 2024-09-19T06:40:30.589 INFO:tasks.workunit.client.1.smithi117.stdout:4/397: dwrite d3/db/f81 [0,4194304] 0 2024-09-19T06:40:30.590 INFO:tasks.workunit.client.1.smithi117.stdout:7/287: readlink d1/d8/l36 0 2024-09-19T06:40:30.592 INFO:tasks.workunit.client.1.smithi117.stdout:9/295: mkdir d4/d5d 0 2024-09-19T06:40:30.593 INFO:tasks.workunit.client.1.smithi117.stdout:7/288: truncate d1/d8/d24/d1c/f4e 142280 0 2024-09-19T06:40:30.594 INFO:tasks.workunit.client.1.smithi117.stdout:7/289: stat d1/d8/l36 0 2024-09-19T06:40:30.595 INFO:tasks.workunit.client.0.smithi099.stdout:3/227: rename d7/d16/f17 to d7/d23/f33 0 2024-09-19T06:40:30.596 INFO:tasks.workunit.client.0.smithi099.stdout:1/151: mkdir d0/d2d 0 2024-09-19T06:40:30.596 INFO:tasks.workunit.client.1.smithi117.stdout:4/398: unlink d3/d4/f18 0 2024-09-19T06:40:30.599 INFO:tasks.workunit.client.1.smithi117.stdout:6/209: dwrite d1/d14/f23 [0,4194304] 0 2024-09-19T06:40:30.600 INFO:tasks.workunit.client.0.smithi099.stdout:4/190: truncate d12/d1b/d1c/f31 727714 0 2024-09-19T06:40:30.600 INFO:tasks.workunit.client.0.smithi099.stdout:0/139: rmdir d0 39 2024-09-19T06:40:30.601 INFO:tasks.workunit.client.1.smithi117.stdout:6/210: readlink d1/d3/d25/l35 0 2024-09-19T06:40:30.602 INFO:tasks.workunit.client.0.smithi099.stdout:1/152: read d0/f6 [8512,5965] 0 2024-09-19T06:40:30.603 INFO:tasks.workunit.client.1.smithi117.stdout:4/399: creat d3/d41/f89 x:0 0 0 2024-09-19T06:40:30.603 INFO:tasks.workunit.client.1.smithi117.stdout:3/362: sync 2024-09-19T06:40:30.603 INFO:tasks.workunit.client.1.smithi117.stdout:8/255: sync 2024-09-19T06:40:30.603 INFO:tasks.workunit.client.0.smithi099.stdout:8/80: sync 2024-09-19T06:40:30.604 INFO:tasks.workunit.client.0.smithi099.stdout:9/169: sync 2024-09-19T06:40:30.604 INFO:tasks.workunit.client.1.smithi117.stdout:9/296: creat d4/d17/f5e x:0 0 0 2024-09-19T06:40:30.604 INFO:tasks.workunit.client.0.smithi099.stdout:4/191: creat d12/d1b/d1c/f4a x:0 0 0 2024-09-19T06:40:30.605 INFO:tasks.workunit.client.0.smithi099.stdout:9/170: chown dd/f1f 872456 1 2024-09-19T06:40:30.606 INFO:tasks.workunit.client.0.smithi099.stdout:1/153: write d0/d12/d13/f22 [2746599,40191] 0 2024-09-19T06:40:30.607 INFO:tasks.workunit.client.0.smithi099.stdout:8/81: creat d4/f17 x:0 0 0 2024-09-19T06:40:30.609 INFO:tasks.workunit.client.1.smithi117.stdout:7/290: dread d1/f50 [0,4194304] 0 2024-09-19T06:40:30.611 INFO:tasks.workunit.client.0.smithi099.stdout:0/140: dread d0/d17/f1c [0,4194304] 0 2024-09-19T06:40:30.611 INFO:tasks.workunit.client.0.smithi099.stdout:4/192: stat fb 0 2024-09-19T06:40:30.612 INFO:tasks.workunit.client.1.smithi117.stdout:3/363: read d0/f12 [306157,79756] 0 2024-09-19T06:40:30.612 INFO:tasks.workunit.client.1.smithi117.stdout:4/400: truncate d3/db/d13/f1d 996883 0 2024-09-19T06:40:30.613 INFO:tasks.workunit.client.1.smithi117.stdout:7/291: write d1/d8/f2a [640983,58772] 0 2024-09-19T06:40:30.614 INFO:tasks.workunit.client.0.smithi099.stdout:8/82: symlink d4/de/d14/l18 0 2024-09-19T06:40:30.614 INFO:tasks.workunit.client.0.smithi099.stdout:0/141: chown d0/d17 24 1 2024-09-19T06:40:30.614 INFO:tasks.workunit.client.0.smithi099.stdout:4/193: read d12/d32/f29 [1509811,41311] 0 2024-09-19T06:40:30.615 INFO:tasks.workunit.client.0.smithi099.stdout:9/171: creat dd/d10/f2e x:0 0 0 2024-09-19T06:40:30.616 INFO:tasks.workunit.client.1.smithi117.stdout:4/401: rmdir d3/db/d13 39 2024-09-19T06:40:30.617 INFO:tasks.workunit.client.0.smithi099.stdout:8/83: mknod d4/de/d14/c19 0 2024-09-19T06:40:30.619 INFO:tasks.workunit.client.0.smithi099.stdout:9/172: write dd/f22 [3226375,1371] 0 2024-09-19T06:40:30.620 INFO:tasks.workunit.client.0.smithi099.stdout:1/154: dwrite d0/db/dd/f18 [0,4194304] 0 2024-09-19T06:40:30.621 INFO:tasks.workunit.client.0.smithi099.stdout:8/84: chown d4/c7 6 1 2024-09-19T06:40:30.622 INFO:tasks.workunit.client.1.smithi117.stdout:6/211: dwrite d1/d3/f9 [4194304,4194304] 0 2024-09-19T06:40:30.622 INFO:tasks.workunit.client.0.smithi099.stdout:9/173: write fb [3218152,104145] 0 2024-09-19T06:40:30.622 INFO:tasks.workunit.client.1.smithi117.stdout:3/364: write d0/d9/d1c/f1d [1498035,55563] 0 2024-09-19T06:40:30.622 INFO:tasks.workunit.client.1.smithi117.stdout:4/402: write d3/db/f81 [3116131,99782] 0 2024-09-19T06:40:30.624 INFO:tasks.workunit.client.0.smithi099.stdout:8/85: fsync d4/f6 0 2024-09-19T06:40:30.625 INFO:tasks.workunit.client.1.smithi117.stdout:8/256: dwrite d1d/d1e/d29/f2d [0,4194304] 0 2024-09-19T06:40:30.626 INFO:tasks.workunit.client.1.smithi117.stdout:9/297: dwrite d4/df/d16/f26 [0,4194304] 0 2024-09-19T06:40:30.627 INFO:tasks.workunit.client.0.smithi099.stdout:9/174: read dd/f1f [288485,1004] 0 2024-09-19T06:40:30.628 INFO:tasks.workunit.client.1.smithi117.stdout:3/365: fdatasync d0/f63 0 2024-09-19T06:40:30.629 INFO:tasks.workunit.client.1.smithi117.stdout:6/212: chown d1/d14/f2b 62530521 1 2024-09-19T06:40:30.629 INFO:tasks.workunit.client.1.smithi117.stdout:7/292: dread d1/f50 [0,4194304] 0 2024-09-19T06:40:30.630 INFO:tasks.workunit.client.1.smithi117.stdout:9/298: truncate d4/d8/f31 980821 0 2024-09-19T06:40:30.631 INFO:tasks.workunit.client.0.smithi099.stdout:0/142: dwrite d0/db/fe [0,4194304] 0 2024-09-19T06:40:30.631 INFO:tasks.workunit.client.1.smithi117.stdout:5/271: sync 2024-09-19T06:40:30.632 INFO:tasks.workunit.client.1.smithi117.stdout:8/257: readlink d1d/d2a/d3f/l4e 0 2024-09-19T06:40:30.632 INFO:tasks.workunit.client.1.smithi117.stdout:2/285: sync 2024-09-19T06:40:30.633 INFO:tasks.workunit.client.1.smithi117.stdout:6/213: read d1/f1b [4494470,25362] 0 2024-09-19T06:40:30.633 INFO:tasks.workunit.client.0.smithi099.stdout:1/155: mknod d0/db/dd/c2e 0 2024-09-19T06:40:30.634 INFO:tasks.workunit.client.0.smithi099.stdout:3/228: rename d7/d16 to d7/d34 0 2024-09-19T06:40:30.634 INFO:tasks.workunit.client.1.smithi117.stdout:3/366: creat d0/d19/d2b/f6e x:0 0 0 2024-09-19T06:40:30.635 INFO:tasks.workunit.client.0.smithi099.stdout:2/74: sync 2024-09-19T06:40:30.635 INFO:tasks.workunit.client.0.smithi099.stdout:6/168: sync 2024-09-19T06:40:30.635 INFO:tasks.workunit.client.0.smithi099.stdout:5/305: sync 2024-09-19T06:40:30.635 INFO:tasks.workunit.client.0.smithi099.stdout:7/162: sync 2024-09-19T06:40:30.635 INFO:tasks.workunit.client.0.smithi099.stdout:4/194: dwrite d12/f35 [0,4194304] 0 2024-09-19T06:40:30.636 INFO:tasks.workunit.client.1.smithi117.stdout:9/299: write d4/d8/f2d [642855,113908] 0 2024-09-19T06:40:30.636 INFO:tasks.workunit.client.0.smithi099.stdout:9/175: dread dd/d2c/f25 [0,4194304] 0 2024-09-19T06:40:30.636 INFO:tasks.workunit.client.1.smithi117.stdout:3/367: write d0/d19/f38 [806573,77529] 0 2024-09-19T06:40:30.637 INFO:tasks.workunit.client.1.smithi117.stdout:4/403: mknod d3/db/d20/d35/d45/c8a 0 2024-09-19T06:40:30.637 INFO:tasks.workunit.client.0.smithi099.stdout:8/86: creat d4/de/f1a x:0 0 0 2024-09-19T06:40:30.643 INFO:tasks.workunit.client.1.smithi117.stdout:7/293: dwrite d1/d8/f1a [0,4194304] 0 2024-09-19T06:40:30.645 INFO:tasks.workunit.client.1.smithi117.stdout:8/258: rmdir d1d/d1e 39 2024-09-19T06:40:30.646 INFO:tasks.workunit.client.0.smithi099.stdout:7/163: write d7/f31 [761165,95053] 0 2024-09-19T06:40:30.646 INFO:tasks.workunit.client.0.smithi099.stdout:5/306: unlink d3/d1f/d4f/f5b 0 2024-09-19T06:40:30.647 INFO:tasks.workunit.client.1.smithi117.stdout:7/294: dread - d1/d8/d24/d1c/d55/f59 zero size 2024-09-19T06:40:30.649 INFO:tasks.workunit.client.1.smithi117.stdout:4/404: dwrite d3/d41/f69 [0,4194304] 0 2024-09-19T06:40:30.650 INFO:tasks.workunit.client.0.smithi099.stdout:1/156: mknod d0/d2d/c2f 0 2024-09-19T06:40:30.651 INFO:tasks.workunit.client.1.smithi117.stdout:3/368: dread d0/d24/f5c [0,4194304] 0 2024-09-19T06:40:30.652 INFO:tasks.workunit.client.1.smithi117.stdout:2/286: mknod d0/d64/c6d 0 2024-09-19T06:40:30.654 INFO:tasks.workunit.client.1.smithi117.stdout:9/300: write d4/f44 [318560,123533] 0 2024-09-19T06:40:30.658 INFO:tasks.workunit.client.0.smithi099.stdout:8/87: truncate f3 205532 0 2024-09-19T06:40:30.658 INFO:tasks.workunit.client.0.smithi099.stdout:5/307: mknod d3/d1f/c6b 0 2024-09-19T06:40:30.658 INFO:tasks.workunit.client.1.smithi117.stdout:6/214: rmdir d1/d3/d34 0 2024-09-19T06:40:30.659 INFO:tasks.workunit.client.0.smithi099.stdout:6/169: rename d1/d12/f34 to d1/d5/f3a 0 2024-09-19T06:40:30.660 INFO:tasks.workunit.client.1.smithi117.stdout:6/215: fdatasync d1/d14/f1a 0 2024-09-19T06:40:30.660 INFO:tasks.workunit.client.1.smithi117.stdout:8/259: creat d1d/f52 x:0 0 0 2024-09-19T06:40:30.663 INFO:tasks.workunit.client.0.smithi099.stdout:0/143: dwrite d0/db/d13/f20 [4194304,4194304] 0 2024-09-19T06:40:30.664 INFO:tasks.workunit.client.1.smithi117.stdout:7/295: getdents d1/d8/d24/d26/d3e 0 2024-09-19T06:40:30.664 INFO:tasks.workunit.client.1.smithi117.stdout:2/287: truncate d0/d7/f16 1474804 0 2024-09-19T06:40:30.665 INFO:tasks.workunit.client.0.smithi099.stdout:2/75: truncate d1/d2/d5/d8/fa 5877301 0 2024-09-19T06:40:30.665 INFO:tasks.workunit.client.0.smithi099.stdout:8/88: write d4/de/f12 [446153,28094] 0 2024-09-19T06:40:30.666 INFO:tasks.workunit.client.0.smithi099.stdout:0/144: readlink d0/l18 0 2024-09-19T06:40:30.668 INFO:tasks.workunit.client.1.smithi117.stdout:6/216: symlink d1/d5/l36 0 2024-09-19T06:40:30.668 INFO:tasks.workunit.client.0.smithi099.stdout:8/89: write d4/de/f1a [66160,34936] 0 2024-09-19T06:40:30.669 INFO:tasks.workunit.client.1.smithi117.stdout:3/369: getdents d0/d3d/d48 0 2024-09-19T06:40:30.669 INFO:tasks.workunit.client.0.smithi099.stdout:3/229: dwrite d7/d34/d28/f30 [0,4194304] 0 2024-09-19T06:40:30.669 INFO:tasks.workunit.client.0.smithi099.stdout:6/170: mknod d1/d5/d24/d2b/c3b 0 2024-09-19T06:40:30.670 INFO:tasks.workunit.client.0.smithi099.stdout:9/176: dread fa [0,4194304] 0 2024-09-19T06:40:30.671 INFO:tasks.workunit.client.1.smithi117.stdout:4/405: dwrite d3/d1b/d7d/f12 [0,4194304] 0 2024-09-19T06:40:30.672 INFO:tasks.workunit.client.0.smithi099.stdout:8/90: dread - d4/de/f16 zero size 2024-09-19T06:40:30.673 INFO:tasks.workunit.client.0.smithi099.stdout:0/145: write d0/db/d13/f20 [1475367,12305] 0 2024-09-19T06:40:30.673 INFO:tasks.workunit.client.1.smithi117.stdout:6/217: creat d1/d3/f37 x:0 0 0 2024-09-19T06:40:30.674 INFO:tasks.workunit.client.0.smithi099.stdout:0/146: dread - d0/f2a zero size 2024-09-19T06:40:30.675 INFO:tasks.workunit.client.0.smithi099.stdout:2/76: mkdir d1/d2/d5/d8/d18 0 2024-09-19T06:40:30.675 INFO:tasks.workunit.client.0.smithi099.stdout:2/77: chown d1/d2/f12 3142568 1 2024-09-19T06:40:30.677 INFO:tasks.workunit.client.1.smithi117.stdout:8/260: mkdir d1d/d1e/d53 0 2024-09-19T06:40:30.678 INFO:tasks.workunit.client.0.smithi099.stdout:1/157: rename d0/db/dd/f18 to d0/d12/f30 0 2024-09-19T06:40:30.678 INFO:tasks.workunit.client.1.smithi117.stdout:6/218: fdatasync d1/d3/f20 0 2024-09-19T06:40:30.679 INFO:tasks.workunit.client.0.smithi099.stdout:3/230: unlink d7/d34/d1d/d20/f2d 0 2024-09-19T06:40:30.681 INFO:tasks.workunit.client.1.smithi117.stdout:8/261: chown c13 28 1 2024-09-19T06:40:30.681 INFO:tasks.workunit.client.0.smithi099.stdout:9/177: mknod dd/d2c/d27/c2f 0 2024-09-19T06:40:30.681 INFO:tasks.workunit.client.1.smithi117.stdout:3/370: mknod d0/d9/d1c/c6f 0 2024-09-19T06:40:30.682 INFO:tasks.workunit.client.0.smithi099.stdout:8/91: creat d4/de/f1b x:0 0 0 2024-09-19T06:40:30.683 INFO:tasks.workunit.client.0.smithi099.stdout:1/158: dread d0/db/f25 [0,4194304] 0 2024-09-19T06:40:30.683 INFO:tasks.workunit.client.0.smithi099.stdout:0/147: mknod d0/db/d27/c2e 0 2024-09-19T06:40:30.684 INFO:tasks.workunit.client.0.smithi099.stdout:2/78: rmdir d1/d2/d5 39 2024-09-19T06:40:30.687 INFO:tasks.workunit.client.1.smithi117.stdout:8/262: write d1d/d1e/d29/f49 [560393,58416] 0 2024-09-19T06:40:30.687 INFO:tasks.workunit.client.0.smithi099.stdout:7/164: rename d7/l3e to d7/d39/l40 0 2024-09-19T06:40:30.690 INFO:tasks.workunit.client.1.smithi117.stdout:4/406: dread d3/db/f47 [0,4194304] 0 2024-09-19T06:40:30.690 INFO:tasks.workunit.client.1.smithi117.stdout:5/272: dwrite ff [0,4194304] 0 2024-09-19T06:40:30.691 INFO:tasks.workunit.client.0.smithi099.stdout:9/178: creat dd/d2c/f30 x:0 0 0 2024-09-19T06:40:30.691 INFO:tasks.workunit.client.0.smithi099.stdout:3/231: dwrite f6 [0,4194304] 0 2024-09-19T06:40:30.692 INFO:tasks.workunit.client.1.smithi117.stdout:8/263: unlink d1d/d1e/l20 0 2024-09-19T06:40:30.693 INFO:tasks.workunit.client.0.smithi099.stdout:8/92: mkdir d4/de/d1c 0 2024-09-19T06:40:30.693 INFO:tasks.workunit.client.1.smithi117.stdout:5/273: unlink d17/d1b/f38 0 2024-09-19T06:40:30.696 INFO:tasks.workunit.client.0.smithi099.stdout:2/79: dread - d1/d2/d5/d8/f11 zero size 2024-09-19T06:40:30.696 INFO:tasks.workunit.client.0.smithi099.stdout:4/195: rename d12/d32/c41 to d12/d32/d39/c4b 0 2024-09-19T06:40:30.697 INFO:tasks.workunit.client.0.smithi099.stdout:9/179: rmdir dd/d2c/d27 39 2024-09-19T06:40:30.697 INFO:tasks.workunit.client.1.smithi117.stdout:4/407: rename d3/db/d20/d35/d45 to d3/db/d20/d29/d39/d4f/d8b 0 2024-09-19T06:40:30.697 INFO:tasks.workunit.client.1.smithi117.stdout:8/264: dread d1d/d1e/d29/f2d [0,4194304] 0 2024-09-19T06:40:30.699 INFO:tasks.workunit.client.0.smithi099.stdout:9/180: chown dd/f16 2242 1 2024-09-19T06:40:30.701 INFO:tasks.workunit.client.0.smithi099.stdout:0/148: dwrite d0/db/f14 [0,4194304] 0 2024-09-19T06:40:30.701 INFO:tasks.workunit.client.1.smithi117.stdout:8/265: symlink d1d/d1e/d29/l54 0 2024-09-19T06:40:30.702 INFO:tasks.workunit.client.1.smithi117.stdout:8/266: chown d1d/d1e/d29/f43 1 1 2024-09-19T06:40:30.702 INFO:tasks.workunit.client.0.smithi099.stdout:1/159: creat d0/db/f31 x:0 0 0 2024-09-19T06:40:30.703 INFO:tasks.workunit.client.0.smithi099.stdout:9/181: dread - dd/d2c/f2d zero size 2024-09-19T06:40:30.706 INFO:tasks.workunit.client.0.smithi099.stdout:8/93: creat d4/de/d1c/f1d x:0 0 0 2024-09-19T06:40:30.709 INFO:tasks.workunit.client.0.smithi099.stdout:4/196: unlink d12/d1b/l36 0 2024-09-19T06:40:30.709 INFO:tasks.workunit.client.0.smithi099.stdout:3/232: write d7/f12 [2049855,83299] 0 2024-09-19T06:40:30.710 INFO:tasks.workunit.client.0.smithi099.stdout:7/165: dwrite d7/dd/d29/f3c [0,4194304] 0 2024-09-19T06:40:30.712 INFO:tasks.workunit.client.0.smithi099.stdout:6/171: rename d1/d5/d24/d25 to d1/d5/d38/d3c 0 2024-09-19T06:40:30.713 INFO:tasks.workunit.client.0.smithi099.stdout:8/94: symlink d4/de/d14/l1e 0 2024-09-19T06:40:30.713 INFO:tasks.workunit.client.1.smithi117.stdout:8/267: link d1d/d1e/l23 d1d/l55 0 2024-09-19T06:40:30.713 INFO:tasks.workunit.client.1.smithi117.stdout:3/371: dread d0/d9/d1c/f1d [0,4194304] 0 2024-09-19T06:40:30.714 INFO:tasks.workunit.client.0.smithi099.stdout:0/149: mkdir d0/db/d2f 0 2024-09-19T06:40:30.714 INFO:tasks.workunit.client.1.smithi117.stdout:9/301: fsync d4/d8/fb 0 2024-09-19T06:40:30.715 INFO:tasks.workunit.client.0.smithi099.stdout:0/150: stat d0/f3 0 2024-09-19T06:40:30.715 INFO:tasks.workunit.client.0.smithi099.stdout:3/233: write d7/d23/f2a [961298,83115] 0 2024-09-19T06:40:30.716 INFO:tasks.workunit.client.1.smithi117.stdout:3/372: mkdir d0/d19/d70 0 2024-09-19T06:40:30.718 INFO:tasks.workunit.client.1.smithi117.stdout:8/268: symlink d1d/d2a/d3f/d4c/l56 0 2024-09-19T06:40:30.720 INFO:tasks.workunit.client.0.smithi099.stdout:9/182: creat dd/d10/f31 x:0 0 0 2024-09-19T06:40:30.721 INFO:tasks.workunit.client.0.smithi099.stdout:4/197: creat d12/d32/f4c x:0 0 0 2024-09-19T06:40:30.723 INFO:tasks.workunit.client.1.smithi117.stdout:9/302: rename d4/d8/d55 to d4/d1c/d5f 0 2024-09-19T06:40:30.726 INFO:tasks.workunit.client.1.smithi117.stdout:9/303: write d4/d20/f50 [487163,38914] 0 2024-09-19T06:40:30.729 INFO:tasks.workunit.client.1.smithi117.stdout:9/304: chown d4/d20/f45 1 1 2024-09-19T06:40:30.732 INFO:tasks.workunit.client.1.smithi117.stdout:9/305: mknod d4/d1c/d36/c60 0 2024-09-19T06:40:30.733 INFO:tasks.workunit.client.1.smithi117.stdout:8/269: dwrite d1d/d31/f36 [0,4194304] 0 2024-09-19T06:40:30.734 INFO:tasks.workunit.client.1.smithi117.stdout:2/288: dwrite d0/d12/d2f/f40 [0,4194304] 0 2024-09-19T06:40:30.735 INFO:tasks.workunit.client.1.smithi117.stdout:2/289: chown d0/d12/d2f/f60 57330 1 2024-09-19T06:40:30.737 INFO:tasks.workunit.client.1.smithi117.stdout:2/290: truncate d0/d12/d2f/f60 314726 0 2024-09-19T06:40:30.741 INFO:tasks.workunit.client.1.smithi117.stdout:9/306: creat d4/d17/f61 x:0 0 0 2024-09-19T06:40:30.741 INFO:tasks.workunit.client.1.smithi117.stdout:4/408: dread d3/d4/f2f [0,4194304] 0 2024-09-19T06:40:30.742 INFO:tasks.workunit.client.1.smithi117.stdout:8/270: fsync d1d/d2a/f45 0 2024-09-19T06:40:30.742 INFO:tasks.workunit.client.0.smithi099.stdout:7/166: truncate d7/dd/d29/f2f 531883 0 2024-09-19T06:40:30.744 INFO:tasks.workunit.client.1.smithi117.stdout:2/291: mknod d0/d7/d58/c6e 0 2024-09-19T06:40:30.744 INFO:tasks.workunit.client.1.smithi117.stdout:5/274: dread f1 [0,4194304] 0 2024-09-19T06:40:30.745 INFO:tasks.workunit.client.0.smithi099.stdout:5/308: write d3/d7/f11 [1029924,97264] 0 2024-09-19T06:40:30.747 INFO:tasks.workunit.client.1.smithi117.stdout:5/275: write d17/f22 [987296,123447] 0 2024-09-19T06:40:30.747 INFO:tasks.workunit.client.1.smithi117.stdout:2/292: chown d0/d12/d2f/f60 105781 1 2024-09-19T06:40:30.748 INFO:tasks.workunit.client.0.smithi099.stdout:0/151: dread d0/f11 [4194304,4194304] 0 2024-09-19T06:40:30.749 INFO:tasks.workunit.client.1.smithi117.stdout:8/271: symlink d1d/d2a/d3f/d4c/l57 0 2024-09-19T06:40:30.750 INFO:tasks.workunit.client.0.smithi099.stdout:9/183: chown dd/d2c/f21 1 1 2024-09-19T06:40:30.752 INFO:tasks.workunit.client.0.smithi099.stdout:4/198: symlink d12/d1b/d1c/l4d 0 2024-09-19T06:40:30.752 INFO:tasks.workunit.client.0.smithi099.stdout:1/160: dwrite d0/f29 [0,4194304] 0 2024-09-19T06:40:30.754 INFO:tasks.workunit.client.1.smithi117.stdout:2/293: rmdir d0/d7/d58 39 2024-09-19T06:40:30.758 INFO:tasks.workunit.client.1.smithi117.stdout:3/373: dread d0/d8/f10 [4194304,4194304] 0 2024-09-19T06:40:30.760 INFO:tasks.workunit.client.0.smithi099.stdout:9/184: rename dd/d2c/l1d to dd/l32 0 2024-09-19T06:40:30.761 INFO:tasks.workunit.client.0.smithi099.stdout:2/80: fsync d1/d2/d5/d8/fa 0 2024-09-19T06:40:30.762 INFO:tasks.workunit.client.1.smithi117.stdout:2/294: mkdir d0/d6f 0 2024-09-19T06:40:30.762 INFO:tasks.workunit.client.0.smithi099.stdout:6/172: dwrite d1/d5/f3a [0,4194304] 0 2024-09-19T06:40:30.763 INFO:tasks.workunit.client.0.smithi099.stdout:1/161: write d0/d12/d13/f1b [558597,5672] 0 2024-09-19T06:40:30.763 INFO:tasks.workunit.client.1.smithi117.stdout:3/374: mknod d0/d3d/c71 0 2024-09-19T06:40:30.765 INFO:tasks.workunit.client.0.smithi099.stdout:3/234: dwrite d7/f12 [0,4194304] 0 2024-09-19T06:40:30.765 INFO:tasks.workunit.client.1.smithi117.stdout:8/272: creat d1d/d1e/f58 x:0 0 0 2024-09-19T06:40:30.766 INFO:tasks.workunit.client.1.smithi117.stdout:8/273: fsync d1d/d1e/d29/f51 0 2024-09-19T06:40:30.767 INFO:tasks.workunit.client.0.smithi099.stdout:6/173: dread - d1/f19 zero size 2024-09-19T06:40:30.767 INFO:tasks.workunit.client.1.smithi117.stdout:8/274: chown d1d/d1e/d29/l33 4362263 1 2024-09-19T06:40:30.767 INFO:tasks.workunit.client.1.smithi117.stdout:9/307: truncate d4/d1c/d36/f4f 662723 0 2024-09-19T06:40:30.768 INFO:tasks.workunit.client.1.smithi117.stdout:9/308: chown d4/d1c/d54 1003 1 2024-09-19T06:40:30.771 INFO:tasks.workunit.client.1.smithi117.stdout:9/309: dread d4/d1c/d36/f4f [0,4194304] 0 2024-09-19T06:40:30.773 INFO:tasks.workunit.client.0.smithi099.stdout:5/309: link d3/d2a/f5f d3/d16/d2f/d34/d3c/d65/f6c 0 2024-09-19T06:40:30.773 INFO:tasks.workunit.client.0.smithi099.stdout:0/152: creat d0/db/d2f/f30 x:0 0 0 2024-09-19T06:40:30.774 INFO:tasks.workunit.client.0.smithi099.stdout:7/167: dwrite d7/dd/d29/d34/f35 [0,4194304] 0 2024-09-19T06:40:30.774 INFO:tasks.workunit.client.0.smithi099.stdout:6/174: unlink d1/d5/f14 0 2024-09-19T06:40:30.775 INFO:tasks.workunit.client.0.smithi099.stdout:2/81: mknod d1/d2/c19 0 2024-09-19T06:40:30.776 INFO:tasks.workunit.client.1.smithi117.stdout:5/276: write f1 [2425295,79799] 0 2024-09-19T06:40:30.776 INFO:tasks.workunit.client.1.smithi117.stdout:3/375: link d0/d9/d49/l2e d0/d3d/l72 0 2024-09-19T06:40:30.778 INFO:tasks.workunit.client.0.smithi099.stdout:1/162: truncate d0/db/dd/f2c 296904 0 2024-09-19T06:40:30.779 INFO:tasks.workunit.client.1.smithi117.stdout:8/275: creat d1d/d2a/d3f/d4b/f59 x:0 0 0 2024-09-19T06:40:30.779 INFO:tasks.workunit.client.1.smithi117.stdout:9/310: creat d4/df/d52/f62 x:0 0 0 2024-09-19T06:40:30.780 INFO:tasks.workunit.client.0.smithi099.stdout:1/163: read - d0/db/f23 zero size 2024-09-19T06:40:30.781 INFO:tasks.workunit.client.0.smithi099.stdout:5/310: chown d3/d7/f3b 1643 1 2024-09-19T06:40:30.781 INFO:tasks.workunit.client.0.smithi099.stdout:3/235: dread d7/d23/f33 [0,4194304] 0 2024-09-19T06:40:30.781 INFO:tasks.workunit.client.0.smithi099.stdout:4/199: getdents d12 0 2024-09-19T06:40:30.781 INFO:tasks.workunit.client.1.smithi117.stdout:3/376: creat d0/d8/f73 x:0 0 0 2024-09-19T06:40:30.782 INFO:tasks.workunit.client.1.smithi117.stdout:4/409: dwrite d3/db/d20/d29/d39/d4f/d8b/f5d [0,4194304] 0 2024-09-19T06:40:30.784 INFO:tasks.workunit.client.1.smithi117.stdout:5/277: mkdir d17/d5c 0 2024-09-19T06:40:30.785 INFO:tasks.workunit.client.1.smithi117.stdout:8/276: mknod d1d/d2a/d3f/d4b/c5a 0 2024-09-19T06:40:30.786 INFO:tasks.workunit.client.0.smithi099.stdout:7/168: truncate d7/f8 4637225 0 2024-09-19T06:40:30.787 INFO:tasks.workunit.client.1.smithi117.stdout:5/278: dread d17/d2f/d3b/f44 [0,4194304] 0 2024-09-19T06:40:30.791 INFO:tasks.workunit.client.1.smithi117.stdout:9/311: getdents d4/df 0 2024-09-19T06:40:30.791 INFO:tasks.workunit.client.0.smithi099.stdout:2/82: link d1/f15 d1/d2/d5/d8/f1a 0 2024-09-19T06:40:30.792 INFO:tasks.workunit.client.1.smithi117.stdout:2/295: dwrite d0/d7/f2d [0,4194304] 0 2024-09-19T06:40:30.793 INFO:tasks.workunit.client.1.smithi117.stdout:8/277: rename d1d/d1e/d29/f2d to d1d/d2a/d3f/d4b/f5b 0 2024-09-19T06:40:30.794 INFO:tasks.workunit.client.0.smithi099.stdout:1/164: mkdir d0/d17/d32 0 2024-09-19T06:40:30.794 INFO:tasks.workunit.client.0.smithi099.stdout:9/185: read dd/f19 [993697,18287] 0 2024-09-19T06:40:30.795 INFO:tasks.workunit.client.1.smithi117.stdout:9/312: mknod d4/d5d/c63 0 2024-09-19T06:40:30.797 INFO:tasks.workunit.client.0.smithi099.stdout:6/175: dwrite d1/f19 [0,4194304] 0 2024-09-19T06:40:30.799 INFO:tasks.workunit.client.0.smithi099.stdout:0/153: link d0/l8 d0/d17/l31 0 2024-09-19T06:40:30.799 INFO:tasks.workunit.client.0.smithi099.stdout:5/311: dwrite d3/d2a/f2e [0,4194304] 0 2024-09-19T06:40:30.800 INFO:tasks.workunit.client.0.smithi099.stdout:4/200: rename d12/d1b/c21 to d12/d1b/c4e 0 2024-09-19T06:40:30.800 INFO:tasks.workunit.client.1.smithi117.stdout:9/313: creat d4/df/f64 x:0 0 0 2024-09-19T06:40:30.802 INFO:tasks.workunit.client.0.smithi099.stdout:0/154: dread - d0/db/d13/d1f/f2b zero size 2024-09-19T06:40:30.802 INFO:tasks.workunit.client.0.smithi099.stdout:9/186: fdatasync dd/f19 0 2024-09-19T06:40:30.802 INFO:tasks.workunit.client.1.smithi117.stdout:2/296: symlink d0/d7/d58/l70 0 2024-09-19T06:40:30.803 INFO:tasks.workunit.client.0.smithi099.stdout:7/169: creat d7/f41 x:0 0 0 2024-09-19T06:40:30.804 INFO:tasks.workunit.client.1.smithi117.stdout:4/410: write d3/d4/d14/f6a [3028832,22884] 0 2024-09-19T06:40:30.804 INFO:tasks.workunit.client.0.smithi099.stdout:4/201: dread - d12/d32/f3e zero size 2024-09-19T06:40:30.805 INFO:tasks.workunit.client.1.smithi117.stdout:9/314: dread - d4/df/d52/f3e zero size 2024-09-19T06:40:30.806 INFO:tasks.workunit.client.0.smithi099.stdout:1/165: creat d0/d12/d13/f33 x:0 0 0 2024-09-19T06:40:30.806 INFO:tasks.workunit.client.1.smithi117.stdout:5/279: dwrite d17/d1b/d3a/d3c/d46/f4f [0,4194304] 0 2024-09-19T06:40:30.807 INFO:tasks.workunit.client.0.smithi099.stdout:2/83: creat d1/d2/d5/d13/f1b x:0 0 0 2024-09-19T06:40:30.808 INFO:tasks.workunit.client.1.smithi117.stdout:8/278: creat d1d/d1e/f5c x:0 0 0 2024-09-19T06:40:30.808 INFO:tasks.workunit.client.0.smithi099.stdout:3/236: getdents d7/d34/d1d 0 2024-09-19T06:40:30.808 INFO:tasks.workunit.client.0.smithi099.stdout:5/312: creat d3/d16/d2f/d34/d3c/f6d x:0 0 0 2024-09-19T06:40:30.808 INFO:tasks.workunit.client.0.smithi099.stdout:9/187: rmdir dd 39 2024-09-19T06:40:30.809 INFO:tasks.workunit.client.1.smithi117.stdout:9/315: mknod d4/d8/c65 0 2024-09-19T06:40:30.810 INFO:tasks.workunit.client.0.smithi099.stdout:3/237: chown d7/d23/c2c 728919 1 2024-09-19T06:40:30.812 INFO:tasks.workunit.client.0.smithi099.stdout:6/176: symlink d1/l3d 0 2024-09-19T06:40:30.813 INFO:tasks.workunit.client.0.smithi099.stdout:4/202: dread - d12/d32/f2e zero size 2024-09-19T06:40:30.813 INFO:tasks.workunit.client.1.smithi117.stdout:8/279: symlink d1d/d1e/d29/l5d 0 2024-09-19T06:40:30.816 INFO:tasks.workunit.client.1.smithi117.stdout:5/280: mkdir d17/d1b/d5d 0 2024-09-19T06:40:30.818 INFO:tasks.workunit.client.1.smithi117.stdout:9/316: write d4/d1c/d46/f49 [517796,44663] 0 2024-09-19T06:40:30.818 INFO:tasks.workunit.client.1.smithi117.stdout:8/280: symlink d1d/d2a/d3f/d4b/l5e 0 2024-09-19T06:40:30.819 INFO:tasks.workunit.client.0.smithi099.stdout:0/155: dwrite d0/d17/f1c [0,4194304] 0 2024-09-19T06:40:30.819 INFO:tasks.workunit.client.1.smithi117.stdout:4/411: dwrite d3/db/d13/f3c [0,4194304] 0 2024-09-19T06:40:30.821 INFO:tasks.workunit.client.0.smithi099.stdout:3/238: read d7/d23/f2a [592392,21232] 0 2024-09-19T06:40:30.822 INFO:tasks.workunit.client.1.smithi117.stdout:3/377: dread d0/f14 [0,4194304] 0 2024-09-19T06:40:30.823 INFO:tasks.workunit.client.0.smithi099.stdout:4/203: write d12/d32/f3e [89268,126889] 0 2024-09-19T06:40:30.823 INFO:tasks.workunit.client.0.smithi099.stdout:2/84: mknod d1/d2/d5/d8/d9/c1c 0 2024-09-19T06:40:30.824 INFO:tasks.workunit.client.1.smithi117.stdout:5/281: mknod d17/d1b/d3a/d3c/c5e 0 2024-09-19T06:40:30.826 INFO:tasks.workunit.client.0.smithi099.stdout:7/170: rename d7/dd/c3b to d7/d39/c42 0 2024-09-19T06:40:30.826 INFO:tasks.workunit.client.0.smithi099.stdout:3/239: dread - d7/d34/d1d/f21 zero size 2024-09-19T06:40:30.826 INFO:tasks.workunit.client.0.smithi099.stdout:5/313: creat d3/d16/f6e x:0 0 0 2024-09-19T06:40:30.826 INFO:tasks.workunit.client.1.smithi117.stdout:0/245: sync 2024-09-19T06:40:30.827 INFO:tasks.workunit.client.1.smithi117.stdout:1/283: sync 2024-09-19T06:40:30.827 INFO:tasks.workunit.client.1.smithi117.stdout:8/281: mkdir d1d/d2a/d3f/d4b/d5f 0 2024-09-19T06:40:30.827 INFO:tasks.workunit.client.0.smithi099.stdout:3/240: fdatasync d7/d34/f1b 0 2024-09-19T06:40:30.829 INFO:tasks.workunit.client.0.smithi099.stdout:5/314: stat d3/d16/f6e 0 2024-09-19T06:40:30.829 INFO:tasks.workunit.client.0.smithi099.stdout:6/177: symlink d1/d5/d38/d3c/d2a/l3e 0 2024-09-19T06:40:30.829 INFO:tasks.workunit.client.0.smithi099.stdout:1/166: mknod d0/db/c34 0 2024-09-19T06:40:30.832 INFO:tasks.workunit.client.1.smithi117.stdout:5/282: creat d17/d2e/f5f x:0 0 0 2024-09-19T06:40:30.833 INFO:tasks.workunit.client.0.smithi099.stdout:2/85: creat d1/d2/d5/d8/d9/f1d x:0 0 0 2024-09-19T06:40:30.833 INFO:tasks.workunit.client.0.smithi099.stdout:7/171: read d7/dd/d29/d1f/f21 [420716,108023] 0 2024-09-19T06:40:30.835 INFO:tasks.workunit.client.0.smithi099.stdout:6/178: stat d1/c1b 0 2024-09-19T06:40:30.835 INFO:tasks.workunit.client.0.smithi099.stdout:7/172: chown d7/dd 9627 1 2024-09-19T06:40:30.835 INFO:tasks.workunit.client.1.smithi117.stdout:5/283: dread - d17/d2e/d55/f5a zero size 2024-09-19T06:40:30.835 INFO:tasks.workunit.client.1.smithi117.stdout:5/284: fsync d17/f41 0 2024-09-19T06:40:30.836 INFO:tasks.workunit.client.1.smithi117.stdout:1/284: creat d3/d22/f5f x:0 0 0 2024-09-19T06:40:30.836 INFO:tasks.workunit.client.1.smithi117.stdout:4/412: read d3/db/f3a [3911417,97095] 0 2024-09-19T06:40:30.836 INFO:tasks.workunit.client.1.smithi117.stdout:1/285: chown d3/d22/f33 2754250 1 2024-09-19T06:40:30.841 INFO:tasks.workunit.client.1.smithi117.stdout:0/246: getdents d11/d13/d14/d2c/d35 0 2024-09-19T06:40:30.842 INFO:tasks.workunit.client.1.smithi117.stdout:1/286: write d3/d18/d23/f52 [245097,126369] 0 2024-09-19T06:40:30.842 INFO:tasks.workunit.client.1.smithi117.stdout:1/287: write d3/d18/d23/f5d [1486202,111326] 0 2024-09-19T06:40:30.843 INFO:tasks.workunit.client.0.smithi099.stdout:3/241: write d7/d23/f2a [62766,76652] 0 2024-09-19T06:40:30.843 INFO:tasks.workunit.client.0.smithi099.stdout:3/242: stat d7/d23/f33 0 2024-09-19T06:40:30.843 INFO:tasks.workunit.client.0.smithi099.stdout:6/179: dread - d1/d5/d24/d2e/f31 zero size 2024-09-19T06:40:30.843 INFO:tasks.workunit.client.0.smithi099.stdout:9/188: creat dd/d2c/d27/f33 x:0 0 0 2024-09-19T06:40:30.843 INFO:tasks.workunit.client.0.smithi099.stdout:7/173: chown d7/c24 1 1 2024-09-19T06:40:30.843 INFO:tasks.workunit.client.0.smithi099.stdout:4/204: creat d12/d1b/f4f x:0 0 0 2024-09-19T06:40:30.843 INFO:tasks.workunit.client.0.smithi099.stdout:2/86: truncate d1/d2/d5/d8/f11 521827 0 2024-09-19T06:40:30.843 INFO:tasks.workunit.client.0.smithi099.stdout:9/189: chown fa 5 1 2024-09-19T06:40:30.844 INFO:tasks.workunit.client.0.smithi099.stdout:0/156: getdents d0/db/d27 0 2024-09-19T06:40:30.844 INFO:tasks.workunit.client.0.smithi099.stdout:6/180: mkdir d1/d5/d24/d2b/d3f 0 2024-09-19T06:40:30.845 INFO:tasks.workunit.client.0.smithi099.stdout:4/205: creat d12/f50 x:0 0 0 2024-09-19T06:40:30.845 INFO:tasks.workunit.client.0.smithi099.stdout:0/157: dread - d0/db/d13/f1e zero size 2024-09-19T06:40:30.845 INFO:tasks.workunit.client.1.smithi117.stdout:5/285: rename d17/d1b/c29 to d17/d2e/d55/c60 0 2024-09-19T06:40:30.846 INFO:tasks.workunit.client.1.smithi117.stdout:8/282: link l7 d1d/d2a/d3f/d4b/d5f/l60 0 2024-09-19T06:40:30.846 INFO:tasks.workunit.client.1.smithi117.stdout:1/288: creat d3/d22/d2f/f60 x:0 0 0 2024-09-19T06:40:30.846 INFO:tasks.workunit.client.0.smithi099.stdout:0/158: chown d0/db/d13/d29 87042806 1 2024-09-19T06:40:30.847 INFO:tasks.workunit.client.1.smithi117.stdout:5/286: creat d17/d1b/d3a/d3c/d46/f61 x:0 0 0 2024-09-19T06:40:30.848 INFO:tasks.workunit.client.1.smithi117.stdout:0/247: dwrite d11/d13/d14/d16/f3a [0,4194304] 0 2024-09-19T06:40:30.848 INFO:tasks.workunit.client.0.smithi099.stdout:0/159: dread - d0/db/d13/d29/f2d zero size 2024-09-19T06:40:30.848 INFO:tasks.workunit.client.0.smithi099.stdout:1/167: link d0/l20 d0/l35 0 2024-09-19T06:40:30.849 INFO:tasks.workunit.client.0.smithi099.stdout:7/174: dread d7/dd/d29/d34/f35 [0,4194304] 0 2024-09-19T06:40:30.850 INFO:tasks.workunit.client.1.smithi117.stdout:5/287: write d17/d1b/d3a/d3c/d46/f61 [232562,118839] 0 2024-09-19T06:40:30.850 INFO:tasks.workunit.client.0.smithi099.stdout:6/181: fdatasync d1/fe 0 2024-09-19T06:40:30.851 INFO:tasks.workunit.client.1.smithi117.stdout:0/248: rmdir d11/d13 39 2024-09-19T06:40:30.852 INFO:tasks.workunit.client.0.smithi099.stdout:0/160: unlink d0/d17/f1c 0 2024-09-19T06:40:30.852 INFO:tasks.workunit.client.0.smithi099.stdout:6/182: fsync d1/fe 0 2024-09-19T06:40:30.853 INFO:tasks.workunit.client.0.smithi099.stdout:7/175: read d7/dd/d29/d1f/f2a [767550,49543] 0 2024-09-19T06:40:30.853 INFO:tasks.workunit.client.0.smithi099.stdout:1/168: fsync d0/db/f25 0 2024-09-19T06:40:30.854 INFO:tasks.workunit.client.1.smithi117.stdout:5/288: readlink d17/d2f/d3b/l4c 0 2024-09-19T06:40:30.854 INFO:tasks.workunit.client.0.smithi099.stdout:9/190: creat dd/f34 x:0 0 0 2024-09-19T06:40:30.856 INFO:tasks.workunit.client.1.smithi117.stdout:0/249: mkdir d11/d13/d1b/d4b 0 2024-09-19T06:40:30.857 INFO:tasks.workunit.client.0.smithi099.stdout:3/243: dread d7/f1a [0,4194304] 0 2024-09-19T06:40:30.858 INFO:tasks.workunit.client.1.smithi117.stdout:1/289: fsync d3/d18/d23/f5d 0 2024-09-19T06:40:30.859 INFO:tasks.workunit.client.0.smithi099.stdout:0/161: mkdir d0/db/d13/d1f/d32 0 2024-09-19T06:40:30.861 INFO:tasks.workunit.client.1.smithi117.stdout:1/290: symlink d3/d22/d2f/l61 0 2024-09-19T06:40:30.862 INFO:tasks.workunit.client.0.smithi099.stdout:1/169: unlink d0/f9 0 2024-09-19T06:40:30.862 INFO:tasks.workunit.client.0.smithi099.stdout:3/244: mknod d7/d34/c35 0 2024-09-19T06:40:30.864 INFO:tasks.workunit.client.0.smithi099.stdout:9/191: mknod dd/c35 0 2024-09-19T06:40:30.869 INFO:tasks.workunit.client.0.smithi099.stdout:9/192: fdatasync dd/f22 0 2024-09-19T06:40:30.871 INFO:tasks.workunit.client.0.smithi099.stdout:1/170: mknod d0/d12/c36 0 2024-09-19T06:40:30.872 INFO:tasks.workunit.client.0.smithi099.stdout:0/162: dwrite d0/db/d13/d1f/f28 [0,4194304] 0 2024-09-19T06:40:30.872 INFO:tasks.workunit.client.0.smithi099.stdout:5/315: dread d3/d7/f1c [0,4194304] 0 2024-09-19T06:40:30.875 INFO:tasks.workunit.client.1.smithi117.stdout:4/413: dread d3/d4/d14/f6a [0,4194304] 0 2024-09-19T06:40:30.875 INFO:tasks.workunit.client.1.smithi117.stdout:3/378: dwrite d0/f1e [0,4194304] 0 2024-09-19T06:40:30.878 INFO:tasks.workunit.client.0.smithi099.stdout:3/245: dwrite d7/f12 [0,4194304] 0 2024-09-19T06:40:30.879 INFO:tasks.workunit.client.0.smithi099.stdout:1/171: read - d0/f21 zero size 2024-09-19T06:40:30.879 INFO:tasks.workunit.client.0.smithi099.stdout:5/316: write d3/d7/fb [5484092,21081] 0 2024-09-19T06:40:30.880 INFO:tasks.workunit.client.0.smithi099.stdout:6/183: rmdir d1/d5 39 2024-09-19T06:40:30.881 INFO:tasks.workunit.client.1.smithi117.stdout:4/414: creat d3/d1b/d63/f8c x:0 0 0 2024-09-19T06:40:30.884 INFO:tasks.workunit.client.1.smithi117.stdout:3/379: rename d0/d3d/l59 to d0/d8/l74 0 2024-09-19T06:40:30.885 INFO:tasks.workunit.client.0.smithi099.stdout:9/193: dwrite dd/d2c/f1a [4194304,4194304] 0 2024-09-19T06:40:30.885 INFO:tasks.workunit.client.0.smithi099.stdout:2/87: write d1/d2/d5/d8/d9/ff [453591,5387] 0 2024-09-19T06:40:30.886 INFO:tasks.workunit.client.1.smithi117.stdout:1/291: dwrite d3/f4c [0,4194304] 0 2024-09-19T06:40:30.887 INFO:tasks.workunit.client.0.smithi099.stdout:6/184: dread - d1/d5/d24/d2e/f32 zero size 2024-09-19T06:40:30.887 INFO:tasks.workunit.client.0.smithi099.stdout:2/88: stat d1/d2/d5/d6 0 2024-09-19T06:40:30.888 INFO:tasks.workunit.client.1.smithi117.stdout:4/415: dread - d3/d4/d5f/f7f zero size 2024-09-19T06:40:30.888 INFO:tasks.workunit.client.0.smithi099.stdout:6/185: dread - d1/d5/d24/d2e/f32 zero size 2024-09-19T06:40:30.889 INFO:tasks.workunit.client.1.smithi117.stdout:0/250: dread d11/f19 [0,4194304] 0 2024-09-19T06:40:30.889 INFO:tasks.workunit.client.1.smithi117.stdout:8/283: dread d1d/f40 [0,4194304] 0 2024-09-19T06:40:30.893 INFO:tasks.workunit.client.0.smithi099.stdout:5/317: creat d3/d16/d2f/d34/f6f x:0 0 0 2024-09-19T06:40:30.893 INFO:tasks.workunit.client.1.smithi117.stdout:5/289: dwrite d17/f26 [4194304,4194304] 0 2024-09-19T06:40:30.894 INFO:tasks.workunit.client.1.smithi117.stdout:3/380: stat d0/d3d/f4f 0 2024-09-19T06:40:30.894 INFO:tasks.workunit.client.0.smithi099.stdout:6/186: dread d1/f19 [0,4194304] 0 2024-09-19T06:40:30.894 INFO:tasks.workunit.client.0.smithi099.stdout:5/318: readlink d3/l1b 0 2024-09-19T06:40:30.894 INFO:tasks.workunit.client.0.smithi099.stdout:8/95: sync 2024-09-19T06:40:30.895 INFO:tasks.workunit.client.0.smithi099.stdout:8/96: chown d4/de/d14/c19 25 1 2024-09-19T06:40:30.897 INFO:tasks.workunit.client.0.smithi099.stdout:3/246: rename d7/d23 to d7/d34/d1d/d36 0 2024-09-19T06:40:30.897 INFO:tasks.workunit.client.1.smithi117.stdout:5/290: write d17/d1b/d3a/d3c/f57 [919067,10441] 0 2024-09-19T06:40:30.897 INFO:tasks.workunit.client.0.smithi099.stdout:8/97: dread - d4/f17 zero size 2024-09-19T06:40:30.898 INFO:tasks.workunit.client.1.smithi117.stdout:3/381: rmdir d0/d9 39 2024-09-19T06:40:30.899 INFO:tasks.workunit.client.0.smithi099.stdout:3/247: write f6 [1406121,64606] 0 2024-09-19T06:40:30.899 INFO:tasks.workunit.client.1.smithi117.stdout:0/251: write fd [4663576,31972] 0 2024-09-19T06:40:30.901 INFO:tasks.workunit.client.0.smithi099.stdout:8/98: write d4/de/d1c/f1d [205097,25613] 0 2024-09-19T06:40:30.901 INFO:tasks.workunit.client.1.smithi117.stdout:4/416: creat d3/db/f8d x:0 0 0 2024-09-19T06:40:30.902 INFO:tasks.workunit.client.0.smithi099.stdout:0/163: rmdir d0/db/d13/d1f/d32 0 2024-09-19T06:40:30.902 INFO:tasks.workunit.client.1.smithi117.stdout:0/252: chown d11/d13/d1b/d4b 67 1 2024-09-19T06:40:30.902 INFO:tasks.workunit.client.1.smithi117.stdout:8/284: rename d1d/f3a to d1d/f61 0 2024-09-19T06:40:30.903 INFO:tasks.workunit.client.1.smithi117.stdout:3/382: chown d0/d8/d64/f6a 11 1 2024-09-19T06:40:30.906 INFO:tasks.workunit.client.1.smithi117.stdout:1/292: link d3/d22/d2f/f3d d3/d22/d2f/f62 0 2024-09-19T06:40:30.907 INFO:tasks.workunit.client.1.smithi117.stdout:8/285: chown d1d/d1e/l23 199713 1 2024-09-19T06:40:30.907 INFO:tasks.workunit.client.0.smithi099.stdout:9/194: unlink dd/d2c/f2d 0 2024-09-19T06:40:30.908 INFO:tasks.workunit.client.1.smithi117.stdout:4/417: mkdir d3/d1b/d63/d8e 0 2024-09-19T06:40:30.908 INFO:tasks.workunit.client.1.smithi117.stdout:0/253: mknod d11/d13/c4c 0 2024-09-19T06:40:30.910 INFO:tasks.workunit.client.0.smithi099.stdout:6/187: mknod d1/d5/d38/c40 0 2024-09-19T06:40:30.911 INFO:tasks.workunit.client.1.smithi117.stdout:3/383: getdents d0/d3d/d68/d40 0 2024-09-19T06:40:30.913 INFO:tasks.workunit.client.0.smithi099.stdout:7/176: dwrite d7/dd/d29/d1f/f21 [0,4194304] 0 2024-09-19T06:40:30.914 INFO:tasks.workunit.client.0.smithi099.stdout:4/206: mkdir d12/d1b/d1c/d51 0 2024-09-19T06:40:30.914 INFO:tasks.workunit.client.0.smithi099.stdout:0/164: dwrite d0/f2a [0,4194304] 0 2024-09-19T06:40:30.916 INFO:tasks.workunit.client.1.smithi117.stdout:1/293: dwrite d3/f5c [0,4194304] 0 2024-09-19T06:40:30.917 INFO:tasks.workunit.client.1.smithi117.stdout:0/254: rename f3 to d11/d13/d14/f4d 0 2024-09-19T06:40:30.917 INFO:tasks.workunit.client.0.smithi099.stdout:0/165: fdatasync d0/f1b 0 2024-09-19T06:40:30.918 INFO:tasks.workunit.client.0.smithi099.stdout:4/207: chown d12/d1b/d1c/c1e 476092 1 2024-09-19T06:40:30.918 INFO:tasks.workunit.client.0.smithi099.stdout:8/99: read d4/de/ff [171350,21617] 0 2024-09-19T06:40:30.919 INFO:tasks.workunit.client.1.smithi117.stdout:1/294: write d3/f9 [5867415,76535] 0 2024-09-19T06:40:30.920 INFO:tasks.workunit.client.1.smithi117.stdout:3/384: read d0/f1e [4958972,109599] 0 2024-09-19T06:40:30.925 INFO:tasks.workunit.client.0.smithi099.stdout:6/188: rmdir d1/d5/d38/d3c 39 2024-09-19T06:40:30.925 INFO:tasks.workunit.client.0.smithi099.stdout:5/319: mknod d3/d16/d2f/d34/d3c/d65/c70 0 2024-09-19T06:40:30.926 INFO:tasks.workunit.client.0.smithi099.stdout:7/177: symlink d7/dd/d29/d1f/l43 0 2024-09-19T06:40:30.929 INFO:tasks.workunit.client.1.smithi117.stdout:1/295: fsync d3/f10 0 2024-09-19T06:40:30.929 INFO:tasks.workunit.client.1.smithi117.stdout:0/255: dwrite d11/d13/d14/d2c/f2f [0,4194304] 0 2024-09-19T06:40:30.929 INFO:tasks.workunit.client.0.smithi099.stdout:3/248: link d7/d34/d1d/d36/l2f d7/d34/d1d/l37 0 2024-09-19T06:40:30.931 INFO:tasks.workunit.client.1.smithi117.stdout:1/296: dread - d3/d18/d56/f47 zero size 2024-09-19T06:40:30.932 INFO:tasks.workunit.client.0.smithi099.stdout:8/100: rename d4/de/ff to d4/d11/f1f 0 2024-09-19T06:40:30.932 INFO:tasks.workunit.client.0.smithi099.stdout:6/189: mkdir d1/d5/d24/d2e/d41 0 2024-09-19T06:40:30.932 INFO:tasks.workunit.client.1.smithi117.stdout:5/291: fsync d17/d1b/d3a/d3c/f57 0 2024-09-19T06:40:30.933 INFO:tasks.workunit.client.0.smithi099.stdout:5/320: dwrite d3/d1f/f51 [0,4194304] 0 2024-09-19T06:40:30.934 INFO:tasks.workunit.client.1.smithi117.stdout:0/256: creat d11/d13/d1b/f4e x:0 0 0 2024-09-19T06:40:30.934 INFO:tasks.workunit.client.0.smithi099.stdout:7/178: chown d7/dd/c14 13277212 1 2024-09-19T06:40:30.935 INFO:tasks.workunit.client.0.smithi099.stdout:5/321: stat d3/cc 0 2024-09-19T06:40:30.936 INFO:tasks.workunit.client.1.smithi117.stdout:5/292: write d17/d1b/d3a/d3c/d46/f4f [2802480,100041] 0 2024-09-19T06:40:30.937 INFO:tasks.workunit.client.0.smithi099.stdout:7/179: write d7/f8 [4770225,27597] 0 2024-09-19T06:40:30.937 INFO:tasks.workunit.client.0.smithi099.stdout:3/249: rename f6 to d7/d34/d1d/d36/f38 0 2024-09-19T06:40:30.939 INFO:tasks.workunit.client.1.smithi117.stdout:5/293: truncate d17/d2e/f5f 668229 0 2024-09-19T06:40:30.940 INFO:tasks.workunit.client.0.smithi099.stdout:7/180: dread - d7/dd/d29/f33 zero size 2024-09-19T06:40:30.941 INFO:tasks.workunit.client.1.smithi117.stdout:1/297: getdents d3/d18/d23 0 2024-09-19T06:40:30.943 INFO:tasks.workunit.client.0.smithi099.stdout:6/190: creat d1/d5/f42 x:0 0 0 2024-09-19T06:40:30.944 INFO:tasks.workunit.client.0.smithi099.stdout:8/101: dwrite d4/f6 [0,4194304] 0 2024-09-19T06:40:30.946 INFO:tasks.workunit.client.0.smithi099.stdout:5/322: creat d3/d7/f71 x:0 0 0 2024-09-19T06:40:30.949 INFO:tasks.workunit.client.0.smithi099.stdout:4/208: link d12/d32/d39/c43 d12/d1b/d1c/c52 0 2024-09-19T06:40:30.951 INFO:tasks.workunit.client.0.smithi099.stdout:7/181: mknod d7/dd/d29/d34/c44 0 2024-09-19T06:40:30.951 INFO:tasks.workunit.client.1.smithi117.stdout:0/257: dwrite d11/d13/d14/d2c/f30 [0,4194304] 0 2024-09-19T06:40:30.953 INFO:tasks.workunit.client.1.smithi117.stdout:1/298: symlink d3/d18/l63 0 2024-09-19T06:40:30.953 INFO:tasks.workunit.client.1.smithi117.stdout:1/299: fdatasync d3/d18/f53 0 2024-09-19T06:40:30.956 INFO:tasks.workunit.client.1.smithi117.stdout:5/294: dread d17/d2e/f33 [0,4194304] 0 2024-09-19T06:40:30.957 INFO:tasks.workunit.client.0.smithi099.stdout:7/182: mkdir d7/dd/d29/d1f/d45 0 2024-09-19T06:40:30.959 INFO:tasks.workunit.client.0.smithi099.stdout:6/191: dwrite d1/f19 [0,4194304] 0 2024-09-19T06:40:30.959 INFO:tasks.workunit.client.1.smithi117.stdout:4/418: dread d3/db/d23/f54 [0,4194304] 0 2024-09-19T06:40:30.960 INFO:tasks.workunit.client.1.smithi117.stdout:0/258: getdents d11/d13/d1b/d27 0 2024-09-19T06:40:30.961 INFO:tasks.workunit.client.0.smithi099.stdout:8/102: creat d4/de/d10/f20 x:0 0 0 2024-09-19T06:40:30.961 INFO:tasks.workunit.client.1.smithi117.stdout:5/295: symlink d17/d1b/d3a/d3c/l62 0 2024-09-19T06:40:30.965 INFO:tasks.workunit.client.1.smithi117.stdout:4/419: rename d3/db/f5c to d3/d28/d2a/f8f 0 2024-09-19T06:40:30.965 INFO:tasks.workunit.client.1.smithi117.stdout:8/286: dread d1d/d1e/d29/f2b [4194304,4194304] 0 2024-09-19T06:40:30.966 INFO:tasks.workunit.client.0.smithi099.stdout:9/195: dread dd/fe [0,4194304] 0 2024-09-19T06:40:30.966 INFO:tasks.workunit.client.1.smithi117.stdout:4/420: chown d3/db/l37 656178 1 2024-09-19T06:40:30.967 INFO:tasks.workunit.client.0.smithi099.stdout:1/172: dread d0/db/f19 [0,4194304] 0 2024-09-19T06:40:30.968 INFO:tasks.workunit.client.1.smithi117.stdout:0/259: link d11/d13/d14/f45 d11/d13/d1b/d4b/f4f 0 2024-09-19T06:40:30.969 INFO:tasks.workunit.client.0.smithi099.stdout:8/103: creat d4/d11/f21 x:0 0 0 2024-09-19T06:40:30.969 INFO:tasks.workunit.client.1.smithi117.stdout:8/287: rename d1d/f26 to d1d/d2a/f62 0 2024-09-19T06:40:30.970 INFO:tasks.workunit.client.0.smithi099.stdout:8/104: stat d4/cc 0 2024-09-19T06:40:30.971 INFO:tasks.workunit.client.1.smithi117.stdout:5/296: dwrite d17/f41 [0,4194304] 0 2024-09-19T06:40:30.973 INFO:tasks.workunit.client.1.smithi117.stdout:0/260: creat d11/d13/d14/d2c/f50 x:0 0 0 2024-09-19T06:40:30.975 INFO:tasks.workunit.client.1.smithi117.stdout:0/261: chown d11/d13/d1b/d27 2 1 2024-09-19T06:40:30.975 INFO:tasks.workunit.client.0.smithi099.stdout:0/166: dwrite d0/f3 [0,4194304] 0 2024-09-19T06:40:30.976 INFO:tasks.workunit.client.1.smithi117.stdout:8/288: fsync d1d/d2a/d3f/d4b/f5b 0 2024-09-19T06:40:30.976 INFO:tasks.workunit.client.0.smithi099.stdout:6/192: mknod d1/c43 0 2024-09-19T06:40:30.977 INFO:tasks.workunit.client.1.smithi117.stdout:8/289: chown l2 5731 1 2024-09-19T06:40:30.979 INFO:tasks.workunit.client.0.smithi099.stdout:4/209: link d12/l17 d12/d32/d39/l53 0 2024-09-19T06:40:30.980 INFO:tasks.workunit.client.1.smithi117.stdout:8/290: fsync f3 0 2024-09-19T06:40:30.984 INFO:tasks.workunit.client.1.smithi117.stdout:4/421: rename d3/db/d13/f1d to d3/f90 0 2024-09-19T06:40:30.985 INFO:tasks.workunit.client.1.smithi117.stdout:4/422: fsync d3/d1b/d7d/f12 0 2024-09-19T06:40:30.985 INFO:tasks.workunit.client.0.smithi099.stdout:8/105: mknod d4/de/d14/c22 0 2024-09-19T06:40:30.985 INFO:tasks.workunit.client.0.smithi099.stdout:8/106: dread - d4/de/d10/f20 zero size 2024-09-19T06:40:30.986 INFO:tasks.workunit.client.1.smithi117.stdout:4/423: dread - d3/d1b/f4d zero size 2024-09-19T06:40:30.986 INFO:tasks.workunit.client.1.smithi117.stdout:0/262: rmdir d11/d13/d14/d2c/d44 0 2024-09-19T06:40:30.986 INFO:tasks.workunit.client.0.smithi099.stdout:0/167: mknod d0/d17/c33 0 2024-09-19T06:40:30.986 INFO:tasks.workunit.client.0.smithi099.stdout:8/107: truncate d4/de/d10/f20 134426 0 2024-09-19T06:40:30.987 INFO:tasks.workunit.client.1.smithi117.stdout:4/424: stat d3/d4/d5f/f7f 0 2024-09-19T06:40:30.987 INFO:tasks.workunit.client.1.smithi117.stdout:5/297: rename d17/c2a to d17/c63 0 2024-09-19T06:40:30.988 INFO:tasks.workunit.client.1.smithi117.stdout:4/425: read d3/db/f47 [311931,124951] 0 2024-09-19T06:40:30.989 INFO:tasks.workunit.client.0.smithi099.stdout:8/108: mkdir d4/d11/d23 0 2024-09-19T06:40:30.989 INFO:tasks.workunit.client.0.smithi099.stdout:8/109: chown d4/de/f16 29 1 2024-09-19T06:40:30.991 INFO:tasks.workunit.client.1.smithi117.stdout:8/291: creat d1d/f63 x:0 0 0 2024-09-19T06:40:30.991 INFO:tasks.workunit.client.0.smithi099.stdout:0/168: mkdir d0/db/d27/d34 0 2024-09-19T06:40:30.991 INFO:tasks.workunit.client.1.smithi117.stdout:8/292: chown d1d/d1e/f2c 60294 1 2024-09-19T06:40:30.992 INFO:tasks.workunit.client.1.smithi117.stdout:0/263: symlink d11/d13/d14/l51 0 2024-09-19T06:40:30.993 INFO:tasks.workunit.client.0.smithi099.stdout:6/193: link d1/c36 d1/d5/d38/c44 0 2024-09-19T06:40:30.994 INFO:tasks.workunit.client.1.smithi117.stdout:4/426: rename d3/d4/d5f/d88 to d3/d65/d66/d80/d91 0 2024-09-19T06:40:30.995 INFO:tasks.workunit.client.0.smithi099.stdout:0/169: chown d0/d17/c1a 809200 1 2024-09-19T06:40:30.995 INFO:tasks.workunit.client.0.smithi099.stdout:5/323: dread d3/d2a/f2c [0,4194304] 0 2024-09-19T06:40:30.995 INFO:tasks.workunit.client.0.smithi099.stdout:6/194: read d1/fe [2549453,19990] 0 2024-09-19T06:40:30.996 INFO:tasks.workunit.client.1.smithi117.stdout:0/264: creat d11/d13/d14/d2c/d35/d3e/f52 x:0 0 0 2024-09-19T06:40:30.997 INFO:tasks.workunit.client.0.smithi099.stdout:9/196: link dd/f1f dd/d10/f36 0 2024-09-19T06:40:30.998 INFO:tasks.workunit.client.1.smithi117.stdout:4/427: creat d3/d4/d5f/f92 x:0 0 0 2024-09-19T06:40:30.999 INFO:tasks.workunit.client.1.smithi117.stdout:5/298: link d17/d1b/d3a/d3c/d46/c59 d17/c64 0 2024-09-19T06:40:30.999 INFO:tasks.workunit.client.1.smithi117.stdout:0/265: dread - d11/d13/d14/d2c/d35/d3e/f52 zero size 2024-09-19T06:40:30.999 INFO:tasks.workunit.client.0.smithi099.stdout:0/170: symlink d0/d17/l35 0 2024-09-19T06:40:31.000 INFO:tasks.workunit.client.1.smithi117.stdout:4/428: dread - d3/d65/d66/f78 zero size 2024-09-19T06:40:31.000 INFO:tasks.workunit.client.0.smithi099.stdout:8/110: dwrite d4/de/d10/f20 [0,4194304] 0 2024-09-19T06:40:31.003 INFO:tasks.workunit.client.0.smithi099.stdout:5/324: truncate d3/d2a/f45 373603 0 2024-09-19T06:40:31.003 INFO:tasks.workunit.client.0.smithi099.stdout:7/183: dread f5 [0,4194304] 0 2024-09-19T06:40:31.009 INFO:tasks.workunit.client.1.smithi117.stdout:5/299: mkdir d17/d2e/d65 0 2024-09-19T06:40:31.009 INFO:tasks.workunit.client.1.smithi117.stdout:8/293: dwrite d1d/d2a/f62 [0,4194304] 0 2024-09-19T06:40:31.010 INFO:tasks.workunit.client.1.smithi117.stdout:5/300: fsync ff 0 2024-09-19T06:40:31.011 INFO:tasks.workunit.client.0.smithi099.stdout:7/184: readlink d7/l1a 0 2024-09-19T06:40:31.013 INFO:tasks.workunit.client.1.smithi117.stdout:8/294: write d1d/d2a/d3f/d4b/f59 [373478,59520] 0 2024-09-19T06:40:31.016 INFO:tasks.workunit.client.1.smithi117.stdout:0/266: unlink d11/d13/d14/d2c/f30 0 2024-09-19T06:40:31.016 INFO:tasks.workunit.client.1.smithi117.stdout:4/429: rename d3/db/d20/d35/c83 to d3/d28/c93 0 2024-09-19T06:40:31.016 INFO:tasks.workunit.client.1.smithi117.stdout:5/301: mknod d17/d1b/d3a/d3c/d46/c66 0 2024-09-19T06:40:31.017 INFO:tasks.workunit.client.0.smithi099.stdout:6/195: rename d1/d5/d24/d2b/f37 to d1/d5/d24/d2b/f45 0 2024-09-19T06:40:31.017 INFO:tasks.workunit.client.0.smithi099.stdout:5/325: mknod d3/d16/c72 0 2024-09-19T06:40:31.017 INFO:tasks.workunit.client.0.smithi099.stdout:8/111: creat d4/de/d10/f24 x:0 0 0 2024-09-19T06:40:31.018 INFO:tasks.workunit.client.1.smithi117.stdout:4/430: chown d3/d4/d14 18 1 2024-09-19T06:40:31.018 INFO:tasks.workunit.client.1.smithi117.stdout:0/267: readlink d11/d13/l2d 0 2024-09-19T06:40:31.018 INFO:tasks.workunit.client.0.smithi099.stdout:0/171: mkdir d0/db/d36 0 2024-09-19T06:40:31.019 INFO:tasks.workunit.client.0.smithi099.stdout:5/326: truncate d3/d16/d5e/f63 318031 0 2024-09-19T06:40:31.020 INFO:tasks.workunit.client.1.smithi117.stdout:8/295: getdents d1d/d31 0 2024-09-19T06:40:31.023 INFO:tasks.workunit.client.1.smithi117.stdout:4/431: rename d3/d28/d2a/c59 to d3/db/c94 0 2024-09-19T06:40:31.023 INFO:tasks.workunit.client.1.smithi117.stdout:8/296: mknod d1d/d1e/d53/c64 0 2024-09-19T06:40:31.024 INFO:tasks.workunit.client.1.smithi117.stdout:4/432: chown d3/d1b/l25 3163832 1 2024-09-19T06:40:31.025 INFO:tasks.workunit.client.1.smithi117.stdout:5/302: dwrite f1 [4194304,4194304] 0 2024-09-19T06:40:31.025 INFO:tasks.workunit.client.1.smithi117.stdout:0/268: rename d11/d13/d14/d41 to d11/d13/d14/d2c/d53 0 2024-09-19T06:40:31.026 INFO:tasks.workunit.client.1.smithi117.stdout:8/297: mknod d1d/d31/c65 0 2024-09-19T06:40:31.026 INFO:tasks.workunit.client.1.smithi117.stdout:4/433: truncate d3/d1b/f62 778572 0 2024-09-19T06:40:31.027 INFO:tasks.workunit.client.1.smithi117.stdout:5/303: mknod d17/d1b/d3a/d3c/c67 0 2024-09-19T06:40:31.028 INFO:tasks.workunit.client.1.smithi117.stdout:8/298: write d1d/d1e/f5c [1034909,75073] 0 2024-09-19T06:40:31.029 INFO:tasks.workunit.client.1.smithi117.stdout:4/434: rmdir d3/d1b/d63 39 2024-09-19T06:40:31.030 INFO:tasks.workunit.client.1.smithi117.stdout:8/299: chown d1d/d1e/l23 1426 1 2024-09-19T06:40:31.033 INFO:tasks.workunit.client.1.smithi117.stdout:5/304: dread d17/d1b/d3a/d3c/d46/f61 [0,4194304] 0 2024-09-19T06:40:31.034 INFO:tasks.workunit.client.1.smithi117.stdout:4/435: truncate d3/d1b/d63/f8c 949327 0 2024-09-19T06:40:31.036 INFO:tasks.workunit.client.1.smithi117.stdout:8/300: dread d1d/d2a/d3f/d4b/f5b [0,4194304] 0 2024-09-19T06:40:31.036 INFO:tasks.workunit.client.1.smithi117.stdout:5/305: unlink d17/f19 0 2024-09-19T06:40:31.038 INFO:tasks.workunit.client.1.smithi117.stdout:4/436: mkdir d3/d1b/d7d/d51/d95 0 2024-09-19T06:40:31.040 INFO:tasks.workunit.client.1.smithi117.stdout:8/301: stat l18 0 2024-09-19T06:40:31.040 INFO:tasks.workunit.client.1.smithi117.stdout:8/302: stat l9 0 2024-09-19T06:40:31.040 INFO:tasks.workunit.client.1.smithi117.stdout:5/306: dread d17/d1b/d3a/d3c/d46/f4f [0,4194304] 0 2024-09-19T06:40:31.041 INFO:tasks.workunit.client.1.smithi117.stdout:5/307: fdatasync ff 0 2024-09-19T06:40:31.045 INFO:tasks.workunit.client.1.smithi117.stdout:0/269: dread d11/d13/d14/f1d [0,4194304] 0 2024-09-19T06:40:31.048 INFO:tasks.workunit.client.1.smithi117.stdout:8/303: dwrite d1d/d2a/d3f/d4b/f59 [0,4194304] 0 2024-09-19T06:40:31.049 INFO:tasks.workunit.client.1.smithi117.stdout:5/308: dread d17/f41 [0,4194304] 0 2024-09-19T06:40:31.052 INFO:tasks.workunit.client.1.smithi117.stdout:8/304: mkdir d1d/d2a/d3f/d4b/d66 0 2024-09-19T06:40:31.054 INFO:tasks.workunit.client.1.smithi117.stdout:4/437: dwrite d3/d4/f9 [0,4194304] 0 2024-09-19T06:40:31.055 INFO:tasks.workunit.client.1.smithi117.stdout:5/309: rename d17/d1b/d3a/d3c/f52 to d17/d1b/d3a/f68 0 2024-09-19T06:40:31.058 INFO:tasks.workunit.client.1.smithi117.stdout:4/438: mknod d3/db/d20/d29/c96 0 2024-09-19T06:40:31.065 INFO:tasks.workunit.client.1.smithi117.stdout:8/305: write d1d/d2a/f45 [8889051,92038] 0 2024-09-19T06:40:31.065 INFO:tasks.workunit.client.1.smithi117.stdout:8/306: fdatasync d1d/f4a 0 2024-09-19T06:40:31.067 INFO:tasks.workunit.client.1.smithi117.stdout:8/307: rmdir d1d/d1e 39 2024-09-19T06:40:31.070 INFO:tasks.workunit.client.1.smithi117.stdout:8/308: mkdir d1d/d2a/d3f/d4b/d66/d67 0 2024-09-19T06:40:31.073 INFO:tasks.workunit.client.1.smithi117.stdout:8/309: symlink d1d/d1e/d53/l68 0 2024-09-19T06:40:31.075 INFO:tasks.workunit.client.1.smithi117.stdout:8/310: unlink d1d/f4a 0 2024-09-19T06:40:31.077 INFO:tasks.workunit.client.1.smithi117.stdout:8/311: fsync f15 0 2024-09-19T06:40:31.077 INFO:tasks.workunit.client.1.smithi117.stdout:8/312: chown d1d/d1e/f5c 1 1 2024-09-19T06:40:31.077 INFO:tasks.workunit.client.1.smithi117.stdout:8/313: chown d1d/d31/f36 2401 1 2024-09-19T06:40:31.080 INFO:tasks.workunit.client.1.smithi117.stdout:8/314: mkdir d1d/d2a/d3f/d4b/d5f/d69 0 2024-09-19T06:40:31.081 INFO:tasks.workunit.client.1.smithi117.stdout:5/310: dread d17/f22 [0,4194304] 0 2024-09-19T06:40:31.082 INFO:tasks.workunit.client.1.smithi117.stdout:4/439: dread d3/d1b/d7d/f4b [0,4194304] 0 2024-09-19T06:40:31.083 INFO:tasks.workunit.client.1.smithi117.stdout:8/315: creat d1d/d2a/d3f/d4c/f6a x:0 0 0 2024-09-19T06:40:31.084 INFO:tasks.workunit.client.1.smithi117.stdout:5/311: rename d17/d1b/f24 to d17/d5c/f69 0 2024-09-19T06:40:31.085 INFO:tasks.workunit.client.1.smithi117.stdout:5/312: write f3 [7829075,13131] 0 2024-09-19T06:40:31.086 INFO:tasks.workunit.client.1.smithi117.stdout:8/316: creat d1d/d2a/d3f/d4b/f6b x:0 0 0 2024-09-19T06:40:31.087 INFO:tasks.workunit.client.1.smithi117.stdout:8/317: write d1d/d1e/d29/f43 [817050,99539] 0 2024-09-19T06:40:31.089 INFO:tasks.workunit.client.1.smithi117.stdout:5/313: mkdir d17/d2f/d6a 0 2024-09-19T06:40:31.089 INFO:tasks.workunit.client.1.smithi117.stdout:8/318: write d1d/d2a/f62 [3181706,92354] 0 2024-09-19T06:40:31.089 INFO:tasks.workunit.client.1.smithi117.stdout:4/440: mknod d3/d1b/d7d/d51/d95/c97 0 2024-09-19T06:40:31.092 INFO:tasks.workunit.client.1.smithi117.stdout:5/314: symlink d17/d2f/d3b/l6b 0 2024-09-19T06:40:31.093 INFO:tasks.workunit.client.1.smithi117.stdout:8/319: creat d1d/d1e/d3b/f6c x:0 0 0 2024-09-19T06:40:31.095 INFO:tasks.workunit.client.1.smithi117.stdout:4/441: rename d3/db/d20/d29/d39/f67 to d3/db/d23/f98 0 2024-09-19T06:40:31.096 INFO:tasks.workunit.client.1.smithi117.stdout:8/320: mknod d1d/d2a/d3f/c6d 0 2024-09-19T06:40:31.097 INFO:tasks.workunit.client.1.smithi117.stdout:4/442: creat d3/d1b/d7d/d51/d95/f99 x:0 0 0 2024-09-19T06:40:31.099 INFO:tasks.workunit.client.1.smithi117.stdout:8/321: mkdir d1d/d1e/d53/d6e 0 2024-09-19T06:40:31.099 INFO:tasks.workunit.client.1.smithi117.stdout:8/322: chown f15 7047 1 2024-09-19T06:40:31.100 INFO:tasks.workunit.client.1.smithi117.stdout:5/315: link l12 d17/d1b/d3a/d3c/l6c 0 2024-09-19T06:40:31.100 INFO:tasks.workunit.client.0.smithi099.stdout:0/172: mkdir d0/db/d13/d37 0 2024-09-19T06:40:31.101 INFO:tasks.workunit.client.1.smithi117.stdout:4/443: symlink d3/db/l9a 0 2024-09-19T06:40:31.101 INFO:tasks.workunit.client.0.smithi099.stdout:6/196: read d1/f9 [1437699,5765] 0 2024-09-19T06:40:31.102 INFO:tasks.workunit.client.1.smithi117.stdout:4/444: chown d3/db/d20/d29 29953 1 2024-09-19T06:40:31.102 INFO:tasks.workunit.client.0.smithi099.stdout:9/197: truncate fa 3335327 0 2024-09-19T06:40:31.102 INFO:tasks.workunit.client.0.smithi099.stdout:5/327: symlink d3/d2a/l73 0 2024-09-19T06:40:31.103 INFO:tasks.workunit.client.1.smithi117.stdout:5/316: mknod d17/d2f/c6d 0 2024-09-19T06:40:31.103 INFO:tasks.workunit.client.0.smithi099.stdout:0/173: write d0/db/fe [3931472,32987] 0 2024-09-19T06:40:31.103 INFO:tasks.workunit.client.0.smithi099.stdout:8/112: creat d4/d11/d23/f25 x:0 0 0 2024-09-19T06:40:31.103 INFO:tasks.workunit.client.0.smithi099.stdout:4/210: dread f10 [0,4194304] 0 2024-09-19T06:40:31.104 INFO:tasks.workunit.client.1.smithi117.stdout:5/317: fdatasync d17/d1b/d3a/d3c/f53 0 2024-09-19T06:40:31.104 INFO:tasks.workunit.client.0.smithi099.stdout:5/328: fdatasync d3/d7/f3b 0 2024-09-19T06:40:31.105 INFO:tasks.workunit.client.1.smithi117.stdout:8/323: rename d1d/d1e/d29/f49 to d1d/d1e/d29/f6f 0 2024-09-19T06:40:31.105 INFO:tasks.workunit.client.0.smithi099.stdout:4/211: read - d12/d32/f2e zero size 2024-09-19T06:40:31.106 INFO:tasks.workunit.client.0.smithi099.stdout:7/185: link d7/d39/l40 d7/dd/d29/d1f/l46 0 2024-09-19T06:40:31.107 INFO:tasks.workunit.client.0.smithi099.stdout:4/212: write ff [594841,103351] 0 2024-09-19T06:40:31.107 INFO:tasks.workunit.client.1.smithi117.stdout:5/318: creat d17/d2e/d55/f6e x:0 0 0 2024-09-19T06:40:31.107 INFO:tasks.workunit.client.0.smithi099.stdout:9/198: rmdir dd/d2c 39 2024-09-19T06:40:31.108 INFO:tasks.workunit.client.1.smithi117.stdout:5/319: write f3 [1264330,98678] 0 2024-09-19T06:40:31.109 INFO:tasks.workunit.client.0.smithi099.stdout:0/174: mkdir d0/db/d27/d38 0 2024-09-19T06:40:31.111 INFO:tasks.workunit.client.1.smithi117.stdout:8/324: creat d1d/d1e/f70 x:0 0 0 2024-09-19T06:40:31.111 INFO:tasks.workunit.client.0.smithi099.stdout:4/213: write fb [7592801,114725] 0 2024-09-19T06:40:31.112 INFO:tasks.workunit.client.1.smithi117.stdout:5/320: mknod d17/d1b/d5d/c6f 0 2024-09-19T06:40:31.114 INFO:tasks.workunit.client.1.smithi117.stdout:8/325: mknod d1d/d2a/d3f/c71 0 2024-09-19T06:40:31.114 INFO:tasks.workunit.client.0.smithi099.stdout:7/186: mknod d7/d39/c47 0 2024-09-19T06:40:31.115 INFO:tasks.workunit.client.1.smithi117.stdout:5/321: mkdir d17/d1b/d3a/d3c/d70 0 2024-09-19T06:40:31.116 INFO:tasks.workunit.client.0.smithi099.stdout:0/175: rmdir d0 39 2024-09-19T06:40:31.117 INFO:tasks.workunit.client.1.smithi117.stdout:5/322: write d17/d1b/f28 [4579808,120093] 0 2024-09-19T06:40:31.118 INFO:tasks.workunit.client.1.smithi117.stdout:8/326: dread d1d/d1e/d29/f43 [0,4194304] 0 2024-09-19T06:40:31.119 INFO:tasks.workunit.client.0.smithi099.stdout:6/197: dwrite d1/f9 [0,4194304] 0 2024-09-19T06:40:31.120 INFO:tasks.workunit.client.0.smithi099.stdout:8/113: dwrite d4/de/f16 [0,4194304] 0 2024-09-19T06:40:31.121 INFO:tasks.workunit.client.1.smithi117.stdout:8/327: creat d1d/d2a/d3f/f72 x:0 0 0 2024-09-19T06:40:31.126 INFO:tasks.workunit.client.1.smithi117.stdout:5/323: dwrite d17/d2e/d55/f5a [0,4194304] 0 2024-09-19T06:40:31.128 INFO:tasks.workunit.client.0.smithi099.stdout:8/114: readlink d4/de/d14/l18 0 2024-09-19T06:40:31.128 INFO:tasks.workunit.client.1.smithi117.stdout:4/445: truncate d3/db/d20/d4a/f6f 1545485 0 2024-09-19T06:40:31.129 INFO:tasks.workunit.client.1.smithi117.stdout:8/328: mkdir d1d/d2a/d3f/d73 0 2024-09-19T06:40:31.130 INFO:tasks.workunit.client.1.smithi117.stdout:8/329: dread - d1d/d1e/d3b/f6c zero size 2024-09-19T06:40:31.130 INFO:tasks.workunit.client.0.smithi099.stdout:4/214: dwrite d12/d1b/f44 [0,4194304] 0 2024-09-19T06:40:31.130 INFO:tasks.workunit.client.0.smithi099.stdout:9/199: truncate dd/f19 456850 0 2024-09-19T06:40:31.131 INFO:tasks.workunit.client.1.smithi117.stdout:8/330: dread - d1d/d1e/d29/f51 zero size 2024-09-19T06:40:31.132 INFO:tasks.workunit.client.1.smithi117.stdout:8/331: chown l7 7878 1 2024-09-19T06:40:31.135 INFO:tasks.workunit.client.0.smithi099.stdout:6/198: mknod d1/d5/d38/d3c/d2a/c46 0 2024-09-19T06:40:31.136 INFO:tasks.workunit.client.1.smithi117.stdout:8/332: creat d1d/d2a/d3f/d4b/d66/f74 x:0 0 0 2024-09-19T06:40:31.137 INFO:tasks.workunit.client.1.smithi117.stdout:8/333: chown d1d/d2a/d3f/d4b/f59 421 1 2024-09-19T06:40:31.138 INFO:tasks.workunit.client.1.smithi117.stdout:5/324: symlink d17/d2f/d6a/l71 0 2024-09-19T06:40:31.138 INFO:tasks.workunit.client.0.smithi099.stdout:5/329: dread d3/f9 [0,4194304] 0 2024-09-19T06:40:31.139 INFO:tasks.workunit.client.1.smithi117.stdout:8/334: chown d1d/d2a/d3f/d4b/c5a 2131776377 1 2024-09-19T06:40:31.139 INFO:tasks.workunit.client.0.smithi099.stdout:7/187: dwrite d7/dd/d29/f23 [0,4194304] 0 2024-09-19T06:40:31.141 INFO:tasks.workunit.client.1.smithi117.stdout:8/335: write d1d/d2a/f45 [7952076,38165] 0 2024-09-19T06:40:31.142 INFO:tasks.workunit.client.0.smithi099.stdout:6/199: creat d1/d5/d38/d3c/d2a/f47 x:0 0 0 2024-09-19T06:40:31.151 INFO:tasks.workunit.client.0.smithi099.stdout:0/176: dwrite d0/db/d13/f20 [0,4194304] 0 2024-09-19T06:40:31.152 INFO:tasks.workunit.client.0.smithi099.stdout:8/115: dread d4/d11/f1f [0,4194304] 0 2024-09-19T06:40:31.152 INFO:tasks.workunit.client.0.smithi099.stdout:5/330: truncate d3/d16/d5e/f62 584098 0 2024-09-19T06:40:31.152 INFO:tasks.workunit.client.1.smithi117.stdout:4/446: getdents d3/d4/d5f 0 2024-09-19T06:40:31.152 INFO:tasks.workunit.client.0.smithi099.stdout:6/200: readlink d1/l3d 0 2024-09-19T06:40:31.153 INFO:tasks.workunit.client.0.smithi099.stdout:7/188: chown d7/c2d 220 1 2024-09-19T06:40:31.154 INFO:tasks.workunit.client.0.smithi099.stdout:8/116: write d4/f13 [1714277,107215] 0 2024-09-19T06:40:31.156 INFO:tasks.workunit.client.1.smithi117.stdout:4/447: link d3/db/f8d d3/d28/d2a/f9b 0 2024-09-19T06:40:31.157 INFO:tasks.workunit.client.0.smithi099.stdout:5/331: rename d3/d7/fa to d3/d16/f74 0 2024-09-19T06:40:31.159 INFO:tasks.workunit.client.0.smithi099.stdout:6/201: mknod d1/d5/d24/d2b/c48 0 2024-09-19T06:40:31.159 INFO:tasks.workunit.client.1.smithi117.stdout:8/336: dwrite d1d/f40 [0,4194304] 0 2024-09-19T06:40:31.161 INFO:tasks.workunit.client.0.smithi099.stdout:0/177: dread d0/db/d13/f20 [0,4194304] 0 2024-09-19T06:40:31.164 INFO:tasks.workunit.client.1.smithi117.stdout:4/448: rename d3/db/d20/d29/d39/c73 to d3/d65/c9c 0 2024-09-19T06:40:31.164 INFO:tasks.workunit.client.0.smithi099.stdout:5/332: creat d3/d16/d2f/f75 x:0 0 0 2024-09-19T06:40:31.164 INFO:tasks.workunit.client.0.smithi099.stdout:0/178: chown d0/f2a 642645536 1 2024-09-19T06:40:31.169 INFO:tasks.workunit.client.1.smithi117.stdout:4/449: read - d3/d1b/d7d/f86 zero size 2024-09-19T06:40:31.169 INFO:tasks.workunit.client.1.smithi117.stdout:8/337: dwrite f4 [0,4194304] 0 2024-09-19T06:40:31.170 INFO:tasks.workunit.client.0.smithi099.stdout:7/189: dwrite d7/dd/d29/f23 [0,4194304] 0 2024-09-19T06:40:31.171 INFO:tasks.workunit.client.0.smithi099.stdout:8/117: dwrite d4/f9 [0,4194304] 0 2024-09-19T06:40:31.176 INFO:tasks.workunit.client.1.smithi117.stdout:8/338: dwrite d1d/f63 [0,4194304] 0 2024-09-19T06:40:31.178 INFO:tasks.workunit.client.0.smithi099.stdout:0/179: dwrite d0/f11 [0,4194304] 0 2024-09-19T06:40:31.179 INFO:tasks.workunit.client.0.smithi099.stdout:0/180: readlink d0/d17/l22 0 2024-09-19T06:40:31.184 INFO:tasks.workunit.client.1.smithi117.stdout:8/339: symlink d1d/l75 0 2024-09-19T06:40:31.185 INFO:tasks.workunit.client.0.smithi099.stdout:7/190: mkdir d7/dd/d29/d1f/d45/d48 0 2024-09-19T06:40:31.188 INFO:tasks.workunit.client.0.smithi099.stdout:0/181: mkdir d0/db/d13/d1f/d39 0 2024-09-19T06:40:31.190 INFO:tasks.workunit.client.0.smithi099.stdout:7/191: chown d7/f32 0 1 2024-09-19T06:40:31.191 INFO:tasks.workunit.client.0.smithi099.stdout:5/333: getdents d3/d7/d47 0 2024-09-19T06:40:31.191 INFO:tasks.workunit.client.0.smithi099.stdout:7/192: chown d7/dd/d29/f3c 407223 1 2024-09-19T06:40:31.192 INFO:tasks.workunit.client.1.smithi117.stdout:8/340: link d1d/d1e/f2c d1d/d2a/f76 0 2024-09-19T06:40:31.192 INFO:tasks.workunit.client.1.smithi117.stdout:5/325: dread d17/f26 [0,4194304] 0 2024-09-19T06:40:31.195 INFO:tasks.workunit.client.1.smithi117.stdout:5/326: creat d17/d2f/d6a/f72 x:0 0 0 2024-09-19T06:40:31.195 INFO:tasks.workunit.client.1.smithi117.stdout:5/327: readlink d17/l18 0 2024-09-19T06:40:31.196 INFO:tasks.workunit.client.0.smithi099.stdout:0/182: getdents d0 0 2024-09-19T06:40:31.197 INFO:tasks.workunit.client.0.smithi099.stdout:7/193: rename d7/f31 to d7/f49 0 2024-09-19T06:40:31.198 INFO:tasks.workunit.client.1.smithi117.stdout:5/328: rename d17/d2e/f33 to d17/d1b/d3a/f73 0 2024-09-19T06:40:31.199 INFO:tasks.workunit.client.1.smithi117.stdout:5/329: read - d17/d2f/d6a/f72 zero size 2024-09-19T06:40:31.199 INFO:tasks.workunit.client.1.smithi117.stdout:4/450: dread d3/d4/d14/f17 [0,4194304] 0 2024-09-19T06:40:31.200 INFO:tasks.workunit.client.0.smithi099.stdout:0/183: getdents d0/db/d36 0 2024-09-19T06:40:31.203 INFO:tasks.workunit.client.0.smithi099.stdout:4/215: dread d12/d1b/d1c/f26 [0,4194304] 0 2024-09-19T06:40:31.203 INFO:tasks.workunit.client.0.smithi099.stdout:0/184: dread - d0/db/d13/f1e zero size 2024-09-19T06:40:31.204 INFO:tasks.workunit.client.1.smithi117.stdout:5/330: creat d17/f74 x:0 0 0 2024-09-19T06:40:31.205 INFO:tasks.workunit.client.1.smithi117.stdout:5/331: creat d17/d2f/d6a/f75 x:0 0 0 2024-09-19T06:40:31.205 INFO:tasks.workunit.client.0.smithi099.stdout:4/216: write d12/d32/f2e [228502,97214] 0 2024-09-19T06:40:31.205 INFO:tasks.workunit.client.0.smithi099.stdout:0/185: dread - d0/db/d13/d29/f2d zero size 2024-09-19T06:40:31.206 INFO:tasks.workunit.client.0.smithi099.stdout:7/194: dwrite d7/dd/d29/d1f/f21 [0,4194304] 0 2024-09-19T06:40:31.207 INFO:tasks.workunit.client.0.smithi099.stdout:0/186: stat d0/db/l26 0 2024-09-19T06:40:31.207 INFO:tasks.workunit.client.0.smithi099.stdout:4/217: truncate f5 5020550 0 2024-09-19T06:40:31.208 INFO:tasks.workunit.client.0.smithi099.stdout:4/218: write fb [9196945,21538] 0 2024-09-19T06:40:31.212 INFO:tasks.workunit.client.0.smithi099.stdout:7/195: rename d7/f8 to d7/dd/d29/f4a 0 2024-09-19T06:40:31.213 INFO:tasks.workunit.client.0.smithi099.stdout:4/219: mknod d12/d1b/d1c/d51/c54 0 2024-09-19T06:40:31.216 INFO:tasks.workunit.client.1.smithi117.stdout:7/296: sync 2024-09-19T06:40:31.217 INFO:tasks.workunit.client.1.smithi117.stdout:7/297: chown d1/d8/d24/c1b 1112751 1 2024-09-19T06:40:31.217 INFO:tasks.workunit.client.0.smithi099.stdout:7/196: link d7/dd/d29/d1f/c28 d7/dd/d29/d34/c4b 0 2024-09-19T06:40:31.218 INFO:tasks.workunit.client.1.smithi117.stdout:7/298: truncate d1/d3f/f57 285126 0 2024-09-19T06:40:31.219 INFO:tasks.workunit.client.0.smithi099.stdout:7/197: write d7/f49 [82296,57278] 0 2024-09-19T06:40:31.220 INFO:tasks.workunit.client.0.smithi099.stdout:4/220: dwrite d12/d1b/d1c/f26 [0,4194304] 0 2024-09-19T06:40:31.221 INFO:tasks.workunit.client.1.smithi117.stdout:7/299: truncate d1/d8/d24/d1c/f22 684331 0 2024-09-19T06:40:31.223 INFO:tasks.workunit.client.0.smithi099.stdout:6/202: dread d1/f1d [4194304,4194304] 0 2024-09-19T06:40:31.223 INFO:tasks.workunit.client.0.smithi099.stdout:6/203: fsync d1/d5/d38/d3c/d2a/f30 0 2024-09-19T06:40:31.224 INFO:tasks.workunit.client.0.smithi099.stdout:4/221: rename d12/d1b/d1c/f4a to d12/d32/d42/f55 0 2024-09-19T06:40:31.225 INFO:tasks.workunit.client.0.smithi099.stdout:7/198: unlink d7/f9 0 2024-09-19T06:40:31.226 INFO:tasks.workunit.client.0.smithi099.stdout:6/204: creat d1/d5/f49 x:0 0 0 2024-09-19T06:40:31.228 INFO:tasks.workunit.client.0.smithi099.stdout:7/199: dread d7/f3f [0,4194304] 0 2024-09-19T06:40:31.229 INFO:tasks.workunit.client.0.smithi099.stdout:6/205: dread d1/f9 [0,4194304] 0 2024-09-19T06:40:31.230 INFO:tasks.workunit.client.0.smithi099.stdout:4/222: unlink d12/d1b/d1c/c37 0 2024-09-19T06:40:31.231 INFO:tasks.workunit.client.0.smithi099.stdout:4/223: write d12/d1b/f44 [421893,5203] 0 2024-09-19T06:40:31.233 INFO:tasks.workunit.client.0.smithi099.stdout:6/206: readlink d1/l11 0 2024-09-19T06:40:31.235 INFO:tasks.workunit.client.1.smithi117.stdout:8/341: dread d1d/d1e/f32 [0,4194304] 0 2024-09-19T06:40:31.235 INFO:tasks.workunit.client.0.smithi099.stdout:6/207: write d1/d5/d38/d3c/d2a/f47 [403889,34854] 0 2024-09-19T06:40:31.235 INFO:tasks.workunit.client.0.smithi099.stdout:4/224: creat d12/d32/d42/f56 x:0 0 0 2024-09-19T06:40:31.236 INFO:tasks.workunit.client.0.smithi099.stdout:7/200: creat d7/dd/d29/f4c x:0 0 0 2024-09-19T06:40:31.237 INFO:tasks.workunit.client.0.smithi099.stdout:4/225: write d12/d32/d42/f56 [601514,62752] 0 2024-09-19T06:40:31.239 INFO:tasks.workunit.client.1.smithi117.stdout:8/342: symlink d1d/d2a/d3f/d4b/l77 0 2024-09-19T06:40:31.239 INFO:tasks.workunit.client.0.smithi099.stdout:6/208: symlink d1/d5/l4a 0 2024-09-19T06:40:31.241 INFO:tasks.workunit.client.0.smithi099.stdout:7/201: read d7/f49 [713290,102435] 0 2024-09-19T06:40:31.241 INFO:tasks.workunit.client.0.smithi099.stdout:6/209: readlink d1/l20 0 2024-09-19T06:40:31.242 INFO:tasks.workunit.client.1.smithi117.stdout:5/332: dread d17/d1b/d3a/d3c/f3d [0,4194304] 0 2024-09-19T06:40:31.242 INFO:tasks.workunit.client.0.smithi099.stdout:4/226: symlink d12/d32/d42/l57 0 2024-09-19T06:40:31.243 INFO:tasks.workunit.client.1.smithi117.stdout:8/343: creat d1d/d2a/d3f/d4b/d66/d67/f78 x:0 0 0 2024-09-19T06:40:31.244 INFO:tasks.workunit.client.1.smithi117.stdout:5/333: fdatasync d17/f41 0 2024-09-19T06:40:31.245 INFO:tasks.workunit.client.1.smithi117.stdout:8/344: write d1d/f27 [5223214,92325] 0 2024-09-19T06:40:31.246 INFO:tasks.workunit.client.0.smithi099.stdout:6/210: dread d1/d12/f27 [0,4194304] 0 2024-09-19T06:40:31.246 INFO:tasks.workunit.client.1.smithi117.stdout:4/451: dwrite d3/db/d23/f57 [0,4194304] 0 2024-09-19T06:40:31.247 INFO:tasks.workunit.client.0.smithi099.stdout:8/118: dwrite d4/d11/f1f [0,4194304] 0 2024-09-19T06:40:31.247 INFO:tasks.workunit.client.1.smithi117.stdout:5/334: readlink l12 0 2024-09-19T06:40:31.248 INFO:tasks.workunit.client.0.smithi099.stdout:7/202: rmdir d7/dd/d29/d1f/d45 39 2024-09-19T06:40:31.249 INFO:tasks.workunit.client.1.smithi117.stdout:4/452: mknod d3/db/d20/d35/c9d 0 2024-09-19T06:40:31.249 INFO:tasks.workunit.client.0.smithi099.stdout:5/334: dwrite d3/d7/f64 [0,4194304] 0 2024-09-19T06:40:31.250 INFO:tasks.workunit.client.0.smithi099.stdout:7/203: chown d7/c2d 18 1 2024-09-19T06:40:31.250 INFO:tasks.workunit.client.0.smithi099.stdout:6/211: write d1/d5/d38/d3c/d2a/f30 [577317,71183] 0 2024-09-19T06:40:31.254 INFO:tasks.workunit.client.0.smithi099.stdout:8/119: mkdir d4/de/d26 0 2024-09-19T06:40:31.255 INFO:tasks.workunit.client.0.smithi099.stdout:8/120: dread - d4/de/d10/f24 zero size 2024-09-19T06:40:31.260 INFO:tasks.workunit.client.0.smithi099.stdout:8/121: rename d4/f6 to d4/f27 0 2024-09-19T06:40:31.260 INFO:tasks.workunit.client.0.smithi099.stdout:5/335: creat d3/d1f/f76 x:0 0 0 2024-09-19T06:40:31.264 INFO:tasks.workunit.client.0.smithi099.stdout:7/204: getdents d7 0 2024-09-19T06:40:31.264 INFO:tasks.workunit.client.0.smithi099.stdout:5/336: creat d3/d2a/f77 x:0 0 0 2024-09-19T06:40:31.265 INFO:tasks.workunit.client.0.smithi099.stdout:6/212: dwrite d1/f9 [0,4194304] 0 2024-09-19T06:40:31.267 INFO:tasks.workunit.client.0.smithi099.stdout:5/337: mknod d3/d16/d2f/d34/d3c/c78 0 2024-09-19T06:40:31.269 INFO:tasks.workunit.client.0.smithi099.stdout:7/205: link d7/f3f d7/f4d 0 2024-09-19T06:40:31.269 INFO:tasks.workunit.client.0.smithi099.stdout:6/213: mknod d1/d5/d38/d3c/d2a/c4b 0 2024-09-19T06:40:31.273 INFO:tasks.workunit.client.0.smithi099.stdout:5/338: rename d3/d14/f38 to d3/f79 0 2024-09-19T06:40:31.274 INFO:tasks.workunit.client.0.smithi099.stdout:6/214: read d1/d12/f1f [3941751,35245] 0 2024-09-19T06:40:31.275 INFO:tasks.workunit.client.0.smithi099.stdout:5/339: creat d3/d2a/f7a x:0 0 0 2024-09-19T06:40:31.277 INFO:tasks.workunit.client.0.smithi099.stdout:5/340: symlink d3/d16/d5e/l7b 0 2024-09-19T06:40:31.277 INFO:tasks.workunit.client.0.smithi099.stdout:6/215: creat d1/f4c x:0 0 0 2024-09-19T06:40:31.279 INFO:tasks.workunit.client.0.smithi099.stdout:6/216: rmdir d1/d5/d24/d2b 39 2024-09-19T06:40:31.282 INFO:tasks.workunit.client.0.smithi099.stdout:4/227: dread d12/f16 [0,4194304] 0 2024-09-19T06:40:31.283 INFO:tasks.workunit.client.0.smithi099.stdout:6/217: rmdir d1/d5/d24/d2b/d3f 0 2024-09-19T06:40:31.285 INFO:tasks.workunit.client.0.smithi099.stdout:4/228: read f5 [1849308,83042] 0 2024-09-19T06:40:31.286 INFO:tasks.workunit.client.0.smithi099.stdout:4/229: stat d12/d32/d42/l57 0 2024-09-19T06:40:31.291 INFO:tasks.workunit.client.0.smithi099.stdout:7/206: chown d7/dd/d29/d34 0 1 2024-09-19T06:40:31.292 INFO:tasks.workunit.client.0.smithi099.stdout:4/230: dwrite f10 [0,4194304] 0 2024-09-19T06:40:31.301 INFO:tasks.workunit.client.0.smithi099.stdout:5/341: dread d3/d1f/d4f/f5c [4194304,4194304] 0 2024-09-19T06:40:31.308 INFO:tasks.workunit.client.0.smithi099.stdout:5/342: truncate d3/d2a/f2c 1176988 0 2024-09-19T06:40:31.310 INFO:tasks.workunit.client.0.smithi099.stdout:5/343: symlink d3/d16/d5e/l7c 0 2024-09-19T06:40:31.311 INFO:tasks.workunit.client.0.smithi099.stdout:5/344: chown d3/d16/d2f 966366694 1 2024-09-19T06:40:31.311 INFO:tasks.workunit.client.0.smithi099.stdout:7/207: dread d7/f26 [0,4194304] 0 2024-09-19T06:40:31.311 INFO:tasks.workunit.client.0.smithi099.stdout:5/345: dread - d3/d16/d2f/d34/d3c/f6d zero size 2024-09-19T06:40:31.313 INFO:tasks.workunit.client.0.smithi099.stdout:7/208: write d7/f2c [2434836,85098] 0 2024-09-19T06:40:31.313 INFO:tasks.workunit.client.0.smithi099.stdout:5/346: mkdir d3/d16/d7d 0 2024-09-19T06:40:31.313 INFO:tasks.workunit.client.0.smithi099.stdout:7/209: chown f5 232449 1 2024-09-19T06:40:31.315 INFO:tasks.workunit.client.0.smithi099.stdout:7/210: mkdir d7/dd/d29/d4e 0 2024-09-19T06:40:31.316 INFO:tasks.workunit.client.0.smithi099.stdout:5/347: link d3/d16/c72 d3/c7e 0 2024-09-19T06:40:31.317 INFO:tasks.workunit.client.0.smithi099.stdout:7/211: truncate d7/dd/d29/d1f/f2a 2378876 0 2024-09-19T06:40:31.318 INFO:tasks.workunit.client.0.smithi099.stdout:5/348: creat d3/d16/d2f/f7f x:0 0 0 2024-09-19T06:40:31.320 INFO:tasks.workunit.client.0.smithi099.stdout:5/349: rmdir d3/d7 39 2024-09-19T06:40:31.323 INFO:tasks.workunit.client.0.smithi099.stdout:5/350: creat d3/d7/f80 x:0 0 0 2024-09-19T06:40:31.323 INFO:tasks.workunit.client.0.smithi099.stdout:5/351: read - d3/d7/f4d zero size 2024-09-19T06:40:31.326 INFO:tasks.workunit.client.0.smithi099.stdout:7/212: write d7/dd/d29/f1e [1044007,77561] 0 2024-09-19T06:40:31.330 INFO:tasks.workunit.client.0.smithi099.stdout:5/352: dwrite d3/d16/d5e/f63 [0,4194304] 0 2024-09-19T06:40:31.333 INFO:tasks.workunit.client.0.smithi099.stdout:7/213: rename d7/c11 to d7/dd/d29/d1f/d45/c4f 0 2024-09-19T06:40:31.334 INFO:tasks.workunit.client.0.smithi099.stdout:5/353: unlink d3/d2a/l57 0 2024-09-19T06:40:31.334 INFO:tasks.workunit.client.0.smithi099.stdout:5/354: readlink d3/d16/d5e/l7b 0 2024-09-19T06:40:31.335 INFO:tasks.workunit.client.0.smithi099.stdout:5/355: fsync d3/d7/d47/f61 0 2024-09-19T06:40:31.336 INFO:tasks.workunit.client.0.smithi099.stdout:3/250: sync 2024-09-19T06:40:31.336 INFO:tasks.workunit.client.0.smithi099.stdout:2/89: sync 2024-09-19T06:40:31.337 INFO:tasks.workunit.client.0.smithi099.stdout:5/356: creat d3/d16/d2f/d34/d3c/d65/f81 x:0 0 0 2024-09-19T06:40:31.338 INFO:tasks.workunit.client.0.smithi099.stdout:2/90: mknod d1/d2/d5/c1e 0 2024-09-19T06:40:31.338 INFO:tasks.workunit.client.0.smithi099.stdout:7/214: dread f4 [0,4194304] 0 2024-09-19T06:40:31.338 INFO:tasks.workunit.client.0.smithi099.stdout:5/357: readlink d3/d7/l12 0 2024-09-19T06:40:31.340 INFO:tasks.workunit.client.0.smithi099.stdout:2/91: write d1/d2/d5/d8/fa [5142101,36881] 0 2024-09-19T06:40:31.341 INFO:tasks.workunit.client.0.smithi099.stdout:3/251: dread d7/d34/d1d/d36/f32 [0,4194304] 0 2024-09-19T06:40:31.344 INFO:tasks.workunit.client.0.smithi099.stdout:3/252: mknod d7/d34/d1d/c39 0 2024-09-19T06:40:31.345 INFO:tasks.workunit.client.0.smithi099.stdout:3/253: creat d7/d34/f3a x:0 0 0 2024-09-19T06:40:31.348 INFO:tasks.workunit.client.0.smithi099.stdout:3/254: getdents d7 0 2024-09-19T06:40:31.349 INFO:tasks.workunit.client.0.smithi099.stdout:7/215: chown d7/dd/d29/d34 13609617 1 2024-09-19T06:40:31.350 INFO:tasks.workunit.client.0.smithi099.stdout:3/255: symlink d7/d34/d1d/d20/l3b 0 2024-09-19T06:40:31.351 INFO:tasks.workunit.client.0.smithi099.stdout:7/216: mknod d7/dd/d29/d1f/c50 0 2024-09-19T06:40:31.352 INFO:tasks.workunit.client.0.smithi099.stdout:5/358: write d3/d2a/f4c [2454048,111113] 0 2024-09-19T06:40:31.352 INFO:tasks.workunit.client.0.smithi099.stdout:2/92: write d1/d2/d5/d8/f11 [1042810,32660] 0 2024-09-19T06:40:31.352 INFO:tasks.workunit.client.0.smithi099.stdout:7/217: read f4 [206716,120423] 0 2024-09-19T06:40:31.354 INFO:tasks.workunit.client.0.smithi099.stdout:2/93: chown d1/d2/d5/d8/d9/f1d 3548082 1 2024-09-19T06:40:31.357 INFO:tasks.workunit.client.1.smithi117.stdout:4/453: chown d3/d4/lc 22836 1 2024-09-19T06:40:31.358 INFO:tasks.workunit.client.1.smithi117.stdout:5/335: creat d17/f76 x:0 0 0 2024-09-19T06:40:31.358 INFO:tasks.workunit.client.0.smithi099.stdout:5/359: link c2 d3/d16/d2f/d34/d3c/d65/c82 0 2024-09-19T06:40:31.359 INFO:tasks.workunit.client.1.smithi117.stdout:8/345: dwrite d1d/d1e/d29/f51 [0,4194304] 0 2024-09-19T06:40:31.360 INFO:tasks.workunit.client.1.smithi117.stdout:4/454: dread - d3/db/d20/d35/f70 zero size 2024-09-19T06:40:31.360 INFO:tasks.workunit.client.0.smithi099.stdout:2/94: dread d1/d2/f12 [0,4194304] 0 2024-09-19T06:40:31.360 INFO:tasks.workunit.client.0.smithi099.stdout:7/218: write d7/dd/d29/f16 [641240,59298] 0 2024-09-19T06:40:31.362 INFO:tasks.workunit.client.1.smithi117.stdout:4/455: dread d3/d1b/d63/f8c [0,4194304] 0 2024-09-19T06:40:31.362 INFO:tasks.workunit.client.0.smithi099.stdout:7/219: chown d7/dd/d29/d1f/f2a 0 1 2024-09-19T06:40:31.363 INFO:tasks.workunit.client.1.smithi117.stdout:5/336: rename l12 to d17/d1b/d3a/d3c/l77 0 2024-09-19T06:40:31.364 INFO:tasks.workunit.client.0.smithi099.stdout:2/95: creat d1/d2/f1f x:0 0 0 2024-09-19T06:40:31.366 INFO:tasks.workunit.client.0.smithi099.stdout:2/96: chown d1/f15 46215217 1 2024-09-19T06:40:31.366 INFO:tasks.workunit.client.1.smithi117.stdout:4/456: mkdir d3/d1b/d7d/d9e 0 2024-09-19T06:40:31.367 INFO:tasks.workunit.client.1.smithi117.stdout:4/457: chown d3/db/f43 19 1 2024-09-19T06:40:31.368 INFO:tasks.workunit.client.0.smithi099.stdout:7/220: creat d7/dd/f51 x:0 0 0 2024-09-19T06:40:31.368 INFO:tasks.workunit.client.1.smithi117.stdout:5/337: dwrite d17/f41 [0,4194304] 0 2024-09-19T06:40:31.370 INFO:tasks.workunit.client.0.smithi099.stdout:5/360: dwrite d3/d7/f10 [4194304,4194304] 0 2024-09-19T06:40:31.372 INFO:tasks.workunit.client.0.smithi099.stdout:5/361: write d3/d1f/f21 [56286,104103] 0 2024-09-19T06:40:31.372 INFO:tasks.workunit.client.1.smithi117.stdout:5/338: creat d17/d2f/d3b/f78 x:0 0 0 2024-09-19T06:40:31.372 INFO:tasks.workunit.client.1.smithi117.stdout:8/346: truncate d1d/d2a/f62 77548 0 2024-09-19T06:40:31.373 INFO:tasks.workunit.client.1.smithi117.stdout:5/339: stat d17/d1b/d3a/d3c/d46/l47 0 2024-09-19T06:40:31.374 INFO:tasks.workunit.client.0.smithi099.stdout:2/97: getdents d1/d2/d5/d8/d9 0 2024-09-19T06:40:31.374 INFO:tasks.workunit.client.1.smithi117.stdout:8/347: write d1d/d2a/d3f/d4b/f6b [298817,80825] 0 2024-09-19T06:40:31.375 INFO:tasks.workunit.client.1.smithi117.stdout:5/340: chown d17/d2f/c6d 296307599 1 2024-09-19T06:40:31.376 INFO:tasks.workunit.client.1.smithi117.stdout:8/348: write d1d/d2a/f45 [9772503,94683] 0 2024-09-19T06:40:31.378 INFO:tasks.workunit.client.0.smithi099.stdout:7/221: creat d7/f52 x:0 0 0 2024-09-19T06:40:31.379 INFO:tasks.workunit.client.1.smithi117.stdout:5/341: rmdir d17/d1b/d3a/d3c/d46 39 2024-09-19T06:40:31.380 INFO:tasks.workunit.client.0.smithi099.stdout:2/98: write d1/d2/d5/d8/f11 [1287003,75419] 0 2024-09-19T06:40:31.381 INFO:tasks.workunit.client.1.smithi117.stdout:8/349: creat d1d/d31/f79 x:0 0 0 2024-09-19T06:40:31.382 INFO:tasks.workunit.client.1.smithi117.stdout:8/350: chown d1d/d2a/d3f/d4b/f6b 5687522 1 2024-09-19T06:40:31.383 INFO:tasks.workunit.client.0.smithi099.stdout:5/362: dwrite d3/d7/f3b [0,4194304] 0 2024-09-19T06:40:31.384 INFO:tasks.workunit.client.1.smithi117.stdout:8/351: write d1d/d1e/d29/f2e [1547254,34934] 0 2024-09-19T06:40:31.384 INFO:tasks.workunit.client.1.smithi117.stdout:8/352: chown l1c 3113 1 2024-09-19T06:40:31.384 INFO:tasks.workunit.client.1.smithi117.stdout:5/342: truncate d17/d1b/d3a/d3c/f57 661580 0 2024-09-19T06:40:31.385 INFO:tasks.workunit.client.1.smithi117.stdout:8/353: write d1d/d2a/d3f/d4c/f6a [488819,11018] 0 2024-09-19T06:40:31.387 INFO:tasks.workunit.client.0.smithi099.stdout:7/222: getdents d7/dd/d29/d34 0 2024-09-19T06:40:31.388 INFO:tasks.workunit.client.0.smithi099.stdout:5/363: link d3/d2a/f32 d3/d16/f83 0 2024-09-19T06:40:31.390 INFO:tasks.workunit.client.0.smithi099.stdout:7/223: truncate d7/f32 145871 0 2024-09-19T06:40:31.390 INFO:tasks.workunit.client.0.smithi099.stdout:7/224: stat d7/f52 0 2024-09-19T06:40:31.391 INFO:tasks.workunit.client.1.smithi117.stdout:5/343: getdents d17/d1b/d3a 0 2024-09-19T06:40:31.391 INFO:tasks.workunit.client.0.smithi099.stdout:7/225: write d7/f52 [455230,19113] 0 2024-09-19T06:40:31.391 INFO:tasks.workunit.client.1.smithi117.stdout:5/344: stat ff 0 2024-09-19T06:40:31.393 INFO:tasks.workunit.client.0.smithi099.stdout:5/364: creat d3/d16/d2f/d34/d3c/d65/f84 x:0 0 0 2024-09-19T06:40:31.393 INFO:tasks.workunit.client.0.smithi099.stdout:5/365: fdatasync d3/d7/f4d 0 2024-09-19T06:40:31.394 INFO:tasks.workunit.client.0.smithi099.stdout:5/366: readlink d3/l1d 0 2024-09-19T06:40:31.394 INFO:tasks.workunit.client.0.smithi099.stdout:5/367: chown d3/d16/d5e 58 1 2024-09-19T06:40:31.395 INFO:tasks.workunit.client.1.smithi117.stdout:8/354: dwrite d1d/d1e/d29/f48 [0,4194304] 0 2024-09-19T06:40:31.395 INFO:tasks.workunit.client.0.smithi099.stdout:7/226: mkdir d7/dd/d29/d4e/d53 0 2024-09-19T06:40:31.396 INFO:tasks.workunit.client.1.smithi117.stdout:4/458: dread d3/d28/d2a/f8f [0,4194304] 0 2024-09-19T06:40:31.396 INFO:tasks.workunit.client.1.smithi117.stdout:5/345: creat d17/d1b/d3a/d3c/d70/f79 x:0 0 0 2024-09-19T06:40:31.396 INFO:tasks.workunit.client.0.smithi099.stdout:7/227: truncate d7/dd/d29/f4c 777091 0 2024-09-19T06:40:31.396 INFO:tasks.workunit.client.0.smithi099.stdout:5/368: creat d3/d16/d5e/f85 x:0 0 0 2024-09-19T06:40:31.397 INFO:tasks.workunit.client.0.smithi099.stdout:5/369: read - d3/d1f/f76 zero size 2024-09-19T06:40:31.398 INFO:tasks.workunit.client.1.smithi117.stdout:8/355: creat d1d/d1e/d53/f7a x:0 0 0 2024-09-19T06:40:31.399 INFO:tasks.workunit.client.1.smithi117.stdout:5/346: dread d17/d2e/f5f [0,4194304] 0 2024-09-19T06:40:31.399 INFO:tasks.workunit.client.1.smithi117.stdout:4/459: fsync d3/db/f3a 0 2024-09-19T06:40:31.399 INFO:tasks.workunit.client.1.smithi117.stdout:8/356: dread - d1d/d2a/f2f zero size 2024-09-19T06:40:31.400 INFO:tasks.workunit.client.1.smithi117.stdout:4/460: readlink d3/db/l37 0 2024-09-19T06:40:31.401 INFO:tasks.workunit.client.1.smithi117.stdout:5/347: chown d17/d1b/d3a/d3c/d70/f79 23 1 2024-09-19T06:40:31.402 INFO:tasks.workunit.client.1.smithi117.stdout:4/461: write d3/db/d13/f3c [3215520,103272] 0 2024-09-19T06:40:31.403 INFO:tasks.workunit.client.1.smithi117.stdout:8/357: creat d1d/d1e/d3b/f7b x:0 0 0 2024-09-19T06:40:31.404 INFO:tasks.workunit.client.0.smithi099.stdout:5/370: unlink d3/d2a/f4c 0 2024-09-19T06:40:31.404 INFO:tasks.workunit.client.0.smithi099.stdout:5/371: stat d3/d16/d2f/c50 0 2024-09-19T06:40:31.404 INFO:tasks.workunit.client.1.smithi117.stdout:5/348: creat d17/d2e/d55/f7a x:0 0 0 2024-09-19T06:40:31.405 INFO:tasks.workunit.client.0.smithi099.stdout:2/99: truncate d1/f15 5785566 0 2024-09-19T06:40:31.407 INFO:tasks.workunit.client.0.smithi099.stdout:5/372: creat d3/d16/d2f/d34/d3c/d65/f86 x:0 0 0 2024-09-19T06:40:31.408 INFO:tasks.workunit.client.1.smithi117.stdout:4/462: mkdir d3/d1b/d7d/d9f 0 2024-09-19T06:40:31.408 INFO:tasks.workunit.client.0.smithi099.stdout:7/228: write d7/dd/d29/d1f/f21 [2920810,113400] 0 2024-09-19T06:40:31.410 INFO:tasks.workunit.client.1.smithi117.stdout:5/349: write d17/d1b/d3a/d3c/f3d [4898428,3345] 0 2024-09-19T06:40:31.411 INFO:tasks.workunit.client.0.smithi099.stdout:5/373: symlink d3/d16/d2f/d34/d3c/l87 0 2024-09-19T06:40:31.411 INFO:tasks.workunit.client.0.smithi099.stdout:7/229: creat d7/dd/f54 x:0 0 0 2024-09-19T06:40:31.412 INFO:tasks.workunit.client.1.smithi117.stdout:8/358: dwrite d1d/d2a/d3f/d4c/f6a [0,4194304] 0 2024-09-19T06:40:31.414 INFO:tasks.workunit.client.0.smithi099.stdout:5/374: truncate d3/d2a/f32 3759207 0 2024-09-19T06:40:31.414 INFO:tasks.workunit.client.1.smithi117.stdout:5/350: symlink d17/l7b 0 2024-09-19T06:40:31.418 INFO:tasks.workunit.client.0.smithi099.stdout:7/230: creat d7/dd/d29/d1f/f55 x:0 0 0 2024-09-19T06:40:31.418 INFO:tasks.workunit.client.1.smithi117.stdout:4/463: dwrite d3/db/ff [4194304,4194304] 0 2024-09-19T06:40:31.418 INFO:tasks.workunit.client.1.smithi117.stdout:6/219: sync 2024-09-19T06:40:31.421 INFO:tasks.workunit.client.1.smithi117.stdout:4/464: write d3/db/d20/d35/f70 [294765,60059] 0 2024-09-19T06:40:31.422 INFO:tasks.workunit.client.0.smithi099.stdout:7/231: fsync d7/dd/d29/f4a 0 2024-09-19T06:40:31.423 INFO:tasks.workunit.client.1.smithi117.stdout:8/359: dwrite d1d/d2a/d3f/d4b/d66/d67/f78 [0,4194304] 0 2024-09-19T06:40:31.423 INFO:tasks.workunit.client.1.smithi117.stdout:5/351: link l13 d17/d2e/d55/l7c 0 2024-09-19T06:40:31.424 INFO:tasks.workunit.client.1.smithi117.stdout:4/465: chown d3/d65/f7c 15 1 2024-09-19T06:40:31.425 INFO:tasks.workunit.client.1.smithi117.stdout:8/360: chown d1d/d1e/d53/d6e 12 1 2024-09-19T06:40:31.426 INFO:tasks.workunit.client.1.smithi117.stdout:8/361: chown d1d/d31 13848752 1 2024-09-19T06:40:31.426 INFO:tasks.workunit.client.0.smithi099.stdout:7/232: mknod d7/dd/d29/d4e/d53/c56 0 2024-09-19T06:40:31.428 INFO:tasks.workunit.client.1.smithi117.stdout:8/362: read - d1d/d2a/d3f/d4b/d66/f74 zero size 2024-09-19T06:40:31.432 INFO:tasks.workunit.client.1.smithi117.stdout:5/352: unlink d17/d1b/d3a/d3c/d46/c59 0 2024-09-19T06:40:31.432 INFO:tasks.workunit.client.1.smithi117.stdout:6/220: dwrite d1/f18 [0,4194304] 0 2024-09-19T06:40:31.434 INFO:tasks.workunit.client.0.smithi099.stdout:7/233: dread d7/f52 [0,4194304] 0 2024-09-19T06:40:31.434 INFO:tasks.workunit.client.1.smithi117.stdout:6/221: fsync d1/d14/f1a 0 2024-09-19T06:40:31.436 INFO:tasks.workunit.client.1.smithi117.stdout:5/353: rmdir d17/d2f 39 2024-09-19T06:40:31.437 INFO:tasks.workunit.client.0.smithi099.stdout:2/100: dread d1/d2/d5/d8/fa [4194304,4194304] 0 2024-09-19T06:40:31.437 INFO:tasks.workunit.client.1.smithi117.stdout:5/354: truncate d17/f74 608367 0 2024-09-19T06:40:31.438 INFO:tasks.workunit.client.1.smithi117.stdout:8/363: getdents d1d/d2a/d3f/d4b/d5f 0 2024-09-19T06:40:31.438 INFO:tasks.workunit.client.0.smithi099.stdout:7/234: creat d7/dd/d29/d1f/d45/d48/f57 x:0 0 0 2024-09-19T06:40:31.439 INFO:tasks.workunit.client.0.smithi099.stdout:2/101: fsync d1/d2/d5/d8/fa 0 2024-09-19T06:40:31.440 INFO:tasks.workunit.client.1.smithi117.stdout:5/355: mkdir d17/d1b/d5d/d7d 0 2024-09-19T06:40:31.441 INFO:tasks.workunit.client.0.smithi099.stdout:7/235: symlink d7/dd/d29/d1f/d45/d48/l58 0 2024-09-19T06:40:31.441 INFO:tasks.workunit.client.0.smithi099.stdout:2/102: dread - d1/d2/f1f zero size 2024-09-19T06:40:31.442 INFO:tasks.workunit.client.0.smithi099.stdout:7/236: chown d7/f4d 111042262 1 2024-09-19T06:40:31.442 INFO:tasks.workunit.client.1.smithi117.stdout:5/356: write d17/f41 [2267794,85996] 0 2024-09-19T06:40:31.443 INFO:tasks.workunit.client.1.smithi117.stdout:6/222: getdents d1/d3 0 2024-09-19T06:40:31.444 INFO:tasks.workunit.client.0.smithi099.stdout:2/103: mknod d1/d2/d5/d6/c20 0 2024-09-19T06:40:31.445 INFO:tasks.workunit.client.0.smithi099.stdout:2/104: dread - d1/d2/d5/d8/d9/f1d zero size 2024-09-19T06:40:31.446 INFO:tasks.workunit.client.1.smithi117.stdout:8/364: dwrite d1d/d1e/f70 [0,4194304] 0 2024-09-19T06:40:31.447 INFO:tasks.workunit.client.1.smithi117.stdout:5/357: symlink d17/d1b/d5d/d7d/l7e 0 2024-09-19T06:40:31.447 INFO:tasks.workunit.client.1.smithi117.stdout:6/223: dread d1/d14/f2b [0,4194304] 0 2024-09-19T06:40:31.448 INFO:tasks.workunit.client.1.smithi117.stdout:8/365: rmdir d1d/d2a 39 2024-09-19T06:40:31.448 INFO:tasks.workunit.client.0.smithi099.stdout:2/105: symlink d1/d2/l21 0 2024-09-19T06:40:31.449 INFO:tasks.workunit.client.0.smithi099.stdout:9/200: sync 2024-09-19T06:40:31.449 INFO:tasks.workunit.client.0.smithi099.stdout:0/187: sync 2024-09-19T06:40:31.449 INFO:tasks.workunit.client.0.smithi099.stdout:1/173: sync 2024-09-19T06:40:31.449 INFO:tasks.workunit.client.1.smithi117.stdout:8/366: write f15 [1861279,29544] 0 2024-09-19T06:40:31.450 INFO:tasks.workunit.client.1.smithi117.stdout:5/358: write d17/d2e/f32 [2095246,117130] 0 2024-09-19T06:40:31.451 INFO:tasks.workunit.client.1.smithi117.stdout:5/359: dread - d17/f76 zero size 2024-09-19T06:40:31.451 INFO:tasks.workunit.client.0.smithi099.stdout:2/106: symlink d1/d2/d5/d8/d9/l22 0 2024-09-19T06:40:31.452 INFO:tasks.workunit.client.0.smithi099.stdout:2/107: write d1/d2/f1f [439519,62824] 0 2024-09-19T06:40:31.454 INFO:tasks.workunit.client.0.smithi099.stdout:1/174: mkdir d0/d12/d13/d37 0 2024-09-19T06:40:31.454 INFO:tasks.workunit.client.1.smithi117.stdout:8/367: mkdir d1d/d2a/d3f/d4b/d5f/d7c 0 2024-09-19T06:40:31.455 INFO:tasks.workunit.client.0.smithi099.stdout:0/188: mkdir d0/db/d13/d1f/d3a 0 2024-09-19T06:40:31.456 INFO:tasks.workunit.client.1.smithi117.stdout:8/368: truncate d1d/d1e/f58 782401 0 2024-09-19T06:40:31.457 INFO:tasks.workunit.client.1.smithi117.stdout:6/224: dwrite d1/d3/f9 [0,4194304] 0 2024-09-19T06:40:31.458 INFO:tasks.workunit.client.0.smithi099.stdout:2/108: creat d1/d2/d5/d8/d18/f23 x:0 0 0 2024-09-19T06:40:31.460 INFO:tasks.workunit.client.1.smithi117.stdout:5/360: creat d17/d1b/d3a/d3c/f7f x:0 0 0 2024-09-19T06:40:31.463 INFO:tasks.workunit.client.0.smithi099.stdout:2/109: mkdir d1/d2/d24 0 2024-09-19T06:40:31.463 INFO:tasks.workunit.client.0.smithi099.stdout:1/175: dwrite d0/d12/d13/f1b [4194304,4194304] 0 2024-09-19T06:40:31.463 INFO:tasks.workunit.client.0.smithi099.stdout:0/189: dread d0/db/d13/d1f/f28 [0,4194304] 0 2024-09-19T06:40:31.464 INFO:tasks.workunit.client.1.smithi117.stdout:8/369: dread f4 [0,4194304] 0 2024-09-19T06:40:31.465 INFO:tasks.workunit.client.1.smithi117.stdout:8/370: chown l1c 400 1 2024-09-19T06:40:31.466 INFO:tasks.workunit.client.1.smithi117.stdout:6/225: dwrite d1/d14/f2e [4194304,4194304] 0 2024-09-19T06:40:31.467 INFO:tasks.workunit.client.1.smithi117.stdout:6/226: truncate d1/d14/f2b 1349572 0 2024-09-19T06:40:31.468 INFO:tasks.workunit.client.0.smithi099.stdout:2/110: creat d1/f25 x:0 0 0 2024-09-19T06:40:31.468 INFO:tasks.workunit.client.1.smithi117.stdout:8/371: read f12 [3871233,86232] 0 2024-09-19T06:40:31.469 INFO:tasks.workunit.client.0.smithi099.stdout:7/237: dread d7/dd/d29/f4a [0,4194304] 0 2024-09-19T06:40:31.469 INFO:tasks.workunit.client.1.smithi117.stdout:8/372: read - d1d/f52 zero size 2024-09-19T06:40:31.469 INFO:tasks.workunit.client.0.smithi099.stdout:2/111: write d1/d2/d5/d13/f1b [348704,16814] 0 2024-09-19T06:40:31.471 INFO:tasks.workunit.client.0.smithi099.stdout:7/238: stat d7/ff 0 2024-09-19T06:40:31.473 INFO:tasks.workunit.client.0.smithi099.stdout:2/112: symlink d1/d2/d5/d6/l26 0 2024-09-19T06:40:31.474 INFO:tasks.workunit.client.0.smithi099.stdout:1/176: creat d0/db/f38 x:0 0 0 2024-09-19T06:40:31.475 INFO:tasks.workunit.client.1.smithi117.stdout:8/373: mknod d1d/d2a/d3f/d4c/c7d 0 2024-09-19T06:40:31.476 INFO:tasks.workunit.client.0.smithi099.stdout:2/113: rmdir d1/d2/d5/d13 39 2024-09-19T06:40:31.477 INFO:tasks.workunit.client.1.smithi117.stdout:6/227: getdents d1/d14 0 2024-09-19T06:40:31.477 INFO:tasks.workunit.client.1.smithi117.stdout:8/374: mknod d1d/d1e/d3b/c7e 0 2024-09-19T06:40:31.479 INFO:tasks.workunit.client.0.smithi099.stdout:7/239: creat d7/d39/f59 x:0 0 0 2024-09-19T06:40:31.480 INFO:tasks.workunit.client.0.smithi099.stdout:2/114: mkdir d1/d2/d5/d8/d18/d27 0 2024-09-19T06:40:31.481 INFO:tasks.workunit.client.0.smithi099.stdout:2/115: write d1/f15 [4546155,74369] 0 2024-09-19T06:40:31.482 INFO:tasks.workunit.client.1.smithi117.stdout:8/375: creat d1d/d2a/d3f/d4b/d5f/d7c/f7f x:0 0 0 2024-09-19T06:40:31.482 INFO:tasks.workunit.client.0.smithi099.stdout:7/240: mknod d7/dd/d29/c5a 0 2024-09-19T06:40:31.483 INFO:tasks.workunit.client.1.smithi117.stdout:6/228: read d1/d3/fd [5559070,69805] 0 2024-09-19T06:40:31.484 INFO:tasks.workunit.client.1.smithi117.stdout:6/229: write d1/d14/f23 [1110650,52568] 0 2024-09-19T06:40:31.484 INFO:tasks.workunit.client.1.smithi117.stdout:8/376: fdatasync d1d/d1e/f2c 0 2024-09-19T06:40:31.485 INFO:tasks.workunit.client.1.smithi117.stdout:6/230: dread - d1/d3/f37 zero size 2024-09-19T06:40:31.486 INFO:tasks.workunit.client.0.smithi099.stdout:2/116: unlink d1/d2/d5/d8/d9/c1c 0 2024-09-19T06:40:31.486 INFO:tasks.workunit.client.0.smithi099.stdout:7/241: dread d7/dd/d29/d1f/f21 [0,4194304] 0 2024-09-19T06:40:31.487 INFO:tasks.workunit.client.1.smithi117.stdout:6/231: dread d1/d14/f2b [0,4194304] 0 2024-09-19T06:40:31.489 INFO:tasks.workunit.client.1.smithi117.stdout:6/232: read d1/d3/f20 [1327821,16954] 0 2024-09-19T06:40:31.489 INFO:tasks.workunit.client.1.smithi117.stdout:8/377: dread d1d/d2a/d3f/d4b/d66/d67/f78 [0,4194304] 0 2024-09-19T06:40:31.490 INFO:tasks.workunit.client.0.smithi099.stdout:7/242: unlink d7/f25 0 2024-09-19T06:40:31.491 INFO:tasks.workunit.client.1.smithi117.stdout:6/233: symlink d1/d5/d32/l38 0 2024-09-19T06:40:31.493 INFO:tasks.workunit.client.0.smithi099.stdout:2/117: getdents d1/d2/d5 0 2024-09-19T06:40:31.493 INFO:tasks.workunit.client.1.smithi117.stdout:6/234: read - d1/d3/f37 zero size 2024-09-19T06:40:31.493 INFO:tasks.workunit.client.1.smithi117.stdout:8/378: mknod d1d/d1e/d53/d6e/c80 0 2024-09-19T06:40:31.494 INFO:tasks.workunit.client.1.smithi117.stdout:8/379: chown d1d/d2a/d3f/f72 22471974 1 2024-09-19T06:40:31.495 INFO:tasks.workunit.client.1.smithi117.stdout:8/380: stat d1d/d2a/d3f/d4c 0 2024-09-19T06:40:31.497 INFO:tasks.workunit.client.0.smithi099.stdout:2/118: dread d1/d2/d5/d8/f11 [0,4194304] 0 2024-09-19T06:40:31.497 INFO:tasks.workunit.client.1.smithi117.stdout:6/235: dread d1/d14/f2e [4194304,4194304] 0 2024-09-19T06:40:31.498 INFO:tasks.workunit.client.1.smithi117.stdout:6/236: readlink d1/d5/d32/l38 0 2024-09-19T06:40:31.499 INFO:tasks.workunit.client.0.smithi099.stdout:5/375: dwrite d3/d2a/f32 [0,4194304] 0 2024-09-19T06:40:31.499 INFO:tasks.workunit.client.1.smithi117.stdout:8/381: getdents d1d/d2a/d3f/d4b/d66 0 2024-09-19T06:40:31.500 INFO:tasks.workunit.client.0.smithi099.stdout:2/119: symlink d1/d2/d5/d8/dc/l28 0 2024-09-19T06:40:31.500 INFO:tasks.workunit.client.0.smithi099.stdout:5/376: read d3/f37 [670463,107191] 0 2024-09-19T06:40:31.501 INFO:tasks.workunit.client.0.smithi099.stdout:9/201: truncate dd/d2c/f21 2442119 0 2024-09-19T06:40:31.502 INFO:tasks.workunit.client.0.smithi099.stdout:2/120: read - d1/f25 zero size 2024-09-19T06:40:31.503 INFO:tasks.workunit.client.1.smithi117.stdout:6/237: link d1/f18 d1/d5/f39 0 2024-09-19T06:40:31.506 INFO:tasks.workunit.client.1.smithi117.stdout:8/382: dread d1d/d1e/f1f [0,4194304] 0 2024-09-19T06:40:31.507 INFO:tasks.workunit.client.0.smithi099.stdout:9/202: truncate dd/d10/f36 747924 0 2024-09-19T06:40:31.508 INFO:tasks.workunit.client.1.smithi117.stdout:8/383: read d1d/f27 [1835532,96753] 0 2024-09-19T06:40:31.509 INFO:tasks.workunit.client.0.smithi099.stdout:0/190: truncate d0/db/f14 1704202 0 2024-09-19T06:40:31.510 INFO:tasks.workunit.client.1.smithi117.stdout:8/384: mknod d1d/d1e/d3b/c81 0 2024-09-19T06:40:31.511 INFO:tasks.workunit.client.1.smithi117.stdout:6/238: link d1/d5/d32/c31 d1/d14/c3a 0 2024-09-19T06:40:31.511 INFO:tasks.workunit.client.0.smithi099.stdout:2/121: dwrite d1/f15 [0,4194304] 0 2024-09-19T06:40:31.511 INFO:tasks.workunit.client.0.smithi099.stdout:5/377: dwrite d3/d16/d2f/d34/d3c/f6d [0,4194304] 0 2024-09-19T06:40:31.512 INFO:tasks.workunit.client.1.smithi117.stdout:6/239: truncate d1/d5/d8/f19 4225845 0 2024-09-19T06:40:31.513 INFO:tasks.workunit.client.1.smithi117.stdout:8/385: creat d1d/d1e/d53/f82 x:0 0 0 2024-09-19T06:40:31.515 INFO:tasks.workunit.client.0.smithi099.stdout:0/191: mknod d0/d17/c3b 0 2024-09-19T06:40:31.515 INFO:tasks.workunit.client.1.smithi117.stdout:6/240: mknod d1/d3/c3b 0 2024-09-19T06:40:31.518 INFO:tasks.workunit.client.0.smithi099.stdout:1/177: write d0/db/dd/f2c [96757,33807] 0 2024-09-19T06:40:31.518 INFO:tasks.workunit.client.0.smithi099.stdout:7/243: truncate d7/f26 3526004 0 2024-09-19T06:40:31.518 INFO:tasks.workunit.client.1.smithi117.stdout:8/386: rename d1d/d2a/d3f/d4b/d5f/d69 to d1d/d31/d83 0 2024-09-19T06:40:31.520 INFO:tasks.workunit.client.0.smithi099.stdout:1/178: stat d0/d12/c36 0 2024-09-19T06:40:31.520 INFO:tasks.workunit.client.0.smithi099.stdout:2/122: symlink d1/d2/d5/d8/dc/l29 0 2024-09-19T06:40:31.520 INFO:tasks.workunit.client.1.smithi117.stdout:6/241: creat d1/f3c x:0 0 0 2024-09-19T06:40:31.523 INFO:tasks.workunit.client.1.smithi117.stdout:6/242: mkdir d1/d3d 0 2024-09-19T06:40:31.523 INFO:tasks.workunit.client.1.smithi117.stdout:6/243: stat d1 0 2024-09-19T06:40:31.524 INFO:tasks.workunit.client.1.smithi117.stdout:8/387: dread d1d/d1e/d29/f51 [0,4194304] 0 2024-09-19T06:40:31.525 INFO:tasks.workunit.client.1.smithi117.stdout:8/388: truncate d1d/f50 708826 0 2024-09-19T06:40:31.525 INFO:tasks.workunit.client.0.smithi099.stdout:9/203: dwrite dd/d10/f2e [0,4194304] 0 2024-09-19T06:40:31.525 INFO:tasks.workunit.client.1.smithi117.stdout:6/244: rmdir d1/d3 39 2024-09-19T06:40:31.527 INFO:tasks.workunit.client.1.smithi117.stdout:6/245: write d1/f3c [473195,129002] 0 2024-09-19T06:40:31.527 INFO:tasks.workunit.client.0.smithi099.stdout:5/378: link d3/d16/f6e d3/d7/d47/f88 0 2024-09-19T06:40:31.528 INFO:tasks.workunit.client.0.smithi099.stdout:0/192: mkdir d0/db/d13/d37/d3c 0 2024-09-19T06:40:31.528 INFO:tasks.workunit.client.1.smithi117.stdout:8/389: unlink d1d/d1e/d29/f48 0 2024-09-19T06:40:31.529 INFO:tasks.workunit.client.0.smithi099.stdout:7/244: dread d7/dd/d29/f4a [0,4194304] 0 2024-09-19T06:40:31.532 INFO:tasks.workunit.client.1.smithi117.stdout:8/390: creat d1d/d2a/f84 x:0 0 0 2024-09-19T06:40:31.533 INFO:tasks.workunit.client.0.smithi099.stdout:0/193: creat d0/db/d13/d29/f3d x:0 0 0 2024-09-19T06:40:31.533 INFO:tasks.workunit.client.1.smithi117.stdout:6/246: creat d1/d3/f3e x:0 0 0 2024-09-19T06:40:31.535 INFO:tasks.workunit.client.0.smithi099.stdout:0/194: fdatasync d0/db/f23 0 2024-09-19T06:40:31.535 INFO:tasks.workunit.client.1.smithi117.stdout:8/391: creat d1d/d2a/d3f/d73/f85 x:0 0 0 2024-09-19T06:40:31.535 INFO:tasks.workunit.client.0.smithi099.stdout:7/245: unlink d7/dd/d29/d1f/d45/d48/f57 0 2024-09-19T06:40:31.536 INFO:tasks.workunit.client.0.smithi099.stdout:2/123: link d1/d2/d5/d8/dc/c14 d1/d2/d5/d8/d18/c2a 0 2024-09-19T06:40:31.536 INFO:tasks.workunit.client.1.smithi117.stdout:8/392: chown d1d/d2a/d3f/d4b/f6b 564 1 2024-09-19T06:40:31.536 INFO:tasks.workunit.client.1.smithi117.stdout:6/247: unlink d1/d5/c24 0 2024-09-19T06:40:31.538 INFO:tasks.workunit.client.0.smithi099.stdout:0/195: mkdir d0/db/d13/d37/d3c/d3e 0 2024-09-19T06:40:31.539 INFO:tasks.workunit.client.1.smithi117.stdout:8/393: mknod d1d/c86 0 2024-09-19T06:40:31.539 INFO:tasks.workunit.client.0.smithi099.stdout:5/379: dwrite d3/d16/d2f/d34/d3c/f6d [0,4194304] 0 2024-09-19T06:40:31.539 INFO:tasks.workunit.client.1.smithi117.stdout:8/394: truncate f1a 162285 0 2024-09-19T06:40:31.539 INFO:tasks.workunit.client.1.smithi117.stdout:6/248: mkdir d1/d3f 0 2024-09-19T06:40:31.540 INFO:tasks.workunit.client.1.smithi117.stdout:6/249: fdatasync d1/d3/f12 0 2024-09-19T06:40:31.540 INFO:tasks.workunit.client.0.smithi099.stdout:0/196: truncate d0/db/d13/d29/f2d 634736 0 2024-09-19T06:40:31.541 INFO:tasks.workunit.client.0.smithi099.stdout:0/197: chown d0/db/d13/d1f 27712427 1 2024-09-19T06:40:31.542 INFO:tasks.workunit.client.1.smithi117.stdout:8/395: symlink d1d/d2a/d3f/d4b/d5f/l87 0 2024-09-19T06:40:31.542 INFO:tasks.workunit.client.0.smithi099.stdout:5/380: creat d3/d16/d2f/f89 x:0 0 0 2024-09-19T06:40:31.543 INFO:tasks.workunit.client.1.smithi117.stdout:6/250: creat d1/d5/f40 x:0 0 0 2024-09-19T06:40:31.543 INFO:tasks.workunit.client.0.smithi099.stdout:5/381: dread - d3/d16/d2f/f89 zero size 2024-09-19T06:40:31.547 INFO:tasks.workunit.client.0.smithi099.stdout:5/382: creat d3/d16/d2f/d34/d3c/d65/f8a x:0 0 0 2024-09-19T06:40:31.547 INFO:tasks.workunit.client.0.smithi099.stdout:0/198: dread d0/db/d13/d1f/f28 [0,4194304] 0 2024-09-19T06:40:31.549 INFO:tasks.workunit.client.0.smithi099.stdout:0/199: truncate d0/db/f23 4742248 0 2024-09-19T06:40:31.587 INFO:tasks.workunit.client.1.smithi117.stdout:8/396: getdents d1d/d1e/d29 0 2024-09-19T06:40:31.587 INFO:tasks.workunit.client.1.smithi117.stdout:8/397: symlink d1d/d2a/d3f/d4b/d5f/d7c/l88 0 2024-09-19T06:40:31.587 INFO:tasks.workunit.client.1.smithi117.stdout:8/398: dread d1d/d2a/f62 [0,4194304] 0 2024-09-19T06:40:31.587 INFO:tasks.workunit.client.1.smithi117.stdout:8/399: chown d1d/d2a/d3f/d4b/d5f/d7c/l88 1939 1 2024-09-19T06:40:31.587 INFO:tasks.workunit.client.1.smithi117.stdout:8/400: rename d1d/f24 to d1d/d1e/d29/f89 0 2024-09-19T06:40:31.587 INFO:tasks.workunit.client.1.smithi117.stdout:6/251: truncate d1/d5/d8/f19 3616649 0 2024-09-19T06:40:31.588 INFO:tasks.workunit.client.1.smithi117.stdout:8/401: getdents d1d/d2a/d3f/d4b 0 2024-09-19T06:40:31.588 INFO:tasks.workunit.client.1.smithi117.stdout:8/402: chown d1d/d1e/f1f 1864 1 2024-09-19T06:40:31.588 INFO:tasks.workunit.client.1.smithi117.stdout:8/403: truncate d1d/d1e/f2c 3271636 0 2024-09-19T06:40:31.588 INFO:tasks.workunit.client.1.smithi117.stdout:8/404: truncate d1d/d2a/d3f/d4c/f6a 3087965 0 2024-09-19T06:40:31.589 INFO:tasks.workunit.client.0.smithi099.stdout:0/200: truncate d0/f11 4892456 0 2024-09-19T06:40:31.590 INFO:tasks.workunit.client.0.smithi099.stdout:9/204: rename dd/d2c/f21 to dd/f37 0 2024-09-19T06:40:31.590 INFO:tasks.workunit.client.0.smithi099.stdout:5/383: dwrite d3/d16/d2f/d34/d3c/d65/f84 [0,4194304] 0 2024-09-19T06:40:31.590 INFO:tasks.workunit.client.0.smithi099.stdout:0/201: mkdir d0/db/d36/d3f 0 2024-09-19T06:40:31.590 INFO:tasks.workunit.client.0.smithi099.stdout:5/384: creat d3/d2a/f8b x:0 0 0 2024-09-19T06:40:31.590 INFO:tasks.workunit.client.0.smithi099.stdout:0/202: write d0/db/f23 [240962,36400] 0 2024-09-19T06:40:31.590 INFO:tasks.workunit.client.0.smithi099.stdout:9/205: creat dd/d2c/d27/f38 x:0 0 0 2024-09-19T06:40:31.590 INFO:tasks.workunit.client.0.smithi099.stdout:5/385: mkdir d3/d16/d2f/d8c 0 2024-09-19T06:40:31.590 INFO:tasks.workunit.client.0.smithi099.stdout:0/203: truncate d0/f1b 1486475 0 2024-09-19T06:40:31.590 INFO:tasks.workunit.client.0.smithi099.stdout:7/246: rmdir d7/dd/d29/d1f/d45/d48 39 2024-09-19T06:40:31.590 INFO:tasks.workunit.client.0.smithi099.stdout:7/247: truncate d7/d39/f59 336466 0 2024-09-19T06:40:31.591 INFO:tasks.workunit.client.0.smithi099.stdout:9/206: creat dd/d2c/f39 x:0 0 0 2024-09-19T06:40:31.591 INFO:tasks.workunit.client.0.smithi099.stdout:1/179: dread d0/d12/d13/f1b [0,4194304] 0 2024-09-19T06:40:31.591 INFO:tasks.workunit.client.0.smithi099.stdout:5/386: rename d3/d7/d47 to d3/d1f/d8d 0 2024-09-19T06:40:31.591 INFO:tasks.workunit.client.0.smithi099.stdout:7/248: dread d7/f49 [0,4194304] 0 2024-09-19T06:40:31.591 INFO:tasks.workunit.client.0.smithi099.stdout:7/249: dread f4 [0,4194304] 0 2024-09-19T06:40:31.591 INFO:tasks.workunit.client.0.smithi099.stdout:7/250: dread - d7/dd/d29/d1f/f55 zero size 2024-09-19T06:40:31.591 INFO:tasks.workunit.client.0.smithi099.stdout:9/207: link dd/d2c/f30 dd/d2c/d27/f3a 0 2024-09-19T06:40:31.591 INFO:tasks.workunit.client.0.smithi099.stdout:1/180: mknod d0/d17/d24/c39 0 2024-09-19T06:40:31.591 INFO:tasks.workunit.client.0.smithi099.stdout:7/251: write d7/dd/d29/f23 [1771887,116533] 0 2024-09-19T06:40:31.591 INFO:tasks.workunit.client.0.smithi099.stdout:9/208: creat dd/d2c/d27/f3b x:0 0 0 2024-09-19T06:40:31.591 INFO:tasks.workunit.client.0.smithi099.stdout:1/181: mkdir d0/d17/d24/d3a 0 2024-09-19T06:40:31.591 INFO:tasks.workunit.client.0.smithi099.stdout:5/387: rmdir d3/d1f/d8d 39 2024-09-19T06:40:31.592 INFO:tasks.workunit.client.0.smithi099.stdout:9/209: mknod dd/d2c/c3c 0 2024-09-19T06:40:31.592 INFO:tasks.workunit.client.1.smithi117.stdout:8/405: symlink d1d/d1e/d53/d6e/l8a 0 2024-09-19T06:40:31.592 INFO:tasks.workunit.client.1.smithi117.stdout:6/252: dwrite d1/d5/d8/f19 [4194304,4194304] 0 2024-09-19T06:40:31.593 INFO:tasks.workunit.client.0.smithi099.stdout:9/210: stat dd/f37 0 2024-09-19T06:40:31.593 INFO:tasks.workunit.client.1.smithi117.stdout:8/406: link cc d1d/d1e/d3b/c8b 0 2024-09-19T06:40:31.594 INFO:tasks.workunit.client.0.smithi099.stdout:7/252: getdents d7/dd/d29/d4e/d53 0 2024-09-19T06:40:31.594 INFO:tasks.workunit.client.0.smithi099.stdout:9/211: readlink dd/d2c/d27/l28 0 2024-09-19T06:40:31.595 INFO:tasks.workunit.client.0.smithi099.stdout:5/388: link d3/f6a d3/d1f/f8e 0 2024-09-19T06:40:31.596 INFO:tasks.workunit.client.1.smithi117.stdout:8/407: mknod d1d/d1e/d53/d6e/c8c 0 2024-09-19T06:40:31.597 INFO:tasks.workunit.client.0.smithi099.stdout:5/389: write d3/d7/f11 [62206,60298] 0 2024-09-19T06:40:31.597 INFO:tasks.workunit.client.0.smithi099.stdout:9/212: symlink dd/l3d 0 2024-09-19T06:40:31.598 INFO:tasks.workunit.client.0.smithi099.stdout:9/213: chown dd 8624 1 2024-09-19T06:40:31.598 INFO:tasks.workunit.client.0.smithi099.stdout:5/390: dread - d3/d7/f80 zero size 2024-09-19T06:40:31.599 INFO:tasks.workunit.client.0.smithi099.stdout:9/214: fdatasync dd/d10/f11 0 2024-09-19T06:40:31.600 INFO:tasks.workunit.client.0.smithi099.stdout:7/253: creat d7/dd/d29/d1f/d45/f5b x:0 0 0 2024-09-19T06:40:31.602 INFO:tasks.workunit.client.0.smithi099.stdout:5/391: symlink d3/d16/d2f/d34/d3c/l8f 0 2024-09-19T06:40:31.602 INFO:tasks.workunit.client.1.smithi117.stdout:2/297: sync 2024-09-19T06:40:31.602 INFO:tasks.workunit.client.0.smithi099.stdout:9/215: symlink dd/d10/l3e 0 2024-09-19T06:40:31.605 INFO:tasks.workunit.client.0.smithi099.stdout:5/392: write d3/d1f/f8e [500885,10126] 0 2024-09-19T06:40:31.606 INFO:tasks.workunit.client.0.smithi099.stdout:7/254: link d7/dd/d29/f33 d7/dd/d29/d4e/d53/f5c 0 2024-09-19T06:40:31.606 INFO:tasks.workunit.client.1.smithi117.stdout:6/253: dread d1/f18 [4194304,4194304] 0 2024-09-19T06:40:31.608 INFO:tasks.workunit.client.0.smithi099.stdout:5/393: rmdir d3/d16/d2f/d34/d3c/d65 39 2024-09-19T06:40:31.608 INFO:tasks.workunit.client.1.smithi117.stdout:6/254: unlink d1/d5/c1e 0 2024-09-19T06:40:31.610 INFO:tasks.workunit.client.0.smithi099.stdout:7/255: creat d7/dd/d29/d4e/d53/f5d x:0 0 0 2024-09-19T06:40:31.610 INFO:tasks.workunit.client.1.smithi117.stdout:6/255: unlink d1/d3/f1f 0 2024-09-19T06:40:31.611 INFO:tasks.workunit.client.0.smithi099.stdout:5/394: chown d3/d1f/d8d/f61 1630433803 1 2024-09-19T06:40:31.611 INFO:tasks.workunit.client.1.smithi117.stdout:2/298: write d0/d12/d32/f63 [2792353,95302] 0 2024-09-19T06:40:31.612 INFO:tasks.workunit.client.0.smithi099.stdout:7/256: dread d7/d39/f59 [0,4194304] 0 2024-09-19T06:40:31.612 INFO:tasks.workunit.client.1.smithi117.stdout:6/256: rmdir d1/d5/d8/d27 39 2024-09-19T06:40:31.614 INFO:tasks.workunit.client.1.smithi117.stdout:6/257: read d1/f3c [350710,90633] 0 2024-09-19T06:40:31.615 INFO:tasks.workunit.client.1.smithi117.stdout:8/408: dread d1d/d1e/f2c [0,4194304] 0 2024-09-19T06:40:31.615 INFO:tasks.workunit.client.0.smithi099.stdout:7/257: write d7/dd/d29/f33 [171742,117345] 0 2024-09-19T06:40:31.615 INFO:tasks.workunit.client.1.smithi117.stdout:2/299: mkdir d0/d7/d29/d71 0 2024-09-19T06:40:31.616 INFO:tasks.workunit.client.1.smithi117.stdout:6/258: write d1/d3/f12 [4124056,103429] 0 2024-09-19T06:40:31.616 INFO:tasks.workunit.client.1.smithi117.stdout:8/409: chown d1d/d2a/d3f/c6d 1738509871 1 2024-09-19T06:40:31.617 INFO:tasks.workunit.client.1.smithi117.stdout:6/259: fsync d1/d14/f23 0 2024-09-19T06:40:31.618 INFO:tasks.workunit.client.1.smithi117.stdout:8/410: truncate d1d/d1e/f3e 1031891 0 2024-09-19T06:40:31.619 INFO:tasks.workunit.client.1.smithi117.stdout:6/260: write d1/d3/f17 [2534457,71633] 0 2024-09-19T06:40:31.620 INFO:tasks.workunit.client.0.smithi099.stdout:7/258: getdents d7/dd/d29/d34 0 2024-09-19T06:40:31.620 INFO:tasks.workunit.client.1.smithi117.stdout:8/411: read d1d/d1e/f1f [990403,61637] 0 2024-09-19T06:40:31.627 INFO:tasks.workunit.client.0.smithi099.stdout:7/259: link d7/dd/d29/d1f/f55 d7/dd/d29/d1f/d45/d48/f5e 0 2024-09-19T06:40:31.628 INFO:tasks.workunit.client.0.smithi099.stdout:7/260: rmdir d7/dd/d29/d34 39 2024-09-19T06:40:31.636 INFO:tasks.workunit.client.0.smithi099.stdout:7/261: dwrite d7/dd/d29/f4c [0,4194304] 0 2024-09-19T06:40:31.639 INFO:tasks.workunit.client.0.smithi099.stdout:7/262: symlink d7/dd/d29/l5f 0 2024-09-19T06:40:31.641 INFO:tasks.workunit.client.0.smithi099.stdout:7/263: creat d7/dd/f60 x:0 0 0 2024-09-19T06:40:31.642 INFO:tasks.workunit.client.0.smithi099.stdout:7/264: write d7/dd/d29/d4e/d53/f5c [1117888,117585] 0 2024-09-19T06:40:31.645 INFO:tasks.workunit.client.1.smithi117.stdout:8/412: link d1d/d1e/d29/f43 d1d/d2a/d3f/d4b/d66/f8d 0 2024-09-19T06:40:31.645 INFO:tasks.workunit.client.0.smithi099.stdout:7/265: creat d7/dd/d29/d4e/d53/f61 x:0 0 0 2024-09-19T06:40:31.646 INFO:tasks.workunit.client.0.smithi099.stdout:7/266: stat d7/dd/d29/d1f/l36 0 2024-09-19T06:40:31.647 INFO:tasks.workunit.client.1.smithi117.stdout:6/261: creat d1/f41 x:0 0 0 2024-09-19T06:40:31.649 INFO:tasks.workunit.client.0.smithi099.stdout:7/267: rmdir d7/dd/d29/d4e 39 2024-09-19T06:40:31.649 INFO:tasks.workunit.client.1.smithi117.stdout:2/300: dwrite d0/d7/f8 [0,4194304] 0 2024-09-19T06:40:31.650 INFO:tasks.workunit.client.1.smithi117.stdout:8/413: symlink d1d/d1e/l8e 0 2024-09-19T06:40:31.652 INFO:tasks.workunit.client.1.smithi117.stdout:8/414: symlink d1d/d1e/d53/l8f 0 2024-09-19T06:40:31.653 INFO:tasks.workunit.client.0.smithi099.stdout:7/268: mkdir d7/dd/d29/d34/d62 0 2024-09-19T06:40:31.653 INFO:tasks.workunit.client.0.smithi099.stdout:7/269: chown d7/dd/d29/c5a 70 1 2024-09-19T06:40:31.655 INFO:tasks.workunit.client.1.smithi117.stdout:2/301: rename d0/d7/d29/d35/d61/d65/d66 to d0/d7/d29/d35/d3d/d72 0 2024-09-19T06:40:31.656 INFO:tasks.workunit.client.0.smithi099.stdout:7/270: mkdir d7/dd/d29/d1f/d45/d48/d63 0 2024-09-19T06:40:31.657 INFO:tasks.workunit.client.1.smithi117.stdout:8/415: mknod d1d/d1e/d3b/c90 0 2024-09-19T06:40:31.658 INFO:tasks.workunit.client.1.smithi117.stdout:2/302: chown d0/f6 14385 1 2024-09-19T06:40:31.658 INFO:tasks.workunit.client.0.smithi099.stdout:7/271: unlink d7/dd/d29/d1f/f21 0 2024-09-19T06:40:31.659 INFO:tasks.workunit.client.0.smithi099.stdout:7/272: readlink d7/d39/l3a 0 2024-09-19T06:40:31.660 INFO:tasks.workunit.client.1.smithi117.stdout:8/416: truncate d1d/d2a/f62 303770 0 2024-09-19T06:40:31.663 INFO:tasks.workunit.client.0.smithi099.stdout:7/273: rename d7/dd/d29/d34/d62 to d7/dd/d29/d4e/d53/d64 0 2024-09-19T06:40:31.664 INFO:tasks.workunit.client.0.smithi099.stdout:7/274: fsync d7/f32 0 2024-09-19T06:40:31.666 INFO:tasks.workunit.client.0.smithi099.stdout:7/275: creat d7/dd/d29/d4e/d53/d64/f65 x:0 0 0 2024-09-19T06:40:31.668 INFO:tasks.workunit.client.0.smithi099.stdout:7/276: creat d7/dd/d29/d4e/d53/f66 x:0 0 0 2024-09-19T06:40:31.669 INFO:tasks.workunit.client.0.smithi099.stdout:7/277: write d7/dd/d29/f1e [896439,15119] 0 2024-09-19T06:40:31.671 INFO:tasks.workunit.client.0.smithi099.stdout:7/278: mkdir d7/dd/d29/d4e/d53/d64/d67 0 2024-09-19T06:40:31.682 INFO:tasks.workunit.client.0.smithi099.stdout:7/279: dwrite d7/f26 [0,4194304] 0 2024-09-19T06:40:31.687 INFO:tasks.workunit.client.0.smithi099.stdout:7/280: truncate d7/dd/d29/f4c 2846033 0 2024-09-19T06:40:31.691 INFO:tasks.workunit.client.0.smithi099.stdout:7/281: getdents d7/dd/d29/d1f/d45 0 2024-09-19T06:40:31.692 INFO:tasks.workunit.client.0.smithi099.stdout:7/282: readlink d7/dd/d29/d1f/l43 0 2024-09-19T06:40:31.695 INFO:tasks.workunit.client.0.smithi099.stdout:7/283: creat d7/dd/d29/d4e/d53/d64/f68 x:0 0 0 2024-09-19T06:40:31.702 INFO:tasks.workunit.client.0.smithi099.stdout:7/284: truncate d7/f4d 2828917 0 2024-09-19T06:40:31.707 INFO:tasks.workunit.client.0.smithi099.stdout:7/285: dread d7/dd/d29/f33 [0,4194304] 0 2024-09-19T06:40:31.709 INFO:tasks.workunit.client.0.smithi099.stdout:7/286: symlink d7/dd/d29/d34/l69 0 2024-09-19T06:40:31.722 INFO:tasks.workunit.client.0.smithi099.stdout:7/287: dwrite d7/f4d [0,4194304] 0 2024-09-19T06:40:31.726 INFO:tasks.workunit.client.0.smithi099.stdout:7/288: rename f5 to d7/d39/f6a 0 2024-09-19T06:40:31.727 INFO:tasks.workunit.client.0.smithi099.stdout:7/289: write d7/f2c [2067342,98499] 0 2024-09-19T06:40:31.729 INFO:tasks.workunit.client.0.smithi099.stdout:7/290: creat d7/d39/f6b x:0 0 0 2024-09-19T06:40:31.731 INFO:tasks.workunit.client.0.smithi099.stdout:7/291: mknod d7/dd/d29/d4e/d53/d64/d67/c6c 0 2024-09-19T06:40:31.733 INFO:tasks.workunit.client.0.smithi099.stdout:8/122: sync 2024-09-19T06:40:31.733 INFO:tasks.workunit.client.0.smithi099.stdout:4/231: sync 2024-09-19T06:40:31.733 INFO:tasks.workunit.client.0.smithi099.stdout:3/256: sync 2024-09-19T06:40:31.733 INFO:tasks.workunit.client.0.smithi099.stdout:6/218: sync 2024-09-19T06:40:31.737 INFO:tasks.workunit.client.0.smithi099.stdout:6/219: symlink d1/d5/d24/d2e/d41/l4d 0 2024-09-19T06:40:31.738 INFO:tasks.workunit.client.0.smithi099.stdout:4/232: read d12/f35 [3689289,111937] 0 2024-09-19T06:40:31.738 INFO:tasks.workunit.client.0.smithi099.stdout:7/292: dread d7/dd/d29/d34/f35 [0,4194304] 0 2024-09-19T06:40:31.740 INFO:tasks.workunit.client.0.smithi099.stdout:6/220: dread - d1/d5/f49 zero size 2024-09-19T06:40:31.741 INFO:tasks.workunit.client.0.smithi099.stdout:4/233: truncate ff 1292521 0 2024-09-19T06:40:31.742 INFO:tasks.workunit.client.0.smithi099.stdout:7/293: creat d7/f6d x:0 0 0 2024-09-19T06:40:31.743 INFO:tasks.workunit.client.0.smithi099.stdout:8/123: dread d4/f27 [0,4194304] 0 2024-09-19T06:40:31.744 INFO:tasks.workunit.client.0.smithi099.stdout:7/294: dread - f2 zero size 2024-09-19T06:40:31.744 INFO:tasks.workunit.client.0.smithi099.stdout:4/234: mkdir d12/d58 0 2024-09-19T06:40:31.744 INFO:tasks.workunit.client.0.smithi099.stdout:3/257: dwrite d7/f18 [0,4194304] 0 2024-09-19T06:40:31.745 INFO:tasks.workunit.client.0.smithi099.stdout:8/124: chown d4/de/f1b 740032 1 2024-09-19T06:40:31.749 INFO:tasks.workunit.client.0.smithi099.stdout:3/258: unlink d7/d34/d1d/d36/f2a 0 2024-09-19T06:40:31.750 INFO:tasks.workunit.client.1.smithi117.stdout:8/417: truncate d1d/f52 312678 0 2024-09-19T06:40:31.750 INFO:tasks.workunit.client.0.smithi099.stdout:7/295: creat d7/dd/d29/d4e/d53/d64/f6e x:0 0 0 2024-09-19T06:40:31.750 INFO:tasks.workunit.client.1.smithi117.stdout:8/418: dread - d1d/d1e/d29/f89 zero size 2024-09-19T06:40:31.752 INFO:tasks.workunit.client.0.smithi099.stdout:3/259: write d7/f14 [5067409,87216] 0 2024-09-19T06:40:31.753 INFO:tasks.workunit.client.0.smithi099.stdout:6/221: dwrite d1/f1e [0,4194304] 0 2024-09-19T06:40:31.754 INFO:tasks.workunit.client.0.smithi099.stdout:8/125: getdents d4/d11/d23 0 2024-09-19T06:40:31.755 INFO:tasks.workunit.client.0.smithi099.stdout:7/296: symlink d7/dd/d29/d4e/d53/l6f 0 2024-09-19T06:40:31.756 INFO:tasks.workunit.client.0.smithi099.stdout:7/297: chown d7/d39/f6b 3 1 2024-09-19T06:40:31.757 INFO:tasks.workunit.client.0.smithi099.stdout:7/298: chown d7/dd/c2e 328875 1 2024-09-19T06:40:31.757 INFO:tasks.workunit.client.0.smithi099.stdout:3/260: symlink d7/d34/d28/l3c 0 2024-09-19T06:40:31.757 INFO:tasks.workunit.client.1.smithi117.stdout:8/419: write d1d/d1e/d29/f43 [912199,43440] 0 2024-09-19T06:40:31.759 INFO:tasks.workunit.client.0.smithi099.stdout:8/126: rename d4/f13 to d4/de/d26/f28 0 2024-09-19T06:40:31.760 INFO:tasks.workunit.client.1.smithi117.stdout:8/420: mkdir d1d/d2a/d3f/d4b/d91 0 2024-09-19T06:40:31.761 INFO:tasks.workunit.client.0.smithi099.stdout:7/299: unlink d7/f49 0 2024-09-19T06:40:31.763 INFO:tasks.workunit.client.1.smithi117.stdout:8/421: write d1d/d2a/d3f/d4b/d66/f8d [1328147,125150] 0 2024-09-19T06:40:31.763 INFO:tasks.workunit.client.0.smithi099.stdout:7/300: write d7/dd/d29/d4e/d53/f61 [292130,114496] 0 2024-09-19T06:40:31.765 INFO:tasks.workunit.client.1.smithi117.stdout:8/422: rmdir d1d/d2a/d3f/d4b 39 2024-09-19T06:40:31.765 INFO:tasks.workunit.client.1.smithi117.stdout:2/303: dread d0/d7/d1e/d20/f48 [0,4194304] 0 2024-09-19T06:40:31.765 INFO:tasks.workunit.client.0.smithi099.stdout:3/261: chown d7/d34/d1d/d36/l2f 4519 1 2024-09-19T06:40:31.766 INFO:tasks.workunit.client.0.smithi099.stdout:3/262: chown d7/d34/f1f 6 1 2024-09-19T06:40:31.767 INFO:tasks.workunit.client.0.smithi099.stdout:3/263: read - d7/d34/f3a zero size 2024-09-19T06:40:31.767 INFO:tasks.workunit.client.1.smithi117.stdout:2/304: mknod d0/d12/d32/c73 0 2024-09-19T06:40:31.769 INFO:tasks.workunit.client.1.smithi117.stdout:2/305: chown d0/d12/d32/f4b 299734705 1 2024-09-19T06:40:31.769 INFO:tasks.workunit.client.1.smithi117.stdout:8/423: dread f4 [0,4194304] 0 2024-09-19T06:40:31.769 INFO:tasks.workunit.client.0.smithi099.stdout:4/235: dread d12/d32/f27 [0,4194304] 0 2024-09-19T06:40:31.770 INFO:tasks.workunit.client.0.smithi099.stdout:8/127: rename d4/f9 to d4/de/d10/f29 0 2024-09-19T06:40:31.770 INFO:tasks.workunit.client.0.smithi099.stdout:7/301: stat d7/f15 0 2024-09-19T06:40:31.771 INFO:tasks.workunit.client.0.smithi099.stdout:3/264: creat d7/d34/f3d x:0 0 0 2024-09-19T06:40:31.771 INFO:tasks.workunit.client.1.smithi117.stdout:8/424: readlink d1d/d1e/l8e 0 2024-09-19T06:40:31.771 INFO:tasks.workunit.client.1.smithi117.stdout:2/306: mknod d0/d12/d2f/c74 0 2024-09-19T06:40:31.771 INFO:tasks.workunit.client.1.smithi117.stdout:8/425: readlink d1d/d2a/d3f/d4b/d5f/d7c/l88 0 2024-09-19T06:40:31.772 INFO:tasks.workunit.client.0.smithi099.stdout:8/128: symlink d4/de/d10/l2a 0 2024-09-19T06:40:31.772 INFO:tasks.workunit.client.0.smithi099.stdout:7/302: readlink d7/l1a 0 2024-09-19T06:40:31.774 INFO:tasks.workunit.client.0.smithi099.stdout:8/129: mkdir d4/de/d26/d2b 0 2024-09-19T06:40:31.776 INFO:tasks.workunit.client.0.smithi099.stdout:7/303: link d7/dd/d29/f3c d7/dd/d29/d34/f70 0 2024-09-19T06:40:31.778 INFO:tasks.workunit.client.1.smithi117.stdout:8/426: dwrite d1d/d1e/d29/f6f [0,4194304] 0 2024-09-19T06:40:31.779 INFO:tasks.workunit.client.1.smithi117.stdout:2/307: write d0/d7/d29/d35/d3d/f43 [1997666,26062] 0 2024-09-19T06:40:31.782 INFO:tasks.workunit.client.1.smithi117.stdout:8/427: creat d1d/d1e/d53/d6e/f92 x:0 0 0 2024-09-19T06:40:31.784 INFO:tasks.workunit.client.0.smithi099.stdout:3/265: rmdir d7/d34 39 2024-09-19T06:40:31.788 INFO:tasks.workunit.client.0.smithi099.stdout:8/130: dwrite d4/de/f1b [0,4194304] 0 2024-09-19T06:40:31.789 INFO:tasks.workunit.client.1.smithi117.stdout:8/428: write d1d/d1e/f2c [2347239,12223] 0 2024-09-19T06:40:31.790 INFO:tasks.workunit.client.0.smithi099.stdout:6/222: dwrite d1/d12/f27 [0,4194304] 0 2024-09-19T06:40:31.791 INFO:tasks.workunit.client.0.smithi099.stdout:7/304: dwrite d7/f4d [0,4194304] 0 2024-09-19T06:40:31.793 INFO:tasks.workunit.client.0.smithi099.stdout:3/266: write d7/f12 [6231039,19199] 0 2024-09-19T06:40:31.793 INFO:tasks.workunit.client.0.smithi099.stdout:8/131: mknod d4/c2c 0 2024-09-19T06:40:31.798 INFO:tasks.workunit.client.1.smithi117.stdout:8/429: dwrite d1d/d2a/d3f/d4b/f6b [0,4194304] 0 2024-09-19T06:40:31.800 INFO:tasks.workunit.client.0.smithi099.stdout:6/223: rename d1/d5/d38/d3c to d1/d5/d24/d2e/d41/d4e 0 2024-09-19T06:40:31.800 INFO:tasks.workunit.client.1.smithi117.stdout:8/430: dread f1a [0,4194304] 0 2024-09-19T06:40:31.800 INFO:tasks.workunit.client.1.smithi117.stdout:2/308: dread d0/f2a [0,4194304] 0 2024-09-19T06:40:31.801 INFO:tasks.workunit.client.0.smithi099.stdout:8/132: dread d4/de/d10/f20 [0,4194304] 0 2024-09-19T06:40:31.801 INFO:tasks.workunit.client.0.smithi099.stdout:4/236: dread d12/f35 [0,4194304] 0 2024-09-19T06:40:31.803 INFO:tasks.workunit.client.0.smithi099.stdout:4/237: read - d12/d32/f48 zero size 2024-09-19T06:40:31.803 INFO:tasks.workunit.client.0.smithi099.stdout:3/267: fdatasync d7/d34/d1d/d36/f33 0 2024-09-19T06:40:31.803 INFO:tasks.workunit.client.0.smithi099.stdout:8/133: write d4/de/f1b [4133661,32469] 0 2024-09-19T06:40:31.805 INFO:tasks.workunit.client.0.smithi099.stdout:4/238: stat d12/d1b/d1c/f26 0 2024-09-19T06:40:31.806 INFO:tasks.workunit.client.0.smithi099.stdout:8/134: mknod d4/c2d 0 2024-09-19T06:40:31.807 INFO:tasks.workunit.client.0.smithi099.stdout:6/224: dread d1/f1e [0,4194304] 0 2024-09-19T06:40:31.808 INFO:tasks.workunit.client.0.smithi099.stdout:4/239: creat d12/d32/d42/f59 x:0 0 0 2024-09-19T06:40:31.809 INFO:tasks.workunit.client.0.smithi099.stdout:6/225: dread - d1/d5/f42 zero size 2024-09-19T06:40:31.809 INFO:tasks.workunit.client.0.smithi099.stdout:4/240: chown d12/d1b/d1c 42558 1 2024-09-19T06:40:31.809 INFO:tasks.workunit.client.1.smithi117.stdout:2/309: link d0/d7/d29/d35/d3d/d72/c6c d0/d7/d1e/d20/d3e/c75 0 2024-09-19T06:40:31.810 INFO:tasks.workunit.client.0.smithi099.stdout:3/268: link d7/d34/c35 d7/d34/d1d/d36/c3e 0 2024-09-19T06:40:31.810 INFO:tasks.workunit.client.1.smithi117.stdout:2/310: fdatasync d0/d7/d29/f68 0 2024-09-19T06:40:31.810 INFO:tasks.workunit.client.0.smithi099.stdout:8/135: mknod d4/de/d26/d2b/c2e 0 2024-09-19T06:40:31.811 INFO:tasks.workunit.client.0.smithi099.stdout:4/241: symlink d12/d1b/d1c/l5a 0 2024-09-19T06:40:31.812 INFO:tasks.workunit.client.0.smithi099.stdout:8/136: truncate d4/de/d10/f24 862810 0 2024-09-19T06:40:31.814 INFO:tasks.workunit.client.1.smithi117.stdout:2/311: link d0/d7/d29/c5d d0/d7/d29/d71/c76 0 2024-09-19T06:40:31.821 INFO:tasks.workunit.client.0.smithi099.stdout:3/269: dwrite d7/d34/f3a [0,4194304] 0 2024-09-19T06:40:31.822 INFO:tasks.workunit.client.0.smithi099.stdout:7/305: write d7/f15 [998944,46774] 0 2024-09-19T06:40:31.823 INFO:tasks.workunit.client.0.smithi099.stdout:4/242: dread d12/d1b/d1c/f26 [0,4194304] 0 2024-09-19T06:40:31.824 INFO:tasks.workunit.client.1.smithi117.stdout:2/312: rename d0/fb to d0/d7/d29/d35/f77 0 2024-09-19T06:40:31.826 INFO:tasks.workunit.client.0.smithi099.stdout:7/306: read d7/dd/d29/f16 [1391898,92546] 0 2024-09-19T06:40:31.826 INFO:tasks.workunit.client.0.smithi099.stdout:8/137: dwrite d4/de/d1c/f1d [0,4194304] 0 2024-09-19T06:40:31.827 INFO:tasks.workunit.client.0.smithi099.stdout:4/243: rmdir d12 39 2024-09-19T06:40:31.828 INFO:tasks.workunit.client.0.smithi099.stdout:8/138: chown d4/d11/f21 18 1 2024-09-19T06:40:31.829 INFO:tasks.workunit.client.0.smithi099.stdout:3/270: mkdir d7/d34/d1d/d20/d3f 0 2024-09-19T06:40:31.829 INFO:tasks.workunit.client.1.smithi117.stdout:2/313: unlink d0/f2a 0 2024-09-19T06:40:31.829 INFO:tasks.workunit.client.1.smithi117.stdout:2/314: readlink d0/l1 0 2024-09-19T06:40:31.830 INFO:tasks.workunit.client.0.smithi099.stdout:7/307: write d7/d39/f6b [588511,73339] 0 2024-09-19T06:40:31.835 INFO:tasks.workunit.client.0.smithi099.stdout:8/139: rename c1 to d4/de/c2f 0 2024-09-19T06:40:31.835 INFO:tasks.workunit.client.1.smithi117.stdout:2/315: dwrite d0/f2b [4194304,4194304] 0 2024-09-19T06:40:31.837 INFO:tasks.workunit.client.0.smithi099.stdout:8/140: read - d4/d11/f21 zero size 2024-09-19T06:40:31.838 INFO:tasks.workunit.client.0.smithi099.stdout:8/141: stat d4/d11/d23 0 2024-09-19T06:40:31.839 INFO:tasks.workunit.client.0.smithi099.stdout:7/308: dwrite d7/dd/d29/d4e/d53/f66 [0,4194304] 0 2024-09-19T06:40:31.841 INFO:tasks.workunit.client.1.smithi117.stdout:2/316: rename d0/d7/f2d to d0/d12/f78 0 2024-09-19T06:40:31.842 INFO:tasks.workunit.client.0.smithi099.stdout:4/244: link d12/d1b/f44 d12/d32/f5b 0 2024-09-19T06:40:31.846 INFO:tasks.workunit.client.0.smithi099.stdout:8/142: rename d4/de/f1b to d4/f30 0 2024-09-19T06:40:31.846 INFO:tasks.workunit.client.0.smithi099.stdout:7/309: mkdir d7/dd/d29/d1f/d45/d48/d63/d71 0 2024-09-19T06:40:31.847 INFO:tasks.workunit.client.1.smithi117.stdout:2/317: dwrite d0/f5e [0,4194304] 0 2024-09-19T06:40:31.849 INFO:tasks.workunit.client.0.smithi099.stdout:4/245: rename d12/d1b/d1c to d12/d32/d42/d5c 0 2024-09-19T06:40:31.850 INFO:tasks.workunit.client.1.smithi117.stdout:2/318: stat d0/d7/d29/d35/f77 0 2024-09-19T06:40:31.852 INFO:tasks.workunit.client.1.smithi117.stdout:2/319: symlink d0/d7/d29/d35/d3d/l79 0 2024-09-19T06:40:31.856 INFO:tasks.workunit.client.0.smithi099.stdout:8/143: dwrite d4/d11/f1f [0,4194304] 0 2024-09-19T06:40:31.858 INFO:tasks.workunit.client.0.smithi099.stdout:8/144: write d4/de/d1c/f1d [3464362,30711] 0 2024-09-19T06:40:31.858 INFO:tasks.workunit.client.0.smithi099.stdout:4/246: read d12/f30 [1683126,49149] 0 2024-09-19T06:40:31.858 INFO:tasks.workunit.client.0.smithi099.stdout:7/310: rename d7/c1b to d7/dd/d29/c72 0 2024-09-19T06:40:31.861 INFO:tasks.workunit.client.0.smithi099.stdout:3/271: dread d7/d34/f1b [0,4194304] 0 2024-09-19T06:40:31.861 INFO:tasks.workunit.client.0.smithi099.stdout:8/145: creat d4/d11/d23/f31 x:0 0 0 2024-09-19T06:40:31.862 INFO:tasks.workunit.client.0.smithi099.stdout:3/272: dread - d7/d34/f3d zero size 2024-09-19T06:40:31.863 INFO:tasks.workunit.client.0.smithi099.stdout:8/146: dread - d4/d11/d23/f25 zero size 2024-09-19T06:40:31.864 INFO:tasks.workunit.client.0.smithi099.stdout:3/273: read d7/d34/f3a [4054252,81465] 0 2024-09-19T06:40:31.864 INFO:tasks.workunit.client.0.smithi099.stdout:4/247: dread d12/f35 [0,4194304] 0 2024-09-19T06:40:31.865 INFO:tasks.workunit.client.0.smithi099.stdout:7/311: getdents d7/dd/d29/d4e 0 2024-09-19T06:40:31.869 INFO:tasks.workunit.client.0.smithi099.stdout:8/147: rename d4/d11/d23/f25 to d4/de/d26/d2b/f32 0 2024-09-19T06:40:31.870 INFO:tasks.workunit.client.0.smithi099.stdout:8/148: stat d4/f17 0 2024-09-19T06:40:31.870 INFO:tasks.workunit.client.0.smithi099.stdout:8/149: read d4/f27 [725078,31912] 0 2024-09-19T06:40:31.871 INFO:tasks.workunit.client.1.smithi117.stdout:2/320: dread d0/d7/d1e/f41 [0,4194304] 0 2024-09-19T06:40:31.871 INFO:tasks.workunit.client.0.smithi099.stdout:8/150: stat d4/fa 0 2024-09-19T06:40:31.871 INFO:tasks.workunit.client.0.smithi099.stdout:8/151: read d4/de/f12 [42894,77508] 0 2024-09-19T06:40:31.872 INFO:tasks.workunit.client.1.smithi117.stdout:2/321: symlink d0/d7/d29/d71/l7a 0 2024-09-19T06:40:31.873 INFO:tasks.workunit.client.0.smithi099.stdout:3/274: rename d7/d34/d1d/f21 to d7/d34/d1d/d20/d3f/f40 0 2024-09-19T06:40:31.874 INFO:tasks.workunit.client.1.smithi117.stdout:2/322: truncate d0/d7/d1e/d20/d3e/f4a 4458523 0 2024-09-19T06:40:31.876 INFO:tasks.workunit.client.0.smithi099.stdout:8/152: mknod d4/de/d26/c33 0 2024-09-19T06:40:31.877 INFO:tasks.workunit.client.1.smithi117.stdout:2/323: unlink d0/d7/d29/c5d 0 2024-09-19T06:40:31.877 INFO:tasks.workunit.client.0.smithi099.stdout:4/248: write d12/f30 [4679704,2413] 0 2024-09-19T06:40:31.879 INFO:tasks.workunit.client.0.smithi099.stdout:3/275: dwrite d7/d34/d1d/d36/f26 [0,4194304] 0 2024-09-19T06:40:31.879 INFO:tasks.workunit.client.0.smithi099.stdout:8/153: write d4/de/d10/f24 [1008028,3087] 0 2024-09-19T06:40:31.879 INFO:tasks.workunit.client.1.smithi117.stdout:2/324: read d0/d7/d1e/d20/d3e/f50 [3807297,86063] 0 2024-09-19T06:40:31.880 INFO:tasks.workunit.client.1.smithi117.stdout:2/325: fsync d0/f2b 0 2024-09-19T06:40:31.882 INFO:tasks.workunit.client.1.smithi117.stdout:2/326: chown d0/d7/d1e/d20/d3e/c75 121 1 2024-09-19T06:40:31.883 INFO:tasks.workunit.client.0.smithi099.stdout:7/312: getdents d7 0 2024-09-19T06:40:31.884 INFO:tasks.workunit.client.0.smithi099.stdout:8/154: symlink d4/de/l34 0 2024-09-19T06:40:31.885 INFO:tasks.workunit.client.1.smithi117.stdout:2/327: unlink d0/l26 0 2024-09-19T06:40:31.885 INFO:tasks.workunit.client.0.smithi099.stdout:3/276: write d7/f14 [6000959,35136] 0 2024-09-19T06:40:31.888 INFO:tasks.workunit.client.1.smithi117.stdout:2/328: creat d0/d7/d1e/d20/f7b x:0 0 0 2024-09-19T06:40:31.888 INFO:tasks.workunit.client.0.smithi099.stdout:7/313: dread - d7/dd/d29/d4e/d53/f5d zero size 2024-09-19T06:40:31.889 INFO:tasks.workunit.client.0.smithi099.stdout:4/249: dwrite d12/d32/d39/f40 [0,4194304] 0 2024-09-19T06:40:31.891 INFO:tasks.workunit.client.1.smithi117.stdout:2/329: symlink d0/d7/d29/d35/d61/d65/l7c 0 2024-09-19T06:40:31.891 INFO:tasks.workunit.client.0.smithi099.stdout:8/155: rename d4/de/l34 to d4/d11/l35 0 2024-09-19T06:40:31.892 INFO:tasks.workunit.client.0.smithi099.stdout:3/277: symlink d7/l41 0 2024-09-19T06:40:31.893 INFO:tasks.workunit.client.0.smithi099.stdout:4/250: fsync f10 0 2024-09-19T06:40:31.893 INFO:tasks.workunit.client.0.smithi099.stdout:3/278: write d7/f14 [4663790,12081] 0 2024-09-19T06:40:31.894 INFO:tasks.workunit.client.0.smithi099.stdout:7/314: creat d7/dd/d29/d4e/f73 x:0 0 0 2024-09-19T06:40:31.895 INFO:tasks.workunit.client.0.smithi099.stdout:8/156: mknod d4/de/d1c/c36 0 2024-09-19T06:40:31.898 INFO:tasks.workunit.client.0.smithi099.stdout:4/251: creat d12/d32/d42/d5c/f5d x:0 0 0 2024-09-19T06:40:31.898 INFO:tasks.workunit.client.1.smithi117.stdout:2/330: dwrite d0/d7/d1e/d20/f7b [0,4194304] 0 2024-09-19T06:40:31.898 INFO:tasks.workunit.client.0.smithi099.stdout:4/252: stat d12/d32/d39/f40 0 2024-09-19T06:40:31.901 INFO:tasks.workunit.client.1.smithi117.stdout:2/331: read - d0/d12/d2f/f45 zero size 2024-09-19T06:40:31.902 INFO:tasks.workunit.client.0.smithi099.stdout:7/315: truncate d7/dd/d29/f3c 2004163 0 2024-09-19T06:40:31.905 INFO:tasks.workunit.client.1.smithi117.stdout:2/332: mkdir d0/d12/d32/d7d 0 2024-09-19T06:40:31.906 INFO:tasks.workunit.client.0.smithi099.stdout:7/316: rmdir d7/dd/d29/d4e 39 2024-09-19T06:40:31.908 INFO:tasks.workunit.client.1.smithi117.stdout:2/333: symlink d0/d7/l7e 0 2024-09-19T06:40:31.908 INFO:tasks.workunit.client.0.smithi099.stdout:4/253: rmdir d12/d32/d42 39 2024-09-19T06:40:31.908 INFO:tasks.workunit.client.0.smithi099.stdout:3/279: dwrite d7/d34/d1d/d36/f38 [4194304,4194304] 0 2024-09-19T06:40:31.909 INFO:tasks.workunit.client.0.smithi099.stdout:8/157: dwrite d4/de/d26/f28 [0,4194304] 0 2024-09-19T06:40:31.914 INFO:tasks.workunit.client.0.smithi099.stdout:8/158: creat d4/de/f37 x:0 0 0 2024-09-19T06:40:31.916 INFO:tasks.workunit.client.0.smithi099.stdout:4/254: rename d12/d1b/c20 to d12/d58/c5e 0 2024-09-19T06:40:31.918 INFO:tasks.workunit.client.0.smithi099.stdout:8/159: mkdir d4/d11/d38 0 2024-09-19T06:40:31.918 INFO:tasks.workunit.client.0.smithi099.stdout:7/317: link d7/dd/d29/d1f/l36 d7/dd/d29/d1f/d45/d48/l74 0 2024-09-19T06:40:31.919 INFO:tasks.workunit.client.0.smithi099.stdout:8/160: write d4/f17 [611354,87204] 0 2024-09-19T06:40:31.919 INFO:tasks.workunit.client.0.smithi099.stdout:3/280: rename d7/d34/d1d/d20/d3f to d7/d34/d1d/d36/d42 0 2024-09-19T06:40:31.922 INFO:tasks.workunit.client.0.smithi099.stdout:4/255: write d12/d32/d42/f56 [1654729,82309] 0 2024-09-19T06:40:31.925 INFO:tasks.workunit.client.0.smithi099.stdout:3/281: creat d7/d34/d1d/d36/d42/f43 x:0 0 0 2024-09-19T06:40:31.925 INFO:tasks.workunit.client.0.smithi099.stdout:3/282: dread - d7/d34/d1d/d36/d42/f40 zero size 2024-09-19T06:40:31.926 INFO:tasks.workunit.client.0.smithi099.stdout:3/283: write d7/d34/f1f [4939258,18686] 0 2024-09-19T06:40:31.927 INFO:tasks.workunit.client.0.smithi099.stdout:3/284: fsync d7/d34/d28/f30 0 2024-09-19T06:40:31.927 INFO:tasks.workunit.client.0.smithi099.stdout:8/161: link d4/de/d10/f29 d4/de/d14/f39 0 2024-09-19T06:40:31.928 INFO:tasks.workunit.client.0.smithi099.stdout:8/162: chown d4/f17 2107955 1 2024-09-19T06:40:31.928 INFO:tasks.workunit.client.0.smithi099.stdout:8/163: readlink d4/de/d10/l2a 0 2024-09-19T06:40:31.929 INFO:tasks.workunit.client.0.smithi099.stdout:3/285: mknod d7/d34/d1d/d36/d42/c44 0 2024-09-19T06:40:31.930 INFO:tasks.workunit.client.0.smithi099.stdout:8/164: symlink d4/d11/d23/l3a 0 2024-09-19T06:40:31.933 INFO:tasks.workunit.client.0.smithi099.stdout:8/165: fsync d4/de/d26/d2b/f32 0 2024-09-19T06:40:31.933 INFO:tasks.workunit.client.0.smithi099.stdout:3/286: write d7/f1a [2523502,80234] 0 2024-09-19T06:40:31.933 INFO:tasks.workunit.client.1.smithi117.stdout:1/300: sync 2024-09-19T06:40:31.934 INFO:tasks.workunit.client.1.smithi117.stdout:3/385: sync 2024-09-19T06:40:31.934 INFO:tasks.workunit.client.1.smithi117.stdout:7/300: sync 2024-09-19T06:40:31.934 INFO:tasks.workunit.client.1.smithi117.stdout:0/270: sync 2024-09-19T06:40:31.934 INFO:tasks.workunit.client.1.smithi117.stdout:9/317: sync 2024-09-19T06:40:31.934 INFO:tasks.workunit.client.0.smithi099.stdout:4/256: dwrite d12/d32/d42/f55 [0,4194304] 0 2024-09-19T06:40:31.935 INFO:tasks.workunit.client.1.smithi117.stdout:1/301: fdatasync d3/f9 0 2024-09-19T06:40:31.935 INFO:tasks.workunit.client.1.smithi117.stdout:3/386: chown d0/d19 1936 1 2024-09-19T06:40:31.936 INFO:tasks.workunit.client.1.smithi117.stdout:0/271: chown d11/d13/d14/d2c/f50 36265614 1 2024-09-19T06:40:31.937 INFO:tasks.workunit.client.1.smithi117.stdout:7/301: creat d1/d8/d24/f69 x:0 0 0 2024-09-19T06:40:31.938 INFO:tasks.workunit.client.0.smithi099.stdout:1/182: sync 2024-09-19T06:40:31.938 INFO:tasks.workunit.client.0.smithi099.stdout:0/204: sync 2024-09-19T06:40:31.939 INFO:tasks.workunit.client.0.smithi099.stdout:2/124: sync 2024-09-19T06:40:31.939 INFO:tasks.workunit.client.0.smithi099.stdout:5/395: sync 2024-09-19T06:40:31.939 INFO:tasks.workunit.client.0.smithi099.stdout:9/216: sync 2024-09-19T06:40:31.939 INFO:tasks.workunit.client.0.smithi099.stdout:3/287: unlink d7/fa 0 2024-09-19T06:40:31.939 INFO:tasks.workunit.client.1.smithi117.stdout:1/302: mkdir d3/d22/d2f/d64 0 2024-09-19T06:40:31.941 INFO:tasks.workunit.client.1.smithi117.stdout:9/318: symlink d4/d1c/d54/l66 0 2024-09-19T06:40:31.941 INFO:tasks.workunit.client.0.smithi099.stdout:8/166: dread d4/de/d10/f24 [0,4194304] 0 2024-09-19T06:40:31.941 INFO:tasks.workunit.client.0.smithi099.stdout:3/288: chown d7/d34/d1d/d20/f31 18654 1 2024-09-19T06:40:31.943 INFO:tasks.workunit.client.0.smithi099.stdout:2/125: write d1/d2/d5/d8/d9/ff [1384007,123104] 0 2024-09-19T06:40:31.943 INFO:tasks.workunit.client.1.smithi117.stdout:3/387: rename d0/d9/d4e/l65 to d0/d3d/l75 0 2024-09-19T06:40:31.947 INFO:tasks.workunit.client.0.smithi099.stdout:9/217: read dd/d10/f11 [2918245,127520] 0 2024-09-19T06:40:31.948 INFO:tasks.workunit.client.0.smithi099.stdout:5/396: mkdir d3/d7/d90 0 2024-09-19T06:40:31.949 INFO:tasks.workunit.client.1.smithi117.stdout:3/388: creat d0/d3d/d68/f76 x:0 0 0 2024-09-19T06:40:31.949 INFO:tasks.workunit.client.1.smithi117.stdout:7/302: dwrite d1/d8/d24/d26/f2f [0,4194304] 0 2024-09-19T06:40:31.950 INFO:tasks.workunit.client.1.smithi117.stdout:9/319: link d4/d1c/f1f d4/d58/f67 0 2024-09-19T06:40:31.950 INFO:tasks.workunit.client.1.smithi117.stdout:1/303: dread d3/d22/f33 [0,4194304] 0 2024-09-19T06:40:31.950 INFO:tasks.workunit.client.1.smithi117.stdout:3/389: chown d0/d9 0 1 2024-09-19T06:40:31.950 INFO:tasks.workunit.client.1.smithi117.stdout:2/334: dread d0/ff [0,4194304] 0 2024-09-19T06:40:31.951 INFO:tasks.workunit.client.0.smithi099.stdout:1/183: fsync d0/d12/d13/f1b 0 2024-09-19T06:40:31.951 INFO:tasks.workunit.client.1.smithi117.stdout:7/303: dread - d1/d4a/f5d zero size 2024-09-19T06:40:31.952 INFO:tasks.workunit.client.1.smithi117.stdout:3/390: chown d0/f15 13 1 2024-09-19T06:40:31.952 INFO:tasks.workunit.client.1.smithi117.stdout:9/320: dread - d4/df/d52/f62 zero size 2024-09-19T06:40:31.953 INFO:tasks.workunit.client.0.smithi099.stdout:0/205: dwrite d0/f2a [4194304,4194304] 0 2024-09-19T06:40:31.954 INFO:tasks.workunit.client.0.smithi099.stdout:4/257: rename d12/d32/d42/d5c/l5a to d12/d1b/l5f 0 2024-09-19T06:40:31.954 INFO:tasks.workunit.client.1.smithi117.stdout:7/304: read d1/d8/d24/f6 [2507273,76016] 0 2024-09-19T06:40:31.956 INFO:tasks.workunit.client.0.smithi099.stdout:3/289: creat d7/d34/d1d/d20/f45 x:0 0 0 2024-09-19T06:40:31.957 INFO:tasks.workunit.client.1.smithi117.stdout:1/304: read d3/f5 [2309037,78383] 0 2024-09-19T06:40:31.957 INFO:tasks.workunit.client.0.smithi099.stdout:8/167: dwrite d4/fa [0,4194304] 0 2024-09-19T06:40:31.958 INFO:tasks.workunit.client.1.smithi117.stdout:3/391: dread d0/d19/f3e [0,4194304] 0 2024-09-19T06:40:31.958 INFO:tasks.workunit.client.1.smithi117.stdout:1/305: chown d3/d18/d56/f47 1022411857 1 2024-09-19T06:40:31.959 INFO:tasks.workunit.client.1.smithi117.stdout:3/392: dread - d0/d8/f73 zero size 2024-09-19T06:40:31.960 INFO:tasks.workunit.client.1.smithi117.stdout:3/393: chown d0/d3d/d48 448 1 2024-09-19T06:40:31.960 INFO:tasks.workunit.client.1.smithi117.stdout:7/305: chown d1/l15 63445 1 2024-09-19T06:40:31.961 INFO:tasks.workunit.client.0.smithi099.stdout:2/126: creat d1/d2/d5/d8/f2b x:0 0 0 2024-09-19T06:40:31.961 INFO:tasks.workunit.client.0.smithi099.stdout:1/184: dread d0/db/dd/f2c [0,4194304] 0 2024-09-19T06:40:31.961 INFO:tasks.workunit.client.1.smithi117.stdout:9/321: creat d4/d58/f68 x:0 0 0 2024-09-19T06:40:31.962 INFO:tasks.workunit.client.1.smithi117.stdout:3/394: write d0/d8/f20 [2557492,47105] 0 2024-09-19T06:40:31.962 INFO:tasks.workunit.client.1.smithi117.stdout:7/306: write d1/d8/f1a [3527164,73665] 0 2024-09-19T06:40:31.962 INFO:tasks.workunit.client.0.smithi099.stdout:7/318: dwrite d7/dd/d29/f4c [0,4194304] 0 2024-09-19T06:40:31.964 INFO:tasks.workunit.client.1.smithi117.stdout:3/395: write d0/d3d/d68/f76 [329925,12283] 0 2024-09-19T06:40:31.965 INFO:tasks.workunit.client.1.smithi117.stdout:1/306: creat d3/d18/d23/f65 x:0 0 0 2024-09-19T06:40:31.966 INFO:tasks.workunit.client.0.smithi099.stdout:9/218: chown dd/c15 0 1 2024-09-19T06:40:31.967 INFO:tasks.workunit.client.1.smithi117.stdout:9/322: mkdir d4/df/d69 0 2024-09-19T06:40:31.969 INFO:tasks.workunit.client.1.smithi117.stdout:1/307: creat d3/d18/d23/f66 x:0 0 0 2024-09-19T06:40:31.971 INFO:tasks.workunit.client.0.smithi099.stdout:3/290: rename l0 to d7/d34/d28/l46 0 2024-09-19T06:40:31.972 INFO:tasks.workunit.client.1.smithi117.stdout:9/323: mkdir d4/d8/d6a 0 2024-09-19T06:40:31.972 INFO:tasks.workunit.client.0.smithi099.stdout:5/397: dwrite d3/d16/d2f/d34/d3c/f49 [0,4194304] 0 2024-09-19T06:40:31.975 INFO:tasks.workunit.client.0.smithi099.stdout:8/168: creat d4/d11/d23/f3b x:0 0 0 2024-09-19T06:40:31.975 INFO:tasks.workunit.client.0.smithi099.stdout:7/319: unlink d7/dd/d29/c3d 0 2024-09-19T06:40:31.976 INFO:tasks.workunit.client.1.smithi117.stdout:1/308: symlink d3/d22/l67 0 2024-09-19T06:40:31.976 INFO:tasks.workunit.client.0.smithi099.stdout:4/258: symlink d12/l60 0 2024-09-19T06:40:31.977 INFO:tasks.workunit.client.1.smithi117.stdout:7/307: link d1/d8/f16 d1/d8/d24/d26/d3e/f6a 0 2024-09-19T06:40:31.979 INFO:tasks.workunit.client.0.smithi099.stdout:4/259: fsync d12/d32/d42/d5c/f5d 0 2024-09-19T06:40:31.980 INFO:tasks.workunit.client.0.smithi099.stdout:3/291: fsync d7/f10 0 2024-09-19T06:40:31.980 INFO:tasks.workunit.client.1.smithi117.stdout:1/309: creat d3/d18/d56/f68 x:0 0 0 2024-09-19T06:40:31.981 INFO:tasks.workunit.client.1.smithi117.stdout:1/310: fdatasync d3/f38 0 2024-09-19T06:40:31.982 INFO:tasks.workunit.client.1.smithi117.stdout:7/308: write d1/d8/d24/d26/d44/f68 [454791,118142] 0 2024-09-19T06:40:31.983 INFO:tasks.workunit.client.1.smithi117.stdout:2/335: truncate d0/d7/f8 5190163 0 2024-09-19T06:40:31.983 INFO:tasks.workunit.client.0.smithi099.stdout:8/169: creat d4/d11/d38/f3c x:0 0 0 2024-09-19T06:40:31.983 INFO:tasks.workunit.client.0.smithi099.stdout:4/260: stat f11 0 2024-09-19T06:40:31.985 INFO:tasks.workunit.client.0.smithi099.stdout:7/320: mkdir d7/dd/d29/d1f/d45/d48/d63/d75 0 2024-09-19T06:40:31.985 INFO:tasks.workunit.client.0.smithi099.stdout:5/398: dwrite d3/d16/f83 [0,4194304] 0 2024-09-19T06:40:31.985 INFO:tasks.workunit.client.0.smithi099.stdout:3/292: mknod d7/d34/c47 0 2024-09-19T06:40:31.986 INFO:tasks.workunit.client.1.smithi117.stdout:1/311: unlink d3/d18/d23/f5d 0 2024-09-19T06:40:31.987 INFO:tasks.workunit.client.0.smithi099.stdout:1/185: link d0/db/c2a d0/d17/d32/c3b 0 2024-09-19T06:40:31.987 INFO:tasks.workunit.client.1.smithi117.stdout:7/309: symlink d1/d8/l6b 0 2024-09-19T06:40:31.988 INFO:tasks.workunit.client.0.smithi099.stdout:8/170: symlink d4/l3d 0 2024-09-19T06:40:31.988 INFO:tasks.workunit.client.1.smithi117.stdout:3/396: dread d0/f5e [0,4194304] 0 2024-09-19T06:40:31.989 INFO:tasks.workunit.client.0.smithi099.stdout:1/186: write d0/d12/d13/f33 [853895,72636] 0 2024-09-19T06:40:31.990 INFO:tasks.workunit.client.0.smithi099.stdout:6/226: sync 2024-09-19T06:40:31.990 INFO:tasks.workunit.client.0.smithi099.stdout:8/171: dread - d4/d11/d38/f3c zero size 2024-09-19T06:40:31.991 INFO:tasks.workunit.client.0.smithi099.stdout:1/187: chown d0/d12/f30 8137 1 2024-09-19T06:40:31.992 INFO:tasks.workunit.client.1.smithi117.stdout:2/336: dwrite d0/f2b [0,4194304] 0 2024-09-19T06:40:31.992 INFO:tasks.workunit.client.1.smithi117.stdout:3/397: write d0/d3d/f4f [1991192,124195] 0 2024-09-19T06:40:31.992 INFO:tasks.workunit.client.0.smithi099.stdout:4/261: link ff d12/d32/f61 0 2024-09-19T06:40:31.993 INFO:tasks.workunit.client.0.smithi099.stdout:8/172: truncate d4/d11/d23/f3b 957626 0 2024-09-19T06:40:31.993 INFO:tasks.workunit.client.0.smithi099.stdout:8/173: read - d4/d11/f21 zero size 2024-09-19T06:40:31.993 INFO:tasks.workunit.client.1.smithi117.stdout:3/398: chown d0/fb 230 1 2024-09-19T06:40:31.994 INFO:tasks.workunit.client.1.smithi117.stdout:7/310: chown d1/d8/f16 1973663 1 2024-09-19T06:40:31.995 INFO:tasks.workunit.client.0.smithi099.stdout:1/188: read - d0/f16 zero size 2024-09-19T06:40:31.997 INFO:tasks.workunit.client.1.smithi117.stdout:2/337: chown d0/d12/d32/c73 0 1 2024-09-19T06:40:31.997 INFO:tasks.workunit.client.0.smithi099.stdout:5/399: rename d3/d7/f4d to d3/d1f/f91 0 2024-09-19T06:40:31.998 INFO:tasks.workunit.client.1.smithi117.stdout:1/312: dwrite d3/f5c [4194304,4194304] 0 2024-09-19T06:40:31.999 INFO:tasks.workunit.client.1.smithi117.stdout:3/399: read d0/d24/f5c [643867,112480] 0 2024-09-19T06:40:31.999 INFO:tasks.workunit.client.1.smithi117.stdout:7/311: creat d1/d8/d24/d49/f6c x:0 0 0 2024-09-19T06:40:32.000 INFO:tasks.workunit.client.1.smithi117.stdout:4/466: sync 2024-09-19T06:40:32.000 INFO:tasks.workunit.client.1.smithi117.stdout:5/361: sync 2024-09-19T06:40:32.000 INFO:tasks.workunit.client.0.smithi099.stdout:6/227: rename d1/fe to d1/f4f 0 2024-09-19T06:40:32.002 INFO:tasks.workunit.client.0.smithi099.stdout:5/400: fdatasync d3/f25 0 2024-09-19T06:40:32.002 INFO:tasks.workunit.client.1.smithi117.stdout:9/324: truncate d4/d1c/f35 4028285 0 2024-09-19T06:40:32.004 INFO:tasks.workunit.client.0.smithi099.stdout:3/293: rename d7/d34/d1d/d20/f31 to d7/d34/d28/f48 0 2024-09-19T06:40:32.004 INFO:tasks.workunit.client.0.smithi099.stdout:6/228: stat d1/d5/d24/d2e/d41/d4e/d2a 0 2024-09-19T06:40:32.007 INFO:tasks.workunit.client.0.smithi099.stdout:1/189: dwrite d0/f21 [0,4194304] 0 2024-09-19T06:40:32.008 INFO:tasks.workunit.client.0.smithi099.stdout:9/219: dread dd/f22 [0,4194304] 0 2024-09-19T06:40:32.009 INFO:tasks.workunit.client.0.smithi099.stdout:5/401: unlink d3/d16/l4a 0 2024-09-19T06:40:32.009 INFO:tasks.workunit.client.0.smithi099.stdout:6/229: write d1/d12/f39 [3381781,113230] 0 2024-09-19T06:40:32.013 INFO:tasks.workunit.client.1.smithi117.stdout:5/362: dwrite d17/d1b/d3a/d3c/f7f [0,4194304] 0 2024-09-19T06:40:32.014 INFO:tasks.workunit.client.0.smithi099.stdout:4/262: dwrite d12/d32/f29 [0,4194304] 0 2024-09-19T06:40:32.016 INFO:tasks.workunit.client.1.smithi117.stdout:1/313: chown d3/f32 0 1 2024-09-19T06:40:32.017 INFO:tasks.workunit.client.0.smithi099.stdout:3/294: dread d7/d34/f1b [0,4194304] 0 2024-09-19T06:40:32.020 INFO:tasks.workunit.client.0.smithi099.stdout:4/263: dread f10 [0,4194304] 0 2024-09-19T06:40:32.022 INFO:tasks.workunit.client.0.smithi099.stdout:4/264: write d12/f50 [533100,64066] 0 2024-09-19T06:40:32.026 INFO:tasks.workunit.client.1.smithi117.stdout:2/338: dwrite d0/d7/d29/f68 [0,4194304] 0 2024-09-19T06:40:32.027 INFO:tasks.workunit.client.0.smithi099.stdout:3/295: rmdir d7 39 2024-09-19T06:40:32.027 INFO:tasks.workunit.client.1.smithi117.stdout:7/312: rename d1/d8/d24/d49/f52 to d1/d8/d24/d1c/d35/f6d 0 2024-09-19T06:40:32.030 INFO:tasks.workunit.client.0.smithi099.stdout:1/190: creat d0/f3c x:0 0 0 2024-09-19T06:40:32.031 INFO:tasks.workunit.client.1.smithi117.stdout:9/325: creat d4/d1c/d46/f6b x:0 0 0 2024-09-19T06:40:32.033 INFO:tasks.workunit.client.1.smithi117.stdout:7/313: readlink d1/d8/d24/d1c/d35/l41 0 2024-09-19T06:40:32.033 INFO:tasks.workunit.client.1.smithi117.stdout:3/400: mkdir d0/d3d/d48/d77 0 2024-09-19T06:40:32.033 INFO:tasks.workunit.client.0.smithi099.stdout:5/402: getdents d3/d14 0 2024-09-19T06:40:32.035 INFO:tasks.workunit.client.1.smithi117.stdout:2/339: fsync d0/d7/d1e/d20/f44 0 2024-09-19T06:40:32.035 INFO:tasks.workunit.client.1.smithi117.stdout:4/467: dwrite d3/d4/f40 [0,4194304] 0 2024-09-19T06:40:32.035 INFO:tasks.workunit.client.1.smithi117.stdout:1/314: symlink d3/d18/l69 0 2024-09-19T06:40:32.036 INFO:tasks.workunit.client.1.smithi117.stdout:7/314: chown d1/f50 4432 1 2024-09-19T06:40:32.038 INFO:tasks.workunit.client.1.smithi117.stdout:4/468: chown d3/db/d20/f36 36646 1 2024-09-19T06:40:32.039 INFO:tasks.workunit.client.1.smithi117.stdout:3/401: creat d0/d19/f78 x:0 0 0 2024-09-19T06:40:32.041 INFO:tasks.workunit.client.0.smithi099.stdout:3/296: unlink d7/d34/d1d/d36/f33 0 2024-09-19T06:40:32.041 INFO:tasks.workunit.client.0.smithi099.stdout:4/265: dwrite d12/f35 [0,4194304] 0 2024-09-19T06:40:32.043 INFO:tasks.workunit.client.0.smithi099.stdout:1/191: creat d0/d12/d13/d37/f3d x:0 0 0 2024-09-19T06:40:32.044 INFO:tasks.workunit.client.1.smithi117.stdout:7/315: symlink d1/d8/d24/d1c/d55/l6e 0 2024-09-19T06:40:32.045 INFO:tasks.workunit.client.0.smithi099.stdout:4/266: dread - d12/d32/f48 zero size 2024-09-19T06:40:32.048 INFO:tasks.workunit.client.0.smithi099.stdout:5/403: dwrite d3/d7/ff [0,4194304] 0 2024-09-19T06:40:32.049 INFO:tasks.workunit.client.1.smithi117.stdout:2/340: mkdir d0/d7/d7f 0 2024-09-19T06:40:32.049 INFO:tasks.workunit.client.1.smithi117.stdout:9/326: creat d4/d1c/d36/f6c x:0 0 0 2024-09-19T06:40:32.050 INFO:tasks.workunit.client.1.smithi117.stdout:4/469: mkdir d3/db/d20/d4a/d7b/da0 0 2024-09-19T06:40:32.050 INFO:tasks.workunit.client.0.smithi099.stdout:5/404: write d3/d1f/f20 [3858896,36351] 0 2024-09-19T06:40:32.052 INFO:tasks.workunit.client.1.smithi117.stdout:3/402: dwrite d0/f15 [4194304,4194304] 0 2024-09-19T06:40:32.053 INFO:tasks.workunit.client.1.smithi117.stdout:3/403: truncate d0/d24/f5c 1240969 0 2024-09-19T06:40:32.054 INFO:tasks.workunit.client.1.smithi117.stdout:3/404: fsync d0/d8/f1a 0 2024-09-19T06:40:32.055 INFO:tasks.workunit.client.1.smithi117.stdout:9/327: symlink d4/d20/l6d 0 2024-09-19T06:40:32.057 INFO:tasks.workunit.client.0.smithi099.stdout:3/297: dwrite d7/d34/d1d/d36/f29 [0,4194304] 0 2024-09-19T06:40:32.057 INFO:tasks.workunit.client.1.smithi117.stdout:2/341: creat d0/d6f/f80 x:0 0 0 2024-09-19T06:40:32.058 INFO:tasks.workunit.client.0.smithi099.stdout:1/192: getdents d0/db/dd 0 2024-09-19T06:40:32.059 INFO:tasks.workunit.client.1.smithi117.stdout:4/470: creat d3/d1b/d63/fa1 x:0 0 0 2024-09-19T06:40:32.062 INFO:tasks.workunit.client.1.smithi117.stdout:3/405: unlink d0/f13 0 2024-09-19T06:40:32.064 INFO:tasks.workunit.client.1.smithi117.stdout:9/328: mkdir d4/d8/d6e 0 2024-09-19T06:40:32.064 INFO:tasks.workunit.client.1.smithi117.stdout:3/406: read d0/d3d/d68/f76 [307946,31807] 0 2024-09-19T06:40:32.065 INFO:tasks.workunit.client.1.smithi117.stdout:7/316: dread d1/d8/d24/d26/d44/f68 [0,4194304] 0 2024-09-19T06:40:32.066 INFO:tasks.workunit.client.0.smithi099.stdout:5/405: dwrite d3/d16/d5e/f63 [0,4194304] 0 2024-09-19T06:40:32.066 INFO:tasks.workunit.client.0.smithi099.stdout:4/267: rename d12/d1b/c4e to d12/d32/c62 0 2024-09-19T06:40:32.068 INFO:tasks.workunit.client.0.smithi099.stdout:3/298: dread d7/f18 [0,4194304] 0 2024-09-19T06:40:32.073 INFO:tasks.workunit.client.0.smithi099.stdout:7/321: getdents d7/dd/d29 0 2024-09-19T06:40:32.073 INFO:tasks.workunit.client.0.smithi099.stdout:1/193: fdatasync d0/db/dd/f1d 0 2024-09-19T06:40:32.073 INFO:tasks.workunit.client.0.smithi099.stdout:0/206: write d0/f1b [2407290,7600] 0 2024-09-19T06:40:32.073 INFO:tasks.workunit.client.1.smithi117.stdout:3/407: unlink d0/d3d/c56 0 2024-09-19T06:40:32.074 INFO:tasks.workunit.client.1.smithi117.stdout:2/342: dwrite d0/d7/d1e/d20/d3e/f50 [0,4194304] 0 2024-09-19T06:40:32.074 INFO:tasks.workunit.client.0.smithi099.stdout:5/406: symlink d3/d14/l92 0 2024-09-19T06:40:32.075 INFO:tasks.workunit.client.0.smithi099.stdout:5/407: dread - d3/d7/f80 zero size 2024-09-19T06:40:32.076 INFO:tasks.workunit.client.0.smithi099.stdout:1/194: dread - d0/db/f23 zero size 2024-09-19T06:40:32.078 INFO:tasks.workunit.client.1.smithi117.stdout:4/471: link d3/d41/f69 d3/d1b/d7d/d9f/fa2 0 2024-09-19T06:40:32.079 INFO:tasks.workunit.client.0.smithi099.stdout:1/195: read d0/d12/d13/f33 [665542,15105] 0 2024-09-19T06:40:32.081 INFO:tasks.workunit.client.1.smithi117.stdout:3/408: rmdir d0/d9/d1c 39 2024-09-19T06:40:32.081 INFO:tasks.workunit.client.1.smithi117.stdout:2/343: symlink d0/d7/d29/d35/d61/d65/l81 0 2024-09-19T06:40:32.082 INFO:tasks.workunit.client.1.smithi117.stdout:2/344: stat d0/d7/d1e/d20/d3e/f50 0 2024-09-19T06:40:32.083 INFO:tasks.workunit.client.0.smithi099.stdout:5/408: chown d3/d16/c72 58505559 1 2024-09-19T06:40:32.084 INFO:tasks.workunit.client.1.smithi117.stdout:5/363: write d17/d1b/d3a/d3c/f57 [295454,65637] 0 2024-09-19T06:40:32.085 INFO:tasks.workunit.client.0.smithi099.stdout:5/409: truncate d3/d1f/f91 988988 0 2024-09-19T06:40:32.087 INFO:tasks.workunit.client.1.smithi117.stdout:4/472: dread d3/d1b/d63/f8c [0,4194304] 0 2024-09-19T06:40:32.087 INFO:tasks.workunit.client.0.smithi099.stdout:9/220: write fa [489390,69134] 0 2024-09-19T06:40:32.088 INFO:tasks.workunit.client.1.smithi117.stdout:3/409: symlink d0/l79 0 2024-09-19T06:40:32.089 INFO:tasks.workunit.client.0.smithi099.stdout:3/299: creat d7/f49 x:0 0 0 2024-09-19T06:40:32.089 INFO:tasks.workunit.client.1.smithi117.stdout:7/317: rename d1/l9 to d1/l6f 0 2024-09-19T06:40:32.089 INFO:tasks.workunit.client.1.smithi117.stdout:4/473: write d3/d65/f75 [875252,49212] 0 2024-09-19T06:40:32.091 INFO:tasks.workunit.client.0.smithi099.stdout:6/230: truncate d1/f19 3249601 0 2024-09-19T06:40:32.092 INFO:tasks.workunit.client.0.smithi099.stdout:4/268: getdents d12/d32/d42 0 2024-09-19T06:40:32.092 INFO:tasks.workunit.client.1.smithi117.stdout:3/410: creat d0/d3d/d68/f7a x:0 0 0 2024-09-19T06:40:32.093 INFO:tasks.workunit.client.1.smithi117.stdout:7/318: creat d1/d3f/f70 x:0 0 0 2024-09-19T06:40:32.093 INFO:tasks.workunit.client.1.smithi117.stdout:7/319: readlink d1/l15 0 2024-09-19T06:40:32.094 INFO:tasks.workunit.client.0.smithi099.stdout:5/410: dwrite d3/d1f/f8e [0,4194304] 0 2024-09-19T06:40:32.095 INFO:tasks.workunit.client.1.smithi117.stdout:4/474: dread d3/d1b/f62 [0,4194304] 0 2024-09-19T06:40:32.095 INFO:tasks.workunit.client.1.smithi117.stdout:2/345: dwrite d0/d7/d1e/d20/f48 [0,4194304] 0 2024-09-19T06:40:32.095 INFO:tasks.workunit.client.1.smithi117.stdout:7/320: readlink d1/d8/d48/d5f/l65 0 2024-09-19T06:40:32.096 INFO:tasks.workunit.client.0.smithi099.stdout:1/196: mknod d0/d12/c3e 0 2024-09-19T06:40:32.098 INFO:tasks.workunit.client.0.smithi099.stdout:6/231: creat d1/d5/f50 x:0 0 0 2024-09-19T06:40:32.101 INFO:tasks.workunit.client.0.smithi099.stdout:5/411: mknod d3/d16/d2f/c93 0 2024-09-19T06:40:32.105 INFO:tasks.workunit.client.0.smithi099.stdout:7/322: write d7/dd/d29/d1f/f55 [732816,118427] 0 2024-09-19T06:40:32.106 INFO:tasks.workunit.client.1.smithi117.stdout:1/315: write d3/f14 [296084,122546] 0 2024-09-19T06:40:32.108 INFO:tasks.workunit.client.1.smithi117.stdout:2/346: unlink d0/d7/d29/d35/c4d 0 2024-09-19T06:40:32.108 INFO:tasks.workunit.client.0.smithi099.stdout:1/197: link d0/d12/d13/f2b d0/d12/d13/d37/f3f 0 2024-09-19T06:40:32.109 INFO:tasks.workunit.client.1.smithi117.stdout:2/347: stat d0/f2b 0 2024-09-19T06:40:32.109 INFO:tasks.workunit.client.1.smithi117.stdout:2/348: write d0/d6f/f80 [985126,19004] 0 2024-09-19T06:40:32.110 INFO:tasks.workunit.client.0.smithi099.stdout:7/323: write d7/f15 [1520753,80018] 0 2024-09-19T06:40:32.110 INFO:tasks.workunit.client.0.smithi099.stdout:9/221: link dd/d2c/f39 dd/d10/f3f 0 2024-09-19T06:40:32.112 INFO:tasks.workunit.client.1.smithi117.stdout:7/321: link d1/c5e d1/c71 0 2024-09-19T06:40:32.113 INFO:tasks.workunit.client.0.smithi099.stdout:6/232: dwrite d1/d5/f33 [0,4194304] 0 2024-09-19T06:40:32.114 INFO:tasks.workunit.client.1.smithi117.stdout:2/349: symlink d0/d7/d1e/l82 0 2024-09-19T06:40:32.114 INFO:tasks.workunit.client.0.smithi099.stdout:3/300: write d7/d34/f3a [3948144,50491] 0 2024-09-19T06:40:32.115 INFO:tasks.workunit.client.0.smithi099.stdout:5/412: creat d3/d1f/f94 x:0 0 0 2024-09-19T06:40:32.116 INFO:tasks.workunit.client.0.smithi099.stdout:4/269: dwrite d12/d32/d42/d5c/f26 [0,4194304] 0 2024-09-19T06:40:32.117 INFO:tasks.workunit.client.0.smithi099.stdout:7/324: stat d7/dd/d29/d4e/d53/l6f 0 2024-09-19T06:40:32.119 INFO:tasks.workunit.client.0.smithi099.stdout:7/325: stat d7/dd/d29/d4e/d53 0 2024-09-19T06:40:32.121 INFO:tasks.workunit.client.1.smithi117.stdout:2/350: write d0/d12/f3c [962439,96501] 0 2024-09-19T06:40:32.121 INFO:tasks.workunit.client.0.smithi099.stdout:7/326: chown d7/f4d 267641 1 2024-09-19T06:40:32.122 INFO:tasks.workunit.client.0.smithi099.stdout:6/233: write d1/d5/d24/d2b/f45 [910404,22388] 0 2024-09-19T06:40:32.122 INFO:tasks.workunit.client.0.smithi099.stdout:4/270: mknod d12/d32/d39/c63 0 2024-09-19T06:40:32.127 INFO:tasks.workunit.client.1.smithi117.stdout:9/329: dwrite d4/d1c/f28 [0,4194304] 0 2024-09-19T06:40:32.128 INFO:tasks.workunit.client.0.smithi099.stdout:3/301: dwrite d7/f10 [0,4194304] 0 2024-09-19T06:40:32.128 INFO:tasks.workunit.client.1.smithi117.stdout:7/322: dwrite d1/d8/d24/d26/f2f [0,4194304] 0 2024-09-19T06:40:32.131 INFO:tasks.workunit.client.1.smithi117.stdout:2/351: creat d0/d7/d1e/d20/d3e/f83 x:0 0 0 2024-09-19T06:40:32.132 INFO:tasks.workunit.client.0.smithi099.stdout:1/198: link d0/db/c10 d0/d17/d24/c40 0 2024-09-19T06:40:32.135 INFO:tasks.workunit.client.0.smithi099.stdout:6/234: dwrite d1/d5/d24/d2b/f45 [0,4194304] 0 2024-09-19T06:40:32.135 INFO:tasks.workunit.client.0.smithi099.stdout:3/302: creat d7/d34/d1d/d36/f4a x:0 0 0 2024-09-19T06:40:32.137 INFO:tasks.workunit.client.0.smithi099.stdout:5/413: getdents d3/d1f/d4f 0 2024-09-19T06:40:32.137 INFO:tasks.workunit.client.0.smithi099.stdout:7/327: symlink d7/dd/d29/d1f/d45/d48/d63/d71/l76 0 2024-09-19T06:40:32.138 INFO:tasks.workunit.client.1.smithi117.stdout:5/364: dread d17/d5c/f69 [0,4194304] 0 2024-09-19T06:40:32.138 INFO:tasks.workunit.client.0.smithi099.stdout:1/199: readlink d0/l35 0 2024-09-19T06:40:32.139 INFO:tasks.workunit.client.1.smithi117.stdout:9/330: write d4/d17/f61 [357993,8105] 0 2024-09-19T06:40:32.139 INFO:tasks.workunit.client.0.smithi099.stdout:6/235: chown d1/l18 34838604 1 2024-09-19T06:40:32.140 INFO:tasks.workunit.client.0.smithi099.stdout:0/207: dread d0/f1b [0,4194304] 0 2024-09-19T06:40:32.141 INFO:tasks.workunit.client.0.smithi099.stdout:7/328: write d7/f41 [7219,73909] 0 2024-09-19T06:40:32.142 INFO:tasks.workunit.client.0.smithi099.stdout:1/200: chown d0/db/f23 918530 1 2024-09-19T06:40:32.142 INFO:tasks.workunit.client.0.smithi099.stdout:5/414: symlink d3/d2a/l95 0 2024-09-19T06:40:32.144 INFO:tasks.workunit.client.1.smithi117.stdout:7/323: dwrite d1/d8/f58 [0,4194304] 0 2024-09-19T06:40:32.146 INFO:tasks.workunit.client.0.smithi099.stdout:9/222: rename dd/d10 to dd/d2c/d27/d40 0 2024-09-19T06:40:32.147 INFO:tasks.workunit.client.0.smithi099.stdout:7/329: dread d7/dd/d29/f2f [0,4194304] 0 2024-09-19T06:40:32.148 INFO:tasks.workunit.client.1.smithi117.stdout:7/324: write d1/d8/d24/d1c/d55/f59 [458970,99947] 0 2024-09-19T06:40:32.148 INFO:tasks.workunit.client.0.smithi099.stdout:1/201: mkdir d0/d12/d13/d37/d41 0 2024-09-19T06:40:32.150 INFO:tasks.workunit.client.0.smithi099.stdout:1/202: fdatasync d0/db/f23 0 2024-09-19T06:40:32.151 INFO:tasks.workunit.client.1.smithi117.stdout:5/365: rename d17/f26 to d17/d2f/f80 0 2024-09-19T06:40:32.152 INFO:tasks.workunit.client.1.smithi117.stdout:1/316: truncate d3/f4c 1416924 0 2024-09-19T06:40:32.152 INFO:tasks.workunit.client.1.smithi117.stdout:9/331: creat d4/d8/d6e/f6f x:0 0 0 2024-09-19T06:40:32.153 INFO:tasks.workunit.client.1.smithi117.stdout:1/317: chown d3/d18/d23/f34 41502 1 2024-09-19T06:40:32.155 INFO:tasks.workunit.client.0.smithi099.stdout:7/330: creat d7/dd/d29/d4e/f77 x:0 0 0 2024-09-19T06:40:32.156 INFO:tasks.workunit.client.0.smithi099.stdout:0/208: dwrite d0/db/d13/d29/f2d [0,4194304] 0 2024-09-19T06:40:32.156 INFO:tasks.workunit.client.0.smithi099.stdout:6/236: write d1/f19 [3622348,29332] 0 2024-09-19T06:40:32.157 INFO:tasks.workunit.client.1.smithi117.stdout:1/318: mknod d3/d22/d2f/c6a 0 2024-09-19T06:40:32.159 INFO:tasks.workunit.client.1.smithi117.stdout:2/352: getdents d0 0 2024-09-19T06:40:32.159 INFO:tasks.workunit.client.0.smithi099.stdout:1/203: chown d0/db/c10 222650 1 2024-09-19T06:40:32.160 INFO:tasks.workunit.client.1.smithi117.stdout:9/332: creat d4/df/d69/f70 x:0 0 0 2024-09-19T06:40:32.161 INFO:tasks.workunit.client.0.smithi099.stdout:7/331: creat d7/dd/d29/d1f/d45/f78 x:0 0 0 2024-09-19T06:40:32.161 INFO:tasks.workunit.client.1.smithi117.stdout:7/325: dwrite d1/d8/d24/d1c/d35/f6d [0,4194304] 0 2024-09-19T06:40:32.161 INFO:tasks.workunit.client.1.smithi117.stdout:1/319: rmdir d3/d18/d56 39 2024-09-19T06:40:32.162 INFO:tasks.workunit.client.1.smithi117.stdout:4/475: dread d3/db/d20/d29/d39/d4f/d8b/f5d [0,4194304] 0 2024-09-19T06:40:32.162 INFO:tasks.workunit.client.0.smithi099.stdout:4/271: rename d12/d1b/c1d to d12/d32/c64 0 2024-09-19T06:40:32.162 INFO:tasks.workunit.client.0.smithi099.stdout:5/415: dread d3/f37 [0,4194304] 0 2024-09-19T06:40:32.163 INFO:tasks.workunit.client.0.smithi099.stdout:6/237: mknod d1/c51 0 2024-09-19T06:40:32.164 INFO:tasks.workunit.client.0.smithi099.stdout:0/209: mknod d0/db/d27/d38/c40 0 2024-09-19T06:40:32.164 INFO:tasks.workunit.client.1.smithi117.stdout:9/333: dread - d4/d58/f68 zero size 2024-09-19T06:40:32.165 INFO:tasks.workunit.client.1.smithi117.stdout:7/326: chown d1/d3f/f70 112588552 1 2024-09-19T06:40:32.165 INFO:tasks.workunit.client.0.smithi099.stdout:7/332: rmdir d7/d39 39 2024-09-19T06:40:32.167 INFO:tasks.workunit.client.0.smithi099.stdout:0/210: truncate d0/db/f23 4769847 0 2024-09-19T06:40:32.168 INFO:tasks.workunit.client.0.smithi099.stdout:3/303: rename d7/f1a to d7/d34/d1d/d20/f4b 0 2024-09-19T06:40:32.168 INFO:tasks.workunit.client.1.smithi117.stdout:9/334: write d4/d1c/d46/f6b [595271,127893] 0 2024-09-19T06:40:32.170 INFO:tasks.workunit.client.1.smithi117.stdout:7/327: dread d1/d8/d24/d26/d44/f68 [0,4194304] 0 2024-09-19T06:40:32.170 INFO:tasks.workunit.client.0.smithi099.stdout:1/204: dwrite d0/f21 [0,4194304] 0 2024-09-19T06:40:32.170 INFO:tasks.workunit.client.0.smithi099.stdout:2/127: sync 2024-09-19T06:40:32.171 INFO:tasks.workunit.client.1.smithi117.stdout:4/476: rmdir d3 39 2024-09-19T06:40:32.171 INFO:tasks.workunit.client.0.smithi099.stdout:5/416: creat d3/d7/f96 x:0 0 0 2024-09-19T06:40:32.172 INFO:tasks.workunit.client.1.smithi117.stdout:1/320: creat d3/d18/d23/f6b x:0 0 0 2024-09-19T06:40:32.172 INFO:tasks.workunit.client.0.smithi099.stdout:6/238: mkdir d1/d5/d52 0 2024-09-19T06:40:32.173 INFO:tasks.workunit.client.1.smithi117.stdout:2/353: dwrite d0/f2b [4194304,4194304] 0 2024-09-19T06:40:32.173 INFO:tasks.workunit.client.1.smithi117.stdout:9/335: dread - d4/d1c/d46/f47 zero size 2024-09-19T06:40:32.176 INFO:tasks.workunit.client.0.smithi099.stdout:7/333: rmdir d7 39 2024-09-19T06:40:32.177 INFO:tasks.workunit.client.1.smithi117.stdout:7/328: rmdir d1 39 2024-09-19T06:40:32.178 INFO:tasks.workunit.client.1.smithi117.stdout:4/477: fsync d3/f90 0 2024-09-19T06:40:32.179 INFO:tasks.workunit.client.0.smithi099.stdout:2/128: stat d1/d2/d5/d8/d18/c2a 0 2024-09-19T06:40:32.180 INFO:tasks.workunit.client.1.smithi117.stdout:1/321: symlink d3/d18/d23/d51/l6c 0 2024-09-19T06:40:32.180 INFO:tasks.workunit.client.1.smithi117.stdout:4/478: write d3/d41/f89 [207673,98172] 0 2024-09-19T06:40:32.180 INFO:tasks.workunit.client.1.smithi117.stdout:9/336: mknod d4/df/d69/c71 0 2024-09-19T06:40:32.180 INFO:tasks.workunit.client.1.smithi117.stdout:1/322: readlink d3/d18/l63 0 2024-09-19T06:40:32.181 INFO:tasks.workunit.client.1.smithi117.stdout:2/354: mknod d0/d7/d29/d35/d61/d65/c84 0 2024-09-19T06:40:32.184 INFO:tasks.workunit.client.1.smithi117.stdout:7/329: chown d1/d8 10 1 2024-09-19T06:40:32.185 INFO:tasks.workunit.client.1.smithi117.stdout:4/479: mkdir d3/db/d20/d29/d39/d4f/d6e/da3 0 2024-09-19T06:40:32.186 INFO:tasks.workunit.client.1.smithi117.stdout:2/355: mknod d0/d7/d1e/c85 0 2024-09-19T06:40:32.187 INFO:tasks.workunit.client.0.smithi099.stdout:0/211: dread d0/db/d13/d29/f2d [0,4194304] 0 2024-09-19T06:40:32.188 INFO:tasks.workunit.client.1.smithi117.stdout:4/480: chown d3/db/d13/c5b 187 1 2024-09-19T06:40:32.188 INFO:tasks.workunit.client.1.smithi117.stdout:7/330: chown d1/d8/f39 167124912 1 2024-09-19T06:40:32.188 INFO:tasks.workunit.client.0.smithi099.stdout:2/129: fsync d1/d2/d5/d8/d9/f1d 0 2024-09-19T06:40:32.189 INFO:tasks.workunit.client.1.smithi117.stdout:1/323: dwrite d3/d18/d23/f4f [0,4194304] 0 2024-09-19T06:40:32.190 INFO:tasks.workunit.client.0.smithi099.stdout:3/304: dwrite d7/d34/d28/f48 [0,4194304] 0 2024-09-19T06:40:32.192 INFO:tasks.workunit.client.1.smithi117.stdout:4/481: symlink d3/db/d20/d4a/la4 0 2024-09-19T06:40:32.193 INFO:tasks.workunit.client.0.smithi099.stdout:5/417: dwrite d3/d2a/f45 [0,4194304] 0 2024-09-19T06:40:32.195 INFO:tasks.workunit.client.0.smithi099.stdout:0/212: write d0/db/d27/f2c [248018,75942] 0 2024-09-19T06:40:32.195 INFO:tasks.workunit.client.0.smithi099.stdout:7/334: creat d7/dd/d29/d4e/d53/d64/d67/f79 x:0 0 0 2024-09-19T06:40:32.197 INFO:tasks.workunit.client.1.smithi117.stdout:7/331: rename d1/d8/d24/d26/d3e to d1/d72 0 2024-09-19T06:40:32.201 INFO:tasks.workunit.client.0.smithi099.stdout:5/418: unlink d3/d16/d2f/d34/d3c/f49 0 2024-09-19T06:40:32.202 INFO:tasks.workunit.client.1.smithi117.stdout:4/482: creat d3/db/fa5 x:0 0 0 2024-09-19T06:40:32.203 INFO:tasks.workunit.client.0.smithi099.stdout:2/130: dread d1/d2/d5/d8/f1a [0,4194304] 0 2024-09-19T06:40:32.203 INFO:tasks.workunit.client.1.smithi117.stdout:7/332: creat d1/d3f/f73 x:0 0 0 2024-09-19T06:40:32.203 INFO:tasks.workunit.client.0.smithi099.stdout:3/305: dwrite d7/f10 [0,4194304] 0 2024-09-19T06:40:32.204 INFO:tasks.workunit.client.0.smithi099.stdout:8/174: sync 2024-09-19T06:40:32.204 INFO:tasks.workunit.client.0.smithi099.stdout:7/335: write d7/d39/f6b [91162,74643] 0 2024-09-19T06:40:32.210 INFO:tasks.workunit.client.0.smithi099.stdout:0/213: unlink d0/db/c21 0 2024-09-19T06:40:32.210 INFO:tasks.workunit.client.0.smithi099.stdout:3/306: write d7/d34/f1f [3195191,87952] 0 2024-09-19T06:40:32.211 INFO:tasks.workunit.client.1.smithi117.stdout:7/333: rmdir d1/d8/d24/d1c/d55 39 2024-09-19T06:40:32.212 INFO:tasks.workunit.client.1.smithi117.stdout:5/366: truncate d17/d2e/d55/f5a 3927017 0 2024-09-19T06:40:32.213 INFO:tasks.workunit.client.1.smithi117.stdout:4/483: dwrite d3/d1b/d7d/d51/f85 [0,4194304] 0 2024-09-19T06:40:32.213 INFO:tasks.workunit.client.0.smithi099.stdout:8/175: mknod d4/d11/d38/c3e 0 2024-09-19T06:40:32.214 INFO:tasks.workunit.client.0.smithi099.stdout:5/419: mknod d3/d1f/c97 0 2024-09-19T06:40:32.216 INFO:tasks.workunit.client.0.smithi099.stdout:0/214: truncate d0/db/d13/d29/f3d 493498 0 2024-09-19T06:40:32.216 INFO:tasks.workunit.client.0.smithi099.stdout:3/307: chown d7/l11 91815236 1 2024-09-19T06:40:32.217 INFO:tasks.workunit.client.1.smithi117.stdout:4/484: write d3/db/d20/d29/d39/f6c [16772,126092] 0 2024-09-19T06:40:32.218 INFO:tasks.workunit.client.0.smithi099.stdout:8/176: mkdir d4/d11/d23/d3f 0 2024-09-19T06:40:32.221 INFO:tasks.workunit.client.0.smithi099.stdout:9/223: truncate dd/fe 3660534 0 2024-09-19T06:40:32.222 INFO:tasks.workunit.client.0.smithi099.stdout:2/131: dwrite d1/d2/d5/d8/d9/f1d [0,4194304] 0 2024-09-19T06:40:32.222 INFO:tasks.workunit.client.0.smithi099.stdout:0/215: truncate d0/f11 5080104 0 2024-09-19T06:40:32.224 INFO:tasks.workunit.client.1.smithi117.stdout:7/334: dwrite d1/d8/d24/f69 [0,4194304] 0 2024-09-19T06:40:32.225 INFO:tasks.workunit.client.0.smithi099.stdout:1/205: dread d0/d12/d13/f22 [0,4194304] 0 2024-09-19T06:40:32.226 INFO:tasks.workunit.client.1.smithi117.stdout:1/324: dread d3/f1b [0,4194304] 0 2024-09-19T06:40:32.226 INFO:tasks.workunit.client.0.smithi099.stdout:8/177: unlink d4/f27 0 2024-09-19T06:40:32.227 INFO:tasks.workunit.client.1.smithi117.stdout:2/356: dread d0/d7/f16 [0,4194304] 0 2024-09-19T06:40:32.228 INFO:tasks.workunit.client.1.smithi117.stdout:7/335: mknod d1/c74 0 2024-09-19T06:40:32.229 INFO:tasks.workunit.client.0.smithi099.stdout:7/336: dwrite d7/dd/d29/f33 [0,4194304] 0 2024-09-19T06:40:32.229 INFO:tasks.workunit.client.0.smithi099.stdout:4/272: write d12/d1b/f44 [2699680,7749] 0 2024-09-19T06:40:32.230 INFO:tasks.workunit.client.1.smithi117.stdout:6/262: sync 2024-09-19T06:40:32.231 INFO:tasks.workunit.client.1.smithi117.stdout:6/263: readlink d1/d5/d32/l33 0 2024-09-19T06:40:32.232 INFO:tasks.workunit.client.1.smithi117.stdout:1/325: mknod d3/d18/d56/c6d 0 2024-09-19T06:40:32.232 INFO:tasks.workunit.client.0.smithi099.stdout:5/420: rename d3/d7/c8 to d3/d16/d2f/d34/d3c/d65/c98 0 2024-09-19T06:40:32.233 INFO:tasks.workunit.client.1.smithi117.stdout:7/336: creat d1/d72/f75 x:0 0 0 2024-09-19T06:40:32.233 INFO:tasks.workunit.client.0.smithi099.stdout:2/132: mkdir d1/d2/d5/d13/d2c 0 2024-09-19T06:40:32.234 INFO:tasks.workunit.client.1.smithi117.stdout:2/357: mknod d0/d12/d32/d7d/c86 0 2024-09-19T06:40:32.234 INFO:tasks.workunit.client.0.smithi099.stdout:6/239: write d1/d5/d24/d2e/f32 [273045,94550] 0 2024-09-19T06:40:32.235 INFO:tasks.workunit.client.1.smithi117.stdout:6/264: rmdir d1 39 2024-09-19T06:40:32.235 INFO:tasks.workunit.client.0.smithi099.stdout:0/216: rmdir d0/db/d36 39 2024-09-19T06:40:32.237 INFO:tasks.workunit.client.0.smithi099.stdout:6/240: truncate d1/d5/d24/d2e/f31 1362316 0 2024-09-19T06:40:32.239 INFO:tasks.workunit.client.0.smithi099.stdout:8/178: creat d4/de/d10/f40 x:0 0 0 2024-09-19T06:40:32.241 INFO:tasks.workunit.client.0.smithi099.stdout:4/273: mknod d12/d32/d39/c65 0 2024-09-19T06:40:32.241 INFO:tasks.workunit.client.0.smithi099.stdout:9/224: symlink dd/d2c/d27/d40/l41 0 2024-09-19T06:40:32.243 INFO:tasks.workunit.client.0.smithi099.stdout:9/225: dread - dd/d2c/d27/d40/f3f zero size 2024-09-19T06:40:32.243 INFO:tasks.workunit.client.1.smithi117.stdout:6/265: unlink d1/d5/d32/l33 0 2024-09-19T06:40:32.244 INFO:tasks.workunit.client.0.smithi099.stdout:1/206: rename d0/f3c to d0/d17/d24/f42 0 2024-09-19T06:40:32.244 INFO:tasks.workunit.client.1.smithi117.stdout:4/485: rmdir d3/db 39 2024-09-19T06:40:32.245 INFO:tasks.workunit.client.0.smithi099.stdout:2/133: mkdir d1/d2/d5/d8/d18/d2d 0 2024-09-19T06:40:32.245 INFO:tasks.workunit.client.0.smithi099.stdout:7/337: rmdir d7/dd/d29/d1f/d45 39 2024-09-19T06:40:32.246 INFO:tasks.workunit.client.1.smithi117.stdout:2/358: dwrite d0/fd [4194304,4194304] 0 2024-09-19T06:40:32.246 INFO:tasks.workunit.client.0.smithi099.stdout:6/241: symlink d1/d5/d24/d2e/d41/l53 0 2024-09-19T06:40:32.248 INFO:tasks.workunit.client.0.smithi099.stdout:8/179: fsync d4/de/f12 0 2024-09-19T06:40:32.249 INFO:tasks.workunit.client.0.smithi099.stdout:8/180: chown d4/de/d10 3454285 1 2024-09-19T06:40:32.252 INFO:tasks.workunit.client.1.smithi117.stdout:7/337: dwrite d1/d72/f75 [0,4194304] 0 2024-09-19T06:40:32.252 INFO:tasks.workunit.client.0.smithi099.stdout:0/217: rename d0/db/d13/d29 to d0/d17/d41 0 2024-09-19T06:40:32.252 INFO:tasks.workunit.client.0.smithi099.stdout:4/274: dread ff [0,4194304] 0 2024-09-19T06:40:32.254 INFO:tasks.workunit.client.0.smithi099.stdout:7/338: dwrite d7/dd/d29/f4c [0,4194304] 0 2024-09-19T06:40:32.254 INFO:tasks.workunit.client.1.smithi117.stdout:2/359: symlink d0/d7/l87 0 2024-09-19T06:40:32.254 INFO:tasks.workunit.client.0.smithi099.stdout:1/207: creat d0/d2d/f43 x:0 0 0 2024-09-19T06:40:32.256 INFO:tasks.workunit.client.0.smithi099.stdout:4/275: write d12/f50 [1098346,37292] 0 2024-09-19T06:40:32.257 INFO:tasks.workunit.client.1.smithi117.stdout:6/266: dread d1/d14/f2e [4194304,4194304] 0 2024-09-19T06:40:32.257 INFO:tasks.workunit.client.0.smithi099.stdout:0/218: write d0/f3 [1632072,72801] 0 2024-09-19T06:40:32.257 INFO:tasks.workunit.client.1.smithi117.stdout:7/338: mknod d1/d8/c76 0 2024-09-19T06:40:32.258 INFO:tasks.workunit.client.0.smithi099.stdout:4/276: read d12/d32/d39/f40 [2106619,27939] 0 2024-09-19T06:40:32.259 INFO:tasks.workunit.client.0.smithi099.stdout:0/219: chown d0/db/d13/d1f/f2b 75 1 2024-09-19T06:40:32.259 INFO:tasks.workunit.client.0.smithi099.stdout:9/226: symlink dd/d2c/d27/d40/l42 0 2024-09-19T06:40:32.262 INFO:tasks.workunit.client.1.smithi117.stdout:6/267: chown d1/d14/c29 8110980 1 2024-09-19T06:40:32.263 INFO:tasks.workunit.client.1.smithi117.stdout:4/486: dwrite d3/db/d20/d29/d39/f6c [0,4194304] 0 2024-09-19T06:40:32.264 INFO:tasks.workunit.client.0.smithi099.stdout:8/181: unlink d4/de/d1c/c36 0 2024-09-19T06:40:32.266 INFO:tasks.workunit.client.1.smithi117.stdout:2/360: creat d0/d6f/f88 x:0 0 0 2024-09-19T06:40:32.267 INFO:tasks.workunit.client.1.smithi117.stdout:7/339: chown d1/d8/d24/d26/d44/f68 230170 1 2024-09-19T06:40:32.267 INFO:tasks.workunit.client.1.smithi117.stdout:7/340: fdatasync d1/f4c 0 2024-09-19T06:40:32.269 INFO:tasks.workunit.client.0.smithi099.stdout:8/182: read d4/f17 [369790,107175] 0 2024-09-19T06:40:32.270 INFO:tasks.workunit.client.1.smithi117.stdout:7/341: write d1/d8/d24/d49/f6c [552819,42264] 0 2024-09-19T06:40:32.273 INFO:tasks.workunit.client.1.smithi117.stdout:7/342: mkdir d1/d4a/d77 0 2024-09-19T06:40:32.275 INFO:tasks.workunit.client.1.smithi117.stdout:6/268: write d1/d3/f9 [23551,90317] 0 2024-09-19T06:40:32.276 INFO:tasks.workunit.client.1.smithi117.stdout:4/487: dread d3/d28/d2a/f8f [0,4194304] 0 2024-09-19T06:40:32.276 INFO:tasks.workunit.client.1.smithi117.stdout:6/269: fsync d1/d5/f40 0 2024-09-19T06:40:32.279 INFO:tasks.workunit.client.1.smithi117.stdout:7/343: creat d1/d8/d24/d26/d44/f78 x:0 0 0 2024-09-19T06:40:32.280 INFO:tasks.workunit.client.0.smithi099.stdout:7/339: dwrite d7/f26 [4194304,4194304] 0 2024-09-19T06:40:32.280 INFO:tasks.workunit.client.1.smithi117.stdout:4/488: chown d3/d1b/d7d/c3f 5158 1 2024-09-19T06:40:32.280 INFO:tasks.workunit.client.1.smithi117.stdout:6/270: chown d1/d5/d8/d27/l2f 0 1 2024-09-19T06:40:32.281 INFO:tasks.workunit.client.1.smithi117.stdout:6/271: stat d1/f1b 0 2024-09-19T06:40:32.281 INFO:tasks.workunit.client.0.smithi099.stdout:3/308: truncate d7/d34/f1f 1469073 0 2024-09-19T06:40:32.282 INFO:tasks.workunit.client.0.smithi099.stdout:8/183: symlink d4/d11/d23/l41 0 2024-09-19T06:40:32.282 INFO:tasks.workunit.client.1.smithi117.stdout:4/489: dread d3/d1b/d63/f8c [0,4194304] 0 2024-09-19T06:40:32.283 INFO:tasks.workunit.client.1.smithi117.stdout:6/272: write d1/d14/f2b [931151,121263] 0 2024-09-19T06:40:32.283 INFO:tasks.workunit.client.0.smithi099.stdout:8/184: chown d4/de/d10 3 1 2024-09-19T06:40:32.283 INFO:tasks.workunit.client.0.smithi099.stdout:3/309: chown d7/d34/d28/l3c 0 1 2024-09-19T06:40:32.286 INFO:tasks.workunit.client.0.smithi099.stdout:8/185: write d4/d11/d23/f31 [252041,70184] 0 2024-09-19T06:40:32.286 INFO:tasks.workunit.client.0.smithi099.stdout:4/277: dwrite fb [4194304,4194304] 0 2024-09-19T06:40:32.288 INFO:tasks.workunit.client.1.smithi117.stdout:4/490: creat d3/db/d20/d35/d79/fa6 x:0 0 0 2024-09-19T06:40:32.291 INFO:tasks.workunit.client.0.smithi099.stdout:9/227: symlink dd/d2c/l43 0 2024-09-19T06:40:32.294 INFO:tasks.workunit.client.1.smithi117.stdout:1/326: dwrite d3/f4c [0,4194304] 0 2024-09-19T06:40:32.295 INFO:tasks.workunit.client.1.smithi117.stdout:1/327: dread - d3/f5e zero size 2024-09-19T06:40:32.295 INFO:tasks.workunit.client.0.smithi099.stdout:7/340: unlink d7/dd/d29/f23 0 2024-09-19T06:40:32.296 INFO:tasks.workunit.client.0.smithi099.stdout:3/310: rmdir d7/d34/d1d/d36 39 2024-09-19T06:40:32.297 INFO:tasks.workunit.client.1.smithi117.stdout:1/328: truncate d3/d22/f2a 1577916 0 2024-09-19T06:40:32.298 INFO:tasks.workunit.client.1.smithi117.stdout:4/491: dwrite d3/db/d20/d29/d39/d4f/f72 [0,4194304] 0 2024-09-19T06:40:32.299 INFO:tasks.workunit.client.0.smithi099.stdout:8/186: rename d4/l5 to d4/d11/l42 0 2024-09-19T06:40:32.300 INFO:tasks.workunit.client.1.smithi117.stdout:1/329: write d3/d22/f5f [677879,69290] 0 2024-09-19T06:40:32.301 INFO:tasks.workunit.client.0.smithi099.stdout:4/278: mknod d12/d32/d42/c66 0 2024-09-19T06:40:32.301 INFO:tasks.workunit.client.0.smithi099.stdout:4/279: fsync d12/d32/d42/d5c/f5d 0 2024-09-19T06:40:32.302 INFO:tasks.workunit.client.1.smithi117.stdout:1/330: symlink d3/d18/d23/d51/l6e 0 2024-09-19T06:40:32.303 INFO:tasks.workunit.client.1.smithi117.stdout:1/331: chown d3/d18 35 1 2024-09-19T06:40:32.304 INFO:tasks.workunit.client.1.smithi117.stdout:4/492: link d3/db/d20/d35/d79/fa6 d3/d1b/d7d/d51/d95/fa7 0 2024-09-19T06:40:32.304 INFO:tasks.workunit.client.0.smithi099.stdout:1/208: getdents d0/d12/d13 0 2024-09-19T06:40:32.305 INFO:tasks.workunit.client.1.smithi117.stdout:1/332: fdatasync d3/f10 0 2024-09-19T06:40:32.305 INFO:tasks.workunit.client.0.smithi099.stdout:1/209: stat d0/d12/d13/f1b 0 2024-09-19T06:40:32.305 INFO:tasks.workunit.client.0.smithi099.stdout:8/187: mknod d4/de/d10/c43 0 2024-09-19T06:40:32.306 INFO:tasks.workunit.client.1.smithi117.stdout:4/493: creat d3/d1b/d63/fa8 x:0 0 0 2024-09-19T06:40:32.306 INFO:tasks.workunit.client.0.smithi099.stdout:7/341: readlink d7/dd/d29/d1f/l46 0 2024-09-19T06:40:32.307 INFO:tasks.workunit.client.0.smithi099.stdout:3/311: creat d7/d34/d1d/d36/f4c x:0 0 0 2024-09-19T06:40:32.308 INFO:tasks.workunit.client.0.smithi099.stdout:1/210: symlink d0/d12/d13/d37/l44 0 2024-09-19T06:40:32.310 INFO:tasks.workunit.client.0.smithi099.stdout:9/228: rename dd/d2c/d27/f3a to dd/f44 0 2024-09-19T06:40:32.310 INFO:tasks.workunit.client.1.smithi117.stdout:4/494: link d3/db/d20/d29/l64 d3/db/d20/d29/la9 0 2024-09-19T06:40:32.311 INFO:tasks.workunit.client.0.smithi099.stdout:8/188: mkdir d4/d11/d23/d3f/d44 0 2024-09-19T06:40:32.311 INFO:tasks.workunit.client.0.smithi099.stdout:0/220: dread d0/db/d13/f20 [4194304,4194304] 0 2024-09-19T06:40:32.311 INFO:tasks.workunit.client.0.smithi099.stdout:3/312: fsync d7/d34/d1d/d20/f4b 0 2024-09-19T06:40:32.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:32 smithi117 ceph-mon[34564]: pgmap v14: 65 pgs: 65 active+clean; 1.1 GiB data, 4.8 GiB used, 532 GiB / 536 GiB avail; 13 MiB/s rd, 141 MiB/s wr, 394 op/s 2024-09-19T06:40:32.312 INFO:tasks.workunit.client.0.smithi099.stdout:1/211: chown d0/db/f31 0 1 2024-09-19T06:40:32.312 INFO:tasks.workunit.client.0.smithi099.stdout:7/342: symlink d7/dd/d29/d4e/d53/l7a 0 2024-09-19T06:40:32.314 INFO:tasks.workunit.client.0.smithi099.stdout:4/280: rename ff to d12/d32/d42/f67 0 2024-09-19T06:40:32.314 INFO:tasks.workunit.client.0.smithi099.stdout:8/189: symlink d4/l45 0 2024-09-19T06:40:32.315 INFO:tasks.workunit.client.0.smithi099.stdout:0/221: unlink d0/db/d13/c25 0 2024-09-19T06:40:32.315 INFO:tasks.workunit.client.0.smithi099.stdout:0/222: chown d0/f3 1837 1 2024-09-19T06:40:32.317 INFO:tasks.workunit.client.0.smithi099.stdout:1/212: creat d0/d12/d13/f45 x:0 0 0 2024-09-19T06:40:32.317 INFO:tasks.workunit.client.0.smithi099.stdout:3/313: fdatasync d7/d34/d1d/d36/d42/f40 0 2024-09-19T06:40:32.318 INFO:tasks.workunit.client.0.smithi099.stdout:7/343: unlink d7/dd/d29/c72 0 2024-09-19T06:40:32.319 INFO:tasks.workunit.client.0.smithi099.stdout:1/213: fsync d0/d12/d13/f1b 0 2024-09-19T06:40:32.319 INFO:tasks.workunit.client.0.smithi099.stdout:0/223: creat d0/db/d13/f42 x:0 0 0 2024-09-19T06:40:32.320 INFO:tasks.workunit.client.0.smithi099.stdout:9/229: rename dd/c23 to dd/c45 0 2024-09-19T06:40:32.322 INFO:tasks.workunit.client.0.smithi099.stdout:8/190: dwrite d4/d11/d23/f3b [0,4194304] 0 2024-09-19T06:40:32.323 INFO:tasks.workunit.client.0.smithi099.stdout:1/214: stat d0/d17/d24/c40 0 2024-09-19T06:40:32.323 INFO:tasks.workunit.client.0.smithi099.stdout:0/224: creat d0/db/d2f/f43 x:0 0 0 2024-09-19T06:40:32.324 INFO:tasks.workunit.client.0.smithi099.stdout:0/225: chown d0/d17 200549 1 2024-09-19T06:40:32.324 INFO:tasks.workunit.client.0.smithi099.stdout:7/344: creat d7/dd/d29/d34/f7b x:0 0 0 2024-09-19T06:40:32.325 INFO:tasks.workunit.client.0.smithi099.stdout:3/314: creat d7/f4d x:0 0 0 2024-09-19T06:40:32.326 INFO:tasks.workunit.client.0.smithi099.stdout:4/281: dread d12/d32/d42/d5c/f31 [0,4194304] 0 2024-09-19T06:40:32.326 INFO:tasks.workunit.client.0.smithi099.stdout:9/230: symlink dd/d2c/d27/d40/l46 0 2024-09-19T06:40:32.328 INFO:tasks.workunit.client.0.smithi099.stdout:7/345: chown d7/dd/d29/f3c 2250585 1 2024-09-19T06:40:32.328 INFO:tasks.workunit.client.0.smithi099.stdout:4/282: dread - d12/d32/f48 zero size 2024-09-19T06:40:32.329 INFO:tasks.workunit.client.0.smithi099.stdout:9/231: chown dd/d2c/d27/d40/l42 753885832 1 2024-09-19T06:40:32.330 INFO:tasks.workunit.client.0.smithi099.stdout:4/283: readlink d12/l49 0 2024-09-19T06:40:32.331 INFO:tasks.workunit.client.0.smithi099.stdout:3/315: rename d7/d34/d28/l46 to d7/d34/d1d/d36/l4e 0 2024-09-19T06:40:32.333 INFO:tasks.workunit.client.0.smithi099.stdout:4/284: read d12/d32/f3e [83178,115933] 0 2024-09-19T06:40:32.334 INFO:tasks.workunit.client.0.smithi099.stdout:1/215: dwrite d0/f5 [4194304,4194304] 0 2024-09-19T06:40:32.339 INFO:tasks.workunit.client.0.smithi099.stdout:3/316: rename d7/d34/d1d/d36/f26 to d7/d34/d1d/d36/f4f 0 2024-09-19T06:40:32.340 INFO:tasks.workunit.client.0.smithi099.stdout:1/216: creat d0/d17/d24/f46 x:0 0 0 2024-09-19T06:40:32.356 INFO:tasks.workunit.client.1.smithi117.stdout:7/344: dwrite d1/d8/d24/d1c/f22 [0,4194304] 0 2024-09-19T06:40:32.361 INFO:tasks.workunit.client.0.smithi099.stdout:3/317: unlink d7/l41 0 2024-09-19T06:40:32.361 INFO:tasks.workunit.client.0.smithi099.stdout:2/134: truncate d1/f15 2619250 0 2024-09-19T06:40:32.367 INFO:tasks.workunit.client.1.smithi117.stdout:1/333: dwrite d3/d18/d23/f4f [4194304,4194304] 0 2024-09-19T06:40:32.368 INFO:tasks.workunit.client.0.smithi099.stdout:4/285: dread f5 [0,4194304] 0 2024-09-19T06:40:32.369 INFO:tasks.workunit.client.1.smithi117.stdout:7/345: truncate d1/d8/d24/f31 638063 0 2024-09-19T06:40:32.373 INFO:tasks.workunit.client.1.smithi117.stdout:1/334: rmdir d3/d22/d2f/d64 0 2024-09-19T06:40:32.374 INFO:tasks.workunit.client.0.smithi099.stdout:2/135: mknod d1/d2/d5/d8/c2e 0 2024-09-19T06:40:32.374 INFO:tasks.workunit.client.0.smithi099.stdout:0/226: dread d0/db/f14 [0,4194304] 0 2024-09-19T06:40:32.374 INFO:tasks.workunit.client.1.smithi117.stdout:1/335: read d3/f38 [558334,37847] 0 2024-09-19T06:40:32.377 INFO:tasks.workunit.client.0.smithi099.stdout:0/227: write d0/db/d13/d1f/f2b [653656,12013] 0 2024-09-19T06:40:32.377 INFO:tasks.workunit.client.0.smithi099.stdout:7/346: link d7/dd/d29/d1f/d45/d48/l74 d7/dd/d29/d4e/d53/d64/d67/l7c 0 2024-09-19T06:40:32.379 INFO:tasks.workunit.client.0.smithi099.stdout:4/286: chown d12/d1b/l2d 9 1 2024-09-19T06:40:32.380 INFO:tasks.workunit.client.0.smithi099.stdout:3/318: symlink d7/d34/d1d/l50 0 2024-09-19T06:40:32.381 INFO:tasks.workunit.client.0.smithi099.stdout:4/287: dread - d12/d32/f4c zero size 2024-09-19T06:40:32.382 INFO:tasks.workunit.client.1.smithi117.stdout:4/495: dwrite d3/db/d20/d29/d39/f6c [4194304,4194304] 0 2024-09-19T06:40:32.382 INFO:tasks.workunit.client.0.smithi099.stdout:2/136: dwrite d1/d2/d5/d8/d9/f1d [0,4194304] 0 2024-09-19T06:40:32.384 INFO:tasks.workunit.client.0.smithi099.stdout:0/228: rename d0/d17/l35 to d0/d17/l44 0 2024-09-19T06:40:32.385 INFO:tasks.workunit.client.0.smithi099.stdout:7/347: mkdir d7/d39/d7d 0 2024-09-19T06:40:32.388 INFO:tasks.workunit.client.0.smithi099.stdout:2/137: creat d1/d2/d5/d8/d18/f2f x:0 0 0 2024-09-19T06:40:32.394 INFO:tasks.workunit.client.0.smithi099.stdout:2/138: link d1/d2/d5/d8/l16 d1/l30 0 2024-09-19T06:40:32.395 INFO:tasks.workunit.client.0.smithi099.stdout:9/232: rename dd/d2c/d27 to dd/d47 0 2024-09-19T06:40:32.396 INFO:tasks.workunit.client.0.smithi099.stdout:8/191: truncate d4/d11/f1f 3540240 0 2024-09-19T06:40:32.399 INFO:tasks.workunit.client.0.smithi099.stdout:3/319: rename d7/d34/d1d/d20/f45 to d7/d34/f51 0 2024-09-19T06:40:32.403 INFO:tasks.workunit.client.1.smithi117.stdout:1/336: dread d3/f10 [0,4194304] 0 2024-09-19T06:40:32.403 INFO:tasks.workunit.client.0.smithi099.stdout:8/192: dwrite d4/d11/f21 [0,4194304] 0 2024-09-19T06:40:32.404 INFO:tasks.workunit.client.1.smithi117.stdout:1/337: fsync d3/f4c 0 2024-09-19T06:40:32.405 INFO:tasks.workunit.client.0.smithi099.stdout:7/348: rename d7/dd/d29/f3c to d7/dd/d29/d1f/d45/d48/f7e 0 2024-09-19T06:40:32.405 INFO:tasks.workunit.client.0.smithi099.stdout:3/320: mkdir d7/d34/d52 0 2024-09-19T06:40:32.407 INFO:tasks.workunit.client.0.smithi099.stdout:9/233: mknod dd/d47/d40/c48 0 2024-09-19T06:40:32.408 INFO:tasks.workunit.client.1.smithi117.stdout:1/338: rename d3/d22/f46 to d3/d18/d23/f6f 0 2024-09-19T06:40:32.408 INFO:tasks.workunit.client.0.smithi099.stdout:9/234: chown dd/d47/d40/c26 473147677 1 2024-09-19T06:40:32.409 INFO:tasks.workunit.client.0.smithi099.stdout:8/193: symlink d4/de/d14/l46 0 2024-09-19T06:40:32.410 INFO:tasks.workunit.client.0.smithi099.stdout:8/194: readlink d4/de/d10/l2a 0 2024-09-19T06:40:32.410 INFO:tasks.workunit.client.0.smithi099.stdout:8/195: chown d4/de/d26 0 1 2024-09-19T06:40:32.411 INFO:tasks.workunit.client.1.smithi117.stdout:1/339: creat d3/d18/d23/f70 x:0 0 0 2024-09-19T06:40:32.412 INFO:tasks.workunit.client.0.smithi099.stdout:7/349: write d7/dd/d29/f1e [76668,70210] 0 2024-09-19T06:40:32.412 INFO:tasks.workunit.client.1.smithi117.stdout:1/340: fsync d3/d18/d23/f52 0 2024-09-19T06:40:32.412 INFO:tasks.workunit.client.0.smithi099.stdout:3/321: creat d7/d34/d28/f53 x:0 0 0 2024-09-19T06:40:32.413 INFO:tasks.workunit.client.1.smithi117.stdout:4/496: dread d3/db/d13/f3c [0,4194304] 0 2024-09-19T06:40:32.413 INFO:tasks.workunit.client.1.smithi117.stdout:4/497: dread - d3/d65/f7c zero size 2024-09-19T06:40:32.414 INFO:tasks.workunit.client.0.smithi099.stdout:7/350: write d7/dd/d29/d4e/d53/f5c [667582,76662] 0 2024-09-19T06:40:32.416 INFO:tasks.workunit.client.1.smithi117.stdout:1/341: rename d3/f32 to d3/d22/f71 0 2024-09-19T06:40:32.417 INFO:tasks.workunit.client.1.smithi117.stdout:4/498: creat d3/d1b/d7d/d51/d95/faa x:0 0 0 2024-09-19T06:40:32.421 INFO:tasks.workunit.client.1.smithi117.stdout:4/499: dread d3/d4/d14/f17 [0,4194304] 0 2024-09-19T06:40:32.422 INFO:tasks.workunit.client.1.smithi117.stdout:4/500: creat d3/d65/d66/fab x:0 0 0 2024-09-19T06:40:32.423 INFO:tasks.workunit.client.1.smithi117.stdout:4/501: readlink d3/db/d20/d29/l64 0 2024-09-19T06:40:32.438 INFO:tasks.workunit.client.1.smithi117.stdout:4/502: dread - d3/d1b/d7d/d51/d95/faa zero size 2024-09-19T06:40:32.441 INFO:tasks.workunit.client.0.smithi099.stdout:7/351: creat d7/dd/d29/d4e/d53/d64/f7f x:0 0 0 2024-09-19T06:40:32.443 INFO:tasks.workunit.client.0.smithi099.stdout:9/235: creat dd/d2c/f49 x:0 0 0 2024-09-19T06:40:32.443 INFO:tasks.workunit.client.0.smithi099.stdout:9/236: dread - dd/d2c/f30 zero size 2024-09-19T06:40:32.443 INFO:tasks.workunit.client.0.smithi099.stdout:9/237: read - dd/d2c/f49 zero size 2024-09-19T06:40:32.443 INFO:tasks.workunit.client.0.smithi099.stdout:8/196: rmdir d4/d11/d23/d3f/d44 0 2024-09-19T06:40:32.444 INFO:tasks.workunit.client.1.smithi117.stdout:4/503: rename d3/d4/f2f to d3/db/d20/d29/d39/d4f/fac 0 2024-09-19T06:40:32.445 INFO:tasks.workunit.client.0.smithi099.stdout:8/197: readlink d4/d11/d23/l3a 0 2024-09-19T06:40:32.445 INFO:tasks.workunit.client.0.smithi099.stdout:8/198: chown d4/de/d14/l1e 0 1 2024-09-19T06:40:32.445 INFO:tasks.workunit.client.1.smithi117.stdout:4/504: truncate d3/d4/d14/f17 608955 0 2024-09-19T06:40:32.446 INFO:tasks.workunit.client.1.smithi117.stdout:4/505: write d3/db/d20/d29/f31 [2538046,49886] 0 2024-09-19T06:40:32.446 INFO:tasks.workunit.client.0.smithi099.stdout:7/352: creat d7/dd/d29/d1f/d45/d48/f80 x:0 0 0 2024-09-19T06:40:32.447 INFO:tasks.workunit.client.0.smithi099.stdout:7/353: stat d7/dd/d29/d1f/l46 0 2024-09-19T06:40:32.449 INFO:tasks.workunit.client.0.smithi099.stdout:7/354: write d7/dd/d29/d34/f7b [579949,130834] 0 2024-09-19T06:40:32.449 INFO:tasks.workunit.client.1.smithi117.stdout:4/506: symlink d3/db/d20/d29/d39/lad 0 2024-09-19T06:40:32.449 INFO:tasks.workunit.client.0.smithi099.stdout:7/355: dread - d7/dd/d29/d4e/d53/d64/f65 zero size 2024-09-19T06:40:32.451 INFO:tasks.workunit.client.0.smithi099.stdout:9/238: chown dd/f1f 3946 1 2024-09-19T06:40:32.451 INFO:tasks.workunit.client.0.smithi099.stdout:3/322: link d7/d34/d1d/c27 d7/d34/d1d/c54 0 2024-09-19T06:40:32.455 INFO:tasks.workunit.client.1.smithi117.stdout:4/507: link d3/d28/c30 d3/db/d20/d29/d39/d4f/d6e/cae 0 2024-09-19T06:40:32.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:32 smithi099 ceph-mon[27651]: pgmap v14: 65 pgs: 65 active+clean; 1.1 GiB data, 4.8 GiB used, 532 GiB / 536 GiB avail; 13 MiB/s rd, 141 MiB/s wr, 394 op/s 2024-09-19T06:40:32.457 INFO:tasks.workunit.client.1.smithi117.stdout:4/508: mknod d3/d65/d66/d80/caf 0 2024-09-19T06:40:32.457 INFO:tasks.workunit.client.0.smithi099.stdout:9/239: mknod dd/d47/d40/c4a 0 2024-09-19T06:40:32.459 INFO:tasks.workunit.client.0.smithi099.stdout:1/217: dwrite d0/db/f19 [0,4194304] 0 2024-09-19T06:40:32.460 INFO:tasks.workunit.client.0.smithi099.stdout:3/323: creat d7/f55 x:0 0 0 2024-09-19T06:40:32.463 INFO:tasks.workunit.client.0.smithi099.stdout:8/199: getdents d4/d11/d38 0 2024-09-19T06:40:32.463 INFO:tasks.workunit.client.1.smithi117.stdout:4/509: truncate d3/d4/d14/f60 1034026 0 2024-09-19T06:40:32.464 INFO:tasks.workunit.client.0.smithi099.stdout:1/218: read d0/f5 [3962175,61640] 0 2024-09-19T06:40:32.464 INFO:tasks.workunit.client.0.smithi099.stdout:1/219: fdatasync d0/db/dd/f1d 0 2024-09-19T06:40:32.466 INFO:tasks.workunit.client.1.smithi117.stdout:4/510: creat d3/d28/fb0 x:0 0 0 2024-09-19T06:40:32.466 INFO:tasks.workunit.client.1.smithi117.stdout:4/511: stat d3/l44 0 2024-09-19T06:40:32.467 INFO:tasks.workunit.client.0.smithi099.stdout:3/324: creat d7/d34/d1d/d36/d42/f56 x:0 0 0 2024-09-19T06:40:32.468 INFO:tasks.workunit.client.1.smithi117.stdout:4/512: write d3/d1b/d7d/f12 [1831603,60607] 0 2024-09-19T06:40:32.470 INFO:tasks.workunit.client.0.smithi099.stdout:8/200: mknod d4/d11/d23/c47 0 2024-09-19T06:40:32.474 INFO:tasks.workunit.client.0.smithi099.stdout:9/240: creat dd/d2c/f4b x:0 0 0 2024-09-19T06:40:32.475 INFO:tasks.workunit.client.0.smithi099.stdout:8/201: mknod d4/de/d14/c48 0 2024-09-19T06:40:32.481 INFO:tasks.workunit.client.0.smithi099.stdout:3/325: mkdir d7/d34/d1d/d57 0 2024-09-19T06:40:32.481 INFO:tasks.workunit.client.0.smithi099.stdout:9/241: readlink dd/l32 0 2024-09-19T06:40:32.481 INFO:tasks.workunit.client.0.smithi099.stdout:8/202: creat d4/de/d10/f49 x:0 0 0 2024-09-19T06:40:32.482 INFO:tasks.workunit.client.0.smithi099.stdout:3/326: unlink d7/d34/d1d/d36/d42/f56 0 2024-09-19T06:40:32.483 INFO:tasks.workunit.client.0.smithi099.stdout:3/327: chown d7/d34/d1d/d20/l3b 1 1 2024-09-19T06:40:32.483 INFO:tasks.workunit.client.0.smithi099.stdout:3/328: fsync d7/d34/d1d/d36/f4a 0 2024-09-19T06:40:32.483 INFO:tasks.workunit.client.1.smithi117.stdout:4/513: read d3/d4/d14/f60 [616073,59346] 0 2024-09-19T06:40:32.484 INFO:tasks.workunit.client.0.smithi099.stdout:3/329: dread - d7/d34/f3d zero size 2024-09-19T06:40:32.485 INFO:tasks.workunit.client.1.smithi117.stdout:4/514: symlink d3/d4/d5f/lb1 0 2024-09-19T06:40:32.486 INFO:tasks.workunit.client.0.smithi099.stdout:9/242: creat dd/d2c/f4c x:0 0 0 2024-09-19T06:40:32.486 INFO:tasks.workunit.client.0.smithi099.stdout:8/203: link d4/l45 d4/de/d1c/l4a 0 2024-09-19T06:40:32.488 INFO:tasks.workunit.client.0.smithi099.stdout:9/243: read fa [1915287,62124] 0 2024-09-19T06:40:32.489 INFO:tasks.workunit.client.0.smithi099.stdout:2/139: write d1/d2/d5/d8/f1a [863756,127299] 0 2024-09-19T06:40:32.490 INFO:tasks.workunit.client.0.smithi099.stdout:3/330: dwrite d7/d34/d1d/d36/d42/f43 [0,4194304] 0 2024-09-19T06:40:32.493 INFO:tasks.workunit.client.1.smithi117.stdout:0/272: sync 2024-09-19T06:40:32.493 INFO:tasks.workunit.client.1.smithi117.stdout:8/431: sync 2024-09-19T06:40:32.495 INFO:tasks.workunit.client.1.smithi117.stdout:4/515: dread d3/db/d23/f54 [0,4194304] 0 2024-09-19T06:40:32.495 INFO:tasks.workunit.client.0.smithi099.stdout:7/356: symlink d7/l81 0 2024-09-19T06:40:32.496 INFO:tasks.workunit.client.0.smithi099.stdout:7/357: chown d7/f4d 3 1 2024-09-19T06:40:32.496 INFO:tasks.workunit.client.1.smithi117.stdout:0/273: mkdir d11/d13/d1b/d27/d54 0 2024-09-19T06:40:32.497 INFO:tasks.workunit.client.0.smithi099.stdout:2/140: rename d1/d2/d5/d6/l26 to d1/d2/d24/l31 0 2024-09-19T06:40:32.497 INFO:tasks.workunit.client.1.smithi117.stdout:8/432: creat d1d/d2a/d3f/d4b/d5f/d7c/f93 x:0 0 0 2024-09-19T06:40:32.498 INFO:tasks.workunit.client.0.smithi099.stdout:7/358: write d7/dd/d29/f1e [423538,105555] 0 2024-09-19T06:40:32.498 INFO:tasks.workunit.client.0.smithi099.stdout:9/244: mknod dd/d2c/c4d 0 2024-09-19T06:40:32.499 INFO:tasks.workunit.client.1.smithi117.stdout:4/516: symlink d3/d1b/d7d/d9e/lb2 0 2024-09-19T06:40:32.500 INFO:tasks.workunit.client.1.smithi117.stdout:4/517: chown d3/d1b/d7d/d51 1 1 2024-09-19T06:40:32.501 INFO:tasks.workunit.client.0.smithi099.stdout:9/245: fdatasync dd/d2c/f49 0 2024-09-19T06:40:32.501 INFO:tasks.workunit.client.0.smithi099.stdout:3/331: dwrite d7/ff [0,4194304] 0 2024-09-19T06:40:32.501 INFO:tasks.workunit.client.0.smithi099.stdout:2/141: fdatasync d1/d2/d5/d8/f11 0 2024-09-19T06:40:32.502 INFO:tasks.workunit.client.0.smithi099.stdout:9/246: read - dd/d47/f3b zero size 2024-09-19T06:40:32.503 INFO:tasks.workunit.client.1.smithi117.stdout:8/433: getdents d1d/d2a/d3f/d4b/d5f 0 2024-09-19T06:40:32.503 INFO:tasks.workunit.client.0.smithi099.stdout:9/247: dread - dd/d47/f3b zero size 2024-09-19T06:40:32.504 INFO:tasks.workunit.client.0.smithi099.stdout:3/332: rmdir d7/d34/d28 39 2024-09-19T06:40:32.506 INFO:tasks.workunit.client.1.smithi117.stdout:4/518: dread d3/d4/f40 [0,4194304] 0 2024-09-19T06:40:32.506 INFO:tasks.workunit.client.1.smithi117.stdout:8/434: symlink d1d/d1e/d53/d6e/l94 0 2024-09-19T06:40:32.506 INFO:tasks.workunit.client.0.smithi099.stdout:9/248: chown dd/d2c/f1a 3090 1 2024-09-19T06:40:32.509 INFO:tasks.workunit.client.1.smithi117.stdout:4/519: creat d3/db/d20/d29/d39/d4f/fb3 x:0 0 0 2024-09-19T06:40:32.510 INFO:tasks.workunit.client.0.smithi099.stdout:7/359: dwrite d7/f15 [0,4194304] 0 2024-09-19T06:40:32.511 INFO:tasks.workunit.client.1.smithi117.stdout:4/520: write d3/d4/d14/f56 [5884471,39640] 0 2024-09-19T06:40:32.512 INFO:tasks.workunit.client.1.smithi117.stdout:4/521: rmdir d3/d1b 39 2024-09-19T06:40:32.513 INFO:tasks.workunit.client.0.smithi099.stdout:8/204: dread d4/d11/f1f [0,4194304] 0 2024-09-19T06:40:32.513 INFO:tasks.workunit.client.0.smithi099.stdout:7/360: stat d7/dd/d29/d4e/f73 0 2024-09-19T06:40:32.513 INFO:tasks.workunit.client.0.smithi099.stdout:3/333: mkdir d7/d34/d1d/d20/d58 0 2024-09-19T06:40:32.515 INFO:tasks.workunit.client.0.smithi099.stdout:1/220: write d0/db/f25 [879166,121313] 0 2024-09-19T06:40:32.515 INFO:tasks.workunit.client.1.smithi117.stdout:4/522: write d3/db/f47 [4572890,59027] 0 2024-09-19T06:40:32.516 INFO:tasks.workunit.client.0.smithi099.stdout:3/334: chown d7/d34/c35 0 1 2024-09-19T06:40:32.517 INFO:tasks.workunit.client.0.smithi099.stdout:9/249: mknod dd/d2c/c4e 0 2024-09-19T06:40:32.518 INFO:tasks.workunit.client.1.smithi117.stdout:4/523: getdents d3/db/d20/d29/d39/d4f/d6e/da3 0 2024-09-19T06:40:32.520 INFO:tasks.workunit.client.0.smithi099.stdout:8/205: creat d4/d11/d23/f4b x:0 0 0 2024-09-19T06:40:32.520 INFO:tasks.workunit.client.1.smithi117.stdout:8/435: truncate d1d/d1e/d29/f6f 2832310 0 2024-09-19T06:40:32.521 INFO:tasks.workunit.client.0.smithi099.stdout:7/361: mkdir d7/dd/d29/d4e/d82 0 2024-09-19T06:40:32.521 INFO:tasks.workunit.client.1.smithi117.stdout:4/524: write d3/d65/f7c [632836,119149] 0 2024-09-19T06:40:32.523 INFO:tasks.workunit.client.1.smithi117.stdout:0/274: dread fd [0,4194304] 0 2024-09-19T06:40:32.524 INFO:tasks.workunit.client.1.smithi117.stdout:0/275: dread - d11/d13/d1b/f4e zero size 2024-09-19T06:40:32.526 INFO:tasks.workunit.client.0.smithi099.stdout:8/206: fdatasync d4/f17 0 2024-09-19T06:40:32.527 INFO:tasks.workunit.client.1.smithi117.stdout:8/436: rename d1d/d2a/d3f/d4b/d66/d67 to d1d/d2a/d3f/d4b/d5f/d95 0 2024-09-19T06:40:32.527 INFO:tasks.workunit.client.1.smithi117.stdout:0/276: truncate d11/d13/d14/d2c/d35/d3e/f52 453832 0 2024-09-19T06:40:32.530 INFO:tasks.workunit.client.1.smithi117.stdout:0/277: creat d11/d13/d1b/d27/f55 x:0 0 0 2024-09-19T06:40:32.530 INFO:tasks.workunit.client.0.smithi099.stdout:4/288: sync 2024-09-19T06:40:32.530 INFO:tasks.workunit.client.0.smithi099.stdout:5/421: sync 2024-09-19T06:40:32.530 INFO:tasks.workunit.client.0.smithi099.stdout:6/242: sync 2024-09-19T06:40:32.531 INFO:tasks.workunit.client.0.smithi099.stdout:9/250: fdatasync dd/fe 0 2024-09-19T06:40:32.531 INFO:tasks.workunit.client.1.smithi117.stdout:0/278: chown d11/d13/d1b/d27/d37 42832022 1 2024-09-19T06:40:32.531 INFO:tasks.workunit.client.0.smithi099.stdout:4/289: chown d12/f50 6379490 1 2024-09-19T06:40:32.533 INFO:tasks.workunit.client.0.smithi099.stdout:4/290: fsync d12/d1b/f4f 0 2024-09-19T06:40:32.533 INFO:tasks.workunit.client.0.smithi099.stdout:8/207: rmdir d4/de/d14 39 2024-09-19T06:40:32.534 INFO:tasks.workunit.client.0.smithi099.stdout:7/362: truncate d7/dd/d29/d1f/d45/d48/f7e 1221354 0 2024-09-19T06:40:32.534 INFO:tasks.workunit.client.0.smithi099.stdout:5/422: dread d3/d16/d5e/f62 [0,4194304] 0 2024-09-19T06:40:32.535 INFO:tasks.workunit.client.1.smithi117.stdout:8/437: dwrite d1d/d1e/d29/f51 [0,4194304] 0 2024-09-19T06:40:32.536 INFO:tasks.workunit.client.0.smithi099.stdout:5/423: stat d3/d2a/f8b 0 2024-09-19T06:40:32.537 INFO:tasks.workunit.client.0.smithi099.stdout:2/142: truncate d1/d2/f1f 297052 0 2024-09-19T06:40:32.538 INFO:tasks.workunit.client.0.smithi099.stdout:5/424: chown d3/d16/c29 2262830 1 2024-09-19T06:40:32.539 INFO:tasks.workunit.client.1.smithi117.stdout:8/438: creat d1d/d2a/d3f/d4b/f96 x:0 0 0 2024-09-19T06:40:32.540 INFO:tasks.workunit.client.0.smithi099.stdout:4/291: readlink d12/d32/d39/l53 0 2024-09-19T06:40:32.540 INFO:tasks.workunit.client.1.smithi117.stdout:4/525: dwrite d3/d1b/d7d/f4b [0,4194304] 0 2024-09-19T06:40:32.540 INFO:tasks.workunit.client.1.smithi117.stdout:8/439: chown d1d/d1e/d29/f89 1317103 1 2024-09-19T06:40:32.541 INFO:tasks.workunit.client.1.smithi117.stdout:0/279: write d11/d13/f22 [321070,82860] 0 2024-09-19T06:40:32.541 INFO:tasks.workunit.client.0.smithi099.stdout:2/143: dread - d1/d2/d5/d8/f2b zero size 2024-09-19T06:40:32.542 INFO:tasks.workunit.client.1.smithi117.stdout:8/440: read d1d/d1e/f5c [1075959,23257] 0 2024-09-19T06:40:32.544 INFO:tasks.workunit.client.0.smithi099.stdout:6/243: dwrite d1/d5/d24/d2e/d41/d4e/d2a/f30 [0,4194304] 0 2024-09-19T06:40:32.545 INFO:tasks.workunit.client.1.smithi117.stdout:4/526: symlink d3/d1b/d7d/d9f/lb4 0 2024-09-19T06:40:32.547 INFO:tasks.workunit.client.0.smithi099.stdout:2/144: chown d1/d2/d5/d8/dc/c14 166 1 2024-09-19T06:40:32.548 INFO:tasks.workunit.client.0.smithi099.stdout:4/292: chown d12/d32/d42/d5c/f25 1419397 1 2024-09-19T06:40:32.548 INFO:tasks.workunit.client.0.smithi099.stdout:3/335: truncate d7/f18 127783 0 2024-09-19T06:40:32.549 INFO:tasks.workunit.client.1.smithi117.stdout:0/280: dwrite d11/d13/d1b/d27/f55 [0,4194304] 0 2024-09-19T06:40:32.550 INFO:tasks.workunit.client.1.smithi117.stdout:8/441: mkdir d1d/d2a/d3f/d4b/d91/d97 0 2024-09-19T06:40:32.552 INFO:tasks.workunit.client.0.smithi099.stdout:5/425: mknod d3/d14/c99 0 2024-09-19T06:40:32.553 INFO:tasks.workunit.client.1.smithi117.stdout:8/442: symlink d1d/d2a/l98 0 2024-09-19T06:40:32.555 INFO:tasks.workunit.client.1.smithi117.stdout:0/281: creat d11/d13/d28/d38/f56 x:0 0 0 2024-09-19T06:40:32.556 INFO:tasks.workunit.client.0.smithi099.stdout:8/208: getdents d4/d11/d38 0 2024-09-19T06:40:32.556 INFO:tasks.workunit.client.0.smithi099.stdout:3/336: write d7/f4d [598413,63097] 0 2024-09-19T06:40:32.556 INFO:tasks.workunit.client.0.smithi099.stdout:7/363: symlink d7/d39/d7d/l83 0 2024-09-19T06:40:32.558 INFO:tasks.workunit.client.0.smithi099.stdout:6/244: write d1/d5/d24/d2e/d41/d4e/d2a/f30 [3683600,113862] 0 2024-09-19T06:40:32.559 INFO:tasks.workunit.client.0.smithi099.stdout:8/209: stat d4/de/d10/f24 0 2024-09-19T06:40:32.560 INFO:tasks.workunit.client.1.smithi117.stdout:8/443: dread f15 [0,4194304] 0 2024-09-19T06:40:32.560 INFO:tasks.workunit.client.1.smithi117.stdout:0/282: creat d11/d13/d1b/d27/d54/f57 x:0 0 0 2024-09-19T06:40:32.561 INFO:tasks.workunit.client.0.smithi099.stdout:1/221: dwrite d0/d12/d13/f33 [0,4194304] 0 2024-09-19T06:40:32.561 INFO:tasks.workunit.client.1.smithi117.stdout:8/444: write d1d/d1e/d29/f43 [1786367,26961] 0 2024-09-19T06:40:32.564 INFO:tasks.workunit.client.1.smithi117.stdout:8/445: write d1d/d2a/f76 [403814,116885] 0 2024-09-19T06:40:32.565 INFO:tasks.workunit.client.0.smithi099.stdout:9/251: dread dd/d2c/f1a [0,4194304] 0 2024-09-19T06:40:32.565 INFO:tasks.workunit.client.0.smithi099.stdout:3/337: unlink d7/d34/d1d/d36/f32 0 2024-09-19T06:40:32.566 INFO:tasks.workunit.client.0.smithi099.stdout:7/364: chown d7/dd/d29/d1f/d45/d48 383 1 2024-09-19T06:40:32.566 INFO:tasks.workunit.client.0.smithi099.stdout:1/222: symlink d0/db/dd/l47 0 2024-09-19T06:40:32.569 INFO:tasks.workunit.client.1.smithi117.stdout:8/446: rename d1d/d2a/f62 to d1d/d2a/d3f/d73/f99 0 2024-09-19T06:40:32.573 INFO:tasks.workunit.client.1.smithi117.stdout:4/527: dread d3/d1b/d7d/d9f/fa2 [0,4194304] 0 2024-09-19T06:40:32.575 INFO:tasks.workunit.client.1.smithi117.stdout:4/528: mknod d3/d65/d66/cb5 0 2024-09-19T06:40:32.576 INFO:tasks.workunit.client.1.smithi117.stdout:4/529: fdatasync d3/db/d20/d29/d39/d4f/fb3 0 2024-09-19T06:40:32.578 INFO:tasks.workunit.client.1.smithi117.stdout:4/530: unlink d3/db/d20/d29/d39/d4f/d8b/l46 0 2024-09-19T06:40:32.578 INFO:tasks.workunit.client.1.smithi117.stdout:4/531: chown d3/db/d20/d4a/d7b/da0 423 1 2024-09-19T06:40:32.579 INFO:tasks.workunit.client.1.smithi117.stdout:4/532: readlink d3/d1b/l25 0 2024-09-19T06:40:32.580 INFO:tasks.workunit.client.1.smithi117.stdout:4/533: creat d3/fb6 x:0 0 0 2024-09-19T06:40:32.583 INFO:tasks.workunit.client.1.smithi117.stdout:4/534: mknod d3/db/d20/d4a/d7b/da0/cb7 0 2024-09-19T06:40:32.586 INFO:tasks.workunit.client.1.smithi117.stdout:4/535: mkdir d3/d1b/db8 0 2024-09-19T06:40:32.588 INFO:tasks.workunit.client.0.smithi099.stdout:2/145: mknod d1/d2/d5/d8/d18/d27/c32 0 2024-09-19T06:40:32.588 INFO:tasks.workunit.client.0.smithi099.stdout:1/223: fdatasync d0/db/f25 0 2024-09-19T06:40:32.589 INFO:tasks.workunit.client.0.smithi099.stdout:5/426: getdents d3/d1f/d4f 0 2024-09-19T06:40:32.589 INFO:tasks.workunit.client.0.smithi099.stdout:6/245: mkdir d1/d5/d24/d2e/d41/d4e/d54 0 2024-09-19T06:40:32.590 INFO:tasks.workunit.client.0.smithi099.stdout:4/293: dread d12/d32/d39/f40 [0,4194304] 0 2024-09-19T06:40:32.590 INFO:tasks.workunit.client.0.smithi099.stdout:6/246: fsync d1/f19 0 2024-09-19T06:40:32.591 INFO:tasks.workunit.client.1.smithi117.stdout:3/411: sync 2024-09-19T06:40:32.591 INFO:tasks.workunit.client.0.smithi099.stdout:2/146: read - d1/d2/d5/d8/f2b zero size 2024-09-19T06:40:32.591 INFO:tasks.workunit.client.0.smithi099.stdout:5/427: dread - d3/d1f/f94 zero size 2024-09-19T06:40:32.592 INFO:tasks.workunit.client.1.smithi117.stdout:3/412: read - d0/d19/f69 zero size 2024-09-19T06:40:32.592 INFO:tasks.workunit.client.1.smithi117.stdout:0/283: truncate d11/d13/d14/f1d 1143345 0 2024-09-19T06:40:32.592 INFO:tasks.workunit.client.1.smithi117.stdout:4/536: link d3/d1b/c2d d3/db/d20/d29/d39/d4f/d8b/cb9 0 2024-09-19T06:40:32.592 INFO:tasks.workunit.client.1.smithi117.stdout:3/413: chown d0/d19/f3e 203426227 1 2024-09-19T06:40:32.593 INFO:tasks.workunit.client.0.smithi099.stdout:6/247: dread - d1/d5/f50 zero size 2024-09-19T06:40:32.593 INFO:tasks.workunit.client.0.smithi099.stdout:9/252: truncate dd/d2c/f30 20153 0 2024-09-19T06:40:32.593 INFO:tasks.workunit.client.0.smithi099.stdout:3/338: mknod d7/d34/c59 0 2024-09-19T06:40:32.593 INFO:tasks.workunit.client.0.smithi099.stdout:2/147: fdatasync d1/d2/d5/d8/d18/f2f 0 2024-09-19T06:40:32.594 INFO:tasks.workunit.client.1.smithi117.stdout:3/414: stat d0/d19/d2b/f6e 0 2024-09-19T06:40:32.594 INFO:tasks.workunit.client.1.smithi117.stdout:3/415: readlink d0/l79 0 2024-09-19T06:40:32.594 INFO:tasks.workunit.client.0.smithi099.stdout:4/294: symlink d12/d58/l68 0 2024-09-19T06:40:32.594 INFO:tasks.workunit.client.0.smithi099.stdout:9/253: dread - dd/d47/f3b zero size 2024-09-19T06:40:32.595 INFO:tasks.workunit.client.0.smithi099.stdout:1/224: truncate d0/db/f1f 1264563 0 2024-09-19T06:40:32.595 INFO:tasks.workunit.client.0.smithi099.stdout:5/428: creat d3/d16/d2f/f9a x:0 0 0 2024-09-19T06:40:32.596 INFO:tasks.workunit.client.1.smithi117.stdout:3/416: creat d0/d3d/d48/f7b x:0 0 0 2024-09-19T06:40:32.597 INFO:tasks.workunit.client.0.smithi099.stdout:5/429: dread - d3/d16/d2f/d34/f6f zero size 2024-09-19T06:40:32.597 INFO:tasks.workunit.client.1.smithi117.stdout:4/537: link d3/db/d23/f98 d3/d1b/d7d/d51/fba 0 2024-09-19T06:40:32.598 INFO:tasks.workunit.client.0.smithi099.stdout:6/248: unlink d1/d12/f21 0 2024-09-19T06:40:32.598 INFO:tasks.workunit.client.1.smithi117.stdout:4/538: chown d3/d65 15020864 1 2024-09-19T06:40:32.598 INFO:tasks.workunit.client.0.smithi099.stdout:6/249: chown d1/d5/d24/d2b/c3b 2 1 2024-09-19T06:40:32.599 INFO:tasks.workunit.client.1.smithi117.stdout:3/417: getdents d0/d8/d64 0 2024-09-19T06:40:32.599 INFO:tasks.workunit.client.0.smithi099.stdout:7/365: creat d7/dd/d29/d1f/d45/f84 x:0 0 0 2024-09-19T06:40:32.600 INFO:tasks.workunit.client.0.smithi099.stdout:3/339: unlink d7/d34/d1d/d36/d42/c44 0 2024-09-19T06:40:32.601 INFO:tasks.workunit.client.1.smithi117.stdout:4/539: unlink d3/d1b/d7d/f1c 0 2024-09-19T06:40:32.601 INFO:tasks.workunit.client.0.smithi099.stdout:3/340: stat d7/d34/d1d/l37 0 2024-09-19T06:40:32.602 INFO:tasks.workunit.client.1.smithi117.stdout:4/540: truncate d3/d1b/f4d 533801 0 2024-09-19T06:40:32.603 INFO:tasks.workunit.client.0.smithi099.stdout:5/430: mknod d3/d7/c9b 0 2024-09-19T06:40:32.604 INFO:tasks.workunit.client.1.smithi117.stdout:3/418: creat d0/d9/d4e/f7c x:0 0 0 2024-09-19T06:40:32.604 INFO:tasks.workunit.client.0.smithi099.stdout:9/254: unlink dd/c1c 0 2024-09-19T06:40:32.605 INFO:tasks.workunit.client.0.smithi099.stdout:9/255: write dd/d47/f33 [567437,70616] 0 2024-09-19T06:40:32.606 INFO:tasks.workunit.client.0.smithi099.stdout:9/256: truncate dd/f34 795577 0 2024-09-19T06:40:32.607 INFO:tasks.workunit.client.1.smithi117.stdout:3/419: write d0/d9/fd [5867493,67178] 0 2024-09-19T06:40:32.607 INFO:tasks.workunit.client.0.smithi099.stdout:6/250: creat d1/d5/d24/d2e/d41/d4e/d2a/f55 x:0 0 0 2024-09-19T06:40:32.608 INFO:tasks.workunit.client.1.smithi117.stdout:0/284: dread d11/d13/d1b/d27/f29 [0,4194304] 0 2024-09-19T06:40:32.611 INFO:tasks.workunit.client.1.smithi117.stdout:3/420: write d0/d19/f3e [351866,97579] 0 2024-09-19T06:40:32.611 INFO:tasks.workunit.client.1.smithi117.stdout:0/285: truncate d11/f47 256115 0 2024-09-19T06:40:32.612 INFO:tasks.workunit.client.1.smithi117.stdout:4/541: dwrite d3/d1b/d7d/d51/d95/f99 [0,4194304] 0 2024-09-19T06:40:32.613 INFO:tasks.workunit.client.0.smithi099.stdout:9/257: dwrite dd/d47/f3b [0,4194304] 0 2024-09-19T06:40:32.614 INFO:tasks.workunit.client.1.smithi117.stdout:4/542: chown d3/db/d20/d35/d79/fa6 852091 1 2024-09-19T06:40:32.615 INFO:tasks.workunit.client.0.smithi099.stdout:5/431: rename d3/d16/c29 to d3/d2a/c9c 0 2024-09-19T06:40:32.619 INFO:tasks.workunit.client.0.smithi099.stdout:6/251: unlink d1/l3d 0 2024-09-19T06:40:32.621 INFO:tasks.workunit.client.0.smithi099.stdout:6/252: write d1/f9 [3332878,72117] 0 2024-09-19T06:40:32.621 INFO:tasks.workunit.client.0.smithi099.stdout:7/366: mknod d7/dd/d29/d1f/d45/d48/d63/d75/c85 0 2024-09-19T06:40:32.622 INFO:tasks.workunit.client.0.smithi099.stdout:2/148: link d1/d2/d5/d6/c20 d1/d2/d5/d8/dc/c33 0 2024-09-19T06:40:32.630 INFO:tasks.workunit.client.1.smithi117.stdout:3/421: link d0/d9/d1c/l4b d0/d3d/d48/l7d 0 2024-09-19T06:40:32.631 INFO:tasks.workunit.client.0.smithi099.stdout:7/367: chown d7/dd/d29/d1f/d45/d48/d63/d71 233 1 2024-09-19T06:40:32.631 INFO:tasks.workunit.client.0.smithi099.stdout:2/149: chown d1/d2/d5/d8/dc 822746372 1 2024-09-19T06:40:32.631 INFO:tasks.workunit.client.0.smithi099.stdout:2/150: write d1/f15 [2885672,37136] 0 2024-09-19T06:40:32.631 INFO:tasks.workunit.client.0.smithi099.stdout:4/295: getdents d12/d1b 0 2024-09-19T06:40:32.631 INFO:tasks.workunit.client.0.smithi099.stdout:5/432: dwrite d3/d2a/f7a [0,4194304] 0 2024-09-19T06:40:32.632 INFO:tasks.workunit.client.0.smithi099.stdout:9/258: creat dd/d47/d40/f4f x:0 0 0 2024-09-19T06:40:32.634 INFO:tasks.workunit.client.0.smithi099.stdout:2/151: mknod d1/d2/d5/d6/c34 0 2024-09-19T06:40:32.636 INFO:tasks.workunit.client.0.smithi099.stdout:4/296: mknod d12/d32/d42/d5c/d51/c69 0 2024-09-19T06:40:32.637 INFO:tasks.workunit.client.0.smithi099.stdout:9/259: chown dd/c35 109 1 2024-09-19T06:40:32.639 INFO:tasks.workunit.client.0.smithi099.stdout:5/433: mknod d3/d16/d7d/c9d 0 2024-09-19T06:40:32.640 INFO:tasks.workunit.client.1.smithi117.stdout:3/422: write d0/d9/d1c/f39 [4419489,896] 0 2024-09-19T06:40:32.640 INFO:tasks.workunit.client.1.smithi117.stdout:4/543: mknod d3/db/d20/d35/cbb 0 2024-09-19T06:40:32.641 INFO:tasks.workunit.client.0.smithi099.stdout:1/225: dwrite d0/d12/d13/f2b [0,4194304] 0 2024-09-19T06:40:32.642 INFO:tasks.workunit.client.0.smithi099.stdout:5/434: readlink d3/d1f/d8d/l4e 0 2024-09-19T06:40:32.643 INFO:tasks.workunit.client.1.smithi117.stdout:3/423: read d0/d9/d1c/f39 [2231224,21784] 0 2024-09-19T06:40:32.643 INFO:tasks.workunit.client.1.smithi117.stdout:0/286: dread d11/d13/d1b/d4b/f4f [0,4194304] 0 2024-09-19T06:40:32.643 INFO:tasks.workunit.client.0.smithi099.stdout:6/253: dwrite d1/f10 [0,4194304] 0 2024-09-19T06:40:32.643 INFO:tasks.workunit.client.1.smithi117.stdout:4/544: symlink d3/db/d20/d29/d39/d4f/lbc 0 2024-09-19T06:40:32.644 INFO:tasks.workunit.client.0.smithi099.stdout:2/152: symlink d1/d2/d5/d6/l35 0 2024-09-19T06:40:32.645 INFO:tasks.workunit.client.0.smithi099.stdout:5/435: dread - d3/d16/d2f/f9a zero size 2024-09-19T06:40:32.647 INFO:tasks.workunit.client.1.smithi117.stdout:0/287: creat d11/d13/d1b/d27/d37/f58 x:0 0 0 2024-09-19T06:40:32.647 INFO:tasks.workunit.client.0.smithi099.stdout:4/297: mknod d12/c6a 0 2024-09-19T06:40:32.647 INFO:tasks.workunit.client.0.smithi099.stdout:5/436: chown d3/d16/d2f/d34/d3c 1733822852 1 2024-09-19T06:40:32.649 INFO:tasks.workunit.client.1.smithi117.stdout:3/424: dwrite d0/d19/f78 [0,4194304] 0 2024-09-19T06:40:32.653 INFO:tasks.workunit.client.0.smithi099.stdout:3/341: truncate d7/d34/f3a 549377 0 2024-09-19T06:40:32.654 INFO:tasks.workunit.client.1.smithi117.stdout:0/288: fsync d11/d13/d1b/d27/f29 0 2024-09-19T06:40:32.655 INFO:tasks.workunit.client.0.smithi099.stdout:2/153: mkdir d1/d2/d5/d8/d36 0 2024-09-19T06:40:32.655 INFO:tasks.workunit.client.1.smithi117.stdout:3/425: write d0/f14 [4204404,126809] 0 2024-09-19T06:40:32.657 INFO:tasks.workunit.client.1.smithi117.stdout:0/289: write d11/d13/d1b/d27/f29 [4912504,76147] 0 2024-09-19T06:40:32.657 INFO:tasks.workunit.client.1.smithi117.stdout:3/426: stat d0/l2 0 2024-09-19T06:40:32.657 INFO:tasks.workunit.client.0.smithi099.stdout:1/226: mkdir d0/d12/d13/d37/d48 0 2024-09-19T06:40:32.658 INFO:tasks.workunit.client.0.smithi099.stdout:2/154: readlink d1/d2/d5/d8/dc/l28 0 2024-09-19T06:40:32.658 INFO:tasks.workunit.client.0.smithi099.stdout:3/342: mknod d7/d34/d1d/d36/d42/c5a 0 2024-09-19T06:40:32.661 INFO:tasks.workunit.client.0.smithi099.stdout:9/260: rename dd/d47/d40/c26 to dd/d2c/c50 0 2024-09-19T06:40:32.662 INFO:tasks.workunit.client.0.smithi099.stdout:1/227: rmdir d0/d2d 39 2024-09-19T06:40:32.663 INFO:tasks.workunit.client.1.smithi117.stdout:3/427: link d0/f6 d0/d3d/d48/f7e 0 2024-09-19T06:40:32.663 INFO:tasks.workunit.client.0.smithi099.stdout:7/368: dwrite d7/dd/d29/d1f/d45/d48/f7e [0,4194304] 0 2024-09-19T06:40:32.665 INFO:tasks.workunit.client.0.smithi099.stdout:2/155: mkdir d1/d2/d5/d8/d9/d37 0 2024-09-19T06:40:32.667 INFO:tasks.workunit.client.1.smithi117.stdout:0/290: dwrite d11/d13/f22 [0,4194304] 0 2024-09-19T06:40:32.668 INFO:tasks.workunit.client.0.smithi099.stdout:6/254: getdents d1/d5/d24/d2e/d41/d4e/d2a 0 2024-09-19T06:40:32.669 INFO:tasks.workunit.client.1.smithi117.stdout:3/428: rename d0/d3d/d68 to d0/d8/d7f 0 2024-09-19T06:40:32.669 INFO:tasks.workunit.client.0.smithi099.stdout:6/255: write d1/d12/f27 [1746961,62658] 0 2024-09-19T06:40:32.670 INFO:tasks.workunit.client.0.smithi099.stdout:3/343: symlink d7/d34/d1d/l5b 0 2024-09-19T06:40:32.671 INFO:tasks.workunit.client.0.smithi099.stdout:4/298: dread d12/f16 [0,4194304] 0 2024-09-19T06:40:32.672 INFO:tasks.workunit.client.0.smithi099.stdout:1/228: creat d0/d12/d13/f49 x:0 0 0 2024-09-19T06:40:32.672 INFO:tasks.workunit.client.1.smithi117.stdout:0/291: rename d11/d13/c21 to d11/d13/d1b/d27/d54/c59 0 2024-09-19T06:40:32.673 INFO:tasks.workunit.client.0.smithi099.stdout:7/369: rename d7/d39/d7d/l83 to d7/d39/d7d/l86 0 2024-09-19T06:40:32.674 INFO:tasks.workunit.client.0.smithi099.stdout:2/156: stat d1/d2/d24/l31 0 2024-09-19T06:40:32.675 INFO:tasks.workunit.client.0.smithi099.stdout:1/229: write d0/f29 [4485173,55205] 0 2024-09-19T06:40:32.675 INFO:tasks.workunit.client.0.smithi099.stdout:7/370: fdatasync d7/dd/f51 0 2024-09-19T06:40:32.677 INFO:tasks.workunit.client.1.smithi117.stdout:0/292: unlink d11/f47 0 2024-09-19T06:40:32.677 INFO:tasks.workunit.client.0.smithi099.stdout:5/437: rename d3/d16/d2f/d34/d3c/c4b to d3/d7/c9e 0 2024-09-19T06:40:32.677 INFO:tasks.workunit.client.0.smithi099.stdout:6/256: rmdir d1/d5/d24/d2e/d41 39 2024-09-19T06:40:32.681 INFO:tasks.workunit.client.1.smithi117.stdout:3/429: creat d0/d9/f80 x:0 0 0 2024-09-19T06:40:32.682 INFO:tasks.workunit.client.0.smithi099.stdout:0/229: sync 2024-09-19T06:40:32.682 INFO:tasks.workunit.client.0.smithi099.stdout:4/299: symlink d12/d58/l6b 0 2024-09-19T06:40:32.682 INFO:tasks.workunit.client.0.smithi099.stdout:1/230: write d0/d12/d13/d37/f3d [1025911,55585] 0 2024-09-19T06:40:32.682 INFO:tasks.workunit.client.0.smithi099.stdout:3/344: mkdir d7/d34/d1d/d20/d58/d5c 0 2024-09-19T06:40:32.685 INFO:tasks.workunit.client.0.smithi099.stdout:0/230: write d0/db/d2f/f30 [37658,27307] 0 2024-09-19T06:40:32.685 INFO:tasks.workunit.client.0.smithi099.stdout:5/438: creat d3/d16/d7d/f9f x:0 0 0 2024-09-19T06:40:32.685 INFO:tasks.workunit.client.0.smithi099.stdout:7/371: fsync d7/dd/d29/d4e/d53/f5d 0 2024-09-19T06:40:32.685 INFO:tasks.workunit.client.0.smithi099.stdout:2/157: creat d1/d2/d5/d13/d2c/f38 x:0 0 0 2024-09-19T06:40:32.686 INFO:tasks.workunit.client.1.smithi117.stdout:3/430: dwrite d0/f14 [4194304,4194304] 0 2024-09-19T06:40:32.688 INFO:tasks.workunit.client.1.smithi117.stdout:4/545: creat d3/db/d20/d35/fbd x:0 0 0 2024-09-19T06:40:32.689 INFO:tasks.workunit.client.0.smithi099.stdout:6/257: mknod d1/d5/d52/c56 0 2024-09-19T06:40:32.692 INFO:tasks.workunit.client.1.smithi117.stdout:3/431: rmdir d0/d19/d70 0 2024-09-19T06:40:32.693 INFO:tasks.workunit.client.0.smithi099.stdout:2/158: creat d1/f39 x:0 0 0 2024-09-19T06:40:32.694 INFO:tasks.workunit.client.1.smithi117.stdout:3/432: write d0/f1e [2614906,1319] 0 2024-09-19T06:40:32.696 INFO:tasks.workunit.client.0.smithi099.stdout:1/231: mknod d0/d12/c4a 0 2024-09-19T06:40:32.696 INFO:tasks.workunit.client.1.smithi117.stdout:3/433: mkdir d0/d3d/d48/d77/d81 0 2024-09-19T06:40:32.697 INFO:tasks.workunit.client.0.smithi099.stdout:0/231: creat d0/db/d2f/f45 x:0 0 0 2024-09-19T06:40:32.698 INFO:tasks.workunit.client.1.smithi117.stdout:3/434: symlink d0/d9/d1c/d53/l82 0 2024-09-19T06:40:32.698 INFO:tasks.workunit.client.0.smithi099.stdout:1/232: readlink d0/l35 0 2024-09-19T06:40:32.702 INFO:tasks.workunit.client.0.smithi099.stdout:7/372: creat d7/dd/d29/d1f/d45/f87 x:0 0 0 2024-09-19T06:40:32.702 INFO:tasks.workunit.client.0.smithi099.stdout:3/345: dwrite d7/d34/d1d/d36/f29 [4194304,4194304] 0 2024-09-19T06:40:32.703 INFO:tasks.workunit.client.1.smithi117.stdout:3/435: rename d0/d3d/d48/l7d to d0/d9/d1c/d53/l83 0 2024-09-19T06:40:32.703 INFO:tasks.workunit.client.0.smithi099.stdout:2/159: symlink d1/d2/d5/d8/d36/l3a 0 2024-09-19T06:40:32.703 INFO:tasks.workunit.client.0.smithi099.stdout:9/261: dread dd/d47/d40/f2e [0,4194304] 0 2024-09-19T06:40:32.703 INFO:tasks.workunit.client.0.smithi099.stdout:5/439: dwrite d3/d1f/f21 [0,4194304] 0 2024-09-19T06:40:32.705 INFO:tasks.workunit.client.1.smithi117.stdout:3/436: mknod d0/d19/d2b/c84 0 2024-09-19T06:40:32.705 INFO:tasks.workunit.client.0.smithi099.stdout:6/258: creat d1/d5/d24/d2e/d41/d4e/d54/f57 x:0 0 0 2024-09-19T06:40:32.707 INFO:tasks.workunit.client.0.smithi099.stdout:8/210: sync 2024-09-19T06:40:32.708 INFO:tasks.workunit.client.1.smithi117.stdout:3/437: rmdir d0/d9/d1c/d53 39 2024-09-19T06:40:32.708 INFO:tasks.workunit.client.0.smithi099.stdout:5/440: chown d3/d1f/f8e 28393 1 2024-09-19T06:40:32.709 INFO:tasks.workunit.client.0.smithi099.stdout:1/233: creat d0/d12/d13/d37/d48/f4b x:0 0 0 2024-09-19T06:40:32.709 INFO:tasks.workunit.client.0.smithi099.stdout:0/232: creat d0/db/f46 x:0 0 0 2024-09-19T06:40:32.711 INFO:tasks.workunit.client.1.smithi117.stdout:3/438: write d0/d24/f5c [1969119,65097] 0 2024-09-19T06:40:32.711 INFO:tasks.workunit.client.0.smithi099.stdout:6/259: chown d1/d5/c2c 2016329 1 2024-09-19T06:40:32.711 INFO:tasks.workunit.client.0.smithi099.stdout:7/373: creat d7/dd/d29/d1f/d45/d48/d63/f88 x:0 0 0 2024-09-19T06:40:32.712 INFO:tasks.workunit.client.0.smithi099.stdout:3/346: write d7/d34/d1d/d36/f29 [8189886,119133] 0 2024-09-19T06:40:32.712 INFO:tasks.workunit.client.0.smithi099.stdout:9/262: symlink dd/d47/l51 0 2024-09-19T06:40:32.716 INFO:tasks.workunit.client.0.smithi099.stdout:0/233: rmdir d0/d17 39 2024-09-19T06:40:32.717 INFO:tasks.workunit.client.0.smithi099.stdout:8/211: dread d4/d11/d23/f3b [0,4194304] 0 2024-09-19T06:40:32.719 INFO:tasks.workunit.client.0.smithi099.stdout:1/234: rename d0/f5 to d0/d12/d13/f4c 0 2024-09-19T06:40:32.720 INFO:tasks.workunit.client.0.smithi099.stdout:6/260: creat d1/d5/d24/d2b/f58 x:0 0 0 2024-09-19T06:40:32.721 INFO:tasks.workunit.client.0.smithi099.stdout:4/300: write d12/d32/d42/f67 [1384938,30601] 0 2024-09-19T06:40:32.722 INFO:tasks.workunit.client.0.smithi099.stdout:6/261: chown d1/d5/d24/d2e/d41/d4e/d54 3190786 1 2024-09-19T06:40:32.722 INFO:tasks.workunit.client.0.smithi099.stdout:9/263: fsync dd/f44 0 2024-09-19T06:40:32.725 INFO:tasks.workunit.client.0.smithi099.stdout:4/301: dread - d12/d32/d42/d5c/f25 zero size 2024-09-19T06:40:32.725 INFO:tasks.workunit.client.0.smithi099.stdout:9/264: chown dd/d2c/f49 34414 1 2024-09-19T06:40:32.726 INFO:tasks.workunit.client.0.smithi099.stdout:8/212: mkdir d4/d11/d23/d4c 0 2024-09-19T06:40:32.729 INFO:tasks.workunit.client.0.smithi099.stdout:5/441: rename d3/d16/d2f/c50 to d3/d16/d2f/d34/d3c/d65/ca0 0 2024-09-19T06:40:32.731 INFO:tasks.workunit.client.1.smithi117.stdout:4/546: dread d3/db/f81 [0,4194304] 0 2024-09-19T06:40:32.732 INFO:tasks.workunit.client.0.smithi099.stdout:0/234: getdents d0/db/d13/d37/d3c/d3e 0 2024-09-19T06:40:32.732 INFO:tasks.workunit.client.0.smithi099.stdout:1/235: dwrite d0/f29 [4194304,4194304] 0 2024-09-19T06:40:32.732 INFO:tasks.workunit.client.0.smithi099.stdout:2/160: getdents d1/d2/d5/d8/dc 0 2024-09-19T06:40:32.734 INFO:tasks.workunit.client.0.smithi099.stdout:2/161: write d1/d2/d5/d8/d18/f23 [713286,26193] 0 2024-09-19T06:40:32.734 INFO:tasks.workunit.client.0.smithi099.stdout:4/302: mknod d12/d32/d42/d5c/c6c 0 2024-09-19T06:40:32.735 INFO:tasks.workunit.client.0.smithi099.stdout:2/162: write d1/d2/d5/d8/d18/f23 [1302105,77309] 0 2024-09-19T06:40:32.736 INFO:tasks.workunit.client.0.smithi099.stdout:2/163: dread - d1/d2/d5/d8/d18/f2f zero size 2024-09-19T06:40:32.738 INFO:tasks.workunit.client.1.smithi117.stdout:4/547: dwrite d3/d4/d5f/f7f [0,4194304] 0 2024-09-19T06:40:32.739 INFO:tasks.workunit.client.0.smithi099.stdout:3/347: rename d7/d34/f1b to d7/d34/d1d/d20/d58/d5c/f5d 0 2024-09-19T06:40:32.739 INFO:tasks.workunit.client.0.smithi099.stdout:3/348: dread - d7/d34/d1d/d36/f4c zero size 2024-09-19T06:40:32.740 INFO:tasks.workunit.client.0.smithi099.stdout:1/236: readlink d0/lf 0 2024-09-19T06:40:32.741 INFO:tasks.workunit.client.0.smithi099.stdout:1/237: chown d0/db/f19 267 1 2024-09-19T06:40:32.741 INFO:tasks.workunit.client.1.smithi117.stdout:3/439: dread d0/d9/d1c/f28 [0,4194304] 0 2024-09-19T06:40:32.742 INFO:tasks.workunit.client.0.smithi099.stdout:9/265: write dd/f44 [731995,58628] 0 2024-09-19T06:40:32.742 INFO:tasks.workunit.client.0.smithi099.stdout:0/235: mkdir d0/db/d13/d47 0 2024-09-19T06:40:32.742 INFO:tasks.workunit.client.0.smithi099.stdout:9/266: readlink dd/d47/d40/l41 0 2024-09-19T06:40:32.743 INFO:tasks.workunit.client.0.smithi099.stdout:0/236: dread - d0/db/d2f/f43 zero size 2024-09-19T06:40:32.744 INFO:tasks.workunit.client.1.smithi117.stdout:3/440: creat d0/d8/f85 x:0 0 0 2024-09-19T06:40:32.744 INFO:tasks.workunit.client.0.smithi099.stdout:0/237: dread - d0/db/d13/f1e zero size 2024-09-19T06:40:32.745 INFO:tasks.workunit.client.1.smithi117.stdout:4/548: creat d3/db/d20/fbe x:0 0 0 2024-09-19T06:40:32.747 INFO:tasks.workunit.client.1.smithi117.stdout:3/441: symlink d0/d19/l86 0 2024-09-19T06:40:32.750 INFO:tasks.workunit.client.0.smithi099.stdout:1/238: fsync d0/d2d/f43 0 2024-09-19T06:40:32.750 INFO:tasks.workunit.client.0.smithi099.stdout:6/262: creat d1/d5/d38/f59 x:0 0 0 2024-09-19T06:40:32.750 INFO:tasks.workunit.client.1.smithi117.stdout:3/442: unlink d0/d8/d7f/f57 0 2024-09-19T06:40:32.750 INFO:tasks.workunit.client.1.smithi117.stdout:3/443: fsync d0/f1e 0 2024-09-19T06:40:32.751 INFO:tasks.workunit.client.0.smithi099.stdout:4/303: dwrite d12/d32/f3e [0,4194304] 0 2024-09-19T06:40:32.753 INFO:tasks.workunit.client.0.smithi099.stdout:9/267: write dd/f16 [4208728,19738] 0 2024-09-19T06:40:32.754 INFO:tasks.workunit.client.0.smithi099.stdout:2/164: symlink d1/d2/d5/d8/d18/d2d/l3b 0 2024-09-19T06:40:32.754 INFO:tasks.workunit.client.1.smithi117.stdout:3/444: unlink d0/d8/d7f/f76 0 2024-09-19T06:40:32.754 INFO:tasks.workunit.client.0.smithi099.stdout:1/239: unlink d0/db/dd/f2c 0 2024-09-19T06:40:32.755 INFO:tasks.workunit.client.1.smithi117.stdout:3/445: chown d0/f6 0 1 2024-09-19T06:40:32.757 INFO:tasks.workunit.client.0.smithi099.stdout:9/268: read dd/f1f [502892,118871] 0 2024-09-19T06:40:32.759 INFO:tasks.workunit.client.0.smithi099.stdout:1/240: write d0/f16 [369614,119175] 0 2024-09-19T06:40:32.761 INFO:tasks.workunit.client.1.smithi117.stdout:3/446: getdents d0/d3d 0 2024-09-19T06:40:32.762 INFO:tasks.workunit.client.1.smithi117.stdout:3/447: dread - d0/d3d/d48/f7b zero size 2024-09-19T06:40:32.763 INFO:tasks.workunit.client.1.smithi117.stdout:4/549: truncate d3/d1b/d7d/f10 821323 0 2024-09-19T06:40:32.765 INFO:tasks.workunit.client.0.smithi099.stdout:6/263: dread d1/d5/d24/d2e/d41/d4e/d2a/f47 [0,4194304] 0 2024-09-19T06:40:32.768 INFO:tasks.workunit.client.0.smithi099.stdout:9/269: rename dd/d2c/f4c to dd/d47/d40/f52 0 2024-09-19T06:40:32.770 INFO:tasks.workunit.client.0.smithi099.stdout:0/238: dwrite d0/f1b [0,4194304] 0 2024-09-19T06:40:32.771 INFO:tasks.workunit.client.0.smithi099.stdout:2/165: dread d1/d2/d5/d8/d9/f1d [0,4194304] 0 2024-09-19T06:40:32.773 INFO:tasks.workunit.client.0.smithi099.stdout:4/304: dwrite d12/d1b/f44 [4194304,4194304] 0 2024-09-19T06:40:32.773 INFO:tasks.workunit.client.0.smithi099.stdout:6/264: dread - d1/d5/d24/d2e/d41/d4e/d54/f57 zero size 2024-09-19T06:40:32.774 INFO:tasks.workunit.client.0.smithi099.stdout:3/349: dread d7/f12 [4194304,4194304] 0 2024-09-19T06:40:32.776 INFO:tasks.workunit.client.1.smithi117.stdout:4/550: dwrite d3/d1b/f62 [0,4194304] 0 2024-09-19T06:40:32.778 INFO:tasks.workunit.client.0.smithi099.stdout:1/241: getdents d0/db/dd 0 2024-09-19T06:40:32.787 INFO:tasks.workunit.client.0.smithi099.stdout:2/166: dwrite d1/d2/d5/d13/d2c/f38 [0,4194304] 0 2024-09-19T06:40:32.787 INFO:tasks.workunit.client.0.smithi099.stdout:4/305: dwrite d12/d1b/f44 [0,4194304] 0 2024-09-19T06:40:32.789 INFO:tasks.workunit.client.0.smithi099.stdout:6/265: dwrite d1/d5/f49 [0,4194304] 0 2024-09-19T06:40:32.791 INFO:tasks.workunit.client.0.smithi099.stdout:4/306: chown d12/d32/f5b 327 1 2024-09-19T06:40:32.791 INFO:tasks.workunit.client.0.smithi099.stdout:2/167: write d1/d2/d5/d8/f2b [71648,63505] 0 2024-09-19T06:40:32.792 INFO:tasks.workunit.client.0.smithi099.stdout:0/239: creat d0/db/f48 x:0 0 0 2024-09-19T06:40:32.792 INFO:tasks.workunit.client.0.smithi099.stdout:3/350: symlink d7/d34/d52/l5e 0 2024-09-19T06:40:32.793 INFO:tasks.workunit.client.0.smithi099.stdout:1/242: creat d0/d17/d32/f4d x:0 0 0 2024-09-19T06:40:32.797 INFO:tasks.workunit.client.0.smithi099.stdout:3/351: truncate d7/f49 762869 0 2024-09-19T06:40:32.800 INFO:tasks.workunit.client.0.smithi099.stdout:1/243: creat d0/d17/d32/f4e x:0 0 0 2024-09-19T06:40:32.803 INFO:tasks.workunit.client.0.smithi099.stdout:6/266: dwrite d1/f19 [0,4194304] 0 2024-09-19T06:40:32.810 INFO:tasks.workunit.client.0.smithi099.stdout:2/168: dwrite d1/d2/d5/d8/fa [0,4194304] 0 2024-09-19T06:40:32.814 INFO:tasks.workunit.client.0.smithi099.stdout:0/240: dwrite d0/d17/d41/f3d [0,4194304] 0 2024-09-19T06:40:32.823 INFO:tasks.workunit.client.1.smithi117.stdout:4/551: dwrite d3/db/d20/d29/d39/d4f/fac [0,4194304] 0 2024-09-19T06:40:32.826 INFO:tasks.workunit.client.0.smithi099.stdout:1/244: dwrite d0/d12/d13/d37/f3f [0,4194304] 0 2024-09-19T06:40:32.826 INFO:tasks.workunit.client.0.smithi099.stdout:6/267: dwrite d1/f4f [0,4194304] 0 2024-09-19T06:40:32.828 INFO:tasks.workunit.client.0.smithi099.stdout:0/241: creat d0/d17/d41/f49 x:0 0 0 2024-09-19T06:40:32.834 INFO:tasks.workunit.client.0.smithi099.stdout:9/270: dread fb [0,4194304] 0 2024-09-19T06:40:32.834 INFO:tasks.workunit.client.0.smithi099.stdout:0/242: mkdir d0/db/d13/d1f/d4a 0 2024-09-19T06:40:32.836 INFO:tasks.workunit.client.0.smithi099.stdout:1/245: rename d0/d12/d13/c26 to d0/d17/d24/d3a/c4f 0 2024-09-19T06:40:32.838 INFO:tasks.workunit.client.0.smithi099.stdout:2/169: dread d1/d2/d5/d8/fa [0,4194304] 0 2024-09-19T06:40:32.839 INFO:tasks.workunit.client.0.smithi099.stdout:9/271: rename dd/d47/d40/c48 to dd/d47/c53 0 2024-09-19T06:40:32.840 INFO:tasks.workunit.client.0.smithi099.stdout:2/170: chown d1/d2 7166 1 2024-09-19T06:40:32.841 INFO:tasks.workunit.client.0.smithi099.stdout:0/243: getdents d0/db/d13/d1f/d4a 0 2024-09-19T06:40:32.841 INFO:tasks.workunit.client.0.smithi099.stdout:4/307: dread fb [0,4194304] 0 2024-09-19T06:40:32.843 INFO:tasks.workunit.client.0.smithi099.stdout:9/272: dread - dd/d47/d40/f4f zero size 2024-09-19T06:40:32.844 INFO:tasks.workunit.client.0.smithi099.stdout:2/171: chown d1/d2/d5/d8/dc/l17 1056 1 2024-09-19T06:40:32.844 INFO:tasks.workunit.client.0.smithi099.stdout:1/246: rename d0/db/f38 to d0/d17/d32/f50 0 2024-09-19T06:40:32.845 INFO:tasks.workunit.client.0.smithi099.stdout:6/268: dwrite d1/f1d [4194304,4194304] 0 2024-09-19T06:40:32.846 INFO:tasks.workunit.client.0.smithi099.stdout:0/244: write d0/d17/d41/f2d [1283131,4421] 0 2024-09-19T06:40:32.849 INFO:tasks.workunit.client.0.smithi099.stdout:2/172: rmdir d1/d2/d5/d13 39 2024-09-19T06:40:32.850 INFO:tasks.workunit.client.0.smithi099.stdout:6/269: dread d1/d5/d24/d2e/d41/d4e/d2a/f47 [0,4194304] 0 2024-09-19T06:40:32.852 INFO:tasks.workunit.client.1.smithi117.stdout:9/337: sync 2024-09-19T06:40:32.852 INFO:tasks.workunit.client.0.smithi099.stdout:6/270: write d1/d5/d24/d2e/f31 [919199,87748] 0 2024-09-19T06:40:32.853 INFO:tasks.workunit.client.0.smithi099.stdout:4/308: link d12/d32/d42/c66 d12/d58/c6d 0 2024-09-19T06:40:32.855 INFO:tasks.workunit.client.0.smithi099.stdout:6/271: creat d1/d5/d24/d2e/d41/f5a x:0 0 0 2024-09-19T06:40:32.855 INFO:tasks.workunit.client.1.smithi117.stdout:9/338: mknod d4/d1c/d36/d37/c72 0 2024-09-19T06:40:32.856 INFO:tasks.workunit.client.0.smithi099.stdout:6/272: read d1/d5/f49 [3965540,120458] 0 2024-09-19T06:40:32.857 INFO:tasks.workunit.client.0.smithi099.stdout:1/247: getdents d0/d12/d13/d37/d48 0 2024-09-19T06:40:32.858 INFO:tasks.workunit.client.0.smithi099.stdout:1/248: mknod d0/d17/c51 0 2024-09-19T06:40:32.860 INFO:tasks.workunit.client.0.smithi099.stdout:4/309: rename d12/l49 to d12/l6e 0 2024-09-19T06:40:32.861 INFO:tasks.workunit.client.0.smithi099.stdout:3/352: dread d7/f12 [0,4194304] 0 2024-09-19T06:40:32.862 INFO:tasks.workunit.client.1.smithi117.stdout:9/339: dread d4/f44 [0,4194304] 0 2024-09-19T06:40:32.866 INFO:tasks.workunit.client.0.smithi099.stdout:3/353: getdents d7/d34/d1d/d20 0 2024-09-19T06:40:32.867 INFO:tasks.workunit.client.0.smithi099.stdout:3/354: write d7/d34/d1d/d36/f29 [8592590,21671] 0 2024-09-19T06:40:32.869 INFO:tasks.workunit.client.0.smithi099.stdout:3/355: fdatasync d7/f15 0 2024-09-19T06:40:32.872 INFO:tasks.workunit.client.0.smithi099.stdout:3/356: rename d7/d34/d1d/d20/f4b to d7/f5f 0 2024-09-19T06:40:32.873 INFO:tasks.workunit.client.0.smithi099.stdout:3/357: readlink d7/d34/d28/l3c 0 2024-09-19T06:40:32.875 INFO:tasks.workunit.client.0.smithi099.stdout:3/358: write d7/d34/d28/f30 [5016391,48174] 0 2024-09-19T06:40:32.877 INFO:tasks.workunit.client.0.smithi099.stdout:9/273: write dd/fe [3230176,72672] 0 2024-09-19T06:40:32.878 INFO:tasks.workunit.client.0.smithi099.stdout:3/359: mknod d7/d34/d1d/d20/d58/d5c/c60 0 2024-09-19T06:40:32.878 INFO:tasks.workunit.client.0.smithi099.stdout:0/245: dread d0/f11 [0,4194304] 0 2024-09-19T06:40:32.879 INFO:tasks.workunit.client.1.smithi117.stdout:9/340: dread d4/f19 [0,4194304] 0 2024-09-19T06:40:32.879 INFO:tasks.workunit.client.0.smithi099.stdout:9/274: read dd/d47/f33 [358309,58982] 0 2024-09-19T06:40:32.886 INFO:tasks.workunit.client.1.smithi117.stdout:9/341: unlink d4/l4b 0 2024-09-19T06:40:32.886 INFO:tasks.workunit.client.1.smithi117.stdout:9/342: truncate d4/d1c/d46/f47 322018 0 2024-09-19T06:40:32.886 INFO:tasks.workunit.client.0.smithi099.stdout:6/273: truncate d1/f1e 180816 0 2024-09-19T06:40:32.886 INFO:tasks.workunit.client.0.smithi099.stdout:6/274: dread - d1/d5/f42 zero size 2024-09-19T06:40:32.886 INFO:tasks.workunit.client.0.smithi099.stdout:4/310: write d12/d32/d39/f40 [4136539,67298] 0 2024-09-19T06:40:32.886 INFO:tasks.workunit.client.1.smithi117.stdout:9/343: mkdir d4/d1c/d73 0 2024-09-19T06:40:32.887 INFO:tasks.workunit.client.0.smithi099.stdout:4/311: rename fb to d12/d1b/f6f 0 2024-09-19T06:40:32.889 INFO:tasks.workunit.client.0.smithi099.stdout:0/246: rmdir d0/db/d27/d34 0 2024-09-19T06:40:32.889 INFO:tasks.workunit.client.0.smithi099.stdout:9/275: creat dd/d2c/f54 x:0 0 0 2024-09-19T06:40:32.891 INFO:tasks.workunit.client.0.smithi099.stdout:9/276: write dd/d47/f2a [3790177,96654] 0 2024-09-19T06:40:32.891 INFO:tasks.workunit.client.1.smithi117.stdout:9/344: dwrite d4/d8/f31 [0,4194304] 0 2024-09-19T06:40:32.893 INFO:tasks.workunit.client.1.smithi117.stdout:9/345: write d4/d1c/f28 [5233822,34950] 0 2024-09-19T06:40:32.895 INFO:tasks.workunit.client.0.smithi099.stdout:3/360: write d7/d34/d1d/d36/f38 [6067997,79610] 0 2024-09-19T06:40:32.896 INFO:tasks.workunit.client.0.smithi099.stdout:9/277: mknod dd/d2c/c55 0 2024-09-19T06:40:32.898 INFO:tasks.workunit.client.1.smithi117.stdout:9/346: dread d4/d1c/f28 [0,4194304] 0 2024-09-19T06:40:32.898 INFO:tasks.workunit.client.0.smithi099.stdout:4/312: getdents d12/d32 0 2024-09-19T06:40:32.900 INFO:tasks.workunit.client.0.smithi099.stdout:3/361: symlink d7/d34/l61 0 2024-09-19T06:40:32.904 INFO:tasks.workunit.client.0.smithi099.stdout:6/275: truncate d1/d12/f1f 3541354 0 2024-09-19T06:40:32.905 INFO:tasks.workunit.client.0.smithi099.stdout:9/278: link dd/d2c/f30 dd/d47/d40/f56 0 2024-09-19T06:40:32.905 INFO:tasks.workunit.client.0.smithi099.stdout:4/313: dwrite d12/d32/f61 [0,4194304] 0 2024-09-19T06:40:32.906 INFO:tasks.workunit.client.0.smithi099.stdout:3/362: truncate d7/f15 2430304 0 2024-09-19T06:40:32.907 INFO:tasks.workunit.client.0.smithi099.stdout:6/276: creat d1/d5/d24/d2b/f5b x:0 0 0 2024-09-19T06:40:32.907 INFO:tasks.workunit.client.0.smithi099.stdout:9/279: stat dd/c14 0 2024-09-19T06:40:32.911 INFO:tasks.workunit.client.0.smithi099.stdout:6/277: unlink d1/d5/d24/d2b/f5b 0 2024-09-19T06:40:32.914 INFO:tasks.workunit.client.0.smithi099.stdout:0/247: dread d0/f2a [4194304,4194304] 0 2024-09-19T06:40:32.914 INFO:tasks.workunit.client.0.smithi099.stdout:3/363: dwrite d7/f12 [4194304,4194304] 0 2024-09-19T06:40:32.914 INFO:tasks.workunit.client.0.smithi099.stdout:6/278: write d1/d5/d24/d2e/d41/d4e/d2a/f55 [338122,14661] 0 2024-09-19T06:40:32.916 INFO:tasks.workunit.client.0.smithi099.stdout:0/248: chown d0/db/d36/d3f 4867 1 2024-09-19T06:40:32.917 INFO:tasks.workunit.client.0.smithi099.stdout:9/280: link dd/c14 dd/c57 0 2024-09-19T06:40:32.918 INFO:tasks.workunit.client.0.smithi099.stdout:3/364: creat d7/d34/d1d/d36/d42/f62 x:0 0 0 2024-09-19T06:40:32.920 INFO:tasks.workunit.client.0.smithi099.stdout:9/281: unlink dd/l3d 0 2024-09-19T06:40:32.922 INFO:tasks.workunit.client.0.smithi099.stdout:3/365: mknod d7/d34/d1d/d36/d42/c63 0 2024-09-19T06:40:32.922 INFO:tasks.workunit.client.0.smithi099.stdout:0/249: mknod d0/db/c4b 0 2024-09-19T06:40:32.923 INFO:tasks.workunit.client.0.smithi099.stdout:0/250: write d0/db/d27/f2c [78809,19708] 0 2024-09-19T06:40:32.925 INFO:tasks.workunit.client.0.smithi099.stdout:3/366: symlink d7/d34/d1d/d20/d58/d5c/l64 0 2024-09-19T06:40:32.927 INFO:tasks.workunit.client.0.smithi099.stdout:0/251: creat d0/db/d13/d37/d3c/d3e/f4c x:0 0 0 2024-09-19T06:40:32.928 INFO:tasks.workunit.client.0.smithi099.stdout:0/252: rename d0/db to d0/db/d27/d38/d4d 22 2024-09-19T06:40:32.929 INFO:tasks.workunit.client.0.smithi099.stdout:6/279: getdents d1/d5/d24/d2b 0 2024-09-19T06:40:32.929 INFO:tasks.workunit.client.0.smithi099.stdout:3/367: getdents d7/d34/d1d/d57 0 2024-09-19T06:40:32.930 INFO:tasks.workunit.client.0.smithi099.stdout:0/253: rmdir d0/db/d13/d37/d3c 39 2024-09-19T06:40:32.931 INFO:tasks.workunit.client.0.smithi099.stdout:0/254: write d0/db/f23 [2324515,52074] 0 2024-09-19T06:40:32.931 INFO:tasks.workunit.client.0.smithi099.stdout:6/280: rename d1/l20 to d1/d12/l5c 0 2024-09-19T06:40:32.933 INFO:tasks.workunit.client.0.smithi099.stdout:0/255: write d0/db/d2f/f43 [372347,39319] 0 2024-09-19T06:40:32.934 INFO:tasks.workunit.client.0.smithi099.stdout:0/256: readlink d0/db/l26 0 2024-09-19T06:40:32.936 INFO:tasks.workunit.client.0.smithi099.stdout:9/282: truncate fb 2374697 0 2024-09-19T06:40:32.937 INFO:tasks.workunit.client.0.smithi099.stdout:6/281: mkdir d1/d5/d24/d2e/d41/d4e/d54/d5d 0 2024-09-19T06:40:32.937 INFO:tasks.workunit.client.0.smithi099.stdout:0/257: chown d0/f3 12 1 2024-09-19T06:40:32.938 INFO:tasks.workunit.client.0.smithi099.stdout:3/368: dwrite d7/d34/d28/f30 [0,4194304] 0 2024-09-19T06:40:32.938 INFO:tasks.workunit.client.0.smithi099.stdout:0/258: fsync d0/db/d27/f2c 0 2024-09-19T06:40:32.939 INFO:tasks.workunit.client.0.smithi099.stdout:9/283: truncate dd/d47/f33 31103 0 2024-09-19T06:40:32.939 INFO:tasks.workunit.client.0.smithi099.stdout:0/259: chown d0/db/d13/d1f/d39 14664 1 2024-09-19T06:40:32.940 INFO:tasks.workunit.client.0.smithi099.stdout:6/282: rename d1/d5/d24/d2b/c3b to d1/d12/c5e 0 2024-09-19T06:40:32.942 INFO:tasks.workunit.client.0.smithi099.stdout:9/284: mknod dd/d2c/c58 0 2024-09-19T06:40:32.945 INFO:tasks.workunit.client.0.smithi099.stdout:9/285: fdatasync dd/d47/d40/f2e 0 2024-09-19T06:40:32.947 INFO:tasks.workunit.client.0.smithi099.stdout:9/286: write dd/d47/f38 [691662,84834] 0 2024-09-19T06:40:32.948 INFO:tasks.workunit.client.0.smithi099.stdout:6/283: dwrite d1/f19 [0,4194304] 0 2024-09-19T06:40:32.949 INFO:tasks.workunit.client.0.smithi099.stdout:6/284: write d1/f10 [3318508,117486] 0 2024-09-19T06:40:32.952 INFO:tasks.workunit.client.0.smithi099.stdout:6/285: creat d1/d12/f5f x:0 0 0 2024-09-19T06:40:32.953 INFO:tasks.workunit.client.0.smithi099.stdout:9/287: rename dd/d2c/f25 to dd/d47/d40/f59 0 2024-09-19T06:40:32.953 INFO:tasks.workunit.client.0.smithi099.stdout:9/288: chown dd/d47/l51 524079946 1 2024-09-19T06:40:32.954 INFO:tasks.workunit.client.1.smithi117.stdout:5/367: sync 2024-09-19T06:40:32.955 INFO:tasks.workunit.client.0.smithi099.stdout:9/289: truncate dd/d2c/f49 181079 0 2024-09-19T06:40:32.955 INFO:tasks.workunit.client.1.smithi117.stdout:9/347: truncate d4/f33 5161924 0 2024-09-19T06:40:32.957 INFO:tasks.workunit.client.0.smithi099.stdout:6/286: creat d1/d5/d24/d2e/d41/d4e/d2a/f60 x:0 0 0 2024-09-19T06:40:32.957 INFO:tasks.workunit.client.1.smithi117.stdout:9/348: mknod d4/d1c/d46/c74 0 2024-09-19T06:40:32.958 INFO:tasks.workunit.client.1.smithi117.stdout:5/368: creat d17/f81 x:0 0 0 2024-09-19T06:40:32.958 INFO:tasks.workunit.client.1.smithi117.stdout:9/349: rmdir d4/d1c/d54 39 2024-09-19T06:40:32.959 INFO:tasks.workunit.client.0.smithi099.stdout:6/287: write d1/d5/d24/d2e/d41/d4e/d2a/f30 [3296347,22140] 0 2024-09-19T06:40:32.959 INFO:tasks.workunit.client.0.smithi099.stdout:6/288: read - d1/d5/d24/d2b/f58 zero size 2024-09-19T06:40:32.960 INFO:tasks.workunit.client.1.smithi117.stdout:5/369: write d17/d1b/d3a/f68 [735613,80866] 0 2024-09-19T06:40:32.962 INFO:tasks.workunit.client.0.smithi099.stdout:9/290: creat dd/d2c/f5a x:0 0 0 2024-09-19T06:40:32.962 INFO:tasks.workunit.client.1.smithi117.stdout:9/350: mkdir d4/d1c/d54/d75 0 2024-09-19T06:40:32.965 INFO:tasks.workunit.client.1.smithi117.stdout:9/351: creat d4/d17/f76 x:0 0 0 2024-09-19T06:40:32.966 INFO:tasks.workunit.client.0.smithi099.stdout:6/289: mkdir d1/d5/d24/d2e/d41/d4e/d54/d5d/d61 0 2024-09-19T06:40:32.968 INFO:tasks.workunit.client.1.smithi117.stdout:5/370: dwrite d17/d2f/d3b/f78 [0,4194304] 0 2024-09-19T06:40:32.970 INFO:tasks.workunit.client.0.smithi099.stdout:9/291: dwrite dd/d2c/f49 [0,4194304] 0 2024-09-19T06:40:32.973 INFO:tasks.workunit.client.0.smithi099.stdout:6/290: symlink d1/d12/l62 0 2024-09-19T06:40:32.973 INFO:tasks.workunit.client.0.smithi099.stdout:3/369: truncate d7/d34/d1d/d36/f29 4809502 0 2024-09-19T06:40:32.978 INFO:tasks.workunit.client.0.smithi099.stdout:0/260: truncate d0/f2a 6840009 0 2024-09-19T06:40:32.979 INFO:tasks.workunit.client.1.smithi117.stdout:5/371: truncate d17/d1b/d3a/f68 359414 0 2024-09-19T06:40:32.980 INFO:tasks.workunit.client.0.smithi099.stdout:0/261: chown d0/d17 468 1 2024-09-19T06:40:32.981 INFO:tasks.workunit.client.0.smithi099.stdout:9/292: creat dd/f5b x:0 0 0 2024-09-19T06:40:32.982 INFO:tasks.workunit.client.1.smithi117.stdout:5/372: mknod d17/d2e/d65/c82 0 2024-09-19T06:40:32.982 INFO:tasks.workunit.client.0.smithi099.stdout:6/291: dread d1/d5/d24/d2e/f32 [0,4194304] 0 2024-09-19T06:40:32.983 INFO:tasks.workunit.client.0.smithi099.stdout:9/293: fdatasync dd/d47/f38 0 2024-09-19T06:40:32.984 INFO:tasks.workunit.client.0.smithi099.stdout:0/262: creat d0/db/d2f/f4e x:0 0 0 2024-09-19T06:40:32.986 INFO:tasks.workunit.client.0.smithi099.stdout:6/292: chown d1/d5/d24/d2b 6 1 2024-09-19T06:40:32.986 INFO:tasks.workunit.client.0.smithi099.stdout:9/294: mkdir dd/d2c/d5c 0 2024-09-19T06:40:32.987 INFO:tasks.workunit.client.1.smithi117.stdout:5/373: unlink d17/d2e/d55/f5a 0 2024-09-19T06:40:32.988 INFO:tasks.workunit.client.0.smithi099.stdout:0/263: creat d0/db/d13/d1f/d39/f4f x:0 0 0 2024-09-19T06:40:32.989 INFO:tasks.workunit.client.0.smithi099.stdout:0/264: fdatasync d0/db/d13/d1f/f2b 0 2024-09-19T06:40:32.989 INFO:tasks.workunit.client.0.smithi099.stdout:6/293: chown d1/d12/c5e 1819 1 2024-09-19T06:40:32.992 INFO:tasks.workunit.client.0.smithi099.stdout:9/295: creat dd/f5d x:0 0 0 2024-09-19T06:40:32.993 INFO:tasks.workunit.client.0.smithi099.stdout:9/296: truncate dd/f44 1402773 0 2024-09-19T06:40:32.994 INFO:tasks.workunit.client.0.smithi099.stdout:0/265: chown d0/db/d13/c19 616941120 1 2024-09-19T06:40:33.003 INFO:tasks.workunit.client.1.smithi117.stdout:5/374: truncate d17/d2f/f80 7904294 0 2024-09-19T06:40:33.007 INFO:tasks.workunit.client.0.smithi099.stdout:3/370: dread d7/f10 [0,4194304] 0 2024-09-19T06:40:33.007 INFO:tasks.workunit.client.0.smithi099.stdout:0/266: rmdir d0/db/d13 39 2024-09-19T06:40:33.008 INFO:tasks.workunit.client.0.smithi099.stdout:3/371: chown d7/ff 48480 1 2024-09-19T06:40:33.009 INFO:tasks.workunit.client.1.smithi117.stdout:9/352: dread d4/df/d16/f26 [0,4194304] 0 2024-09-19T06:40:33.010 INFO:tasks.workunit.client.1.smithi117.stdout:5/375: dwrite d17/f74 [0,4194304] 0 2024-09-19T06:40:33.010 INFO:tasks.workunit.client.0.smithi099.stdout:3/372: mknod d7/d34/d1d/d20/d58/c65 0 2024-09-19T06:40:33.011 INFO:tasks.workunit.client.1.smithi117.stdout:5/376: fsync d17/d1b/d3a/d3c/d46/f4a 0 2024-09-19T06:40:33.012 INFO:tasks.workunit.client.1.smithi117.stdout:5/377: chown d17/d2f/d3b/l6b 15902305 1 2024-09-19T06:40:33.013 INFO:tasks.workunit.client.0.smithi099.stdout:0/267: creat d0/db/d13/d1f/d4a/f50 x:0 0 0 2024-09-19T06:40:33.014 INFO:tasks.workunit.client.0.smithi099.stdout:0/268: fdatasync d0/d17/d41/f3d 0 2024-09-19T06:40:33.015 INFO:tasks.workunit.client.0.smithi099.stdout:0/269: fdatasync d0/db/d13/f1e 0 2024-09-19T06:40:33.016 INFO:tasks.workunit.client.1.smithi117.stdout:9/353: creat d4/d1c/d36/f77 x:0 0 0 2024-09-19T06:40:33.017 INFO:tasks.workunit.client.1.smithi117.stdout:9/354: fsync d4/df/d52/f3c 0 2024-09-19T06:40:33.017 INFO:tasks.workunit.client.1.smithi117.stdout:9/355: readlink d4/df/l11 0 2024-09-19T06:40:33.019 INFO:tasks.workunit.client.1.smithi117.stdout:9/356: write d4/d17/f61 [526909,6548] 0 2024-09-19T06:40:33.022 INFO:tasks.workunit.client.1.smithi117.stdout:9/357: truncate d4/df/f2f 1099658 0 2024-09-19T06:40:33.023 INFO:tasks.workunit.client.1.smithi117.stdout:9/358: chown d4/d8/d6a 28516 1 2024-09-19T06:40:33.024 INFO:tasks.workunit.client.1.smithi117.stdout:9/359: dread - d4/df/d52/f3e zero size 2024-09-19T06:40:33.024 INFO:tasks.workunit.client.0.smithi099.stdout:6/294: dread d1/f9 [0,4194304] 0 2024-09-19T06:40:33.024 INFO:tasks.workunit.client.0.smithi099.stdout:9/297: dwrite dd/d47/d40/f56 [0,4194304] 0 2024-09-19T06:40:33.025 INFO:tasks.workunit.client.1.smithi117.stdout:9/360: read - d4/df/d52/f3e zero size 2024-09-19T06:40:33.025 INFO:tasks.workunit.client.1.smithi117.stdout:9/361: fsync d4/d1c/f59 0 2024-09-19T06:40:33.025 INFO:tasks.workunit.client.0.smithi099.stdout:7/374: sync 2024-09-19T06:40:33.026 INFO:tasks.workunit.client.0.smithi099.stdout:3/373: chown d7/d34/d1d/d36/f29 4193 1 2024-09-19T06:40:33.026 INFO:tasks.workunit.client.1.smithi117.stdout:5/378: truncate d17/d2f/f80 5976651 0 2024-09-19T06:40:33.028 INFO:tasks.workunit.client.1.smithi117.stdout:9/362: mknod d4/d1c/d36/c78 0 2024-09-19T06:40:33.029 INFO:tasks.workunit.client.0.smithi099.stdout:0/270: dwrite d0/db/d2f/f4e [0,4194304] 0 2024-09-19T06:40:33.031 INFO:tasks.workunit.client.0.smithi099.stdout:3/374: chown d7/f14 5962532 1 2024-09-19T06:40:33.032 INFO:tasks.workunit.client.1.smithi117.stdout:9/363: mknod d4/d1c/c79 0 2024-09-19T06:40:33.033 INFO:tasks.workunit.client.0.smithi099.stdout:0/271: symlink d0/db/d13/d1f/d39/l51 0 2024-09-19T06:40:33.035 INFO:tasks.workunit.client.1.smithi117.stdout:5/379: link d17/d1b/d3a/d3c/l6c d17/d1b/d3a/d3c/d70/l83 0 2024-09-19T06:40:33.035 INFO:tasks.workunit.client.0.smithi099.stdout:6/295: creat d1/d5/d24/d2e/d41/d4e/d54/d5d/d61/f63 x:0 0 0 2024-09-19T06:40:33.037 INFO:tasks.workunit.client.0.smithi099.stdout:0/272: write d0/d17/d41/f3d [1148709,29042] 0 2024-09-19T06:40:33.041 INFO:tasks.workunit.client.0.smithi099.stdout:6/296: write d1/d5/d24/d2e/d41/d4e/d2a/f47 [997414,117600] 0 2024-09-19T06:40:33.041 INFO:tasks.workunit.client.1.smithi117.stdout:5/380: dwrite d17/d1b/f48 [0,4194304] 0 2024-09-19T06:40:33.042 INFO:tasks.workunit.client.0.smithi099.stdout:0/273: mknod d0/db/d13/d1f/c52 0 2024-09-19T06:40:33.042 INFO:tasks.workunit.client.0.smithi099.stdout:3/375: dwrite d7/d34/d1d/d36/d42/f62 [0,4194304] 0 2024-09-19T06:40:33.046 INFO:tasks.workunit.client.0.smithi099.stdout:0/274: unlink d0/db/d13/d1f/d39/l51 0 2024-09-19T06:40:33.047 INFO:tasks.workunit.client.1.smithi117.stdout:5/381: link d17/d1b/d3a/d3c/d46/l47 d17/d1b/d5d/l84 0 2024-09-19T06:40:33.048 INFO:tasks.workunit.client.0.smithi099.stdout:9/298: truncate dd/f34 389220 0 2024-09-19T06:40:33.050 INFO:tasks.workunit.client.0.smithi099.stdout:3/376: getdents d7/d34/d28 0 2024-09-19T06:40:33.051 INFO:tasks.workunit.client.0.smithi099.stdout:0/275: symlink d0/db/d13/d37/l53 0 2024-09-19T06:40:33.051 INFO:tasks.workunit.client.1.smithi117.stdout:5/382: link c9 d17/d2f/c85 0 2024-09-19T06:40:33.052 INFO:tasks.workunit.client.0.smithi099.stdout:9/299: creat dd/d47/d40/f5e x:0 0 0 2024-09-19T06:40:33.054 INFO:tasks.workunit.client.1.smithi117.stdout:5/383: unlink l4 0 2024-09-19T06:40:33.054 INFO:tasks.workunit.client.0.smithi099.stdout:3/377: mknod d7/d34/d1d/d20/c66 0 2024-09-19T06:40:33.054 INFO:tasks.workunit.client.0.smithi099.stdout:7/375: truncate d7/dd/d29/d34/f35 3487668 0 2024-09-19T06:40:33.055 INFO:tasks.workunit.client.1.smithi117.stdout:9/364: rename d4/df to d4/d1c/d7a 0 2024-09-19T06:40:33.055 INFO:tasks.workunit.client.1.smithi117.stdout:5/384: write d17/d1b/d3a/f3e [439454,76433] 0 2024-09-19T06:40:33.056 INFO:tasks.workunit.client.0.smithi099.stdout:9/300: rename dd/d2c/f18 to dd/d47/f5f 0 2024-09-19T06:40:33.057 INFO:tasks.workunit.client.1.smithi117.stdout:9/365: fdatasync d4/f19 0 2024-09-19T06:40:33.057 INFO:tasks.workunit.client.0.smithi099.stdout:3/378: rmdir d7/d34/d1d/d20/d58/d5c 39 2024-09-19T06:40:33.058 INFO:tasks.workunit.client.1.smithi117.stdout:5/385: chown d17/d2e/d55/c60 101 1 2024-09-19T06:40:33.059 INFO:tasks.workunit.client.0.smithi099.stdout:7/376: creat d7/dd/d29/d4e/d53/d64/f89 x:0 0 0 2024-09-19T06:40:33.060 INFO:tasks.workunit.client.1.smithi117.stdout:5/386: mkdir d17/d1b/d5d/d86 0 2024-09-19T06:40:33.060 INFO:tasks.workunit.client.1.smithi117.stdout:5/387: stat d17/d2f/c6d 0 2024-09-19T06:40:33.060 INFO:tasks.workunit.client.0.smithi099.stdout:7/377: write d7/dd/d29/d4e/d53/f5c [4965988,14678] 0 2024-09-19T06:40:33.061 INFO:tasks.workunit.client.1.smithi117.stdout:9/366: link d4/f33 d4/d17/f7b 0 2024-09-19T06:40:33.061 INFO:tasks.workunit.client.0.smithi099.stdout:9/301: rename dd/f22 to dd/f60 0 2024-09-19T06:40:33.061 INFO:tasks.workunit.client.1.smithi117.stdout:5/388: write d17/d1b/d3a/d3c/f3d [2771445,94555] 0 2024-09-19T06:40:33.064 INFO:tasks.workunit.client.1.smithi117.stdout:5/389: creat d17/d1b/d3a/d3c/d70/f87 x:0 0 0 2024-09-19T06:40:33.064 INFO:tasks.workunit.client.0.smithi099.stdout:7/378: mknod d7/dd/d29/d4e/d53/c8a 0 2024-09-19T06:40:33.065 INFO:tasks.workunit.client.0.smithi099.stdout:9/302: mkdir dd/d47/d40/d61 0 2024-09-19T06:40:33.068 INFO:tasks.workunit.client.0.smithi099.stdout:9/303: unlink dd/d47/c2f 0 2024-09-19T06:40:33.068 INFO:tasks.workunit.client.0.smithi099.stdout:3/379: dwrite d7/d34/d1d/d20/d58/d5c/f5d [4194304,4194304] 0 2024-09-19T06:40:33.069 INFO:tasks.workunit.client.0.smithi099.stdout:9/304: dread - dd/d47/d40/f31 zero size 2024-09-19T06:40:33.077 INFO:tasks.workunit.client.0.smithi099.stdout:3/380: getdents d7/d34 0 2024-09-19T06:40:33.077 INFO:tasks.workunit.client.0.smithi099.stdout:7/379: write d7/d39/f59 [168760,99405] 0 2024-09-19T06:40:33.078 INFO:tasks.workunit.client.0.smithi099.stdout:9/305: rmdir dd/d47 39 2024-09-19T06:40:33.081 INFO:tasks.workunit.client.0.smithi099.stdout:9/306: write dd/d47/d40/f52 [489571,9289] 0 2024-09-19T06:40:33.083 INFO:tasks.workunit.client.0.smithi099.stdout:9/307: mkdir dd/d62 0 2024-09-19T06:40:33.089 INFO:tasks.workunit.client.0.smithi099.stdout:9/308: dwrite dd/d47/f2a [4194304,4194304] 0 2024-09-19T06:40:33.099 INFO:tasks.workunit.client.0.smithi099.stdout:9/309: dwrite dd/f1f [0,4194304] 0 2024-09-19T06:40:33.099 INFO:tasks.workunit.client.0.smithi099.stdout:9/310: readlink dd/d47/l51 0 2024-09-19T06:40:33.103 INFO:tasks.workunit.client.0.smithi099.stdout:9/311: unlink dd/d47/d40/f4f 0 2024-09-19T06:40:33.106 INFO:tasks.workunit.client.0.smithi099.stdout:9/312: creat dd/d47/d40/d61/f63 x:0 0 0 2024-09-19T06:40:33.108 INFO:tasks.workunit.client.0.smithi099.stdout:9/313: mkdir dd/d2c/d5c/d64 0 2024-09-19T06:40:33.110 INFO:tasks.workunit.client.0.smithi099.stdout:9/314: mkdir dd/d65 0 2024-09-19T06:40:33.123 INFO:tasks.workunit.client.0.smithi099.stdout:9/315: dread dd/d47/d40/f11 [0,4194304] 0 2024-09-19T06:40:33.127 INFO:tasks.workunit.client.0.smithi099.stdout:9/316: rmdir dd/d47/d40/d61 39 2024-09-19T06:40:33.128 INFO:tasks.workunit.client.0.smithi099.stdout:9/317: unlink dd/d2c/f1a 0 2024-09-19T06:40:33.142 INFO:tasks.workunit.client.0.smithi099.stdout:9/318: rename dd/d47/f33 to dd/d62/f66 0 2024-09-19T06:40:33.144 INFO:tasks.workunit.client.0.smithi099.stdout:9/319: rename dd/f16 to dd/d65/f67 0 2024-09-19T06:40:33.146 INFO:tasks.workunit.client.0.smithi099.stdout:9/320: mkdir dd/d47/d68 0 2024-09-19T06:40:33.149 INFO:tasks.workunit.client.0.smithi099.stdout:9/321: dread dd/d47/d40/f52 [0,4194304] 0 2024-09-19T06:40:33.152 INFO:tasks.workunit.client.1.smithi117.stdout:5/390: fsync d17/f22 0 2024-09-19T06:40:33.153 INFO:tasks.workunit.client.1.smithi117.stdout:9/367: getdents d4/d8 0 2024-09-19T06:40:33.153 INFO:tasks.workunit.client.0.smithi099.stdout:9/322: write fb [343480,95193] 0 2024-09-19T06:40:33.154 INFO:tasks.workunit.client.1.smithi117.stdout:9/368: truncate d4/d20/f45 195232 0 2024-09-19T06:40:33.154 INFO:tasks.workunit.client.1.smithi117.stdout:5/391: mkdir d17/d2e/d65/d88 0 2024-09-19T06:40:33.154 INFO:tasks.workunit.client.1.smithi117.stdout:9/369: readlink d4/d17/l32 0 2024-09-19T06:40:33.155 INFO:tasks.workunit.client.1.smithi117.stdout:9/370: fdatasync d4/d20/f45 0 2024-09-19T06:40:33.157 INFO:tasks.workunit.client.1.smithi117.stdout:9/371: symlink d4/d8/l7c 0 2024-09-19T06:40:33.157 INFO:tasks.workunit.client.1.smithi117.stdout:9/372: stat d4/d1c/d36/f77 0 2024-09-19T06:40:33.159 INFO:tasks.workunit.client.0.smithi099.stdout:9/323: dwrite fb [0,4194304] 0 2024-09-19T06:40:33.159 INFO:tasks.workunit.client.1.smithi117.stdout:5/392: getdents d17/d1b/d3a/d3c/d46 0 2024-09-19T06:40:33.161 INFO:tasks.workunit.client.0.smithi099.stdout:9/324: write dd/d47/d40/d61/f63 [25370,14102] 0 2024-09-19T06:40:33.162 INFO:tasks.workunit.client.1.smithi117.stdout:5/393: creat d17/f89 x:0 0 0 2024-09-19T06:40:33.163 INFO:tasks.workunit.client.1.smithi117.stdout:5/394: write d17/f89 [215145,10771] 0 2024-09-19T06:40:33.165 INFO:tasks.workunit.client.1.smithi117.stdout:9/373: dwrite d4/f3b [0,4194304] 0 2024-09-19T06:40:33.168 INFO:tasks.workunit.client.0.smithi099.stdout:9/325: dwrite dd/d47/d40/f31 [0,4194304] 0 2024-09-19T06:40:33.175 INFO:tasks.workunit.client.1.smithi117.stdout:9/374: getdents d4 0 2024-09-19T06:40:33.175 INFO:tasks.workunit.client.0.smithi099.stdout:9/326: rename dd/d2c/c55 to dd/d47/d40/c69 0 2024-09-19T06:40:33.176 INFO:tasks.workunit.client.0.smithi099.stdout:9/327: read dd/d47/d40/f11 [3474773,16270] 0 2024-09-19T06:40:33.177 INFO:tasks.workunit.client.0.smithi099.stdout:9/328: stat dd/d47/d40/l3e 0 2024-09-19T06:40:33.180 INFO:tasks.workunit.client.1.smithi117.stdout:9/375: dread d4/d1c/d46/f6b [0,4194304] 0 2024-09-19T06:40:33.181 INFO:tasks.workunit.client.1.smithi117.stdout:9/376: rmdir d4/d8 39 2024-09-19T06:40:33.185 INFO:tasks.workunit.client.1.smithi117.stdout:9/377: rename d4/d1c/d46/f49 to d4/d1c/d36/f7d 0 2024-09-19T06:40:33.191 INFO:tasks.workunit.client.1.smithi117.stdout:9/378: dwrite d4/d1c/d36/f6c [0,4194304] 0 2024-09-19T06:40:33.193 INFO:tasks.workunit.client.1.smithi117.stdout:5/395: dwrite d17/d1b/d3a/f68 [0,4194304] 0 2024-09-19T06:40:33.195 INFO:tasks.workunit.client.0.smithi099.stdout:8/213: sync 2024-09-19T06:40:33.198 INFO:tasks.workunit.client.1.smithi117.stdout:5/396: creat d17/d1b/d5d/d7d/f8a x:0 0 0 2024-09-19T06:40:33.199 INFO:tasks.workunit.client.0.smithi099.stdout:8/214: rename d4/c7 to d4/de/d14/c4d 0 2024-09-19T06:40:33.202 INFO:tasks.workunit.client.1.smithi117.stdout:5/397: fdatasync d17/d2f/d3b/f44 0 2024-09-19T06:40:33.202 INFO:tasks.workunit.client.1.smithi117.stdout:9/379: dwrite d4/d17/f5e [0,4194304] 0 2024-09-19T06:40:33.203 INFO:tasks.workunit.client.1.smithi117.stdout:5/398: chown d17/d2f/d6a/l71 27 1 2024-09-19T06:40:33.203 INFO:tasks.workunit.client.1.smithi117.stdout:9/380: write d4/d17/f61 [1443172,41927] 0 2024-09-19T06:40:33.208 INFO:tasks.workunit.client.1.smithi117.stdout:9/381: dread d4/d8/fb [4194304,4194304] 0 2024-09-19T06:40:33.212 INFO:tasks.workunit.client.1.smithi117.stdout:9/382: creat d4/d1c/d7a/d69/f7e x:0 0 0 2024-09-19T06:40:33.213 INFO:tasks.workunit.client.1.smithi117.stdout:5/399: dwrite d17/d2f/d3b/f44 [0,4194304] 0 2024-09-19T06:40:33.214 INFO:tasks.workunit.client.1.smithi117.stdout:5/400: write d17/d1b/d5d/d7d/f8a [457040,102743] 0 2024-09-19T06:40:33.217 INFO:tasks.workunit.client.1.smithi117.stdout:9/383: link d4/d1c/d7a/d52/f62 d4/f7f 0 2024-09-19T06:40:33.218 INFO:tasks.workunit.client.1.smithi117.stdout:9/384: fdatasync d4/d1c/d46/f6b 0 2024-09-19T06:40:33.221 INFO:tasks.workunit.client.1.smithi117.stdout:9/385: chown d4/d1c/d7a/d16/l34 5 1 2024-09-19T06:40:33.222 INFO:tasks.workunit.client.1.smithi117.stdout:5/401: dread d17/d1b/d3a/d3c/f57 [0,4194304] 0 2024-09-19T06:40:33.223 INFO:tasks.workunit.client.1.smithi117.stdout:9/386: creat d4/d1c/d5f/f80 x:0 0 0 2024-09-19T06:40:33.223 INFO:tasks.workunit.client.1.smithi117.stdout:5/402: dread - d17/d2f/d6a/f72 zero size 2024-09-19T06:40:33.225 INFO:tasks.workunit.client.1.smithi117.stdout:5/403: symlink d17/d1b/d3a/d3c/d46/l8b 0 2024-09-19T06:40:33.227 INFO:tasks.workunit.client.1.smithi117.stdout:5/404: truncate d17/d2f/d6a/f75 604962 0 2024-09-19T06:40:33.227 INFO:tasks.workunit.client.1.smithi117.stdout:9/387: dread d4/d8/f31 [0,4194304] 0 2024-09-19T06:40:33.228 INFO:tasks.workunit.client.1.smithi117.stdout:9/388: rmdir d4/d1c/d54 39 2024-09-19T06:40:33.231 INFO:tasks.workunit.client.1.smithi117.stdout:9/389: symlink d4/d1c/d54/l81 0 2024-09-19T06:40:33.232 INFO:tasks.workunit.client.1.smithi117.stdout:5/405: dwrite d17/d2f/d6a/f75 [0,4194304] 0 2024-09-19T06:40:33.233 INFO:tasks.workunit.client.1.smithi117.stdout:5/406: fdatasync d17/d1b/d3a/f3e 0 2024-09-19T06:40:33.237 INFO:tasks.workunit.client.1.smithi117.stdout:5/407: creat d17/d1b/d5d/d86/f8c x:0 0 0 2024-09-19T06:40:33.239 INFO:tasks.workunit.client.1.smithi117.stdout:5/408: creat d17/d2e/d65/f8d x:0 0 0 2024-09-19T06:40:33.242 INFO:tasks.workunit.client.1.smithi117.stdout:5/409: link d17/d2f/d6a/l71 d17/d1b/d5d/d7d/l8e 0 2024-09-19T06:40:33.243 INFO:tasks.workunit.client.1.smithi117.stdout:5/410: fdatasync d17/d1b/d3a/f73 0 2024-09-19T06:40:33.244 INFO:tasks.workunit.client.1.smithi117.stdout:5/411: dread - d17/d1b/d3a/d3c/d70/f79 zero size 2024-09-19T06:40:33.245 INFO:tasks.workunit.client.1.smithi117.stdout:5/412: stat cb 0 2024-09-19T06:40:33.264 INFO:tasks.workunit.client.1.smithi117.stdout:5/413: dread ff [0,4194304] 0 2024-09-19T06:40:33.265 INFO:tasks.workunit.client.1.smithi117.stdout:5/414: fdatasync d17/d2e/f5f 0 2024-09-19T06:40:33.267 INFO:tasks.workunit.client.1.smithi117.stdout:5/415: creat d17/d2f/d6a/f8f x:0 0 0 2024-09-19T06:40:33.286 INFO:tasks.workunit.client.1.smithi117.stdout:2/361: sync 2024-09-19T06:40:33.294 INFO:tasks.workunit.client.1.smithi117.stdout:2/362: dwrite d0/d12/f2c [4194304,4194304] 0 2024-09-19T06:40:33.320 INFO:tasks.workunit.client.0.smithi099.stdout:5/442: sync 2024-09-19T06:40:33.321 INFO:tasks.workunit.client.0.smithi099.stdout:5/443: readlink d3/d16/l44 0 2024-09-19T06:40:33.333 INFO:tasks.workunit.client.0.smithi099.stdout:5/444: dread d3/f9 [0,4194304] 0 2024-09-19T06:40:33.338 INFO:tasks.workunit.client.0.smithi099.stdout:5/445: truncate d3/d2a/f45 617923 0 2024-09-19T06:40:33.339 INFO:tasks.workunit.client.0.smithi099.stdout:5/446: creat d3/d14/fa1 x:0 0 0 2024-09-19T06:40:33.340 INFO:tasks.workunit.client.0.smithi099.stdout:5/447: dread - d3/d7/f80 zero size 2024-09-19T06:40:33.340 INFO:tasks.workunit.client.0.smithi099.stdout:5/448: chown d3/d16/d7d 349 1 2024-09-19T06:40:33.342 INFO:tasks.workunit.client.0.smithi099.stdout:5/449: creat d3/d16/d2f/d34/d3c/d65/fa2 x:0 0 0 2024-09-19T06:40:33.343 INFO:tasks.workunit.client.0.smithi099.stdout:5/450: mknod d3/d16/d2f/d34/ca3 0 2024-09-19T06:40:33.345 INFO:tasks.workunit.client.0.smithi099.stdout:5/451: rename d3/d1f/d8d to d3/d16/d2f/d34/da4 0 2024-09-19T06:40:33.346 INFO:tasks.workunit.client.0.smithi099.stdout:5/452: chown d3/d7/f80 2915 1 2024-09-19T06:40:33.346 INFO:tasks.workunit.client.0.smithi099.stdout:5/453: write d3/d14/fa1 [447356,24309] 0 2024-09-19T06:40:33.348 INFO:tasks.workunit.client.0.smithi099.stdout:5/454: mkdir d3/d16/d2f/d34/da4/da5 0 2024-09-19T06:40:33.350 INFO:tasks.workunit.client.0.smithi099.stdout:5/455: mkdir d3/d7/d90/da6 0 2024-09-19T06:40:33.351 INFO:tasks.workunit.client.0.smithi099.stdout:5/456: rename d3/d16/d5e/l7c to d3/d16/d5e/la7 0 2024-09-19T06:40:33.353 INFO:tasks.workunit.client.0.smithi099.stdout:5/457: symlink d3/d16/d2f/d34/la8 0 2024-09-19T06:40:33.353 INFO:tasks.workunit.client.0.smithi099.stdout:5/458: stat d3/d16/d7d 0 2024-09-19T06:40:33.366 INFO:tasks.workunit.client.0.smithi099.stdout:5/459: dwrite d3/d2a/f45 [0,4194304] 0 2024-09-19T06:40:33.367 INFO:tasks.workunit.client.0.smithi099.stdout:5/460: chown d3/d16/d2f/d34/la8 0 1 2024-09-19T06:40:33.367 INFO:tasks.workunit.client.0.smithi099.stdout:5/461: readlink d3/d16/d2f/d34/da4/l4e 0 2024-09-19T06:40:33.368 INFO:tasks.workunit.client.0.smithi099.stdout:5/462: write d3/d7/f71 [438873,8495] 0 2024-09-19T06:40:33.369 INFO:tasks.workunit.client.0.smithi099.stdout:5/463: fdatasync d3/d2a/f2e 0 2024-09-19T06:40:33.375 INFO:tasks.workunit.client.0.smithi099.stdout:5/464: write d3/d16/f74 [309967,67493] 0 2024-09-19T06:40:33.376 INFO:tasks.workunit.client.0.smithi099.stdout:5/465: mknod d3/d7/d90/ca9 0 2024-09-19T06:40:33.377 INFO:tasks.workunit.client.0.smithi099.stdout:5/466: dread - d3/d16/d5e/f85 zero size 2024-09-19T06:40:33.379 INFO:tasks.workunit.client.0.smithi099.stdout:5/467: rename d3/f6a to d3/d16/d2f/d34/da4/faa 0 2024-09-19T06:40:33.381 INFO:tasks.workunit.client.0.smithi099.stdout:5/468: rmdir d3/d1f 39 2024-09-19T06:40:33.381 INFO:tasks.workunit.client.0.smithi099.stdout:1/249: sync 2024-09-19T06:40:33.382 INFO:tasks.workunit.client.0.smithi099.stdout:2/173: sync 2024-09-19T06:40:33.382 INFO:tasks.workunit.client.0.smithi099.stdout:5/469: mknod d3/d16/cab 0 2024-09-19T06:40:33.384 INFO:tasks.workunit.client.0.smithi099.stdout:5/470: creat d3/d14/fac x:0 0 0 2024-09-19T06:40:33.388 INFO:tasks.workunit.client.0.smithi099.stdout:5/471: unlink d3/d16/d2f/d34/d3c/d65/f6c 0 2024-09-19T06:40:33.389 INFO:tasks.workunit.client.0.smithi099.stdout:1/250: truncate d0/d12/d13/f33 2080172 0 2024-09-19T06:40:33.389 INFO:tasks.workunit.client.0.smithi099.stdout:5/472: dread - d3/d16/d2f/d34/d3c/d65/f86 zero size 2024-09-19T06:40:33.390 INFO:tasks.workunit.client.0.smithi099.stdout:2/174: dwrite d1/d2/d5/d13/d2c/f38 [0,4194304] 0 2024-09-19T06:40:33.392 INFO:tasks.workunit.client.0.smithi099.stdout:5/473: getdents d3/d7/d90/da6 0 2024-09-19T06:40:33.393 INFO:tasks.workunit.client.1.smithi117.stdout:6/273: sync 2024-09-19T06:40:33.394 INFO:tasks.workunit.client.1.smithi117.stdout:7/346: sync 2024-09-19T06:40:33.394 INFO:tasks.workunit.client.1.smithi117.stdout:1/342: sync 2024-09-19T06:40:33.395 INFO:tasks.workunit.client.1.smithi117.stdout:1/343: fdatasync d3/f14 0 2024-09-19T06:40:33.395 INFO:tasks.workunit.client.0.smithi099.stdout:2/175: creat d1/d2/d5/d8/d9/f3c x:0 0 0 2024-09-19T06:40:33.395 INFO:tasks.workunit.client.0.smithi099.stdout:1/251: dread d0/db/f1f [0,4194304] 0 2024-09-19T06:40:33.395 INFO:tasks.workunit.client.0.smithi099.stdout:5/474: mknod d3/cad 0 2024-09-19T06:40:33.396 INFO:tasks.workunit.client.1.smithi117.stdout:1/344: dread - d3/d22/d2f/f60 zero size 2024-09-19T06:40:33.396 INFO:tasks.workunit.client.0.smithi099.stdout:5/475: chown d3/d16/d5e/l7b 30327132 1 2024-09-19T06:40:33.397 INFO:tasks.workunit.client.0.smithi099.stdout:2/176: symlink d1/d2/d5/d8/dc/l3d 0 2024-09-19T06:40:33.397 INFO:tasks.workunit.client.1.smithi117.stdout:1/345: read f1 [8502426,23116] 0 2024-09-19T06:40:33.399 INFO:tasks.workunit.client.0.smithi099.stdout:2/177: creat d1/f3e x:0 0 0 2024-09-19T06:40:33.400 INFO:tasks.workunit.client.1.smithi117.stdout:7/347: creat d1/d8/d24/d1c/f79 x:0 0 0 2024-09-19T06:40:33.401 INFO:tasks.workunit.client.1.smithi117.stdout:6/274: creat d1/d3/d25/f42 x:0 0 0 2024-09-19T06:40:33.402 INFO:tasks.workunit.client.1.smithi117.stdout:1/346: mknod d3/d18/c72 0 2024-09-19T06:40:33.403 INFO:tasks.workunit.client.1.smithi117.stdout:7/348: creat d1/d72/f7a x:0 0 0 2024-09-19T06:40:33.404 INFO:tasks.workunit.client.0.smithi099.stdout:1/252: dwrite d0/d12/f30 [0,4194304] 0 2024-09-19T06:40:33.404 INFO:tasks.workunit.client.0.smithi099.stdout:2/178: mkdir d1/d2/d5/d13/d2c/d3f 0 2024-09-19T06:40:33.404 INFO:tasks.workunit.client.1.smithi117.stdout:6/275: chown d1/d14/c3a 52253198 1 2024-09-19T06:40:33.404 INFO:tasks.workunit.client.1.smithi117.stdout:6/276: fsync d1/d3/fd 0 2024-09-19T06:40:33.405 INFO:tasks.workunit.client.0.smithi099.stdout:5/476: dwrite d3/d7/f96 [0,4194304] 0 2024-09-19T06:40:33.405 INFO:tasks.workunit.client.1.smithi117.stdout:1/347: creat d3/d18/d56/f73 x:0 0 0 2024-09-19T06:40:33.405 INFO:tasks.workunit.client.1.smithi117.stdout:1/348: write d3/f4c [3107437,2122] 0 2024-09-19T06:40:33.406 INFO:tasks.workunit.client.1.smithi117.stdout:7/349: write d1/d8/d24/d1c/f46 [869627,127041] 0 2024-09-19T06:40:33.406 INFO:tasks.workunit.client.0.smithi099.stdout:2/179: chown d1/d2/d5/d13/d2c 15554 1 2024-09-19T06:40:33.407 INFO:tasks.workunit.client.1.smithi117.stdout:1/349: stat d3/d18/f48 0 2024-09-19T06:40:33.407 INFO:tasks.workunit.client.0.smithi099.stdout:1/253: rmdir d0/d17 39 2024-09-19T06:40:33.408 INFO:tasks.workunit.client.0.smithi099.stdout:2/180: write d1/d2/d5/d8/f11 [981058,101505] 0 2024-09-19T06:40:33.409 INFO:tasks.workunit.client.1.smithi117.stdout:6/277: symlink d1/l43 0 2024-09-19T06:40:33.410 INFO:tasks.workunit.client.1.smithi117.stdout:6/278: fdatasync d1/d5/f40 0 2024-09-19T06:40:33.411 INFO:tasks.workunit.client.1.smithi117.stdout:7/350: creat d1/d4a/f7b x:0 0 0 2024-09-19T06:40:33.412 INFO:tasks.workunit.client.1.smithi117.stdout:1/350: mkdir d3/d18/d23/d74 0 2024-09-19T06:40:33.412 INFO:tasks.workunit.client.1.smithi117.stdout:7/351: fsync d1/d3f/f73 0 2024-09-19T06:40:33.413 INFO:tasks.workunit.client.0.smithi099.stdout:5/477: creat d3/d16/d2f/d8c/fae x:0 0 0 2024-09-19T06:40:33.413 INFO:tasks.workunit.client.1.smithi117.stdout:1/351: chown d3/c8 0 1 2024-09-19T06:40:33.413 INFO:tasks.workunit.client.1.smithi117.stdout:7/352: readlink d1/d8/l36 0 2024-09-19T06:40:33.415 INFO:tasks.workunit.client.1.smithi117.stdout:6/279: read d1/d3/f12 [2061959,65588] 0 2024-09-19T06:40:33.416 INFO:tasks.workunit.client.1.smithi117.stdout:7/353: read d1/d8/d24/f20 [3052570,38527] 0 2024-09-19T06:40:33.416 INFO:tasks.workunit.client.1.smithi117.stdout:1/352: creat d3/d18/d23/d74/f75 x:0 0 0 2024-09-19T06:40:33.417 INFO:tasks.workunit.client.0.smithi099.stdout:5/478: unlink d3/d16/d2f/d34/d3c/d65/c70 0 2024-09-19T06:40:33.422 INFO:tasks.workunit.client.0.smithi099.stdout:2/181: creat d1/d2/d5/f40 x:0 0 0 2024-09-19T06:40:33.423 INFO:tasks.workunit.client.1.smithi117.stdout:1/353: rename d3/d22/l67 to d3/l76 0 2024-09-19T06:40:33.424 INFO:tasks.workunit.client.1.smithi117.stdout:1/354: chown d3/f5e 0 1 2024-09-19T06:40:33.424 INFO:tasks.workunit.client.0.smithi099.stdout:2/182: fdatasync d1/d2/d5/f40 0 2024-09-19T06:40:33.425 INFO:tasks.workunit.client.0.smithi099.stdout:1/254: getdents d0/d17/d32 0 2024-09-19T06:40:33.426 INFO:tasks.workunit.client.1.smithi117.stdout:7/354: dwrite d1/d8/d24/d1c/f22 [0,4194304] 0 2024-09-19T06:40:33.426 INFO:tasks.workunit.client.0.smithi099.stdout:5/479: dwrite d3/d16/d5e/f63 [4194304,4194304] 0 2024-09-19T06:40:33.426 INFO:tasks.workunit.client.0.smithi099.stdout:1/255: rmdir d0/d12 39 2024-09-19T06:40:33.428 INFO:tasks.workunit.client.1.smithi117.stdout:7/355: mkdir d1/d4a/d7c 0 2024-09-19T06:40:33.428 INFO:tasks.workunit.client.0.smithi099.stdout:5/480: creat d3/d14/faf x:0 0 0 2024-09-19T06:40:33.432 INFO:tasks.workunit.client.0.smithi099.stdout:6/297: sync 2024-09-19T06:40:33.432 INFO:tasks.workunit.client.0.smithi099.stdout:7/380: sync 2024-09-19T06:40:33.432 INFO:tasks.workunit.client.0.smithi099.stdout:4/314: sync 2024-09-19T06:40:33.432 INFO:tasks.workunit.client.0.smithi099.stdout:5/481: creat d3/d2a/fb0 x:0 0 0 2024-09-19T06:40:33.432 INFO:tasks.workunit.client.0.smithi099.stdout:3/381: sync 2024-09-19T06:40:33.432 INFO:tasks.workunit.client.0.smithi099.stdout:9/329: sync 2024-09-19T06:40:33.433 INFO:tasks.workunit.client.0.smithi099.stdout:0/276: sync 2024-09-19T06:40:33.433 INFO:tasks.workunit.client.0.smithi099.stdout:8/215: sync 2024-09-19T06:40:33.433 INFO:tasks.workunit.client.1.smithi117.stdout:1/355: dwrite d3/d18/d23/f55 [0,4194304] 0 2024-09-19T06:40:33.433 INFO:tasks.workunit.client.1.smithi117.stdout:7/356: symlink d1/d8/d24/d1c/d35/d4f/l7d 0 2024-09-19T06:40:33.434 INFO:tasks.workunit.client.1.smithi117.stdout:1/356: stat d3/d22/f5f 0 2024-09-19T06:40:33.435 INFO:tasks.workunit.client.0.smithi099.stdout:0/277: chown d0/db/d2f 2886 1 2024-09-19T06:40:33.435 INFO:tasks.workunit.client.0.smithi099.stdout:2/183: dwrite d1/d2/d5/d8/f2b [0,4194304] 0 2024-09-19T06:40:33.435 INFO:tasks.workunit.client.0.smithi099.stdout:8/216: chown d4/de/f12 239985891 1 2024-09-19T06:40:33.437 INFO:tasks.workunit.client.0.smithi099.stdout:2/184: chown d1/d2/f12 240285 1 2024-09-19T06:40:33.437 INFO:tasks.workunit.client.0.smithi099.stdout:1/256: mknod d0/d12/d13/d37/d41/c52 0 2024-09-19T06:40:33.439 INFO:tasks.workunit.client.0.smithi099.stdout:9/330: rmdir dd/d47 39 2024-09-19T06:40:33.439 INFO:tasks.workunit.client.0.smithi099.stdout:6/298: truncate d1/d5/d24/d2e/d41/d4e/d54/d5d/d61/f63 787678 0 2024-09-19T06:40:33.439 INFO:tasks.workunit.client.0.smithi099.stdout:5/482: read d3/d1f/f91 [18867,72913] 0 2024-09-19T06:40:33.441 INFO:tasks.workunit.client.0.smithi099.stdout:4/315: mknod d12/c70 0 2024-09-19T06:40:33.443 INFO:tasks.workunit.client.0.smithi099.stdout:3/382: creat d7/d34/d1d/d20/f67 x:0 0 0 2024-09-19T06:40:33.444 INFO:tasks.workunit.client.0.smithi099.stdout:1/257: stat d0/d12/d13/f4c 0 2024-09-19T06:40:33.447 INFO:tasks.workunit.client.0.smithi099.stdout:3/383: truncate d7/d34/d1d/d36/d42/f40 1001518 0 2024-09-19T06:40:33.447 INFO:tasks.workunit.client.0.smithi099.stdout:5/483: dread d3/d16/f2b [0,4194304] 0 2024-09-19T06:40:33.448 INFO:tasks.workunit.client.0.smithi099.stdout:5/484: stat d3/cd 0 2024-09-19T06:40:33.449 INFO:tasks.workunit.client.0.smithi099.stdout:2/185: link d1/f39 d1/d2/d5/d8/d36/f41 0 2024-09-19T06:40:33.449 INFO:tasks.workunit.client.1.smithi117.stdout:6/280: dread d1/f18 [4194304,4194304] 0 2024-09-19T06:40:33.450 INFO:tasks.workunit.client.0.smithi099.stdout:2/186: write d1/d2/d5/d8/f2b [1024729,40755] 0 2024-09-19T06:40:33.450 INFO:tasks.workunit.client.0.smithi099.stdout:1/258: creat d0/d17/d32/f53 x:0 0 0 2024-09-19T06:40:33.451 INFO:tasks.workunit.client.0.smithi099.stdout:7/381: creat d7/dd/d29/d1f/d45/f8b x:0 0 0 2024-09-19T06:40:33.452 INFO:tasks.workunit.client.0.smithi099.stdout:6/299: mknod d1/c64 0 2024-09-19T06:40:33.452 INFO:tasks.workunit.client.0.smithi099.stdout:3/384: read d7/d34/d28/f48 [1853339,67492] 0 2024-09-19T06:40:33.453 INFO:tasks.workunit.client.1.smithi117.stdout:6/281: creat d1/d5/d8/d27/f44 x:0 0 0 2024-09-19T06:40:33.455 INFO:tasks.workunit.client.0.smithi099.stdout:2/187: fdatasync d1/d2/d5/d8/f1a 0 2024-09-19T06:40:33.456 INFO:tasks.workunit.client.1.smithi117.stdout:6/282: rename d1/d3f to d1/d5/d32/d45 0 2024-09-19T06:40:33.456 INFO:tasks.workunit.client.0.smithi099.stdout:9/331: creat dd/f6a x:0 0 0 2024-09-19T06:40:33.457 INFO:tasks.workunit.client.1.smithi117.stdout:7/357: truncate d1/d8/d24/d1c/d35/f6d 166549 0 2024-09-19T06:40:33.457 INFO:tasks.workunit.client.1.smithi117.stdout:7/358: dread - d1/d3f/f73 zero size 2024-09-19T06:40:33.458 INFO:tasks.workunit.client.0.smithi099.stdout:4/316: unlink d12/d1b/l5f 0 2024-09-19T06:40:33.459 INFO:tasks.workunit.client.1.smithi117.stdout:6/283: unlink d1/d3/f37 0 2024-09-19T06:40:33.460 INFO:tasks.workunit.client.0.smithi099.stdout:6/300: dwrite d1/d12/f27 [0,4194304] 0 2024-09-19T06:40:33.460 INFO:tasks.workunit.client.0.smithi099.stdout:5/485: unlink d3/d2a/f2c 0 2024-09-19T06:40:33.462 INFO:tasks.workunit.client.0.smithi099.stdout:5/486: chown d3/d2a/f8b 98663 1 2024-09-19T06:40:33.462 INFO:tasks.workunit.client.0.smithi099.stdout:1/259: mkdir d0/d12/d54 0 2024-09-19T06:40:33.464 INFO:tasks.workunit.client.0.smithi099.stdout:1/260: fdatasync d0/d17/d32/f4d 0 2024-09-19T06:40:33.465 INFO:tasks.workunit.client.1.smithi117.stdout:7/359: dread d1/d3f/f4d [0,4194304] 0 2024-09-19T06:40:33.465 INFO:tasks.workunit.client.1.smithi117.stdout:6/284: creat d1/d3/d25/f46 x:0 0 0 2024-09-19T06:40:33.467 INFO:tasks.workunit.client.1.smithi117.stdout:7/360: write d1/d8/d24/d1c/f67 [306695,90434] 0 2024-09-19T06:40:33.469 INFO:tasks.workunit.client.1.smithi117.stdout:6/285: unlink d1/d5/l7 0 2024-09-19T06:40:33.470 INFO:tasks.workunit.client.0.smithi099.stdout:0/278: write d0/f2a [3796906,14231] 0 2024-09-19T06:40:33.470 INFO:tasks.workunit.client.0.smithi099.stdout:3/385: creat d7/f68 x:0 0 0 2024-09-19T06:40:33.471 INFO:tasks.workunit.client.1.smithi117.stdout:7/361: chown d1/l6f 54160619 1 2024-09-19T06:40:33.472 INFO:tasks.workunit.client.0.smithi099.stdout:2/188: getdents d1/d2/d5/d8/d36 0 2024-09-19T06:40:33.474 INFO:tasks.workunit.client.1.smithi117.stdout:6/286: rename d1/d3/fc to d1/d5/d8/d27/f47 0 2024-09-19T06:40:33.476 INFO:tasks.workunit.client.1.smithi117.stdout:7/362: symlink d1/d8/d24/d1c/d35/l7e 0 2024-09-19T06:40:33.477 INFO:tasks.workunit.client.0.smithi099.stdout:1/261: link d0/d17/d24/f42 d0/d17/d24/f55 0 2024-09-19T06:40:33.477 INFO:tasks.workunit.client.1.smithi117.stdout:7/363: fsync d1/d3f/f70 0 2024-09-19T06:40:33.477 INFO:tasks.workunit.client.1.smithi117.stdout:7/364: fdatasync d1/f4c 0 2024-09-19T06:40:33.478 INFO:tasks.workunit.client.0.smithi099.stdout:3/386: fdatasync d7/d34/d1d/d36/d42/f40 0 2024-09-19T06:40:33.478 INFO:tasks.workunit.client.0.smithi099.stdout:6/301: dread d1/d5/d24/d2e/d41/d4e/d54/d5d/d61/f63 [0,4194304] 0 2024-09-19T06:40:33.479 INFO:tasks.workunit.client.0.smithi099.stdout:9/332: dwrite dd/f60 [4194304,4194304] 0 2024-09-19T06:40:33.480 INFO:tasks.workunit.client.0.smithi099.stdout:0/279: write d0/db/d13/d1f/f2b [1309568,58071] 0 2024-09-19T06:40:33.481 INFO:tasks.workunit.client.0.smithi099.stdout:2/189: unlink d1/d2/d5/d8/f11 0 2024-09-19T06:40:33.481 INFO:tasks.workunit.client.1.smithi117.stdout:7/365: getdents d1/d8/d24 0 2024-09-19T06:40:33.482 INFO:tasks.workunit.client.0.smithi099.stdout:4/317: dwrite d12/f16 [4194304,4194304] 0 2024-09-19T06:40:33.483 INFO:tasks.workunit.client.0.smithi099.stdout:1/262: write d0/d12/d13/f1b [5524421,38628] 0 2024-09-19T06:40:33.484 INFO:tasks.workunit.client.0.smithi099.stdout:0/280: chown d0/db/d13/d1f/d4a 3 1 2024-09-19T06:40:33.485 INFO:tasks.workunit.client.1.smithi117.stdout:7/366: creat d1/d8/d48/d5f/f7f x:0 0 0 2024-09-19T06:40:33.485 INFO:tasks.workunit.client.0.smithi099.stdout:3/387: mkdir d7/d34/d1d/d36/d69 0 2024-09-19T06:40:33.486 INFO:tasks.workunit.client.1.smithi117.stdout:7/367: write d1/d3f/f70 [979112,3650] 0 2024-09-19T06:40:33.487 INFO:tasks.workunit.client.0.smithi099.stdout:6/302: write d1/d5/d24/d2e/d41/f5a [247304,63630] 0 2024-09-19T06:40:33.487 INFO:tasks.workunit.client.0.smithi099.stdout:0/281: fdatasync d0/d17/d41/f49 0 2024-09-19T06:40:33.488 INFO:tasks.workunit.client.0.smithi099.stdout:1/263: dread - d0/d17/d24/f46 zero size 2024-09-19T06:40:33.489 INFO:tasks.workunit.client.0.smithi099.stdout:7/382: dread d7/f15 [0,4194304] 0 2024-09-19T06:40:33.490 INFO:tasks.workunit.client.0.smithi099.stdout:4/318: chown d12/d32/d42/d5c/l4d 309 1 2024-09-19T06:40:33.491 INFO:tasks.workunit.client.0.smithi099.stdout:2/190: mknod d1/d2/d5/d8/d18/d27/c42 0 2024-09-19T06:40:33.492 INFO:tasks.workunit.client.0.smithi099.stdout:9/333: mknod dd/d47/d68/c6b 0 2024-09-19T06:40:33.493 INFO:tasks.workunit.client.0.smithi099.stdout:9/334: write dd/f44 [552716,114975] 0 2024-09-19T06:40:33.498 INFO:tasks.workunit.client.0.smithi099.stdout:6/303: chown d1/d5/d38/c44 1972854 1 2024-09-19T06:40:33.498 INFO:tasks.workunit.client.1.smithi117.stdout:7/368: dwrite d1/f1e [0,4194304] 0 2024-09-19T06:40:33.498 INFO:tasks.workunit.client.0.smithi099.stdout:6/304: truncate d1/f4c 507379 0 2024-09-19T06:40:33.499 INFO:tasks.workunit.client.0.smithi099.stdout:0/282: creat d0/db/d13/d1f/d39/f54 x:0 0 0 2024-09-19T06:40:33.499 INFO:tasks.workunit.client.0.smithi099.stdout:3/388: rename d7/d34/d28/f30 to d7/d34/d1d/d36/d69/f6a 0 2024-09-19T06:40:33.499 INFO:tasks.workunit.client.1.smithi117.stdout:7/369: dread d1/d8/d24/d1c/f22 [0,4194304] 0 2024-09-19T06:40:33.500 INFO:tasks.workunit.client.0.smithi099.stdout:2/191: mknod d1/c43 0 2024-09-19T06:40:33.502 INFO:tasks.workunit.client.0.smithi099.stdout:1/264: dwrite d0/f1a [0,4194304] 0 2024-09-19T06:40:33.502 INFO:tasks.workunit.client.1.smithi117.stdout:7/370: dread d1/d8/f16 [0,4194304] 0 2024-09-19T06:40:33.503 INFO:tasks.workunit.client.1.smithi117.stdout:7/371: write d1/d4a/f7b [85669,15284] 0 2024-09-19T06:40:33.506 INFO:tasks.workunit.client.0.smithi099.stdout:9/335: creat dd/d47/d68/f6c x:0 0 0 2024-09-19T06:40:33.510 INFO:tasks.workunit.client.0.smithi099.stdout:2/192: dread d1/d2/d5/d13/f1b [0,4194304] 0 2024-09-19T06:40:33.510 INFO:tasks.workunit.client.0.smithi099.stdout:2/193: write d1/f25 [335728,99612] 0 2024-09-19T06:40:33.511 INFO:tasks.workunit.client.1.smithi117.stdout:7/372: dwrite d1/d8/d24/f69 [0,4194304] 0 2024-09-19T06:40:33.511 INFO:tasks.workunit.client.0.smithi099.stdout:7/383: rename d7/dd/f60 to d7/d39/f8c 0 2024-09-19T06:40:33.513 INFO:tasks.workunit.client.0.smithi099.stdout:3/389: creat d7/d34/d1d/d36/d69/f6b x:0 0 0 2024-09-19T06:40:33.514 INFO:tasks.workunit.client.1.smithi117.stdout:7/373: unlink d1/d8/d24/d26/l30 0 2024-09-19T06:40:33.516 INFO:tasks.workunit.client.0.smithi099.stdout:1/265: creat d0/d12/d13/d37/d41/f56 x:0 0 0 2024-09-19T06:40:33.516 INFO:tasks.workunit.client.0.smithi099.stdout:3/390: write d7/d34/d1d/d20/d58/d5c/f5d [7062423,48173] 0 2024-09-19T06:40:33.517 INFO:tasks.workunit.client.0.smithi099.stdout:9/336: mknod dd/d62/c6d 0 2024-09-19T06:40:33.519 INFO:tasks.workunit.client.0.smithi099.stdout:0/283: dwrite d0/db/d13/d37/d3c/d3e/f4c [0,4194304] 0 2024-09-19T06:40:33.520 INFO:tasks.workunit.client.0.smithi099.stdout:0/284: chown d0/f11 288 1 2024-09-19T06:40:33.521 INFO:tasks.workunit.client.0.smithi099.stdout:0/285: truncate d0/db/d2f/f43 508112 0 2024-09-19T06:40:33.527 INFO:tasks.workunit.client.0.smithi099.stdout:3/391: dwrite d7/d34/d1d/d20/f67 [0,4194304] 0 2024-09-19T06:40:33.530 INFO:tasks.workunit.client.0.smithi099.stdout:0/286: rename d0/d17/c3b to d0/db/d36/d3f/c55 0 2024-09-19T06:40:33.531 INFO:tasks.workunit.client.0.smithi099.stdout:3/392: creat d7/d34/d1d/d36/d42/f6c x:0 0 0 2024-09-19T06:40:33.532 INFO:tasks.workunit.client.0.smithi099.stdout:4/319: truncate d12/d32/d39/f40 1567396 0 2024-09-19T06:40:33.533 INFO:tasks.workunit.client.0.smithi099.stdout:4/320: chown d12/d32/d42/f67 1128 1 2024-09-19T06:40:33.534 INFO:tasks.workunit.client.1.smithi117.stdout:7/374: dwrite d1/d8/d24/d49/f62 [0,4194304] 0 2024-09-19T06:40:33.535 INFO:tasks.workunit.client.0.smithi099.stdout:3/393: mkdir d7/d34/d1d/d36/d69/d6d 0 2024-09-19T06:40:33.536 INFO:tasks.workunit.client.0.smithi099.stdout:0/287: symlink d0/db/d13/d1f/d3a/l56 0 2024-09-19T06:40:33.537 INFO:tasks.workunit.client.0.smithi099.stdout:0/288: fsync d0/db/d13/d1f/f24 0 2024-09-19T06:40:33.538 INFO:tasks.workunit.client.0.smithi099.stdout:0/289: write d0/db/d27/f2c [179499,129614] 0 2024-09-19T06:40:33.539 INFO:tasks.workunit.client.0.smithi099.stdout:3/394: mknod d7/d34/d52/c6e 0 2024-09-19T06:40:33.540 INFO:tasks.workunit.client.0.smithi099.stdout:3/395: dread - d7/d34/f3d zero size 2024-09-19T06:40:33.543 INFO:tasks.workunit.client.0.smithi099.stdout:6/305: truncate d1/f4f 3371032 0 2024-09-19T06:40:33.544 INFO:tasks.workunit.client.0.smithi099.stdout:6/306: fdatasync d1/d12/f5f 0 2024-09-19T06:40:33.546 INFO:tasks.workunit.client.0.smithi099.stdout:9/337: write dd/f37 [1920246,85773] 0 2024-09-19T06:40:33.546 INFO:tasks.workunit.client.0.smithi099.stdout:4/321: link d12/c70 d12/d32/d42/d5c/d51/c71 0 2024-09-19T06:40:33.546 INFO:tasks.workunit.client.0.smithi099.stdout:2/194: mknod d1/d2/d5/d8/d36/c44 0 2024-09-19T06:40:33.549 INFO:tasks.workunit.client.0.smithi099.stdout:6/307: rmdir d1/d5/d24/d2e/d41/d4e/d54/d5d/d61 39 2024-09-19T06:40:33.550 INFO:tasks.workunit.client.0.smithi099.stdout:3/396: dwrite d7/d34/d1d/d36/f38 [8388608,4194304] 0 2024-09-19T06:40:33.555 INFO:tasks.workunit.client.0.smithi099.stdout:7/384: dread d7/dd/d29/d34/f70 [0,4194304] 0 2024-09-19T06:40:33.555 INFO:tasks.workunit.client.1.smithi117.stdout:7/375: write d1/d8/d24/f20 [2760180,51473] 0 2024-09-19T06:40:33.556 INFO:tasks.workunit.client.1.smithi117.stdout:7/376: fsync d1/d4a/f7b 0 2024-09-19T06:40:33.557 INFO:tasks.workunit.client.0.smithi099.stdout:9/338: dread dd/d47/d40/f31 [0,4194304] 0 2024-09-19T06:40:33.557 INFO:tasks.workunit.client.1.smithi117.stdout:7/377: stat d1/d3f/f73 0 2024-09-19T06:40:33.558 INFO:tasks.workunit.client.0.smithi099.stdout:2/195: dread d1/d2/d5/d8/fa [0,4194304] 0 2024-09-19T06:40:33.559 INFO:tasks.workunit.client.1.smithi117.stdout:7/378: dread d1/d3f/f4d [0,4194304] 0 2024-09-19T06:40:33.560 INFO:tasks.workunit.client.0.smithi099.stdout:6/308: mkdir d1/d5/d24/d2e/d41/d4e/d54/d5d/d61/d65 0 2024-09-19T06:40:33.561 INFO:tasks.workunit.client.1.smithi117.stdout:7/379: creat d1/d8/d24/d1c/f80 x:0 0 0 2024-09-19T06:40:33.565 INFO:tasks.workunit.client.0.smithi099.stdout:7/385: write d7/f52 [1416885,4558] 0 2024-09-19T06:40:33.567 INFO:tasks.workunit.client.1.smithi117.stdout:0/293: sync 2024-09-19T06:40:33.567 INFO:tasks.workunit.client.1.smithi117.stdout:8/447: sync 2024-09-19T06:40:33.567 INFO:tasks.workunit.client.1.smithi117.stdout:3/448: sync 2024-09-19T06:40:33.568 INFO:tasks.workunit.client.0.smithi099.stdout:4/322: truncate d12/f35 1126995 0 2024-09-19T06:40:33.568 INFO:tasks.workunit.client.0.smithi099.stdout:2/196: rmdir d1/d2/d24 39 2024-09-19T06:40:33.568 INFO:tasks.workunit.client.1.smithi117.stdout:3/449: write d0/f5e [1665266,43630] 0 2024-09-19T06:40:33.569 INFO:tasks.workunit.client.0.smithi099.stdout:9/339: mknod dd/d2c/d5c/d64/c6e 0 2024-09-19T06:40:33.570 INFO:tasks.workunit.client.1.smithi117.stdout:8/448: creat d1d/d31/f9a x:0 0 0 2024-09-19T06:40:33.572 INFO:tasks.workunit.client.1.smithi117.stdout:0/294: creat d11/f5a x:0 0 0 2024-09-19T06:40:33.572 INFO:tasks.workunit.client.1.smithi117.stdout:8/449: write d1d/d2a/d3f/d4b/d5f/d7c/f7f [538842,21778] 0 2024-09-19T06:40:33.573 INFO:tasks.workunit.client.0.smithi099.stdout:4/323: creat d12/d32/f72 x:0 0 0 2024-09-19T06:40:33.574 INFO:tasks.workunit.client.0.smithi099.stdout:6/309: dwrite d1/f9 [0,4194304] 0 2024-09-19T06:40:33.574 INFO:tasks.workunit.client.1.smithi117.stdout:7/380: rename d1/d8 to d1/d4a/d81 0 2024-09-19T06:40:33.574 INFO:tasks.workunit.client.0.smithi099.stdout:6/310: readlink d1/l11 0 2024-09-19T06:40:33.575 INFO:tasks.workunit.client.0.smithi099.stdout:3/397: truncate d7/d34/d1d/d36/f38 10305221 0 2024-09-19T06:40:33.577 INFO:tasks.workunit.client.1.smithi117.stdout:0/295: mkdir d11/d13/d28/d38/d5b 0 2024-09-19T06:40:33.578 INFO:tasks.workunit.client.1.smithi117.stdout:3/450: dwrite d0/d9/d1c/f1d [0,4194304] 0 2024-09-19T06:40:33.578 INFO:tasks.workunit.client.1.smithi117.stdout:0/296: read - d11/d13/d1b/f4e zero size 2024-09-19T06:40:33.579 INFO:tasks.workunit.client.0.smithi099.stdout:9/340: symlink dd/d47/l6f 0 2024-09-19T06:40:33.581 INFO:tasks.workunit.client.1.smithi117.stdout:0/297: fdatasync d11/d13/d1b/d27/d54/f57 0 2024-09-19T06:40:33.583 INFO:tasks.workunit.client.1.smithi117.stdout:3/451: symlink d0/d24/l87 0 2024-09-19T06:40:33.583 INFO:tasks.workunit.client.0.smithi099.stdout:6/311: dread d1/d5/d24/d2e/d41/f5a [0,4194304] 0 2024-09-19T06:40:33.584 INFO:tasks.workunit.client.1.smithi117.stdout:3/452: write d0/d9/f80 [961849,111988] 0 2024-09-19T06:40:33.584 INFO:tasks.workunit.client.1.smithi117.stdout:3/453: dread - d0/f63 zero size 2024-09-19T06:40:33.585 INFO:tasks.workunit.client.1.smithi117.stdout:8/450: rename d1d/d2a/d3f/d73/f99 to d1d/d2a/d3f/d4b/d5f/d95/f9b 0 2024-09-19T06:40:33.587 INFO:tasks.workunit.client.1.smithi117.stdout:0/298: unlink d11/d13/d14/d16/f26 0 2024-09-19T06:40:33.587 INFO:tasks.workunit.client.0.smithi099.stdout:3/398: mknod d7/d34/d1d/d20/d58/c6f 0 2024-09-19T06:40:33.587 INFO:tasks.workunit.client.1.smithi117.stdout:3/454: creat d0/d19/f88 x:0 0 0 2024-09-19T06:40:33.589 INFO:tasks.workunit.client.1.smithi117.stdout:0/299: truncate d11/d13/d1b/d27/d54/f57 666453 0 2024-09-19T06:40:33.591 INFO:tasks.workunit.client.0.smithi099.stdout:9/341: creat dd/f70 x:0 0 0 2024-09-19T06:40:33.593 INFO:tasks.workunit.client.0.smithi099.stdout:9/342: chown dd/d47/d40/d61 2490440 1 2024-09-19T06:40:33.594 INFO:tasks.workunit.client.0.smithi099.stdout:4/324: dread d12/f16 [0,4194304] 0 2024-09-19T06:40:33.594 INFO:tasks.workunit.client.1.smithi117.stdout:0/300: link d11/d13/d28/f43 d11/d13/d14/d2c/d53/f5c 0 2024-09-19T06:40:33.595 INFO:tasks.workunit.client.1.smithi117.stdout:3/455: dwrite d0/d19/f54 [0,4194304] 0 2024-09-19T06:40:33.595 INFO:tasks.workunit.client.0.smithi099.stdout:6/312: dread d1/f19 [0,4194304] 0 2024-09-19T06:40:33.595 INFO:tasks.workunit.client.0.smithi099.stdout:9/343: fsync dd/d2c/f5a 0 2024-09-19T06:40:33.596 INFO:tasks.workunit.client.1.smithi117.stdout:8/451: read f3 [7428221,100208] 0 2024-09-19T06:40:33.597 INFO:tasks.workunit.client.1.smithi117.stdout:8/452: chown d1d/f40 118684897 1 2024-09-19T06:40:33.599 INFO:tasks.workunit.client.1.smithi117.stdout:8/453: write d1d/f50 [714466,92772] 0 2024-09-19T06:40:33.600 INFO:tasks.workunit.client.0.smithi099.stdout:3/399: dwrite d7/d34/f3d [0,4194304] 0 2024-09-19T06:40:33.601 INFO:tasks.workunit.client.1.smithi117.stdout:7/381: write d1/d4a/d81/f47 [251894,64094] 0 2024-09-19T06:40:33.601 INFO:tasks.workunit.client.0.smithi099.stdout:9/344: mknod dd/d2c/d5c/d64/c71 0 2024-09-19T06:40:33.602 INFO:tasks.workunit.client.1.smithi117.stdout:8/454: write d1d/d1e/f70 [2161536,113340] 0 2024-09-19T06:40:33.602 INFO:tasks.workunit.client.1.smithi117.stdout:0/301: dread d11/d13/d28/f2e [0,4194304] 0 2024-09-19T06:40:33.604 INFO:tasks.workunit.client.1.smithi117.stdout:0/302: write d11/d13/d14/d2c/f36 [291188,30311] 0 2024-09-19T06:40:33.604 INFO:tasks.workunit.client.0.smithi099.stdout:4/325: dread - d12/d32/f48 zero size 2024-09-19T06:40:33.605 INFO:tasks.workunit.client.1.smithi117.stdout:7/382: mkdir d1/d4a/d81/d48/d5f/d82 0 2024-09-19T06:40:33.605 INFO:tasks.workunit.client.0.smithi099.stdout:7/386: dread d7/dd/d29/d4e/d53/f66 [0,4194304] 0 2024-09-19T06:40:33.607 INFO:tasks.workunit.client.1.smithi117.stdout:0/303: creat d11/d13/d28/f5d x:0 0 0 2024-09-19T06:40:33.608 INFO:tasks.workunit.client.0.smithi099.stdout:2/197: dwrite d1/d2/d5/d13/f1b [0,4194304] 0 2024-09-19T06:40:33.609 INFO:tasks.workunit.client.1.smithi117.stdout:7/383: mknod d1/c83 0 2024-09-19T06:40:33.611 INFO:tasks.workunit.client.0.smithi099.stdout:7/387: stat d7/fa 0 2024-09-19T06:40:33.611 INFO:tasks.workunit.client.0.smithi099.stdout:6/313: read d1/f4f [2185713,93357] 0 2024-09-19T06:40:33.615 INFO:tasks.workunit.client.1.smithi117.stdout:7/384: creat d1/d4a/d81/f84 x:0 0 0 2024-09-19T06:40:33.619 INFO:tasks.workunit.client.1.smithi117.stdout:8/455: link d1d/d2a/d3f/d4b/d5f/d95/f9b d1d/d2a/d3f/d4b/d5f/d7c/f9c 0 2024-09-19T06:40:33.621 INFO:tasks.workunit.client.0.smithi099.stdout:4/326: dwrite d12/d32/f72 [0,4194304] 0 2024-09-19T06:40:33.621 INFO:tasks.workunit.client.0.smithi099.stdout:6/314: mknod d1/d5/d24/d2e/c66 0 2024-09-19T06:40:33.621 INFO:tasks.workunit.client.1.smithi117.stdout:3/456: write d0/d3d/d48/f7e [2233145,11881] 0 2024-09-19T06:40:33.621 INFO:tasks.workunit.client.0.smithi099.stdout:9/345: dwrite dd/d47/d40/f31 [0,4194304] 0 2024-09-19T06:40:33.623 INFO:tasks.workunit.client.1.smithi117.stdout:8/456: mknod d1d/d1e/d53/c9d 0 2024-09-19T06:40:33.625 INFO:tasks.workunit.client.1.smithi117.stdout:8/457: chown d1d/d2a/l38 220 1 2024-09-19T06:40:33.626 INFO:tasks.workunit.client.1.smithi117.stdout:7/385: dwrite d1/d4a/d81/d24/d1c/f80 [0,4194304] 0 2024-09-19T06:40:33.627 INFO:tasks.workunit.client.0.smithi099.stdout:6/315: fsync d1/d5/d24/d2e/d41/d4e/d2a/f30 0 2024-09-19T06:40:33.628 INFO:tasks.workunit.client.1.smithi117.stdout:7/386: stat d1/d4a/d81/d24/d1c/c40 0 2024-09-19T06:40:33.628 INFO:tasks.workunit.client.1.smithi117.stdout:0/304: truncate d11/d13/d28/f43 600920 0 2024-09-19T06:40:33.628 INFO:tasks.workunit.client.0.smithi099.stdout:9/346: unlink dd/d47/f2a 0 2024-09-19T06:40:33.630 INFO:tasks.workunit.client.1.smithi117.stdout:8/458: creat d1d/d2a/d3f/d73/f9e x:0 0 0 2024-09-19T06:40:33.632 INFO:tasks.workunit.client.1.smithi117.stdout:8/459: truncate d1d/d2a/d3f/f72 295342 0 2024-09-19T06:40:33.632 INFO:tasks.workunit.client.1.smithi117.stdout:3/457: link d0/d8/d7f/f7a d0/d8/f89 0 2024-09-19T06:40:33.633 INFO:tasks.workunit.client.1.smithi117.stdout:0/305: chown d11/d13/d1b/d27/f40 271211 1 2024-09-19T06:40:33.635 INFO:tasks.workunit.client.0.smithi099.stdout:9/347: symlink dd/d2c/d5c/d64/l72 0 2024-09-19T06:40:33.635 INFO:tasks.workunit.client.1.smithi117.stdout:8/460: creat d1d/d31/d83/f9f x:0 0 0 2024-09-19T06:40:33.638 INFO:tasks.workunit.client.0.smithi099.stdout:4/327: dwrite d12/d32/d42/d5c/f25 [0,4194304] 0 2024-09-19T06:40:33.640 INFO:tasks.workunit.client.1.smithi117.stdout:8/461: rename d1d/d1e/l8e to d1d/d1e/d53/la0 0 2024-09-19T06:40:33.640 INFO:tasks.workunit.client.0.smithi099.stdout:2/198: write d1/d2/d5/d8/d36/f41 [402706,34521] 0 2024-09-19T06:40:33.640 INFO:tasks.workunit.client.0.smithi099.stdout:9/348: dread - dd/d47/d68/f6c zero size 2024-09-19T06:40:33.644 INFO:tasks.workunit.client.0.smithi099.stdout:4/328: fdatasync d12/d32/f4c 0 2024-09-19T06:40:33.644 INFO:tasks.workunit.client.1.smithi117.stdout:8/462: creat d1d/d2a/fa1 x:0 0 0 2024-09-19T06:40:33.645 INFO:tasks.workunit.client.0.smithi099.stdout:6/316: dwrite d1/f35 [0,4194304] 0 2024-09-19T06:40:33.645 INFO:tasks.workunit.client.0.smithi099.stdout:3/400: dread d7/d34/d1d/d20/d58/d5c/f5d [0,4194304] 0 2024-09-19T06:40:33.648 INFO:tasks.workunit.client.0.smithi099.stdout:2/199: chown d1/d2/d5/d6/l7 497007635 1 2024-09-19T06:40:33.648 INFO:tasks.workunit.client.0.smithi099.stdout:9/349: creat dd/d2c/d5c/f73 x:0 0 0 2024-09-19T06:40:33.650 INFO:tasks.workunit.client.1.smithi117.stdout:8/463: getdents d1d/d2a/d3f/d4b 0 2024-09-19T06:40:33.650 INFO:tasks.workunit.client.0.smithi099.stdout:6/317: truncate d1/d5/f42 332213 0 2024-09-19T06:40:33.650 INFO:tasks.workunit.client.0.smithi099.stdout:4/329: mkdir d12/d1b/d73 0 2024-09-19T06:40:33.651 INFO:tasks.workunit.client.1.smithi117.stdout:8/464: chown d1d/d31/f79 1 1 2024-09-19T06:40:33.651 INFO:tasks.workunit.client.0.smithi099.stdout:3/401: dread d7/f49 [0,4194304] 0 2024-09-19T06:40:33.651 INFO:tasks.workunit.client.0.smithi099.stdout:9/350: write dd/f44 [656205,120427] 0 2024-09-19T06:40:33.652 INFO:tasks.workunit.client.0.smithi099.stdout:6/318: mknod d1/d12/c67 0 2024-09-19T06:40:33.654 INFO:tasks.workunit.client.1.smithi117.stdout:8/465: creat d1d/d2a/d3f/d4b/d5f/d95/fa2 x:0 0 0 2024-09-19T06:40:33.655 INFO:tasks.workunit.client.0.smithi099.stdout:2/200: creat d1/d2/d5/d8/d36/f45 x:0 0 0 2024-09-19T06:40:33.655 INFO:tasks.workunit.client.0.smithi099.stdout:8/217: sync 2024-09-19T06:40:33.656 INFO:tasks.workunit.client.0.smithi099.stdout:8/218: chown d4/de 47 1 2024-09-19T06:40:33.657 INFO:tasks.workunit.client.1.smithi117.stdout:8/466: creat d1d/d2a/d3f/d4b/fa3 x:0 0 0 2024-09-19T06:40:33.658 INFO:tasks.workunit.client.0.smithi099.stdout:9/351: fsync dd/d65/f67 0 2024-09-19T06:40:33.660 INFO:tasks.workunit.client.0.smithi099.stdout:9/352: fsync dd/d47/f38 0 2024-09-19T06:40:33.660 INFO:tasks.workunit.client.0.smithi099.stdout:7/388: truncate d7/dd/d29/f1e 76465 0 2024-09-19T06:40:33.662 INFO:tasks.workunit.client.0.smithi099.stdout:9/353: dread - dd/f5b zero size 2024-09-19T06:40:33.664 INFO:tasks.workunit.client.1.smithi117.stdout:8/467: dwrite d1d/d2a/d3f/d73/f9e [0,4194304] 0 2024-09-19T06:40:33.666 INFO:tasks.workunit.client.0.smithi099.stdout:2/201: dwrite d1/d2/d5/d8/d18/f2f [0,4194304] 0 2024-09-19T06:40:33.667 INFO:tasks.workunit.client.0.smithi099.stdout:7/389: creat d7/dd/d29/d1f/d45/d48/d63/d75/f8d x:0 0 0 2024-09-19T06:40:33.667 INFO:tasks.workunit.client.0.smithi099.stdout:9/354: write dd/f70 [560862,109487] 0 2024-09-19T06:40:33.668 INFO:tasks.workunit.client.0.smithi099.stdout:3/402: dwrite d7/d34/d1d/d36/f38 [4194304,4194304] 0 2024-09-19T06:40:33.669 INFO:tasks.workunit.client.1.smithi117.stdout:0/306: truncate d11/d13/d14/d2c/d35/d3e/f52 185510 0 2024-09-19T06:40:33.671 INFO:tasks.workunit.client.1.smithi117.stdout:7/387: dread d1/d4a/d81/f1a [0,4194304] 0 2024-09-19T06:40:33.672 INFO:tasks.workunit.client.1.smithi117.stdout:0/307: chown d11/d13/c24 115988575 1 2024-09-19T06:40:33.673 INFO:tasks.workunit.client.0.smithi099.stdout:6/319: truncate d1/f9 1764105 0 2024-09-19T06:40:33.673 INFO:tasks.workunit.client.1.smithi117.stdout:7/388: chown d1/d4a/d81/d24/d1c/f27 2806619 1 2024-09-19T06:40:33.675 INFO:tasks.workunit.client.1.smithi117.stdout:8/468: dwrite d1d/d2a/f84 [0,4194304] 0 2024-09-19T06:40:33.679 INFO:tasks.workunit.client.0.smithi099.stdout:4/330: dwrite d12/d32/d42/d5c/f31 [0,4194304] 0 2024-09-19T06:40:33.682 INFO:tasks.workunit.client.1.smithi117.stdout:7/389: rename d1/d4a/d81/d24/d49/f6c to d1/d3f/f85 0 2024-09-19T06:40:33.683 INFO:tasks.workunit.client.0.smithi099.stdout:6/320: creat d1/d5/d24/d2e/d41/d4e/d54/d5d/d61/f68 x:0 0 0 2024-09-19T06:40:33.684 INFO:tasks.workunit.client.1.smithi117.stdout:7/390: chown d1/l17 587 1 2024-09-19T06:40:33.685 INFO:tasks.workunit.client.0.smithi099.stdout:3/403: link d7/f49 d7/d34/f70 0 2024-09-19T06:40:33.685 INFO:tasks.workunit.client.0.smithi099.stdout:6/321: readlink d1/d5/l4a 0 2024-09-19T06:40:33.686 INFO:tasks.workunit.client.0.smithi099.stdout:9/355: rename dd/d2c/c1b to dd/c74 0 2024-09-19T06:40:33.688 INFO:tasks.workunit.client.0.smithi099.stdout:8/219: dwrite d4/f17 [0,4194304] 0 2024-09-19T06:40:33.689 INFO:tasks.workunit.client.0.smithi099.stdout:6/322: chown d1/f1e 2146446844 1 2024-09-19T06:40:33.691 INFO:tasks.workunit.client.0.smithi099.stdout:8/220: fdatasync d4/de/d10/f24 0 2024-09-19T06:40:33.693 INFO:tasks.workunit.client.0.smithi099.stdout:7/390: rmdir d7/dd 39 2024-09-19T06:40:33.697 INFO:tasks.workunit.client.0.smithi099.stdout:7/391: stat d7/dd/d29/d1f/l27 0 2024-09-19T06:40:33.702 INFO:tasks.workunit.client.0.smithi099.stdout:7/392: creat d7/d39/d7d/f8e x:0 0 0 2024-09-19T06:40:33.702 INFO:tasks.workunit.client.0.smithi099.stdout:8/221: dwrite d4/de/d10/f40 [0,4194304] 0 2024-09-19T06:40:33.702 INFO:tasks.workunit.client.0.smithi099.stdout:8/222: chown d4/de 68 1 2024-09-19T06:40:33.703 INFO:tasks.workunit.client.0.smithi099.stdout:7/393: dread d7/dd/d29/f2f [0,4194304] 0 2024-09-19T06:40:33.705 INFO:tasks.workunit.client.0.smithi099.stdout:7/394: truncate d7/d39/f8c 227873 0 2024-09-19T06:40:33.705 INFO:tasks.workunit.client.0.smithi099.stdout:7/395: write d7/f52 [697681,82449] 0 2024-09-19T06:40:33.723 INFO:tasks.workunit.client.1.smithi117.stdout:0/308: dwrite d11/d13/d14/f1d [0,4194304] 0 2024-09-19T06:40:33.725 INFO:tasks.workunit.client.0.smithi099.stdout:2/202: truncate d1/d2/d5/d13/d2c/f38 281511 0 2024-09-19T06:40:33.725 INFO:tasks.workunit.client.0.smithi099.stdout:6/323: dread d1/f10 [0,4194304] 0 2024-09-19T06:40:33.726 INFO:tasks.workunit.client.1.smithi117.stdout:7/391: dread d1/d4a/d81/d24/d1c/f28 [0,4194304] 0 2024-09-19T06:40:33.726 INFO:tasks.workunit.client.1.smithi117.stdout:0/309: unlink d11/d13/d14/l3f 0 2024-09-19T06:40:33.726 INFO:tasks.workunit.client.0.smithi099.stdout:3/404: stat d7/d34/f3a 0 2024-09-19T06:40:33.726 INFO:tasks.workunit.client.0.smithi099.stdout:9/356: rmdir dd/d2c 39 2024-09-19T06:40:33.728 INFO:tasks.workunit.client.0.smithi099.stdout:9/357: chown dd/d47/d40/l41 145391 1 2024-09-19T06:40:33.729 INFO:tasks.workunit.client.0.smithi099.stdout:2/203: mkdir d1/d2/d5/d8/d18/d46 0 2024-09-19T06:40:33.732 INFO:tasks.workunit.client.0.smithi099.stdout:8/223: dread d4/de/f16 [0,4194304] 0 2024-09-19T06:40:33.732 INFO:tasks.workunit.client.0.smithi099.stdout:2/204: creat d1/f47 x:0 0 0 2024-09-19T06:40:33.733 INFO:tasks.workunit.client.1.smithi117.stdout:0/310: rename d11/d13/d14/d2c/d35/d3e/f46 to d11/d13/d1b/d27/d37/f5e 0 2024-09-19T06:40:33.733 INFO:tasks.workunit.client.0.smithi099.stdout:6/324: mknod d1/d5/d24/d2e/c69 0 2024-09-19T06:40:33.734 INFO:tasks.workunit.client.0.smithi099.stdout:3/405: write d7/d34/d1d/d20/d58/d5c/f5d [4213836,127002] 0 2024-09-19T06:40:33.736 INFO:tasks.workunit.client.0.smithi099.stdout:6/325: chown d1/f19 20371 1 2024-09-19T06:40:33.738 INFO:tasks.workunit.client.0.smithi099.stdout:8/224: creat d4/d11/d23/d4c/f4e x:0 0 0 2024-09-19T06:40:33.738 INFO:tasks.workunit.client.0.smithi099.stdout:3/406: mknod d7/d34/d1d/d36/d42/c71 0 2024-09-19T06:40:33.741 INFO:tasks.workunit.client.0.smithi099.stdout:6/326: creat d1/d5/d24/f6a x:0 0 0 2024-09-19T06:40:33.742 INFO:tasks.workunit.client.0.smithi099.stdout:8/225: fsync d4/de/d14/f39 0 2024-09-19T06:40:33.742 INFO:tasks.workunit.client.0.smithi099.stdout:9/358: dwrite dd/d47/d68/f6c [0,4194304] 0 2024-09-19T06:40:33.743 INFO:tasks.workunit.client.0.smithi099.stdout:6/327: fsync d1/d5/f42 0 2024-09-19T06:40:33.743 INFO:tasks.workunit.client.0.smithi099.stdout:3/407: unlink d7/d34/d1d/d36/f4c 0 2024-09-19T06:40:33.744 INFO:tasks.workunit.client.1.smithi117.stdout:2/363: sync 2024-09-19T06:40:33.744 INFO:tasks.workunit.client.1.smithi117.stdout:9/390: sync 2024-09-19T06:40:33.744 INFO:tasks.workunit.client.1.smithi117.stdout:5/416: sync 2024-09-19T06:40:33.744 INFO:tasks.workunit.client.1.smithi117.stdout:4/552: sync 2024-09-19T06:40:33.745 INFO:tasks.workunit.client.0.smithi099.stdout:8/226: truncate d4/d11/d38/f3c 933699 0 2024-09-19T06:40:33.745 INFO:tasks.workunit.client.0.smithi099.stdout:9/359: creat dd/d65/f75 x:0 0 0 2024-09-19T06:40:33.746 INFO:tasks.workunit.client.0.smithi099.stdout:6/328: truncate d1/d5/d24/f6a 711602 0 2024-09-19T06:40:33.746 INFO:tasks.workunit.client.1.smithi117.stdout:7/392: dread d1/d4a/d81/d24/d26/f2f [0,4194304] 0 2024-09-19T06:40:33.749 INFO:tasks.workunit.client.0.smithi099.stdout:8/227: readlink d4/d11/l42 0 2024-09-19T06:40:33.749 INFO:tasks.workunit.client.1.smithi117.stdout:5/417: creat d17/d5c/f90 x:0 0 0 2024-09-19T06:40:33.750 INFO:tasks.workunit.client.1.smithi117.stdout:5/418: chown d17/f76 189996 1 2024-09-19T06:40:33.750 INFO:tasks.workunit.client.1.smithi117.stdout:2/364: read d0/d12/f3c [1034479,111652] 0 2024-09-19T06:40:33.750 INFO:tasks.workunit.client.0.smithi099.stdout:8/228: truncate d4/d11/f1f 4178045 0 2024-09-19T06:40:33.751 INFO:tasks.workunit.client.0.smithi099.stdout:9/360: mkdir dd/d62/d76 0 2024-09-19T06:40:33.751 INFO:tasks.workunit.client.0.smithi099.stdout:8/229: fdatasync d4/d11/d23/f4b 0 2024-09-19T06:40:33.752 INFO:tasks.workunit.client.1.smithi117.stdout:4/553: creat d3/db/d20/d4a/d7b/da0/fbf x:0 0 0 2024-09-19T06:40:33.752 INFO:tasks.workunit.client.1.smithi117.stdout:9/391: mkdir d4/d8/d6a/d82 0 2024-09-19T06:40:33.752 INFO:tasks.workunit.client.0.smithi099.stdout:9/361: read dd/f70 [54791,44128] 0 2024-09-19T06:40:33.753 INFO:tasks.workunit.client.0.smithi099.stdout:6/329: chown d1/c6 15258369 1 2024-09-19T06:40:33.754 INFO:tasks.workunit.client.1.smithi117.stdout:2/365: write d0/d7/d1e/d20/f44 [1779384,15779] 0 2024-09-19T06:40:33.754 INFO:tasks.workunit.client.1.smithi117.stdout:4/554: fsync d3/d28/fb0 0 2024-09-19T06:40:33.754 INFO:tasks.workunit.client.0.smithi099.stdout:3/408: dread d7/f15 [0,4194304] 0 2024-09-19T06:40:33.755 INFO:tasks.workunit.client.1.smithi117.stdout:7/393: dread d1/d4a/d81/d24/f69 [0,4194304] 0 2024-09-19T06:40:33.755 INFO:tasks.workunit.client.1.smithi117.stdout:9/392: symlink d4/d8/l83 0 2024-09-19T06:40:33.756 INFO:tasks.workunit.client.1.smithi117.stdout:9/393: fdatasync d4/d8/fe 0 2024-09-19T06:40:33.757 INFO:tasks.workunit.client.1.smithi117.stdout:5/419: getdents d17/d1b/d3a 0 2024-09-19T06:40:33.757 INFO:tasks.workunit.client.1.smithi117.stdout:2/366: mknod d0/d7/d1e/c89 0 2024-09-19T06:40:33.759 INFO:tasks.workunit.client.1.smithi117.stdout:7/394: fsync d1/d4a/d81/d24/d26/f2f 0 2024-09-19T06:40:33.760 INFO:tasks.workunit.client.1.smithi117.stdout:9/394: mkdir d4/d8/d6a/d84 0 2024-09-19T06:40:33.761 INFO:tasks.workunit.client.0.smithi099.stdout:9/362: fsync dd/d2c/f39 0 2024-09-19T06:40:33.761 INFO:tasks.workunit.client.1.smithi117.stdout:2/367: mknod d0/d7/d29/d35/d61/d65/c8a 0 2024-09-19T06:40:33.762 INFO:tasks.workunit.client.1.smithi117.stdout:2/368: fsync d0/d12/d2f/f60 0 2024-09-19T06:40:33.762 INFO:tasks.workunit.client.0.smithi099.stdout:6/330: symlink d1/d5/d24/d2e/d41/d4e/d54/d5d/d61/d65/l6b 0 2024-09-19T06:40:33.764 INFO:tasks.workunit.client.0.smithi099.stdout:9/363: mknod dd/d47/d40/d61/c77 0 2024-09-19T06:40:33.764 INFO:tasks.workunit.client.0.smithi099.stdout:6/331: write d1/d5/d24/d2e/d41/d4e/d54/f57 [513691,98290] 0 2024-09-19T06:40:33.764 INFO:tasks.workunit.client.1.smithi117.stdout:7/395: creat d1/d4a/d77/f86 x:0 0 0 2024-09-19T06:40:33.765 INFO:tasks.workunit.client.1.smithi117.stdout:9/395: write d4/d58/f68 [706510,113782] 0 2024-09-19T06:40:33.766 INFO:tasks.workunit.client.1.smithi117.stdout:0/311: dread d11/d13/d14/d16/f3a [0,4194304] 0 2024-09-19T06:40:33.767 INFO:tasks.workunit.client.1.smithi117.stdout:9/396: stat d4/d1c/d54/d75 0 2024-09-19T06:40:33.767 INFO:tasks.workunit.client.0.smithi099.stdout:9/364: mkdir dd/d62/d78 0 2024-09-19T06:40:33.768 INFO:tasks.workunit.client.1.smithi117.stdout:2/369: link d0/d6f/f80 d0/d6f/f8b 0 2024-09-19T06:40:33.770 INFO:tasks.workunit.client.1.smithi117.stdout:7/396: creat d1/d4a/d81/d24/d1c/d35/d4f/f87 x:0 0 0 2024-09-19T06:40:33.770 INFO:tasks.workunit.client.1.smithi117.stdout:2/370: creat d0/d7/d1e/d20/f8c x:0 0 0 2024-09-19T06:40:33.771 INFO:tasks.workunit.client.1.smithi117.stdout:9/397: creat d4/d1c/d7a/d52/f85 x:0 0 0 2024-09-19T06:40:33.771 INFO:tasks.workunit.client.0.smithi099.stdout:9/365: mkdir dd/d2c/d79 0 2024-09-19T06:40:33.773 INFO:tasks.workunit.client.0.smithi099.stdout:9/366: chown dd/d2c/f39 8110712 1 2024-09-19T06:40:33.773 INFO:tasks.workunit.client.0.smithi099.stdout:6/332: rmdir d1/d5/d24/d2e/d41/d4e/d54/d5d/d61 39 2024-09-19T06:40:33.774 INFO:tasks.workunit.client.1.smithi117.stdout:0/312: dread d11/d13/d14/f45 [4194304,4194304] 0 2024-09-19T06:40:33.774 INFO:tasks.workunit.client.1.smithi117.stdout:7/397: dread d1/d4a/d81/d24/d1c/f4e [0,4194304] 0 2024-09-19T06:40:33.774 INFO:tasks.workunit.client.1.smithi117.stdout:9/398: symlink d4/d8/l86 0 2024-09-19T06:40:33.776 INFO:tasks.workunit.client.1.smithi117.stdout:4/555: write d3/d1b/d7d/d51/fba [1147222,1486] 0 2024-09-19T06:40:33.776 INFO:tasks.workunit.client.0.smithi099.stdout:9/367: chown dd/d47/d40/f3f 1035393 1 2024-09-19T06:40:33.777 INFO:tasks.workunit.client.1.smithi117.stdout:2/371: dread d0/d6f/f8b [0,4194304] 0 2024-09-19T06:40:33.777 INFO:tasks.workunit.client.0.smithi099.stdout:3/409: dwrite d7/d34/f70 [0,4194304] 0 2024-09-19T06:40:33.777 INFO:tasks.workunit.client.0.smithi099.stdout:6/333: mknod d1/c6c 0 2024-09-19T06:40:33.778 INFO:tasks.workunit.client.0.smithi099.stdout:3/410: read - d7/f68 zero size 2024-09-19T06:40:33.778 INFO:tasks.workunit.client.0.smithi099.stdout:8/230: dread f3 [0,4194304] 0 2024-09-19T06:40:33.779 INFO:tasks.workunit.client.1.smithi117.stdout:2/372: write d0/d12/d32/f4f [3524590,30373] 0 2024-09-19T06:40:33.780 INFO:tasks.workunit.client.0.smithi099.stdout:8/231: chown d4/d11/d23/f31 6 1 2024-09-19T06:40:33.780 INFO:tasks.workunit.client.1.smithi117.stdout:5/420: dread d17/d5c/f69 [0,4194304] 0 2024-09-19T06:40:33.780 INFO:tasks.workunit.client.0.smithi099.stdout:9/368: unlink fb 0 2024-09-19T06:40:33.781 INFO:tasks.workunit.client.0.smithi099.stdout:8/232: chown d4/d11/d23/l3a 210530603 1 2024-09-19T06:40:33.782 INFO:tasks.workunit.client.1.smithi117.stdout:7/398: mknod d1/d4a/d81/d48/d5f/d82/c88 0 2024-09-19T06:40:33.784 INFO:tasks.workunit.client.0.smithi099.stdout:6/334: rmdir d1/d5/d38 39 2024-09-19T06:40:33.786 INFO:tasks.workunit.client.1.smithi117.stdout:9/399: creat d4/d1c/d54/d75/f87 x:0 0 0 2024-09-19T06:40:33.786 INFO:tasks.workunit.client.0.smithi099.stdout:3/411: creat d7/d34/d1d/d36/d69/f72 x:0 0 0 2024-09-19T06:40:33.786 INFO:tasks.workunit.client.0.smithi099.stdout:8/233: symlink d4/de/d10/l4f 0 2024-09-19T06:40:33.787 INFO:tasks.workunit.client.0.smithi099.stdout:6/335: write d1/d5/f3a [876584,53149] 0 2024-09-19T06:40:33.790 INFO:tasks.workunit.client.1.smithi117.stdout:5/421: creat d17/d1b/d3a/d3c/d46/f91 x:0 0 0 2024-09-19T06:40:33.791 INFO:tasks.workunit.client.0.smithi099.stdout:9/369: dwrite dd/d2c/f4b [0,4194304] 0 2024-09-19T06:40:33.792 INFO:tasks.workunit.client.1.smithi117.stdout:4/556: rename d3/db/d20/d35/c3e to d3/d4/d5f/cc0 0 2024-09-19T06:40:33.793 INFO:tasks.workunit.client.1.smithi117.stdout:9/400: dwrite d4/d8/fe [0,4194304] 0 2024-09-19T06:40:33.793 INFO:tasks.workunit.client.1.smithi117.stdout:2/373: mkdir d0/d7/d7f/d8d 0 2024-09-19T06:40:33.794 INFO:tasks.workunit.client.0.smithi099.stdout:6/336: unlink d1/d5/d24/d2e/d41/d4e/d2a/f60 0 2024-09-19T06:40:33.794 INFO:tasks.workunit.client.1.smithi117.stdout:0/313: getdents d11/d13/d1b/d27/d37 0 2024-09-19T06:40:33.796 INFO:tasks.workunit.client.0.smithi099.stdout:9/370: rmdir dd/d47/d40/d61 39 2024-09-19T06:40:33.797 INFO:tasks.workunit.client.1.smithi117.stdout:5/422: symlink d17/d2f/d6a/l92 0 2024-09-19T06:40:33.797 INFO:tasks.workunit.client.1.smithi117.stdout:0/314: dread - d11/d13/d1b/d27/d37/f58 zero size 2024-09-19T06:40:33.798 INFO:tasks.workunit.client.0.smithi099.stdout:9/371: write dd/d65/f67 [5950550,115091] 0 2024-09-19T06:40:33.798 INFO:tasks.workunit.client.0.smithi099.stdout:6/337: creat d1/d5/d24/d2e/d41/d4e/f6d x:0 0 0 2024-09-19T06:40:33.801 INFO:tasks.workunit.client.1.smithi117.stdout:9/401: creat d4/d1c/d46/f88 x:0 0 0 2024-09-19T06:40:33.803 INFO:tasks.workunit.client.0.smithi099.stdout:6/338: unlink d1/d12/c16 0 2024-09-19T06:40:33.803 INFO:tasks.workunit.client.0.smithi099.stdout:9/372: dread dd/f34 [0,4194304] 0 2024-09-19T06:40:33.804 INFO:tasks.workunit.client.1.smithi117.stdout:9/402: fsync d4/d1c/f59 0 2024-09-19T06:40:33.805 INFO:tasks.workunit.client.1.smithi117.stdout:0/315: creat d11/d13/d1b/f5f x:0 0 0 2024-09-19T06:40:33.806 INFO:tasks.workunit.client.1.smithi117.stdout:9/403: read f0 [2646664,79378] 0 2024-09-19T06:40:33.806 INFO:tasks.workunit.client.1.smithi117.stdout:4/557: dwrite d3/fb6 [0,4194304] 0 2024-09-19T06:40:33.806 INFO:tasks.workunit.client.0.smithi099.stdout:9/373: mknod dd/d2c/d5c/d64/c7a 0 2024-09-19T06:40:33.808 INFO:tasks.workunit.client.0.smithi099.stdout:3/412: dread d7/d34/f1f [0,4194304] 0 2024-09-19T06:40:33.808 INFO:tasks.workunit.client.0.smithi099.stdout:9/374: readlink dd/d2c/d5c/d64/l72 0 2024-09-19T06:40:33.811 INFO:tasks.workunit.client.1.smithi117.stdout:5/423: link d17/d1b/d3a/d3c/d46/c66 d17/d2e/d65/d88/c93 0 2024-09-19T06:40:33.812 INFO:tasks.workunit.client.1.smithi117.stdout:4/558: write d3/db/d23/f54 [4887332,15041] 0 2024-09-19T06:40:33.813 INFO:tasks.workunit.client.0.smithi099.stdout:6/339: dwrite d1/d5/f50 [0,4194304] 0 2024-09-19T06:40:33.813 INFO:tasks.workunit.client.0.smithi099.stdout:9/375: unlink dd/d47/l6f 0 2024-09-19T06:40:33.814 INFO:tasks.workunit.client.1.smithi117.stdout:0/316: link d11/d13/d1b/d27/f40 d11/d13/d1b/d27/f60 0 2024-09-19T06:40:33.815 INFO:tasks.workunit.client.1.smithi117.stdout:7/399: dread d1/d4a/d81/f2c [0,4194304] 0 2024-09-19T06:40:33.818 INFO:tasks.workunit.client.0.smithi099.stdout:6/340: mkdir d1/d5/d24/d2e/d6e 0 2024-09-19T06:40:33.820 INFO:tasks.workunit.client.0.smithi099.stdout:3/413: link d7/f18 d7/f73 0 2024-09-19T06:40:33.821 INFO:tasks.workunit.client.1.smithi117.stdout:0/317: mkdir d11/d13/d1b/d61 0 2024-09-19T06:40:33.822 INFO:tasks.workunit.client.0.smithi099.stdout:9/376: dwrite dd/d47/d40/f5e [0,4194304] 0 2024-09-19T06:40:33.823 INFO:tasks.workunit.client.1.smithi117.stdout:7/400: mknod d1/d4a/d81/d24/d1c/d35/c89 0 2024-09-19T06:40:33.827 INFO:tasks.workunit.client.1.smithi117.stdout:0/318: creat d11/d13/d14/d2c/d35/d3e/f62 x:0 0 0 2024-09-19T06:40:33.829 INFO:tasks.workunit.client.1.smithi117.stdout:7/401: rename d1/d3f/l5c to d1/d4a/d81/d48/d5f/l8a 0 2024-09-19T06:40:33.829 INFO:tasks.workunit.client.0.smithi099.stdout:6/341: symlink d1/l6f 0 2024-09-19T06:40:33.830 INFO:tasks.workunit.client.1.smithi117.stdout:7/402: write d1/d4a/f7b [998471,127647] 0 2024-09-19T06:40:33.831 INFO:tasks.workunit.client.1.smithi117.stdout:2/374: dread d0/d12/d32/f4f [0,4194304] 0 2024-09-19T06:40:33.831 INFO:tasks.workunit.client.1.smithi117.stdout:9/404: write d4/f7f [952841,18771] 0 2024-09-19T06:40:33.832 INFO:tasks.workunit.client.0.smithi099.stdout:3/414: dread d7/f49 [0,4194304] 0 2024-09-19T06:40:33.832 INFO:tasks.workunit.client.0.smithi099.stdout:9/377: creat dd/d62/d78/f7b x:0 0 0 2024-09-19T06:40:33.833 INFO:tasks.workunit.client.1.smithi117.stdout:5/424: write d17/f21 [4070837,28830] 0 2024-09-19T06:40:33.833 INFO:tasks.workunit.client.0.smithi099.stdout:9/378: chown dd/d2c/f4b 143419 1 2024-09-19T06:40:33.834 INFO:tasks.workunit.client.1.smithi117.stdout:2/375: write d0/d12/d2f/f40 [795343,83223] 0 2024-09-19T06:40:33.835 INFO:tasks.workunit.client.1.smithi117.stdout:5/425: dread - d17/d2e/d55/f7a zero size 2024-09-19T06:40:33.835 INFO:tasks.workunit.client.1.smithi117.stdout:0/319: creat d11/f63 x:0 0 0 2024-09-19T06:40:33.837 INFO:tasks.workunit.client.0.smithi099.stdout:3/415: mkdir d7/d34/d1d/d57/d74 0 2024-09-19T06:40:33.837 INFO:tasks.workunit.client.1.smithi117.stdout:9/405: mknod d4/d8/d6e/c89 0 2024-09-19T06:40:33.837 INFO:tasks.workunit.client.1.smithi117.stdout:4/559: write d3/db/d20/d35/d79/fa6 [970457,98669] 0 2024-09-19T06:40:33.838 INFO:tasks.workunit.client.1.smithi117.stdout:2/376: stat d0/d7/d1e/c4e 0 2024-09-19T06:40:33.838 INFO:tasks.workunit.client.0.smithi099.stdout:6/342: dwrite d1/d5/d24/d2b/f45 [0,4194304] 0 2024-09-19T06:40:33.839 INFO:tasks.workunit.client.0.smithi099.stdout:9/379: creat dd/d2c/d79/f7c x:0 0 0 2024-09-19T06:40:33.840 INFO:tasks.workunit.client.1.smithi117.stdout:9/406: chown d4/c23 11 1 2024-09-19T06:40:33.840 INFO:tasks.workunit.client.0.smithi099.stdout:3/416: mkdir d7/d34/d1d/d20/d75 0 2024-09-19T06:40:33.841 INFO:tasks.workunit.client.1.smithi117.stdout:4/560: write d3/db/f43 [8222155,42588] 0 2024-09-19T06:40:33.841 INFO:tasks.workunit.client.1.smithi117.stdout:0/320: rename d11/d13/d1b/d27/d37/d42 to d11/d13/d14/d2c/d64 0 2024-09-19T06:40:33.842 INFO:tasks.workunit.client.0.smithi099.stdout:9/380: creat dd/d62/d78/f7d x:0 0 0 2024-09-19T06:40:33.843 INFO:tasks.workunit.client.0.smithi099.stdout:9/381: read - dd/f5d zero size 2024-09-19T06:40:33.844 INFO:tasks.workunit.client.0.smithi099.stdout:9/382: read dd/d47/d40/f52 [379540,75137] 0 2024-09-19T06:40:33.844 INFO:tasks.workunit.client.1.smithi117.stdout:7/403: write d1/d4a/d81/d24/f31 [1546627,121039] 0 2024-09-19T06:40:33.845 INFO:tasks.workunit.client.0.smithi099.stdout:6/343: creat d1/d5/d24/d2e/f70 x:0 0 0 2024-09-19T06:40:33.846 INFO:tasks.workunit.client.1.smithi117.stdout:2/377: mkdir d0/d7/d29/d35/d61/d8e 0 2024-09-19T06:40:33.847 INFO:tasks.workunit.client.1.smithi117.stdout:9/407: mknod d4/d8/d6e/c8a 0 2024-09-19T06:40:33.850 INFO:tasks.workunit.client.1.smithi117.stdout:2/378: readlink d0/d12/l1a 0 2024-09-19T06:40:33.851 INFO:tasks.workunit.client.1.smithi117.stdout:7/404: symlink d1/d4a/d81/d24/d1c/d35/d4f/l8b 0 2024-09-19T06:40:33.852 INFO:tasks.workunit.client.1.smithi117.stdout:0/321: dwrite d11/d13/d1b/d27/d37/f58 [0,4194304] 0 2024-09-19T06:40:33.853 INFO:tasks.workunit.client.1.smithi117.stdout:4/561: truncate d3/db/d20/d35/f4c 1011015 0 2024-09-19T06:40:33.853 INFO:tasks.workunit.client.1.smithi117.stdout:0/322: readlink l2 0 2024-09-19T06:40:33.853 INFO:tasks.workunit.client.1.smithi117.stdout:1/357: sync 2024-09-19T06:40:33.853 INFO:tasks.workunit.client.1.smithi117.stdout:6/287: sync 2024-09-19T06:40:33.854 INFO:tasks.workunit.client.1.smithi117.stdout:7/405: write d1/d4a/d81/f47 [738397,97453] 0 2024-09-19T06:40:33.855 INFO:tasks.workunit.client.1.smithi117.stdout:2/379: creat d0/d7/d29/d35/d61/d65/f8f x:0 0 0 2024-09-19T06:40:33.858 INFO:tasks.workunit.client.1.smithi117.stdout:1/358: write f1 [5246358,112178] 0 2024-09-19T06:40:33.858 INFO:tasks.workunit.client.0.smithi099.stdout:6/344: truncate d1/d5/f33 2286481 0 2024-09-19T06:40:33.861 INFO:tasks.workunit.client.0.smithi099.stdout:6/345: stat d1/f9 0 2024-09-19T06:40:33.861 INFO:tasks.workunit.client.1.smithi117.stdout:5/426: truncate d17/d1b/d3a/d3c/d46/f4f 1520532 0 2024-09-19T06:40:33.862 INFO:tasks.workunit.client.1.smithi117.stdout:7/406: dread d1/d3f/f85 [0,4194304] 0 2024-09-19T06:40:33.863 INFO:tasks.workunit.client.1.smithi117.stdout:9/408: write d4/d58/f67 [2285355,90851] 0 2024-09-19T06:40:33.864 INFO:tasks.workunit.client.0.smithi099.stdout:9/383: dwrite dd/f70 [0,4194304] 0 2024-09-19T06:40:33.864 INFO:tasks.workunit.client.1.smithi117.stdout:1/359: mknod d3/d22/d2f/c77 0 2024-09-19T06:40:33.864 INFO:tasks.workunit.client.1.smithi117.stdout:0/323: creat d11/d13/d14/d2c/d53/f65 x:0 0 0 2024-09-19T06:40:33.865 INFO:tasks.workunit.client.0.smithi099.stdout:6/346: truncate d1/d5/d38/f59 437040 0 2024-09-19T06:40:33.865 INFO:tasks.workunit.client.1.smithi117.stdout:6/288: write d1/f18 [1187153,56450] 0 2024-09-19T06:40:33.865 INFO:tasks.workunit.client.0.smithi099.stdout:6/347: readlink d1/l11 0 2024-09-19T06:40:33.866 INFO:tasks.workunit.client.0.smithi099.stdout:9/384: fdatasync dd/d47/f5f 0 2024-09-19T06:40:33.866 INFO:tasks.workunit.client.1.smithi117.stdout:5/427: mkdir d17/d1b/d3a/d3c/d70/d94 0 2024-09-19T06:40:33.867 INFO:tasks.workunit.client.1.smithi117.stdout:9/409: stat d4/d8/l4c 0 2024-09-19T06:40:33.869 INFO:tasks.workunit.client.1.smithi117.stdout:4/562: dwrite d3/db/d20/d29/d39/d4f/f72 [4194304,4194304] 0 2024-09-19T06:40:33.869 INFO:tasks.workunit.client.0.smithi099.stdout:6/348: symlink d1/d5/d24/d2e/d41/d4e/d54/l71 0 2024-09-19T06:40:33.871 INFO:tasks.workunit.client.1.smithi117.stdout:7/407: chown d1/d4a/d81/l6b 203590 1 2024-09-19T06:40:33.872 INFO:tasks.workunit.client.0.smithi099.stdout:9/385: symlink dd/d47/d40/l7e 0 2024-09-19T06:40:33.875 INFO:tasks.workunit.client.1.smithi117.stdout:0/324: chown d11/d13/d14/f1d 6679607 1 2024-09-19T06:40:33.875 INFO:tasks.workunit.client.1.smithi117.stdout:2/380: getdents d0/d7/d29/d35/d3d/d72/d6b 0 2024-09-19T06:40:33.875 INFO:tasks.workunit.client.1.smithi117.stdout:9/410: chown d4/d1c/d46/f47 5197107 1 2024-09-19T06:40:33.876 INFO:tasks.workunit.client.0.smithi099.stdout:6/349: creat d1/f72 x:0 0 0 2024-09-19T06:40:33.876 INFO:tasks.workunit.client.1.smithi117.stdout:4/563: write d3/db/f47 [4248627,90128] 0 2024-09-19T06:40:33.877 INFO:tasks.workunit.client.0.smithi099.stdout:6/350: truncate d1/d5/f3a 5070914 0 2024-09-19T06:40:33.878 INFO:tasks.workunit.client.1.smithi117.stdout:7/408: symlink d1/d72/l8c 0 2024-09-19T06:40:33.878 INFO:tasks.workunit.client.0.smithi099.stdout:9/386: symlink dd/d47/d40/d61/l7f 0 2024-09-19T06:40:33.879 INFO:tasks.workunit.client.1.smithi117.stdout:7/409: readlink d1/d4a/d81/d24/d1c/l2b 0 2024-09-19T06:40:33.880 INFO:tasks.workunit.client.0.smithi099.stdout:6/351: unlink d1/d5/f42 0 2024-09-19T06:40:33.882 INFO:tasks.workunit.client.0.smithi099.stdout:9/387: symlink dd/d62/d78/l80 0 2024-09-19T06:40:33.884 INFO:tasks.workunit.client.1.smithi117.stdout:9/411: chown d4/f33 0 1 2024-09-19T06:40:33.885 INFO:tasks.workunit.client.0.smithi099.stdout:9/388: mknod dd/d2c/d5c/d64/c81 0 2024-09-19T06:40:33.885 INFO:tasks.workunit.client.0.smithi099.stdout:9/389: dread - dd/d65/f75 zero size 2024-09-19T06:40:33.887 INFO:tasks.workunit.client.1.smithi117.stdout:0/325: dread d11/d13/d14/d2c/d35/d3e/f52 [0,4194304] 0 2024-09-19T06:40:33.888 INFO:tasks.workunit.client.1.smithi117.stdout:5/428: creat d17/f95 x:0 0 0 2024-09-19T06:40:33.889 INFO:tasks.workunit.client.0.smithi099.stdout:9/390: rename dd/d65/f67 to dd/d2c/d5c/d64/f82 0 2024-09-19T06:40:33.890 INFO:tasks.workunit.client.1.smithi117.stdout:6/289: getdents d1/d5 0 2024-09-19T06:40:33.890 INFO:tasks.workunit.client.1.smithi117.stdout:7/410: dwrite d1/d4a/f7b [0,4194304] 0 2024-09-19T06:40:33.890 INFO:tasks.workunit.client.0.smithi099.stdout:9/391: dread - dd/d2c/f39 zero size 2024-09-19T06:40:33.890 INFO:tasks.workunit.client.1.smithi117.stdout:1/360: rename d3/l6 to d3/l78 0 2024-09-19T06:40:33.893 INFO:tasks.workunit.client.1.smithi117.stdout:5/429: rmdir d17/d1b 39 2024-09-19T06:40:33.895 INFO:tasks.workunit.client.1.smithi117.stdout:0/326: write d11/d13/d14/d2c/f32 [1145590,94280] 0 2024-09-19T06:40:33.896 INFO:tasks.workunit.client.1.smithi117.stdout:5/430: truncate d17/f41 4465904 0 2024-09-19T06:40:33.898 INFO:tasks.workunit.client.1.smithi117.stdout:9/412: dwrite d4/d1c/f1f [8388608,4194304] 0 2024-09-19T06:40:33.898 INFO:tasks.workunit.client.1.smithi117.stdout:7/411: dread d1/d4a/d81/f16 [0,4194304] 0 2024-09-19T06:40:33.898 INFO:tasks.workunit.client.0.smithi099.stdout:9/392: dwrite dd/f44 [0,4194304] 0 2024-09-19T06:40:33.899 INFO:tasks.workunit.client.1.smithi117.stdout:1/361: creat d3/d18/d23/d51/f79 x:0 0 0 2024-09-19T06:40:33.901 INFO:tasks.workunit.client.1.smithi117.stdout:2/381: getdents d0 0 2024-09-19T06:40:33.901 INFO:tasks.workunit.client.1.smithi117.stdout:0/327: dread d11/d13/d14/f1d [0,4194304] 0 2024-09-19T06:40:33.901 INFO:tasks.workunit.client.1.smithi117.stdout:2/382: fdatasync d0/f2b 0 2024-09-19T06:40:33.902 INFO:tasks.workunit.client.1.smithi117.stdout:6/290: mknod d1/d3d/c48 0 2024-09-19T06:40:33.903 INFO:tasks.workunit.client.0.smithi099.stdout:6/352: dwrite d1/d5/d24/d2e/d41/f5a [0,4194304] 0 2024-09-19T06:40:33.903 INFO:tasks.workunit.client.1.smithi117.stdout:0/328: dread - d11/d13/d1b/d27/f60 zero size 2024-09-19T06:40:33.904 INFO:tasks.workunit.client.1.smithi117.stdout:8/469: sync 2024-09-19T06:40:33.904 INFO:tasks.workunit.client.1.smithi117.stdout:3/458: sync 2024-09-19T06:40:33.905 INFO:tasks.workunit.client.1.smithi117.stdout:3/459: write d0/d19/f38 [503455,45499] 0 2024-09-19T06:40:33.905 INFO:tasks.workunit.client.1.smithi117.stdout:8/470: truncate d1d/d1e/d53/f82 831328 0 2024-09-19T06:40:33.907 INFO:tasks.workunit.client.1.smithi117.stdout:8/471: chown d1d/d1e/d53/d6e/c80 5 1 2024-09-19T06:40:33.911 INFO:tasks.workunit.client.1.smithi117.stdout:7/412: mkdir d1/d4a/d81/d8d 0 2024-09-19T06:40:33.912 INFO:tasks.workunit.client.1.smithi117.stdout:4/564: truncate d3/d1b/f62 2671581 0 2024-09-19T06:40:33.912 INFO:tasks.workunit.client.0.smithi099.stdout:6/353: symlink d1/d5/l73 0 2024-09-19T06:40:33.915 INFO:tasks.workunit.client.0.smithi099.stdout:6/354: read d1/f35 [267645,26476] 0 2024-09-19T06:40:33.916 INFO:tasks.workunit.client.1.smithi117.stdout:2/383: creat d0/d12/d32/d7d/f90 x:0 0 0 2024-09-19T06:40:33.916 INFO:tasks.workunit.client.0.smithi099.stdout:9/393: dwrite dd/f6a [0,4194304] 0 2024-09-19T06:40:33.916 INFO:tasks.workunit.client.0.smithi099.stdout:9/394: chown dd/f5d 23521827 1 2024-09-19T06:40:33.918 INFO:tasks.workunit.client.1.smithi117.stdout:0/329: mknod d11/d13/d14/d2c/d35/d3e/c66 0 2024-09-19T06:40:33.919 INFO:tasks.workunit.client.1.smithi117.stdout:4/565: read d3/db/ff [7410187,98395] 0 2024-09-19T06:40:33.919 INFO:tasks.workunit.client.1.smithi117.stdout:0/330: fsync d11/d13/d1b/d27/d37/f58 0 2024-09-19T06:40:33.920 INFO:tasks.workunit.client.0.smithi099.stdout:9/395: readlink l0 0 2024-09-19T06:40:33.920 INFO:tasks.workunit.client.1.smithi117.stdout:3/460: rename d0/d9/l11 to d0/d8/d7f/l8a 0 2024-09-19T06:40:33.920 INFO:tasks.workunit.client.0.smithi099.stdout:9/396: dread - dd/f5b zero size 2024-09-19T06:40:33.921 INFO:tasks.workunit.client.0.smithi099.stdout:6/355: creat d1/d5/d24/d2b/f74 x:0 0 0 2024-09-19T06:40:33.922 INFO:tasks.workunit.client.1.smithi117.stdout:5/431: symlink d17/d1b/d3a/d3c/d70/l96 0 2024-09-19T06:40:33.923 INFO:tasks.workunit.client.1.smithi117.stdout:7/413: fsync d1/d4a/d81/f1a 0 2024-09-19T06:40:33.923 INFO:tasks.workunit.client.0.smithi099.stdout:9/397: write dd/d2c/f5a [675297,71523] 0 2024-09-19T06:40:33.924 INFO:tasks.workunit.client.1.smithi117.stdout:2/384: chown d0/d7/c21 2875788 1 2024-09-19T06:40:33.925 INFO:tasks.workunit.client.1.smithi117.stdout:6/291: symlink d1/d5/d8/l49 0 2024-09-19T06:40:33.927 INFO:tasks.workunit.client.1.smithi117.stdout:0/331: mkdir d11/d13/d1b/d67 0 2024-09-19T06:40:33.927 INFO:tasks.workunit.client.0.smithi099.stdout:9/398: rename dd/d47/d40/f5e to dd/d47/f83 0 2024-09-19T06:40:33.928 INFO:tasks.workunit.client.1.smithi117.stdout:4/566: symlink d3/d1b/d7d/d51/d95/lc1 0 2024-09-19T06:40:33.928 INFO:tasks.workunit.client.0.smithi099.stdout:9/399: chown dd/d47/d40/l42 60038308 1 2024-09-19T06:40:33.929 INFO:tasks.workunit.client.0.smithi099.stdout:9/400: fdatasync dd/f70 0 2024-09-19T06:40:33.929 INFO:tasks.workunit.client.1.smithi117.stdout:2/385: write d0/d12/d32/f63 [3270915,24992] 0 2024-09-19T06:40:33.930 INFO:tasks.workunit.client.0.smithi099.stdout:9/401: readlink dd/l2b 0 2024-09-19T06:40:33.931 INFO:tasks.workunit.client.1.smithi117.stdout:7/414: creat d1/d4a/d81/f8e x:0 0 0 2024-09-19T06:40:33.932 INFO:tasks.workunit.client.0.smithi099.stdout:9/402: write dd/d2c/f54 [58941,34476] 0 2024-09-19T06:40:33.932 INFO:tasks.workunit.client.1.smithi117.stdout:3/461: getdents d0/d8/d64 0 2024-09-19T06:40:33.933 INFO:tasks.workunit.client.1.smithi117.stdout:5/432: dwrite d17/d1b/d3a/d3c/f3d [4194304,4194304] 0 2024-09-19T06:40:33.934 INFO:tasks.workunit.client.1.smithi117.stdout:4/567: rmdir d3/db/d20 39 2024-09-19T06:40:33.935 INFO:tasks.workunit.client.0.smithi099.stdout:5/487: sync 2024-09-19T06:40:33.936 INFO:tasks.workunit.client.1.smithi117.stdout:8/472: getdents d1d/d1e/d53/d6e 0 2024-09-19T06:40:33.937 INFO:tasks.workunit.client.1.smithi117.stdout:6/292: mknod d1/d5/d8/c4a 0 2024-09-19T06:40:33.938 INFO:tasks.workunit.client.1.smithi117.stdout:0/332: creat d11/d13/d1b/d4b/f68 x:0 0 0 2024-09-19T06:40:33.939 INFO:tasks.workunit.client.1.smithi117.stdout:7/415: mknod d1/d4a/d81/d24/c8f 0 2024-09-19T06:40:33.939 INFO:tasks.workunit.client.1.smithi117.stdout:3/462: dread d0/f12 [0,4194304] 0 2024-09-19T06:40:33.940 INFO:tasks.workunit.client.1.smithi117.stdout:2/386: creat d0/d7/d1e/d20/d3e/f91 x:0 0 0 2024-09-19T06:40:33.941 INFO:tasks.workunit.client.1.smithi117.stdout:5/433: creat d17/d1b/d3a/d3c/d46/f97 x:0 0 0 2024-09-19T06:40:33.941 INFO:tasks.workunit.client.0.smithi099.stdout:5/488: getdents d3/d16/d2f/d8c 0 2024-09-19T06:40:33.944 INFO:tasks.workunit.client.1.smithi117.stdout:8/473: symlink d1d/d2a/d3f/d4b/d5f/d95/la4 0 2024-09-19T06:40:33.945 INFO:tasks.workunit.client.1.smithi117.stdout:6/293: rename d1/f18 to d1/d3/f4b 0 2024-09-19T06:40:33.946 INFO:tasks.workunit.client.1.smithi117.stdout:7/416: mknod d1/d4a/d81/c90 0 2024-09-19T06:40:33.947 INFO:tasks.workunit.client.1.smithi117.stdout:4/568: dread f1 [0,4194304] 0 2024-09-19T06:40:33.947 INFO:tasks.workunit.client.1.smithi117.stdout:1/362: dread d3/f5 [0,4194304] 0 2024-09-19T06:40:33.948 INFO:tasks.workunit.client.0.smithi099.stdout:5/489: dwrite d3/d7/f3b [0,4194304] 0 2024-09-19T06:40:33.948 INFO:tasks.workunit.client.1.smithi117.stdout:6/294: chown d1/d5/d8/d27/l2a 7886322 1 2024-09-19T06:40:33.949 INFO:tasks.workunit.client.1.smithi117.stdout:5/434: creat d17/d2e/d55/f98 x:0 0 0 2024-09-19T06:40:33.950 INFO:tasks.workunit.client.1.smithi117.stdout:7/417: fsync d1/d4a/d81/d24/d26/f2f 0 2024-09-19T06:40:33.951 INFO:tasks.workunit.client.1.smithi117.stdout:1/363: write d3/d18/d23/f34 [1140688,24481] 0 2024-09-19T06:40:33.952 INFO:tasks.workunit.client.1.smithi117.stdout:9/413: dread d4/d1c/f35 [0,4194304] 0 2024-09-19T06:40:33.955 INFO:tasks.workunit.client.1.smithi117.stdout:8/474: write d1d/d1e/f1f [1274519,115681] 0 2024-09-19T06:40:33.956 INFO:tasks.workunit.client.1.smithi117.stdout:6/295: dread d1/f3c [0,4194304] 0 2024-09-19T06:40:33.959 INFO:tasks.workunit.client.1.smithi117.stdout:5/435: mknod d17/d5c/c99 0 2024-09-19T06:40:33.959 INFO:tasks.workunit.client.0.smithi099.stdout:9/403: dread dd/d2c/f49 [0,4194304] 0 2024-09-19T06:40:33.960 INFO:tasks.workunit.client.0.smithi099.stdout:9/404: fdatasync dd/d47/f38 0 2024-09-19T06:40:33.961 INFO:tasks.workunit.client.1.smithi117.stdout:2/387: creat d0/d7/d7f/d8d/f92 x:0 0 0 2024-09-19T06:40:33.962 INFO:tasks.workunit.client.0.smithi099.stdout:9/405: write dd/f60 [5939500,56440] 0 2024-09-19T06:40:33.962 INFO:tasks.workunit.client.1.smithi117.stdout:6/296: chown d1/d5/d8/l49 188 1 2024-09-19T06:40:33.963 INFO:tasks.workunit.client.1.smithi117.stdout:0/333: creat d11/d13/d28/d38/d5b/f69 x:0 0 0 2024-09-19T06:40:33.964 INFO:tasks.workunit.client.1.smithi117.stdout:7/418: dwrite d1/d4a/d81/d24/d26/d44/f78 [0,4194304] 0 2024-09-19T06:40:33.964 INFO:tasks.workunit.client.1.smithi117.stdout:8/475: dread - d1d/d1e/d53/d6e/f92 zero size 2024-09-19T06:40:33.966 INFO:tasks.workunit.client.1.smithi117.stdout:5/436: write d17/f74 [1824591,47892] 0 2024-09-19T06:40:33.968 INFO:tasks.workunit.client.0.smithi099.stdout:9/406: link lc dd/d62/l84 0 2024-09-19T06:40:33.971 INFO:tasks.workunit.client.1.smithi117.stdout:9/414: chown d4/d20/f53 2520 1 2024-09-19T06:40:33.974 INFO:tasks.workunit.client.1.smithi117.stdout:2/388: read d0/d12/f78 [3263944,6045] 0 2024-09-19T06:40:33.975 INFO:tasks.workunit.client.0.smithi099.stdout:9/407: truncate dd/d47/d40/f11 1246529 0 2024-09-19T06:40:33.975 INFO:tasks.workunit.client.1.smithi117.stdout:3/463: getdents d0/d9/d4e 0 2024-09-19T06:40:33.978 INFO:tasks.workunit.client.1.smithi117.stdout:1/364: rename d3/f14 to d3/d18/f7a 0 2024-09-19T06:40:33.979 INFO:tasks.workunit.client.1.smithi117.stdout:9/415: symlink d4/d1c/d5f/l8b 0 2024-09-19T06:40:33.980 INFO:tasks.workunit.client.1.smithi117.stdout:7/419: rmdir d1/d4a/d81/d24/d1c 39 2024-09-19T06:40:33.981 INFO:tasks.workunit.client.1.smithi117.stdout:6/297: dwrite d1/d5/d8/d27/f44 [0,4194304] 0 2024-09-19T06:40:33.982 INFO:tasks.workunit.client.1.smithi117.stdout:5/437: mknod d17/d2f/d3b/c9a 0 2024-09-19T06:40:33.984 INFO:tasks.workunit.client.1.smithi117.stdout:2/389: symlink d0/d7/d1e/d20/l93 0 2024-09-19T06:40:33.985 INFO:tasks.workunit.client.1.smithi117.stdout:9/416: fdatasync d4/d8/fe 0 2024-09-19T06:40:33.987 INFO:tasks.workunit.client.1.smithi117.stdout:4/569: dread d3/db/d23/f57 [0,4194304] 0 2024-09-19T06:40:33.988 INFO:tasks.workunit.client.0.smithi099.stdout:9/408: write dd/d47/d40/f3f [363521,72582] 0 2024-09-19T06:40:33.989 INFO:tasks.workunit.client.1.smithi117.stdout:9/417: write d4/d1c/d7a/d16/f26 [339919,62352] 0 2024-09-19T06:40:33.989 INFO:tasks.workunit.client.1.smithi117.stdout:3/464: rename d0/d8/f85 to d0/d8/f8b 0 2024-09-19T06:40:33.990 INFO:tasks.workunit.client.1.smithi117.stdout:8/476: dwrite d1d/d2a/d3f/d4b/d5f/d95/f78 [0,4194304] 0 2024-09-19T06:40:33.991 INFO:tasks.workunit.client.0.smithi099.stdout:9/409: mkdir dd/d2c/d5c/d85 0 2024-09-19T06:40:33.992 INFO:tasks.workunit.client.1.smithi117.stdout:3/465: write d0/d9/fd [1177951,67122] 0 2024-09-19T06:40:33.993 INFO:tasks.workunit.client.1.smithi117.stdout:6/298: creat d1/d14/f4c x:0 0 0 2024-09-19T06:40:33.994 INFO:tasks.workunit.client.1.smithi117.stdout:3/466: chown d0/d24/f5c 13 1 2024-09-19T06:40:33.994 INFO:tasks.workunit.client.1.smithi117.stdout:1/365: mknod d3/d22/c7b 0 2024-09-19T06:40:33.994 INFO:tasks.workunit.client.1.smithi117.stdout:6/299: chown d1/d3/fd 20061022 1 2024-09-19T06:40:33.996 INFO:tasks.workunit.client.1.smithi117.stdout:0/334: rename d11/d13/d28/d38/d5b/f69 to d11/d13/d14/d2c/f6a 0 2024-09-19T06:40:33.997 INFO:tasks.workunit.client.0.smithi099.stdout:9/410: link dd/d47/d40/l7e dd/d62/d76/l86 0 2024-09-19T06:40:33.998 INFO:tasks.workunit.client.1.smithi117.stdout:9/418: symlink d4/d1c/d5f/l8c 0 2024-09-19T06:40:34.001 INFO:tasks.workunit.client.1.smithi117.stdout:6/300: unlink d1/d3/c3b 0 2024-09-19T06:40:34.001 INFO:tasks.workunit.client.1.smithi117.stdout:8/477: write d1d/d1e/d29/f89 [381938,73923] 0 2024-09-19T06:40:34.002 INFO:tasks.workunit.client.0.smithi099.stdout:9/411: rename dd/c57 to dd/d47/d40/c87 0 2024-09-19T06:40:34.004 INFO:tasks.workunit.client.0.smithi099.stdout:9/412: chown dd/d62/l84 0 1 2024-09-19T06:40:34.004 INFO:tasks.workunit.client.1.smithi117.stdout:3/467: dwrite d0/f5e [4194304,4194304] 0 2024-09-19T06:40:34.005 INFO:tasks.workunit.client.0.smithi099.stdout:9/413: truncate dd/d2c/f5a 828241 0 2024-09-19T06:40:34.006 INFO:tasks.workunit.client.1.smithi117.stdout:2/390: rename d0/f5e to d0/d64/f94 0 2024-09-19T06:40:34.007 INFO:tasks.workunit.client.1.smithi117.stdout:9/419: mkdir d4/d1c/d7a/d52/d8d 0 2024-09-19T06:40:34.009 INFO:tasks.workunit.client.1.smithi117.stdout:6/301: creat d1/d5/d32/d45/f4d x:0 0 0 2024-09-19T06:40:34.011 INFO:tasks.workunit.client.1.smithi117.stdout:9/420: dread d4/f7f [0,4194304] 0 2024-09-19T06:40:34.012 INFO:tasks.workunit.client.1.smithi117.stdout:3/468: creat d0/d19/d2b/f8c x:0 0 0 2024-09-19T06:40:34.015 INFO:tasks.workunit.client.1.smithi117.stdout:2/391: symlink d0/d7/d1e/l95 0 2024-09-19T06:40:34.016 INFO:tasks.workunit.client.1.smithi117.stdout:7/420: truncate d1/d4a/d81/f47 457258 0 2024-09-19T06:40:34.016 INFO:tasks.workunit.client.1.smithi117.stdout:8/478: mkdir d1d/d1e/da5 0 2024-09-19T06:40:34.019 INFO:tasks.workunit.client.1.smithi117.stdout:7/421: dread - d1/d4a/d81/d48/d5f/f7f zero size 2024-09-19T06:40:34.019 INFO:tasks.workunit.client.1.smithi117.stdout:0/335: creat d11/d13/d14/f6b x:0 0 0 2024-09-19T06:40:34.020 INFO:tasks.workunit.client.1.smithi117.stdout:6/302: rmdir d1/d5/d8 39 2024-09-19T06:40:34.021 INFO:tasks.workunit.client.1.smithi117.stdout:1/366: dwrite d3/d18/f48 [0,4194304] 0 2024-09-19T06:40:34.024 INFO:tasks.workunit.client.1.smithi117.stdout:5/438: rename d17/d2e/d55/l7c to d17/d2f/l9b 0 2024-09-19T06:40:34.025 INFO:tasks.workunit.client.1.smithi117.stdout:2/392: creat d0/d7/d29/d35/d61/d65/f96 x:0 0 0 2024-09-19T06:40:34.029 INFO:tasks.workunit.client.1.smithi117.stdout:4/570: dread d3/d4/d5f/f7f [0,4194304] 0 2024-09-19T06:40:34.032 INFO:tasks.workunit.client.1.smithi117.stdout:5/439: symlink d17/d5c/l9c 0 2024-09-19T06:40:34.055 INFO:tasks.workunit.client.1.smithi117.stdout:5/440: readlink d17/d2f/d3b/l5b 0 2024-09-19T06:40:34.055 INFO:tasks.workunit.client.1.smithi117.stdout:3/469: dwrite d0/d8/d7f/f7a [0,4194304] 0 2024-09-19T06:40:34.057 INFO:tasks.workunit.client.1.smithi117.stdout:5/441: fsync d17/d1b/f48 0 2024-09-19T06:40:34.057 INFO:tasks.workunit.client.1.smithi117.stdout:9/421: truncate d4/d8/fb 1606247 0 2024-09-19T06:40:34.057 INFO:tasks.workunit.client.1.smithi117.stdout:7/422: rename d1/d4a/d81/d24/d1c/d35/d4f/f5b to d1/d4a/d81/d48/d5f/f91 0 2024-09-19T06:40:34.060 INFO:tasks.workunit.client.1.smithi117.stdout:9/422: truncate d4/d1c/f28 5288854 0 2024-09-19T06:40:34.060 INFO:tasks.workunit.client.1.smithi117.stdout:1/367: creat d3/d22/f7c x:0 0 0 2024-09-19T06:40:34.061 INFO:tasks.workunit.client.1.smithi117.stdout:4/571: symlink d3/db/d20/d29/d39/lc2 0 2024-09-19T06:40:34.062 INFO:tasks.workunit.client.1.smithi117.stdout:7/423: mkdir d1/d3f/d92 0 2024-09-19T06:40:34.064 INFO:tasks.workunit.client.1.smithi117.stdout:8/479: getdents d1d/d31 0 2024-09-19T06:40:34.064 INFO:tasks.workunit.client.1.smithi117.stdout:2/393: creat d0/d7/d29/d35/f97 x:0 0 0 2024-09-19T06:40:34.066 INFO:tasks.workunit.client.1.smithi117.stdout:4/572: symlink d3/d1b/d63/lc3 0 2024-09-19T06:40:34.067 INFO:tasks.workunit.client.1.smithi117.stdout:7/424: mknod d1/d4a/d81/c93 0 2024-09-19T06:40:34.068 INFO:tasks.workunit.client.1.smithi117.stdout:3/470: dwrite d0/f63 [0,4194304] 0 2024-09-19T06:40:34.068 INFO:tasks.workunit.client.1.smithi117.stdout:5/442: rename d17/f95 to d17/f9d 0 2024-09-19T06:40:34.070 INFO:tasks.workunit.client.1.smithi117.stdout:2/394: truncate d0/f9 3293285 0 2024-09-19T06:40:34.070 INFO:tasks.workunit.client.1.smithi117.stdout:7/425: fdatasync d1/d4a/d77/f86 0 2024-09-19T06:40:34.072 INFO:tasks.workunit.client.1.smithi117.stdout:4/573: chown d3/d65/f75 10307841 1 2024-09-19T06:40:34.072 INFO:tasks.workunit.client.1.smithi117.stdout:1/368: creat d3/d22/f7d x:0 0 0 2024-09-19T06:40:34.074 INFO:tasks.workunit.client.1.smithi117.stdout:5/443: write d17/d1b/f48 [3721681,116963] 0 2024-09-19T06:40:34.078 INFO:tasks.workunit.client.1.smithi117.stdout:9/423: dwrite d4/d8/d6e/f6f [0,4194304] 0 2024-09-19T06:40:34.086 INFO:tasks.workunit.client.1.smithi117.stdout:1/369: symlink d3/d18/l7e 0 2024-09-19T06:40:34.091 INFO:tasks.workunit.client.1.smithi117.stdout:8/480: dwrite d1d/d1e/f1f [0,4194304] 0 2024-09-19T06:40:34.092 INFO:tasks.workunit.client.1.smithi117.stdout:7/426: rename d1/d4a/d81/d24/d26/d44/f78 to d1/d4a/d81/d48/d5f/d82/f94 0 2024-09-19T06:40:34.092 INFO:tasks.workunit.client.1.smithi117.stdout:9/424: creat d4/d58/f8e x:0 0 0 2024-09-19T06:40:34.095 INFO:tasks.workunit.client.1.smithi117.stdout:3/471: dwrite d0/f14 [4194304,4194304] 0 2024-09-19T06:40:34.096 INFO:tasks.workunit.client.1.smithi117.stdout:1/370: read - d3/d18/d23/f66 zero size 2024-09-19T06:40:34.099 INFO:tasks.workunit.client.1.smithi117.stdout:9/425: fsync d4/d1c/d54/f5a 0 2024-09-19T06:40:34.101 INFO:tasks.workunit.client.1.smithi117.stdout:8/481: chown d1d/d2a/d3f/f72 28170 1 2024-09-19T06:40:34.102 INFO:tasks.workunit.client.1.smithi117.stdout:2/395: dwrite d0/d12/d32/f63 [0,4194304] 0 2024-09-19T06:40:34.102 INFO:tasks.workunit.client.1.smithi117.stdout:5/444: dwrite d17/d5c/f90 [0,4194304] 0 2024-09-19T06:40:34.103 INFO:tasks.workunit.client.1.smithi117.stdout:3/472: creat d0/d24/f8d x:0 0 0 2024-09-19T06:40:34.103 INFO:tasks.workunit.client.1.smithi117.stdout:4/574: dwrite d3/db/d20/d29/d39/f6c [8388608,4194304] 0 2024-09-19T06:40:34.106 INFO:tasks.workunit.client.1.smithi117.stdout:7/427: write d1/d4a/d81/f1a [1303000,100082] 0 2024-09-19T06:40:34.107 INFO:tasks.workunit.client.1.smithi117.stdout:1/371: rename d3/f1b to d3/d18/d23/f7f 0 2024-09-19T06:40:34.107 INFO:tasks.workunit.client.1.smithi117.stdout:8/482: rmdir d1d/d31 39 2024-09-19T06:40:34.108 INFO:tasks.workunit.client.1.smithi117.stdout:1/372: readlink l2 0 2024-09-19T06:40:34.109 INFO:tasks.workunit.client.1.smithi117.stdout:5/445: write d17/d1b/d3a/f68 [46102,70965] 0 2024-09-19T06:40:34.109 INFO:tasks.workunit.client.1.smithi117.stdout:1/373: stat d3/d18/d56/c44 0 2024-09-19T06:40:34.111 INFO:tasks.workunit.client.1.smithi117.stdout:7/428: chown d1/d4a/d81/d24/d26/l5a 539 1 2024-09-19T06:40:34.111 INFO:tasks.workunit.client.1.smithi117.stdout:4/575: chown d3/d1b/d63/fa1 5247201 1 2024-09-19T06:40:34.112 INFO:tasks.workunit.client.1.smithi117.stdout:1/374: dread - d3/d18/d23/f65 zero size 2024-09-19T06:40:34.117 INFO:tasks.workunit.client.1.smithi117.stdout:1/375: creat d3/d18/d23/d51/f80 x:0 0 0 2024-09-19T06:40:34.117 INFO:tasks.workunit.client.1.smithi117.stdout:1/376: readlink d3/lb 0 2024-09-19T06:40:34.119 INFO:tasks.workunit.client.1.smithi117.stdout:7/429: mkdir d1/d4a/d7c/d95 0 2024-09-19T06:40:34.120 INFO:tasks.workunit.client.1.smithi117.stdout:3/473: getdents d0 0 2024-09-19T06:40:34.121 INFO:tasks.workunit.client.1.smithi117.stdout:2/396: getdents d0/d6f 0 2024-09-19T06:40:34.122 INFO:tasks.workunit.client.1.smithi117.stdout:1/377: rmdir d3/d18/d23/d74 39 2024-09-19T06:40:34.124 INFO:tasks.workunit.client.1.smithi117.stdout:9/426: dwrite d4/d1c/d36/d37/f42 [0,4194304] 0 2024-09-19T06:40:34.124 INFO:tasks.workunit.client.1.smithi117.stdout:2/397: chown d0/d7/d7f/d8d 358655 1 2024-09-19T06:40:34.124 INFO:tasks.workunit.client.1.smithi117.stdout:7/430: write d1/f4c [220005,87573] 0 2024-09-19T06:40:34.125 INFO:tasks.workunit.client.1.smithi117.stdout:1/378: chown d3/f38 0 1 2024-09-19T06:40:34.126 INFO:tasks.workunit.client.1.smithi117.stdout:4/576: dwrite d3/f90 [0,4194304] 0 2024-09-19T06:40:34.128 INFO:tasks.workunit.client.1.smithi117.stdout:2/398: mkdir d0/d12/d2f/d98 0 2024-09-19T06:40:34.129 INFO:tasks.workunit.client.1.smithi117.stdout:1/379: truncate d3/d22/f2a 2245401 0 2024-09-19T06:40:34.129 INFO:tasks.workunit.client.1.smithi117.stdout:3/474: getdents d0/d3d/d48/d77/d81 0 2024-09-19T06:40:34.130 INFO:tasks.workunit.client.0.smithi099.stdout:0/290: sync 2024-09-19T06:40:34.131 INFO:tasks.workunit.client.0.smithi099.stdout:1/266: sync 2024-09-19T06:40:34.132 INFO:tasks.workunit.client.1.smithi117.stdout:4/577: rmdir d3 39 2024-09-19T06:40:34.133 INFO:tasks.workunit.client.0.smithi099.stdout:0/291: read d0/d17/d41/f3d [2120883,6436] 0 2024-09-19T06:40:34.134 INFO:tasks.workunit.client.0.smithi099.stdout:1/267: mknod d0/d17/c57 0 2024-09-19T06:40:34.134 INFO:tasks.workunit.client.1.smithi117.stdout:2/399: write d0/d12/d32/f4f [51356,69022] 0 2024-09-19T06:40:34.136 INFO:tasks.workunit.client.1.smithi117.stdout:3/475: dread d0/d8/f89 [0,4194304] 0 2024-09-19T06:40:34.136 INFO:tasks.workunit.client.0.smithi099.stdout:1/268: dread - d0/db/f31 zero size 2024-09-19T06:40:34.138 INFO:tasks.workunit.client.1.smithi117.stdout:3/476: fsync d0/f1e 0 2024-09-19T06:40:34.138 INFO:tasks.workunit.client.0.smithi099.stdout:0/292: creat d0/f57 x:0 0 0 2024-09-19T06:40:34.143 INFO:tasks.workunit.client.1.smithi117.stdout:9/427: rmdir d4/d8/d6a/d84 0 2024-09-19T06:40:34.143 INFO:tasks.workunit.client.1.smithi117.stdout:3/477: fsync d0/f14 0 2024-09-19T06:40:34.143 INFO:tasks.workunit.client.1.smithi117.stdout:8/483: dread d1d/d1e/d29/f2e [0,4194304] 0 2024-09-19T06:40:34.143 INFO:tasks.workunit.client.0.smithi099.stdout:1/269: dwrite d0/f29 [4194304,4194304] 0 2024-09-19T06:40:34.144 INFO:tasks.workunit.client.1.smithi117.stdout:2/400: fdatasync d0/d12/f3c 0 2024-09-19T06:40:34.145 INFO:tasks.workunit.client.1.smithi117.stdout:4/578: write d3/db/d13/f3c [2645978,9796] 0 2024-09-19T06:40:34.146 INFO:tasks.workunit.client.1.smithi117.stdout:5/446: dread d17/d1b/f48 [0,4194304] 0 2024-09-19T06:40:34.146 INFO:tasks.workunit.client.0.smithi099.stdout:1/270: mkdir d0/d17/d24/d3a/d58 0 2024-09-19T06:40:34.150 INFO:tasks.workunit.client.1.smithi117.stdout:5/447: write d17/d2e/d55/f6e [294347,53217] 0 2024-09-19T06:40:34.152 INFO:tasks.workunit.client.1.smithi117.stdout:8/484: creat d1d/d31/d83/fa6 x:0 0 0 2024-09-19T06:40:34.153 INFO:tasks.workunit.client.0.smithi099.stdout:1/271: rename d0/db/ce to d0/db/c59 0 2024-09-19T06:40:34.155 INFO:tasks.workunit.client.1.smithi117.stdout:1/380: truncate d3/d18/d23/f34 513861 0 2024-09-19T06:40:34.156 INFO:tasks.workunit.client.1.smithi117.stdout:4/579: symlink d3/d1b/lc4 0 2024-09-19T06:40:34.157 INFO:tasks.workunit.client.1.smithi117.stdout:3/478: dread d0/d24/f5c [0,4194304] 0 2024-09-19T06:40:34.158 INFO:tasks.workunit.client.1.smithi117.stdout:8/485: creat d1d/d31/fa7 x:0 0 0 2024-09-19T06:40:34.159 INFO:tasks.workunit.client.1.smithi117.stdout:8/486: stat f1a 0 2024-09-19T06:40:34.159 INFO:tasks.workunit.client.1.smithi117.stdout:1/381: chown d3/d18/d23/f70 329086807 1 2024-09-19T06:40:34.159 INFO:tasks.workunit.client.1.smithi117.stdout:9/428: dwrite d4/d1c/d36/f7d [0,4194304] 0 2024-09-19T06:40:34.160 INFO:tasks.workunit.client.1.smithi117.stdout:2/401: rmdir d0/d7/d29/d35/d3d/d72/d6b 0 2024-09-19T06:40:34.161 INFO:tasks.workunit.client.1.smithi117.stdout:4/580: mkdir d3/d65/d66/d80/dc5 0 2024-09-19T06:40:34.161 INFO:tasks.workunit.client.0.smithi099.stdout:1/272: dwrite d0/d12/d13/f22 [0,4194304] 0 2024-09-19T06:40:34.162 INFO:tasks.workunit.client.1.smithi117.stdout:9/429: read - d4/d1c/d7a/d52/f85 zero size 2024-09-19T06:40:34.163 INFO:tasks.workunit.client.1.smithi117.stdout:8/487: truncate d1d/d1e/d3b/f6c 514042 0 2024-09-19T06:40:34.164 INFO:tasks.workunit.client.1.smithi117.stdout:2/402: symlink d0/d7/d1e/l99 0 2024-09-19T06:40:34.164 INFO:tasks.workunit.client.1.smithi117.stdout:4/581: symlink d3/db/d20/d4a/lc6 0 2024-09-19T06:40:34.166 INFO:tasks.workunit.client.1.smithi117.stdout:9/430: creat d4/d8/d6e/f8f x:0 0 0 2024-09-19T06:40:34.167 INFO:tasks.workunit.client.0.smithi099.stdout:1/273: getdents d0/d17/d32 0 2024-09-19T06:40:34.168 INFO:tasks.workunit.client.1.smithi117.stdout:1/382: symlink d3/d18/d23/l81 0 2024-09-19T06:40:34.171 INFO:tasks.workunit.client.0.smithi099.stdout:1/274: creat d0/d17/d32/f5a x:0 0 0 2024-09-19T06:40:34.171 INFO:tasks.workunit.client.1.smithi117.stdout:8/488: chown d1d/d2a/f76 3721224 1 2024-09-19T06:40:34.171 INFO:tasks.workunit.client.1.smithi117.stdout:4/582: chown d3/db/d20/f36 132 1 2024-09-19T06:40:34.171 INFO:tasks.workunit.client.1.smithi117.stdout:5/448: link d17/d1b/d3a/d3c/d70/l96 d17/d1b/d3a/d3c/d70/d94/l9e 0 2024-09-19T06:40:34.172 INFO:tasks.workunit.client.0.smithi099.stdout:0/293: dread d0/db/d13/d1f/f28 [0,4194304] 0 2024-09-19T06:40:34.173 INFO:tasks.workunit.client.1.smithi117.stdout:3/479: dwrite d0/d24/f8d [0,4194304] 0 2024-09-19T06:40:34.175 INFO:tasks.workunit.client.0.smithi099.stdout:0/294: creat d0/db/d27/f58 x:0 0 0 2024-09-19T06:40:34.175 INFO:tasks.workunit.client.1.smithi117.stdout:1/383: fdatasync d3/f38 0 2024-09-19T06:40:34.177 INFO:tasks.workunit.client.1.smithi117.stdout:5/449: creat d17/d2f/d6a/f9f x:0 0 0 2024-09-19T06:40:34.177 INFO:tasks.workunit.client.1.smithi117.stdout:1/384: chown d3/d18/f3f 1008615 1 2024-09-19T06:40:34.178 INFO:tasks.workunit.client.0.smithi099.stdout:0/295: mkdir d0/db/d13/d59 0 2024-09-19T06:40:34.179 INFO:tasks.workunit.client.0.smithi099.stdout:1/275: getdents d0/d17/d24/d3a 0 2024-09-19T06:40:34.180 INFO:tasks.workunit.client.1.smithi117.stdout:2/403: rename d0/d7/d29/d35/d61/d8e to d0/d7/d7f/d8d/d9a 0 2024-09-19T06:40:34.182 INFO:tasks.workunit.client.1.smithi117.stdout:1/385: symlink d3/d18/d23/d51/l82 0 2024-09-19T06:40:34.186 INFO:tasks.workunit.client.1.smithi117.stdout:2/404: creat d0/d7/d29/d35/d3d/f9b x:0 0 0 2024-09-19T06:40:34.187 INFO:tasks.workunit.client.0.smithi099.stdout:0/296: dwrite d0/f11 [4194304,4194304] 0 2024-09-19T06:40:34.187 INFO:tasks.workunit.client.1.smithi117.stdout:3/480: dwrite d0/d24/f2c [4194304,4194304] 0 2024-09-19T06:40:34.190 INFO:tasks.workunit.client.1.smithi117.stdout:2/405: dread - d0/d12/d2f/f45 zero size 2024-09-19T06:40:34.191 INFO:tasks.workunit.client.1.smithi117.stdout:5/450: dwrite d17/d1b/f28 [0,4194304] 0 2024-09-19T06:40:34.192 INFO:tasks.workunit.client.1.smithi117.stdout:1/386: dread d3/d18/d23/f28 [0,4194304] 0 2024-09-19T06:40:34.193 INFO:tasks.workunit.client.1.smithi117.stdout:4/583: dwrite d3/db/d20/d29/d39/d4f/fac [0,4194304] 0 2024-09-19T06:40:34.195 INFO:tasks.workunit.client.1.smithi117.stdout:2/406: dread - d0/d7/d29/d35/d3d/f9b zero size 2024-09-19T06:40:34.196 INFO:tasks.workunit.client.1.smithi117.stdout:3/481: rename d0/d24 to d0/d19/d2b/d8e 0 2024-09-19T06:40:34.197 INFO:tasks.workunit.client.1.smithi117.stdout:5/451: creat d17/d1b/d3a/d3c/d46/fa0 x:0 0 0 2024-09-19T06:40:34.198 INFO:tasks.workunit.client.0.smithi099.stdout:0/297: dwrite d0/f57 [0,4194304] 0 2024-09-19T06:40:34.200 INFO:tasks.workunit.client.0.smithi099.stdout:0/298: write d0/d17/d41/f49 [723789,129960] 0 2024-09-19T06:40:34.200 INFO:tasks.workunit.client.1.smithi117.stdout:5/452: read - d17/d2e/d55/f98 zero size 2024-09-19T06:40:34.201 INFO:tasks.workunit.client.1.smithi117.stdout:4/584: write d3/db/d20/d29/d39/f6c [12402708,120334] 0 2024-09-19T06:40:34.201 INFO:tasks.workunit.client.1.smithi117.stdout:2/407: fsync d0/d7/d1e/d20/d3e/f91 0 2024-09-19T06:40:34.204 INFO:tasks.workunit.client.0.smithi099.stdout:0/299: creat d0/db/d13/d1f/f5a x:0 0 0 2024-09-19T06:40:34.205 INFO:tasks.workunit.client.1.smithi117.stdout:1/387: mknod d3/d18/d23/d74/c83 0 2024-09-19T06:40:34.207 INFO:tasks.workunit.client.1.smithi117.stdout:2/408: rename d0/d7/d1e/l95 to d0/l9c 0 2024-09-19T06:40:34.208 INFO:tasks.workunit.client.1.smithi117.stdout:1/388: chown d3/d22/d2f/l4a 3158 1 2024-09-19T06:40:34.209 INFO:tasks.workunit.client.1.smithi117.stdout:5/453: symlink d17/d1b/d3a/d3c/la1 0 2024-09-19T06:40:34.213 INFO:tasks.workunit.client.1.smithi117.stdout:4/585: dwrite d3/db/d20/fbe [0,4194304] 0 2024-09-19T06:40:34.213 INFO:tasks.workunit.client.1.smithi117.stdout:2/409: creat d0/d7/d7f/d8d/f9d x:0 0 0 2024-09-19T06:40:34.213 INFO:tasks.workunit.client.0.smithi099.stdout:0/300: dwrite d0/db/d13/d1f/f28 [0,4194304] 0 2024-09-19T06:40:34.215 INFO:tasks.workunit.client.1.smithi117.stdout:1/389: symlink d3/d22/l84 0 2024-09-19T06:40:34.216 INFO:tasks.workunit.client.0.smithi099.stdout:0/301: mkdir d0/db/d13/d1f/d39/d5b 0 2024-09-19T06:40:34.217 INFO:tasks.workunit.client.1.smithi117.stdout:4/586: fdatasync d3/d4/d5f/f7f 0 2024-09-19T06:40:34.218 INFO:tasks.workunit.client.0.smithi099.stdout:0/302: write d0/db/f46 [776970,71736] 0 2024-09-19T06:40:34.220 INFO:tasks.workunit.client.1.smithi117.stdout:1/390: creat d3/d18/d56/f85 x:0 0 0 2024-09-19T06:40:34.220 INFO:tasks.workunit.client.1.smithi117.stdout:8/489: dread d1d/d31/f36 [0,4194304] 0 2024-09-19T06:40:34.220 INFO:tasks.workunit.client.1.smithi117.stdout:5/454: dwrite d17/d2f/d3b/f78 [0,4194304] 0 2024-09-19T06:40:34.221 INFO:tasks.workunit.client.0.smithi099.stdout:0/303: fsync d0/db/d13/f20 0 2024-09-19T06:40:34.221 INFO:tasks.workunit.client.1.smithi117.stdout:4/587: mknod d3/d28/d2a/cc7 0 2024-09-19T06:40:34.222 INFO:tasks.workunit.client.1.smithi117.stdout:1/391: write d3/d22/f5f [633506,108456] 0 2024-09-19T06:40:34.223 INFO:tasks.workunit.client.1.smithi117.stdout:2/410: link d0/d7/d1e/d20/d3e/f91 d0/d7/d7f/d8d/f9e 0 2024-09-19T06:40:34.224 INFO:tasks.workunit.client.1.smithi117.stdout:1/392: read - d3/d18/d23/d51/f79 zero size 2024-09-19T06:40:34.226 INFO:tasks.workunit.client.0.smithi099.stdout:0/304: rename d0/db/d13/d37/l53 to d0/db/d27/l5c 0 2024-09-19T06:40:34.228 INFO:tasks.workunit.client.0.smithi099.stdout:0/305: mkdir d0/db/d27/d5d 0 2024-09-19T06:40:34.229 INFO:tasks.workunit.client.0.smithi099.stdout:0/306: mknod d0/db/d13/d1f/c5e 0 2024-09-19T06:40:34.230 INFO:tasks.workunit.client.0.smithi099.stdout:0/307: rmdir d0/d17 39 2024-09-19T06:40:34.230 INFO:tasks.workunit.client.0.smithi099.stdout:0/308: stat d0/db/f46 0 2024-09-19T06:40:34.231 INFO:tasks.workunit.client.0.smithi099.stdout:0/309: truncate d0/db/d13/f42 967408 0 2024-09-19T06:40:34.247 INFO:tasks.workunit.client.0.smithi099.stdout:4/331: sync 2024-09-19T06:40:34.248 INFO:tasks.workunit.client.0.smithi099.stdout:0/310: readlink d0/l18 0 2024-09-19T06:40:34.251 INFO:tasks.workunit.client.0.smithi099.stdout:4/332: readlink d12/d1b/l2b 0 2024-09-19T06:40:34.252 INFO:tasks.workunit.client.1.smithi117.stdout:1/393: creat d3/d18/d23/d51/f86 x:0 0 0 2024-09-19T06:40:34.253 INFO:tasks.workunit.client.0.smithi099.stdout:4/333: write d12/d32/d42/d5c/f5d [333607,2439] 0 2024-09-19T06:40:34.253 INFO:tasks.workunit.client.1.smithi117.stdout:1/394: stat d3/d18/d23/f66 0 2024-09-19T06:40:34.255 INFO:tasks.workunit.client.1.smithi117.stdout:4/588: rename d3/db/d23/c38 to d3/d1b/d63/d8e/cc8 0 2024-09-19T06:40:34.255 INFO:tasks.workunit.client.0.smithi099.stdout:4/334: symlink d12/d1b/l74 0 2024-09-19T06:40:34.259 INFO:tasks.workunit.client.1.smithi117.stdout:1/395: dwrite d3/f5c [0,4194304] 0 2024-09-19T06:40:34.261 INFO:tasks.workunit.client.1.smithi117.stdout:1/396: mknod d3/d18/c87 0 2024-09-19T06:40:34.262 INFO:tasks.workunit.client.1.smithi117.stdout:1/397: fsync d3/d22/f7c 0 2024-09-19T06:40:34.266 INFO:tasks.workunit.client.1.smithi117.stdout:1/398: creat d3/d22/f88 x:0 0 0 2024-09-19T06:40:34.266 INFO:tasks.workunit.client.0.smithi099.stdout:0/311: fdatasync d0/db/d13/d1f/f28 0 2024-09-19T06:40:34.269 INFO:tasks.workunit.client.1.smithi117.stdout:1/399: mkdir d3/d18/d23/d74/d89 0 2024-09-19T06:40:34.270 INFO:tasks.workunit.client.1.smithi117.stdout:1/400: symlink d3/d18/d56/l8a 0 2024-09-19T06:40:34.271 INFO:tasks.workunit.client.1.smithi117.stdout:1/401: fsync d3/d18/d23/d74/f75 0 2024-09-19T06:40:34.272 INFO:tasks.workunit.client.1.smithi117.stdout:2/411: getdents d0/d7/d7f/d8d 0 2024-09-19T06:40:34.274 INFO:tasks.workunit.client.1.smithi117.stdout:8/490: write d1d/d1e/f5c [190417,60349] 0 2024-09-19T06:40:34.274 INFO:tasks.workunit.client.0.smithi099.stdout:0/312: dwrite d0/db/d13/d1f/d4a/f50 [0,4194304] 0 2024-09-19T06:40:34.276 INFO:tasks.workunit.client.1.smithi117.stdout:1/402: read d3/d18/f3f [6576243,40262] 0 2024-09-19T06:40:34.276 INFO:tasks.workunit.client.0.smithi099.stdout:0/313: dread - d0/db/d13/d1f/d39/f4f zero size 2024-09-19T06:40:34.278 INFO:tasks.workunit.client.1.smithi117.stdout:2/412: link d0/d12/d32/f4b d0/d12/d32/f9f 0 2024-09-19T06:40:34.279 INFO:tasks.workunit.client.1.smithi117.stdout:8/491: symlink d1d/d2a/d3f/d4b/d66/la8 0 2024-09-19T06:40:34.280 INFO:tasks.workunit.client.0.smithi099.stdout:0/314: rename d0/f11 to d0/db/d36/f5f 0 2024-09-19T06:40:34.281 INFO:tasks.workunit.client.1.smithi117.stdout:1/403: rename d3/d22/d2f/f3d to d3/d18/d23/d51/f8b 0 2024-09-19T06:40:34.282 INFO:tasks.workunit.client.1.smithi117.stdout:2/413: unlink d0/d7/d1e/d20/d3e/l67 0 2024-09-19T06:40:34.283 INFO:tasks.workunit.client.1.smithi117.stdout:8/492: creat d1d/d1e/da5/fa9 x:0 0 0 2024-09-19T06:40:34.284 INFO:tasks.workunit.client.1.smithi117.stdout:1/404: mkdir d3/d18/d8c 0 2024-09-19T06:40:34.284 INFO:tasks.workunit.client.1.smithi117.stdout:4/589: dread d3/db/d20/d29/d39/d4f/f72 [0,4194304] 0 2024-09-19T06:40:34.285 INFO:tasks.workunit.client.1.smithi117.stdout:2/414: creat d0/d12/d2f/fa0 x:0 0 0 2024-09-19T06:40:34.285 INFO:tasks.workunit.client.1.smithi117.stdout:1/405: chown d3/f4c 6 1 2024-09-19T06:40:34.286 INFO:tasks.workunit.client.1.smithi117.stdout:5/455: dread ff [0,4194304] 0 2024-09-19T06:40:34.286 INFO:tasks.workunit.client.1.smithi117.stdout:4/590: fdatasync d3/d1b/f4d 0 2024-09-19T06:40:34.286 INFO:tasks.workunit.client.1.smithi117.stdout:1/406: fsync d3/f5c 0 2024-09-19T06:40:34.287 INFO:tasks.workunit.client.1.smithi117.stdout:5/456: stat d17/d1b 0 2024-09-19T06:40:34.288 INFO:tasks.workunit.client.1.smithi117.stdout:8/493: truncate d1d/d1e/d53/d6e/f92 740946 0 2024-09-19T06:40:34.288 INFO:tasks.workunit.client.1.smithi117.stdout:1/407: readlink d3/d18/d56/l8a 0 2024-09-19T06:40:34.288 INFO:tasks.workunit.client.1.smithi117.stdout:2/415: creat d0/d7/fa1 x:0 0 0 2024-09-19T06:40:34.289 INFO:tasks.workunit.client.1.smithi117.stdout:4/591: mknod d3/db/d20/d4a/d7b/da0/cc9 0 2024-09-19T06:40:34.290 INFO:tasks.workunit.client.1.smithi117.stdout:5/457: write d17/d1b/d3a/d3c/d70/f79 [322177,79115] 0 2024-09-19T06:40:34.290 INFO:tasks.workunit.client.1.smithi117.stdout:8/494: mkdir d1d/d2a/d3f/d4c/daa 0 2024-09-19T06:40:34.291 INFO:tasks.workunit.client.1.smithi117.stdout:5/458: readlink d17/d1b/d3a/d3c/l62 0 2024-09-19T06:40:34.292 INFO:tasks.workunit.client.1.smithi117.stdout:1/408: creat d3/d18/d23/d74/d89/f8d x:0 0 0 2024-09-19T06:40:34.294 INFO:tasks.workunit.client.1.smithi117.stdout:5/459: write d17/d1b/d3a/d3c/d46/f4a [570979,100770] 0 2024-09-19T06:40:34.295 INFO:tasks.workunit.client.1.smithi117.stdout:1/409: write d3/d18/d23/f4f [4954612,104847] 0 2024-09-19T06:40:34.296 INFO:tasks.workunit.client.1.smithi117.stdout:2/416: dread d0/d12/d32/f4f [0,4194304] 0 2024-09-19T06:40:34.298 INFO:tasks.workunit.client.1.smithi117.stdout:8/495: dread d1d/d2a/d3f/d4b/d5f/d7c/f7f [0,4194304] 0 2024-09-19T06:40:34.298 INFO:tasks.workunit.client.1.smithi117.stdout:1/410: write d3/d18/f24 [3138819,17904] 0 2024-09-19T06:40:34.299 INFO:tasks.workunit.client.1.smithi117.stdout:1/411: write d3/d18/f48 [2651452,61559] 0 2024-09-19T06:40:34.299 INFO:tasks.workunit.client.1.smithi117.stdout:2/417: creat d0/d7/d7f/fa2 x:0 0 0 2024-09-19T06:40:34.300 INFO:tasks.workunit.client.1.smithi117.stdout:1/412: readlink d3/l57 0 2024-09-19T06:40:34.300 INFO:tasks.workunit.client.1.smithi117.stdout:5/460: mkdir d17/d1b/d3a/d3c/d70/d94/da2 0 2024-09-19T06:40:34.302 INFO:tasks.workunit.client.1.smithi117.stdout:2/418: creat d0/d12/d32/d7d/fa3 x:0 0 0 2024-09-19T06:40:34.304 INFO:tasks.workunit.client.1.smithi117.stdout:5/461: creat d17/d1b/d3a/fa3 x:0 0 0 2024-09-19T06:40:34.305 INFO:tasks.workunit.client.1.smithi117.stdout:2/419: mkdir d0/d12/d32/da4 0 2024-09-19T06:40:34.307 INFO:tasks.workunit.client.1.smithi117.stdout:1/413: rename d3/d18/d8c to d3/d8e 0 2024-09-19T06:40:34.309 INFO:tasks.workunit.client.1.smithi117.stdout:4/592: truncate d3/db/d20/fbe 568324 0 2024-09-19T06:40:34.310 INFO:tasks.workunit.client.1.smithi117.stdout:5/462: dwrite d17/f89 [0,4194304] 0 2024-09-19T06:40:34.310 INFO:tasks.workunit.client.1.smithi117.stdout:2/420: getdents d0/d7/d29 0 2024-09-19T06:40:34.311 INFO:tasks.workunit.client.1.smithi117.stdout:4/593: stat d3/l24 0 2024-09-19T06:40:34.316 INFO:tasks.workunit.client.1.smithi117.stdout:5/463: write d17/d1b/d3a/fa3 [787269,50977] 0 2024-09-19T06:40:34.317 INFO:tasks.workunit.client.1.smithi117.stdout:4/594: read d3/d1b/f62 [822757,59260] 0 2024-09-19T06:40:34.318 INFO:tasks.workunit.client.1.smithi117.stdout:4/595: readlink d3/db/d20/d29/l64 0 2024-09-19T06:40:34.318 INFO:tasks.workunit.client.1.smithi117.stdout:5/464: write d17/d5c/f69 [65694,56817] 0 2024-09-19T06:40:34.318 INFO:tasks.workunit.client.1.smithi117.stdout:1/414: dwrite d3/d18/d23/f65 [0,4194304] 0 2024-09-19T06:40:34.319 INFO:tasks.workunit.client.1.smithi117.stdout:1/415: chown d3/d18/l1a 0 1 2024-09-19T06:40:34.320 INFO:tasks.workunit.client.1.smithi117.stdout:4/596: write d3/d65/f7c [1505752,10583] 0 2024-09-19T06:40:34.323 INFO:tasks.workunit.client.1.smithi117.stdout:5/465: mknod d17/d1b/d5d/d86/ca4 0 2024-09-19T06:40:34.324 INFO:tasks.workunit.client.1.smithi117.stdout:4/597: unlink d3/d1b/d7d/d51/f85 0 2024-09-19T06:40:34.325 INFO:tasks.workunit.client.1.smithi117.stdout:1/416: mkdir d3/d8f 0 2024-09-19T06:40:34.326 INFO:tasks.workunit.client.1.smithi117.stdout:2/421: truncate d0/d7/d29/f68 1201029 0 2024-09-19T06:40:34.329 INFO:tasks.workunit.client.1.smithi117.stdout:2/422: truncate d0/d7/d1e/d20/d3e/f91 52699 0 2024-09-19T06:40:34.332 INFO:tasks.workunit.client.1.smithi117.stdout:1/417: dwrite d3/d18/f3f [4194304,4194304] 0 2024-09-19T06:40:34.332 INFO:tasks.workunit.client.1.smithi117.stdout:1/418: dread - d3/d18/d56/f73 zero size 2024-09-19T06:40:34.379 INFO:tasks.workunit.client.0.smithi099.stdout:7/396: sync 2024-09-19T06:40:34.381 INFO:tasks.workunit.client.0.smithi099.stdout:7/397: truncate d7/dd/d29/d1f/d45/f5b 638704 0 2024-09-19T06:40:34.383 INFO:tasks.workunit.client.0.smithi099.stdout:7/398: mkdir d7/dd/d29/d34/d8f 0 2024-09-19T06:40:34.385 INFO:tasks.workunit.client.0.smithi099.stdout:7/399: dread f4 [0,4194304] 0 2024-09-19T06:40:34.386 INFO:tasks.workunit.client.0.smithi099.stdout:7/400: symlink d7/dd/l90 0 2024-09-19T06:40:34.388 INFO:tasks.workunit.client.0.smithi099.stdout:7/401: creat d7/dd/d29/d4e/d53/d64/d67/f91 x:0 0 0 2024-09-19T06:40:34.388 INFO:tasks.workunit.client.0.smithi099.stdout:7/402: write d7/dd/d29/d1f/d45/f8b [429422,123171] 0 2024-09-19T06:40:34.391 INFO:tasks.workunit.client.0.smithi099.stdout:7/403: link d7/dd/d29/d4e/f77 d7/dd/d29/d34/d8f/f92 0 2024-09-19T06:40:34.393 INFO:tasks.workunit.client.0.smithi099.stdout:7/404: creat d7/dd/d29/f93 x:0 0 0 2024-09-19T06:40:34.396 INFO:tasks.workunit.client.0.smithi099.stdout:7/405: link d7/dd/d29/d4e/d53/d64/d67/f91 d7/dd/d29/d1f/d45/d48/d63/d71/f94 0 2024-09-19T06:40:34.398 INFO:tasks.workunit.client.0.smithi099.stdout:7/406: write d7/dd/d29/d1f/d45/d48/f80 [59537,50646] 0 2024-09-19T06:40:34.401 INFO:tasks.workunit.client.0.smithi099.stdout:7/407: rename d7/dd/d29/d1f/d45/d48/d63/d75/c85 to d7/dd/d29/d1f/d45/c95 0 2024-09-19T06:40:34.402 INFO:tasks.workunit.client.0.smithi099.stdout:7/408: truncate d7/dd/d29/d4e/d53/d64/f89 736402 0 2024-09-19T06:40:34.403 INFO:tasks.workunit.client.1.smithi117.stdout:5/466: mknod d17/d1b/d5d/d7d/ca5 0 2024-09-19T06:40:34.403 INFO:tasks.workunit.client.1.smithi117.stdout:5/467: truncate d17/f76 673701 0 2024-09-19T06:40:34.404 INFO:tasks.workunit.client.1.smithi117.stdout:4/598: mkdir d3/db/d20/d4a/d7b/da0/dca 0 2024-09-19T06:40:34.404 INFO:tasks.workunit.client.1.smithi117.stdout:5/468: chown d17/d1b/l1e 5573 1 2024-09-19T06:40:34.405 INFO:tasks.workunit.client.1.smithi117.stdout:2/423: mkdir d0/d7/d29/d35/d61/da5 0 2024-09-19T06:40:34.407 INFO:tasks.workunit.client.0.smithi099.stdout:7/409: dwrite d7/d39/f6a [0,4194304] 0 2024-09-19T06:40:34.409 INFO:tasks.workunit.client.1.smithi117.stdout:5/469: dwrite d17/d2e/d55/f7a [0,4194304] 0 2024-09-19T06:40:34.410 INFO:tasks.workunit.client.0.smithi099.stdout:7/410: mknod d7/d39/c96 0 2024-09-19T06:40:34.412 INFO:tasks.workunit.client.1.smithi117.stdout:5/470: write d17/f76 [1619565,33184] 0 2024-09-19T06:40:34.413 INFO:tasks.workunit.client.1.smithi117.stdout:1/419: creat d3/d22/f90 x:0 0 0 2024-09-19T06:40:34.415 INFO:tasks.workunit.client.1.smithi117.stdout:4/599: getdents d3/d1b/d63/d8e 0 2024-09-19T06:40:34.421 INFO:tasks.workunit.client.1.smithi117.stdout:4/600: creat d3/db/d20/d35/d79/fcb x:0 0 0 2024-09-19T06:40:34.422 INFO:tasks.workunit.client.1.smithi117.stdout:1/420: dwrite d3/d18/d23/f4f [0,4194304] 0 2024-09-19T06:40:34.423 INFO:tasks.workunit.client.1.smithi117.stdout:4/601: mknod d3/d28/ccc 0 2024-09-19T06:40:34.425 INFO:tasks.workunit.client.1.smithi117.stdout:1/421: chown d3/l76 2 1 2024-09-19T06:40:34.428 INFO:tasks.workunit.client.1.smithi117.stdout:1/422: mkdir d3/d18/d91 0 2024-09-19T06:40:34.428 INFO:tasks.workunit.client.1.smithi117.stdout:4/602: link d3/d28/d2a/f9b d3/db/d13/fcd 0 2024-09-19T06:40:34.429 INFO:tasks.workunit.client.1.smithi117.stdout:1/423: stat d3/d18/d23/f34 0 2024-09-19T06:40:34.431 INFO:tasks.workunit.client.1.smithi117.stdout:1/424: chown d3/d22/d2f/l4a 8203979 1 2024-09-19T06:40:34.434 INFO:tasks.workunit.client.1.smithi117.stdout:2/424: dread d0/d7/d29/d35/f77 [0,4194304] 0 2024-09-19T06:40:34.436 INFO:tasks.workunit.client.1.smithi117.stdout:4/603: dwrite d3/d1b/d63/fa8 [0,4194304] 0 2024-09-19T06:40:34.438 INFO:tasks.workunit.client.1.smithi117.stdout:2/425: symlink d0/d12/d2f/la6 0 2024-09-19T06:40:34.439 INFO:tasks.workunit.client.1.smithi117.stdout:4/604: mkdir d3/d65/d66/dce 0 2024-09-19T06:40:34.440 INFO:tasks.workunit.client.1.smithi117.stdout:4/605: chown d3/db/f3a 11 1 2024-09-19T06:40:34.440 INFO:tasks.workunit.client.1.smithi117.stdout:2/426: symlink d0/d7/d29/d35/d61/la7 0 2024-09-19T06:40:34.441 INFO:tasks.workunit.client.1.smithi117.stdout:1/425: truncate d3/d18/f3f 5724758 0 2024-09-19T06:40:34.441 INFO:tasks.workunit.client.1.smithi117.stdout:4/606: read - d3/d65/d66/f78 zero size 2024-09-19T06:40:34.443 INFO:tasks.workunit.client.1.smithi117.stdout:1/426: chown d3/d22/c7b 773294440 1 2024-09-19T06:40:34.444 INFO:tasks.workunit.client.1.smithi117.stdout:4/607: read - d3/db/d20/d35/fbd zero size 2024-09-19T06:40:34.444 INFO:tasks.workunit.client.1.smithi117.stdout:5/471: dread f3 [4194304,4194304] 0 2024-09-19T06:40:34.445 INFO:tasks.workunit.client.1.smithi117.stdout:2/427: truncate d0/d7/f8 115241 0 2024-09-19T06:40:34.445 INFO:tasks.workunit.client.0.smithi099.stdout:7/411: write f4 [331374,90686] 0 2024-09-19T06:40:34.445 INFO:tasks.workunit.client.1.smithi117.stdout:1/427: creat d3/d22/d2f/f92 x:0 0 0 2024-09-19T06:40:34.447 INFO:tasks.workunit.client.0.smithi099.stdout:7/412: mkdir d7/dd/d97 0 2024-09-19T06:40:34.447 INFO:tasks.workunit.client.1.smithi117.stdout:2/428: mkdir d0/d7/d58/da8 0 2024-09-19T06:40:34.449 INFO:tasks.workunit.client.1.smithi117.stdout:4/608: link d3/d1b/d7d/d51/d95/f99 d3/d1b/d7d/d9e/fcf 0 2024-09-19T06:40:34.449 INFO:tasks.workunit.client.0.smithi099.stdout:7/413: creat d7/dd/d29/d34/f98 x:0 0 0 2024-09-19T06:40:34.450 INFO:tasks.workunit.client.1.smithi117.stdout:1/428: mkdir d3/d8f/d93 0 2024-09-19T06:40:34.450 INFO:tasks.workunit.client.0.smithi099.stdout:7/414: write d7/dd/d29/d1f/d45/d48/d63/f88 [432475,20760] 0 2024-09-19T06:40:34.452 INFO:tasks.workunit.client.0.smithi099.stdout:7/415: write d7/dd/d29/d1f/d45/f8b [136505,84048] 0 2024-09-19T06:40:34.452 INFO:tasks.workunit.client.1.smithi117.stdout:5/472: dwrite d17/d2f/d3b/f44 [0,4194304] 0 2024-09-19T06:40:34.453 INFO:tasks.workunit.client.0.smithi099.stdout:7/416: chown d7/d39/f8c 12779973 1 2024-09-19T06:40:34.454 INFO:tasks.workunit.client.1.smithi117.stdout:1/429: creat d3/d18/d56/f94 x:0 0 0 2024-09-19T06:40:34.455 INFO:tasks.workunit.client.1.smithi117.stdout:4/609: creat d3/d65/d66/dce/fd0 x:0 0 0 2024-09-19T06:40:34.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:34 smithi099 ceph-mon[27651]: pgmap v15: 65 pgs: 65 active+clean; 1.1 GiB data, 4.8 GiB used, 532 GiB / 536 GiB avail; 12 MiB/s rd, 129 MiB/s wr, 259 op/s 2024-09-19T06:40:34.457 INFO:tasks.workunit.client.1.smithi117.stdout:5/473: mkdir d17/d2e/da6 0 2024-09-19T06:40:34.457 INFO:tasks.workunit.client.1.smithi117.stdout:4/610: dread - d3/db/d20/d35/fbd zero size 2024-09-19T06:40:34.457 INFO:tasks.workunit.client.1.smithi117.stdout:2/429: dwrite d0/d7/d29/d35/f6a [0,4194304] 0 2024-09-19T06:40:34.460 INFO:tasks.workunit.client.1.smithi117.stdout:1/430: creat d3/d8f/f95 x:0 0 0 2024-09-19T06:40:34.460 INFO:tasks.workunit.client.1.smithi117.stdout:5/474: write d17/d2e/d55/f98 [681547,86749] 0 2024-09-19T06:40:34.460 INFO:tasks.workunit.client.1.smithi117.stdout:2/430: chown d0/d12/d2f/f51 31354 1 2024-09-19T06:40:34.463 INFO:tasks.workunit.client.0.smithi099.stdout:7/417: dwrite d7/f41 [0,4194304] 0 2024-09-19T06:40:34.464 INFO:tasks.workunit.client.1.smithi117.stdout:2/431: unlink d0/d12/l1a 0 2024-09-19T06:40:34.466 INFO:tasks.workunit.client.0.smithi099.stdout:7/418: symlink d7/dd/l99 0 2024-09-19T06:40:34.466 INFO:tasks.workunit.client.1.smithi117.stdout:5/475: dread d17/d1b/d3a/d3c/d46/f4a [0,4194304] 0 2024-09-19T06:40:34.466 INFO:tasks.workunit.client.1.smithi117.stdout:1/431: creat d3/f96 x:0 0 0 2024-09-19T06:40:34.467 INFO:tasks.workunit.client.1.smithi117.stdout:5/476: chown d17/d1b/d3a/d3c/d46/c56 39621 1 2024-09-19T06:40:34.467 INFO:tasks.workunit.client.1.smithi117.stdout:4/611: getdents d3/d65 0 2024-09-19T06:40:34.468 INFO:tasks.workunit.client.1.smithi117.stdout:1/432: dread - d3/d22/d2f/f92 zero size 2024-09-19T06:40:34.469 INFO:tasks.workunit.client.1.smithi117.stdout:2/432: mknod d0/d12/d2f/d98/ca9 0 2024-09-19T06:40:34.470 INFO:tasks.workunit.client.1.smithi117.stdout:2/433: write d0/d12/d2f/fa0 [363063,54713] 0 2024-09-19T06:40:34.472 INFO:tasks.workunit.client.1.smithi117.stdout:5/477: symlink d17/d1b/d3a/d3c/d70/la7 0 2024-09-19T06:40:34.473 INFO:tasks.workunit.client.1.smithi117.stdout:1/433: mkdir d3/d18/d97 0 2024-09-19T06:40:34.474 INFO:tasks.workunit.client.0.smithi099.stdout:7/419: dwrite d7/dd/f51 [0,4194304] 0 2024-09-19T06:40:34.475 INFO:tasks.workunit.client.0.smithi099.stdout:7/420: dread - d7/dd/d29/d1f/d45/d48/d63/d75/f8d zero size 2024-09-19T06:40:34.479 INFO:tasks.workunit.client.1.smithi117.stdout:2/434: unlink d0/d12/f28 0 2024-09-19T06:40:34.479 INFO:tasks.workunit.client.1.smithi117.stdout:4/612: getdents d3/db/d20 0 2024-09-19T06:40:34.480 INFO:tasks.workunit.client.1.smithi117.stdout:2/435: write d0/d7/d7f/d8d/f9d [234320,42264] 0 2024-09-19T06:40:34.480 INFO:tasks.workunit.client.1.smithi117.stdout:4/613: readlink d3/d1b/d7d/d9e/lb2 0 2024-09-19T06:40:34.483 INFO:tasks.workunit.client.0.smithi099.stdout:7/421: dwrite d7/dd/d29/d4e/d53/d64/f6e [0,4194304] 0 2024-09-19T06:40:34.483 INFO:tasks.workunit.client.1.smithi117.stdout:2/436: rmdir d0/d12/d32/d7d 39 2024-09-19T06:40:34.484 INFO:tasks.workunit.client.0.smithi099.stdout:6/356: sync 2024-09-19T06:40:34.484 INFO:tasks.workunit.client.0.smithi099.stdout:3/417: sync 2024-09-19T06:40:34.484 INFO:tasks.workunit.client.0.smithi099.stdout:8/234: sync 2024-09-19T06:40:34.485 INFO:tasks.workunit.client.0.smithi099.stdout:2/205: sync 2024-09-19T06:40:34.488 INFO:tasks.workunit.client.0.smithi099.stdout:8/235: mkdir d4/de/d1c/d50 0 2024-09-19T06:40:34.490 INFO:tasks.workunit.client.0.smithi099.stdout:6/357: symlink d1/d5/d24/d2e/d41/d4e/l75 0 2024-09-19T06:40:34.491 INFO:tasks.workunit.client.0.smithi099.stdout:3/418: rename d7/d34/d1d/d57/d74 to d7/d34/d1d/d57/d76 0 2024-09-19T06:40:34.492 INFO:tasks.workunit.client.1.smithi117.stdout:4/614: dwrite d3/db/d20/d29/d39/f6c [0,4194304] 0 2024-09-19T06:40:34.494 INFO:tasks.workunit.client.1.smithi117.stdout:4/615: write d3/db/d20/d29/d39/d4f/fb3 [549456,121274] 0 2024-09-19T06:40:34.495 INFO:tasks.workunit.client.0.smithi099.stdout:6/358: mkdir d1/d5/d38/d76 0 2024-09-19T06:40:34.496 INFO:tasks.workunit.client.0.smithi099.stdout:3/419: write d7/d34/d1d/d36/f38 [1971795,9732] 0 2024-09-19T06:40:34.496 INFO:tasks.workunit.client.0.smithi099.stdout:2/206: getdents d1/d2/d5/d8/d36 0 2024-09-19T06:40:34.497 INFO:tasks.workunit.client.0.smithi099.stdout:7/422: dwrite d7/dd/d29/d1f/d45/f5b [0,4194304] 0 2024-09-19T06:40:34.498 INFO:tasks.workunit.client.1.smithi117.stdout:4/616: creat d3/d65/d66/fd1 x:0 0 0 2024-09-19T06:40:34.499 INFO:tasks.workunit.client.1.smithi117.stdout:4/617: fdatasync d3/db/d20/d29/f31 0 2024-09-19T06:40:34.500 INFO:tasks.workunit.client.0.smithi099.stdout:3/420: rename d7/d34 to d7/d34/d1d/d20/d77 22 2024-09-19T06:40:34.502 INFO:tasks.workunit.client.1.smithi117.stdout:4/618: mknod d3/d4/d5f/cd2 0 2024-09-19T06:40:34.502 INFO:tasks.workunit.client.0.smithi099.stdout:8/236: dwrite d4/d11/d23/d4c/f4e [0,4194304] 0 2024-09-19T06:40:34.504 INFO:tasks.workunit.client.0.smithi099.stdout:5/490: sync 2024-09-19T06:40:34.504 INFO:tasks.workunit.client.0.smithi099.stdout:0/315: sync 2024-09-19T06:40:34.504 INFO:tasks.workunit.client.0.smithi099.stdout:1/276: sync 2024-09-19T06:40:34.504 INFO:tasks.workunit.client.0.smithi099.stdout:9/414: sync 2024-09-19T06:40:34.505 INFO:tasks.workunit.client.0.smithi099.stdout:2/207: creat d1/d2/d5/d8/d18/d27/f48 x:0 0 0 2024-09-19T06:40:34.505 INFO:tasks.workunit.client.0.smithi099.stdout:4/335: sync 2024-09-19T06:40:34.508 INFO:tasks.workunit.client.0.smithi099.stdout:1/277: fsync d0/f1a 0 2024-09-19T06:40:34.509 INFO:tasks.workunit.client.0.smithi099.stdout:6/359: truncate d1/d12/f1f 244082 0 2024-09-19T06:40:34.512 INFO:tasks.workunit.client.0.smithi099.stdout:5/491: rmdir d3/d1f 39 2024-09-19T06:40:34.512 INFO:tasks.workunit.client.0.smithi099.stdout:9/415: fdatasync dd/d47/f83 0 2024-09-19T06:40:34.512 INFO:tasks.workunit.client.1.smithi117.stdout:4/619: dwrite d3/d65/d66/dce/fd0 [0,4194304] 0 2024-09-19T06:40:34.513 INFO:tasks.workunit.client.0.smithi099.stdout:2/208: read - d1/d2/d5/d8/d9/f3c zero size 2024-09-19T06:40:34.514 INFO:tasks.workunit.client.0.smithi099.stdout:1/278: read d0/d12/d13/d37/f3d [740161,52727] 0 2024-09-19T06:40:34.516 INFO:tasks.workunit.client.0.smithi099.stdout:6/360: symlink d1/d5/d24/d2b/l77 0 2024-09-19T06:40:34.516 INFO:tasks.workunit.client.1.smithi117.stdout:1/434: dread d3/d22/d2f/f62 [0,4194304] 0 2024-09-19T06:40:34.517 INFO:tasks.workunit.client.0.smithi099.stdout:7/423: dwrite d7/dd/d29/d4e/d53/d64/d67/f79 [0,4194304] 0 2024-09-19T06:40:34.518 INFO:tasks.workunit.client.0.smithi099.stdout:3/421: rename d7/f73 to d7/d34/d1d/f78 0 2024-09-19T06:40:34.519 INFO:tasks.workunit.client.1.smithi117.stdout:1/435: write d3/d18/d23/f6b [317154,89405] 0 2024-09-19T06:40:34.522 INFO:tasks.workunit.client.0.smithi099.stdout:5/492: mkdir d3/d16/d5e/db1 0 2024-09-19T06:40:34.522 INFO:tasks.workunit.client.1.smithi117.stdout:1/436: symlink d3/d18/d97/l98 0 2024-09-19T06:40:34.522 INFO:tasks.workunit.client.1.smithi117.stdout:4/620: read d3/db/ff [4245730,67374] 0 2024-09-19T06:40:34.523 INFO:tasks.workunit.client.0.smithi099.stdout:3/422: write d7/d34/d1d/d36/d42/f43 [3867684,126360] 0 2024-09-19T06:40:34.525 INFO:tasks.workunit.client.1.smithi117.stdout:4/621: write d3/db/f81 [4218036,36181] 0 2024-09-19T06:40:34.526 INFO:tasks.workunit.client.0.smithi099.stdout:1/279: mkdir d0/d17/d5b 0 2024-09-19T06:40:34.526 INFO:tasks.workunit.client.1.smithi117.stdout:1/437: mkdir d3/d99 0 2024-09-19T06:40:34.527 INFO:tasks.workunit.client.0.smithi099.stdout:5/493: write d3/d16/d2f/d34/d3c/f46 [936192,5526] 0 2024-09-19T06:40:34.528 INFO:tasks.workunit.client.1.smithi117.stdout:1/438: write d3/d18/d23/f52 [1056682,51082] 0 2024-09-19T06:40:34.528 INFO:tasks.workunit.client.1.smithi117.stdout:1/439: dread - d3/d18/d56/f94 zero size 2024-09-19T06:40:34.529 INFO:tasks.workunit.client.0.smithi099.stdout:6/361: dwrite d1/d5/d24/d2b/f58 [0,4194304] 0 2024-09-19T06:40:34.529 INFO:tasks.workunit.client.0.smithi099.stdout:7/424: creat d7/dd/d29/d4e/f9a x:0 0 0 2024-09-19T06:40:34.529 INFO:tasks.workunit.client.1.smithi117.stdout:4/622: symlink d3/d65/d66/d80/dc5/ld3 0 2024-09-19T06:40:34.532 INFO:tasks.workunit.client.0.smithi099.stdout:8/237: getdents d4/de/d26 0 2024-09-19T06:40:34.533 INFO:tasks.workunit.client.1.smithi117.stdout:4/623: truncate d3/db/d20/d35/f70 1292309 0 2024-09-19T06:40:34.533 INFO:tasks.workunit.client.1.smithi117.stdout:1/440: creat d3/d8f/d93/f9a x:0 0 0 2024-09-19T06:40:34.534 INFO:tasks.workunit.client.0.smithi099.stdout:6/362: chown d1/d5/c2c 67537 1 2024-09-19T06:40:34.534 INFO:tasks.workunit.client.1.smithi117.stdout:1/441: chown d3/d18/f3f 4923 1 2024-09-19T06:40:34.535 INFO:tasks.workunit.client.1.smithi117.stdout:1/442: chown d3/l11 1455128780 1 2024-09-19T06:40:34.536 INFO:tasks.workunit.client.1.smithi117.stdout:4/624: unlink d3/l44 0 2024-09-19T06:40:34.537 INFO:tasks.workunit.client.0.smithi099.stdout:6/363: fsync d1/d5/d24/d2e/d41/f5a 0 2024-09-19T06:40:34.537 INFO:tasks.workunit.client.0.smithi099.stdout:9/416: creat dd/d2c/f88 x:0 0 0 2024-09-19T06:40:34.538 INFO:tasks.workunit.client.0.smithi099.stdout:3/423: dwrite d7/f68 [0,4194304] 0 2024-09-19T06:40:34.539 INFO:tasks.workunit.client.0.smithi099.stdout:5/494: creat d3/d2a/fb2 x:0 0 0 2024-09-19T06:40:34.540 INFO:tasks.workunit.client.1.smithi117.stdout:4/625: mkdir d3/db/d20/d35/d79/dd4 0 2024-09-19T06:40:34.542 INFO:tasks.workunit.client.0.smithi099.stdout:7/425: creat d7/dd/d29/d4e/d53/d64/f9b x:0 0 0 2024-09-19T06:40:34.544 INFO:tasks.workunit.client.0.smithi099.stdout:1/280: mknod d0/d17/d5b/c5c 0 2024-09-19T06:40:34.544 INFO:tasks.workunit.client.1.smithi117.stdout:1/443: dwrite d3/d22/d2f/f60 [0,4194304] 0 2024-09-19T06:40:34.545 INFO:tasks.workunit.client.1.smithi117.stdout:4/626: fdatasync d3/d1b/d7d/d9e/fcf 0 2024-09-19T06:40:34.546 INFO:tasks.workunit.client.0.smithi099.stdout:5/495: symlink d3/d16/d5e/lb3 0 2024-09-19T06:40:34.546 INFO:tasks.workunit.client.0.smithi099.stdout:7/426: chown d7/dd/d29/d34/f98 34298835 1 2024-09-19T06:40:34.546 INFO:tasks.workunit.client.0.smithi099.stdout:2/209: link d1/d2/f1f d1/d2/d5/d13/d2c/f49 0 2024-09-19T06:40:34.547 INFO:tasks.workunit.client.0.smithi099.stdout:7/427: write d7/f52 [953165,98464] 0 2024-09-19T06:40:34.549 INFO:tasks.workunit.client.0.smithi099.stdout:8/238: rename d4/d11/d23/d4c/f4e to d4/d11/d23/d4c/f51 0 2024-09-19T06:40:34.549 INFO:tasks.workunit.client.0.smithi099.stdout:4/336: dread d12/d32/f29 [0,4194304] 0 2024-09-19T06:40:34.551 INFO:tasks.workunit.client.0.smithi099.stdout:1/281: creat d0/d17/d5b/f5d x:0 0 0 2024-09-19T06:40:34.552 INFO:tasks.workunit.client.1.smithi117.stdout:1/444: creat d3/d18/d23/f9b x:0 0 0 2024-09-19T06:40:34.552 INFO:tasks.workunit.client.1.smithi117.stdout:4/627: link d3/db/l37 d3/d1b/d63/d84/ld5 0 2024-09-19T06:40:34.554 INFO:tasks.workunit.client.0.smithi099.stdout:3/424: rename d7/d34/d52 to d7/d34/d1d/d20/d75/d79 0 2024-09-19T06:40:34.555 INFO:tasks.workunit.client.0.smithi099.stdout:7/428: chown d7/dd/d29/d1f/c28 7520570 1 2024-09-19T06:40:34.556 INFO:tasks.workunit.client.1.smithi117.stdout:4/628: mkdir d3/d41/dd6 0 2024-09-19T06:40:34.557 INFO:tasks.workunit.client.0.smithi099.stdout:1/282: mkdir d0/d17/d24/d5e 0 2024-09-19T06:40:34.558 INFO:tasks.workunit.client.0.smithi099.stdout:7/429: write d7/dd/d29/d1f/d45/f78 [546532,96759] 0 2024-09-19T06:40:34.561 INFO:tasks.workunit.client.0.smithi099.stdout:3/425: dread d7/f68 [0,4194304] 0 2024-09-19T06:40:34.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:34 smithi117 ceph-mon[34564]: pgmap v15: 65 pgs: 65 active+clean; 1.1 GiB data, 4.8 GiB used, 532 GiB / 536 GiB avail; 12 MiB/s rd, 129 MiB/s wr, 259 op/s 2024-09-19T06:40:34.561 INFO:tasks.workunit.client.1.smithi117.stdout:4/629: link d3/d65/d66/d80/dc5/ld3 d3/d1b/d63/d84/ld7 0 2024-09-19T06:40:34.563 INFO:tasks.workunit.client.1.smithi117.stdout:4/630: symlink d3/d65/d66/d80/d91/ld8 0 2024-09-19T06:40:34.564 INFO:tasks.workunit.client.1.smithi117.stdout:4/631: fdatasync d3/db/d20/d29/d39/d4f/fb3 0 2024-09-19T06:40:34.565 INFO:tasks.workunit.client.0.smithi099.stdout:4/337: creat d12/d1b/f75 x:0 0 0 2024-09-19T06:40:34.568 INFO:tasks.workunit.client.0.smithi099.stdout:6/364: rename d1/d5/d24/d2e/d41/d4e/d2a/l2f to d1/d5/d24/d2e/d41/d4e/d54/d5d/l78 0 2024-09-19T06:40:34.569 INFO:tasks.workunit.client.0.smithi099.stdout:6/365: stat d1/d5/d38 0 2024-09-19T06:40:34.570 INFO:tasks.workunit.client.0.smithi099.stdout:5/496: rename d3/d16/c72 to d3/d7/cb4 0 2024-09-19T06:40:34.571 INFO:tasks.workunit.client.1.smithi117.stdout:1/445: rmdir d3/d18/d23 39 2024-09-19T06:40:34.572 INFO:tasks.workunit.client.0.smithi099.stdout:7/430: getdents d7/d39 0 2024-09-19T06:40:34.572 INFO:tasks.workunit.client.1.smithi117.stdout:1/446: chown d3/d22/d2f/f62 140958952 1 2024-09-19T06:40:34.573 INFO:tasks.workunit.client.1.smithi117.stdout:1/447: write d3/d22/d2f/f5b [222019,45289] 0 2024-09-19T06:40:34.574 INFO:tasks.workunit.client.1.smithi117.stdout:4/632: write d3/db/f8d [262976,53920] 0 2024-09-19T06:40:34.574 INFO:tasks.workunit.client.1.smithi117.stdout:4/633: stat d3/l24 0 2024-09-19T06:40:34.575 INFO:tasks.workunit.client.0.smithi099.stdout:4/338: dwrite d12/d1b/f75 [0,4194304] 0 2024-09-19T06:40:34.575 INFO:tasks.workunit.client.0.smithi099.stdout:5/497: chown d3/d16/d5e/la7 0 1 2024-09-19T06:40:34.576 INFO:tasks.workunit.client.0.smithi099.stdout:5/498: truncate d3/d2a/fb0 369935 0 2024-09-19T06:40:34.577 INFO:tasks.workunit.client.1.smithi117.stdout:1/448: mknod d3/d99/c9c 0 2024-09-19T06:40:34.577 INFO:tasks.workunit.client.0.smithi099.stdout:4/339: read - d12/d32/f4c zero size 2024-09-19T06:40:34.578 INFO:tasks.workunit.client.1.smithi117.stdout:4/634: write d3/db/d20/d29/d39/d4f/f72 [6578120,117379] 0 2024-09-19T06:40:34.578 INFO:tasks.workunit.client.0.smithi099.stdout:5/499: chown d3/l1d 2096107326 1 2024-09-19T06:40:34.578 INFO:tasks.workunit.client.0.smithi099.stdout:9/417: truncate dd/f37 315697 0 2024-09-19T06:40:34.579 INFO:tasks.workunit.client.0.smithi099.stdout:7/431: symlink d7/dd/d97/l9c 0 2024-09-19T06:40:34.580 INFO:tasks.workunit.client.1.smithi117.stdout:1/449: read - d3/d18/d23/d74/d89/f8d zero size 2024-09-19T06:40:34.580 INFO:tasks.workunit.client.1.smithi117.stdout:1/450: chown d3/d22/f7d 1234227 1 2024-09-19T06:40:34.581 INFO:tasks.workunit.client.1.smithi117.stdout:4/635: getdents d3/d1b/d63/d8e 0 2024-09-19T06:40:34.581 INFO:tasks.workunit.client.0.smithi099.stdout:9/418: truncate dd/d65/f75 811802 0 2024-09-19T06:40:34.582 INFO:tasks.workunit.client.0.smithi099.stdout:9/419: chown dd/d47/f3b 57672488 1 2024-09-19T06:40:34.583 INFO:tasks.workunit.client.0.smithi099.stdout:8/239: truncate d4/f17 2253886 0 2024-09-19T06:40:34.583 INFO:tasks.workunit.client.0.smithi099.stdout:3/426: chown d7/d34/d1d/d20/f67 44513 1 2024-09-19T06:40:34.583 INFO:tasks.workunit.client.0.smithi099.stdout:7/432: creat d7/dd/d29/d4e/d53/d64/f9d x:0 0 0 2024-09-19T06:40:34.584 INFO:tasks.workunit.client.1.smithi117.stdout:1/451: rename d3/d22/d2f/f5b to d3/d8f/f9d 0 2024-09-19T06:40:34.584 INFO:tasks.workunit.client.1.smithi117.stdout:1/452: chown d3/d8f/f95 549730 1 2024-09-19T06:40:34.585 INFO:tasks.workunit.client.1.smithi117.stdout:1/453: write d3/d18/d56/f85 [654451,30052] 0 2024-09-19T06:40:34.588 INFO:tasks.workunit.client.1.smithi117.stdout:1/454: rmdir d3/d18/d97 39 2024-09-19T06:40:34.589 INFO:tasks.workunit.client.1.smithi117.stdout:1/455: write d3/f38 [3036,35724] 0 2024-09-19T06:40:34.589 INFO:tasks.workunit.client.0.smithi099.stdout:3/427: write d7/f5f [3720695,52693] 0 2024-09-19T06:40:34.589 INFO:tasks.workunit.client.1.smithi117.stdout:1/456: chown d3/d18/l69 54390478 1 2024-09-19T06:40:34.589 INFO:tasks.workunit.client.0.smithi099.stdout:8/240: rename d4/de/f37 to d4/de/d26/d2b/f52 0 2024-09-19T06:40:34.590 INFO:tasks.workunit.client.1.smithi117.stdout:1/457: chown d3/d22/f90 1 1 2024-09-19T06:40:34.590 INFO:tasks.workunit.client.0.smithi099.stdout:9/420: mknod dd/c89 0 2024-09-19T06:40:34.592 INFO:tasks.workunit.client.0.smithi099.stdout:8/241: chown d4/de/d26/d2b/f52 0 1 2024-09-19T06:40:34.592 INFO:tasks.workunit.client.0.smithi099.stdout:7/433: dwrite d7/dd/d29/d4e/d53/f5c [4194304,4194304] 0 2024-09-19T06:40:34.594 INFO:tasks.workunit.client.1.smithi117.stdout:4/636: write d3/d4/d14/f17 [1559077,121668] 0 2024-09-19T06:40:34.595 INFO:tasks.workunit.client.0.smithi099.stdout:9/421: mknod dd/d62/d78/c8a 0 2024-09-19T06:40:34.595 INFO:tasks.workunit.client.1.smithi117.stdout:4/637: stat d3/d28/d2a/f9b 0 2024-09-19T06:40:34.596 INFO:tasks.workunit.client.1.smithi117.stdout:1/458: rename d3/c15 to d3/c9e 0 2024-09-19T06:40:34.598 INFO:tasks.workunit.client.0.smithi099.stdout:7/434: truncate d7/dd/d29/d34/f98 293894 0 2024-09-19T06:40:34.599 INFO:tasks.workunit.client.0.smithi099.stdout:3/428: mkdir d7/d34/d1d/d36/d69/d6d/d7a 0 2024-09-19T06:40:34.600 INFO:tasks.workunit.client.0.smithi099.stdout:6/366: dwrite d1/d5/f33 [0,4194304] 0 2024-09-19T06:40:34.601 INFO:tasks.workunit.client.1.smithi117.stdout:1/459: mkdir d3/d18/d23/d74/d89/d9f 0 2024-09-19T06:40:34.602 INFO:tasks.workunit.client.0.smithi099.stdout:8/242: rename d4/d11/l42 to d4/d11/d23/l53 0 2024-09-19T06:40:34.603 INFO:tasks.workunit.client.0.smithi099.stdout:9/422: symlink dd/d62/l8b 0 2024-09-19T06:40:34.604 INFO:tasks.workunit.client.1.smithi117.stdout:1/460: symlink d3/d99/la0 0 2024-09-19T06:40:34.604 INFO:tasks.workunit.client.0.smithi099.stdout:5/500: truncate d3/d2a/f7a 3887410 0 2024-09-19T06:40:34.606 INFO:tasks.workunit.client.0.smithi099.stdout:8/243: creat d4/f54 x:0 0 0 2024-09-19T06:40:34.607 INFO:tasks.workunit.client.1.smithi117.stdout:4/638: truncate d3/db/d20/d29/d39/d4f/fac 3130542 0 2024-09-19T06:40:34.608 INFO:tasks.workunit.client.1.smithi117.stdout:1/461: mkdir d3/da1 0 2024-09-19T06:40:34.608 INFO:tasks.workunit.client.1.smithi117.stdout:4/639: chown d3/d28/d2a/c2c 181 1 2024-09-19T06:40:34.609 INFO:tasks.workunit.client.1.smithi117.stdout:1/462: mknod d3/d99/ca2 0 2024-09-19T06:40:34.611 INFO:tasks.workunit.client.0.smithi099.stdout:7/435: link f2 d7/dd/d29/d1f/f9e 0 2024-09-19T06:40:34.611 INFO:tasks.workunit.client.1.smithi117.stdout:1/463: symlink d3/d8e/la3 0 2024-09-19T06:40:34.612 INFO:tasks.workunit.client.0.smithi099.stdout:7/436: chown d7/dd/d29/f93 28451982 1 2024-09-19T06:40:34.612 INFO:tasks.workunit.client.1.smithi117.stdout:1/464: stat d3/d22/d2f/c77 0 2024-09-19T06:40:34.612 INFO:tasks.workunit.client.0.smithi099.stdout:9/423: symlink dd/d2c/l8c 0 2024-09-19T06:40:34.613 INFO:tasks.workunit.client.1.smithi117.stdout:1/465: dread - d3/d18/d23/d51/f86 zero size 2024-09-19T06:40:34.614 INFO:tasks.workunit.client.0.smithi099.stdout:8/244: creat d4/d11/d23/d3f/f55 x:0 0 0 2024-09-19T06:40:34.614 INFO:tasks.workunit.client.0.smithi099.stdout:6/367: truncate d1/d5/d24/d2e/d41/d4e/d54/d5d/d61/f63 1124773 0 2024-09-19T06:40:34.616 INFO:tasks.workunit.client.0.smithi099.stdout:9/424: dread dd/d2c/f5a [0,4194304] 0 2024-09-19T06:40:34.617 INFO:tasks.workunit.client.0.smithi099.stdout:6/368: fsync d1/d5/d24/d2e/f32 0 2024-09-19T06:40:34.618 INFO:tasks.workunit.client.0.smithi099.stdout:7/437: mknod d7/dd/d29/c9f 0 2024-09-19T06:40:34.619 INFO:tasks.workunit.client.0.smithi099.stdout:8/245: mknod d4/de/c56 0 2024-09-19T06:40:34.620 INFO:tasks.workunit.client.0.smithi099.stdout:7/438: truncate d7/dd/d29/d4e/d53/d64/f9b 253216 0 2024-09-19T06:40:34.620 INFO:tasks.workunit.client.0.smithi099.stdout:6/369: symlink d1/d5/d24/d2e/d41/d4e/d54/d5d/d61/d65/l79 0 2024-09-19T06:40:34.620 INFO:tasks.workunit.client.0.smithi099.stdout:8/246: chown d4/d11/d23/l41 489161 1 2024-09-19T06:40:34.621 INFO:tasks.workunit.client.0.smithi099.stdout:7/439: rmdir d7/dd/d97 39 2024-09-19T06:40:34.624 INFO:tasks.workunit.client.0.smithi099.stdout:8/247: symlink d4/d11/d38/l57 0 2024-09-19T06:40:34.627 INFO:tasks.workunit.client.0.smithi099.stdout:6/370: mknod d1/d5/c7a 0 2024-09-19T06:40:34.629 INFO:tasks.workunit.client.0.smithi099.stdout:3/429: truncate d7/d34/d1d/d36/d42/f62 2239840 0 2024-09-19T06:40:34.630 INFO:tasks.workunit.client.1.smithi117.stdout:1/466: dread d3/f10 [0,4194304] 0 2024-09-19T06:40:34.630 INFO:tasks.workunit.client.1.smithi117.stdout:4/640: dread d3/db/d23/f98 [0,4194304] 0 2024-09-19T06:40:34.633 INFO:tasks.workunit.client.0.smithi099.stdout:3/430: creat d7/d34/d1d/d36/d69/d6d/f7b x:0 0 0 2024-09-19T06:40:34.635 INFO:tasks.workunit.client.0.smithi099.stdout:8/248: rmdir d4/de/d1c/d50 0 2024-09-19T06:40:34.639 INFO:tasks.workunit.client.0.smithi099.stdout:5/501: truncate d3/d16/d2f/d34/da4/faa 932068 0 2024-09-19T06:40:34.639 INFO:tasks.workunit.client.1.smithi117.stdout:1/467: dwrite d3/d18/f7a [0,4194304] 0 2024-09-19T06:40:34.640 INFO:tasks.workunit.client.1.smithi117.stdout:4/641: dread d3/d1b/d7d/d9f/fa2 [0,4194304] 0 2024-09-19T06:40:34.640 INFO:tasks.workunit.client.0.smithi099.stdout:8/249: creat d4/de/d26/d2b/f58 x:0 0 0 2024-09-19T06:40:34.641 INFO:tasks.workunit.client.1.smithi117.stdout:1/468: write d3/d18/d23/f6f [453369,118163] 0 2024-09-19T06:40:34.644 INFO:tasks.workunit.client.1.smithi117.stdout:4/642: symlink d3/d1b/d7d/d51/d95/ld9 0 2024-09-19T06:40:34.644 INFO:tasks.workunit.client.0.smithi099.stdout:8/250: mkdir d4/d11/d38/d59 0 2024-09-19T06:40:34.646 INFO:tasks.workunit.client.1.smithi117.stdout:1/469: chown d3/d18/d97 8134235 1 2024-09-19T06:40:34.649 INFO:tasks.workunit.client.1.smithi117.stdout:4/643: dread d3/d1b/d7d/d51/fba [0,4194304] 0 2024-09-19T06:40:34.650 INFO:tasks.workunit.client.1.smithi117.stdout:1/470: symlink d3/da1/la4 0 2024-09-19T06:40:34.650 INFO:tasks.workunit.client.1.smithi117.stdout:4/644: stat d3/db/d20/d4a/lc6 0 2024-09-19T06:40:34.650 INFO:tasks.workunit.client.0.smithi099.stdout:6/371: dread d1/f1d [4194304,4194304] 0 2024-09-19T06:40:34.650 INFO:tasks.workunit.client.1.smithi117.stdout:1/471: chown d3/d18/d23/f4f 2252166 1 2024-09-19T06:40:34.653 INFO:tasks.workunit.client.0.smithi099.stdout:8/251: rmdir d4/d11/d38/d59 0 2024-09-19T06:40:34.657 INFO:tasks.workunit.client.0.smithi099.stdout:6/372: fsync d1/d5/d24/d2e/d41/d4e/d2a/f47 0 2024-09-19T06:40:34.659 INFO:tasks.workunit.client.1.smithi117.stdout:1/472: dwrite d3/d8f/f9d [0,4194304] 0 2024-09-19T06:40:34.660 INFO:tasks.workunit.client.0.smithi099.stdout:5/502: dwrite d3/d1f/f20 [0,4194304] 0 2024-09-19T06:40:34.660 INFO:tasks.workunit.client.0.smithi099.stdout:7/440: dwrite d7/dd/d29/d34/d8f/f92 [0,4194304] 0 2024-09-19T06:40:34.663 INFO:tasks.workunit.client.1.smithi117.stdout:1/473: mkdir d3/da1/da5 0 2024-09-19T06:40:34.666 INFO:tasks.workunit.client.1.smithi117.stdout:0/336: sync 2024-09-19T06:40:34.668 INFO:tasks.workunit.client.1.smithi117.stdout:0/337: truncate d11/d13/f17 772693 0 2024-09-19T06:40:34.672 INFO:tasks.workunit.client.1.smithi117.stdout:0/338: rename d11/d13/d1b/f5f to d11/d13/d14/d2c/d35/f6c 0 2024-09-19T06:40:34.673 INFO:tasks.workunit.client.1.smithi117.stdout:0/339: read - d11/d13/d1b/d4b/f68 zero size 2024-09-19T06:40:34.674 INFO:tasks.workunit.client.1.smithi117.stdout:1/474: dread d3/f3c [0,4194304] 0 2024-09-19T06:40:34.676 INFO:tasks.workunit.client.1.smithi117.stdout:4/645: dread d3/db/d20/d4a/f6f [0,4194304] 0 2024-09-19T06:40:34.677 INFO:tasks.workunit.client.1.smithi117.stdout:1/475: creat d3/d18/d23/d51/fa6 x:0 0 0 2024-09-19T06:40:34.677 INFO:tasks.workunit.client.1.smithi117.stdout:0/340: getdents d11/d13/d28 0 2024-09-19T06:40:34.677 INFO:tasks.workunit.client.1.smithi117.stdout:4/646: creat d3/d65/d66/dce/fda x:0 0 0 2024-09-19T06:40:34.678 INFO:tasks.workunit.client.1.smithi117.stdout:1/476: write d3/d18/d23/f9b [882514,45414] 0 2024-09-19T06:40:34.679 INFO:tasks.workunit.client.1.smithi117.stdout:0/341: mkdir d11/d13/d1b/d27/d37/d6d 0 2024-09-19T06:40:34.681 INFO:tasks.workunit.client.1.smithi117.stdout:1/477: dread d3/d18/d23/f6f [0,4194304] 0 2024-09-19T06:40:34.682 INFO:tasks.workunit.client.1.smithi117.stdout:0/342: mkdir d11/d13/d1b/d67/d6e 0 2024-09-19T06:40:34.682 INFO:tasks.workunit.client.1.smithi117.stdout:1/478: chown d3/d18/d56/f47 7229 1 2024-09-19T06:40:34.684 INFO:tasks.workunit.client.1.smithi117.stdout:0/343: mknod d11/d13/d1b/c6f 0 2024-09-19T06:40:34.684 INFO:tasks.workunit.client.1.smithi117.stdout:1/479: creat d3/d8f/fa7 x:0 0 0 2024-09-19T06:40:34.686 INFO:tasks.workunit.client.1.smithi117.stdout:1/480: creat d3/d18/d56/fa8 x:0 0 0 2024-09-19T06:40:34.693 INFO:tasks.workunit.client.1.smithi117.stdout:1/481: dwrite d3/f5e [0,4194304] 0 2024-09-19T06:40:34.699 INFO:tasks.workunit.client.1.smithi117.stdout:1/482: write d3/d22/f71 [1908995,104600] 0 2024-09-19T06:40:34.701 INFO:tasks.workunit.client.1.smithi117.stdout:4/647: dwrite d3/d1b/d7d/f10 [0,4194304] 0 2024-09-19T06:40:34.702 INFO:tasks.workunit.client.1.smithi117.stdout:0/344: dwrite d11/d13/d14/d16/f34 [0,4194304] 0 2024-09-19T06:40:34.703 INFO:tasks.workunit.client.1.smithi117.stdout:1/483: write d3/d18/d23/d51/fa6 [531803,22168] 0 2024-09-19T06:40:34.705 INFO:tasks.workunit.client.1.smithi117.stdout:0/345: fdatasync d11/d13/d14/f33 0 2024-09-19T06:40:34.705 INFO:tasks.workunit.client.1.smithi117.stdout:4/648: truncate d3/d28/d2a/f9b 1222466 0 2024-09-19T06:40:34.716 INFO:tasks.workunit.client.1.smithi117.stdout:4/649: dwrite d3/d4/f9 [0,4194304] 0 2024-09-19T06:40:34.718 INFO:tasks.workunit.client.1.smithi117.stdout:1/484: dwrite d3/f4c [0,4194304] 0 2024-09-19T06:40:34.720 INFO:tasks.workunit.client.1.smithi117.stdout:4/650: mkdir d3/db/d23/ddb 0 2024-09-19T06:40:34.722 INFO:tasks.workunit.client.1.smithi117.stdout:0/346: dwrite d11/d13/d14/d2c/d35/d3e/f52 [0,4194304] 0 2024-09-19T06:40:34.724 INFO:tasks.workunit.client.1.smithi117.stdout:0/347: fdatasync d11/d13/d14/f49 0 2024-09-19T06:40:34.725 INFO:tasks.workunit.client.1.smithi117.stdout:1/485: dread d3/d18/d23/f65 [0,4194304] 0 2024-09-19T06:40:34.725 INFO:tasks.workunit.client.1.smithi117.stdout:4/651: creat d3/db/d20/d35/d79/fdc x:0 0 0 2024-09-19T06:40:34.732 INFO:tasks.workunit.client.1.smithi117.stdout:7/431: sync 2024-09-19T06:40:34.732 INFO:tasks.workunit.client.1.smithi117.stdout:5/478: sync 2024-09-19T06:40:34.732 INFO:tasks.workunit.client.1.smithi117.stdout:6/303: sync 2024-09-19T06:40:34.732 INFO:tasks.workunit.client.1.smithi117.stdout:0/348: rename d11/d13/d1b/d67/d6e to d11/d13/d14/d2c/d70 0 2024-09-19T06:40:34.733 INFO:tasks.workunit.client.0.smithi099.stdout:9/425: dwrite dd/d47/d40/f11 [0,4194304] 0 2024-09-19T06:40:34.733 INFO:tasks.workunit.client.1.smithi117.stdout:1/486: dwrite d3/d18/d23/d74/f75 [0,4194304] 0 2024-09-19T06:40:34.734 INFO:tasks.workunit.client.0.smithi099.stdout:9/426: readlink dd/d2c/l8c 0 2024-09-19T06:40:34.734 INFO:tasks.workunit.client.1.smithi117.stdout:6/304: write d1/d14/f15 [1418535,30589] 0 2024-09-19T06:40:34.735 INFO:tasks.workunit.client.1.smithi117.stdout:7/432: chown d1/d4a/d81/d24/d1c/d35/d4f 11170630 1 2024-09-19T06:40:34.737 INFO:tasks.workunit.client.1.smithi117.stdout:5/479: read d17/f76 [91813,94843] 0 2024-09-19T06:40:34.738 INFO:tasks.workunit.client.0.smithi099.stdout:7/441: write d7/dd/d29/d4e/d53/d64/f6e [3111701,31100] 0 2024-09-19T06:40:34.738 INFO:tasks.workunit.client.1.smithi117.stdout:6/305: chown d1/d14/f4c 1 1 2024-09-19T06:40:34.739 INFO:tasks.workunit.client.0.smithi099.stdout:9/427: write dd/d62/d78/f7b [989170,1871] 0 2024-09-19T06:40:34.742 INFO:tasks.workunit.client.1.smithi117.stdout:7/433: rmdir d1/d4a/d81/d48/d5f 39 2024-09-19T06:40:34.742 INFO:tasks.workunit.client.1.smithi117.stdout:1/487: symlink d3/da1/la9 0 2024-09-19T06:40:34.742 INFO:tasks.workunit.client.1.smithi117.stdout:0/349: rename d11/d13/f22 to d11/d13/d14/d2c/d53/f71 0 2024-09-19T06:40:34.747 INFO:tasks.workunit.client.1.smithi117.stdout:7/434: unlink d1/d4a/d81/d24/d1c/c40 0 2024-09-19T06:40:34.747 INFO:tasks.workunit.client.1.smithi117.stdout:5/480: dwrite d17/d1b/d3a/d3c/f7f [0,4194304] 0 2024-09-19T06:40:34.749 INFO:tasks.workunit.client.1.smithi117.stdout:0/350: mknod d11/c72 0 2024-09-19T06:40:34.758 INFO:tasks.workunit.client.1.smithi117.stdout:7/435: dwrite d1/d4a/d81/d24/d26/f2f [0,4194304] 0 2024-09-19T06:40:34.758 INFO:tasks.workunit.client.1.smithi117.stdout:6/306: dread d1/d14/f2b [0,4194304] 0 2024-09-19T06:40:34.759 INFO:tasks.workunit.client.1.smithi117.stdout:6/307: fsync d1/f1d 0 2024-09-19T06:40:34.760 INFO:tasks.workunit.client.1.smithi117.stdout:0/351: dwrite d11/d13/d1b/f4e [0,4194304] 0 2024-09-19T06:40:34.760 INFO:tasks.workunit.client.1.smithi117.stdout:7/436: fdatasync d1/d4a/d81/d24/d1c/f67 0 2024-09-19T06:40:34.763 INFO:tasks.workunit.client.0.smithi099.stdout:8/252: getdents d4/de/d26/d2b 0 2024-09-19T06:40:34.764 INFO:tasks.workunit.client.0.smithi099.stdout:3/431: dwrite d7/d34/f3a [0,4194304] 0 2024-09-19T06:40:34.765 INFO:tasks.workunit.client.0.smithi099.stdout:8/253: write d4/de/d10/f40 [1491372,61418] 0 2024-09-19T06:40:34.768 INFO:tasks.workunit.client.0.smithi099.stdout:6/373: getdents d1/d12 0 2024-09-19T06:40:34.768 INFO:tasks.workunit.client.0.smithi099.stdout:7/442: mknod d7/dd/ca0 0 2024-09-19T06:40:34.769 INFO:tasks.workunit.client.0.smithi099.stdout:7/443: readlink d7/d39/l3a 0 2024-09-19T06:40:34.770 INFO:tasks.workunit.client.0.smithi099.stdout:5/503: link d3/d16/d2f/d34/d3c/d65/f86 d3/d7/d90/fb5 0 2024-09-19T06:40:34.770 INFO:tasks.workunit.client.1.smithi117.stdout:0/352: rmdir d11/d13/d1b/d61 0 2024-09-19T06:40:34.773 INFO:tasks.workunit.client.0.smithi099.stdout:8/254: symlink d4/de/l5a 0 2024-09-19T06:40:34.774 INFO:tasks.workunit.client.0.smithi099.stdout:5/504: creat d3/d16/fb6 x:0 0 0 2024-09-19T06:40:34.775 INFO:tasks.workunit.client.0.smithi099.stdout:7/444: mkdir d7/dd/d29/d34/da1 0 2024-09-19T06:40:34.776 INFO:tasks.workunit.client.1.smithi117.stdout:6/308: rename d1/d5/d32/l38 to d1/d3/d25/l4e 0 2024-09-19T06:40:34.776 INFO:tasks.workunit.client.1.smithi117.stdout:7/437: dread d1/d4a/d81/d24/d1c/d35/f6d [0,4194304] 0 2024-09-19T06:40:34.776 INFO:tasks.workunit.client.1.smithi117.stdout:6/309: stat d1 0 2024-09-19T06:40:34.776 INFO:tasks.workunit.client.1.smithi117.stdout:0/353: write d11/d13/d1b/d27/d37/f5e [601654,54758] 0 2024-09-19T06:40:34.776 INFO:tasks.workunit.client.1.smithi117.stdout:6/310: chown d1/d3d 112696048 1 2024-09-19T06:40:34.777 INFO:tasks.workunit.client.0.smithi099.stdout:8/255: unlink d4/d11/d38/c3e 0 2024-09-19T06:40:34.779 INFO:tasks.workunit.client.0.smithi099.stdout:6/374: dwrite d1/d5/d24/d2e/d41/d4e/d2a/f30 [0,4194304] 0 2024-09-19T06:40:34.779 INFO:tasks.workunit.client.0.smithi099.stdout:5/505: mkdir d3/db7 0 2024-09-19T06:40:34.780 INFO:tasks.workunit.client.0.smithi099.stdout:8/256: dread - d4/de/d26/d2b/f32 zero size 2024-09-19T06:40:34.781 INFO:tasks.workunit.client.1.smithi117.stdout:7/438: rename d1/d4a/d81/f39 to d1/d4a/f96 0 2024-09-19T06:40:34.782 INFO:tasks.workunit.client.0.smithi099.stdout:5/506: creat d3/d7/fb8 x:0 0 0 2024-09-19T06:40:34.785 INFO:tasks.workunit.client.0.smithi099.stdout:8/257: unlink d4/de/f1a 0 2024-09-19T06:40:34.787 INFO:tasks.workunit.client.1.smithi117.stdout:0/354: dwrite d11/d13/d14/f49 [0,4194304] 0 2024-09-19T06:40:34.788 INFO:tasks.workunit.client.1.smithi117.stdout:7/439: write d1/d3f/f85 [234317,72996] 0 2024-09-19T06:40:34.788 INFO:tasks.workunit.client.1.smithi117.stdout:4/652: write d3/db/ff [8732330,1142] 0 2024-09-19T06:40:34.789 INFO:tasks.workunit.client.0.smithi099.stdout:5/507: rename d3/d16/d2f/d34/da4/l4e to d3/db7/lb9 0 2024-09-19T06:40:34.789 INFO:tasks.workunit.client.1.smithi117.stdout:0/355: chown d11/f48 12915 1 2024-09-19T06:40:34.791 INFO:tasks.workunit.client.0.smithi099.stdout:5/508: symlink d3/d2a/lba 0 2024-09-19T06:40:34.792 INFO:tasks.workunit.client.0.smithi099.stdout:3/432: read d7/d34/d1d/d36/d42/f62 [1267909,129844] 0 2024-09-19T06:40:34.793 INFO:tasks.workunit.client.1.smithi117.stdout:6/311: dwrite d1/d14/f2e [8388608,4194304] 0 2024-09-19T06:40:34.795 INFO:tasks.workunit.client.1.smithi117.stdout:7/440: write d1/d4a/d81/f58 [1114307,67369] 0 2024-09-19T06:40:34.797 INFO:tasks.workunit.client.1.smithi117.stdout:6/312: dread - d1/f1d zero size 2024-09-19T06:40:34.798 INFO:tasks.workunit.client.1.smithi117.stdout:5/481: dread d17/d1b/d3a/d3c/f3d [0,4194304] 0 2024-09-19T06:40:34.798 INFO:tasks.workunit.client.1.smithi117.stdout:7/441: chown d1/c25 0 1 2024-09-19T06:40:34.800 INFO:tasks.workunit.client.1.smithi117.stdout:4/653: truncate d3/db/d20/d4a/f6f 2567967 0 2024-09-19T06:40:34.801 INFO:tasks.workunit.client.1.smithi117.stdout:7/442: write d1/d4a/d81/d24/d1c/f79 [558706,25713] 0 2024-09-19T06:40:34.802 INFO:tasks.workunit.client.1.smithi117.stdout:5/482: creat d17/d1b/d5d/d7d/fa8 x:0 0 0 2024-09-19T06:40:34.804 INFO:tasks.workunit.client.0.smithi099.stdout:9/428: write dd/d2c/f5a [842804,96614] 0 2024-09-19T06:40:34.807 INFO:tasks.workunit.client.1.smithi117.stdout:5/483: mknod d17/d1b/d3a/d3c/d70/ca9 0 2024-09-19T06:40:34.809 INFO:tasks.workunit.client.0.smithi099.stdout:9/429: mkdir dd/d2c/d5c/d85/d8d 0 2024-09-19T06:40:34.809 INFO:tasks.workunit.client.1.smithi117.stdout:5/484: rename d17/d1b/d3a/d3c/d70 to d17/d1b/d3a/d3c/d70/d94/daa 22 2024-09-19T06:40:34.814 INFO:tasks.workunit.client.0.smithi099.stdout:6/375: truncate d1/d5/d24/d2b/f45 2155532 0 2024-09-19T06:40:34.816 INFO:tasks.workunit.client.0.smithi099.stdout:9/430: dread dd/d47/f38 [0,4194304] 0 2024-09-19T06:40:34.817 INFO:tasks.workunit.client.1.smithi117.stdout:5/485: rmdir d17/d1b/d3a/d3c/d70/d94/da2 0 2024-09-19T06:40:34.820 INFO:tasks.workunit.client.1.smithi117.stdout:5/486: dread d17/d5c/f90 [0,4194304] 0 2024-09-19T06:40:34.821 INFO:tasks.workunit.client.0.smithi099.stdout:3/433: dwrite d7/f14 [0,4194304] 0 2024-09-19T06:40:34.822 INFO:tasks.workunit.client.0.smithi099.stdout:3/434: fsync d7/d34/d1d/d36/d42/f40 0 2024-09-19T06:40:34.824 INFO:tasks.workunit.client.0.smithi099.stdout:6/376: dread d1/f9 [0,4194304] 0 2024-09-19T06:40:34.824 INFO:tasks.workunit.client.1.smithi117.stdout:6/313: truncate d1/d3/f12 1299112 0 2024-09-19T06:40:34.825 INFO:tasks.workunit.client.0.smithi099.stdout:9/431: fdatasync dd/d2c/f5a 0 2024-09-19T06:40:34.826 INFO:tasks.workunit.client.1.smithi117.stdout:5/487: mkdir d17/d2e/dab 0 2024-09-19T06:40:34.827 INFO:tasks.workunit.client.0.smithi099.stdout:9/432: chown dd/d2c/f39 392994337 1 2024-09-19T06:40:34.827 INFO:tasks.workunit.client.0.smithi099.stdout:7/445: dread d7/f2c [0,4194304] 0 2024-09-19T06:40:34.828 INFO:tasks.workunit.client.1.smithi117.stdout:7/443: truncate d1/d72/f75 1024902 0 2024-09-19T06:40:34.833 INFO:tasks.workunit.client.1.smithi117.stdout:0/356: dread d11/d13/d1b/d27/f55 [0,4194304] 0 2024-09-19T06:40:34.833 INFO:tasks.workunit.client.1.smithi117.stdout:6/314: getdents d1/d5/d8/d27 0 2024-09-19T06:40:34.834 INFO:tasks.workunit.client.1.smithi117.stdout:4/654: dread d3/d1b/d7d/d51/d95/f99 [0,4194304] 0 2024-09-19T06:40:34.835 INFO:tasks.workunit.client.1.smithi117.stdout:6/315: fsync d1/d3/f3e 0 2024-09-19T06:40:34.837 INFO:tasks.workunit.client.1.smithi117.stdout:0/357: write d11/d13/d28/f2e [4773864,68865] 0 2024-09-19T06:40:34.837 INFO:tasks.workunit.client.1.smithi117.stdout:4/655: chown d3/d65/d66/c71 849 1 2024-09-19T06:40:34.838 INFO:tasks.workunit.client.1.smithi117.stdout:5/488: dwrite d17/d1b/d3a/d3c/f7f [0,4194304] 0 2024-09-19T06:40:34.838 INFO:tasks.workunit.client.1.smithi117.stdout:6/316: truncate d1/d5/f40 335361 0 2024-09-19T06:40:34.839 INFO:tasks.workunit.client.1.smithi117.stdout:6/317: readlink d1/l43 0 2024-09-19T06:40:34.839 INFO:tasks.workunit.client.1.smithi117.stdout:4/656: dread - d3/db/d20/d35/d79/fcb zero size 2024-09-19T06:40:34.840 INFO:tasks.workunit.client.1.smithi117.stdout:6/318: chown d1/d14/f1a 7 1 2024-09-19T06:40:34.841 INFO:tasks.workunit.client.1.smithi117.stdout:0/358: creat d11/d13/d28/d38/d5b/f73 x:0 0 0 2024-09-19T06:40:34.841 INFO:tasks.workunit.client.1.smithi117.stdout:6/319: stat d1/d5/d8/d27/f44 0 2024-09-19T06:40:34.843 INFO:tasks.workunit.client.1.smithi117.stdout:4/657: mknod d3/d65/d66/d80/d91/cdd 0 2024-09-19T06:40:34.843 INFO:tasks.workunit.client.1.smithi117.stdout:6/320: fdatasync d1/d5/f39 0 2024-09-19T06:40:34.847 INFO:tasks.workunit.client.1.smithi117.stdout:6/321: creat d1/d5/d8/f4f x:0 0 0 2024-09-19T06:40:34.848 INFO:tasks.workunit.client.1.smithi117.stdout:6/322: chown d1/d3/f3e 1185350076 1 2024-09-19T06:40:34.848 INFO:tasks.workunit.client.1.smithi117.stdout:6/323: chown d1/d5/d8/d27/f44 319156611 1 2024-09-19T06:40:34.854 INFO:tasks.workunit.client.1.smithi117.stdout:5/489: truncate f1 5847447 0 2024-09-19T06:40:34.855 INFO:tasks.workunit.client.1.smithi117.stdout:6/324: dwrite d1/f1b [8388608,4194304] 0 2024-09-19T06:40:34.855 INFO:tasks.workunit.client.1.smithi117.stdout:5/490: write d17/d2e/d55/f6e [560995,6886] 0 2024-09-19T06:40:34.858 INFO:tasks.workunit.client.1.smithi117.stdout:5/491: rmdir d17/d5c 39 2024-09-19T06:40:34.860 INFO:tasks.workunit.client.1.smithi117.stdout:6/325: rename d1/d5/d8/d27/f44 to d1/d3/f50 0 2024-09-19T06:40:34.861 INFO:tasks.workunit.client.1.smithi117.stdout:6/326: dread - d1/d3/d25/f46 zero size 2024-09-19T06:40:34.863 INFO:tasks.workunit.client.1.smithi117.stdout:5/492: rmdir d17/d2e/d65 39 2024-09-19T06:40:34.865 INFO:tasks.workunit.client.1.smithi117.stdout:0/359: write d11/d13/d14/d16/f4a [1066183,13138] 0 2024-09-19T06:40:34.867 INFO:tasks.workunit.client.1.smithi117.stdout:6/327: creat d1/d5/f51 x:0 0 0 2024-09-19T06:40:34.868 INFO:tasks.workunit.client.1.smithi117.stdout:4/658: dread d3/db/d20/d29/d39/f6c [8388608,4194304] 0 2024-09-19T06:40:34.869 INFO:tasks.workunit.client.1.smithi117.stdout:7/444: dread d1/d72/f75 [0,4194304] 0 2024-09-19T06:40:34.869 INFO:tasks.workunit.client.1.smithi117.stdout:0/360: creat d11/d13/d14/d2c/d35/d3e/f74 x:0 0 0 2024-09-19T06:40:34.870 INFO:tasks.workunit.client.1.smithi117.stdout:6/328: fsync d1/d3/f3e 0 2024-09-19T06:40:34.873 INFO:tasks.workunit.client.1.smithi117.stdout:6/329: truncate d1/f3c 1350214 0 2024-09-19T06:40:34.873 INFO:tasks.workunit.client.1.smithi117.stdout:5/493: dwrite d17/d1b/d3a/d3c/d46/fa0 [0,4194304] 0 2024-09-19T06:40:34.874 INFO:tasks.workunit.client.1.smithi117.stdout:0/361: creat d11/d13/d1b/d4b/f75 x:0 0 0 2024-09-19T06:40:34.875 INFO:tasks.workunit.client.1.smithi117.stdout:6/330: write d1/d5/f39 [3640345,79983] 0 2024-09-19T06:40:34.875 INFO:tasks.workunit.client.1.smithi117.stdout:4/659: read d3/db/d20/d29/f31 [2626478,56947] 0 2024-09-19T06:40:34.877 INFO:tasks.workunit.client.1.smithi117.stdout:7/445: link d1/d4a/d81/d24/f6 d1/d4a/d7c/d95/f97 0 2024-09-19T06:40:34.879 INFO:tasks.workunit.client.1.smithi117.stdout:6/331: dread - d1/d3/f3e zero size 2024-09-19T06:40:34.881 INFO:tasks.workunit.client.1.smithi117.stdout:6/332: write d1/d3/fd [1787318,101202] 0 2024-09-19T06:40:34.882 INFO:tasks.workunit.client.1.smithi117.stdout:7/446: creat d1/d4a/d7c/f98 x:0 0 0 2024-09-19T06:40:34.883 INFO:tasks.workunit.client.1.smithi117.stdout:4/660: creat d3/db/d20/d4a/d7b/fde x:0 0 0 2024-09-19T06:40:34.883 INFO:tasks.workunit.client.1.smithi117.stdout:5/494: dwrite d17/d1b/d5d/d86/f8c [0,4194304] 0 2024-09-19T06:40:34.885 INFO:tasks.workunit.client.1.smithi117.stdout:7/447: creat d1/d4a/d7c/d95/f99 x:0 0 0 2024-09-19T06:40:34.887 INFO:tasks.workunit.client.1.smithi117.stdout:6/333: creat d1/d3/d25/f52 x:0 0 0 2024-09-19T06:40:34.889 INFO:tasks.workunit.client.1.smithi117.stdout:7/448: creat d1/d4a/f9a x:0 0 0 2024-09-19T06:40:34.890 INFO:tasks.workunit.client.1.smithi117.stdout:9/431: sync 2024-09-19T06:40:34.890 INFO:tasks.workunit.client.1.smithi117.stdout:8/496: sync 2024-09-19T06:40:34.891 INFO:tasks.workunit.client.1.smithi117.stdout:3/482: sync 2024-09-19T06:40:34.891 INFO:tasks.workunit.client.1.smithi117.stdout:2/437: sync 2024-09-19T06:40:34.892 INFO:tasks.workunit.client.1.smithi117.stdout:4/661: write f1 [192831,126680] 0 2024-09-19T06:40:34.892 INFO:tasks.workunit.client.1.smithi117.stdout:6/334: unlink d1/d14/f1a 0 2024-09-19T06:40:34.896 INFO:tasks.workunit.client.1.smithi117.stdout:9/432: write d4/d17/f76 [911584,84915] 0 2024-09-19T06:40:34.896 INFO:tasks.workunit.client.1.smithi117.stdout:4/662: fsync d3/db/f43 0 2024-09-19T06:40:34.897 INFO:tasks.workunit.client.1.smithi117.stdout:7/449: mkdir d1/d4a/d81/d24/d1c/d35/d4f/d9b 0 2024-09-19T06:40:34.898 INFO:tasks.workunit.client.1.smithi117.stdout:5/495: dwrite ff [4194304,4194304] 0 2024-09-19T06:40:34.899 INFO:tasks.workunit.client.1.smithi117.stdout:6/335: creat d1/d5/d32/d45/f53 x:0 0 0 2024-09-19T06:40:34.900 INFO:tasks.workunit.client.1.smithi117.stdout:8/497: dread d1d/d1e/d53/f82 [0,4194304] 0 2024-09-19T06:40:34.901 INFO:tasks.workunit.client.1.smithi117.stdout:0/362: dwrite d11/d13/d1b/d27/f40 [0,4194304] 0 2024-09-19T06:40:34.902 INFO:tasks.workunit.client.1.smithi117.stdout:9/433: dread - d4/d1c/d7a/d69/f70 zero size 2024-09-19T06:40:34.904 INFO:tasks.workunit.client.1.smithi117.stdout:2/438: rename d0/d7/d29/d35/d61/da5 to d0/d7/d58/da8/daa 0 2024-09-19T06:40:34.905 INFO:tasks.workunit.client.1.smithi117.stdout:6/336: rmdir d1/d3 39 2024-09-19T06:40:34.907 INFO:tasks.workunit.client.1.smithi117.stdout:1/488: sync 2024-09-19T06:40:34.909 INFO:tasks.workunit.client.1.smithi117.stdout:1/489: write d3/f38 [1965252,71955] 0 2024-09-19T06:40:34.911 INFO:tasks.workunit.client.1.smithi117.stdout:5/496: dread d17/f76 [0,4194304] 0 2024-09-19T06:40:34.912 INFO:tasks.workunit.client.1.smithi117.stdout:8/498: rename f15 to d1d/d2a/d3f/d4b/d5f/d95/fab 0 2024-09-19T06:40:34.914 INFO:tasks.workunit.client.1.smithi117.stdout:0/363: mknod d11/d13/d14/d2c/d70/c76 0 2024-09-19T06:40:34.915 INFO:tasks.workunit.client.1.smithi117.stdout:8/499: read d1d/d1e/d29/f2b [7957444,105412] 0 2024-09-19T06:40:34.915 INFO:tasks.workunit.client.1.smithi117.stdout:5/497: dread d17/d1b/d3a/d3c/d46/f61 [0,4194304] 0 2024-09-19T06:40:34.916 INFO:tasks.workunit.client.1.smithi117.stdout:0/364: dread - d11/d13/d14/d2c/d35/d3e/f62 zero size 2024-09-19T06:40:34.917 INFO:tasks.workunit.client.1.smithi117.stdout:2/439: creat d0/d7/d29/d35/d61/d65/fab x:0 0 0 2024-09-19T06:40:34.918 INFO:tasks.workunit.client.1.smithi117.stdout:2/440: write d0/f2b [911391,80591] 0 2024-09-19T06:40:34.918 INFO:tasks.workunit.client.1.smithi117.stdout:7/450: link d1/d3f/f73 d1/d4a/d7c/f9c 0 2024-09-19T06:40:34.920 INFO:tasks.workunit.client.1.smithi117.stdout:4/663: rmdir d3/db/d23/ddb 0 2024-09-19T06:40:34.922 INFO:tasks.workunit.client.1.smithi117.stdout:9/434: creat d4/d8/d6a/d82/f90 x:0 0 0 2024-09-19T06:40:34.922 INFO:tasks.workunit.client.1.smithi117.stdout:1/490: write d3/d18/d23/f52 [231259,123471] 0 2024-09-19T06:40:34.923 INFO:tasks.workunit.client.1.smithi117.stdout:5/498: mknod d17/d2e/d55/cac 0 2024-09-19T06:40:34.924 INFO:tasks.workunit.client.1.smithi117.stdout:8/500: getdents d1d/d1e/d53/d6e 0 2024-09-19T06:40:34.925 INFO:tasks.workunit.client.1.smithi117.stdout:6/337: mknod d1/d3/d25/c54 0 2024-09-19T06:40:34.925 INFO:tasks.workunit.client.1.smithi117.stdout:9/435: read - d4/d8/d6a/d82/f90 zero size 2024-09-19T06:40:34.927 INFO:tasks.workunit.client.1.smithi117.stdout:4/664: rename d3/d65/f75 to d3/db/d20/d29/d39/fdf 0 2024-09-19T06:40:34.927 INFO:tasks.workunit.client.1.smithi117.stdout:0/365: dwrite d11/d13/d1b/d27/d54/f57 [0,4194304] 0 2024-09-19T06:40:34.928 INFO:tasks.workunit.client.1.smithi117.stdout:5/499: dread - d17/d1b/d3a/d3c/d46/f97 zero size 2024-09-19T06:40:34.928 INFO:tasks.workunit.client.1.smithi117.stdout:1/491: creat d3/d18/d91/faa x:0 0 0 2024-09-19T06:40:34.928 INFO:tasks.workunit.client.1.smithi117.stdout:4/665: chown d3/d28 19185608 1 2024-09-19T06:40:34.929 INFO:tasks.workunit.client.0.smithi099.stdout:0/316: sync 2024-09-19T06:40:34.932 INFO:tasks.workunit.client.1.smithi117.stdout:4/666: readlink d3/db/d13/l26 0 2024-09-19T06:40:34.932 INFO:tasks.workunit.client.1.smithi117.stdout:1/492: fdatasync d3/d22/d2f/f60 0 2024-09-19T06:40:34.933 INFO:tasks.workunit.client.1.smithi117.stdout:0/366: chown d11/d13/d1b/d4b/f75 6678315 1 2024-09-19T06:40:34.936 INFO:tasks.workunit.client.1.smithi117.stdout:8/501: rename d1d/d2a/d3f/d4b/d5f/d7c to d1d/d2a/d3f/d4b/d66/dac 0 2024-09-19T06:40:34.937 INFO:tasks.workunit.client.1.smithi117.stdout:4/667: read - d3/db/d20/d4a/d7b/fde zero size 2024-09-19T06:40:34.937 INFO:tasks.workunit.client.0.smithi099.stdout:9/433: chown dd/d47/d40/c29 1664 1 2024-09-19T06:40:34.938 INFO:tasks.workunit.client.0.smithi099.stdout:6/377: mkdir d1/d5/d24/d2e/d7b 0 2024-09-19T06:40:34.939 INFO:tasks.workunit.client.1.smithi117.stdout:1/493: rmdir d3/d22/d2f 39 2024-09-19T06:40:34.940 INFO:tasks.workunit.client.0.smithi099.stdout:8/258: dread d4/f30 [0,4194304] 0 2024-09-19T06:40:34.941 INFO:tasks.workunit.client.0.smithi099.stdout:3/435: dwrite d7/f49 [0,4194304] 0 2024-09-19T06:40:34.941 INFO:tasks.workunit.client.0.smithi099.stdout:7/446: creat d7/dd/d97/fa2 x:0 0 0 2024-09-19T06:40:34.941 INFO:tasks.workunit.client.0.smithi099.stdout:9/434: mknod dd/c8e 0 2024-09-19T06:40:34.942 INFO:tasks.workunit.client.1.smithi117.stdout:4/668: readlink d3/d4/d14/l52 0 2024-09-19T06:40:34.942 INFO:tasks.workunit.client.1.smithi117.stdout:0/367: creat d11/d13/d14/d16/f77 x:0 0 0 2024-09-19T06:40:34.943 INFO:tasks.workunit.client.0.smithi099.stdout:3/436: dread - d7/d34/d1d/d36/d69/d6d/f7b zero size 2024-09-19T06:40:34.944 INFO:tasks.workunit.client.1.smithi117.stdout:8/502: mkdir d1d/d31/d83/dad 0 2024-09-19T06:40:34.946 INFO:tasks.workunit.client.0.smithi099.stdout:3/437: read d7/d34/d1d/d20/f67 [3016773,121639] 0 2024-09-19T06:40:34.946 INFO:tasks.workunit.client.0.smithi099.stdout:9/435: creat dd/d62/d76/f8f x:0 0 0 2024-09-19T06:40:34.947 INFO:tasks.workunit.client.1.smithi117.stdout:6/338: dwrite d1/d14/f15 [0,4194304] 0 2024-09-19T06:40:34.950 INFO:tasks.workunit.client.1.smithi117.stdout:3/483: dread d0/d19/d2b/d8e/f2f [0,4194304] 0 2024-09-19T06:40:34.952 INFO:tasks.workunit.client.1.smithi117.stdout:5/500: dwrite d17/f41 [0,4194304] 0 2024-09-19T06:40:34.952 INFO:tasks.workunit.client.0.smithi099.stdout:8/259: link d4/de/d26/d2b/f52 d4/f5b 0 2024-09-19T06:40:34.953 INFO:tasks.workunit.client.1.smithi117.stdout:9/436: dwrite d4/f7 [0,4194304] 0 2024-09-19T06:40:34.955 INFO:tasks.workunit.client.0.smithi099.stdout:3/438: unlink d7/f10 0 2024-09-19T06:40:34.956 INFO:tasks.workunit.client.0.smithi099.stdout:9/436: symlink dd/d47/d40/d61/l90 0 2024-09-19T06:40:34.961 INFO:tasks.workunit.client.0.smithi099.stdout:8/260: creat d4/de/d26/f5c x:0 0 0 2024-09-19T06:40:34.961 INFO:tasks.workunit.client.1.smithi117.stdout:4/669: creat d3/d1b/d7d/d9f/fe0 x:0 0 0 2024-09-19T06:40:34.961 INFO:tasks.workunit.client.0.smithi099.stdout:3/439: symlink d7/d34/d1d/d36/d69/l7c 0 2024-09-19T06:40:34.963 INFO:tasks.workunit.client.0.smithi099.stdout:9/437: symlink dd/d62/d76/l91 0 2024-09-19T06:40:34.963 INFO:tasks.workunit.client.0.smithi099.stdout:3/440: truncate d7/d34/f3a 4511162 0 2024-09-19T06:40:34.963 INFO:tasks.workunit.client.0.smithi099.stdout:7/447: link d7/dd/d29/d34/c44 d7/dd/d97/ca3 0 2024-09-19T06:40:34.965 INFO:tasks.workunit.client.0.smithi099.stdout:8/261: write d4/de/f16 [4548181,83952] 0 2024-09-19T06:40:34.968 INFO:tasks.workunit.client.0.smithi099.stdout:9/438: creat dd/d65/f92 x:0 0 0 2024-09-19T06:40:34.968 INFO:tasks.workunit.client.0.smithi099.stdout:8/262: write d4/f54 [638881,31284] 0 2024-09-19T06:40:34.968 INFO:tasks.workunit.client.1.smithi117.stdout:1/494: write d3/d22/d2f/f62 [4170402,24577] 0 2024-09-19T06:40:34.969 INFO:tasks.workunit.client.1.smithi117.stdout:0/368: write d11/d13/d1b/d27/f40 [655415,15603] 0 2024-09-19T06:40:34.969 INFO:tasks.workunit.client.0.smithi099.stdout:8/263: write d4/fa [1572384,30897] 0 2024-09-19T06:40:34.970 INFO:tasks.workunit.client.1.smithi117.stdout:8/503: rename d1d/d1e/d53/d6e/l8a to d1d/d2a/d3f/d4b/d5f/lae 0 2024-09-19T06:40:34.970 INFO:tasks.workunit.client.1.smithi117.stdout:7/451: dread d1/d4a/d81/f1a [0,4194304] 0 2024-09-19T06:40:34.971 INFO:tasks.workunit.client.0.smithi099.stdout:7/448: getdents d7/d39 0 2024-09-19T06:40:34.972 INFO:tasks.workunit.client.1.smithi117.stdout:2/441: dwrite d0/d7/d1e/d20/d3e/f91 [0,4194304] 0 2024-09-19T06:40:34.973 INFO:tasks.workunit.client.1.smithi117.stdout:0/369: dread - d11/d13/d28/f5d zero size 2024-09-19T06:40:34.976 INFO:tasks.workunit.client.1.smithi117.stdout:6/339: dwrite d1/d14/f15 [0,4194304] 0 2024-09-19T06:40:34.977 INFO:tasks.workunit.client.1.smithi117.stdout:4/670: mknod d3/d65/d66/ce1 0 2024-09-19T06:40:34.978 INFO:tasks.workunit.client.0.smithi099.stdout:9/439: dwrite dd/d47/d40/f36 [0,4194304] 0 2024-09-19T06:40:34.979 INFO:tasks.workunit.client.0.smithi099.stdout:3/441: dwrite d7/d34/d1d/d20/f67 [0,4194304] 0 2024-09-19T06:40:34.979 INFO:tasks.workunit.client.1.smithi117.stdout:1/495: write d3/d18/d23/f4f [2736493,55394] 0 2024-09-19T06:40:34.981 INFO:tasks.workunit.client.1.smithi117.stdout:4/671: readlink d3/db/d20/d29/d39/d4f/lbc 0 2024-09-19T06:40:34.982 INFO:tasks.workunit.client.0.smithi099.stdout:9/440: truncate dd/d47/d40/f56 4288234 0 2024-09-19T06:40:34.984 INFO:tasks.workunit.client.1.smithi117.stdout:8/504: dwrite d1d/d2a/f2f [0,4194304] 0 2024-09-19T06:40:34.986 INFO:tasks.workunit.client.1.smithi117.stdout:5/501: rename d17/d1b/d3a/d3c/f53 to d17/d2e/dab/fad 0 2024-09-19T06:40:34.987 INFO:tasks.workunit.client.1.smithi117.stdout:9/437: getdents d4/d1c 0 2024-09-19T06:40:34.988 INFO:tasks.workunit.client.0.smithi099.stdout:9/441: dread dd/f44 [0,4194304] 0 2024-09-19T06:40:34.990 INFO:tasks.workunit.client.1.smithi117.stdout:7/452: creat d1/d4a/d81/d24/d1c/d35/f9d x:0 0 0 2024-09-19T06:40:34.993 INFO:tasks.workunit.client.1.smithi117.stdout:1/496: mknod d3/d18/d91/cab 0 2024-09-19T06:40:34.994 INFO:tasks.workunit.client.1.smithi117.stdout:6/340: dread d1/d3/f20 [0,4194304] 0 2024-09-19T06:40:34.996 INFO:tasks.workunit.client.1.smithi117.stdout:0/370: rename d11/d13/l2d to d11/d13/d14/d2c/d35/l78 0 2024-09-19T06:40:34.997 INFO:tasks.workunit.client.1.smithi117.stdout:4/672: fdatasync d3/db/d20/fbe 0 2024-09-19T06:40:34.997 INFO:tasks.workunit.client.1.smithi117.stdout:8/505: dread d1d/d1e/d53/d6e/f92 [0,4194304] 0 2024-09-19T06:40:35.000 INFO:tasks.workunit.client.1.smithi117.stdout:5/502: read d17/d2e/f5f [68443,33649] 0 2024-09-19T06:40:35.002 INFO:tasks.workunit.client.1.smithi117.stdout:8/506: write d1d/d2a/f76 [604927,59022] 0 2024-09-19T06:40:35.002 INFO:tasks.workunit.client.1.smithi117.stdout:4/673: chown d3/db/d20/d35/d79/fa6 399 1 2024-09-19T06:40:35.004 INFO:tasks.workunit.client.1.smithi117.stdout:9/438: rename d4/d1c/c79 to d4/d1c/d46/c91 0 2024-09-19T06:40:35.006 INFO:tasks.workunit.client.1.smithi117.stdout:6/341: symlink d1/d3d/l55 0 2024-09-19T06:40:35.007 INFO:tasks.workunit.client.1.smithi117.stdout:4/674: creat d3/d4/fe2 x:0 0 0 2024-09-19T06:40:35.007 INFO:tasks.workunit.client.1.smithi117.stdout:5/503: rmdir d17/d5c 39 2024-09-19T06:40:35.008 INFO:tasks.workunit.client.1.smithi117.stdout:0/371: dread d11/d13/d28/f43 [0,4194304] 0 2024-09-19T06:40:35.008 INFO:tasks.workunit.client.1.smithi117.stdout:8/507: creat d1d/d2a/d3f/d4b/d66/dac/faf x:0 0 0 2024-09-19T06:40:35.009 INFO:tasks.workunit.client.1.smithi117.stdout:6/342: dread - d1/d5/d8/f4f zero size 2024-09-19T06:40:35.010 INFO:tasks.workunit.client.1.smithi117.stdout:4/675: chown d3/db/d20/d29/l64 1 1 2024-09-19T06:40:35.010 INFO:tasks.workunit.client.1.smithi117.stdout:9/439: truncate d4/d17/f7b 2291794 0 2024-09-19T06:40:35.012 INFO:tasks.workunit.client.1.smithi117.stdout:0/372: mknod d11/d13/d14/d2c/d35/c79 0 2024-09-19T06:40:35.013 INFO:tasks.workunit.client.1.smithi117.stdout:8/508: write f4 [3093080,62556] 0 2024-09-19T06:40:35.016 INFO:tasks.workunit.client.1.smithi117.stdout:4/676: truncate d3/d65/d66/fab 951212 0 2024-09-19T06:40:35.016 INFO:tasks.workunit.client.1.smithi117.stdout:0/373: truncate d11/f48 459706 0 2024-09-19T06:40:35.016 INFO:tasks.workunit.client.1.smithi117.stdout:6/343: rename d1/d14/f2e to d1/d5/f56 0 2024-09-19T06:40:35.017 INFO:tasks.workunit.client.0.smithi099.stdout:3/442: dread d7/d34/d1d/d36/d42/f62 [0,4194304] 0 2024-09-19T06:40:35.018 INFO:tasks.workunit.client.1.smithi117.stdout:8/509: write d1d/d2a/d3f/d4b/d66/f8d [771259,83264] 0 2024-09-19T06:40:35.018 INFO:tasks.workunit.client.1.smithi117.stdout:0/374: readlink d11/d13/d14/l51 0 2024-09-19T06:40:35.019 INFO:tasks.workunit.client.0.smithi099.stdout:3/443: creat d7/d34/d1d/d20/f7d x:0 0 0 2024-09-19T06:40:35.020 INFO:tasks.workunit.client.1.smithi117.stdout:5/504: dwrite d17/d2e/f32 [0,4194304] 0 2024-09-19T06:40:35.021 INFO:tasks.workunit.client.1.smithi117.stdout:6/344: mknod d1/d3d/c57 0 2024-09-19T06:40:35.023 INFO:tasks.workunit.client.1.smithi117.stdout:6/345: write d1/d3/f20 [1362332,91395] 0 2024-09-19T06:40:35.023 INFO:tasks.workunit.client.0.smithi099.stdout:3/444: creat d7/d34/d1d/d20/d75/f7e x:0 0 0 2024-09-19T06:40:35.025 INFO:tasks.workunit.client.0.smithi099.stdout:7/449: dwrite d7/dd/d29/f1e [0,4194304] 0 2024-09-19T06:40:35.029 INFO:tasks.workunit.client.0.smithi099.stdout:7/450: creat d7/dd/d29/d1f/d45/d48/d63/d75/fa4 x:0 0 0 2024-09-19T06:40:35.030 INFO:tasks.workunit.client.0.smithi099.stdout:3/445: symlink d7/d34/d1d/l7f 0 2024-09-19T06:40:35.031 INFO:tasks.workunit.client.1.smithi117.stdout:0/375: truncate d11/f5a 461228 0 2024-09-19T06:40:35.033 INFO:tasks.workunit.client.0.smithi099.stdout:7/451: unlink d7/dd/ca0 0 2024-09-19T06:40:35.033 INFO:tasks.workunit.client.1.smithi117.stdout:9/440: dread d4/d17/f61 [0,4194304] 0 2024-09-19T06:40:35.034 INFO:tasks.workunit.client.1.smithi117.stdout:2/442: dread d0/ff [0,4194304] 0 2024-09-19T06:40:35.036 INFO:tasks.workunit.client.1.smithi117.stdout:5/505: creat d17/d1b/d5d/d86/fae x:0 0 0 2024-09-19T06:40:35.037 INFO:tasks.workunit.client.1.smithi117.stdout:9/441: dread - d4/d20/f53 zero size 2024-09-19T06:40:35.037 INFO:tasks.workunit.client.0.smithi099.stdout:3/446: dwrite d7/f49 [0,4194304] 0 2024-09-19T06:40:35.039 INFO:tasks.workunit.client.0.smithi099.stdout:7/452: creat d7/dd/d29/d34/da1/fa5 x:0 0 0 2024-09-19T06:40:35.039 INFO:tasks.workunit.client.1.smithi117.stdout:6/346: getdents d1/d5/d8/d27 0 2024-09-19T06:40:35.040 INFO:tasks.workunit.client.1.smithi117.stdout:0/376: mkdir d11/d13/d7a 0 2024-09-19T06:40:35.041 INFO:tasks.workunit.client.0.smithi099.stdout:7/453: creat d7/dd/d29/d4e/fa6 x:0 0 0 2024-09-19T06:40:35.041 INFO:tasks.workunit.client.0.smithi099.stdout:7/454: readlink d7/l81 0 2024-09-19T06:40:35.042 INFO:tasks.workunit.client.0.smithi099.stdout:7/455: dread - d7/dd/d29/d4e/d53/d64/d67/f91 zero size 2024-09-19T06:40:35.045 INFO:tasks.workunit.client.0.smithi099.stdout:7/456: symlink d7/dd/d29/d1f/d45/d48/d63/d75/la7 0 2024-09-19T06:40:35.046 INFO:tasks.workunit.client.0.smithi099.stdout:7/457: write d7/dd/d29/d1f/d45/f78 [52959,105559] 0 2024-09-19T06:40:35.049 INFO:tasks.workunit.client.1.smithi117.stdout:7/453: dwrite d1/d3f/f73 [0,4194304] 0 2024-09-19T06:40:35.054 INFO:tasks.workunit.client.0.smithi099.stdout:7/458: dwrite d7/d39/f6b [0,4194304] 0 2024-09-19T06:40:35.055 INFO:tasks.workunit.client.0.smithi099.stdout:1/283: sync 2024-09-19T06:40:35.055 INFO:tasks.workunit.client.0.smithi099.stdout:2/210: sync 2024-09-19T06:40:35.056 INFO:tasks.workunit.client.1.smithi117.stdout:0/377: write d11/d13/d14/d2c/f2f [4790356,10951] 0 2024-09-19T06:40:35.056 INFO:tasks.workunit.client.0.smithi099.stdout:1/284: fdatasync d0/d12/f30 0 2024-09-19T06:40:35.056 INFO:tasks.workunit.client.0.smithi099.stdout:7/459: fdatasync d7/dd/d29/d1f/d45/d48/d63/d75/fa4 0 2024-09-19T06:40:35.057 INFO:tasks.workunit.client.1.smithi117.stdout:8/510: dwrite d1d/f27 [0,4194304] 0 2024-09-19T06:40:35.059 INFO:tasks.workunit.client.0.smithi099.stdout:2/211: mknod d1/d2/c4a 0 2024-09-19T06:40:35.060 INFO:tasks.workunit.client.1.smithi117.stdout:5/506: dread d17/d2e/d55/f6e [0,4194304] 0 2024-09-19T06:40:35.061 INFO:tasks.workunit.client.0.smithi099.stdout:1/285: mknod d0/d17/c5f 0 2024-09-19T06:40:35.061 INFO:tasks.workunit.client.0.smithi099.stdout:7/460: creat d7/dd/d29/d34/fa8 x:0 0 0 2024-09-19T06:40:35.062 INFO:tasks.workunit.client.1.smithi117.stdout:7/454: read - d1/d4a/d81/f54 zero size 2024-09-19T06:40:35.064 INFO:tasks.workunit.client.1.smithi117.stdout:4/677: dwrite d3/db/d20/d35/f4c [0,4194304] 0 2024-09-19T06:40:35.065 INFO:tasks.workunit.client.0.smithi099.stdout:1/286: rename d0/d17/d24/c39 to d0/d17/d32/c60 0 2024-09-19T06:40:35.069 INFO:tasks.workunit.client.0.smithi099.stdout:7/461: link d7/dd/d29/d1f/d45/d48/d63/d71/f94 d7/dd/d29/d34/da1/fa9 0 2024-09-19T06:40:35.069 INFO:tasks.workunit.client.1.smithi117.stdout:2/443: dwrite d0/d7/d29/d35/f97 [0,4194304] 0 2024-09-19T06:40:35.070 INFO:tasks.workunit.client.0.smithi099.stdout:7/462: write d7/f4d [4830469,20423] 0 2024-09-19T06:40:35.072 INFO:tasks.workunit.client.0.smithi099.stdout:3/447: dread d7/d34/d28/f48 [0,4194304] 0 2024-09-19T06:40:35.074 INFO:tasks.workunit.client.0.smithi099.stdout:7/463: mknod d7/d39/caa 0 2024-09-19T06:40:35.075 INFO:tasks.workunit.client.0.smithi099.stdout:2/212: dread d1/d2/d5/d8/d18/f23 [0,4194304] 0 2024-09-19T06:40:35.077 INFO:tasks.workunit.client.0.smithi099.stdout:7/464: mknod d7/cab 0 2024-09-19T06:40:35.079 INFO:tasks.workunit.client.1.smithi117.stdout:5/507: getdents d17/d1b/d3a/d3c 0 2024-09-19T06:40:35.084 INFO:tasks.workunit.client.0.smithi099.stdout:7/465: getdents d7/dd/d29/d4e 0 2024-09-19T06:40:35.084 INFO:tasks.workunit.client.1.smithi117.stdout:6/347: dwrite d1/d5/d8/f4f [0,4194304] 0 2024-09-19T06:40:35.085 INFO:tasks.workunit.client.0.smithi099.stdout:2/213: dwrite d1/d2/d5/d8/d18/f23 [0,4194304] 0 2024-09-19T06:40:35.090 INFO:tasks.workunit.client.1.smithi117.stdout:0/378: dwrite d11/d13/d1b/d27/d37/f5e [0,4194304] 0 2024-09-19T06:40:35.095 INFO:tasks.workunit.client.0.smithi099.stdout:7/466: dwrite d7/dd/d29/d1f/d45/f8b [0,4194304] 0 2024-09-19T06:40:35.096 INFO:tasks.workunit.client.1.smithi117.stdout:8/511: dwrite d1d/d2a/d3f/d73/f85 [0,4194304] 0 2024-09-19T06:40:35.096 INFO:tasks.workunit.client.1.smithi117.stdout:2/444: rename d0/d7/d29/d35/d3d/c5a to d0/d7/d29/d35/d61/d65/cac 0 2024-09-19T06:40:35.099 INFO:tasks.workunit.client.0.smithi099.stdout:2/214: getdents d1/d2/d5/d8/d18/d27 0 2024-09-19T06:40:35.100 INFO:tasks.workunit.client.1.smithi117.stdout:7/455: dwrite d1/d4a/f7b [0,4194304] 0 2024-09-19T06:40:35.106 INFO:tasks.workunit.client.1.smithi117.stdout:0/379: symlink d11/l7b 0 2024-09-19T06:40:35.107 INFO:tasks.workunit.client.1.smithi117.stdout:4/678: dread d3/d1b/d7d/d51/d95/f99 [0,4194304] 0 2024-09-19T06:40:35.107 INFO:tasks.workunit.client.0.smithi099.stdout:7/467: creat d7/dd/d29/d4e/d53/fac x:0 0 0 2024-09-19T06:40:35.108 INFO:tasks.workunit.client.1.smithi117.stdout:9/442: dwrite d4/d1c/d36/d37/f39 [0,4194304] 0 2024-09-19T06:40:35.109 INFO:tasks.workunit.client.0.smithi099.stdout:7/468: write d7/dd/d29/f93 [505921,122318] 0 2024-09-19T06:40:35.110 INFO:tasks.workunit.client.1.smithi117.stdout:0/380: stat d11/d13/d14/d2c/d35/d3e/c66 0 2024-09-19T06:40:35.110 INFO:tasks.workunit.client.0.smithi099.stdout:2/215: mknod d1/d2/d24/c4b 0 2024-09-19T06:40:35.112 INFO:tasks.workunit.client.1.smithi117.stdout:7/456: readlink d1/d4a/d81/d24/d49/l4b 0 2024-09-19T06:40:35.112 INFO:tasks.workunit.client.0.smithi099.stdout:7/469: dread - d7/dd/d29/d4e/d53/d64/f68 zero size 2024-09-19T06:40:35.113 INFO:tasks.workunit.client.0.smithi099.stdout:3/448: write d7/f18 [840768,7346] 0 2024-09-19T06:40:35.113 INFO:tasks.workunit.client.1.smithi117.stdout:5/508: dwrite d17/d1b/d5d/d7d/fa8 [0,4194304] 0 2024-09-19T06:40:35.114 INFO:tasks.workunit.client.0.smithi099.stdout:7/470: chown d7/dd/d29/f93 399763 1 2024-09-19T06:40:35.114 INFO:tasks.workunit.client.1.smithi117.stdout:0/381: chown d11/d13/d14/d2c/f6a 59211302 1 2024-09-19T06:40:35.116 INFO:tasks.workunit.client.1.smithi117.stdout:9/443: stat d4/f19 0 2024-09-19T06:40:35.116 INFO:tasks.workunit.client.1.smithi117.stdout:8/512: read d1d/d1e/d53/d6e/f92 [349507,32218] 0 2024-09-19T06:40:35.118 INFO:tasks.workunit.client.0.smithi099.stdout:1/287: dwrite d0/d12/d13/f33 [0,4194304] 0 2024-09-19T06:40:35.119 INFO:tasks.workunit.client.0.smithi099.stdout:7/471: creat d7/dd/d97/fad x:0 0 0 2024-09-19T06:40:35.120 INFO:tasks.workunit.client.0.smithi099.stdout:3/449: unlink d7/d34/d1d/d36/d42/f40 0 2024-09-19T06:40:35.122 INFO:tasks.workunit.client.0.smithi099.stdout:3/450: stat d7/d34/f70 0 2024-09-19T06:40:35.122 INFO:tasks.workunit.client.1.smithi117.stdout:0/382: write fd [4643551,64601] 0 2024-09-19T06:40:35.123 INFO:tasks.workunit.client.1.smithi117.stdout:0/383: chown d11/d13/d7a 17951419 1 2024-09-19T06:40:35.124 INFO:tasks.workunit.client.0.smithi099.stdout:7/472: creat d7/dd/d29/d1f/d45/d48/d63/fae x:0 0 0 2024-09-19T06:40:35.124 INFO:tasks.workunit.client.1.smithi117.stdout:4/679: creat d3/d1b/fe3 x:0 0 0 2024-09-19T06:40:35.128 INFO:tasks.workunit.client.1.smithi117.stdout:0/384: mknod d11/d13/d1b/d4b/c7c 0 2024-09-19T06:40:35.129 INFO:tasks.workunit.client.1.smithi117.stdout:4/680: mknod d3/db/d20/d4a/d7b/da0/ce4 0 2024-09-19T06:40:35.129 INFO:tasks.workunit.client.0.smithi099.stdout:7/473: chown d7/dd/d29/f33 492020 1 2024-09-19T06:40:35.129 INFO:tasks.workunit.client.0.smithi099.stdout:1/288: dread d0/f29 [4194304,4194304] 0 2024-09-19T06:40:35.130 INFO:tasks.workunit.client.1.smithi117.stdout:9/444: dread d4/d1c/d7a/f2f [0,4194304] 0 2024-09-19T06:40:35.131 INFO:tasks.workunit.client.1.smithi117.stdout:7/457: link d1/d3f/f70 d1/d4a/d81/d48/d5f/d82/f9e 0 2024-09-19T06:40:35.131 INFO:tasks.workunit.client.0.smithi099.stdout:3/451: symlink d7/d34/d1d/d20/d58/l80 0 2024-09-19T06:40:35.132 INFO:tasks.workunit.client.1.smithi117.stdout:8/513: creat d1d/fb0 x:0 0 0 2024-09-19T06:40:35.132 INFO:tasks.workunit.client.1.smithi117.stdout:0/385: rmdir d11/d13/d1b/d27/d37 39 2024-09-19T06:40:35.133 INFO:tasks.workunit.client.0.smithi099.stdout:7/474: creat d7/dd/d29/d34/d8f/faf x:0 0 0 2024-09-19T06:40:35.133 INFO:tasks.workunit.client.1.smithi117.stdout:4/681: rmdir d3/db 39 2024-09-19T06:40:35.133 INFO:tasks.workunit.client.1.smithi117.stdout:8/514: dread - d1d/d2a/d3f/d4b/f96 zero size 2024-09-19T06:40:35.133 INFO:tasks.workunit.client.1.smithi117.stdout:4/682: write d3/d41/f89 [1099851,36067] 0 2024-09-19T06:40:35.134 INFO:tasks.workunit.client.1.smithi117.stdout:7/458: mknod d1/d4a/d81/d24/d26/c9f 0 2024-09-19T06:40:35.135 INFO:tasks.workunit.client.0.smithi099.stdout:3/452: creat d7/d34/d1d/d36/d69/d6d/d7a/f81 x:0 0 0 2024-09-19T06:40:35.135 INFO:tasks.workunit.client.1.smithi117.stdout:9/445: symlink d4/d1c/l92 0 2024-09-19T06:40:35.136 INFO:tasks.workunit.client.1.smithi117.stdout:4/683: write d3/d65/d66/fd1 [876118,109147] 0 2024-09-19T06:40:35.137 INFO:tasks.workunit.client.1.smithi117.stdout:7/459: creat d1/d4a/d81/d24/d49/fa0 x:0 0 0 2024-09-19T06:40:35.138 INFO:tasks.workunit.client.0.smithi099.stdout:1/289: dwrite d0/d2d/f43 [0,4194304] 0 2024-09-19T06:40:35.139 INFO:tasks.workunit.client.1.smithi117.stdout:0/386: creat d11/d13/d1b/d27/f7d x:0 0 0 2024-09-19T06:40:35.141 INFO:tasks.workunit.client.1.smithi117.stdout:4/684: stat d3/db/d20/d29/d39 0 2024-09-19T06:40:35.142 INFO:tasks.workunit.client.1.smithi117.stdout:8/515: creat d1d/fb1 x:0 0 0 2024-09-19T06:40:35.142 INFO:tasks.workunit.client.0.smithi099.stdout:1/290: symlink d0/d12/d13/d37/l61 0 2024-09-19T06:40:35.144 INFO:tasks.workunit.client.1.smithi117.stdout:8/516: readlink d1d/l3d 0 2024-09-19T06:40:35.144 INFO:tasks.workunit.client.0.smithi099.stdout:3/453: dwrite d7/d34/f3d [0,4194304] 0 2024-09-19T06:40:35.145 INFO:tasks.workunit.client.1.smithi117.stdout:0/387: mkdir d11/d13/d14/d2c/d53/d7e 0 2024-09-19T06:40:35.146 INFO:tasks.workunit.client.0.smithi099.stdout:3/454: write d7/d34/d1d/d20/d75/f7e [860819,21098] 0 2024-09-19T06:40:35.148 INFO:tasks.workunit.client.0.smithi099.stdout:1/291: unlink d0/db/c34 0 2024-09-19T06:40:35.149 INFO:tasks.workunit.client.1.smithi117.stdout:6/348: dwrite d1/d5/d8/d27/f47 [0,4194304] 0 2024-09-19T06:40:35.149 INFO:tasks.workunit.client.1.smithi117.stdout:4/685: mkdir d3/d1b/d7d/d51/d95/de5 0 2024-09-19T06:40:35.149 INFO:tasks.workunit.client.1.smithi117.stdout:0/388: rmdir d11/d13/d28/d38 39 2024-09-19T06:40:35.150 INFO:tasks.workunit.client.0.smithi099.stdout:3/455: rmdir d7/d34/d1d 39 2024-09-19T06:40:35.151 INFO:tasks.workunit.client.1.smithi117.stdout:6/349: stat d1/d3/d25/f52 0 2024-09-19T06:40:35.154 INFO:tasks.workunit.client.0.smithi099.stdout:1/292: mknod d0/d17/d24/d5e/c62 0 2024-09-19T06:40:35.154 INFO:tasks.workunit.client.0.smithi099.stdout:1/293: write d0/db/f31 [232993,92810] 0 2024-09-19T06:40:35.155 INFO:tasks.workunit.client.1.smithi117.stdout:6/350: readlink d1/d5/d8/d27/l2f 0 2024-09-19T06:40:35.155 INFO:tasks.workunit.client.1.smithi117.stdout:7/460: rename d1/c71 to d1/d4a/d81/d48/ca1 0 2024-09-19T06:40:35.156 INFO:tasks.workunit.client.0.smithi099.stdout:3/456: readlink d7/d34/l1c 0 2024-09-19T06:40:35.156 INFO:tasks.workunit.client.0.smithi099.stdout:1/294: write d0/d12/d13/f2b [5171637,100818] 0 2024-09-19T06:40:35.157 INFO:tasks.workunit.client.1.smithi117.stdout:2/445: truncate d0/fd 4638615 0 2024-09-19T06:40:35.161 INFO:tasks.workunit.client.0.smithi099.stdout:1/295: mknod d0/c63 0 2024-09-19T06:40:35.161 INFO:tasks.workunit.client.0.smithi099.stdout:3/457: mknod d7/d34/d28/c82 0 2024-09-19T06:40:35.162 INFO:tasks.workunit.client.1.smithi117.stdout:7/461: mknod d1/d4a/d77/ca2 0 2024-09-19T06:40:35.162 INFO:tasks.workunit.client.1.smithi117.stdout:8/517: dwrite d1d/d2a/fa1 [0,4194304] 0 2024-09-19T06:40:35.162 INFO:tasks.workunit.client.1.smithi117.stdout:5/509: truncate d17/f89 258717 0 2024-09-19T06:40:35.166 INFO:tasks.workunit.client.0.smithi099.stdout:3/458: creat d7/d34/d1d/d20/d58/d5c/f83 x:0 0 0 2024-09-19T06:40:35.168 INFO:tasks.workunit.client.1.smithi117.stdout:6/351: rename d1/d3d/c48 to d1/d5/d8/d27/c58 0 2024-09-19T06:40:35.169 INFO:tasks.workunit.client.1.smithi117.stdout:6/352: readlink d1/l26 0 2024-09-19T06:40:35.169 INFO:tasks.workunit.client.0.smithi099.stdout:3/459: mknod d7/d34/d1d/d36/d69/d6d/d7a/c84 0 2024-09-19T06:40:35.170 INFO:tasks.workunit.client.1.smithi117.stdout:8/518: dread d1d/d1e/f3e [0,4194304] 0 2024-09-19T06:40:35.171 INFO:tasks.workunit.client.0.smithi099.stdout:3/460: stat d7/d34/d1d/l5b 0 2024-09-19T06:40:35.173 INFO:tasks.workunit.client.1.smithi117.stdout:5/510: dwrite d17/d5c/f69 [4194304,4194304] 0 2024-09-19T06:40:35.176 INFO:tasks.workunit.client.1.smithi117.stdout:8/519: symlink d1d/d2a/d3f/d4b/d66/dac/lb2 0 2024-09-19T06:40:35.176 INFO:tasks.workunit.client.1.smithi117.stdout:7/462: link d1/d4a/d81/l36 d1/d4a/d81/d24/d1c/d35/d4f/la3 0 2024-09-19T06:40:35.182 INFO:tasks.workunit.client.1.smithi117.stdout:9/446: dread d4/d8/d6e/f6f [0,4194304] 0 2024-09-19T06:40:35.182 INFO:tasks.workunit.client.1.smithi117.stdout:0/389: write d11/d13/d14/d2c/f6a [708878,99045] 0 2024-09-19T06:40:35.183 INFO:tasks.workunit.client.1.smithi117.stdout:5/511: dwrite ff [0,4194304] 0 2024-09-19T06:40:35.183 INFO:tasks.workunit.client.1.smithi117.stdout:7/463: read - d1/d4a/d81/d48/d5f/f91 zero size 2024-09-19T06:40:35.184 INFO:tasks.workunit.client.1.smithi117.stdout:9/447: readlink d4/la 0 2024-09-19T06:40:35.186 INFO:tasks.workunit.client.1.smithi117.stdout:5/512: mkdir d17/d2f/d3b/daf 0 2024-09-19T06:40:35.187 INFO:tasks.workunit.client.1.smithi117.stdout:7/464: creat d1/d4a/d81/fa4 x:0 0 0 2024-09-19T06:40:35.188 INFO:tasks.workunit.client.1.smithi117.stdout:0/390: fsync d11/d13/d14/f1d 0 2024-09-19T06:40:35.188 INFO:tasks.workunit.client.1.smithi117.stdout:5/513: truncate d17/f74 4366760 0 2024-09-19T06:40:35.189 INFO:tasks.workunit.client.1.smithi117.stdout:9/448: truncate d4/f7f 857361 0 2024-09-19T06:40:35.190 INFO:tasks.workunit.client.1.smithi117.stdout:5/514: chown d17/d2f/d6a/f75 56419186 1 2024-09-19T06:40:35.190 INFO:tasks.workunit.client.1.smithi117.stdout:7/465: chown d1/d4a/d81/d24/d1c/d35/d4f/l8b 3 1 2024-09-19T06:40:35.193 INFO:tasks.workunit.client.0.smithi099.stdout:3/461: dread d7/d34/d1d/d36/f38 [8388608,4194304] 0 2024-09-19T06:40:35.195 INFO:tasks.workunit.client.0.smithi099.stdout:3/462: mknod d7/d34/d28/c85 0 2024-09-19T06:40:35.196 INFO:tasks.workunit.client.1.smithi117.stdout:5/515: fdatasync d17/d1b/d3a/d3c/f3d 0 2024-09-19T06:40:35.196 INFO:tasks.workunit.client.1.smithi117.stdout:9/449: fsync d4/d1c/d46/f47 0 2024-09-19T06:40:35.197 INFO:tasks.workunit.client.1.smithi117.stdout:7/466: rename d1/f1e to d1/d4a/d81/d48/d5f/d82/fa5 0 2024-09-19T06:40:35.197 INFO:tasks.workunit.client.0.smithi099.stdout:4/340: sync 2024-09-19T06:40:35.199 INFO:tasks.workunit.client.1.smithi117.stdout:4/686: dread d3/db/f3a [0,4194304] 0 2024-09-19T06:40:35.200 INFO:tasks.workunit.client.1.smithi117.stdout:7/467: readlink d1/d4a/d81/d24/d49/l4b 0 2024-09-19T06:40:35.201 INFO:tasks.workunit.client.1.smithi117.stdout:6/353: truncate d1/d5/f56 5874863 0 2024-09-19T06:40:35.202 INFO:tasks.workunit.client.1.smithi117.stdout:0/391: creat d11/d13/d28/f7f x:0 0 0 2024-09-19T06:40:35.202 INFO:tasks.workunit.client.1.smithi117.stdout:2/446: dwrite d0/d7/d29/f5f [0,4194304] 0 2024-09-19T06:40:35.204 INFO:tasks.workunit.client.1.smithi117.stdout:8/520: truncate f4 203545 0 2024-09-19T06:40:35.207 INFO:tasks.workunit.client.1.smithi117.stdout:4/687: chown d3/d1b/d63/d84/ld5 0 1 2024-09-19T06:40:35.208 INFO:tasks.workunit.client.1.smithi117.stdout:6/354: mknod d1/d3/c59 0 2024-09-19T06:40:35.209 INFO:tasks.workunit.client.1.smithi117.stdout:3/484: sync 2024-09-19T06:40:35.211 INFO:tasks.workunit.client.0.smithi099.stdout:3/463: write d7/d34/d1d/d36/d42/f62 [1814191,110045] 0 2024-09-19T06:40:35.211 INFO:tasks.workunit.client.1.smithi117.stdout:7/468: dwrite d1/d4a/d81/fa4 [0,4194304] 0 2024-09-19T06:40:35.213 INFO:tasks.workunit.client.1.smithi117.stdout:0/392: creat d11/d13/d1b/d67/f80 x:0 0 0 2024-09-19T06:40:35.216 INFO:tasks.workunit.client.1.smithi117.stdout:8/521: symlink d1d/d2a/d3f/d4b/d5f/lb3 0 2024-09-19T06:40:35.218 INFO:tasks.workunit.client.1.smithi117.stdout:6/355: creat d1/d3d/f5a x:0 0 0 2024-09-19T06:40:35.223 INFO:tasks.workunit.client.1.smithi117.stdout:9/450: rename d4/d5d to d4/d1c/d73/d93 0 2024-09-19T06:40:35.224 INFO:tasks.workunit.client.1.smithi117.stdout:9/451: write d4/d17/f5e [1344019,24610] 0 2024-09-19T06:40:35.224 INFO:tasks.workunit.client.1.smithi117.stdout:4/688: truncate d3/d1b/d7d/d9f/fa2 2587531 0 2024-09-19T06:40:35.227 INFO:tasks.workunit.client.0.smithi099.stdout:4/341: dread f5 [0,4194304] 0 2024-09-19T06:40:35.229 INFO:tasks.workunit.client.0.smithi099.stdout:4/342: mknod d12/c76 0 2024-09-19T06:40:35.230 INFO:tasks.workunit.client.1.smithi117.stdout:3/485: rmdir d0/d9/d4e 39 2024-09-19T06:40:35.233 INFO:tasks.workunit.client.0.smithi099.stdout:4/343: link d12/d32/d42/d5c/f5d d12/d1b/d73/f77 0 2024-09-19T06:40:35.234 INFO:tasks.workunit.client.0.smithi099.stdout:4/344: write d12/d32/d42/f59 [9163,98175] 0 2024-09-19T06:40:35.235 INFO:tasks.workunit.client.1.smithi117.stdout:5/516: getdents d17/d1b/d5d/d86 0 2024-09-19T06:40:35.237 INFO:tasks.workunit.client.0.smithi099.stdout:3/464: dread d7/d34/d1d/d36/f38 [0,4194304] 0 2024-09-19T06:40:35.237 INFO:tasks.workunit.client.0.smithi099.stdout:4/345: write d12/d1b/d73/f77 [357513,46085] 0 2024-09-19T06:40:35.239 INFO:tasks.workunit.client.1.smithi117.stdout:8/522: rmdir d1d/d2a/d3f/d4b 39 2024-09-19T06:40:35.240 INFO:tasks.workunit.client.0.smithi099.stdout:3/465: creat d7/d34/d1d/d20/d75/d79/f86 x:0 0 0 2024-09-19T06:40:35.240 INFO:tasks.workunit.client.1.smithi117.stdout:8/523: fdatasync d1d/f40 0 2024-09-19T06:40:35.241 INFO:tasks.workunit.client.1.smithi117.stdout:5/517: dread d17/d1b/d3a/d3c/d46/fa0 [0,4194304] 0 2024-09-19T06:40:35.241 INFO:tasks.workunit.client.0.smithi099.stdout:4/346: mknod d12/d32/c78 0 2024-09-19T06:40:35.241 INFO:tasks.workunit.client.0.smithi099.stdout:3/466: write d7/f5f [1385288,6827] 0 2024-09-19T06:40:35.244 INFO:tasks.workunit.client.0.smithi099.stdout:4/347: chown d12/d32/d42/l57 438206 1 2024-09-19T06:40:35.245 INFO:tasks.workunit.client.0.smithi099.stdout:3/467: creat d7/d34/d1d/d57/d76/f87 x:0 0 0 2024-09-19T06:40:35.246 INFO:tasks.workunit.client.0.smithi099.stdout:4/348: mknod d12/d32/d42/d5c/c79 0 2024-09-19T06:40:35.248 INFO:tasks.workunit.client.1.smithi117.stdout:6/356: creat d1/d5/f5b x:0 0 0 2024-09-19T06:40:35.249 INFO:tasks.workunit.client.1.smithi117.stdout:2/447: truncate d0/d7/d29/d35/d3d/f43 89112 0 2024-09-19T06:40:35.250 INFO:tasks.workunit.client.1.smithi117.stdout:5/518: dread d17/d1b/f48 [0,4194304] 0 2024-09-19T06:40:35.250 INFO:tasks.workunit.client.1.smithi117.stdout:4/689: dread d3/db/ff [4194304,4194304] 0 2024-09-19T06:40:35.251 INFO:tasks.workunit.client.1.smithi117.stdout:7/469: rename d1/l6f to d1/d4a/d81/d48/la6 0 2024-09-19T06:40:35.253 INFO:tasks.workunit.client.1.smithi117.stdout:8/524: creat d1d/d1e/d29/fb4 x:0 0 0 2024-09-19T06:40:35.253 INFO:tasks.workunit.client.0.smithi099.stdout:3/468: dwrite d7/d34/d1d/d20/d58/d5c/f83 [0,4194304] 0 2024-09-19T06:40:35.254 INFO:tasks.workunit.client.1.smithi117.stdout:0/393: truncate d11/d13/d14/f45 7934931 0 2024-09-19T06:40:35.256 INFO:tasks.workunit.client.1.smithi117.stdout:0/394: read d11/f48 [14605,76334] 0 2024-09-19T06:40:35.258 INFO:tasks.workunit.client.1.smithi117.stdout:9/452: write d4/f51 [631313,89334] 0 2024-09-19T06:40:35.259 INFO:tasks.workunit.client.1.smithi117.stdout:5/519: chown d17/d2f/l9b 10102 1 2024-09-19T06:40:35.260 INFO:tasks.workunit.client.0.smithi099.stdout:3/469: getdents d7/d34/d1d/d20/d58 0 2024-09-19T06:40:35.261 INFO:tasks.workunit.client.0.smithi099.stdout:4/349: dwrite d12/f1a [0,4194304] 0 2024-09-19T06:40:35.261 INFO:tasks.workunit.client.1.smithi117.stdout:3/486: creat d0/d3d/d48/d77/d81/f8f x:0 0 0 2024-09-19T06:40:35.262 INFO:tasks.workunit.client.0.smithi099.stdout:3/470: write d7/d34/d1d/d36/d42/f6c [943133,93987] 0 2024-09-19T06:40:35.263 INFO:tasks.workunit.client.1.smithi117.stdout:4/690: unlink d3/d28/d2a/f8f 0 2024-09-19T06:40:35.264 INFO:tasks.workunit.client.0.smithi099.stdout:3/471: write d7/f55 [100193,84590] 0 2024-09-19T06:40:35.266 INFO:tasks.workunit.client.0.smithi099.stdout:3/472: fdatasync d7/f12 0 2024-09-19T06:40:35.266 INFO:tasks.workunit.client.1.smithi117.stdout:7/470: symlink d1/d4a/d81/d24/d1c/d35/la7 0 2024-09-19T06:40:35.266 INFO:tasks.workunit.client.1.smithi117.stdout:8/525: mkdir d1d/d2a/db5 0 2024-09-19T06:40:35.267 INFO:tasks.workunit.client.1.smithi117.stdout:6/357: mkdir d1/d3/d25/d5c 0 2024-09-19T06:40:35.268 INFO:tasks.workunit.client.0.smithi099.stdout:4/350: dread d12/d32/f29 [0,4194304] 0 2024-09-19T06:40:35.268 INFO:tasks.workunit.client.1.smithi117.stdout:0/395: creat d11/d13/d14/d2c/d64/f81 x:0 0 0 2024-09-19T06:40:35.268 INFO:tasks.workunit.client.0.smithi099.stdout:3/473: dread - d7/d34/f51 zero size 2024-09-19T06:40:35.270 INFO:tasks.workunit.client.0.smithi099.stdout:3/474: fsync d7/ff 0 2024-09-19T06:40:35.270 INFO:tasks.workunit.client.0.smithi099.stdout:3/475: chown d7/d34/d28/f48 938 1 2024-09-19T06:40:35.271 INFO:tasks.workunit.client.1.smithi117.stdout:3/487: unlink d0/d19/d2b/d8e/l87 0 2024-09-19T06:40:35.271 INFO:tasks.workunit.client.0.smithi099.stdout:3/476: chown d7/d34/d28/c85 18557954 1 2024-09-19T06:40:35.271 INFO:tasks.workunit.client.0.smithi099.stdout:3/477: fdatasync d7/f49 0 2024-09-19T06:40:35.272 INFO:tasks.workunit.client.0.smithi099.stdout:4/351: creat d12/d1b/d73/f7a x:0 0 0 2024-09-19T06:40:35.272 INFO:tasks.workunit.client.1.smithi117.stdout:4/691: unlink d3/db/d20/d29/d39/lad 0 2024-09-19T06:40:35.274 INFO:tasks.workunit.client.1.smithi117.stdout:4/692: read d3/db/d20/f36 [193682,71672] 0 2024-09-19T06:40:35.276 INFO:tasks.workunit.client.1.smithi117.stdout:4/693: write d3/d4/d14/f56 [1321781,49918] 0 2024-09-19T06:40:35.276 INFO:tasks.workunit.client.0.smithi099.stdout:4/352: rmdir d12/d1b 39 2024-09-19T06:40:35.276 INFO:tasks.workunit.client.1.smithi117.stdout:3/488: unlink d0/d19/f54 0 2024-09-19T06:40:35.277 INFO:tasks.workunit.client.1.smithi117.stdout:4/694: write d3/d1b/d63/fa1 [189124,21570] 0 2024-09-19T06:40:35.277 INFO:tasks.workunit.client.1.smithi117.stdout:7/471: unlink d1/d4a/d81/d24/f6 0 2024-09-19T06:40:35.278 INFO:tasks.workunit.client.0.smithi099.stdout:4/353: write d12/d32/d42/d5c/f31 [1388209,1699] 0 2024-09-19T06:40:35.281 INFO:tasks.workunit.client.1.smithi117.stdout:9/453: creat d4/d1c/f94 x:0 0 0 2024-09-19T06:40:35.281 INFO:tasks.workunit.client.0.smithi099.stdout:3/478: dwrite d7/d34/d1d/d20/d58/d5c/f83 [0,4194304] 0 2024-09-19T06:40:35.281 INFO:tasks.workunit.client.0.smithi099.stdout:4/354: symlink d12/d1b/l7b 0 2024-09-19T06:40:35.282 INFO:tasks.workunit.client.1.smithi117.stdout:0/396: mknod d11/d13/d1b/d27/c82 0 2024-09-19T06:40:35.283 INFO:tasks.workunit.client.0.smithi099.stdout:4/355: fsync d12/d32/f61 0 2024-09-19T06:40:35.287 INFO:tasks.workunit.client.0.smithi099.stdout:4/356: read d12/f16 [1618596,116971] 0 2024-09-19T06:40:35.287 INFO:tasks.workunit.client.1.smithi117.stdout:4/695: dwrite d3/db/d20/d35/f70 [0,4194304] 0 2024-09-19T06:40:35.290 INFO:tasks.workunit.client.1.smithi117.stdout:6/358: creat d1/d5/d8/f5d x:0 0 0 2024-09-19T06:40:35.291 INFO:tasks.workunit.client.1.smithi117.stdout:9/454: rename d4/d8/l83 to d4/d8/l95 0 2024-09-19T06:40:35.292 INFO:tasks.workunit.client.1.smithi117.stdout:3/489: dwrite d0/f15 [0,4194304] 0 2024-09-19T06:40:35.293 INFO:tasks.workunit.client.0.smithi099.stdout:3/479: dwrite d7/d34/f1f [0,4194304] 0 2024-09-19T06:40:35.296 INFO:tasks.workunit.client.1.smithi117.stdout:7/472: mkdir d1/d4a/d81/d24/d1c/da8 0 2024-09-19T06:40:35.299 INFO:tasks.workunit.client.1.smithi117.stdout:4/696: dwrite d3/d65/d66/fab [0,4194304] 0 2024-09-19T06:40:35.300 INFO:tasks.workunit.client.1.smithi117.stdout:7/473: write d1/d4a/d7c/f98 [860031,91826] 0 2024-09-19T06:40:35.301 INFO:tasks.workunit.client.1.smithi117.stdout:6/359: unlink d1/d5/d8/l49 0 2024-09-19T06:40:35.305 INFO:tasks.workunit.client.1.smithi117.stdout:9/455: unlink d4/d8/f2d 0 2024-09-19T06:40:35.305 INFO:tasks.workunit.client.1.smithi117.stdout:3/490: dwrite d0/d19/d2b/d8e/f2c [4194304,4194304] 0 2024-09-19T06:40:35.306 INFO:tasks.workunit.client.0.smithi099.stdout:3/480: rename d7/d34/d1d/d36/d69/f6a to d7/d34/f88 0 2024-09-19T06:40:35.308 INFO:tasks.workunit.client.0.smithi099.stdout:3/481: stat d7/d34/d1d/d36/d69/d6d/d7a/f81 0 2024-09-19T06:40:35.308 INFO:tasks.workunit.client.1.smithi117.stdout:7/474: dread d1/d3f/f57 [0,4194304] 0 2024-09-19T06:40:35.309 INFO:tasks.workunit.client.1.smithi117.stdout:7/475: readlink d1/d4a/d81/d24/d26/l32 0 2024-09-19T06:40:35.309 INFO:tasks.workunit.client.1.smithi117.stdout:0/397: creat d11/f83 x:0 0 0 2024-09-19T06:40:35.312 INFO:tasks.workunit.client.1.smithi117.stdout:0/398: write d11/d13/d14/f6b [690091,125636] 0 2024-09-19T06:40:35.313 INFO:tasks.workunit.client.1.smithi117.stdout:7/476: truncate d1/d4a/d81/d24/d1c/f67 1348955 0 2024-09-19T06:40:35.314 INFO:tasks.workunit.client.0.smithi099.stdout:3/482: truncate d7/f49 3080240 0 2024-09-19T06:40:35.315 INFO:tasks.workunit.client.0.smithi099.stdout:4/357: dwrite d12/d32/d39/f40 [0,4194304] 0 2024-09-19T06:40:35.316 INFO:tasks.workunit.client.0.smithi099.stdout:3/483: chown d7/d34/d1d/d36/d69/d6d 563670 1 2024-09-19T06:40:35.319 INFO:tasks.workunit.client.0.smithi099.stdout:3/484: symlink d7/d34/d28/l89 0 2024-09-19T06:40:35.319 INFO:tasks.workunit.client.1.smithi117.stdout:9/456: creat d4/d17/f96 x:0 0 0 2024-09-19T06:40:35.320 INFO:tasks.workunit.client.0.smithi099.stdout:4/358: creat d12/d32/d42/f7c x:0 0 0 2024-09-19T06:40:35.322 INFO:tasks.workunit.client.0.smithi099.stdout:3/485: symlink d7/d34/d1d/d20/l8a 0 2024-09-19T06:40:35.325 INFO:tasks.workunit.client.0.smithi099.stdout:3/486: creat d7/d34/d1d/d36/d42/f8b x:0 0 0 2024-09-19T06:40:35.326 INFO:tasks.workunit.client.1.smithi117.stdout:8/526: truncate d1d/d2a/d3f/d73/f9e 1905607 0 2024-09-19T06:40:35.327 INFO:tasks.workunit.client.0.smithi099.stdout:3/487: chown d7/d34/d1d/d36/d42/c63 6979430 1 2024-09-19T06:40:35.328 INFO:tasks.workunit.client.0.smithi099.stdout:3/488: truncate d7/d34/d1d/d36/f4a 548994 0 2024-09-19T06:40:35.329 INFO:tasks.workunit.client.1.smithi117.stdout:6/360: mkdir d1/d5/d8/d5e 0 2024-09-19T06:40:35.329 INFO:tasks.workunit.client.0.smithi099.stdout:4/359: dread d12/f30 [4194304,4194304] 0 2024-09-19T06:40:35.330 INFO:tasks.workunit.client.0.smithi099.stdout:3/489: rmdir d7/d34/d1d 39 2024-09-19T06:40:35.331 INFO:tasks.workunit.client.0.smithi099.stdout:4/360: mknod d12/d58/c7d 0 2024-09-19T06:40:35.332 INFO:tasks.workunit.client.1.smithi117.stdout:3/491: dwrite d0/f63 [4194304,4194304] 0 2024-09-19T06:40:35.333 INFO:tasks.workunit.client.0.smithi099.stdout:3/490: dread - d7/d34/d1d/d36/d69/d6d/f7b zero size 2024-09-19T06:40:35.336 INFO:tasks.workunit.client.1.smithi117.stdout:6/361: symlink d1/d14/l5f 0 2024-09-19T06:40:35.337 INFO:tasks.workunit.client.0.smithi099.stdout:4/361: creat d12/f7e x:0 0 0 2024-09-19T06:40:35.338 INFO:tasks.workunit.client.1.smithi117.stdout:9/457: dwrite d4/d8/fe [4194304,4194304] 0 2024-09-19T06:40:35.340 INFO:tasks.workunit.client.1.smithi117.stdout:3/492: stat d0/d19/d2b/d8e/f2f 0 2024-09-19T06:40:35.341 INFO:tasks.workunit.client.0.smithi099.stdout:4/362: rename d12/d32/d42/f59 to d12/d32/d42/d5c/d51/f7f 0 2024-09-19T06:40:35.342 INFO:tasks.workunit.client.1.smithi117.stdout:4/697: dread d3/d1b/d7d/f10 [0,4194304] 0 2024-09-19T06:40:35.343 INFO:tasks.workunit.client.1.smithi117.stdout:6/362: write d1/d5/f39 [2152298,94853] 0 2024-09-19T06:40:35.344 INFO:tasks.workunit.client.0.smithi099.stdout:4/363: dread d12/d32/d42/d5c/d51/f7f [0,4194304] 0 2024-09-19T06:40:35.345 INFO:tasks.workunit.client.1.smithi117.stdout:9/458: chown d4/d1c/d7a/d52/f3c 0 1 2024-09-19T06:40:35.345 INFO:tasks.workunit.client.1.smithi117.stdout:8/527: dwrite d1d/d1e/d29/f43 [0,4194304] 0 2024-09-19T06:40:35.345 INFO:tasks.workunit.client.0.smithi099.stdout:4/364: write d12/d32/f72 [832556,62501] 0 2024-09-19T06:40:35.346 INFO:tasks.workunit.client.1.smithi117.stdout:7/477: dread d1/d4a/d7c/d95/f97 [0,4194304] 0 2024-09-19T06:40:35.347 INFO:tasks.workunit.client.1.smithi117.stdout:9/459: readlink d4/d1c/d7a/l11 0 2024-09-19T06:40:35.350 INFO:tasks.workunit.client.0.smithi099.stdout:4/365: mkdir d12/d32/d42/d80 0 2024-09-19T06:40:35.350 INFO:tasks.workunit.client.0.smithi099.stdout:5/509: sync 2024-09-19T06:40:35.351 INFO:tasks.workunit.client.1.smithi117.stdout:4/698: chown d3/d65/d66/cb5 23 1 2024-09-19T06:40:35.352 INFO:tasks.workunit.client.1.smithi117.stdout:8/528: creat d1d/d1e/d29/fb6 x:0 0 0 2024-09-19T06:40:35.354 INFO:tasks.workunit.client.0.smithi099.stdout:4/366: mkdir d12/d1b/d73/d81 0 2024-09-19T06:40:35.355 INFO:tasks.workunit.client.0.smithi099.stdout:5/510: write d3/d1f/f91 [1874212,33639] 0 2024-09-19T06:40:35.355 INFO:tasks.workunit.client.1.smithi117.stdout:3/493: creat d0/d9/f90 x:0 0 0 2024-09-19T06:40:35.356 INFO:tasks.workunit.client.1.smithi117.stdout:9/460: write d4/d1c/d7a/d52/f3c [3982333,67148] 0 2024-09-19T06:40:35.356 INFO:tasks.workunit.client.0.smithi099.stdout:5/511: truncate d3/d16/f58 395486 0 2024-09-19T06:40:35.357 INFO:tasks.workunit.client.0.smithi099.stdout:5/512: chown d3/d7/fb8 282895 1 2024-09-19T06:40:35.359 INFO:tasks.workunit.client.1.smithi117.stdout:8/529: mkdir d1d/d2a/d3f/d4c/db7 0 2024-09-19T06:40:35.359 INFO:tasks.workunit.client.1.smithi117.stdout:3/494: write d0/d9/d1c/f1d [3659789,21329] 0 2024-09-19T06:40:35.360 INFO:tasks.workunit.client.0.smithi099.stdout:4/367: getdents d12/d1b 0 2024-09-19T06:40:35.360 INFO:tasks.workunit.client.1.smithi117.stdout:0/399: dwrite d11/d13/d14/f1d [0,4194304] 0 2024-09-19T06:40:35.361 INFO:tasks.workunit.client.0.smithi099.stdout:5/513: link d3/d14/fa1 d3/d16/d5e/fbb 0 2024-09-19T06:40:35.363 INFO:tasks.workunit.client.1.smithi117.stdout:0/400: write fd [574739,26672] 0 2024-09-19T06:40:35.364 INFO:tasks.workunit.client.0.smithi099.stdout:4/368: read d12/d32/d42/f55 [2189376,128686] 0 2024-09-19T06:40:35.367 INFO:tasks.workunit.client.0.smithi099.stdout:4/369: mkdir d12/d82 0 2024-09-19T06:40:35.369 INFO:tasks.workunit.client.0.smithi099.stdout:5/514: dwrite d3/d16/f83 [0,4194304] 0 2024-09-19T06:40:35.372 INFO:tasks.workunit.client.1.smithi117.stdout:7/478: rmdir d1/d4a/d77 39 2024-09-19T06:40:35.373 INFO:tasks.workunit.client.1.smithi117.stdout:6/363: rename d1/d5/d8/d27/c58 to d1/c60 0 2024-09-19T06:40:35.374 INFO:tasks.workunit.client.1.smithi117.stdout:4/699: dwrite d3/db/d20/d35/d79/fdc [0,4194304] 0 2024-09-19T06:40:35.374 INFO:tasks.workunit.client.1.smithi117.stdout:0/401: chown d11/f63 27084 1 2024-09-19T06:40:35.375 INFO:tasks.workunit.client.0.smithi099.stdout:4/370: dread d12/d1b/f75 [0,4194304] 0 2024-09-19T06:40:35.376 INFO:tasks.workunit.client.0.smithi099.stdout:4/371: stat d12/d58/l6b 0 2024-09-19T06:40:35.377 INFO:tasks.workunit.client.0.smithi099.stdout:5/515: link d3/d16/d2f/d34/d3c/f6d d3/d16/d5e/fbc 0 2024-09-19T06:40:35.379 INFO:tasks.workunit.client.0.smithi099.stdout:3/491: dwrite d7/f49 [0,4194304] 0 2024-09-19T06:40:35.379 INFO:tasks.workunit.client.1.smithi117.stdout:6/364: chown d1/d5/d8/d27/l2a 14404359 1 2024-09-19T06:40:35.379 INFO:tasks.workunit.client.0.smithi099.stdout:4/372: stat ce 0 2024-09-19T06:40:35.382 INFO:tasks.workunit.client.1.smithi117.stdout:4/700: chown d3/d4/fe2 28042 1 2024-09-19T06:40:35.383 INFO:tasks.workunit.client.1.smithi117.stdout:6/365: dread - d1/d5/d32/d45/f4d zero size 2024-09-19T06:40:35.384 INFO:tasks.workunit.client.0.smithi099.stdout:3/492: creat d7/d34/d1d/d20/d75/d79/f8c x:0 0 0 2024-09-19T06:40:35.386 INFO:tasks.workunit.client.1.smithi117.stdout:3/495: dwrite d0/d19/d2b/d8e/f8d [4194304,4194304] 0 2024-09-19T06:40:35.387 INFO:tasks.workunit.client.0.smithi099.stdout:4/373: rename d12/d1b/d73/f77 to d12/d32/d42/d80/f83 0 2024-09-19T06:40:35.388 INFO:tasks.workunit.client.1.smithi117.stdout:9/461: rename d4/d8/d6e/f6f to d4/d17/f97 0 2024-09-19T06:40:35.389 INFO:tasks.workunit.client.0.smithi099.stdout:3/493: fdatasync d7/d34/d28/f48 0 2024-09-19T06:40:35.389 INFO:tasks.workunit.client.1.smithi117.stdout:0/402: creat d11/d13/d14/d2c/d64/f84 x:0 0 0 2024-09-19T06:40:35.391 INFO:tasks.workunit.client.0.smithi099.stdout:3/494: write d7/f14 [1172646,54535] 0 2024-09-19T06:40:35.391 INFO:tasks.workunit.client.1.smithi117.stdout:3/496: readlink d0/d9/d1c/l51 0 2024-09-19T06:40:35.391 INFO:tasks.workunit.client.1.smithi117.stdout:8/530: link d1d/d1e/d29/fb4 d1d/d31/fb8 0 2024-09-19T06:40:35.391 INFO:tasks.workunit.client.1.smithi117.stdout:0/403: dread - d11/d13/d1b/d4b/f68 zero size 2024-09-19T06:40:35.392 INFO:tasks.workunit.client.0.smithi099.stdout:3/495: write d7/f18 [1545953,35569] 0 2024-09-19T06:40:35.392 INFO:tasks.workunit.client.1.smithi117.stdout:9/462: fsync d4/d1c/d46/f47 0 2024-09-19T06:40:35.393 INFO:tasks.workunit.client.0.smithi099.stdout:4/374: symlink d12/l84 0 2024-09-19T06:40:35.395 INFO:tasks.workunit.client.0.smithi099.stdout:3/496: creat d7/d34/d1d/d36/d69/d6d/f8d x:0 0 0 2024-09-19T06:40:35.396 INFO:tasks.workunit.client.0.smithi099.stdout:4/375: symlink d12/d32/d39/l85 0 2024-09-19T06:40:35.397 INFO:tasks.workunit.client.1.smithi117.stdout:7/479: creat d1/d4a/d81/d48/d5f/d82/fa9 x:0 0 0 2024-09-19T06:40:35.397 INFO:tasks.workunit.client.0.smithi099.stdout:4/376: chown d12/d32/d42/d5c/d51/f7f 3251181 1 2024-09-19T06:40:35.398 INFO:tasks.workunit.client.1.smithi117.stdout:9/463: mkdir d4/d1c/d7a/d52/d8d/d98 0 2024-09-19T06:40:35.399 INFO:tasks.workunit.client.0.smithi099.stdout:3/497: rmdir d7/d34/d1d/d36/d42 39 2024-09-19T06:40:35.401 INFO:tasks.workunit.client.0.smithi099.stdout:3/498: symlink d7/d34/d1d/d20/l8e 0 2024-09-19T06:40:35.402 INFO:tasks.workunit.client.1.smithi117.stdout:7/480: symlink d1/d4a/d81/d24/d49/laa 0 2024-09-19T06:40:35.403 INFO:tasks.workunit.client.0.smithi099.stdout:4/377: creat d12/d32/f86 x:0 0 0 2024-09-19T06:40:35.404 INFO:tasks.workunit.client.1.smithi117.stdout:6/366: rename d1/d3/d25/l35 to d1/d5/l61 0 2024-09-19T06:40:35.404 INFO:tasks.workunit.client.1.smithi117.stdout:8/531: dwrite d1d/d31/d83/fa6 [0,4194304] 0 2024-09-19T06:40:35.404 INFO:tasks.workunit.client.1.smithi117.stdout:9/464: chown d4/d1c/f59 4087 1 2024-09-19T06:40:35.408 INFO:tasks.workunit.client.0.smithi099.stdout:3/499: dwrite d7/d34/d1d/d20/d58/d5c/f5d [4194304,4194304] 0 2024-09-19T06:40:35.409 INFO:tasks.workunit.client.1.smithi117.stdout:4/701: rename d3/d65/d66/d80/d91/ld8 to d3/db/d20/d4a/le6 0 2024-09-19T06:40:35.411 INFO:tasks.workunit.client.1.smithi117.stdout:4/702: write d3/d28/fb0 [974861,67201] 0 2024-09-19T06:40:35.412 INFO:tasks.workunit.client.0.smithi099.stdout:3/500: dread d7/d34/d28/f48 [0,4194304] 0 2024-09-19T06:40:35.412 INFO:tasks.workunit.client.1.smithi117.stdout:9/465: symlink d4/d8/d6a/l99 0 2024-09-19T06:40:35.417 INFO:tasks.workunit.client.1.smithi117.stdout:3/497: rename d0/d19/d2b/d8e/f5c to d0/d3d/d48/f91 0 2024-09-19T06:40:35.417 INFO:tasks.workunit.client.1.smithi117.stdout:8/532: dwrite d1d/d1e/f2c [0,4194304] 0 2024-09-19T06:40:35.417 INFO:tasks.workunit.client.1.smithi117.stdout:6/367: link d1/d5/l36 d1/d3/l62 0 2024-09-19T06:40:35.418 INFO:tasks.workunit.client.1.smithi117.stdout:6/368: stat d1/d5/f40 0 2024-09-19T06:40:35.419 INFO:tasks.workunit.client.1.smithi117.stdout:6/369: dread - d1/f1d zero size 2024-09-19T06:40:35.419 INFO:tasks.workunit.client.1.smithi117.stdout:4/703: unlink d3/d65/d66/fd1 0 2024-09-19T06:40:35.419 INFO:tasks.workunit.client.0.smithi099.stdout:3/501: getdents d7/d34/d1d/d57 0 2024-09-19T06:40:35.419 INFO:tasks.workunit.client.1.smithi117.stdout:6/370: chown d1/f1d 105 1 2024-09-19T06:40:35.420 INFO:tasks.workunit.client.0.smithi099.stdout:3/502: stat d7/d34/d1d/d20/l3b 0 2024-09-19T06:40:35.422 INFO:tasks.workunit.client.1.smithi117.stdout:4/704: stat d3/d28/c30 0 2024-09-19T06:40:35.426 INFO:tasks.workunit.client.0.smithi099.stdout:3/503: dread d7/d34/d1d/d20/d58/d5c/f83 [0,4194304] 0 2024-09-19T06:40:35.427 INFO:tasks.workunit.client.0.smithi099.stdout:5/516: truncate d3/d16/d2f/d34/d3c/f6d 164967 0 2024-09-19T06:40:35.428 INFO:tasks.workunit.client.0.smithi099.stdout:3/504: mkdir d7/d34/d1d/d36/d69/d6d/d8f 0 2024-09-19T06:40:35.431 INFO:tasks.workunit.client.0.smithi099.stdout:3/505: creat d7/d34/d1d/d20/d58/d5c/f90 x:0 0 0 2024-09-19T06:40:35.432 INFO:tasks.workunit.client.0.smithi099.stdout:5/517: getdents d3/db7 0 2024-09-19T06:40:35.433 INFO:tasks.workunit.client.0.smithi099.stdout:3/506: mknod d7/d34/d1d/d20/c91 0 2024-09-19T06:40:35.434 INFO:tasks.workunit.client.0.smithi099.stdout:5/518: fsync d3/f25 0 2024-09-19T06:40:35.442 INFO:tasks.workunit.client.0.smithi099.stdout:5/519: dwrite d3/d7/f80 [0,4194304] 0 2024-09-19T06:40:35.443 INFO:tasks.workunit.client.0.smithi099.stdout:3/507: dwrite d7/d34/d1d/d20/d58/d5c/f83 [0,4194304] 0 2024-09-19T06:40:35.445 INFO:tasks.workunit.client.0.smithi099.stdout:5/520: symlink d3/d16/d2f/lbd 0 2024-09-19T06:40:35.447 INFO:tasks.workunit.client.0.smithi099.stdout:3/508: write d7/d34/d1d/d36/d42/f8b [406790,50211] 0 2024-09-19T06:40:35.449 INFO:tasks.workunit.client.0.smithi099.stdout:5/521: mkdir d3/d16/d2f/d34/d3c/d65/dbe 0 2024-09-19T06:40:35.451 INFO:tasks.workunit.client.0.smithi099.stdout:4/378: dread d12/f38 [0,4194304] 0 2024-09-19T06:40:35.453 INFO:tasks.workunit.client.0.smithi099.stdout:4/379: fsync d12/d32/d42/f67 0 2024-09-19T06:40:35.453 INFO:tasks.workunit.client.0.smithi099.stdout:3/509: link d7/d34/d1d/d36/c2c d7/d34/d1d/d36/d69/c92 0 2024-09-19T06:40:35.454 INFO:tasks.workunit.client.0.smithi099.stdout:5/522: symlink d3/d16/d2f/d34/d3c/d65/dbe/lbf 0 2024-09-19T06:40:35.455 INFO:tasks.workunit.client.0.smithi099.stdout:4/380: fsync f10 0 2024-09-19T06:40:35.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:35 smithi099 ceph-mon[27651]: pgmap v16: 65 pgs: 65 active+clean; 1.1 GiB data, 4.8 GiB used, 532 GiB / 536 GiB avail; 12 MiB/s rd, 129 MiB/s wr, 259 op/s 2024-09-19T06:40:35.456 INFO:tasks.workunit.client.0.smithi099.stdout:6/378: sync 2024-09-19T06:40:35.456 INFO:tasks.workunit.client.0.smithi099.stdout:0/317: sync 2024-09-19T06:40:35.456 INFO:tasks.workunit.client.0.smithi099.stdout:3/510: symlink d7/d34/d1d/d36/l93 0 2024-09-19T06:40:35.457 INFO:tasks.workunit.client.0.smithi099.stdout:4/381: creat d12/d32/d39/f87 x:0 0 0 2024-09-19T06:40:35.457 INFO:tasks.workunit.client.0.smithi099.stdout:6/379: read - d1/d5/d24/d2e/f70 zero size 2024-09-19T06:40:35.458 INFO:tasks.workunit.client.0.smithi099.stdout:5/523: getdents d3/d7/d90 0 2024-09-19T06:40:35.458 INFO:tasks.workunit.client.0.smithi099.stdout:3/511: dread - d7/d34/d1d/d57/d76/f87 zero size 2024-09-19T06:40:35.459 INFO:tasks.workunit.client.0.smithi099.stdout:5/524: stat d3/l6 0 2024-09-19T06:40:35.459 INFO:tasks.workunit.client.0.smithi099.stdout:0/318: creat d0/db/d13/d59/f60 x:0 0 0 2024-09-19T06:40:35.459 INFO:tasks.workunit.client.0.smithi099.stdout:4/382: truncate f5 3716088 0 2024-09-19T06:40:35.460 INFO:tasks.workunit.client.0.smithi099.stdout:6/380: dread - d1/d5/d24/d2e/d41/d4e/f6d zero size 2024-09-19T06:40:35.461 INFO:tasks.workunit.client.0.smithi099.stdout:6/381: write d1/f4c [514612,129103] 0 2024-09-19T06:40:35.462 INFO:tasks.workunit.client.1.smithi117.stdout:1/497: sync 2024-09-19T06:40:35.463 INFO:tasks.workunit.client.0.smithi099.stdout:0/319: mkdir d0/db/d13/d1f/d4a/d61 0 2024-09-19T06:40:35.463 INFO:tasks.workunit.client.1.smithi117.stdout:9/466: rename d4/d1c/d54/d75 to d4/d1c/d73/d9a 0 2024-09-19T06:40:35.464 INFO:tasks.workunit.client.1.smithi117.stdout:8/533: mkdir d1d/d2a/d3f/d4c/db7/db9 0 2024-09-19T06:40:35.465 INFO:tasks.workunit.client.1.smithi117.stdout:7/481: link d1/d4a/d7c/d95/f97 d1/d72/fab 0 2024-09-19T06:40:35.466 INFO:tasks.workunit.client.0.smithi099.stdout:0/320: mknod d0/db/d13/d1f/c62 0 2024-09-19T06:40:35.467 INFO:tasks.workunit.client.0.smithi099.stdout:5/525: dwrite d3/d7/fb [4194304,4194304] 0 2024-09-19T06:40:35.467 INFO:tasks.workunit.client.1.smithi117.stdout:9/467: write d4/d20/f45 [437024,125044] 0 2024-09-19T06:40:35.467 INFO:tasks.workunit.client.1.smithi117.stdout:8/534: read d1d/d2a/fa1 [1241518,68538] 0 2024-09-19T06:40:35.467 INFO:tasks.workunit.client.0.smithi099.stdout:0/321: write d0/db/d13/f42 [1893740,74786] 0 2024-09-19T06:40:35.471 INFO:tasks.workunit.client.1.smithi117.stdout:1/498: creat d3/da1/fac x:0 0 0 2024-09-19T06:40:35.471 INFO:tasks.workunit.client.1.smithi117.stdout:4/705: mkdir d3/db/d20/d29/d39/d4f/de7 0 2024-09-19T06:40:35.473 INFO:tasks.workunit.client.1.smithi117.stdout:9/468: creat d4/d58/f9b x:0 0 0 2024-09-19T06:40:35.473 INFO:tasks.workunit.client.1.smithi117.stdout:7/482: creat d1/d4a/d81/d24/d1c/d35/d4f/fac x:0 0 0 2024-09-19T06:40:35.478 INFO:tasks.workunit.client.1.smithi117.stdout:1/499: symlink d3/d18/d23/d51/lad 0 2024-09-19T06:40:35.479 INFO:tasks.workunit.client.1.smithi117.stdout:6/371: getdents d1/d5/d32/d45 0 2024-09-19T06:40:35.479 INFO:tasks.workunit.client.1.smithi117.stdout:7/483: write d1/d4a/d7c/f9c [2555005,81067] 0 2024-09-19T06:40:35.480 INFO:tasks.workunit.client.1.smithi117.stdout:9/469: unlink d4/d17/f5e 0 2024-09-19T06:40:35.481 INFO:tasks.workunit.client.1.smithi117.stdout:8/535: rename f3 to d1d/d2a/d3f/d4b/d91/fba 0 2024-09-19T06:40:35.481 INFO:tasks.workunit.client.1.smithi117.stdout:0/404: dwrite f0 [0,4194304] 0 2024-09-19T06:40:35.483 INFO:tasks.workunit.client.1.smithi117.stdout:6/372: fdatasync d1/d3/d25/f42 0 2024-09-19T06:40:35.483 INFO:tasks.workunit.client.1.smithi117.stdout:3/498: dread d0/d3d/f4f [0,4194304] 0 2024-09-19T06:40:35.483 INFO:tasks.workunit.client.1.smithi117.stdout:9/470: dread - d4/d1c/d7a/f64 zero size 2024-09-19T06:40:35.485 INFO:tasks.workunit.client.1.smithi117.stdout:7/484: symlink d1/d4a/d77/lad 0 2024-09-19T06:40:35.486 INFO:tasks.workunit.client.1.smithi117.stdout:8/536: write d1d/d2a/d3f/f72 [77751,108781] 0 2024-09-19T06:40:35.487 INFO:tasks.workunit.client.1.smithi117.stdout:6/373: rmdir d1/d3 39 2024-09-19T06:40:35.488 INFO:tasks.workunit.client.0.smithi099.stdout:3/512: truncate d7/d34/f70 1146972 0 2024-09-19T06:40:35.488 INFO:tasks.workunit.client.1.smithi117.stdout:8/537: fdatasync d1d/f27 0 2024-09-19T06:40:35.488 INFO:tasks.workunit.client.1.smithi117.stdout:4/706: link d3/db/d20/d35/cbb d3/d65/d66/d80/dc5/ce8 0 2024-09-19T06:40:35.489 INFO:tasks.workunit.client.1.smithi117.stdout:0/405: symlink d11/d13/d1b/d4b/l85 0 2024-09-19T06:40:35.491 INFO:tasks.workunit.client.1.smithi117.stdout:1/500: link d3/d22/f90 d3/da1/da5/fae 0 2024-09-19T06:40:35.491 INFO:tasks.workunit.client.1.smithi117.stdout:8/538: dread - d1d/d1e/d3b/f7b zero size 2024-09-19T06:40:35.492 INFO:tasks.workunit.client.1.smithi117.stdout:0/406: stat d11/d13/d14/d16/f1a 0 2024-09-19T06:40:35.492 INFO:tasks.workunit.client.0.smithi099.stdout:5/526: dwrite d3/d16/d2f/d34/d3c/f46 [0,4194304] 0 2024-09-19T06:40:35.492 INFO:tasks.workunit.client.1.smithi117.stdout:9/471: chown d4/d8/fb 0 1 2024-09-19T06:40:35.494 INFO:tasks.workunit.client.1.smithi117.stdout:7/485: fdatasync d1/d4a/d81/d48/d5f/d82/f9e 0 2024-09-19T06:40:35.495 INFO:tasks.workunit.client.0.smithi099.stdout:5/527: chown d3/d2a/c5a 390 1 2024-09-19T06:40:35.496 INFO:tasks.workunit.client.1.smithi117.stdout:4/707: creat d3/db/d20/d35/d79/dd4/fe9 x:0 0 0 2024-09-19T06:40:35.496 INFO:tasks.workunit.client.0.smithi099.stdout:4/383: dwrite d12/f35 [0,4194304] 0 2024-09-19T06:40:35.498 INFO:tasks.workunit.client.1.smithi117.stdout:8/539: write d1d/f52 [954401,9929] 0 2024-09-19T06:40:35.501 INFO:tasks.workunit.client.0.smithi099.stdout:3/513: dwrite d7/d34/f3a [0,4194304] 0 2024-09-19T06:40:35.502 INFO:tasks.workunit.client.0.smithi099.stdout:4/384: mkdir d12/d1b/d88 0 2024-09-19T06:40:35.502 INFO:tasks.workunit.client.1.smithi117.stdout:0/407: chown d11/d13/d1b/d27/l39 3205 1 2024-09-19T06:40:35.503 INFO:tasks.workunit.client.1.smithi117.stdout:4/708: chown d3/d1b/lc4 1446797 1 2024-09-19T06:40:35.504 INFO:tasks.workunit.client.0.smithi099.stdout:3/514: readlink d7/d34/d1d/d20/l8e 0 2024-09-19T06:40:35.507 INFO:tasks.workunit.client.0.smithi099.stdout:5/528: dwrite d3/d16/d2f/d8c/fae [0,4194304] 0 2024-09-19T06:40:35.509 INFO:tasks.workunit.client.0.smithi099.stdout:3/515: fsync d7/d34/d1d/d36/d42/f43 0 2024-09-19T06:40:35.510 INFO:tasks.workunit.client.0.smithi099.stdout:5/529: chown d3/d7/c3f 4777128 1 2024-09-19T06:40:35.510 INFO:tasks.workunit.client.1.smithi117.stdout:6/374: dwrite d1/d5/d8/f5d [0,4194304] 0 2024-09-19T06:40:35.512 INFO:tasks.workunit.client.0.smithi099.stdout:5/530: write d3/d7/f26 [1427676,57879] 0 2024-09-19T06:40:35.515 INFO:tasks.workunit.client.0.smithi099.stdout:4/385: dwrite d12/f30 [4194304,4194304] 0 2024-09-19T06:40:35.516 INFO:tasks.workunit.client.1.smithi117.stdout:3/499: dwrite d0/f14 [4194304,4194304] 0 2024-09-19T06:40:35.519 INFO:tasks.workunit.client.1.smithi117.stdout:1/501: dwrite d3/d18/d56/f94 [0,4194304] 0 2024-09-19T06:40:35.520 INFO:tasks.workunit.client.1.smithi117.stdout:0/408: chown d11/d13/d14/f6b 23423944 1 2024-09-19T06:40:35.520 INFO:tasks.workunit.client.0.smithi099.stdout:5/531: creat d3/d7/d90/da6/fc0 x:0 0 0 2024-09-19T06:40:35.522 INFO:tasks.workunit.client.0.smithi099.stdout:5/532: rmdir d3/d16/d5e 39 2024-09-19T06:40:35.524 INFO:tasks.workunit.client.1.smithi117.stdout:6/375: mknod d1/d14/c63 0 2024-09-19T06:40:35.524 INFO:tasks.workunit.client.1.smithi117.stdout:9/472: write d4/d1c/d7a/f2f [128796,62784] 0 2024-09-19T06:40:35.526 INFO:tasks.workunit.client.0.smithi099.stdout:5/533: creat d3/d16/d2f/fc1 x:0 0 0 2024-09-19T06:40:35.528 INFO:tasks.workunit.client.0.smithi099.stdout:5/534: chown d3/d16/d2f/d34/d3c/d65/fa2 2121 1 2024-09-19T06:40:35.528 INFO:tasks.workunit.client.1.smithi117.stdout:7/486: dwrite d1/d4a/d81/d24/d26/f2f [4194304,4194304] 0 2024-09-19T06:40:35.529 INFO:tasks.workunit.client.0.smithi099.stdout:5/535: chown d3/d1f/l2d 10328895 1 2024-09-19T06:40:35.529 INFO:tasks.workunit.client.1.smithi117.stdout:0/409: rmdir d11 39 2024-09-19T06:40:35.530 INFO:tasks.workunit.client.1.smithi117.stdout:6/376: chown d1/d5/f51 56208 1 2024-09-19T06:40:35.531 INFO:tasks.workunit.client.1.smithi117.stdout:1/502: truncate d3/d8f/fa7 812310 0 2024-09-19T06:40:35.532 INFO:tasks.workunit.client.0.smithi099.stdout:5/536: chown d3/d16/d5e/f85 2 1 2024-09-19T06:40:35.534 INFO:tasks.workunit.client.1.smithi117.stdout:9/473: chown d4/c10 160419 1 2024-09-19T06:40:35.535 INFO:tasks.workunit.client.1.smithi117.stdout:8/540: symlink d1d/d2a/d3f/d4c/daa/lbb 0 2024-09-19T06:40:35.537 INFO:tasks.workunit.client.1.smithi117.stdout:8/541: dread - d1d/fb1 zero size 2024-09-19T06:40:35.537 INFO:tasks.workunit.client.1.smithi117.stdout:3/500: creat d0/f92 x:0 0 0 2024-09-19T06:40:35.538 INFO:tasks.workunit.client.1.smithi117.stdout:0/410: chown d11/d13/d1b/d27/f55 459 1 2024-09-19T06:40:35.539 INFO:tasks.workunit.client.1.smithi117.stdout:1/503: rename d3/d18/d23/f66 to d3/d22/d2f/faf 0 2024-09-19T06:40:35.539 INFO:tasks.workunit.client.1.smithi117.stdout:0/411: dread - d11/d13/d1b/d4b/f75 zero size 2024-09-19T06:40:35.540 INFO:tasks.workunit.client.1.smithi117.stdout:9/474: symlink d4/d1c/d73/d93/l9c 0 2024-09-19T06:40:35.540 INFO:tasks.workunit.client.1.smithi117.stdout:4/709: dread d3/db/d20/d35/d79/fa6 [0,4194304] 0 2024-09-19T06:40:35.541 INFO:tasks.workunit.client.1.smithi117.stdout:3/501: truncate d0/f5e 8778974 0 2024-09-19T06:40:35.542 INFO:tasks.workunit.client.1.smithi117.stdout:6/377: creat d1/f64 x:0 0 0 2024-09-19T06:40:35.542 INFO:tasks.workunit.client.1.smithi117.stdout:7/487: mknod d1/d3f/d92/cae 0 2024-09-19T06:40:35.542 INFO:tasks.workunit.client.1.smithi117.stdout:9/475: write d4/d1c/d36/f6c [1731162,44664] 0 2024-09-19T06:40:35.544 INFO:tasks.workunit.client.1.smithi117.stdout:8/542: mkdir d1d/d1e/dbc 0 2024-09-19T06:40:35.544 INFO:tasks.workunit.client.1.smithi117.stdout:6/378: write d1/d5/f39 [2307607,76249] 0 2024-09-19T06:40:35.545 INFO:tasks.workunit.client.1.smithi117.stdout:8/543: chown d1d/d2a/d3f/d4c 863 1 2024-09-19T06:40:35.546 INFO:tasks.workunit.client.1.smithi117.stdout:3/502: truncate d0/d9/f50 142279 0 2024-09-19T06:40:35.548 INFO:tasks.workunit.client.1.smithi117.stdout:3/503: fsync d0/d9/f80 0 2024-09-19T06:40:35.551 INFO:tasks.workunit.client.1.smithi117.stdout:4/710: dwrite f1 [0,4194304] 0 2024-09-19T06:40:35.552 INFO:tasks.workunit.client.1.smithi117.stdout:8/544: dread d1d/d2a/d3f/d4b/d66/dac/f7f [0,4194304] 0 2024-09-19T06:40:35.552 INFO:tasks.workunit.client.1.smithi117.stdout:4/711: chown d3/db/ff 1845739555 1 2024-09-19T06:40:35.553 INFO:tasks.workunit.client.1.smithi117.stdout:8/545: dread - d1d/d31/d83/f9f zero size 2024-09-19T06:40:35.558 INFO:tasks.workunit.client.1.smithi117.stdout:8/546: rename d1d/d1e/d53/c64 to d1d/d31/cbd 0 2024-09-19T06:40:35.560 INFO:tasks.workunit.client.1.smithi117.stdout:4/712: getdents d3/d28/d2a 0 2024-09-19T06:40:35.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:35 smithi117 ceph-mon[34564]: pgmap v16: 65 pgs: 65 active+clean; 1.1 GiB data, 4.8 GiB used, 532 GiB / 536 GiB avail; 12 MiB/s rd, 129 MiB/s wr, 259 op/s 2024-09-19T06:40:35.563 INFO:tasks.workunit.client.0.smithi099.stdout:4/386: mkdir d12/d1b/d73/d81/d89 0 2024-09-19T06:40:35.564 INFO:tasks.workunit.client.0.smithi099.stdout:4/387: chown d12/d1b/d73/d81 13 1 2024-09-19T06:40:35.566 INFO:tasks.workunit.client.0.smithi099.stdout:4/388: mkdir d12/d1b/d73/d81/d8a 0 2024-09-19T06:40:35.567 INFO:tasks.workunit.client.0.smithi099.stdout:3/516: dread d7/d34/d1d/d36/d42/f43 [0,4194304] 0 2024-09-19T06:40:35.569 INFO:tasks.workunit.client.0.smithi099.stdout:4/389: creat d12/d32/f8b x:0 0 0 2024-09-19T06:40:35.570 INFO:tasks.workunit.client.0.smithi099.stdout:3/517: mknod d7/d34/c94 0 2024-09-19T06:40:35.570 INFO:tasks.workunit.client.0.smithi099.stdout:4/390: fdatasync d12/d32/f86 0 2024-09-19T06:40:35.571 INFO:tasks.workunit.client.1.smithi117.stdout:4/713: dread d3/d1b/d7d/d51/fba [0,4194304] 0 2024-09-19T06:40:35.572 INFO:tasks.workunit.client.1.smithi117.stdout:4/714: chown d3/d65/d66/cb5 10 1 2024-09-19T06:40:35.573 INFO:tasks.workunit.client.0.smithi099.stdout:4/391: mknod d12/d1b/d73/d81/d89/c8c 0 2024-09-19T06:40:35.574 INFO:tasks.workunit.client.0.smithi099.stdout:4/392: fsync d12/d32/d39/f87 0 2024-09-19T06:40:35.574 INFO:tasks.workunit.client.0.smithi099.stdout:3/518: dread d7/d34/d1d/d36/d42/f6c [0,4194304] 0 2024-09-19T06:40:35.577 INFO:tasks.workunit.client.1.smithi117.stdout:9/476: truncate d4/f44 293774 0 2024-09-19T06:40:35.578 INFO:tasks.workunit.client.0.smithi099.stdout:4/393: unlink d12/d32/d42/f7c 0 2024-09-19T06:40:35.578 INFO:tasks.workunit.client.0.smithi099.stdout:4/394: stat d12/d32/d39/c3a 0 2024-09-19T06:40:35.579 INFO:tasks.workunit.client.1.smithi117.stdout:4/715: creat d3/db/fea x:0 0 0 2024-09-19T06:40:35.581 INFO:tasks.workunit.client.1.smithi117.stdout:9/477: mknod d4/d8/d6a/c9d 0 2024-09-19T06:40:35.582 INFO:tasks.workunit.client.0.smithi099.stdout:4/395: mknod d12/d82/c8d 0 2024-09-19T06:40:35.583 INFO:tasks.workunit.client.1.smithi117.stdout:1/504: dread f1 [4194304,4194304] 0 2024-09-19T06:40:35.583 INFO:tasks.workunit.client.1.smithi117.stdout:4/716: chown d3/d65/d66/d80/d91/cdd 0 1 2024-09-19T06:40:35.583 INFO:tasks.workunit.client.0.smithi099.stdout:3/519: truncate d7/d34/f70 322394 0 2024-09-19T06:40:35.585 INFO:tasks.workunit.client.0.smithi099.stdout:4/396: creat d12/d1b/d73/f8e x:0 0 0 2024-09-19T06:40:35.586 INFO:tasks.workunit.client.1.smithi117.stdout:7/488: dread d1/d4a/d81/d24/d1c/f27 [0,4194304] 0 2024-09-19T06:40:35.586 INFO:tasks.workunit.client.0.smithi099.stdout:3/520: creat d7/d34/d1d/d57/d76/f95 x:0 0 0 2024-09-19T06:40:35.587 INFO:tasks.workunit.client.1.smithi117.stdout:4/717: write d3/f90 [5123991,72923] 0 2024-09-19T06:40:35.587 INFO:tasks.workunit.client.1.smithi117.stdout:3/504: dread d0/d9/d1c/f42 [0,4194304] 0 2024-09-19T06:40:35.588 INFO:tasks.workunit.client.0.smithi099.stdout:3/521: mkdir d7/d34/d1d/d36/d69/d96 0 2024-09-19T06:40:35.589 INFO:tasks.workunit.client.1.smithi117.stdout:8/547: dwrite d1d/d1e/d29/f2b [8388608,4194304] 0 2024-09-19T06:40:35.591 INFO:tasks.workunit.client.1.smithi117.stdout:3/505: chown d0/d19/d2b 992074 1 2024-09-19T06:40:35.591 INFO:tasks.workunit.client.0.smithi099.stdout:3/522: mknod d7/d34/d1d/d57/c97 0 2024-09-19T06:40:35.591 INFO:tasks.workunit.client.0.smithi099.stdout:3/523: stat d7/d34/d28 0 2024-09-19T06:40:35.592 INFO:tasks.workunit.client.1.smithi117.stdout:1/505: symlink d3/d18/d23/d74/d89/lb0 0 2024-09-19T06:40:35.593 INFO:tasks.workunit.client.0.smithi099.stdout:3/524: mkdir d7/d34/d1d/d20/d58/d5c/d98 0 2024-09-19T06:40:35.594 INFO:tasks.workunit.client.0.smithi099.stdout:8/264: sync 2024-09-19T06:40:35.594 INFO:tasks.workunit.client.0.smithi099.stdout:7/475: sync 2024-09-19T06:40:35.594 INFO:tasks.workunit.client.0.smithi099.stdout:2/216: sync 2024-09-19T06:40:35.594 INFO:tasks.workunit.client.0.smithi099.stdout:9/442: sync 2024-09-19T06:40:35.594 INFO:tasks.workunit.client.0.smithi099.stdout:1/296: sync 2024-09-19T06:40:35.594 INFO:tasks.workunit.client.0.smithi099.stdout:3/525: dread - d7/d34/d1d/d20/d58/d5c/f90 zero size 2024-09-19T06:40:35.595 INFO:tasks.workunit.client.1.smithi117.stdout:8/548: read - d1d/d2a/d3f/f4d zero size 2024-09-19T06:40:35.598 INFO:tasks.workunit.client.0.smithi099.stdout:7/476: unlink d7/d39/f6a 0 2024-09-19T06:40:35.598 INFO:tasks.workunit.client.0.smithi099.stdout:2/217: chown d1/d2/d5/d8/d18/d27/c32 5 1 2024-09-19T06:40:35.598 INFO:tasks.workunit.client.1.smithi117.stdout:8/549: mkdir d1d/d31/dbe 0 2024-09-19T06:40:35.600 INFO:tasks.workunit.client.1.smithi117.stdout:3/506: dread d0/d19/f38 [0,4194304] 0 2024-09-19T06:40:35.600 INFO:tasks.workunit.client.0.smithi099.stdout:9/443: mkdir dd/d2c/d5c/d64/d93 0 2024-09-19T06:40:35.601 INFO:tasks.workunit.client.0.smithi099.stdout:1/297: unlink d0/d12/d13/d37/d41/f56 0 2024-09-19T06:40:35.602 INFO:tasks.workunit.client.1.smithi117.stdout:8/550: mkdir d1d/d2a/d3f/d4b/d5f/dbf 0 2024-09-19T06:40:35.602 INFO:tasks.workunit.client.0.smithi099.stdout:3/526: creat d7/d34/d1d/d20/d58/d5c/f99 x:0 0 0 2024-09-19T06:40:35.603 INFO:tasks.workunit.client.1.smithi117.stdout:1/506: getdents d3/d18 0 2024-09-19T06:40:35.605 INFO:tasks.workunit.client.1.smithi117.stdout:9/478: dread d4/d1c/d36/d37/f42 [0,4194304] 0 2024-09-19T06:40:35.607 INFO:tasks.workunit.client.0.smithi099.stdout:2/218: dwrite d1/f15 [0,4194304] 0 2024-09-19T06:40:35.608 INFO:tasks.workunit.client.0.smithi099.stdout:2/219: stat d1/d2/d5/d8 0 2024-09-19T06:40:35.608 INFO:tasks.workunit.client.0.smithi099.stdout:3/527: fsync d7/d34/d28/f48 0 2024-09-19T06:40:35.609 INFO:tasks.workunit.client.1.smithi117.stdout:8/551: rename d1d/d1e/da5 to d1d/d31/d83/dad/dc0 0 2024-09-19T06:40:35.609 INFO:tasks.workunit.client.0.smithi099.stdout:3/528: stat d7/f12 0 2024-09-19T06:40:35.612 INFO:tasks.workunit.client.1.smithi117.stdout:9/479: chown d4/f3b 1995587 1 2024-09-19T06:40:35.613 INFO:tasks.workunit.client.0.smithi099.stdout:7/477: rmdir d7/d39 39 2024-09-19T06:40:35.613 INFO:tasks.workunit.client.0.smithi099.stdout:8/265: write d4/de/d10/f29 [2348958,66559] 0 2024-09-19T06:40:35.615 INFO:tasks.workunit.client.1.smithi117.stdout:9/480: mknod d4/d8/d6a/d82/c9e 0 2024-09-19T06:40:35.617 INFO:tasks.workunit.client.0.smithi099.stdout:9/444: getdents dd/d62/d78 0 2024-09-19T06:40:35.619 INFO:tasks.workunit.client.1.smithi117.stdout:9/481: rename d4/c10 to d4/d17/c9f 0 2024-09-19T06:40:35.619 INFO:tasks.workunit.client.0.smithi099.stdout:1/298: write d0/d17/d24/f55 [996209,58925] 0 2024-09-19T06:40:35.620 INFO:tasks.workunit.client.1.smithi117.stdout:9/482: stat d4/d1c/d7a/d69 0 2024-09-19T06:40:35.620 INFO:tasks.workunit.client.1.smithi117.stdout:7/489: dread d1/d4a/d81/d48/d5f/d82/fa5 [0,4194304] 0 2024-09-19T06:40:35.621 INFO:tasks.workunit.client.0.smithi099.stdout:2/220: rename d1/d2/l21 to d1/d2/l4c 0 2024-09-19T06:40:35.622 INFO:tasks.workunit.client.1.smithi117.stdout:8/552: dread d1d/f50 [0,4194304] 0 2024-09-19T06:40:35.623 INFO:tasks.workunit.client.1.smithi117.stdout:9/483: truncate d4/d8/d6a/d82/f90 641227 0 2024-09-19T06:40:35.625 INFO:tasks.workunit.client.1.smithi117.stdout:7/490: creat d1/d4a/d81/d48/faf x:0 0 0 2024-09-19T06:40:35.626 INFO:tasks.workunit.client.0.smithi099.stdout:1/299: symlink d0/d17/d32/l64 0 2024-09-19T06:40:35.626 INFO:tasks.workunit.client.1.smithi117.stdout:9/484: creat d4/d1c/d73/d93/fa0 x:0 0 0 2024-09-19T06:40:35.626 INFO:tasks.workunit.client.0.smithi099.stdout:8/266: dwrite d4/de/d14/f39 [0,4194304] 0 2024-09-19T06:40:35.627 INFO:tasks.workunit.client.0.smithi099.stdout:3/529: dwrite d7/f68 [4194304,4194304] 0 2024-09-19T06:40:35.628 INFO:tasks.workunit.client.0.smithi099.stdout:2/221: rmdir d1/d2/d5/d8/d36 39 2024-09-19T06:40:35.628 INFO:tasks.workunit.client.1.smithi117.stdout:9/485: dread - d4/d17/f96 zero size 2024-09-19T06:40:35.628 INFO:tasks.workunit.client.0.smithi099.stdout:1/300: dread - d0/d17/d24/f46 zero size 2024-09-19T06:40:35.630 INFO:tasks.workunit.client.1.smithi117.stdout:8/553: dwrite d1d/f63 [0,4194304] 0 2024-09-19T06:40:35.630 INFO:tasks.workunit.client.0.smithi099.stdout:8/267: symlink d4/d11/l5d 0 2024-09-19T06:40:35.633 INFO:tasks.workunit.client.1.smithi117.stdout:9/486: symlink d4/d1c/d7a/d52/la1 0 2024-09-19T06:40:35.636 INFO:tasks.workunit.client.0.smithi099.stdout:1/301: write d0/f29 [8007633,88476] 0 2024-09-19T06:40:35.637 INFO:tasks.workunit.client.0.smithi099.stdout:8/268: mkdir d4/d5e 0 2024-09-19T06:40:35.638 INFO:tasks.workunit.client.0.smithi099.stdout:2/222: truncate d1/d2/d5/d13/d2c/f49 1081115 0 2024-09-19T06:40:35.639 INFO:tasks.workunit.client.1.smithi117.stdout:8/554: mkdir d1d/d1e/dbc/dc1 0 2024-09-19T06:40:35.641 INFO:tasks.workunit.client.0.smithi099.stdout:1/302: rename d0/d17/c57 to d0/d17/c65 0 2024-09-19T06:40:35.641 INFO:tasks.workunit.client.0.smithi099.stdout:3/530: dwrite d7/d34/d1d/d20/d75/d79/f86 [0,4194304] 0 2024-09-19T06:40:35.643 INFO:tasks.workunit.client.0.smithi099.stdout:2/223: write d1/d2/d5/d8/d18/d27/f48 [418053,127755] 0 2024-09-19T06:40:35.643 INFO:tasks.workunit.client.1.smithi117.stdout:9/487: fdatasync d4/f44 0 2024-09-19T06:40:35.644 INFO:tasks.workunit.client.0.smithi099.stdout:2/224: readlink d1/d2/d5/d8/dc/l3d 0 2024-09-19T06:40:35.648 INFO:tasks.workunit.client.1.smithi117.stdout:1/507: dread d3/f2e [0,4194304] 0 2024-09-19T06:40:35.648 INFO:tasks.workunit.client.1.smithi117.stdout:8/555: stat d1d/d2a/d3f/d4b/d5f/d95/f9b 0 2024-09-19T06:40:35.648 INFO:tasks.workunit.client.1.smithi117.stdout:9/488: rmdir d4/d1c/d7a/d16 39 2024-09-19T06:40:35.648 INFO:tasks.workunit.client.0.smithi099.stdout:3/531: mknod d7/d34/d28/c9a 0 2024-09-19T06:40:35.648 INFO:tasks.workunit.client.0.smithi099.stdout:8/269: getdents d4/de 0 2024-09-19T06:40:35.650 INFO:tasks.workunit.client.0.smithi099.stdout:3/532: write d7/d34/f3a [1430667,113145] 0 2024-09-19T06:40:35.650 INFO:tasks.workunit.client.1.smithi117.stdout:7/491: dwrite d1/d4a/d7c/d95/f97 [0,4194304] 0 2024-09-19T06:40:35.650 INFO:tasks.workunit.client.1.smithi117.stdout:3/507: dread d0/d8/f10 [0,4194304] 0 2024-09-19T06:40:35.652 INFO:tasks.workunit.client.0.smithi099.stdout:8/270: rmdir d4/de/d1c 39 2024-09-19T06:40:35.652 INFO:tasks.workunit.client.1.smithi117.stdout:7/492: fsync d1/d4a/d81/f84 0 2024-09-19T06:40:35.653 INFO:tasks.workunit.client.1.smithi117.stdout:8/556: truncate d1d/d1e/d29/fb6 998472 0 2024-09-19T06:40:35.656 INFO:tasks.workunit.client.1.smithi117.stdout:9/489: creat d4/fa2 x:0 0 0 2024-09-19T06:40:35.656 INFO:tasks.workunit.client.1.smithi117.stdout:8/557: dread - d1d/d2a/d3f/d4b/f96 zero size 2024-09-19T06:40:35.657 INFO:tasks.workunit.client.1.smithi117.stdout:7/493: symlink d1/d4a/d77/lb0 0 2024-09-19T06:40:35.658 INFO:tasks.workunit.client.1.smithi117.stdout:3/508: read d0/d19/d2b/d8e/f8d [3116028,66346] 0 2024-09-19T06:40:35.658 INFO:tasks.workunit.client.0.smithi099.stdout:8/271: symlink d4/d11/d23/l5f 0 2024-09-19T06:40:35.658 INFO:tasks.workunit.client.0.smithi099.stdout:2/225: getdents d1/d2/d5/d8/d9 0 2024-09-19T06:40:35.659 INFO:tasks.workunit.client.1.smithi117.stdout:9/490: chown d4/d17/f61 2841354 1 2024-09-19T06:40:35.659 INFO:tasks.workunit.client.1.smithi117.stdout:8/558: fdatasync d1d/d1e/d29/f89 0 2024-09-19T06:40:35.660 INFO:tasks.workunit.client.1.smithi117.stdout:3/509: dread - d0/d3d/d48/f7b zero size 2024-09-19T06:40:35.660 INFO:tasks.workunit.client.0.smithi099.stdout:8/272: write d4/fa [2102940,112683] 0 2024-09-19T06:40:35.660 INFO:tasks.workunit.client.0.smithi099.stdout:2/226: dread - d1/d2/d5/d8/d9/f3c zero size 2024-09-19T06:40:35.662 INFO:tasks.workunit.client.1.smithi117.stdout:9/491: write d4/d1c/d46/f47 [525901,58282] 0 2024-09-19T06:40:35.662 INFO:tasks.workunit.client.1.smithi117.stdout:3/510: stat d0/l23 0 2024-09-19T06:40:35.663 INFO:tasks.workunit.client.1.smithi117.stdout:3/511: stat d0/d9/d49/c3b 0 2024-09-19T06:40:35.664 INFO:tasks.workunit.client.1.smithi117.stdout:7/494: truncate d1/d4a/d81/d24/d49/fa0 768938 0 2024-09-19T06:40:35.664 INFO:tasks.workunit.client.1.smithi117.stdout:8/559: creat d1d/d2a/d3f/d4b/fc2 x:0 0 0 2024-09-19T06:40:35.665 INFO:tasks.workunit.client.1.smithi117.stdout:9/492: mkdir d4/d8/d6a/d82/da3 0 2024-09-19T06:40:35.666 INFO:tasks.workunit.client.1.smithi117.stdout:3/512: chown d0/l79 2 1 2024-09-19T06:40:35.667 INFO:tasks.workunit.client.1.smithi117.stdout:8/560: symlink d1d/d2a/d3f/d4b/d5f/d95/lc3 0 2024-09-19T06:40:35.668 INFO:tasks.workunit.client.1.smithi117.stdout:8/561: stat d1d/d1e/c25 0 2024-09-19T06:40:35.669 INFO:tasks.workunit.client.1.smithi117.stdout:8/562: rmdir d1d/d1e/dbc 39 2024-09-19T06:40:35.671 INFO:tasks.workunit.client.0.smithi099.stdout:8/273: dwrite d4/de/d10/f24 [0,4194304] 0 2024-09-19T06:40:35.671 INFO:tasks.workunit.client.1.smithi117.stdout:9/493: getdents d4/d20 0 2024-09-19T06:40:35.672 INFO:tasks.workunit.client.1.smithi117.stdout:8/563: mkdir d1d/d2a/d3f/d4c/db7/db9/dc4 0 2024-09-19T06:40:35.673 INFO:tasks.workunit.client.0.smithi099.stdout:8/274: truncate d4/de/d10/f49 270568 0 2024-09-19T06:40:35.673 INFO:tasks.workunit.client.0.smithi099.stdout:1/303: dread d0/f21 [0,4194304] 0 2024-09-19T06:40:35.676 INFO:tasks.workunit.client.0.smithi099.stdout:1/304: read - d0/db/f23 zero size 2024-09-19T06:40:35.676 INFO:tasks.workunit.client.1.smithi117.stdout:8/564: creat d1d/d1e/d29/fc5 x:0 0 0 2024-09-19T06:40:35.680 INFO:tasks.workunit.client.0.smithi099.stdout:1/305: rename d0/d12/d13/d37/f3d to d0/d17/f66 0 2024-09-19T06:40:35.680 INFO:tasks.workunit.client.1.smithi117.stdout:1/508: truncate d3/d18/d23/f55 1259721 0 2024-09-19T06:40:35.681 INFO:tasks.workunit.client.0.smithi099.stdout:2/227: write d1/d2/d5/d13/d2c/f38 [596309,118150] 0 2024-09-19T06:40:35.682 INFO:tasks.workunit.client.1.smithi117.stdout:8/565: mknod d1d/d2a/d3f/cc6 0 2024-09-19T06:40:35.682 INFO:tasks.workunit.client.1.smithi117.stdout:9/494: dwrite d4/d1c/f1f [0,4194304] 0 2024-09-19T06:40:35.683 INFO:tasks.workunit.client.0.smithi099.stdout:1/306: rmdir d0/d12/d13/d37/d41 39 2024-09-19T06:40:35.684 INFO:tasks.workunit.client.1.smithi117.stdout:1/509: write d3/d22/f33 [606104,103975] 0 2024-09-19T06:40:35.686 INFO:tasks.workunit.client.0.smithi099.stdout:3/533: dwrite d7/d34/d1d/d36/f29 [0,4194304] 0 2024-09-19T06:40:35.687 INFO:tasks.workunit.client.0.smithi099.stdout:3/534: stat d7/ff 0 2024-09-19T06:40:35.687 INFO:tasks.workunit.client.0.smithi099.stdout:2/228: rename d1/d2/d24 to d1/d2/d4d 0 2024-09-19T06:40:35.688 INFO:tasks.workunit.client.1.smithi117.stdout:8/566: mkdir d1d/d2a/d3f/d4c/db7/dc7 0 2024-09-19T06:40:35.693 INFO:tasks.workunit.client.0.smithi099.stdout:2/229: mknod d1/d2/d5/d8/d18/d27/c4e 0 2024-09-19T06:40:35.695 INFO:tasks.workunit.client.0.smithi099.stdout:3/535: getdents d7 0 2024-09-19T06:40:35.696 INFO:tasks.workunit.client.0.smithi099.stdout:2/230: creat d1/f4f x:0 0 0 2024-09-19T06:40:35.696 INFO:tasks.workunit.client.0.smithi099.stdout:1/307: dread d0/d17/d24/f42 [0,4194304] 0 2024-09-19T06:40:35.696 INFO:tasks.workunit.client.1.smithi117.stdout:3/513: dwrite d0/d8/f4c [0,4194304] 0 2024-09-19T06:40:35.697 INFO:tasks.workunit.client.1.smithi117.stdout:3/514: fsync d0/d8/f1a 0 2024-09-19T06:40:35.697 INFO:tasks.workunit.client.1.smithi117.stdout:9/495: dread d4/d1c/d46/f6b [0,4194304] 0 2024-09-19T06:40:35.698 INFO:tasks.workunit.client.0.smithi099.stdout:2/231: read d1/d2/d5/d8/d18/f23 [3504914,74090] 0 2024-09-19T06:40:35.700 INFO:tasks.workunit.client.0.smithi099.stdout:3/536: write d7/d34/f51 [508446,2458] 0 2024-09-19T06:40:35.700 INFO:tasks.workunit.client.1.smithi117.stdout:9/496: read - d4/d1c/d7a/d52/f3e zero size 2024-09-19T06:40:35.702 INFO:tasks.workunit.client.0.smithi099.stdout:2/232: symlink d1/d2/d5/d13/l50 0 2024-09-19T06:40:35.702 INFO:tasks.workunit.client.0.smithi099.stdout:3/537: dread - d7/d34/d1d/d36/d69/d6d/d7a/f81 zero size 2024-09-19T06:40:35.703 INFO:tasks.workunit.client.1.smithi117.stdout:7/495: dread d1/d4a/d7c/f9c [0,4194304] 0 2024-09-19T06:40:35.703 INFO:tasks.workunit.client.1.smithi117.stdout:9/497: write d4/d8/d6e/f8f [406898,90649] 0 2024-09-19T06:40:35.704 INFO:tasks.workunit.client.0.smithi099.stdout:8/275: dread d4/fa [0,4194304] 0 2024-09-19T06:40:35.705 INFO:tasks.workunit.client.1.smithi117.stdout:9/498: write d4/f3b [3391198,112492] 0 2024-09-19T06:40:35.706 INFO:tasks.workunit.client.1.smithi117.stdout:3/515: dwrite d0/d9/fd [4194304,4194304] 0 2024-09-19T06:40:35.708 INFO:tasks.workunit.client.1.smithi117.stdout:9/499: fsync d4/d1c/d7a/d69/f70 0 2024-09-19T06:40:35.708 INFO:tasks.workunit.client.1.smithi117.stdout:9/500: chown d4/d1c/d36/f77 159956 1 2024-09-19T06:40:35.709 INFO:tasks.workunit.client.0.smithi099.stdout:3/538: symlink d7/d34/d1d/d36/d69/d6d/l9b 0 2024-09-19T06:40:35.709 INFO:tasks.workunit.client.0.smithi099.stdout:2/233: rmdir d1/d2/d5/d8/d18/d27 39 2024-09-19T06:40:35.710 INFO:tasks.workunit.client.1.smithi117.stdout:9/501: fdatasync d4/d1c/d36/f77 0 2024-09-19T06:40:35.711 INFO:tasks.workunit.client.0.smithi099.stdout:3/539: truncate d7/d34/d1d/d36/d69/d6d/d7a/f81 607769 0 2024-09-19T06:40:35.712 INFO:tasks.workunit.client.0.smithi099.stdout:8/276: symlink d4/de/d26/d2b/l60 0 2024-09-19T06:40:35.712 INFO:tasks.workunit.client.0.smithi099.stdout:1/308: link d0/d12/d13/d37/d41/c52 d0/d12/d54/c67 0 2024-09-19T06:40:35.712 INFO:tasks.workunit.client.0.smithi099.stdout:1/309: chown d0/d17 973957 1 2024-09-19T06:40:35.712 INFO:tasks.workunit.client.1.smithi117.stdout:3/516: creat d0/d19/d2b/d8e/f93 x:0 0 0 2024-09-19T06:40:35.714 INFO:tasks.workunit.client.0.smithi099.stdout:3/540: mknod d7/c9c 0 2024-09-19T06:40:35.714 INFO:tasks.workunit.client.1.smithi117.stdout:9/502: dread - d4/d1c/d7a/d69/f70 zero size 2024-09-19T06:40:35.716 INFO:tasks.workunit.client.0.smithi099.stdout:1/310: fdatasync d0/d17/d24/f55 0 2024-09-19T06:40:35.717 INFO:tasks.workunit.client.1.smithi117.stdout:9/503: fsync d4/d1c/d7a/d52/f85 0 2024-09-19T06:40:35.719 INFO:tasks.workunit.client.0.smithi099.stdout:1/311: truncate d0/d12/d13/d37/d48/f4b 490337 0 2024-09-19T06:40:35.720 INFO:tasks.workunit.client.1.smithi117.stdout:3/517: rename d0/d9/d49/c47 to d0/d8/d7f/c94 0 2024-09-19T06:40:35.721 INFO:tasks.workunit.client.1.smithi117.stdout:8/567: dwrite d1d/d1e/f3e [0,4194304] 0 2024-09-19T06:40:35.721 INFO:tasks.workunit.client.1.smithi117.stdout:9/504: mkdir d4/d8/d6e/da4 0 2024-09-19T06:40:35.723 INFO:tasks.workunit.client.1.smithi117.stdout:1/510: dread d3/f9 [0,4194304] 0 2024-09-19T06:40:35.724 INFO:tasks.workunit.client.0.smithi099.stdout:1/312: rename d0/db/dd to d0/d68 0 2024-09-19T06:40:35.725 INFO:tasks.workunit.client.0.smithi099.stdout:1/313: chown d0/d12/c4a 424749 1 2024-09-19T06:40:35.726 INFO:tasks.workunit.client.0.smithi099.stdout:1/314: chown d0/d12/d13/d37/l61 145567 1 2024-09-19T06:40:35.729 INFO:tasks.workunit.client.0.smithi099.stdout:1/315: creat d0/d68/f69 x:0 0 0 2024-09-19T06:40:35.730 INFO:tasks.workunit.client.0.smithi099.stdout:1/316: readlink d0/d17/d32/l64 0 2024-09-19T06:40:35.732 INFO:tasks.workunit.client.0.smithi099.stdout:3/541: write d7/d34/f1f [1828446,82984] 0 2024-09-19T06:40:35.733 INFO:tasks.workunit.client.0.smithi099.stdout:1/317: read d0/d12/d13/f22 [3355131,28699] 0 2024-09-19T06:40:35.735 INFO:tasks.workunit.client.0.smithi099.stdout:3/542: dread - d7/d34/d1d/d36/d69/f6b zero size 2024-09-19T06:40:35.737 INFO:tasks.workunit.client.0.smithi099.stdout:2/234: dwrite d1/d2/f1f [0,4194304] 0 2024-09-19T06:40:35.738 INFO:tasks.workunit.client.0.smithi099.stdout:1/318: rename d0/d12/d13/f4c to d0/d17/d24/f6a 0 2024-09-19T06:40:35.739 INFO:tasks.workunit.client.0.smithi099.stdout:3/543: mkdir d7/d34/d1d/d20/d75/d9d 0 2024-09-19T06:40:35.741 INFO:tasks.workunit.client.0.smithi099.stdout:2/235: getdents d1/d2/d5/d8/d9 0 2024-09-19T06:40:35.741 INFO:tasks.workunit.client.0.smithi099.stdout:3/544: chown d7/d34/d1d/d57/d76 4887 1 2024-09-19T06:40:35.743 INFO:tasks.workunit.client.0.smithi099.stdout:1/319: mknod d0/d17/d5b/c6b 0 2024-09-19T06:40:35.743 INFO:tasks.workunit.client.0.smithi099.stdout:8/277: dread d4/d11/f21 [0,4194304] 0 2024-09-19T06:40:35.744 INFO:tasks.workunit.client.0.smithi099.stdout:1/320: read - d0/d12/d13/f49 zero size 2024-09-19T06:40:35.745 INFO:tasks.workunit.client.0.smithi099.stdout:8/278: mkdir d4/d11/d61 0 2024-09-19T06:40:35.746 INFO:tasks.workunit.client.0.smithi099.stdout:3/545: dread d7/d34/d1d/d36/d42/f8b [0,4194304] 0 2024-09-19T06:40:35.751 INFO:tasks.workunit.client.0.smithi099.stdout:3/546: write d7/d34/d1d/d20/d75/d79/f86 [2773518,4012] 0 2024-09-19T06:40:35.753 INFO:tasks.workunit.client.0.smithi099.stdout:2/236: dwrite d1/d2/d5/d8/d36/f45 [0,4194304] 0 2024-09-19T06:40:35.753 INFO:tasks.workunit.client.0.smithi099.stdout:6/382: sync 2024-09-19T06:40:35.754 INFO:tasks.workunit.client.0.smithi099.stdout:1/321: dwrite d0/f29 [0,4194304] 0 2024-09-19T06:40:35.755 INFO:tasks.workunit.client.1.smithi117.stdout:3/518: symlink d0/d8/d7f/d40/l95 0 2024-09-19T06:40:35.758 INFO:tasks.workunit.client.0.smithi099.stdout:8/279: dread d4/de/d10/f24 [0,4194304] 0 2024-09-19T06:40:35.758 INFO:tasks.workunit.client.0.smithi099.stdout:8/280: stat d4/d11/d23/l3a 0 2024-09-19T06:40:35.759 INFO:tasks.workunit.client.0.smithi099.stdout:6/383: write d1/d5/d24/d2e/f31 [491138,68252] 0 2024-09-19T06:40:35.759 INFO:tasks.workunit.client.0.smithi099.stdout:1/322: rmdir d0/d17/d24/d3a 39 2024-09-19T06:40:35.761 INFO:tasks.workunit.client.1.smithi117.stdout:1/511: rename d3/d8f to d3/da1/db1 0 2024-09-19T06:40:35.762 INFO:tasks.workunit.client.1.smithi117.stdout:1/512: stat d3/d18/d56/fa8 0 2024-09-19T06:40:35.763 INFO:tasks.workunit.client.0.smithi099.stdout:1/323: write d0/d17/d32/f53 [744136,48484] 0 2024-09-19T06:40:35.763 INFO:tasks.workunit.client.1.smithi117.stdout:3/519: mknod d0/d19/d2b/d8e/c96 0 2024-09-19T06:40:35.763 INFO:tasks.workunit.client.0.smithi099.stdout:8/281: mknod d4/d11/d38/c62 0 2024-09-19T06:40:35.765 INFO:tasks.workunit.client.0.smithi099.stdout:1/324: write d0/d12/d13/f33 [2168744,42009] 0 2024-09-19T06:40:35.765 INFO:tasks.workunit.client.0.smithi099.stdout:2/237: link d1/d2/d5/d6/l35 d1/d2/d5/d8/d9/l51 0 2024-09-19T06:40:35.766 INFO:tasks.workunit.client.0.smithi099.stdout:8/282: readlink d4/de/l5a 0 2024-09-19T06:40:35.769 INFO:tasks.workunit.client.1.smithi117.stdout:7/496: dwrite d1/d4a/d81/d24/d1c/d35/f6d [0,4194304] 0 2024-09-19T06:40:35.770 INFO:tasks.workunit.client.1.smithi117.stdout:8/568: link l18 d1d/d2a/lc8 0 2024-09-19T06:40:35.770 INFO:tasks.workunit.client.0.smithi099.stdout:8/283: read - d4/de/d26/d2b/f52 zero size 2024-09-19T06:40:35.770 INFO:tasks.workunit.client.0.smithi099.stdout:3/547: dwrite d7/d34/d1d/d36/f29 [0,4194304] 0 2024-09-19T06:40:35.770 INFO:tasks.workunit.client.0.smithi099.stdout:1/325: truncate d0/d12/d13/f45 687642 0 2024-09-19T06:40:35.772 INFO:tasks.workunit.client.0.smithi099.stdout:1/326: stat d0/d17/d24/c40 0 2024-09-19T06:40:35.772 INFO:tasks.workunit.client.0.smithi099.stdout:2/238: truncate d1/d2/d5/d13/d2c/f49 5037301 0 2024-09-19T06:40:35.773 INFO:tasks.workunit.client.0.smithi099.stdout:8/284: fsync d4/d11/d23/d4c/f51 0 2024-09-19T06:40:35.774 INFO:tasks.workunit.client.1.smithi117.stdout:1/513: dwrite d3/d18/f3f [4194304,4194304] 0 2024-09-19T06:40:35.774 INFO:tasks.workunit.client.1.smithi117.stdout:3/520: creat d0/d9/d1c/f97 x:0 0 0 2024-09-19T06:40:35.776 INFO:tasks.workunit.client.0.smithi099.stdout:1/327: write d0/d17/d32/f4d [476645,110854] 0 2024-09-19T06:40:35.776 INFO:tasks.workunit.client.0.smithi099.stdout:3/548: chown d7/f15 1179 1 2024-09-19T06:40:35.779 INFO:tasks.workunit.client.0.smithi099.stdout:3/549: truncate d7/d34/d1d/d20/d58/d5c/f83 4969919 0 2024-09-19T06:40:35.779 INFO:tasks.workunit.client.1.smithi117.stdout:7/497: creat d1/d4a/d81/d48/d5f/fb1 x:0 0 0 2024-09-19T06:40:35.779 INFO:tasks.workunit.client.0.smithi099.stdout:2/239: unlink d1/d2/d5/d8/d9/f1d 0 2024-09-19T06:40:35.781 INFO:tasks.workunit.client.0.smithi099.stdout:1/328: creat d0/d17/d32/f6c x:0 0 0 2024-09-19T06:40:35.783 INFO:tasks.workunit.client.0.smithi099.stdout:8/285: mknod d4/d11/d23/d3f/c63 0 2024-09-19T06:40:35.784 INFO:tasks.workunit.client.0.smithi099.stdout:3/550: write d7/f14 [2551737,110026] 0 2024-09-19T06:40:35.785 INFO:tasks.workunit.client.1.smithi117.stdout:9/505: dwrite d4/f44 [0,4194304] 0 2024-09-19T06:40:35.786 INFO:tasks.workunit.client.0.smithi099.stdout:3/551: write d7/d34/d1d/d20/d75/d79/f8c [807330,80673] 0 2024-09-19T06:40:35.787 INFO:tasks.workunit.client.1.smithi117.stdout:7/498: dread - d1/d4a/d81/d24/d26/f37 zero size 2024-09-19T06:40:35.788 INFO:tasks.workunit.client.1.smithi117.stdout:8/569: dwrite d1d/d2a/d3f/d4b/d66/dac/f93 [0,4194304] 0 2024-09-19T06:40:35.788 INFO:tasks.workunit.client.0.smithi099.stdout:8/286: symlink d4/d11/d23/l64 0 2024-09-19T06:40:35.790 INFO:tasks.workunit.client.0.smithi099.stdout:3/552: dread d7/f49 [0,4194304] 0 2024-09-19T06:40:35.790 INFO:tasks.workunit.client.0.smithi099.stdout:1/329: truncate d0/d17/d24/f6a 9424436 0 2024-09-19T06:40:35.791 INFO:tasks.workunit.client.0.smithi099.stdout:3/553: chown d7/d34/d1d/d36/d42/c63 102772747 1 2024-09-19T06:40:35.792 INFO:tasks.workunit.client.0.smithi099.stdout:1/330: write d0/d17/d24/f42 [277492,65499] 0 2024-09-19T06:40:35.793 INFO:tasks.workunit.client.0.smithi099.stdout:1/331: dread - d0/d17/d32/f5a zero size 2024-09-19T06:40:35.793 INFO:tasks.workunit.client.1.smithi117.stdout:9/506: mkdir d4/d1c/d54/da5 0 2024-09-19T06:40:35.794 INFO:tasks.workunit.client.1.smithi117.stdout:7/499: unlink d1/d72/f7a 0 2024-09-19T06:40:35.796 INFO:tasks.workunit.client.0.smithi099.stdout:1/332: mkdir d0/d2d/d6d 0 2024-09-19T06:40:35.797 INFO:tasks.workunit.client.0.smithi099.stdout:2/240: write d1/d2/d5/d8/d18/f23 [4960927,89461] 0 2024-09-19T06:40:35.797 INFO:tasks.workunit.client.1.smithi117.stdout:8/570: dwrite d1d/d1e/f3e [0,4194304] 0 2024-09-19T06:40:35.799 INFO:tasks.workunit.client.1.smithi117.stdout:9/507: creat d4/d8/d6e/da4/fa6 x:0 0 0 2024-09-19T06:40:35.800 INFO:tasks.workunit.client.1.smithi117.stdout:3/521: dread d0/d9/f50 [0,4194304] 0 2024-09-19T06:40:35.800 INFO:tasks.workunit.client.0.smithi099.stdout:1/333: creat d0/d17/d24/f6e x:0 0 0 2024-09-19T06:40:35.801 INFO:tasks.workunit.client.1.smithi117.stdout:8/571: read d1d/f52 [583953,84721] 0 2024-09-19T06:40:35.802 INFO:tasks.workunit.client.1.smithi117.stdout:9/508: creat d4/d1c/d73/fa7 x:0 0 0 2024-09-19T06:40:35.803 INFO:tasks.workunit.client.0.smithi099.stdout:2/241: rename d1/d2/d5/d8 to d1/d2/d4d/d52 0 2024-09-19T06:40:35.803 INFO:tasks.workunit.client.1.smithi117.stdout:8/572: rmdir d1d/d1e/d53 39 2024-09-19T06:40:35.803 INFO:tasks.workunit.client.1.smithi117.stdout:3/522: truncate d0/d3d/d48/d77/d81/f8f 306680 0 2024-09-19T06:40:35.804 INFO:tasks.workunit.client.0.smithi099.stdout:1/334: write d0/d17/f66 [1270562,66148] 0 2024-09-19T06:40:35.806 INFO:tasks.workunit.client.1.smithi117.stdout:9/509: mkdir d4/d1c/d73/da8 0 2024-09-19T06:40:35.808 INFO:tasks.workunit.client.0.smithi099.stdout:2/242: creat d1/d2/d4d/d52/d36/f53 x:0 0 0 2024-09-19T06:40:35.808 INFO:tasks.workunit.client.1.smithi117.stdout:9/510: dread - d4/d1c/d36/f77 zero size 2024-09-19T06:40:35.809 INFO:tasks.workunit.client.0.smithi099.stdout:3/554: dread d7/d34/f88 [0,4194304] 0 2024-09-19T06:40:35.809 INFO:tasks.workunit.client.0.smithi099.stdout:1/335: rename d0/d17/f66 to d0/d12/d54/f6f 0 2024-09-19T06:40:35.810 INFO:tasks.workunit.client.1.smithi117.stdout:3/523: creat d0/d9/d4e/f98 x:0 0 0 2024-09-19T06:40:35.811 INFO:tasks.workunit.client.0.smithi099.stdout:2/243: creat d1/d2/d5/d13/f54 x:0 0 0 2024-09-19T06:40:35.812 INFO:tasks.workunit.client.1.smithi117.stdout:8/573: dwrite d1d/d2a/d3f/d4b/d66/f8d [0,4194304] 0 2024-09-19T06:40:35.813 INFO:tasks.workunit.client.1.smithi117.stdout:9/511: symlink d4/d1c/d5f/la9 0 2024-09-19T06:40:35.813 INFO:tasks.workunit.client.0.smithi099.stdout:1/336: creat d0/d12/d13/d37/d41/f70 x:0 0 0 2024-09-19T06:40:35.814 INFO:tasks.workunit.client.1.smithi117.stdout:8/574: readlink d1d/d2a/d3f/d4b/l77 0 2024-09-19T06:40:35.814 INFO:tasks.workunit.client.0.smithi099.stdout:2/244: mkdir d1/d2/d4d/d55 0 2024-09-19T06:40:35.814 INFO:tasks.workunit.client.0.smithi099.stdout:1/337: dread - d0/d17/d32/f4e zero size 2024-09-19T06:40:35.815 INFO:tasks.workunit.client.1.smithi117.stdout:3/524: creat d0/d19/d2b/d8e/f99 x:0 0 0 2024-09-19T06:40:35.817 INFO:tasks.workunit.client.0.smithi099.stdout:3/555: dwrite d7/d34/d1d/d20/d58/d5c/f83 [0,4194304] 0 2024-09-19T06:40:35.817 INFO:tasks.workunit.client.0.smithi099.stdout:2/245: creat d1/d2/d4d/f56 x:0 0 0 2024-09-19T06:40:35.818 INFO:tasks.workunit.client.1.smithi117.stdout:9/512: rename d4/d1c/d46/f47 to d4/d1c/d36/d37/faa 0 2024-09-19T06:40:35.818 INFO:tasks.workunit.client.0.smithi099.stdout:2/246: chown d1/d2/d5/d13/f54 25162714 1 2024-09-19T06:40:35.819 INFO:tasks.workunit.client.0.smithi099.stdout:3/556: mknod d7/d34/d28/c9e 0 2024-09-19T06:40:35.820 INFO:tasks.workunit.client.0.smithi099.stdout:3/557: chown d7/d34/d1d/d20/d58/d5c/f83 0 1 2024-09-19T06:40:35.820 INFO:tasks.workunit.client.1.smithi117.stdout:3/525: write d0/d9/d1c/f28 [5011927,116345] 0 2024-09-19T06:40:35.820 INFO:tasks.workunit.client.0.smithi099.stdout:2/247: symlink d1/d2/d5/d13/d2c/l57 0 2024-09-19T06:40:35.822 INFO:tasks.workunit.client.1.smithi117.stdout:9/513: read - d4/d8/d6e/da4/fa6 zero size 2024-09-19T06:40:35.825 INFO:tasks.workunit.client.1.smithi117.stdout:3/526: fdatasync d0/f12 0 2024-09-19T06:40:35.826 INFO:tasks.workunit.client.0.smithi099.stdout:2/248: dread d1/d2/f1f [0,4194304] 0 2024-09-19T06:40:35.827 INFO:tasks.workunit.client.1.smithi117.stdout:7/500: dwrite d1/d4a/d81/f54 [0,4194304] 0 2024-09-19T06:40:35.827 INFO:tasks.workunit.client.1.smithi117.stdout:8/575: dwrite d1d/d1e/d29/f89 [0,4194304] 0 2024-09-19T06:40:35.827 INFO:tasks.workunit.client.1.smithi117.stdout:9/514: creat d4/d1c/d54/fab x:0 0 0 2024-09-19T06:40:35.827 INFO:tasks.workunit.client.0.smithi099.stdout:3/558: dwrite d7/ff [0,4194304] 0 2024-09-19T06:40:35.828 INFO:tasks.workunit.client.0.smithi099.stdout:3/559: chown d7/d34/d28/c85 59 1 2024-09-19T06:40:35.830 INFO:tasks.workunit.client.0.smithi099.stdout:2/249: mknod d1/d2/d4d/d52/dc/c58 0 2024-09-19T06:40:35.831 INFO:tasks.workunit.client.0.smithi099.stdout:3/560: creat d7/d34/d1d/d36/d69/d6d/d7a/f9f x:0 0 0 2024-09-19T06:40:35.834 INFO:tasks.workunit.client.1.smithi117.stdout:9/515: write d4/d17/f97 [3779234,108278] 0 2024-09-19T06:40:35.835 INFO:tasks.workunit.client.0.smithi099.stdout:2/250: chown d1/d2/d5/ce 26814769 1 2024-09-19T06:40:35.835 INFO:tasks.workunit.client.0.smithi099.stdout:2/251: dread - d1/d2/d5/f40 zero size 2024-09-19T06:40:35.837 INFO:tasks.workunit.client.0.smithi099.stdout:1/338: fsync d0/d12/d13/d37/d41/f70 0 2024-09-19T06:40:35.841 INFO:tasks.workunit.client.1.smithi117.stdout:7/501: dwrite d1/d4a/d81/d24/d1c/f46 [0,4194304] 0 2024-09-19T06:40:35.842 INFO:tasks.workunit.client.0.smithi099.stdout:2/252: dwrite d1/f25 [0,4194304] 0 2024-09-19T06:40:35.844 INFO:tasks.workunit.client.0.smithi099.stdout:2/253: read d1/d2/f1f [3542699,49431] 0 2024-09-19T06:40:35.845 INFO:tasks.workunit.client.0.smithi099.stdout:2/254: stat d1/d2/d5/d13/d2c 0 2024-09-19T06:40:35.846 INFO:tasks.workunit.client.1.smithi117.stdout:7/502: creat d1/d4a/d81/d24/d26/d44/fb2 x:0 0 0 2024-09-19T06:40:35.846 INFO:tasks.workunit.client.0.smithi099.stdout:1/339: read d0/db/f19 [354478,7112] 0 2024-09-19T06:40:35.849 INFO:tasks.workunit.client.1.smithi117.stdout:7/503: creat d1/d4a/d81/d24/d49/fb3 x:0 0 0 2024-09-19T06:40:35.850 INFO:tasks.workunit.client.0.smithi099.stdout:2/255: rmdir d1/d2/d5/d13/d2c/d3f 0 2024-09-19T06:40:35.851 INFO:tasks.workunit.client.0.smithi099.stdout:3/561: write d7/d34/d28/f48 [3366107,58858] 0 2024-09-19T06:40:35.851 INFO:tasks.workunit.client.1.smithi117.stdout:7/504: symlink d1/d4a/d81/d24/lb4 0 2024-09-19T06:40:35.851 INFO:tasks.workunit.client.0.smithi099.stdout:1/340: creat d0/f71 x:0 0 0 2024-09-19T06:40:35.853 INFO:tasks.workunit.client.0.smithi099.stdout:1/341: chown d0/d17/d24/f42 84 1 2024-09-19T06:40:35.855 INFO:tasks.workunit.client.0.smithi099.stdout:3/562: creat d7/d34/d1d/d36/d69/d96/fa0 x:0 0 0 2024-09-19T06:40:35.858 INFO:tasks.workunit.client.0.smithi099.stdout:1/342: symlink d0/db/l72 0 2024-09-19T06:40:35.861 INFO:tasks.workunit.client.0.smithi099.stdout:2/256: dwrite d1/d2/d5/d13/f1b [4194304,4194304] 0 2024-09-19T06:40:35.864 INFO:tasks.workunit.client.1.smithi117.stdout:8/576: dread d1d/d2a/d3f/d4b/d91/fba [0,4194304] 0 2024-09-19T06:40:35.867 INFO:tasks.workunit.client.1.smithi117.stdout:3/527: dread d0/f6 [0,4194304] 0 2024-09-19T06:40:35.867 INFO:tasks.workunit.client.1.smithi117.stdout:3/528: write d0/d9/f90 [1025590,118464] 0 2024-09-19T06:40:35.868 INFO:tasks.workunit.client.1.smithi117.stdout:7/505: truncate d1/d3f/f85 298357 0 2024-09-19T06:40:35.870 INFO:tasks.workunit.client.1.smithi117.stdout:9/516: dread d4/d1c/f28 [0,4194304] 0 2024-09-19T06:40:35.872 INFO:tasks.workunit.client.0.smithi099.stdout:2/257: getdents d1/d2/d4d/d52/d9/d37 0 2024-09-19T06:40:35.872 INFO:tasks.workunit.client.0.smithi099.stdout:3/563: dwrite d7/f18 [0,4194304] 0 2024-09-19T06:40:35.878 INFO:tasks.workunit.client.1.smithi117.stdout:8/577: symlink d1d/d1e/d53/lc9 0 2024-09-19T06:40:35.880 INFO:tasks.workunit.client.0.smithi099.stdout:2/258: rename d1/d2/d5/c1e to d1/d2/d4d/d52/d9/c59 0 2024-09-19T06:40:35.880 INFO:tasks.workunit.client.1.smithi117.stdout:3/529: creat d0/d9/f9a x:0 0 0 2024-09-19T06:40:35.881 INFO:tasks.workunit.client.1.smithi117.stdout:7/506: mkdir d1/d4a/d7c/d95/db5 0 2024-09-19T06:40:35.882 INFO:tasks.workunit.client.0.smithi099.stdout:2/259: dread - d1/d2/d4d/d52/d36/f53 zero size 2024-09-19T06:40:35.884 INFO:tasks.workunit.client.1.smithi117.stdout:9/517: mkdir d4/d1c/d7a/d16/dac 0 2024-09-19T06:40:35.885 INFO:tasks.workunit.client.0.smithi099.stdout:3/564: rename d7/d34/d1d/d36/d42/c5a to d7/d34/d1d/d20/d75/ca1 0 2024-09-19T06:40:35.887 INFO:tasks.workunit.client.0.smithi099.stdout:2/260: rmdir d1/d2/d4d/d52/d18 39 2024-09-19T06:40:35.889 INFO:tasks.workunit.client.1.smithi117.stdout:3/530: dwrite d0/d9/d4e/f7c [0,4194304] 0 2024-09-19T06:40:35.890 INFO:tasks.workunit.client.0.smithi099.stdout:2/261: mknod d1/d2/d4d/d52/dc/c5a 0 2024-09-19T06:40:35.890 INFO:tasks.workunit.client.1.smithi117.stdout:8/578: getdents d1d/d1e/d29 0 2024-09-19T06:40:35.891 INFO:tasks.workunit.client.0.smithi099.stdout:3/565: mknod d7/d34/ca2 0 2024-09-19T06:40:35.895 INFO:tasks.workunit.client.0.smithi099.stdout:1/343: dread d0/db/f19 [0,4194304] 0 2024-09-19T06:40:35.897 INFO:tasks.workunit.client.1.smithi117.stdout:7/507: getdents d1/d4a/d7c 0 2024-09-19T06:40:35.898 INFO:tasks.workunit.client.0.smithi099.stdout:3/566: symlink d7/d34/d1d/d20/d75/la3 0 2024-09-19T06:40:35.900 INFO:tasks.workunit.client.0.smithi099.stdout:1/344: rename d0/d12/c3e to d0/d17/d32/c73 0 2024-09-19T06:40:35.900 INFO:tasks.workunit.client.1.smithi117.stdout:7/508: write d1/d4a/d81/fa4 [1074727,35010] 0 2024-09-19T06:40:35.901 INFO:tasks.workunit.client.0.smithi099.stdout:2/262: mkdir d1/d2/d4d/d52/d18/d27/d5b 0 2024-09-19T06:40:35.902 INFO:tasks.workunit.client.0.smithi099.stdout:1/345: chown d0/d17/d32/c60 2 1 2024-09-19T06:40:35.902 INFO:tasks.workunit.client.1.smithi117.stdout:3/531: rmdir d0/d8/d7f/d40/d5b 39 2024-09-19T06:40:35.902 INFO:tasks.workunit.client.1.smithi117.stdout:9/518: rename d4/d8/d6e/f8f to d4/d1c/d36/fad 0 2024-09-19T06:40:35.903 INFO:tasks.workunit.client.1.smithi117.stdout:8/579: dwrite d1d/d1e/d3b/f7b [0,4194304] 0 2024-09-19T06:40:35.907 INFO:tasks.workunit.client.0.smithi099.stdout:2/263: dwrite d1/f47 [0,4194304] 0 2024-09-19T06:40:35.908 INFO:tasks.workunit.client.1.smithi117.stdout:3/532: truncate d0/d8/d7f/d40/f67 4876391 0 2024-09-19T06:40:35.908 INFO:tasks.workunit.client.1.smithi117.stdout:9/519: mkdir d4/d1c/d7a/d52/d8d/d98/dae 0 2024-09-19T06:40:35.912 INFO:tasks.workunit.client.1.smithi117.stdout:3/533: rmdir d0/d19/d2b/d8e 39 2024-09-19T06:40:35.913 INFO:tasks.workunit.client.1.smithi117.stdout:8/580: dwrite d1d/f52 [0,4194304] 0 2024-09-19T06:40:35.914 INFO:tasks.workunit.client.1.smithi117.stdout:9/520: mkdir d4/d1c/d54/da5/daf 0 2024-09-19T06:40:35.915 INFO:tasks.workunit.client.0.smithi099.stdout:2/264: dwrite d1/d2/d5/f40 [0,4194304] 0 2024-09-19T06:40:35.915 INFO:tasks.workunit.client.1.smithi117.stdout:3/534: unlink d0/d19/d2b/f8c 0 2024-09-19T06:40:35.916 INFO:tasks.workunit.client.1.smithi117.stdout:8/581: dread - d1d/d1e/d53/f7a zero size 2024-09-19T06:40:35.917 INFO:tasks.workunit.client.0.smithi099.stdout:2/265: write d1/d2/d4d/d52/f2b [2279001,61768] 0 2024-09-19T06:40:35.920 INFO:tasks.workunit.client.1.smithi117.stdout:3/535: mkdir d0/d19/d9b 0 2024-09-19T06:40:35.927 INFO:tasks.workunit.client.1.smithi117.stdout:9/521: dwrite d4/d17/f76 [0,4194304] 0 2024-09-19T06:40:35.927 INFO:tasks.workunit.client.0.smithi099.stdout:2/266: truncate d1/d2/f12 305917 0 2024-09-19T06:40:35.927 INFO:tasks.workunit.client.0.smithi099.stdout:2/267: read - d1/d2/d4d/d52/d9/f3c zero size 2024-09-19T06:40:35.930 INFO:tasks.workunit.client.1.smithi117.stdout:8/582: dread d1d/d2a/f76 [0,4194304] 0 2024-09-19T06:40:35.930 INFO:tasks.workunit.client.1.smithi117.stdout:3/536: creat d0/d19/d2b/f9c x:0 0 0 2024-09-19T06:40:35.932 INFO:tasks.workunit.client.1.smithi117.stdout:8/583: fdatasync d1d/d1e/f70 0 2024-09-19T06:40:35.935 INFO:tasks.workunit.client.1.smithi117.stdout:9/522: link d4/d1c/d73/d93/fa0 d4/d8/d6e/da4/fb0 0 2024-09-19T06:40:35.935 INFO:tasks.workunit.client.1.smithi117.stdout:9/523: chown d4/d1c/d73/da8 3453 1 2024-09-19T06:40:35.936 INFO:tasks.workunit.client.1.smithi117.stdout:3/537: creat d0/d8/d7f/d40/f9d x:0 0 0 2024-09-19T06:40:35.939 INFO:tasks.workunit.client.1.smithi117.stdout:9/524: read d4/f33 [418239,2775] 0 2024-09-19T06:40:35.939 INFO:tasks.workunit.client.1.smithi117.stdout:8/584: link d1d/d2a/d3f/d4b/d66/f74 d1d/d2a/d3f/fca 0 2024-09-19T06:40:35.941 INFO:tasks.workunit.client.1.smithi117.stdout:9/525: symlink d4/d1c/d73/d93/lb1 0 2024-09-19T06:40:35.942 INFO:tasks.workunit.client.1.smithi117.stdout:9/526: read d4/f7 [7298052,126599] 0 2024-09-19T06:40:35.942 INFO:tasks.workunit.client.1.smithi117.stdout:8/585: fdatasync d1d/d2a/d3f/d4b/d5f/d95/f9b 0 2024-09-19T06:40:35.948 INFO:tasks.workunit.client.0.smithi099.stdout:0/322: sync 2024-09-19T06:40:35.949 INFO:tasks.workunit.client.1.smithi117.stdout:7/509: truncate d1/d72/fab 3522980 0 2024-09-19T06:40:35.951 INFO:tasks.workunit.client.1.smithi117.stdout:7/510: mknod d1/d4a/d81/d24/cb6 0 2024-09-19T06:40:35.952 INFO:tasks.workunit.client.1.smithi117.stdout:7/511: stat d1/d4a/f7b 0 2024-09-19T06:40:35.953 INFO:tasks.workunit.client.1.smithi117.stdout:7/512: write d1/d4a/d81/d24/d1c/d35/f6d [4209053,85052] 0 2024-09-19T06:40:35.953 INFO:tasks.workunit.client.0.smithi099.stdout:0/323: dwrite d0/f57 [0,4194304] 0 2024-09-19T06:40:35.954 INFO:tasks.workunit.client.0.smithi099.stdout:0/324: fdatasync d0/db/d2f/f43 0 2024-09-19T06:40:35.954 INFO:tasks.workunit.client.1.smithi117.stdout:7/513: chown d1/d4a/d81/d24/d1c/f4e 14 1 2024-09-19T06:40:35.955 INFO:tasks.workunit.client.0.smithi099.stdout:0/325: write d0/db/f48 [638561,25031] 0 2024-09-19T06:40:35.957 INFO:tasks.workunit.client.0.smithi099.stdout:0/326: write d0/db/d13/d1f/f28 [1560496,129846] 0 2024-09-19T06:40:35.960 INFO:tasks.workunit.client.0.smithi099.stdout:0/327: creat d0/db/d13/d1f/d39/f63 x:0 0 0 2024-09-19T06:40:35.964 INFO:tasks.workunit.client.1.smithi117.stdout:3/538: rmdir d0/d8/d7f 39 2024-09-19T06:40:35.965 INFO:tasks.workunit.client.0.smithi099.stdout:0/328: creat d0/db/d13/d37/d3c/f64 x:0 0 0 2024-09-19T06:40:35.967 INFO:tasks.workunit.client.1.smithi117.stdout:3/539: mkdir d0/d9/d4e/d9e 0 2024-09-19T06:40:35.967 INFO:tasks.workunit.client.0.smithi099.stdout:0/329: mknod d0/db/d13/d1f/c65 0 2024-09-19T06:40:35.968 INFO:tasks.workunit.client.0.smithi099.stdout:2/268: dread d1/d2/d4d/d52/d18/f2f [0,4194304] 0 2024-09-19T06:40:35.969 INFO:tasks.workunit.client.0.smithi099.stdout:0/330: read d0/db/d13/d1f/f2b [439181,112992] 0 2024-09-19T06:40:35.970 INFO:tasks.workunit.client.0.smithi099.stdout:2/269: write d1/d2/d4d/d52/d36/f53 [91782,56154] 0 2024-09-19T06:40:35.971 INFO:tasks.workunit.client.1.smithi117.stdout:3/540: symlink d0/d9/d49/l9f 0 2024-09-19T06:40:35.972 INFO:tasks.workunit.client.0.smithi099.stdout:0/331: fsync d0/db/d13/d1f/f2b 0 2024-09-19T06:40:35.972 INFO:tasks.workunit.client.0.smithi099.stdout:2/270: write d1/d2/d4d/d52/d18/f23 [1293633,91219] 0 2024-09-19T06:40:35.974 INFO:tasks.workunit.client.1.smithi117.stdout:9/527: dwrite d4/d8/fb [0,4194304] 0 2024-09-19T06:40:35.974 INFO:tasks.workunit.client.0.smithi099.stdout:0/332: creat d0/db/d13/d1f/d39/f66 x:0 0 0 2024-09-19T06:40:35.975 INFO:tasks.workunit.client.0.smithi099.stdout:2/271: write d1/d2/d4d/d52/d18/f2f [1694910,60425] 0 2024-09-19T06:40:35.977 INFO:tasks.workunit.client.0.smithi099.stdout:0/333: creat d0/db/d36/f67 x:0 0 0 2024-09-19T06:40:35.978 INFO:tasks.workunit.client.0.smithi099.stdout:0/334: chown d0/db/d13/d1f/f24 9702388 1 2024-09-19T06:40:35.978 INFO:tasks.workunit.client.1.smithi117.stdout:9/528: chown d4/d58/f67 36851 1 2024-09-19T06:40:35.979 INFO:tasks.workunit.client.0.smithi099.stdout:0/335: readlink d0/db/l26 0 2024-09-19T06:40:35.981 INFO:tasks.workunit.client.0.smithi099.stdout:0/336: symlink d0/db/d13/d37/d3c/l68 0 2024-09-19T06:40:35.983 INFO:tasks.workunit.client.1.smithi117.stdout:8/586: dwrite d1d/d2a/d3f/d73/f9e [0,4194304] 0 2024-09-19T06:40:35.986 INFO:tasks.workunit.client.0.smithi099.stdout:0/337: symlink d0/db/l69 0 2024-09-19T06:40:35.988 INFO:tasks.workunit.client.0.smithi099.stdout:0/338: rmdir d0/db/d27/d38 39 2024-09-19T06:40:35.991 INFO:tasks.workunit.client.1.smithi117.stdout:7/514: dwrite d1/d4a/d81/d48/d5f/f91 [0,4194304] 0 2024-09-19T06:40:35.991 INFO:tasks.workunit.client.1.smithi117.stdout:3/541: dread d0/d9/d49/f46 [4194304,4194304] 0 2024-09-19T06:40:35.993 INFO:tasks.workunit.client.1.smithi117.stdout:8/587: creat d1d/d2a/d3f/d4b/d66/dac/fcb x:0 0 0 2024-09-19T06:40:35.994 INFO:tasks.workunit.client.1.smithi117.stdout:9/529: dwrite d4/d58/f67 [0,4194304] 0 2024-09-19T06:40:35.995 INFO:tasks.workunit.client.0.smithi099.stdout:0/339: write d0/db/fc [5230005,127842] 0 2024-09-19T06:40:35.996 INFO:tasks.workunit.client.1.smithi117.stdout:3/542: truncate d0/d19/d2b/f9c 705839 0 2024-09-19T06:40:35.996 INFO:tasks.workunit.client.1.smithi117.stdout:9/530: chown d4/d1c/d73 28349 1 2024-09-19T06:40:36.001 INFO:tasks.workunit.client.0.smithi099.stdout:0/340: dread d0/db/d2f/f30 [0,4194304] 0 2024-09-19T06:40:36.001 INFO:tasks.workunit.client.1.smithi117.stdout:8/588: mknod d1d/d2a/d3f/d4c/db7/ccc 0 2024-09-19T06:40:36.001 INFO:tasks.workunit.client.0.smithi099.stdout:2/272: dwrite d1/d2/f12 [0,4194304] 0 2024-09-19T06:40:36.006 INFO:tasks.workunit.client.0.smithi099.stdout:2/273: mkdir d1/d2/d5/d13/d5c 0 2024-09-19T06:40:36.007 INFO:tasks.workunit.client.0.smithi099.stdout:0/341: creat d0/d17/f6a x:0 0 0 2024-09-19T06:40:36.010 INFO:tasks.workunit.client.0.smithi099.stdout:0/342: write d0/db/d13/d59/f60 [866855,48256] 0 2024-09-19T06:40:36.010 INFO:tasks.workunit.client.1.smithi117.stdout:7/515: dwrite d1/d4a/d81/d24/d1c/d55/f59 [0,4194304] 0 2024-09-19T06:40:36.011 INFO:tasks.workunit.client.1.smithi117.stdout:9/531: dread d4/f51 [0,4194304] 0 2024-09-19T06:40:36.011 INFO:tasks.workunit.client.1.smithi117.stdout:3/543: dread d0/d9/d49/f46 [4194304,4194304] 0 2024-09-19T06:40:36.012 INFO:tasks.workunit.client.0.smithi099.stdout:2/274: dwrite d1/f47 [4194304,4194304] 0 2024-09-19T06:40:36.014 INFO:tasks.workunit.client.1.smithi117.stdout:9/532: write f0 [3452108,66374] 0 2024-09-19T06:40:36.017 INFO:tasks.workunit.client.0.smithi099.stdout:0/343: dwrite d0/db/f46 [0,4194304] 0 2024-09-19T06:40:36.018 INFO:tasks.workunit.client.1.smithi117.stdout:3/544: creat d0/d19/d2b/d8e/fa0 x:0 0 0 2024-09-19T06:40:36.019 INFO:tasks.workunit.client.0.smithi099.stdout:2/275: symlink d1/d2/d4d/d52/l5d 0 2024-09-19T06:40:36.021 INFO:tasks.workunit.client.0.smithi099.stdout:2/276: write d1/d2/d5/f40 [1318006,60016] 0 2024-09-19T06:40:36.023 INFO:tasks.workunit.client.1.smithi117.stdout:3/545: write d0/d3d/d48/d77/d81/f8f [59329,3884] 0 2024-09-19T06:40:36.023 INFO:tasks.workunit.client.1.smithi117.stdout:9/533: mknod d4/d1c/d54/da5/cb2 0 2024-09-19T06:40:36.026 INFO:tasks.workunit.client.0.smithi099.stdout:2/277: unlink d1/d2/d4d/f56 0 2024-09-19T06:40:36.027 INFO:tasks.workunit.client.1.smithi117.stdout:7/516: getdents d1/d4a/d81/d48/d5f 0 2024-09-19T06:40:36.030 INFO:tasks.workunit.client.1.smithi117.stdout:3/546: creat d0/fa1 x:0 0 0 2024-09-19T06:40:36.031 INFO:tasks.workunit.client.1.smithi117.stdout:7/517: write d1/d4a/d81/d48/d5f/d82/fa5 [5231442,13853] 0 2024-09-19T06:40:36.031 INFO:tasks.workunit.client.0.smithi099.stdout:2/278: dread d1/d2/f12 [0,4194304] 0 2024-09-19T06:40:36.037 INFO:tasks.workunit.client.0.smithi099.stdout:2/279: dwrite d1/d2/d4d/d52/d36/f41 [0,4194304] 0 2024-09-19T06:40:36.043 INFO:tasks.workunit.client.0.smithi099.stdout:2/280: dread d1/d2/d4d/d52/d18/f23 [0,4194304] 0 2024-09-19T06:40:36.045 INFO:tasks.workunit.client.0.smithi099.stdout:2/281: creat d1/d2/d4d/f5e x:0 0 0 2024-09-19T06:40:36.046 INFO:tasks.workunit.client.0.smithi099.stdout:2/282: fdatasync d1/d2/d4d/d52/f2b 0 2024-09-19T06:40:36.049 INFO:tasks.workunit.client.1.smithi117.stdout:8/589: truncate d1d/d2a/d3f/d4b/d91/fba 4917906 0 2024-09-19T06:40:36.050 INFO:tasks.workunit.client.1.smithi117.stdout:3/547: rmdir d0/d19/d2b/d8e 39 2024-09-19T06:40:36.050 INFO:tasks.workunit.client.0.smithi099.stdout:2/283: dread d1/f25 [0,4194304] 0 2024-09-19T06:40:36.050 INFO:tasks.workunit.client.1.smithi117.stdout:3/548: fdatasync d0/d19/f78 0 2024-09-19T06:40:36.051 INFO:tasks.workunit.client.0.smithi099.stdout:2/284: read d1/f47 [1599385,98854] 0 2024-09-19T06:40:36.053 INFO:tasks.workunit.client.1.smithi117.stdout:3/549: write d0/d9/d1c/f28 [1708690,98268] 0 2024-09-19T06:40:36.055 INFO:tasks.workunit.client.1.smithi117.stdout:3/550: dread - d0/f62 zero size 2024-09-19T06:40:36.057 INFO:tasks.workunit.client.0.smithi099.stdout:0/344: dread d0/f1b [0,4194304] 0 2024-09-19T06:40:36.058 INFO:tasks.workunit.client.1.smithi117.stdout:8/590: dwrite d1d/d1e/f58 [0,4194304] 0 2024-09-19T06:40:36.062 INFO:tasks.workunit.client.0.smithi099.stdout:0/345: link d0/db/d13/d59/f60 d0/db/d27/d5d/f6b 0 2024-09-19T06:40:36.062 INFO:tasks.workunit.client.1.smithi117.stdout:3/551: creat d0/fa2 x:0 0 0 2024-09-19T06:40:36.062 INFO:tasks.workunit.client.0.smithi099.stdout:0/346: fdatasync d0/db/d27/f2c 0 2024-09-19T06:40:36.064 INFO:tasks.workunit.client.0.smithi099.stdout:0/347: truncate d0/db/d2f/f43 1167219 0 2024-09-19T06:40:36.064 INFO:tasks.workunit.client.1.smithi117.stdout:3/552: getdents d0/d9/d4e/d9e 0 2024-09-19T06:40:36.066 INFO:tasks.workunit.client.1.smithi117.stdout:3/553: read - d0/d19/d2b/d8e/f99 zero size 2024-09-19T06:40:36.068 INFO:tasks.workunit.client.1.smithi117.stdout:8/591: dread d1d/d2a/d3f/d4b/d5f/d95/fab [0,4194304] 0 2024-09-19T06:40:36.069 INFO:tasks.workunit.client.1.smithi117.stdout:3/554: creat d0/d9/d4e/d9e/fa3 x:0 0 0 2024-09-19T06:40:36.070 INFO:tasks.workunit.client.1.smithi117.stdout:3/555: creat d0/d9/d4e/d9e/fa4 x:0 0 0 2024-09-19T06:40:36.072 INFO:tasks.workunit.client.1.smithi117.stdout:8/592: rmdir d1d/d2a/d3f/d4c/db7/dc7 0 2024-09-19T06:40:36.074 INFO:tasks.workunit.client.1.smithi117.stdout:8/593: unlink d1d/d2a/l98 0 2024-09-19T06:40:36.076 INFO:tasks.workunit.client.1.smithi117.stdout:3/556: dwrite d0/d9/fd [4194304,4194304] 0 2024-09-19T06:40:36.077 INFO:tasks.workunit.client.0.smithi099.stdout:0/348: dwrite d0/db/f14 [0,4194304] 0 2024-09-19T06:40:36.079 INFO:tasks.workunit.client.0.smithi099.stdout:0/349: fsync d0/db/d36/f5f 0 2024-09-19T06:40:36.080 INFO:tasks.workunit.client.0.smithi099.stdout:0/350: chown d0/db/d27/d5d/f6b 3 1 2024-09-19T06:40:36.083 INFO:tasks.workunit.client.1.smithi117.stdout:8/594: write f19 [1659753,67108] 0 2024-09-19T06:40:36.084 INFO:tasks.workunit.client.0.smithi099.stdout:0/351: rename d0/db/d27/d5d/f6b to d0/db/d13/d59/f6c 0 2024-09-19T06:40:36.085 INFO:tasks.workunit.client.1.smithi117.stdout:3/557: dwrite d0/f5e [0,4194304] 0 2024-09-19T06:40:36.086 INFO:tasks.workunit.client.0.smithi099.stdout:0/352: write d0/db/d2f/f30 [714069,55369] 0 2024-09-19T06:40:36.089 INFO:tasks.workunit.client.1.smithi117.stdout:3/558: unlink d0/d8/c3c 0 2024-09-19T06:40:36.090 INFO:tasks.workunit.client.0.smithi099.stdout:0/353: dread d0/db/d13/d59/f60 [0,4194304] 0 2024-09-19T06:40:36.091 INFO:tasks.workunit.client.0.smithi099.stdout:0/354: chown d0/db/d13/d1f/f24 48 1 2024-09-19T06:40:36.091 INFO:tasks.workunit.client.0.smithi099.stdout:0/355: readlink d0/db/l10 0 2024-09-19T06:40:36.093 INFO:tasks.workunit.client.1.smithi117.stdout:3/559: truncate d0/f62 895970 0 2024-09-19T06:40:36.095 INFO:tasks.workunit.client.1.smithi117.stdout:8/595: dwrite d1d/fb1 [0,4194304] 0 2024-09-19T06:40:36.098 INFO:tasks.workunit.client.1.smithi117.stdout:3/560: mknod d0/d9/d4e/ca5 0 2024-09-19T06:40:36.099 INFO:tasks.workunit.client.0.smithi099.stdout:0/356: getdents d0/db/d27 0 2024-09-19T06:40:36.103 INFO:tasks.workunit.client.1.smithi117.stdout:3/561: mknod d0/d3d/d48/d77/ca6 0 2024-09-19T06:40:36.104 INFO:tasks.workunit.client.1.smithi117.stdout:8/596: dwrite d1d/d1e/d3b/f6c [0,4194304] 0 2024-09-19T06:40:36.106 INFO:tasks.workunit.client.0.smithi099.stdout:0/357: link d0/db/d13/d37/d3c/l68 d0/db/d27/d5d/l6d 0 2024-09-19T06:40:36.107 INFO:tasks.workunit.client.0.smithi099.stdout:0/358: mknod d0/db/d36/c6e 0 2024-09-19T06:40:36.129 INFO:tasks.workunit.client.0.smithi099.stdout:5/537: sync 2024-09-19T06:40:36.132 INFO:tasks.workunit.client.0.smithi099.stdout:5/538: mkdir d3/d16/d2f/d34/d3c/d65/dbe/dc2 0 2024-09-19T06:40:36.133 INFO:tasks.workunit.client.0.smithi099.stdout:0/359: truncate d0/f2a 3216833 0 2024-09-19T06:40:36.133 INFO:tasks.workunit.client.0.smithi099.stdout:5/539: truncate d3/d16/d5e/f85 286966 0 2024-09-19T06:40:36.136 INFO:tasks.workunit.client.0.smithi099.stdout:0/360: link d0/db/d13/d1f/d39/f66 d0/db/d2f/f6f 0 2024-09-19T06:40:36.137 INFO:tasks.workunit.client.0.smithi099.stdout:5/540: dread d3/f79 [0,4194304] 0 2024-09-19T06:40:36.143 INFO:tasks.workunit.client.0.smithi099.stdout:0/361: dwrite d0/db/d13/d1f/d39/f63 [0,4194304] 0 2024-09-19T06:40:36.145 INFO:tasks.workunit.client.0.smithi099.stdout:0/362: chown d0/db/d27/f2c 22 1 2024-09-19T06:40:36.148 INFO:tasks.workunit.client.0.smithi099.stdout:5/541: dwrite d3/d16/d5e/f62 [0,4194304] 0 2024-09-19T06:40:36.149 INFO:tasks.workunit.client.0.smithi099.stdout:0/363: getdents d0/db/d36/d3f 0 2024-09-19T06:40:36.159 INFO:tasks.workunit.client.0.smithi099.stdout:0/364: dwrite d0/db/d36/f67 [0,4194304] 0 2024-09-19T06:40:36.168 INFO:tasks.workunit.client.0.smithi099.stdout:5/542: write d3/d1f/f8e [1031908,35493] 0 2024-09-19T06:40:36.169 INFO:tasks.workunit.client.0.smithi099.stdout:5/543: write d3/d16/d2f/f89 [695773,81111] 0 2024-09-19T06:40:36.171 INFO:tasks.workunit.client.0.smithi099.stdout:5/544: creat d3/d16/d5e/db1/fc3 x:0 0 0 2024-09-19T06:40:36.173 INFO:tasks.workunit.client.0.smithi099.stdout:5/545: unlink d3/c7e 0 2024-09-19T06:40:36.175 INFO:tasks.workunit.client.0.smithi099.stdout:5/546: mknod d3/d7/d90/da6/cc4 0 2024-09-19T06:40:36.177 INFO:tasks.workunit.client.1.smithi117.stdout:2/448: sync 2024-09-19T06:40:36.179 INFO:tasks.workunit.client.1.smithi117.stdout:2/449: rmdir d0/d7/d29/d71 39 2024-09-19T06:40:36.180 INFO:tasks.workunit.client.1.smithi117.stdout:2/450: chown d0/d12/d2f/la6 55179728 1 2024-09-19T06:40:36.181 INFO:tasks.workunit.client.0.smithi099.stdout:5/547: dwrite d3/d7/fb8 [0,4194304] 0 2024-09-19T06:40:36.182 INFO:tasks.workunit.client.1.smithi117.stdout:2/451: write d0/d7/d1e/d20/d3e/f91 [391283,83650] 0 2024-09-19T06:40:36.184 INFO:tasks.workunit.client.1.smithi117.stdout:2/452: truncate d0/d7/f16 546853 0 2024-09-19T06:40:36.185 INFO:tasks.workunit.client.1.smithi117.stdout:2/453: chown d0/d6f/f80 124701 1 2024-09-19T06:40:36.188 INFO:tasks.workunit.client.0.smithi099.stdout:0/365: dread d0/db/fe [0,4194304] 0 2024-09-19T06:40:36.191 INFO:tasks.workunit.client.0.smithi099.stdout:5/548: dwrite d3/d1f/f76 [0,4194304] 0 2024-09-19T06:40:36.191 INFO:tasks.workunit.client.0.smithi099.stdout:0/366: symlink d0/d17/l70 0 2024-09-19T06:40:36.196 INFO:tasks.workunit.client.0.smithi099.stdout:5/549: creat d3/d16/d2f/d34/d3c/d65/dbe/dc2/fc5 x:0 0 0 2024-09-19T06:40:36.199 INFO:tasks.workunit.client.0.smithi099.stdout:5/550: creat d3/d16/d2f/fc6 x:0 0 0 2024-09-19T06:40:36.200 INFO:tasks.workunit.client.0.smithi099.stdout:0/367: dwrite d0/f3 [4194304,4194304] 0 2024-09-19T06:40:36.204 INFO:tasks.workunit.client.0.smithi099.stdout:0/368: mknod d0/db/d2f/c71 0 2024-09-19T06:40:36.207 INFO:tasks.workunit.client.0.smithi099.stdout:5/551: dwrite d3/d7/f96 [0,4194304] 0 2024-09-19T06:40:36.207 INFO:tasks.workunit.client.0.smithi099.stdout:0/369: mknod d0/db/d13/c72 0 2024-09-19T06:40:36.209 INFO:tasks.workunit.client.0.smithi099.stdout:5/552: read d3/d16/d5e/fbb [281649,4567] 0 2024-09-19T06:40:36.211 INFO:tasks.workunit.client.1.smithi117.stdout:2/454: dread d0/f2b [4194304,4194304] 0 2024-09-19T06:40:36.212 INFO:tasks.workunit.client.0.smithi099.stdout:0/370: symlink d0/db/d2f/l73 0 2024-09-19T06:40:36.213 INFO:tasks.workunit.client.1.smithi117.stdout:2/455: read d0/d6f/f8b [729999,63892] 0 2024-09-19T06:40:36.215 INFO:tasks.workunit.client.0.smithi099.stdout:5/553: symlink d3/d16/d2f/d34/da4/da5/lc7 0 2024-09-19T06:40:36.220 INFO:tasks.workunit.client.1.smithi117.stdout:2/456: dwrite d0/d7/fa1 [0,4194304] 0 2024-09-19T06:40:36.222 INFO:tasks.workunit.client.0.smithi099.stdout:5/554: dwrite d3/d16/d2f/d34/d3c/d65/f81 [0,4194304] 0 2024-09-19T06:40:36.226 INFO:tasks.workunit.client.1.smithi117.stdout:2/457: chown d0/d7/d29/d35/d61/d65/l7c 485487952 1 2024-09-19T06:40:36.230 INFO:tasks.workunit.client.0.smithi099.stdout:5/555: rename d3/d1f/f94 to d3/d16/d2f/d34/d3c/fc8 0 2024-09-19T06:40:36.231 INFO:tasks.workunit.client.0.smithi099.stdout:5/556: read d3/d7/fb [5070212,111631] 0 2024-09-19T06:40:36.231 INFO:tasks.workunit.client.0.smithi099.stdout:5/557: stat d3/db7 0 2024-09-19T06:40:36.232 INFO:tasks.workunit.client.1.smithi117.stdout:2/458: rename d0/d7/l7e to d0/d12/lad 0 2024-09-19T06:40:36.235 INFO:tasks.workunit.client.0.smithi099.stdout:5/558: write d3/f9 [2042161,61594] 0 2024-09-19T06:40:36.235 INFO:tasks.workunit.client.1.smithi117.stdout:2/459: mknod d0/d7/d58/da8/cae 0 2024-09-19T06:40:36.238 INFO:tasks.workunit.client.1.smithi117.stdout:2/460: symlink d0/d7/d29/d35/d61/d65/laf 0 2024-09-19T06:40:36.239 INFO:tasks.workunit.client.1.smithi117.stdout:2/461: mkdir d0/d7/d29/db0 0 2024-09-19T06:40:36.241 INFO:tasks.workunit.client.1.smithi117.stdout:2/462: rmdir d0/d7/d29/d35/d3d 39 2024-09-19T06:40:36.242 INFO:tasks.workunit.client.1.smithi117.stdout:2/463: stat d0/d7/d58/da8/cae 0 2024-09-19T06:40:36.251 INFO:tasks.workunit.client.1.smithi117.stdout:2/464: truncate d0/d7/d1e/d20/d3e/f4a 2866523 0 2024-09-19T06:40:36.252 INFO:tasks.workunit.client.1.smithi117.stdout:2/465: write d0/ff [1579517,119301] 0 2024-09-19T06:40:36.259 INFO:tasks.workunit.client.0.smithi099.stdout:5/559: dread d3/d16/f83 [0,4194304] 0 2024-09-19T06:40:36.259 INFO:tasks.workunit.client.1.smithi117.stdout:2/466: dwrite d0/d7/d29/d35/d61/d65/f8f [0,4194304] 0 2024-09-19T06:40:36.259 INFO:tasks.workunit.client.0.smithi099.stdout:5/560: stat d3/f25 0 2024-09-19T06:40:36.260 INFO:tasks.workunit.client.0.smithi099.stdout:4/397: sync 2024-09-19T06:40:36.260 INFO:tasks.workunit.client.0.smithi099.stdout:4/398: chown d12/f50 600590754 1 2024-09-19T06:40:36.261 INFO:tasks.workunit.client.0.smithi099.stdout:4/399: readlink d12/d58/l6b 0 2024-09-19T06:40:36.267 INFO:tasks.workunit.client.0.smithi099.stdout:5/561: dwrite d3/d2a/fb0 [0,4194304] 0 2024-09-19T06:40:36.269 INFO:tasks.workunit.client.0.smithi099.stdout:4/400: dwrite d12/f30 [4194304,4194304] 0 2024-09-19T06:40:36.270 INFO:tasks.workunit.client.1.smithi117.stdout:2/467: dread d0/d7/d29/d35/d3d/f57 [0,4194304] 0 2024-09-19T06:40:36.271 INFO:tasks.workunit.client.0.smithi099.stdout:4/401: write d12/f50 [1723514,32639] 0 2024-09-19T06:40:36.271 INFO:tasks.workunit.client.0.smithi099.stdout:4/402: chown d12/d32/d42/l45 29528 1 2024-09-19T06:40:36.273 INFO:tasks.workunit.client.0.smithi099.stdout:5/562: rename d3/d14/c99 to d3/d16/d5e/cc9 0 2024-09-19T06:40:36.273 INFO:tasks.workunit.client.1.smithi117.stdout:2/468: chown d0/d12/d32/d7d/f90 9 1 2024-09-19T06:40:36.276 INFO:tasks.workunit.client.1.smithi117.stdout:2/469: mkdir d0/d7/d58/db1 0 2024-09-19T06:40:36.277 INFO:tasks.workunit.client.1.smithi117.stdout:2/470: chown d0/d7/d1e/l99 12550 1 2024-09-19T06:40:36.280 INFO:tasks.workunit.client.1.smithi117.stdout:2/471: creat d0/d6f/fb2 x:0 0 0 2024-09-19T06:40:36.282 INFO:tasks.workunit.client.1.smithi117.stdout:2/472: creat d0/d7/d58/db1/fb3 x:0 0 0 2024-09-19T06:40:36.293 INFO:tasks.workunit.client.1.smithi117.stdout:2/473: dread d0/d7/f16 [0,4194304] 0 2024-09-19T06:40:36.294 INFO:tasks.workunit.client.1.smithi117.stdout:2/474: write d0/d7/d29/d35/d61/d65/f96 [321719,117221] 0 2024-09-19T06:40:36.295 INFO:tasks.workunit.client.1.smithi117.stdout:2/475: fdatasync d0/d7/d1e/f41 0 2024-09-19T06:40:36.295 INFO:tasks.workunit.client.0.smithi099.stdout:5/563: dwrite d3/d7/fb [0,4194304] 0 2024-09-19T06:40:36.298 INFO:tasks.workunit.client.0.smithi099.stdout:5/564: rmdir d3/d16/d5e 39 2024-09-19T06:40:36.300 INFO:tasks.workunit.client.0.smithi099.stdout:5/565: truncate d3/d16/d2f/d34/d3c/d65/f8a 745984 0 2024-09-19T06:40:36.306 INFO:tasks.workunit.client.0.smithi099.stdout:5/566: dwrite d3/f9 [0,4194304] 0 2024-09-19T06:40:36.309 INFO:tasks.workunit.client.0.smithi099.stdout:4/403: dread d12/f16 [0,4194304] 0 2024-09-19T06:40:36.312 INFO:tasks.workunit.client.0.smithi099.stdout:5/567: rename d3/d16/d2f/d8c/fae to d3/d7/d90/da6/fca 0 2024-09-19T06:40:36.313 INFO:tasks.workunit.client.1.smithi117.stdout:2/476: dread d0/d7/d1e/d20/d3e/f91 [0,4194304] 0 2024-09-19T06:40:36.315 INFO:tasks.workunit.client.1.smithi117.stdout:2/477: fsync d0/d7/d29/d35/d61/d65/f8f 0 2024-09-19T06:40:36.316 INFO:tasks.workunit.client.0.smithi099.stdout:5/568: dread d3/d16/f83 [0,4194304] 0 2024-09-19T06:40:36.317 INFO:tasks.workunit.client.0.smithi099.stdout:4/404: dread d12/d32/d42/d80/f83 [0,4194304] 0 2024-09-19T06:40:36.317 INFO:tasks.workunit.client.1.smithi117.stdout:2/478: fdatasync d0/d12/d32/f9f 0 2024-09-19T06:40:36.318 INFO:tasks.workunit.client.0.smithi099.stdout:4/405: truncate d12/d32/f86 365614 0 2024-09-19T06:40:36.319 INFO:tasks.workunit.client.0.smithi099.stdout:5/569: truncate d3/f79 225794 0 2024-09-19T06:40:36.320 INFO:tasks.workunit.client.1.smithi117.stdout:2/479: fsync d0/d7/f16 0 2024-09-19T06:40:36.320 INFO:tasks.workunit.client.1.smithi117.stdout:2/480: readlink d0/d7/d1e/l25 0 2024-09-19T06:40:36.321 INFO:tasks.workunit.client.0.smithi099.stdout:5/570: symlink d3/d14/lcb 0 2024-09-19T06:40:36.323 INFO:tasks.workunit.client.1.smithi117.stdout:2/481: mknod d0/d7/d29/d35/d3d/d72/cb4 0 2024-09-19T06:40:36.328 INFO:tasks.workunit.client.1.smithi117.stdout:2/482: write d0/f9 [2562640,38592] 0 2024-09-19T06:40:36.328 INFO:tasks.workunit.client.0.smithi099.stdout:5/571: truncate d3/d7/fb8 1521976 0 2024-09-19T06:40:36.329 INFO:tasks.workunit.client.1.smithi117.stdout:2/483: fdatasync d0/d12/d2f/f60 0 2024-09-19T06:40:36.330 INFO:tasks.workunit.client.0.smithi099.stdout:5/572: creat d3/d16/d2f/d8c/fcc x:0 0 0 2024-09-19T06:40:36.332 INFO:tasks.workunit.client.1.smithi117.stdout:2/484: getdents d0/d7/d58 0 2024-09-19T06:40:36.332 INFO:tasks.workunit.client.1.smithi117.stdout:2/485: read d0/f2b [5877817,4466] 0 2024-09-19T06:40:36.336 INFO:tasks.workunit.client.1.smithi117.stdout:2/486: rename d0/d7/d1e/d20/d3e to d0/d12/d32/db5 0 2024-09-19T06:40:36.337 INFO:tasks.workunit.client.0.smithi099.stdout:5/573: dwrite d3/d16/d2f/d34/d3c/fc8 [0,4194304] 0 2024-09-19T06:40:36.340 INFO:tasks.workunit.client.1.smithi117.stdout:2/487: symlink d0/d7/d29/d71/lb6 0 2024-09-19T06:40:36.340 INFO:tasks.workunit.client.1.smithi117.stdout:2/488: chown d0/d12/d2f 5963 1 2024-09-19T06:40:36.342 INFO:tasks.workunit.client.0.smithi099.stdout:5/574: rmdir d3/d7/d90/da6 39 2024-09-19T06:40:36.345 INFO:tasks.workunit.client.0.smithi099.stdout:5/575: mkdir d3/d16/d2f/d34/da4/da5/dcd 0 2024-09-19T06:40:36.345 INFO:tasks.workunit.client.1.smithi117.stdout:2/489: link d0/d7/d1e/l82 d0/d7/d29/db0/lb7 0 2024-09-19T06:40:36.347 INFO:tasks.workunit.client.0.smithi099.stdout:5/576: mkdir d3/d16/d2f/d34/da4/da5/dce 0 2024-09-19T06:40:36.355 INFO:tasks.workunit.client.0.smithi099.stdout:5/577: truncate d3/d1f/d4f/f5c 3173166 0 2024-09-19T06:40:36.374 INFO:tasks.workunit.client.1.smithi117.stdout:5/520: sync 2024-09-19T06:40:36.377 INFO:tasks.workunit.client.1.smithi117.stdout:5/521: creat d17/d1b/d3a/fb0 x:0 0 0 2024-09-19T06:40:36.382 INFO:tasks.workunit.client.1.smithi117.stdout:5/522: dwrite d17/f41 [0,4194304] 0 2024-09-19T06:40:36.386 INFO:tasks.workunit.client.1.smithi117.stdout:5/523: link l14 d17/d1b/d3a/d3c/lb1 0 2024-09-19T06:40:36.393 INFO:tasks.workunit.client.1.smithi117.stdout:5/524: dwrite d17/f81 [0,4194304] 0 2024-09-19T06:40:36.394 INFO:tasks.workunit.client.1.smithi117.stdout:5/525: read d17/f81 [3772187,94609] 0 2024-09-19T06:40:36.398 INFO:tasks.workunit.client.0.smithi099.stdout:7/478: sync 2024-09-19T06:40:36.402 INFO:tasks.workunit.client.0.smithi099.stdout:7/479: creat d7/d39/fb0 x:0 0 0 2024-09-19T06:40:36.405 INFO:tasks.workunit.client.0.smithi099.stdout:7/480: symlink d7/dd/d29/d1f/lb1 0 2024-09-19T06:40:36.409 INFO:tasks.workunit.client.1.smithi117.stdout:5/526: rename d17/c2c to d17/d1b/d3a/d3c/d46/cb2 0 2024-09-19T06:40:36.409 INFO:tasks.workunit.client.0.smithi099.stdout:7/481: getdents d7/dd/d29/d1f/d45/d48 0 2024-09-19T06:40:36.411 INFO:tasks.workunit.client.1.smithi117.stdout:5/527: rmdir d17/d1b/d3a/d3c/d70/d94 39 2024-09-19T06:40:36.412 INFO:tasks.workunit.client.0.smithi099.stdout:7/482: fdatasync d7/dd/d29/d34/f35 0 2024-09-19T06:40:36.413 INFO:tasks.workunit.client.1.smithi117.stdout:5/528: truncate d17/d1b/d3a/d3c/d46/f4a 785317 0 2024-09-19T06:40:36.413 INFO:tasks.workunit.client.0.smithi099.stdout:7/483: chown d7/dd/d29/d4e/d53/d64/f65 6766087 1 2024-09-19T06:40:36.414 INFO:tasks.workunit.client.1.smithi117.stdout:5/529: write d17/d1b/d3a/f68 [1860259,50310] 0 2024-09-19T06:40:36.415 INFO:tasks.workunit.client.0.smithi099.stdout:7/484: write d7/dd/d29/d4e/d53/d64/d67/f79 [2003570,128440] 0 2024-09-19T06:40:36.415 INFO:tasks.workunit.client.0.smithi099.stdout:7/485: readlink d7/d39/l3a 0 2024-09-19T06:40:36.416 INFO:tasks.workunit.client.1.smithi117.stdout:5/530: fdatasync d17/d2f/d6a/f8f 0 2024-09-19T06:40:36.420 INFO:tasks.workunit.client.0.smithi099.stdout:7/486: creat d7/fb2 x:0 0 0 2024-09-19T06:40:36.423 INFO:tasks.workunit.client.1.smithi117.stdout:5/531: dwrite d17/d1b/f28 [4194304,4194304] 0 2024-09-19T06:40:36.424 INFO:tasks.workunit.client.0.smithi099.stdout:7/487: unlink d7/dd/d29/d4e/d53/f5d 0 2024-09-19T06:40:36.426 INFO:tasks.workunit.client.1.smithi117.stdout:5/532: write d17/d2e/d55/f6e [396339,42732] 0 2024-09-19T06:40:36.426 INFO:tasks.workunit.client.0.smithi099.stdout:7/488: rmdir d7/dd/d29/d1f/d45/d48/d63/d71 39 2024-09-19T06:40:36.428 INFO:tasks.workunit.client.1.smithi117.stdout:5/533: mkdir d17/d1b/db3 0 2024-09-19T06:40:36.431 INFO:tasks.workunit.client.1.smithi117.stdout:5/534: truncate d17/d1b/d3a/d3c/d46/fa0 5069715 0 2024-09-19T06:40:36.434 INFO:tasks.workunit.client.1.smithi117.stdout:5/535: truncate d17/d1b/d3a/d3c/f3d 8607118 0 2024-09-19T06:40:36.438 INFO:tasks.workunit.client.0.smithi099.stdout:7/489: rmdir d7/dd 39 2024-09-19T06:40:36.441 INFO:tasks.workunit.client.0.smithi099.stdout:7/490: symlink d7/dd/d29/lb3 0 2024-09-19T06:40:36.442 INFO:tasks.workunit.client.0.smithi099.stdout:7/491: readlink d7/dd/d97/l9c 0 2024-09-19T06:40:36.444 INFO:tasks.workunit.client.0.smithi099.stdout:7/492: symlink d7/dd/d29/d34/d8f/lb4 0 2024-09-19T06:40:36.445 INFO:tasks.workunit.client.0.smithi099.stdout:7/493: write d7/dd/d29/d1f/d45/f84 [934845,34005] 0 2024-09-19T06:40:36.451 INFO:tasks.workunit.client.0.smithi099.stdout:7/494: dwrite d7/fb2 [0,4194304] 0 2024-09-19T06:40:36.455 INFO:tasks.workunit.client.0.smithi099.stdout:7/495: rename d7/d39/fb0 to d7/dd/d29/d1f/fb5 0 2024-09-19T06:40:36.456 INFO:tasks.workunit.client.0.smithi099.stdout:7/496: write d7/dd/d97/fa2 [6496,41316] 0 2024-09-19T06:40:36.457 INFO:tasks.workunit.client.1.smithi117.stdout:5/536: dread d17/d1b/d5d/d86/f8c [0,4194304] 0 2024-09-19T06:40:36.457 INFO:tasks.workunit.client.0.smithi099.stdout:7/497: readlink d7/dd/l99 0 2024-09-19T06:40:36.460 INFO:tasks.workunit.client.0.smithi099.stdout:7/498: chown d7/dd/d29/d1f/d45/d48/d63/d71/f94 1 1 2024-09-19T06:40:36.463 INFO:tasks.workunit.client.0.smithi099.stdout:7/499: mknod d7/dd/d29/d1f/d45/cb6 0 2024-09-19T06:40:36.464 INFO:tasks.workunit.client.1.smithi117.stdout:5/537: dwrite d17/d2f/d6a/f8f [0,4194304] 0 2024-09-19T06:40:36.464 INFO:tasks.workunit.client.0.smithi099.stdout:7/500: creat d7/d39/fb7 x:0 0 0 2024-09-19T06:40:36.465 INFO:tasks.workunit.client.0.smithi099.stdout:7/501: stat d7/dd/d29/d4e/d53/d64/d67/c6c 0 2024-09-19T06:40:36.466 INFO:tasks.workunit.client.1.smithi117.stdout:5/538: write d17/d1b/d3a/d3c/d70/f79 [1199937,69936] 0 2024-09-19T06:40:36.467 INFO:tasks.workunit.client.0.smithi099.stdout:7/502: dread - d7/dd/d29/d34/da1/fa9 zero size 2024-09-19T06:40:36.469 INFO:tasks.workunit.client.1.smithi117.stdout:5/539: rename d17/l27 to d17/d1b/d5d/d86/lb4 0 2024-09-19T06:40:36.470 INFO:tasks.workunit.client.0.smithi099.stdout:7/503: symlink d7/dd/d29/d4e/d53/d64/d67/lb8 0 2024-09-19T06:40:36.472 INFO:tasks.workunit.client.1.smithi117.stdout:5/540: truncate d17/d2e/f5f 1229554 0 2024-09-19T06:40:36.473 INFO:tasks.workunit.client.1.smithi117.stdout:5/541: write d17/d1b/d3a/d3c/d46/f91 [144896,33184] 0 2024-09-19T06:40:36.473 INFO:tasks.workunit.client.0.smithi099.stdout:7/504: creat d7/dd/fb9 x:0 0 0 2024-09-19T06:40:36.476 INFO:tasks.workunit.client.1.smithi117.stdout:5/542: symlink d17/d2e/lb5 0 2024-09-19T06:40:36.481 INFO:tasks.workunit.client.0.smithi099.stdout:7/505: dwrite d7/dd/d29/d4e/f77 [4194304,4194304] 0 2024-09-19T06:40:36.482 INFO:tasks.workunit.client.1.smithi117.stdout:0/412: sync 2024-09-19T06:40:36.482 INFO:tasks.workunit.client.0.smithi099.stdout:2/285: sync 2024-09-19T06:40:36.482 INFO:tasks.workunit.client.0.smithi099.stdout:6/384: sync 2024-09-19T06:40:36.483 INFO:tasks.workunit.client.0.smithi099.stdout:9/445: sync 2024-09-19T06:40:36.483 INFO:tasks.workunit.client.1.smithi117.stdout:5/543: rmdir d17/d2e 39 2024-09-19T06:40:36.483 INFO:tasks.workunit.client.0.smithi099.stdout:0/371: sync 2024-09-19T06:40:36.484 INFO:tasks.workunit.client.0.smithi099.stdout:8/287: sync 2024-09-19T06:40:36.484 INFO:tasks.workunit.client.0.smithi099.stdout:1/346: sync 2024-09-19T06:40:36.484 INFO:tasks.workunit.client.0.smithi099.stdout:3/567: sync 2024-09-19T06:40:36.485 INFO:tasks.workunit.client.0.smithi099.stdout:7/506: creat d7/dd/d29/d4e/d53/fba x:0 0 0 2024-09-19T06:40:36.485 INFO:tasks.workunit.client.0.smithi099.stdout:0/372: stat d0/db/d2f/f30 0 2024-09-19T06:40:36.486 INFO:tasks.workunit.client.0.smithi099.stdout:7/507: chown d7/d39/caa 21 1 2024-09-19T06:40:36.487 INFO:tasks.workunit.client.1.smithi117.stdout:0/413: truncate d11/d13/d14/d2c/f50 593002 0 2024-09-19T06:40:36.489 INFO:tasks.workunit.client.1.smithi117.stdout:5/544: rmdir d17/d2e/d65 39 2024-09-19T06:40:36.490 INFO:tasks.workunit.client.0.smithi099.stdout:3/568: creat d7/d34/d1d/d20/d58/d5c/fa4 x:0 0 0 2024-09-19T06:40:36.491 INFO:tasks.workunit.client.1.smithi117.stdout:5/545: chown d17/d1b/d3a/d3c 196742 1 2024-09-19T06:40:36.494 INFO:tasks.workunit.client.0.smithi099.stdout:0/373: fsync d0/db/d2f/f6f 0 2024-09-19T06:40:36.494 INFO:tasks.workunit.client.1.smithi117.stdout:5/546: mknod d17/d2e/dab/cb6 0 2024-09-19T06:40:36.495 INFO:tasks.workunit.client.0.smithi099.stdout:7/508: creat d7/dd/d29/d34/da1/fbb x:0 0 0 2024-09-19T06:40:36.496 INFO:tasks.workunit.client.1.smithi117.stdout:0/414: dwrite d11/d13/d14/f49 [0,4194304] 0 2024-09-19T06:40:36.496 INFO:tasks.workunit.client.0.smithi099.stdout:3/569: fsync d7/f55 0 2024-09-19T06:40:36.497 INFO:tasks.workunit.client.0.smithi099.stdout:1/347: rmdir d0/d2d/d6d 0 2024-09-19T06:40:36.497 INFO:tasks.workunit.client.0.smithi099.stdout:6/385: dwrite d1/f35 [0,4194304] 0 2024-09-19T06:40:36.498 INFO:tasks.workunit.client.0.smithi099.stdout:7/509: dread - d7/dd/d29/d34/da1/fa9 zero size 2024-09-19T06:40:36.499 INFO:tasks.workunit.client.0.smithi099.stdout:1/348: fdatasync d0/d17/d24/f6e 0 2024-09-19T06:40:36.500 INFO:tasks.workunit.client.0.smithi099.stdout:0/374: creat d0/db/d13/d1f/d39/f74 x:0 0 0 2024-09-19T06:40:36.502 INFO:tasks.workunit.client.0.smithi099.stdout:2/286: rmdir d1/d2/d4d/d52/d9/d37 0 2024-09-19T06:40:36.502 INFO:tasks.workunit.client.0.smithi099.stdout:6/386: rmdir d1/d12 39 2024-09-19T06:40:36.503 INFO:tasks.workunit.client.1.smithi117.stdout:5/547: fsync d17/d1b/d3a/d3c/d46/fa0 0 2024-09-19T06:40:36.504 INFO:tasks.workunit.client.1.smithi117.stdout:5/548: dread - d17/d2f/d6a/f72 zero size 2024-09-19T06:40:36.506 INFO:tasks.workunit.client.0.smithi099.stdout:3/570: creat d7/d34/d28/fa5 x:0 0 0 2024-09-19T06:40:36.506 INFO:tasks.workunit.client.1.smithi117.stdout:0/415: link d11/f5a d11/d13/d14/f86 0 2024-09-19T06:40:36.507 INFO:tasks.workunit.client.1.smithi117.stdout:5/549: truncate d17/d1b/d3a/f3e 557929 0 2024-09-19T06:40:36.507 INFO:tasks.workunit.client.0.smithi099.stdout:3/571: fsync d7/d34/d1d/d36/d69/f6b 0 2024-09-19T06:40:36.508 INFO:tasks.workunit.client.0.smithi099.stdout:7/510: creat d7/dd/d29/d4e/fbc x:0 0 0 2024-09-19T06:40:36.508 INFO:tasks.workunit.client.1.smithi117.stdout:5/550: write d17/d2f/d3b/f44 [4676112,77457] 0 2024-09-19T06:40:36.509 INFO:tasks.workunit.client.0.smithi099.stdout:2/287: creat d1/f5f x:0 0 0 2024-09-19T06:40:36.510 INFO:tasks.workunit.client.0.smithi099.stdout:0/375: mkdir d0/db/d13/d47/d75 0 2024-09-19T06:40:36.510 INFO:tasks.workunit.client.1.smithi117.stdout:0/416: fsync d11/d13/d1b/d4b/f4f 0 2024-09-19T06:40:36.512 INFO:tasks.workunit.client.0.smithi099.stdout:7/511: fdatasync d7/dd/d29/d1f/d45/d48/d63/d75/fa4 0 2024-09-19T06:40:36.512 INFO:tasks.workunit.client.0.smithi099.stdout:3/572: unlink d7/d34/d1d/l2e 0 2024-09-19T06:40:36.513 INFO:tasks.workunit.client.0.smithi099.stdout:6/387: mkdir d1/d7c 0 2024-09-19T06:40:36.516 INFO:tasks.workunit.client.1.smithi117.stdout:0/417: creat d11/d13/d28/f87 x:0 0 0 2024-09-19T06:40:36.517 INFO:tasks.workunit.client.0.smithi099.stdout:0/376: read d0/db/d2f/f4e [2124893,127108] 0 2024-09-19T06:40:36.517 INFO:tasks.workunit.client.0.smithi099.stdout:7/512: unlink d7/dd/d29/d4e/d53/d64/f89 0 2024-09-19T06:40:36.520 INFO:tasks.workunit.client.0.smithi099.stdout:0/377: dread - d0/db/d13/d1f/d39/f74 zero size 2024-09-19T06:40:36.521 INFO:tasks.workunit.client.0.smithi099.stdout:2/288: dwrite d1/d2/d4d/d52/d18/d27/f48 [0,4194304] 0 2024-09-19T06:40:36.522 INFO:tasks.workunit.client.0.smithi099.stdout:9/446: dread dd/f70 [0,4194304] 0 2024-09-19T06:40:36.522 INFO:tasks.workunit.client.0.smithi099.stdout:6/388: creat d1/d5/d24/d2e/d41/d4e/d54/d5d/d61/f7d x:0 0 0 2024-09-19T06:40:36.523 INFO:tasks.workunit.client.0.smithi099.stdout:0/378: write d0/d17/f6a [932218,125379] 0 2024-09-19T06:40:36.524 INFO:tasks.workunit.client.0.smithi099.stdout:3/573: rename d7/d34/d1d/d36/l4e to d7/d34/d1d/d20/la6 0 2024-09-19T06:40:36.525 INFO:tasks.workunit.client.0.smithi099.stdout:3/574: chown d7/c9c 0 1 2024-09-19T06:40:36.526 INFO:tasks.workunit.client.0.smithi099.stdout:6/389: read d1/d12/f39 [3439800,20058] 0 2024-09-19T06:40:36.526 INFO:tasks.workunit.client.0.smithi099.stdout:0/379: creat d0/db/d36/f76 x:0 0 0 2024-09-19T06:40:36.527 INFO:tasks.workunit.client.1.smithi117.stdout:0/418: truncate d11/d13/d14/f49 3875582 0 2024-09-19T06:40:36.527 INFO:tasks.workunit.client.0.smithi099.stdout:8/288: dread d4/de/d1c/f1d [0,4194304] 0 2024-09-19T06:40:36.528 INFO:tasks.workunit.client.0.smithi099.stdout:9/447: rename dd/d47/d40/c29 to dd/d62/c94 0 2024-09-19T06:40:36.530 INFO:tasks.workunit.client.1.smithi117.stdout:0/419: mknod d11/d13/c88 0 2024-09-19T06:40:36.532 INFO:tasks.workunit.client.0.smithi099.stdout:3/575: mknod d7/d34/d1d/d57/ca7 0 2024-09-19T06:40:36.539 INFO:tasks.workunit.client.0.smithi099.stdout:0/380: rename d0/db/fe to d0/db/d13/d1f/d3a/f77 0 2024-09-19T06:40:36.539 INFO:tasks.workunit.client.1.smithi117.stdout:0/420: dwrite d11/d13/d14/f33 [0,4194304] 0 2024-09-19T06:40:36.540 INFO:tasks.workunit.client.0.smithi099.stdout:6/390: dwrite d1/f1d [4194304,4194304] 0 2024-09-19T06:40:36.540 INFO:tasks.workunit.client.0.smithi099.stdout:2/289: mknod d1/d2/d4d/d52/d18/d46/c60 0 2024-09-19T06:40:36.541 INFO:tasks.workunit.client.1.smithi117.stdout:5/551: dread d17/f21 [4194304,4194304] 0 2024-09-19T06:40:36.541 INFO:tasks.workunit.client.0.smithi099.stdout:1/349: truncate d0/d12/d13/f2b 1411158 0 2024-09-19T06:40:36.544 INFO:tasks.workunit.client.0.smithi099.stdout:3/576: creat d7/d34/d1d/d57/d76/fa8 x:0 0 0 2024-09-19T06:40:36.545 INFO:tasks.workunit.client.0.smithi099.stdout:2/290: chown d1/d2/d4d/d52 1800459 1 2024-09-19T06:40:36.546 INFO:tasks.workunit.client.0.smithi099.stdout:8/289: dwrite f3 [4194304,4194304] 0 2024-09-19T06:40:36.547 INFO:tasks.workunit.client.0.smithi099.stdout:2/291: readlink d1/d2/d4d/d52/d36/l3a 0 2024-09-19T06:40:36.548 INFO:tasks.workunit.client.1.smithi117.stdout:0/421: mknod d11/d13/d7a/c89 0 2024-09-19T06:40:36.548 INFO:tasks.workunit.client.0.smithi099.stdout:1/350: readlink d0/l14 0 2024-09-19T06:40:36.549 INFO:tasks.workunit.client.0.smithi099.stdout:3/577: fdatasync d7/d34/f3a 0 2024-09-19T06:40:36.549 INFO:tasks.workunit.client.0.smithi099.stdout:2/292: stat d1/f39 0 2024-09-19T06:40:36.549 INFO:tasks.workunit.client.0.smithi099.stdout:0/381: symlink d0/db/d13/d1f/d39/l78 0 2024-09-19T06:40:36.550 INFO:tasks.workunit.client.0.smithi099.stdout:8/290: readlink d4/l3d 0 2024-09-19T06:40:36.550 INFO:tasks.workunit.client.0.smithi099.stdout:1/351: write d0/d12/f30 [345197,9862] 0 2024-09-19T06:40:36.552 INFO:tasks.workunit.client.1.smithi117.stdout:0/422: truncate d11/f19 6299500 0 2024-09-19T06:40:36.552 INFO:tasks.workunit.client.0.smithi099.stdout:6/391: mknod d1/d5/d24/d2e/d7b/c7e 0 2024-09-19T06:40:36.553 INFO:tasks.workunit.client.0.smithi099.stdout:3/578: stat d7/d34/d1d/d36/d69/d6d/d8f 0 2024-09-19T06:40:36.553 INFO:tasks.workunit.client.0.smithi099.stdout:9/448: write dd/f44 [5107084,118146] 0 2024-09-19T06:40:36.556 INFO:tasks.workunit.client.1.smithi117.stdout:0/423: symlink d11/d13/d1b/d27/d54/l8a 0 2024-09-19T06:40:36.556 INFO:tasks.workunit.client.0.smithi099.stdout:3/579: readlink d7/d34/d1d/d20/l8e 0 2024-09-19T06:40:36.560 INFO:tasks.workunit.client.0.smithi099.stdout:9/449: chown dd/d47/d40/f52 36 1 2024-09-19T06:40:36.561 INFO:tasks.workunit.client.0.smithi099.stdout:2/293: truncate d1/d2/d5/d13/d2c/f49 243591 0 2024-09-19T06:40:36.563 INFO:tasks.workunit.client.0.smithi099.stdout:9/450: read dd/f60 [7016014,47022] 0 2024-09-19T06:40:36.566 INFO:tasks.workunit.client.0.smithi099.stdout:0/382: dwrite d0/db/d13/d1f/f2b [0,4194304] 0 2024-09-19T06:40:36.567 INFO:tasks.workunit.client.0.smithi099.stdout:9/451: symlink dd/d47/l95 0 2024-09-19T06:40:36.567 INFO:tasks.workunit.client.0.smithi099.stdout:1/352: dread d0/d68/f1d [0,4194304] 0 2024-09-19T06:40:36.570 INFO:tasks.workunit.client.0.smithi099.stdout:0/383: rmdir d0/db/d13/d37 39 2024-09-19T06:40:36.572 INFO:tasks.workunit.client.0.smithi099.stdout:2/294: dwrite d1/d2/d4d/f5e [0,4194304] 0 2024-09-19T06:40:36.577 INFO:tasks.workunit.client.0.smithi099.stdout:2/295: readlink d1/d2/d4d/d52/d9/l51 0 2024-09-19T06:40:36.581 INFO:tasks.workunit.client.1.smithi117.stdout:5/552: dread ff [0,4194304] 0 2024-09-19T06:40:36.581 INFO:tasks.workunit.client.1.smithi117.stdout:5/553: readlink d17/d1b/d3a/l45 0 2024-09-19T06:40:36.582 INFO:tasks.workunit.client.1.smithi117.stdout:5/554: stat d17/d2f/c4d 0 2024-09-19T06:40:36.583 INFO:tasks.workunit.client.0.smithi099.stdout:0/384: dwrite d0/db/d13/f1e [0,4194304] 0 2024-09-19T06:40:36.584 INFO:tasks.workunit.client.1.smithi117.stdout:5/555: write d17/d2f/d3b/f44 [5626986,96864] 0 2024-09-19T06:40:36.584 INFO:tasks.workunit.client.0.smithi099.stdout:2/296: rename d1/d2/d5/d6/c34 to d1/c61 0 2024-09-19T06:40:36.587 INFO:tasks.workunit.client.0.smithi099.stdout:0/385: symlink d0/db/d13/d59/l79 0 2024-09-19T06:40:36.592 INFO:tasks.workunit.client.1.smithi117.stdout:5/556: link d17/d5c/f69 d17/d2e/dab/fb7 0 2024-09-19T06:40:36.593 INFO:tasks.workunit.client.0.smithi099.stdout:2/297: link d1/d2/d4d/d52/d36/f53 d1/d2/d4d/d52/d18/d2d/f62 0 2024-09-19T06:40:36.594 INFO:tasks.workunit.client.0.smithi099.stdout:0/386: rename d0/db/d2f/c71 to d0/d17/d41/c7a 0 2024-09-19T06:40:36.595 INFO:tasks.workunit.client.1.smithi117.stdout:5/557: chown d17/d1b/d3a/d3c/d46/f4f 589 1 2024-09-19T06:40:36.595 INFO:tasks.workunit.client.0.smithi099.stdout:9/452: dread dd/d47/d68/f6c [0,4194304] 0 2024-09-19T06:40:36.597 INFO:tasks.workunit.client.0.smithi099.stdout:6/392: dread d1/f4f [0,4194304] 0 2024-09-19T06:40:36.597 INFO:tasks.workunit.client.1.smithi117.stdout:5/558: mkdir d17/d5c/db8 0 2024-09-19T06:40:36.598 INFO:tasks.workunit.client.0.smithi099.stdout:2/298: rename d1/d2/d4d/d52/dc to d1/d2/d4d/d52/d9/d63 0 2024-09-19T06:40:36.599 INFO:tasks.workunit.client.1.smithi117.stdout:5/559: fdatasync d17/f81 0 2024-09-19T06:40:36.600 INFO:tasks.workunit.client.0.smithi099.stdout:6/393: mknod d1/d5/d24/d2e/d41/d4e/c7f 0 2024-09-19T06:40:36.603 INFO:tasks.workunit.client.0.smithi099.stdout:0/387: dwrite d0/db/d13/d1f/d4a/f50 [0,4194304] 0 2024-09-19T06:40:36.606 INFO:tasks.workunit.client.1.smithi117.stdout:5/560: dwrite d17/d1b/d5d/d7d/f8a [0,4194304] 0 2024-09-19T06:40:36.608 INFO:tasks.workunit.client.0.smithi099.stdout:9/453: dwrite dd/d2c/f5a [0,4194304] 0 2024-09-19T06:40:36.610 INFO:tasks.workunit.client.1.smithi117.stdout:5/561: fdatasync d17/d1b/d3a/d3c/d46/f4f 0 2024-09-19T06:40:36.612 INFO:tasks.workunit.client.0.smithi099.stdout:9/454: write dd/d2c/f39 [1454853,8779] 0 2024-09-19T06:40:36.612 INFO:tasks.workunit.client.0.smithi099.stdout:0/388: creat d0/db/d13/d1f/d4a/f7b x:0 0 0 2024-09-19T06:40:36.614 INFO:tasks.workunit.client.0.smithi099.stdout:3/580: dread d7/d34/d1d/d36/f4f [4194304,4194304] 0 2024-09-19T06:40:36.615 INFO:tasks.workunit.client.0.smithi099.stdout:2/299: dwrite d1/d2/d4d/d52/d18/f23 [4194304,4194304] 0 2024-09-19T06:40:36.615 INFO:tasks.workunit.client.1.smithi117.stdout:5/562: rmdir d17/d1b/db3 0 2024-09-19T06:40:36.619 INFO:tasks.workunit.client.0.smithi099.stdout:3/581: truncate d7/d34/d1d/d36/d69/f6b 467219 0 2024-09-19T06:40:36.622 INFO:tasks.workunit.client.0.smithi099.stdout:6/394: link d1/d5/d24/d2b/f45 d1/d5/d24/d2b/f80 0 2024-09-19T06:40:36.623 INFO:tasks.workunit.client.0.smithi099.stdout:9/455: dwrite dd/d47/d40/d61/f63 [0,4194304] 0 2024-09-19T06:40:36.625 INFO:tasks.workunit.client.0.smithi099.stdout:6/395: chown d1/c36 64 1 2024-09-19T06:40:36.625 INFO:tasks.workunit.client.1.smithi117.stdout:5/563: dwrite d17/d1b/d3a/f68 [0,4194304] 0 2024-09-19T06:40:36.626 INFO:tasks.workunit.client.0.smithi099.stdout:6/396: write d1/d5/f50 [1344162,12378] 0 2024-09-19T06:40:36.629 INFO:tasks.workunit.client.0.smithi099.stdout:5/578: sync 2024-09-19T06:40:36.629 INFO:tasks.workunit.client.0.smithi099.stdout:4/406: sync 2024-09-19T06:40:36.637 INFO:tasks.workunit.client.0.smithi099.stdout:6/397: mkdir d1/d5/d24/d2e/d41/d81 0 2024-09-19T06:40:36.638 INFO:tasks.workunit.client.0.smithi099.stdout:9/456: dwrite dd/f70 [0,4194304] 0 2024-09-19T06:40:36.638 INFO:tasks.workunit.client.0.smithi099.stdout:9/457: readlink l7 0 2024-09-19T06:40:36.642 INFO:tasks.workunit.client.0.smithi099.stdout:2/300: creat d1/d2/f64 x:0 0 0 2024-09-19T06:40:36.644 INFO:tasks.workunit.client.0.smithi099.stdout:5/579: getdents d3/db7 0 2024-09-19T06:40:36.646 INFO:tasks.workunit.client.0.smithi099.stdout:3/582: dread d7/d34/d1d/d20/d58/d5c/f5d [0,4194304] 0 2024-09-19T06:40:36.646 INFO:tasks.workunit.client.0.smithi099.stdout:9/458: rename dd/d2c/f88 to dd/d65/f96 0 2024-09-19T06:40:36.646 INFO:tasks.workunit.client.0.smithi099.stdout:0/389: link d0/d17/d41/f3d d0/db/d13/d37/d3c/d3e/f7c 0 2024-09-19T06:40:36.648 INFO:tasks.workunit.client.0.smithi099.stdout:6/398: mknod d1/d5/c82 0 2024-09-19T06:40:36.648 INFO:tasks.workunit.client.0.smithi099.stdout:0/390: write d0/db/d13/d1f/d4a/f7b [409071,26906] 0 2024-09-19T06:40:36.657 INFO:tasks.workunit.client.1.smithi117.stdout:5/564: mknod d17/d1b/d5d/d7d/cb9 0 2024-09-19T06:40:36.662 INFO:tasks.workunit.client.1.smithi117.stdout:5/565: dread d17/f81 [0,4194304] 0 2024-09-19T06:40:36.665 INFO:tasks.workunit.client.1.smithi117.stdout:5/566: unlink d17/d2f/d3b/l6b 0 2024-09-19T06:40:36.689 INFO:tasks.workunit.client.1.smithi117.stdout:5/567: write d17/d2f/f80 [5048123,48277] 0 2024-09-19T06:40:36.690 INFO:tasks.workunit.client.1.smithi117.stdout:5/568: stat d17/d1b/d3a/d3c/d46/f4a 0 2024-09-19T06:40:36.697 INFO:tasks.workunit.client.1.smithi117.stdout:5/569: rename d17/d2e/d65/d88/c93 to d17/d1b/d3a/d3c/d46/cba 0 2024-09-19T06:40:36.704 INFO:tasks.workunit.client.1.smithi117.stdout:5/570: dwrite d17/f22 [0,4194304] 0 2024-09-19T06:40:36.708 INFO:tasks.workunit.client.1.smithi117.stdout:5/571: mknod d17/d2f/d3b/cbb 0 2024-09-19T06:40:36.718 INFO:tasks.workunit.client.1.smithi117.stdout:5/572: dwrite d17/f9d [0,4194304] 0 2024-09-19T06:40:36.722 INFO:tasks.workunit.client.1.smithi117.stdout:3/562: sync 2024-09-19T06:40:36.722 INFO:tasks.workunit.client.1.smithi117.stdout:6/379: sync 2024-09-19T06:40:36.723 INFO:tasks.workunit.client.1.smithi117.stdout:2/490: sync 2024-09-19T06:40:36.723 INFO:tasks.workunit.client.1.smithi117.stdout:9/534: sync 2024-09-19T06:40:36.723 INFO:tasks.workunit.client.1.smithi117.stdout:1/514: sync 2024-09-19T06:40:36.723 INFO:tasks.workunit.client.1.smithi117.stdout:8/597: sync 2024-09-19T06:40:36.723 INFO:tasks.workunit.client.1.smithi117.stdout:4/718: sync 2024-09-19T06:40:36.723 INFO:tasks.workunit.client.1.smithi117.stdout:7/518: sync 2024-09-19T06:40:36.724 INFO:tasks.workunit.client.1.smithi117.stdout:3/563: dread - d0/d8/f73 zero size 2024-09-19T06:40:36.729 INFO:tasks.workunit.client.1.smithi117.stdout:4/719: write d3/d1b/d7d/f4b [4459427,72732] 0 2024-09-19T06:40:36.730 INFO:tasks.workunit.client.1.smithi117.stdout:6/380: read d1/f3c [571817,98237] 0 2024-09-19T06:40:36.731 INFO:tasks.workunit.client.1.smithi117.stdout:2/491: read d0/d7/d29/d35/d61/d65/f96 [214573,11317] 0 2024-09-19T06:40:36.733 INFO:tasks.workunit.client.1.smithi117.stdout:5/573: link c9 d17/d1b/d3a/d3c/d70/d94/cbc 0 2024-09-19T06:40:36.733 INFO:tasks.workunit.client.1.smithi117.stdout:4/720: fsync d3/d4/d5f/f7f 0 2024-09-19T06:40:36.734 INFO:tasks.workunit.client.1.smithi117.stdout:8/598: mknod d1d/d2a/d3f/d4b/d91/d97/ccd 0 2024-09-19T06:40:36.735 INFO:tasks.workunit.client.1.smithi117.stdout:3/564: mknod d0/d19/d2b/ca7 0 2024-09-19T06:40:36.740 INFO:tasks.workunit.client.1.smithi117.stdout:2/492: creat d0/d7/d7f/fb8 x:0 0 0 2024-09-19T06:40:36.741 INFO:tasks.workunit.client.1.smithi117.stdout:1/515: dwrite d3/d18/d23/f6b [0,4194304] 0 2024-09-19T06:40:36.744 INFO:tasks.workunit.client.1.smithi117.stdout:7/519: dwrite d1/d4a/d7c/f98 [0,4194304] 0 2024-09-19T06:40:36.745 INFO:tasks.workunit.client.1.smithi117.stdout:4/721: mknod d3/db/d23/ceb 0 2024-09-19T06:40:36.748 INFO:tasks.workunit.client.1.smithi117.stdout:5/574: write d17/d1b/d3a/fa3 [252573,115923] 0 2024-09-19T06:40:36.752 INFO:tasks.workunit.client.1.smithi117.stdout:8/599: write d1d/d2a/d3f/d4b/d5f/d95/f78 [275895,109955] 0 2024-09-19T06:40:36.753 INFO:tasks.workunit.client.1.smithi117.stdout:6/381: dwrite d1/d5/d32/d45/f4d [0,4194304] 0 2024-09-19T06:40:36.755 INFO:tasks.workunit.client.1.smithi117.stdout:9/535: dread d4/f7 [0,4194304] 0 2024-09-19T06:40:36.755 INFO:tasks.workunit.client.1.smithi117.stdout:2/493: unlink d0/d7/d58/c6e 0 2024-09-19T06:40:36.756 INFO:tasks.workunit.client.1.smithi117.stdout:6/382: stat d1/d3d/f5a 0 2024-09-19T06:40:36.757 INFO:tasks.workunit.client.1.smithi117.stdout:1/516: rename d3/d18/d23/d51/lad to d3/d18/d23/d51/lb2 0 2024-09-19T06:40:36.758 INFO:tasks.workunit.client.1.smithi117.stdout:9/536: fdatasync d4/d1c/d46/f6b 0 2024-09-19T06:40:36.762 INFO:tasks.workunit.client.0.smithi099.stdout:6/399: chown d1/d5/d24/d2e/d41/d4e/d2a/c46 322654 1 2024-09-19T06:40:36.762 INFO:tasks.workunit.client.0.smithi099.stdout:4/407: write d12/d32/f27 [1371804,36804] 0 2024-09-19T06:40:36.766 INFO:tasks.workunit.client.0.smithi099.stdout:9/459: dwrite dd/d65/f92 [0,4194304] 0 2024-09-19T06:40:36.767 INFO:tasks.workunit.client.0.smithi099.stdout:0/391: creat d0/db/d13/f7d x:0 0 0 2024-09-19T06:40:36.767 INFO:tasks.workunit.client.1.smithi117.stdout:1/517: read - d3/d18/d23/d51/f80 zero size 2024-09-19T06:40:36.767 INFO:tasks.workunit.client.1.smithi117.stdout:0/424: sync 2024-09-19T06:40:36.768 INFO:tasks.workunit.client.0.smithi099.stdout:9/460: stat dd/d2c/d5c/d64 0 2024-09-19T06:40:36.770 INFO:tasks.workunit.client.1.smithi117.stdout:3/565: rename d0/d8/d7f/d40/d5b/c5f to d0/d3d/d48/d77/d81/ca8 0 2024-09-19T06:40:36.772 INFO:tasks.workunit.client.1.smithi117.stdout:5/575: link d17/d2f/c31 d17/d2f/d3b/cbd 0 2024-09-19T06:40:36.773 INFO:tasks.workunit.client.0.smithi099.stdout:6/400: fsync d1/d5/d24/d2b/f45 0 2024-09-19T06:40:36.773 INFO:tasks.workunit.client.0.smithi099.stdout:4/408: link d12/f38 d12/d82/f8f 0 2024-09-19T06:40:36.773 INFO:tasks.workunit.client.0.smithi099.stdout:0/392: creat d0/db/d13/d1f/d3a/f7e x:0 0 0 2024-09-19T06:40:36.774 INFO:tasks.workunit.client.0.smithi099.stdout:9/461: creat dd/d2c/d5c/f97 x:0 0 0 2024-09-19T06:40:36.775 INFO:tasks.workunit.client.1.smithi117.stdout:0/425: creat d11/d13/d14/d2c/f8b x:0 0 0 2024-09-19T06:40:36.776 INFO:tasks.workunit.client.1.smithi117.stdout:1/518: mknod d3/d18/d23/d74/cb3 0 2024-09-19T06:40:36.777 INFO:tasks.workunit.client.0.smithi099.stdout:0/393: write d0/db/d36/f76 [488346,12021] 0 2024-09-19T06:40:36.777 INFO:tasks.workunit.client.1.smithi117.stdout:2/494: dread d0/d7/d29/d35/d61/d65/f96 [0,4194304] 0 2024-09-19T06:40:36.777 INFO:tasks.workunit.client.1.smithi117.stdout:8/600: dwrite d1d/d1e/d29/f89 [0,4194304] 0 2024-09-19T06:40:36.779 INFO:tasks.workunit.client.0.smithi099.stdout:9/462: write dd/f70 [4365072,85340] 0 2024-09-19T06:40:36.780 INFO:tasks.workunit.client.0.smithi099.stdout:6/401: chown d1/d5/d24/d2e/d41/d4e/d54/d5d/d61/d65 15 1 2024-09-19T06:40:36.781 INFO:tasks.workunit.client.0.smithi099.stdout:9/463: stat dd/c45 0 2024-09-19T06:40:36.782 INFO:tasks.workunit.client.1.smithi117.stdout:6/383: dread d1/d3/f20 [0,4194304] 0 2024-09-19T06:40:36.782 INFO:tasks.workunit.client.1.smithi117.stdout:3/566: mknod d0/d19/ca9 0 2024-09-19T06:40:36.784 INFO:tasks.workunit.client.0.smithi099.stdout:9/464: rmdir dd/d62 39 2024-09-19T06:40:36.785 INFO:tasks.workunit.client.1.smithi117.stdout:5/576: creat d17/d1b/d5d/fbe x:0 0 0 2024-09-19T06:40:36.785 INFO:tasks.workunit.client.0.smithi099.stdout:3/583: dread d7/d34/f1f [0,4194304] 0 2024-09-19T06:40:36.785 INFO:tasks.workunit.client.1.smithi117.stdout:7/520: dwrite d1/d4a/d81/d48/d5f/d82/fa9 [0,4194304] 0 2024-09-19T06:40:36.792 INFO:tasks.workunit.client.0.smithi099.stdout:0/394: dwrite d0/db/d13/d1f/f5a [0,4194304] 0 2024-09-19T06:40:36.793 INFO:tasks.workunit.client.1.smithi117.stdout:7/521: write d1/d4a/d77/f86 [56597,123594] 0 2024-09-19T06:40:36.793 INFO:tasks.workunit.client.1.smithi117.stdout:0/426: readlink d11/d13/d14/d2c/d35/l78 0 2024-09-19T06:40:36.793 INFO:tasks.workunit.client.1.smithi117.stdout:3/567: creat d0/d3d/d48/faa x:0 0 0 2024-09-19T06:40:36.795 INFO:tasks.workunit.client.1.smithi117.stdout:6/384: write d1/f64 [380142,95120] 0 2024-09-19T06:40:36.798 INFO:tasks.workunit.client.0.smithi099.stdout:5/580: dread d3/d2a/f7a [0,4194304] 0 2024-09-19T06:40:36.799 INFO:tasks.workunit.client.0.smithi099.stdout:9/465: dwrite dd/d47/d40/f3f [0,4194304] 0 2024-09-19T06:40:36.799 INFO:tasks.workunit.client.0.smithi099.stdout:9/466: fsync dd/f6a 0 2024-09-19T06:40:36.803 INFO:tasks.workunit.client.0.smithi099.stdout:0/395: rmdir d0/db/d2f 39 2024-09-19T06:40:36.803 INFO:tasks.workunit.client.0.smithi099.stdout:5/581: creat d3/d16/d2f/fcf x:0 0 0 2024-09-19T06:40:36.804 INFO:tasks.workunit.client.1.smithi117.stdout:0/427: unlink d11/d13/d14/d16/f77 0 2024-09-19T06:40:36.811 INFO:tasks.workunit.client.0.smithi099.stdout:5/582: dread d3/d7/f96 [0,4194304] 0 2024-09-19T06:40:36.813 INFO:tasks.workunit.client.0.smithi099.stdout:0/396: rename d0/d17/l70 to d0/db/d2f/l7f 0 2024-09-19T06:40:36.814 INFO:tasks.workunit.client.0.smithi099.stdout:0/397: fdatasync d0/f57 0 2024-09-19T06:40:36.814 INFO:tasks.workunit.client.0.smithi099.stdout:4/409: dread d12/d1b/f44 [0,4194304] 0 2024-09-19T06:40:36.815 INFO:tasks.workunit.client.0.smithi099.stdout:4/410: fdatasync f10 0 2024-09-19T06:40:36.816 INFO:tasks.workunit.client.1.smithi117.stdout:1/519: dwrite d3/d22/f71 [4194304,4194304] 0 2024-09-19T06:40:36.816 INFO:tasks.workunit.client.1.smithi117.stdout:2/495: truncate d0/d7/d29/d35/d3d/f43 1019134 0 2024-09-19T06:40:36.817 INFO:tasks.workunit.client.0.smithi099.stdout:5/583: write d3/d7/d90/da6/fc0 [611430,80734] 0 2024-09-19T06:40:36.817 INFO:tasks.workunit.client.1.smithi117.stdout:9/537: dwrite d4/d8/d6e/da4/fb0 [0,4194304] 0 2024-09-19T06:40:36.819 INFO:tasks.workunit.client.1.smithi117.stdout:4/722: dread d3/db/d20/d29/d39/d4f/d8b/f5d [0,4194304] 0 2024-09-19T06:40:36.820 INFO:tasks.workunit.client.0.smithi099.stdout:0/398: truncate d0/db/d13/d59/f6c 882196 0 2024-09-19T06:40:36.822 INFO:tasks.workunit.client.0.smithi099.stdout:0/399: dread - d0/db/d13/f7d zero size 2024-09-19T06:40:36.824 INFO:tasks.workunit.client.0.smithi099.stdout:4/411: getdents d12/d1b/d73/d81/d89 0 2024-09-19T06:40:36.825 INFO:tasks.workunit.client.1.smithi117.stdout:0/428: mknod d11/d13/d14/d2c/d64/c8c 0 2024-09-19T06:40:36.825 INFO:tasks.workunit.client.1.smithi117.stdout:5/577: dwrite d17/d1b/d5d/d86/fae [0,4194304] 0 2024-09-19T06:40:36.825 INFO:tasks.workunit.client.0.smithi099.stdout:5/584: symlink d3/d16/d5e/ld0 0 2024-09-19T06:40:36.826 INFO:tasks.workunit.client.1.smithi117.stdout:6/385: dwrite d1/f1b [0,4194304] 0 2024-09-19T06:40:36.826 INFO:tasks.workunit.client.0.smithi099.stdout:3/584: dwrite d7/d34/f70 [0,4194304] 0 2024-09-19T06:40:36.826 INFO:tasks.workunit.client.0.smithi099.stdout:4/412: stat d12/d32/f72 0 2024-09-19T06:40:36.827 INFO:tasks.workunit.client.1.smithi117.stdout:7/522: dread d1/d4a/d81/d24/d1c/f46 [0,4194304] 0 2024-09-19T06:40:36.828 INFO:tasks.workunit.client.0.smithi099.stdout:0/400: chown d0/db/d13/d1f/d39/f66 476238 1 2024-09-19T06:40:36.829 INFO:tasks.workunit.client.1.smithi117.stdout:9/538: unlink d4/d1c/d7a/c2b 0 2024-09-19T06:40:36.829 INFO:tasks.workunit.client.0.smithi099.stdout:3/585: fdatasync d7/d34/d1d/d36/d42/f43 0 2024-09-19T06:40:36.831 INFO:tasks.workunit.client.0.smithi099.stdout:5/585: rename d3/db7 to d3/d16/d2f/dd1 0 2024-09-19T06:40:36.833 INFO:tasks.workunit.client.1.smithi117.stdout:9/539: readlink d4/d20/l30 0 2024-09-19T06:40:36.835 INFO:tasks.workunit.client.1.smithi117.stdout:2/496: rename d0/d7/d29/d35/d61/d65/l81 to d0/d6f/lb9 0 2024-09-19T06:40:36.838 INFO:tasks.workunit.client.1.smithi117.stdout:6/386: read d1/d5/f39 [66198,55692] 0 2024-09-19T06:40:36.840 INFO:tasks.workunit.client.0.smithi099.stdout:4/413: dread d12/d32/f86 [0,4194304] 0 2024-09-19T06:40:36.840 INFO:tasks.workunit.client.0.smithi099.stdout:3/586: rename d7/f12 to d7/d34/d28/fa9 0 2024-09-19T06:40:36.841 INFO:tasks.workunit.client.1.smithi117.stdout:5/578: symlink d17/d1b/d3a/lbf 0 2024-09-19T06:40:36.843 INFO:tasks.workunit.client.1.smithi117.stdout:9/540: truncate d4/d8/d6e/da4/fb0 5195282 0 2024-09-19T06:40:36.845 INFO:tasks.workunit.client.0.smithi099.stdout:4/414: rename d12/d32/d39/f87 to d12/d32/d39/f90 0 2024-09-19T06:40:36.845 INFO:tasks.workunit.client.1.smithi117.stdout:7/523: fsync d1/d3f/f85 0 2024-09-19T06:40:36.847 INFO:tasks.workunit.client.1.smithi117.stdout:0/429: dwrite d11/f63 [0,4194304] 0 2024-09-19T06:40:36.847 INFO:tasks.workunit.client.1.smithi117.stdout:4/723: rename d3/db/c94 to d3/db/d20/d4a/cec 0 2024-09-19T06:40:36.849 INFO:tasks.workunit.client.0.smithi099.stdout:4/415: mkdir d12/d1b/d73/d81/d89/d91 0 2024-09-19T06:40:36.851 INFO:tasks.workunit.client.1.smithi117.stdout:2/497: creat d0/d7/fba x:0 0 0 2024-09-19T06:40:36.854 INFO:tasks.workunit.client.1.smithi117.stdout:4/724: write d3/db/f3a [3847558,33003] 0 2024-09-19T06:40:36.854 INFO:tasks.workunit.client.1.smithi117.stdout:9/541: creat d4/d1c/d46/fb3 x:0 0 0 2024-09-19T06:40:36.855 INFO:tasks.workunit.client.1.smithi117.stdout:3/568: dread d0/d19/f78 [0,4194304] 0 2024-09-19T06:40:36.855 INFO:tasks.workunit.client.1.smithi117.stdout:0/430: chown d11/d13/d1b/d27/c82 20 1 2024-09-19T06:40:36.856 INFO:tasks.workunit.client.1.smithi117.stdout:9/542: read - d4/d1c/f59 zero size 2024-09-19T06:40:36.856 INFO:tasks.workunit.client.1.smithi117.stdout:5/579: rename d17/d1b/d3a/d3c/l62 to d17/d1b/lc0 0 2024-09-19T06:40:36.858 INFO:tasks.workunit.client.1.smithi117.stdout:7/524: symlink d1/d4a/d81/d24/lb7 0 2024-09-19T06:40:36.859 INFO:tasks.workunit.client.1.smithi117.stdout:2/498: symlink d0/d64/lbb 0 2024-09-19T06:40:36.860 INFO:tasks.workunit.client.1.smithi117.stdout:4/725: mkdir d3/d41/ded 0 2024-09-19T06:40:36.860 INFO:tasks.workunit.client.1.smithi117.stdout:3/569: creat d0/d9/d4e/d9e/fab x:0 0 0 2024-09-19T06:40:36.861 INFO:tasks.workunit.client.1.smithi117.stdout:7/525: read - d1/d4a/d81/f84 zero size 2024-09-19T06:40:36.865 INFO:tasks.workunit.client.0.smithi099.stdout:5/586: dread d3/d1f/d4f/f5c [0,4194304] 0 2024-09-19T06:40:36.865 INFO:tasks.workunit.client.1.smithi117.stdout:3/570: stat d0/d8/f89 0 2024-09-19T06:40:36.865 INFO:tasks.workunit.client.1.smithi117.stdout:0/431: symlink d11/d13/d1b/l8d 0 2024-09-19T06:40:36.866 INFO:tasks.workunit.client.1.smithi117.stdout:6/387: rename d1/d3/f9 to d1/d3/d25/d5c/f65 0 2024-09-19T06:40:36.866 INFO:tasks.workunit.client.1.smithi117.stdout:0/432: chown d11 23819 1 2024-09-19T06:40:36.866 INFO:tasks.workunit.client.0.smithi099.stdout:0/401: fsync d0/db/d13/d59/f6c 0 2024-09-19T06:40:36.868 INFO:tasks.workunit.client.0.smithi099.stdout:5/587: write d3/d7/f96 [5193844,82107] 0 2024-09-19T06:40:36.871 INFO:tasks.workunit.client.0.smithi099.stdout:4/416: rmdir d12/d1b/d73 39 2024-09-19T06:40:36.872 INFO:tasks.workunit.client.1.smithi117.stdout:1/520: dread d3/da1/db1/f9d [0,4194304] 0 2024-09-19T06:40:36.873 INFO:tasks.workunit.client.1.smithi117.stdout:9/543: mkdir d4/d1c/d7a/d52/d8d/d98/dae/db4 0 2024-09-19T06:40:36.875 INFO:tasks.workunit.client.0.smithi099.stdout:5/588: unlink d3/d16/d2f/d34/d3c/f46 0 2024-09-19T06:40:36.876 INFO:tasks.workunit.client.1.smithi117.stdout:3/571: dwrite d0/d9/fd [4194304,4194304] 0 2024-09-19T06:40:36.878 INFO:tasks.workunit.client.0.smithi099.stdout:4/417: getdents d12/d32/d39 0 2024-09-19T06:40:36.880 INFO:tasks.workunit.client.0.smithi099.stdout:5/589: mkdir d3/d7/d90/dd2 0 2024-09-19T06:40:36.880 INFO:tasks.workunit.client.0.smithi099.stdout:3/587: dwrite d7/d34/d1d/d36/d42/f62 [0,4194304] 0 2024-09-19T06:40:36.881 INFO:tasks.workunit.client.1.smithi117.stdout:1/521: mkdir d3/d8e/db4 0 2024-09-19T06:40:36.881 INFO:tasks.workunit.client.1.smithi117.stdout:4/726: stat d3/db/d20/d4a/cec 0 2024-09-19T06:40:36.882 INFO:tasks.workunit.client.0.smithi099.stdout:5/590: read d3/d7/fb [1834740,91672] 0 2024-09-19T06:40:36.882 INFO:tasks.workunit.client.0.smithi099.stdout:4/418: read - d12/d32/f4c zero size 2024-09-19T06:40:36.882 INFO:tasks.workunit.client.0.smithi099.stdout:5/591: stat d3/d16/f83 0 2024-09-19T06:40:36.884 INFO:tasks.workunit.client.0.smithi099.stdout:5/592: readlink d3/d16/d2f/d34/la8 0 2024-09-19T06:40:36.887 INFO:tasks.workunit.client.1.smithi117.stdout:4/727: dread - d3/d1b/fe3 zero size 2024-09-19T06:40:36.887 INFO:tasks.workunit.client.1.smithi117.stdout:5/580: write d17/f89 [431357,17346] 0 2024-09-19T06:40:36.887 INFO:tasks.workunit.client.1.smithi117.stdout:7/526: dwrite d1/d4a/d7c/d95/f99 [0,4194304] 0 2024-09-19T06:40:36.889 INFO:tasks.workunit.client.1.smithi117.stdout:2/499: write d0/d12/d32/f4b [3059912,107643] 0 2024-09-19T06:40:36.889 INFO:tasks.workunit.client.1.smithi117.stdout:1/522: creat d3/d18/d97/fb5 x:0 0 0 2024-09-19T06:40:36.890 INFO:tasks.workunit.client.1.smithi117.stdout:3/572: rename d0/d9/d49/f46 to d0/d9/d1c/fac 0 2024-09-19T06:40:36.891 INFO:tasks.workunit.client.0.smithi099.stdout:3/588: creat d7/d34/d1d/d36/d69/d6d/d8f/faa x:0 0 0 2024-09-19T06:40:36.893 INFO:tasks.workunit.client.1.smithi117.stdout:9/544: dwrite d4/d1c/f28 [4194304,4194304] 0 2024-09-19T06:40:36.893 INFO:tasks.workunit.client.1.smithi117.stdout:2/500: write d0/f9 [2567168,12390] 0 2024-09-19T06:40:36.894 INFO:tasks.workunit.client.0.smithi099.stdout:5/593: creat d3/d1f/fd3 x:0 0 0 2024-09-19T06:40:36.895 INFO:tasks.workunit.client.1.smithi117.stdout:6/388: truncate d1/d3/f4b 2250596 0 2024-09-19T06:40:36.897 INFO:tasks.workunit.client.0.smithi099.stdout:3/589: dread d7/d34/d1d/d36/d69/f6b [0,4194304] 0 2024-09-19T06:40:36.897 INFO:tasks.workunit.client.0.smithi099.stdout:4/419: dwrite d12/d32/d42/d5c/d51/f7f [0,4194304] 0 2024-09-19T06:40:36.897 INFO:tasks.workunit.client.1.smithi117.stdout:1/523: unlink d3/d18/d23/d51/f80 0 2024-09-19T06:40:36.897 INFO:tasks.workunit.client.1.smithi117.stdout:2/501: read - d0/d6f/fb2 zero size 2024-09-19T06:40:36.898 INFO:tasks.workunit.client.1.smithi117.stdout:4/728: rmdir d3/db/d20/d29/d39/d4f/d8b 39 2024-09-19T06:40:36.900 INFO:tasks.workunit.client.1.smithi117.stdout:3/573: creat d0/d8/d7f/fad x:0 0 0 2024-09-19T06:40:36.901 INFO:tasks.workunit.client.1.smithi117.stdout:7/527: symlink d1/d4a/d81/d24/d26/lb8 0 2024-09-19T06:40:36.902 INFO:tasks.workunit.client.0.smithi099.stdout:5/594: mknod d3/d16/d2f/d8c/cd4 0 2024-09-19T06:40:36.902 INFO:tasks.workunit.client.0.smithi099.stdout:4/420: write d12/f35 [2907933,113247] 0 2024-09-19T06:40:36.902 INFO:tasks.workunit.client.0.smithi099.stdout:3/590: stat d7/d34/d1d/d20/d58/d5c/f99 0 2024-09-19T06:40:36.902 INFO:tasks.workunit.client.0.smithi099.stdout:5/595: read - d3/d16/f6e zero size 2024-09-19T06:40:36.902 INFO:tasks.workunit.client.0.smithi099.stdout:5/596: stat d3/d16/f2b 0 2024-09-19T06:40:36.905 INFO:tasks.workunit.client.1.smithi117.stdout:2/502: mkdir d0/d7/d1e/d20/dbc 0 2024-09-19T06:40:36.908 INFO:tasks.workunit.client.0.smithi099.stdout:3/591: symlink d7/d34/lab 0 2024-09-19T06:40:36.910 INFO:tasks.workunit.client.1.smithi117.stdout:3/574: symlink d0/d3d/d48/d77/d81/lae 0 2024-09-19T06:40:36.914 INFO:tasks.workunit.client.1.smithi117.stdout:4/729: mknod d3/db/d20/d35/cee 0 2024-09-19T06:40:36.916 INFO:tasks.workunit.client.1.smithi117.stdout:7/528: creat d1/d4a/d81/d24/d1c/d35/d4f/fb9 x:0 0 0 2024-09-19T06:40:36.916 INFO:tasks.workunit.client.0.smithi099.stdout:4/421: getdents d12/d1b/d73/d81/d89 0 2024-09-19T06:40:36.919 INFO:tasks.workunit.client.0.smithi099.stdout:4/422: chown d12/d32/c64 356775796 1 2024-09-19T06:40:36.921 INFO:tasks.workunit.client.1.smithi117.stdout:3/575: chown d0/d19/c29 53 1 2024-09-19T06:40:36.921 INFO:tasks.workunit.client.0.smithi099.stdout:4/423: symlink d12/d1b/l92 0 2024-09-19T06:40:36.923 INFO:tasks.workunit.client.1.smithi117.stdout:9/545: dwrite d4/d17/f61 [0,4194304] 0 2024-09-19T06:40:36.924 INFO:tasks.workunit.client.1.smithi117.stdout:2/503: dwrite d0/d12/f2c [0,4194304] 0 2024-09-19T06:40:36.925 INFO:tasks.workunit.client.1.smithi117.stdout:3/576: chown d0/d3d/d48/f5a 221 1 2024-09-19T06:40:36.925 INFO:tasks.workunit.client.0.smithi099.stdout:4/424: rename d12/d32/f8b to d12/d32/d42/f93 0 2024-09-19T06:40:36.926 INFO:tasks.workunit.client.1.smithi117.stdout:1/524: write d3/d18/d23/f2d [1504505,40234] 0 2024-09-19T06:40:36.926 INFO:tasks.workunit.client.1.smithi117.stdout:5/581: write d17/d1b/d3a/d3c/d46/f4f [637657,94461] 0 2024-09-19T06:40:36.927 INFO:tasks.workunit.client.0.smithi099.stdout:4/425: dread d12/d32/d42/d80/f83 [0,4194304] 0 2024-09-19T06:40:36.928 INFO:tasks.workunit.client.1.smithi117.stdout:3/577: stat d0/d19/f78 0 2024-09-19T06:40:36.932 INFO:tasks.workunit.client.1.smithi117.stdout:5/582: fdatasync d17/d1b/f48 0 2024-09-19T06:40:36.936 INFO:tasks.workunit.client.1.smithi117.stdout:1/525: unlink d3/d22/d2f/faf 0 2024-09-19T06:40:36.940 INFO:tasks.workunit.client.1.smithi117.stdout:7/529: rename d1/d4a/d81/f16 to d1/fba 0 2024-09-19T06:40:36.945 INFO:tasks.workunit.client.1.smithi117.stdout:1/526: creat d3/d18/d23/d74/fb6 x:0 0 0 2024-09-19T06:40:36.945 INFO:tasks.workunit.client.1.smithi117.stdout:3/578: dwrite d0/d9/d4e/f7c [0,4194304] 0 2024-09-19T06:40:36.946 INFO:tasks.workunit.client.0.smithi099.stdout:4/426: dread d12/d32/d42/d5c/f25 [0,4194304] 0 2024-09-19T06:40:36.946 INFO:tasks.workunit.client.0.smithi099.stdout:4/427: stat d12/f35 0 2024-09-19T06:40:36.947 INFO:tasks.workunit.client.0.smithi099.stdout:4/428: read d12/f38 [3094977,12151] 0 2024-09-19T06:40:36.948 INFO:tasks.workunit.client.1.smithi117.stdout:9/546: dwrite d4/d8/d6e/da4/fa6 [0,4194304] 0 2024-09-19T06:40:36.950 INFO:tasks.workunit.client.1.smithi117.stdout:4/730: dread d3/d65/d66/fab [0,4194304] 0 2024-09-19T06:40:36.950 INFO:tasks.workunit.client.1.smithi117.stdout:2/504: rename d0/d7/d7f to d0/d7/d29/d35/dbd 0 2024-09-19T06:40:36.953 INFO:tasks.workunit.client.0.smithi099.stdout:3/592: dread d7/f14 [0,4194304] 0 2024-09-19T06:40:36.957 INFO:tasks.workunit.client.1.smithi117.stdout:1/527: rmdir d3/d8e 39 2024-09-19T06:40:36.959 INFO:tasks.workunit.client.1.smithi117.stdout:9/547: mkdir d4/d1c/d73/db5 0 2024-09-19T06:40:36.960 INFO:tasks.workunit.client.1.smithi117.stdout:7/530: dwrite d1/d4a/d81/f8e [0,4194304] 0 2024-09-19T06:40:36.961 INFO:tasks.workunit.client.1.smithi117.stdout:4/731: chown d3/db/d20/d4a/f6f 207 1 2024-09-19T06:40:36.962 INFO:tasks.workunit.client.0.smithi099.stdout:1/353: sync 2024-09-19T06:40:36.962 INFO:tasks.workunit.client.0.smithi099.stdout:7/513: sync 2024-09-19T06:40:36.964 INFO:tasks.workunit.client.1.smithi117.stdout:2/505: truncate d0/f4c 102094 0 2024-09-19T06:40:36.964 INFO:tasks.workunit.client.1.smithi117.stdout:4/732: stat d3/db/d20/d29 0 2024-09-19T06:40:36.965 INFO:tasks.workunit.client.0.smithi099.stdout:3/593: dwrite d7/d34/d1d/d36/d42/f8b [0,4194304] 0 2024-09-19T06:40:36.967 INFO:tasks.workunit.client.1.smithi117.stdout:2/506: write d0/d7/d29/d35/dbd/d8d/f9d [166134,91054] 0 2024-09-19T06:40:36.969 INFO:tasks.workunit.client.0.smithi099.stdout:7/514: creat d7/dd/d29/d1f/d45/d48/fbd x:0 0 0 2024-09-19T06:40:36.969 INFO:tasks.workunit.client.1.smithi117.stdout:9/548: creat d4/d1c/d73/fb6 x:0 0 0 2024-09-19T06:40:36.970 INFO:tasks.workunit.client.1.smithi117.stdout:7/531: rename d1/d4a/d81/d48/d5f/fb1 to d1/d4a/d81/d48/d5f/d82/fbb 0 2024-09-19T06:40:36.970 INFO:tasks.workunit.client.1.smithi117.stdout:2/507: read - d0/d12/d32/db5/f83 zero size 2024-09-19T06:40:36.972 INFO:tasks.workunit.client.0.smithi099.stdout:3/594: fsync d7/f55 0 2024-09-19T06:40:36.973 INFO:tasks.workunit.client.0.smithi099.stdout:1/354: mknod d0/d17/d32/c74 0 2024-09-19T06:40:36.973 INFO:tasks.workunit.client.0.smithi099.stdout:7/515: stat d7/c12 0 2024-09-19T06:40:36.974 INFO:tasks.workunit.client.0.smithi099.stdout:1/355: readlink d0/l14 0 2024-09-19T06:40:36.975 INFO:tasks.workunit.client.0.smithi099.stdout:1/356: dread - d0/d17/d32/f5a zero size 2024-09-19T06:40:36.977 INFO:tasks.workunit.client.1.smithi117.stdout:9/549: chown d4/d1c/d73/fa7 19364764 1 2024-09-19T06:40:36.978 INFO:tasks.workunit.client.1.smithi117.stdout:4/733: dwrite d3/d1b/d7d/f4b [0,4194304] 0 2024-09-19T06:40:36.979 INFO:tasks.workunit.client.1.smithi117.stdout:5/583: dread d17/f74 [0,4194304] 0 2024-09-19T06:40:36.979 INFO:tasks.workunit.client.1.smithi117.stdout:3/579: creat d0/faf x:0 0 0 2024-09-19T06:40:36.979 INFO:tasks.workunit.client.1.smithi117.stdout:2/508: truncate d0/d7/d29/d35/d61/d65/fab 945316 0 2024-09-19T06:40:36.981 INFO:tasks.workunit.client.1.smithi117.stdout:4/734: readlink d3/d1b/d7d/l1e 0 2024-09-19T06:40:36.982 INFO:tasks.workunit.client.0.smithi099.stdout:3/595: unlink d7/d34/f3d 0 2024-09-19T06:40:36.983 INFO:tasks.workunit.client.0.smithi099.stdout:1/357: mkdir d0/d17/d24/d75 0 2024-09-19T06:40:36.984 INFO:tasks.workunit.client.1.smithi117.stdout:2/509: dread - d0/d7/d29/d35/d3d/f9b zero size 2024-09-19T06:40:36.985 INFO:tasks.workunit.client.0.smithi099.stdout:3/596: creat d7/d34/d1d/d36/d42/fac x:0 0 0 2024-09-19T06:40:36.987 INFO:tasks.workunit.client.1.smithi117.stdout:2/510: chown d0/d7/d1e/d20/l93 536915767 1 2024-09-19T06:40:36.987 INFO:tasks.workunit.client.1.smithi117.stdout:5/584: creat d17/d2e/d65/fc1 x:0 0 0 2024-09-19T06:40:36.988 INFO:tasks.workunit.client.0.smithi099.stdout:1/358: creat d0/d2d/f76 x:0 0 0 2024-09-19T06:40:36.988 INFO:tasks.workunit.client.1.smithi117.stdout:4/735: chown d3/db/d20/d4a/le6 9479606 1 2024-09-19T06:40:36.991 INFO:tasks.workunit.client.1.smithi117.stdout:2/511: creat d0/d7/d58/db1/fbe x:0 0 0 2024-09-19T06:40:36.991 INFO:tasks.workunit.client.1.smithi117.stdout:3/580: rename d0/d9/d4e/d9e/fab to d0/d9/d1c/fb0 0 2024-09-19T06:40:36.992 INFO:tasks.workunit.client.0.smithi099.stdout:1/359: rename d0/d2d/f76 to d0/d17/d24/d75/f77 0 2024-09-19T06:40:36.995 INFO:tasks.workunit.client.1.smithi117.stdout:6/389: dread d1/d3/f50 [0,4194304] 0 2024-09-19T06:40:36.996 INFO:tasks.workunit.client.0.smithi099.stdout:3/597: dwrite d7/f14 [4194304,4194304] 0 2024-09-19T06:40:36.996 INFO:tasks.workunit.client.0.smithi099.stdout:1/360: mkdir d0/d12/d13/d37/d41/d78 0 2024-09-19T06:40:37.000 INFO:tasks.workunit.client.0.smithi099.stdout:3/598: truncate d7/d34/d1d/d20/d58/d5c/f90 282167 0 2024-09-19T06:40:37.001 INFO:tasks.workunit.client.1.smithi117.stdout:6/390: unlink d1/d5/f5b 0 2024-09-19T06:40:37.002 INFO:tasks.workunit.client.0.smithi099.stdout:3/599: write d7/d34/d1d/d36/d69/d96/fa0 [536582,70814] 0 2024-09-19T06:40:37.003 INFO:tasks.workunit.client.1.smithi117.stdout:1/528: truncate d3/d18/d56/f85 631923 0 2024-09-19T06:40:37.003 INFO:tasks.workunit.client.0.smithi099.stdout:1/361: dread d0/d12/d13/f45 [0,4194304] 0 2024-09-19T06:40:37.005 INFO:tasks.workunit.client.1.smithi117.stdout:1/529: read - d3/d18/d23/f70 zero size 2024-09-19T06:40:37.007 INFO:tasks.workunit.client.0.smithi099.stdout:3/600: truncate d7/f55 331985 0 2024-09-19T06:40:37.007 INFO:tasks.workunit.client.1.smithi117.stdout:7/532: truncate d1/d4a/d81/d48/d5f/d82/fa5 945732 0 2024-09-19T06:40:37.009 INFO:tasks.workunit.client.1.smithi117.stdout:5/585: rename cb to d17/d5c/db8/cc2 0 2024-09-19T06:40:37.010 INFO:tasks.workunit.client.0.smithi099.stdout:3/601: creat d7/d34/d1d/d20/d58/fad x:0 0 0 2024-09-19T06:40:37.011 INFO:tasks.workunit.client.1.smithi117.stdout:6/391: mknod d1/d5/d32/c66 0 2024-09-19T06:40:37.012 INFO:tasks.workunit.client.1.smithi117.stdout:4/736: write d3/d1b/d7d/d51/d95/f99 [4599494,3346] 0 2024-09-19T06:40:37.013 INFO:tasks.workunit.client.1.smithi117.stdout:3/581: link d0/d9/d49/f6d d0/d3d/d48/fb1 0 2024-09-19T06:40:37.013 INFO:tasks.workunit.client.0.smithi099.stdout:3/602: creat d7/d34/d1d/d36/d42/fae x:0 0 0 2024-09-19T06:40:37.014 INFO:tasks.workunit.client.1.smithi117.stdout:7/533: mkdir d1/d4a/d7c/dbc 0 2024-09-19T06:40:37.014 INFO:tasks.workunit.client.1.smithi117.stdout:1/530: chown d3/d18/d23/d51/lb2 1848 1 2024-09-19T06:40:37.015 INFO:tasks.workunit.client.0.smithi099.stdout:4/429: truncate d12/d32/d42/d5c/f26 1678368 0 2024-09-19T06:40:37.016 INFO:tasks.workunit.client.1.smithi117.stdout:2/512: link d0/d7/d29/d35/d3d/d72/c6c d0/d7/d29/d35/dbd/d8d/cbf 0 2024-09-19T06:40:37.017 INFO:tasks.workunit.client.0.smithi099.stdout:3/603: mknod d7/d34/d1d/d20/d75/d9d/caf 0 2024-09-19T06:40:37.017 INFO:tasks.workunit.client.1.smithi117.stdout:7/534: write d1/d4a/d81/d24/d1c/d35/d4f/fb9 [319707,125909] 0 2024-09-19T06:40:37.018 INFO:tasks.workunit.client.1.smithi117.stdout:3/582: creat d0/d3d/d48/d77/fb2 x:0 0 0 2024-09-19T06:40:37.019 INFO:tasks.workunit.client.0.smithi099.stdout:4/430: chown d12/d32/d42/c66 372654153 1 2024-09-19T06:40:37.021 INFO:tasks.workunit.client.0.smithi099.stdout:3/604: mknod d7/d34/d1d/d20/cb0 0 2024-09-19T06:40:37.021 INFO:tasks.workunit.client.1.smithi117.stdout:6/392: mkdir d1/d5/d8/d5e/d67 0 2024-09-19T06:40:37.023 INFO:tasks.workunit.client.0.smithi099.stdout:4/431: write d12/d32/d42/d5c/f5d [60872,92776] 0 2024-09-19T06:40:37.023 INFO:tasks.workunit.client.1.smithi117.stdout:3/583: chown d0/d3d/d48/d77/d81 9089591 1 2024-09-19T06:40:37.025 INFO:tasks.workunit.client.1.smithi117.stdout:4/737: mkdir d3/db/d20/d29/d39/d4f/def 0 2024-09-19T06:40:37.028 INFO:tasks.workunit.client.0.smithi099.stdout:4/432: rename d12/d32/c47 to d12/d1b/d73/d81/d89/d91/c94 0 2024-09-19T06:40:37.029 INFO:tasks.workunit.client.1.smithi117.stdout:1/531: dwrite d3/d22/f71 [0,4194304] 0 2024-09-19T06:40:37.030 INFO:tasks.workunit.client.0.smithi099.stdout:1/362: write d0/f6 [37851,81288] 0 2024-09-19T06:40:37.032 INFO:tasks.workunit.client.0.smithi099.stdout:4/433: fdatasync d12/d32/f86 0 2024-09-19T06:40:37.034 INFO:tasks.workunit.client.1.smithi117.stdout:4/738: rename d3/d1b/l82 to d3/d4/d5f/lf0 0 2024-09-19T06:40:37.034 INFO:tasks.workunit.client.1.smithi117.stdout:7/535: getdents d1/d4a/d81/d8d 0 2024-09-19T06:40:37.037 INFO:tasks.workunit.client.1.smithi117.stdout:1/532: creat d3/d18/d23/d74/fb7 x:0 0 0 2024-09-19T06:40:37.040 INFO:tasks.workunit.client.1.smithi117.stdout:6/393: rename d1/d3/d25/f42 to d1/d5/d8/d5e/f68 0 2024-09-19T06:40:37.041 INFO:tasks.workunit.client.0.smithi099.stdout:4/434: dwrite d12/d32/f27 [0,4194304] 0 2024-09-19T06:40:37.046 INFO:tasks.workunit.client.0.smithi099.stdout:1/363: write d0/d12/d13/d37/f3f [141556,66878] 0 2024-09-19T06:40:37.047 INFO:tasks.workunit.client.1.smithi117.stdout:4/739: creat d3/d1b/ff1 x:0 0 0 2024-09-19T06:40:37.047 INFO:tasks.workunit.client.1.smithi117.stdout:5/586: dread d17/d2e/d55/f7a [0,4194304] 0 2024-09-19T06:40:37.048 INFO:tasks.workunit.client.1.smithi117.stdout:1/533: creat d3/d8e/fb8 x:0 0 0 2024-09-19T06:40:37.048 INFO:tasks.workunit.client.0.smithi099.stdout:1/364: write d0/d17/d24/f42 [72075,70746] 0 2024-09-19T06:40:37.049 INFO:tasks.workunit.client.1.smithi117.stdout:2/513: dread d0/d12/d2f/f51 [0,4194304] 0 2024-09-19T06:40:37.049 INFO:tasks.workunit.client.1.smithi117.stdout:1/534: fdatasync d3/f9 0 2024-09-19T06:40:37.050 INFO:tasks.workunit.client.0.smithi099.stdout:4/435: write d12/d82/f8f [4572213,1405] 0 2024-09-19T06:40:37.050 INFO:tasks.workunit.client.1.smithi117.stdout:6/394: rename d1/d3/d25/l4e to d1/d5/d32/d45/l69 0 2024-09-19T06:40:37.050 INFO:tasks.workunit.client.0.smithi099.stdout:1/365: write d0/d12/d13/d37/d48/f4b [13746,54607] 0 2024-09-19T06:40:37.052 INFO:tasks.workunit.client.1.smithi117.stdout:1/535: stat d3/f2e 0 2024-09-19T06:40:37.052 INFO:tasks.workunit.client.1.smithi117.stdout:4/740: readlink d3/db/d20/d29/d39/lc2 0 2024-09-19T06:40:37.055 INFO:tasks.workunit.client.1.smithi117.stdout:3/584: dwrite d0/d9/f50 [0,4194304] 0 2024-09-19T06:40:37.055 INFO:tasks.workunit.client.0.smithi099.stdout:1/366: unlink d0/d12/d13/d37/l61 0 2024-09-19T06:40:37.056 INFO:tasks.workunit.client.0.smithi099.stdout:1/367: stat d0/db/f1f 0 2024-09-19T06:40:37.056 INFO:tasks.workunit.client.1.smithi117.stdout:1/536: chown d3/d18/d97/l98 4696 1 2024-09-19T06:40:37.062 INFO:tasks.workunit.client.1.smithi117.stdout:4/741: unlink d3/d1b/d7d/l1e 0 2024-09-19T06:40:37.065 INFO:tasks.workunit.client.0.smithi099.stdout:1/368: dwrite d0/d12/d13/f22 [0,4194304] 0 2024-09-19T06:40:37.065 INFO:tasks.workunit.client.1.smithi117.stdout:3/585: rename d0/d9/d1c/c6f to d0/d19/cb3 0 2024-09-19T06:40:37.070 INFO:tasks.workunit.client.1.smithi117.stdout:4/742: symlink d3/d1b/d63/d8e/lf2 0 2024-09-19T06:40:37.070 INFO:tasks.workunit.client.0.smithi099.stdout:1/369: creat d0/d12/f79 x:0 0 0 2024-09-19T06:40:37.071 INFO:tasks.workunit.client.0.smithi099.stdout:1/370: dread - d0/f71 zero size 2024-09-19T06:40:37.072 INFO:tasks.workunit.client.0.smithi099.stdout:1/371: fsync d0/d2d/f43 0 2024-09-19T06:40:37.075 INFO:tasks.workunit.client.1.smithi117.stdout:5/587: dwrite d17/f76 [0,4194304] 0 2024-09-19T06:40:37.078 INFO:tasks.workunit.client.0.smithi099.stdout:1/372: rmdir d0/d17/d24/d3a 39 2024-09-19T06:40:37.081 INFO:tasks.workunit.client.1.smithi117.stdout:2/514: dwrite d0/d7/d1e/d20/f48 [0,4194304] 0 2024-09-19T06:40:37.081 INFO:tasks.workunit.client.0.smithi099.stdout:1/373: symlink d0/d12/d13/d37/d41/l7a 0 2024-09-19T06:40:37.081 INFO:tasks.workunit.client.1.smithi117.stdout:6/395: dwrite d1/d14/f2b [0,4194304] 0 2024-09-19T06:40:37.083 INFO:tasks.workunit.client.0.smithi099.stdout:1/374: mkdir d0/d17/d32/d7b 0 2024-09-19T06:40:37.086 INFO:tasks.workunit.client.1.smithi117.stdout:7/536: dread d1/d4a/f96 [0,4194304] 0 2024-09-19T06:40:37.088 INFO:tasks.workunit.client.0.smithi099.stdout:1/375: unlink d0/d17/c5f 0 2024-09-19T06:40:37.092 INFO:tasks.workunit.client.0.smithi099.stdout:4/436: dread d12/d82/f8f [0,4194304] 0 2024-09-19T06:40:37.102 INFO:tasks.workunit.client.1.smithi117.stdout:8/601: sync 2024-09-19T06:40:37.105 INFO:tasks.workunit.client.0.smithi099.stdout:1/376: unlink d0/d12/c4a 0 2024-09-19T06:40:37.105 INFO:tasks.workunit.client.1.smithi117.stdout:6/396: readlink d1/d5/l36 0 2024-09-19T06:40:37.106 INFO:tasks.workunit.client.1.smithi117.stdout:7/537: readlink d1/d4a/d81/d48/la6 0 2024-09-19T06:40:37.106 INFO:tasks.workunit.client.0.smithi099.stdout:1/377: truncate d0/d17/d32/f4e 362535 0 2024-09-19T06:40:37.107 INFO:tasks.workunit.client.1.smithi117.stdout:3/586: truncate d0/d8/d7f/d40/f67 3982615 0 2024-09-19T06:40:37.109 INFO:tasks.workunit.client.1.smithi117.stdout:3/587: dread - d0/d9/f9a zero size 2024-09-19T06:40:37.109 INFO:tasks.workunit.client.1.smithi117.stdout:4/743: symlink d3/d1b/d7d/lf3 0 2024-09-19T06:40:37.111 INFO:tasks.workunit.client.1.smithi117.stdout:8/602: rmdir d1d/d31/d83/dad/dc0 39 2024-09-19T06:40:37.112 INFO:tasks.workunit.client.1.smithi117.stdout:6/397: write d1/d3d/f5a [451634,2113] 0 2024-09-19T06:40:37.115 INFO:tasks.workunit.client.1.smithi117.stdout:3/588: mkdir d0/d9/d4e/db4 0 2024-09-19T06:40:37.115 INFO:tasks.workunit.client.0.smithi099.stdout:1/378: dread d0/db/f25 [0,4194304] 0 2024-09-19T06:40:37.115 INFO:tasks.workunit.client.1.smithi117.stdout:1/537: dwrite d3/da1/da5/fae [0,4194304] 0 2024-09-19T06:40:37.116 INFO:tasks.workunit.client.1.smithi117.stdout:7/538: symlink d1/d4a/d81/d48/d5f/lbd 0 2024-09-19T06:40:37.116 INFO:tasks.workunit.client.0.smithi099.stdout:8/291: sync 2024-09-19T06:40:37.117 INFO:tasks.workunit.client.1.smithi117.stdout:8/603: write d1d/d31/f79 [318268,58499] 0 2024-09-19T06:40:37.117 INFO:tasks.workunit.client.1.smithi117.stdout:6/398: dread - d1/d5/f51 zero size 2024-09-19T06:40:37.119 INFO:tasks.workunit.client.1.smithi117.stdout:5/588: dwrite d17/d1b/d3a/d3c/d46/f97 [0,4194304] 0 2024-09-19T06:40:37.119 INFO:tasks.workunit.client.1.smithi117.stdout:4/744: mkdir d3/d1b/d7d/d51/d95/df4 0 2024-09-19T06:40:37.121 INFO:tasks.workunit.client.0.smithi099.stdout:8/292: unlink d4/d11/d38/c62 0 2024-09-19T06:40:37.122 INFO:tasks.workunit.client.1.smithi117.stdout:7/539: creat d1/d4a/d7c/fbe x:0 0 0 2024-09-19T06:40:37.122 INFO:tasks.workunit.client.0.smithi099.stdout:1/379: dwrite d0/d17/d32/f6c [0,4194304] 0 2024-09-19T06:40:37.123 INFO:tasks.workunit.client.1.smithi117.stdout:6/399: read d1/f64 [271513,85993] 0 2024-09-19T06:40:37.127 INFO:tasks.workunit.client.1.smithi117.stdout:3/589: creat d0/fb5 x:0 0 0 2024-09-19T06:40:37.130 INFO:tasks.workunit.client.1.smithi117.stdout:5/589: dwrite d17/d1b/f28 [4194304,4194304] 0 2024-09-19T06:40:37.131 INFO:tasks.workunit.client.1.smithi117.stdout:4/745: mknod d3/d1b/cf5 0 2024-09-19T06:40:37.132 INFO:tasks.workunit.client.0.smithi099.stdout:4/437: truncate d12/d32/f27 339158 0 2024-09-19T06:40:37.133 INFO:tasks.workunit.client.1.smithi117.stdout:8/604: creat d1d/d31/d83/dad/dc0/fce x:0 0 0 2024-09-19T06:40:37.135 INFO:tasks.workunit.client.0.smithi099.stdout:1/380: read d0/d12/f30 [1874935,82533] 0 2024-09-19T06:40:37.137 INFO:tasks.workunit.client.1.smithi117.stdout:3/590: creat d0/d8/d64/fb6 x:0 0 0 2024-09-19T06:40:37.137 INFO:tasks.workunit.client.1.smithi117.stdout:5/590: dread d17/d1b/d3a/d3c/d46/f61 [0,4194304] 0 2024-09-19T06:40:37.137 INFO:tasks.workunit.client.1.smithi117.stdout:2/515: dread d0/d7/d29/d35/d61/d65/f8f [0,4194304] 0 2024-09-19T06:40:37.138 INFO:tasks.workunit.client.1.smithi117.stdout:5/591: fdatasync d17/f9d 0 2024-09-19T06:40:37.139 INFO:tasks.workunit.client.1.smithi117.stdout:4/746: unlink d3/db/d20/d35/f4c 0 2024-09-19T06:40:37.139 INFO:tasks.workunit.client.1.smithi117.stdout:5/592: write d17/f41 [3370755,57142] 0 2024-09-19T06:40:37.142 INFO:tasks.workunit.client.0.smithi099.stdout:1/381: rename d0/d12/d13/f33 to d0/d12/d13/d37/d48/f7c 0 2024-09-19T06:40:37.144 INFO:tasks.workunit.client.1.smithi117.stdout:8/605: truncate d1d/d1e/d53/d6e/f92 134082 0 2024-09-19T06:40:37.146 INFO:tasks.workunit.client.0.smithi099.stdout:1/382: creat d0/f7d x:0 0 0 2024-09-19T06:40:37.148 INFO:tasks.workunit.client.1.smithi117.stdout:7/540: write d1/d72/fab [2736057,69236] 0 2024-09-19T06:40:37.149 INFO:tasks.workunit.client.1.smithi117.stdout:2/516: creat d0/d7/d29/d35/d3d/d72/fc0 x:0 0 0 2024-09-19T06:40:37.150 INFO:tasks.workunit.client.1.smithi117.stdout:5/593: chown d17/d1b/d3a/d3c/d70/la7 0 1 2024-09-19T06:40:37.151 INFO:tasks.workunit.client.1.smithi117.stdout:5/594: read d17/f76 [3416102,84628] 0 2024-09-19T06:40:37.151 INFO:tasks.workunit.client.1.smithi117.stdout:7/541: truncate d1/d4a/d81/d24/d1c/d35/f9d 149206 0 2024-09-19T06:40:37.151 INFO:tasks.workunit.client.1.smithi117.stdout:6/400: truncate d1/d5/f40 96992 0 2024-09-19T06:40:37.151 INFO:tasks.workunit.client.0.smithi099.stdout:1/383: dwrite d0/d2d/f43 [0,4194304] 0 2024-09-19T06:40:37.152 INFO:tasks.workunit.client.1.smithi117.stdout:6/401: chown d1/d3/f50 80337 1 2024-09-19T06:40:37.152 INFO:tasks.workunit.client.0.smithi099.stdout:1/384: dread - d0/d17/d5b/f5d zero size 2024-09-19T06:40:37.153 INFO:tasks.workunit.client.1.smithi117.stdout:7/542: dread - d1/d4a/d81/d24/d1c/d35/d4f/f87 zero size 2024-09-19T06:40:37.154 INFO:tasks.workunit.client.1.smithi117.stdout:3/591: mknod d0/d9/d4e/db4/cb7 0 2024-09-19T06:40:37.155 INFO:tasks.workunit.client.1.smithi117.stdout:4/747: symlink d3/db/d20/d29/d39/d4f/d6e/da3/lf6 0 2024-09-19T06:40:37.155 INFO:tasks.workunit.client.0.smithi099.stdout:1/385: creat d0/d12/d54/f7e x:0 0 0 2024-09-19T06:40:37.157 INFO:tasks.workunit.client.0.smithi099.stdout:8/293: dread d4/de/f16 [0,4194304] 0 2024-09-19T06:40:37.158 INFO:tasks.workunit.client.0.smithi099.stdout:8/294: stat d4/de 0 2024-09-19T06:40:37.159 INFO:tasks.workunit.client.1.smithi117.stdout:5/595: symlink d17/d2e/d65/lc3 0 2024-09-19T06:40:37.159 INFO:tasks.workunit.client.1.smithi117.stdout:3/592: write d0/f92 [34094,87232] 0 2024-09-19T06:40:37.159 INFO:tasks.workunit.client.1.smithi117.stdout:6/402: symlink d1/d5/d8/d5e/l6a 0 2024-09-19T06:40:37.160 INFO:tasks.workunit.client.0.smithi099.stdout:4/438: write d12/d32/f86 [598330,42834] 0 2024-09-19T06:40:37.161 INFO:tasks.workunit.client.1.smithi117.stdout:7/543: mkdir d1/d4a/d81/d24/d49/dbf 0 2024-09-19T06:40:37.161 INFO:tasks.workunit.client.1.smithi117.stdout:8/606: creat d1d/d1e/fcf x:0 0 0 2024-09-19T06:40:37.162 INFO:tasks.workunit.client.0.smithi099.stdout:1/386: link d0/f71 d0/f7f 0 2024-09-19T06:40:37.163 INFO:tasks.workunit.client.1.smithi117.stdout:3/593: read d0/f6 [1126968,6538] 0 2024-09-19T06:40:37.164 INFO:tasks.workunit.client.0.smithi099.stdout:8/295: creat d4/de/d14/f65 x:0 0 0 2024-09-19T06:40:37.164 INFO:tasks.workunit.client.1.smithi117.stdout:6/403: chown d1/d5/d32/d45/l69 403943 1 2024-09-19T06:40:37.164 INFO:tasks.workunit.client.1.smithi117.stdout:5/596: chown d17/d1b/d5d/d7d/l8e 419 1 2024-09-19T06:40:37.168 INFO:tasks.workunit.client.1.smithi117.stdout:5/597: truncate d17/d2e/dab/fad 378839 0 2024-09-19T06:40:37.168 INFO:tasks.workunit.client.1.smithi117.stdout:3/594: rmdir d0/d8/d64 39 2024-09-19T06:40:37.168 INFO:tasks.workunit.client.1.smithi117.stdout:5/598: readlink d17/l1a 0 2024-09-19T06:40:37.168 INFO:tasks.workunit.client.1.smithi117.stdout:3/595: fsync d0/d9/d1c/f1d 0 2024-09-19T06:40:37.170 INFO:tasks.workunit.client.0.smithi099.stdout:4/439: rename d12/c76 to d12/c95 0 2024-09-19T06:40:37.170 INFO:tasks.workunit.client.0.smithi099.stdout:4/440: read d12/f38 [4304136,44395] 0 2024-09-19T06:40:37.171 INFO:tasks.workunit.client.1.smithi117.stdout:5/599: chown d17/d2f/d6a/f75 490220 1 2024-09-19T06:40:37.171 INFO:tasks.workunit.client.1.smithi117.stdout:3/596: chown d0/d9/f50 84 1 2024-09-19T06:40:37.171 INFO:tasks.workunit.client.1.smithi117.stdout:4/748: rmdir d3/db/d20/d29/d39/d4f/def 0 2024-09-19T06:40:37.172 INFO:tasks.workunit.client.1.smithi117.stdout:7/544: rename d1/d4a/d81/d24/f31 to d1/d4a/d7c/fc0 0 2024-09-19T06:40:37.172 INFO:tasks.workunit.client.0.smithi099.stdout:8/296: getdents d4/d5e 0 2024-09-19T06:40:37.173 INFO:tasks.workunit.client.0.smithi099.stdout:4/441: creat d12/d58/f96 x:0 0 0 2024-09-19T06:40:37.174 INFO:tasks.workunit.client.0.smithi099.stdout:4/442: write d12/d82/f8f [4743439,39238] 0 2024-09-19T06:40:37.174 INFO:tasks.workunit.client.0.smithi099.stdout:8/297: dread d4/d11/d38/f3c [0,4194304] 0 2024-09-19T06:40:37.174 INFO:tasks.workunit.client.1.smithi117.stdout:5/600: creat d17/d2f/d3b/fc4 x:0 0 0 2024-09-19T06:40:37.176 INFO:tasks.workunit.client.0.smithi099.stdout:8/298: mkdir d4/d66 0 2024-09-19T06:40:37.176 INFO:tasks.workunit.client.0.smithi099.stdout:8/299: stat d4/cc 0 2024-09-19T06:40:37.176 INFO:tasks.workunit.client.1.smithi117.stdout:4/749: mknod d3/d4/cf7 0 2024-09-19T06:40:37.179 INFO:tasks.workunit.client.1.smithi117.stdout:8/607: rename d1d/d2a/d3f/d4c/db7 to d1d/d2a/d3f/d4b/d5f/dbf/dd0 0 2024-09-19T06:40:37.179 INFO:tasks.workunit.client.0.smithi099.stdout:1/387: truncate d0/f16 131661 0 2024-09-19T06:40:37.179 INFO:tasks.workunit.client.0.smithi099.stdout:1/388: chown d0/d17/d24/f42 3411 1 2024-09-19T06:40:37.179 INFO:tasks.workunit.client.1.smithi117.stdout:7/545: mkdir d1/d4a/d81/d24/d1c/d35/dc1 0 2024-09-19T06:40:37.180 INFO:tasks.workunit.client.0.smithi099.stdout:1/389: chown d0/d68/f1d 11302190 1 2024-09-19T06:40:37.180 INFO:tasks.workunit.client.1.smithi117.stdout:8/608: fsync d1d/d1e/f70 0 2024-09-19T06:40:37.182 INFO:tasks.workunit.client.1.smithi117.stdout:8/609: fsync d1d/fb1 0 2024-09-19T06:40:37.182 INFO:tasks.workunit.client.1.smithi117.stdout:5/601: chown d17/d1b/d3a/d3c/d70/l83 26357468 1 2024-09-19T06:40:37.183 INFO:tasks.workunit.client.1.smithi117.stdout:3/597: dwrite d0/d8/d64/fb6 [0,4194304] 0 2024-09-19T06:40:37.187 INFO:tasks.workunit.client.1.smithi117.stdout:4/750: creat d3/db/d20/d77/ff8 x:0 0 0 2024-09-19T06:40:37.187 INFO:tasks.workunit.client.1.smithi117.stdout:7/546: symlink d1/d4a/d81/d8d/lc2 0 2024-09-19T06:40:37.189 INFO:tasks.workunit.client.1.smithi117.stdout:5/602: stat d17/d1b/d3a/d3c/d46/cb2 0 2024-09-19T06:40:37.189 INFO:tasks.workunit.client.1.smithi117.stdout:6/404: dread d1/d3/f17 [0,4194304] 0 2024-09-19T06:40:37.189 INFO:tasks.workunit.client.1.smithi117.stdout:3/598: write d0/d8/f8b [13805,68506] 0 2024-09-19T06:40:37.190 INFO:tasks.workunit.client.0.smithi099.stdout:8/300: dwrite d4/f17 [0,4194304] 0 2024-09-19T06:40:37.191 INFO:tasks.workunit.client.0.smithi099.stdout:8/301: fsync d4/de/d26/d2b/f58 0 2024-09-19T06:40:37.192 INFO:tasks.workunit.client.0.smithi099.stdout:8/302: chown d4/d5e 52 1 2024-09-19T06:40:37.197 INFO:tasks.workunit.client.0.smithi099.stdout:8/303: dread - d4/d11/d23/f4b zero size 2024-09-19T06:40:37.197 INFO:tasks.workunit.client.0.smithi099.stdout:4/443: dread d12/d32/d42/f55 [0,4194304] 0 2024-09-19T06:40:37.197 INFO:tasks.workunit.client.1.smithi117.stdout:5/603: dread d17/f9d [0,4194304] 0 2024-09-19T06:40:37.197 INFO:tasks.workunit.client.1.smithi117.stdout:4/751: unlink d3/db/d20/d29/d39/d4f/fb3 0 2024-09-19T06:40:37.199 INFO:tasks.workunit.client.0.smithi099.stdout:8/304: rename d4/de/d10/f49 to d4/d11/d38/f67 0 2024-09-19T06:40:37.203 INFO:tasks.workunit.client.1.smithi117.stdout:4/752: write d3/db/d20/d35/d79/fa6 [1333103,45559] 0 2024-09-19T06:40:37.204 INFO:tasks.workunit.client.0.smithi099.stdout:4/444: truncate f11 791273 0 2024-09-19T06:40:37.206 INFO:tasks.workunit.client.1.smithi117.stdout:5/604: dread d17/d1b/d3a/d3c/d46/f97 [0,4194304] 0 2024-09-19T06:40:37.207 INFO:tasks.workunit.client.0.smithi099.stdout:8/305: dwrite d4/de/d26/d2b/f58 [0,4194304] 0 2024-09-19T06:40:37.208 INFO:tasks.workunit.client.1.smithi117.stdout:4/753: write d3/d1b/d7d/d51/d95/faa [809584,40908] 0 2024-09-19T06:40:37.212 INFO:tasks.workunit.client.1.smithi117.stdout:8/610: dread d1d/d2a/d3f/d4b/d66/f8d [0,4194304] 0 2024-09-19T06:40:37.214 INFO:tasks.workunit.client.1.smithi117.stdout:8/611: truncate d1d/d1e/d29/fc5 413768 0 2024-09-19T06:40:37.215 INFO:tasks.workunit.client.0.smithi099.stdout:8/306: getdents d4/de/d1c 0 2024-09-19T06:40:37.217 INFO:tasks.workunit.client.1.smithi117.stdout:3/599: truncate d0/fb 5134065 0 2024-09-19T06:40:37.218 INFO:tasks.workunit.client.1.smithi117.stdout:5/605: write d17/d1b/d3a/d3c/d46/fa0 [4228600,62743] 0 2024-09-19T06:40:37.221 INFO:tasks.workunit.client.1.smithi117.stdout:8/612: getdents d1d/d2a/d3f/d4c 0 2024-09-19T06:40:37.223 INFO:tasks.workunit.client.1.smithi117.stdout:6/405: dread d1/d14/f23 [0,4194304] 0 2024-09-19T06:40:37.223 INFO:tasks.workunit.client.1.smithi117.stdout:3/600: rename d0/d19/f88 to d0/d9/d4e/d9e/fb8 0 2024-09-19T06:40:37.224 INFO:tasks.workunit.client.0.smithi099.stdout:4/445: dwrite d12/d32/f2e [0,4194304] 0 2024-09-19T06:40:37.225 INFO:tasks.workunit.client.1.smithi117.stdout:7/547: dread d1/d4a/d81/d24/d1c/f28 [0,4194304] 0 2024-09-19T06:40:37.226 INFO:tasks.workunit.client.1.smithi117.stdout:5/606: creat d17/d1b/d5d/d86/fc5 x:0 0 0 2024-09-19T06:40:37.227 INFO:tasks.workunit.client.0.smithi099.stdout:4/446: mkdir d12/d32/d42/d97 0 2024-09-19T06:40:37.229 INFO:tasks.workunit.client.1.smithi117.stdout:3/601: creat d0/d19/fb9 x:0 0 0 2024-09-19T06:40:37.230 INFO:tasks.workunit.client.1.smithi117.stdout:6/406: write d1/d3/f17 [5957665,73745] 0 2024-09-19T06:40:37.230 INFO:tasks.workunit.client.0.smithi099.stdout:4/447: mknod d12/d1b/d73/d81/d89/c98 0 2024-09-19T06:40:37.233 INFO:tasks.workunit.client.0.smithi099.stdout:4/448: fsync d12/d1b/f44 0 2024-09-19T06:40:37.233 INFO:tasks.workunit.client.1.smithi117.stdout:7/548: chown d1/d4a/d81/d24/d49/fa0 99 1 2024-09-19T06:40:37.235 INFO:tasks.workunit.client.1.smithi117.stdout:8/613: dwrite d1d/d2a/d3f/d73/f85 [0,4194304] 0 2024-09-19T06:40:37.236 INFO:tasks.workunit.client.0.smithi099.stdout:8/307: dread d4/de/d10/f20 [0,4194304] 0 2024-09-19T06:40:37.237 INFO:tasks.workunit.client.1.smithi117.stdout:3/602: symlink d0/d8/d64/lba 0 2024-09-19T06:40:37.237 INFO:tasks.workunit.client.1.smithi117.stdout:8/614: chown d1d/d2a/d3f/d4b/d66 1 1 2024-09-19T06:40:37.238 INFO:tasks.workunit.client.0.smithi099.stdout:8/308: creat d4/de/d10/f68 x:0 0 0 2024-09-19T06:40:37.239 INFO:tasks.workunit.client.1.smithi117.stdout:5/607: write d17/d5c/f69 [7495120,74313] 0 2024-09-19T06:40:37.241 INFO:tasks.workunit.client.0.smithi099.stdout:4/449: link d12/d32/d42/d5c/c52 d12/d32/d39/c99 0 2024-09-19T06:40:37.241 INFO:tasks.workunit.client.1.smithi117.stdout:3/603: unlink d0/d9/d49/l9f 0 2024-09-19T06:40:37.242 INFO:tasks.workunit.client.0.smithi099.stdout:4/450: write d12/d32/f61 [3212952,8152] 0 2024-09-19T06:40:37.243 INFO:tasks.workunit.client.1.smithi117.stdout:3/604: chown d0/f15 51 1 2024-09-19T06:40:37.243 INFO:tasks.workunit.client.1.smithi117.stdout:5/608: mkdir d17/d1b/d5d/d7d/dc6 0 2024-09-19T06:40:37.244 INFO:tasks.workunit.client.0.smithi099.stdout:8/309: link d4/de/f16 d4/d11/d23/d4c/f69 0 2024-09-19T06:40:37.245 INFO:tasks.workunit.client.1.smithi117.stdout:7/549: link d1/d4a/d81/d24/d1c/f67 d1/d4a/d81/d48/d5f/d82/fc3 0 2024-09-19T06:40:37.246 INFO:tasks.workunit.client.0.smithi099.stdout:4/451: creat d12/d1b/d73/d81/d89/f9a x:0 0 0 2024-09-19T06:40:37.246 INFO:tasks.workunit.client.0.smithi099.stdout:8/310: mknod d4/de/d14/c6a 0 2024-09-19T06:40:37.247 INFO:tasks.workunit.client.1.smithi117.stdout:8/615: rename la to d1d/d2a/d3f/d4b/d91/d97/ld1 0 2024-09-19T06:40:37.248 INFO:tasks.workunit.client.0.smithi099.stdout:8/311: chown d4/de/d26/c33 17 1 2024-09-19T06:40:37.248 INFO:tasks.workunit.client.1.smithi117.stdout:8/616: chown d1d/fb0 1350793770 1 2024-09-19T06:40:37.249 INFO:tasks.workunit.client.0.smithi099.stdout:8/312: chown d4/de/f16 62029 1 2024-09-19T06:40:37.250 INFO:tasks.workunit.client.1.smithi117.stdout:7/550: mkdir d1/d4a/d81/d24/d49/dbf/dc4 0 2024-09-19T06:40:37.251 INFO:tasks.workunit.client.1.smithi117.stdout:5/609: dwrite d17/d2e/d55/f98 [0,4194304] 0 2024-09-19T06:40:37.253 INFO:tasks.workunit.client.1.smithi117.stdout:3/605: creat d0/d8/d7f/d40/fbb x:0 0 0 2024-09-19T06:40:37.253 INFO:tasks.workunit.client.1.smithi117.stdout:6/407: write d1/d5/f39 [630150,26331] 0 2024-09-19T06:40:37.254 INFO:tasks.workunit.client.0.smithi099.stdout:4/452: dwrite d12/f7e [0,4194304] 0 2024-09-19T06:40:37.258 INFO:tasks.workunit.client.1.smithi117.stdout:7/551: read d1/d4a/d81/d24/d1c/d55/f59 [1917792,63025] 0 2024-09-19T06:40:37.261 INFO:tasks.workunit.client.0.smithi099.stdout:4/453: mkdir d12/d1b/d73/d81/d9b 0 2024-09-19T06:40:37.261 INFO:tasks.workunit.client.1.smithi117.stdout:5/610: dread d17/d1b/d3a/d3c/d70/f79 [0,4194304] 0 2024-09-19T06:40:37.261 INFO:tasks.workunit.client.1.smithi117.stdout:8/617: rmdir d1d/d2a/db5 0 2024-09-19T06:40:37.262 INFO:tasks.workunit.client.1.smithi117.stdout:6/408: creat d1/d5/d32/f6b x:0 0 0 2024-09-19T06:40:37.262 INFO:tasks.workunit.client.0.smithi099.stdout:8/313: fsync d4/de/f16 0 2024-09-19T06:40:37.264 INFO:tasks.workunit.client.1.smithi117.stdout:5/611: write d17/d1b/d5d/fbe [79436,64346] 0 2024-09-19T06:40:37.264 INFO:tasks.workunit.client.1.smithi117.stdout:3/606: dwrite d0/d19/d2b/d8e/f99 [0,4194304] 0 2024-09-19T06:40:37.265 INFO:tasks.workunit.client.0.smithi099.stdout:8/314: write d4/de/f16 [2800845,9469] 0 2024-09-19T06:40:37.266 INFO:tasks.workunit.client.1.smithi117.stdout:5/612: chown d17/d5c/c99 127996724 1 2024-09-19T06:40:37.267 INFO:tasks.workunit.client.0.smithi099.stdout:8/315: write d4/f30 [2937215,108926] 0 2024-09-19T06:40:37.268 INFO:tasks.workunit.client.1.smithi117.stdout:7/552: symlink d1/d4a/lc5 0 2024-09-19T06:40:37.269 INFO:tasks.workunit.client.1.smithi117.stdout:8/618: symlink d1d/d2a/d3f/ld2 0 2024-09-19T06:40:37.269 INFO:tasks.workunit.client.0.smithi099.stdout:4/454: dwrite d12/d58/f96 [0,4194304] 0 2024-09-19T06:40:37.272 INFO:tasks.workunit.client.1.smithi117.stdout:8/619: write d1d/d2a/f84 [1040642,112214] 0 2024-09-19T06:40:37.273 INFO:tasks.workunit.client.0.smithi099.stdout:8/316: creat d4/de/d1c/f6b x:0 0 0 2024-09-19T06:40:37.273 INFO:tasks.workunit.client.1.smithi117.stdout:5/613: write d17/d2f/f80 [6854712,108667] 0 2024-09-19T06:40:37.274 INFO:tasks.workunit.client.1.smithi117.stdout:7/553: read d1/d4a/d81/d24/f20 [3346062,85369] 0 2024-09-19T06:40:37.276 INFO:tasks.workunit.client.1.smithi117.stdout:3/607: creat d0/d8/d7f/d40/fbc x:0 0 0 2024-09-19T06:40:37.278 INFO:tasks.workunit.client.1.smithi117.stdout:8/620: write d1d/f27 [3923221,114183] 0 2024-09-19T06:40:37.278 INFO:tasks.workunit.client.0.smithi099.stdout:4/455: rename d12/d32/d39/c99 to d12/d58/c9c 0 2024-09-19T06:40:37.280 INFO:tasks.workunit.client.0.smithi099.stdout:4/456: write d12/d32/d42/f67 [3984125,78187] 0 2024-09-19T06:40:37.281 INFO:tasks.workunit.client.1.smithi117.stdout:7/554: chown d1/d4a/d81/c42 73 1 2024-09-19T06:40:37.283 INFO:tasks.workunit.client.0.smithi099.stdout:8/317: rename f3 to d4/d5e/f6c 0 2024-09-19T06:40:37.284 INFO:tasks.workunit.client.1.smithi117.stdout:6/409: dwrite d1/d3/f20 [0,4194304] 0 2024-09-19T06:40:37.285 INFO:tasks.workunit.client.0.smithi099.stdout:4/457: mkdir d12/d32/d42/d5c/d9d 0 2024-09-19T06:40:37.285 INFO:tasks.workunit.client.1.smithi117.stdout:8/621: creat d1d/d2a/d3f/d4b/d5f/fd3 x:0 0 0 2024-09-19T06:40:37.288 INFO:tasks.workunit.client.0.smithi099.stdout:4/458: symlink d12/d32/l9e 0 2024-09-19T06:40:37.290 INFO:tasks.workunit.client.1.smithi117.stdout:7/555: chown d1/d4a/d81/d48/d5f/d82/f94 875649 1 2024-09-19T06:40:37.291 INFO:tasks.workunit.client.0.smithi099.stdout:8/318: getdents d4/de 0 2024-09-19T06:40:37.293 INFO:tasks.workunit.client.0.smithi099.stdout:8/319: write d4/d11/d23/d4c/f69 [3827643,110105] 0 2024-09-19T06:40:37.294 INFO:tasks.workunit.client.1.smithi117.stdout:5/614: dwrite d17/d1b/d3a/d3c/d46/fa0 [0,4194304] 0 2024-09-19T06:40:37.295 INFO:tasks.workunit.client.1.smithi117.stdout:7/556: symlink d1/d4a/d81/d24/d26/lc6 0 2024-09-19T06:40:37.298 INFO:tasks.workunit.client.0.smithi099.stdout:8/320: creat d4/de/d1c/f6d x:0 0 0 2024-09-19T06:40:37.298 INFO:tasks.workunit.client.0.smithi099.stdout:4/459: rename d12/d32/d42/d5c/d51/c69 to d12/d32/c9f 0 2024-09-19T06:40:37.299 INFO:tasks.workunit.client.1.smithi117.stdout:3/608: dwrite d0/f5e [4194304,4194304] 0 2024-09-19T06:40:37.299 INFO:tasks.workunit.client.0.smithi099.stdout:8/321: write d4/f54 [1407046,35004] 0 2024-09-19T06:40:37.300 INFO:tasks.workunit.client.0.smithi099.stdout:8/322: chown d4/de/d26/f5c 423 1 2024-09-19T06:40:37.302 INFO:tasks.workunit.client.0.smithi099.stdout:8/323: write d4/de/d14/f39 [2207059,128220] 0 2024-09-19T06:40:37.302 INFO:tasks.workunit.client.1.smithi117.stdout:7/557: stat d1/d4a/d81/d24/d1c/f46 0 2024-09-19T06:40:37.303 INFO:tasks.workunit.client.0.smithi099.stdout:2/301: sync 2024-09-19T06:40:37.305 INFO:tasks.workunit.client.1.smithi117.stdout:6/410: dwrite d1/d3/f20 [0,4194304] 0 2024-09-19T06:40:37.307 INFO:tasks.workunit.client.1.smithi117.stdout:5/615: rename d17/d1b/d5d/l84 to d17/lc7 0 2024-09-19T06:40:37.310 INFO:tasks.workunit.client.1.smithi117.stdout:6/411: mknod d1/d14/c6c 0 2024-09-19T06:40:37.311 INFO:tasks.workunit.client.0.smithi099.stdout:2/302: rmdir d1/d2/d4d/d52/d36 39 2024-09-19T06:40:37.311 INFO:tasks.workunit.client.0.smithi099.stdout:8/324: truncate d4/de/d26/f28 4150237 0 2024-09-19T06:40:37.311 INFO:tasks.workunit.client.0.smithi099.stdout:2/303: read d1/d2/d4d/d52/d18/f2f [4190427,43041] 0 2024-09-19T06:40:37.311 INFO:tasks.workunit.client.0.smithi099.stdout:4/460: unlink d12/d32/d39/c43 0 2024-09-19T06:40:37.312 INFO:tasks.workunit.client.1.smithi117.stdout:7/558: mknod d1/d4a/d81/d24/d1c/d55/cc7 0 2024-09-19T06:40:37.312 INFO:tasks.workunit.client.1.smithi117.stdout:3/609: link d0/d19/d2b/l33 d0/d19/d2b/d8e/lbd 0 2024-09-19T06:40:37.312 INFO:tasks.workunit.client.0.smithi099.stdout:8/325: write d4/d11/d23/f4b [377724,68587] 0 2024-09-19T06:40:37.313 INFO:tasks.workunit.client.1.smithi117.stdout:7/559: fsync d1/d4a/d81/d24/d26/f2f 0 2024-09-19T06:40:37.315 INFO:tasks.workunit.client.1.smithi117.stdout:3/610: creat d0/d9/d4e/fbe x:0 0 0 2024-09-19T06:40:37.315 INFO:tasks.workunit.client.0.smithi099.stdout:8/326: fsync d4/d11/f21 0 2024-09-19T06:40:37.317 INFO:tasks.workunit.client.0.smithi099.stdout:4/461: creat d12/d1b/d73/d81/fa0 x:0 0 0 2024-09-19T06:40:37.317 INFO:tasks.workunit.client.0.smithi099.stdout:8/327: chown d4/de/d26/c33 363 1 2024-09-19T06:40:37.318 INFO:tasks.workunit.client.1.smithi117.stdout:7/560: rmdir d1/d3f 39 2024-09-19T06:40:37.319 INFO:tasks.workunit.client.1.smithi117.stdout:5/616: rename d17/d1b/d3a/d3c/d70/d94/l9e to d17/d2e/dab/lc8 0 2024-09-19T06:40:37.320 INFO:tasks.workunit.client.1.smithi117.stdout:5/617: stat d17/d5c/f90 0 2024-09-19T06:40:37.320 INFO:tasks.workunit.client.0.smithi099.stdout:2/304: dwrite d1/d2/d4d/d52/fa [0,4194304] 0 2024-09-19T06:40:37.322 INFO:tasks.workunit.client.0.smithi099.stdout:2/305: fsync d1/f25 0 2024-09-19T06:40:37.323 INFO:tasks.workunit.client.1.smithi117.stdout:7/561: unlink d1/c25 0 2024-09-19T06:40:37.324 INFO:tasks.workunit.client.1.smithi117.stdout:7/562: write d1/d4a/d81/f54 [5076899,121280] 0 2024-09-19T06:40:37.325 INFO:tasks.workunit.client.0.smithi099.stdout:4/462: rename d12/l34 to d12/d1b/d73/d81/d9b/la1 0 2024-09-19T06:40:37.327 INFO:tasks.workunit.client.0.smithi099.stdout:8/328: dwrite d4/f54 [0,4194304] 0 2024-09-19T06:40:37.328 INFO:tasks.workunit.client.0.smithi099.stdout:2/306: truncate d1/d2/d5/f40 4289979 0 2024-09-19T06:40:37.329 INFO:tasks.workunit.client.0.smithi099.stdout:4/463: mkdir d12/d1b/d73/d81/d9b/da2 0 2024-09-19T06:40:37.332 INFO:tasks.workunit.client.1.smithi117.stdout:5/618: getdents d17/d2e/d55 0 2024-09-19T06:40:37.334 INFO:tasks.workunit.client.0.smithi099.stdout:2/307: dwrite d1/f15 [0,4194304] 0 2024-09-19T06:40:37.335 INFO:tasks.workunit.client.1.smithi117.stdout:7/563: dwrite d1/d4a/d81/d24/d1c/f79 [0,4194304] 0 2024-09-19T06:40:37.335 INFO:tasks.workunit.client.1.smithi117.stdout:8/622: dread d1d/d2a/d3f/d73/f9e [0,4194304] 0 2024-09-19T06:40:37.337 INFO:tasks.workunit.client.1.smithi117.stdout:5/619: creat d17/d1b/d5d/fc9 x:0 0 0 2024-09-19T06:40:37.338 INFO:tasks.workunit.client.0.smithi099.stdout:6/402: sync 2024-09-19T06:40:37.341 INFO:tasks.workunit.client.1.smithi117.stdout:8/623: dread d1d/d1e/d53/f82 [0,4194304] 0 2024-09-19T06:40:37.342 INFO:tasks.workunit.client.1.smithi117.stdout:8/624: stat d1d/d2a/d3f/d4b/d66/dac/lb2 0 2024-09-19T06:40:37.343 INFO:tasks.workunit.client.0.smithi099.stdout:9/467: sync 2024-09-19T06:40:37.343 INFO:tasks.workunit.client.0.smithi099.stdout:0/402: sync 2024-09-19T06:40:37.343 INFO:tasks.workunit.client.0.smithi099.stdout:2/308: read d1/d2/d4d/d52/d36/f41 [476416,73734] 0 2024-09-19T06:40:37.344 INFO:tasks.workunit.client.1.smithi117.stdout:5/620: read d17/d2e/dab/fad [135917,77736] 0 2024-09-19T06:40:37.347 INFO:tasks.workunit.client.1.smithi117.stdout:7/564: link d1/d4a/f9a d1/d4a/d81/d24/fc8 0 2024-09-19T06:40:37.350 INFO:tasks.workunit.client.1.smithi117.stdout:5/621: rmdir d17/d2f/d6a 39 2024-09-19T06:40:37.351 INFO:tasks.workunit.client.0.smithi099.stdout:0/403: dread d0/db/d13/d1f/f2b [0,4194304] 0 2024-09-19T06:40:37.353 INFO:tasks.workunit.client.0.smithi099.stdout:9/468: dread dd/d47/d40/f3f [0,4194304] 0 2024-09-19T06:40:37.353 INFO:tasks.workunit.client.1.smithi117.stdout:5/622: read d17/d1b/d3a/d3c/d70/f79 [701403,83814] 0 2024-09-19T06:40:37.354 INFO:tasks.workunit.client.1.smithi117.stdout:5/623: fdatasync d17/d2e/d55/f98 0 2024-09-19T06:40:37.356 INFO:tasks.workunit.client.0.smithi099.stdout:2/309: dwrite d1/d2/d5/d13/f1b [0,4194304] 0 2024-09-19T06:40:37.357 INFO:tasks.workunit.client.0.smithi099.stdout:2/310: write d1/d2/d4d/d52/d9/ff [4297434,8271] 0 2024-09-19T06:40:37.362 INFO:tasks.workunit.client.1.smithi117.stdout:7/565: dwrite d1/f50 [0,4194304] 0 2024-09-19T06:40:37.369 INFO:tasks.workunit.client.1.smithi117.stdout:7/566: creat d1/d4a/d81/d8d/fc9 x:0 0 0 2024-09-19T06:40:37.371 INFO:tasks.workunit.client.1.smithi117.stdout:5/624: dwrite d17/d5c/f69 [4194304,4194304] 0 2024-09-19T06:40:37.385 INFO:tasks.workunit.client.1.smithi117.stdout:7/567: dread d1/d4a/d81/d24/d1c/d35/f9d [0,4194304] 0 2024-09-19T06:40:37.386 INFO:tasks.workunit.client.1.smithi117.stdout:5/625: creat d17/d1b/d3a/d3c/fca x:0 0 0 2024-09-19T06:40:37.391 INFO:tasks.workunit.client.0.smithi099.stdout:6/403: rename d1/d5/d24/d2e/d41/d4e/d54/d5d/d61/f63 to d1/d12/f83 0 2024-09-19T06:40:37.394 INFO:tasks.workunit.client.0.smithi099.stdout:8/329: write f2 [2594121,113480] 0 2024-09-19T06:40:37.396 INFO:tasks.workunit.client.0.smithi099.stdout:2/311: mkdir d1/d2/d4d/d52/d18/d46/d65 0 2024-09-19T06:40:37.396 INFO:tasks.workunit.client.1.smithi117.stdout:5/626: dread d17/d1b/d3a/d3c/f57 [0,4194304] 0 2024-09-19T06:40:37.397 INFO:tasks.workunit.client.1.smithi117.stdout:5/627: chown d17/d1b/l1e 388 1 2024-09-19T06:40:37.401 INFO:tasks.workunit.client.0.smithi099.stdout:8/330: dwrite d4/d11/d23/d3f/f55 [0,4194304] 0 2024-09-19T06:40:37.401 INFO:tasks.workunit.client.1.smithi117.stdout:5/628: mkdir d17/d1b/d3a/d3c/dcb 0 2024-09-19T06:40:37.401 INFO:tasks.workunit.client.1.smithi117.stdout:7/568: rmdir d1/d4a/d81/d8d 39 2024-09-19T06:40:37.401 INFO:tasks.workunit.client.0.smithi099.stdout:4/464: truncate d12/d58/f96 3259657 0 2024-09-19T06:40:37.402 INFO:tasks.workunit.client.1.smithi117.stdout:7/569: chown d1/d4a/d81/d24/d26 201 1 2024-09-19T06:40:37.407 INFO:tasks.workunit.client.0.smithi099.stdout:4/465: dread d12/d32/d42/d5c/f25 [0,4194304] 0 2024-09-19T06:40:37.407 INFO:tasks.workunit.client.0.smithi099.stdout:6/404: creat d1/d5/d24/d2b/f84 x:0 0 0 2024-09-19T06:40:37.408 INFO:tasks.workunit.client.1.smithi117.stdout:5/629: dwrite d17/d2f/f80 [4194304,4194304] 0 2024-09-19T06:40:37.408 INFO:tasks.workunit.client.0.smithi099.stdout:4/466: chown d12/d32/c78 102620 1 2024-09-19T06:40:37.409 INFO:tasks.workunit.client.1.smithi117.stdout:7/570: creat d1/d4a/d81/fca x:0 0 0 2024-09-19T06:40:37.411 INFO:tasks.workunit.client.0.smithi099.stdout:0/404: mknod d0/db/d13/d47/d75/c80 0 2024-09-19T06:40:37.412 INFO:tasks.workunit.client.1.smithi117.stdout:5/630: mknod d17/d2e/da6/ccc 0 2024-09-19T06:40:37.414 INFO:tasks.workunit.client.1.smithi117.stdout:7/571: symlink d1/d4a/d7c/d95/lcb 0 2024-09-19T06:40:37.414 INFO:tasks.workunit.client.0.smithi099.stdout:9/469: truncate dd/f6a 3583160 0 2024-09-19T06:40:37.418 INFO:tasks.workunit.client.1.smithi117.stdout:5/631: rename d17/d2e/f5f to d17/d1b/d3a/d3c/d70/d94/fcd 0 2024-09-19T06:40:37.419 INFO:tasks.workunit.client.1.smithi117.stdout:7/572: creat d1/d4a/d77/fcc x:0 0 0 2024-09-19T06:40:37.420 INFO:tasks.workunit.client.1.smithi117.stdout:5/632: rmdir d17/d1b/d3a 39 2024-09-19T06:40:37.421 INFO:tasks.workunit.client.0.smithi099.stdout:4/467: creat d12/d32/d42/d5c/d51/fa3 x:0 0 0 2024-09-19T06:40:37.425 INFO:tasks.workunit.client.0.smithi099.stdout:0/405: unlink d0/db/d2f/f45 0 2024-09-19T06:40:37.426 INFO:tasks.workunit.client.1.smithi117.stdout:5/633: mknod d17/d1b/d3a/d3c/d70/d94/cce 0 2024-09-19T06:40:37.429 INFO:tasks.workunit.client.1.smithi117.stdout:5/634: rename d17/d1b/d3a/d3c/fca to d17/d2e/dab/fcf 0 2024-09-19T06:40:37.430 INFO:tasks.workunit.client.1.smithi117.stdout:7/573: rmdir d1/d4a/d81 39 2024-09-19T06:40:37.432 INFO:tasks.workunit.client.1.smithi117.stdout:5/635: mkdir d17/d2e/d65/d88/dd0 0 2024-09-19T06:40:37.432 INFO:tasks.workunit.client.0.smithi099.stdout:0/406: unlink d0/db/d13/d1f/d3a/f77 0 2024-09-19T06:40:37.433 INFO:tasks.workunit.client.1.smithi117.stdout:7/574: creat d1/d4a/d7c/fcd x:0 0 0 2024-09-19T06:40:37.433 INFO:tasks.workunit.client.1.smithi117.stdout:5/636: mkdir d17/d2e/d55/dd1 0 2024-09-19T06:40:37.435 INFO:tasks.workunit.client.0.smithi099.stdout:5/597: sync 2024-09-19T06:40:37.435 INFO:tasks.workunit.client.0.smithi099.stdout:1/390: sync 2024-09-19T06:40:37.435 INFO:tasks.workunit.client.0.smithi099.stdout:7/516: sync 2024-09-19T06:40:37.435 INFO:tasks.workunit.client.0.smithi099.stdout:3/605: sync 2024-09-19T06:40:37.436 INFO:tasks.workunit.client.0.smithi099.stdout:5/598: readlink d3/le 0 2024-09-19T06:40:37.438 INFO:tasks.workunit.client.0.smithi099.stdout:4/468: mkdir d12/d1b/da4 0 2024-09-19T06:40:37.439 INFO:tasks.workunit.client.0.smithi099.stdout:4/469: write d12/f30 [4767757,34435] 0 2024-09-19T06:40:37.440 INFO:tasks.workunit.client.0.smithi099.stdout:0/407: dwrite d0/db/d13/d1f/d39/f74 [0,4194304] 0 2024-09-19T06:40:37.443 INFO:tasks.workunit.client.1.smithi117.stdout:5/637: dwrite d17/d2f/d6a/f9f [0,4194304] 0 2024-09-19T06:40:37.444 INFO:tasks.workunit.client.0.smithi099.stdout:5/599: dread - d3/d2a/f77 zero size 2024-09-19T06:40:37.445 INFO:tasks.workunit.client.0.smithi099.stdout:5/600: write d3/d1f/f8e [2023806,38173] 0 2024-09-19T06:40:37.447 INFO:tasks.workunit.client.1.smithi117.stdout:5/638: read - d17/d1b/d5d/d86/fc5 zero size 2024-09-19T06:40:37.451 INFO:tasks.workunit.client.1.smithi117.stdout:5/639: dread - d17/d1b/d5d/d86/fc5 zero size 2024-09-19T06:40:37.453 INFO:tasks.workunit.client.0.smithi099.stdout:5/601: mkdir d3/d16/d2f/d34/d3c/d65/dd5 0 2024-09-19T06:40:37.454 INFO:tasks.workunit.client.0.smithi099.stdout:5/602: write d3/d16/d2f/d34/da4/faa [433585,111593] 0 2024-09-19T06:40:37.455 INFO:tasks.workunit.client.1.smithi117.stdout:5/640: write d17/f22 [3664808,21382] 0 2024-09-19T06:40:37.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:37 smithi099 ceph-mon[27651]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:40:37.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:37 smithi099 ceph-mon[27651]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:40:37.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:37 smithi099 ceph-mon[27651]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:40:37.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:37 smithi099 ceph-mon[27651]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:40:37.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:37 smithi099 ceph-mon[27651]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:40:37.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:37 smithi099 ceph-mon[27651]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:40:37.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:37 smithi099 ceph-mon[27651]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:40:37.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:37 smithi099 ceph-mon[27651]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:40:37.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:37 smithi099 ceph-mon[27651]: Adjusting osd_memory_target on smithi117 to 2581M 2024-09-19T06:40:37.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:37 smithi099 ceph-mon[27651]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:40:37.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:37 smithi099 ceph-mon[27651]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:40:37.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:37 smithi099 ceph-mon[27651]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:40:37.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:37 smithi099 ceph-mon[27651]: Updating smithi099:/etc/ceph/ceph.conf 2024-09-19T06:40:37.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:37 smithi099 ceph-mon[27651]: Updating smithi117:/etc/ceph/ceph.conf 2024-09-19T06:40:37.457 INFO:tasks.workunit.client.1.smithi117.stdout:7/575: dwrite d1/d4a/d81/f2a [0,4194304] 0 2024-09-19T06:40:37.459 INFO:tasks.workunit.client.1.smithi117.stdout:5/641: symlink d17/d1b/d3a/ld2 0 2024-09-19T06:40:37.460 INFO:tasks.workunit.client.0.smithi099.stdout:5/603: dwrite d3/d7/f96 [0,4194304] 0 2024-09-19T06:40:37.463 INFO:tasks.workunit.client.1.smithi117.stdout:7/576: chown d1/d4a/d81/d24/d26/d44/c61 13 1 2024-09-19T06:40:37.464 INFO:tasks.workunit.client.0.smithi099.stdout:1/391: symlink d0/d12/d13/l80 0 2024-09-19T06:40:37.469 INFO:tasks.workunit.client.1.smithi117.stdout:5/642: dread d17/f74 [0,4194304] 0 2024-09-19T06:40:37.471 INFO:tasks.workunit.client.0.smithi099.stdout:1/392: write d0/d12/d54/f6f [398600,37116] 0 2024-09-19T06:40:37.471 INFO:tasks.workunit.client.1.smithi117.stdout:7/577: creat d1/d4a/d7c/d95/db5/fce x:0 0 0 2024-09-19T06:40:37.474 INFO:tasks.workunit.client.0.smithi099.stdout:1/393: unlink d0/db/f25 0 2024-09-19T06:40:37.474 INFO:tasks.workunit.client.0.smithi099.stdout:1/394: write d0/f7d [281886,128392] 0 2024-09-19T06:40:37.477 INFO:tasks.workunit.client.1.smithi117.stdout:7/578: write d1/d4a/d81/d24/d26/d44/fb2 [916191,97184] 0 2024-09-19T06:40:37.483 INFO:tasks.workunit.client.0.smithi099.stdout:1/395: creat d0/d17/d24/d3a/f81 x:0 0 0 2024-09-19T06:40:37.483 INFO:tasks.workunit.client.0.smithi099.stdout:1/396: readlink d0/d12/d13/d37/l44 0 2024-09-19T06:40:37.484 INFO:tasks.workunit.client.1.smithi117.stdout:7/579: mkdir d1/d4a/d81/d24/d49/dbf/dcf 0 2024-09-19T06:40:37.485 INFO:tasks.workunit.client.0.smithi099.stdout:1/397: chown d0/d17/d32/c73 1799728 1 2024-09-19T06:40:37.486 INFO:tasks.workunit.client.1.smithi117.stdout:7/580: unlink d1/d4a/d7c/d95/f97 0 2024-09-19T06:40:37.490 INFO:tasks.workunit.client.0.smithi099.stdout:7/517: rmdir d7/dd/d29/d1f/d45 39 2024-09-19T06:40:37.495 INFO:tasks.workunit.client.1.smithi117.stdout:7/581: write d1/d3f/f85 [258550,40681] 0 2024-09-19T06:40:37.495 INFO:tasks.workunit.client.0.smithi099.stdout:7/518: write d7/dd/d29/d1f/d45/f78 [1648194,30595] 0 2024-09-19T06:40:37.496 INFO:tasks.workunit.client.0.smithi099.stdout:1/398: dwrite d0/d17/d24/d75/f77 [0,4194304] 0 2024-09-19T06:40:37.497 INFO:tasks.workunit.client.1.smithi117.stdout:7/582: fdatasync d1/d4a/d81/d24/d1c/f46 0 2024-09-19T06:40:37.498 INFO:tasks.workunit.client.1.smithi117.stdout:7/583: chown d1/d4a/d81/d48/d5f/l8a 1771997355 1 2024-09-19T06:40:37.501 INFO:tasks.workunit.client.0.smithi099.stdout:1/399: chown d0/d12/d13/l80 30 1 2024-09-19T06:40:37.502 INFO:tasks.workunit.client.0.smithi099.stdout:3/606: rename d7/d34/l1c to d7/d34/d1d/d36/d42/lb1 0 2024-09-19T06:40:37.502 INFO:tasks.workunit.client.1.smithi117.stdout:7/584: unlink d1/d4a/d81/d48/d5f/d82/f9e 0 2024-09-19T06:40:37.502 INFO:tasks.workunit.client.0.smithi099.stdout:3/607: stat d7/c9c 0 2024-09-19T06:40:37.503 INFO:tasks.workunit.client.0.smithi099.stdout:9/470: creat dd/d2c/f98 x:0 0 0 2024-09-19T06:40:37.504 INFO:tasks.workunit.client.1.smithi117.stdout:7/585: creat d1/d4a/d7c/d95/db5/fd0 x:0 0 0 2024-09-19T06:40:37.505 INFO:tasks.workunit.client.0.smithi099.stdout:6/405: creat d1/d5/d24/f85 x:0 0 0 2024-09-19T06:40:37.507 INFO:tasks.workunit.client.0.smithi099.stdout:6/406: write d1/d5/f50 [5234957,47928] 0 2024-09-19T06:40:37.508 INFO:tasks.workunit.client.0.smithi099.stdout:2/312: dwrite d1/d2/f1f [0,4194304] 0 2024-09-19T06:40:37.508 INFO:tasks.workunit.client.1.smithi117.stdout:7/586: mknod d1/d4a/d81/d24/d49/dbf/dcf/cd1 0 2024-09-19T06:40:37.509 INFO:tasks.workunit.client.0.smithi099.stdout:2/313: fdatasync d1/d2/d4d/f5e 0 2024-09-19T06:40:37.510 INFO:tasks.workunit.client.0.smithi099.stdout:3/608: rmdir d7/d34/d1d/d20 39 2024-09-19T06:40:37.510 INFO:tasks.workunit.client.0.smithi099.stdout:4/470: truncate d12/f30 2694130 0 2024-09-19T06:40:37.512 INFO:tasks.workunit.client.0.smithi099.stdout:3/609: write d7/d34/f70 [1424240,41459] 0 2024-09-19T06:40:37.513 INFO:tasks.workunit.client.0.smithi099.stdout:6/407: mkdir d1/d5/d24/d2b/d86 0 2024-09-19T06:40:37.514 INFO:tasks.workunit.client.0.smithi099.stdout:8/331: symlink d4/d11/l6e 0 2024-09-19T06:40:37.514 INFO:tasks.workunit.client.0.smithi099.stdout:4/471: write d12/d32/d42/d5c/f31 [2654953,47848] 0 2024-09-19T06:40:37.515 INFO:tasks.workunit.client.0.smithi099.stdout:0/408: write d0/d17/d41/f3d [1364023,101107] 0 2024-09-19T06:40:37.516 INFO:tasks.workunit.client.1.smithi117.stdout:7/587: dwrite d1/d4a/d77/fcc [0,4194304] 0 2024-09-19T06:40:37.516 INFO:tasks.workunit.client.0.smithi099.stdout:4/472: truncate f10 5164174 0 2024-09-19T06:40:37.518 INFO:tasks.workunit.client.0.smithi099.stdout:0/409: write d0/db/d13/d1f/d4a/f50 [2946141,72420] 0 2024-09-19T06:40:37.519 INFO:tasks.workunit.client.0.smithi099.stdout:8/332: symlink d4/de/d1c/l6f 0 2024-09-19T06:40:37.520 INFO:tasks.workunit.client.0.smithi099.stdout:3/610: dread d7/d34/d1d/d36/d69/f6b [0,4194304] 0 2024-09-19T06:40:37.521 INFO:tasks.workunit.client.1.smithi117.stdout:7/588: mkdir d1/d4a/d81/d24/d26/d44/dd2 0 2024-09-19T06:40:37.521 INFO:tasks.workunit.client.0.smithi099.stdout:4/473: chown f11 13 1 2024-09-19T06:40:37.524 INFO:tasks.workunit.client.0.smithi099.stdout:7/519: link d7/dd/d29/d1f/fb5 d7/dd/d29/d1f/d45/d48/fbe 0 2024-09-19T06:40:37.527 INFO:tasks.workunit.client.0.smithi099.stdout:4/474: read - d12/d1b/d73/d81/fa0 zero size 2024-09-19T06:40:37.527 INFO:tasks.workunit.client.0.smithi099.stdout:0/410: creat d0/db/d27/d5d/f81 x:0 0 0 2024-09-19T06:40:37.529 INFO:tasks.workunit.client.0.smithi099.stdout:4/475: readlink d12/d1b/l7b 0 2024-09-19T06:40:37.529 INFO:tasks.workunit.client.0.smithi099.stdout:7/520: stat d7/dd/d29/d1f/d45/d48/fbd 0 2024-09-19T06:40:37.531 INFO:tasks.workunit.client.0.smithi099.stdout:3/611: fdatasync d7/d34/d1d/d36/d42/f6c 0 2024-09-19T06:40:37.531 INFO:tasks.workunit.client.0.smithi099.stdout:8/333: dread d4/de/f16 [0,4194304] 0 2024-09-19T06:40:37.532 INFO:tasks.workunit.client.0.smithi099.stdout:8/334: chown d4 5598 1 2024-09-19T06:40:37.532 INFO:tasks.workunit.client.0.smithi099.stdout:6/408: dwrite d1/d5/f50 [0,4194304] 0 2024-09-19T06:40:37.533 INFO:tasks.workunit.client.0.smithi099.stdout:0/411: rmdir d0/db/d36 39 2024-09-19T06:40:37.534 INFO:tasks.workunit.client.0.smithi099.stdout:8/335: chown d4/de/d10 1164523 1 2024-09-19T06:40:37.535 INFO:tasks.workunit.client.0.smithi099.stdout:7/521: symlink d7/dd/d29/d34/da1/lbf 0 2024-09-19T06:40:37.535 INFO:tasks.workunit.client.1.smithi117.stdout:7/589: dread d1/d4a/d81/d24/f69 [0,4194304] 0 2024-09-19T06:40:37.536 INFO:tasks.workunit.client.0.smithi099.stdout:4/476: symlink d12/d1b/da4/la5 0 2024-09-19T06:40:37.540 INFO:tasks.workunit.client.1.smithi117.stdout:7/590: dread d1/d4a/d81/f2a [0,4194304] 0 2024-09-19T06:40:37.541 INFO:tasks.workunit.client.0.smithi099.stdout:7/522: symlink d7/dd/d29/d34/lc0 0 2024-09-19T06:40:37.541 INFO:tasks.workunit.client.0.smithi099.stdout:0/412: mknod d0/db/d13/d37/c82 0 2024-09-19T06:40:37.542 INFO:tasks.workunit.client.1.smithi117.stdout:7/591: read - d1/d4a/d81/d48/d5f/f7f zero size 2024-09-19T06:40:37.542 INFO:tasks.workunit.client.0.smithi099.stdout:4/477: chown d12/d1b/f4f 97034 1 2024-09-19T06:40:37.544 INFO:tasks.workunit.client.0.smithi099.stdout:6/409: creat d1/d5/d24/d2e/d6e/f87 x:0 0 0 2024-09-19T06:40:37.545 INFO:tasks.workunit.client.0.smithi099.stdout:4/478: write d12/d32/f4c [256514,13309] 0 2024-09-19T06:40:37.546 INFO:tasks.workunit.client.0.smithi099.stdout:3/612: rename d7/d34/d1d/d36/d69/f6b to d7/fb2 0 2024-09-19T06:40:37.548 INFO:tasks.workunit.client.0.smithi099.stdout:7/523: rmdir d7/dd/d29/d1f/d45/d48/d63/d75 39 2024-09-19T06:40:37.548 INFO:tasks.workunit.client.1.smithi117.stdout:7/592: rename d1/d4a/d81/d48/d5f/d82/f94 to d1/d4a/d81/d24/fd3 0 2024-09-19T06:40:37.549 INFO:tasks.workunit.client.0.smithi099.stdout:2/314: dread d1/f39 [0,4194304] 0 2024-09-19T06:40:37.550 INFO:tasks.workunit.client.0.smithi099.stdout:8/336: dwrite d4/d11/d23/f3b [0,4194304] 0 2024-09-19T06:40:37.551 INFO:tasks.workunit.client.0.smithi099.stdout:4/479: rmdir d12/d32/d42/d5c 39 2024-09-19T06:40:37.553 INFO:tasks.workunit.client.1.smithi117.stdout:7/593: dread d1/d4a/d7c/d95/f99 [0,4194304] 0 2024-09-19T06:40:37.553 INFO:tasks.workunit.client.0.smithi099.stdout:3/613: write d7/d34/d1d/d57/d76/f95 [453701,32531] 0 2024-09-19T06:40:37.554 INFO:tasks.workunit.client.0.smithi099.stdout:2/315: stat d1/d2/d4d/d52/d36/f45 0 2024-09-19T06:40:37.554 INFO:tasks.workunit.client.0.smithi099.stdout:8/337: symlink d4/l70 0 2024-09-19T06:40:37.554 INFO:tasks.workunit.client.1.smithi117.stdout:7/594: readlink d1/d4a/d81/d24/d49/l4b 0 2024-09-19T06:40:37.555 INFO:tasks.workunit.client.0.smithi099.stdout:2/316: dread - d1/f5f zero size 2024-09-19T06:40:37.555 INFO:tasks.workunit.client.0.smithi099.stdout:7/524: dread d7/dd/d97/fa2 [0,4194304] 0 2024-09-19T06:40:37.555 INFO:tasks.workunit.client.1.smithi117.stdout:7/595: chown d1/d4a/d81/d48 2962 1 2024-09-19T06:40:37.556 INFO:tasks.workunit.client.0.smithi099.stdout:4/480: chown d12/d1b/l74 60199 1 2024-09-19T06:40:37.556 INFO:tasks.workunit.client.1.smithi117.stdout:7/596: chown d1/d3f/d92/cae 3 1 2024-09-19T06:40:37.556 INFO:tasks.workunit.client.0.smithi099.stdout:6/410: link d1/c36 d1/d5/d24/d2e/d41/c88 0 2024-09-19T06:40:37.557 INFO:tasks.workunit.client.0.smithi099.stdout:4/481: stat d12/d32/d42/f56 0 2024-09-19T06:40:37.558 INFO:tasks.workunit.client.0.smithi099.stdout:4/482: fsync d12/f7e 0 2024-09-19T06:40:37.559 INFO:tasks.workunit.client.0.smithi099.stdout:4/483: fdatasync d12/d1b/d73/f7a 0 2024-09-19T06:40:37.560 INFO:tasks.workunit.client.0.smithi099.stdout:8/338: creat d4/d66/f71 x:0 0 0 2024-09-19T06:40:37.560 INFO:tasks.workunit.client.0.smithi099.stdout:7/525: readlink d7/d39/d7d/l86 0 2024-09-19T06:40:37.561 INFO:tasks.workunit.client.0.smithi099.stdout:6/411: dread d1/d5/d24/f6a [0,4194304] 0 2024-09-19T06:40:37.561 INFO:tasks.workunit.client.0.smithi099.stdout:6/412: readlink d1/d5/l7 0 2024-09-19T06:40:37.562 INFO:tasks.workunit.client.0.smithi099.stdout:3/614: mkdir d7/d34/d1d/d36/db3 0 2024-09-19T06:40:37.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:37 smithi117 ceph-mon[34564]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:40:37.563 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:37 smithi117 ceph-mon[34564]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:40:37.563 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:37 smithi117 ceph-mon[34564]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:40:37.563 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:37 smithi117 ceph-mon[34564]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:40:37.563 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:37 smithi117 ceph-mon[34564]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:40:37.563 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:37 smithi117 ceph-mon[34564]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:40:37.563 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:37 smithi117 ceph-mon[34564]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:40:37.563 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:37 smithi117 ceph-mon[34564]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T06:40:37.563 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:37 smithi117 ceph-mon[34564]: Adjusting osd_memory_target on smithi117 to 2581M 2024-09-19T06:40:37.563 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:37 smithi117 ceph-mon[34564]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:40:37.564 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:37 smithi117 ceph-mon[34564]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:40:37.564 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:37 smithi117 ceph-mon[34564]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:40:37.564 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:37 smithi117 ceph-mon[34564]: Updating smithi099:/etc/ceph/ceph.conf 2024-09-19T06:40:37.564 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:37 smithi117 ceph-mon[34564]: Updating smithi117:/etc/ceph/ceph.conf 2024-09-19T06:40:37.564 INFO:tasks.workunit.client.0.smithi099.stdout:4/484: truncate d12/d1b/f6f 9546862 0 2024-09-19T06:40:37.565 INFO:tasks.workunit.client.0.smithi099.stdout:3/615: dread - d7/d34/d1d/d36/d69/d6d/d8f/faa zero size 2024-09-19T06:40:37.565 INFO:tasks.workunit.client.0.smithi099.stdout:8/339: rename d4/de/d14/l46 to d4/d11/d23/d3f/l72 0 2024-09-19T06:40:37.567 INFO:tasks.workunit.client.0.smithi099.stdout:8/340: chown d4/d11/d23 299 1 2024-09-19T06:40:37.569 INFO:tasks.workunit.client.0.smithi099.stdout:4/485: mknod d12/d32/d42/d97/ca6 0 2024-09-19T06:40:37.569 INFO:tasks.workunit.client.0.smithi099.stdout:4/486: readlink d12/d1b/l74 0 2024-09-19T06:40:37.570 INFO:tasks.workunit.client.0.smithi099.stdout:7/526: dwrite d7/dd/d29/d4e/d53/f66 [4194304,4194304] 0 2024-09-19T06:40:37.572 INFO:tasks.workunit.client.0.smithi099.stdout:6/413: creat d1/d5/d24/f89 x:0 0 0 2024-09-19T06:40:37.577 INFO:tasks.workunit.client.0.smithi099.stdout:0/413: dread d0/db/d13/d1f/f24 [0,4194304] 0 2024-09-19T06:40:37.577 INFO:tasks.workunit.client.0.smithi099.stdout:6/414: fsync d1/d5/d24/d2e/d41/d4e/d2a/f30 0 2024-09-19T06:40:37.578 INFO:tasks.workunit.client.0.smithi099.stdout:7/527: unlink d7/dd/d97/l9c 0 2024-09-19T06:40:37.579 INFO:tasks.workunit.client.0.smithi099.stdout:3/616: dwrite d7/d34/f1f [4194304,4194304] 0 2024-09-19T06:40:37.584 INFO:tasks.workunit.client.0.smithi099.stdout:2/317: dread d1/d2/d4d/d52/d18/f2f [0,4194304] 0 2024-09-19T06:40:37.589 INFO:tasks.workunit.client.0.smithi099.stdout:8/341: write d4/de/d26/d2b/f52 [314504,72736] 0 2024-09-19T06:40:37.590 INFO:tasks.workunit.client.1.smithi117.stdout:7/597: dread d1/d3f/f73 [0,4194304] 0 2024-09-19T06:40:37.591 INFO:tasks.workunit.client.0.smithi099.stdout:4/487: write d12/d32/d42/f56 [216498,4495] 0 2024-09-19T06:40:37.597 INFO:tasks.workunit.client.1.smithi117.stdout:7/598: truncate d1/d4a/f7b 2382972 0 2024-09-19T06:40:37.598 INFO:tasks.workunit.client.1.smithi117.stdout:7/599: symlink d1/d4a/d7c/ld4 0 2024-09-19T06:40:37.599 INFO:tasks.workunit.client.1.smithi117.stdout:7/600: fdatasync d1/d4a/d81/fca 0 2024-09-19T06:40:37.604 INFO:tasks.workunit.client.1.smithi117.stdout:7/601: write d1/d4a/d81/d24/d1c/f4e [977728,114557] 0 2024-09-19T06:40:37.608 INFO:tasks.workunit.client.1.smithi117.stdout:7/602: rename d1/d4a/d81/d24/d1c/d35/l41 to d1/d4a/d81/d24/d1c/d35/ld5 0 2024-09-19T06:40:37.608 INFO:tasks.workunit.client.1.smithi117.stdout:9/550: sync 2024-09-19T06:40:37.608 INFO:tasks.workunit.client.1.smithi117.stdout:0/433: sync 2024-09-19T06:40:37.611 INFO:tasks.workunit.client.1.smithi117.stdout:0/434: creat d11/d13/f8e x:0 0 0 2024-09-19T06:40:37.613 INFO:tasks.workunit.client.0.smithi099.stdout:7/528: link d7/dd/d29/d1f/d45/d48/l58 d7/dd/d29/d4e/lc1 0 2024-09-19T06:40:37.613 INFO:tasks.workunit.client.0.smithi099.stdout:2/318: dwrite d1/f15 [0,4194304] 0 2024-09-19T06:40:37.615 INFO:tasks.workunit.client.1.smithi117.stdout:9/551: link d4/d1c/d36/f77 d4/d1c/d7a/d52/d8d/d98/fb7 0 2024-09-19T06:40:37.615 INFO:tasks.workunit.client.0.smithi099.stdout:0/414: dwrite d0/db/d2f/f4e [0,4194304] 0 2024-09-19T06:40:37.617 INFO:tasks.workunit.client.0.smithi099.stdout:3/617: getdents d7/d34/d1d/d36/d69/d6d/d8f 0 2024-09-19T06:40:37.617 INFO:tasks.workunit.client.0.smithi099.stdout:7/529: chown d7/cab 8609938 1 2024-09-19T06:40:37.617 INFO:tasks.workunit.client.0.smithi099.stdout:4/488: chown d12/d32/d42/d5c/l4d 281765 1 2024-09-19T06:40:37.617 INFO:tasks.workunit.client.0.smithi099.stdout:8/342: rename d4/de/d1c/l4a to d4/d11/d23/l73 0 2024-09-19T06:40:37.620 INFO:tasks.workunit.client.1.smithi117.stdout:9/552: creat d4/d1c/d7a/d52/d8d/d98/fb8 x:0 0 0 2024-09-19T06:40:37.620 INFO:tasks.workunit.client.1.smithi117.stdout:0/435: dwrite d11/d13/d1b/d27/f7d [0,4194304] 0 2024-09-19T06:40:37.621 INFO:tasks.workunit.client.0.smithi099.stdout:8/343: fsync d4/d11/d23/f4b 0 2024-09-19T06:40:37.623 INFO:tasks.workunit.client.0.smithi099.stdout:2/319: rename d1/d2/d4d/d52/d9/ff to d1/d2/d4d/f66 0 2024-09-19T06:40:37.627 INFO:tasks.workunit.client.0.smithi099.stdout:6/415: dwrite d1/f4f [0,4194304] 0 2024-09-19T06:40:37.627 INFO:tasks.workunit.client.0.smithi099.stdout:0/415: write d0/db/d13/d1f/d39/f63 [2742647,26472] 0 2024-09-19T06:40:37.629 INFO:tasks.workunit.client.1.smithi117.stdout:9/553: link d4/d8/l4c d4/d1c/lb9 0 2024-09-19T06:40:37.630 INFO:tasks.workunit.client.0.smithi099.stdout:8/344: rmdir d4/d11/d38 39 2024-09-19T06:40:37.630 INFO:tasks.workunit.client.0.smithi099.stdout:4/489: mkdir d12/d1b/d73/d81/d8a/da7 0 2024-09-19T06:40:37.630 INFO:tasks.workunit.client.0.smithi099.stdout:2/320: creat d1/d2/d4d/d52/d9/f67 x:0 0 0 2024-09-19T06:40:37.631 INFO:tasks.workunit.client.0.smithi099.stdout:3/618: dread d7/d34/f1f [4194304,4194304] 0 2024-09-19T06:40:37.633 INFO:tasks.workunit.client.0.smithi099.stdout:7/530: creat d7/dd/d29/d1f/d45/fc2 x:0 0 0 2024-09-19T06:40:37.634 INFO:tasks.workunit.client.1.smithi117.stdout:9/554: mknod d4/d1c/d7a/cba 0 2024-09-19T06:40:37.637 INFO:tasks.workunit.client.0.smithi099.stdout:8/345: mknod d4/d11/d38/c74 0 2024-09-19T06:40:37.638 INFO:tasks.workunit.client.1.smithi117.stdout:0/436: dread d11/d13/d14/d16/f4a [0,4194304] 0 2024-09-19T06:40:37.638 INFO:tasks.workunit.client.0.smithi099.stdout:6/416: getdents d1/d5/d52 0 2024-09-19T06:40:37.640 INFO:tasks.workunit.client.1.smithi117.stdout:7/603: dread d1/d4a/d81/fa4 [0,4194304] 0 2024-09-19T06:40:37.643 INFO:tasks.workunit.client.0.smithi099.stdout:8/346: mknod d4/d11/d23/d3f/c75 0 2024-09-19T06:40:37.643 INFO:tasks.workunit.client.1.smithi117.stdout:0/437: creat d11/d13/d1b/d27/d54/f8f x:0 0 0 2024-09-19T06:40:37.644 INFO:tasks.workunit.client.0.smithi099.stdout:7/531: dread d7/d39/f59 [0,4194304] 0 2024-09-19T06:40:37.644 INFO:tasks.workunit.client.1.smithi117.stdout:7/604: symlink d1/d4a/d81/d24/d26/d44/ld6 0 2024-09-19T06:40:37.645 INFO:tasks.workunit.client.1.smithi117.stdout:0/438: write d11/d13/d14/d2c/f2f [2682014,122641] 0 2024-09-19T06:40:37.645 INFO:tasks.workunit.client.1.smithi117.stdout:7/605: stat d1/d4a/d81/d48/d5f/d82 0 2024-09-19T06:40:37.646 INFO:tasks.workunit.client.1.smithi117.stdout:0/439: readlink d11/d13/d1b/d4b/l85 0 2024-09-19T06:40:37.646 INFO:tasks.workunit.client.0.smithi099.stdout:6/417: write d1/d5/d24/d2e/d6e/f87 [151344,87855] 0 2024-09-19T06:40:37.647 INFO:tasks.workunit.client.1.smithi117.stdout:9/555: write d4/d17/f7b [2681990,125280] 0 2024-09-19T06:40:37.647 INFO:tasks.workunit.client.0.smithi099.stdout:0/416: dwrite d0/db/d13/d1f/d4a/f50 [0,4194304] 0 2024-09-19T06:40:37.648 INFO:tasks.workunit.client.1.smithi117.stdout:0/440: chown d11/d13/d1b/d27/d54/f57 1724 1 2024-09-19T06:40:37.648 INFO:tasks.workunit.client.0.smithi099.stdout:3/619: dwrite d7/d34/d1d/d36/d42/f6c [0,4194304] 0 2024-09-19T06:40:37.648 INFO:tasks.workunit.client.1.smithi117.stdout:7/606: write d1/d4a/d81/f2a [2254949,82516] 0 2024-09-19T06:40:37.649 INFO:tasks.workunit.client.1.smithi117.stdout:9/556: write d4/d1c/d36/f6c [2569707,100498] 0 2024-09-19T06:40:37.650 INFO:tasks.workunit.client.0.smithi099.stdout:7/532: chown d7/dd/d29/d1f/d45/f8b 1146919225 1 2024-09-19T06:40:37.654 INFO:tasks.workunit.client.1.smithi117.stdout:0/441: creat d11/d13/f90 x:0 0 0 2024-09-19T06:40:37.657 INFO:tasks.workunit.client.0.smithi099.stdout:6/418: creat d1/d5/d24/d2e/d41/d4e/d54/d5d/d61/f8a x:0 0 0 2024-09-19T06:40:37.657 INFO:tasks.workunit.client.0.smithi099.stdout:0/417: creat d0/db/d27/f83 x:0 0 0 2024-09-19T06:40:37.658 INFO:tasks.workunit.client.0.smithi099.stdout:7/533: rmdir d7/dd/d29/d4e/d53/d64/d67 39 2024-09-19T06:40:37.658 INFO:tasks.workunit.client.0.smithi099.stdout:3/620: stat d7/d34/d1d/d20/l8a 0 2024-09-19T06:40:37.659 INFO:tasks.workunit.client.1.smithi117.stdout:9/557: dwrite d4/d1c/d36/f6c [4194304,4194304] 0 2024-09-19T06:40:37.660 INFO:tasks.workunit.client.0.smithi099.stdout:4/490: rmdir d12/d1b/d73/d81 39 2024-09-19T06:40:37.661 INFO:tasks.workunit.client.1.smithi117.stdout:7/607: dwrite d1/d4a/d81/d24/d49/f62 [0,4194304] 0 2024-09-19T06:40:37.661 INFO:tasks.workunit.client.1.smithi117.stdout:9/558: fdatasync d4/d1c/f1f 0 2024-09-19T06:40:37.662 INFO:tasks.workunit.client.0.smithi099.stdout:6/419: read d1/d5/d24/f6a [341389,111201] 0 2024-09-19T06:40:37.663 INFO:tasks.workunit.client.1.smithi117.stdout:7/608: chown d1/d4a/d81/d24/d1c/d35/d4f/l8b 3720 1 2024-09-19T06:40:37.663 INFO:tasks.workunit.client.0.smithi099.stdout:8/347: dwrite d4/f5b [0,4194304] 0 2024-09-19T06:40:37.667 INFO:tasks.workunit.client.1.smithi117.stdout:9/559: rename d4/d1c/d5f/la9 to d4/d8/lbb 0 2024-09-19T06:40:37.668 INFO:tasks.workunit.client.1.smithi117.stdout:9/560: write d4/d58/f68 [288359,114411] 0 2024-09-19T06:40:37.668 INFO:tasks.workunit.client.1.smithi117.stdout:0/442: link d11/d13/d28/f87 d11/d13/d1b/d27/d37/f91 0 2024-09-19T06:40:37.671 INFO:tasks.workunit.client.0.smithi099.stdout:7/534: rename d7/dd/d29/d1f/d45/d48/d63/fae to d7/dd/d29/d34/d8f/fc3 0 2024-09-19T06:40:37.672 INFO:tasks.workunit.client.1.smithi117.stdout:9/561: mkdir d4/d1c/d5f/dbc 0 2024-09-19T06:40:37.673 INFO:tasks.workunit.client.0.smithi099.stdout:7/535: truncate d7/dd/d29/d34/f98 723622 0 2024-09-19T06:40:37.673 INFO:tasks.workunit.client.0.smithi099.stdout:7/536: stat d7/dd/d29/d1f/l43 0 2024-09-19T06:40:37.674 INFO:tasks.workunit.client.0.smithi099.stdout:7/537: fsync d7/dd/d29/d1f/d45/d48/fbd 0 2024-09-19T06:40:37.676 INFO:tasks.workunit.client.0.smithi099.stdout:8/348: link d4/de/d1c/f6d d4/d66/f76 0 2024-09-19T06:40:37.678 INFO:tasks.workunit.client.0.smithi099.stdout:3/621: creat d7/d34/d1d/d20/d58/fb4 x:0 0 0 2024-09-19T06:40:37.678 INFO:tasks.workunit.client.0.smithi099.stdout:7/538: creat d7/dd/d29/d4e/d53/fc4 x:0 0 0 2024-09-19T06:40:37.679 INFO:tasks.workunit.client.0.smithi099.stdout:8/349: truncate d4/de/d10/f20 857647 0 2024-09-19T06:40:37.679 INFO:tasks.workunit.client.0.smithi099.stdout:8/350: fdatasync d4/f54 0 2024-09-19T06:40:37.681 INFO:tasks.workunit.client.0.smithi099.stdout:8/351: fsync d4/d11/d23/d4c/f51 0 2024-09-19T06:40:37.682 INFO:tasks.workunit.client.0.smithi099.stdout:3/622: creat d7/d34/d1d/d20/d58/fb5 x:0 0 0 2024-09-19T06:40:37.683 INFO:tasks.workunit.client.0.smithi099.stdout:8/352: symlink d4/d11/d23/d3f/l77 0 2024-09-19T06:40:37.685 INFO:tasks.workunit.client.0.smithi099.stdout:3/623: rename d7/d34/d1d/d20/l3b to d7/d34/d1d/d20/lb6 0 2024-09-19T06:40:37.687 INFO:tasks.workunit.client.0.smithi099.stdout:8/353: rename d4/d11/d38/l57 to d4/d11/d23/d4c/l78 0 2024-09-19T06:40:37.688 INFO:tasks.workunit.client.0.smithi099.stdout:3/624: creat d7/d34/d1d/d57/d76/fb7 x:0 0 0 2024-09-19T06:40:37.690 INFO:tasks.workunit.client.0.smithi099.stdout:3/625: write d7/f68 [6829419,126003] 0 2024-09-19T06:40:37.691 INFO:tasks.workunit.client.1.smithi117.stdout:9/562: write d4/d1c/f35 [12807,21249] 0 2024-09-19T06:40:37.691 INFO:tasks.workunit.client.1.smithi117.stdout:7/609: dread d1/d4a/d81/d24/f20 [0,4194304] 0 2024-09-19T06:40:37.692 INFO:tasks.workunit.client.0.smithi099.stdout:3/626: chown d7/d34/c94 131911308 1 2024-09-19T06:40:37.693 INFO:tasks.workunit.client.1.smithi117.stdout:9/563: symlink d4/d1c/d7a/d16/lbd 0 2024-09-19T06:40:37.695 INFO:tasks.workunit.client.0.smithi099.stdout:3/627: chown d7/d34/d1d/d36/d42/fac 67 1 2024-09-19T06:40:37.697 INFO:tasks.workunit.client.0.smithi099.stdout:8/354: dwrite d4/de/d1c/f6d [0,4194304] 0 2024-09-19T06:40:37.698 INFO:tasks.workunit.client.0.smithi099.stdout:3/628: mkdir d7/d34/d1d/d36/db8 0 2024-09-19T06:40:37.699 INFO:tasks.workunit.client.1.smithi117.stdout:9/564: rename d4/f33 to d4/d1c/d7a/d52/d8d/d98/fbe 0 2024-09-19T06:40:37.703 INFO:tasks.workunit.client.1.smithi117.stdout:9/565: symlink d4/d1c/d73/lbf 0 2024-09-19T06:40:37.704 INFO:tasks.workunit.client.0.smithi099.stdout:6/420: write d1/d5/d24/f6a [1697566,56224] 0 2024-09-19T06:40:37.704 INFO:tasks.workunit.client.0.smithi099.stdout:4/491: write d12/f30 [472601,75330] 0 2024-09-19T06:40:37.705 INFO:tasks.workunit.client.0.smithi099.stdout:8/355: dread d4/de/d1c/f6d [0,4194304] 0 2024-09-19T06:40:37.707 INFO:tasks.workunit.client.1.smithi117.stdout:9/566: creat d4/d1c/d73/db5/fc0 x:0 0 0 2024-09-19T06:40:37.708 INFO:tasks.workunit.client.1.smithi117.stdout:7/610: dwrite d1/d4a/d81/d48/d5f/d82/fa5 [0,4194304] 0 2024-09-19T06:40:37.709 INFO:tasks.workunit.client.0.smithi099.stdout:0/418: dread d0/db/d13/d37/d3c/d3e/f4c [0,4194304] 0 2024-09-19T06:40:37.709 INFO:tasks.workunit.client.0.smithi099.stdout:6/421: readlink d1/d5/d24/d2e/d41/d4e/l75 0 2024-09-19T06:40:37.709 INFO:tasks.workunit.client.0.smithi099.stdout:7/539: dread d7/dd/d29/d34/d8f/f92 [4194304,4194304] 0 2024-09-19T06:40:37.710 INFO:tasks.workunit.client.1.smithi117.stdout:9/567: dread - d4/d1c/d73/db5/fc0 zero size 2024-09-19T06:40:37.711 INFO:tasks.workunit.client.0.smithi099.stdout:3/629: rename d7/c9c to d7/d34/d1d/d36/d42/cb9 0 2024-09-19T06:40:37.712 INFO:tasks.workunit.client.1.smithi117.stdout:7/611: truncate d1/d4a/d81/d24/d26/f2f 9241636 0 2024-09-19T06:40:37.714 INFO:tasks.workunit.client.1.smithi117.stdout:7/612: rmdir d1/d4a/d81/d24/d26 39 2024-09-19T06:40:37.715 INFO:tasks.workunit.client.0.smithi099.stdout:0/419: creat d0/d17/f84 x:0 0 0 2024-09-19T06:40:37.715 INFO:tasks.workunit.client.1.smithi117.stdout:9/568: getdents d4/d1c/d7a/d52 0 2024-09-19T06:40:37.717 INFO:tasks.workunit.client.1.smithi117.stdout:7/613: mkdir d1/d72/dd7 0 2024-09-19T06:40:37.718 INFO:tasks.workunit.client.0.smithi099.stdout:6/422: creat d1/d5/d24/d2e/d41/d4e/d2a/f8b x:0 0 0 2024-09-19T06:40:37.719 INFO:tasks.workunit.client.1.smithi117.stdout:9/569: mkdir d4/d1c/d7a/d52/d8d/dc1 0 2024-09-19T06:40:37.720 INFO:tasks.workunit.client.1.smithi117.stdout:9/570: chown d4/d58/f68 10 1 2024-09-19T06:40:37.721 INFO:tasks.workunit.client.1.smithi117.stdout:7/614: creat d1/d4a/d7c/fd8 x:0 0 0 2024-09-19T06:40:37.722 INFO:tasks.workunit.client.0.smithi099.stdout:4/492: dwrite d12/d32/d42/d5c/d51/f7f [0,4194304] 0 2024-09-19T06:40:37.722 INFO:tasks.workunit.client.0.smithi099.stdout:8/356: dwrite d4/de/d26/f5c [0,4194304] 0 2024-09-19T06:40:37.725 INFO:tasks.workunit.client.1.smithi117.stdout:9/571: rename d4/d1c/d54/fab to d4/d20/fc2 0 2024-09-19T06:40:37.725 INFO:tasks.workunit.client.0.smithi099.stdout:6/423: chown d1/d5/d24/d2e/d41/d4e/d54/d5d/d61/d65 4 1 2024-09-19T06:40:37.726 INFO:tasks.workunit.client.1.smithi117.stdout:9/572: write d4/d17/f61 [1492516,33454] 0 2024-09-19T06:40:37.726 INFO:tasks.workunit.client.0.smithi099.stdout:3/630: rename d7/d34/d1d/d57/d76/f87 to d7/d34/d1d/d57/d76/fba 0 2024-09-19T06:40:37.729 INFO:tasks.workunit.client.0.smithi099.stdout:7/540: rename d7/d39/f8c to d7/dd/d29/d4e/d53/d64/fc5 0 2024-09-19T06:40:37.735 INFO:tasks.workunit.client.0.smithi099.stdout:3/631: dwrite d7/f68 [4194304,4194304] 0 2024-09-19T06:40:37.735 INFO:tasks.workunit.client.0.smithi099.stdout:6/424: symlink d1/d5/d24/d2e/d6e/l8c 0 2024-09-19T06:40:37.737 INFO:tasks.workunit.client.1.smithi117.stdout:9/573: dread d4/d1c/d46/f6b [0,4194304] 0 2024-09-19T06:40:37.741 INFO:tasks.workunit.client.1.smithi117.stdout:9/574: unlink d4/d8/l7c 0 2024-09-19T06:40:37.742 INFO:tasks.workunit.client.0.smithi099.stdout:6/425: creat d1/d5/d24/d2e/d41/f8d x:0 0 0 2024-09-19T06:40:37.742 INFO:tasks.workunit.client.0.smithi099.stdout:8/357: link d4/d11/d23/l73 d4/de/d1c/l79 0 2024-09-19T06:40:37.743 INFO:tasks.workunit.client.0.smithi099.stdout:3/632: symlink d7/d34/d1d/d20/d58/lbb 0 2024-09-19T06:40:37.744 INFO:tasks.workunit.client.0.smithi099.stdout:4/493: dwrite d12/d32/d42/f93 [0,4194304] 0 2024-09-19T06:40:37.745 INFO:tasks.workunit.client.1.smithi117.stdout:9/575: getdents d4/d1c/d36 0 2024-09-19T06:40:37.749 INFO:tasks.workunit.client.0.smithi099.stdout:7/541: dwrite d7/f15 [0,4194304] 0 2024-09-19T06:40:37.750 INFO:tasks.workunit.client.0.smithi099.stdout:3/633: unlink d7/d34/d1d/d36/d69/d6d/d7a/f81 0 2024-09-19T06:40:37.752 INFO:tasks.workunit.client.0.smithi099.stdout:8/358: rename d4/d11/d23/l53 to d4/de/d10/l7a 0 2024-09-19T06:40:37.753 INFO:tasks.workunit.client.0.smithi099.stdout:8/359: chown d4/de/d26/d2b 1828 1 2024-09-19T06:40:37.755 INFO:tasks.workunit.client.0.smithi099.stdout:7/542: creat d7/fc6 x:0 0 0 2024-09-19T06:40:37.756 INFO:tasks.workunit.client.0.smithi099.stdout:7/543: stat d7/dd/d29/f1e 0 2024-09-19T06:40:37.770 INFO:tasks.workunit.client.0.smithi099.stdout:8/360: truncate d4/d5e/f6c 2870290 0 2024-09-19T06:40:37.770 INFO:tasks.workunit.client.0.smithi099.stdout:7/544: truncate d7/dd/d29/d1f/d45/f5b 885325 0 2024-09-19T06:40:37.773 INFO:tasks.workunit.client.0.smithi099.stdout:3/634: dread d7/d34/d1d/f78 [0,4194304] 0 2024-09-19T06:40:37.774 INFO:tasks.workunit.client.0.smithi099.stdout:7/545: rename d7/dd/d29/d4e/d53/d64 to d7/dc7 0 2024-09-19T06:40:37.778 INFO:tasks.workunit.client.0.smithi099.stdout:8/361: dwrite d4/de/d10/f24 [4194304,4194304] 0 2024-09-19T06:40:37.782 INFO:tasks.workunit.client.0.smithi099.stdout:3/635: dwrite d7/d34/d28/f53 [0,4194304] 0 2024-09-19T06:40:37.782 INFO:tasks.workunit.client.0.smithi099.stdout:8/362: unlink d4/de/d14/f39 0 2024-09-19T06:40:37.787 INFO:tasks.workunit.client.0.smithi099.stdout:3/636: write d7/d34/d1d/d36/f38 [4175827,106317] 0 2024-09-19T06:40:37.791 INFO:tasks.workunit.client.0.smithi099.stdout:8/363: rmdir d4/d11/d23/d4c 39 2024-09-19T06:40:37.792 INFO:tasks.workunit.client.0.smithi099.stdout:8/364: dread - d4/de/d14/f65 zero size 2024-09-19T06:40:37.792 INFO:tasks.workunit.client.0.smithi099.stdout:3/637: write d7/f14 [7748469,61573] 0 2024-09-19T06:40:37.794 INFO:tasks.workunit.client.0.smithi099.stdout:6/426: dread d1/d5/d24/d2e/d41/f5a [0,4194304] 0 2024-09-19T06:40:37.795 INFO:tasks.workunit.client.0.smithi099.stdout:8/365: creat d4/d5e/f7b x:0 0 0 2024-09-19T06:40:37.796 INFO:tasks.workunit.client.0.smithi099.stdout:6/427: stat d1/d5/d24/d2e/d41/d4e/d54/d5d/d61/f68 0 2024-09-19T06:40:37.797 INFO:tasks.workunit.client.0.smithi099.stdout:6/428: chown d1/l18 205 1 2024-09-19T06:40:37.798 INFO:tasks.workunit.client.0.smithi099.stdout:8/366: mknod d4/d5e/c7c 0 2024-09-19T06:40:37.799 INFO:tasks.workunit.client.0.smithi099.stdout:6/429: truncate d1/d5/d24/d2b/f74 300808 0 2024-09-19T06:40:37.801 INFO:tasks.workunit.client.0.smithi099.stdout:6/430: symlink d1/d5/d24/d2e/d41/d4e/d54/d5d/d61/l8e 0 2024-09-19T06:40:37.803 INFO:tasks.workunit.client.0.smithi099.stdout:6/431: creat d1/d5/d24/d2e/f8f x:0 0 0 2024-09-19T06:40:37.804 INFO:tasks.workunit.client.0.smithi099.stdout:6/432: chown d1/d5/d24/d2e/d41/d4e/d54/d5d/d61/d65/l79 3554176 1 2024-09-19T06:40:37.811 INFO:tasks.workunit.client.0.smithi099.stdout:6/433: dwrite d1/d5/d24/d2e/d41/d4e/f6d [0,4194304] 0 2024-09-19T06:40:37.813 INFO:tasks.workunit.client.0.smithi099.stdout:7/546: dread d7/dd/d29/d1f/d45/f8b [0,4194304] 0 2024-09-19T06:40:37.813 INFO:tasks.workunit.client.0.smithi099.stdout:6/434: write d1/d5/d24/d2e/f31 [300766,101307] 0 2024-09-19T06:40:37.817 INFO:tasks.workunit.client.0.smithi099.stdout:3/638: dread d7/d34/d1d/d20/d58/d5c/f83 [0,4194304] 0 2024-09-19T06:40:37.818 INFO:tasks.workunit.client.0.smithi099.stdout:6/435: link d1/d5/d38/f59 d1/d5/d38/d76/f90 0 2024-09-19T06:40:37.820 INFO:tasks.workunit.client.0.smithi099.stdout:6/436: read - d1/d5/d24/d2e/d41/f8d zero size 2024-09-19T06:40:37.822 INFO:tasks.workunit.client.0.smithi099.stdout:3/639: link d7/f55 d7/d34/d1d/d57/fbc 0 2024-09-19T06:40:37.823 INFO:tasks.workunit.client.0.smithi099.stdout:7/547: dwrite d7/d39/d7d/f8e [0,4194304] 0 2024-09-19T06:40:37.823 INFO:tasks.workunit.client.0.smithi099.stdout:3/640: stat d7/d34/d1d/d36/c3e 0 2024-09-19T06:40:37.832 INFO:tasks.workunit.client.0.smithi099.stdout:7/548: dwrite d7/dd/d29/d34/d8f/fc3 [0,4194304] 0 2024-09-19T06:40:37.867 INFO:tasks.workunit.client.1.smithi117.stdout:1/538: sync 2024-09-19T06:40:37.868 INFO:tasks.workunit.client.0.smithi099.stdout:7/549: fdatasync d7/dd/d29/f2f 0 2024-09-19T06:40:37.871 INFO:tasks.workunit.client.0.smithi099.stdout:3/641: dwrite d7/d34/d1d/d20/d58/d5c/f83 [4194304,4194304] 0 2024-09-19T06:40:37.872 INFO:tasks.workunit.client.0.smithi099.stdout:6/437: write d1/d12/f83 [1161236,102633] 0 2024-09-19T06:40:37.873 INFO:tasks.workunit.client.0.smithi099.stdout:6/438: chown d1/f4f 22 1 2024-09-19T06:40:37.873 INFO:tasks.workunit.client.0.smithi099.stdout:3/642: mkdir d7/d34/d1d/d20/d58/d5c/dbd 0 2024-09-19T06:40:37.874 INFO:tasks.workunit.client.1.smithi117.stdout:1/539: dwrite d3/d18/d23/f6b [0,4194304] 0 2024-09-19T06:40:37.878 INFO:tasks.workunit.client.0.smithi099.stdout:3/643: symlink d7/d34/d1d/d36/d69/d6d/d7a/lbe 0 2024-09-19T06:40:37.879 INFO:tasks.workunit.client.0.smithi099.stdout:7/550: dwrite d7/dd/d29/d1f/d45/f8b [0,4194304] 0 2024-09-19T06:40:37.882 INFO:tasks.workunit.client.0.smithi099.stdout:3/644: symlink d7/d34/d1d/d36/db3/lbf 0 2024-09-19T06:40:37.884 INFO:tasks.workunit.client.1.smithi117.stdout:1/540: rename d3/c9e to d3/d18/d23/cb9 0 2024-09-19T06:40:37.886 INFO:tasks.workunit.client.0.smithi099.stdout:3/645: creat d7/d34/d1d/d36/d69/d6d/d8f/fc0 x:0 0 0 2024-09-19T06:40:37.887 INFO:tasks.workunit.client.1.smithi117.stdout:1/541: creat d3/d18/fba x:0 0 0 2024-09-19T06:40:37.892 INFO:tasks.workunit.client.0.smithi099.stdout:6/439: dwrite d1/d5/d38/f59 [0,4194304] 0 2024-09-19T06:40:37.896 INFO:tasks.workunit.client.0.smithi099.stdout:6/440: mknod d1/c91 0 2024-09-19T06:40:37.897 INFO:tasks.workunit.client.0.smithi099.stdout:3/646: dwrite d7/d34/d1d/d36/f4a [0,4194304] 0 2024-09-19T06:40:37.897 INFO:tasks.workunit.client.0.smithi099.stdout:1/400: sync 2024-09-19T06:40:37.898 INFO:tasks.workunit.client.0.smithi099.stdout:5/604: sync 2024-09-19T06:40:37.898 INFO:tasks.workunit.client.0.smithi099.stdout:6/441: fdatasync d1/d5/d24/d2e/d41/f8d 0 2024-09-19T06:40:37.901 INFO:tasks.workunit.client.0.smithi099.stdout:3/647: symlink d7/d34/d1d/d36/d69/d6d/d8f/lc1 0 2024-09-19T06:40:37.903 INFO:tasks.workunit.client.0.smithi099.stdout:3/648: stat d7/d34/d1d/d20/d58/lbb 0 2024-09-19T06:40:37.903 INFO:tasks.workunit.client.0.smithi099.stdout:5/605: mknod d3/d1f/d4f/cd6 0 2024-09-19T06:40:37.906 INFO:tasks.workunit.client.0.smithi099.stdout:1/401: creat d0/f82 x:0 0 0 2024-09-19T06:40:37.908 INFO:tasks.workunit.client.0.smithi099.stdout:3/649: creat d7/d34/d1d/d36/d69/fc2 x:0 0 0 2024-09-19T06:40:37.909 INFO:tasks.workunit.client.0.smithi099.stdout:1/402: mknod d0/d17/d5b/c83 0 2024-09-19T06:40:37.911 INFO:tasks.workunit.client.0.smithi099.stdout:3/650: creat d7/d34/d1d/d36/d69/fc3 x:0 0 0 2024-09-19T06:40:37.913 INFO:tasks.workunit.client.0.smithi099.stdout:5/606: link d3/c36 d3/d7/cd7 0 2024-09-19T06:40:37.913 INFO:tasks.workunit.client.1.smithi117.stdout:1/542: unlink d3/d18/d56/c44 0 2024-09-19T06:40:37.914 INFO:tasks.workunit.client.0.smithi099.stdout:1/403: creat d0/d17/d32/d7b/f84 x:0 0 0 2024-09-19T06:40:37.915 INFO:tasks.workunit.client.1.smithi117.stdout:1/543: chown d3/d18/d23/f4f 87451781 1 2024-09-19T06:40:37.916 INFO:tasks.workunit.client.0.smithi099.stdout:3/651: rename d7/d34/d1d/d20/d75/d79/c6e to d7/d34/d1d/d57/cc4 0 2024-09-19T06:40:37.919 INFO:tasks.workunit.client.0.smithi099.stdout:3/652: chown d7/d34/d1d/d20/d75/d9d/caf 2 1 2024-09-19T06:40:37.922 INFO:tasks.workunit.client.0.smithi099.stdout:1/404: dwrite d0/d12/d54/f7e [0,4194304] 0 2024-09-19T06:40:37.925 INFO:tasks.workunit.client.0.smithi099.stdout:1/405: truncate d0/d68/f1d 1568355 0 2024-09-19T06:40:37.929 INFO:tasks.workunit.client.0.smithi099.stdout:1/406: fdatasync d0/d17/d24/d75/f77 0 2024-09-19T06:40:37.931 INFO:tasks.workunit.client.0.smithi099.stdout:3/653: dwrite d7/d34/d1d/d36/d69/d6d/f7b [0,4194304] 0 2024-09-19T06:40:37.938 INFO:tasks.workunit.client.0.smithi099.stdout:5/607: dwrite d3/d16/d5e/fbb [0,4194304] 0 2024-09-19T06:40:37.942 INFO:tasks.workunit.client.0.smithi099.stdout:6/442: dread d1/d5/d24/d2b/f58 [0,4194304] 0 2024-09-19T06:40:37.943 INFO:tasks.workunit.client.0.smithi099.stdout:3/654: mkdir d7/d34/d1d/d36/dc5 0 2024-09-19T06:40:37.943 INFO:tasks.workunit.client.1.smithi117.stdout:1/544: dread d3/d18/d56/f94 [0,4194304] 0 2024-09-19T06:40:37.944 INFO:tasks.workunit.client.1.smithi117.stdout:1/545: chown d3/d18/d56/fa8 2285300 1 2024-09-19T06:40:37.949 INFO:tasks.workunit.client.1.smithi117.stdout:1/546: write d3/f5 [4039265,79758] 0 2024-09-19T06:40:37.950 INFO:tasks.workunit.client.1.smithi117.stdout:1/547: chown d3/d18/d23/f6b 5 1 2024-09-19T06:40:37.951 INFO:tasks.workunit.client.1.smithi117.stdout:1/548: fdatasync d3/d22/f7d 0 2024-09-19T06:40:37.952 INFO:tasks.workunit.client.0.smithi099.stdout:5/608: dwrite d3/d16/d5e/f62 [4194304,4194304] 0 2024-09-19T06:40:37.955 INFO:tasks.workunit.client.1.smithi117.stdout:1/549: creat d3/d18/d23/d74/d89/d9f/fbb x:0 0 0 2024-09-19T06:40:37.958 INFO:tasks.workunit.client.1.smithi117.stdout:1/550: rename d3/d22/c7b to d3/da1/cbc 0 2024-09-19T06:40:37.959 INFO:tasks.workunit.client.0.smithi099.stdout:6/443: rmdir d1/d5/d24/d2e/d41/d4e 39 2024-09-19T06:40:37.961 INFO:tasks.workunit.client.0.smithi099.stdout:3/655: symlink d7/d34/d1d/d36/d69/d6d/d8f/lc6 0 2024-09-19T06:40:37.961 INFO:tasks.workunit.client.1.smithi117.stdout:1/551: mknod d3/da1/da5/cbd 0 2024-09-19T06:40:37.962 INFO:tasks.workunit.client.1.smithi117.stdout:1/552: write d3/f96 [700444,9435] 0 2024-09-19T06:40:37.963 INFO:tasks.workunit.client.1.smithi117.stdout:1/553: chown d3/da1/da5/fae 96534831 1 2024-09-19T06:40:37.967 INFO:tasks.workunit.client.1.smithi117.stdout:1/554: creat d3/d18/fbe x:0 0 0 2024-09-19T06:40:37.968 INFO:tasks.workunit.client.0.smithi099.stdout:6/444: truncate d1/d5/d24/d2e/d41/d4e/d2a/f47 1250324 0 2024-09-19T06:40:37.968 INFO:tasks.workunit.client.0.smithi099.stdout:3/656: creat d7/d34/d1d/d20/d58/fc7 x:0 0 0 2024-09-19T06:40:37.971 INFO:tasks.workunit.client.1.smithi117.stdout:1/555: creat d3/d18/d56/fbf x:0 0 0 2024-09-19T06:40:37.971 INFO:tasks.workunit.client.0.smithi099.stdout:5/609: dwrite d3/d1f/f21 [0,4194304] 0 2024-09-19T06:40:37.972 INFO:tasks.workunit.client.0.smithi099.stdout:1/407: dread d0/d12/d13/f22 [0,4194304] 0 2024-09-19T06:40:37.974 INFO:tasks.workunit.client.0.smithi099.stdout:3/657: creat d7/d34/d1d/d57/fc8 x:0 0 0 2024-09-19T06:40:37.975 INFO:tasks.workunit.client.0.smithi099.stdout:3/658: stat d7/d34/d1d/l50 0 2024-09-19T06:40:37.979 INFO:tasks.workunit.client.0.smithi099.stdout:3/659: fsync d7/f5f 0 2024-09-19T06:40:37.980 INFO:tasks.workunit.client.0.smithi099.stdout:6/445: link d1/l4 d1/d5/l92 0 2024-09-19T06:40:37.982 INFO:tasks.workunit.client.0.smithi099.stdout:1/408: creat d0/d12/d13/d37/d41/d78/f85 x:0 0 0 2024-09-19T06:40:37.983 INFO:tasks.workunit.client.0.smithi099.stdout:9/471: sync 2024-09-19T06:40:37.984 INFO:tasks.workunit.client.0.smithi099.stdout:6/446: unlink d1/d5/f3a 0 2024-09-19T06:40:37.985 INFO:tasks.workunit.client.0.smithi099.stdout:3/660: rename d7/d34/d28/f53 to d7/d34/d1d/d36/d69/fc9 0 2024-09-19T06:40:37.986 INFO:tasks.workunit.client.0.smithi099.stdout:1/409: symlink d0/d17/d32/d7b/l86 0 2024-09-19T06:40:37.987 INFO:tasks.workunit.client.0.smithi099.stdout:1/410: dread - d0/d17/d32/f50 zero size 2024-09-19T06:40:37.988 INFO:tasks.workunit.client.0.smithi099.stdout:9/472: creat dd/d47/d40/d61/f99 x:0 0 0 2024-09-19T06:40:37.989 INFO:tasks.workunit.client.0.smithi099.stdout:1/411: stat d0/d17/d32/c60 0 2024-09-19T06:40:37.991 INFO:tasks.workunit.client.0.smithi099.stdout:9/473: fsync dd/d47/d40/f52 0 2024-09-19T06:40:37.991 INFO:tasks.workunit.client.0.smithi099.stdout:6/447: dwrite d1/d12/f83 [0,4194304] 0 2024-09-19T06:40:37.991 INFO:tasks.workunit.client.0.smithi099.stdout:3/661: mknod d7/cca 0 2024-09-19T06:40:37.993 INFO:tasks.workunit.client.0.smithi099.stdout:6/448: chown d1/d5/d24/d2e/d41/d4e/d2a/f55 352459772 1 2024-09-19T06:40:37.994 INFO:tasks.workunit.client.0.smithi099.stdout:3/662: rmdir d7/d34/d1d/d36/d42 39 2024-09-19T06:40:37.999 INFO:tasks.workunit.client.0.smithi099.stdout:1/412: dwrite d0/d17/d32/f50 [0,4194304] 0 2024-09-19T06:40:38.000 INFO:tasks.workunit.client.0.smithi099.stdout:3/663: creat d7/d34/d1d/d20/d75/d9d/fcb x:0 0 0 2024-09-19T06:40:38.002 INFO:tasks.workunit.client.0.smithi099.stdout:1/413: mknod d0/d17/c87 0 2024-09-19T06:40:38.005 INFO:tasks.workunit.client.0.smithi099.stdout:5/610: dwrite d3/d16/d2f/d34/d3c/d65/f84 [0,4194304] 0 2024-09-19T06:40:38.007 INFO:tasks.workunit.client.0.smithi099.stdout:3/664: rename d7/d34/d1d/d20/f67 to d7/d34/d1d/d36/db8/fcc 0 2024-09-19T06:40:38.008 INFO:tasks.workunit.client.0.smithi099.stdout:5/611: chown d3/d7/c9e 4 1 2024-09-19T06:40:38.027 INFO:tasks.workunit.client.0.smithi099.stdout:3/665: dread d7/f14 [0,4194304] 0 2024-09-19T06:40:38.027 INFO:tasks.workunit.client.0.smithi099.stdout:9/474: dread dd/f1f [0,4194304] 0 2024-09-19T06:40:38.074 INFO:tasks.workunit.client.1.smithi117.stdout:2/517: sync 2024-09-19T06:40:38.076 INFO:tasks.workunit.client.1.smithi117.stdout:2/518: mknod d0/d12/d2f/d98/cc1 0 2024-09-19T06:40:38.077 INFO:tasks.workunit.client.1.smithi117.stdout:2/519: readlink d0/d7/d29/d71/lb6 0 2024-09-19T06:40:38.078 INFO:tasks.workunit.client.1.smithi117.stdout:2/520: mknod d0/d12/d2f/d98/cc2 0 2024-09-19T06:40:38.081 INFO:tasks.workunit.client.1.smithi117.stdout:2/521: link d0/d12/d2f/f60 d0/d7/d29/db0/fc3 0 2024-09-19T06:40:38.083 INFO:tasks.workunit.client.1.smithi117.stdout:2/522: rename d0/c22 to d0/d7/d58/cc4 0 2024-09-19T06:40:38.084 INFO:tasks.workunit.client.1.smithi117.stdout:2/523: write d0/d7/d58/db1/fb3 [656717,73715] 0 2024-09-19T06:40:38.086 INFO:tasks.workunit.client.1.smithi117.stdout:2/524: symlink d0/d12/d2f/lc5 0 2024-09-19T06:40:38.087 INFO:tasks.workunit.client.1.smithi117.stdout:2/525: write d0/d7/d29/f5f [1637838,67244] 0 2024-09-19T06:40:38.090 INFO:tasks.workunit.client.1.smithi117.stdout:2/526: creat d0/d7/d29/d35/d61/d65/fc6 x:0 0 0 2024-09-19T06:40:38.093 INFO:tasks.workunit.client.1.smithi117.stdout:2/527: rename d0/d7/d58/da8/cae to d0/d12/d2f/d98/cc7 0 2024-09-19T06:40:38.094 INFO:tasks.workunit.client.1.smithi117.stdout:2/528: write d0/d7/d1e/f41 [6841656,72465] 0 2024-09-19T06:40:38.099 INFO:tasks.workunit.client.1.smithi117.stdout:2/529: rename d0/d12/d32/f4f to d0/d64/fc8 0 2024-09-19T06:40:38.100 INFO:tasks.workunit.client.1.smithi117.stdout:2/530: stat d0/f4c 0 2024-09-19T06:40:38.101 INFO:tasks.workunit.client.0.smithi099.stdout:5/612: dread d3/d16/d2f/d34/d3c/f6d [0,4194304] 0 2024-09-19T06:40:38.103 INFO:tasks.workunit.client.0.smithi099.stdout:5/613: truncate d3/d16/d2f/fcf 495946 0 2024-09-19T06:40:38.105 INFO:tasks.workunit.client.0.smithi099.stdout:3/666: dwrite d7/d34/d1d/d36/f4f [4194304,4194304] 0 2024-09-19T06:40:38.106 INFO:tasks.workunit.client.1.smithi117.stdout:2/531: dwrite d0/d12/d32/db5/f91 [4194304,4194304] 0 2024-09-19T06:40:38.108 INFO:tasks.workunit.client.1.smithi117.stdout:2/532: write d0/d12/d2f/f40 [3218849,31758] 0 2024-09-19T06:40:38.113 INFO:tasks.workunit.client.1.smithi117.stdout:2/533: mkdir d0/d7/d1e/d20/dc9 0 2024-09-19T06:40:38.115 INFO:tasks.workunit.client.1.smithi117.stdout:2/534: read d0/d7/f55 [379289,40864] 0 2024-09-19T06:40:38.116 INFO:tasks.workunit.client.1.smithi117.stdout:2/535: chown d0/d12/d2f/c74 0 1 2024-09-19T06:40:38.122 INFO:tasks.workunit.client.1.smithi117.stdout:2/536: dwrite d0/d7/d29/d35/d61/d65/f8f [0,4194304] 0 2024-09-19T06:40:38.124 INFO:tasks.workunit.client.1.smithi117.stdout:2/537: mkdir d0/d12/d2f/d98/dca 0 2024-09-19T06:40:38.127 INFO:tasks.workunit.client.1.smithi117.stdout:2/538: symlink d0/d7/d29/db0/lcb 0 2024-09-19T06:40:38.129 INFO:tasks.workunit.client.1.smithi117.stdout:2/539: symlink d0/d7/d29/d35/d61/lcc 0 2024-09-19T06:40:38.130 INFO:tasks.workunit.client.1.smithi117.stdout:2/540: rmdir d0/d7/d29/d35/d3d 39 2024-09-19T06:40:38.133 INFO:tasks.workunit.client.1.smithi117.stdout:2/541: rename d0/d7/d29/d35/dbd/d8d/f92 to d0/d6f/fcd 0 2024-09-19T06:40:38.135 INFO:tasks.workunit.client.1.smithi117.stdout:2/542: symlink d0/d7/d29/d35/dbd/d8d/d9a/lce 0 2024-09-19T06:40:38.137 INFO:tasks.workunit.client.0.smithi099.stdout:0/420: sync 2024-09-19T06:40:38.137 INFO:tasks.workunit.client.0.smithi099.stdout:2/321: sync 2024-09-19T06:40:38.137 INFO:tasks.workunit.client.1.smithi117.stdout:2/543: creat d0/d12/d2f/d98/fcf x:0 0 0 2024-09-19T06:40:38.138 INFO:tasks.workunit.client.0.smithi099.stdout:0/421: write d0/d17/f6a [616485,23609] 0 2024-09-19T06:40:38.142 INFO:tasks.workunit.client.1.smithi117.stdout:2/544: dwrite d0/d12/f2c [4194304,4194304] 0 2024-09-19T06:40:38.143 INFO:tasks.workunit.client.1.smithi117.stdout:2/545: dread - d0/d7/d29/d35/dbd/fb8 zero size 2024-09-19T06:40:38.145 INFO:tasks.workunit.client.1.smithi117.stdout:2/546: creat d0/d7/d58/da8/daa/fd0 x:0 0 0 2024-09-19T06:40:38.147 INFO:tasks.workunit.client.1.smithi117.stdout:2/547: mkdir d0/d7/d1e/d20/dd1 0 2024-09-19T06:40:38.149 INFO:tasks.workunit.client.1.smithi117.stdout:2/548: truncate d0/f4c 356279 0 2024-09-19T06:40:38.149 INFO:tasks.workunit.client.1.smithi117.stdout:2/549: chown d0/d7/d58/da8/daa 6872971 1 2024-09-19T06:40:38.165 INFO:tasks.workunit.client.1.smithi117.stdout:2/550: dread d0/d12/d32/db5/f4a [0,4194304] 0 2024-09-19T06:40:38.166 INFO:tasks.workunit.client.1.smithi117.stdout:2/551: mkdir d0/d12/d2f/d98/dd2 0 2024-09-19T06:40:38.168 INFO:tasks.workunit.client.1.smithi117.stdout:2/552: creat d0/d7/d58/fd3 x:0 0 0 2024-09-19T06:40:38.168 INFO:tasks.workunit.client.1.smithi117.stdout:2/553: stat d0/d7/d29/d35/d61/d65 0 2024-09-19T06:40:38.170 INFO:tasks.workunit.client.1.smithi117.stdout:2/554: creat d0/d7/fd4 x:0 0 0 2024-09-19T06:40:38.177 INFO:tasks.workunit.client.1.smithi117.stdout:2/555: dread d0/f4c [0,4194304] 0 2024-09-19T06:40:38.182 INFO:tasks.workunit.client.1.smithi117.stdout:2/556: dwrite d0/d7/fd4 [0,4194304] 0 2024-09-19T06:40:38.186 INFO:tasks.workunit.client.1.smithi117.stdout:2/557: link d0/d7/d1e/c4e d0/d7/d29/d35/d61/d65/cd5 0 2024-09-19T06:40:38.188 INFO:tasks.workunit.client.1.smithi117.stdout:2/558: creat d0/d7/d29/d35/dbd/d8d/fd6 x:0 0 0 2024-09-19T06:40:38.190 INFO:tasks.workunit.client.1.smithi117.stdout:2/559: unlink d0/d12/f2c 0 2024-09-19T06:40:38.191 INFO:tasks.workunit.client.1.smithi117.stdout:2/560: fdatasync d0/d7/d29/d35/f97 0 2024-09-19T06:40:38.196 INFO:tasks.workunit.client.1.smithi117.stdout:2/561: link d0/d7/d29/d35/f77 d0/d7/d29/d35/d3d/fd7 0 2024-09-19T06:40:38.198 INFO:tasks.workunit.client.0.smithi099.stdout:9/475: mkdir dd/d62/d76/d9a 0 2024-09-19T06:40:38.198 INFO:tasks.workunit.client.0.smithi099.stdout:1/414: link d0/d12/d54/c67 d0/d17/d24/d3a/c88 0 2024-09-19T06:40:38.199 INFO:tasks.workunit.client.0.smithi099.stdout:5/614: fdatasync d3/d16/f28 0 2024-09-19T06:40:38.199 INFO:tasks.workunit.client.1.smithi117.stdout:2/562: unlink d0/d7/d29/f68 0 2024-09-19T06:40:38.200 INFO:tasks.workunit.client.0.smithi099.stdout:0/422: rename d0 to d0/db/d13/d85 22 2024-09-19T06:40:38.204 INFO:tasks.workunit.client.0.smithi099.stdout:5/615: mkdir d3/d16/d2f/d34/da4/dd8 0 2024-09-19T06:40:38.205 INFO:tasks.workunit.client.1.smithi117.stdout:2/563: getdents d0/d7/d29/d35/d3d/d72 0 2024-09-19T06:40:38.205 INFO:tasks.workunit.client.0.smithi099.stdout:2/322: mknod d1/d2/d4d/d52/d18/c68 0 2024-09-19T06:40:38.205 INFO:tasks.workunit.client.0.smithi099.stdout:1/415: dwrite d0/d12/d13/d37/f3f [0,4194304] 0 2024-09-19T06:40:38.207 INFO:tasks.workunit.client.0.smithi099.stdout:9/476: creat dd/d2c/d5c/d64/d93/f9b x:0 0 0 2024-09-19T06:40:38.207 INFO:tasks.workunit.client.0.smithi099.stdout:3/667: link d7/d34/d1d/d36/l93 d7/d34/d1d/d20/d75/d79/lcd 0 2024-09-19T06:40:38.208 INFO:tasks.workunit.client.0.smithi099.stdout:0/423: write d0/db/d36/f67 [1619728,80688] 0 2024-09-19T06:40:38.209 INFO:tasks.workunit.client.1.smithi117.stdout:2/564: mknod d0/d7/d58/cd8 0 2024-09-19T06:40:38.209 INFO:tasks.workunit.client.0.smithi099.stdout:5/616: mkdir d3/d16/d2f/d8c/dd9 0 2024-09-19T06:40:38.211 INFO:tasks.workunit.client.1.smithi117.stdout:2/565: write d0/f2b [8338435,68081] 0 2024-09-19T06:40:38.212 INFO:tasks.workunit.client.1.smithi117.stdout:2/566: fdatasync d0/d7/d29/d35/f97 0 2024-09-19T06:40:38.212 INFO:tasks.workunit.client.0.smithi099.stdout:1/416: rename d0/d17/d32/f5a to d0/d12/d13/f89 0 2024-09-19T06:40:38.214 INFO:tasks.workunit.client.0.smithi099.stdout:2/323: symlink d1/d2/d4d/d55/l69 0 2024-09-19T06:40:38.214 INFO:tasks.workunit.client.0.smithi099.stdout:1/417: fsync d0/d12/d13/d37/d41/f70 0 2024-09-19T06:40:38.216 INFO:tasks.workunit.client.0.smithi099.stdout:8/367: sync 2024-09-19T06:40:38.216 INFO:tasks.workunit.client.0.smithi099.stdout:4/494: sync 2024-09-19T06:40:38.216 INFO:tasks.workunit.client.0.smithi099.stdout:7/551: sync 2024-09-19T06:40:38.216 INFO:tasks.workunit.client.0.smithi099.stdout:6/449: sync 2024-09-19T06:40:38.216 INFO:tasks.workunit.client.0.smithi099.stdout:3/668: readlink d7/d34/d1d/d20/la6 0 2024-09-19T06:40:38.216 INFO:tasks.workunit.client.0.smithi099.stdout:5/617: mkdir d3/dda 0 2024-09-19T06:40:38.217 INFO:tasks.workunit.client.1.smithi117.stdout:2/567: rename d0/d6f to d0/d64/dd9 0 2024-09-19T06:40:38.218 INFO:tasks.workunit.client.0.smithi099.stdout:2/324: write d1/d2/f64 [452434,49102] 0 2024-09-19T06:40:38.218 INFO:tasks.workunit.client.0.smithi099.stdout:8/368: creat d4/d66/f7d x:0 0 0 2024-09-19T06:40:38.219 INFO:tasks.workunit.client.0.smithi099.stdout:5/618: write d3/d14/fac [841341,67523] 0 2024-09-19T06:40:38.220 INFO:tasks.workunit.client.0.smithi099.stdout:6/450: unlink d1/d5/d24/d2b/c48 0 2024-09-19T06:40:38.221 INFO:tasks.workunit.client.0.smithi099.stdout:0/424: fdatasync d0/db/d36/f67 0 2024-09-19T06:40:38.222 INFO:tasks.workunit.client.0.smithi099.stdout:2/325: unlink d1/f25 0 2024-09-19T06:40:38.223 INFO:tasks.workunit.client.0.smithi099.stdout:0/425: chown d0/db 3 1 2024-09-19T06:40:38.225 INFO:tasks.workunit.client.0.smithi099.stdout:7/552: mkdir d7/dd/d29/d1f/d45/d48/d63/d75/dc8 0 2024-09-19T06:40:38.226 INFO:tasks.workunit.client.0.smithi099.stdout:3/669: creat d7/d34/d1d/d20/d58/fce x:0 0 0 2024-09-19T06:40:38.228 INFO:tasks.workunit.client.0.smithi099.stdout:2/326: mknod d1/d2/d4d/c6a 0 2024-09-19T06:40:38.230 INFO:tasks.workunit.client.0.smithi099.stdout:1/418: dwrite d0/d12/d13/f89 [0,4194304] 0 2024-09-19T06:40:38.232 INFO:tasks.workunit.client.0.smithi099.stdout:2/327: write d1/d2/f1f [462720,60451] 0 2024-09-19T06:40:38.232 INFO:tasks.workunit.client.0.smithi099.stdout:7/553: mknod d7/d39/d7d/cc9 0 2024-09-19T06:40:38.234 INFO:tasks.workunit.client.0.smithi099.stdout:8/369: dwrite d4/de/d1c/f6b [0,4194304] 0 2024-09-19T06:40:38.236 INFO:tasks.workunit.client.0.smithi099.stdout:3/670: rmdir d7/d34/d1d/d36/d69/d6d/d7a 39 2024-09-19T06:40:38.237 INFO:tasks.workunit.client.0.smithi099.stdout:9/477: dread dd/d2c/d5c/d64/f82 [4194304,4194304] 0 2024-09-19T06:40:38.239 INFO:tasks.workunit.client.0.smithi099.stdout:1/419: mkdir d0/d17/d24/d5e/d8a 0 2024-09-19T06:40:38.242 INFO:tasks.workunit.client.0.smithi099.stdout:1/420: read d0/db/f31 [294390,44516] 0 2024-09-19T06:40:38.244 INFO:tasks.workunit.client.0.smithi099.stdout:5/619: write d3/d16/d2f/d34/d3c/d65/f86 [544659,76919] 0 2024-09-19T06:40:38.245 INFO:tasks.workunit.client.0.smithi099.stdout:3/671: unlink d7/d34/d1d/d36/db3/lbf 0 2024-09-19T06:40:38.246 INFO:tasks.workunit.client.0.smithi099.stdout:9/478: creat dd/d47/d68/f9c x:0 0 0 2024-09-19T06:40:38.248 INFO:tasks.workunit.client.0.smithi099.stdout:6/451: truncate d1/f19 1649424 0 2024-09-19T06:40:38.248 INFO:tasks.workunit.client.0.smithi099.stdout:7/554: mknod d7/dd/d29/cca 0 2024-09-19T06:40:38.249 INFO:tasks.workunit.client.0.smithi099.stdout:0/426: write d0/db/d13/d1f/d39/f66 [354507,55987] 0 2024-09-19T06:40:38.249 INFO:tasks.workunit.client.0.smithi099.stdout:2/328: symlink d1/d2/d4d/d52/d18/d27/d5b/l6b 0 2024-09-19T06:40:38.251 INFO:tasks.workunit.client.0.smithi099.stdout:1/421: stat d0/d17/d24/f6a 0 2024-09-19T06:40:38.252 INFO:tasks.workunit.client.0.smithi099.stdout:9/479: symlink dd/d62/l9d 0 2024-09-19T06:40:38.252 INFO:tasks.workunit.client.0.smithi099.stdout:5/620: dread d3/d16/d2f/f89 [0,4194304] 0 2024-09-19T06:40:38.256 INFO:tasks.workunit.client.0.smithi099.stdout:5/621: dread - d3/d16/d2f/d8c/fcc zero size 2024-09-19T06:40:38.257 INFO:tasks.workunit.client.0.smithi099.stdout:6/452: rename d1/d12/c67 to d1/d5/d24/d2e/d41/d4e/d54/d5d/c93 0 2024-09-19T06:40:38.258 INFO:tasks.workunit.client.0.smithi099.stdout:7/555: rmdir d7/dd/d29/d1f/d45/d48/d63/d75/dc8 0 2024-09-19T06:40:38.262 INFO:tasks.workunit.client.0.smithi099.stdout:0/427: dwrite d0/db/d13/f42 [0,4194304] 0 2024-09-19T06:40:38.263 INFO:tasks.workunit.client.0.smithi099.stdout:1/422: dread d0/d12/d54/f7e [0,4194304] 0 2024-09-19T06:40:38.266 INFO:tasks.workunit.client.0.smithi099.stdout:3/672: truncate d7/d34/d1d/d20/d58/d5c/f83 6977056 0 2024-09-19T06:40:38.266 INFO:tasks.workunit.client.0.smithi099.stdout:9/480: dwrite dd/d62/d78/f7b [0,4194304] 0 2024-09-19T06:40:38.267 INFO:tasks.workunit.client.0.smithi099.stdout:2/329: link d1/d2/d4d/d52/d18/d27/c32 d1/d2/d4d/d52/d18/d27/c6c 0 2024-09-19T06:40:38.267 INFO:tasks.workunit.client.0.smithi099.stdout:0/428: write d0/db/d2f/f6f [960250,7249] 0 2024-09-19T06:40:38.269 INFO:tasks.workunit.client.0.smithi099.stdout:7/556: mknod d7/dc7/d67/ccb 0 2024-09-19T06:40:38.271 INFO:tasks.workunit.client.0.smithi099.stdout:1/423: symlink d0/d2d/l8b 0 2024-09-19T06:40:38.273 INFO:tasks.workunit.client.0.smithi099.stdout:9/481: write dd/f5d [650342,102983] 0 2024-09-19T06:40:38.276 INFO:tasks.workunit.client.0.smithi099.stdout:2/330: fdatasync d1/d2/d5/d13/d2c/f38 0 2024-09-19T06:40:38.277 INFO:tasks.workunit.client.0.smithi099.stdout:7/557: chown d7/dd/d29/d34/da1 1 1 2024-09-19T06:40:38.277 INFO:tasks.workunit.client.0.smithi099.stdout:5/622: dwrite d3/d1f/f21 [0,4194304] 0 2024-09-19T06:40:38.280 INFO:tasks.workunit.client.0.smithi099.stdout:6/453: dwrite d1/d5/d24/d2e/d41/d4e/d2a/f8b [0,4194304] 0 2024-09-19T06:40:38.280 INFO:tasks.workunit.client.0.smithi099.stdout:0/429: link d0/db/d13/f20 d0/db/f86 0 2024-09-19T06:40:38.283 INFO:tasks.workunit.client.0.smithi099.stdout:5/623: stat c2 0 2024-09-19T06:40:38.287 INFO:tasks.workunit.client.0.smithi099.stdout:1/424: dwrite d0/d17/d24/d3a/f81 [0,4194304] 0 2024-09-19T06:40:38.288 INFO:tasks.workunit.client.0.smithi099.stdout:1/425: fdatasync d0/d12/d13/d37/d41/f70 0 2024-09-19T06:40:38.289 INFO:tasks.workunit.client.0.smithi099.stdout:1/426: truncate d0/db/f19 5131329 0 2024-09-19T06:40:38.289 INFO:tasks.workunit.client.0.smithi099.stdout:1/427: readlink d0/d17/d32/l64 0 2024-09-19T06:40:38.290 INFO:tasks.workunit.client.0.smithi099.stdout:1/428: readlink d0/d17/d32/l64 0 2024-09-19T06:40:38.363 INFO:tasks.workunit.client.1.smithi117.stdout:4/754: sync 2024-09-19T06:40:38.367 INFO:tasks.workunit.client.0.smithi099.stdout:7/558: unlink d7/dd/f37 0 2024-09-19T06:40:38.368 INFO:tasks.workunit.client.0.smithi099.stdout:9/482: dread dd/d47/d40/f59 [0,4194304] 0 2024-09-19T06:40:38.368 INFO:tasks.workunit.client.0.smithi099.stdout:2/331: mknod d1/d2/d4d/d52/d18/d46/c6d 0 2024-09-19T06:40:38.368 INFO:tasks.workunit.client.0.smithi099.stdout:0/430: unlink d0/db/l10 0 2024-09-19T06:40:38.369 INFO:tasks.workunit.client.0.smithi099.stdout:9/483: stat dd/f44 0 2024-09-19T06:40:38.370 INFO:tasks.workunit.client.0.smithi099.stdout:1/429: mknod d0/d12/d13/d37/d48/c8c 0 2024-09-19T06:40:38.371 INFO:tasks.workunit.client.0.smithi099.stdout:5/624: mknod d3/dda/cdb 0 2024-09-19T06:40:38.371 INFO:tasks.workunit.client.0.smithi099.stdout:2/332: fsync d1/f47 0 2024-09-19T06:40:38.373 INFO:tasks.workunit.client.1.smithi117.stdout:2/568: dread d0/d7/f16 [0,4194304] 0 2024-09-19T06:40:38.374 INFO:tasks.workunit.client.0.smithi099.stdout:0/431: read d0/f3 [562026,69217] 0 2024-09-19T06:40:38.374 INFO:tasks.workunit.client.0.smithi099.stdout:9/484: symlink dd/d2c/d5c/l9e 0 2024-09-19T06:40:38.374 INFO:tasks.workunit.client.0.smithi099.stdout:5/625: fdatasync d3/d16/d2f/d34/d3c/d65/f8a 0 2024-09-19T06:40:38.375 INFO:tasks.workunit.client.0.smithi099.stdout:0/432: fsync d0/db/fc 0 2024-09-19T06:40:38.377 INFO:tasks.workunit.client.0.smithi099.stdout:1/430: mkdir d0/d17/d24/d3a/d58/d8d 0 2024-09-19T06:40:38.377 INFO:tasks.workunit.client.0.smithi099.stdout:0/433: write d0/db/d13/d1f/d3a/f7e [742768,8038] 0 2024-09-19T06:40:38.378 INFO:tasks.workunit.client.0.smithi099.stdout:0/434: truncate d0/db/f48 1005959 0 2024-09-19T06:40:38.380 INFO:tasks.workunit.client.0.smithi099.stdout:5/626: mkdir d3/d16/d2f/d34/ddc 0 2024-09-19T06:40:38.381 INFO:tasks.workunit.client.0.smithi099.stdout:1/431: symlink d0/d17/d5b/l8e 0 2024-09-19T06:40:38.382 INFO:tasks.workunit.client.0.smithi099.stdout:1/432: chown d0/d17/c51 3455 1 2024-09-19T06:40:38.382 INFO:tasks.workunit.client.0.smithi099.stdout:2/333: rmdir d1/d2/d5/d13/d5c 0 2024-09-19T06:40:38.382 INFO:tasks.workunit.client.1.smithi117.stdout:2/569: read d0/d7/d1e/d20/f7b [2152115,16458] 0 2024-09-19T06:40:38.384 INFO:tasks.workunit.client.0.smithi099.stdout:7/559: getdents d7/dd/d29/d1f/d45/d48/d63 0 2024-09-19T06:40:38.384 INFO:tasks.workunit.client.0.smithi099.stdout:1/433: write d0/d12/d13/d37/d41/d78/f85 [57650,115721] 0 2024-09-19T06:40:38.385 INFO:tasks.workunit.client.0.smithi099.stdout:1/434: chown d0/f71 42210 1 2024-09-19T06:40:38.386 INFO:tasks.workunit.client.0.smithi099.stdout:7/560: read d7/dc7/f9b [233385,22205] 0 2024-09-19T06:40:38.386 INFO:tasks.workunit.client.0.smithi099.stdout:5/627: mknod d3/d7/d90/cdd 0 2024-09-19T06:40:38.387 INFO:tasks.workunit.client.1.smithi117.stdout:2/570: dread d0/d64/dd9/f8b [0,4194304] 0 2024-09-19T06:40:38.388 INFO:tasks.workunit.client.0.smithi099.stdout:0/435: mkdir d0/db/d27/d5d/d87 0 2024-09-19T06:40:38.389 INFO:tasks.workunit.client.0.smithi099.stdout:5/628: write d3/d7/f26 [671928,46597] 0 2024-09-19T06:40:38.390 INFO:tasks.workunit.client.1.smithi117.stdout:2/571: creat d0/d12/d32/da4/fda x:0 0 0 2024-09-19T06:40:38.390 INFO:tasks.workunit.client.0.smithi099.stdout:5/629: chown c0 2950552 1 2024-09-19T06:40:38.391 INFO:tasks.workunit.client.1.smithi117.stdout:2/572: read - d0/d7/d29/d35/dbd/fa2 zero size 2024-09-19T06:40:38.393 INFO:tasks.workunit.client.1.smithi117.stdout:2/573: read d0/d7/d29/d35/dbd/d8d/f9e [2031283,90330] 0 2024-09-19T06:40:38.395 INFO:tasks.workunit.client.0.smithi099.stdout:1/435: dwrite d0/f29 [0,4194304] 0 2024-09-19T06:40:38.395 INFO:tasks.workunit.client.0.smithi099.stdout:5/630: symlink d3/d16/d2f/d34/da4/da5/dcd/lde 0 2024-09-19T06:40:38.397 INFO:tasks.workunit.client.0.smithi099.stdout:1/436: dread - d0/d12/f79 zero size 2024-09-19T06:40:38.397 INFO:tasks.workunit.client.0.smithi099.stdout:0/436: dread d0/db/d2f/f4e [0,4194304] 0 2024-09-19T06:40:38.398 INFO:tasks.workunit.client.1.smithi117.stdout:2/574: rename d0/d64/dd9/lb9 to d0/d7/d58/da8/daa/ldb 0 2024-09-19T06:40:38.401 INFO:tasks.workunit.client.1.smithi117.stdout:2/575: creat d0/d12/d32/da4/fdc x:0 0 0 2024-09-19T06:40:38.401 INFO:tasks.workunit.client.1.smithi117.stdout:2/576: stat d0/ff 0 2024-09-19T06:40:38.402 INFO:tasks.workunit.client.1.smithi117.stdout:4/755: dread d3/d1b/d7d/f12 [0,4194304] 0 2024-09-19T06:40:38.402 INFO:tasks.workunit.client.0.smithi099.stdout:2/334: dread d1/d2/d5/d13/f1b [4194304,4194304] 0 2024-09-19T06:40:38.403 INFO:tasks.workunit.client.0.smithi099.stdout:5/631: link d3/d16/f74 d3/d16/d2f/d34/d3c/d65/fdf 0 2024-09-19T06:40:38.404 INFO:tasks.workunit.client.1.smithi117.stdout:4/756: mknod d3/d28/d2a/cf9 0 2024-09-19T06:40:38.406 INFO:tasks.workunit.client.0.smithi099.stdout:2/335: write d1/d2/d5/d13/f54 [188763,36273] 0 2024-09-19T06:40:38.407 INFO:tasks.workunit.client.1.smithi117.stdout:2/577: fdatasync d0/d7/d29/d35/d3d/fd7 0 2024-09-19T06:40:38.408 INFO:tasks.workunit.client.0.smithi099.stdout:2/336: chown d1/f15 118967769 1 2024-09-19T06:40:38.408 INFO:tasks.workunit.client.0.smithi099.stdout:7/561: dread d7/fa [0,4194304] 0 2024-09-19T06:40:38.411 INFO:tasks.workunit.client.0.smithi099.stdout:0/437: dwrite d0/db/d13/d37/d3c/d3e/f7c [0,4194304] 0 2024-09-19T06:40:38.412 INFO:tasks.workunit.client.1.smithi117.stdout:2/578: creat d0/d7/d29/d35/fdd x:0 0 0 2024-09-19T06:40:38.412 INFO:tasks.workunit.client.1.smithi117.stdout:2/579: readlink d0/l59 0 2024-09-19T06:40:38.412 INFO:tasks.workunit.client.1.smithi117.stdout:2/580: fsync d0/d7/d29/d35/f6a 0 2024-09-19T06:40:38.413 INFO:tasks.workunit.client.0.smithi099.stdout:7/562: mknod d7/dd/d29/d4e/d53/ccc 0 2024-09-19T06:40:38.418 INFO:tasks.workunit.client.0.smithi099.stdout:0/438: creat d0/db/d27/d5d/d87/f88 x:0 0 0 2024-09-19T06:40:38.420 INFO:tasks.workunit.client.0.smithi099.stdout:7/563: symlink d7/dd/d29/d1f/d45/d48/lcd 0 2024-09-19T06:40:38.420 INFO:tasks.workunit.client.0.smithi099.stdout:6/454: dwrite d1/f9 [0,4194304] 0 2024-09-19T06:40:38.423 INFO:tasks.workunit.client.1.smithi117.stdout:4/757: write d3/db/d20/d35/f70 [4699719,9529] 0 2024-09-19T06:40:38.426 INFO:tasks.workunit.client.0.smithi099.stdout:9/485: dwrite dd/d47/d40/f59 [0,4194304] 0 2024-09-19T06:40:38.426 INFO:tasks.workunit.client.0.smithi099.stdout:7/564: chown d7/dd/d29/l5f 39 1 2024-09-19T06:40:38.427 INFO:tasks.workunit.client.1.smithi117.stdout:2/581: write d0/d7/d29/db0/fc3 [958493,4833] 0 2024-09-19T06:40:38.428 INFO:tasks.workunit.client.0.smithi099.stdout:9/486: symlink dd/d65/l9f 0 2024-09-19T06:40:38.429 INFO:tasks.workunit.client.0.smithi099.stdout:0/439: truncate d0/f2a 1933997 0 2024-09-19T06:40:38.430 INFO:tasks.workunit.client.0.smithi099.stdout:6/455: mknod d1/d5/d24/d2e/d41/c94 0 2024-09-19T06:40:38.431 INFO:tasks.workunit.client.0.smithi099.stdout:9/487: mknod dd/d47/d40/d61/ca0 0 2024-09-19T06:40:38.432 INFO:tasks.workunit.client.1.smithi117.stdout:4/758: dwrite d3/db/d13/f3c [0,4194304] 0 2024-09-19T06:40:38.432 INFO:tasks.workunit.client.1.smithi117.stdout:2/582: mknod d0/d7/d29/d35/dbd/cde 0 2024-09-19T06:40:38.433 INFO:tasks.workunit.client.1.smithi117.stdout:4/759: readlink d3/d28/l34 0 2024-09-19T06:40:38.433 INFO:tasks.workunit.client.0.smithi099.stdout:7/565: rename d7/dd/d29/d1f/d45/f84 to d7/dd/d29/d1f/fce 0 2024-09-19T06:40:38.435 INFO:tasks.workunit.client.1.smithi117.stdout:2/583: rmdir d0/d7/d58/db1 39 2024-09-19T06:40:38.437 INFO:tasks.workunit.client.1.smithi117.stdout:3/611: sync 2024-09-19T06:40:38.437 INFO:tasks.workunit.client.1.smithi117.stdout:6/412: sync 2024-09-19T06:40:38.437 INFO:tasks.workunit.client.1.smithi117.stdout:2/584: write d0/d7/d29/d35/f97 [2816995,32169] 0 2024-09-19T06:40:38.438 INFO:tasks.workunit.client.0.smithi099.stdout:6/456: rmdir d1/d5/d38 39 2024-09-19T06:40:38.438 INFO:tasks.workunit.client.1.smithi117.stdout:4/760: creat d3/d1b/d7d/d51/d95/df4/ffa x:0 0 0 2024-09-19T06:40:38.439 INFO:tasks.workunit.client.0.smithi099.stdout:1/437: dread d0/d17/d24/d75/f77 [0,4194304] 0 2024-09-19T06:40:38.441 INFO:tasks.workunit.client.1.smithi117.stdout:4/761: chown d3/d1b/d63/d84 258 1 2024-09-19T06:40:38.441 INFO:tasks.workunit.client.1.smithi117.stdout:2/585: fdatasync d0/d64/dd9/fcd 0 2024-09-19T06:40:38.441 INFO:tasks.workunit.client.0.smithi099.stdout:9/488: dread dd/d62/f66 [0,4194304] 0 2024-09-19T06:40:38.441 INFO:tasks.workunit.client.0.smithi099.stdout:0/440: link d0/db/d13/f7d d0/d17/d41/f89 0 2024-09-19T06:40:38.443 INFO:tasks.workunit.client.0.smithi099.stdout:4/495: sync 2024-09-19T06:40:38.447 INFO:tasks.workunit.client.1.smithi117.stdout:3/612: dwrite d0/d8/f4c [0,4194304] 0 2024-09-19T06:40:38.448 INFO:tasks.workunit.client.1.smithi117.stdout:6/413: dwrite d1/d5/f51 [0,4194304] 0 2024-09-19T06:40:38.448 INFO:tasks.workunit.client.0.smithi099.stdout:7/566: dread d7/f3f [0,4194304] 0 2024-09-19T06:40:38.448 INFO:tasks.workunit.client.0.smithi099.stdout:0/441: unlink d0/db/f14 0 2024-09-19T06:40:38.449 INFO:tasks.workunit.client.1.smithi117.stdout:3/613: fsync d0/d8/d7f/fad 0 2024-09-19T06:40:38.449 INFO:tasks.workunit.client.1.smithi117.stdout:4/762: symlink d3/db/d20/d4a/d7b/da0/lfb 0 2024-09-19T06:40:38.452 INFO:tasks.workunit.client.1.smithi117.stdout:2/586: rename d0/d7/d1e/d20/dd1 to d0/d12/d2f/d98/dca/ddf 0 2024-09-19T06:40:38.452 INFO:tasks.workunit.client.0.smithi099.stdout:6/457: dwrite d1/f4f [0,4194304] 0 2024-09-19T06:40:38.455 INFO:tasks.workunit.client.0.smithi099.stdout:4/496: read d12/d32/d42/d80/f83 [94250,42709] 0 2024-09-19T06:40:38.456 INFO:tasks.workunit.client.1.smithi117.stdout:3/614: unlink d0/d9/d1c/c4a 0 2024-09-19T06:40:38.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:38 smithi099 ceph-mon[27651]: Updating smithi099:/var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:40:38.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:38 smithi099 ceph-mon[27651]: Updating smithi117:/var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:40:38.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:38 smithi099 ceph-mon[27651]: Updating smithi099:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:40:38.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:38 smithi099 ceph-mon[27651]: Updating smithi117:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:40:38.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:38 smithi099 ceph-mon[27651]: pgmap v17: 65 pgs: 65 active+clean; 1.9 GiB data, 7.2 GiB used, 529 GiB / 536 GiB avail; 62 MiB/s rd, 272 MiB/s wr, 524 op/s 2024-09-19T06:40:38.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:38 smithi099 ceph-mon[27651]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:40:38.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:38 smithi099 ceph-mon[27651]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:40:38.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:38 smithi099 ceph-mon[27651]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:40:38.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:38 smithi099 ceph-mon[27651]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:40:38.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:38 smithi099 ceph-mon[27651]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:40:38.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:38 smithi099 ceph-mon[27651]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:40:38.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:38 smithi099 ceph-mon[27651]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:40:38.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:38 smithi099 ceph-mon[27651]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:40:38.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:38 smithi099 ceph-mon[27651]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:40:38.458 INFO:tasks.workunit.client.1.smithi117.stdout:4/763: dwrite d3/db/f47 [0,4194304] 0 2024-09-19T06:40:38.459 INFO:tasks.workunit.client.1.smithi117.stdout:2/587: mknod d0/d7/d29/ce0 0 2024-09-19T06:40:38.460 INFO:tasks.workunit.client.1.smithi117.stdout:3/615: mkdir d0/d8/d7f/dbf 0 2024-09-19T06:40:38.461 INFO:tasks.workunit.client.0.smithi099.stdout:6/458: rmdir d1/d5/d24/d2e/d7b 39 2024-09-19T06:40:38.463 INFO:tasks.workunit.client.1.smithi117.stdout:3/616: fdatasync d0/d9/d4e/f98 0 2024-09-19T06:40:38.466 INFO:tasks.workunit.client.1.smithi117.stdout:3/617: dread - d0/d3d/d48/d77/fb2 zero size 2024-09-19T06:40:38.466 INFO:tasks.workunit.client.1.smithi117.stdout:4/764: dwrite d3/d1b/d7d/f4b [0,4194304] 0 2024-09-19T06:40:38.467 INFO:tasks.workunit.client.0.smithi099.stdout:4/497: symlink d12/d32/d39/la8 0 2024-09-19T06:40:38.468 INFO:tasks.workunit.client.1.smithi117.stdout:6/414: truncate d1/d5/f51 3151295 0 2024-09-19T06:40:38.470 INFO:tasks.workunit.client.1.smithi117.stdout:6/415: dread - d1/d14/f4c zero size 2024-09-19T06:40:38.474 INFO:tasks.workunit.client.0.smithi099.stdout:9/489: dwrite dd/d47/f83 [4194304,4194304] 0 2024-09-19T06:40:38.474 INFO:tasks.workunit.client.1.smithi117.stdout:2/588: dwrite d0/d7/d1e/d20/f48 [4194304,4194304] 0 2024-09-19T06:40:38.475 INFO:tasks.workunit.client.0.smithi099.stdout:0/442: dwrite d0/d17/d41/f49 [0,4194304] 0 2024-09-19T06:40:38.478 INFO:tasks.workunit.client.1.smithi117.stdout:6/416: mkdir d1/d5/d8/d5e/d6d 0 2024-09-19T06:40:38.479 INFO:tasks.workunit.client.0.smithi099.stdout:1/438: dwrite d0/d12/d13/d37/f3f [4194304,4194304] 0 2024-09-19T06:40:38.479 INFO:tasks.workunit.client.1.smithi117.stdout:6/417: chown d1/d3/f4b 2951 1 2024-09-19T06:40:38.480 INFO:tasks.workunit.client.0.smithi099.stdout:6/459: mknod d1/d5/d24/d2b/d86/c95 0 2024-09-19T06:40:38.484 INFO:tasks.workunit.client.1.smithi117.stdout:4/765: link d3/db/f3a d3/db/d20/d4a/d7b/da0/ffc 0 2024-09-19T06:40:38.485 INFO:tasks.workunit.client.1.smithi117.stdout:6/418: mknod d1/d14/c6e 0 2024-09-19T06:40:38.488 INFO:tasks.workunit.client.1.smithi117.stdout:0/443: sync 2024-09-19T06:40:38.489 INFO:tasks.workunit.client.1.smithi117.stdout:4/766: truncate d3/d4/f40 565886 0 2024-09-19T06:40:38.491 INFO:tasks.workunit.client.1.smithi117.stdout:0/444: dread - d11/d13/d14/d2c/f8b zero size 2024-09-19T06:40:38.493 INFO:tasks.workunit.client.0.smithi099.stdout:0/443: creat d0/db/d36/d3f/f8a x:0 0 0 2024-09-19T06:40:38.493 INFO:tasks.workunit.client.1.smithi117.stdout:0/445: fsync d11/d13/d28/f7f 0 2024-09-19T06:40:38.494 INFO:tasks.workunit.client.1.smithi117.stdout:0/446: readlink lf 0 2024-09-19T06:40:38.496 INFO:tasks.workunit.client.1.smithi117.stdout:1/556: sync 2024-09-19T06:40:38.496 INFO:tasks.workunit.client.1.smithi117.stdout:8/625: sync 2024-09-19T06:40:38.496 INFO:tasks.workunit.client.1.smithi117.stdout:9/576: sync 2024-09-19T06:40:38.496 INFO:tasks.workunit.client.1.smithi117.stdout:0/447: chown d11/d13/d1b/d27/d37/l3d 1339 1 2024-09-19T06:40:38.496 INFO:tasks.workunit.client.1.smithi117.stdout:7/615: sync 2024-09-19T06:40:38.496 INFO:tasks.workunit.client.1.smithi117.stdout:5/643: sync 2024-09-19T06:40:38.497 INFO:tasks.workunit.client.0.smithi099.stdout:1/439: truncate d0/f1a 1463881 0 2024-09-19T06:40:38.497 INFO:tasks.workunit.client.0.smithi099.stdout:6/460: getdents d1/d5/d52 0 2024-09-19T06:40:38.498 INFO:tasks.workunit.client.0.smithi099.stdout:1/440: chown d0/d17/d32/f4d 833068717 1 2024-09-19T06:40:38.500 INFO:tasks.workunit.client.0.smithi099.stdout:6/461: symlink d1/d5/d24/d2e/d41/d4e/d54/l96 0 2024-09-19T06:40:38.502 INFO:tasks.workunit.client.1.smithi117.stdout:5/644: chown d17/d1b/d5d/d86/fc5 25153 1 2024-09-19T06:40:38.503 INFO:tasks.workunit.client.0.smithi099.stdout:0/444: creat d0/db/d27/f8b x:0 0 0 2024-09-19T06:40:38.503 INFO:tasks.workunit.client.1.smithi117.stdout:1/557: symlink d3/d8e/db4/lc0 0 2024-09-19T06:40:38.504 INFO:tasks.workunit.client.0.smithi099.stdout:7/567: dread d7/dd/d29/f33 [4194304,4194304] 0 2024-09-19T06:40:38.505 INFO:tasks.workunit.client.1.smithi117.stdout:5/645: chown d17/d1b/d3a/d3c/d46/cba 1006 1 2024-09-19T06:40:38.506 INFO:tasks.workunit.client.1.smithi117.stdout:9/577: getdents d4/d1c/d7a/d16 0 2024-09-19T06:40:38.507 INFO:tasks.workunit.client.1.smithi117.stdout:1/558: symlink d3/d18/d97/lc1 0 2024-09-19T06:40:38.507 INFO:tasks.workunit.client.1.smithi117.stdout:9/578: stat d4/f44 0 2024-09-19T06:40:38.508 INFO:tasks.workunit.client.0.smithi099.stdout:7/568: truncate d7/ff 522737 0 2024-09-19T06:40:38.509 INFO:tasks.workunit.client.0.smithi099.stdout:6/462: getdents d1/d5/d24 0 2024-09-19T06:40:38.509 INFO:tasks.workunit.client.1.smithi117.stdout:6/419: dread d1/f3c [0,4194304] 0 2024-09-19T06:40:38.509 INFO:tasks.workunit.client.1.smithi117.stdout:5/646: truncate d17/d2e/d65/fc1 310404 0 2024-09-19T06:40:38.510 INFO:tasks.workunit.client.1.smithi117.stdout:9/579: creat d4/d58/fc3 x:0 0 0 2024-09-19T06:40:38.512 INFO:tasks.workunit.client.1.smithi117.stdout:6/420: write d1/d14/f15 [1116033,31531] 0 2024-09-19T06:40:38.513 INFO:tasks.workunit.client.1.smithi117.stdout:5/647: write d17/d1b/d3a/f68 [2996885,106302] 0 2024-09-19T06:40:38.514 INFO:tasks.workunit.client.1.smithi117.stdout:9/580: unlink d4/d1c/d7a/f2f 0 2024-09-19T06:40:38.515 INFO:tasks.workunit.client.0.smithi099.stdout:7/569: rename d7/dd to d7/dcf 0 2024-09-19T06:40:38.516 INFO:tasks.workunit.client.1.smithi117.stdout:1/559: creat d3/d18/d23/fc2 x:0 0 0 2024-09-19T06:40:38.517 INFO:tasks.workunit.client.1.smithi117.stdout:3/618: dread d0/f63 [0,4194304] 0 2024-09-19T06:40:38.518 INFO:tasks.workunit.client.1.smithi117.stdout:9/581: creat d4/d1c/d73/d9a/fc4 x:0 0 0 2024-09-19T06:40:38.519 INFO:tasks.workunit.client.0.smithi099.stdout:4/498: write f11 [905933,54008] 0 2024-09-19T06:40:38.520 INFO:tasks.workunit.client.1.smithi117.stdout:1/560: mknod d3/d18/d56/cc3 0 2024-09-19T06:40:38.522 INFO:tasks.workunit.client.0.smithi099.stdout:9/490: write dd/fe [4442173,15682] 0 2024-09-19T06:40:38.522 INFO:tasks.workunit.client.1.smithi117.stdout:1/561: stat d3/d18/d23/d74 0 2024-09-19T06:40:38.523 INFO:tasks.workunit.client.1.smithi117.stdout:5/648: rename d17/d1b/d3a/d3c/c5e to d17/d5c/cd3 0 2024-09-19T06:40:38.524 INFO:tasks.workunit.client.0.smithi099.stdout:9/491: write dd/d2c/d5c/f73 [294797,31111] 0 2024-09-19T06:40:38.524 INFO:tasks.workunit.client.1.smithi117.stdout:2/589: dread d0/d7/d1e/f31 [0,4194304] 0 2024-09-19T06:40:38.525 INFO:tasks.workunit.client.1.smithi117.stdout:1/562: write d3/d18/d23/d74/fb7 [330854,11003] 0 2024-09-19T06:40:38.526 INFO:tasks.workunit.client.1.smithi117.stdout:2/590: fdatasync d0/d64/dd9/fcd 0 2024-09-19T06:40:38.527 INFO:tasks.workunit.client.1.smithi117.stdout:9/582: symlink d4/d1c/d7a/d52/lc5 0 2024-09-19T06:40:38.528 INFO:tasks.workunit.client.0.smithi099.stdout:4/499: dwrite d12/f7e [0,4194304] 0 2024-09-19T06:40:38.528 INFO:tasks.workunit.client.1.smithi117.stdout:9/583: dread - d4/d1c/d7a/f64 zero size 2024-09-19T06:40:38.530 INFO:tasks.workunit.client.1.smithi117.stdout:3/619: creat d0/fc0 x:0 0 0 2024-09-19T06:40:38.531 INFO:tasks.workunit.client.1.smithi117.stdout:3/620: chown d0/d19/ca9 22 1 2024-09-19T06:40:38.532 INFO:tasks.workunit.client.1.smithi117.stdout:4/767: truncate d3/d4/f40 680995 0 2024-09-19T06:40:38.532 INFO:tasks.workunit.client.1.smithi117.stdout:3/621: fsync d0/d9/d1c/f28 0 2024-09-19T06:40:38.534 INFO:tasks.workunit.client.1.smithi117.stdout:1/563: mknod d3/d18/d23/d74/d89/cc4 0 2024-09-19T06:40:38.535 INFO:tasks.workunit.client.0.smithi099.stdout:9/492: dwrite dd/d2c/d5c/d64/f82 [0,4194304] 0 2024-09-19T06:40:38.535 INFO:tasks.workunit.client.1.smithi117.stdout:0/448: dread d11/f63 [0,4194304] 0 2024-09-19T06:40:38.536 INFO:tasks.workunit.client.0.smithi099.stdout:4/500: mkdir d12/d1b/d73/d81/d8a/da9 0 2024-09-19T06:40:38.536 INFO:tasks.workunit.client.1.smithi117.stdout:1/564: fsync d3/d22/f33 0 2024-09-19T06:40:38.537 INFO:tasks.workunit.client.0.smithi099.stdout:9/493: write dd/d47/f38 [184456,32299] 0 2024-09-19T06:40:38.539 INFO:tasks.workunit.client.1.smithi117.stdout:7/616: dwrite d1/d4a/d81/d48/d5f/d82/fc3 [0,4194304] 0 2024-09-19T06:40:38.539 INFO:tasks.workunit.client.1.smithi117.stdout:0/449: write d11/d13/d14/d2c/f36 [365275,49568] 0 2024-09-19T06:40:38.540 INFO:tasks.workunit.client.1.smithi117.stdout:9/584: stat d4/d1c/c56 0 2024-09-19T06:40:38.540 INFO:tasks.workunit.client.0.smithi099.stdout:1/441: truncate d0/d12/d13/f2b 8088604 0 2024-09-19T06:40:38.540 INFO:tasks.workunit.client.0.smithi099.stdout:7/570: write d7/f26 [397518,32078] 0 2024-09-19T06:40:38.543 INFO:tasks.workunit.client.0.smithi099.stdout:6/463: truncate d1/d5/d24/d2e/d41/d4e/f6d 803963 0 2024-09-19T06:40:38.543 INFO:tasks.workunit.client.1.smithi117.stdout:6/421: write d1/d3/f12 [660926,45910] 0 2024-09-19T06:40:38.545 INFO:tasks.workunit.client.1.smithi117.stdout:3/622: symlink d0/d9/d4e/lc1 0 2024-09-19T06:40:38.545 INFO:tasks.workunit.client.1.smithi117.stdout:2/591: getdents d0/d12/d2f/d98/dd2 0 2024-09-19T06:40:38.546 INFO:tasks.workunit.client.0.smithi099.stdout:1/442: creat d0/d12/d13/d37/d41/d78/f8f x:0 0 0 2024-09-19T06:40:38.546 INFO:tasks.workunit.client.0.smithi099.stdout:4/501: mknod d12/d32/d42/d5c/d9d/caa 0 2024-09-19T06:40:38.547 INFO:tasks.workunit.client.1.smithi117.stdout:2/592: fsync d0/d7/d29/d35/dbd/fb8 0 2024-09-19T06:40:38.548 INFO:tasks.workunit.client.1.smithi117.stdout:2/593: write d0/d12/d32/f4b [3809714,15564] 0 2024-09-19T06:40:38.548 INFO:tasks.workunit.client.0.smithi099.stdout:7/571: creat d7/dcf/d97/fd0 x:0 0 0 2024-09-19T06:40:38.549 INFO:tasks.workunit.client.1.smithi117.stdout:5/649: link cc d17/d2e/d65/d88/cd4 0 2024-09-19T06:40:38.550 INFO:tasks.workunit.client.0.smithi099.stdout:1/443: creat d0/d17/d24/d75/f90 x:0 0 0 2024-09-19T06:40:38.551 INFO:tasks.workunit.client.1.smithi117.stdout:6/422: fsync d1/d5/f51 0 2024-09-19T06:40:38.551 INFO:tasks.workunit.client.0.smithi099.stdout:1/444: chown d0/f71 0 1 2024-09-19T06:40:38.551 INFO:tasks.workunit.client.0.smithi099.stdout:6/464: link d1/f72 d1/d5/d24/d2e/d41/d4e/f97 0 2024-09-19T06:40:38.552 INFO:tasks.workunit.client.1.smithi117.stdout:9/585: mkdir d4/d1c/d7a/d52/d8d/dc1/dc6 0 2024-09-19T06:40:38.553 INFO:tasks.workunit.client.0.smithi099.stdout:7/572: unlink d7/f4d 0 2024-09-19T06:40:38.553 INFO:tasks.workunit.client.1.smithi117.stdout:4/768: creat d3/d1b/ffd x:0 0 0 2024-09-19T06:40:38.553 INFO:tasks.workunit.client.1.smithi117.stdout:7/617: readlink d1/d4a/d81/d24/d26/l60 0 2024-09-19T06:40:38.554 INFO:tasks.workunit.client.0.smithi099.stdout:6/465: unlink d1/d5/l73 0 2024-09-19T06:40:38.555 INFO:tasks.workunit.client.0.smithi099.stdout:7/573: truncate d7/dcf/d29/d4e/d53/fac 704849 0 2024-09-19T06:40:38.556 INFO:tasks.workunit.client.1.smithi117.stdout:1/565: creat d3/fc5 x:0 0 0 2024-09-19T06:40:38.556 INFO:tasks.workunit.client.1.smithi117.stdout:6/423: mkdir d1/d3d/d6f 0 2024-09-19T06:40:38.557 INFO:tasks.workunit.client.1.smithi117.stdout:0/450: creat d11/d13/d28/f92 x:0 0 0 2024-09-19T06:40:38.558 INFO:tasks.workunit.client.1.smithi117.stdout:2/594: symlink d0/d7/d1e/d20/dbc/le1 0 2024-09-19T06:40:38.559 INFO:tasks.workunit.client.1.smithi117.stdout:6/424: dread - d1/d5/d32/d45/f53 zero size 2024-09-19T06:40:38.559 INFO:tasks.workunit.client.0.smithi099.stdout:4/502: dread d12/d82/f8f [0,4194304] 0 2024-09-19T06:40:38.560 INFO:tasks.workunit.client.0.smithi099.stdout:6/466: rename d1/d5/d24/d2e/d41/d4e/c7f to d1/d5/d24/d2e/d41/d4e/d54/d5d/c98 0 2024-09-19T06:40:38.561 INFO:tasks.workunit.client.1.smithi117.stdout:4/769: rename d3/db/d20/d4a/cec to d3/db/d20/d29/d39/cfe 0 2024-09-19T06:40:38.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:38 smithi117 ceph-mon[34564]: Updating smithi099:/var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:40:38.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:38 smithi117 ceph-mon[34564]: Updating smithi117:/var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:40:38.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:38 smithi117 ceph-mon[34564]: Updating smithi099:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:40:38.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:38 smithi117 ceph-mon[34564]: Updating smithi117:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:40:38.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:38 smithi117 ceph-mon[34564]: pgmap v17: 65 pgs: 65 active+clean; 1.9 GiB data, 7.2 GiB used, 529 GiB / 536 GiB avail; 62 MiB/s rd, 272 MiB/s wr, 524 op/s 2024-09-19T06:40:38.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:38 smithi117 ceph-mon[34564]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:40:38.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:38 smithi117 ceph-mon[34564]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:40:38.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:38 smithi117 ceph-mon[34564]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:40:38.563 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:38 smithi117 ceph-mon[34564]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:40:38.563 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:38 smithi117 ceph-mon[34564]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:40:38.563 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:38 smithi117 ceph-mon[34564]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:40:38.563 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:38 smithi117 ceph-mon[34564]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:40:38.563 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:38 smithi117 ceph-mon[34564]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:40:38.563 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:38 smithi117 ceph-mon[34564]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:40:38.563 INFO:tasks.workunit.client.1.smithi117.stdout:1/566: rename d3/d18 to d3/d18/d23/d74/d89/d9f/dc6 22 2024-09-19T06:40:38.564 INFO:tasks.workunit.client.1.smithi117.stdout:9/586: symlink d4/d1c/d7a/d52/d8d/dc1/dc6/lc7 0 2024-09-19T06:40:38.564 INFO:tasks.workunit.client.1.smithi117.stdout:9/587: stat d4/d8 0 2024-09-19T06:40:38.564 INFO:tasks.workunit.client.0.smithi099.stdout:4/503: mkdir d12/d1b/d73/d81/d9b/dab 0 2024-09-19T06:40:38.565 INFO:tasks.workunit.client.0.smithi099.stdout:4/504: chown d12/f1a 41 1 2024-09-19T06:40:38.566 INFO:tasks.workunit.client.0.smithi099.stdout:4/505: chown d12/d1b/d73/d81 624698 1 2024-09-19T06:40:38.566 INFO:tasks.workunit.client.0.smithi099.stdout:0/445: write d0/f2a [2126608,43262] 0 2024-09-19T06:40:38.566 INFO:tasks.workunit.client.1.smithi117.stdout:2/595: creat d0/d12/d32/da4/fe2 x:0 0 0 2024-09-19T06:40:38.568 INFO:tasks.workunit.client.1.smithi117.stdout:0/451: creat d11/d13/d14/d2c/d35/d3e/f93 x:0 0 0 2024-09-19T06:40:38.570 INFO:tasks.workunit.client.1.smithi117.stdout:0/452: dread - d11/d13/d14/d2c/d35/d3e/f74 zero size 2024-09-19T06:40:38.570 INFO:tasks.workunit.client.0.smithi099.stdout:6/467: dwrite d1/f1d [0,4194304] 0 2024-09-19T06:40:38.571 INFO:tasks.workunit.client.0.smithi099.stdout:4/506: symlink d12/d32/lac 0 2024-09-19T06:40:38.571 INFO:tasks.workunit.client.1.smithi117.stdout:1/567: mknod d3/d18/d23/d74/d89/d9f/cc7 0 2024-09-19T06:40:38.572 INFO:tasks.workunit.client.0.smithi099.stdout:6/468: dread - d1/d5/d24/d2e/d41/f8d zero size 2024-09-19T06:40:38.573 INFO:tasks.workunit.client.0.smithi099.stdout:9/494: dread dd/f60 [0,4194304] 0 2024-09-19T06:40:38.574 INFO:tasks.workunit.client.0.smithi099.stdout:0/446: creat d0/db/d13/d1f/d4a/d61/f8c x:0 0 0 2024-09-19T06:40:38.574 INFO:tasks.workunit.client.0.smithi099.stdout:1/445: truncate d0/d17/d32/f4d 292220 0 2024-09-19T06:40:38.575 INFO:tasks.workunit.client.1.smithi117.stdout:9/588: truncate d4/d1c/d36/f4f 1196361 0 2024-09-19T06:40:38.575 INFO:tasks.workunit.client.0.smithi099.stdout:4/507: rmdir d12/d1b/da4 39 2024-09-19T06:40:38.576 INFO:tasks.workunit.client.1.smithi117.stdout:5/650: getdents d17/d1b/d3a/d3c/d70/d94 0 2024-09-19T06:40:38.577 INFO:tasks.workunit.client.0.smithi099.stdout:1/446: chown d0/d17/d5b/c5c 0 1 2024-09-19T06:40:38.577 INFO:tasks.workunit.client.1.smithi117.stdout:9/589: write d4/d1c/d7a/f64 [723689,56525] 0 2024-09-19T06:40:38.577 INFO:tasks.workunit.client.1.smithi117.stdout:2/596: stat d0/d7/d29/d35/d3d/d72/c6c 0 2024-09-19T06:40:38.579 INFO:tasks.workunit.client.0.smithi099.stdout:6/469: unlink d1/d5/l29 0 2024-09-19T06:40:38.580 INFO:tasks.workunit.client.1.smithi117.stdout:2/597: dread - d0/d12/d2f/f45 zero size 2024-09-19T06:40:38.580 INFO:tasks.workunit.client.1.smithi117.stdout:7/618: link d1/d4a/d81/d24/d26/d44/f68 d1/d4a/d81/d48/d5f/d82/fd9 0 2024-09-19T06:40:38.581 INFO:tasks.workunit.client.0.smithi099.stdout:9/495: creat dd/d2c/d5c/d64/d93/fa1 x:0 0 0 2024-09-19T06:40:38.581 INFO:tasks.workunit.client.1.smithi117.stdout:9/590: mkdir d4/d8/d6a/d82/dc8 0 2024-09-19T06:40:38.582 INFO:tasks.workunit.client.1.smithi117.stdout:2/598: chown d0/d12/d32/d7d/fa3 796082 1 2024-09-19T06:40:38.584 INFO:tasks.workunit.client.1.smithi117.stdout:1/568: rename d3/d8e/db4/lc0 to d3/d18/d91/lc8 0 2024-09-19T06:40:38.585 INFO:tasks.workunit.client.1.smithi117.stdout:0/453: link d11/d13/d14/d16/f1a d11/d13/d1b/f94 0 2024-09-19T06:40:38.585 INFO:tasks.workunit.client.1.smithi117.stdout:9/591: rmdir d4/d1c/d7a/d16 39 2024-09-19T06:40:38.586 INFO:tasks.workunit.client.1.smithi117.stdout:0/454: dread - d11/d13/d14/d2c/d35/d3e/f93 zero size 2024-09-19T06:40:38.588 INFO:tasks.workunit.client.1.smithi117.stdout:0/455: stat d11/d13/d14/d2c/f36 0 2024-09-19T06:40:38.590 INFO:tasks.workunit.client.1.smithi117.stdout:9/592: creat d4/d8/d6e/da4/fc9 x:0 0 0 2024-09-19T06:40:38.594 INFO:tasks.workunit.client.1.smithi117.stdout:0/456: rename d11/d13/d14/d2c/d53/f65 to d11/d13/d1b/d27/d37/d6d/f95 0 2024-09-19T06:40:38.653 INFO:tasks.workunit.client.0.smithi099.stdout:7/574: dwrite d7/dc7/f9b [0,4194304] 0 2024-09-19T06:40:38.658 INFO:tasks.workunit.client.0.smithi099.stdout:0/447: rename d0/db/d36/f76 to d0/db/f8d 0 2024-09-19T06:40:38.658 INFO:tasks.workunit.client.0.smithi099.stdout:1/447: dwrite d0/f7d [0,4194304] 0 2024-09-19T06:40:38.659 INFO:tasks.workunit.client.0.smithi099.stdout:6/470: truncate d1/d5/d24/d2b/f45 108400 0 2024-09-19T06:40:38.663 INFO:tasks.workunit.client.0.smithi099.stdout:0/448: truncate d0/db/d27/f83 178471 0 2024-09-19T06:40:38.664 INFO:tasks.workunit.client.0.smithi099.stdout:9/496: write dd/d47/d40/f3f [4750677,91942] 0 2024-09-19T06:40:38.665 INFO:tasks.workunit.client.0.smithi099.stdout:7/575: dwrite d7/dcf/d29/d34/da1/fbb [0,4194304] 0 2024-09-19T06:40:38.666 INFO:tasks.workunit.client.0.smithi099.stdout:9/497: write dd/d47/f5f [4595410,55254] 0 2024-09-19T06:40:38.666 INFO:tasks.workunit.client.0.smithi099.stdout:6/471: read d1/d5/d24/d2b/f74 [283129,76483] 0 2024-09-19T06:40:38.668 INFO:tasks.workunit.client.0.smithi099.stdout:7/576: stat d7/dcf/d29/d1f/d45/d48/f7e 0 2024-09-19T06:40:38.668 INFO:tasks.workunit.client.0.smithi099.stdout:0/449: unlink d0/db/d13/d1f/d39/f4f 0 2024-09-19T06:40:38.669 INFO:tasks.workunit.client.0.smithi099.stdout:9/498: symlink dd/d62/d78/la2 0 2024-09-19T06:40:38.669 INFO:tasks.workunit.client.0.smithi099.stdout:7/577: write d7/f41 [1058060,102330] 0 2024-09-19T06:40:38.671 INFO:tasks.workunit.client.0.smithi099.stdout:6/472: fdatasync d1/d5/d38/d76/f90 0 2024-09-19T06:40:38.674 INFO:tasks.workunit.client.0.smithi099.stdout:9/499: mkdir dd/d65/da3 0 2024-09-19T06:40:38.678 INFO:tasks.workunit.client.0.smithi099.stdout:6/473: link d1/d5/d24/d2e/d41/l4d d1/d12/l99 0 2024-09-19T06:40:38.679 INFO:tasks.workunit.client.0.smithi099.stdout:0/450: dwrite d0/d17/d41/f3d [4194304,4194304] 0 2024-09-19T06:40:38.679 INFO:tasks.workunit.client.0.smithi099.stdout:9/500: read dd/d2c/f54 [81386,98086] 0 2024-09-19T06:40:38.681 INFO:tasks.workunit.client.0.smithi099.stdout:1/448: truncate d0/f29 2855740 0 2024-09-19T06:40:38.683 INFO:tasks.workunit.client.0.smithi099.stdout:0/451: mkdir d0/db/d13/d1f/d8e 0 2024-09-19T06:40:38.688 INFO:tasks.workunit.client.0.smithi099.stdout:1/449: rename d0/d17/d32/c3b to d0/d68/c91 0 2024-09-19T06:40:38.691 INFO:tasks.workunit.client.0.smithi099.stdout:0/452: getdents d0/db/d13/d1f/d3a 0 2024-09-19T06:40:38.694 INFO:tasks.workunit.client.0.smithi099.stdout:6/474: write d1/f72 [835455,15349] 0 2024-09-19T06:40:38.696 INFO:tasks.workunit.client.0.smithi099.stdout:9/501: write dd/d62/d78/f7b [4725766,128068] 0 2024-09-19T06:40:38.697 INFO:tasks.workunit.client.0.smithi099.stdout:1/450: dwrite d0/d17/d32/d7b/f84 [0,4194304] 0 2024-09-19T06:40:38.699 INFO:tasks.workunit.client.0.smithi099.stdout:6/475: mkdir d1/d5/d24/d2b/d86/d9a 0 2024-09-19T06:40:38.701 INFO:tasks.workunit.client.0.smithi099.stdout:9/502: mknod dd/d47/ca4 0 2024-09-19T06:40:38.704 INFO:tasks.workunit.client.0.smithi099.stdout:9/503: write dd/d2c/f98 [296232,118178] 0 2024-09-19T06:40:38.706 INFO:tasks.workunit.client.0.smithi099.stdout:0/453: dwrite d0/db/d27/f58 [0,4194304] 0 2024-09-19T06:40:38.709 INFO:tasks.workunit.client.0.smithi099.stdout:6/476: mknod d1/d5/d24/d2e/d41/d4e/d54/d5d/c9b 0 2024-09-19T06:40:38.710 INFO:tasks.workunit.client.0.smithi099.stdout:1/451: rename d0/f6 to d0/d17/d24/d5e/f92 0 2024-09-19T06:40:38.713 INFO:tasks.workunit.client.0.smithi099.stdout:1/452: fsync d0/d12/d13/d37/d48/f7c 0 2024-09-19T06:40:38.713 INFO:tasks.workunit.client.0.smithi099.stdout:6/477: mkdir d1/d5/d24/d2b/d86/d9a/d9c 0 2024-09-19T06:40:38.714 INFO:tasks.workunit.client.0.smithi099.stdout:9/504: creat dd/fa5 x:0 0 0 2024-09-19T06:40:38.714 INFO:tasks.workunit.client.0.smithi099.stdout:1/453: dread - d0/d17/d24/d75/f90 zero size 2024-09-19T06:40:38.716 INFO:tasks.workunit.client.0.smithi099.stdout:6/478: creat d1/d7c/f9d x:0 0 0 2024-09-19T06:40:38.716 INFO:tasks.workunit.client.0.smithi099.stdout:6/479: fsync d1/d12/f5f 0 2024-09-19T06:40:38.717 INFO:tasks.workunit.client.0.smithi099.stdout:9/505: rename dd/d2c/f39 to dd/d65/da3/fa6 0 2024-09-19T06:40:38.719 INFO:tasks.workunit.client.0.smithi099.stdout:6/480: truncate d1/d5/d24/d2e/d41/d4e/f97 1211208 0 2024-09-19T06:40:38.719 INFO:tasks.workunit.client.1.smithi117.stdout:5/651: link d17/d1b/d3a/d3c/d46/l47 d17/d1b/ld5 0 2024-09-19T06:40:38.719 INFO:tasks.workunit.client.1.smithi117.stdout:9/593: dwrite d4/d1c/d36/f6c [8388608,4194304] 0 2024-09-19T06:40:38.720 INFO:tasks.workunit.client.1.smithi117.stdout:4/770: write d3/d41/f69 [1772185,69161] 0 2024-09-19T06:40:38.721 INFO:tasks.workunit.client.0.smithi099.stdout:9/506: symlink dd/d65/da3/la7 0 2024-09-19T06:40:38.721 INFO:tasks.workunit.client.1.smithi117.stdout:2/599: write d0/d12/d32/db5/f4a [1541125,129449] 0 2024-09-19T06:40:38.722 INFO:tasks.workunit.client.0.smithi099.stdout:9/507: truncate dd/d2c/f98 593887 0 2024-09-19T06:40:38.724 INFO:tasks.workunit.client.1.smithi117.stdout:1/569: getdents d3/d18/d23/d74/d89/d9f 0 2024-09-19T06:40:38.725 INFO:tasks.workunit.client.1.smithi117.stdout:2/600: chown d0/d7/d29/d71 329120 1 2024-09-19T06:40:38.725 INFO:tasks.workunit.client.1.smithi117.stdout:9/594: chown d4/d1c/d46/fb3 790369 1 2024-09-19T06:40:38.726 INFO:tasks.workunit.client.0.smithi099.stdout:1/454: getdents d0/d17/d24/d3a 0 2024-09-19T06:40:38.728 INFO:tasks.workunit.client.0.smithi099.stdout:6/481: creat d1/d5/d24/d2e/d41/f9e x:0 0 0 2024-09-19T06:40:38.728 INFO:tasks.workunit.client.0.smithi099.stdout:9/508: fdatasync dd/f37 0 2024-09-19T06:40:38.728 INFO:tasks.workunit.client.1.smithi117.stdout:0/457: dwrite d11/d13/d14/d2c/f8b [0,4194304] 0 2024-09-19T06:40:38.731 INFO:tasks.workunit.client.1.smithi117.stdout:1/570: write d3/d18/d56/fa8 [33231,93185] 0 2024-09-19T06:40:38.731 INFO:tasks.workunit.client.1.smithi117.stdout:2/601: fsync d0/d7/d1e/f31 0 2024-09-19T06:40:38.731 INFO:tasks.workunit.client.0.smithi099.stdout:0/454: dwrite d0/db/d13/d59/f6c [0,4194304] 0 2024-09-19T06:40:38.734 INFO:tasks.workunit.client.0.smithi099.stdout:0/455: write d0/d17/d41/f3d [6931224,33855] 0 2024-09-19T06:40:38.737 INFO:tasks.workunit.client.0.smithi099.stdout:9/509: rmdir dd/d62/d78 39 2024-09-19T06:40:38.737 INFO:tasks.workunit.client.1.smithi117.stdout:0/458: read d11/d13/d14/d2c/f32 [4140933,130375] 0 2024-09-19T06:40:38.738 INFO:tasks.workunit.client.1.smithi117.stdout:2/602: write d0/d12/d2f/f51 [3103734,7405] 0 2024-09-19T06:40:38.738 INFO:tasks.workunit.client.0.smithi099.stdout:0/456: fdatasync d0/f1b 0 2024-09-19T06:40:38.739 INFO:tasks.workunit.client.0.smithi099.stdout:9/510: chown dd/d2c/c4e 3439 1 2024-09-19T06:40:38.740 INFO:tasks.workunit.client.0.smithi099.stdout:6/482: dwrite d1/d5/d24/d2b/f84 [0,4194304] 0 2024-09-19T06:40:38.741 INFO:tasks.workunit.client.1.smithi117.stdout:0/459: readlink d11/d13/d14/d2c/d35/l3b 0 2024-09-19T06:40:38.741 INFO:tasks.workunit.client.1.smithi117.stdout:9/595: dwrite d4/d1c/d46/f6b [0,4194304] 0 2024-09-19T06:40:38.741 INFO:tasks.workunit.client.0.smithi099.stdout:9/511: chown dd/d2c/l43 97747 1 2024-09-19T06:40:38.745 INFO:tasks.workunit.client.1.smithi117.stdout:1/571: write d3/d18/d56/f68 [48426,96037] 0 2024-09-19T06:40:38.745 INFO:tasks.workunit.client.1.smithi117.stdout:4/771: dread d3/db/d23/f54 [0,4194304] 0 2024-09-19T06:40:38.745 INFO:tasks.workunit.client.0.smithi099.stdout:6/483: write d1/d5/d24/d2e/d41/d4e/d2a/f8b [1907564,87003] 0 2024-09-19T06:40:38.746 INFO:tasks.workunit.client.1.smithi117.stdout:2/603: symlink d0/d12/d32/d7d/le3 0 2024-09-19T06:40:38.747 INFO:tasks.workunit.client.1.smithi117.stdout:5/652: truncate d17/d1b/d3a/d3c/d70/f79 1236026 0 2024-09-19T06:40:38.749 INFO:tasks.workunit.client.0.smithi099.stdout:6/484: dread - d1/d5/d24/d2e/f8f zero size 2024-09-19T06:40:38.750 INFO:tasks.workunit.client.1.smithi117.stdout:1/572: rmdir d3/d22/d2f 39 2024-09-19T06:40:38.751 INFO:tasks.workunit.client.0.smithi099.stdout:0/457: rename d0/db/d13/d37/c82 to d0/db/d13/d47/c8f 0 2024-09-19T06:40:38.753 INFO:tasks.workunit.client.0.smithi099.stdout:1/455: write d0/d17/d24/f6a [3207097,53523] 0 2024-09-19T06:40:38.753 INFO:tasks.workunit.client.0.smithi099.stdout:9/512: dwrite dd/d47/d40/f56 [0,4194304] 0 2024-09-19T06:40:38.754 INFO:tasks.workunit.client.1.smithi117.stdout:9/596: dwrite d4/d8/d6e/da4/fa6 [0,4194304] 0 2024-09-19T06:40:38.758 INFO:tasks.workunit.client.0.smithi099.stdout:1/456: rmdir d0/d12/d13 39 2024-09-19T06:40:38.758 INFO:tasks.workunit.client.1.smithi117.stdout:0/460: link d11/d13/d14/d2c/f32 d11/f96 0 2024-09-19T06:40:38.760 INFO:tasks.workunit.client.0.smithi099.stdout:1/457: chown d0/d17/d5b/l8e 261940 1 2024-09-19T06:40:38.760 INFO:tasks.workunit.client.1.smithi117.stdout:9/597: truncate d4/f51 1193113 0 2024-09-19T06:40:38.762 INFO:tasks.workunit.client.1.smithi117.stdout:0/461: mknod d11/d13/d1b/d4b/c97 0 2024-09-19T06:40:38.762 INFO:tasks.workunit.client.0.smithi099.stdout:0/458: mknod d0/db/d13/d1f/d39/c90 0 2024-09-19T06:40:38.762 INFO:tasks.workunit.client.0.smithi099.stdout:6/485: dwrite d1/f1d [0,4194304] 0 2024-09-19T06:40:38.763 INFO:tasks.workunit.client.1.smithi117.stdout:4/772: dwrite d3/db/d20/d29/d39/d4f/f72 [4194304,4194304] 0 2024-09-19T06:40:38.765 INFO:tasks.workunit.client.1.smithi117.stdout:5/653: getdents d17/d1b/d3a 0 2024-09-19T06:40:38.765 INFO:tasks.workunit.client.1.smithi117.stdout:9/598: stat d4/d1c/d7a/l40 0 2024-09-19T06:40:38.766 INFO:tasks.workunit.client.1.smithi117.stdout:4/773: write d3/db/d20/d29/d39/d4f/f72 [6148273,16660] 0 2024-09-19T06:40:38.768 INFO:tasks.workunit.client.1.smithi117.stdout:5/654: symlink d17/d2e/da6/ld6 0 2024-09-19T06:40:38.768 INFO:tasks.workunit.client.0.smithi099.stdout:0/459: unlink d0/db/d13/d1f/f5a 0 2024-09-19T06:40:38.769 INFO:tasks.workunit.client.1.smithi117.stdout:1/573: dread d3/d18/d23/d74/fb7 [0,4194304] 0 2024-09-19T06:40:38.770 INFO:tasks.workunit.client.0.smithi099.stdout:0/460: write d0/db/d13/d1f/d39/f63 [1299157,55645] 0 2024-09-19T06:40:38.771 INFO:tasks.workunit.client.1.smithi117.stdout:4/774: read d3/d28/fb0 [919408,18485] 0 2024-09-19T06:40:38.772 INFO:tasks.workunit.client.0.smithi099.stdout:0/461: fdatasync d0/db/d27/f83 0 2024-09-19T06:40:38.773 INFO:tasks.workunit.client.1.smithi117.stdout:4/775: chown d3/db/d20/d35/d79/dd4 495 1 2024-09-19T06:40:38.774 INFO:tasks.workunit.client.0.smithi099.stdout:6/486: dwrite d1/d5/d24/d2e/f31 [0,4194304] 0 2024-09-19T06:40:38.774 INFO:tasks.workunit.client.1.smithi117.stdout:1/574: symlink d3/da1/db1/lc9 0 2024-09-19T06:40:38.777 INFO:tasks.workunit.client.1.smithi117.stdout:9/599: creat d4/d8/d6a/d82/dc8/fca x:0 0 0 2024-09-19T06:40:38.778 INFO:tasks.workunit.client.0.smithi099.stdout:6/487: rmdir d1/d5/d24/d2e/d41/d4e 39 2024-09-19T06:40:38.779 INFO:tasks.workunit.client.1.smithi117.stdout:4/776: stat d3/db/d20/d29/la9 0 2024-09-19T06:40:38.780 INFO:tasks.workunit.client.1.smithi117.stdout:1/575: dread - d3/d18/d23/d74/d89/d9f/fbb zero size 2024-09-19T06:40:38.780 INFO:tasks.workunit.client.1.smithi117.stdout:5/655: creat d17/d2f/d3b/daf/fd7 x:0 0 0 2024-09-19T06:40:38.782 INFO:tasks.workunit.client.0.smithi099.stdout:0/462: dwrite d0/db/fc [0,4194304] 0 2024-09-19T06:40:38.783 INFO:tasks.workunit.client.1.smithi117.stdout:0/462: dwrite d11/d13/d1b/d27/f55 [0,4194304] 0 2024-09-19T06:40:38.787 INFO:tasks.workunit.client.0.smithi099.stdout:0/463: chown d0/d17/l31 14 1 2024-09-19T06:40:38.787 INFO:tasks.workunit.client.1.smithi117.stdout:1/576: creat d3/d8e/fca x:0 0 0 2024-09-19T06:40:38.789 INFO:tasks.workunit.client.1.smithi117.stdout:4/777: fdatasync d3/d28/d2a/f5e 0 2024-09-19T06:40:38.789 INFO:tasks.workunit.client.1.smithi117.stdout:1/577: dread - d3/d22/f7c zero size 2024-09-19T06:40:38.791 INFO:tasks.workunit.client.0.smithi099.stdout:0/464: rmdir d0/db/d27/d5d/d87 39 2024-09-19T06:40:38.794 INFO:tasks.workunit.client.1.smithi117.stdout:5/656: creat d17/d1b/d3a/d3c/fd8 x:0 0 0 2024-09-19T06:40:38.794 INFO:tasks.workunit.client.0.smithi099.stdout:0/465: mkdir d0/db/d36/d3f/d91 0 2024-09-19T06:40:38.795 INFO:tasks.workunit.client.1.smithi117.stdout:4/778: fdatasync d3/d65/d66/dce/fda 0 2024-09-19T06:40:38.795 INFO:tasks.workunit.client.1.smithi117.stdout:2/604: dwrite d0/f6 [0,4194304] 0 2024-09-19T06:40:38.795 INFO:tasks.workunit.client.0.smithi099.stdout:0/466: readlink d0/db/d13/d1f/d39/l78 0 2024-09-19T06:40:38.796 INFO:tasks.workunit.client.0.smithi099.stdout:0/467: write d0/db/d13/d1f/d39/f54 [688663,48633] 0 2024-09-19T06:40:38.797 INFO:tasks.workunit.client.1.smithi117.stdout:1/578: creat d3/d8e/db4/fcb x:0 0 0 2024-09-19T06:40:38.797 INFO:tasks.workunit.client.1.smithi117.stdout:9/600: dread d4/d1c/d36/f4f [0,4194304] 0 2024-09-19T06:40:38.798 INFO:tasks.workunit.client.0.smithi099.stdout:0/468: write d0/d17/f84 [628798,53236] 0 2024-09-19T06:40:38.802 INFO:tasks.workunit.client.0.smithi099.stdout:0/469: creat d0/db/d13/d47/f92 x:0 0 0 2024-09-19T06:40:38.804 INFO:tasks.workunit.client.1.smithi117.stdout:0/463: dwrite d11/f63 [4194304,4194304] 0 2024-09-19T06:40:38.805 INFO:tasks.workunit.client.0.smithi099.stdout:0/470: creat d0/db/d36/d3f/f93 x:0 0 0 2024-09-19T06:40:38.806 INFO:tasks.workunit.client.1.smithi117.stdout:9/601: fsync d4/d1c/d36/f77 0 2024-09-19T06:40:38.807 INFO:tasks.workunit.client.0.smithi099.stdout:9/513: write dd/f37 [329770,59150] 0 2024-09-19T06:40:38.808 INFO:tasks.workunit.client.0.smithi099.stdout:8/370: sync 2024-09-19T06:40:38.808 INFO:tasks.workunit.client.0.smithi099.stdout:3/673: sync 2024-09-19T06:40:38.809 INFO:tasks.workunit.client.1.smithi117.stdout:4/779: getdents d3/db/d20/d29 0 2024-09-19T06:40:38.810 INFO:tasks.workunit.client.0.smithi099.stdout:9/514: fdatasync dd/d47/d40/f2e 0 2024-09-19T06:40:38.810 INFO:tasks.workunit.client.0.smithi099.stdout:0/471: mknod d0/db/d27/d5d/c94 0 2024-09-19T06:40:38.810 INFO:tasks.workunit.client.0.smithi099.stdout:3/674: chown d7/f4d 7383802 1 2024-09-19T06:40:38.811 INFO:tasks.workunit.client.1.smithi117.stdout:0/464: symlink d11/d13/d14/d2c/d53/l98 0 2024-09-19T06:40:38.813 INFO:tasks.workunit.client.0.smithi099.stdout:9/515: write dd/d47/d40/f59 [1192897,60437] 0 2024-09-19T06:40:38.815 INFO:tasks.workunit.client.1.smithi117.stdout:1/579: dwrite d3/d18/d56/fa8 [0,4194304] 0 2024-09-19T06:40:38.816 INFO:tasks.workunit.client.1.smithi117.stdout:0/465: unlink d11/d13/d28/f2e 0 2024-09-19T06:40:38.816 INFO:tasks.workunit.client.1.smithi117.stdout:4/780: fsync d3/d1b/d7d/d51/d95/df4/ffa 0 2024-09-19T06:40:38.817 INFO:tasks.workunit.client.1.smithi117.stdout:9/602: dread d4/d1c/d7a/d52/f62 [0,4194304] 0 2024-09-19T06:40:38.818 INFO:tasks.workunit.client.1.smithi117.stdout:2/605: dwrite d0/d7/d29/d35/dbd/d8d/f9d [0,4194304] 0 2024-09-19T06:40:38.819 INFO:tasks.workunit.client.0.smithi099.stdout:3/675: rename d7/d34/d1d/d36/d69/d6d/d8f/faa to d7/d34/d1d/d36/fcf 0 2024-09-19T06:40:38.820 INFO:tasks.workunit.client.1.smithi117.stdout:0/466: chown d11/d13/d14 9865 1 2024-09-19T06:40:38.820 INFO:tasks.workunit.client.1.smithi117.stdout:1/580: chown d3/d18/d56/c6d 250 1 2024-09-19T06:40:38.821 INFO:tasks.workunit.client.0.smithi099.stdout:1/458: write d0/f71 [7435,129552] 0 2024-09-19T06:40:38.823 INFO:tasks.workunit.client.1.smithi117.stdout:4/781: chown d3/f90 56507186 1 2024-09-19T06:40:38.823 INFO:tasks.workunit.client.1.smithi117.stdout:8/626: sync 2024-09-19T06:40:38.824 INFO:tasks.workunit.client.1.smithi117.stdout:3/623: sync 2024-09-19T06:40:38.824 INFO:tasks.workunit.client.0.smithi099.stdout:9/516: rename dd/d47/d40/d61/ca0 to dd/d62/d78/ca8 0 2024-09-19T06:40:38.824 INFO:tasks.workunit.client.0.smithi099.stdout:9/517: chown dd/f34 650 1 2024-09-19T06:40:38.825 INFO:tasks.workunit.client.0.smithi099.stdout:9/518: readlink lc 0 2024-09-19T06:40:38.827 INFO:tasks.workunit.client.1.smithi117.stdout:0/467: unlink d11/d13/d1b/d27/f29 0 2024-09-19T06:40:38.831 INFO:tasks.workunit.client.1.smithi117.stdout:2/606: link d0/d7/fd4 d0/d7/d29/d35/dbd/fe4 0 2024-09-19T06:40:38.831 INFO:tasks.workunit.client.0.smithi099.stdout:6/488: write d1/d12/f1f [1067019,92300] 0 2024-09-19T06:40:38.832 INFO:tasks.workunit.client.1.smithi117.stdout:3/624: mknod d0/d19/d9b/cc2 0 2024-09-19T06:40:38.832 INFO:tasks.workunit.client.0.smithi099.stdout:3/676: dwrite d7/d34/d1d/d36/db8/fcc [0,4194304] 0 2024-09-19T06:40:38.833 INFO:tasks.workunit.client.1.smithi117.stdout:8/627: truncate d1d/d1e/d29/fb4 869533 0 2024-09-19T06:40:38.836 INFO:tasks.workunit.client.1.smithi117.stdout:1/581: dwrite d3/d18/fbe [0,4194304] 0 2024-09-19T06:40:38.836 INFO:tasks.workunit.client.1.smithi117.stdout:2/607: rmdir d0/d12/d32 39 2024-09-19T06:40:38.839 INFO:tasks.workunit.client.1.smithi117.stdout:2/608: write d0/d7/fba [589367,67153] 0 2024-09-19T06:40:38.839 INFO:tasks.workunit.client.0.smithi099.stdout:6/489: symlink d1/d5/d24/d2e/d41/d4e/l9f 0 2024-09-19T06:40:38.840 INFO:tasks.workunit.client.1.smithi117.stdout:1/582: write d3/d18/d23/d51/fa6 [523704,77650] 0 2024-09-19T06:40:38.841 INFO:tasks.workunit.client.1.smithi117.stdout:8/628: symlink d1d/d2a/d3f/d4b/d5f/d95/ld4 0 2024-09-19T06:40:38.843 INFO:tasks.workunit.client.0.smithi099.stdout:8/371: dwrite d4/de/f12 [0,4194304] 0 2024-09-19T06:40:38.846 INFO:tasks.workunit.client.0.smithi099.stdout:0/472: dread d0/db/d13/d1f/d4a/f50 [0,4194304] 0 2024-09-19T06:40:38.847 INFO:tasks.workunit.client.0.smithi099.stdout:6/490: rename d1/d5/d24/d2e/d41 to d1/d5/d24/d2e/d41/d4e/d54/d5d/d61/d65/da0 22 2024-09-19T06:40:38.848 INFO:tasks.workunit.client.1.smithi117.stdout:9/603: write d4/d1c/d36/f77 [888348,20497] 0 2024-09-19T06:40:38.848 INFO:tasks.workunit.client.1.smithi117.stdout:5/657: truncate d17/d2f/d6a/f9f 4125344 0 2024-09-19T06:40:38.848 INFO:tasks.workunit.client.0.smithi099.stdout:8/372: mknod d4/d11/d61/c7e 0 2024-09-19T06:40:38.849 INFO:tasks.workunit.client.0.smithi099.stdout:8/373: stat d4/de/d1c/f6b 0 2024-09-19T06:40:38.850 INFO:tasks.workunit.client.1.smithi117.stdout:9/604: stat d4/d1c/d54/da5 0 2024-09-19T06:40:38.852 INFO:tasks.workunit.client.0.smithi099.stdout:9/519: getdents dd/d47/d40/d61 0 2024-09-19T06:40:38.854 INFO:tasks.workunit.client.0.smithi099.stdout:1/459: truncate d0/d17/d32/d7b/f84 3282728 0 2024-09-19T06:40:38.856 INFO:tasks.workunit.client.1.smithi117.stdout:3/625: dwrite d0/d9/d4e/f7c [0,4194304] 0 2024-09-19T06:40:38.859 INFO:tasks.workunit.client.0.smithi099.stdout:9/520: fsync fa 0 2024-09-19T06:40:38.859 INFO:tasks.workunit.client.0.smithi099.stdout:6/491: mkdir d1/da1 0 2024-09-19T06:40:38.860 INFO:tasks.workunit.client.0.smithi099.stdout:3/677: dwrite d7/f4d [0,4194304] 0 2024-09-19T06:40:38.861 INFO:tasks.workunit.client.0.smithi099.stdout:6/492: chown d1/f72 46695 1 2024-09-19T06:40:38.862 INFO:tasks.workunit.client.1.smithi117.stdout:9/605: creat d4/d20/fcb x:0 0 0 2024-09-19T06:40:38.864 INFO:tasks.workunit.client.1.smithi117.stdout:8/629: dwrite d1d/d1e/d29/fb6 [0,4194304] 0 2024-09-19T06:40:38.865 INFO:tasks.workunit.client.0.smithi099.stdout:0/473: rmdir d0/db/d13/d1f/d39/d5b 0 2024-09-19T06:40:38.874 INFO:tasks.workunit.client.1.smithi117.stdout:3/626: getdents d0/d19 0 2024-09-19T06:40:38.875 INFO:tasks.workunit.client.0.smithi099.stdout:1/460: rename d0/d17/d24/d3a/c88 to d0/d17/d24/d3a/d58/c93 0 2024-09-19T06:40:38.875 INFO:tasks.workunit.client.1.smithi117.stdout:1/583: getdents d3/d22/d2f 0 2024-09-19T06:40:38.877 INFO:tasks.workunit.client.1.smithi117.stdout:9/606: creat d4/d1c/d54/da5/daf/fcc x:0 0 0 2024-09-19T06:40:38.879 INFO:tasks.workunit.client.0.smithi099.stdout:9/521: mkdir dd/d47/d40/da9 0 2024-09-19T06:40:38.879 INFO:tasks.workunit.client.1.smithi117.stdout:3/627: write d0/d9/d4e/d9e/fa4 [811635,123042] 0 2024-09-19T06:40:38.880 INFO:tasks.workunit.client.1.smithi117.stdout:1/584: mkdir d3/da1/dcc 0 2024-09-19T06:40:38.880 INFO:tasks.workunit.client.1.smithi117.stdout:4/782: dread d3/fb6 [0,4194304] 0 2024-09-19T06:40:38.881 INFO:tasks.workunit.client.0.smithi099.stdout:6/493: symlink d1/d5/d24/d2e/d41/d4e/d54/d5d/la2 0 2024-09-19T06:40:38.882 INFO:tasks.workunit.client.0.smithi099.stdout:8/374: getdents d4/d11/d38 0 2024-09-19T06:40:38.883 INFO:tasks.workunit.client.0.smithi099.stdout:8/375: write d4/d11/d23/f4b [1096197,85564] 0 2024-09-19T06:40:38.885 INFO:tasks.workunit.client.1.smithi117.stdout:8/630: rename d1d/d2a/d3f/d4b/l77 to d1d/d2a/d3f/d4b/d5f/dbf/dd0/ld5 0 2024-09-19T06:40:38.885 INFO:tasks.workunit.client.0.smithi099.stdout:0/474: truncate d0/f57 717542 0 2024-09-19T06:40:38.886 INFO:tasks.workunit.client.1.smithi117.stdout:9/607: creat d4/d1c/d36/fcd x:0 0 0 2024-09-19T06:40:38.886 INFO:tasks.workunit.client.1.smithi117.stdout:1/585: rmdir d3/d22 39 2024-09-19T06:40:38.887 INFO:tasks.workunit.client.0.smithi099.stdout:0/475: write d0/db/d13/d1f/d39/f66 [266404,6219] 0 2024-09-19T06:40:38.890 INFO:tasks.workunit.client.1.smithi117.stdout:4/783: mkdir d3/d65/d66/d80/dff 0 2024-09-19T06:40:38.891 INFO:tasks.workunit.client.1.smithi117.stdout:0/468: dread f0 [0,4194304] 0 2024-09-19T06:40:38.891 INFO:tasks.workunit.client.0.smithi099.stdout:0/476: dread d0/db/d13/f42 [0,4194304] 0 2024-09-19T06:40:38.892 INFO:tasks.workunit.client.0.smithi099.stdout:6/494: mknod d1/d5/d24/d2b/d86/ca3 0 2024-09-19T06:40:38.892 INFO:tasks.workunit.client.1.smithi117.stdout:8/631: write d1d/f27 [3723324,19953] 0 2024-09-19T06:40:38.894 INFO:tasks.workunit.client.1.smithi117.stdout:9/608: creat d4/d1c/d54/da5/daf/fce x:0 0 0 2024-09-19T06:40:38.895 INFO:tasks.workunit.client.0.smithi099.stdout:3/678: getdents d7/d34/d1d/d36/d69/d6d 0 2024-09-19T06:40:38.897 INFO:tasks.workunit.client.1.smithi117.stdout:4/784: mknod d3/d4/d5f/c100 0 2024-09-19T06:40:38.897 INFO:tasks.workunit.client.0.smithi099.stdout:9/522: dwrite fa [0,4194304] 0 2024-09-19T06:40:38.898 INFO:tasks.workunit.client.1.smithi117.stdout:9/609: write d4/f19 [1967515,118031] 0 2024-09-19T06:40:38.900 INFO:tasks.workunit.client.0.smithi099.stdout:9/523: write dd/d2c/f30 [5143381,97290] 0 2024-09-19T06:40:38.902 INFO:tasks.workunit.client.1.smithi117.stdout:5/658: dread d17/d2f/d6a/f8f [0,4194304] 0 2024-09-19T06:40:38.902 INFO:tasks.workunit.client.0.smithi099.stdout:3/679: dread d7/d34/d1d/d36/db8/fcc [0,4194304] 0 2024-09-19T06:40:38.903 INFO:tasks.workunit.client.1.smithi117.stdout:3/628: creat d0/d8/fc3 x:0 0 0 2024-09-19T06:40:38.904 INFO:tasks.workunit.client.0.smithi099.stdout:0/477: symlink d0/db/d27/l95 0 2024-09-19T06:40:38.904 INFO:tasks.workunit.client.0.smithi099.stdout:3/680: truncate d7/d34/d1d/d57/d76/fa8 602828 0 2024-09-19T06:40:38.905 INFO:tasks.workunit.client.0.smithi099.stdout:1/461: creat d0/d12/d13/d37/f94 x:0 0 0 2024-09-19T06:40:38.906 INFO:tasks.workunit.client.1.smithi117.stdout:5/659: write d17/d2e/dab/fb7 [7624291,69069] 0 2024-09-19T06:40:38.907 INFO:tasks.workunit.client.1.smithi117.stdout:6/425: sync 2024-09-19T06:40:38.907 INFO:tasks.workunit.client.0.smithi099.stdout:2/337: sync 2024-09-19T06:40:38.907 INFO:tasks.workunit.client.0.smithi099.stdout:5/632: sync 2024-09-19T06:40:38.907 INFO:tasks.workunit.client.0.smithi099.stdout:7/578: sync 2024-09-19T06:40:38.907 INFO:tasks.workunit.client.0.smithi099.stdout:4/508: sync 2024-09-19T06:40:38.908 INFO:tasks.workunit.client.1.smithi117.stdout:7/619: sync 2024-09-19T06:40:38.909 INFO:tasks.workunit.client.0.smithi099.stdout:2/338: write d1/d2/d4d/f5e [4230610,97253] 0 2024-09-19T06:40:38.909 INFO:tasks.workunit.client.1.smithi117.stdout:9/610: creat d4/d1c/d7a/d52/d8d/d98/fcf x:0 0 0 2024-09-19T06:40:38.910 INFO:tasks.workunit.client.1.smithi117.stdout:8/632: mkdir d1d/d2a/d3f/d4b/d5f/dbf/dd0/db9/dd6 0 2024-09-19T06:40:38.910 INFO:tasks.workunit.client.0.smithi099.stdout:8/376: link d4/d11/l5d d4/d11/d38/l7f 0 2024-09-19T06:40:38.910 INFO:tasks.workunit.client.0.smithi099.stdout:2/339: chown d1/d2/d5/d13/d2c/l57 2 1 2024-09-19T06:40:38.911 INFO:tasks.workunit.client.0.smithi099.stdout:2/340: chown d1/d2/d4d/d52/d18/d27/c4e 12397707 1 2024-09-19T06:40:38.912 INFO:tasks.workunit.client.1.smithi117.stdout:8/633: stat d1d/d2a/d3f/d73 0 2024-09-19T06:40:38.913 INFO:tasks.workunit.client.0.smithi099.stdout:9/524: mknod dd/d2c/d79/caa 0 2024-09-19T06:40:38.914 INFO:tasks.workunit.client.1.smithi117.stdout:8/634: write d1d/f40 [2876220,65722] 0 2024-09-19T06:40:38.914 INFO:tasks.workunit.client.1.smithi117.stdout:9/611: chown d4/d1c/d54/da5/daf/fce 56983 1 2024-09-19T06:40:38.915 INFO:tasks.workunit.client.0.smithi099.stdout:0/478: rmdir d0/db/d13/d37 39 2024-09-19T06:40:38.916 INFO:tasks.workunit.client.1.smithi117.stdout:6/426: symlink d1/d14/l70 0 2024-09-19T06:40:38.916 INFO:tasks.workunit.client.0.smithi099.stdout:0/479: read - d0/db/d36/d3f/f8a zero size 2024-09-19T06:40:38.917 INFO:tasks.workunit.client.0.smithi099.stdout:0/480: readlink d0/db/d13/d59/l79 0 2024-09-19T06:40:38.917 INFO:tasks.workunit.client.0.smithi099.stdout:0/481: chown d0/db/d2f 2003636 1 2024-09-19T06:40:38.918 INFO:tasks.workunit.client.0.smithi099.stdout:3/681: creat d7/d34/d1d/d20/d58/d5c/fd0 x:0 0 0 2024-09-19T06:40:38.918 INFO:tasks.workunit.client.1.smithi117.stdout:4/785: dread d3/d65/f7c [0,4194304] 0 2024-09-19T06:40:38.918 INFO:tasks.workunit.client.1.smithi117.stdout:7/620: creat d1/d4a/d7c/d95/db5/fda x:0 0 0 2024-09-19T06:40:38.918 INFO:tasks.workunit.client.1.smithi117.stdout:5/660: read d17/d1b/d3a/d3c/d70/d94/fcd [584855,99189] 0 2024-09-19T06:40:38.919 INFO:tasks.workunit.client.1.smithi117.stdout:8/635: write d1d/d1e/f1f [3438241,117878] 0 2024-09-19T06:40:38.920 INFO:tasks.workunit.client.0.smithi099.stdout:1/462: symlink d0/d17/d24/d5e/l95 0 2024-09-19T06:40:38.920 INFO:tasks.workunit.client.0.smithi099.stdout:1/463: fsync d0/d2d/f43 0 2024-09-19T06:40:38.921 INFO:tasks.workunit.client.1.smithi117.stdout:3/629: rename d0/d9/d49 to d0/d8/d7f/d40/dc4 0 2024-09-19T06:40:38.922 INFO:tasks.workunit.client.0.smithi099.stdout:1/464: chown d0/d12/d13/d37/d41/d78/f8f 518 1 2024-09-19T06:40:38.922 INFO:tasks.workunit.client.1.smithi117.stdout:9/612: rmdir d4/d8/d6a/d82 39 2024-09-19T06:40:38.924 INFO:tasks.workunit.client.1.smithi117.stdout:2/609: dread d0/d7/d1e/d20/f7b [0,4194304] 0 2024-09-19T06:40:38.926 INFO:tasks.workunit.client.0.smithi099.stdout:8/377: creat d4/de/d26/d2b/f80 x:0 0 0 2024-09-19T06:40:38.928 INFO:tasks.workunit.client.1.smithi117.stdout:4/786: rmdir d3/d4/d5f 39 2024-09-19T06:40:38.929 INFO:tasks.workunit.client.1.smithi117.stdout:3/630: write d0/d19/d2b/d8e/f99 [3531255,55133] 0 2024-09-19T06:40:38.929 INFO:tasks.workunit.client.0.smithi099.stdout:9/525: unlink dd/fa5 0 2024-09-19T06:40:38.930 INFO:tasks.workunit.client.1.smithi117.stdout:5/661: mknod d17/d2e/d65/d88/cd9 0 2024-09-19T06:40:38.930 INFO:tasks.workunit.client.0.smithi099.stdout:9/526: stat dd/d2c/d5c/f97 0 2024-09-19T06:40:38.931 INFO:tasks.workunit.client.1.smithi117.stdout:2/610: write d0/d7/d1e/d20/f44 [5142625,119216] 0 2024-09-19T06:40:38.932 INFO:tasks.workunit.client.0.smithi099.stdout:0/482: symlink d0/db/d13/d1f/d3a/l96 0 2024-09-19T06:40:38.932 INFO:tasks.workunit.client.0.smithi099.stdout:9/527: write dd/d2c/d5c/d64/d93/fa1 [556704,113679] 0 2024-09-19T06:40:38.933 INFO:tasks.workunit.client.0.smithi099.stdout:0/483: write d0/db/d27/f8b [582631,79232] 0 2024-09-19T06:40:38.933 INFO:tasks.workunit.client.1.smithi117.stdout:1/586: write d3/d18/d56/f85 [1434109,1032] 0 2024-09-19T06:40:38.934 INFO:tasks.workunit.client.1.smithi117.stdout:8/636: mknod d1d/d2a/d3f/cd7 0 2024-09-19T06:40:38.936 INFO:tasks.workunit.client.1.smithi117.stdout:6/427: rename d1/f3c to d1/d5/d8/d5e/d6d/f71 0 2024-09-19T06:40:38.937 INFO:tasks.workunit.client.0.smithi099.stdout:0/484: dread d0/db/d2f/f4e [0,4194304] 0 2024-09-19T06:40:38.938 INFO:tasks.workunit.client.0.smithi099.stdout:5/633: write d3/d16/f30 [4973680,91454] 0 2024-09-19T06:40:38.939 INFO:tasks.workunit.client.1.smithi117.stdout:1/587: read - d3/d18/d23/fc2 zero size 2024-09-19T06:40:38.941 INFO:tasks.workunit.client.0.smithi099.stdout:4/509: unlink d12/d32/d42/d5c/f26 0 2024-09-19T06:40:38.943 INFO:tasks.workunit.client.1.smithi117.stdout:9/613: creat d4/d8/d6a/d82/da3/fd0 x:0 0 0 2024-09-19T06:40:38.943 INFO:tasks.workunit.client.0.smithi099.stdout:7/579: link d7/dcf/d29/d4e/fa6 d7/dcf/d29/d34/fd1 0 2024-09-19T06:40:38.944 INFO:tasks.workunit.client.1.smithi117.stdout:7/621: dwrite d1/d4a/d81/d48/faf [0,4194304] 0 2024-09-19T06:40:38.945 INFO:tasks.workunit.client.0.smithi099.stdout:8/378: rmdir d4/de/d14 39 2024-09-19T06:40:38.945 INFO:tasks.workunit.client.1.smithi117.stdout:8/637: symlink d1d/d31/d83/ld8 0 2024-09-19T06:40:38.946 INFO:tasks.workunit.client.0.smithi099.stdout:1/465: dwrite d0/db/f19 [0,4194304] 0 2024-09-19T06:40:38.947 INFO:tasks.workunit.client.0.smithi099.stdout:6/495: getdents d1/d5/d24/d2e/d41/d4e 0 2024-09-19T06:40:38.948 INFO:tasks.workunit.client.0.smithi099.stdout:7/580: chown d7/dcf/d29/d1f/d45/f87 11822582 1 2024-09-19T06:40:38.949 INFO:tasks.workunit.client.1.smithi117.stdout:4/787: rename d3/d1b/c2d to d3/db/d23/c101 0 2024-09-19T06:40:38.951 INFO:tasks.workunit.client.1.smithi117.stdout:3/631: dwrite d0/d9/d1c/f1d [0,4194304] 0 2024-09-19T06:40:38.951 INFO:tasks.workunit.client.1.smithi117.stdout:9/614: write d4/d1c/d36/fcd [682934,88552] 0 2024-09-19T06:40:38.955 INFO:tasks.workunit.client.0.smithi099.stdout:9/528: mknod dd/d2c/d5c/cab 0 2024-09-19T06:40:38.956 INFO:tasks.workunit.client.1.smithi117.stdout:0/469: dwrite d11/d13/d14/d16/f1a [0,4194304] 0 2024-09-19T06:40:38.956 INFO:tasks.workunit.client.1.smithi117.stdout:4/788: chown d3/d1b/d7d/d51 0 1 2024-09-19T06:40:38.956 INFO:tasks.workunit.client.0.smithi099.stdout:4/510: dwrite d12/f30 [0,4194304] 0 2024-09-19T06:40:38.957 INFO:tasks.workunit.client.1.smithi117.stdout:8/638: chown d1d/d1e/d29/l5d 721 1 2024-09-19T06:40:38.958 INFO:tasks.workunit.client.0.smithi099.stdout:5/634: fdatasync d3/d16/d5e/fbc 0 2024-09-19T06:40:38.959 INFO:tasks.workunit.client.0.smithi099.stdout:4/511: write d12/d1b/d73/d81/d89/f9a [166140,48446] 0 2024-09-19T06:40:38.960 INFO:tasks.workunit.client.1.smithi117.stdout:8/639: dread - d1d/d2a/d3f/d4b/d5f/d95/fa2 zero size 2024-09-19T06:40:38.962 INFO:tasks.workunit.client.1.smithi117.stdout:9/615: fsync d4/d58/f8e 0 2024-09-19T06:40:38.969 INFO:tasks.workunit.client.0.smithi099.stdout:2/341: rename d1/d2/d4d/d52/d18/d27/d5b/l6b to d1/d2/d5/l6e 0 2024-09-19T06:40:38.971 INFO:tasks.workunit.client.1.smithi117.stdout:5/662: truncate d17/d5c/f69 5577015 0 2024-09-19T06:40:38.971 INFO:tasks.workunit.client.1.smithi117.stdout:0/470: chown d11/d13/d28/d38/d5b 237601613 1 2024-09-19T06:40:38.971 INFO:tasks.workunit.client.1.smithi117.stdout:8/640: mknod d1d/d2a/d3f/d73/cd9 0 2024-09-19T06:40:38.972 INFO:tasks.workunit.client.0.smithi099.stdout:2/342: chown d1/f4f 26675 1 2024-09-19T06:40:38.972 INFO:tasks.workunit.client.1.smithi117.stdout:7/622: write d1/d4a/d81/d24/d26/f37 [736526,39334] 0 2024-09-19T06:40:38.974 INFO:tasks.workunit.client.0.smithi099.stdout:4/512: dwrite d12/f30 [0,4194304] 0 2024-09-19T06:40:38.974 INFO:tasks.workunit.client.1.smithi117.stdout:6/428: dread d1/d5/d8/f4f [0,4194304] 0 2024-09-19T06:40:38.976 INFO:tasks.workunit.client.0.smithi099.stdout:2/343: fdatasync d1/f4f 0 2024-09-19T06:40:38.976 INFO:tasks.workunit.client.1.smithi117.stdout:9/616: mknod d4/d1c/d7a/d52/d8d/cd1 0 2024-09-19T06:40:38.978 INFO:tasks.workunit.client.0.smithi099.stdout:5/635: dwrite d3/d16/d2f/d8c/fcc [0,4194304] 0 2024-09-19T06:40:38.979 INFO:tasks.workunit.client.1.smithi117.stdout:5/663: dread - d17/d1b/d5d/d86/fc5 zero size 2024-09-19T06:40:38.980 INFO:tasks.workunit.client.1.smithi117.stdout:2/611: dwrite d0/d64/dd9/f8b [0,4194304] 0 2024-09-19T06:40:38.982 INFO:tasks.workunit.client.1.smithi117.stdout:9/617: fsync d4/d1c/d7a/d52/f3c 0 2024-09-19T06:40:38.985 INFO:tasks.workunit.client.1.smithi117.stdout:5/664: fsync d17/d1b/d3a/f68 0 2024-09-19T06:40:38.985 INFO:tasks.workunit.client.1.smithi117.stdout:3/632: dwrite d0/fc0 [0,4194304] 0 2024-09-19T06:40:38.986 INFO:tasks.workunit.client.0.smithi099.stdout:6/496: rmdir d1/d5/d24/d2e/d41/d4e 39 2024-09-19T06:40:38.987 INFO:tasks.workunit.client.0.smithi099.stdout:6/497: chown d1/d5/d24/d2e/d41/l53 86533632 1 2024-09-19T06:40:38.989 INFO:tasks.workunit.client.1.smithi117.stdout:7/623: creat d1/d4a/d81/d24/d1c/d55/fdb x:0 0 0 2024-09-19T06:40:38.989 INFO:tasks.workunit.client.1.smithi117.stdout:6/429: symlink d1/d5/d32/d45/l72 0 2024-09-19T06:40:38.990 INFO:tasks.workunit.client.0.smithi099.stdout:0/485: creat d0/db/d13/d37/d3c/d3e/f97 x:0 0 0 2024-09-19T06:40:38.991 INFO:tasks.workunit.client.1.smithi117.stdout:0/471: getdents d11/d13/d14 0 2024-09-19T06:40:38.994 INFO:tasks.workunit.client.1.smithi117.stdout:2/612: write d0/d7/fa1 [843703,52538] 0 2024-09-19T06:40:38.994 INFO:tasks.workunit.client.0.smithi099.stdout:1/466: rename d0/d12/d13/d37/d41/d78/f85 to d0/d2d/f96 0 2024-09-19T06:40:38.995 INFO:tasks.workunit.client.1.smithi117.stdout:9/618: symlink d4/d1c/d46/ld2 0 2024-09-19T06:40:38.995 INFO:tasks.workunit.client.0.smithi099.stdout:7/581: dwrite d7/dcf/d97/fa2 [0,4194304] 0 2024-09-19T06:40:38.997 INFO:tasks.workunit.client.0.smithi099.stdout:6/498: rmdir d1/d5/d24/d2b 39 2024-09-19T06:40:38.998 INFO:tasks.workunit.client.0.smithi099.stdout:2/344: write d1/d2/d4d/f66 [5263025,20958] 0 2024-09-19T06:40:38.998 INFO:tasks.workunit.client.1.smithi117.stdout:5/665: write d17/d2e/dab/fcf [780340,74908] 0 2024-09-19T06:40:39.002 INFO:tasks.workunit.client.0.smithi099.stdout:9/529: rename dd/d47/l28 to dd/d2c/d5c/d85/lac 0 2024-09-19T06:40:39.003 INFO:tasks.workunit.client.0.smithi099.stdout:9/530: chown dd/d47/l95 3 1 2024-09-19T06:40:39.004 INFO:tasks.workunit.client.0.smithi099.stdout:1/467: mknod d0/d17/d5b/c97 0 2024-09-19T06:40:39.005 INFO:tasks.workunit.client.1.smithi117.stdout:2/613: fdatasync d0/d7/d29/d35/d61/d65/fc6 0 2024-09-19T06:40:39.005 INFO:tasks.workunit.client.1.smithi117.stdout:7/624: dread - d1/d4a/d81/d8d/fc9 zero size 2024-09-19T06:40:39.005 INFO:tasks.workunit.client.1.smithi117.stdout:9/619: unlink d4/d1c/d36/fcd 0 2024-09-19T06:40:39.006 INFO:tasks.workunit.client.0.smithi099.stdout:5/636: mknod d3/d16/d2f/d34/ddc/ce0 0 2024-09-19T06:40:39.007 INFO:tasks.workunit.client.0.smithi099.stdout:5/637: chown d3/d7/d90/da6/cc4 37445 1 2024-09-19T06:40:39.008 INFO:tasks.workunit.client.1.smithi117.stdout:4/789: dwrite d3/d4/f40 [0,4194304] 0 2024-09-19T06:40:39.009 INFO:tasks.workunit.client.0.smithi099.stdout:0/486: symlink d0/l98 0 2024-09-19T06:40:39.010 INFO:tasks.workunit.client.0.smithi099.stdout:9/531: creat dd/d62/d78/fad x:0 0 0 2024-09-19T06:40:39.015 INFO:tasks.workunit.client.0.smithi099.stdout:2/345: link d1/f47 d1/d2/d4d/d52/d9/f6f 0 2024-09-19T06:40:39.015 INFO:tasks.workunit.client.1.smithi117.stdout:3/633: creat d0/fc5 x:0 0 0 2024-09-19T06:40:39.015 INFO:tasks.workunit.client.1.smithi117.stdout:0/472: dwrite d11/d13/d28/d38/d5b/f73 [0,4194304] 0 2024-09-19T06:40:39.016 INFO:tasks.workunit.client.0.smithi099.stdout:2/346: truncate d1/d2/d5/d13/f54 593909 0 2024-09-19T06:40:39.017 INFO:tasks.workunit.client.0.smithi099.stdout:2/347: chown d1/d2/d4d/d52/d18/d27 7009 1 2024-09-19T06:40:39.018 INFO:tasks.workunit.client.1.smithi117.stdout:9/620: dread - d4/fa2 zero size 2024-09-19T06:40:39.018 INFO:tasks.workunit.client.0.smithi099.stdout:7/582: creat d7/fd2 x:0 0 0 2024-09-19T06:40:39.021 INFO:tasks.workunit.client.1.smithi117.stdout:6/430: dwrite d1/d5/d32/f6b [0,4194304] 0 2024-09-19T06:40:39.022 INFO:tasks.workunit.client.0.smithi099.stdout:8/379: link d4/de/d10/l4f d4/de/l81 0 2024-09-19T06:40:39.022 INFO:tasks.workunit.client.0.smithi099.stdout:2/348: creat d1/d2/d5/d13/d2c/f70 x:0 0 0 2024-09-19T06:40:39.024 INFO:tasks.workunit.client.0.smithi099.stdout:8/380: write d4/f54 [1325350,54563] 0 2024-09-19T06:40:39.025 INFO:tasks.workunit.client.1.smithi117.stdout:2/614: unlink d0/d7/cc 0 2024-09-19T06:40:39.026 INFO:tasks.workunit.client.0.smithi099.stdout:1/468: getdents d0/d12/d13 0 2024-09-19T06:40:39.026 INFO:tasks.workunit.client.1.smithi117.stdout:6/431: dread - d1/d3/d25/f46 zero size 2024-09-19T06:40:39.027 INFO:tasks.workunit.client.1.smithi117.stdout:9/621: creat d4/d1c/d36/fd3 x:0 0 0 2024-09-19T06:40:39.029 INFO:tasks.workunit.client.1.smithi117.stdout:8/641: dwrite d1d/d31/fb8 [0,4194304] 0 2024-09-19T06:40:39.029 INFO:tasks.workunit.client.0.smithi099.stdout:2/349: truncate d1/d2/d4d/d52/d18/d2d/f62 480108 0 2024-09-19T06:40:39.029 INFO:tasks.workunit.client.1.smithi117.stdout:4/790: rename d3/d28/d2a/c2c to d3/d28/d2a/c102 0 2024-09-19T06:40:39.030 INFO:tasks.workunit.client.0.smithi099.stdout:2/350: stat d1/d2/d4d/d52/f2b 0 2024-09-19T06:40:39.030 INFO:tasks.workunit.client.1.smithi117.stdout:1/588: dread d3/d18/f3f [4194304,4194304] 0 2024-09-19T06:40:39.034 INFO:tasks.workunit.client.1.smithi117.stdout:9/622: write d4/d20/f45 [1507762,43561] 0 2024-09-19T06:40:39.038 INFO:tasks.workunit.client.1.smithi117.stdout:1/589: symlink d3/d18/d23/d74/d89/lcd 0 2024-09-19T06:40:39.038 INFO:tasks.workunit.client.0.smithi099.stdout:2/351: truncate d1/d2/d4d/d52/f2b 3669309 0 2024-09-19T06:40:39.039 INFO:tasks.workunit.client.1.smithi117.stdout:4/791: truncate d3/db/ff 8753978 0 2024-09-19T06:40:39.040 INFO:tasks.workunit.client.0.smithi099.stdout:0/487: dread d0/db/d13/d1f/f24 [0,4194304] 0 2024-09-19T06:40:39.040 INFO:tasks.workunit.client.1.smithi117.stdout:0/473: dwrite d11/d13/d1b/d4b/f75 [0,4194304] 0 2024-09-19T06:40:39.041 INFO:tasks.workunit.client.1.smithi117.stdout:9/623: mknod d4/d8/d6a/d82/da3/cd4 0 2024-09-19T06:40:39.043 INFO:tasks.workunit.client.0.smithi099.stdout:0/488: mkdir d0/db/d13/d1f/d99 0 2024-09-19T06:40:39.047 INFO:tasks.workunit.client.1.smithi117.stdout:4/792: creat d3/d65/d66/dce/f103 x:0 0 0 2024-09-19T06:40:39.048 INFO:tasks.workunit.client.1.smithi117.stdout:1/590: symlink d3/d18/d23/lce 0 2024-09-19T06:40:39.049 INFO:tasks.workunit.client.0.smithi099.stdout:0/489: dwrite d0/db/d13/d1f/d4a/f7b [0,4194304] 0 2024-09-19T06:40:39.049 INFO:tasks.workunit.client.1.smithi117.stdout:9/624: creat d4/d1c/d73/d93/fd5 x:0 0 0 2024-09-19T06:40:39.051 INFO:tasks.workunit.client.1.smithi117.stdout:6/432: dwrite d1/d5/d8/d5e/f68 [0,4194304] 0 2024-09-19T06:40:39.051 INFO:tasks.workunit.client.0.smithi099.stdout:0/490: write d0/d17/f6a [324183,92143] 0 2024-09-19T06:40:39.053 INFO:tasks.workunit.client.1.smithi117.stdout:0/474: creat d11/d13/d28/f99 x:0 0 0 2024-09-19T06:40:39.053 INFO:tasks.workunit.client.1.smithi117.stdout:1/591: mkdir d3/d18/d23/d74/dcf 0 2024-09-19T06:40:39.055 INFO:tasks.workunit.client.0.smithi099.stdout:0/491: unlink d0/db/d27/f58 0 2024-09-19T06:40:39.058 INFO:tasks.workunit.client.1.smithi117.stdout:4/793: dread d3/db/d23/f54 [0,4194304] 0 2024-09-19T06:40:39.059 INFO:tasks.workunit.client.0.smithi099.stdout:4/513: dwrite d12/d32/f3e [0,4194304] 0 2024-09-19T06:40:39.061 INFO:tasks.workunit.client.1.smithi117.stdout:6/433: symlink d1/d5/l73 0 2024-09-19T06:40:39.061 INFO:tasks.workunit.client.1.smithi117.stdout:1/592: write d3/f9 [439417,126773] 0 2024-09-19T06:40:39.065 INFO:tasks.workunit.client.0.smithi099.stdout:4/514: dread d12/d32/f3e [0,4194304] 0 2024-09-19T06:40:39.066 INFO:tasks.workunit.client.1.smithi117.stdout:8/642: dwrite d1d/d2a/d3f/d4b/f59 [0,4194304] 0 2024-09-19T06:40:39.069 INFO:tasks.workunit.client.1.smithi117.stdout:6/434: mknod d1/d3/c74 0 2024-09-19T06:40:39.069 INFO:tasks.workunit.client.0.smithi099.stdout:4/515: mknod d12/d1b/d73/d81/d89/d91/cad 0 2024-09-19T06:40:39.070 INFO:tasks.workunit.client.0.smithi099.stdout:4/516: fsync d12/d1b/d73/d81/fa0 0 2024-09-19T06:40:39.071 INFO:tasks.workunit.client.1.smithi117.stdout:7/625: dread d1/d4a/d81/d24/d1c/f79 [0,4194304] 0 2024-09-19T06:40:39.071 INFO:tasks.workunit.client.0.smithi099.stdout:5/638: rename d3/d16/d2f/d34/ddc to d3/d16/d2f/d34/d3c/de1 0 2024-09-19T06:40:39.071 INFO:tasks.workunit.client.1.smithi117.stdout:4/794: creat d3/d41/dd6/f104 x:0 0 0 2024-09-19T06:40:39.072 INFO:tasks.workunit.client.1.smithi117.stdout:4/795: stat d3/db/d13/l26 0 2024-09-19T06:40:39.072 INFO:tasks.workunit.client.0.smithi099.stdout:5/639: write d3/d1f/f20 [1451939,69772] 0 2024-09-19T06:40:39.073 INFO:tasks.workunit.client.1.smithi117.stdout:6/435: unlink d1/d3/d25/d5c/f65 0 2024-09-19T06:40:39.073 INFO:tasks.workunit.client.1.smithi117.stdout:4/796: fdatasync d3/d65/d66/dce/fda 0 2024-09-19T06:40:39.073 INFO:tasks.workunit.client.0.smithi099.stdout:4/517: write d12/d32/f72 [3690682,41530] 0 2024-09-19T06:40:39.075 INFO:tasks.workunit.client.0.smithi099.stdout:8/381: write d4/de/d10/f29 [375388,32072] 0 2024-09-19T06:40:39.076 INFO:tasks.workunit.client.1.smithi117.stdout:7/626: mkdir d1/d4a/d7c/d95/ddc 0 2024-09-19T06:40:39.077 INFO:tasks.workunit.client.1.smithi117.stdout:7/627: stat d1/d4a/d81/d48/d5f/l8a 0 2024-09-19T06:40:39.077 INFO:tasks.workunit.client.0.smithi099.stdout:4/518: stat d12/d1b/d73/d81/d89/d91/cad 0 2024-09-19T06:40:39.079 INFO:tasks.workunit.client.1.smithi117.stdout:4/797: fsync d3/d1b/d63/f8c 0 2024-09-19T06:40:39.079 INFO:tasks.workunit.client.1.smithi117.stdout:6/436: symlink d1/d5/d8/d5e/d6d/l75 0 2024-09-19T06:40:39.080 INFO:tasks.workunit.client.0.smithi099.stdout:5/640: creat d3/d16/d2f/d34/d3c/d65/dbe/dc2/fe2 x:0 0 0 2024-09-19T06:40:39.081 INFO:tasks.workunit.client.1.smithi117.stdout:4/798: fdatasync d3/db/d20/d29/d39/f6c 0 2024-09-19T06:40:39.081 INFO:tasks.workunit.client.0.smithi099.stdout:5/641: chown d3/d2a/l73 964 1 2024-09-19T06:40:39.082 INFO:tasks.workunit.client.0.smithi099.stdout:5/642: readlink d3/d2a/l73 0 2024-09-19T06:40:39.082 INFO:tasks.workunit.client.1.smithi117.stdout:6/437: fdatasync d1/f41 0 2024-09-19T06:40:39.083 INFO:tasks.workunit.client.0.smithi099.stdout:8/382: creat d4/de/d26/d2b/f82 x:0 0 0 2024-09-19T06:40:39.085 INFO:tasks.workunit.client.0.smithi099.stdout:7/583: rename d7/dcf/d29/d34/f7b to d7/dcf/d29/d1f/fd3 0 2024-09-19T06:40:39.087 INFO:tasks.workunit.client.1.smithi117.stdout:6/438: dread d1/d5/f40 [0,4194304] 0 2024-09-19T06:40:39.087 INFO:tasks.workunit.client.1.smithi117.stdout:7/628: dwrite d1/d4a/d81/f8e [0,4194304] 0 2024-09-19T06:40:39.088 INFO:tasks.workunit.client.0.smithi099.stdout:8/383: symlink d4/l83 0 2024-09-19T06:40:39.090 INFO:tasks.workunit.client.0.smithi099.stdout:6/499: rename d1/d5/d24/d2e/d41/d4e to d1/d5/d24/d2e/d41/d4e/d54/d5d/da4 22 2024-09-19T06:40:39.091 INFO:tasks.workunit.client.0.smithi099.stdout:5/643: read d3/d16/d5e/f62 [695651,103563] 0 2024-09-19T06:40:39.091 INFO:tasks.workunit.client.0.smithi099.stdout:7/584: stat d7/dcf/d29/d1f/d45/d48/f5e 0 2024-09-19T06:40:39.092 INFO:tasks.workunit.client.0.smithi099.stdout:6/500: unlink d1/d5/c1a 0 2024-09-19T06:40:39.093 INFO:tasks.workunit.client.0.smithi099.stdout:8/384: fdatasync d4/d11/d23/d3f/f55 0 2024-09-19T06:40:39.094 INFO:tasks.workunit.client.0.smithi099.stdout:1/469: rename d0/d12/d13/d37/d48/c8c to d0/d12/d54/c98 0 2024-09-19T06:40:39.095 INFO:tasks.workunit.client.1.smithi117.stdout:0/475: dwrite d11/d13/d1b/d27/d37/f5e [4194304,4194304] 0 2024-09-19T06:40:39.096 INFO:tasks.workunit.client.0.smithi099.stdout:4/519: dwrite d12/d32/d39/f90 [0,4194304] 0 2024-09-19T06:40:39.098 INFO:tasks.workunit.client.1.smithi117.stdout:7/629: creat d1/d3f/d92/fdd x:0 0 0 2024-09-19T06:40:39.099 INFO:tasks.workunit.client.0.smithi099.stdout:7/585: readlink d7/d39/d7d/l86 0 2024-09-19T06:40:39.099 INFO:tasks.workunit.client.0.smithi099.stdout:8/385: fsync d4/f5b 0 2024-09-19T06:40:39.103 INFO:tasks.workunit.client.0.smithi099.stdout:5/644: mknod d3/d16/d2f/dd1/ce3 0 2024-09-19T06:40:39.105 INFO:tasks.workunit.client.1.smithi117.stdout:4/799: link d3/d4/d14/f60 d3/d65/d66/dce/f105 0 2024-09-19T06:40:39.106 INFO:tasks.workunit.client.0.smithi099.stdout:4/520: write d12/f38 [2125978,76582] 0 2024-09-19T06:40:39.107 INFO:tasks.workunit.client.1.smithi117.stdout:4/800: fsync d3/d1b/f4d 0 2024-09-19T06:40:39.109 INFO:tasks.workunit.client.1.smithi117.stdout:6/439: dwrite d1/f1b [4194304,4194304] 0 2024-09-19T06:40:39.111 INFO:tasks.workunit.client.0.smithi099.stdout:8/386: mknod d4/d11/d61/c84 0 2024-09-19T06:40:39.113 INFO:tasks.workunit.client.1.smithi117.stdout:7/630: mknod d1/d4a/d7c/d95/cde 0 2024-09-19T06:40:39.113 INFO:tasks.workunit.client.1.smithi117.stdout:0/476: mknod d11/c9a 0 2024-09-19T06:40:39.116 INFO:tasks.workunit.client.0.smithi099.stdout:0/492: dread d0/db/d13/d37/d3c/d3e/f4c [0,4194304] 0 2024-09-19T06:40:39.116 INFO:tasks.workunit.client.0.smithi099.stdout:1/470: dread d0/d12/d54/f7e [0,4194304] 0 2024-09-19T06:40:39.120 INFO:tasks.workunit.client.0.smithi099.stdout:6/501: dwrite d1/d5/d24/d2e/d41/d4e/d54/d5d/d61/f8a [0,4194304] 0 2024-09-19T06:40:39.120 INFO:tasks.workunit.client.0.smithi099.stdout:1/471: write d0/d68/f69 [864166,80027] 0 2024-09-19T06:40:39.122 INFO:tasks.workunit.client.1.smithi117.stdout:4/801: write d3/d65/f7c [528280,62463] 0 2024-09-19T06:40:39.122 INFO:tasks.workunit.client.1.smithi117.stdout:0/477: rename d11/d13/d14/d2c/c3c to d11/d13/d28/d38/c9b 0 2024-09-19T06:40:39.123 INFO:tasks.workunit.client.0.smithi099.stdout:2/352: write d1/d2/d4d/d52/f2b [3286143,60117] 0 2024-09-19T06:40:39.125 INFO:tasks.workunit.client.0.smithi099.stdout:5/645: rename d3/d16/d2f/d34/da4/faa to d3/d16/d2f/d34/d3c/d65/dd5/fe4 0 2024-09-19T06:40:39.128 INFO:tasks.workunit.client.1.smithi117.stdout:7/631: mkdir d1/d4a/d81/d24/d26/ddf 0 2024-09-19T06:40:39.131 INFO:tasks.workunit.client.0.smithi099.stdout:1/472: readlink d0/db/l27 0 2024-09-19T06:40:39.131 INFO:tasks.workunit.client.0.smithi099.stdout:7/586: creat d7/dcf/d97/fd4 x:0 0 0 2024-09-19T06:40:39.133 INFO:tasks.workunit.client.0.smithi099.stdout:2/353: rename d1/d2/d4d/d52/c2e to d1/d2/d4d/d52/d18/d2d/c71 0 2024-09-19T06:40:39.133 INFO:tasks.workunit.client.0.smithi099.stdout:7/587: readlink d7/dcf/d29/d1f/d45/d48/d63/d71/l76 0 2024-09-19T06:40:39.133 INFO:tasks.workunit.client.0.smithi099.stdout:6/502: fsync d1/d5/d24/d2e/d41/f5a 0 2024-09-19T06:40:39.134 INFO:tasks.workunit.client.0.smithi099.stdout:8/387: unlink d4/de/d10/f20 0 2024-09-19T06:40:39.136 INFO:tasks.workunit.client.0.smithi099.stdout:8/388: dread - d4/d66/f71 zero size 2024-09-19T06:40:39.137 INFO:tasks.workunit.client.1.smithi117.stdout:4/802: mkdir d3/db/d106 0 2024-09-19T06:40:39.138 INFO:tasks.workunit.client.1.smithi117.stdout:4/803: chown d3/d65/c9c 2546275 1 2024-09-19T06:40:39.138 INFO:tasks.workunit.client.1.smithi117.stdout:7/632: truncate d1/d4a/f5d 792642 0 2024-09-19T06:40:39.138 INFO:tasks.workunit.client.0.smithi099.stdout:5/646: rename d3/d16/d2f/d34/d3c/d65/dbe/dc2 to d3/d16/d2f/d34/da4/da5/dce/de5 0 2024-09-19T06:40:39.140 INFO:tasks.workunit.client.0.smithi099.stdout:0/493: creat d0/db/d13/d37/f9a x:0 0 0 2024-09-19T06:40:39.140 INFO:tasks.workunit.client.0.smithi099.stdout:5/647: readlink d3/d1f/l40 0 2024-09-19T06:40:39.141 INFO:tasks.workunit.client.0.smithi099.stdout:7/588: fdatasync d7/dcf/d29/d1f/d45/d48/d63/d75/f8d 0 2024-09-19T06:40:39.142 INFO:tasks.workunit.client.0.smithi099.stdout:2/354: truncate d1/d2/d4d/d52/d18/f2f 2938182 0 2024-09-19T06:40:39.143 INFO:tasks.workunit.client.0.smithi099.stdout:6/503: mkdir d1/d5/d24/d2b/d86/da5 0 2024-09-19T06:40:39.143 INFO:tasks.workunit.client.0.smithi099.stdout:8/389: creat d4/d11/d23/d4c/f85 x:0 0 0 2024-09-19T06:40:39.144 INFO:tasks.workunit.client.0.smithi099.stdout:2/355: fdatasync d1/d2/d4d/f5e 0 2024-09-19T06:40:39.144 INFO:tasks.workunit.client.0.smithi099.stdout:0/494: mkdir d0/db/d13/d1f/d8e/d9b 0 2024-09-19T06:40:39.145 INFO:tasks.workunit.client.0.smithi099.stdout:5/648: truncate d3/d16/d2f/d34/da4/f88 645456 0 2024-09-19T06:40:39.147 INFO:tasks.workunit.client.0.smithi099.stdout:5/649: chown d3/d16/f83 243 1 2024-09-19T06:40:39.149 INFO:tasks.workunit.client.1.smithi117.stdout:0/478: getdents d11/d13/d1b/d27/d37/d6d 0 2024-09-19T06:40:39.149 INFO:tasks.workunit.client.0.smithi099.stdout:0/495: rmdir d0/db/d13/d1f/d4a 39 2024-09-19T06:40:39.150 INFO:tasks.workunit.client.1.smithi117.stdout:0/479: chown d11/d13/d14/l25 40230241 1 2024-09-19T06:40:39.152 INFO:tasks.workunit.client.1.smithi117.stdout:4/804: creat d3/db/d20/d29/d39/d4f/de7/f107 x:0 0 0 2024-09-19T06:40:39.153 INFO:tasks.workunit.client.0.smithi099.stdout:8/390: dread d4/d11/d23/f4b [0,4194304] 0 2024-09-19T06:40:39.153 INFO:tasks.workunit.client.1.smithi117.stdout:0/480: write d11/d13/d14/d16/f34 [2000998,123590] 0 2024-09-19T06:40:39.154 INFO:tasks.workunit.client.0.smithi099.stdout:2/356: creat d1/d2/d4d/d52/d18/d27/f72 x:0 0 0 2024-09-19T06:40:39.154 INFO:tasks.workunit.client.0.smithi099.stdout:1/473: write d0/d17/d32/d7b/f84 [1735412,1684] 0 2024-09-19T06:40:39.155 INFO:tasks.workunit.client.0.smithi099.stdout:6/504: dwrite d1/d5/d24/f89 [0,4194304] 0 2024-09-19T06:40:39.156 INFO:tasks.workunit.client.1.smithi117.stdout:4/805: stat d3/d28/d2a/f9b 0 2024-09-19T06:40:39.156 INFO:tasks.workunit.client.1.smithi117.stdout:6/440: dwrite d1/d14/f15 [0,4194304] 0 2024-09-19T06:40:39.157 INFO:tasks.workunit.client.0.smithi099.stdout:2/357: chown d1/d2/f1f 2662 1 2024-09-19T06:40:39.160 INFO:tasks.workunit.client.1.smithi117.stdout:4/806: write d3/d1b/f4d [1476074,57724] 0 2024-09-19T06:40:39.160 INFO:tasks.workunit.client.1.smithi117.stdout:7/633: dread d1/d4a/d81/d24/d1c/f67 [0,4194304] 0 2024-09-19T06:40:39.161 INFO:tasks.workunit.client.1.smithi117.stdout:7/634: stat d1/d3f/d92 0 2024-09-19T06:40:39.162 INFO:tasks.workunit.client.0.smithi099.stdout:4/521: dread f5 [0,4194304] 0 2024-09-19T06:40:39.162 INFO:tasks.workunit.client.1.smithi117.stdout:4/807: chown d3/db/d20/d4a/d7b/da0/fbf 579411309 1 2024-09-19T06:40:39.162 INFO:tasks.workunit.client.1.smithi117.stdout:6/441: rmdir d1/d3/d25 39 2024-09-19T06:40:39.164 INFO:tasks.workunit.client.1.smithi117.stdout:0/481: rename d11/d13/d1b/d27/d37/l3d to d11/d13/d1b/d27/l9c 0 2024-09-19T06:40:39.165 INFO:tasks.workunit.client.0.smithi099.stdout:1/474: dread d0/d68/f69 [0,4194304] 0 2024-09-19T06:40:39.167 INFO:tasks.workunit.client.1.smithi117.stdout:4/808: creat d3/db/d20/d29/d39/f108 x:0 0 0 2024-09-19T06:40:39.168 INFO:tasks.workunit.client.0.smithi099.stdout:3/682: sync 2024-09-19T06:40:39.168 INFO:tasks.workunit.client.0.smithi099.stdout:9/532: sync 2024-09-19T06:40:39.168 INFO:tasks.workunit.client.1.smithi117.stdout:4/809: readlink d3/d1b/d7d/d51/d95/ld9 0 2024-09-19T06:40:39.168 INFO:tasks.workunit.client.1.smithi117.stdout:0/482: write d11/d13/d14/d16/f4a [1017191,52844] 0 2024-09-19T06:40:39.169 INFO:tasks.workunit.client.0.smithi099.stdout:8/391: dwrite d4/d66/f7d [0,4194304] 0 2024-09-19T06:40:39.171 INFO:tasks.workunit.client.1.smithi117.stdout:7/635: creat d1/d4a/d81/d24/d1c/fe0 x:0 0 0 2024-09-19T06:40:39.173 INFO:tasks.workunit.client.1.smithi117.stdout:0/483: mkdir d11/d13/d1b/d27/d37/d9d 0 2024-09-19T06:40:39.173 INFO:tasks.workunit.client.0.smithi099.stdout:6/505: dwrite d1/d5/d24/d2e/d41/d4e/d54/d5d/d61/f7d [0,4194304] 0 2024-09-19T06:40:39.175 INFO:tasks.workunit.client.1.smithi117.stdout:6/442: link d1/d3/d25/f46 d1/d3/f76 0 2024-09-19T06:40:39.178 INFO:tasks.workunit.client.1.smithi117.stdout:4/810: dwrite d3/d1b/d7d/f4b [0,4194304] 0 2024-09-19T06:40:39.181 INFO:tasks.workunit.client.1.smithi117.stdout:7/636: unlink d1/d4a/d81/d24/d1c/d35/d4f/l7d 0 2024-09-19T06:40:39.184 INFO:tasks.workunit.client.1.smithi117.stdout:6/443: stat d1/d5/l61 0 2024-09-19T06:40:39.186 INFO:tasks.workunit.client.0.smithi099.stdout:6/506: dwrite d1/d5/d24/d2e/d41/f9e [0,4194304] 0 2024-09-19T06:40:39.186 INFO:tasks.workunit.client.1.smithi117.stdout:4/811: chown d3/db/d20/d29/d39/d4f/d8b/c74 23104 1 2024-09-19T06:40:39.187 INFO:tasks.workunit.client.1.smithi117.stdout:0/484: getdents d11/d13/d1b/d67 0 2024-09-19T06:40:39.187 INFO:tasks.workunit.client.0.smithi099.stdout:2/358: dread d1/d2/d4d/f66 [0,4194304] 0 2024-09-19T06:40:39.188 INFO:tasks.workunit.client.1.smithi117.stdout:7/637: symlink d1/d4a/d7c/dbc/le1 0 2024-09-19T06:40:39.189 INFO:tasks.workunit.client.1.smithi117.stdout:0/485: mkdir d11/d13/d14/d2c/d70/d9e 0 2024-09-19T06:40:39.191 INFO:tasks.workunit.client.0.smithi099.stdout:7/589: getdents d7/dcf/d29/d34/da1 0 2024-09-19T06:40:39.192 INFO:tasks.workunit.client.1.smithi117.stdout:7/638: mkdir d1/d4a/d7c/d95/db5/de2 0 2024-09-19T06:40:39.192 INFO:tasks.workunit.client.1.smithi117.stdout:6/444: read d1/d14/f23 [1655760,83939] 0 2024-09-19T06:40:39.193 INFO:tasks.workunit.client.1.smithi117.stdout:6/445: write d1/d14/f2b [2831458,114397] 0 2024-09-19T06:40:39.193 INFO:tasks.workunit.client.1.smithi117.stdout:7/639: chown d1/d4a/d81/d24/d26/d44/fb2 1530555 1 2024-09-19T06:40:39.194 INFO:tasks.workunit.client.0.smithi099.stdout:7/590: truncate d7/dcf/d29/d4e/f9a 283191 0 2024-09-19T06:40:39.195 INFO:tasks.workunit.client.0.smithi099.stdout:2/359: read d1/d2/d4d/d52/d36/f45 [3410574,111061] 0 2024-09-19T06:40:39.196 INFO:tasks.workunit.client.0.smithi099.stdout:2/360: write d1/d2/d4d/d52/d36/f45 [4862822,64299] 0 2024-09-19T06:40:39.198 INFO:tasks.workunit.client.0.smithi099.stdout:4/522: rmdir d12/d1b/d73/d81/d8a 39 2024-09-19T06:40:39.198 INFO:tasks.workunit.client.0.smithi099.stdout:9/533: fsync dd/d47/f3b 0 2024-09-19T06:40:39.199 INFO:tasks.workunit.client.0.smithi099.stdout:3/683: rmdir d7/d34/d1d/d36 39 2024-09-19T06:40:39.200 INFO:tasks.workunit.client.0.smithi099.stdout:3/684: readlink d7/d34/d1d/l7f 0 2024-09-19T06:40:39.202 INFO:tasks.workunit.client.1.smithi117.stdout:6/446: dwrite d1/d3/fd [4194304,4194304] 0 2024-09-19T06:40:39.202 INFO:tasks.workunit.client.0.smithi099.stdout:5/650: creat d3/d7/d90/fe6 x:0 0 0 2024-09-19T06:40:39.203 INFO:tasks.workunit.client.0.smithi099.stdout:0/496: symlink d0/db/d13/l9c 0 2024-09-19T06:40:39.203 INFO:tasks.workunit.client.0.smithi099.stdout:5/651: fdatasync d3/d7/d90/fb5 0 2024-09-19T06:40:39.204 INFO:tasks.workunit.client.1.smithi117.stdout:6/447: mkdir d1/d5/d8/d27/d77 0 2024-09-19T06:40:39.205 INFO:tasks.workunit.client.0.smithi099.stdout:7/591: mkdir d7/dcf/d29/d34/da1/dd5 0 2024-09-19T06:40:39.206 INFO:tasks.workunit.client.0.smithi099.stdout:7/592: dread - d7/dcf/d29/d1f/d45/d48/fbd zero size 2024-09-19T06:40:39.208 INFO:tasks.workunit.client.0.smithi099.stdout:6/507: mknod d1/d5/d24/d2e/d41/d81/ca6 0 2024-09-19T06:40:39.210 INFO:tasks.workunit.client.1.smithi117.stdout:6/448: dread d1/d14/f15 [0,4194304] 0 2024-09-19T06:40:39.210 INFO:tasks.workunit.client.0.smithi099.stdout:3/685: dread - d7/d34/d1d/d36/d69/fc3 zero size 2024-09-19T06:40:39.211 INFO:tasks.workunit.client.1.smithi117.stdout:6/449: stat d1/d3/f4b 0 2024-09-19T06:40:39.211 INFO:tasks.workunit.client.0.smithi099.stdout:5/652: mknod d3/d16/d5e/db1/ce7 0 2024-09-19T06:40:39.212 INFO:tasks.workunit.client.0.smithi099.stdout:0/497: rename d0/db/d13/d37/d3c/f64 to d0/db/d2f/f9d 0 2024-09-19T06:40:39.214 INFO:tasks.workunit.client.1.smithi117.stdout:6/450: creat d1/d3/d25/f78 x:0 0 0 2024-09-19T06:40:39.215 INFO:tasks.workunit.client.0.smithi099.stdout:4/523: symlink d12/d1b/d88/lae 0 2024-09-19T06:40:39.216 INFO:tasks.workunit.client.0.smithi099.stdout:5/653: fsync d3/d16/d2f/d8c/fcc 0 2024-09-19T06:40:39.217 INFO:tasks.workunit.client.0.smithi099.stdout:3/686: creat d7/d34/d1d/d20/d75/d79/fd1 x:0 0 0 2024-09-19T06:40:39.218 INFO:tasks.workunit.client.1.smithi117.stdout:4/812: dread d3/db/f81 [0,4194304] 0 2024-09-19T06:40:39.219 INFO:tasks.workunit.client.1.smithi117.stdout:4/813: fdatasync d3/db/d20/d29/d39/f108 0 2024-09-19T06:40:39.220 INFO:tasks.workunit.client.0.smithi099.stdout:9/534: creat dd/d2c/fae x:0 0 0 2024-09-19T06:40:39.220 INFO:tasks.workunit.client.0.smithi099.stdout:8/392: getdents d4/de/d26/d2b 0 2024-09-19T06:40:39.220 INFO:tasks.workunit.client.0.smithi099.stdout:4/524: chown d12/d32/d42/c66 1 1 2024-09-19T06:40:39.221 INFO:tasks.workunit.client.0.smithi099.stdout:7/593: dwrite d7/dc7/d67/f79 [0,4194304] 0 2024-09-19T06:40:39.223 INFO:tasks.workunit.client.0.smithi099.stdout:1/475: dread d0/f29 [0,4194304] 0 2024-09-19T06:40:39.223 INFO:tasks.workunit.client.0.smithi099.stdout:5/654: fdatasync d3/d16/d2f/d34/d3c/d65/f8a 0 2024-09-19T06:40:39.225 INFO:tasks.workunit.client.0.smithi099.stdout:2/361: getdents d1/d2/d5/d13 0 2024-09-19T06:40:39.226 INFO:tasks.workunit.client.0.smithi099.stdout:5/655: chown d3/d14/lcb 228490 1 2024-09-19T06:40:39.226 INFO:tasks.workunit.client.0.smithi099.stdout:1/476: write d0/d2d/f43 [1853778,81537] 0 2024-09-19T06:40:39.227 INFO:tasks.workunit.client.0.smithi099.stdout:4/525: rmdir d12/d32/d39 39 2024-09-19T06:40:39.232 INFO:tasks.workunit.client.1.smithi117.stdout:0/486: write d11/d13/d14/f45 [1339446,42921] 0 2024-09-19T06:40:39.232 INFO:tasks.workunit.client.0.smithi099.stdout:3/687: mknod d7/d34/d1d/d20/d58/d5c/dbd/cd2 0 2024-09-19T06:40:39.233 INFO:tasks.workunit.client.0.smithi099.stdout:9/535: rename dd/d47/d40/d61/f99 to dd/d62/d76/faf 0 2024-09-19T06:40:39.233 INFO:tasks.workunit.client.0.smithi099.stdout:8/393: mknod d4/de/d14/c86 0 2024-09-19T06:40:39.234 INFO:tasks.workunit.client.0.smithi099.stdout:2/362: symlink d1/d2/d5/d13/d2c/l73 0 2024-09-19T06:40:39.235 INFO:tasks.workunit.client.0.smithi099.stdout:8/394: dread - d4/de/d26/d2b/f80 zero size 2024-09-19T06:40:39.235 INFO:tasks.workunit.client.1.smithi117.stdout:0/487: rename lf to d11/d13/d14/d2c/d53/d7e/l9f 0 2024-09-19T06:40:39.236 INFO:tasks.workunit.client.1.smithi117.stdout:0/488: fsync fd 0 2024-09-19T06:40:39.237 INFO:tasks.workunit.client.1.smithi117.stdout:4/814: dwrite d3/db/d20/fbe [0,4194304] 0 2024-09-19T06:40:39.237 INFO:tasks.workunit.client.0.smithi099.stdout:1/477: mkdir d0/d17/d32/d7b/d99 0 2024-09-19T06:40:39.237 INFO:tasks.workunit.client.0.smithi099.stdout:8/395: write d4/d66/f7d [1665857,9300] 0 2024-09-19T06:40:39.239 INFO:tasks.workunit.client.1.smithi117.stdout:4/815: chown d3/d1b/d7d/d51/d95/df4/ffa 26237995 1 2024-09-19T06:40:39.239 INFO:tasks.workunit.client.0.smithi099.stdout:3/688: dwrite d7/f5f [0,4194304] 0 2024-09-19T06:40:39.240 INFO:tasks.workunit.client.1.smithi117.stdout:4/816: write d3/d4/f40 [2303633,118142] 0 2024-09-19T06:40:39.241 INFO:tasks.workunit.client.0.smithi099.stdout:3/689: fdatasync d7/d34/d1d/d57/d76/f95 0 2024-09-19T06:40:39.242 INFO:tasks.workunit.client.1.smithi117.stdout:0/489: mknod d11/d13/d14/d2c/d70/d9e/ca0 0 2024-09-19T06:40:39.244 INFO:tasks.workunit.client.1.smithi117.stdout:6/451: dread d1/f1b [0,4194304] 0 2024-09-19T06:40:39.245 INFO:tasks.workunit.client.1.smithi117.stdout:4/817: mkdir d3/d41/d109 0 2024-09-19T06:40:39.246 INFO:tasks.workunit.client.1.smithi117.stdout:6/452: stat d1/d5/d32/d45/l69 0 2024-09-19T06:40:39.246 INFO:tasks.workunit.client.1.smithi117.stdout:0/490: rmdir d11/d13/d28/d38 39 2024-09-19T06:40:39.246 INFO:tasks.workunit.client.0.smithi099.stdout:4/526: creat d12/d1b/da4/faf x:0 0 0 2024-09-19T06:40:39.247 INFO:tasks.workunit.client.1.smithi117.stdout:4/818: rmdir d3/db/d20 39 2024-09-19T06:40:39.248 INFO:tasks.workunit.client.0.smithi099.stdout:1/478: symlink d0/d68/l9a 0 2024-09-19T06:40:39.252 INFO:tasks.workunit.client.0.smithi099.stdout:3/690: unlink d7/d34/d1d/d57/c97 0 2024-09-19T06:40:39.253 INFO:tasks.workunit.client.1.smithi117.stdout:0/491: mkdir d11/d13/d14/d16/da1 0 2024-09-19T06:40:39.253 INFO:tasks.workunit.client.1.smithi117.stdout:4/819: dread d3/db/f81 [0,4194304] 0 2024-09-19T06:40:39.254 INFO:tasks.workunit.client.0.smithi099.stdout:3/691: dread - d7/d34/d1d/d20/d58/fc7 zero size 2024-09-19T06:40:39.254 INFO:tasks.workunit.client.1.smithi117.stdout:0/492: write d11/d13/d28/f92 [561383,87127] 0 2024-09-19T06:40:39.256 INFO:tasks.workunit.client.0.smithi099.stdout:4/527: rename d12/d32/d42/d5c/f25 to d12/d1b/d73/d81/d9b/fb0 0 2024-09-19T06:40:39.256 INFO:tasks.workunit.client.0.smithi099.stdout:3/692: chown d7/d34/d1d/d36/d69/d6d/d8f/lc6 53 1 2024-09-19T06:40:39.257 INFO:tasks.workunit.client.1.smithi117.stdout:0/493: read - d11/d13/d1b/d27/d54/f8f zero size 2024-09-19T06:40:39.258 INFO:tasks.workunit.client.0.smithi099.stdout:0/498: write d0/d17/d41/f89 [25840,51552] 0 2024-09-19T06:40:39.258 INFO:tasks.workunit.client.1.smithi117.stdout:4/820: mknod d3/d4/d5f/c10a 0 2024-09-19T06:40:39.258 INFO:tasks.workunit.client.1.smithi117.stdout:6/453: dwrite d1/d5/d8/d5e/d6d/f71 [0,4194304] 0 2024-09-19T06:40:39.259 INFO:tasks.workunit.client.0.smithi099.stdout:2/363: creat d1/d2/d4d/d52/d18/f74 x:0 0 0 2024-09-19T06:40:39.259 INFO:tasks.workunit.client.0.smithi099.stdout:3/693: stat d7/d34/f51 0 2024-09-19T06:40:39.263 INFO:tasks.workunit.client.1.smithi117.stdout:0/494: unlink d11/d13/d28/f99 0 2024-09-19T06:40:39.264 INFO:tasks.workunit.client.1.smithi117.stdout:6/454: creat d1/d5/d8/d5e/d6d/f79 x:0 0 0 2024-09-19T06:40:39.267 INFO:tasks.workunit.client.0.smithi099.stdout:4/528: chown d12/d1b/f75 879 1 2024-09-19T06:40:39.267 INFO:tasks.workunit.client.0.smithi099.stdout:6/508: dwrite d1/d5/d24/d2e/d41/d4e/d54/d5d/d61/f68 [0,4194304] 0 2024-09-19T06:40:39.273 INFO:tasks.workunit.client.0.smithi099.stdout:0/499: symlink d0/db/d13/d1f/d3a/l9e 0 2024-09-19T06:40:39.273 INFO:tasks.workunit.client.0.smithi099.stdout:9/536: dread dd/f6a [0,4194304] 0 2024-09-19T06:40:39.274 INFO:tasks.workunit.client.0.smithi099.stdout:1/479: dwrite d0/d12/d54/f7e [0,4194304] 0 2024-09-19T06:40:39.276 INFO:tasks.workunit.client.0.smithi099.stdout:2/364: rename d1/d2/d4d/d52/d9/d63/c5a to d1/d2/d4d/d55/c75 0 2024-09-19T06:40:39.277 INFO:tasks.workunit.client.0.smithi099.stdout:4/529: chown d12/c70 33 1 2024-09-19T06:40:39.278 INFO:tasks.workunit.client.0.smithi099.stdout:6/509: write d1/d12/f5f [150377,42277] 0 2024-09-19T06:40:39.278 INFO:tasks.workunit.client.0.smithi099.stdout:9/537: readlink dd/d47/d40/d61/l7f 0 2024-09-19T06:40:39.282 INFO:tasks.workunit.client.0.smithi099.stdout:8/396: dread d4/d66/f76 [0,4194304] 0 2024-09-19T06:40:39.285 INFO:tasks.workunit.client.0.smithi099.stdout:3/694: dwrite d7/f5f [0,4194304] 0 2024-09-19T06:40:39.287 INFO:tasks.workunit.client.0.smithi099.stdout:9/538: mknod dd/d62/d76/d9a/cb0 0 2024-09-19T06:40:39.289 INFO:tasks.workunit.client.0.smithi099.stdout:5/656: dwrite d3/d7/fb8 [0,4194304] 0 2024-09-19T06:40:39.289 INFO:tasks.workunit.client.0.smithi099.stdout:2/365: mkdir d1/d2/d4d/d52/d18/d76 0 2024-09-19T06:40:39.290 INFO:tasks.workunit.client.0.smithi099.stdout:4/530: write d12/f1a [3207564,1762] 0 2024-09-19T06:40:39.299 INFO:tasks.workunit.client.0.smithi099.stdout:4/531: mkdir d12/d1b/db1 0 2024-09-19T06:40:39.301 INFO:tasks.workunit.client.0.smithi099.stdout:2/366: chown d1/d2/d4d/d52/d18/d27/c32 15 1 2024-09-19T06:40:39.301 INFO:tasks.workunit.client.0.smithi099.stdout:0/500: dwrite d0/db/f8d [0,4194304] 0 2024-09-19T06:40:39.302 INFO:tasks.workunit.client.0.smithi099.stdout:9/539: rename dd/d62/d78/la2 to dd/d65/lb1 0 2024-09-19T06:40:39.302 INFO:tasks.workunit.client.0.smithi099.stdout:1/480: dread d0/d12/d54/f7e [0,4194304] 0 2024-09-19T06:40:39.304 INFO:tasks.workunit.client.0.smithi099.stdout:6/510: truncate d1/f9 151223 0 2024-09-19T06:40:39.306 INFO:tasks.workunit.client.0.smithi099.stdout:2/367: chown d1/f39 29346 1 2024-09-19T06:40:39.308 INFO:tasks.workunit.client.0.smithi099.stdout:0/501: write d0/db/f48 [875907,95024] 0 2024-09-19T06:40:39.311 INFO:tasks.workunit.client.0.smithi099.stdout:9/540: mknod dd/d62/d76/cb2 0 2024-09-19T06:40:39.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:39 smithi117 ceph-mon[34564]: Updating smithi099:/var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:40:39.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:39 smithi117 ceph-mon[34564]: Updating smithi117:/var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:40:39.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:39 smithi117 ceph-mon[34564]: Reconfiguring node-exporter.smithi099 (dependencies changed)... 2024-09-19T06:40:39.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:39 smithi117 ceph-mon[34564]: Deploying daemon node-exporter.smithi099 on smithi099 2024-09-19T06:40:39.313 INFO:tasks.workunit.client.0.smithi099.stdout:4/532: creat d12/d32/d42/d5c/d9d/fb2 x:0 0 0 2024-09-19T06:40:39.313 INFO:tasks.workunit.client.0.smithi099.stdout:8/397: dwrite d4/d11/d38/f67 [0,4194304] 0 2024-09-19T06:40:39.313 INFO:tasks.workunit.client.0.smithi099.stdout:5/657: dwrite d3/d7/f3b [0,4194304] 0 2024-09-19T06:40:39.316 INFO:tasks.workunit.client.0.smithi099.stdout:3/695: dread d7/d34/d1d/d36/db8/fcc [0,4194304] 0 2024-09-19T06:40:39.317 INFO:tasks.workunit.client.0.smithi099.stdout:3/696: write d7/d34/d28/f48 [2218134,73802] 0 2024-09-19T06:40:39.319 INFO:tasks.workunit.client.0.smithi099.stdout:0/502: unlink d0/db/d36/d3f/f93 0 2024-09-19T06:40:39.322 INFO:tasks.workunit.client.0.smithi099.stdout:9/541: mknod dd/d62/d78/cb3 0 2024-09-19T06:40:39.322 INFO:tasks.workunit.client.0.smithi099.stdout:1/481: rename d0/d17/d24/d3a/d58/c93 to d0/d17/d24/d3a/c9b 0 2024-09-19T06:40:39.322 INFO:tasks.workunit.client.0.smithi099.stdout:0/503: truncate d0/db/d13/f7d 825216 0 2024-09-19T06:40:39.322 INFO:tasks.workunit.client.0.smithi099.stdout:1/482: chown d0/d17/d24 50682 1 2024-09-19T06:40:39.322 INFO:tasks.workunit.client.0.smithi099.stdout:8/398: chown d4/de/d14/c4d 46383062 1 2024-09-19T06:40:39.323 INFO:tasks.workunit.client.0.smithi099.stdout:8/399: chown d4/de 7 1 2024-09-19T06:40:39.325 INFO:tasks.workunit.client.0.smithi099.stdout:0/504: chown d0/db/d13/d59/f6c 14364 1 2024-09-19T06:40:39.328 INFO:tasks.workunit.client.0.smithi099.stdout:9/542: write dd/d2c/d5c/d64/d93/f9b [692836,33354] 0 2024-09-19T06:40:39.329 INFO:tasks.workunit.client.0.smithi099.stdout:1/483: mknod d0/d17/d24/c9c 0 2024-09-19T06:40:39.329 INFO:tasks.workunit.client.0.smithi099.stdout:4/533: read d12/d58/f96 [1312255,15692] 0 2024-09-19T06:40:39.329 INFO:tasks.workunit.client.0.smithi099.stdout:0/505: creat d0/db/d36/f9f x:0 0 0 2024-09-19T06:40:39.330 INFO:tasks.workunit.client.0.smithi099.stdout:8/400: symlink d4/de/d10/l87 0 2024-09-19T06:40:39.331 INFO:tasks.workunit.client.0.smithi099.stdout:3/697: rename d7/d34/d1d/d36/d42/f6c to d7/d34/d1d/d20/fd3 0 2024-09-19T06:40:39.333 INFO:tasks.workunit.client.0.smithi099.stdout:9/543: chown dd/d62/c94 0 1 2024-09-19T06:40:39.334 INFO:tasks.workunit.client.0.smithi099.stdout:1/484: write d0/f21 [4541457,112600] 0 2024-09-19T06:40:39.334 INFO:tasks.workunit.client.0.smithi099.stdout:2/368: dwrite d1/d2/d4d/d52/f1a [0,4194304] 0 2024-09-19T06:40:39.336 INFO:tasks.workunit.client.0.smithi099.stdout:9/544: mkdir dd/d2c/d79/db4 0 2024-09-19T06:40:39.336 INFO:tasks.workunit.client.0.smithi099.stdout:4/534: truncate d12/d1b/d73/d81/d89/f9a 486616 0 2024-09-19T06:40:39.340 INFO:tasks.workunit.client.0.smithi099.stdout:8/401: rename d4/de/f16 to d4/de/f88 0 2024-09-19T06:40:39.340 INFO:tasks.workunit.client.0.smithi099.stdout:1/485: symlink d0/l9d 0 2024-09-19T06:40:39.343 INFO:tasks.workunit.client.0.smithi099.stdout:9/545: mknod dd/d2c/d5c/d85/d8d/cb5 0 2024-09-19T06:40:39.344 INFO:tasks.workunit.client.0.smithi099.stdout:1/486: write d0/d17/d24/f46 [524211,124709] 0 2024-09-19T06:40:39.345 INFO:tasks.workunit.client.0.smithi099.stdout:5/658: write d3/d7/f71 [738610,26176] 0 2024-09-19T06:40:39.349 INFO:tasks.workunit.client.0.smithi099.stdout:8/402: truncate d4/d11/f21 3432044 0 2024-09-19T06:40:39.353 INFO:tasks.workunit.client.0.smithi099.stdout:5/659: symlink d3/d16/d2f/d34/da4/da5/le8 0 2024-09-19T06:40:39.356 INFO:tasks.workunit.client.0.smithi099.stdout:1/487: creat d0/d17/d32/d7b/d99/f9e x:0 0 0 2024-09-19T06:40:39.356 INFO:tasks.workunit.client.0.smithi099.stdout:4/535: dwrite d12/d1b/f44 [0,4194304] 0 2024-09-19T06:40:39.358 INFO:tasks.workunit.client.0.smithi099.stdout:6/511: dwrite d1/f9 [0,4194304] 0 2024-09-19T06:40:39.359 INFO:tasks.workunit.client.0.smithi099.stdout:8/403: unlink d4/de/d26/f5c 0 2024-09-19T06:40:39.366 INFO:tasks.workunit.client.0.smithi099.stdout:1/488: unlink d0/d17/d24/d75/f77 0 2024-09-19T06:40:39.368 INFO:tasks.workunit.client.0.smithi099.stdout:5/660: creat d3/d16/d2f/d34/da4/da5/dce/de5/fe9 x:0 0 0 2024-09-19T06:40:39.368 INFO:tasks.workunit.client.0.smithi099.stdout:2/369: dwrite d1/d2/d4d/d52/d18/f2f [0,4194304] 0 2024-09-19T06:40:39.369 INFO:tasks.workunit.client.0.smithi099.stdout:8/404: creat d4/de/d26/f89 x:0 0 0 2024-09-19T06:40:39.370 INFO:tasks.workunit.client.0.smithi099.stdout:3/698: dread d7/d34/d28/f48 [0,4194304] 0 2024-09-19T06:40:39.371 INFO:tasks.workunit.client.1.smithi117.stdout:0/495: creat d11/d13/d1b/fa2 x:0 0 0 2024-09-19T06:40:39.372 INFO:tasks.workunit.client.0.smithi099.stdout:3/699: dread - d7/d34/d1d/d57/d76/fba zero size 2024-09-19T06:40:39.372 INFO:tasks.workunit.client.1.smithi117.stdout:4/821: dwrite d3/d28/d2a/f9b [0,4194304] 0 2024-09-19T06:40:39.372 INFO:tasks.workunit.client.0.smithi099.stdout:6/512: mkdir d1/d5/d24/d2b/d86/d9a/da7 0 2024-09-19T06:40:39.374 INFO:tasks.workunit.client.0.smithi099.stdout:5/661: dread - d3/d16/d2f/f9a zero size 2024-09-19T06:40:39.374 INFO:tasks.workunit.client.1.smithi117.stdout:4/822: write d3/d4/f9 [2349445,115233] 0 2024-09-19T06:40:39.377 INFO:tasks.workunit.client.1.smithi117.stdout:0/496: creat d11/d13/d14/d2c/d35/fa3 x:0 0 0 2024-09-19T06:40:39.379 INFO:tasks.workunit.client.0.smithi099.stdout:6/513: chown d1/d5/d24/d2e/d41/d4e/f6d 52641021 1 2024-09-19T06:40:39.379 INFO:tasks.workunit.client.1.smithi117.stdout:0/497: write d11/f63 [4789624,71286] 0 2024-09-19T06:40:39.379 INFO:tasks.workunit.client.0.smithi099.stdout:8/405: unlink d4/d11/d23/d3f/c75 0 2024-09-19T06:40:39.380 INFO:tasks.workunit.client.1.smithi117.stdout:0/498: stat d11/f12 0 2024-09-19T06:40:39.381 INFO:tasks.workunit.client.1.smithi117.stdout:6/455: getdents d1/d3/d25/d5c 0 2024-09-19T06:40:39.384 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:39 smithi099 ceph-mon[27651]: Updating smithi099:/var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:40:39.384 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:39 smithi099 ceph-mon[27651]: Updating smithi117:/var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:40:39.384 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:39 smithi099 ceph-mon[27651]: Reconfiguring node-exporter.smithi099 (dependencies changed)... 2024-09-19T06:40:39.384 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:39 smithi099 ceph-mon[27651]: Deploying daemon node-exporter.smithi099 on smithi099 2024-09-19T06:40:39.387 INFO:tasks.workunit.client.0.smithi099.stdout:3/700: rmdir d7/d34/d1d/d36/d69/d6d 39 2024-09-19T06:40:39.388 INFO:tasks.workunit.client.1.smithi117.stdout:6/456: fdatasync d1/d14/f15 0 2024-09-19T06:40:39.389 INFO:tasks.workunit.client.1.smithi117.stdout:4/823: dread d3/d1b/d7d/d51/d95/faa [0,4194304] 0 2024-09-19T06:40:39.389 INFO:tasks.workunit.client.0.smithi099.stdout:1/489: dwrite d0/d12/d13/d37/d41/f70 [0,4194304] 0 2024-09-19T06:40:39.389 INFO:tasks.workunit.client.0.smithi099.stdout:4/536: getdents d12/d1b/d73/d81/d9b/dab 0 2024-09-19T06:40:39.394 INFO:tasks.workunit.client.1.smithi117.stdout:0/499: dwrite d11/d13/d28/f92 [0,4194304] 0 2024-09-19T06:40:39.398 INFO:tasks.workunit.client.0.smithi099.stdout:9/546: dread dd/d47/d40/f31 [0,4194304] 0 2024-09-19T06:40:39.398 INFO:tasks.workunit.client.0.smithi099.stdout:2/370: dwrite d1/f39 [0,4194304] 0 2024-09-19T06:40:39.401 INFO:tasks.workunit.client.0.smithi099.stdout:4/537: stat d12/d1b/d73/d81/d89/d91 0 2024-09-19T06:40:39.403 INFO:tasks.workunit.client.0.smithi099.stdout:5/662: dwrite d3/d2a/fb0 [4194304,4194304] 0 2024-09-19T06:40:39.404 INFO:tasks.workunit.client.0.smithi099.stdout:8/406: dwrite d4/de/d26/d2b/f80 [0,4194304] 0 2024-09-19T06:40:39.411 INFO:tasks.workunit.client.0.smithi099.stdout:3/701: creat d7/d34/d1d/d20/d75/d9d/fd4 x:0 0 0 2024-09-19T06:40:39.413 INFO:tasks.workunit.client.0.smithi099.stdout:1/490: write d0/d68/f69 [1966395,15689] 0 2024-09-19T06:40:39.416 INFO:tasks.workunit.client.1.smithi117.stdout:0/500: mknod d11/d13/d1b/d27/d37/d6d/ca4 0 2024-09-19T06:40:39.416 INFO:tasks.workunit.client.1.smithi117.stdout:5/666: sync 2024-09-19T06:40:39.417 INFO:tasks.workunit.client.1.smithi117.stdout:0/501: readlink d11/d13/d14/l51 0 2024-09-19T06:40:39.417 INFO:tasks.workunit.client.0.smithi099.stdout:5/663: creat d3/d16/d2f/d34/da4/fea x:0 0 0 2024-09-19T06:40:39.419 INFO:tasks.workunit.client.0.smithi099.stdout:8/407: dread d4/d66/f76 [0,4194304] 0 2024-09-19T06:40:39.420 INFO:tasks.workunit.client.0.smithi099.stdout:8/408: chown d4/de/d26 1149662 1 2024-09-19T06:40:39.421 INFO:tasks.workunit.client.1.smithi117.stdout:6/457: creat d1/d3/d25/f7a x:0 0 0 2024-09-19T06:40:39.422 INFO:tasks.workunit.client.0.smithi099.stdout:2/371: mkdir d1/d2/d5/d77 0 2024-09-19T06:40:39.423 INFO:tasks.workunit.client.1.smithi117.stdout:5/667: mkdir d17/d2e/d65/d88/dda 0 2024-09-19T06:40:39.424 INFO:tasks.workunit.client.0.smithi099.stdout:6/514: dwrite d1/f10 [0,4194304] 0 2024-09-19T06:40:39.424 INFO:tasks.workunit.client.0.smithi099.stdout:3/702: write d7/ff [218004,27042] 0 2024-09-19T06:40:39.425 INFO:tasks.workunit.client.1.smithi117.stdout:0/502: creat d11/d13/d28/d38/fa5 x:0 0 0 2024-09-19T06:40:39.426 INFO:tasks.workunit.client.1.smithi117.stdout:6/458: mkdir d1/d5/d32/d45/d7b 0 2024-09-19T06:40:39.427 INFO:tasks.workunit.client.1.smithi117.stdout:5/668: write d17/f74 [4267892,42836] 0 2024-09-19T06:40:39.433 INFO:tasks.workunit.client.0.smithi099.stdout:2/372: chown d1/l30 1698 1 2024-09-19T06:40:39.434 INFO:tasks.workunit.client.1.smithi117.stdout:0/503: rename l2 to d11/d13/d14/d2c/d35/la6 0 2024-09-19T06:40:39.434 INFO:tasks.workunit.client.1.smithi117.stdout:5/669: dwrite d17/d2f/d3b/fc4 [0,4194304] 0 2024-09-19T06:40:39.440 INFO:tasks.workunit.client.0.smithi099.stdout:6/515: dwrite d1/f9 [0,4194304] 0 2024-09-19T06:40:39.443 INFO:tasks.workunit.client.1.smithi117.stdout:5/670: fdatasync f3 0 2024-09-19T06:40:39.445 INFO:tasks.workunit.client.1.smithi117.stdout:6/459: creat d1/d3d/d6f/f7c x:0 0 0 2024-09-19T06:40:39.445 INFO:tasks.workunit.client.0.smithi099.stdout:5/664: dread d3/d7/f71 [0,4194304] 0 2024-09-19T06:40:39.448 INFO:tasks.workunit.client.1.smithi117.stdout:4/824: dwrite d3/d65/d66/dce/f105 [0,4194304] 0 2024-09-19T06:40:39.449 INFO:tasks.workunit.client.0.smithi099.stdout:5/665: chown d3/d16/l44 46074 1 2024-09-19T06:40:39.449 INFO:tasks.workunit.client.0.smithi099.stdout:5/666: chown d3/d16/d5e 3 1 2024-09-19T06:40:39.449 INFO:tasks.workunit.client.0.smithi099.stdout:5/667: write d3/f9 [3908923,96110] 0 2024-09-19T06:40:39.451 INFO:tasks.workunit.client.0.smithi099.stdout:5/668: write d3/d7/d90/fe6 [756444,100444] 0 2024-09-19T06:40:39.452 INFO:tasks.workunit.client.1.smithi117.stdout:5/671: symlink d17/d1b/d5d/d86/ldb 0 2024-09-19T06:40:39.452 INFO:tasks.workunit.client.1.smithi117.stdout:6/460: dread d1/d5/d32/f6b [0,4194304] 0 2024-09-19T06:40:39.454 INFO:tasks.workunit.client.1.smithi117.stdout:0/504: write d11/f96 [5129539,71403] 0 2024-09-19T06:40:39.456 INFO:tasks.workunit.client.1.smithi117.stdout:4/825: creat d3/d41/f10b x:0 0 0 2024-09-19T06:40:39.458 INFO:tasks.workunit.client.1.smithi117.stdout:6/461: getdents d1/d5/d32/d45/d7b 0 2024-09-19T06:40:39.462 INFO:tasks.workunit.client.0.smithi099.stdout:5/669: dwrite d3/d7/d90/fb5 [0,4194304] 0 2024-09-19T06:40:39.462 INFO:tasks.workunit.client.0.smithi099.stdout:3/703: dread d7/d34/d1d/d36/f4f [0,4194304] 0 2024-09-19T06:40:39.462 INFO:tasks.workunit.client.1.smithi117.stdout:5/672: link d17/d1b/d3a/lbf d17/d2e/d65/ldc 0 2024-09-19T06:40:39.464 INFO:tasks.workunit.client.0.smithi099.stdout:8/409: dread d4/de/d1c/f6b [0,4194304] 0 2024-09-19T06:40:39.464 INFO:tasks.workunit.client.1.smithi117.stdout:6/462: creat d1/d5/d8/d27/d77/f7d x:0 0 0 2024-09-19T06:40:39.464 INFO:tasks.workunit.client.1.smithi117.stdout:4/826: dwrite d3/db/ff [8388608,4194304] 0 2024-09-19T06:40:39.465 INFO:tasks.workunit.client.1.smithi117.stdout:0/505: getdents d11/d13/d14/d2c/d70 0 2024-09-19T06:40:39.466 INFO:tasks.workunit.client.1.smithi117.stdout:4/827: chown d3/db/d23 175 1 2024-09-19T06:40:39.468 INFO:tasks.workunit.client.1.smithi117.stdout:6/463: mknod d1/d5/d32/c7e 0 2024-09-19T06:40:39.471 INFO:tasks.workunit.client.0.smithi099.stdout:1/491: dread d0/f21 [0,4194304] 0 2024-09-19T06:40:39.471 INFO:tasks.workunit.client.0.smithi099.stdout:7/594: sync 2024-09-19T06:40:39.471 INFO:tasks.workunit.client.0.smithi099.stdout:0/506: sync 2024-09-19T06:40:39.471 INFO:tasks.workunit.client.1.smithi117.stdout:0/506: creat d11/d13/d14/d16/fa7 x:0 0 0 2024-09-19T06:40:39.472 INFO:tasks.workunit.client.0.smithi099.stdout:0/507: fdatasync d0/db/d27/f8b 0 2024-09-19T06:40:39.475 INFO:tasks.workunit.client.1.smithi117.stdout:5/673: dwrite d17/d1b/d3a/d3c/fd8 [0,4194304] 0 2024-09-19T06:40:39.475 INFO:tasks.workunit.client.1.smithi117.stdout:4/828: rmdir d3/db/d20 39 2024-09-19T06:40:39.477 INFO:tasks.workunit.client.0.smithi099.stdout:1/492: dwrite d0/f7d [0,4194304] 0 2024-09-19T06:40:39.478 INFO:tasks.workunit.client.1.smithi117.stdout:0/507: creat d11/d13/d1b/d4b/fa8 x:0 0 0 2024-09-19T06:40:39.480 INFO:tasks.workunit.client.1.smithi117.stdout:6/464: dwrite d1/d3/d25/f78 [0,4194304] 0 2024-09-19T06:40:39.482 INFO:tasks.workunit.client.1.smithi117.stdout:5/674: creat d17/d1b/d5d/d86/fdd x:0 0 0 2024-09-19T06:40:39.486 INFO:tasks.workunit.client.1.smithi117.stdout:4/829: creat d3/d28/d2a/f10c x:0 0 0 2024-09-19T06:40:39.490 INFO:tasks.workunit.client.1.smithi117.stdout:5/675: rename d17/d2e to d17/d1b/d3a/d3c/dcb/dde 0 2024-09-19T06:40:39.491 INFO:tasks.workunit.client.1.smithi117.stdout:4/830: fsync d3/db/f3a 0 2024-09-19T06:40:39.491 INFO:tasks.workunit.client.1.smithi117.stdout:5/676: chown d17/d1b/d3a/d3c/dcb/dde/d65/d88 279660 1 2024-09-19T06:40:39.493 INFO:tasks.workunit.client.1.smithi117.stdout:4/831: mknod d3/d65/d66/c10d 0 2024-09-19T06:40:39.494 INFO:tasks.workunit.client.1.smithi117.stdout:5/677: mkdir d17/d1b/d3a/d3c/d70/d94/ddf 0 2024-09-19T06:40:39.495 INFO:tasks.workunit.client.1.smithi117.stdout:4/832: truncate d3/d4/d5f/f7f 5023938 0 2024-09-19T06:40:39.498 INFO:tasks.workunit.client.1.smithi117.stdout:5/678: rename d17/d1b/d3a/d3c/d70/l96 to d17/d2f/d6a/le0 0 2024-09-19T06:40:39.501 INFO:tasks.workunit.client.1.smithi117.stdout:4/833: link d3/d1b/l25 d3/db/d20/d35/l10e 0 2024-09-19T06:40:39.502 INFO:tasks.workunit.client.1.smithi117.stdout:5/679: dread d17/d1b/d3a/d3c/dcb/dde/dab/fcf [0,4194304] 0 2024-09-19T06:40:39.502 INFO:tasks.workunit.client.1.smithi117.stdout:4/834: symlink d3/d65/d66/dce/l10f 0 2024-09-19T06:40:39.505 INFO:tasks.workunit.client.1.smithi117.stdout:5/680: write d17/d1b/d3a/d3c/f57 [731719,118794] 0 2024-09-19T06:40:39.507 INFO:tasks.workunit.client.1.smithi117.stdout:4/835: rename d3/db/d20/d29/d39/d4f/d8b to d3/d1b/d7d/d9f/d110 0 2024-09-19T06:40:39.507 INFO:tasks.workunit.client.1.smithi117.stdout:4/836: readlink d3/d4/d14/l52 0 2024-09-19T06:40:39.507 INFO:tasks.workunit.client.1.smithi117.stdout:5/681: creat d17/d5c/fe1 x:0 0 0 2024-09-19T06:40:39.508 INFO:tasks.workunit.client.0.smithi099.stdout:3/704: dread d7/d34/d1d/f78 [0,4194304] 0 2024-09-19T06:40:39.508 INFO:tasks.workunit.client.0.smithi099.stdout:3/705: read d7/d34/d28/fa9 [6082001,22811] 0 2024-09-19T06:40:39.509 INFO:tasks.workunit.client.1.smithi117.stdout:4/837: mknod d3/db/d20/c111 0 2024-09-19T06:40:39.510 INFO:tasks.workunit.client.1.smithi117.stdout:5/682: symlink d17/d1b/d3a/d3c/dcb/dde/d65/d88/dd0/le2 0 2024-09-19T06:40:39.511 INFO:tasks.workunit.client.1.smithi117.stdout:5/683: dread - d17/d1b/d5d/fc9 zero size 2024-09-19T06:40:39.512 INFO:tasks.workunit.client.0.smithi099.stdout:6/516: symlink d1/d5/d24/d2b/d86/la8 0 2024-09-19T06:40:39.512 INFO:tasks.workunit.client.1.smithi117.stdout:4/838: unlink d3/db/d20/d29/d39/f108 0 2024-09-19T06:40:39.513 INFO:tasks.workunit.client.0.smithi099.stdout:4/538: truncate d12/d32/f2e 127270 0 2024-09-19T06:40:39.515 INFO:tasks.workunit.client.1.smithi117.stdout:4/839: unlink d3/d28/d2a/f5e 0 2024-09-19T06:40:39.516 INFO:tasks.workunit.client.0.smithi099.stdout:8/410: mkdir d4/d8a 0 2024-09-19T06:40:39.516 INFO:tasks.workunit.client.1.smithi117.stdout:5/684: symlink d17/d1b/d3a/d3c/d70/le3 0 2024-09-19T06:40:39.516 INFO:tasks.workunit.client.0.smithi099.stdout:9/547: dwrite dd/d62/d78/f7d [0,4194304] 0 2024-09-19T06:40:39.518 INFO:tasks.workunit.client.0.smithi099.stdout:7/595: mkdir d7/d39/d7d/dd6 0 2024-09-19T06:40:39.522 INFO:tasks.workunit.client.1.smithi117.stdout:0/508: dread d11/d13/d1b/d4b/f4f [4194304,4194304] 0 2024-09-19T06:40:39.523 INFO:tasks.workunit.client.0.smithi099.stdout:1/493: unlink d0/d12/d13/f1b 0 2024-09-19T06:40:39.523 INFO:tasks.workunit.client.1.smithi117.stdout:0/509: fsync d11/d13/d1b/d4b/f68 0 2024-09-19T06:40:39.523 INFO:tasks.workunit.client.1.smithi117.stdout:4/840: dwrite d3/d1b/d63/fa8 [0,4194304] 0 2024-09-19T06:40:39.526 INFO:tasks.workunit.client.0.smithi099.stdout:4/539: read d12/d1b/f6f [158925,129810] 0 2024-09-19T06:40:39.526 INFO:tasks.workunit.client.0.smithi099.stdout:3/706: unlink d7/d34/d1d/d57/d76/f95 0 2024-09-19T06:40:39.526 INFO:tasks.workunit.client.1.smithi117.stdout:0/510: stat d11/d13/d14/d2c/d35/fa3 0 2024-09-19T06:40:39.526 INFO:tasks.workunit.client.1.smithi117.stdout:5/685: link d17/d1b/lc0 d17/d5c/db8/le4 0 2024-09-19T06:40:39.530 INFO:tasks.workunit.client.1.smithi117.stdout:0/511: mkdir d11/d13/d1b/d27/d37/da9 0 2024-09-19T06:40:39.531 INFO:tasks.workunit.client.1.smithi117.stdout:0/512: stat d11/c72 0 2024-09-19T06:40:39.533 INFO:tasks.workunit.client.0.smithi099.stdout:8/411: mknod d4/de/d1c/c8b 0 2024-09-19T06:40:39.533 INFO:tasks.workunit.client.0.smithi099.stdout:7/596: read - d7/dcf/d29/d4e/f73 zero size 2024-09-19T06:40:39.534 INFO:tasks.workunit.client.1.smithi117.stdout:5/686: rename d17/d2f to d17/d1b/d3a/d3c/dcb/dde/d65/d88/de5 0 2024-09-19T06:40:39.534 INFO:tasks.workunit.client.1.smithi117.stdout:4/841: dwrite d3/db/d20/fbe [0,4194304] 0 2024-09-19T06:40:39.534 INFO:tasks.workunit.client.0.smithi099.stdout:0/508: rmdir d0/db/d27/d38 39 2024-09-19T06:40:39.536 INFO:tasks.workunit.client.1.smithi117.stdout:0/513: write d11/d13/d1b/d4b/f4f [4802884,78812] 0 2024-09-19T06:40:39.536 INFO:tasks.workunit.client.0.smithi099.stdout:1/494: symlink d0/d17/d24/d75/l9f 0 2024-09-19T06:40:39.538 INFO:tasks.workunit.client.1.smithi117.stdout:5/687: creat d17/d1b/d5d/d7d/fe6 x:0 0 0 2024-09-19T06:40:39.540 INFO:tasks.workunit.client.0.smithi099.stdout:4/540: creat d12/d32/d42/d5c/fb3 x:0 0 0 2024-09-19T06:40:39.541 INFO:tasks.workunit.client.1.smithi117.stdout:5/688: write d17/d1b/d3a/d3c/dcb/dde/f32 [1373150,119588] 0 2024-09-19T06:40:39.542 INFO:tasks.workunit.client.1.smithi117.stdout:4/842: rmdir d3/d41 39 2024-09-19T06:40:39.543 INFO:tasks.workunit.client.1.smithi117.stdout:0/514: dwrite d11/f96 [0,4194304] 0 2024-09-19T06:40:39.544 INFO:tasks.workunit.client.0.smithi099.stdout:2/373: rename d1/d2/d4d/d52/d9/d63/c58 to d1/d2/d4d/d52/c78 0 2024-09-19T06:40:39.544 INFO:tasks.workunit.client.0.smithi099.stdout:1/495: dwrite d0/d17/d24/f6a [0,4194304] 0 2024-09-19T06:40:39.549 INFO:tasks.workunit.client.0.smithi099.stdout:5/670: creat d3/d16/d2f/d34/d3c/feb x:0 0 0 2024-09-19T06:40:39.550 INFO:tasks.workunit.client.0.smithi099.stdout:8/412: creat d4/de/d1c/f8c x:0 0 0 2024-09-19T06:40:39.550 INFO:tasks.workunit.client.1.smithi117.stdout:5/689: mkdir d17/d1b/d5d/d7d/de7 0 2024-09-19T06:40:39.550 INFO:tasks.workunit.client.0.smithi099.stdout:7/597: unlink d7/dcf/d29/d1f/fb5 0 2024-09-19T06:40:39.553 INFO:tasks.workunit.client.1.smithi117.stdout:5/690: chown d17/d1b/d3a/d3c/dcb/dde/d55/f7a 1 1 2024-09-19T06:40:39.553 INFO:tasks.workunit.client.0.smithi099.stdout:0/509: mkdir d0/db/d13/d1f/d3a/da0 0 2024-09-19T06:40:39.555 INFO:tasks.workunit.client.0.smithi099.stdout:2/374: dread d1/d2/d4d/d52/d18/d2d/f62 [0,4194304] 0 2024-09-19T06:40:39.555 INFO:tasks.workunit.client.0.smithi099.stdout:3/707: mkdir d7/d34/d1d/d36/d69/dd5 0 2024-09-19T06:40:39.556 INFO:tasks.workunit.client.0.smithi099.stdout:4/541: mkdir d12/d1b/da4/db4 0 2024-09-19T06:40:39.557 INFO:tasks.workunit.client.0.smithi099.stdout:3/708: write d7/d34/d28/fa5 [275897,15209] 0 2024-09-19T06:40:39.560 INFO:tasks.workunit.client.1.smithi117.stdout:5/691: creat d17/d1b/d3a/d3c/dcb/dde/d65/d88/de5/fe8 x:0 0 0 2024-09-19T06:40:39.562 INFO:tasks.workunit.client.1.smithi117.stdout:5/692: stat d17/d1b/d3a/d3c/dcb/dde/dab/cb6 0 2024-09-19T06:40:39.562 INFO:tasks.workunit.client.0.smithi099.stdout:4/542: dread d12/f30 [0,4194304] 0 2024-09-19T06:40:39.562 INFO:tasks.workunit.client.0.smithi099.stdout:3/709: dread d7/ff [0,4194304] 0 2024-09-19T06:40:39.562 INFO:tasks.workunit.client.0.smithi099.stdout:9/548: creat dd/d47/d40/fb6 x:0 0 0 2024-09-19T06:40:39.563 INFO:tasks.workunit.client.0.smithi099.stdout:5/671: mkdir d3/d16/d2f/d34/d3c/d65/dec 0 2024-09-19T06:40:39.565 INFO:tasks.workunit.client.1.smithi117.stdout:5/693: creat d17/d1b/fe9 x:0 0 0 2024-09-19T06:40:39.565 INFO:tasks.workunit.client.0.smithi099.stdout:8/413: mkdir d4/de/d26/d8d 0 2024-09-19T06:40:39.566 INFO:tasks.workunit.client.0.smithi099.stdout:6/517: write d1/d5/d24/d2b/f45 [36284,105093] 0 2024-09-19T06:40:39.567 INFO:tasks.workunit.client.0.smithi099.stdout:0/510: creat d0/db/d36/d3f/fa1 x:0 0 0 2024-09-19T06:40:39.568 INFO:tasks.workunit.client.0.smithi099.stdout:2/375: mkdir d1/d2/d4d/d55/d79 0 2024-09-19T06:40:39.568 INFO:tasks.workunit.client.1.smithi117.stdout:5/694: unlink d17/d1b/d3a/d3c/d70/f87 0 2024-09-19T06:40:39.571 INFO:tasks.workunit.client.0.smithi099.stdout:4/543: dwrite d12/f30 [0,4194304] 0 2024-09-19T06:40:39.571 INFO:tasks.workunit.client.0.smithi099.stdout:9/549: creat dd/d47/d68/fb7 x:0 0 0 2024-09-19T06:40:39.573 INFO:tasks.workunit.client.1.smithi117.stdout:0/515: dwrite d11/d13/d14/d16/f3a [0,4194304] 0 2024-09-19T06:40:39.573 INFO:tasks.workunit.client.1.smithi117.stdout:4/843: dwrite d3/db/d23/f57 [4194304,4194304] 0 2024-09-19T06:40:39.576 INFO:tasks.workunit.client.1.smithi117.stdout:5/695: symlink d17/d1b/d3a/d3c/dcb/dde/d65/d88/de5/d6a/lea 0 2024-09-19T06:40:39.576 INFO:tasks.workunit.client.1.smithi117.stdout:4/844: readlink d3/d1b/d63/lc3 0 2024-09-19T06:40:39.577 INFO:tasks.workunit.client.0.smithi099.stdout:6/518: mknod d1/d5/d24/d2e/d41/d4e/ca9 0 2024-09-19T06:40:39.578 INFO:tasks.workunit.client.1.smithi117.stdout:3/634: sync 2024-09-19T06:40:39.580 INFO:tasks.workunit.client.1.smithi117.stdout:0/516: mkdir d11/d13/d14/d2c/d53/d7e/daa 0 2024-09-19T06:40:39.580 INFO:tasks.workunit.client.0.smithi099.stdout:9/550: dread dd/d47/d40/f52 [0,4194304] 0 2024-09-19T06:40:39.583 INFO:tasks.workunit.client.1.smithi117.stdout:0/517: stat d11/d13/d14/d16/fa7 0 2024-09-19T06:40:39.586 INFO:tasks.workunit.client.1.smithi117.stdout:0/518: chown d11/d13/d1b/d67 387745156 1 2024-09-19T06:40:39.588 INFO:tasks.workunit.client.0.smithi099.stdout:5/672: getdents d3/d16/d2f/d34/da4/dd8 0 2024-09-19T06:40:39.589 INFO:tasks.workunit.client.1.smithi117.stdout:4/845: dwrite d3/db/d20/d4a/d7b/fde [0,4194304] 0 2024-09-19T06:40:39.590 INFO:tasks.workunit.client.0.smithi099.stdout:8/414: unlink d4/de/c56 0 2024-09-19T06:40:39.592 INFO:tasks.workunit.client.0.smithi099.stdout:1/496: getdents d0/d12/d13/d37/d41 0 2024-09-19T06:40:39.594 INFO:tasks.workunit.client.0.smithi099.stdout:9/551: write dd/d65/da3/fa6 [4468446,67860] 0 2024-09-19T06:40:39.595 INFO:tasks.workunit.client.0.smithi099.stdout:9/552: fdatasync dd/d2c/f98 0 2024-09-19T06:40:39.596 INFO:tasks.workunit.client.0.smithi099.stdout:0/511: mkdir d0/db/d27/d5d/d87/da2 0 2024-09-19T06:40:39.596 INFO:tasks.workunit.client.0.smithi099.stdout:9/553: chown dd/d62/d78/f7d 0 1 2024-09-19T06:40:39.597 INFO:tasks.workunit.client.1.smithi117.stdout:0/519: dwrite d11/d13/d14/d2c/f2f [0,4194304] 0 2024-09-19T06:40:39.597 INFO:tasks.workunit.client.0.smithi099.stdout:9/554: stat dd/fe 0 2024-09-19T06:40:39.598 INFO:tasks.workunit.client.0.smithi099.stdout:9/555: truncate dd/d2c/f54 680787 0 2024-09-19T06:40:39.599 INFO:tasks.workunit.client.0.smithi099.stdout:9/556: chown dd/d47/d40/l20 105299200 1 2024-09-19T06:40:39.600 INFO:tasks.workunit.client.0.smithi099.stdout:1/497: creat d0/d12/d13/d37/d41/fa0 x:0 0 0 2024-09-19T06:40:39.602 INFO:tasks.workunit.client.0.smithi099.stdout:7/598: link d7/f6d d7/dcf/d29/d1f/fd7 0 2024-09-19T06:40:39.602 INFO:tasks.workunit.client.0.smithi099.stdout:4/544: dread f11 [0,4194304] 0 2024-09-19T06:40:39.604 INFO:tasks.workunit.client.0.smithi099.stdout:9/557: write dd/d62/d76/faf [444169,53839] 0 2024-09-19T06:40:39.605 INFO:tasks.workunit.client.1.smithi117.stdout:0/520: dwrite d11/d13/d1b/d27/f55 [0,4194304] 0 2024-09-19T06:40:39.606 INFO:tasks.workunit.client.1.smithi117.stdout:0/521: chown d11/d13/d14/d2c 0 1 2024-09-19T06:40:39.607 INFO:tasks.workunit.client.0.smithi099.stdout:1/498: dread d0/f7d [0,4194304] 0 2024-09-19T06:40:39.607 INFO:tasks.workunit.client.0.smithi099.stdout:4/545: fdatasync d12/d32/d42/d5c/f5d 0 2024-09-19T06:40:39.609 INFO:tasks.workunit.client.0.smithi099.stdout:1/499: write d0/d17/d32/f4e [626809,50221] 0 2024-09-19T06:40:39.610 INFO:tasks.workunit.client.0.smithi099.stdout:5/673: getdents d3/d16/d2f 0 2024-09-19T06:40:39.611 INFO:tasks.workunit.client.0.smithi099.stdout:4/546: truncate d12/d1b/da4/faf 800422 0 2024-09-19T06:40:39.612 INFO:tasks.workunit.client.1.smithi117.stdout:0/522: getdents d11/d13/d14/d2c/d70/d9e 0 2024-09-19T06:40:39.613 INFO:tasks.workunit.client.0.smithi099.stdout:1/500: fdatasync d0/d12/d13/d37/f3f 0 2024-09-19T06:40:39.616 INFO:tasks.workunit.client.0.smithi099.stdout:5/674: write d3/d16/d2f/d34/d3c/feb [632274,103221] 0 2024-09-19T06:40:39.616 INFO:tasks.workunit.client.0.smithi099.stdout:5/675: write d3/d16/d5e/db1/fc3 [1031706,96621] 0 2024-09-19T06:40:39.616 INFO:tasks.workunit.client.0.smithi099.stdout:4/547: rmdir d12/d32/d42/d5c/d9d 39 2024-09-19T06:40:39.617 INFO:tasks.workunit.client.1.smithi117.stdout:0/523: link d11/d13/f17 d11/d13/d14/d2c/d53/d7e/fab 0 2024-09-19T06:40:39.618 INFO:tasks.workunit.client.0.smithi099.stdout:1/501: mknod d0/d12/d13/d37/ca1 0 2024-09-19T06:40:39.621 INFO:tasks.workunit.client.0.smithi099.stdout:5/676: creat d3/d16/d2f/d34/d3c/d65/dec/fed x:0 0 0 2024-09-19T06:40:39.624 INFO:tasks.workunit.client.0.smithi099.stdout:5/677: mknod d3/d14/cee 0 2024-09-19T06:40:39.625 INFO:tasks.workunit.client.0.smithi099.stdout:4/548: dwrite d12/d32/d42/f56 [0,4194304] 0 2024-09-19T06:40:39.626 INFO:tasks.workunit.client.1.smithi117.stdout:0/524: dwrite d11/d13/d28/f5d [0,4194304] 0 2024-09-19T06:40:39.627 INFO:tasks.workunit.client.0.smithi099.stdout:1/502: dread d0/d12/d13/d37/d48/f4b [0,4194304] 0 2024-09-19T06:40:39.629 INFO:tasks.workunit.client.1.smithi117.stdout:3/635: dread d0/f1e [4194304,4194304] 0 2024-09-19T06:40:39.629 INFO:tasks.workunit.client.1.smithi117.stdout:5/696: dwrite d17/d1b/d3a/d3c/dcb/dde/dab/fb7 [0,4194304] 0 2024-09-19T06:40:39.631 INFO:tasks.workunit.client.1.smithi117.stdout:0/525: write d11/d13/d1b/d4b/fa8 [271678,123143] 0 2024-09-19T06:40:39.631 INFO:tasks.workunit.client.1.smithi117.stdout:3/636: chown d0/d19/d2b 504684 1 2024-09-19T06:40:39.632 INFO:tasks.workunit.client.0.smithi099.stdout:1/503: rmdir d0/d17/d5b 39 2024-09-19T06:40:39.633 INFO:tasks.workunit.client.1.smithi117.stdout:3/637: chown d0/d9/d1c/l51 321 1 2024-09-19T06:40:39.638 INFO:tasks.workunit.client.1.smithi117.stdout:0/526: rename d11/d13/d1b/d27/d54/c59 to d11/d13/d7a/cac 0 2024-09-19T06:40:39.638 INFO:tasks.workunit.client.0.smithi099.stdout:1/504: creat d0/d17/d32/d7b/d99/fa2 x:0 0 0 2024-09-19T06:40:39.639 INFO:tasks.workunit.client.0.smithi099.stdout:1/505: write d0/d17/d24/f42 [1741098,48658] 0 2024-09-19T06:40:39.640 INFO:tasks.workunit.client.1.smithi117.stdout:0/527: write d11/d13/d1b/d27/f60 [3810154,116590] 0 2024-09-19T06:40:39.644 INFO:tasks.workunit.client.1.smithi117.stdout:3/638: rename d0/d8/f89 to d0/d19/d2b/d8e/fc6 0 2024-09-19T06:40:39.644 INFO:tasks.workunit.client.0.smithi099.stdout:4/549: dread d12/f50 [0,4194304] 0 2024-09-19T06:40:39.646 INFO:tasks.workunit.client.1.smithi117.stdout:0/528: mknod d11/d13/d14/d2c/d35/cad 0 2024-09-19T06:40:39.646 INFO:tasks.workunit.client.0.smithi099.stdout:2/376: truncate d1/d2/d4d/d52/d18/f2f 1441041 0 2024-09-19T06:40:39.646 INFO:tasks.workunit.client.0.smithi099.stdout:7/599: dread - d7/dcf/d29/d1f/d45/d48/fbe zero size 2024-09-19T06:40:39.648 INFO:tasks.workunit.client.0.smithi099.stdout:1/506: mkdir d0/d17/d24/d5e/d8a/da3 0 2024-09-19T06:40:39.649 INFO:tasks.workunit.client.0.smithi099.stdout:4/550: rmdir d12/d1b 39 2024-09-19T06:40:39.649 INFO:tasks.workunit.client.1.smithi117.stdout:0/529: write d11/d13/d14/d16/fa7 [481247,32606] 0 2024-09-19T06:40:39.650 INFO:tasks.workunit.client.1.smithi117.stdout:4/846: dwrite d3/d1b/d7d/f86 [0,4194304] 0 2024-09-19T06:40:39.651 INFO:tasks.workunit.client.1.smithi117.stdout:3/639: getdents d0/d9/d1c 0 2024-09-19T06:40:39.651 INFO:tasks.workunit.client.1.smithi117.stdout:5/697: write d17/d1b/d3a/d3c/d70/d94/fcd [2091924,3212] 0 2024-09-19T06:40:39.654 INFO:tasks.workunit.client.0.smithi099.stdout:2/377: unlink d1/d2/d4d/d52/d36/c44 0 2024-09-19T06:40:39.654 INFO:tasks.workunit.client.0.smithi099.stdout:9/558: truncate dd/d65/da3/fa6 2665430 0 2024-09-19T06:40:39.655 INFO:tasks.workunit.client.1.smithi117.stdout:4/847: readlink d3/d1b/d63/d84/ld7 0 2024-09-19T06:40:39.655 INFO:tasks.workunit.client.1.smithi117.stdout:3/640: truncate d0/d9/f9a 835730 0 2024-09-19T06:40:39.657 INFO:tasks.workunit.client.1.smithi117.stdout:3/641: chown d0/d19/d2b/c84 248 1 2024-09-19T06:40:39.657 INFO:tasks.workunit.client.1.smithi117.stdout:0/530: mknod d11/d13/d1b/d67/cae 0 2024-09-19T06:40:39.657 INFO:tasks.workunit.client.0.smithi099.stdout:1/507: dwrite d0/d12/d13/d37/d41/fa0 [0,4194304] 0 2024-09-19T06:40:39.657 INFO:tasks.workunit.client.0.smithi099.stdout:9/559: write dd/f5d [1575707,79023] 0 2024-09-19T06:40:39.658 INFO:tasks.workunit.client.1.smithi117.stdout:3/642: fsync d0/d19/d2b/f9c 0 2024-09-19T06:40:39.659 INFO:tasks.workunit.client.0.smithi099.stdout:5/678: rmdir d3/d16/d2f/d34/d3c/d65 39 2024-09-19T06:40:39.662 INFO:tasks.workunit.client.0.smithi099.stdout:1/508: write d0/d17/d32/f50 [1604483,84165] 0 2024-09-19T06:40:39.662 INFO:tasks.workunit.client.0.smithi099.stdout:5/679: write d3/d1f/fd3 [374477,40053] 0 2024-09-19T06:40:39.666 INFO:tasks.workunit.client.0.smithi099.stdout:9/560: creat dd/d47/fb8 x:0 0 0 2024-09-19T06:40:39.668 INFO:tasks.workunit.client.1.smithi117.stdout:3/643: rmdir d0/d9/d4e/db4 39 2024-09-19T06:40:39.668 INFO:tasks.workunit.client.0.smithi099.stdout:1/509: mkdir d0/d17/d24/d3a/da4 0 2024-09-19T06:40:39.670 INFO:tasks.workunit.client.1.smithi117.stdout:0/531: creat d11/d13/d1b/d27/d37/d9d/faf x:0 0 0 2024-09-19T06:40:39.671 INFO:tasks.workunit.client.0.smithi099.stdout:7/600: mkdir d7/dcf/d29/d1f/d45/d48/d63/d75/dd8 0 2024-09-19T06:40:39.671 INFO:tasks.workunit.client.0.smithi099.stdout:0/512: dread d0/db/f86 [0,4194304] 0 2024-09-19T06:40:39.672 INFO:tasks.workunit.client.1.smithi117.stdout:5/698: rmdir d17/d1b/d3a/d3c/d70/d94/ddf 0 2024-09-19T06:40:39.672 INFO:tasks.workunit.client.0.smithi099.stdout:4/551: creat d12/fb5 x:0 0 0 2024-09-19T06:40:39.673 INFO:tasks.workunit.client.1.smithi117.stdout:3/644: mkdir d0/d3d/d48/dc7 0 2024-09-19T06:40:39.675 INFO:tasks.workunit.client.1.smithi117.stdout:3/645: stat d0/d19/fb9 0 2024-09-19T06:40:39.675 INFO:tasks.workunit.client.1.smithi117.stdout:4/848: dwrite d3/db/d20/f36 [0,4194304] 0 2024-09-19T06:40:39.676 INFO:tasks.workunit.client.0.smithi099.stdout:1/510: rename d0/d17/d24/d5e/l95 to d0/d17/d32/d7b/la5 0 2024-09-19T06:40:39.678 INFO:tasks.workunit.client.0.smithi099.stdout:0/513: creat d0/db/d13/d37/d3c/d3e/fa3 x:0 0 0 2024-09-19T06:40:39.679 INFO:tasks.workunit.client.1.smithi117.stdout:0/532: creat d11/d13/d14/d2c/d53/d7e/daa/fb0 x:0 0 0 2024-09-19T06:40:39.680 INFO:tasks.workunit.client.0.smithi099.stdout:4/552: truncate d12/d32/f5b 9363871 0 2024-09-19T06:40:39.680 INFO:tasks.workunit.client.1.smithi117.stdout:5/699: dread d17/d1b/d3a/f3e [0,4194304] 0 2024-09-19T06:40:39.680 INFO:tasks.workunit.client.0.smithi099.stdout:7/601: rename d7/dcf/f51 to d7/dcf/d29/d34/fd9 0 2024-09-19T06:40:39.681 INFO:tasks.workunit.client.0.smithi099.stdout:1/511: read d0/d2d/f96 [126880,70955] 0 2024-09-19T06:40:39.682 INFO:tasks.workunit.client.0.smithi099.stdout:0/514: mkdir d0/db/d13/d47/d75/da4 0 2024-09-19T06:40:39.682 INFO:tasks.workunit.client.1.smithi117.stdout:4/849: unlink d3/db/d20/d29/l64 0 2024-09-19T06:40:39.683 INFO:tasks.workunit.client.0.smithi099.stdout:2/378: write d1/d2/d4d/d52/d9/f6f [4979664,4452] 0 2024-09-19T06:40:39.684 INFO:tasks.workunit.client.1.smithi117.stdout:5/700: chown d17/d1b/lc0 561526 1 2024-09-19T06:40:39.685 INFO:tasks.workunit.client.1.smithi117.stdout:0/533: creat d11/d13/d28/d38/d5b/fb1 x:0 0 0 2024-09-19T06:40:39.686 INFO:tasks.workunit.client.0.smithi099.stdout:4/553: write d12/d1b/d73/d81/d89/f9a [238730,50402] 0 2024-09-19T06:40:39.686 INFO:tasks.workunit.client.0.smithi099.stdout:7/602: mkdir d7/dcf/d29/d1f/d45/d48/dda 0 2024-09-19T06:40:39.687 INFO:tasks.workunit.client.0.smithi099.stdout:1/512: mknod d0/d17/ca6 0 2024-09-19T06:40:39.687 INFO:tasks.workunit.client.1.smithi117.stdout:3/646: truncate d0/d3d/d48/fb1 124563 0 2024-09-19T06:40:39.687 INFO:tasks.workunit.client.1.smithi117.stdout:4/850: symlink d3/db/d20/d4a/d7b/l112 0 2024-09-19T06:40:39.688 INFO:tasks.workunit.client.0.smithi099.stdout:5/680: write d3/d2a/f8b [638100,72111] 0 2024-09-19T06:40:39.688 INFO:tasks.workunit.client.1.smithi117.stdout:5/701: rmdir d17/d1b/d3a/d3c/dcb/dde/d65/d88/dd0 39 2024-09-19T06:40:39.689 INFO:tasks.workunit.client.1.smithi117.stdout:3/647: chown d0/d9/d4e/fbe 528670364 1 2024-09-19T06:40:39.690 INFO:tasks.workunit.client.1.smithi117.stdout:0/534: unlink d11/d13/d1b/d4b/f68 0 2024-09-19T06:40:39.691 INFO:tasks.workunit.client.1.smithi117.stdout:3/648: dread - d0/d9/d1c/f60 zero size 2024-09-19T06:40:39.693 INFO:tasks.workunit.client.1.smithi117.stdout:0/535: write d11/d13/d1b/d27/d54/f57 [993637,96294] 0 2024-09-19T06:40:39.694 INFO:tasks.workunit.client.1.smithi117.stdout:5/702: dread d17/d1b/d3a/d3c/d70/d94/fcd [0,4194304] 0 2024-09-19T06:40:39.694 INFO:tasks.workunit.client.1.smithi117.stdout:3/649: dread - d0/d8/d7f/fad zero size 2024-09-19T06:40:39.695 INFO:tasks.workunit.client.1.smithi117.stdout:4/851: getdents d3/db/d20/d29/d39/d4f 0 2024-09-19T06:40:39.697 INFO:tasks.workunit.client.0.smithi099.stdout:9/561: dread dd/d47/f3b [0,4194304] 0 2024-09-19T06:40:39.697 INFO:tasks.workunit.client.0.smithi099.stdout:0/515: mknod d0/db/d27/d5d/ca5 0 2024-09-19T06:40:39.698 INFO:tasks.workunit.client.0.smithi099.stdout:0/516: chown d0/f1b 234319 1 2024-09-19T06:40:39.698 INFO:tasks.workunit.client.0.smithi099.stdout:9/562: chown dd/d47/d68/f9c 10192922 1 2024-09-19T06:40:39.699 INFO:tasks.workunit.client.0.smithi099.stdout:5/681: mknod d3/d7/d90/cef 0 2024-09-19T06:40:39.700 INFO:tasks.workunit.client.0.smithi099.stdout:2/379: creat d1/d2/f7a x:0 0 0 2024-09-19T06:40:39.700 INFO:tasks.workunit.client.0.smithi099.stdout:9/563: read dd/d65/da3/fa6 [2485113,6011] 0 2024-09-19T06:40:39.701 INFO:tasks.workunit.client.1.smithi117.stdout:5/703: creat d17/d1b/d3a/d3c/d70/d94/feb x:0 0 0 2024-09-19T06:40:39.701 INFO:tasks.workunit.client.0.smithi099.stdout:7/603: creat d7/dc7/fdb x:0 0 0 2024-09-19T06:40:39.702 INFO:tasks.workunit.client.0.smithi099.stdout:1/513: truncate d0/d17/d32/f4d 577590 0 2024-09-19T06:40:39.702 INFO:tasks.workunit.client.0.smithi099.stdout:2/380: truncate d1/d2/f64 846614 0 2024-09-19T06:40:39.703 INFO:tasks.workunit.client.0.smithi099.stdout:7/604: write d7/dc7/f9b [3698937,87237] 0 2024-09-19T06:40:39.704 INFO:tasks.workunit.client.0.smithi099.stdout:0/517: symlink d0/d17/la6 0 2024-09-19T06:40:39.704 INFO:tasks.workunit.client.1.smithi117.stdout:4/852: dwrite d3/d4/d5f/f7f [4194304,4194304] 0 2024-09-19T06:40:39.705 INFO:tasks.workunit.client.0.smithi099.stdout:2/381: write d1/d2/d4d/d52/fa [2709071,19365] 0 2024-09-19T06:40:39.706 INFO:tasks.workunit.client.0.smithi099.stdout:0/518: chown d0/db/l26 2249 1 2024-09-19T06:40:39.706 INFO:tasks.workunit.client.0.smithi099.stdout:9/564: creat dd/d62/d76/fb9 x:0 0 0 2024-09-19T06:40:39.707 INFO:tasks.workunit.client.1.smithi117.stdout:4/853: read d3/d28/d2a/f9b [4065582,126727] 0 2024-09-19T06:40:39.708 INFO:tasks.workunit.client.0.smithi099.stdout:4/554: link d12/d32/d42/c66 d12/d32/d42/d5c/d9d/cb6 0 2024-09-19T06:40:39.710 INFO:tasks.workunit.client.0.smithi099.stdout:9/565: dread - dd/d47/fb8 zero size 2024-09-19T06:40:39.711 INFO:tasks.workunit.client.0.smithi099.stdout:2/382: symlink d1/d2/d4d/d55/l7b 0 2024-09-19T06:40:39.713 INFO:tasks.workunit.client.0.smithi099.stdout:5/682: rename d3/d16/d2f/d34/d3c/d65/dd5/fe4 to d3/d16/d2f/d34/d3c/de1/ff0 0 2024-09-19T06:40:39.715 INFO:tasks.workunit.client.0.smithi099.stdout:9/566: write dd/d2c/d5c/f97 [87252,73656] 0 2024-09-19T06:40:39.715 INFO:tasks.workunit.client.0.smithi099.stdout:4/555: rmdir d12/d58 39 2024-09-19T06:40:39.716 INFO:tasks.workunit.client.1.smithi117.stdout:3/650: rename d0/d8/d7f/d40/f67 to d0/d19/d2b/fc8 0 2024-09-19T06:40:39.717 INFO:tasks.workunit.client.1.smithi117.stdout:4/854: mknod d3/d1b/d7d/c113 0 2024-09-19T06:40:39.718 INFO:tasks.workunit.client.0.smithi099.stdout:9/567: chown dd/d62/d76/d9a 17 1 2024-09-19T06:40:39.718 INFO:tasks.workunit.client.1.smithi117.stdout:3/651: mkdir d0/d9/d4e/d9e/dc9 0 2024-09-19T06:40:39.720 INFO:tasks.workunit.client.0.smithi099.stdout:0/519: creat d0/fa7 x:0 0 0 2024-09-19T06:40:39.722 INFO:tasks.workunit.client.0.smithi099.stdout:7/605: dwrite d7/f41 [4194304,4194304] 0 2024-09-19T06:40:39.723 INFO:tasks.workunit.client.1.smithi117.stdout:0/536: truncate d11/d13/d14/d16/f4a 884420 0 2024-09-19T06:40:39.723 INFO:tasks.workunit.client.0.smithi099.stdout:4/556: symlink d12/d1b/d73/d81/d9b/lb7 0 2024-09-19T06:40:39.723 INFO:tasks.workunit.client.1.smithi117.stdout:4/855: dwrite d3/db/d20/f36 [0,4194304] 0 2024-09-19T06:40:39.724 INFO:tasks.workunit.client.1.smithi117.stdout:3/652: rmdir d0/d8/d7f 39 2024-09-19T06:40:39.724 INFO:tasks.workunit.client.0.smithi099.stdout:9/568: rmdir dd/d2c/d5c/d64 39 2024-09-19T06:40:39.727 INFO:tasks.workunit.client.0.smithi099.stdout:0/520: creat d0/db/d13/d1f/d3a/fa8 x:0 0 0 2024-09-19T06:40:39.727 INFO:tasks.workunit.client.1.smithi117.stdout:4/856: read d3/db/f43 [5638437,20542] 0 2024-09-19T06:40:39.728 INFO:tasks.workunit.client.0.smithi099.stdout:2/383: getdents d1/d2/d4d/d52/d9/d63 0 2024-09-19T06:40:39.729 INFO:tasks.workunit.client.0.smithi099.stdout:4/557: symlink d12/d32/d42/d97/lb8 0 2024-09-19T06:40:39.729 INFO:tasks.workunit.client.1.smithi117.stdout:0/537: dread d11/d13/d1b/d27/f55 [0,4194304] 0 2024-09-19T06:40:39.729 INFO:tasks.workunit.client.1.smithi117.stdout:4/857: write d3/d1b/d63/fa1 [1144332,1494] 0 2024-09-19T06:40:39.731 INFO:tasks.workunit.client.1.smithi117.stdout:0/538: dread - d11/d13/d14/d2c/d35/fa3 zero size 2024-09-19T06:40:39.733 INFO:tasks.workunit.client.0.smithi099.stdout:7/606: mkdir d7/dcf/d29/d1f/d45/d48/ddc 0 2024-09-19T06:40:39.733 INFO:tasks.workunit.client.0.smithi099.stdout:0/521: symlink d0/db/d13/d37/la9 0 2024-09-19T06:40:39.734 INFO:tasks.workunit.client.1.smithi117.stdout:5/704: dread d17/d1b/d3a/d3c/d46/f97 [0,4194304] 0 2024-09-19T06:40:39.735 INFO:tasks.workunit.client.1.smithi117.stdout:3/653: link d0/d19/d9b/cc2 d0/d8/d7f/cca 0 2024-09-19T06:40:39.736 INFO:tasks.workunit.client.0.smithi099.stdout:1/514: dread d0/d2d/f43 [0,4194304] 0 2024-09-19T06:40:39.736 INFO:tasks.workunit.client.0.smithi099.stdout:4/558: link d12/f38 d12/d1b/da4/fb9 0 2024-09-19T06:40:39.737 INFO:tasks.workunit.client.1.smithi117.stdout:5/705: creat d17/d5c/fec x:0 0 0 2024-09-19T06:40:39.737 INFO:tasks.workunit.client.0.smithi099.stdout:4/559: fdatasync d12/d32/d42/d5c/d51/f7f 0 2024-09-19T06:40:39.738 INFO:tasks.workunit.client.1.smithi117.stdout:0/539: read d11/d13/d1b/d27/d37/f58 [3724494,40585] 0 2024-09-19T06:40:39.738 INFO:tasks.workunit.client.1.smithi117.stdout:3/654: creat d0/d8/d7f/fcb x:0 0 0 2024-09-19T06:40:39.739 INFO:tasks.workunit.client.0.smithi099.stdout:0/522: write d0/db/d13/d1f/d4a/f7b [3180092,87562] 0 2024-09-19T06:40:39.740 INFO:tasks.workunit.client.1.smithi117.stdout:4/858: getdents d3/d4/d14 0 2024-09-19T06:40:39.741 INFO:tasks.workunit.client.1.smithi117.stdout:3/655: write d0/faf [447832,31357] 0 2024-09-19T06:40:39.741 INFO:tasks.workunit.client.0.smithi099.stdout:1/515: truncate d0/db/f31 257072 0 2024-09-19T06:40:39.742 INFO:tasks.workunit.client.1.smithi117.stdout:5/706: write d17/d1b/d3a/d3c/dcb/dde/dab/fb7 [4124708,129345] 0 2024-09-19T06:40:39.747 INFO:tasks.workunit.client.1.smithi117.stdout:2/615: sync 2024-09-19T06:40:39.747 INFO:tasks.workunit.client.0.smithi099.stdout:4/560: dwrite d12/f1a [0,4194304] 0 2024-09-19T06:40:39.749 INFO:tasks.workunit.client.0.smithi099.stdout:7/607: getdents d7/dcf/d29/d34/d8f 0 2024-09-19T06:40:39.749 INFO:tasks.workunit.client.1.smithi117.stdout:0/540: dwrite d11/d13/d14/d2c/f36 [0,4194304] 0 2024-09-19T06:40:39.750 INFO:tasks.workunit.client.0.smithi099.stdout:5/683: dwrite d3/d16/d2f/d34/d3c/f6d [0,4194304] 0 2024-09-19T06:40:39.752 INFO:tasks.workunit.client.1.smithi117.stdout:5/707: fdatasync d17/d5c/f69 0 2024-09-19T06:40:39.752 INFO:tasks.workunit.client.1.smithi117.stdout:2/616: symlink d0/d12/le5 0 2024-09-19T06:40:39.754 INFO:tasks.workunit.client.1.smithi117.stdout:0/541: unlink f0 0 2024-09-19T06:40:39.755 INFO:tasks.workunit.client.1.smithi117.stdout:5/708: chown d17/d1b/d3a/d3c/dcb/dde/d65/d88/de5/c4d 353 1 2024-09-19T06:40:39.759 INFO:tasks.workunit.client.1.smithi117.stdout:3/656: rename d0/d19/d9b to d0/d9/d4e/db4/dcc 0 2024-09-19T06:40:39.763 INFO:tasks.workunit.client.0.smithi099.stdout:4/561: rmdir d12/d1b/d73/d81 39 2024-09-19T06:40:39.764 INFO:tasks.workunit.client.1.smithi117.stdout:5/709: creat d17/d1b/d3a/d3c/dcb/dde/d65/d88/de5/d6a/fed x:0 0 0 2024-09-19T06:40:39.765 INFO:tasks.workunit.client.1.smithi117.stdout:2/617: rename d0/d7/d58/da8/daa to d0/d7/d1e/d20/dbc/de6 0 2024-09-19T06:40:39.767 INFO:tasks.workunit.client.1.smithi117.stdout:3/657: creat d0/d9/d4e/d9e/fcd x:0 0 0 2024-09-19T06:40:39.770 INFO:tasks.workunit.client.1.smithi117.stdout:1/593: sync 2024-09-19T06:40:39.770 INFO:tasks.workunit.client.1.smithi117.stdout:7/640: sync 2024-09-19T06:40:39.770 INFO:tasks.workunit.client.1.smithi117.stdout:8/643: sync 2024-09-19T06:40:39.770 INFO:tasks.workunit.client.1.smithi117.stdout:6/465: sync 2024-09-19T06:40:39.770 INFO:tasks.workunit.client.1.smithi117.stdout:9/625: sync 2024-09-19T06:40:39.770 INFO:tasks.workunit.client.0.smithi099.stdout:5/684: write d3/d16/f58 [925811,9313] 0 2024-09-19T06:40:39.771 INFO:tasks.workunit.client.0.smithi099.stdout:9/569: dwrite dd/d2c/d79/f7c [0,4194304] 0 2024-09-19T06:40:39.771 INFO:tasks.workunit.client.0.smithi099.stdout:7/608: truncate d7/dc7/f7f 98457 0 2024-09-19T06:40:39.772 INFO:tasks.workunit.client.0.smithi099.stdout:1/516: dwrite d0/d17/d32/f4e [0,4194304] 0 2024-09-19T06:40:39.773 INFO:tasks.workunit.client.1.smithi117.stdout:5/710: rename d17/d1b/d3a/d3c/dcb/dde/d65/d88/de5/d3b/cbd to d17/d1b/d3a/d3c/dcb/dde/d65/d88/de5/d6a/cee 0 2024-09-19T06:40:39.773 INFO:tasks.workunit.client.1.smithi117.stdout:6/466: symlink d1/d3d/l7f 0 2024-09-19T06:40:39.773 INFO:tasks.workunit.client.0.smithi099.stdout:2/384: dwrite d1/d2/d4d/d52/d18/d2d/f62 [0,4194304] 0 2024-09-19T06:40:39.775 INFO:tasks.workunit.client.1.smithi117.stdout:2/618: rmdir d0/d12/d32/da4 39 2024-09-19T06:40:39.776 INFO:tasks.workunit.client.1.smithi117.stdout:1/594: mkdir d3/da1/db1/d93/dd0 0 2024-09-19T06:40:39.778 INFO:tasks.workunit.client.1.smithi117.stdout:5/711: write d17/d5c/f69 [1445114,3925] 0 2024-09-19T06:40:39.778 INFO:tasks.workunit.client.0.smithi099.stdout:4/562: creat d12/d32/d39/fba x:0 0 0 2024-09-19T06:40:39.780 INFO:tasks.workunit.client.1.smithi117.stdout:2/619: write d0/d64/dd9/f8b [4100822,43955] 0 2024-09-19T06:40:39.781 INFO:tasks.workunit.client.0.smithi099.stdout:9/570: symlink dd/lba 0 2024-09-19T06:40:39.783 INFO:tasks.workunit.client.0.smithi099.stdout:1/517: fdatasync d0/d17/d32/d7b/f84 0 2024-09-19T06:40:39.784 INFO:tasks.workunit.client.0.smithi099.stdout:7/609: symlink d7/dcf/d29/d1f/d45/d48/d63/d75/ldd 0 2024-09-19T06:40:39.784 INFO:tasks.workunit.client.0.smithi099.stdout:1/518: stat d0/d12/d13/d37/d41/f70 0 2024-09-19T06:40:39.786 INFO:tasks.workunit.client.1.smithi117.stdout:0/542: truncate d11/d13/d14/d2c/f2f 3881970 0 2024-09-19T06:40:39.786 INFO:tasks.workunit.client.1.smithi117.stdout:9/626: dwrite d4/d1c/d7a/d52/f3c [0,4194304] 0 2024-09-19T06:40:39.786 INFO:tasks.workunit.client.0.smithi099.stdout:1/519: truncate d0/d2d/f96 858610 0 2024-09-19T06:40:39.788 INFO:tasks.workunit.client.0.smithi099.stdout:2/385: rename d1/d2/d4d/d52/l5d to d1/d2/d5/l7c 0 2024-09-19T06:40:39.788 INFO:tasks.workunit.client.1.smithi117.stdout:6/467: dread d1/f1b [4194304,4194304] 0 2024-09-19T06:40:39.790 INFO:tasks.workunit.client.0.smithi099.stdout:0/523: dread d0/db/d13/d1f/d4a/f7b [0,4194304] 0 2024-09-19T06:40:39.790 INFO:tasks.workunit.client.1.smithi117.stdout:7/641: rename d1/d4a/d81/d24/d1c/d35/dc1 to d1/d4a/d7c/d95/db5/de2/de3 0 2024-09-19T06:40:39.790 INFO:tasks.workunit.client.1.smithi117.stdout:2/620: write d0/d7/d29/d35/d3d/f9b [595756,35177] 0 2024-09-19T06:40:39.791 INFO:tasks.workunit.client.0.smithi099.stdout:1/520: rmdir d0/d12/d54 39 2024-09-19T06:40:39.792 INFO:tasks.workunit.client.0.smithi099.stdout:1/521: write d0/d17/d32/f53 [1144499,91526] 0 2024-09-19T06:40:39.793 INFO:tasks.workunit.client.0.smithi099.stdout:4/563: creat d12/d1b/da4/db4/fbb x:0 0 0 2024-09-19T06:40:39.793 INFO:tasks.workunit.client.1.smithi117.stdout:4/859: dread d3/db/d20/d29/d39/d4f/f72 [4194304,4194304] 0 2024-09-19T06:40:39.793 INFO:tasks.workunit.client.1.smithi117.stdout:1/595: write d3/d18/f7a [3713438,110801] 0 2024-09-19T06:40:39.793 INFO:tasks.workunit.client.1.smithi117.stdout:0/543: creat d11/d13/d1b/d27/d54/fb2 x:0 0 0 2024-09-19T06:40:39.794 INFO:tasks.workunit.client.0.smithi099.stdout:2/386: mknod d1/c7d 0 2024-09-19T06:40:39.794 INFO:tasks.workunit.client.0.smithi099.stdout:9/571: dread dd/d47/f38 [0,4194304] 0 2024-09-19T06:40:39.795 INFO:tasks.workunit.client.0.smithi099.stdout:9/572: stat dd/d47/l95 0 2024-09-19T06:40:39.796 INFO:tasks.workunit.client.0.smithi099.stdout:7/610: creat d7/fde x:0 0 0 2024-09-19T06:40:39.798 INFO:tasks.workunit.client.1.smithi117.stdout:8/644: link d1d/d2a/d3f/d73/cd9 d1d/d2a/d3f/d4b/cda 0 2024-09-19T06:40:39.799 INFO:tasks.workunit.client.0.smithi099.stdout:2/387: creat d1/d2/d4d/d52/d18/d27/d5b/f7e x:0 0 0 2024-09-19T06:40:39.800 INFO:tasks.workunit.client.1.smithi117.stdout:0/544: creat d11/d13/d14/d2c/d64/fb3 x:0 0 0 2024-09-19T06:40:39.802 INFO:tasks.workunit.client.1.smithi117.stdout:2/621: chown d0/d7/d1e/d20/dbc/de6/ldb 3679 1 2024-09-19T06:40:39.802 INFO:tasks.workunit.client.1.smithi117.stdout:6/468: truncate d1/f41 855533 0 2024-09-19T06:40:39.804 INFO:tasks.workunit.client.0.smithi099.stdout:7/611: rename d7/f26 to d7/dcf/d29/d1f/d45/fdf 0 2024-09-19T06:40:39.804 INFO:tasks.workunit.client.1.smithi117.stdout:2/622: fdatasync d0/d7/d29/f5f 0 2024-09-19T06:40:39.804 INFO:tasks.workunit.client.1.smithi117.stdout:0/545: creat d11/d13/d7a/fb4 x:0 0 0 2024-09-19T06:40:39.806 INFO:tasks.workunit.client.0.smithi099.stdout:3/710: sync 2024-09-19T06:40:39.806 INFO:tasks.workunit.client.1.smithi117.stdout:7/642: creat d1/d4a/d81/fe4 x:0 0 0 2024-09-19T06:40:39.806 INFO:tasks.workunit.client.1.smithi117.stdout:4/860: write d3/d41/f10b [143805,5108] 0 2024-09-19T06:40:39.807 INFO:tasks.workunit.client.1.smithi117.stdout:0/546: write d11/f63 [1233479,129256] 0 2024-09-19T06:40:39.808 INFO:tasks.workunit.client.1.smithi117.stdout:6/469: mkdir d1/d5/d8/d80 0 2024-09-19T06:40:39.809 INFO:tasks.workunit.client.1.smithi117.stdout:1/596: link d3/d22/d2f/f62 d3/da1/db1/d93/fd1 0 2024-09-19T06:40:39.810 INFO:tasks.workunit.client.0.smithi099.stdout:3/711: rename d7/d34/d1d/d36/d69/dd5 to d7/d34/dd6 0 2024-09-19T06:40:39.810 INFO:tasks.workunit.client.1.smithi117.stdout:5/712: dread d17/d1b/f48 [0,4194304] 0 2024-09-19T06:40:39.811 INFO:tasks.workunit.client.0.smithi099.stdout:3/712: fsync d7/d34/d1d/d36/d42/f62 0 2024-09-19T06:40:39.812 INFO:tasks.workunit.client.1.smithi117.stdout:2/623: symlink d0/d64/le7 0 2024-09-19T06:40:39.812 INFO:tasks.workunit.client.1.smithi117.stdout:8/645: dread d1d/d31/fb8 [0,4194304] 0 2024-09-19T06:40:39.814 INFO:tasks.workunit.client.1.smithi117.stdout:1/597: truncate d3/d8e/fca 303046 0 2024-09-19T06:40:39.815 INFO:tasks.workunit.client.1.smithi117.stdout:4/861: mkdir d3/db/d20/d114 0 2024-09-19T06:40:39.816 INFO:tasks.workunit.client.0.smithi099.stdout:3/713: creat d7/d34/d1d/d36/d69/d6d/d8f/fd7 x:0 0 0 2024-09-19T06:40:39.817 INFO:tasks.workunit.client.1.smithi117.stdout:0/547: creat d11/d13/d1b/d67/fb5 x:0 0 0 2024-09-19T06:40:39.818 INFO:tasks.workunit.client.1.smithi117.stdout:8/646: chown d1d/d2a/d3f/d4b/d66/f74 2336 1 2024-09-19T06:40:39.818 INFO:tasks.workunit.client.1.smithi117.stdout:1/598: chown d3/d18/d23/f52 1332 1 2024-09-19T06:40:39.819 INFO:tasks.workunit.client.1.smithi117.stdout:6/470: rename d1/d3/c59 to d1/d3/d25/d5c/c81 0 2024-09-19T06:40:39.821 INFO:tasks.workunit.client.1.smithi117.stdout:7/643: creat d1/d4a/d81/d24/d1c/d35/d4f/d9b/fe5 x:0 0 0 2024-09-19T06:40:39.822 INFO:tasks.workunit.client.1.smithi117.stdout:0/548: fdatasync d11/d13/d14/d2c/d35/d3e/f74 0 2024-09-19T06:40:39.823 INFO:tasks.workunit.client.1.smithi117.stdout:2/624: rename d0/d64/f94 to d0/d7/d1e/d20/dc9/fe8 0 2024-09-19T06:40:39.825 INFO:tasks.workunit.client.0.smithi099.stdout:9/573: write dd/f5b [800459,10758] 0 2024-09-19T06:40:39.825 INFO:tasks.workunit.client.1.smithi117.stdout:8/647: mknod d1d/d1e/d53/d6e/cdb 0 2024-09-19T06:40:39.828 INFO:tasks.workunit.client.1.smithi117.stdout:2/625: truncate d0/d7/fba 1094313 0 2024-09-19T06:40:39.828 INFO:tasks.workunit.client.1.smithi117.stdout:9/627: dread d4/f19 [0,4194304] 0 2024-09-19T06:40:39.828 INFO:tasks.workunit.client.1.smithi117.stdout:8/648: chown d1d/d2a/d3f/d4b/d5f/fd3 199131 1 2024-09-19T06:40:39.828 INFO:tasks.workunit.client.1.smithi117.stdout:3/658: dread d0/f63 [0,4194304] 0 2024-09-19T06:40:39.828 INFO:tasks.workunit.client.1.smithi117.stdout:6/471: mknod d1/d5/d32/c82 0 2024-09-19T06:40:39.828 INFO:tasks.workunit.client.0.smithi099.stdout:5/685: dwrite d3/f25 [4194304,4194304] 0 2024-09-19T06:40:39.830 INFO:tasks.workunit.client.1.smithi117.stdout:7/644: rmdir d1/d4a/d7c 39 2024-09-19T06:40:39.830 INFO:tasks.workunit.client.0.smithi099.stdout:3/714: dwrite d7/d34/f88 [0,4194304] 0 2024-09-19T06:40:39.831 INFO:tasks.workunit.client.1.smithi117.stdout:6/472: truncate d1/d3/f3e 449278 0 2024-09-19T06:40:39.831 INFO:tasks.workunit.client.1.smithi117.stdout:7/645: stat d1/d4a/d81/f2a 0 2024-09-19T06:40:39.832 INFO:tasks.workunit.client.0.smithi099.stdout:2/388: dread d1/d2/d5/f40 [0,4194304] 0 2024-09-19T06:40:39.833 INFO:tasks.workunit.client.0.smithi099.stdout:1/522: dread d0/d17/d32/f6c [0,4194304] 0 2024-09-19T06:40:39.834 INFO:tasks.workunit.client.1.smithi117.stdout:0/549: mknod d11/d13/d14/d2c/d70/cb6 0 2024-09-19T06:40:39.835 INFO:tasks.workunit.client.1.smithi117.stdout:3/659: dread d0/d9/f90 [0,4194304] 0 2024-09-19T06:40:39.836 INFO:tasks.workunit.client.0.smithi099.stdout:5/686: symlink d3/d16/d7d/lf1 0 2024-09-19T06:40:39.837 INFO:tasks.workunit.client.0.smithi099.stdout:3/715: mknod d7/d34/d1d/d20/d75/cd8 0 2024-09-19T06:40:39.838 INFO:tasks.workunit.client.1.smithi117.stdout:0/550: write d11/d13/d14/d2c/f32 [953812,79441] 0 2024-09-19T06:40:39.839 INFO:tasks.workunit.client.0.smithi099.stdout:2/389: rename d1/f5f to d1/f7f 0 2024-09-19T06:40:39.841 INFO:tasks.workunit.client.1.smithi117.stdout:0/551: write d11/d13/d1b/fa2 [962459,120823] 0 2024-09-19T06:40:39.841 INFO:tasks.workunit.client.1.smithi117.stdout:1/599: rename d3/l57 to d3/d18/d23/d74/dcf/ld2 0 2024-09-19T06:40:39.844 INFO:tasks.workunit.client.1.smithi117.stdout:5/713: link d17/l2b d17/d1b/d5d/d7d/de7/lef 0 2024-09-19T06:40:39.845 INFO:tasks.workunit.client.1.smithi117.stdout:9/628: creat d4/d8/d6a/d82/dc8/fd6 x:0 0 0 2024-09-19T06:40:39.845 INFO:tasks.workunit.client.0.smithi099.stdout:3/716: link d7/d34/d1d/d36/c3e d7/d34/d1d/d36/db8/cd9 0 2024-09-19T06:40:39.846 INFO:tasks.workunit.client.1.smithi117.stdout:2/626: creat d0/d7/d29/d35/d61/fe9 x:0 0 0 2024-09-19T06:40:39.848 INFO:tasks.workunit.client.1.smithi117.stdout:7/646: dwrite d1/d4a/d81/d24/d26/f37 [0,4194304] 0 2024-09-19T06:40:39.848 INFO:tasks.workunit.client.1.smithi117.stdout:8/649: mknod d1d/d2a/d3f/d4b/d5f/cdc 0 2024-09-19T06:40:39.848 INFO:tasks.workunit.client.1.smithi117.stdout:6/473: creat d1/d3d/f83 x:0 0 0 2024-09-19T06:40:39.849 INFO:tasks.workunit.client.0.smithi099.stdout:1/523: dwrite d0/d12/f30 [0,4194304] 0 2024-09-19T06:40:39.849 INFO:tasks.workunit.client.0.smithi099.stdout:3/717: write d7/d34/d1d/d36/f29 [4300396,112568] 0 2024-09-19T06:40:39.849 INFO:tasks.workunit.client.0.smithi099.stdout:5/687: dread d3/d14/fac [0,4194304] 0 2024-09-19T06:40:39.851 INFO:tasks.workunit.client.1.smithi117.stdout:6/474: fdatasync d1/d14/f23 0 2024-09-19T06:40:39.851 INFO:tasks.workunit.client.1.smithi117.stdout:9/629: dread - d4/d1c/d54/da5/daf/fce zero size 2024-09-19T06:40:39.851 INFO:tasks.workunit.client.0.smithi099.stdout:3/718: truncate d7/d34/f3a 5012018 0 2024-09-19T06:40:39.852 INFO:tasks.workunit.client.0.smithi099.stdout:5/688: stat d3/d16/d2f/d34/d3c/feb 0 2024-09-19T06:40:39.855 INFO:tasks.workunit.client.1.smithi117.stdout:0/552: mknod d11/d13/d14/d2c/d35/d3e/cb7 0 2024-09-19T06:40:39.855 INFO:tasks.workunit.client.0.smithi099.stdout:3/719: unlink d7/f55 0 2024-09-19T06:40:39.856 INFO:tasks.workunit.client.1.smithi117.stdout:0/553: write d11/d13/d28/f5d [1368533,68411] 0 2024-09-19T06:40:39.857 INFO:tasks.workunit.client.1.smithi117.stdout:7/647: symlink d1/d4a/d81/d24/d26/d44/le6 0 2024-09-19T06:40:39.857 INFO:tasks.workunit.client.0.smithi099.stdout:5/689: creat d3/d16/d2f/d34/da4/da5/ff2 x:0 0 0 2024-09-19T06:40:39.859 INFO:tasks.workunit.client.1.smithi117.stdout:9/630: mkdir d4/d17/dd7 0 2024-09-19T06:40:39.860 INFO:tasks.workunit.client.0.smithi099.stdout:2/390: truncate d1/d2/d4d/d52/d18/d27/f48 2314948 0 2024-09-19T06:40:39.861 INFO:tasks.workunit.client.0.smithi099.stdout:1/524: dread d0/d68/f1d [0,4194304] 0 2024-09-19T06:40:39.862 INFO:tasks.workunit.client.1.smithi117.stdout:3/660: creat d0/d8/d7f/d40/fce x:0 0 0 2024-09-19T06:40:39.864 INFO:tasks.workunit.client.1.smithi117.stdout:0/554: write d11/d13/d14/f49 [2509258,84225] 0 2024-09-19T06:40:39.865 INFO:tasks.workunit.client.0.smithi099.stdout:3/720: dwrite d7/d34/d1d/d20/d58/d5c/f99 [0,4194304] 0 2024-09-19T06:40:39.867 INFO:tasks.workunit.client.0.smithi099.stdout:2/391: creat d1/d2/d4d/d52/f80 x:0 0 0 2024-09-19T06:40:39.868 INFO:tasks.workunit.client.0.smithi099.stdout:1/525: symlink d0/d17/d24/d3a/d58/d8d/la7 0 2024-09-19T06:40:39.868 INFO:tasks.workunit.client.0.smithi099.stdout:5/690: dread d3/d1f/f91 [0,4194304] 0 2024-09-19T06:40:39.869 INFO:tasks.workunit.client.0.smithi099.stdout:2/392: fsync d1/d2/d4d/d52/f1a 0 2024-09-19T06:40:39.869 INFO:tasks.workunit.client.1.smithi117.stdout:2/627: link d0/d7/d29/d35/d3d/d72/fc0 d0/d12/fea 0 2024-09-19T06:40:39.869 INFO:tasks.workunit.client.1.smithi117.stdout:9/631: rename d4/d1c/d7a/d52/d8d/d98 to d4/d1c/d54/dd8 0 2024-09-19T06:40:39.870 INFO:tasks.workunit.client.1.smithi117.stdout:8/650: getdents d1d/d2a/d3f/d4b/d5f/dbf 0 2024-09-19T06:40:39.872 INFO:tasks.workunit.client.1.smithi117.stdout:6/475: dwrite d1/d3/f50 [0,4194304] 0 2024-09-19T06:40:39.874 INFO:tasks.workunit.client.1.smithi117.stdout:7/648: creat d1/d4a/d81/d24/fe7 x:0 0 0 2024-09-19T06:40:39.875 INFO:tasks.workunit.client.1.smithi117.stdout:3/661: mkdir d0/d9/d4e/dcf 0 2024-09-19T06:40:39.879 INFO:tasks.workunit.client.1.smithi117.stdout:5/714: dwrite d17/d1b/d3a/d3c/dcb/dde/dab/fad [0,4194304] 0 2024-09-19T06:40:39.879 INFO:tasks.workunit.client.1.smithi117.stdout:1/600: write d3/d18/d23/f34 [727001,105506] 0 2024-09-19T06:40:39.880 INFO:tasks.workunit.client.1.smithi117.stdout:9/632: dread - d4/d1c/d7a/d52/f85 zero size 2024-09-19T06:40:39.880 INFO:tasks.workunit.client.0.smithi099.stdout:1/526: dread d0/d2d/f96 [0,4194304] 0 2024-09-19T06:40:39.882 INFO:tasks.workunit.client.0.smithi099.stdout:5/691: dread d3/d16/f2b [0,4194304] 0 2024-09-19T06:40:39.885 INFO:tasks.workunit.client.1.smithi117.stdout:3/662: dread d0/d9/f9a [0,4194304] 0 2024-09-19T06:40:39.886 INFO:tasks.workunit.client.1.smithi117.stdout:8/651: rename d1d/d1e/d29 to d1d/d2a/d3f/d73/ddd 0 2024-09-19T06:40:39.886 INFO:tasks.workunit.client.0.smithi099.stdout:1/527: symlink d0/d17/d24/d75/la8 0 2024-09-19T06:40:39.888 INFO:tasks.workunit.client.1.smithi117.stdout:0/555: dwrite d11/f96 [0,4194304] 0 2024-09-19T06:40:39.888 INFO:tasks.workunit.client.1.smithi117.stdout:6/476: symlink d1/d5/d8/d27/l84 0 2024-09-19T06:40:39.889 INFO:tasks.workunit.client.1.smithi117.stdout:8/652: fsync d1d/d2a/f2f 0 2024-09-19T06:40:39.889 INFO:tasks.workunit.client.0.smithi099.stdout:2/393: creat d1/d2/d5/f81 x:0 0 0 2024-09-19T06:40:39.889 INFO:tasks.workunit.client.0.smithi099.stdout:1/528: stat d0/d17/d32/c73 0 2024-09-19T06:40:39.890 INFO:tasks.workunit.client.1.smithi117.stdout:5/715: read d17/d1b/d3a/d3c/dcb/dde/d65/fc1 [575,19868] 0 2024-09-19T06:40:39.895 INFO:tasks.workunit.client.1.smithi117.stdout:9/633: read d4/f24 [4031830,110991] 0 2024-09-19T06:40:39.895 INFO:tasks.workunit.client.1.smithi117.stdout:1/601: symlink d3/d18/d23/d74/d89/d9f/ld3 0 2024-09-19T06:40:39.895 INFO:tasks.workunit.client.1.smithi117.stdout:3/663: mkdir d0/d3d/d48/dd0 0 2024-09-19T06:40:39.897 INFO:tasks.workunit.client.1.smithi117.stdout:1/602: dread - d3/d22/d2f/f92 zero size 2024-09-19T06:40:39.897 INFO:tasks.workunit.client.0.smithi099.stdout:5/692: dwrite d3/d14/fa1 [0,4194304] 0 2024-09-19T06:40:39.897 INFO:tasks.workunit.client.0.smithi099.stdout:3/721: dwrite d7/d34/d1d/d57/fbc [0,4194304] 0 2024-09-19T06:40:39.897 INFO:tasks.workunit.client.0.smithi099.stdout:2/394: unlink d1/d2/d4d/d52/d18/d2d/l3b 0 2024-09-19T06:40:39.899 INFO:tasks.workunit.client.1.smithi117.stdout:8/653: dwrite d1d/d1e/d3b/f6c [0,4194304] 0 2024-09-19T06:40:39.900 INFO:tasks.workunit.client.1.smithi117.stdout:0/556: symlink d11/d13/d28/d38/lb8 0 2024-09-19T06:40:39.902 INFO:tasks.workunit.client.1.smithi117.stdout:0/557: chown d11/d13/d1b/d27/l39 7 1 2024-09-19T06:40:39.905 INFO:tasks.workunit.client.0.smithi099.stdout:1/529: dwrite d0/db/f23 [0,4194304] 0 2024-09-19T06:40:39.906 INFO:tasks.workunit.client.1.smithi117.stdout:1/603: dread d3/d18/d23/f9b [0,4194304] 0 2024-09-19T06:40:39.907 INFO:tasks.workunit.client.1.smithi117.stdout:6/477: mkdir d1/d5/d85 0 2024-09-19T06:40:39.907 INFO:tasks.workunit.client.1.smithi117.stdout:2/628: link d0/d7/fd4 d0/d7/feb 0 2024-09-19T06:40:39.908 INFO:tasks.workunit.client.0.smithi099.stdout:2/395: mknod d1/d2/d4d/d52/d9/c82 0 2024-09-19T06:40:39.915 INFO:tasks.workunit.client.1.smithi117.stdout:7/649: creat d1/d4a/d7c/d95/fe8 x:0 0 0 2024-09-19T06:40:39.916 INFO:tasks.workunit.client.0.smithi099.stdout:5/693: getdents d3/d1f 0 2024-09-19T06:40:39.919 INFO:tasks.workunit.client.1.smithi117.stdout:6/478: unlink d1/d5/d8/c4a 0 2024-09-19T06:40:39.921 INFO:tasks.workunit.client.1.smithi117.stdout:8/654: fdatasync d1d/d2a/d3f/d4b/d91/fba 0 2024-09-19T06:40:39.921 INFO:tasks.workunit.client.1.smithi117.stdout:1/604: dwrite d3/d22/f33 [0,4194304] 0 2024-09-19T06:40:39.922 INFO:tasks.workunit.client.1.smithi117.stdout:2/629: rename d0/d7/d29/d35/d3d/fd7 to d0/d7/d58/da8/fec 0 2024-09-19T06:40:39.923 INFO:tasks.workunit.client.1.smithi117.stdout:6/479: write d1/d5/d8/f5d [370905,120655] 0 2024-09-19T06:40:39.924 INFO:tasks.workunit.client.0.smithi099.stdout:3/722: unlink d7/d34/d1d/d57/d76/fba 0 2024-09-19T06:40:39.925 INFO:tasks.workunit.client.1.smithi117.stdout:5/716: creat d17/d1b/ff0 x:0 0 0 2024-09-19T06:40:39.927 INFO:tasks.workunit.client.1.smithi117.stdout:8/655: creat d1d/d1e/d53/d6e/fde x:0 0 0 2024-09-19T06:40:39.928 INFO:tasks.workunit.client.0.smithi099.stdout:3/723: rmdir d7/d34/d1d/d36/d69/d6d/d8f 39 2024-09-19T06:40:39.929 INFO:tasks.workunit.client.0.smithi099.stdout:3/724: chown d7/d34/d28/c9a 322 1 2024-09-19T06:40:39.930 INFO:tasks.workunit.client.1.smithi117.stdout:2/630: symlink d0/d64/dd9/led 0 2024-09-19T06:40:39.930 INFO:tasks.workunit.client.1.smithi117.stdout:6/480: rmdir d1 39 2024-09-19T06:40:39.930 INFO:tasks.workunit.client.0.smithi099.stdout:3/725: dread - d7/d34/d1d/d20/d75/d9d/fd4 zero size 2024-09-19T06:40:39.930 INFO:tasks.workunit.client.1.smithi117.stdout:8/656: dread - d1d/d2a/d3f/d4b/d66/dac/fcb zero size 2024-09-19T06:40:39.931 INFO:tasks.workunit.client.1.smithi117.stdout:1/605: creat d3/da1/fd4 x:0 0 0 2024-09-19T06:40:39.932 INFO:tasks.workunit.client.1.smithi117.stdout:5/717: rename d17/d1b/d3a/d3c/d46/cba to d17/d1b/d3a/d3c/dcb/dde/d55/dd1/cf1 0 2024-09-19T06:40:39.933 INFO:tasks.workunit.client.0.smithi099.stdout:3/726: creat d7/d34/d1d/d20/d75/d79/fda x:0 0 0 2024-09-19T06:40:39.934 INFO:tasks.workunit.client.1.smithi117.stdout:1/606: creat d3/da1/fd5 x:0 0 0 2024-09-19T06:40:39.935 INFO:tasks.workunit.client.0.smithi099.stdout:3/727: mknod d7/d34/d1d/d20/d75/d9d/cdb 0 2024-09-19T06:40:39.936 INFO:tasks.workunit.client.0.smithi099.stdout:3/728: readlink d7/d34/d28/l89 0 2024-09-19T06:40:39.936 INFO:tasks.workunit.client.1.smithi117.stdout:7/650: dread d1/d4a/d81/f47 [0,4194304] 0 2024-09-19T06:40:39.936 INFO:tasks.workunit.client.1.smithi117.stdout:5/718: chown d17/d1b/d3a/d3c/dcb/dde/l43 18574 1 2024-09-19T06:40:39.939 INFO:tasks.workunit.client.1.smithi117.stdout:1/607: rename d3/d18/d56/l8a to d3/da1/dcc/ld6 0 2024-09-19T06:40:39.941 INFO:tasks.workunit.client.0.smithi099.stdout:3/729: rename d7/d34/d1d/d20/d75/d9d/fcb to d7/d34/d1d/fdc 0 2024-09-19T06:40:39.941 INFO:tasks.workunit.client.1.smithi117.stdout:6/481: dread d1/f64 [0,4194304] 0 2024-09-19T06:40:39.942 INFO:tasks.workunit.client.1.smithi117.stdout:8/657: dwrite d1d/d2a/d3f/d4b/fc2 [0,4194304] 0 2024-09-19T06:40:39.943 INFO:tasks.workunit.client.0.smithi099.stdout:3/730: mknod d7/d34/d1d/d20/d75/cdd 0 2024-09-19T06:40:39.944 INFO:tasks.workunit.client.1.smithi117.stdout:1/608: mkdir d3/d99/dd7 0 2024-09-19T06:40:39.947 INFO:tasks.workunit.client.1.smithi117.stdout:8/658: write d1d/d2a/f2f [966420,16343] 0 2024-09-19T06:40:39.949 INFO:tasks.workunit.client.1.smithi117.stdout:1/609: unlink d3/d18/l7e 0 2024-09-19T06:40:39.953 INFO:tasks.workunit.client.1.smithi117.stdout:2/631: truncate d0/d7/d29/d35/d61/d65/f96 372549 0 2024-09-19T06:40:39.954 INFO:tasks.workunit.client.1.smithi117.stdout:1/610: unlink d3/f9 0 2024-09-19T06:40:39.957 INFO:tasks.workunit.client.1.smithi117.stdout:6/482: dwrite d1/d14/f4c [0,4194304] 0 2024-09-19T06:40:39.958 INFO:tasks.workunit.client.1.smithi117.stdout:3/664: dwrite d0/d8/d7f/f7a [0,4194304] 0 2024-09-19T06:40:39.958 INFO:tasks.workunit.client.1.smithi117.stdout:5/719: dread d17/d1b/d3a/d3c/dcb/dde/dab/fb7 [4194304,4194304] 0 2024-09-19T06:40:39.960 INFO:tasks.workunit.client.1.smithi117.stdout:3/665: read - d0/d3d/d48/faa zero size 2024-09-19T06:40:39.961 INFO:tasks.workunit.client.1.smithi117.stdout:8/659: rename d1d/d31/d83/dad/dc0/fa9 to d1d/d2a/d3f/d4b/d91/fdf 0 2024-09-19T06:40:39.962 INFO:tasks.workunit.client.1.smithi117.stdout:6/483: write d1/d3d/f83 [811233,64560] 0 2024-09-19T06:40:39.966 INFO:tasks.workunit.client.1.smithi117.stdout:3/666: dread - d0/d9/d4e/d9e/fcd zero size 2024-09-19T06:40:39.966 INFO:tasks.workunit.client.1.smithi117.stdout:3/667: stat d0/d8/d64/f6a 0 2024-09-19T06:40:39.967 INFO:tasks.workunit.client.1.smithi117.stdout:2/632: mkdir d0/d7/d29/d35/d61/d65/dee 0 2024-09-19T06:40:39.967 INFO:tasks.workunit.client.1.smithi117.stdout:1/611: read d3/d18/d23/d74/fb7 [294321,34389] 0 2024-09-19T06:40:39.969 INFO:tasks.workunit.client.1.smithi117.stdout:1/612: truncate d3/da1/fd4 642218 0 2024-09-19T06:40:39.973 INFO:tasks.workunit.client.1.smithi117.stdout:6/484: creat d1/d3/f86 x:0 0 0 2024-09-19T06:40:39.973 INFO:tasks.workunit.client.1.smithi117.stdout:5/720: write d17/d1b/d3a/d3c/dcb/dde/d65/f8d [167164,30838] 0 2024-09-19T06:40:39.976 INFO:tasks.workunit.client.1.smithi117.stdout:3/668: dwrite d0/f63 [4194304,4194304] 0 2024-09-19T06:40:39.978 INFO:tasks.workunit.client.1.smithi117.stdout:3/669: dread - d0/d9/d4e/f98 zero size 2024-09-19T06:40:39.980 INFO:tasks.workunit.client.1.smithi117.stdout:5/721: symlink d17/d1b/d3a/d3c/dcb/dde/dab/lf2 0 2024-09-19T06:40:39.981 INFO:tasks.workunit.client.1.smithi117.stdout:2/633: dread d0/d12/f3c [0,4194304] 0 2024-09-19T06:40:39.981 INFO:tasks.workunit.client.1.smithi117.stdout:5/722: chown d17/l23 113746 1 2024-09-19T06:40:39.982 INFO:tasks.workunit.client.1.smithi117.stdout:6/485: dwrite d1/d14/f2b [4194304,4194304] 0 2024-09-19T06:40:39.985 INFO:tasks.workunit.client.1.smithi117.stdout:3/670: rename d0/d19/d2b/c34 to d0/d9/d4e/cd1 0 2024-09-19T06:40:39.987 INFO:tasks.workunit.client.1.smithi117.stdout:2/634: unlink d0/d7/d29/d35/d3d/l79 0 2024-09-19T06:40:39.989 INFO:tasks.workunit.client.1.smithi117.stdout:6/486: rmdir d1/d5/d32 39 2024-09-19T06:40:39.989 INFO:tasks.workunit.client.1.smithi117.stdout:1/613: write d3/d18/d23/f28 [1932716,46620] 0 2024-09-19T06:40:39.990 INFO:tasks.workunit.client.1.smithi117.stdout:1/614: fsync d3/f5 0 2024-09-19T06:40:39.991 INFO:tasks.workunit.client.1.smithi117.stdout:6/487: dread - d1/d5/d8/d27/d77/f7d zero size 2024-09-19T06:40:39.992 INFO:tasks.workunit.client.1.smithi117.stdout:2/635: mkdir d0/d7/d29/d35/d61/def 0 2024-09-19T06:40:39.993 INFO:tasks.workunit.client.1.smithi117.stdout:3/671: dread d0/d9/f90 [0,4194304] 0 2024-09-19T06:40:39.995 INFO:tasks.workunit.client.1.smithi117.stdout:1/615: rmdir d3/da1 39 2024-09-19T06:40:39.997 INFO:tasks.workunit.client.1.smithi117.stdout:5/723: creat d17/d1b/d3a/d3c/d70/ff3 x:0 0 0 2024-09-19T06:40:39.999 INFO:tasks.workunit.client.0.smithi099.stdout:1/530: truncate d0/d12/d54/f6f 242006 0 2024-09-19T06:40:39.999 INFO:tasks.workunit.client.1.smithi117.stdout:6/488: rename d1/d3/f12 to d1/d5/d8/d27/d77/f87 0 2024-09-19T06:40:40.001 INFO:tasks.workunit.client.1.smithi117.stdout:2/636: dread d0/d7/fba [0,4194304] 0 2024-09-19T06:40:40.001 INFO:tasks.workunit.client.1.smithi117.stdout:3/672: dwrite d0/d8/f20 [8388608,4194304] 0 2024-09-19T06:40:40.002 INFO:tasks.workunit.client.1.smithi117.stdout:3/673: read - d0/d8/fc3 zero size 2024-09-19T06:40:40.002 INFO:tasks.workunit.client.0.smithi099.stdout:5/694: dread d3/d16/d2f/d34/d3c/fc8 [0,4194304] 0 2024-09-19T06:40:40.004 INFO:tasks.workunit.client.0.smithi099.stdout:3/731: dwrite d7/f68 [0,4194304] 0 2024-09-19T06:40:40.005 INFO:tasks.workunit.client.1.smithi117.stdout:5/724: write d17/d1b/d3a/d3c/f3d [6687713,31567] 0 2024-09-19T06:40:40.006 INFO:tasks.workunit.client.1.smithi117.stdout:2/637: write d0/d7/d58/db1/fbe [602914,117749] 0 2024-09-19T06:40:40.006 INFO:tasks.workunit.client.0.smithi099.stdout:1/531: creat d0/d17/d32/d7b/d99/fa9 x:0 0 0 2024-09-19T06:40:40.008 INFO:tasks.workunit.client.0.smithi099.stdout:5/695: creat d3/d16/d2f/d8c/dd9/ff3 x:0 0 0 2024-09-19T06:40:40.009 INFO:tasks.workunit.client.1.smithi117.stdout:6/489: creat d1/d5/f88 x:0 0 0 2024-09-19T06:40:40.009 INFO:tasks.workunit.client.0.smithi099.stdout:3/732: write d7/d34/d1d/d20/d58/d5c/f90 [1174509,5024] 0 2024-09-19T06:40:40.009 INFO:tasks.workunit.client.0.smithi099.stdout:2/396: dwrite d1/d2/d4d/d52/d18/d27/f48 [0,4194304] 0 2024-09-19T06:40:40.010 INFO:tasks.workunit.client.1.smithi117.stdout:1/616: symlink d3/da1/db1/d93/dd0/ld8 0 2024-09-19T06:40:40.011 INFO:tasks.workunit.client.1.smithi117.stdout:2/638: mkdir d0/d64/dd9/df0 0 2024-09-19T06:40:40.013 INFO:tasks.workunit.client.1.smithi117.stdout:5/725: creat d17/d1b/d3a/d3c/dcb/dde/d65/d88/de5/d3b/ff4 x:0 0 0 2024-09-19T06:40:40.014 INFO:tasks.workunit.client.0.smithi099.stdout:2/397: chown d1/d2/d4d/d52/f1a 28 1 2024-09-19T06:40:40.016 INFO:tasks.workunit.client.1.smithi117.stdout:1/617: rename d3/d22/d2f/l4a to d3/d18/d97/ld9 0 2024-09-19T06:40:40.018 INFO:tasks.workunit.client.0.smithi099.stdout:1/532: rename d0/d12/d54/c67 to d0/d17/d24/d75/caa 0 2024-09-19T06:40:40.019 INFO:tasks.workunit.client.0.smithi099.stdout:5/696: dwrite d3/d16/d2f/d34/d3c/d65/f86 [0,4194304] 0 2024-09-19T06:40:40.019 INFO:tasks.workunit.client.0.smithi099.stdout:2/398: fsync d1/d2/d5/f40 0 2024-09-19T06:40:40.020 INFO:tasks.workunit.client.1.smithi117.stdout:3/674: write d0/d19/d2b/f6e [719283,126773] 0 2024-09-19T06:40:40.022 INFO:tasks.workunit.client.0.smithi099.stdout:3/733: getdents d7/d34/d1d/d20 0 2024-09-19T06:40:40.024 INFO:tasks.workunit.client.0.smithi099.stdout:2/399: creat d1/d2/d5/d13/f83 x:0 0 0 2024-09-19T06:40:40.026 INFO:tasks.workunit.client.0.smithi099.stdout:1/533: mknod d0/cab 0 2024-09-19T06:40:40.030 INFO:tasks.workunit.client.1.smithi117.stdout:6/490: dwrite d1/f1b [8388608,4194304] 0 2024-09-19T06:40:40.032 INFO:tasks.workunit.client.0.smithi099.stdout:2/400: dwrite d1/d2/d5/d13/d2c/f49 [0,4194304] 0 2024-09-19T06:40:40.032 INFO:tasks.workunit.client.1.smithi117.stdout:5/726: dwrite d17/d1b/d3a/d3c/dcb/dde/d65/f8d [0,4194304] 0 2024-09-19T06:40:40.035 INFO:tasks.workunit.client.0.smithi099.stdout:3/734: mkdir d7/d34/d1d/d20/d58/d5c/d98/dde 0 2024-09-19T06:40:40.036 INFO:tasks.workunit.client.1.smithi117.stdout:3/675: mknod d0/d9/d4e/d9e/dc9/cd2 0 2024-09-19T06:40:40.038 INFO:tasks.workunit.client.0.smithi099.stdout:2/401: rename d1/d2/d4d/d52/d36/l3a to d1/d2/d4d/d52/d18/d2d/l84 0 2024-09-19T06:40:40.038 INFO:tasks.workunit.client.1.smithi117.stdout:3/676: truncate d0/fc5 222072 0 2024-09-19T06:40:40.039 INFO:tasks.workunit.client.0.smithi099.stdout:5/697: getdents d3/d16/d2f/d34/da4/da5/dce 0 2024-09-19T06:40:40.041 INFO:tasks.workunit.client.1.smithi117.stdout:2/639: dwrite d0/d12/fea [0,4194304] 0 2024-09-19T06:40:40.043 INFO:tasks.workunit.client.0.smithi099.stdout:3/735: mkdir d7/d34/d1d/d57/d76/ddf 0 2024-09-19T06:40:40.045 INFO:tasks.workunit.client.0.smithi099.stdout:2/402: symlink d1/d2/l85 0 2024-09-19T06:40:40.046 INFO:tasks.workunit.client.0.smithi099.stdout:5/698: mkdir d3/d7/d90/df4 0 2024-09-19T06:40:40.048 INFO:tasks.workunit.client.0.smithi099.stdout:2/403: write d1/d2/d5/d13/d2c/f70 [3854,55611] 0 2024-09-19T06:40:40.049 INFO:tasks.workunit.client.1.smithi117.stdout:6/491: rename d1/d3/d25/c2c to d1/d5/d8/d80/c89 0 2024-09-19T06:40:40.054 INFO:tasks.workunit.client.1.smithi117.stdout:5/727: getdents d17/d1b/d3a/d3c/d70 0 2024-09-19T06:40:40.054 INFO:tasks.workunit.client.1.smithi117.stdout:6/492: chown d1/f1d 1829698 1 2024-09-19T06:40:40.055 INFO:tasks.workunit.client.1.smithi117.stdout:3/677: rename d0/d9/f50 to d0/d8/d64/fd3 0 2024-09-19T06:40:40.056 INFO:tasks.workunit.client.1.smithi117.stdout:6/493: write d1/d14/f23 [1337617,62439] 0 2024-09-19T06:40:40.057 INFO:tasks.workunit.client.0.smithi099.stdout:5/699: link d3/d7/d90/ca9 d3/d16/d7d/cf5 0 2024-09-19T06:40:40.058 INFO:tasks.workunit.client.0.smithi099.stdout:3/736: dwrite d7/d34/d1d/d36/fcf [0,4194304] 0 2024-09-19T06:40:40.058 INFO:tasks.workunit.client.1.smithi117.stdout:5/728: write d17/d1b/d3a/d3c/d46/f4f [1861577,73377] 0 2024-09-19T06:40:40.058 INFO:tasks.workunit.client.1.smithi117.stdout:3/678: unlink d0/d3d/l4d 0 2024-09-19T06:40:40.059 INFO:tasks.workunit.client.1.smithi117.stdout:5/729: write d17/d1b/d3a/d3c/fd8 [1473052,29450] 0 2024-09-19T06:40:40.060 INFO:tasks.workunit.client.0.smithi099.stdout:2/404: dwrite d1/f39 [0,4194304] 0 2024-09-19T06:40:40.061 INFO:tasks.workunit.client.0.smithi099.stdout:2/405: readlink d1/l30 0 2024-09-19T06:40:40.063 INFO:tasks.workunit.client.0.smithi099.stdout:5/700: fdatasync d3/d1f/d4f/f5c 0 2024-09-19T06:40:40.063 INFO:tasks.workunit.client.0.smithi099.stdout:3/737: mkdir d7/d34/d1d/d36/db3/de0 0 2024-09-19T06:40:40.064 INFO:tasks.workunit.client.1.smithi117.stdout:3/679: mknod d0/d19/d2b/cd4 0 2024-09-19T06:40:40.066 INFO:tasks.workunit.client.0.smithi099.stdout:2/406: symlink d1/d2/d4d/d52/l86 0 2024-09-19T06:40:40.068 INFO:tasks.workunit.client.1.smithi117.stdout:3/680: creat d0/d9/d1c/fd5 x:0 0 0 2024-09-19T06:40:40.068 INFO:tasks.workunit.client.0.smithi099.stdout:3/738: mknod d7/d34/d1d/d36/db3/ce1 0 2024-09-19T06:40:40.069 INFO:tasks.workunit.client.1.smithi117.stdout:1/618: dread d3/f5e [0,4194304] 0 2024-09-19T06:40:40.069 INFO:tasks.workunit.client.1.smithi117.stdout:3/681: chown d0/f1e 9203907 1 2024-09-19T06:40:40.071 INFO:tasks.workunit.client.0.smithi099.stdout:8/415: sync 2024-09-19T06:40:40.071 INFO:tasks.workunit.client.0.smithi099.stdout:6/519: sync 2024-09-19T06:40:40.072 INFO:tasks.workunit.client.1.smithi117.stdout:1/619: creat d3/d22/d2f/fda x:0 0 0 2024-09-19T06:40:40.073 INFO:tasks.workunit.client.0.smithi099.stdout:3/739: creat d7/d34/d1d/d20/d58/d5c/d98/dde/fe2 x:0 0 0 2024-09-19T06:40:40.073 INFO:tasks.workunit.client.1.smithi117.stdout:1/620: write d3/d22/f90 [1241429,22407] 0 2024-09-19T06:40:40.073 INFO:tasks.workunit.client.1.smithi117.stdout:3/682: fsync d0/d3d/d48/f91 0 2024-09-19T06:40:40.074 INFO:tasks.workunit.client.1.smithi117.stdout:1/621: dread - d3/d22/d2f/fda zero size 2024-09-19T06:40:40.075 INFO:tasks.workunit.client.0.smithi099.stdout:1/534: dread d0/d12/d13/f22 [0,4194304] 0 2024-09-19T06:40:40.076 INFO:tasks.workunit.client.0.smithi099.stdout:1/535: fdatasync d0/f82 0 2024-09-19T06:40:40.077 INFO:tasks.workunit.client.0.smithi099.stdout:6/520: getdents d1/d5/d38/d76 0 2024-09-19T06:40:40.079 INFO:tasks.workunit.client.0.smithi099.stdout:8/416: read d4/f54 [2206668,72716] 0 2024-09-19T06:40:40.079 INFO:tasks.workunit.client.0.smithi099.stdout:6/521: chown d1/d5/d24/d2e/d41/d4e/d2a/c4b 5 1 2024-09-19T06:40:40.081 INFO:tasks.workunit.client.1.smithi117.stdout:2/640: truncate d0/d7/d29/d35/f97 3103366 0 2024-09-19T06:40:40.081 INFO:tasks.workunit.client.0.smithi099.stdout:6/522: fsync d1/d12/f5f 0 2024-09-19T06:40:40.082 INFO:tasks.workunit.client.0.smithi099.stdout:8/417: fdatasync d4/de/d10/f68 0 2024-09-19T06:40:40.082 INFO:tasks.workunit.client.1.smithi117.stdout:2/641: chown d0/d7/d29/d35/d61/d65/c84 0 1 2024-09-19T06:40:40.082 INFO:tasks.workunit.client.0.smithi099.stdout:3/740: dwrite d7/d34/d1d/d36/f29 [4194304,4194304] 0 2024-09-19T06:40:40.084 INFO:tasks.workunit.client.0.smithi099.stdout:1/536: dread d0/d12/f30 [0,4194304] 0 2024-09-19T06:40:40.084 INFO:tasks.workunit.client.0.smithi099.stdout:8/418: mknod d4/de/d10/c8e 0 2024-09-19T06:40:40.087 INFO:tasks.workunit.client.0.smithi099.stdout:3/741: fsync d7/d34/d1d/d20/d58/d5c/f5d 0 2024-09-19T06:40:40.088 INFO:tasks.workunit.client.1.smithi117.stdout:5/730: truncate d17/d1b/d3a/d3c/dcb/dde/f32 2120338 0 2024-09-19T06:40:40.091 INFO:tasks.workunit.client.1.smithi117.stdout:2/642: write d0/d12/d32/db5/f50 [749098,92801] 0 2024-09-19T06:40:40.092 INFO:tasks.workunit.client.1.smithi117.stdout:3/683: readlink d0/d9/d1c/l4b 0 2024-09-19T06:40:40.094 INFO:tasks.workunit.client.0.smithi099.stdout:3/742: getdents d7/d34/d1d/d36 0 2024-09-19T06:40:40.095 INFO:tasks.workunit.client.1.smithi117.stdout:5/731: dwrite d17/f81 [0,4194304] 0 2024-09-19T06:40:40.096 INFO:tasks.workunit.client.1.smithi117.stdout:5/732: stat d17/d1b/d3a/d3c/d46/f61 0 2024-09-19T06:40:40.097 INFO:tasks.workunit.client.1.smithi117.stdout:2/643: creat d0/d7/d29/d35/dbd/ff1 x:0 0 0 2024-09-19T06:40:40.097 INFO:tasks.workunit.client.1.smithi117.stdout:3/684: symlink d0/d8/d7f/dbf/ld6 0 2024-09-19T06:40:40.098 INFO:tasks.workunit.client.1.smithi117.stdout:5/733: mknod d17/d5c/db8/cf5 0 2024-09-19T06:40:40.099 INFO:tasks.workunit.client.1.smithi117.stdout:5/734: chown d17/f89 64351797 1 2024-09-19T06:40:40.102 INFO:tasks.workunit.client.1.smithi117.stdout:5/735: chown d17/d1b/d3a/d3c/dcb/dde/d65/d88/dd0 8108695 1 2024-09-19T06:40:40.102 INFO:tasks.workunit.client.1.smithi117.stdout:5/736: chown d17/d1b/d5d/d7d/dc6 2603 1 2024-09-19T06:40:40.103 INFO:tasks.workunit.client.1.smithi117.stdout:5/737: write d17/d5c/fe1 [645716,40829] 0 2024-09-19T06:40:40.104 INFO:tasks.workunit.client.0.smithi099.stdout:3/743: dwrite d7/d34/d1d/d20/f7d [0,4194304] 0 2024-09-19T06:40:40.106 INFO:tasks.workunit.client.1.smithi117.stdout:5/738: truncate d17/d1b/d3a/d3c/dcb/dde/d55/f98 4469396 0 2024-09-19T06:40:40.107 INFO:tasks.workunit.client.1.smithi117.stdout:3/685: link d0/d9/d1c/f1d d0/d3d/d48/dd0/fd7 0 2024-09-19T06:40:40.108 INFO:tasks.workunit.client.0.smithi099.stdout:3/744: creat d7/d34/d1d/d20/d75/fe3 x:0 0 0 2024-09-19T06:40:40.110 INFO:tasks.workunit.client.1.smithi117.stdout:5/739: creat d17/d1b/d3a/d3c/dcb/dde/d65/d88/de5/d6a/ff6 x:0 0 0 2024-09-19T06:40:40.110 INFO:tasks.workunit.client.1.smithi117.stdout:3/686: symlink d0/d9/d4e/d9e/ld8 0 2024-09-19T06:40:40.112 INFO:tasks.workunit.client.1.smithi117.stdout:3/687: write d0/d19/d2b/d8e/f8d [3160205,23617] 0 2024-09-19T06:40:40.113 INFO:tasks.workunit.client.1.smithi117.stdout:3/688: fsync d0/f92 0 2024-09-19T06:40:40.117 INFO:tasks.workunit.client.1.smithi117.stdout:3/689: creat d0/d9/d1c/d53/fd9 x:0 0 0 2024-09-19T06:40:40.118 INFO:tasks.workunit.client.0.smithi099.stdout:8/419: dread d4/d11/d23/f3b [0,4194304] 0 2024-09-19T06:40:40.120 INFO:tasks.workunit.client.0.smithi099.stdout:8/420: mknod d4/de/c8f 0 2024-09-19T06:40:40.121 INFO:tasks.workunit.client.1.smithi117.stdout:6/494: fsync d1/f1b 0 2024-09-19T06:40:40.123 INFO:tasks.workunit.client.1.smithi117.stdout:6/495: symlink d1/d3d/l8a 0 2024-09-19T06:40:40.123 INFO:tasks.workunit.client.0.smithi099.stdout:8/421: rename d4/d11/d61/c7e to d4/de/d1c/c90 0 2024-09-19T06:40:40.126 INFO:tasks.workunit.client.1.smithi117.stdout:6/496: creat d1/d5/d8/d5e/d67/f8b x:0 0 0 2024-09-19T06:40:40.126 INFO:tasks.workunit.client.0.smithi099.stdout:8/422: unlink d4/l45 0 2024-09-19T06:40:40.126 INFO:tasks.workunit.client.0.smithi099.stdout:8/423: stat d4/de/d1c 0 2024-09-19T06:40:40.127 INFO:tasks.workunit.client.1.smithi117.stdout:6/497: read d1/d14/f4c [2108225,121422] 0 2024-09-19T06:40:40.129 INFO:tasks.workunit.client.0.smithi099.stdout:8/424: mkdir d4/de/d26/d2b/d91 0 2024-09-19T06:40:40.130 INFO:tasks.workunit.client.1.smithi117.stdout:5/740: dread d17/f74 [0,4194304] 0 2024-09-19T06:40:40.133 INFO:tasks.workunit.client.1.smithi117.stdout:2/644: dread d0/d12/d32/db5/f91 [0,4194304] 0 2024-09-19T06:40:40.134 INFO:tasks.workunit.client.1.smithi117.stdout:2/645: chown d0/d12/f3c 3 1 2024-09-19T06:40:40.135 INFO:tasks.workunit.client.1.smithi117.stdout:5/741: link d17/d1b/d3a/d3c/dcb/dde/d65/d88/de5/fe8 d17/ff7 0 2024-09-19T06:40:40.135 INFO:tasks.workunit.client.0.smithi099.stdout:1/537: write d0/d12/d13/f45 [749019,73292] 0 2024-09-19T06:40:40.136 INFO:tasks.workunit.client.0.smithi099.stdout:6/523: truncate d1/d5/d24/d2e/d41/d4e/f97 1128563 0 2024-09-19T06:40:40.138 INFO:tasks.workunit.client.1.smithi117.stdout:5/742: mkdir d17/d1b/d3a/df8 0 2024-09-19T06:40:40.139 INFO:tasks.workunit.client.0.smithi099.stdout:5/701: dwrite d3/d16/d2f/f7f [0,4194304] 0 2024-09-19T06:40:40.140 INFO:tasks.workunit.client.1.smithi117.stdout:2/646: link d0/d12/d32/db5/f83 d0/d7/d1e/d20/dbc/de6/ff2 0 2024-09-19T06:40:40.141 INFO:tasks.workunit.client.1.smithi117.stdout:5/743: symlink d17/d1b/d3a/d3c/dcb/dde/d55/dd1/lf9 0 2024-09-19T06:40:40.141 INFO:tasks.workunit.client.0.smithi099.stdout:1/538: rename d0/d17/d32/f4d to d0/d2d/fac 0 2024-09-19T06:40:40.143 INFO:tasks.workunit.client.0.smithi099.stdout:6/524: link d1/d12/f27 d1/d12/faa 0 2024-09-19T06:40:40.147 INFO:tasks.workunit.client.1.smithi117.stdout:2/647: link d0/d7/d29/d35/dbd/d8d/f9d d0/d7/d29/d35/dbd/d8d/d9a/ff3 0 2024-09-19T06:40:40.147 INFO:tasks.workunit.client.0.smithi099.stdout:5/702: getdents d3/d16/d2f/d34/d3c/de1 0 2024-09-19T06:40:40.148 INFO:tasks.workunit.client.1.smithi117.stdout:2/648: chown d0/d12/d2f/f40 1385278 1 2024-09-19T06:40:40.149 INFO:tasks.workunit.client.0.smithi099.stdout:8/425: write d4/d11/f1f [2652356,123488] 0 2024-09-19T06:40:40.151 INFO:tasks.workunit.client.0.smithi099.stdout:8/426: stat d4/d11/d38/f67 0 2024-09-19T06:40:40.152 INFO:tasks.workunit.client.0.smithi099.stdout:5/703: symlink d3/d16/d2f/d8c/dd9/lf6 0 2024-09-19T06:40:40.152 INFO:tasks.workunit.client.0.smithi099.stdout:5/704: stat d3 0 2024-09-19T06:40:40.154 INFO:tasks.workunit.client.0.smithi099.stdout:5/705: dread d3/d14/fac [0,4194304] 0 2024-09-19T06:40:40.155 INFO:tasks.workunit.client.0.smithi099.stdout:1/539: dread d0/d17/d24/f42 [0,4194304] 0 2024-09-19T06:40:40.155 INFO:tasks.workunit.client.0.smithi099.stdout:5/706: chown d3/d7/f11 312783 1 2024-09-19T06:40:40.157 INFO:tasks.workunit.client.0.smithi099.stdout:1/540: rmdir d0/d17/d24/d75 39 2024-09-19T06:40:40.158 INFO:tasks.workunit.client.0.smithi099.stdout:6/525: truncate d1/f1d 1657445 0 2024-09-19T06:40:40.159 INFO:tasks.workunit.client.1.smithi117.stdout:5/744: truncate d17/d1b/d5d/d7d/fa8 2587016 0 2024-09-19T06:40:40.160 INFO:tasks.workunit.client.1.smithi117.stdout:2/649: write d0/d7/fd4 [1948410,110770] 0 2024-09-19T06:40:40.160 INFO:tasks.workunit.client.0.smithi099.stdout:1/541: symlink d0/d17/d24/d3a/d58/d8d/lad 0 2024-09-19T06:40:40.162 INFO:tasks.workunit.client.1.smithi117.stdout:5/745: mknod d17/d1b/d5d/cfa 0 2024-09-19T06:40:40.163 INFO:tasks.workunit.client.0.smithi099.stdout:6/526: symlink d1/d5/d24/d2e/d41/lab 0 2024-09-19T06:40:40.163 INFO:tasks.workunit.client.1.smithi117.stdout:2/650: mkdir d0/d7/d29/df4 0 2024-09-19T06:40:40.164 INFO:tasks.workunit.client.0.smithi099.stdout:1/542: mkdir d0/d17/d24/d3a/d58/d8d/dae 0 2024-09-19T06:40:40.167 INFO:tasks.workunit.client.1.smithi117.stdout:5/746: dread d17/d1b/d3a/d3c/dcb/dde/dab/fad [0,4194304] 0 2024-09-19T06:40:40.168 INFO:tasks.workunit.client.0.smithi099.stdout:6/527: rename d1/d5/f49 to d1/d7c/fac 0 2024-09-19T06:40:40.168 INFO:tasks.workunit.client.1.smithi117.stdout:6/498: dread d1/d5/d8/f19 [4194304,4194304] 0 2024-09-19T06:40:40.168 INFO:tasks.workunit.client.0.smithi099.stdout:1/543: mkdir d0/d68/daf 0 2024-09-19T06:40:40.169 INFO:tasks.workunit.client.1.smithi117.stdout:2/651: creat d0/d7/d29/d35/ff5 x:0 0 0 2024-09-19T06:40:40.169 INFO:tasks.workunit.client.1.smithi117.stdout:6/499: read d1/d14/f23 [2600602,45460] 0 2024-09-19T06:40:40.172 INFO:tasks.workunit.client.1.smithi117.stdout:2/652: mknod d0/d12/d2f/cf6 0 2024-09-19T06:40:40.172 INFO:tasks.workunit.client.1.smithi117.stdout:4/862: sync 2024-09-19T06:40:40.174 INFO:tasks.workunit.client.0.smithi099.stdout:5/707: dwrite d3/d14/faf [0,4194304] 0 2024-09-19T06:40:40.175 INFO:tasks.workunit.client.1.smithi117.stdout:4/863: fsync d3/db/d23/f57 0 2024-09-19T06:40:40.176 INFO:tasks.workunit.client.0.smithi099.stdout:6/528: creat d1/d7c/fad x:0 0 0 2024-09-19T06:40:40.177 INFO:tasks.workunit.client.1.smithi117.stdout:6/500: dwrite d1/d3/f17 [4194304,4194304] 0 2024-09-19T06:40:40.178 INFO:tasks.workunit.client.0.smithi099.stdout:1/544: mkdir d0/d17/d32/d7b/db0 0 2024-09-19T06:40:40.179 INFO:tasks.workunit.client.1.smithi117.stdout:4/864: rmdir d3/d65/d66/d80/dc5 39 2024-09-19T06:40:40.181 INFO:tasks.workunit.client.1.smithi117.stdout:4/865: truncate f1 5055846 0 2024-09-19T06:40:40.181 INFO:tasks.workunit.client.0.smithi099.stdout:8/427: write d4/de/d1c/f6b [658691,116533] 0 2024-09-19T06:40:40.182 INFO:tasks.workunit.client.1.smithi117.stdout:4/866: fsync d3/d1b/ff1 0 2024-09-19T06:40:40.183 INFO:tasks.workunit.client.1.smithi117.stdout:6/501: rename d1/d5/f51 to d1/d3d/d6f/f8c 0 2024-09-19T06:40:40.184 INFO:tasks.workunit.client.1.smithi117.stdout:2/653: dwrite d0/d7/d29/d35/ff5 [0,4194304] 0 2024-09-19T06:40:40.185 INFO:tasks.workunit.client.0.smithi099.stdout:1/545: creat d0/d17/d32/d7b/db0/fb1 x:0 0 0 2024-09-19T06:40:40.185 INFO:tasks.workunit.client.0.smithi099.stdout:6/529: dwrite d1/d5/d24/d2e/f32 [0,4194304] 0 2024-09-19T06:40:40.187 INFO:tasks.workunit.client.0.smithi099.stdout:6/530: fdatasync d1/d12/f5f 0 2024-09-19T06:40:40.188 INFO:tasks.workunit.client.0.smithi099.stdout:6/531: write d1/d5/d24/f89 [5045825,102298] 0 2024-09-19T06:40:40.189 INFO:tasks.workunit.client.1.smithi117.stdout:6/502: read d1/d5/d8/d27/f47 [2648180,11050] 0 2024-09-19T06:40:40.191 INFO:tasks.workunit.client.1.smithi117.stdout:4/867: mkdir d3/d41/ded/d115 0 2024-09-19T06:40:40.192 INFO:tasks.workunit.client.1.smithi117.stdout:4/868: write d3/d41/f10b [358574,95324] 0 2024-09-19T06:40:40.196 INFO:tasks.workunit.client.1.smithi117.stdout:6/503: creat d1/d5/d8/d5e/f8d x:0 0 0 2024-09-19T06:40:40.196 INFO:tasks.workunit.client.0.smithi099.stdout:6/532: creat d1/d5/d38/fae x:0 0 0 2024-09-19T06:40:40.197 INFO:tasks.workunit.client.0.smithi099.stdout:0/524: sync 2024-09-19T06:40:40.198 INFO:tasks.workunit.client.1.smithi117.stdout:2/654: getdents d0/d12/d2f/d98/dca 0 2024-09-19T06:40:40.199 INFO:tasks.workunit.client.0.smithi099.stdout:0/525: write d0/db/f86 [4726672,72114] 0 2024-09-19T06:40:40.199 INFO:tasks.workunit.client.0.smithi099.stdout:6/533: mknod d1/d5/d24/d2e/d41/caf 0 2024-09-19T06:40:40.200 INFO:tasks.workunit.client.1.smithi117.stdout:2/655: fsync d0/d7/d29/d35/d61/d65/fab 0 2024-09-19T06:40:40.200 INFO:tasks.workunit.client.1.smithi117.stdout:4/869: rmdir d3/d1b/d7d/d51/d95/de5 0 2024-09-19T06:40:40.202 INFO:tasks.workunit.client.1.smithi117.stdout:4/870: chown d3/d1b/d63/lc3 2577660 1 2024-09-19T06:40:40.202 INFO:tasks.workunit.client.1.smithi117.stdout:6/504: creat d1/d5/f8e x:0 0 0 2024-09-19T06:40:40.202 INFO:tasks.workunit.client.0.smithi099.stdout:0/526: symlink d0/db/d13/d1f/d3a/laa 0 2024-09-19T06:40:40.202 INFO:tasks.workunit.client.1.smithi117.stdout:6/505: chown d1/d14/f2b 31744147 1 2024-09-19T06:40:40.203 INFO:tasks.workunit.client.1.smithi117.stdout:6/506: fsync d1/d3/f3e 0 2024-09-19T06:40:40.204 INFO:tasks.workunit.client.0.smithi099.stdout:0/527: symlink d0/db/d13/d47/d75/lab 0 2024-09-19T06:40:40.205 INFO:tasks.workunit.client.1.smithi117.stdout:2/656: getdents d0/d12/d2f/d98/dd2 0 2024-09-19T06:40:40.208 INFO:tasks.workunit.client.0.smithi099.stdout:0/528: unlink d0/db/d27/l5c 0 2024-09-19T06:40:40.208 INFO:tasks.workunit.client.1.smithi117.stdout:2/657: rmdir d0/d7/d29/d35/d61/d65 39 2024-09-19T06:40:40.212 INFO:tasks.workunit.client.1.smithi117.stdout:6/507: dwrite d1/d3/d25/f52 [0,4194304] 0 2024-09-19T06:40:40.213 INFO:tasks.workunit.client.1.smithi117.stdout:6/508: write d1/d3d/d6f/f7c [487025,128812] 0 2024-09-19T06:40:40.216 INFO:tasks.workunit.client.1.smithi117.stdout:6/509: fdatasync d1/d5/d8/f5d 0 2024-09-19T06:40:40.217 INFO:tasks.workunit.client.1.smithi117.stdout:2/658: dwrite d0/d7/d29/d35/d3d/f9b [0,4194304] 0 2024-09-19T06:40:40.218 INFO:tasks.workunit.client.1.smithi117.stdout:6/510: chown d1/d3/fd 19943162 1 2024-09-19T06:40:40.218 INFO:tasks.workunit.client.1.smithi117.stdout:6/511: readlink d1/d3/l62 0 2024-09-19T06:40:40.220 INFO:tasks.workunit.client.1.smithi117.stdout:2/659: readlink d0/d7/d1e/l82 0 2024-09-19T06:40:40.225 INFO:tasks.workunit.client.0.smithi099.stdout:1/546: dread d0/d17/d24/d3a/f81 [0,4194304] 0 2024-09-19T06:40:40.225 INFO:tasks.workunit.client.1.smithi117.stdout:6/512: dread d1/d14/f4c [0,4194304] 0 2024-09-19T06:40:40.226 INFO:tasks.workunit.client.0.smithi099.stdout:1/547: stat d0/db/f23 0 2024-09-19T06:40:40.227 INFO:tasks.workunit.client.1.smithi117.stdout:2/660: dread d0/d12/fea [0,4194304] 0 2024-09-19T06:40:40.227 INFO:tasks.workunit.client.0.smithi099.stdout:1/548: read d0/d17/d32/f6c [3889962,34656] 0 2024-09-19T06:40:40.228 INFO:tasks.workunit.client.1.smithi117.stdout:6/513: mknod d1/d5/d8/d5e/c8f 0 2024-09-19T06:40:40.230 INFO:tasks.workunit.client.0.smithi099.stdout:1/549: rename d0/d17/ca6 to d0/d12/d13/cb2 0 2024-09-19T06:40:40.231 INFO:tasks.workunit.client.0.smithi099.stdout:1/550: fsync d0/d12/f30 0 2024-09-19T06:40:40.232 INFO:tasks.workunit.client.0.smithi099.stdout:1/551: write d0/d12/d13/f89 [4289658,35847] 0 2024-09-19T06:40:40.233 INFO:tasks.workunit.client.1.smithi117.stdout:2/661: dwrite d0/ff [0,4194304] 0 2024-09-19T06:40:40.235 INFO:tasks.workunit.client.0.smithi099.stdout:1/552: symlink d0/d17/d24/d5e/lb3 0 2024-09-19T06:40:40.236 INFO:tasks.workunit.client.0.smithi099.stdout:6/534: write d1/f19 [1243461,26580] 0 2024-09-19T06:40:40.239 INFO:tasks.workunit.client.1.smithi117.stdout:6/514: write d1/d5/d32/f6b [1702482,64621] 0 2024-09-19T06:40:40.241 INFO:tasks.workunit.client.0.smithi099.stdout:6/535: read d1/d5/d24/d2e/d41/f5a [2143502,29916] 0 2024-09-19T06:40:40.241 INFO:tasks.workunit.client.1.smithi117.stdout:4/871: dwrite d3/d1b/d63/f8c [0,4194304] 0 2024-09-19T06:40:40.243 INFO:tasks.workunit.client.0.smithi099.stdout:1/553: dwrite d0/d17/d32/d7b/f84 [0,4194304] 0 2024-09-19T06:40:40.244 INFO:tasks.workunit.client.1.smithi117.stdout:2/662: read d0/d7/d29/db0/fc3 [407536,70636] 0 2024-09-19T06:40:40.245 INFO:tasks.workunit.client.0.smithi099.stdout:1/554: read d0/d17/d24/f42 [918817,120056] 0 2024-09-19T06:40:40.245 INFO:tasks.workunit.client.1.smithi117.stdout:4/872: mkdir d3/d1b/d63/d8e/d116 0 2024-09-19T06:40:40.246 INFO:tasks.workunit.client.0.smithi099.stdout:6/536: dread - d1/d5/d24/d2e/d41/f8d zero size 2024-09-19T06:40:40.246 INFO:tasks.workunit.client.0.smithi099.stdout:1/555: fdatasync d0/d17/d32/f6c 0 2024-09-19T06:40:40.247 INFO:tasks.workunit.client.0.smithi099.stdout:6/537: rmdir d1/d5/d24 39 2024-09-19T06:40:40.247 INFO:tasks.workunit.client.1.smithi117.stdout:2/663: rmdir d0/d12/d2f 39 2024-09-19T06:40:40.252 INFO:tasks.workunit.client.1.smithi117.stdout:4/873: link d3/d1b/d7d/d51/d95/df4/ffa d3/db/d20/f117 0 2024-09-19T06:40:40.252 INFO:tasks.workunit.client.0.smithi099.stdout:6/538: rmdir d1/d5 39 2024-09-19T06:40:40.253 INFO:tasks.workunit.client.1.smithi117.stdout:4/874: write d3/d65/d66/f78 [125874,61208] 0 2024-09-19T06:40:40.256 INFO:tasks.workunit.client.1.smithi117.stdout:4/875: fdatasync d3/db/d20/d29/d39/d4f/fac 0 2024-09-19T06:40:40.256 INFO:tasks.workunit.client.1.smithi117.stdout:4/876: mknod d3/db/d106/c118 0 2024-09-19T06:40:40.258 INFO:tasks.workunit.client.1.smithi117.stdout:4/877: symlink d3/d1b/d7d/l119 0 2024-09-19T06:40:40.268 INFO:tasks.workunit.client.1.smithi117.stdout:2/664: write d0/d7/d1e/d20/dbc/de6/ff2 [738777,102802] 0 2024-09-19T06:40:40.270 INFO:tasks.workunit.client.1.smithi117.stdout:2/665: creat d0/d64/ff7 x:0 0 0 2024-09-19T06:40:40.270 INFO:tasks.workunit.client.0.smithi099.stdout:6/539: dread d1/f1d [0,4194304] 0 2024-09-19T06:40:40.270 INFO:tasks.workunit.client.0.smithi099.stdout:6/540: fdatasync d1/f4c 0 2024-09-19T06:40:40.273 INFO:tasks.workunit.client.1.smithi117.stdout:4/878: dread d3/db/d20/d4a/f6f [0,4194304] 0 2024-09-19T06:40:40.273 INFO:tasks.workunit.client.0.smithi099.stdout:6/541: readlink d1/d5/d24/d2e/d41/d4e/d54/d5d/l78 0 2024-09-19T06:40:40.275 INFO:tasks.workunit.client.1.smithi117.stdout:4/879: mkdir d3/d1b/d63/d8e/d116/d11a 0 2024-09-19T06:40:40.277 INFO:tasks.workunit.client.1.smithi117.stdout:4/880: creat d3/d1b/d63/f11b x:0 0 0 2024-09-19T06:40:40.277 INFO:tasks.workunit.client.0.smithi099.stdout:6/542: truncate d1/d5/f50 4151591 0 2024-09-19T06:40:40.278 INFO:tasks.workunit.client.0.smithi099.stdout:6/543: fsync d1/d5/d38/d76/f90 0 2024-09-19T06:40:40.287 INFO:tasks.workunit.client.0.smithi099.stdout:6/544: dwrite d1/d12/faa [0,4194304] 0 2024-09-19T06:40:40.289 INFO:tasks.workunit.client.0.smithi099.stdout:6/545: stat d1/d5/d24/d2e/d41/d4e/d54/d5d/c98 0 2024-09-19T06:40:40.289 INFO:tasks.workunit.client.0.smithi099.stdout:6/546: stat d1/d5/d24/d2e/d41/d4e/d54/d5d/d61/l8e 0 2024-09-19T06:40:40.293 INFO:tasks.workunit.client.0.smithi099.stdout:6/547: dread d1/d5/d24/d2b/f74 [0,4194304] 0 2024-09-19T06:40:40.294 INFO:tasks.workunit.client.0.smithi099.stdout:6/548: readlink d1/l11 0 2024-09-19T06:40:40.295 INFO:tasks.workunit.client.0.smithi099.stdout:6/549: write d1/d7c/fad [999539,9334] 0 2024-09-19T06:40:40.295 INFO:tasks.workunit.client.1.smithi117.stdout:4/881: dread d3/f90 [0,4194304] 0 2024-09-19T06:40:40.298 INFO:tasks.workunit.client.0.smithi099.stdout:6/550: rename d1/d5/d24/d2e/d41/d4e to d1/d5/d38/d76/db0 0 2024-09-19T06:40:40.299 INFO:tasks.workunit.client.0.smithi099.stdout:6/551: chown d1/d5/d38/c40 17988 1 2024-09-19T06:40:40.301 INFO:tasks.workunit.client.0.smithi099.stdout:6/552: mknod d1/d5/cb1 0 2024-09-19T06:40:40.302 INFO:tasks.workunit.client.0.smithi099.stdout:6/553: creat d1/d5/d52/fb2 x:0 0 0 2024-09-19T06:40:40.303 INFO:tasks.workunit.client.1.smithi117.stdout:4/882: truncate d3/db/d20/d35/f70 2958420 0 2024-09-19T06:40:40.304 INFO:tasks.workunit.client.1.smithi117.stdout:4/883: write d3/db/d23/f54 [2196338,111169] 0 2024-09-19T06:40:40.305 INFO:tasks.workunit.client.0.smithi099.stdout:6/554: creat d1/d5/d38/d76/db0/d54/fb3 x:0 0 0 2024-09-19T06:40:40.306 INFO:tasks.workunit.client.1.smithi117.stdout:4/884: mknod d3/d1b/d7d/d9e/c11c 0 2024-09-19T06:40:40.307 INFO:tasks.workunit.client.1.smithi117.stdout:4/885: write d3/db/d23/f57 [3541098,67414] 0 2024-09-19T06:40:40.307 INFO:tasks.workunit.client.0.smithi099.stdout:6/555: link d1/d5/l7 d1/lb4 0 2024-09-19T06:40:40.308 INFO:tasks.workunit.client.1.smithi117.stdout:4/886: readlink d3/d4/lc 0 2024-09-19T06:40:40.309 INFO:tasks.workunit.client.1.smithi117.stdout:4/887: fsync d3/d1b/d7d/d9f/d110/f5d 0 2024-09-19T06:40:40.309 INFO:tasks.workunit.client.0.smithi099.stdout:6/556: mknod d1/d5/d24/d2e/d6e/cb5 0 2024-09-19T06:40:40.310 INFO:tasks.workunit.client.1.smithi117.stdout:4/888: chown d3/db/l37 306 1 2024-09-19T06:40:40.310 INFO:tasks.workunit.client.1.smithi117.stdout:4/889: stat d3/d1b/d7d/d51/d95/df4 0 2024-09-19T06:40:40.311 INFO:tasks.workunit.client.1.smithi117.stdout:4/890: write d3/d65/d66/dce/f103 [339467,40805] 0 2024-09-19T06:40:40.312 INFO:tasks.workunit.client.1.smithi117.stdout:4/891: fdatasync d3/d1b/d7d/d9f/d110/f5d 0 2024-09-19T06:40:40.312 INFO:tasks.workunit.client.0.smithi099.stdout:6/557: rename d1/d5/d24/d2e/d7b/c7e to d1/d5/d24/d2e/d6e/cb6 0 2024-09-19T06:40:40.313 INFO:tasks.workunit.client.0.smithi099.stdout:6/558: read - d1/d5/d38/fae zero size 2024-09-19T06:40:40.314 INFO:tasks.workunit.client.1.smithi117.stdout:4/892: creat d3/d1b/d63/d8e/d116/d11a/f11d x:0 0 0 2024-09-19T06:40:40.315 INFO:tasks.workunit.client.0.smithi099.stdout:6/559: getdents d1/d5/d24/d2b/d86/d9a/da7 0 2024-09-19T06:40:40.316 INFO:tasks.workunit.client.1.smithi117.stdout:4/893: creat d3/db/d20/f11e x:0 0 0 2024-09-19T06:40:40.318 INFO:tasks.workunit.client.0.smithi099.stdout:6/560: dread d1/f4c [0,4194304] 0 2024-09-19T06:40:40.320 INFO:tasks.workunit.client.0.smithi099.stdout:6/561: symlink d1/d5/d24/d2b/lb7 0 2024-09-19T06:40:40.321 INFO:tasks.workunit.client.1.smithi117.stdout:4/894: write d3/db/f3a [5064438,36240] 0 2024-09-19T06:40:40.324 INFO:tasks.workunit.client.1.smithi117.stdout:4/895: rmdir d3/db/d20/d35 39 2024-09-19T06:40:40.331 INFO:tasks.workunit.client.0.smithi099.stdout:6/562: dread d1/d5/d38/f59 [0,4194304] 0 2024-09-19T06:40:40.332 INFO:tasks.workunit.client.0.smithi099.stdout:6/563: readlink d1/l1c 0 2024-09-19T06:40:40.335 INFO:tasks.workunit.client.0.smithi099.stdout:6/564: creat d1/d5/d24/d2e/d41/fb8 x:0 0 0 2024-09-19T06:40:40.339 INFO:tasks.workunit.client.0.smithi099.stdout:6/565: link d1/d5/d38/d76/db0/f6d d1/d5/d24/fb9 0 2024-09-19T06:40:40.341 INFO:tasks.workunit.client.0.smithi099.stdout:6/566: mkdir d1/d5/d24/d2e/d7b/dba 0 2024-09-19T06:40:40.345 INFO:tasks.workunit.client.0.smithi099.stdout:6/567: rename d1/d5/d24/d2b/d86/d9a to d1/d5/d38/dbb 0 2024-09-19T06:40:40.346 INFO:tasks.workunit.client.0.smithi099.stdout:6/568: dread - d1/d5/d24/d2e/d41/f8d zero size 2024-09-19T06:40:40.355 INFO:tasks.workunit.client.0.smithi099.stdout:6/569: truncate d1/f10 265410 0 2024-09-19T06:40:40.360 INFO:tasks.workunit.client.0.smithi099.stdout:6/570: dwrite d1/d5/d38/d76/db0/d2a/f8b [0,4194304] 0 2024-09-19T06:40:40.363 INFO:tasks.workunit.client.0.smithi099.stdout:6/571: creat d1/d5/d24/fbc x:0 0 0 2024-09-19T06:40:40.369 INFO:tasks.workunit.client.0.smithi099.stdout:6/572: dwrite d1/d5/d38/f59 [0,4194304] 0 2024-09-19T06:40:40.378 INFO:tasks.workunit.client.0.smithi099.stdout:6/573: write d1/f1e [132826,177] 0 2024-09-19T06:40:40.381 INFO:tasks.workunit.client.0.smithi099.stdout:6/574: creat d1/d5/d38/dbb/da7/fbd x:0 0 0 2024-09-19T06:40:40.383 INFO:tasks.workunit.client.0.smithi099.stdout:6/575: creat d1/d5/d38/dbb/fbe x:0 0 0 2024-09-19T06:40:40.385 INFO:tasks.workunit.client.0.smithi099.stdout:6/576: rename d1/d5/lf to d1/d12/lbf 0 2024-09-19T06:40:40.391 INFO:tasks.workunit.client.1.smithi117.stdout:9/634: sync 2024-09-19T06:40:40.391 INFO:tasks.workunit.client.1.smithi117.stdout:0/558: sync 2024-09-19T06:40:40.391 INFO:tasks.workunit.client.0.smithi099.stdout:6/577: write d1/d5/d38/d76/db0/f6d [763922,30677] 0 2024-09-19T06:40:40.394 INFO:tasks.workunit.client.0.smithi099.stdout:6/578: read d1/d5/d38/d76/db0/d54/d5d/d61/f7d [3244448,21811] 0 2024-09-19T06:40:40.395 INFO:tasks.workunit.client.1.smithi117.stdout:0/559: truncate d11/d13/d28/f87 142560 0 2024-09-19T06:40:40.396 INFO:tasks.workunit.client.1.smithi117.stdout:0/560: fsync d11/d13/d28/d38/fa5 0 2024-09-19T06:40:40.406 INFO:tasks.workunit.client.1.smithi117.stdout:9/635: getdents d4/d8/d6a 0 2024-09-19T06:40:40.408 INFO:tasks.workunit.client.1.smithi117.stdout:9/636: mknod d4/d1c/d54/da5/daf/cd9 0 2024-09-19T06:40:40.411 INFO:tasks.workunit.client.1.smithi117.stdout:9/637: rename d4/d1c/d7a/d16/l43 to d4/d1c/d7a/d52/lda 0 2024-09-19T06:40:40.411 INFO:tasks.workunit.client.1.smithi117.stdout:9/638: chown d4/d20/f45 436199111 1 2024-09-19T06:40:40.412 INFO:tasks.workunit.client.1.smithi117.stdout:9/639: fdatasync d4/d58/f68 0 2024-09-19T06:40:40.413 INFO:tasks.workunit.client.1.smithi117.stdout:9/640: mkdir d4/d8/d6e/ddb 0 2024-09-19T06:40:40.420 INFO:tasks.workunit.client.1.smithi117.stdout:9/641: dwrite d4/d1c/d73/d9a/fc4 [0,4194304] 0 2024-09-19T06:40:40.422 INFO:tasks.workunit.client.1.smithi117.stdout:0/561: dwrite d11/d13/d14/d2c/d53/d7e/fab [4194304,4194304] 0 2024-09-19T06:40:40.425 INFO:tasks.workunit.client.1.smithi117.stdout:9/642: getdents d4/d1c/d46 0 2024-09-19T06:40:40.426 INFO:tasks.workunit.client.1.smithi117.stdout:0/562: dread d11/d13/d1b/d4b/fa8 [0,4194304] 0 2024-09-19T06:40:40.431 INFO:tasks.workunit.client.1.smithi117.stdout:9/643: link d4/d1c/f28 d4/d1c/d46/fdc 0 2024-09-19T06:40:40.432 INFO:tasks.workunit.client.1.smithi117.stdout:9/644: readlink d4/d1c/d7a/l5c 0 2024-09-19T06:40:40.434 INFO:tasks.workunit.client.1.smithi117.stdout:9/645: getdents d4/d1c/d7a/d52/d8d/dc1 0 2024-09-19T06:40:40.436 INFO:tasks.workunit.client.1.smithi117.stdout:9/646: symlink d4/d1c/d54/dd8/ldd 0 2024-09-19T06:40:40.437 INFO:tasks.workunit.client.1.smithi117.stdout:9/647: creat d4/d1c/d36/d37/fde x:0 0 0 2024-09-19T06:40:40.446 INFO:tasks.workunit.client.1.smithi117.stdout:0/563: dwrite d11/d13/d28/d38/f56 [0,4194304] 0 2024-09-19T06:40:40.450 INFO:tasks.workunit.client.1.smithi117.stdout:0/564: mknod d11/d13/d28/d38/d5b/cb9 0 2024-09-19T06:40:40.451 INFO:tasks.workunit.client.1.smithi117.stdout:0/565: write d11/d13/d1b/fa2 [1243194,46061] 0 2024-09-19T06:40:40.454 INFO:tasks.workunit.client.1.smithi117.stdout:0/566: creat d11/d13/d1b/d27/d37/d6d/fba x:0 0 0 2024-09-19T06:40:40.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:40 smithi099 ceph-mon[27651]: pgmap v18: 65 pgs: 65 active+clean; 1.9 GiB data, 7.2 GiB used, 529 GiB / 536 GiB avail; 62 MiB/s rd, 257 MiB/s wr, 430 op/s 2024-09-19T06:40:40.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:40 smithi099 ceph-mon[27651]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:40:40.460 INFO:tasks.workunit.client.1.smithi117.stdout:0/567: truncate d11/d13/d1b/d27/d54/f57 3164763 0 2024-09-19T06:40:40.461 INFO:tasks.workunit.client.1.smithi117.stdout:0/568: chown d11/d13/d28/f5d 1722 1 2024-09-19T06:40:40.462 INFO:tasks.workunit.client.1.smithi117.stdout:0/569: creat d11/fbb x:0 0 0 2024-09-19T06:40:40.463 INFO:tasks.workunit.client.1.smithi117.stdout:0/570: write d11/d13/d14/d2c/f8b [679977,46806] 0 2024-09-19T06:40:40.466 INFO:tasks.workunit.client.1.smithi117.stdout:0/571: unlink d11/d13/d1b/d4b/f4f 0 2024-09-19T06:40:40.467 INFO:tasks.workunit.client.1.smithi117.stdout:0/572: chown d11/d13/d1b/d4b/c97 1142 1 2024-09-19T06:40:40.471 INFO:tasks.workunit.client.1.smithi117.stdout:0/573: link d11/d13/d14/d2c/f2f d11/d13/d14/d2c/d35/d3e/fbc 0 2024-09-19T06:40:40.480 INFO:tasks.workunit.client.1.smithi117.stdout:0/574: dwrite d11/d13/d14/d2c/d53/f5c [0,4194304] 0 2024-09-19T06:40:40.483 INFO:tasks.workunit.client.1.smithi117.stdout:0/575: mkdir d11/d13/d14/dbd 0 2024-09-19T06:40:40.489 INFO:tasks.workunit.client.1.smithi117.stdout:0/576: read d11/d13/d14/f49 [1162925,67615] 0 2024-09-19T06:40:40.490 INFO:tasks.workunit.client.1.smithi117.stdout:0/577: creat d11/d13/d1b/d67/fbe x:0 0 0 2024-09-19T06:40:40.492 INFO:tasks.workunit.client.1.smithi117.stdout:0/578: chown d11/d13/d14/f33 50617221 1 2024-09-19T06:40:40.493 INFO:tasks.workunit.client.1.smithi117.stdout:0/579: symlink d11/d13/d7a/lbf 0 2024-09-19T06:40:40.495 INFO:tasks.workunit.client.1.smithi117.stdout:0/580: mkdir d11/d13/d1b/d27/d37/d6d/dc0 0 2024-09-19T06:40:40.496 INFO:tasks.workunit.client.1.smithi117.stdout:0/581: symlink d11/d13/d7a/lc1 0 2024-09-19T06:40:40.499 INFO:tasks.workunit.client.1.smithi117.stdout:0/582: rmdir d11/d13/d1b/d27/d37/d6d 39 2024-09-19T06:40:40.500 INFO:tasks.workunit.client.1.smithi117.stdout:0/583: chown d11/d13/d14/l25 39201203 1 2024-09-19T06:40:40.543 INFO:tasks.workunit.client.0.smithi099.stdout:4/564: sync 2024-09-19T06:40:40.545 INFO:tasks.workunit.client.0.smithi099.stdout:4/565: chown d12/d1b/d73/d81/d89/d91 410066 1 2024-09-19T06:40:40.546 INFO:tasks.workunit.client.0.smithi099.stdout:4/566: mknod d12/d32/cbc 0 2024-09-19T06:40:40.547 INFO:tasks.workunit.client.0.smithi099.stdout:4/567: chown d12/d1b/d73/d81/d89/c98 1454 1 2024-09-19T06:40:40.549 INFO:tasks.workunit.client.0.smithi099.stdout:4/568: creat d12/d1b/d88/fbd x:0 0 0 2024-09-19T06:40:40.549 INFO:tasks.workunit.client.1.smithi117.stdout:7/651: sync 2024-09-19T06:40:40.549 INFO:tasks.workunit.client.1.smithi117.stdout:0/584: readlink d11/d13/d1b/l8d 0 2024-09-19T06:40:40.550 INFO:tasks.workunit.client.1.smithi117.stdout:0/585: dread d11/d13/d1b/d4b/fa8 [0,4194304] 0 2024-09-19T06:40:40.551 INFO:tasks.workunit.client.1.smithi117.stdout:7/652: symlink d1/d4a/d81/d24/d49/le9 0 2024-09-19T06:40:40.551 INFO:tasks.workunit.client.0.smithi099.stdout:4/569: mknod d12/d1b/d73/d81/cbe 0 2024-09-19T06:40:40.552 INFO:tasks.workunit.client.1.smithi117.stdout:0/586: read d11/f19 [3773857,39157] 0 2024-09-19T06:40:40.553 INFO:tasks.workunit.client.1.smithi117.stdout:7/653: creat d1/d4a/d81/d24/d1c/d35/d4f/d9b/fea x:0 0 0 2024-09-19T06:40:40.554 INFO:tasks.workunit.client.1.smithi117.stdout:0/587: fdatasync d11/d13/d14/d16/f34 0 2024-09-19T06:40:40.555 INFO:tasks.workunit.client.1.smithi117.stdout:7/654: read d1/d4a/d81/d48/d5f/d82/fc3 [3290524,18650] 0 2024-09-19T06:40:40.555 INFO:tasks.workunit.client.1.smithi117.stdout:7/655: dread - d1/d4a/d7c/fd8 zero size 2024-09-19T06:40:40.556 INFO:tasks.workunit.client.0.smithi099.stdout:4/570: dwrite d12/f7e [4194304,4194304] 0 2024-09-19T06:40:40.556 INFO:tasks.workunit.client.1.smithi117.stdout:7/656: dread - d1/d4a/d81/d24/fc8 zero size 2024-09-19T06:40:40.561 INFO:tasks.workunit.client.0.smithi099.stdout:4/571: getdents d12/d1b/da4 0 2024-09-19T06:40:40.561 INFO:tasks.workunit.client.1.smithi117.stdout:0/588: creat d11/d13/d14/d2c/fc2 x:0 0 0 2024-09-19T06:40:40.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:40 smithi117 ceph-mon[34564]: pgmap v18: 65 pgs: 65 active+clean; 1.9 GiB data, 7.2 GiB used, 529 GiB / 536 GiB avail; 62 MiB/s rd, 257 MiB/s wr, 430 op/s 2024-09-19T06:40:40.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:40 smithi117 ceph-mon[34564]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:40:40.562 INFO:tasks.workunit.client.1.smithi117.stdout:7/657: dwrite d1/d4a/d7c/f98 [0,4194304] 0 2024-09-19T06:40:40.564 INFO:tasks.workunit.client.1.smithi117.stdout:0/589: chown d11/d13/d14/d2c/d35/d3e/f93 1443785076 1 2024-09-19T06:40:40.565 INFO:tasks.workunit.client.1.smithi117.stdout:7/658: mknod d1/d4a/d81/d24/d49/ceb 0 2024-09-19T06:40:40.566 INFO:tasks.workunit.client.0.smithi099.stdout:4/572: mkdir d12/d1b/d73/d81/d9b/dab/dbf 0 2024-09-19T06:40:40.567 INFO:tasks.workunit.client.1.smithi117.stdout:7/659: stat d1/d4a/d7c/fd8 0 2024-09-19T06:40:40.567 INFO:tasks.workunit.client.0.smithi099.stdout:4/573: dread - d12/d32/d42/d5c/d9d/fb2 zero size 2024-09-19T06:40:40.569 INFO:tasks.workunit.client.1.smithi117.stdout:0/590: creat d11/d13/d14/d2c/d64/fc3 x:0 0 0 2024-09-19T06:40:40.569 INFO:tasks.workunit.client.1.smithi117.stdout:7/660: unlink d1/d4a/d81/d24/d49/l4b 0 2024-09-19T06:40:40.570 INFO:tasks.workunit.client.1.smithi117.stdout:0/591: write d11/d13/d14/d2c/d64/f84 [461616,16327] 0 2024-09-19T06:40:40.571 INFO:tasks.workunit.client.1.smithi117.stdout:0/592: dread - d11/d13/f8e zero size 2024-09-19T06:40:40.572 INFO:tasks.workunit.client.0.smithi099.stdout:4/574: rename d12/d1b/l2d to d12/d1b/d88/lc0 0 2024-09-19T06:40:40.573 INFO:tasks.workunit.client.1.smithi117.stdout:7/661: creat d1/d4a/d7c/d95/db5/fec x:0 0 0 2024-09-19T06:40:40.573 INFO:tasks.workunit.client.1.smithi117.stdout:0/593: mknod d11/d13/d1b/d27/d37/d9d/cc4 0 2024-09-19T06:40:40.574 INFO:tasks.workunit.client.0.smithi099.stdout:4/575: rename d12/d1b/d73/d81/d8a to d12/d1b/d73/d81/d8a/dc1 22 2024-09-19T06:40:40.575 INFO:tasks.workunit.client.1.smithi117.stdout:0/594: read - d11/f83 zero size 2024-09-19T06:40:40.576 INFO:tasks.workunit.client.0.smithi099.stdout:4/576: fdatasync d12/d1b/d73/d81/d9b/fb0 0 2024-09-19T06:40:40.577 INFO:tasks.workunit.client.1.smithi117.stdout:0/595: mknod d11/d13/d14/d16/da1/cc5 0 2024-09-19T06:40:40.577 INFO:tasks.workunit.client.0.smithi099.stdout:4/577: write d12/d32/f3e [1715187,55650] 0 2024-09-19T06:40:40.579 INFO:tasks.workunit.client.1.smithi117.stdout:0/596: creat d11/d13/d14/d2c/d53/fc6 x:0 0 0 2024-09-19T06:40:40.580 INFO:tasks.workunit.client.0.smithi099.stdout:4/578: dread d12/d1b/da4/faf [0,4194304] 0 2024-09-19T06:40:40.582 INFO:tasks.workunit.client.0.smithi099.stdout:4/579: rename ce to d12/d1b/d73/d81/d8a/cc2 0 2024-09-19T06:40:40.584 INFO:tasks.workunit.client.1.smithi117.stdout:0/597: rename d11/d13/d14/d2c/d53/d7e/fab to d11/d13/fc7 0 2024-09-19T06:40:40.585 INFO:tasks.workunit.client.1.smithi117.stdout:7/662: write d1/d4a/d81/d24/d1c/f22 [1082188,29518] 0 2024-09-19T06:40:40.587 INFO:tasks.workunit.client.1.smithi117.stdout:7/663: read d1/d4a/d81/d24/d26/d44/fb2 [336823,124788] 0 2024-09-19T06:40:40.588 INFO:tasks.workunit.client.1.smithi117.stdout:7/664: chown d1/d3f/f4d 7439 1 2024-09-19T06:40:40.588 INFO:tasks.workunit.client.1.smithi117.stdout:0/598: dread d11/d13/d14/d16/f4a [0,4194304] 0 2024-09-19T06:40:40.589 INFO:tasks.workunit.client.1.smithi117.stdout:7/665: fdatasync d1/d4a/d7c/d95/db5/fda 0 2024-09-19T06:40:40.590 INFO:tasks.workunit.client.1.smithi117.stdout:0/599: creat d11/d13/d1b/d67/fc8 x:0 0 0 2024-09-19T06:40:40.591 INFO:tasks.workunit.client.1.smithi117.stdout:0/600: creat d11/d13/d14/d2c/d64/fc9 x:0 0 0 2024-09-19T06:40:40.593 INFO:tasks.workunit.client.1.smithi117.stdout:0/601: mkdir d11/d13/d14/d2c/d53/d7e/daa/dca 0 2024-09-19T06:40:40.594 INFO:tasks.workunit.client.1.smithi117.stdout:0/602: read - d11/d13/d28/f7f zero size 2024-09-19T06:40:40.597 INFO:tasks.workunit.client.1.smithi117.stdout:0/603: unlink d11/d13/d14/d2c/d35/d3e/f93 0 2024-09-19T06:40:40.598 INFO:tasks.workunit.client.1.smithi117.stdout:0/604: fdatasync d11/d13/d14/f49 0 2024-09-19T06:40:40.598 INFO:tasks.workunit.client.1.smithi117.stdout:0/605: stat d11/d13/d1b/d27/d37/f5e 0 2024-09-19T06:40:40.600 INFO:tasks.workunit.client.1.smithi117.stdout:0/606: creat d11/d13/d14/d2c/d35/d3e/fcb x:0 0 0 2024-09-19T06:40:40.601 INFO:tasks.workunit.client.1.smithi117.stdout:0/607: stat d11/d13/d1b/d67/f80 0 2024-09-19T06:40:40.604 INFO:tasks.workunit.client.1.smithi117.stdout:0/608: rmdir d11/d13/d1b/d27/d37/d6d/dc0 0 2024-09-19T06:40:40.604 INFO:tasks.workunit.client.1.smithi117.stdout:0/609: stat l5 0 2024-09-19T06:40:40.605 INFO:tasks.workunit.client.1.smithi117.stdout:0/610: chown d11/d13/d14/d2c/d53 1313102204 1 2024-09-19T06:40:40.613 INFO:tasks.workunit.client.1.smithi117.stdout:0/611: dwrite d11/f83 [0,4194304] 0 2024-09-19T06:40:40.617 INFO:tasks.workunit.client.1.smithi117.stdout:0/612: rmdir d11/d13/d14/d16 39 2024-09-19T06:40:40.618 INFO:tasks.workunit.client.1.smithi117.stdout:0/613: chown d11/d13/f8e 7140 1 2024-09-19T06:40:40.622 INFO:tasks.workunit.client.1.smithi117.stdout:0/614: symlink d11/d13/d14/d2c/d53/d7e/lcc 0 2024-09-19T06:40:40.624 INFO:tasks.workunit.client.1.smithi117.stdout:0/615: mknod d11/d13/d14/d16/da1/ccd 0 2024-09-19T06:40:40.626 INFO:tasks.workunit.client.1.smithi117.stdout:0/616: creat d11/d13/d1b/d27/d37/da9/fce x:0 0 0 2024-09-19T06:40:40.630 INFO:tasks.workunit.client.1.smithi117.stdout:0/617: write d11/f12 [1710488,87571] 0 2024-09-19T06:40:40.636 INFO:tasks.workunit.client.1.smithi117.stdout:0/618: dwrite d11/d13/d28/f92 [4194304,4194304] 0 2024-09-19T06:40:40.669 INFO:tasks.workunit.client.0.smithi099.stdout:9/574: sync 2024-09-19T06:40:40.670 INFO:tasks.workunit.client.0.smithi099.stdout:7/612: sync 2024-09-19T06:40:40.670 INFO:tasks.workunit.client.0.smithi099.stdout:9/575: chown dd/c89 9133 1 2024-09-19T06:40:40.671 INFO:tasks.workunit.client.0.smithi099.stdout:9/576: creat dd/d62/d76/fbb x:0 0 0 2024-09-19T06:40:40.672 INFO:tasks.workunit.client.0.smithi099.stdout:9/577: dread - dd/d47/d40/fb6 zero size 2024-09-19T06:40:40.674 INFO:tasks.workunit.client.0.smithi099.stdout:7/613: rename d7/fa to d7/dcf/d29/d1f/d45/fe0 0 2024-09-19T06:40:40.679 INFO:tasks.workunit.client.0.smithi099.stdout:7/614: dwrite d7/d39/d7d/f8e [0,4194304] 0 2024-09-19T06:40:40.683 INFO:tasks.workunit.client.1.smithi117.stdout:8/660: sync 2024-09-19T06:40:40.684 INFO:tasks.workunit.client.1.smithi117.stdout:8/661: write d1d/d2a/d3f/d73/f85 [983540,116920] 0 2024-09-19T06:40:40.685 INFO:tasks.workunit.client.0.smithi099.stdout:9/578: dwrite dd/d2c/f4b [0,4194304] 0 2024-09-19T06:40:40.687 INFO:tasks.workunit.client.0.smithi099.stdout:9/579: stat dd/d47/d40/l7e 0 2024-09-19T06:40:40.688 INFO:tasks.workunit.client.0.smithi099.stdout:9/580: chown l0 5 1 2024-09-19T06:40:40.688 INFO:tasks.workunit.client.1.smithi117.stdout:8/662: rename d1d/d2a/d3f/d4b/l5e to d1d/d31/d83/le0 0 2024-09-19T06:40:40.689 INFO:tasks.workunit.client.0.smithi099.stdout:9/581: stat dd/d62/d76/fb9 0 2024-09-19T06:40:40.693 INFO:tasks.workunit.client.0.smithi099.stdout:9/582: creat dd/d2c/d5c/d85/d8d/fbc x:0 0 0 2024-09-19T06:40:40.694 INFO:tasks.workunit.client.0.smithi099.stdout:7/615: dwrite d7/dcf/d29/f4c [0,4194304] 0 2024-09-19T06:40:40.696 INFO:tasks.workunit.client.0.smithi099.stdout:7/616: chown d7/d39/l3a 88442949 1 2024-09-19T06:40:40.697 INFO:tasks.workunit.client.0.smithi099.stdout:9/583: symlink dd/d2c/d5c/lbd 0 2024-09-19T06:40:40.697 INFO:tasks.workunit.client.0.smithi099.stdout:7/617: dread - d7/dcf/d29/d4e/fa6 zero size 2024-09-19T06:40:40.699 INFO:tasks.workunit.client.0.smithi099.stdout:7/618: write d7/dcf/d29/d1f/d45/f8b [3608963,40691] 0 2024-09-19T06:40:40.700 INFO:tasks.workunit.client.0.smithi099.stdout:9/584: rename dd/d2c/fae to dd/d62/d78/fbe 0 2024-09-19T06:40:40.702 INFO:tasks.workunit.client.0.smithi099.stdout:7/619: dread - d7/dcf/d29/d1f/d45/d48/d63/d75/f8d zero size 2024-09-19T06:40:40.704 INFO:tasks.workunit.client.1.smithi117.stdout:8/663: truncate d1d/f27 2718327 0 2024-09-19T06:40:40.705 INFO:tasks.workunit.client.0.smithi099.stdout:9/585: getdents dd/d65/da3 0 2024-09-19T06:40:40.705 INFO:tasks.workunit.client.1.smithi117.stdout:8/664: fdatasync d1d/d31/f79 0 2024-09-19T06:40:40.706 INFO:tasks.workunit.client.1.smithi117.stdout:8/665: truncate d1d/d2a/d3f/fca 844727 0 2024-09-19T06:40:40.707 INFO:tasks.workunit.client.0.smithi099.stdout:7/620: rename d7/dcf/d29/d1f/d45/d48/f80 to d7/dcf/d29/d1f/d45/d48/ddc/fe1 0 2024-09-19T06:40:40.708 INFO:tasks.workunit.client.0.smithi099.stdout:9/586: creat dd/d2c/d79/fbf x:0 0 0 2024-09-19T06:40:40.713 INFO:tasks.workunit.client.0.smithi099.stdout:7/621: link d7/dcf/d97/fd0 d7/dcf/d29/d1f/d45/d48/fe2 0 2024-09-19T06:40:40.727 INFO:tasks.workunit.client.0.smithi099.stdout:7/622: dwrite d7/f52 [0,4194304] 0 2024-09-19T06:40:40.730 INFO:tasks.workunit.client.0.smithi099.stdout:9/587: dread dd/f6a [0,4194304] 0 2024-09-19T06:40:40.732 INFO:tasks.workunit.client.0.smithi099.stdout:9/588: rmdir dd/d47/d40 39 2024-09-19T06:40:40.734 INFO:tasks.workunit.client.1.smithi117.stdout:8/666: dread d1d/f40 [0,4194304] 0 2024-09-19T06:40:40.735 INFO:tasks.workunit.client.0.smithi099.stdout:7/623: getdents d7/dcf/d29/d1f/d45/d48/d63/d71 0 2024-09-19T06:40:40.736 INFO:tasks.workunit.client.0.smithi099.stdout:7/624: stat d7/dcf/d29/d1f/d45/d48/d63/d75/f8d 0 2024-09-19T06:40:40.736 INFO:tasks.workunit.client.0.smithi099.stdout:9/589: fsync dd/d2c/f54 0 2024-09-19T06:40:40.737 INFO:tasks.workunit.client.1.smithi117.stdout:8/667: read - d1d/d2a/d3f/d4b/d91/fdf zero size 2024-09-19T06:40:40.737 INFO:tasks.workunit.client.0.smithi099.stdout:9/590: truncate dd/d2c/f98 936267 0 2024-09-19T06:40:40.739 INFO:tasks.workunit.client.0.smithi099.stdout:7/625: creat d7/d39/d7d/fe3 x:0 0 0 2024-09-19T06:40:40.739 INFO:tasks.workunit.client.0.smithi099.stdout:9/591: read dd/d65/da3/fa6 [1451206,1673] 0 2024-09-19T06:40:40.739 INFO:tasks.workunit.client.1.smithi117.stdout:8/668: write d1d/d2a/d3f/d73/ddd/f43 [3056285,32416] 0 2024-09-19T06:40:40.743 INFO:tasks.workunit.client.0.smithi099.stdout:7/626: dread d7/d39/d7d/f8e [0,4194304] 0 2024-09-19T06:40:40.747 INFO:tasks.workunit.client.0.smithi099.stdout:9/592: dwrite dd/d47/d40/f56 [0,4194304] 0 2024-09-19T06:40:40.748 INFO:tasks.workunit.client.0.smithi099.stdout:9/593: write dd/d62/d78/f7b [4624044,88621] 0 2024-09-19T06:40:40.749 INFO:tasks.workunit.client.1.smithi117.stdout:3/690: sync 2024-09-19T06:40:40.750 INFO:tasks.workunit.client.1.smithi117.stdout:1/622: sync 2024-09-19T06:40:40.750 INFO:tasks.workunit.client.1.smithi117.stdout:5/747: sync 2024-09-19T06:40:40.752 INFO:tasks.workunit.client.1.smithi117.stdout:5/748: chown d17/d1b/d3a/l45 19854 1 2024-09-19T06:40:40.755 INFO:tasks.workunit.client.1.smithi117.stdout:3/691: mknod d0/d3d/d48/dc7/cda 0 2024-09-19T06:40:40.755 INFO:tasks.workunit.client.1.smithi117.stdout:8/669: dwrite d1d/f61 [0,4194304] 0 2024-09-19T06:40:40.756 INFO:tasks.workunit.client.0.smithi099.stdout:9/594: dwrite dd/f44 [0,4194304] 0 2024-09-19T06:40:40.756 INFO:tasks.workunit.client.1.smithi117.stdout:5/749: write d17/d1b/d3a/d3c/dcb/dde/d65/d88/de5/d6a/f72 [828530,122840] 0 2024-09-19T06:40:40.760 INFO:tasks.workunit.client.0.smithi099.stdout:9/595: rename dd/d47/d40/l24 to dd/d47/d40/d61/lc0 0 2024-09-19T06:40:40.761 INFO:tasks.workunit.client.1.smithi117.stdout:1/623: dwrite f1 [4194304,4194304] 0 2024-09-19T06:40:40.761 INFO:tasks.workunit.client.1.smithi117.stdout:5/750: unlink d17/f74 0 2024-09-19T06:40:40.762 INFO:tasks.workunit.client.0.smithi099.stdout:9/596: chown dd/d62/d76/faf 28 1 2024-09-19T06:40:40.762 INFO:tasks.workunit.client.0.smithi099.stdout:3/745: sync 2024-09-19T06:40:40.762 INFO:tasks.workunit.client.0.smithi099.stdout:2/407: sync 2024-09-19T06:40:40.763 INFO:tasks.workunit.client.1.smithi117.stdout:8/670: creat d1d/d2a/d3f/d4b/d66/dac/fe1 x:0 0 0 2024-09-19T06:40:40.764 INFO:tasks.workunit.client.0.smithi099.stdout:2/408: chown d1/d2/d4d/d52/d18/d27/c42 154299 1 2024-09-19T06:40:40.765 INFO:tasks.workunit.client.1.smithi117.stdout:1/624: dread d3/d18/d23/d74/fb7 [0,4194304] 0 2024-09-19T06:40:40.766 INFO:tasks.workunit.client.0.smithi099.stdout:9/597: mkdir dd/d47/dc1 0 2024-09-19T06:40:40.767 INFO:tasks.workunit.client.0.smithi099.stdout:3/746: unlink d7/d34/d1d/d20/d58/d5c/dbd/cd2 0 2024-09-19T06:40:40.767 INFO:tasks.workunit.client.1.smithi117.stdout:8/671: mkdir d1d/d2a/d3f/d4b/d66/dac/de2 0 2024-09-19T06:40:40.768 INFO:tasks.workunit.client.0.smithi099.stdout:2/409: creat d1/d2/d5/d6/f87 x:0 0 0 2024-09-19T06:40:40.769 INFO:tasks.workunit.client.0.smithi099.stdout:9/598: mknod dd/d65/cc2 0 2024-09-19T06:40:40.769 INFO:tasks.workunit.client.0.smithi099.stdout:3/747: mkdir d7/d34/d1d/d36/db8/de4 0 2024-09-19T06:40:40.770 INFO:tasks.workunit.client.1.smithi117.stdout:8/672: truncate d1d/d1e/f5c 1292073 0 2024-09-19T06:40:40.771 INFO:tasks.workunit.client.0.smithi099.stdout:2/410: mkdir d1/d2/d4d/d52/d18/d2d/d88 0 2024-09-19T06:40:40.773 INFO:tasks.workunit.client.0.smithi099.stdout:9/599: mkdir dd/d2c/d5c/dc3 0 2024-09-19T06:40:40.775 INFO:tasks.workunit.client.1.smithi117.stdout:8/673: creat d1d/d31/fe3 x:0 0 0 2024-09-19T06:40:40.776 INFO:tasks.workunit.client.1.smithi117.stdout:8/674: chown d1d/f50 60 1 2024-09-19T06:40:40.776 INFO:tasks.workunit.client.0.smithi099.stdout:7/627: dread d7/f41 [0,4194304] 0 2024-09-19T06:40:40.777 INFO:tasks.workunit.client.0.smithi099.stdout:3/748: getdents d7/d34/d1d/d20/d58/d5c/d98/dde 0 2024-09-19T06:40:40.778 INFO:tasks.workunit.client.1.smithi117.stdout:8/675: creat d1d/d2a/fe4 x:0 0 0 2024-09-19T06:40:40.778 INFO:tasks.workunit.client.0.smithi099.stdout:2/411: rename d1/d2/d4d/d52/d9/d63/l3d to d1/d2/d5/d13/l89 0 2024-09-19T06:40:40.779 INFO:tasks.workunit.client.0.smithi099.stdout:9/600: dread dd/d2c/d79/f7c [0,4194304] 0 2024-09-19T06:40:40.779 INFO:tasks.workunit.client.0.smithi099.stdout:3/749: write d7/d34/f1f [8955491,120084] 0 2024-09-19T06:40:40.780 INFO:tasks.workunit.client.0.smithi099.stdout:7/628: creat d7/dcf/d29/d1f/d45/d48/d63/d75/dd8/fe4 x:0 0 0 2024-09-19T06:40:40.781 INFO:tasks.workunit.client.0.smithi099.stdout:3/750: stat d7/d34/d1d/d36/d69/fc9 0 2024-09-19T06:40:40.781 INFO:tasks.workunit.client.0.smithi099.stdout:7/629: stat d7/dcf/d29/d34/da1 0 2024-09-19T06:40:40.782 INFO:tasks.workunit.client.0.smithi099.stdout:2/412: creat d1/d2/d4d/d52/d36/f8a x:0 0 0 2024-09-19T06:40:40.783 INFO:tasks.workunit.client.0.smithi099.stdout:9/601: creat dd/d47/fc4 x:0 0 0 2024-09-19T06:40:40.784 INFO:tasks.workunit.client.0.smithi099.stdout:3/751: truncate d7/d34/d1d/d20/d58/d5c/fd0 533673 0 2024-09-19T06:40:40.785 INFO:tasks.workunit.client.1.smithi117.stdout:4/896: sync 2024-09-19T06:40:40.785 INFO:tasks.workunit.client.1.smithi117.stdout:0/619: sync 2024-09-19T06:40:40.785 INFO:tasks.workunit.client.1.smithi117.stdout:7/666: sync 2024-09-19T06:40:40.785 INFO:tasks.workunit.client.1.smithi117.stdout:9/648: sync 2024-09-19T06:40:40.785 INFO:tasks.workunit.client.1.smithi117.stdout:2/666: sync 2024-09-19T06:40:40.785 INFO:tasks.workunit.client.1.smithi117.stdout:6/515: sync 2024-09-19T06:40:40.786 INFO:tasks.workunit.client.0.smithi099.stdout:7/630: truncate d7/dcf/d29/d1f/d45/d48/fe2 75179 0 2024-09-19T06:40:40.786 INFO:tasks.workunit.client.0.smithi099.stdout:9/602: mknod dd/d62/d78/cc5 0 2024-09-19T06:40:40.787 INFO:tasks.workunit.client.1.smithi117.stdout:7/667: chown d1/c5e 386974 1 2024-09-19T06:40:40.788 INFO:tasks.workunit.client.1.smithi117.stdout:6/516: dread - d1/d5/d8/d5e/d6d/f79 zero size 2024-09-19T06:40:40.788 INFO:tasks.workunit.client.0.smithi099.stdout:3/752: symlink d7/d34/d1d/d20/d75/le5 0 2024-09-19T06:40:40.789 INFO:tasks.workunit.client.1.smithi117.stdout:9/649: unlink d4/d1c/d5f/l8b 0 2024-09-19T06:40:40.789 INFO:tasks.workunit.client.1.smithi117.stdout:2/667: rmdir d0/d7/d58/da8 39 2024-09-19T06:40:40.789 INFO:tasks.workunit.client.1.smithi117.stdout:3/692: dread d0/d3d/d48/f7e [0,4194304] 0 2024-09-19T06:40:40.790 INFO:tasks.workunit.client.0.smithi099.stdout:7/631: mkdir d7/dcf/d97/de5 0 2024-09-19T06:40:40.790 INFO:tasks.workunit.client.1.smithi117.stdout:4/897: stat d3/d65/d66/d80/dc5 0 2024-09-19T06:40:40.790 INFO:tasks.workunit.client.1.smithi117.stdout:0/620: mkdir d11/d13/d14/d2c/d53/dcf 0 2024-09-19T06:40:40.791 INFO:tasks.workunit.client.0.smithi099.stdout:3/753: dread - d7/d34/d1d/d20/d75/d9d/fd4 zero size 2024-09-19T06:40:40.791 INFO:tasks.workunit.client.0.smithi099.stdout:9/603: mknod dd/d47/cc6 0 2024-09-19T06:40:40.791 INFO:tasks.workunit.client.0.smithi099.stdout:2/413: dwrite d1/d2/d4d/d52/f1a [4194304,4194304] 0 2024-09-19T06:40:40.792 INFO:tasks.workunit.client.1.smithi117.stdout:6/517: unlink d1/d5/d32/d45/f4d 0 2024-09-19T06:40:40.793 INFO:tasks.workunit.client.0.smithi099.stdout:7/632: creat d7/dcf/d97/fe6 x:0 0 0 2024-09-19T06:40:40.793 INFO:tasks.workunit.client.0.smithi099.stdout:9/604: write dd/d2c/f30 [5801023,108003] 0 2024-09-19T06:40:40.794 INFO:tasks.workunit.client.1.smithi117.stdout:9/650: creat d4/d8/d6a/d82/da3/fdf x:0 0 0 2024-09-19T06:40:40.795 INFO:tasks.workunit.client.0.smithi099.stdout:3/754: dread - d7/d34/d1d/d36/d42/fae zero size 2024-09-19T06:40:40.795 INFO:tasks.workunit.client.0.smithi099.stdout:7/633: chown d7/dcf/d97/fe6 270840487 1 2024-09-19T06:40:40.797 INFO:tasks.workunit.client.0.smithi099.stdout:7/634: dread - d7/dcf/d29/d34/fa8 zero size 2024-09-19T06:40:40.799 INFO:tasks.workunit.client.0.smithi099.stdout:9/605: creat dd/d2c/d5c/d85/fc7 x:0 0 0 2024-09-19T06:40:40.799 INFO:tasks.workunit.client.0.smithi099.stdout:6/579: sync 2024-09-19T06:40:40.799 INFO:tasks.workunit.client.0.smithi099.stdout:5/708: sync 2024-09-19T06:40:40.799 INFO:tasks.workunit.client.0.smithi099.stdout:8/428: sync 2024-09-19T06:40:40.799 INFO:tasks.workunit.client.0.smithi099.stdout:0/529: sync 2024-09-19T06:40:40.799 INFO:tasks.workunit.client.0.smithi099.stdout:1/556: sync 2024-09-19T06:40:40.800 INFO:tasks.workunit.client.0.smithi099.stdout:4/580: sync 2024-09-19T06:40:40.800 INFO:tasks.workunit.client.0.smithi099.stdout:6/580: chown d1/d5 333657 1 2024-09-19T06:40:40.801 INFO:tasks.workunit.client.0.smithi099.stdout:2/414: rename d1/d2/d5/d6/c20 to d1/c8b 0 2024-09-19T06:40:40.801 INFO:tasks.workunit.client.1.smithi117.stdout:2/668: creat d0/d7/d29/d35/d3d/d72/ff8 x:0 0 0 2024-09-19T06:40:40.801 INFO:tasks.workunit.client.1.smithi117.stdout:1/625: write d3/da1/db1/d93/fd1 [3370753,127886] 0 2024-09-19T06:40:40.802 INFO:tasks.workunit.client.0.smithi099.stdout:5/709: chown d3/d16/d2f/d34/da4/da5 0 1 2024-09-19T06:40:40.803 INFO:tasks.workunit.client.1.smithi117.stdout:6/518: unlink d1/d3d/c57 0 2024-09-19T06:40:40.804 INFO:tasks.workunit.client.0.smithi099.stdout:7/635: mkdir d7/dc7/de7 0 2024-09-19T06:40:40.805 INFO:tasks.workunit.client.1.smithi117.stdout:9/651: dwrite d4/d1c/d73/fa7 [0,4194304] 0 2024-09-19T06:40:40.805 INFO:tasks.workunit.client.0.smithi099.stdout:0/530: write d0/db/d13/d1f/d39/f66 [863638,99970] 0 2024-09-19T06:40:40.806 INFO:tasks.workunit.client.1.smithi117.stdout:7/668: mknod d1/d4a/d81/d24/d1c/da8/ced 0 2024-09-19T06:40:40.809 INFO:tasks.workunit.client.0.smithi099.stdout:1/557: mknod d0/d17/d24/d3a/da4/cb4 0 2024-09-19T06:40:40.810 INFO:tasks.workunit.client.1.smithi117.stdout:0/621: dread d11/d13/d14/f6b [0,4194304] 0 2024-09-19T06:40:40.810 INFO:tasks.workunit.client.1.smithi117.stdout:5/751: dwrite d17/d1b/d3a/d3c/d70/f79 [0,4194304] 0 2024-09-19T06:40:40.812 INFO:tasks.workunit.client.0.smithi099.stdout:4/581: symlink d12/d1b/d73/d81/d9b/da2/lc3 0 2024-09-19T06:40:40.813 INFO:tasks.workunit.client.1.smithi117.stdout:2/669: mknod d0/d12/d32/db5/cf9 0 2024-09-19T06:40:40.813 INFO:tasks.workunit.client.1.smithi117.stdout:1/626: creat d3/d18/d56/fdb x:0 0 0 2024-09-19T06:40:40.814 INFO:tasks.workunit.client.0.smithi099.stdout:6/581: creat d1/d5/d38/d76/db0/d54/d5d/fc0 x:0 0 0 2024-09-19T06:40:40.817 INFO:tasks.workunit.client.0.smithi099.stdout:2/415: rename d1/f39 to d1/d2/d4d/d52/d18/d27/d5b/f8c 0 2024-09-19T06:40:40.818 INFO:tasks.workunit.client.0.smithi099.stdout:1/558: rmdir d0/d12/d54 39 2024-09-19T06:40:40.818 INFO:tasks.workunit.client.1.smithi117.stdout:0/622: chown d11/d13/d14/d2c/d53/fc6 5475711 1 2024-09-19T06:40:40.820 INFO:tasks.workunit.client.0.smithi099.stdout:9/606: dwrite dd/d2c/d5c/d64/d93/f9b [0,4194304] 0 2024-09-19T06:40:40.822 INFO:tasks.workunit.client.1.smithi117.stdout:4/898: getdents d3/d1b/d7d/d51/d95 0 2024-09-19T06:40:40.823 INFO:tasks.workunit.client.0.smithi099.stdout:3/755: dwrite d7/d34/d1d/d36/d69/d6d/f7b [0,4194304] 0 2024-09-19T06:40:40.824 INFO:tasks.workunit.client.1.smithi117.stdout:5/752: mknod d17/d1b/d3a/d3c/dcb/dde/d65/d88/cfb 0 2024-09-19T06:40:40.824 INFO:tasks.workunit.client.1.smithi117.stdout:8/676: dwrite d1d/d31/f9a [0,4194304] 0 2024-09-19T06:40:40.825 INFO:tasks.workunit.client.0.smithi099.stdout:9/607: write dd/f5b [826838,13259] 0 2024-09-19T06:40:40.826 INFO:tasks.workunit.client.0.smithi099.stdout:7/636: rename d7/dcf/d29/d34/da1/fbb to d7/dcf/d29/d1f/d45/d48/dda/fe8 0 2024-09-19T06:40:40.827 INFO:tasks.workunit.client.0.smithi099.stdout:9/608: chown dd/d2c/d5c/d64/d93 4948 1 2024-09-19T06:40:40.827 INFO:tasks.workunit.client.1.smithi117.stdout:4/899: dread - d3/d1b/d7d/d51/d95/df4/ffa zero size 2024-09-19T06:40:40.828 INFO:tasks.workunit.client.1.smithi117.stdout:3/693: dwrite d0/d9/d1c/f1d [0,4194304] 0 2024-09-19T06:40:40.828 INFO:tasks.workunit.client.1.smithi117.stdout:7/669: rename d1/d4a/f5d to d1/d72/dd7/fee 0 2024-09-19T06:40:40.829 INFO:tasks.workunit.client.0.smithi099.stdout:6/582: symlink d1/d5/d38/d76/db0/d54/d5d/d61/lc1 0 2024-09-19T06:40:40.832 INFO:tasks.workunit.client.1.smithi117.stdout:4/900: symlink d3/d1b/d7d/d9f/l11f 0 2024-09-19T06:40:40.834 INFO:tasks.workunit.client.0.smithi099.stdout:6/583: fsync d1/d5/d24/d2e/f70 0 2024-09-19T06:40:40.839 INFO:tasks.workunit.client.1.smithi117.stdout:2/670: getdents d0/d12/d32 0 2024-09-19T06:40:40.839 INFO:tasks.workunit.client.1.smithi117.stdout:7/670: mknod d1/d4a/d81/d24/d1c/d35/d4f/d9b/cef 0 2024-09-19T06:40:40.840 INFO:tasks.workunit.client.1.smithi117.stdout:0/623: dwrite d11/d13/d28/d38/d5b/f73 [0,4194304] 0 2024-09-19T06:40:40.840 INFO:tasks.workunit.client.1.smithi117.stdout:3/694: mkdir d0/d19/d2b/d8e/ddb 0 2024-09-19T06:40:40.841 INFO:tasks.workunit.client.1.smithi117.stdout:7/671: stat d1/d4a/d77 0 2024-09-19T06:40:40.842 INFO:tasks.workunit.client.1.smithi117.stdout:2/671: stat d0/d12/fea 0 2024-09-19T06:40:40.842 INFO:tasks.workunit.client.1.smithi117.stdout:0/624: stat d11/d13/d28/f87 0 2024-09-19T06:40:40.843 INFO:tasks.workunit.client.0.smithi099.stdout:1/559: mknod d0/d17/d5b/cb5 0 2024-09-19T06:40:40.843 INFO:tasks.workunit.client.0.smithi099.stdout:4/582: dwrite d12/d32/d42/f55 [0,4194304] 0 2024-09-19T06:40:40.843 INFO:tasks.workunit.client.1.smithi117.stdout:1/627: write d3/d18/d23/f65 [2413093,67539] 0 2024-09-19T06:40:40.844 INFO:tasks.workunit.client.0.smithi099.stdout:2/416: dwrite d1/d2/d5/d13/d2c/f70 [0,4194304] 0 2024-09-19T06:40:40.844 INFO:tasks.workunit.client.1.smithi117.stdout:6/519: truncate d1/d5/d32/f6b 188314 0 2024-09-19T06:40:40.845 INFO:tasks.workunit.client.1.smithi117.stdout:0/625: dread - d11/d13/d7a/fb4 zero size 2024-09-19T06:40:40.847 INFO:tasks.workunit.client.0.smithi099.stdout:9/609: creat dd/d65/da3/fc8 x:0 0 0 2024-09-19T06:40:40.847 INFO:tasks.workunit.client.0.smithi099.stdout:3/756: dread d7/d34/d1d/d36/f29 [4194304,4194304] 0 2024-09-19T06:40:40.848 INFO:tasks.workunit.client.1.smithi117.stdout:0/626: dread - d11/d13/d1b/d27/d54/f8f zero size 2024-09-19T06:40:40.849 INFO:tasks.workunit.client.0.smithi099.stdout:6/584: mkdir d1/d5/d24/d2b/dc2 0 2024-09-19T06:40:40.849 INFO:tasks.workunit.client.0.smithi099.stdout:7/637: fdatasync d7/dcf/d29/f16 0 2024-09-19T06:40:40.851 INFO:tasks.workunit.client.0.smithi099.stdout:1/560: write d0/d17/d32/d7b/d99/f9e [452892,129766] 0 2024-09-19T06:40:40.851 INFO:tasks.workunit.client.0.smithi099.stdout:3/757: fdatasync d7/d34/d1d/d57/fbc 0 2024-09-19T06:40:40.851 INFO:tasks.workunit.client.0.smithi099.stdout:2/417: mknod d1/d2/d4d/d55/c8d 0 2024-09-19T06:40:40.851 INFO:tasks.workunit.client.1.smithi117.stdout:1/628: rename d3/d22/f90 to d3/d22/d2f/fdc 0 2024-09-19T06:40:40.852 INFO:tasks.workunit.client.0.smithi099.stdout:4/583: chown d12/d32/d42/f55 27 1 2024-09-19T06:40:40.853 INFO:tasks.workunit.client.0.smithi099.stdout:9/610: mkdir dd/dc9 0 2024-09-19T06:40:40.853 INFO:tasks.workunit.client.0.smithi099.stdout:7/638: chown d7/dcf/d29/l5f 1 1 2024-09-19T06:40:40.854 INFO:tasks.workunit.client.1.smithi117.stdout:4/901: link d3/db/d20/d4a/d7b/da0/cb7 d3/db/d13/c120 0 2024-09-19T06:40:40.855 INFO:tasks.workunit.client.0.smithi099.stdout:2/418: chown d1/f15 2617302 1 2024-09-19T06:40:40.856 INFO:tasks.workunit.client.1.smithi117.stdout:1/629: stat d3/da1/db1/f9d 0 2024-09-19T06:40:40.858 INFO:tasks.workunit.client.0.smithi099.stdout:1/561: readlink d0/d17/d24/d5e/lb3 0 2024-09-19T06:40:40.859 INFO:tasks.workunit.client.1.smithi117.stdout:1/630: chown d3/d18/d23/f6f 5685144 1 2024-09-19T06:40:40.859 INFO:tasks.workunit.client.1.smithi117.stdout:5/753: write d17/d1b/d3a/d3c/dcb/dde/d65/fc1 [20226,79321] 0 2024-09-19T06:40:40.861 INFO:tasks.workunit.client.1.smithi117.stdout:2/672: creat d0/d7/d29/d35/d61/ffa x:0 0 0 2024-09-19T06:40:40.863 INFO:tasks.workunit.client.1.smithi117.stdout:5/754: dread - d17/d1b/d3a/d3c/d70/ff3 zero size 2024-09-19T06:40:40.863 INFO:tasks.workunit.client.0.smithi099.stdout:9/611: creat dd/dc9/fca x:0 0 0 2024-09-19T06:40:40.864 INFO:tasks.workunit.client.0.smithi099.stdout:8/429: truncate d4/f54 2463979 0 2024-09-19T06:40:40.864 INFO:tasks.workunit.client.1.smithi117.stdout:4/902: chown d3/d28/d2a/c50 252047 1 2024-09-19T06:40:40.868 INFO:tasks.workunit.client.0.smithi099.stdout:7/639: mkdir d7/dcf/d29/d1f/de9 0 2024-09-19T06:40:40.869 INFO:tasks.workunit.client.0.smithi099.stdout:5/710: dwrite d3/d16/d2f/f9a [0,4194304] 0 2024-09-19T06:40:40.869 INFO:tasks.workunit.client.0.smithi099.stdout:4/584: symlink d12/d1b/d73/d81/d9b/dab/dbf/lc4 0 2024-09-19T06:40:40.872 INFO:tasks.workunit.client.1.smithi117.stdout:1/631: dread - d3/d18/d23/d51/f86 zero size 2024-09-19T06:40:40.872 INFO:tasks.workunit.client.1.smithi117.stdout:0/627: dwrite d11/d13/d14/d16/f3a [0,4194304] 0 2024-09-19T06:40:40.872 INFO:tasks.workunit.client.1.smithi117.stdout:3/695: read d0/fc0 [751614,98456] 0 2024-09-19T06:40:40.872 INFO:tasks.workunit.client.1.smithi117.stdout:5/755: symlink d17/d1b/d3a/d3c/d70/lfc 0 2024-09-19T06:40:40.872 INFO:tasks.workunit.client.1.smithi117.stdout:9/652: dread d4/d8/f31 [0,4194304] 0 2024-09-19T06:40:40.872 INFO:tasks.workunit.client.1.smithi117.stdout:1/632: unlink d3/d18/d97/lc1 0 2024-09-19T06:40:40.873 INFO:tasks.workunit.client.0.smithi099.stdout:3/758: truncate d7/d34/d1d/d20/d75/d79/fda 64226 0 2024-09-19T06:40:40.873 INFO:tasks.workunit.client.0.smithi099.stdout:8/430: mkdir d4/d11/d23/d92 0 2024-09-19T06:40:40.874 INFO:tasks.workunit.client.1.smithi117.stdout:0/628: dread - d11/d13/d14/d2c/d35/d3e/f62 zero size 2024-09-19T06:40:40.875 INFO:tasks.workunit.client.1.smithi117.stdout:4/903: rename d3/db/d20/d29/d39/d4f/de7 to d3/db/d20/d29/d39/d121 0 2024-09-19T06:40:40.875 INFO:tasks.workunit.client.0.smithi099.stdout:4/585: chown d12/f30 116872 1 2024-09-19T06:40:40.878 INFO:tasks.workunit.client.0.smithi099.stdout:7/640: write d7/d39/d7d/f8e [4991590,84705] 0 2024-09-19T06:40:40.878 INFO:tasks.workunit.client.1.smithi117.stdout:9/653: rmdir d4/d1c/d7a 39 2024-09-19T06:40:40.879 INFO:tasks.workunit.client.1.smithi117.stdout:3/696: chown d0/d8/d7f/d40/dc4/l2e 95 1 2024-09-19T06:40:40.879 INFO:tasks.workunit.client.1.smithi117.stdout:5/756: read d17/d1b/d3a/d3c/dcb/dde/d55/f98 [3989774,47637] 0 2024-09-19T06:40:40.881 INFO:tasks.workunit.client.0.smithi099.stdout:6/585: dwrite d1/d5/d24/d2b/f80 [0,4194304] 0 2024-09-19T06:40:40.882 INFO:tasks.workunit.client.0.smithi099.stdout:2/419: dwrite d1/d2/f7a [0,4194304] 0 2024-09-19T06:40:40.882 INFO:tasks.workunit.client.1.smithi117.stdout:1/633: mknod d3/d18/cdd 0 2024-09-19T06:40:40.883 INFO:tasks.workunit.client.0.smithi099.stdout:8/431: mkdir d4/d11/d23/d4c/d93 0 2024-09-19T06:40:40.883 INFO:tasks.workunit.client.1.smithi117.stdout:8/677: write f4 [1116009,31134] 0 2024-09-19T06:40:40.883 INFO:tasks.workunit.client.1.smithi117.stdout:4/904: rename d3/d1b/d63/d8e/d116/d11a/f11d to d3/d65/f122 0 2024-09-19T06:40:40.885 INFO:tasks.workunit.client.1.smithi117.stdout:2/673: getdents d0/d7/d1e/d20 0 2024-09-19T06:40:40.885 INFO:tasks.workunit.client.1.smithi117.stdout:9/654: creat d4/d1c/d36/fe0 x:0 0 0 2024-09-19T06:40:40.886 INFO:tasks.workunit.client.0.smithi099.stdout:9/612: link dd/d62/d78/c8a dd/d65/ccb 0 2024-09-19T06:40:40.888 INFO:tasks.workunit.client.1.smithi117.stdout:0/629: dread d11/d13/f17 [4194304,4194304] 0 2024-09-19T06:40:40.888 INFO:tasks.workunit.client.1.smithi117.stdout:2/674: write d0/d7/d29/d35/d61/fe9 [168738,39244] 0 2024-09-19T06:40:40.892 INFO:tasks.workunit.client.1.smithi117.stdout:1/634: mkdir d3/d18/d23/dde 0 2024-09-19T06:40:40.893 INFO:tasks.workunit.client.0.smithi099.stdout:6/586: chown d1/d5/d24/d2e/d41/caf 176532 1 2024-09-19T06:40:40.894 INFO:tasks.workunit.client.0.smithi099.stdout:9/613: dread dd/d62/f66 [0,4194304] 0 2024-09-19T06:40:40.894 INFO:tasks.workunit.client.1.smithi117.stdout:3/697: getdents d0/d9/d1c 0 2024-09-19T06:40:40.895 INFO:tasks.workunit.client.1.smithi117.stdout:9/655: rmdir d4/d1c/d7a 39 2024-09-19T06:40:40.895 INFO:tasks.workunit.client.0.smithi099.stdout:5/711: dwrite d3/d16/d2f/d34/da4/da5/dce/de5/fe9 [0,4194304] 0 2024-09-19T06:40:40.896 INFO:tasks.workunit.client.1.smithi117.stdout:0/630: creat d11/d13/d28/d38/d5b/fd0 x:0 0 0 2024-09-19T06:40:40.896 INFO:tasks.workunit.client.0.smithi099.stdout:2/420: mkdir d1/d2/d4d/d8e 0 2024-09-19T06:40:40.897 INFO:tasks.workunit.client.1.smithi117.stdout:6/520: dread d1/d5/d8/f5d [0,4194304] 0 2024-09-19T06:40:40.897 INFO:tasks.workunit.client.0.smithi099.stdout:8/432: unlink d4/d11/d23/d4c/f51 0 2024-09-19T06:40:40.897 INFO:tasks.workunit.client.1.smithi117.stdout:0/631: fsync d11/d13/d1b/d67/fbe 0 2024-09-19T06:40:40.899 INFO:tasks.workunit.client.1.smithi117.stdout:8/678: rename d1d/d2a/d3f/d73/f9e to d1d/d1e/dbc/dc1/fe5 0 2024-09-19T06:40:40.899 INFO:tasks.workunit.client.1.smithi117.stdout:2/675: symlink d0/d7/d1e/d20/lfb 0 2024-09-19T06:40:40.900 INFO:tasks.workunit.client.1.smithi117.stdout:0/632: chown d11/d13/d14/d16/da1/ccd 1799759 1 2024-09-19T06:40:40.901 INFO:tasks.workunit.client.1.smithi117.stdout:8/679: chown d1d/d2a/d3f/d73/ddd/f6f 322 1 2024-09-19T06:40:40.901 INFO:tasks.workunit.client.1.smithi117.stdout:6/521: read d1/d5/d8/f4f [419845,81200] 0 2024-09-19T06:40:40.902 INFO:tasks.workunit.client.0.smithi099.stdout:2/421: fdatasync d1/d2/d4d/f66 0 2024-09-19T06:40:40.905 INFO:tasks.workunit.client.0.smithi099.stdout:6/587: dwrite d1/f4f [0,4194304] 0 2024-09-19T06:40:40.906 INFO:tasks.workunit.client.1.smithi117.stdout:0/633: mknod d11/d13/d14/d2c/d35/d3e/cd1 0 2024-09-19T06:40:40.910 INFO:tasks.workunit.client.1.smithi117.stdout:7/672: dwrite d1/d4a/d81/f2c [0,4194304] 0 2024-09-19T06:40:40.910 INFO:tasks.workunit.client.1.smithi117.stdout:6/522: creat d1/d5/d8/f90 x:0 0 0 2024-09-19T06:40:40.912 INFO:tasks.workunit.client.1.smithi117.stdout:0/634: mkdir d11/d13/d1b/d27/d37/d6d/dd2 0 2024-09-19T06:40:40.914 INFO:tasks.workunit.client.1.smithi117.stdout:7/673: write d1/d4a/d7c/d95/db5/fd0 [744903,91543] 0 2024-09-19T06:40:40.915 INFO:tasks.workunit.client.0.smithi099.stdout:6/588: dwrite d1/d5/d24/d2e/d6e/f87 [0,4194304] 0 2024-09-19T06:40:40.916 INFO:tasks.workunit.client.1.smithi117.stdout:6/523: rmdir d1/d3d 39 2024-09-19T06:40:40.917 INFO:tasks.workunit.client.0.smithi099.stdout:6/589: chown d1/d5/d38/d76/db0/d2a/f8b 118 1 2024-09-19T06:40:40.917 INFO:tasks.workunit.client.1.smithi117.stdout:7/674: stat d1/d4a/d81/d24/d1c/fe0 0 2024-09-19T06:40:40.918 INFO:tasks.workunit.client.0.smithi099.stdout:6/590: read - d1/d5/d24/d2e/d41/fb8 zero size 2024-09-19T06:40:40.918 INFO:tasks.workunit.client.1.smithi117.stdout:6/524: write d1/d3/f4b [439771,106333] 0 2024-09-19T06:40:40.929 INFO:tasks.workunit.client.1.smithi117.stdout:5/757: dread d17/d1b/d3a/f68 [0,4194304] 0 2024-09-19T06:40:40.930 INFO:tasks.workunit.client.1.smithi117.stdout:9/656: dread d4/f44 [0,4194304] 0 2024-09-19T06:40:40.932 INFO:tasks.workunit.client.1.smithi117.stdout:9/657: stat d4/d1c/d7a/d52/d8d/dc1/dc6 0 2024-09-19T06:40:40.933 INFO:tasks.workunit.client.1.smithi117.stdout:4/905: readlink d3/db/d20/d29/d39/d4f/d6e/da3/lf6 0 2024-09-19T06:40:40.934 INFO:tasks.workunit.client.1.smithi117.stdout:9/658: write d4/d1c/d36/d37/f42 [3250581,16307] 0 2024-09-19T06:40:40.934 INFO:tasks.workunit.client.1.smithi117.stdout:4/906: readlink d3/db/d20/d29/d39/d4f/d6e/da3/lf6 0 2024-09-19T06:40:40.935 INFO:tasks.workunit.client.1.smithi117.stdout:4/907: fsync d3/d4/d14/f60 0 2024-09-19T06:40:40.937 INFO:tasks.workunit.client.1.smithi117.stdout:9/659: mkdir d4/d1c/d46/de1 0 2024-09-19T06:40:40.939 INFO:tasks.workunit.client.1.smithi117.stdout:9/660: write d4/d1c/d7a/d69/f70 [114397,3979] 0 2024-09-19T06:40:40.941 INFO:tasks.workunit.client.1.smithi117.stdout:5/758: getdents d17/d1b/d3a 0 2024-09-19T06:40:40.942 INFO:tasks.workunit.client.1.smithi117.stdout:4/908: mkdir d3/db/d20/d29/d39/d4f/d6e/d123 0 2024-09-19T06:40:40.944 INFO:tasks.workunit.client.1.smithi117.stdout:9/661: truncate d4/d1c/d7a/d52/f62 1424758 0 2024-09-19T06:40:40.946 INFO:tasks.workunit.client.1.smithi117.stdout:5/759: unlink d17/d1b/d5d/d7d/cb9 0 2024-09-19T06:40:40.948 INFO:tasks.workunit.client.0.smithi099.stdout:3/759: link d7/d34/d1d/d20/d58/lbb d7/d34/d1d/d36/d69/d96/le6 0 2024-09-19T06:40:40.948 INFO:tasks.workunit.client.1.smithi117.stdout:3/698: dread d0/d19/d2b/d8e/f2f [0,4194304] 0 2024-09-19T06:40:40.949 INFO:tasks.workunit.client.1.smithi117.stdout:9/662: mknod d4/d1c/d54/ce2 0 2024-09-19T06:40:40.949 INFO:tasks.workunit.client.1.smithi117.stdout:4/909: creat d3/d65/d66/dce/f124 x:0 0 0 2024-09-19T06:40:40.950 INFO:tasks.workunit.client.1.smithi117.stdout:8/680: dread d1d/d2a/d3f/d73/ddd/fb4 [0,4194304] 0 2024-09-19T06:40:40.952 INFO:tasks.workunit.client.1.smithi117.stdout:2/676: dwrite d0/d12/d32/d7d/f90 [0,4194304] 0 2024-09-19T06:40:40.952 INFO:tasks.workunit.client.0.smithi099.stdout:8/433: link d4/de/d1c/f6d d4/d11/d23/d4c/d93/f94 0 2024-09-19T06:40:40.954 INFO:tasks.workunit.client.0.smithi099.stdout:1/562: truncate d0/d12/d13/f22 2549826 0 2024-09-19T06:40:40.954 INFO:tasks.workunit.client.1.smithi117.stdout:9/663: rmdir d4/d8/d6e 39 2024-09-19T06:40:40.954 INFO:tasks.workunit.client.1.smithi117.stdout:8/681: chown d1d/d2a/d3f/d4c/f6a 3238 1 2024-09-19T06:40:40.956 INFO:tasks.workunit.client.0.smithi099.stdout:9/614: getdents dd/d47/d40/d61 0 2024-09-19T06:40:40.956 INFO:tasks.workunit.client.0.smithi099.stdout:1/563: fdatasync d0/d17/d24/f6e 0 2024-09-19T06:40:40.957 INFO:tasks.workunit.client.1.smithi117.stdout:8/682: chown d1d/d31/c65 243 1 2024-09-19T06:40:40.958 INFO:tasks.workunit.client.1.smithi117.stdout:8/683: fdatasync d1d/d1e/d3b/f6c 0 2024-09-19T06:40:40.958 INFO:tasks.workunit.client.1.smithi117.stdout:0/635: truncate d11/d13/d1b/fa2 49800 0 2024-09-19T06:40:40.959 INFO:tasks.workunit.client.1.smithi117.stdout:2/677: symlink d0/d7/d29/d35/d61/def/lfc 0 2024-09-19T06:40:40.960 INFO:tasks.workunit.client.1.smithi117.stdout:7/675: truncate d1/d4a/d81/d24/d1c/f28 2074490 0 2024-09-19T06:40:40.961 INFO:tasks.workunit.client.0.smithi099.stdout:7/641: write d7/dcf/d29/d1f/d45/d48/f7e [2612528,78737] 0 2024-09-19T06:40:40.962 INFO:tasks.workunit.client.0.smithi099.stdout:9/615: creat dd/d2c/d5c/d85/fcc x:0 0 0 2024-09-19T06:40:40.963 INFO:tasks.workunit.client.1.smithi117.stdout:9/664: creat d4/d1c/d7a/d52/d8d/fe3 x:0 0 0 2024-09-19T06:40:40.963 INFO:tasks.workunit.client.1.smithi117.stdout:4/910: dwrite d3/d28/d2a/f10c [0,4194304] 0 2024-09-19T06:40:40.963 INFO:tasks.workunit.client.0.smithi099.stdout:7/642: chown d7/dcf/d29/d4e 5929025 1 2024-09-19T06:40:40.964 INFO:tasks.workunit.client.0.smithi099.stdout:1/564: creat d0/d17/d32/d7b/d99/fb6 x:0 0 0 2024-09-19T06:40:40.965 INFO:tasks.workunit.client.0.smithi099.stdout:9/616: write dd/d62/d76/fb9 [516229,57545] 0 2024-09-19T06:40:40.969 INFO:tasks.workunit.client.1.smithi117.stdout:0/636: unlink d11/d13/d28/d38/fa5 0 2024-09-19T06:40:40.969 INFO:tasks.workunit.client.0.smithi099.stdout:6/591: write d1/d5/d24/d2b/f74 [283419,23550] 0 2024-09-19T06:40:40.970 INFO:tasks.workunit.client.0.smithi099.stdout:1/565: write d0/d12/d13/d37/d48/f4b [1468972,130475] 0 2024-09-19T06:40:40.972 INFO:tasks.workunit.client.0.smithi099.stdout:7/643: unlink d7/dc7/d67/l7c 0 2024-09-19T06:40:40.972 INFO:tasks.workunit.client.1.smithi117.stdout:4/911: truncate d3/db/d20/f36 4421005 0 2024-09-19T06:40:40.973 INFO:tasks.workunit.client.0.smithi099.stdout:5/712: dread d3/d7/ff [0,4194304] 0 2024-09-19T06:40:40.973 INFO:tasks.workunit.client.0.smithi099.stdout:1/566: read d0/d12/f30 [4085912,54579] 0 2024-09-19T06:40:40.974 INFO:tasks.workunit.client.1.smithi117.stdout:6/525: dread d1/d14/f23 [0,4194304] 0 2024-09-19T06:40:40.974 INFO:tasks.workunit.client.0.smithi099.stdout:9/617: link dd/d2c/d5c/d85/fcc dd/d47/dc1/fcd 0 2024-09-19T06:40:40.974 INFO:tasks.workunit.client.1.smithi117.stdout:9/665: truncate d4/f24 1164769 0 2024-09-19T06:40:40.976 INFO:tasks.workunit.client.1.smithi117.stdout:6/526: dread - d1/f1d zero size 2024-09-19T06:40:40.977 INFO:tasks.workunit.client.1.smithi117.stdout:2/678: dwrite d0/d64/ff7 [0,4194304] 0 2024-09-19T06:40:40.977 INFO:tasks.workunit.client.0.smithi099.stdout:5/713: rmdir d3/d7/d90/da6 39 2024-09-19T06:40:40.978 INFO:tasks.workunit.client.0.smithi099.stdout:8/434: dread d4/de/d26/d2b/f58 [0,4194304] 0 2024-09-19T06:40:40.979 INFO:tasks.workunit.client.0.smithi099.stdout:6/592: symlink d1/d5/d24/d2e/d7b/dba/lc3 0 2024-09-19T06:40:40.979 INFO:tasks.workunit.client.1.smithi117.stdout:6/527: stat d1/f1d 0 2024-09-19T06:40:40.979 INFO:tasks.workunit.client.0.smithi099.stdout:5/714: chown d3/d16/d5e/f85 0 1 2024-09-19T06:40:40.982 INFO:tasks.workunit.client.1.smithi117.stdout:5/760: write d17/f76 [798685,15048] 0 2024-09-19T06:40:40.983 INFO:tasks.workunit.client.1.smithi117.stdout:9/666: mknod d4/d1c/d73/d9a/ce4 0 2024-09-19T06:40:40.984 INFO:tasks.workunit.client.0.smithi099.stdout:3/760: truncate d7/d34/d1d/d36/d69/d6d/f7b 4065070 0 2024-09-19T06:40:40.984 INFO:tasks.workunit.client.0.smithi099.stdout:3/761: chown d7/d34/d1d/d36 8 1 2024-09-19T06:40:40.986 INFO:tasks.workunit.client.1.smithi117.stdout:7/676: creat d1/d4a/d81/d48/ff0 x:0 0 0 2024-09-19T06:40:40.986 INFO:tasks.workunit.client.1.smithi117.stdout:6/528: fdatasync d1/d5/d8/f19 0 2024-09-19T06:40:40.987 INFO:tasks.workunit.client.0.smithi099.stdout:1/567: mknod d0/d17/d24/d5e/d8a/cb7 0 2024-09-19T06:40:40.988 INFO:tasks.workunit.client.1.smithi117.stdout:4/912: mknod d3/d41/d109/c125 0 2024-09-19T06:40:40.989 INFO:tasks.workunit.client.0.smithi099.stdout:8/435: mknod d4/de/d26/c95 0 2024-09-19T06:40:40.990 INFO:tasks.workunit.client.0.smithi099.stdout:8/436: write d4/d5e/f7b [815487,129924] 0 2024-09-19T06:40:40.991 INFO:tasks.workunit.client.0.smithi099.stdout:6/593: creat d1/d5/d38/d76/db0/d54/d5d/d61/fc4 x:0 0 0 2024-09-19T06:40:40.993 INFO:tasks.workunit.client.0.smithi099.stdout:1/568: mkdir d0/d17/d24/d3a/d58/d8d/dae/db8 0 2024-09-19T06:40:40.993 INFO:tasks.workunit.client.1.smithi117.stdout:7/677: creat d1/d4a/d81/d24/d1c/ff1 x:0 0 0 2024-09-19T06:40:40.994 INFO:tasks.workunit.client.1.smithi117.stdout:6/529: write d1/d5/d8/d5e/d6d/f79 [413921,106281] 0 2024-09-19T06:40:40.994 INFO:tasks.workunit.client.1.smithi117.stdout:2/679: dwrite d0/d64/dd9/fb2 [0,4194304] 0 2024-09-19T06:40:40.995 INFO:tasks.workunit.client.0.smithi099.stdout:3/762: creat d7/d34/d1d/d36/d69/d6d/d7a/fe7 x:0 0 0 2024-09-19T06:40:40.995 INFO:tasks.workunit.client.1.smithi117.stdout:3/699: dread d0/d8/f4c [0,4194304] 0 2024-09-19T06:40:40.995 INFO:tasks.workunit.client.0.smithi099.stdout:6/594: creat d1/d5/d38/d76/db0/d2a/fc5 x:0 0 0 2024-09-19T06:40:40.996 INFO:tasks.workunit.client.1.smithi117.stdout:4/913: symlink d3/db/d20/d4a/d7b/da0/l126 0 2024-09-19T06:40:40.997 INFO:tasks.workunit.client.0.smithi099.stdout:5/715: creat d3/d16/ff7 x:0 0 0 2024-09-19T06:40:40.998 INFO:tasks.workunit.client.0.smithi099.stdout:5/716: chown d3/d16/d2f/d34/d3c/de1 6124788 1 2024-09-19T06:40:40.998 INFO:tasks.workunit.client.1.smithi117.stdout:7/678: chown d1/d4a/d81/d8d/fc9 496 1 2024-09-19T06:40:41.001 INFO:tasks.workunit.client.1.smithi117.stdout:2/680: write d0/d7/d1e/d20/dc9/fe8 [3683897,33399] 0 2024-09-19T06:40:41.001 INFO:tasks.workunit.client.1.smithi117.stdout:9/667: dwrite d4/d1c/d36/f6c [4194304,4194304] 0 2024-09-19T06:40:41.003 INFO:tasks.workunit.client.1.smithi117.stdout:5/761: dread d17/f89 [0,4194304] 0 2024-09-19T06:40:41.003 INFO:tasks.workunit.client.1.smithi117.stdout:7/679: mknod d1/d72/cf2 0 2024-09-19T06:40:41.005 INFO:tasks.workunit.client.1.smithi117.stdout:0/637: rmdir d11/d13/d28 39 2024-09-19T06:40:41.006 INFO:tasks.workunit.client.0.smithi099.stdout:5/717: creat d3/d1f/ff8 x:0 0 0 2024-09-19T06:40:41.006 INFO:tasks.workunit.client.0.smithi099.stdout:1/569: mkdir d0/d12/d13/d37/d48/db9 0 2024-09-19T06:40:41.007 INFO:tasks.workunit.client.0.smithi099.stdout:5/718: fsync d3/f9 0 2024-09-19T06:40:41.010 INFO:tasks.workunit.client.1.smithi117.stdout:0/638: chown d11/d13/d1b/d27/d54 5830 1 2024-09-19T06:40:41.010 INFO:tasks.workunit.client.1.smithi117.stdout:9/668: dread - d4/d8/d6a/d82/da3/fdf zero size 2024-09-19T06:40:41.012 INFO:tasks.workunit.client.1.smithi117.stdout:8/684: truncate d1d/d2a/d3f/d4b/f59 1145094 0 2024-09-19T06:40:41.013 INFO:tasks.workunit.client.1.smithi117.stdout:6/530: dwrite d1/d5/d8/d5e/d6d/f79 [0,4194304] 0 2024-09-19T06:40:41.015 INFO:tasks.workunit.client.1.smithi117.stdout:5/762: symlink d17/d1b/d3a/d3c/dcb/lfd 0 2024-09-19T06:40:41.015 INFO:tasks.workunit.client.1.smithi117.stdout:7/680: unlink d1/d4a/d7c/d95/f99 0 2024-09-19T06:40:41.016 INFO:tasks.workunit.client.0.smithi099.stdout:9/618: write dd/d47/d40/d61/f63 [4486522,22218] 0 2024-09-19T06:40:41.018 INFO:tasks.workunit.client.0.smithi099.stdout:9/619: chown dd/d2c/d5c/cab 48 1 2024-09-19T06:40:41.019 INFO:tasks.workunit.client.0.smithi099.stdout:7/644: dwrite d7/dc7/f65 [0,4194304] 0 2024-09-19T06:40:41.023 INFO:tasks.workunit.client.1.smithi117.stdout:0/639: unlink d11/d13/d7a/cac 0 2024-09-19T06:40:41.025 INFO:tasks.workunit.client.1.smithi117.stdout:3/700: write d0/d19/f3e [530679,28293] 0 2024-09-19T06:40:41.028 INFO:tasks.workunit.client.1.smithi117.stdout:7/681: mknod d1/d72/cf3 0 2024-09-19T06:40:41.029 INFO:tasks.workunit.client.1.smithi117.stdout:7/682: chown d1/d4a/d7c/d95/ddc 4993288 1 2024-09-19T06:40:41.029 INFO:tasks.workunit.client.1.smithi117.stdout:9/669: rmdir d4/d8/d6e 39 2024-09-19T06:40:41.030 INFO:tasks.workunit.client.1.smithi117.stdout:4/914: write d3/d28/d2a/f9b [3597889,123817] 0 2024-09-19T06:40:41.031 INFO:tasks.workunit.client.1.smithi117.stdout:6/531: mknod d1/d3d/d6f/c91 0 2024-09-19T06:40:41.032 INFO:tasks.workunit.client.1.smithi117.stdout:7/683: stat d1/d72/cf3 0 2024-09-19T06:40:41.032 INFO:tasks.workunit.client.0.smithi099.stdout:7/645: dwrite d7/dcf/d29/d34/d8f/fc3 [4194304,4194304] 0 2024-09-19T06:40:41.032 INFO:tasks.workunit.client.0.smithi099.stdout:5/719: mknod d3/d7/d90/da6/cf9 0 2024-09-19T06:40:41.033 INFO:tasks.workunit.client.1.smithi117.stdout:5/763: dread d17/d1b/d3a/fa3 [0,4194304] 0 2024-09-19T06:40:41.034 INFO:tasks.workunit.client.1.smithi117.stdout:4/915: chown d3/d1b/d7d/d9f/d110 292 1 2024-09-19T06:40:41.034 INFO:tasks.workunit.client.1.smithi117.stdout:0/640: rename d11/d13/d14/d2c/d53/d7e/lcc to d11/d13/d1b/d27/d54/ld3 0 2024-09-19T06:40:41.036 INFO:tasks.workunit.client.1.smithi117.stdout:0/641: fsync d11/f96 0 2024-09-19T06:40:41.037 INFO:tasks.workunit.client.1.smithi117.stdout:3/701: dread d0/d8/f4c [0,4194304] 0 2024-09-19T06:40:41.037 INFO:tasks.workunit.client.0.smithi099.stdout:5/720: mkdir d3/d16/d2f/d34/dfa 0 2024-09-19T06:40:41.037 INFO:tasks.workunit.client.1.smithi117.stdout:9/670: mkdir d4/d1c/d7a/d16/dac/de5 0 2024-09-19T06:40:41.038 INFO:tasks.workunit.client.0.smithi099.stdout:7/646: mknod d7/dcf/d29/d1f/d45/d48/d63/d75/cea 0 2024-09-19T06:40:41.039 INFO:tasks.workunit.client.1.smithi117.stdout:4/916: mkdir d3/db/d127 0 2024-09-19T06:40:41.039 INFO:tasks.workunit.client.0.smithi099.stdout:7/647: read - d7/dcf/d29/d34/fd1 zero size 2024-09-19T06:40:41.040 INFO:tasks.workunit.client.1.smithi117.stdout:8/685: dread d1d/d2a/f45 [4194304,4194304] 0 2024-09-19T06:40:41.040 INFO:tasks.workunit.client.1.smithi117.stdout:7/684: mknod d1/d4a/d81/d24/d26/cf4 0 2024-09-19T06:40:41.042 INFO:tasks.workunit.client.1.smithi117.stdout:3/702: mkdir d0/d9/d4e/d9e/ddc 0 2024-09-19T06:40:41.043 INFO:tasks.workunit.client.1.smithi117.stdout:9/671: chown d4/d1c/d36/d37/l3a 664482 1 2024-09-19T06:40:41.044 INFO:tasks.workunit.client.0.smithi099.stdout:5/721: link d3/d14/l55 d3/d16/d2f/d34/d3c/d65/dbe/lfb 0 2024-09-19T06:40:41.044 INFO:tasks.workunit.client.1.smithi117.stdout:2/681: dread d0/d7/d29/d35/f6a [0,4194304] 0 2024-09-19T06:40:41.044 INFO:tasks.workunit.client.1.smithi117.stdout:4/917: mkdir d3/d4/d5f/d128 0 2024-09-19T06:40:41.047 INFO:tasks.workunit.client.1.smithi117.stdout:9/672: write d4/d8/d6a/d82/f90 [1047716,9419] 0 2024-09-19T06:40:41.049 INFO:tasks.workunit.client.0.smithi099.stdout:5/722: creat d3/d16/d2f/d8c/ffc x:0 0 0 2024-09-19T06:40:41.049 INFO:tasks.workunit.client.1.smithi117.stdout:9/673: fsync d4/d1c/d54/dd8/fb7 0 2024-09-19T06:40:41.050 INFO:tasks.workunit.client.1.smithi117.stdout:4/918: mknod d3/d41/c129 0 2024-09-19T06:40:41.052 INFO:tasks.workunit.client.1.smithi117.stdout:1/635: sync 2024-09-19T06:40:41.052 INFO:tasks.workunit.client.1.smithi117.stdout:7/685: truncate d1/d4a/d81/d24/d1c/d35/d4f/f87 595677 0 2024-09-19T06:40:41.052 INFO:tasks.workunit.client.1.smithi117.stdout:3/703: creat d0/d9/d4e/fdd x:0 0 0 2024-09-19T06:40:41.053 INFO:tasks.workunit.client.1.smithi117.stdout:4/919: fsync d3/d41/f89 0 2024-09-19T06:40:41.057 INFO:tasks.workunit.client.1.smithi117.stdout:8/686: dwrite d1d/d1e/d3b/f7b [0,4194304] 0 2024-09-19T06:40:41.059 INFO:tasks.workunit.client.0.smithi099.stdout:5/723: dread d3/d16/f74 [0,4194304] 0 2024-09-19T06:40:41.060 INFO:tasks.workunit.client.0.smithi099.stdout:1/570: write d0/f16 [184424,96922] 0 2024-09-19T06:40:41.061 INFO:tasks.workunit.client.0.smithi099.stdout:9/620: truncate dd/d47/d40/f3f 428719 0 2024-09-19T06:40:41.063 INFO:tasks.workunit.client.0.smithi099.stdout:5/724: readlink d3/d16/d2f/d8c/dd9/lf6 0 2024-09-19T06:40:41.064 INFO:tasks.workunit.client.0.smithi099.stdout:1/571: read d0/f16 [30413,3221] 0 2024-09-19T06:40:41.065 INFO:tasks.workunit.client.1.smithi117.stdout:4/920: mkdir d3/d1b/d7d/d51/d95/d12a 0 2024-09-19T06:40:41.065 INFO:tasks.workunit.client.1.smithi117.stdout:2/682: dwrite d0/d7/d29/d35/dbd/d8d/f9e [4194304,4194304] 0 2024-09-19T06:40:41.067 INFO:tasks.workunit.client.0.smithi099.stdout:1/572: dread - d0/f82 zero size 2024-09-19T06:40:41.068 INFO:tasks.workunit.client.0.smithi099.stdout:6/595: dwrite d1/f10 [0,4194304] 0 2024-09-19T06:40:41.069 INFO:tasks.workunit.client.1.smithi117.stdout:2/683: dread d0/f4c [0,4194304] 0 2024-09-19T06:40:41.070 INFO:tasks.workunit.client.1.smithi117.stdout:6/532: dread d1/d5/f39 [0,4194304] 0 2024-09-19T06:40:41.071 INFO:tasks.workunit.client.0.smithi099.stdout:6/596: write d1/d12/f1f [1720803,57067] 0 2024-09-19T06:40:41.073 INFO:tasks.workunit.client.1.smithi117.stdout:2/684: readlink d0/d7/d29/db0/lcb 0 2024-09-19T06:40:41.073 INFO:tasks.workunit.client.1.smithi117.stdout:5/764: dread d17/f9d [0,4194304] 0 2024-09-19T06:40:41.073 INFO:tasks.workunit.client.1.smithi117.stdout:3/704: rename d0/d9/d4e/f7c to d0/d8/d64/fde 0 2024-09-19T06:40:41.074 INFO:tasks.workunit.client.0.smithi099.stdout:7/648: dwrite d7/dcf/d29/d1f/f55 [0,4194304] 0 2024-09-19T06:40:41.074 INFO:tasks.workunit.client.1.smithi117.stdout:9/674: dread d4/d1c/d7a/d52/f62 [0,4194304] 0 2024-09-19T06:40:41.082 INFO:tasks.workunit.client.1.smithi117.stdout:4/921: read d3/d4/d14/f56 [973878,122771] 0 2024-09-19T06:40:41.082 INFO:tasks.workunit.client.1.smithi117.stdout:6/533: creat d1/d5/d8/d5e/f92 x:0 0 0 2024-09-19T06:40:41.082 INFO:tasks.workunit.client.1.smithi117.stdout:8/687: rename d1d/d31/fb8 to d1d/d2a/d3f/d4b/d5f/dbf/fe6 0 2024-09-19T06:40:41.082 INFO:tasks.workunit.client.0.smithi099.stdout:6/597: mknod d1/d7c/cc6 0 2024-09-19T06:40:41.082 INFO:tasks.workunit.client.0.smithi099.stdout:1/573: getdents d0/d17/d24/d5e/d8a/da3 0 2024-09-19T06:40:41.082 INFO:tasks.workunit.client.0.smithi099.stdout:7/649: mkdir d7/dcf/d29/d1f/deb 0 2024-09-19T06:40:41.083 INFO:tasks.workunit.client.1.smithi117.stdout:5/765: mkdir d17/d1b/d3a/dfe 0 2024-09-19T06:40:41.083 INFO:tasks.workunit.client.0.smithi099.stdout:6/598: creat d1/d5/d38/d76/db0/d54/fc7 x:0 0 0 2024-09-19T06:40:41.083 INFO:tasks.workunit.client.0.smithi099.stdout:1/574: fsync d0/f29 0 2024-09-19T06:40:41.084 INFO:tasks.workunit.client.0.smithi099.stdout:6/599: write d1/d7c/fad [454312,81040] 0 2024-09-19T06:40:41.085 INFO:tasks.workunit.client.0.smithi099.stdout:7/650: chown d7/dcf/d29/d1f/fd7 65 1 2024-09-19T06:40:41.085 INFO:tasks.workunit.client.0.smithi099.stdout:6/600: chown d1/c6 73355260 1 2024-09-19T06:40:41.086 INFO:tasks.workunit.client.1.smithi117.stdout:0/642: dwrite d11/d13/d14/f86 [0,4194304] 0 2024-09-19T06:40:41.087 INFO:tasks.workunit.client.0.smithi099.stdout:6/601: symlink d1/d5/d38/d76/lc8 0 2024-09-19T06:40:41.090 INFO:tasks.workunit.client.1.smithi117.stdout:7/686: dwrite d1/d4a/d81/f47 [0,4194304] 0 2024-09-19T06:40:41.092 INFO:tasks.workunit.client.1.smithi117.stdout:3/705: creat d0/d9/fdf x:0 0 0 2024-09-19T06:40:41.093 INFO:tasks.workunit.client.1.smithi117.stdout:9/675: creat d4/d8/fe6 x:0 0 0 2024-09-19T06:40:41.094 INFO:tasks.workunit.client.1.smithi117.stdout:8/688: rename d1d/d2a/d3f/fca to d1d/d2a/d3f/d4b/d5f/d95/fe7 0 2024-09-19T06:40:41.095 INFO:tasks.workunit.client.0.smithi099.stdout:1/575: getdents d0/d17/d5b 0 2024-09-19T06:40:41.096 INFO:tasks.workunit.client.0.smithi099.stdout:6/602: symlink d1/d5/d24/d2e/lc9 0 2024-09-19T06:40:41.097 INFO:tasks.workunit.client.1.smithi117.stdout:7/687: symlink d1/d3f/d92/lf5 0 2024-09-19T06:40:41.098 INFO:tasks.workunit.client.0.smithi099.stdout:1/576: mkdir d0/d17/d5b/dba 0 2024-09-19T06:40:41.098 INFO:tasks.workunit.client.0.smithi099.stdout:5/725: dwrite d3/d2a/f2e [0,4194304] 0 2024-09-19T06:40:41.099 INFO:tasks.workunit.client.1.smithi117.stdout:5/766: getdents d17/d1b/d5d/d7d/dc6 0 2024-09-19T06:40:41.101 INFO:tasks.workunit.client.1.smithi117.stdout:3/706: symlink d0/d8/d7f/d40/dc4/le0 0 2024-09-19T06:40:41.101 INFO:tasks.workunit.client.0.smithi099.stdout:5/726: dread d3/d14/fac [0,4194304] 0 2024-09-19T06:40:41.103 INFO:tasks.workunit.client.0.smithi099.stdout:5/727: write d3/d16/d2f/d8c/ffc [1020535,53207] 0 2024-09-19T06:40:41.104 INFO:tasks.workunit.client.1.smithi117.stdout:4/922: dwrite d3/db/d20/d4a/d7b/da0/ffc [0,4194304] 0 2024-09-19T06:40:41.104 INFO:tasks.workunit.client.0.smithi099.stdout:6/603: rename d1/d5/d38/d76/db0/f97 to d1/da1/fca 0 2024-09-19T06:40:41.104 INFO:tasks.workunit.client.0.smithi099.stdout:5/728: write d3/d16/d2f/d34/da4/da5/ff2 [125974,84797] 0 2024-09-19T06:40:41.105 INFO:tasks.workunit.client.1.smithi117.stdout:0/643: write d11/d13/f17 [971198,28850] 0 2024-09-19T06:40:41.109 INFO:tasks.workunit.client.1.smithi117.stdout:0/644: stat d11/d13/d7a/c89 0 2024-09-19T06:40:41.111 INFO:tasks.workunit.client.0.smithi099.stdout:5/729: creat d3/d16/d2f/d8c/ffd x:0 0 0 2024-09-19T06:40:41.111 INFO:tasks.workunit.client.1.smithi117.stdout:7/688: creat d1/d4a/d81/d24/d26/d44/ff6 x:0 0 0 2024-09-19T06:40:41.112 INFO:tasks.workunit.client.0.smithi099.stdout:5/730: chown d3/d16/d2f/d34/da4 67042677 1 2024-09-19T06:40:41.112 INFO:tasks.workunit.client.1.smithi117.stdout:3/707: mknod d0/d3d/d48/dc7/ce1 0 2024-09-19T06:40:41.114 INFO:tasks.workunit.client.1.smithi117.stdout:8/689: rename d1d/d2a/d3f/d4b/d5f/fd3 to d1d/d1e/d53/fe8 0 2024-09-19T06:40:41.118 INFO:tasks.workunit.client.1.smithi117.stdout:2/685: dwrite d0/d7/d29/d35/dbd/d8d/f9d [0,4194304] 0 2024-09-19T06:40:41.118 INFO:tasks.workunit.client.1.smithi117.stdout:7/689: symlink d1/d4a/d81/d24/d1c/d35/d4f/lf7 0 2024-09-19T06:40:41.119 INFO:tasks.workunit.client.1.smithi117.stdout:4/923: creat d3/db/d20/f12b x:0 0 0 2024-09-19T06:40:41.121 INFO:tasks.workunit.client.1.smithi117.stdout:9/676: rename d4/d1c/d36/d37/c72 to d4/d1c/d7a/d52/d8d/dc1/dc6/ce7 0 2024-09-19T06:40:41.121 INFO:tasks.workunit.client.0.smithi099.stdout:5/731: dwrite d3/d16/d2f/d34/da4/da5/dce/de5/fe2 [0,4194304] 0 2024-09-19T06:40:41.123 INFO:tasks.workunit.client.1.smithi117.stdout:8/690: read d1d/d1e/d3b/f6c [2262627,56262] 0 2024-09-19T06:40:41.127 INFO:tasks.workunit.client.1.smithi117.stdout:0/645: dwrite d11/d13/d28/f7f [0,4194304] 0 2024-09-19T06:40:41.128 INFO:tasks.workunit.client.0.smithi099.stdout:5/732: mknod d3/d16/d2f/d34/d3c/cfe 0 2024-09-19T06:40:41.129 INFO:tasks.workunit.client.1.smithi117.stdout:0/646: chown d11/f5a 1323 1 2024-09-19T06:40:41.130 INFO:tasks.workunit.client.1.smithi117.stdout:2/686: unlink d0/l59 0 2024-09-19T06:40:41.131 INFO:tasks.workunit.client.0.smithi099.stdout:5/733: creat d3/d16/d2f/d34/da4/da5/dcd/fff x:0 0 0 2024-09-19T06:40:41.134 INFO:tasks.workunit.client.1.smithi117.stdout:5/767: rename d17/d1b/d3a/d3c/d70/d94/fcd to d17/d1b/d3a/d3c/dcb/dde/d65/fff 0 2024-09-19T06:40:41.134 INFO:tasks.workunit.client.1.smithi117.stdout:0/647: dread d11/d13/d28/f87 [0,4194304] 0 2024-09-19T06:40:41.135 INFO:tasks.workunit.client.1.smithi117.stdout:4/924: mkdir d3/d1b/d7d/d9f/d12c 0 2024-09-19T06:40:41.136 INFO:tasks.workunit.client.0.smithi099.stdout:7/651: truncate d7/dc7/d67/f79 4091552 0 2024-09-19T06:40:41.139 INFO:tasks.workunit.client.1.smithi117.stdout:3/708: creat d0/d8/d7f/d40/fe2 x:0 0 0 2024-09-19T06:40:41.140 INFO:tasks.workunit.client.1.smithi117.stdout:0/648: read d11/d13/d28/f43 [411619,74476] 0 2024-09-19T06:40:41.140 INFO:tasks.workunit.client.1.smithi117.stdout:9/677: rename d4/d20/l5b to d4/d1c/d73/da8/le8 0 2024-09-19T06:40:41.142 INFO:tasks.workunit.client.1.smithi117.stdout:7/690: dwrite d1/d4a/d81/f2c [4194304,4194304] 0 2024-09-19T06:40:41.142 INFO:tasks.workunit.client.1.smithi117.stdout:2/687: symlink d0/d64/dd9/df0/lfd 0 2024-09-19T06:40:41.142 INFO:tasks.workunit.client.1.smithi117.stdout:5/768: mknod d17/d1b/d3a/df8/c100 0 2024-09-19T06:40:41.144 INFO:tasks.workunit.client.1.smithi117.stdout:9/678: write d4/d1c/f59 [1010216,108390] 0 2024-09-19T06:40:41.145 INFO:tasks.workunit.client.0.smithi099.stdout:7/652: dread d7/dcf/d29/d1f/d45/d48/f5e [0,4194304] 0 2024-09-19T06:40:41.145 INFO:tasks.workunit.client.1.smithi117.stdout:2/688: chown d0/d7/d29/d35/d3d/c46 41312591 1 2024-09-19T06:40:41.146 INFO:tasks.workunit.client.1.smithi117.stdout:9/679: dread - d4/d58/f9b zero size 2024-09-19T06:40:41.148 INFO:tasks.workunit.client.0.smithi099.stdout:6/604: dwrite d1/d5/d38/d76/db0/d2a/f55 [0,4194304] 0 2024-09-19T06:40:41.148 INFO:tasks.workunit.client.1.smithi117.stdout:7/691: creat d1/d4a/d81/d48/d5f/d82/ff8 x:0 0 0 2024-09-19T06:40:41.149 INFO:tasks.workunit.client.0.smithi099.stdout:7/653: mkdir d7/dcf/d29/d1f/dec 0 2024-09-19T06:40:41.152 INFO:tasks.workunit.client.1.smithi117.stdout:2/689: symlink d0/lfe 0 2024-09-19T06:40:41.152 INFO:tasks.workunit.client.1.smithi117.stdout:9/680: symlink d4/d8/d6a/d82/da3/le9 0 2024-09-19T06:40:41.153 INFO:tasks.workunit.client.1.smithi117.stdout:0/649: mknod d11/d13/d1b/d27/d37/d6d/dd2/cd4 0 2024-09-19T06:40:41.155 INFO:tasks.workunit.client.0.smithi099.stdout:1/577: dread d0/d12/d13/d37/d41/f70 [0,4194304] 0 2024-09-19T06:40:41.155 INFO:tasks.workunit.client.0.smithi099.stdout:1/578: chown d0/l20 1933943059 1 2024-09-19T06:40:41.155 INFO:tasks.workunit.client.1.smithi117.stdout:2/690: unlink d0/d7/d1e/d20/dbc/de6/ldb 0 2024-09-19T06:40:41.156 INFO:tasks.workunit.client.1.smithi117.stdout:7/692: creat d1/d4a/d81/ff9 x:0 0 0 2024-09-19T06:40:41.157 INFO:tasks.workunit.client.0.smithi099.stdout:6/605: mknod d1/d5/d38/ccb 0 2024-09-19T06:40:41.158 INFO:tasks.workunit.client.1.smithi117.stdout:9/681: creat d4/d8/fea x:0 0 0 2024-09-19T06:40:41.158 INFO:tasks.workunit.client.0.smithi099.stdout:7/654: symlink d7/dc7/de7/led 0 2024-09-19T06:40:41.158 INFO:tasks.workunit.client.0.smithi099.stdout:7/655: chown d7/f3f 1129 1 2024-09-19T06:40:41.160 INFO:tasks.workunit.client.0.smithi099.stdout:1/579: mkdir d0/d17/d24/d75/dbb 0 2024-09-19T06:40:41.161 INFO:tasks.workunit.client.0.smithi099.stdout:6/606: chown d1/d5/d24/d2e/d6e/cb6 10621 1 2024-09-19T06:40:41.163 INFO:tasks.workunit.client.0.smithi099.stdout:6/607: chown d1/d5/cb1 1423170 1 2024-09-19T06:40:41.164 INFO:tasks.workunit.client.0.smithi099.stdout:7/656: dread d7/f41 [4194304,4194304] 0 2024-09-19T06:40:41.165 INFO:tasks.workunit.client.1.smithi117.stdout:2/691: rename d0/d7/f16 to d0/d7/d29/db0/fff 0 2024-09-19T06:40:41.165 INFO:tasks.workunit.client.1.smithi117.stdout:9/682: creat d4/d1c/d54/feb x:0 0 0 2024-09-19T06:40:41.167 INFO:tasks.workunit.client.1.smithi117.stdout:8/691: dread d1d/d2a/fa1 [0,4194304] 0 2024-09-19T06:40:41.167 INFO:tasks.workunit.client.0.smithi099.stdout:6/608: rmdir d1/d5/d38/d76/db0/d54/d5d 39 2024-09-19T06:40:41.168 INFO:tasks.workunit.client.1.smithi117.stdout:7/693: mknod d1/d4a/d81/d24/d26/d44/dd2/cfa 0 2024-09-19T06:40:41.168 INFO:tasks.workunit.client.0.smithi099.stdout:6/609: fdatasync d1/d5/d38/fae 0 2024-09-19T06:40:41.168 INFO:tasks.workunit.client.1.smithi117.stdout:7/694: chown d1/d4a/d81/fe4 202452939 1 2024-09-19T06:40:41.169 INFO:tasks.workunit.client.0.smithi099.stdout:5/734: write d3/d7/fb [5934237,55483] 0 2024-09-19T06:40:41.172 INFO:tasks.workunit.client.1.smithi117.stdout:2/692: chown d0/d12/d2f/d98/cc7 6546753 1 2024-09-19T06:40:41.174 INFO:tasks.workunit.client.1.smithi117.stdout:7/695: rename d1/d4a/d81/d24/d26/ddf to d1/d4a/d81/d24/d26/d44/dfb 0 2024-09-19T06:40:41.175 INFO:tasks.workunit.client.0.smithi099.stdout:5/735: fdatasync d3/d1f/f91 0 2024-09-19T06:40:41.177 INFO:tasks.workunit.client.0.smithi099.stdout:6/610: dwrite d1/d5/d38/d76/db0/d2a/fc5 [0,4194304] 0 2024-09-19T06:40:41.178 INFO:tasks.workunit.client.1.smithi117.stdout:9/683: dwrite d4/d1c/d36/fad [0,4194304] 0 2024-09-19T06:40:41.178 INFO:tasks.workunit.client.0.smithi099.stdout:5/736: mkdir d3/d14/d100 0 2024-09-19T06:40:41.179 INFO:tasks.workunit.client.1.smithi117.stdout:5/769: dread d17/d5c/f69 [0,4194304] 0 2024-09-19T06:40:41.180 INFO:tasks.workunit.client.0.smithi099.stdout:6/611: fdatasync d1/d5/d38/d76/db0/d2a/f8b 0 2024-09-19T06:40:41.182 INFO:tasks.workunit.client.1.smithi117.stdout:7/696: write d1/d4a/d81/d24/d1c/f79 [535283,58391] 0 2024-09-19T06:40:41.183 INFO:tasks.workunit.client.0.smithi099.stdout:5/737: getdents d3/d7/d90/dd2 0 2024-09-19T06:40:41.184 INFO:tasks.workunit.client.1.smithi117.stdout:2/693: mkdir d0/d7/d29/d100 0 2024-09-19T06:40:41.184 INFO:tasks.workunit.client.1.smithi117.stdout:7/697: chown d1/d72/l63 127888641 1 2024-09-19T06:40:41.185 INFO:tasks.workunit.client.0.smithi099.stdout:5/738: truncate d3/d16/d2f/fc6 329871 0 2024-09-19T06:40:41.187 INFO:tasks.workunit.client.0.smithi099.stdout:1/580: truncate d0/d17/d32/d7b/f84 869258 0 2024-09-19T06:40:41.188 INFO:tasks.workunit.client.1.smithi117.stdout:9/684: rename d4/d8/fe6 to d4/d1c/d7a/d52/d8d/dc1/dc6/fec 0 2024-09-19T06:40:41.191 INFO:tasks.workunit.client.1.smithi117.stdout:2/694: dwrite d0/d7/fa1 [0,4194304] 0 2024-09-19T06:40:41.192 INFO:tasks.workunit.client.0.smithi099.stdout:5/739: getdents d3/d1f/d4f 0 2024-09-19T06:40:41.192 INFO:tasks.workunit.client.1.smithi117.stdout:7/698: creat d1/d4a/d81/d24/d1c/d35/d4f/ffc x:0 0 0 2024-09-19T06:40:41.193 INFO:tasks.workunit.client.0.smithi099.stdout:1/581: getdents d0/d17/d5b 0 2024-09-19T06:40:41.193 INFO:tasks.workunit.client.1.smithi117.stdout:9/685: chown d4/d1c/lb9 6020163 1 2024-09-19T06:40:41.193 INFO:tasks.workunit.client.0.smithi099.stdout:5/740: write d3/d16/d2f/d34/d3c/feb [256457,27003] 0 2024-09-19T06:40:41.194 INFO:tasks.workunit.client.0.smithi099.stdout:5/741: readlink d3/d16/d2f/lbd 0 2024-09-19T06:40:41.194 INFO:tasks.workunit.client.1.smithi117.stdout:2/695: write d0/d7/d58/db1/fb3 [877908,86985] 0 2024-09-19T06:40:41.194 INFO:tasks.workunit.client.1.smithi117.stdout:9/686: readlink d4/d1c/d7a/l5c 0 2024-09-19T06:40:41.196 INFO:tasks.workunit.client.1.smithi117.stdout:7/699: write d1/d4a/d81/d24/d49/fb3 [514539,117583] 0 2024-09-19T06:40:41.196 INFO:tasks.workunit.client.1.smithi117.stdout:3/709: write d0/d9/fc [1173070,43666] 0 2024-09-19T06:40:41.197 INFO:tasks.workunit.client.0.smithi099.stdout:1/582: write d0/d12/d54/f7e [3574185,8520] 0 2024-09-19T06:40:41.197 INFO:tasks.workunit.client.1.smithi117.stdout:9/687: chown d4/d1c/d7a/d52/la1 36135807 1 2024-09-19T06:40:41.197 INFO:tasks.workunit.client.0.smithi099.stdout:5/742: rmdir d3/d16/d2f/d34/d3c/de1 39 2024-09-19T06:40:41.198 INFO:tasks.workunit.client.1.smithi117.stdout:9/688: dread - d4/d58/fc3 zero size 2024-09-19T06:40:41.200 INFO:tasks.workunit.client.0.smithi099.stdout:1/583: symlink d0/d17/d32/lbc 0 2024-09-19T06:40:41.202 INFO:tasks.workunit.client.0.smithi099.stdout:5/743: write d3/d1f/f21 [1981726,69331] 0 2024-09-19T06:40:41.202 INFO:tasks.workunit.client.1.smithi117.stdout:2/696: symlink d0/d12/d32/d7d/l101 0 2024-09-19T06:40:41.203 INFO:tasks.workunit.client.0.smithi099.stdout:7/657: dread d7/f2c [0,4194304] 0 2024-09-19T06:40:41.203 INFO:tasks.workunit.client.0.smithi099.stdout:1/584: write d0/d12/d54/f7e [1906593,13924] 0 2024-09-19T06:40:41.205 INFO:tasks.workunit.client.0.smithi099.stdout:7/658: write d7/d39/fb7 [532600,116346] 0 2024-09-19T06:40:41.205 INFO:tasks.workunit.client.0.smithi099.stdout:7/659: readlink d7/dcf/d29/lb3 0 2024-09-19T06:40:41.206 INFO:tasks.workunit.client.0.smithi099.stdout:1/585: stat d0/d17/d32/d7b 0 2024-09-19T06:40:41.207 INFO:tasks.workunit.client.1.smithi117.stdout:3/710: mkdir d0/d9/d1c/de3 0 2024-09-19T06:40:41.207 INFO:tasks.workunit.client.1.smithi117.stdout:0/650: write d11/d13/d14/d2c/f2f [2739841,24091] 0 2024-09-19T06:40:41.207 INFO:tasks.workunit.client.1.smithi117.stdout:9/689: dread - d4/d20/f53 zero size 2024-09-19T06:40:41.208 INFO:tasks.workunit.client.0.smithi099.stdout:1/586: symlink d0/d17/d32/d7b/db0/lbd 0 2024-09-19T06:40:41.211 INFO:tasks.workunit.client.1.smithi117.stdout:0/651: truncate d11/d13/d1b/d27/d37/da9/fce 597482 0 2024-09-19T06:40:41.211 INFO:tasks.workunit.client.0.smithi099.stdout:7/660: creat d7/dcf/d29/d1f/d45/d48/d63/d75/fee x:0 0 0 2024-09-19T06:40:41.212 INFO:tasks.workunit.client.1.smithi117.stdout:5/770: dread d17/d5c/f90 [0,4194304] 0 2024-09-19T06:40:41.212 INFO:tasks.workunit.client.0.smithi099.stdout:1/587: mknod d0/d12/d13/cbe 0 2024-09-19T06:40:41.213 INFO:tasks.workunit.client.0.smithi099.stdout:7/661: write d7/fd2 [798222,41347] 0 2024-09-19T06:40:41.213 INFO:tasks.workunit.client.1.smithi117.stdout:5/771: chown d17/l18 2 1 2024-09-19T06:40:41.214 INFO:tasks.workunit.client.1.smithi117.stdout:3/711: creat d0/d19/d2b/d8e/fe4 x:0 0 0 2024-09-19T06:40:41.214 INFO:tasks.workunit.client.1.smithi117.stdout:5/772: readlink d17/d1b/d3a/d3c/d70/lfc 0 2024-09-19T06:40:41.215 INFO:tasks.workunit.client.0.smithi099.stdout:1/588: mknod d0/d17/d5b/cbf 0 2024-09-19T06:40:41.215 INFO:tasks.workunit.client.0.smithi099.stdout:7/662: fdatasync d7/d39/f59 0 2024-09-19T06:40:41.215 INFO:tasks.workunit.client.1.smithi117.stdout:2/697: link d0/d12/d2f/d98/fcf d0/d12/d2f/d98/dca/ddf/f102 0 2024-09-19T06:40:41.216 INFO:tasks.workunit.client.1.smithi117.stdout:3/712: stat d0/d3d/f4f 0 2024-09-19T06:40:41.218 INFO:tasks.workunit.client.0.smithi099.stdout:1/589: read d0/db/f31 [84842,36017] 0 2024-09-19T06:40:41.220 INFO:tasks.workunit.client.0.smithi099.stdout:1/590: rename d0/d12/d13 to d0/d12/d13/d37/d48/dc0 22 2024-09-19T06:40:41.220 INFO:tasks.workunit.client.0.smithi099.stdout:7/663: dread d7/dcf/d29/d1f/f55 [0,4194304] 0 2024-09-19T06:40:41.221 INFO:tasks.workunit.client.0.smithi099.stdout:1/591: readlink d0/d17/d24/d3a/d58/d8d/lad 0 2024-09-19T06:40:41.222 INFO:tasks.workunit.client.1.smithi117.stdout:3/713: creat d0/d3d/d48/d77/fe5 x:0 0 0 2024-09-19T06:40:41.222 INFO:tasks.workunit.client.1.smithi117.stdout:2/698: mknod d0/d7/d1e/c103 0 2024-09-19T06:40:41.222 INFO:tasks.workunit.client.0.smithi099.stdout:7/664: chown d7/f32 304 1 2024-09-19T06:40:41.223 INFO:tasks.workunit.client.1.smithi117.stdout:0/652: dwrite d11/d13/d14/d2c/d35/d3e/fbc [0,4194304] 0 2024-09-19T06:40:41.225 INFO:tasks.workunit.client.0.smithi099.stdout:1/592: creat d0/d12/d13/d37/d48/fc1 x:0 0 0 2024-09-19T06:40:41.225 INFO:tasks.workunit.client.1.smithi117.stdout:5/773: symlink d17/d1b/d3a/d3c/dcb/dde/d65/d88/de5/l101 0 2024-09-19T06:40:41.225 INFO:tasks.workunit.client.0.smithi099.stdout:5/744: dwrite d3/d16/d2f/d34/da4/f88 [0,4194304] 0 2024-09-19T06:40:41.227 INFO:tasks.workunit.client.0.smithi099.stdout:7/665: read - d7/dcf/d29/d1f/d45/d48/fbd zero size 2024-09-19T06:40:41.228 INFO:tasks.workunit.client.0.smithi099.stdout:1/593: rmdir d0/d17/d24/d5e/d8a 39 2024-09-19T06:40:41.229 INFO:tasks.workunit.client.1.smithi117.stdout:7/700: dread d1/d4a/d81/d48/faf [0,4194304] 0 2024-09-19T06:40:41.229 INFO:tasks.workunit.client.0.smithi099.stdout:5/745: rename d3/d14/c48 to d3/d7/c101 0 2024-09-19T06:40:41.230 INFO:tasks.workunit.client.1.smithi117.stdout:3/714: symlink d0/d19/d2b/d8e/ddb/le6 0 2024-09-19T06:40:41.230 INFO:tasks.workunit.client.1.smithi117.stdout:9/690: dwrite f0 [0,4194304] 0 2024-09-19T06:40:41.232 INFO:tasks.workunit.client.0.smithi099.stdout:5/746: mkdir d3/d16/d2f/d8c/dd9/d102 0 2024-09-19T06:40:41.233 INFO:tasks.workunit.client.1.smithi117.stdout:2/699: truncate d0/d7/f55 388127 0 2024-09-19T06:40:41.233 INFO:tasks.workunit.client.1.smithi117.stdout:3/715: fsync d0/d9/d4e/d9e/fa4 0 2024-09-19T06:40:41.233 INFO:tasks.workunit.client.0.smithi099.stdout:5/747: write d3/d16/d2f/fcf [1039677,46384] 0 2024-09-19T06:40:41.233 INFO:tasks.workunit.client.0.smithi099.stdout:7/666: dread d7/f32 [0,4194304] 0 2024-09-19T06:40:41.234 INFO:tasks.workunit.client.0.smithi099.stdout:1/594: truncate d0/f1a 272693 0 2024-09-19T06:40:41.235 INFO:tasks.workunit.client.1.smithi117.stdout:5/774: chown d17/d1b/d3a/d3c/dcb/dde/d65/d88/de5/d6a/cee 477190019 1 2024-09-19T06:40:41.235 INFO:tasks.workunit.client.0.smithi099.stdout:7/667: chown d7/dcf/d29/d1f/c28 28125 1 2024-09-19T06:40:41.235 INFO:tasks.workunit.client.1.smithi117.stdout:5/775: truncate d17/f89 1439204 0 2024-09-19T06:40:41.237 INFO:tasks.workunit.client.0.smithi099.stdout:7/668: chown d7/dcf/d29/d1f/d45/d48/d63/d75/fa4 789243 1 2024-09-19T06:40:41.237 INFO:tasks.workunit.client.1.smithi117.stdout:0/653: link d11/d13/d28/f7f d11/d13/d1b/fd5 0 2024-09-19T06:40:41.238 INFO:tasks.workunit.client.1.smithi117.stdout:7/701: creat d1/d4a/d7c/d95/ddc/ffd x:0 0 0 2024-09-19T06:40:41.238 INFO:tasks.workunit.client.0.smithi099.stdout:7/669: fdatasync d7/dcf/d29/d1f/d45/d48/f7e 0 2024-09-19T06:40:41.239 INFO:tasks.workunit.client.0.smithi099.stdout:7/670: readlink d7/dc7/d67/lb8 0 2024-09-19T06:40:41.240 INFO:tasks.workunit.client.0.smithi099.stdout:1/595: chown d0/d17/d24/d75/caa 1363697049 1 2024-09-19T06:40:41.241 INFO:tasks.workunit.client.0.smithi099.stdout:5/748: truncate d3/d16/d2f/d8c/fcc 2331133 0 2024-09-19T06:40:41.241 INFO:tasks.workunit.client.1.smithi117.stdout:3/716: symlink d0/d9/d4e/dcf/le7 0 2024-09-19T06:40:41.242 INFO:tasks.workunit.client.1.smithi117.stdout:3/717: chown d0/d8/f10 767778 1 2024-09-19T06:40:41.243 INFO:tasks.workunit.client.0.smithi099.stdout:1/596: creat d0/d68/fc2 x:0 0 0 2024-09-19T06:40:41.244 INFO:tasks.workunit.client.1.smithi117.stdout:2/700: mknod d0/d7/d29/d100/c104 0 2024-09-19T06:40:41.244 INFO:tasks.workunit.client.0.smithi099.stdout:5/749: mknod d3/dda/c103 0 2024-09-19T06:40:41.245 INFO:tasks.workunit.client.0.smithi099.stdout:7/671: symlink d7/lef 0 2024-09-19T06:40:41.248 INFO:tasks.workunit.client.0.smithi099.stdout:1/597: rename d0/d17/d5b/l8e to d0/d17/d24/d3a/d58/d8d/lc3 0 2024-09-19T06:40:41.249 INFO:tasks.workunit.client.1.smithi117.stdout:3/718: creat d0/d8/d7f/d40/fe8 x:0 0 0 2024-09-19T06:40:41.249 INFO:tasks.workunit.client.1.smithi117.stdout:0/654: read d11/d13/d14/f33 [649561,21636] 0 2024-09-19T06:40:41.249 INFO:tasks.workunit.client.0.smithi099.stdout:1/598: dread - d0/d12/d13/d37/d48/fc1 zero size 2024-09-19T06:40:41.250 INFO:tasks.workunit.client.0.smithi099.stdout:1/599: chown d0/d12 0 1 2024-09-19T06:40:41.251 INFO:tasks.workunit.client.1.smithi117.stdout:2/701: write d0/d12/d2f/d98/dca/ddf/f102 [510849,11729] 0 2024-09-19T06:40:41.251 INFO:tasks.workunit.client.0.smithi099.stdout:7/672: rename d7/dcf/d97/fa2 to d7/dc7/de7/ff0 0 2024-09-19T06:40:41.251 INFO:tasks.workunit.client.0.smithi099.stdout:5/750: link d3/d7/d90/ca9 d3/d16/d2f/d8c/dd9/c104 0 2024-09-19T06:40:41.252 INFO:tasks.workunit.client.1.smithi117.stdout:9/691: dwrite d4/d1c/d36/d37/f42 [4194304,4194304] 0 2024-09-19T06:40:41.252 INFO:tasks.workunit.client.0.smithi099.stdout:7/673: truncate d7/dcf/d97/fd0 713779 0 2024-09-19T06:40:41.255 INFO:tasks.workunit.client.0.smithi099.stdout:5/751: creat d3/d16/d2f/d34/da4/da5/dce/f105 x:0 0 0 2024-09-19T06:40:41.255 INFO:tasks.workunit.client.1.smithi117.stdout:7/702: dwrite d1/d4a/d81/f84 [0,4194304] 0 2024-09-19T06:40:41.255 INFO:tasks.workunit.client.0.smithi099.stdout:5/752: chown d3/d7/d90/da6 3788 1 2024-09-19T06:40:41.256 INFO:tasks.workunit.client.1.smithi117.stdout:3/719: creat d0/d8/d7f/d40/dc4/fe9 x:0 0 0 2024-09-19T06:40:41.256 INFO:tasks.workunit.client.0.smithi099.stdout:7/674: creat d7/dcf/d29/d34/d8f/ff1 x:0 0 0 2024-09-19T06:40:41.256 INFO:tasks.workunit.client.1.smithi117.stdout:9/692: readlink d4/d8/l95 0 2024-09-19T06:40:41.257 INFO:tasks.workunit.client.0.smithi099.stdout:7/675: fsync d7/dcf/d29/d4e/d53/fac 0 2024-09-19T06:40:41.260 INFO:tasks.workunit.client.0.smithi099.stdout:7/676: read d7/dcf/d29/d34/f35 [2322995,90802] 0 2024-09-19T06:40:41.264 INFO:tasks.workunit.client.0.smithi099.stdout:7/677: dread d7/dcf/d29/d4e/f9a [0,4194304] 0 2024-09-19T06:40:41.265 INFO:tasks.workunit.client.1.smithi117.stdout:9/693: fdatasync d4/d1c/d36/f7d 0 2024-09-19T06:40:41.266 INFO:tasks.workunit.client.1.smithi117.stdout:2/702: mkdir d0/d7/d29/df4/d105 0 2024-09-19T06:40:41.266 INFO:tasks.workunit.client.1.smithi117.stdout:3/720: getdents d0/d9/d4e/d9e/ddc 0 2024-09-19T06:40:41.268 INFO:tasks.workunit.client.1.smithi117.stdout:0/655: link d11/d13/d14/d2c/d64/f84 d11/d13/d14/fd6 0 2024-09-19T06:40:41.270 INFO:tasks.workunit.client.0.smithi099.stdout:7/678: mkdir d7/df2 0 2024-09-19T06:40:41.271 INFO:tasks.workunit.client.1.smithi117.stdout:2/703: read d0/d12/d2f/d98/dca/ddf/f102 [119219,129418] 0 2024-09-19T06:40:41.272 INFO:tasks.workunit.client.0.smithi099.stdout:7/679: fsync d7/dcf/d29/d1f/d45/d48/fbd 0 2024-09-19T06:40:41.274 INFO:tasks.workunit.client.0.smithi099.stdout:7/680: write d7/dcf/d29/d1f/d45/f8b [2267144,32666] 0 2024-09-19T06:40:41.275 INFO:tasks.workunit.client.1.smithi117.stdout:3/721: getdents d0/d19/d2b 0 2024-09-19T06:40:41.276 INFO:tasks.workunit.client.1.smithi117.stdout:5/776: dwrite d17/d1b/d3a/d3c/dcb/dde/d65/d88/de5/d6a/f75 [0,4194304] 0 2024-09-19T06:40:41.276 INFO:tasks.workunit.client.0.smithi099.stdout:7/681: read - d7/dcf/f54 zero size 2024-09-19T06:40:41.276 INFO:tasks.workunit.client.0.smithi099.stdout:1/600: dwrite d0/d17/d32/d7b/f84 [0,4194304] 0 2024-09-19T06:40:41.278 INFO:tasks.workunit.client.1.smithi117.stdout:3/722: readlink d0/d3d/l72 0 2024-09-19T06:40:41.280 INFO:tasks.workunit.client.0.smithi099.stdout:1/601: creat d0/d12/d13/d37/d48/fc4 x:0 0 0 2024-09-19T06:40:41.282 INFO:tasks.workunit.client.1.smithi117.stdout:9/694: dwrite d4/d1c/d7a/d69/f70 [0,4194304] 0 2024-09-19T06:40:41.283 INFO:tasks.workunit.client.0.smithi099.stdout:7/682: dwrite d7/dcf/d29/d1f/d45/f8b [0,4194304] 0 2024-09-19T06:40:41.285 INFO:tasks.workunit.client.1.smithi117.stdout:2/704: write d0/d7/d29/d35/d61/d65/fc6 [22868,70358] 0 2024-09-19T06:40:41.286 INFO:tasks.workunit.client.1.smithi117.stdout:5/777: mkdir d17/d1b/d3a/d3c/d46/d102 0 2024-09-19T06:40:41.288 INFO:tasks.workunit.client.1.smithi117.stdout:0/656: dwrite d11/d13/d14/d16/f4a [0,4194304] 0 2024-09-19T06:40:41.288 INFO:tasks.workunit.client.0.smithi099.stdout:7/683: symlink d7/d39/d7d/dd6/lf3 0 2024-09-19T06:40:41.291 INFO:tasks.workunit.client.1.smithi117.stdout:5/778: dread - d17/d1b/d3a/d3c/dcb/dde/d65/d88/de5/d3b/ff4 zero size 2024-09-19T06:40:41.292 INFO:tasks.workunit.client.1.smithi117.stdout:9/695: creat d4/d1c/d5f/dbc/fed x:0 0 0 2024-09-19T06:40:41.294 INFO:tasks.workunit.client.1.smithi117.stdout:5/779: chown d17/d1b/d3a/d3c/dcb/dde/d65/f8d 59 1 2024-09-19T06:40:41.295 INFO:tasks.workunit.client.1.smithi117.stdout:2/705: creat d0/d12/f106 x:0 0 0 2024-09-19T06:40:41.298 INFO:tasks.workunit.client.1.smithi117.stdout:5/780: mknod d17/d1b/d3a/d3c/dcb/dde/dab/c103 0 2024-09-19T06:40:41.302 INFO:tasks.workunit.client.1.smithi117.stdout:5/781: dread d17/d5c/f69 [0,4194304] 0 2024-09-19T06:40:41.303 INFO:tasks.workunit.client.1.smithi117.stdout:2/706: unlink d0/d12/lad 0 2024-09-19T06:40:41.303 INFO:tasks.workunit.client.0.smithi099.stdout:1/602: dread d0/d12/d13/d37/f3f [0,4194304] 0 2024-09-19T06:40:41.304 INFO:tasks.workunit.client.1.smithi117.stdout:9/696: getdents d4/d1c/d73/d93 0 2024-09-19T06:40:41.305 INFO:tasks.workunit.client.0.smithi099.stdout:1/603: write d0/d12/d13/d37/d48/fc4 [22453,112364] 0 2024-09-19T06:40:41.307 INFO:tasks.workunit.client.1.smithi117.stdout:2/707: creat d0/d7/d29/d35/d61/def/f107 x:0 0 0 2024-09-19T06:40:41.308 INFO:tasks.workunit.client.1.smithi117.stdout:9/697: truncate d4/d1c/d36/d37/f39 821181 0 2024-09-19T06:40:41.308 INFO:tasks.workunit.client.1.smithi117.stdout:3/723: dread d0/d3d/d48/d77/d81/f8f [0,4194304] 0 2024-09-19T06:40:41.308 INFO:tasks.workunit.client.1.smithi117.stdout:1/636: sync 2024-09-19T06:40:41.310 INFO:tasks.workunit.client.1.smithi117.stdout:2/708: write d0/d7/d29/d35/d3d/d72/ff8 [1032061,53952] 0 2024-09-19T06:40:41.310 INFO:tasks.workunit.client.1.smithi117.stdout:1/637: write d3/da1/fd5 [988231,104988] 0 2024-09-19T06:40:41.311 INFO:tasks.workunit.client.1.smithi117.stdout:3/724: write d0/d8/d7f/d40/fbc [694674,79319] 0 2024-09-19T06:40:41.313 INFO:tasks.workunit.client.1.smithi117.stdout:1/638: write d3/d8e/db4/fcb [413579,93245] 0 2024-09-19T06:40:41.315 INFO:tasks.workunit.client.0.smithi099.stdout:1/604: dread d0/d12/d13/d37/f3f [4194304,4194304] 0 2024-09-19T06:40:41.315 INFO:tasks.workunit.client.1.smithi117.stdout:1/639: fdatasync d3/fc5 0 2024-09-19T06:40:41.316 INFO:tasks.workunit.client.1.smithi117.stdout:2/709: creat d0/d12/d2f/d98/dd2/f108 x:0 0 0 2024-09-19T06:40:41.318 INFO:tasks.workunit.client.0.smithi099.stdout:7/684: write d7/dcf/d29/d34/da1/fa9 [809057,119765] 0 2024-09-19T06:40:41.319 INFO:tasks.workunit.client.1.smithi117.stdout:9/698: dwrite d4/f44 [0,4194304] 0 2024-09-19T06:40:41.321 INFO:tasks.workunit.client.0.smithi099.stdout:7/685: fdatasync d7/dcf/d29/d1f/d45/d48/fe2 0 2024-09-19T06:40:41.321 INFO:tasks.workunit.client.0.smithi099.stdout:1/605: dwrite d0/d12/d13/d37/d48/fc1 [0,4194304] 0 2024-09-19T06:40:41.321 INFO:tasks.workunit.client.1.smithi117.stdout:2/710: write d0/d7/d29/d35/dbd/d8d/fd6 [208699,98805] 0 2024-09-19T06:40:41.323 INFO:tasks.workunit.client.1.smithi117.stdout:1/640: creat d3/d18/d23/d74/d89/d9f/fdf x:0 0 0 2024-09-19T06:40:41.325 INFO:tasks.workunit.client.1.smithi117.stdout:3/725: dwrite d0/d19/d2b/d8e/fa0 [0,4194304] 0 2024-09-19T06:40:41.325 INFO:tasks.workunit.client.1.smithi117.stdout:9/699: stat d4/d8/d6a/d82/da3 0 2024-09-19T06:40:41.328 INFO:tasks.workunit.client.0.smithi099.stdout:1/606: creat d0/d12/d13/d37/d41/d78/fc5 x:0 0 0 2024-09-19T06:40:41.329 INFO:tasks.workunit.client.0.smithi099.stdout:1/607: chown d0/d12/d13/d37/d41/d78/fc5 4678863 1 2024-09-19T06:40:41.335 INFO:tasks.workunit.client.1.smithi117.stdout:3/726: creat d0/d9/d4e/fea x:0 0 0 2024-09-19T06:40:41.337 INFO:tasks.workunit.client.1.smithi117.stdout:1/641: getdents d3 0 2024-09-19T06:40:41.339 INFO:tasks.workunit.client.0.smithi099.stdout:1/608: dwrite d0/f21 [0,4194304] 0 2024-09-19T06:40:41.340 INFO:tasks.workunit.client.1.smithi117.stdout:0/657: dread d11/d13/d1b/f94 [0,4194304] 0 2024-09-19T06:40:41.342 INFO:tasks.workunit.client.1.smithi117.stdout:2/711: dwrite d0/d64/dd9/fb2 [0,4194304] 0 2024-09-19T06:40:41.342 INFO:tasks.workunit.client.1.smithi117.stdout:9/700: dwrite d4/d8/d6e/da4/fb0 [4194304,4194304] 0 2024-09-19T06:40:41.345 INFO:tasks.workunit.client.1.smithi117.stdout:1/642: rename d3/d18/f3f to d3/d18/d23/d74/fe0 0 2024-09-19T06:40:41.352 INFO:tasks.workunit.client.0.smithi099.stdout:7/686: dwrite d7/dcf/d29/d34/f35 [0,4194304] 0 2024-09-19T06:40:41.355 INFO:tasks.workunit.client.0.smithi099.stdout:7/687: mknod d7/dcf/d29/d34/cf4 0 2024-09-19T06:40:41.357 INFO:tasks.workunit.client.0.smithi099.stdout:7/688: chown d7/dcf/d29/d34/d8f 969814333 1 2024-09-19T06:40:41.359 INFO:tasks.workunit.client.0.smithi099.stdout:7/689: fdatasync d7/dcf/d29/d1f/fd7 0 2024-09-19T06:40:41.360 INFO:tasks.workunit.client.0.smithi099.stdout:7/690: dread - d7/dcf/d29/d1f/d45/d48/d63/d75/fee zero size 2024-09-19T06:40:41.362 INFO:tasks.workunit.client.1.smithi117.stdout:0/658: truncate d11/d13/d1b/f4e 2900819 0 2024-09-19T06:40:41.364 INFO:tasks.workunit.client.1.smithi117.stdout:2/712: symlink d0/d12/d32/da4/l109 0 2024-09-19T06:40:41.364 INFO:tasks.workunit.client.0.smithi099.stdout:7/691: chown d7/dcf/d29/d1f/d45/f5b 16098533 1 2024-09-19T06:40:41.366 INFO:tasks.workunit.client.1.smithi117.stdout:2/713: stat d0/d12/d32/db5/f83 0 2024-09-19T06:40:41.367 INFO:tasks.workunit.client.1.smithi117.stdout:3/727: dwrite d0/d3d/f4f [0,4194304] 0 2024-09-19T06:40:41.368 INFO:tasks.workunit.client.0.smithi099.stdout:7/692: rename d7/df2 to d7/dcf/d29/d1f/d45/d48/df5 0 2024-09-19T06:40:41.368 INFO:tasks.workunit.client.1.smithi117.stdout:1/643: read d3/f10 [1024684,92001] 0 2024-09-19T06:40:41.369 INFO:tasks.workunit.client.1.smithi117.stdout:0/659: link d11/d13/d28/d38/d5b/f73 d11/d13/d14/d2c/d53/d7e/fd7 0 2024-09-19T06:40:41.371 INFO:tasks.workunit.client.0.smithi099.stdout:7/693: mkdir d7/dcf/d29/d1f/d45/d48/d63/d75/dd8/df6 0 2024-09-19T06:40:41.371 INFO:tasks.workunit.client.1.smithi117.stdout:3/728: creat d0/d8/d7f/feb x:0 0 0 2024-09-19T06:40:41.371 INFO:tasks.workunit.client.1.smithi117.stdout:1/644: creat d3/d18/d56/fe1 x:0 0 0 2024-09-19T06:40:41.372 INFO:tasks.workunit.client.1.smithi117.stdout:3/729: fdatasync d0/d3d/d48/f7b 0 2024-09-19T06:40:41.373 INFO:tasks.workunit.client.1.smithi117.stdout:2/714: rename d0/d12/d2f/d98/dca to d0/d7/d1e/d20/d10a 0 2024-09-19T06:40:41.373 INFO:tasks.workunit.client.0.smithi099.stdout:7/694: creat d7/dcf/d29/d4e/d53/ff7 x:0 0 0 2024-09-19T06:40:41.374 INFO:tasks.workunit.client.0.smithi099.stdout:7/695: chown d7/dcf/d29/d34/fd1 103966 1 2024-09-19T06:40:41.375 INFO:tasks.workunit.client.0.smithi099.stdout:7/696: write d7/dcf/d29/d34/f70 [3375580,42277] 0 2024-09-19T06:40:41.376 INFO:tasks.workunit.client.1.smithi117.stdout:3/730: rmdir d0/d19/d2b/d8e 39 2024-09-19T06:40:41.378 INFO:tasks.workunit.client.1.smithi117.stdout:2/715: mknod d0/d7/d29/d35/dbd/c10b 0 2024-09-19T06:40:41.379 INFO:tasks.workunit.client.1.smithi117.stdout:0/660: rmdir d11/d13/d14/d2c/d53/dcf 0 2024-09-19T06:40:41.381 INFO:tasks.workunit.client.1.smithi117.stdout:2/716: chown d0/d7/d29/d35/f77 1741 1 2024-09-19T06:40:41.382 INFO:tasks.workunit.client.1.smithi117.stdout:0/661: read d11/d13/d14/f86 [4164541,124805] 0 2024-09-19T06:40:41.384 INFO:tasks.workunit.client.1.smithi117.stdout:3/731: dwrite d0/d8/f73 [0,4194304] 0 2024-09-19T06:40:41.388 INFO:tasks.workunit.client.1.smithi117.stdout:3/732: creat d0/d9/d4e/db4/fec x:0 0 0 2024-09-19T06:40:41.392 INFO:tasks.workunit.client.0.smithi099.stdout:7/697: getdents d7 0 2024-09-19T06:40:41.392 INFO:tasks.workunit.client.1.smithi117.stdout:0/662: unlink d11/d13/d1b/d27/d54/f57 0 2024-09-19T06:40:41.393 INFO:tasks.workunit.client.0.smithi099.stdout:7/698: readlink d7/dcf/d29/d1f/l27 0 2024-09-19T06:40:41.395 INFO:tasks.workunit.client.0.smithi099.stdout:7/699: getdents d7/dcf/d29/d1f/d45/d48/df5 0 2024-09-19T06:40:41.397 INFO:tasks.workunit.client.0.smithi099.stdout:7/700: dread - d7/dcf/d29/d1f/d45/d48/d63/d75/fa4 zero size 2024-09-19T06:40:41.399 INFO:tasks.workunit.client.0.smithi099.stdout:7/701: creat d7/dcf/d29/d1f/d45/d48/dda/ff8 x:0 0 0 2024-09-19T06:40:41.400 INFO:tasks.workunit.client.1.smithi117.stdout:9/701: truncate d4/d17/f76 948192 0 2024-09-19T06:40:41.405 INFO:tasks.workunit.client.0.smithi099.stdout:7/702: dwrite d7/dcf/d29/d1f/d45/fc2 [0,4194304] 0 2024-09-19T06:40:41.407 INFO:tasks.workunit.client.1.smithi117.stdout:1/645: dread d3/f13 [0,4194304] 0 2024-09-19T06:40:41.409 INFO:tasks.workunit.client.1.smithi117.stdout:2/717: truncate d0/d7/d29/d35/d3d/f9b 2659328 0 2024-09-19T06:40:41.410 INFO:tasks.workunit.client.0.smithi099.stdout:7/703: dread d7/d39/f59 [0,4194304] 0 2024-09-19T06:40:41.410 INFO:tasks.workunit.client.1.smithi117.stdout:2/718: fsync d0/d7/d58/fd3 0 2024-09-19T06:40:41.414 INFO:tasks.workunit.client.0.smithi099.stdout:7/704: getdents d7/dc7/de7 0 2024-09-19T06:40:41.416 INFO:tasks.workunit.client.0.smithi099.stdout:0/531: sync 2024-09-19T06:40:41.416 INFO:tasks.workunit.client.0.smithi099.stdout:7/705: mkdir d7/dcf/d29/df9 0 2024-09-19T06:40:41.416 INFO:tasks.workunit.client.0.smithi099.stdout:0/532: stat d0/db/d13/d1f/d3a/l56 0 2024-09-19T06:40:41.417 INFO:tasks.workunit.client.0.smithi099.stdout:7/706: write d7/dcf/fb9 [1004697,122046] 0 2024-09-19T06:40:41.420 INFO:tasks.workunit.client.0.smithi099.stdout:0/533: creat d0/db/d27/d38/fac x:0 0 0 2024-09-19T06:40:41.421 INFO:tasks.workunit.client.0.smithi099.stdout:7/707: creat d7/dcf/ffa x:0 0 0 2024-09-19T06:40:41.421 INFO:tasks.workunit.client.0.smithi099.stdout:0/534: dread - d0/db/d13/d37/d3c/d3e/fa3 zero size 2024-09-19T06:40:41.422 INFO:tasks.workunit.client.0.smithi099.stdout:0/535: fsync d0/db/d13/d1f/d39/f74 0 2024-09-19T06:40:41.423 INFO:tasks.workunit.client.0.smithi099.stdout:7/708: creat d7/dcf/d29/d34/d8f/ffb x:0 0 0 2024-09-19T06:40:41.425 INFO:tasks.workunit.client.0.smithi099.stdout:0/536: mknod d0/db/d13/d1f/d99/cad 0 2024-09-19T06:40:41.426 INFO:tasks.workunit.client.1.smithi117.stdout:3/733: fsync d0/fb 0 2024-09-19T06:40:41.427 INFO:tasks.workunit.client.0.smithi099.stdout:7/709: getdents d7/dcf/d97 0 2024-09-19T06:40:41.428 INFO:tasks.workunit.client.1.smithi117.stdout:3/734: chown d0/d3d/d48/f91 14017 1 2024-09-19T06:40:41.428 INFO:tasks.workunit.client.1.smithi117.stdout:9/702: unlink d4/d1c/d7a/d69/f7e 0 2024-09-19T06:40:41.429 INFO:tasks.workunit.client.1.smithi117.stdout:9/703: readlink d4/d20/l3f 0 2024-09-19T06:40:41.430 INFO:tasks.workunit.client.0.smithi099.stdout:7/710: creat d7/dc7/d67/ffc x:0 0 0 2024-09-19T06:40:41.430 INFO:tasks.workunit.client.1.smithi117.stdout:9/704: dread - d4/d58/f8e zero size 2024-09-19T06:40:41.431 INFO:tasks.workunit.client.1.smithi117.stdout:1/646: mknod d3/d22/d2f/ce2 0 2024-09-19T06:40:41.432 INFO:tasks.workunit.client.0.smithi099.stdout:7/711: mkdir d7/dcf/d29/d1f/dec/dfd 0 2024-09-19T06:40:41.432 INFO:tasks.workunit.client.1.smithi117.stdout:1/647: chown d3/da1/db1/d93/f9a 869215631 1 2024-09-19T06:40:41.433 INFO:tasks.workunit.client.1.smithi117.stdout:1/648: chown d3/da1/da5 105 1 2024-09-19T06:40:41.434 INFO:tasks.workunit.client.1.smithi117.stdout:0/663: symlink d11/d13/d14/d2c/d53/d7e/daa/dca/ld8 0 2024-09-19T06:40:41.435 INFO:tasks.workunit.client.0.smithi099.stdout:7/712: link d7/dcf/d29/d1f/d45/f8b d7/dcf/d29/d1f/dec/ffe 0 2024-09-19T06:40:41.437 INFO:tasks.workunit.client.1.smithi117.stdout:9/705: creat d4/d1c/d73/da8/fee x:0 0 0 2024-09-19T06:40:41.438 INFO:tasks.workunit.client.0.smithi099.stdout:7/713: creat d7/dcf/d29/d1f/d45/d48/d63/d75/dd8/df6/fff x:0 0 0 2024-09-19T06:40:41.439 INFO:tasks.workunit.client.0.smithi099.stdout:7/714: stat d7/c2d 0 2024-09-19T06:40:41.440 INFO:tasks.workunit.client.1.smithi117.stdout:1/649: symlink d3/d18/d23/le3 0 2024-09-19T06:40:41.441 INFO:tasks.workunit.client.1.smithi117.stdout:9/706: mknod d4/d1c/d54/da5/cef 0 2024-09-19T06:40:41.442 INFO:tasks.workunit.client.0.smithi099.stdout:7/715: unlink d7/dcf/d29/d1f/d45/d48/f7e 0 2024-09-19T06:40:41.443 INFO:tasks.workunit.client.1.smithi117.stdout:3/735: mknod d0/d19/d2b/d8e/ddb/ced 0 2024-09-19T06:40:41.443 INFO:tasks.workunit.client.0.smithi099.stdout:0/537: dread d0/db/d36/f5f [4194304,4194304] 0 2024-09-19T06:40:41.444 INFO:tasks.workunit.client.1.smithi117.stdout:3/736: mkdir d0/d19/d2b/d8e/dee 0 2024-09-19T06:40:41.445 INFO:tasks.workunit.client.0.smithi099.stdout:7/716: creat d7/dcf/d29/d34/da1/dd5/f100 x:0 0 0 2024-09-19T06:40:41.446 INFO:tasks.workunit.client.1.smithi117.stdout:1/650: dwrite d3/f96 [0,4194304] 0 2024-09-19T06:40:41.447 INFO:tasks.workunit.client.1.smithi117.stdout:9/707: getdents d4/d1c/d7a 0 2024-09-19T06:40:41.447 INFO:tasks.workunit.client.0.smithi099.stdout:7/717: dread - d7/dc7/f68 zero size 2024-09-19T06:40:41.449 INFO:tasks.workunit.client.1.smithi117.stdout:3/737: dread - d0/d8/d7f/d40/f9d zero size 2024-09-19T06:40:41.452 INFO:tasks.workunit.client.1.smithi117.stdout:1/651: read d3/d18/d23/d74/f75 [554044,55685] 0 2024-09-19T06:40:41.454 INFO:tasks.workunit.client.1.smithi117.stdout:2/719: write d0/d64/dd9/f88 [161691,74056] 0 2024-09-19T06:40:41.454 INFO:tasks.workunit.client.1.smithi117.stdout:3/738: mknod d0/d8/cef 0 2024-09-19T06:40:41.455 INFO:tasks.workunit.client.1.smithi117.stdout:9/708: dwrite d4/d1c/d73/d93/fa0 [0,4194304] 0 2024-09-19T06:40:41.456 INFO:tasks.workunit.client.1.smithi117.stdout:1/652: creat d3/d8e/fe4 x:0 0 0 2024-09-19T06:40:41.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:41 smithi099 ceph-mon[27651]: pgmap v19: 65 pgs: 65 active+clean; 2.8 GiB data, 9.8 GiB used, 527 GiB / 536 GiB avail; 118 MiB/s rd, 401 MiB/s wr, 701 op/s 2024-09-19T06:40:41.456 INFO:tasks.workunit.client.0.smithi099.stdout:0/538: truncate d0/db/f46 166683 0 2024-09-19T06:40:41.460 INFO:tasks.workunit.client.0.smithi099.stdout:0/539: mknod d0/db/d13/d1f/d8e/d9b/cae 0 2024-09-19T06:40:41.463 INFO:tasks.workunit.client.1.smithi117.stdout:3/739: creat d0/d8/d7f/dbf/ff0 x:0 0 0 2024-09-19T06:40:41.463 INFO:tasks.workunit.client.0.smithi099.stdout:0/540: creat d0/db/d13/d37/d3c/faf x:0 0 0 2024-09-19T06:40:41.463 INFO:tasks.workunit.client.1.smithi117.stdout:2/720: creat d0/d7/d1e/d20/d10a/f10c x:0 0 0 2024-09-19T06:40:41.464 INFO:tasks.workunit.client.0.smithi099.stdout:0/541: chown d0/d17/f84 6 1 2024-09-19T06:40:41.465 INFO:tasks.workunit.client.0.smithi099.stdout:0/542: write d0/db/d13/f1e [3157576,45126] 0 2024-09-19T06:40:41.466 INFO:tasks.workunit.client.0.smithi099.stdout:0/543: chown d0/db/d13/d47 94603948 1 2024-09-19T06:40:41.467 INFO:tasks.workunit.client.1.smithi117.stdout:0/664: dwrite d11/d13/d14/fd6 [0,4194304] 0 2024-09-19T06:40:41.468 INFO:tasks.workunit.client.1.smithi117.stdout:2/721: readlink d0/d7/d1e/d20/l3a 0 2024-09-19T06:40:41.469 INFO:tasks.workunit.client.1.smithi117.stdout:2/722: readlink d0/d12/d2f/la6 0 2024-09-19T06:40:41.471 INFO:tasks.workunit.client.1.smithi117.stdout:9/709: dwrite d4/d1c/f35 [0,4194304] 0 2024-09-19T06:40:41.473 INFO:tasks.workunit.client.0.smithi099.stdout:0/544: dwrite d0/db/d13/d1f/d39/f74 [0,4194304] 0 2024-09-19T06:40:41.476 INFO:tasks.workunit.client.0.smithi099.stdout:0/545: write d0/f2a [2861261,36872] 0 2024-09-19T06:40:41.478 INFO:tasks.workunit.client.1.smithi117.stdout:0/665: dwrite d11/d13/d28/f92 [0,4194304] 0 2024-09-19T06:40:41.480 INFO:tasks.workunit.client.1.smithi117.stdout:9/710: creat d4/d1c/d46/de1/ff0 x:0 0 0 2024-09-19T06:40:41.480 INFO:tasks.workunit.client.0.smithi099.stdout:7/718: dread d7/dc7/d67/f79 [0,4194304] 0 2024-09-19T06:40:41.480 INFO:tasks.workunit.client.0.smithi099.stdout:0/546: write d0/db/d13/d37/d3c/d3e/fa3 [313626,94868] 0 2024-09-19T06:40:41.482 INFO:tasks.workunit.client.0.smithi099.stdout:0/547: truncate d0/db/d13/f7d 1424635 0 2024-09-19T06:40:41.483 INFO:tasks.workunit.client.1.smithi117.stdout:9/711: dread - d4/d8/d6a/d82/da3/fd0 zero size 2024-09-19T06:40:41.484 INFO:tasks.workunit.client.0.smithi099.stdout:7/719: dread d7/dcf/d97/fd0 [0,4194304] 0 2024-09-19T06:40:41.488 INFO:tasks.workunit.client.0.smithi099.stdout:0/548: mknod d0/db/d13/d1f/d3a/da0/cb0 0 2024-09-19T06:40:41.489 INFO:tasks.workunit.client.0.smithi099.stdout:0/549: fdatasync d0/db/d13/d1f/d3a/fa8 0 2024-09-19T06:40:41.491 INFO:tasks.workunit.client.0.smithi099.stdout:0/550: chown d0/db/d13/d1f/d39/c90 23641161 1 2024-09-19T06:40:41.491 INFO:tasks.workunit.client.1.smithi117.stdout:2/723: write d0/d7/d29/d35/d3d/f9b [2370238,81021] 0 2024-09-19T06:40:41.493 INFO:tasks.workunit.client.0.smithi099.stdout:0/551: mkdir d0/db/d36/db1 0 2024-09-19T06:40:41.494 INFO:tasks.workunit.client.1.smithi117.stdout:9/712: dread d4/d1c/f28 [0,4194304] 0 2024-09-19T06:40:41.494 INFO:tasks.workunit.client.1.smithi117.stdout:0/666: dwrite d11/d13/d14/f33 [0,4194304] 0 2024-09-19T06:40:41.494 INFO:tasks.workunit.client.0.smithi099.stdout:0/552: chown d0/db/d36/c6e 1668 1 2024-09-19T06:40:41.497 INFO:tasks.workunit.client.1.smithi117.stdout:9/713: dread - d4/d58/fc3 zero size 2024-09-19T06:40:41.497 INFO:tasks.workunit.client.1.smithi117.stdout:2/724: chown d0/d12/d2f/c74 66513044 1 2024-09-19T06:40:41.497 INFO:tasks.workunit.client.1.smithi117.stdout:1/653: dread d3/d22/f33 [0,4194304] 0 2024-09-19T06:40:41.497 INFO:tasks.workunit.client.0.smithi099.stdout:0/553: creat d0/db/d13/d59/fb2 x:0 0 0 2024-09-19T06:40:41.499 INFO:tasks.workunit.client.1.smithi117.stdout:3/740: dwrite d0/d8/d7f/d40/dc4/f6d [0,4194304] 0 2024-09-19T06:40:41.499 INFO:tasks.workunit.client.1.smithi117.stdout:9/714: chown d4/d1c/d54/da5/daf 813012 1 2024-09-19T06:40:41.499 INFO:tasks.workunit.client.1.smithi117.stdout:1/654: readlink d3/d22/l84 0 2024-09-19T06:40:41.501 INFO:tasks.workunit.client.1.smithi117.stdout:0/667: dread - d11/d13/d1b/d27/d54/f8f zero size 2024-09-19T06:40:41.502 INFO:tasks.workunit.client.0.smithi099.stdout:0/554: truncate d0/db/d13/d1f/f24 1049809 0 2024-09-19T06:40:41.502 INFO:tasks.workunit.client.1.smithi117.stdout:1/655: chown d3/d22/d2f/f62 5457166 1 2024-09-19T06:40:41.504 INFO:tasks.workunit.client.1.smithi117.stdout:0/668: write d11/d13/d14/d2c/d35/fa3 [72300,76049] 0 2024-09-19T06:40:41.506 INFO:tasks.workunit.client.0.smithi099.stdout:0/555: mknod d0/db/d36/db1/cb3 0 2024-09-19T06:40:41.506 INFO:tasks.workunit.client.1.smithi117.stdout:0/669: chown d11/c72 13518 1 2024-09-19T06:40:41.506 INFO:tasks.workunit.client.1.smithi117.stdout:2/725: truncate d0/d7/d29/f5f 2118014 0 2024-09-19T06:40:41.508 INFO:tasks.workunit.client.1.smithi117.stdout:1/656: fsync d3/f13 0 2024-09-19T06:40:41.509 INFO:tasks.workunit.client.1.smithi117.stdout:1/657: stat d3/f5c 0 2024-09-19T06:40:41.509 INFO:tasks.workunit.client.1.smithi117.stdout:6/534: sync 2024-09-19T06:40:41.510 INFO:tasks.workunit.client.0.smithi099.stdout:0/556: mkdir d0/db/d13/d1f/db4 0 2024-09-19T06:40:41.510 INFO:tasks.workunit.client.1.smithi117.stdout:0/670: mknod d11/d13/d1b/d4b/cd9 0 2024-09-19T06:40:41.512 INFO:tasks.workunit.client.1.smithi117.stdout:0/671: dread - d11/d13/d1b/d27/d37/d6d/fba zero size 2024-09-19T06:40:41.512 INFO:tasks.workunit.client.0.smithi099.stdout:0/557: creat d0/db/d27/d38/fb5 x:0 0 0 2024-09-19T06:40:41.513 INFO:tasks.workunit.client.1.smithi117.stdout:3/741: getdents d0/d8 0 2024-09-19T06:40:41.514 INFO:tasks.workunit.client.0.smithi099.stdout:0/558: chown d0/db/d13/d1f/d4a/f50 3 1 2024-09-19T06:40:41.514 INFO:tasks.workunit.client.1.smithi117.stdout:3/742: fsync d0/d19/fb9 0 2024-09-19T06:40:41.516 INFO:tasks.workunit.client.1.smithi117.stdout:6/535: rename d1/d3/fd to d1/d5/d85/f93 0 2024-09-19T06:40:41.518 INFO:tasks.workunit.client.0.smithi099.stdout:7/720: dread d7/dcf/d29/f4a [0,4194304] 0 2024-09-19T06:40:41.518 INFO:tasks.workunit.client.1.smithi117.stdout:3/743: mkdir d0/d8/d64/df1 0 2024-09-19T06:40:41.519 INFO:tasks.workunit.client.1.smithi117.stdout:6/536: creat d1/d14/f94 x:0 0 0 2024-09-19T06:40:41.520 INFO:tasks.workunit.client.1.smithi117.stdout:2/726: creat d0/d7/d1e/f10d x:0 0 0 2024-09-19T06:40:41.521 INFO:tasks.workunit.client.0.smithi099.stdout:7/721: creat d7/dcf/d97/f101 x:0 0 0 2024-09-19T06:40:41.521 INFO:tasks.workunit.client.1.smithi117.stdout:0/672: mknod d11/d13/d14/dbd/cda 0 2024-09-19T06:40:41.522 INFO:tasks.workunit.client.1.smithi117.stdout:6/537: symlink d1/d14/l95 0 2024-09-19T06:40:41.522 INFO:tasks.workunit.client.0.smithi099.stdout:0/559: dwrite d0/d17/f6a [0,4194304] 0 2024-09-19T06:40:41.523 INFO:tasks.workunit.client.1.smithi117.stdout:2/727: creat d0/d12/d32/f10e x:0 0 0 2024-09-19T06:40:41.524 INFO:tasks.workunit.client.0.smithi099.stdout:0/560: truncate d0/fa7 906945 0 2024-09-19T06:40:41.524 INFO:tasks.workunit.client.1.smithi117.stdout:0/673: mknod d11/d13/d14/d2c/d64/cdb 0 2024-09-19T06:40:41.525 INFO:tasks.workunit.client.0.smithi099.stdout:7/722: write d7/dcf/d29/d34/f98 [159125,102348] 0 2024-09-19T06:40:41.525 INFO:tasks.workunit.client.1.smithi117.stdout:0/674: stat d11/d13/d1b/l8d 0 2024-09-19T06:40:41.525 INFO:tasks.workunit.client.1.smithi117.stdout:3/744: dwrite d0/d8/f73 [0,4194304] 0 2024-09-19T06:40:41.526 INFO:tasks.workunit.client.1.smithi117.stdout:0/675: stat d11/d13/d14/d2c/d64/fb3 0 2024-09-19T06:40:41.527 INFO:tasks.workunit.client.1.smithi117.stdout:3/745: write d0/d3d/d48/dd0/fd7 [4048838,128801] 0 2024-09-19T06:40:41.530 INFO:tasks.workunit.client.1.smithi117.stdout:6/538: creat d1/d5/d8/d5e/f96 x:0 0 0 2024-09-19T06:40:41.531 INFO:tasks.workunit.client.0.smithi099.stdout:7/723: symlink d7/dcf/d29/d1f/d45/d48/d63/d71/l102 0 2024-09-19T06:40:41.533 INFO:tasks.workunit.client.0.smithi099.stdout:0/561: dwrite d0/db/d13/d37/d3c/d3e/f97 [0,4194304] 0 2024-09-19T06:40:41.537 INFO:tasks.workunit.client.1.smithi117.stdout:6/539: dwrite d1/d3/f50 [0,4194304] 0 2024-09-19T06:40:41.539 INFO:tasks.workunit.client.1.smithi117.stdout:6/540: readlink d1/l43 0 2024-09-19T06:40:41.541 INFO:tasks.workunit.client.1.smithi117.stdout:6/541: write d1/f1d [655340,118785] 0 2024-09-19T06:40:41.541 INFO:tasks.workunit.client.0.smithi099.stdout:7/724: dwrite d7/f3f [0,4194304] 0 2024-09-19T06:40:41.542 INFO:tasks.workunit.client.1.smithi117.stdout:0/676: getdents d11/d13/d1b/d4b 0 2024-09-19T06:40:41.543 INFO:tasks.workunit.client.0.smithi099.stdout:0/562: link d0/db/d13/d1f/d3a/l9e d0/db/d36/d3f/d91/lb6 0 2024-09-19T06:40:41.544 INFO:tasks.workunit.client.0.smithi099.stdout:0/563: chown d0/db/d13/f1e 7822 1 2024-09-19T06:40:41.546 INFO:tasks.workunit.client.0.smithi099.stdout:0/564: stat d0/db/f48 0 2024-09-19T06:40:41.547 INFO:tasks.workunit.client.1.smithi117.stdout:6/542: symlink d1/d5/d8/d27/d77/l97 0 2024-09-19T06:40:41.548 INFO:tasks.workunit.client.0.smithi099.stdout:7/725: write d7/d39/f59 [700612,35651] 0 2024-09-19T06:40:41.548 INFO:tasks.workunit.client.1.smithi117.stdout:9/715: dread d4/d1c/d46/f6b [0,4194304] 0 2024-09-19T06:40:41.551 INFO:tasks.workunit.client.1.smithi117.stdout:6/543: read d1/d3/d25/f78 [1578211,65545] 0 2024-09-19T06:40:41.552 INFO:tasks.workunit.client.1.smithi117.stdout:6/544: write d1/f1d [1383576,7267] 0 2024-09-19T06:40:41.553 INFO:tasks.workunit.client.0.smithi099.stdout:0/565: creat d0/db/d27/fb7 x:0 0 0 2024-09-19T06:40:41.555 INFO:tasks.workunit.client.1.smithi117.stdout:9/716: creat d4/d1c/d73/ff1 x:0 0 0 2024-09-19T06:40:41.556 INFO:tasks.workunit.client.1.smithi117.stdout:9/717: chown d4/d1c/d54/da5/daf/cd9 6265 1 2024-09-19T06:40:41.557 INFO:tasks.workunit.client.0.smithi099.stdout:0/566: creat d0/db/d13/d1f/d4a/fb8 x:0 0 0 2024-09-19T06:40:41.559 INFO:tasks.workunit.client.0.smithi099.stdout:0/567: symlink d0/db/d13/d1f/lb9 0 2024-09-19T06:40:41.560 INFO:tasks.workunit.client.1.smithi117.stdout:6/545: mkdir d1/d5/d8/d5e/d67/d98 0 2024-09-19T06:40:41.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:41 smithi117 ceph-mon[34564]: pgmap v19: 65 pgs: 65 active+clean; 2.8 GiB data, 9.8 GiB used, 527 GiB / 536 GiB avail; 118 MiB/s rd, 401 MiB/s wr, 701 op/s 2024-09-19T06:40:41.562 INFO:tasks.workunit.client.1.smithi117.stdout:6/546: chown d1/d3/f20 41168116 1 2024-09-19T06:40:41.562 INFO:tasks.workunit.client.1.smithi117.stdout:1/658: dread d3/d18/d23/d51/f8b [0,4194304] 0 2024-09-19T06:40:41.562 INFO:tasks.workunit.client.1.smithi117.stdout:9/718: symlink d4/d1c/d54/dd8/dae/lf2 0 2024-09-19T06:40:41.563 INFO:tasks.workunit.client.1.smithi117.stdout:2/728: mknod d0/d12/d32/da4/c10f 0 2024-09-19T06:40:41.564 INFO:tasks.workunit.client.1.smithi117.stdout:1/659: symlink d3/le5 0 2024-09-19T06:40:41.565 INFO:tasks.workunit.client.1.smithi117.stdout:9/719: mknod d4/d1c/d54/dd8/dae/cf3 0 2024-09-19T06:40:41.566 INFO:tasks.workunit.client.1.smithi117.stdout:9/720: dread - d4/d1c/d7a/d52/d8d/dc1/dc6/fec zero size 2024-09-19T06:40:41.567 INFO:tasks.workunit.client.1.smithi117.stdout:6/547: mkdir d1/d5/d8/d99 0 2024-09-19T06:40:41.569 INFO:tasks.workunit.client.1.smithi117.stdout:2/729: rename d0/d7/d1e/d20/f48 to d0/d12/d32/db5/f110 0 2024-09-19T06:40:41.569 INFO:tasks.workunit.client.1.smithi117.stdout:9/721: creat d4/d1c/d36/d37/ff4 x:0 0 0 2024-09-19T06:40:41.570 INFO:tasks.workunit.client.1.smithi117.stdout:9/722: write d4/d1c/d36/fad [2635600,126054] 0 2024-09-19T06:40:41.571 INFO:tasks.workunit.client.1.smithi117.stdout:2/730: read d0/d7/d29/d35/d61/d65/f96 [45085,35592] 0 2024-09-19T06:40:41.573 INFO:tasks.workunit.client.1.smithi117.stdout:9/723: mknod d4/d1c/d7a/d52/cf5 0 2024-09-19T06:40:41.574 INFO:tasks.workunit.client.1.smithi117.stdout:2/731: creat d0/d64/dd9/df0/f111 x:0 0 0 2024-09-19T06:40:41.575 INFO:tasks.workunit.client.1.smithi117.stdout:9/724: symlink d4/d58/lf6 0 2024-09-19T06:40:41.576 INFO:tasks.workunit.client.0.smithi099.stdout:7/726: fsync d7/d39/f59 0 2024-09-19T06:40:41.577 INFO:tasks.workunit.client.1.smithi117.stdout:6/548: dwrite d1/d3/f4b [0,4194304] 0 2024-09-19T06:40:41.577 INFO:tasks.workunit.client.1.smithi117.stdout:2/732: creat d0/d64/dd9/f112 x:0 0 0 2024-09-19T06:40:41.580 INFO:tasks.workunit.client.0.smithi099.stdout:7/727: mknod d7/dcf/d29/d1f/deb/c103 0 2024-09-19T06:40:41.581 INFO:tasks.workunit.client.1.smithi117.stdout:0/677: truncate d11/d13/d14/d16/f4a 1529728 0 2024-09-19T06:40:41.583 INFO:tasks.workunit.client.1.smithi117.stdout:0/678: write d11/d13/d1b/f94 [3409475,15928] 0 2024-09-19T06:40:41.584 INFO:tasks.workunit.client.0.smithi099.stdout:7/728: rename d7/dc7/f7f to d7/dcf/d29/d4e/f104 0 2024-09-19T06:40:41.586 INFO:tasks.workunit.client.1.smithi117.stdout:2/733: read d0/d7/d29/d35/f97 [2791626,13248] 0 2024-09-19T06:40:41.587 INFO:tasks.workunit.client.1.smithi117.stdout:0/679: mkdir d11/d13/d1b/d27/d37/da9/ddc 0 2024-09-19T06:40:41.588 INFO:tasks.workunit.client.1.smithi117.stdout:2/734: write d0/d7/d29/d35/f6a [4646418,49234] 0 2024-09-19T06:40:41.590 INFO:tasks.workunit.client.1.smithi117.stdout:2/735: write d0/d7/d29/d35/d61/d65/fc6 [1044473,54872] 0 2024-09-19T06:40:41.591 INFO:tasks.workunit.client.1.smithi117.stdout:1/660: creat d3/d18/d23/fe6 x:0 0 0 2024-09-19T06:40:41.592 INFO:tasks.workunit.client.1.smithi117.stdout:9/725: write d4/d1c/d7a/d16/f26 [2336838,92118] 0 2024-09-19T06:40:41.594 INFO:tasks.workunit.client.1.smithi117.stdout:0/680: creat d11/d13/d28/fdd x:0 0 0 2024-09-19T06:40:41.596 INFO:tasks.workunit.client.1.smithi117.stdout:0/681: stat d11/d13/d1b/d27/d37/d6d 0 2024-09-19T06:40:41.597 INFO:tasks.workunit.client.1.smithi117.stdout:9/726: creat d4/d1c/d7a/d52/d8d/dc1/dc6/ff7 x:0 0 0 2024-09-19T06:40:41.598 INFO:tasks.workunit.client.1.smithi117.stdout:9/727: fdatasync d4/d8/d6e/da4/fc9 0 2024-09-19T06:40:41.599 INFO:tasks.workunit.client.1.smithi117.stdout:1/661: mknod d3/d22/ce7 0 2024-09-19T06:40:41.600 INFO:tasks.workunit.client.1.smithi117.stdout:9/728: truncate d4/d8/d6e/da4/fc9 706308 0 2024-09-19T06:40:41.600 INFO:tasks.workunit.client.1.smithi117.stdout:6/549: dread d1/d5/d8/d27/d77/f87 [0,4194304] 0 2024-09-19T06:40:41.601 INFO:tasks.workunit.client.1.smithi117.stdout:2/736: write d0/d7/d1e/f41 [4969250,75450] 0 2024-09-19T06:40:41.602 INFO:tasks.workunit.client.0.smithi099.stdout:7/729: dwrite d7/dc7/f68 [0,4194304] 0 2024-09-19T06:40:41.604 INFO:tasks.workunit.client.0.smithi099.stdout:7/730: symlink d7/d39/d7d/l105 0 2024-09-19T06:40:41.606 INFO:tasks.workunit.client.0.smithi099.stdout:7/731: read d7/dcf/d29/f33 [4986573,70733] 0 2024-09-19T06:40:41.609 INFO:tasks.workunit.client.1.smithi117.stdout:9/729: truncate d4/d1c/d36/f6c 5590666 0 2024-09-19T06:40:41.610 INFO:tasks.workunit.client.1.smithi117.stdout:2/737: write d0/d12/f78 [1898440,12404] 0 2024-09-19T06:40:41.610 INFO:tasks.workunit.client.1.smithi117.stdout:9/730: readlink d4/d1c/d73/lbf 0 2024-09-19T06:40:41.611 INFO:tasks.workunit.client.1.smithi117.stdout:2/738: readlink d0/d12/d32/da4/l109 0 2024-09-19T06:40:41.612 INFO:tasks.workunit.client.1.smithi117.stdout:2/739: chown d0/d12/d32/da4/fdc 5850 1 2024-09-19T06:40:41.613 INFO:tasks.workunit.client.1.smithi117.stdout:9/731: symlink d4/d8/d6e/ddb/lf8 0 2024-09-19T06:40:41.613 INFO:tasks.workunit.client.0.smithi099.stdout:7/732: dwrite d7/dcf/d29/d4e/fbc [0,4194304] 0 2024-09-19T06:40:41.614 INFO:tasks.workunit.client.1.smithi117.stdout:9/732: fsync d4/d8/d6a/d82/da3/fdf 0 2024-09-19T06:40:41.614 INFO:tasks.workunit.client.0.smithi099.stdout:7/733: chown d7/dcf/l99 550 1 2024-09-19T06:40:41.616 INFO:tasks.workunit.client.1.smithi117.stdout:9/733: mkdir d4/d1c/d7a/d52/d8d/dc1/df9 0 2024-09-19T06:40:41.617 INFO:tasks.workunit.client.0.smithi099.stdout:7/734: mkdir d7/dc7/d106 0 2024-09-19T06:40:41.622 INFO:tasks.workunit.client.1.smithi117.stdout:9/734: dwrite d4/fa2 [0,4194304] 0 2024-09-19T06:40:41.625 INFO:tasks.workunit.client.0.smithi099.stdout:7/735: dwrite d7/dc7/f65 [0,4194304] 0 2024-09-19T06:40:41.631 INFO:tasks.workunit.client.0.smithi099.stdout:7/736: getdents d7/d39/d7d 0 2024-09-19T06:40:41.634 INFO:tasks.workunit.client.0.smithi099.stdout:7/737: truncate d7/dc7/f9d 86297 0 2024-09-19T06:40:41.653 INFO:tasks.workunit.client.0.smithi099.stdout:7/738: write d7/dcf/d29/f4a [5212727,88364] 0 2024-09-19T06:40:41.656 INFO:tasks.workunit.client.0.smithi099.stdout:7/739: creat d7/dcf/d29/d1f/d45/d48/d63/d75/dd8/df6/f107 x:0 0 0 2024-09-19T06:40:41.658 INFO:tasks.workunit.client.0.smithi099.stdout:7/740: creat d7/dcf/d29/d4e/d53/f108 x:0 0 0 2024-09-19T06:40:41.659 INFO:tasks.workunit.client.1.smithi117.stdout:4/925: sync 2024-09-19T06:40:41.661 INFO:tasks.workunit.client.1.smithi117.stdout:2/740: truncate d0/d64/dd9/f8b 2151178 0 2024-09-19T06:40:41.666 INFO:tasks.workunit.client.1.smithi117.stdout:2/741: dwrite d0/d7/d29/d35/d3d/d72/ff8 [0,4194304] 0 2024-09-19T06:40:41.673 INFO:tasks.workunit.client.1.smithi117.stdout:9/735: creat d4/d1c/ffa x:0 0 0 2024-09-19T06:40:41.674 INFO:tasks.workunit.client.1.smithi117.stdout:9/736: dread - d4/d1c/d54/dd8/fb8 zero size 2024-09-19T06:40:41.675 INFO:tasks.workunit.client.1.smithi117.stdout:2/742: symlink d0/d64/dd9/df0/l113 0 2024-09-19T06:40:41.678 INFO:tasks.workunit.client.1.smithi117.stdout:2/743: mkdir d0/d12/d32/db5/d114 0 2024-09-19T06:40:41.680 INFO:tasks.workunit.client.1.smithi117.stdout:2/744: mkdir d0/d7/d29/d35/dbd/d8d/d115 0 2024-09-19T06:40:41.694 INFO:tasks.workunit.client.1.smithi117.stdout:4/926: rename d3/d1b/d63/d84 to d3/db/d20/d4a/d7b/d12d 0 2024-09-19T06:40:41.698 INFO:tasks.workunit.client.1.smithi117.stdout:4/927: unlink d3/db/d23/f98 0 2024-09-19T06:40:41.711 INFO:tasks.workunit.client.1.smithi117.stdout:2/745: rename d0/d12/d2f to d0/d7/d1e/d20/dbc/d116 0 2024-09-19T06:40:41.712 INFO:tasks.workunit.client.1.smithi117.stdout:9/737: dwrite d4/d1c/d7a/d52/f62 [0,4194304] 0 2024-09-19T06:40:41.715 INFO:tasks.workunit.client.1.smithi117.stdout:2/746: write d0/d7/d29/db0/fc3 [236510,95463] 0 2024-09-19T06:40:41.715 INFO:tasks.workunit.client.1.smithi117.stdout:9/738: fdatasync d4/d1c/f94 0 2024-09-19T06:40:41.718 INFO:tasks.workunit.client.1.smithi117.stdout:9/739: write d4/f19 [411980,110364] 0 2024-09-19T06:40:41.720 INFO:tasks.workunit.client.1.smithi117.stdout:2/747: creat d0/d7/f117 x:0 0 0 2024-09-19T06:40:41.724 INFO:tasks.workunit.client.1.smithi117.stdout:4/928: mknod d3/db/c12e 0 2024-09-19T06:40:41.724 INFO:tasks.workunit.client.1.smithi117.stdout:9/740: dwrite d4/d17/f61 [0,4194304] 0 2024-09-19T06:40:41.726 INFO:tasks.workunit.client.1.smithi117.stdout:2/748: rename d0/d7/d29/d35/d61/d65/fab to d0/d12/d32/db5/d114/f118 0 2024-09-19T06:40:41.731 INFO:tasks.workunit.client.1.smithi117.stdout:2/749: symlink d0/d7/d1e/l119 0 2024-09-19T06:40:41.734 INFO:tasks.workunit.client.1.smithi117.stdout:9/741: link d4/l4a d4/d1c/d5f/dbc/lfb 0 2024-09-19T06:40:41.735 INFO:tasks.workunit.client.1.smithi117.stdout:2/750: mknod d0/d12/d32/c11a 0 2024-09-19T06:40:41.735 INFO:tasks.workunit.client.1.smithi117.stdout:9/742: write d4/d1c/d54/dd8/fcf [915998,105750] 0 2024-09-19T06:40:41.736 INFO:tasks.workunit.client.1.smithi117.stdout:9/743: write d4/d20/fcb [872049,88503] 0 2024-09-19T06:40:41.741 INFO:tasks.workunit.client.1.smithi117.stdout:9/744: creat d4/d1c/d54/dd8/dae/db4/ffc x:0 0 0 2024-09-19T06:40:41.741 INFO:tasks.workunit.client.1.smithi117.stdout:4/929: truncate d3/db/d13/fcd 2223985 0 2024-09-19T06:40:41.742 INFO:tasks.workunit.client.1.smithi117.stdout:2/751: dwrite d0/d12/d32/f9f [4194304,4194304] 0 2024-09-19T06:40:41.743 INFO:tasks.workunit.client.1.smithi117.stdout:9/745: chown d4/d1c/d36/d37/f42 2827162 1 2024-09-19T06:40:41.745 INFO:tasks.workunit.client.1.smithi117.stdout:9/746: chown d4/d1c/d73/d93/c63 0 1 2024-09-19T06:40:41.747 INFO:tasks.workunit.client.1.smithi117.stdout:2/752: mkdir d0/d7/d29/df4/d105/d11b 0 2024-09-19T06:40:41.747 INFO:tasks.workunit.client.1.smithi117.stdout:9/747: symlink d4/d8/d6e/ddb/lfd 0 2024-09-19T06:40:41.752 INFO:tasks.workunit.client.1.smithi117.stdout:2/753: link d0/d7/d1e/f31 d0/d7/d1e/d20/dbc/de6/f11c 0 2024-09-19T06:40:41.755 INFO:tasks.workunit.client.1.smithi117.stdout:2/754: creat d0/d7/d1e/f11d x:0 0 0 2024-09-19T06:40:41.757 INFO:tasks.workunit.client.1.smithi117.stdout:2/755: mknod d0/d7/d29/d35/d61/d65/c11e 0 2024-09-19T06:40:41.759 INFO:tasks.workunit.client.1.smithi117.stdout:4/930: dread d3/d1b/d7d/d51/fba [0,4194304] 0 2024-09-19T06:40:41.760 INFO:tasks.workunit.client.1.smithi117.stdout:4/931: stat d3/d1b/cf5 0 2024-09-19T06:40:41.763 INFO:tasks.workunit.client.1.smithi117.stdout:2/756: dwrite d0/d7/d29/d35/d3d/f9b [0,4194304] 0 2024-09-19T06:40:41.765 INFO:tasks.workunit.client.1.smithi117.stdout:2/757: creat d0/d7/d29/d35/d61/def/f11f x:0 0 0 2024-09-19T06:40:41.768 INFO:tasks.workunit.client.1.smithi117.stdout:2/758: mkdir d0/d7/d29/d35/d61/d65/d120 0 2024-09-19T06:40:41.770 INFO:tasks.workunit.client.1.smithi117.stdout:2/759: creat d0/f121 x:0 0 0 2024-09-19T06:40:41.783 INFO:tasks.workunit.client.1.smithi117.stdout:2/760: dwrite d0/d7/d29/d35/f97 [0,4194304] 0 2024-09-19T06:40:41.785 INFO:tasks.workunit.client.1.smithi117.stdout:4/932: dread d3/db/d20/d29/f31 [0,4194304] 0 2024-09-19T06:40:41.787 INFO:tasks.workunit.client.1.smithi117.stdout:4/933: dread - d3/db/d20/d35/d79/fcb zero size 2024-09-19T06:40:41.789 INFO:tasks.workunit.client.1.smithi117.stdout:2/761: dwrite d0/d64/dd9/fb2 [0,4194304] 0 2024-09-19T06:40:41.789 INFO:tasks.workunit.client.1.smithi117.stdout:4/934: mknod d3/d1b/d63/d8e/c12f 0 2024-09-19T06:40:41.794 INFO:tasks.workunit.client.1.smithi117.stdout:2/762: mknod d0/d7/d29/d35/d61/d65/c122 0 2024-09-19T06:40:41.798 INFO:tasks.workunit.client.1.smithi117.stdout:4/935: write d3/d1b/d7d/f10 [1017391,78997] 0 2024-09-19T06:40:41.798 INFO:tasks.workunit.client.1.smithi117.stdout:2/763: dread d0/d7/d58/db1/fbe [0,4194304] 0 2024-09-19T06:40:41.801 INFO:tasks.workunit.client.1.smithi117.stdout:2/764: write d0/d12/d32/da4/fda [589625,45587] 0 2024-09-19T06:40:41.801 INFO:tasks.workunit.client.1.smithi117.stdout:4/936: symlink d3/d1b/db8/l130 0 2024-09-19T06:40:41.804 INFO:tasks.workunit.client.1.smithi117.stdout:4/937: creat d3/f131 x:0 0 0 2024-09-19T06:40:41.807 INFO:tasks.workunit.client.1.smithi117.stdout:4/938: mknod d3/d1b/c132 0 2024-09-19T06:40:41.809 INFO:tasks.workunit.client.1.smithi117.stdout:2/765: dwrite d0/d7/d1e/d20/dbc/d116/d98/dd2/f108 [0,4194304] 0 2024-09-19T06:40:41.810 INFO:tasks.workunit.client.1.smithi117.stdout:2/766: chown d0/d64/dd9/f112 94833708 1 2024-09-19T06:40:41.811 INFO:tasks.workunit.client.1.smithi117.stdout:4/939: creat d3/d1b/d7d/d9f/d12c/f133 x:0 0 0 2024-09-19T06:40:41.812 INFO:tasks.workunit.client.1.smithi117.stdout:2/767: rmdir d0/d7/d29/d100 39 2024-09-19T06:40:41.817 INFO:tasks.workunit.client.1.smithi117.stdout:2/768: link d0/d7/d29/d35/d61/d65/l7c d0/d7/d29/d35/dbd/l123 0 2024-09-19T06:40:41.818 INFO:tasks.workunit.client.1.smithi117.stdout:4/940: write d3/d41/f89 [1657690,125870] 0 2024-09-19T06:40:41.819 INFO:tasks.workunit.client.1.smithi117.stdout:4/941: chown d3/db/f81 1 1 2024-09-19T06:40:41.820 INFO:tasks.workunit.client.1.smithi117.stdout:4/942: readlink d3/db/d20/d4a/la4 0 2024-09-19T06:40:41.821 INFO:tasks.workunit.client.1.smithi117.stdout:2/769: link d0/d12/d32/c11a d0/d7/d1e/d20/dc9/c124 0 2024-09-19T06:40:41.823 INFO:tasks.workunit.client.1.smithi117.stdout:4/943: chown d3/d4/d5f/cc0 34 1 2024-09-19T06:40:41.823 INFO:tasks.workunit.client.1.smithi117.stdout:2/770: fdatasync d0/d12/f3c 0 2024-09-19T06:40:41.823 INFO:tasks.workunit.client.1.smithi117.stdout:4/944: read - d3/d4/fe2 zero size 2024-09-19T06:40:41.823 INFO:tasks.workunit.client.1.smithi117.stdout:4/945: chown d3/d65/d66/dce/f103 12517 1 2024-09-19T06:40:41.823 INFO:tasks.workunit.client.1.smithi117.stdout:2/771: mknod d0/d7/d58/db1/c125 0 2024-09-19T06:40:41.824 INFO:tasks.workunit.client.1.smithi117.stdout:4/946: dread - d3/d1b/d7d/d51/d95/df4/ffa zero size 2024-09-19T06:40:41.825 INFO:tasks.workunit.client.1.smithi117.stdout:2/772: chown d0/d7/f55 5766775 1 2024-09-19T06:40:41.826 INFO:tasks.workunit.client.1.smithi117.stdout:7/703: sync 2024-09-19T06:40:41.826 INFO:tasks.workunit.client.1.smithi117.stdout:5/782: sync 2024-09-19T06:40:41.826 INFO:tasks.workunit.client.1.smithi117.stdout:8/692: sync 2024-09-19T06:40:41.826 INFO:tasks.workunit.client.1.smithi117.stdout:4/947: dread - d3/db/d20/d35/d79/dd4/fe9 zero size 2024-09-19T06:40:41.828 INFO:tasks.workunit.client.1.smithi117.stdout:4/948: fdatasync d3/db/d20/f11e 0 2024-09-19T06:40:41.828 INFO:tasks.workunit.client.1.smithi117.stdout:2/773: creat d0/d7/d1e/d20/f126 x:0 0 0 2024-09-19T06:40:41.829 INFO:tasks.workunit.client.1.smithi117.stdout:7/704: creat d1/d4a/d81/d24/d1c/d55/ffe x:0 0 0 2024-09-19T06:40:41.830 INFO:tasks.workunit.client.1.smithi117.stdout:5/783: fsync d17/d1b/d3a/d3c/dcb/dde/d65/d88/de5/d3b/f78 0 2024-09-19T06:40:41.833 INFO:tasks.workunit.client.1.smithi117.stdout:8/693: link d1d/d31/fe3 d1d/d2a/d3f/d4b/d66/dac/fe9 0 2024-09-19T06:40:41.834 INFO:tasks.workunit.client.1.smithi117.stdout:8/694: truncate d1d/d31/d83/dad/dc0/fce 86369 0 2024-09-19T06:40:41.835 INFO:tasks.workunit.client.1.smithi117.stdout:4/949: creat d3/d65/d66/d80/dff/f134 x:0 0 0 2024-09-19T06:40:41.838 INFO:tasks.workunit.client.1.smithi117.stdout:8/695: fdatasync d1d/d2a/d3f/d4b/f5b 0 2024-09-19T06:40:41.839 INFO:tasks.workunit.client.1.smithi117.stdout:5/784: fdatasync d17/d1b/d5d/d7d/fa8 0 2024-09-19T06:40:41.841 INFO:tasks.workunit.client.1.smithi117.stdout:4/950: creat d3/db/d20/d4a/d7b/da0/f135 x:0 0 0 2024-09-19T06:40:41.841 INFO:tasks.workunit.client.1.smithi117.stdout:2/774: dwrite d0/d7/d29/d35/d3d/f57 [0,4194304] 0 2024-09-19T06:40:41.842 INFO:tasks.workunit.client.1.smithi117.stdout:5/785: chown d17/d1b/d3a/d3c/d70/lfc 541804 1 2024-09-19T06:40:41.842 INFO:tasks.workunit.client.1.smithi117.stdout:4/951: write d3/d65/d66/dce/f103 [799593,124496] 0 2024-09-19T06:40:41.844 INFO:tasks.workunit.client.1.smithi117.stdout:7/705: truncate d1/d4a/d81/f2a 104725 0 2024-09-19T06:40:41.845 INFO:tasks.workunit.client.0.smithi099.stdout:4/586: sync 2024-09-19T06:40:41.845 INFO:tasks.workunit.client.0.smithi099.stdout:8/437: sync 2024-09-19T06:40:41.845 INFO:tasks.workunit.client.0.smithi099.stdout:2/422: sync 2024-09-19T06:40:41.846 INFO:tasks.workunit.client.1.smithi117.stdout:4/952: read d3/d1b/d63/fa8 [3833678,24934] 0 2024-09-19T06:40:41.846 INFO:tasks.workunit.client.1.smithi117.stdout:5/786: fdatasync f3 0 2024-09-19T06:40:41.846 INFO:tasks.workunit.client.0.smithi099.stdout:2/423: fdatasync d1/d2/d4d/f5e 0 2024-09-19T06:40:41.848 INFO:tasks.workunit.client.0.smithi099.stdout:8/438: mkdir d4/d11/d96 0 2024-09-19T06:40:41.849 INFO:tasks.workunit.client.0.smithi099.stdout:4/587: creat d12/d1b/db1/fc5 x:0 0 0 2024-09-19T06:40:41.849 INFO:tasks.workunit.client.1.smithi117.stdout:2/775: dread d0/d7/d1e/d20/d10a/ddf/f102 [0,4194304] 0 2024-09-19T06:40:41.849 INFO:tasks.workunit.client.1.smithi117.stdout:4/953: dread - d3/d1b/d63/f11b zero size 2024-09-19T06:40:41.854 INFO:tasks.workunit.client.0.smithi099.stdout:2/424: rename d1/d2/d4d/d52 to d1/d2/d5/d8f 0 2024-09-19T06:40:41.854 INFO:tasks.workunit.client.1.smithi117.stdout:4/954: write d3/f90 [1205559,78279] 0 2024-09-19T06:40:41.855 INFO:tasks.workunit.client.0.smithi099.stdout:4/588: mknod d12/d1b/d73/d81/d8a/cc6 0 2024-09-19T06:40:41.857 INFO:tasks.workunit.client.1.smithi117.stdout:7/706: dwrite d1/d4a/d77/f86 [0,4194304] 0 2024-09-19T06:40:41.857 INFO:tasks.workunit.client.0.smithi099.stdout:8/439: rename d4/de/d14/c22 to d4/de/d26/d2b/c97 0 2024-09-19T06:40:41.857 INFO:tasks.workunit.client.1.smithi117.stdout:5/787: symlink d17/d1b/d3a/d3c/dcb/dde/d65/d88/de5/d6a/l104 0 2024-09-19T06:40:41.858 INFO:tasks.workunit.client.1.smithi117.stdout:2/776: unlink d0/d12/d32/c73 0 2024-09-19T06:40:41.860 INFO:tasks.workunit.client.0.smithi099.stdout:8/440: rmdir d4/d11/d23/d4c/d93 39 2024-09-19T06:40:41.862 INFO:tasks.workunit.client.0.smithi099.stdout:4/589: dwrite d12/d32/f61 [0,4194304] 0 2024-09-19T06:40:41.862 INFO:tasks.workunit.client.1.smithi117.stdout:8/696: dwrite d1d/d1e/d53/f7a [0,4194304] 0 2024-09-19T06:40:41.862 INFO:tasks.workunit.client.1.smithi117.stdout:4/955: creat d3/d4/d14/f136 x:0 0 0 2024-09-19T06:40:41.866 INFO:tasks.workunit.client.1.smithi117.stdout:2/777: mknod d0/d7/d1e/d20/d10a/ddf/c127 0 2024-09-19T06:40:41.866 INFO:tasks.workunit.client.1.smithi117.stdout:8/697: write d1d/d2a/f2f [2114879,29081] 0 2024-09-19T06:40:41.866 INFO:tasks.workunit.client.0.smithi099.stdout:2/425: creat d1/d2/f90 x:0 0 0 2024-09-19T06:40:41.868 INFO:tasks.workunit.client.0.smithi099.stdout:4/590: unlink d12/d32/d42/f56 0 2024-09-19T06:40:41.873 INFO:tasks.workunit.client.1.smithi117.stdout:2/778: rename d0/f2b to d0/d12/d32/db5/d114/f128 0 2024-09-19T06:40:41.877 INFO:tasks.workunit.client.0.smithi099.stdout:4/591: dwrite d12/d32/f4c [0,4194304] 0 2024-09-19T06:40:41.877 INFO:tasks.workunit.client.1.smithi117.stdout:4/956: dwrite d3/d65/d66/dce/fda [0,4194304] 0 2024-09-19T06:40:41.878 INFO:tasks.workunit.client.1.smithi117.stdout:2/779: write d0/d64/dd9/fcd [5166,107805] 0 2024-09-19T06:40:41.879 INFO:tasks.workunit.client.1.smithi117.stdout:7/707: dwrite d1/d4a/d81/d48/d5f/d82/fc3 [0,4194304] 0 2024-09-19T06:40:41.879 INFO:tasks.workunit.client.1.smithi117.stdout:8/698: rename d1d/d31/f36 to d1d/d2a/d3f/d73/fea 0 2024-09-19T06:40:41.880 INFO:tasks.workunit.client.0.smithi099.stdout:4/592: mkdir d12/d1b/d73/d81/d8a/da9/dc7 0 2024-09-19T06:40:41.885 INFO:tasks.workunit.client.1.smithi117.stdout:8/699: creat d1d/d2a/d3f/d73/feb x:0 0 0 2024-09-19T06:40:41.889 INFO:tasks.workunit.client.0.smithi099.stdout:8/441: truncate d4/de/f12 1220651 0 2024-09-19T06:40:41.891 INFO:tasks.workunit.client.1.smithi117.stdout:4/957: dwrite d3/db/d20/f11e [0,4194304] 0 2024-09-19T06:40:41.898 INFO:tasks.workunit.client.0.smithi099.stdout:8/442: dread d4/d11/d23/f31 [0,4194304] 0 2024-09-19T06:40:41.899 INFO:tasks.workunit.client.0.smithi099.stdout:8/443: mknod d4/d11/d23/d3f/c98 0 2024-09-19T06:40:41.900 INFO:tasks.workunit.client.0.smithi099.stdout:8/444: read d4/d11/d38/f3c [862651,14660] 0 2024-09-19T06:40:41.902 INFO:tasks.workunit.client.0.smithi099.stdout:8/445: mkdir d4/de/d1c/d99 0 2024-09-19T06:40:41.905 INFO:tasks.workunit.client.0.smithi099.stdout:8/446: rename d4/de/d10/f29 to d4/d11/d23/f9a 0 2024-09-19T06:40:41.907 INFO:tasks.workunit.client.0.smithi099.stdout:8/447: creat d4/d11/d38/f9b x:0 0 0 2024-09-19T06:40:41.907 INFO:tasks.workunit.client.0.smithi099.stdout:8/448: chown d4/de/d14/c19 995752 1 2024-09-19T06:40:41.908 INFO:tasks.workunit.client.0.smithi099.stdout:8/449: write d4/d11/d38/f67 [467894,99430] 0 2024-09-19T06:40:41.909 INFO:tasks.workunit.client.0.smithi099.stdout:8/450: chown d4/d11/d23/d3f/c63 16 1 2024-09-19T06:40:41.910 INFO:tasks.workunit.client.1.smithi117.stdout:7/708: dread d1/d4a/d81/d24/d1c/f28 [0,4194304] 0 2024-09-19T06:40:41.910 INFO:tasks.workunit.client.1.smithi117.stdout:7/709: write d1/d4a/d81/f84 [4515286,12652] 0 2024-09-19T06:40:41.910 INFO:tasks.workunit.client.0.smithi099.stdout:8/451: creat d4/de/d10/f9c x:0 0 0 2024-09-19T06:40:41.912 INFO:tasks.workunit.client.0.smithi099.stdout:8/452: mknod d4/de/d26/d2b/c9d 0 2024-09-19T06:40:41.914 INFO:tasks.workunit.client.0.smithi099.stdout:8/453: symlink d4/de/d14/l9e 0 2024-09-19T06:40:41.915 INFO:tasks.workunit.client.0.smithi099.stdout:8/454: creat d4/d11/d23/d3f/f9f x:0 0 0 2024-09-19T06:40:41.916 INFO:tasks.workunit.client.0.smithi099.stdout:8/455: readlink d4/de/l81 0 2024-09-19T06:40:41.917 INFO:tasks.workunit.client.0.smithi099.stdout:8/456: fdatasync d4/f5b 0 2024-09-19T06:40:41.917 INFO:tasks.workunit.client.1.smithi117.stdout:7/710: dwrite d1/d4a/d81/d24/d1c/f46 [0,4194304] 0 2024-09-19T06:40:41.919 INFO:tasks.workunit.client.0.smithi099.stdout:4/593: write d12/d32/f27 [1330006,18368] 0 2024-09-19T06:40:41.921 INFO:tasks.workunit.client.0.smithi099.stdout:8/457: creat d4/de/fa0 x:0 0 0 2024-09-19T06:40:41.923 INFO:tasks.workunit.client.0.smithi099.stdout:4/594: rmdir d12/d32/d42 39 2024-09-19T06:40:41.924 INFO:tasks.workunit.client.0.smithi099.stdout:4/595: write d12/d1b/f44 [4252971,19903] 0 2024-09-19T06:40:41.925 INFO:tasks.workunit.client.0.smithi099.stdout:8/458: rename d4/de/d14/l1e to d4/de/d26/d2b/la1 0 2024-09-19T06:40:41.927 INFO:tasks.workunit.client.0.smithi099.stdout:8/459: rmdir d4/d11/d38 39 2024-09-19T06:40:41.930 INFO:tasks.workunit.client.0.smithi099.stdout:8/460: rename d4/d5e/f6c to d4/de/d1c/d99/fa2 0 2024-09-19T06:40:41.931 INFO:tasks.workunit.client.0.smithi099.stdout:4/596: getdents d12/d1b/d73/d81/d8a/da9 0 2024-09-19T06:40:41.931 INFO:tasks.workunit.client.0.smithi099.stdout:4/597: stat d12/l84 0 2024-09-19T06:40:41.932 INFO:tasks.workunit.client.0.smithi099.stdout:8/461: chown d4/d11/d23/f9a 2956 1 2024-09-19T06:40:41.935 INFO:tasks.workunit.client.0.smithi099.stdout:4/598: symlink d12/d1b/d73/d81/d8a/da9/lc8 0 2024-09-19T06:40:41.936 INFO:tasks.workunit.client.0.smithi099.stdout:4/599: chown d12/l17 2586 1 2024-09-19T06:40:41.939 INFO:tasks.workunit.client.1.smithi117.stdout:3/746: sync 2024-09-19T06:40:41.939 INFO:tasks.workunit.client.0.smithi099.stdout:4/600: rename d12/d32/d42/d5c/f31 to d12/d1b/db1/fc9 0 2024-09-19T06:40:41.939 INFO:tasks.workunit.client.1.smithi117.stdout:3/747: chown d0/d9/d4e/d9e/fa4 80 1 2024-09-19T06:40:41.941 INFO:tasks.workunit.client.0.smithi099.stdout:4/601: rename d12/d1b/d73/f7a to d12/d1b/d88/fca 0 2024-09-19T06:40:41.947 INFO:tasks.workunit.client.0.smithi099.stdout:8/462: dread d4/de/d10/f24 [4194304,4194304] 0 2024-09-19T06:40:41.947 INFO:tasks.workunit.client.0.smithi099.stdout:4/602: write d12/d1b/da4/faf [690230,127654] 0 2024-09-19T06:40:41.948 INFO:tasks.workunit.client.0.smithi099.stdout:4/603: write d12/f1a [3659752,38225] 0 2024-09-19T06:40:41.949 INFO:tasks.workunit.client.0.smithi099.stdout:4/604: fdatasync d12/d32/f27 0 2024-09-19T06:40:41.950 INFO:tasks.workunit.client.0.smithi099.stdout:4/605: readlink d12/d1b/l92 0 2024-09-19T06:40:41.950 INFO:tasks.workunit.client.0.smithi099.stdout:8/463: truncate d4/d11/d38/f3c 611340 0 2024-09-19T06:40:41.952 INFO:tasks.workunit.client.0.smithi099.stdout:8/464: mknod d4/d11/d61/ca3 0 2024-09-19T06:40:41.953 INFO:tasks.workunit.client.0.smithi099.stdout:4/606: mkdir d12/d1b/d73/d81/dcb 0 2024-09-19T06:40:41.955 INFO:tasks.workunit.client.0.smithi099.stdout:4/607: creat d12/d32/d42/d5c/d51/fcc x:0 0 0 2024-09-19T06:40:41.958 INFO:tasks.workunit.client.0.smithi099.stdout:8/465: link d4/d11/f21 d4/d11/d23/d92/fa4 0 2024-09-19T06:40:41.959 INFO:tasks.workunit.client.0.smithi099.stdout:4/608: creat d12/d32/d42/fcd x:0 0 0 2024-09-19T06:40:41.960 INFO:tasks.workunit.client.0.smithi099.stdout:4/609: fsync d12/d32/f4c 0 2024-09-19T06:40:41.961 INFO:tasks.workunit.client.0.smithi099.stdout:4/610: read d12/d1b/d73/d81/d9b/fb0 [4191668,74910] 0 2024-09-19T06:40:41.964 INFO:tasks.workunit.client.0.smithi099.stdout:4/611: mknod d12/d1b/da4/cce 0 2024-09-19T06:40:41.969 INFO:tasks.workunit.client.1.smithi117.stdout:9/748: sync 2024-09-19T06:40:41.969 INFO:tasks.workunit.client.1.smithi117.stdout:0/682: sync 2024-09-19T06:40:41.969 INFO:tasks.workunit.client.1.smithi117.stdout:6/550: sync 2024-09-19T06:40:41.970 INFO:tasks.workunit.client.1.smithi117.stdout:1/662: sync 2024-09-19T06:40:41.970 INFO:tasks.workunit.client.1.smithi117.stdout:5/788: sync 2024-09-19T06:40:41.972 INFO:tasks.workunit.client.1.smithi117.stdout:6/551: write d1/d3/f86 [282095,22568] 0 2024-09-19T06:40:41.972 INFO:tasks.workunit.client.1.smithi117.stdout:5/789: chown d17/d1b/d3a/d3c/dcb/dde/d65/d88/dd0 72202727 1 2024-09-19T06:40:41.978 INFO:tasks.workunit.client.0.smithi099.stdout:8/466: dread d4/de/d10/f24 [0,4194304] 0 2024-09-19T06:40:41.980 INFO:tasks.workunit.client.0.smithi099.stdout:8/467: rename d4/de/f12 to d4/de/d26/fa5 0 2024-09-19T06:40:41.982 INFO:tasks.workunit.client.0.smithi099.stdout:8/468: creat d4/de/d14/fa6 x:0 0 0 2024-09-19T06:40:41.984 INFO:tasks.workunit.client.0.smithi099.stdout:8/469: creat d4/d11/d23/d4c/fa7 x:0 0 0 2024-09-19T06:40:41.985 INFO:tasks.workunit.client.0.smithi099.stdout:8/470: write d4/d66/f71 [931013,5314] 0 2024-09-19T06:40:41.986 INFO:tasks.workunit.client.0.smithi099.stdout:8/471: fdatasync d4/d11/d23/d4c/d93/f94 0 2024-09-19T06:40:41.992 INFO:tasks.workunit.client.0.smithi099.stdout:8/472: truncate d4/d66/f76 1009774 0 2024-09-19T06:40:41.992 INFO:tasks.workunit.client.0.smithi099.stdout:8/473: write d4/d66/f71 [1655587,119414] 0 2024-09-19T06:40:41.995 INFO:tasks.workunit.client.0.smithi099.stdout:8/474: link d4/d11/d38/f9b d4/de/fa8 0 2024-09-19T06:40:41.997 INFO:tasks.workunit.client.0.smithi099.stdout:8/475: fsync d4/d11/d23/d4c/f69 0 2024-09-19T06:40:41.999 INFO:tasks.workunit.client.0.smithi099.stdout:8/476: write d4/de/d1c/f1d [1772271,106440] 0 2024-09-19T06:40:42.000 INFO:tasks.workunit.client.0.smithi099.stdout:8/477: truncate d4/de/d14/fa6 535536 0 2024-09-19T06:40:42.002 INFO:tasks.workunit.client.0.smithi099.stdout:8/478: read d4/de/d26/f28 [1646885,81707] 0 2024-09-19T06:40:42.004 INFO:tasks.workunit.client.0.smithi099.stdout:8/479: symlink d4/d11/la9 0 2024-09-19T06:40:42.004 INFO:tasks.workunit.client.1.smithi117.stdout:8/700: symlink d1d/d2a/d3f/d4b/d91/lec 0 2024-09-19T06:40:42.004 INFO:tasks.workunit.client.1.smithi117.stdout:4/958: rmdir d3/d41 39 2024-09-19T06:40:42.008 INFO:tasks.workunit.client.0.smithi099.stdout:8/480: read - d4/de/d14/f65 zero size 2024-09-19T06:40:42.009 INFO:tasks.workunit.client.1.smithi117.stdout:0/683: chown d11/d13/d14/d2c/d53/d7e/l9f 25 1 2024-09-19T06:40:42.009 INFO:tasks.workunit.client.1.smithi117.stdout:6/552: rmdir d1/d3/d25 39 2024-09-19T06:40:42.011 INFO:tasks.workunit.client.1.smithi117.stdout:9/749: rename d4/d1c/f1f to d4/d8/d6e/ffe 0 2024-09-19T06:40:42.011 INFO:tasks.workunit.client.1.smithi117.stdout:0/684: truncate d11/d13/d1b/d27/d37/d6d/fba 212236 0 2024-09-19T06:40:42.012 INFO:tasks.workunit.client.1.smithi117.stdout:2/780: mkdir d0/d7/d29/df4/d105/d11b/d129 0 2024-09-19T06:40:42.012 INFO:tasks.workunit.client.1.smithi117.stdout:8/701: mknod d1d/d31/d83/dad/dc0/ced 0 2024-09-19T06:40:42.014 INFO:tasks.workunit.client.1.smithi117.stdout:4/959: creat d3/db/d20/d4a/d7b/da0/f137 x:0 0 0 2024-09-19T06:40:42.015 INFO:tasks.workunit.client.1.smithi117.stdout:1/663: creat d3/da1/db1/fe8 x:0 0 0 2024-09-19T06:40:42.016 INFO:tasks.workunit.client.1.smithi117.stdout:2/781: truncate d0/d7/d58/fd3 530826 0 2024-09-19T06:40:42.017 INFO:tasks.workunit.client.1.smithi117.stdout:1/664: write d3/d18/d23/d74/d89/d9f/fdf [63573,96266] 0 2024-09-19T06:40:42.017 INFO:tasks.workunit.client.1.smithi117.stdout:5/790: rename d17/d1b/d3a/d3c/dcb/dde/d55/cac to d17/d1b/d3a/d3c/dcb/c105 0 2024-09-19T06:40:42.019 INFO:tasks.workunit.client.1.smithi117.stdout:9/750: creat d4/d1c/d73/d93/fff x:0 0 0 2024-09-19T06:40:42.020 INFO:tasks.workunit.client.1.smithi117.stdout:3/748: creat d0/d9/ff2 x:0 0 0 2024-09-19T06:40:42.021 INFO:tasks.workunit.client.1.smithi117.stdout:5/791: write d17/f76 [4340936,64997] 0 2024-09-19T06:40:42.022 INFO:tasks.workunit.client.1.smithi117.stdout:8/702: fdatasync d1d/d2a/d3f/d73/ddd/f2b 0 2024-09-19T06:40:42.024 INFO:tasks.workunit.client.1.smithi117.stdout:0/685: rename d11/d13/d28/d38/f56 to d11/d13/d1b/d27/d37/da9/fde 0 2024-09-19T06:40:42.025 INFO:tasks.workunit.client.1.smithi117.stdout:1/665: readlink d3/d8e/la3 0 2024-09-19T06:40:42.027 INFO:tasks.workunit.client.0.smithi099.stdout:8/481: rmdir d4/d11/d96 0 2024-09-19T06:40:42.027 INFO:tasks.workunit.client.0.smithi099.stdout:8/482: fdatasync d4/f5b 0 2024-09-19T06:40:42.028 INFO:tasks.workunit.client.1.smithi117.stdout:7/711: dread d1/d4a/d81/d24/d1c/f80 [0,4194304] 0 2024-09-19T06:40:42.029 INFO:tasks.workunit.client.0.smithi099.stdout:8/483: chown d4/de/d14/c6a 127053617 1 2024-09-19T06:40:42.029 INFO:tasks.workunit.client.1.smithi117.stdout:2/782: dwrite d0/d7/d1e/d20/f44 [4194304,4194304] 0 2024-09-19T06:40:42.029 INFO:tasks.workunit.client.1.smithi117.stdout:5/792: dread d17/d1b/d3a/d3c/d46/f91 [0,4194304] 0 2024-09-19T06:40:42.031 INFO:tasks.workunit.client.1.smithi117.stdout:7/712: stat d1/d4a/d81/d24/d49 0 2024-09-19T06:40:42.032 INFO:tasks.workunit.client.0.smithi099.stdout:8/484: rename d4/d11/d38/f67 to d4/d11/d38/faa 0 2024-09-19T06:40:42.032 INFO:tasks.workunit.client.1.smithi117.stdout:4/960: write d3/d1b/d63/fa8 [2733375,24087] 0 2024-09-19T06:40:42.034 INFO:tasks.workunit.client.1.smithi117.stdout:7/713: dread - d1/d4a/d7c/fcd zero size 2024-09-19T06:40:42.034 INFO:tasks.workunit.client.1.smithi117.stdout:9/751: mkdir d4/d17/dd7/d100 0 2024-09-19T06:40:42.034 INFO:tasks.workunit.client.1.smithi117.stdout:6/553: write d1/d5/f56 [4682646,32178] 0 2024-09-19T06:40:42.034 INFO:tasks.workunit.client.0.smithi099.stdout:8/485: write d4/d11/d23/f3b [2968816,83477] 0 2024-09-19T06:40:42.035 INFO:tasks.workunit.client.1.smithi117.stdout:1/666: symlink d3/da1/le9 0 2024-09-19T06:40:42.036 INFO:tasks.workunit.client.0.smithi099.stdout:8/486: write d4/d11/d23/d3f/f55 [2523814,52171] 0 2024-09-19T06:40:42.036 INFO:tasks.workunit.client.1.smithi117.stdout:0/686: truncate d11/d13/d14/d2c/d35/d3e/f62 477749 0 2024-09-19T06:40:42.037 INFO:tasks.workunit.client.1.smithi117.stdout:1/667: fsync d3/d18/d23/f6b 0 2024-09-19T06:40:42.038 INFO:tasks.workunit.client.1.smithi117.stdout:1/668: write d3/d18/d56/fbf [484618,110099] 0 2024-09-19T06:40:42.040 INFO:tasks.workunit.client.1.smithi117.stdout:1/669: fdatasync d3/d18/d23/d51/fa6 0 2024-09-19T06:40:42.040 INFO:tasks.workunit.client.1.smithi117.stdout:4/961: chown d3/d28/d2a/f9b 16252 1 2024-09-19T06:40:42.041 INFO:tasks.workunit.client.1.smithi117.stdout:5/793: truncate d17/d1b/d3a/f73 1176932 0 2024-09-19T06:40:42.045 INFO:tasks.workunit.client.1.smithi117.stdout:0/687: unlink d11/d13/d14/d2c/d64/fc9 0 2024-09-19T06:40:42.047 INFO:tasks.workunit.client.1.smithi117.stdout:8/703: link d1d/d1e/f70 d1d/d1e/fee 0 2024-09-19T06:40:42.048 INFO:tasks.workunit.client.1.smithi117.stdout:2/783: mknod d0/d7/d29/df4/d105/d11b/d129/c12a 0 2024-09-19T06:40:42.048 INFO:tasks.workunit.client.1.smithi117.stdout:3/749: dread d0/d3d/d48/dd0/fd7 [0,4194304] 0 2024-09-19T06:40:42.049 INFO:tasks.workunit.client.0.smithi099.stdout:3/763: sync 2024-09-19T06:40:42.050 INFO:tasks.workunit.client.1.smithi117.stdout:1/670: mknod d3/d8e/cea 0 2024-09-19T06:40:42.051 INFO:tasks.workunit.client.1.smithi117.stdout:5/794: dwrite d17/d1b/d3a/d3c/dcb/dde/d65/d88/de5/d6a/ff6 [0,4194304] 0 2024-09-19T06:40:42.052 INFO:tasks.workunit.client.0.smithi099.stdout:8/487: truncate d4/de/d26/d2b/f58 2859223 0 2024-09-19T06:40:42.053 INFO:tasks.workunit.client.1.smithi117.stdout:5/795: stat d17/d1b/d5d/d7d/fa8 0 2024-09-19T06:40:42.053 INFO:tasks.workunit.client.0.smithi099.stdout:8/488: chown d4/f30 4 1 2024-09-19T06:40:42.054 INFO:tasks.workunit.client.0.smithi099.stdout:3/764: dread d7/d34/f51 [0,4194304] 0 2024-09-19T06:40:42.056 INFO:tasks.workunit.client.0.smithi099.stdout:3/765: creat d7/d34/d1d/d36/d69/d96/fe8 x:0 0 0 2024-09-19T06:40:42.058 INFO:tasks.workunit.client.1.smithi117.stdout:8/704: chown d1d/d2a/d3f/d4b/d5f/dbf/dd0/ld5 11 1 2024-09-19T06:40:42.059 INFO:tasks.workunit.client.0.smithi099.stdout:3/766: read - d7/d34/d1d/d36/d69/d96/fe8 zero size 2024-09-19T06:40:42.059 INFO:tasks.workunit.client.1.smithi117.stdout:9/752: dwrite d4/d8/f31 [0,4194304] 0 2024-09-19T06:40:42.061 INFO:tasks.workunit.client.1.smithi117.stdout:9/753: dread - d4/d1c/d46/f88 zero size 2024-09-19T06:40:42.061 INFO:tasks.workunit.client.1.smithi117.stdout:4/962: link d3/d1b/d7d/f12 d3/db/d20/d35/d79/f138 0 2024-09-19T06:40:42.062 INFO:tasks.workunit.client.0.smithi099.stdout:8/489: dwrite d4/d11/d23/d3f/f9f [0,4194304] 0 2024-09-19T06:40:42.064 INFO:tasks.workunit.client.1.smithi117.stdout:2/784: truncate d0/d7/d1e/d20/f7b 1714230 0 2024-09-19T06:40:42.064 INFO:tasks.workunit.client.1.smithi117.stdout:9/754: truncate d4/d1c/d5f/dbc/fed 216524 0 2024-09-19T06:40:42.066 INFO:tasks.workunit.client.1.smithi117.stdout:3/750: truncate d0/d8/d7f/d40/dc4/f43 5823175 0 2024-09-19T06:40:42.067 INFO:tasks.workunit.client.1.smithi117.stdout:3/751: chown d0/d3d 441228 1 2024-09-19T06:40:42.068 INFO:tasks.workunit.client.1.smithi117.stdout:7/714: link d1/d4a/d77/lad d1/d4a/d81/d24/d1c/d55/lff 0 2024-09-19T06:40:42.070 INFO:tasks.workunit.client.1.smithi117.stdout:8/705: creat d1d/d1e/d53/fef x:0 0 0 2024-09-19T06:40:42.072 INFO:tasks.workunit.client.1.smithi117.stdout:4/963: mknod d3/d65/d66/c139 0 2024-09-19T06:40:42.072 INFO:tasks.workunit.client.1.smithi117.stdout:4/964: chown d3/d1b/d7d/f4b 49325959 1 2024-09-19T06:40:42.073 INFO:tasks.workunit.client.1.smithi117.stdout:9/755: truncate d4/d1c/d36/f7d 4124686 0 2024-09-19T06:40:42.073 INFO:tasks.workunit.client.1.smithi117.stdout:4/965: write d3/d4/f40 [74274,72172] 0 2024-09-19T06:40:42.074 INFO:tasks.workunit.client.1.smithi117.stdout:2/785: symlink d0/d7/d29/df4/d105/l12b 0 2024-09-19T06:40:42.075 INFO:tasks.workunit.client.1.smithi117.stdout:6/554: rename d1/d3/d25/d5c to d1/d5/d9a 0 2024-09-19T06:40:42.076 INFO:tasks.workunit.client.1.smithi117.stdout:7/715: chown d1/c2e 9597 1 2024-09-19T06:40:42.076 INFO:tasks.workunit.client.1.smithi117.stdout:6/555: dread - d1/d5/d8/d5e/f96 zero size 2024-09-19T06:40:42.077 INFO:tasks.workunit.client.1.smithi117.stdout:0/688: link d11/d13/d1b/d27/d37/d6d/f95 d11/d13/d1b/d27/fdf 0 2024-09-19T06:40:42.078 INFO:tasks.workunit.client.1.smithi117.stdout:1/671: creat d3/feb x:0 0 0 2024-09-19T06:40:42.078 INFO:tasks.workunit.client.1.smithi117.stdout:6/556: truncate d1/d5/d8/f5d 5039465 0 2024-09-19T06:40:42.079 INFO:tasks.workunit.client.1.smithi117.stdout:8/706: mknod d1d/d2a/d3f/d4b/d66/dac/cf0 0 2024-09-19T06:40:42.080 INFO:tasks.workunit.client.1.smithi117.stdout:3/752: readlink d0/d9/d1c/l4b 0 2024-09-19T06:40:42.080 INFO:tasks.workunit.client.1.smithi117.stdout:2/786: rmdir d0/d7/d29/df4 39 2024-09-19T06:40:42.081 INFO:tasks.workunit.client.1.smithi117.stdout:3/753: fdatasync d0/d3d/f4f 0 2024-09-19T06:40:42.082 INFO:tasks.workunit.client.1.smithi117.stdout:5/796: rename f1 to d17/d5c/f106 0 2024-09-19T06:40:42.082 INFO:tasks.workunit.client.1.smithi117.stdout:7/716: mkdir d1/d72/d100 0 2024-09-19T06:40:42.083 INFO:tasks.workunit.client.1.smithi117.stdout:0/689: symlink d11/d13/d14/dbd/le0 0 2024-09-19T06:40:42.083 INFO:tasks.workunit.client.1.smithi117.stdout:2/787: dread d0/d64/dd9/fcd [0,4194304] 0 2024-09-19T06:40:42.084 INFO:tasks.workunit.client.1.smithi117.stdout:8/707: mknod d1d/d2a/d3f/d4b/d5f/dbf/dd0/db9/cf1 0 2024-09-19T06:40:42.084 INFO:tasks.workunit.client.1.smithi117.stdout:6/557: chown d1/d5/d9a/c81 1799 1 2024-09-19T06:40:42.085 INFO:tasks.workunit.client.1.smithi117.stdout:1/672: rmdir d3/da1/dcc 39 2024-09-19T06:40:42.086 INFO:tasks.workunit.client.1.smithi117.stdout:7/717: mknod d1/d4a/d7c/c101 0 2024-09-19T06:40:42.087 INFO:tasks.workunit.client.1.smithi117.stdout:5/797: fsync d17/d1b/d3a/d3c/dcb/dde/d55/f98 0 2024-09-19T06:40:42.089 INFO:tasks.workunit.client.1.smithi117.stdout:0/690: dread d11/d13/d14/f6b [0,4194304] 0 2024-09-19T06:40:42.090 INFO:tasks.workunit.client.1.smithi117.stdout:0/691: dread - d11/d13/d14/d2c/d64/fc3 zero size 2024-09-19T06:40:42.092 INFO:tasks.workunit.client.1.smithi117.stdout:2/788: read d0/d7/d29/d35/d3d/f43 [998733,61942] 0 2024-09-19T06:40:42.092 INFO:tasks.workunit.client.1.smithi117.stdout:2/789: dread - d0/f121 zero size 2024-09-19T06:40:42.092 INFO:tasks.workunit.client.1.smithi117.stdout:6/558: symlink d1/d5/d8/d5e/d67/l9b 0 2024-09-19T06:40:42.093 INFO:tasks.workunit.client.1.smithi117.stdout:1/673: chown d3/d18/d23/f65 1891 1 2024-09-19T06:40:42.094 INFO:tasks.workunit.client.1.smithi117.stdout:9/756: link d4/d17/f76 d4/d8/d6a/d82/f101 0 2024-09-19T06:40:42.095 INFO:tasks.workunit.client.1.smithi117.stdout:9/757: write d4/d1c/d7a/d52/f85 [155330,68277] 0 2024-09-19T06:40:42.096 INFO:tasks.workunit.client.1.smithi117.stdout:7/718: creat d1/d4a/d81/d24/d49/f102 x:0 0 0 2024-09-19T06:40:42.097 INFO:tasks.workunit.client.1.smithi117.stdout:5/798: symlink d17/d1b/d3a/d3c/dcb/dde/d55/dd1/l107 0 2024-09-19T06:40:42.098 INFO:tasks.workunit.client.1.smithi117.stdout:5/799: chown d17/d1b/d3a/d3c/dcb/dde/d65/d88/de5/l101 1623505322 1 2024-09-19T06:40:42.101 INFO:tasks.workunit.client.1.smithi117.stdout:6/559: symlink d1/d5/d9a/l9c 0 2024-09-19T06:40:42.104 INFO:tasks.workunit.client.1.smithi117.stdout:9/758: mknod d4/d1c/d54/dd8/c102 0 2024-09-19T06:40:42.105 INFO:tasks.workunit.client.1.smithi117.stdout:7/719: symlink d1/d4a/d7c/dbc/l103 0 2024-09-19T06:40:42.106 INFO:tasks.workunit.client.1.smithi117.stdout:0/692: mknod d11/ce1 0 2024-09-19T06:40:42.109 INFO:tasks.workunit.client.1.smithi117.stdout:5/800: rename d17/d1b/d3a/d3c/dcb/dde/lb5 to d17/d1b/d3a/d3c/dcb/dde/d65/d88/de5/d3b/l108 0 2024-09-19T06:40:42.111 INFO:tasks.workunit.client.1.smithi117.stdout:1/674: truncate d3/f38 2710188 0 2024-09-19T06:40:42.111 INFO:tasks.workunit.client.1.smithi117.stdout:5/801: truncate d17/d1b/d3a/d3c/dcb/dde/d65/d88/de5/d6a/f75 4990659 0 2024-09-19T06:40:42.111 INFO:tasks.workunit.client.1.smithi117.stdout:9/759: mkdir d4/d1c/d5f/d103 0 2024-09-19T06:40:42.112 INFO:tasks.workunit.client.1.smithi117.stdout:7/720: stat d1/d4a/d81/d24/d26/d44/f68 0 2024-09-19T06:40:42.113 INFO:tasks.workunit.client.1.smithi117.stdout:9/760: write d4/d1c/d7a/d52/f62 [2021725,18344] 0 2024-09-19T06:40:42.113 INFO:tasks.workunit.client.1.smithi117.stdout:0/693: creat d11/d13/d14/d2c/d64/fe2 x:0 0 0 2024-09-19T06:40:42.115 INFO:tasks.workunit.client.1.smithi117.stdout:9/761: chown d4/f19 1603788091 1 2024-09-19T06:40:42.116 INFO:tasks.workunit.client.1.smithi117.stdout:4/966: truncate d3/d41/f89 474907 0 2024-09-19T06:40:42.119 INFO:tasks.workunit.client.1.smithi117.stdout:6/560: link d1/d5/d32/d45/l72 d1/d3d/d6f/l9d 0 2024-09-19T06:40:42.121 INFO:tasks.workunit.client.1.smithi117.stdout:6/561: chown d1/d5/d8/d5e 205629 1 2024-09-19T06:40:42.122 INFO:tasks.workunit.client.1.smithi117.stdout:9/762: truncate d4/d1c/d7a/d52/f3c 4639674 0 2024-09-19T06:40:42.122 INFO:tasks.workunit.client.1.smithi117.stdout:5/802: dwrite d17/d1b/d5d/fc9 [0,4194304] 0 2024-09-19T06:40:42.122 INFO:tasks.workunit.client.1.smithi117.stdout:1/675: symlink d3/d22/lec 0 2024-09-19T06:40:42.126 INFO:tasks.workunit.client.1.smithi117.stdout:7/721: dwrite d1/d4a/d81/d48/d5f/d82/fa9 [0,4194304] 0 2024-09-19T06:40:42.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.124+0000 7f3c3bdcd640 1 -- 172.21.15.99:0/3876881893 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3c34102b60 msgr2=0x7f3c34102f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:42.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.124+0000 7f3c3bdcd640 1 --2- 172.21.15.99:0/3876881893 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3c34102b60 0x7f3c34102f70 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3c30009c50 tx=0x7f3c30004d10 comp rx=0 tx=0).stop 2024-09-19T06:40:42.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.124+0000 7f3c3bdcd640 1 -- 172.21.15.99:0/3876881893 shutdown_connections 2024-09-19T06:40:42.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.124+0000 7f3c3bdcd640 1 --2- 172.21.15.99:0/3876881893 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c34103e30 0x7f3c341042a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:42.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.124+0000 7f3c3bdcd640 1 --2- 172.21.15.99:0/3876881893 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3c34102b60 0x7f3c34102f70 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:42.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.124+0000 7f3c3bdcd640 1 -- 172.21.15.99:0/3876881893 >> 172.21.15.99:0/3876881893 conn(0x7f3c34071dc0 msgr2=0x7f3c340741f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:42.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.124+0000 7f3c3bdcd640 1 -- 172.21.15.99:0/3876881893 shutdown_connections 2024-09-19T06:40:42.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.124+0000 7f3c3bdcd640 1 -- 172.21.15.99:0/3876881893 wait complete. 2024-09-19T06:40:42.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.125+0000 7f3c3bdcd640 1 Processor -- start 2024-09-19T06:40:42.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.125+0000 7f3c3bdcd640 1 -- start start 2024-09-19T06:40:42.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.125+0000 7f3c3bdcd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3c34102b60 0x7f3c34113660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:42.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.125+0000 7f3c3bdcd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c34103e30 0x7f3c34113ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:42.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.125+0000 7f3c3bdcd640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c341141f0 con 0x7f3c34102b60 2024-09-19T06:40:42.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.125+0000 7f3c3bdcd640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c34114a10 con 0x7f3c34103e30 2024-09-19T06:40:42.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.125+0000 7f3c39b69640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3c34102b60 0x7f3c34113660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:42.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.125+0000 7f3c39b69640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3c34102b60 0x7f3c34113660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52042/0 (socket says 172.21.15.99:52042) 2024-09-19T06:40:42.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.125+0000 7f3c39b69640 1 -- 172.21.15.99:0/1680771410 learned_addr learned my addr 172.21.15.99:0/1680771410 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:40:42.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.126+0000 7f3c39368640 1 --2- 172.21.15.99:0/1680771410 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c34103e30 0x7f3c34113ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:42.129 INFO:tasks.workunit.client.1.smithi117.stdout:4/967: creat d3/d41/ded/d115/f13a x:0 0 0 2024-09-19T06:40:42.129 INFO:tasks.workunit.client.1.smithi117.stdout:9/763: write d4/d20/f45 [1582676,114448] 0 2024-09-19T06:40:42.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.126+0000 7f3c39b69640 1 -- 172.21.15.99:0/1680771410 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c34103e30 msgr2=0x7f3c34113ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:42.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.126+0000 7f3c39b69640 1 --2- 172.21.15.99:0/1680771410 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c34103e30 0x7f3c34113ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:42.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.126+0000 7f3c39b69640 1 -- 172.21.15.99:0/1680771410 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c300098b0 con 0x7f3c34102b60 2024-09-19T06:40:42.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.127+0000 7f3c39b69640 1 --2- 172.21.15.99:0/1680771410 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3c34102b60 0x7f3c34113660 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3c30004a30 tx=0x7f3c30004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:42.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.127+0000 7f3c2a7fc640 1 -- 172.21.15.99:0/1680771410 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c30009710 con 0x7f3c34102b60 2024-09-19T06:40:42.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.127+0000 7f3c2a7fc640 1 -- 172.21.15.99:0/1680771410 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3c30032b10 con 0x7f3c34102b60 2024-09-19T06:40:42.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.127+0000 7f3c2a7fc640 1 -- 172.21.15.99:0/1680771410 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c3003db10 con 0x7f3c34102b60 2024-09-19T06:40:42.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.127+0000 7f3c3bdcd640 1 -- 172.21.15.99:0/1680771410 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c34114c40 con 0x7f3c34102b60 2024-09-19T06:40:42.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.127+0000 7f3c3bdcd640 1 -- 172.21.15.99:0/1680771410 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c34115120 con 0x7f3c34102b60 2024-09-19T06:40:42.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.130+0000 7f3c2a7fc640 1 -- 172.21.15.99:0/1680771410 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7f3c3002f030 con 0x7f3c34102b60 2024-09-19T06:40:42.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.130+0000 7f3c3bdcd640 1 -- 172.21.15.99:0/1680771410 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c340759f0 con 0x7f3c34102b60 2024-09-19T06:40:42.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.131+0000 7f3c2a7fc640 1 --2- 172.21.15.99:0/1680771410 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7f3c2006e880 0x7f3c20070d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:42.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.131+0000 7f3c2a7fc640 1 -- 172.21.15.99:0/1680771410 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f3c300b03d0 con 0x7f3c34102b60 2024-09-19T06:40:42.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.131+0000 7f3c39368640 1 --2- 172.21.15.99:0/1680771410 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7f3c2006e880 0x7f3c20070d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:42.133 INFO:tasks.workunit.client.1.smithi117.stdout:5/803: readlink d17/d1b/d3a/d3c/l6c 0 2024-09-19T06:40:42.133 INFO:tasks.workunit.client.1.smithi117.stdout:9/764: stat d4/d1c/d73/d9a/ce4 0 2024-09-19T06:40:42.133 INFO:tasks.workunit.client.1.smithi117.stdout:8/708: dwrite d1d/d2a/d3f/d4b/d5f/d95/f9b [0,4194304] 0 2024-09-19T06:40:42.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.132+0000 7f3c39368640 1 --2- 172.21.15.99:0/1680771410 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7f3c2006e880 0x7f3c20070d30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3c24007fd0 tx=0x7f3c24009e90 comp rx=0 tx=0).ready entity=mgr.24369 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:42.138 INFO:tasks.workunit.client.1.smithi117.stdout:1/676: creat d3/da1/db1/d93/fed x:0 0 0 2024-09-19T06:40:42.141 INFO:tasks.workunit.client.1.smithi117.stdout:7/722: truncate d1/d4a/d81/d48/d5f/d82/ff8 456648 0 2024-09-19T06:40:42.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.140+0000 7f3c2a7fc640 1 -- 172.21.15.99:0/1680771410 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f3c30079cd0 con 0x7f3c34102b60 2024-09-19T06:40:42.142 INFO:tasks.workunit.client.1.smithi117.stdout:6/562: dwrite d1/d5/d8/f90 [0,4194304] 0 2024-09-19T06:40:42.143 INFO:tasks.workunit.client.1.smithi117.stdout:5/804: dread - d17/d1b/d3a/fb0 zero size 2024-09-19T06:40:42.144 INFO:tasks.workunit.client.0.smithi099.stdout:8/490: dwrite d4/d66/f76 [0,4194304] 0 2024-09-19T06:40:42.145 INFO:tasks.workunit.client.1.smithi117.stdout:0/694: write d11/d13/d1b/d67/f80 [256,58683] 0 2024-09-19T06:40:42.149 INFO:tasks.workunit.client.1.smithi117.stdout:1/677: unlink d3/d18/d23/d74/cb3 0 2024-09-19T06:40:42.155 INFO:tasks.workunit.client.1.smithi117.stdout:7/723: rename d1/d4a/d81/c76 to d1/d4a/d77/c104 0 2024-09-19T06:40:42.156 INFO:tasks.workunit.client.1.smithi117.stdout:1/678: dwrite d3/d18/d23/fc2 [0,4194304] 0 2024-09-19T06:40:42.156 INFO:tasks.workunit.client.1.smithi117.stdout:7/724: fdatasync d1/d4a/d81/d24/d1c/f79 0 2024-09-19T06:40:42.157 INFO:tasks.workunit.client.1.smithi117.stdout:1/679: dread - d3/d22/d2f/fda zero size 2024-09-19T06:40:42.158 INFO:tasks.workunit.client.1.smithi117.stdout:5/805: rmdir d17/d1b/d3a/d3c/d46 39 2024-09-19T06:40:42.159 INFO:tasks.workunit.client.1.smithi117.stdout:7/725: chown d1/d4a/d81/d24/d49/f62 212 1 2024-09-19T06:40:42.159 INFO:tasks.workunit.client.1.smithi117.stdout:0/695: creat d11/d13/d7a/fe3 x:0 0 0 2024-09-19T06:40:42.167 INFO:tasks.workunit.client.0.smithi099.stdout:8/491: dwrite d4/de/d10/f40 [0,4194304] 0 2024-09-19T06:40:42.168 INFO:tasks.workunit.client.1.smithi117.stdout:1/680: unlink d3/d22/c42 0 2024-09-19T06:40:42.168 INFO:tasks.workunit.client.1.smithi117.stdout:7/726: write d1/d4a/d81/d24/f69 [1016832,130574] 0 2024-09-19T06:40:42.171 INFO:tasks.workunit.client.1.smithi117.stdout:5/806: mkdir d17/d1b/d3a/d3c/dcb/dde/d65/d88/de5/d3b/d109 0 2024-09-19T06:40:42.171 INFO:tasks.workunit.client.0.smithi099.stdout:8/492: getdents d4/d8a 0 2024-09-19T06:40:42.172 INFO:tasks.workunit.client.1.smithi117.stdout:9/765: link d4/d8/d6e/ddb/lf8 d4/d1c/d7a/d16/dac/l104 0 2024-09-19T06:40:42.173 INFO:tasks.workunit.client.1.smithi117.stdout:0/696: dread d11/d13/d14/d2c/d35/d3e/f62 [0,4194304] 0 2024-09-19T06:40:42.175 INFO:tasks.workunit.client.0.smithi099.stdout:8/493: symlink d4/d11/d23/d92/lab 0 2024-09-19T06:40:42.176 INFO:tasks.workunit.client.1.smithi117.stdout:4/968: getdents d3/d4 0 2024-09-19T06:40:42.180 INFO:tasks.workunit.client.0.smithi099.stdout:8/494: dread d4/de/d1c/f6d [0,4194304] 0 2024-09-19T06:40:42.180 INFO:tasks.workunit.client.0.smithi099.stdout:6/612: sync 2024-09-19T06:40:42.180 INFO:tasks.workunit.client.0.smithi099.stdout:9/621: sync 2024-09-19T06:40:42.181 INFO:tasks.workunit.client.1.smithi117.stdout:1/681: dread d3/d18/d23/f2d [0,4194304] 0 2024-09-19T06:40:42.181 INFO:tasks.workunit.client.0.smithi099.stdout:9/622: dread - dd/d65/f96 zero size 2024-09-19T06:40:42.181 INFO:tasks.workunit.client.1.smithi117.stdout:4/969: dread - d3/db/d20/f117 zero size 2024-09-19T06:40:42.182 INFO:tasks.workunit.client.1.smithi117.stdout:8/709: dwrite d1d/d2a/d3f/d4b/f96 [0,4194304] 0 2024-09-19T06:40:42.182 INFO:tasks.workunit.client.0.smithi099.stdout:9/623: chown dd/l32 855 1 2024-09-19T06:40:42.182 INFO:tasks.workunit.client.0.smithi099.stdout:6/613: write d1/d5/d38/d76/db0/d54/fc7 [957851,21649] 0 2024-09-19T06:40:42.186 INFO:tasks.workunit.client.1.smithi117.stdout:0/697: fsync d11/d13/d14/f6b 0 2024-09-19T06:40:42.187 INFO:tasks.workunit.client.0.smithi099.stdout:9/624: creat dd/d62/d76/d9a/fce x:0 0 0 2024-09-19T06:40:42.187 INFO:tasks.workunit.client.1.smithi117.stdout:6/563: dwrite d1/d5/d8/f19 [0,4194304] 0 2024-09-19T06:40:42.187 INFO:tasks.workunit.client.1.smithi117.stdout:5/807: write d17/d1b/d3a/d3c/dcb/dde/d65/fff [2721004,66316] 0 2024-09-19T06:40:42.188 INFO:tasks.workunit.client.0.smithi099.stdout:6/614: rename d1/d5/c7a to d1/d5/d24/d2e/d7b/ccc 0 2024-09-19T06:40:42.189 INFO:tasks.workunit.client.1.smithi117.stdout:1/682: write d3/d22/d2f/f92 [767269,38271] 0 2024-09-19T06:40:42.190 INFO:tasks.workunit.client.0.smithi099.stdout:9/625: mknod dd/d2c/d5c/d64/d93/ccf 0 2024-09-19T06:40:42.191 INFO:tasks.workunit.client.0.smithi099.stdout:8/495: truncate d4/d11/d23/f3b 3154819 0 2024-09-19T06:40:42.191 INFO:tasks.workunit.client.0.smithi099.stdout:9/626: dread - dd/d65/da3/fc8 zero size 2024-09-19T06:40:42.192 INFO:tasks.workunit.client.0.smithi099.stdout:9/627: stat dd/d47/d40/f31 0 2024-09-19T06:40:42.193 INFO:tasks.workunit.client.1.smithi117.stdout:4/970: chown d3/d41/f89 1588605 1 2024-09-19T06:40:42.195 INFO:tasks.workunit.client.1.smithi117.stdout:8/710: fsync d1d/d1e/f5c 0 2024-09-19T06:40:42.195 INFO:tasks.workunit.client.0.smithi099.stdout:8/496: mkdir d4/de/d26/d8d/dac 0 2024-09-19T06:40:42.196 INFO:tasks.workunit.client.1.smithi117.stdout:6/564: creat d1/d5/d32/d45/f9e x:0 0 0 2024-09-19T06:40:42.196 INFO:tasks.workunit.client.0.smithi099.stdout:8/497: write d4/d5e/f7b [1536324,128184] 0 2024-09-19T06:40:42.197 INFO:tasks.workunit.client.1.smithi117.stdout:2/790: dwrite d0/d7/d1e/d20/f7b [0,4194304] 0 2024-09-19T06:40:42.197 INFO:tasks.workunit.client.1.smithi117.stdout:7/727: link d1/d4a/d7c/fc0 d1/d4a/d77/f105 0 2024-09-19T06:40:42.197 INFO:tasks.workunit.client.0.smithi099.stdout:8/498: readlink d4/l70 0 2024-09-19T06:40:42.200 INFO:tasks.workunit.client.1.smithi117.stdout:7/728: dread - d1/d4a/d7c/d95/fe8 zero size 2024-09-19T06:40:42.201 INFO:tasks.workunit.client.1.smithi117.stdout:2/791: write d0/d7/d1e/f41 [6533864,111107] 0 2024-09-19T06:40:42.202 INFO:tasks.workunit.client.1.smithi117.stdout:1/683: creat d3/d18/d23/d51/fee x:0 0 0 2024-09-19T06:40:42.203 INFO:tasks.workunit.client.1.smithi117.stdout:7/729: dread - d1/d4a/d81/d24/d1c/d55/ffe zero size 2024-09-19T06:40:42.204 INFO:tasks.workunit.client.1.smithi117.stdout:0/698: truncate d11/d13/d14/d2c/d53/f71 2353980 0 2024-09-19T06:40:42.205 INFO:tasks.workunit.client.1.smithi117.stdout:8/711: fsync d1d/d2a/d3f/d4b/d66/dac/f7f 0 2024-09-19T06:40:42.205 INFO:tasks.workunit.client.1.smithi117.stdout:7/730: chown d1/d3f/f57 874963748 1 2024-09-19T06:40:42.206 INFO:tasks.workunit.client.1.smithi117.stdout:9/766: truncate d4/d8/d6e/da4/fa6 2051356 0 2024-09-19T06:40:42.207 INFO:tasks.workunit.client.1.smithi117.stdout:7/731: write d1/d4a/d81/d48/d5f/d82/fa5 [657682,6266] 0 2024-09-19T06:40:42.209 INFO:tasks.workunit.client.1.smithi117.stdout:5/808: rename d17/d1b/d3a/d3c/dcb/dde/d55/dd1/cf1 to d17/d1b/d5d/c10a 0 2024-09-19T06:40:42.209 INFO:tasks.workunit.client.0.smithi099.stdout:8/499: dwrite d4/de/d1c/f6d [4194304,4194304] 0 2024-09-19T06:40:42.210 INFO:tasks.workunit.client.1.smithi117.stdout:6/565: creat d1/d5/d32/d45/d7b/f9f x:0 0 0 2024-09-19T06:40:42.212 INFO:tasks.workunit.client.0.smithi099.stdout:6/615: dread d1/f19 [0,4194304] 0 2024-09-19T06:40:42.213 INFO:tasks.workunit.client.0.smithi099.stdout:8/500: fsync d4/d11/f1f 0 2024-09-19T06:40:42.213 INFO:tasks.workunit.client.1.smithi117.stdout:0/699: creat d11/d13/d14/d2c/d53/d7e/daa/dca/fe4 x:0 0 0 2024-09-19T06:40:42.213 INFO:tasks.workunit.client.0.smithi099.stdout:6/616: fdatasync d1/d5/d38/fae 0 2024-09-19T06:40:42.215 INFO:tasks.workunit.client.1.smithi117.stdout:8/712: creat d1d/d2a/d3f/d4b/d91/d97/ff2 x:0 0 0 2024-09-19T06:40:42.216 INFO:tasks.workunit.client.1.smithi117.stdout:5/809: dwrite d17/d5c/fe1 [0,4194304] 0 2024-09-19T06:40:42.216 INFO:tasks.workunit.client.0.smithi099.stdout:9/628: dread dd/f5d [0,4194304] 0 2024-09-19T06:40:42.217 INFO:tasks.workunit.client.0.smithi099.stdout:8/501: symlink d4/de/d26/d2b/lad 0 2024-09-19T06:40:42.221 INFO:tasks.workunit.client.0.smithi099.stdout:6/617: rename d1/d5/d38/d76/db0/ca9 to d1/d5/d24/d2e/d41/d81/ccd 0 2024-09-19T06:40:42.221 INFO:tasks.workunit.client.1.smithi117.stdout:9/767: rename d4/d8/l4c to d4/d1c/d7a/d52/d8d/l105 0 2024-09-19T06:40:42.222 INFO:tasks.workunit.client.0.smithi099.stdout:6/618: fdatasync d1/d5/d24/d2b/f45 0 2024-09-19T06:40:42.224 INFO:tasks.workunit.client.1.smithi117.stdout:6/566: symlink d1/d5/d8/d27/la0 0 2024-09-19T06:40:42.224 INFO:tasks.workunit.client.1.smithi117.stdout:6/567: fsync d1/d5/d8/f90 0 2024-09-19T06:40:42.225 INFO:tasks.workunit.client.1.smithi117.stdout:6/568: chown d1/d5/d8/d27 11399418 1 2024-09-19T06:40:42.225 INFO:tasks.workunit.client.1.smithi117.stdout:4/971: getdents d3/d4/d14 0 2024-09-19T06:40:42.226 INFO:tasks.workunit.client.1.smithi117.stdout:0/700: mknod d11/d13/d1b/d27/d37/da9/ce5 0 2024-09-19T06:40:42.226 INFO:tasks.workunit.client.1.smithi117.stdout:4/972: truncate d3/d1b/fe3 28172 0 2024-09-19T06:40:42.227 INFO:tasks.workunit.client.0.smithi099.stdout:8/502: dread d4/d11/d23/d4c/f69 [4194304,4194304] 0 2024-09-19T06:40:42.227 INFO:tasks.workunit.client.1.smithi117.stdout:4/973: dread - d3/db/d20/d35/d79/dd4/fe9 zero size 2024-09-19T06:40:42.229 INFO:tasks.workunit.client.1.smithi117.stdout:5/810: symlink d17/d1b/d3a/d3c/dcb/dde/da6/l10b 0 2024-09-19T06:40:42.230 INFO:tasks.workunit.client.0.smithi099.stdout:8/503: write d4/f17 [4315557,14046] 0 2024-09-19T06:40:42.234 INFO:tasks.workunit.client.0.smithi099.stdout:9/629: dwrite dd/d47/d40/f31 [0,4194304] 0 2024-09-19T06:40:42.234 INFO:tasks.workunit.client.0.smithi099.stdout:8/504: mkdir d4/de/d26/d2b/dae 0 2024-09-19T06:40:42.235 INFO:tasks.workunit.client.0.smithi099.stdout:8/505: readlink d4/d11/d23/d3f/l77 0 2024-09-19T06:40:42.235 INFO:tasks.workunit.client.1.smithi117.stdout:9/768: unlink d4/d1c/d54/dd8/c102 0 2024-09-19T06:40:42.236 INFO:tasks.workunit.client.1.smithi117.stdout:9/769: readlink d4/d1c/d5f/l8c 0 2024-09-19T06:40:42.238 INFO:tasks.workunit.client.1.smithi117.stdout:6/569: write d1/d5/d85/f93 [4148430,80013] 0 2024-09-19T06:40:42.238 INFO:tasks.workunit.client.0.smithi099.stdout:9/630: mkdir dd/d2c/d5c/dd0 0 2024-09-19T06:40:42.239 INFO:tasks.workunit.client.0.smithi099.stdout:9/631: chown dd/d47/cc6 9933 1 2024-09-19T06:40:42.240 INFO:tasks.workunit.client.0.smithi099.stdout:9/632: readlink dd/d47/d40/l42 0 2024-09-19T06:40:42.241 INFO:tasks.workunit.client.0.smithi099.stdout:8/506: dread d4/d11/d23/d3f/f9f [0,4194304] 0 2024-09-19T06:40:42.242 INFO:tasks.workunit.client.1.smithi117.stdout:7/732: creat d1/d4a/d81/d24/d1c/f106 x:0 0 0 2024-09-19T06:40:42.243 INFO:tasks.workunit.client.1.smithi117.stdout:1/684: write d3/f5c [542737,6105] 0 2024-09-19T06:40:42.244 INFO:tasks.workunit.client.1.smithi117.stdout:0/701: mkdir d11/d13/d28/de6 0 2024-09-19T06:40:42.245 INFO:tasks.workunit.client.1.smithi117.stdout:8/713: creat d1d/d1e/ff3 x:0 0 0 2024-09-19T06:40:42.245 INFO:tasks.workunit.client.1.smithi117.stdout:1/685: stat d3/d22/ce7 0 2024-09-19T06:40:42.246 INFO:tasks.workunit.client.0.smithi099.stdout:8/507: mkdir d4/d11/d23/d4c/daf 0 2024-09-19T06:40:42.248 INFO:tasks.workunit.client.0.smithi099.stdout:8/508: symlink d4/d11/d23/d4c/daf/lb0 0 2024-09-19T06:40:42.249 INFO:tasks.workunit.client.1.smithi117.stdout:4/974: creat d3/db/f13b x:0 0 0 2024-09-19T06:40:42.249 INFO:tasks.workunit.client.0.smithi099.stdout:9/633: dread dd/f70 [4194304,4194304] 0 2024-09-19T06:40:42.251 INFO:tasks.workunit.client.0.smithi099.stdout:8/509: creat d4/de/d26/d8d/dac/fb1 x:0 0 0 2024-09-19T06:40:42.252 INFO:tasks.workunit.client.1.smithi117.stdout:9/770: getdents d4/d8/d6a 0 2024-09-19T06:40:42.252 INFO:tasks.workunit.client.0.smithi099.stdout:9/634: mknod dd/d2c/d79/db4/cd1 0 2024-09-19T06:40:42.253 INFO:tasks.workunit.client.0.smithi099.stdout:8/510: symlink d4/de/d26/d2b/lb2 0 2024-09-19T06:40:42.255 INFO:tasks.workunit.client.0.smithi099.stdout:9/635: mknod dd/d47/d40/d61/cd2 0 2024-09-19T06:40:42.256 INFO:tasks.workunit.client.1.smithi117.stdout:0/702: dwrite d11/d13/d14/d16/f1a [0,4194304] 0 2024-09-19T06:40:42.257 INFO:tasks.workunit.client.1.smithi117.stdout:5/811: dwrite d17/d1b/d3a/d3c/d46/f4a [0,4194304] 0 2024-09-19T06:40:42.259 INFO:tasks.workunit.client.0.smithi099.stdout:9/636: unlink dd/d62/d78/f7d 0 2024-09-19T06:40:42.260 INFO:tasks.workunit.client.1.smithi117.stdout:5/812: dread - d17/d5c/fec zero size 2024-09-19T06:40:42.261 INFO:tasks.workunit.client.0.smithi099.stdout:8/511: dwrite d4/d11/d23/d4c/f69 [0,4194304] 0 2024-09-19T06:40:42.261 INFO:tasks.workunit.client.1.smithi117.stdout:4/975: rename d3/db/d20/d35/cee to d3/d41/d109/c13c 0 2024-09-19T06:40:42.262 INFO:tasks.workunit.client.0.smithi099.stdout:8/512: chown d4/de/d26/c95 267611039 1 2024-09-19T06:40:42.262 INFO:tasks.workunit.client.0.smithi099.stdout:8/513: readlink d4/d11/d23/l3a 0 2024-09-19T06:40:42.265 INFO:tasks.workunit.client.0.smithi099.stdout:9/637: symlink dd/d2c/d79/ld3 0 2024-09-19T06:40:42.265 INFO:tasks.workunit.client.0.smithi099.stdout:9/638: chown dd/d62/d76 218 1 2024-09-19T06:40:42.269 INFO:tasks.workunit.client.1.smithi117.stdout:9/771: dwrite d4/d1c/d73/da8/fee [0,4194304] 0 2024-09-19T06:40:42.269 INFO:tasks.workunit.client.1.smithi117.stdout:9/772: dread - d4/d8/fea zero size 2024-09-19T06:40:42.269 INFO:tasks.workunit.client.1.smithi117.stdout:0/703: dread d11/d13/d14/fd6 [0,4194304] 0 2024-09-19T06:40:42.270 INFO:tasks.workunit.client.0.smithi099.stdout:9/639: rmdir dd/d62/d76 39 2024-09-19T06:40:42.270 INFO:tasks.workunit.client.1.smithi117.stdout:8/714: truncate d1d/f40 2457017 0 2024-09-19T06:40:42.271 INFO:tasks.workunit.client.0.smithi099.stdout:9/640: fsync dd/d47/d40/f56 0 2024-09-19T06:40:42.273 INFO:tasks.workunit.client.1.smithi117.stdout:7/733: dread d1/d4a/d7c/f98 [0,4194304] 0 2024-09-19T06:40:42.273 INFO:tasks.workunit.client.0.smithi099.stdout:9/641: creat dd/d2c/d79/fd4 x:0 0 0 2024-09-19T06:40:42.274 INFO:tasks.workunit.client.1.smithi117.stdout:8/715: chown d1d/d1e/f1f 145776095 1 2024-09-19T06:40:42.276 INFO:tasks.workunit.client.1.smithi117.stdout:1/686: truncate d3/da1/db1/d93/fd1 285164 0 2024-09-19T06:40:42.277 INFO:tasks.workunit.client.1.smithi117.stdout:4/976: mkdir d3/db/d20/d29/d13d 0 2024-09-19T06:40:42.278 INFO:tasks.workunit.client.0.smithi099.stdout:9/642: rename dd/f37 to dd/d47/d40/da9/fd5 0 2024-09-19T06:40:42.279 INFO:tasks.workunit.client.0.smithi099.stdout:9/643: truncate dd/d47/fb8 735978 0 2024-09-19T06:40:42.280 INFO:tasks.workunit.client.1.smithi117.stdout:6/570: dread d1/d5/f56 [0,4194304] 0 2024-09-19T06:40:42.282 INFO:tasks.workunit.client.1.smithi117.stdout:1/687: chown d3/d8e/fb8 3920 1 2024-09-19T06:40:42.283 INFO:tasks.workunit.client.1.smithi117.stdout:9/773: dwrite d4/d58/fc3 [0,4194304] 0 2024-09-19T06:40:42.285 INFO:tasks.workunit.client.1.smithi117.stdout:1/688: truncate d3/d8e/fb8 851131 0 2024-09-19T06:40:42.286 INFO:tasks.workunit.client.0.smithi099.stdout:9/644: rename dd/d47/fb8 to dd/d62/fd6 0 2024-09-19T06:40:42.286 INFO:tasks.workunit.client.1.smithi117.stdout:8/716: rename d1d/d2a/f45 to d1d/d1e/ff4 0 2024-09-19T06:40:42.286 INFO:tasks.workunit.client.1.smithi117.stdout:7/734: getdents d1/d4a/d81/d24/d26/d44/dfb 0 2024-09-19T06:40:42.287 INFO:tasks.workunit.client.1.smithi117.stdout:9/774: creat d4/d1c/d7a/d16/f106 x:0 0 0 2024-09-19T06:40:42.288 INFO:tasks.workunit.client.1.smithi117.stdout:9/775: fdatasync d4/d58/f8e 0 2024-09-19T06:40:42.289 INFO:tasks.workunit.client.1.smithi117.stdout:1/689: creat d3/d18/d56/fef x:0 0 0 2024-09-19T06:40:42.292 INFO:tasks.workunit.client.1.smithi117.stdout:7/735: mknod d1/c107 0 2024-09-19T06:40:42.293 INFO:tasks.workunit.client.1.smithi117.stdout:1/690: creat d3/da1/da5/ff0 x:0 0 0 2024-09-19T06:40:42.296 INFO:tasks.workunit.client.0.smithi099.stdout:9/645: dwrite dd/d47/d40/d61/f63 [4194304,4194304] 0 2024-09-19T06:40:42.299 INFO:tasks.workunit.client.1.smithi117.stdout:1/691: dwrite f1 [8388608,4194304] 0 2024-09-19T06:40:42.303 INFO:tasks.workunit.client.1.smithi117.stdout:7/736: read d1/d4a/d81/d48/d5f/d82/fa5 [3022320,1480] 0 2024-09-19T06:40:42.305 INFO:tasks.workunit.client.1.smithi117.stdout:7/737: write d1/d3f/d92/fdd [389163,24489] 0 2024-09-19T06:40:42.306 INFO:tasks.workunit.client.1.smithi117.stdout:1/692: getdents d3/d18/d23 0 2024-09-19T06:40:42.307 INFO:tasks.workunit.client.1.smithi117.stdout:0/704: write d11/f19 [2959180,90875] 0 2024-09-19T06:40:42.312 INFO:tasks.workunit.client.1.smithi117.stdout:1/693: unlink d3/d18/d56/c4e 0 2024-09-19T06:40:42.313 INFO:tasks.workunit.client.0.smithi099.stdout:8/514: dread d4/d11/d23/d3f/f55 [0,4194304] 0 2024-09-19T06:40:42.313 INFO:tasks.workunit.client.1.smithi117.stdout:1/694: stat d3/da1 0 2024-09-19T06:40:42.314 INFO:tasks.workunit.client.1.smithi117.stdout:7/738: creat d1/d4a/d7c/d95/ddc/f108 x:0 0 0 2024-09-19T06:40:42.314 INFO:tasks.workunit.client.0.smithi099.stdout:8/515: write d4/de/d1c/d99/fa2 [389763,8462] 0 2024-09-19T06:40:42.316 INFO:tasks.workunit.client.1.smithi117.stdout:1/695: read - d3/da1/db1/d93/fed zero size 2024-09-19T06:40:42.316 INFO:tasks.workunit.client.1.smithi117.stdout:0/705: fsync d11/d13/d1b/d27/d37/f58 0 2024-09-19T06:40:42.316 INFO:tasks.workunit.client.0.smithi099.stdout:8/516: read d4/d11/d23/d4c/f69 [2733898,16651] 0 2024-09-19T06:40:42.316 INFO:tasks.workunit.client.1.smithi117.stdout:6/571: truncate d1/d3/f50 1365275 0 2024-09-19T06:40:42.317 INFO:tasks.workunit.client.0.smithi099.stdout:8/517: chown d4/de/d10/f9c 50 1 2024-09-19T06:40:42.317 INFO:tasks.workunit.client.0.smithi099.stdout:9/646: write dd/d65/f92 [637550,109364] 0 2024-09-19T06:40:42.318 INFO:tasks.workunit.client.0.smithi099.stdout:9/647: stat dd/c45 0 2024-09-19T06:40:42.319 INFO:tasks.workunit.client.0.smithi099.stdout:8/518: symlink d4/de/d26/d8d/dac/lb3 0 2024-09-19T06:40:42.320 INFO:tasks.workunit.client.1.smithi117.stdout:4/977: dwrite d3/d4/fe2 [0,4194304] 0 2024-09-19T06:40:42.322 INFO:tasks.workunit.client.1.smithi117.stdout:7/739: rename d1/d4a/d81/d24/d26/d44/fb2 to d1/d3f/f109 0 2024-09-19T06:40:42.322 INFO:tasks.workunit.client.1.smithi117.stdout:1/696: dread d3/da1/db1/fa7 [0,4194304] 0 2024-09-19T06:40:42.323 INFO:tasks.workunit.client.0.smithi099.stdout:9/648: mknod dd/d62/d76/cd7 0 2024-09-19T06:40:42.323 INFO:tasks.workunit.client.1.smithi117.stdout:4/978: truncate d3/d1b/d7d/f86 4706337 0 2024-09-19T06:40:42.324 INFO:tasks.workunit.client.1.smithi117.stdout:3/754: sync 2024-09-19T06:40:42.325 INFO:tasks.workunit.client.1.smithi117.stdout:1/697: stat d3/d18/d23/d51/lb2 0 2024-09-19T06:40:42.326 INFO:tasks.workunit.client.0.smithi099.stdout:9/649: symlink dd/d62/d78/ld8 0 2024-09-19T06:40:42.327 INFO:tasks.workunit.client.1.smithi117.stdout:6/572: mkdir d1/d5/d8/d5e/d67/d98/da1 0 2024-09-19T06:40:42.328 INFO:tasks.workunit.client.1.smithi117.stdout:3/755: write d0/d9/d4e/fea [541666,3690] 0 2024-09-19T06:40:42.329 INFO:tasks.workunit.client.0.smithi099.stdout:8/519: dwrite d4/d5e/f7b [0,4194304] 0 2024-09-19T06:40:42.330 INFO:tasks.workunit.client.1.smithi117.stdout:4/979: dread d3/d41/f10b [0,4194304] 0 2024-09-19T06:40:42.334 INFO:tasks.workunit.client.1.smithi117.stdout:1/698: creat d3/d18/d23/d74/d89/d9f/ff1 x:0 0 0 2024-09-19T06:40:42.334 INFO:tasks.workunit.client.1.smithi117.stdout:7/740: dwrite d1/d4a/d77/f86 [0,4194304] 0 2024-09-19T06:40:42.337 INFO:tasks.workunit.client.1.smithi117.stdout:7/741: chown d1/d4a/d7c/c101 1342 1 2024-09-19T06:40:42.337 INFO:tasks.workunit.client.1.smithi117.stdout:3/756: mkdir d0/d3d/d48/d77/d81/df3 0 2024-09-19T06:40:42.342 INFO:tasks.workunit.client.1.smithi117.stdout:0/706: rename d11/d13/d1b/d4b/cd9 to d11/d13/ce7 0 2024-09-19T06:40:42.342 INFO:tasks.workunit.client.0.smithi099.stdout:8/520: write d4/d11/d23/d92/fa4 [2880502,16755] 0 2024-09-19T06:40:42.343 INFO:tasks.workunit.client.1.smithi117.stdout:0/707: fsync d11/d13/d28/f92 0 2024-09-19T06:40:42.343 INFO:tasks.workunit.client.1.smithi117.stdout:4/980: mknod d3/db/d20/d29/d39/c13e 0 2024-09-19T06:40:42.343 INFO:tasks.workunit.client.1.smithi117.stdout:3/757: fsync d0/fa2 0 2024-09-19T06:40:42.344 INFO:tasks.workunit.client.1.smithi117.stdout:7/742: unlink d1/d72/l63 0 2024-09-19T06:40:42.345 INFO:tasks.workunit.client.0.smithi099.stdout:8/521: mkdir d4/d5e/db4 0 2024-09-19T06:40:42.345 INFO:tasks.workunit.client.0.smithi099.stdout:8/522: readlink d4/l70 0 2024-09-19T06:40:42.346 INFO:tasks.workunit.client.1.smithi117.stdout:7/743: readlink d1/d4a/d81/d24/d26/l60 0 2024-09-19T06:40:42.346 INFO:tasks.workunit.client.1.smithi117.stdout:1/699: mknod d3/d18/d23/dde/cf2 0 2024-09-19T06:40:42.347 INFO:tasks.workunit.client.1.smithi117.stdout:7/744: write d1/d4a/d81/f2c [8054537,54788] 0 2024-09-19T06:40:42.348 INFO:tasks.workunit.client.1.smithi117.stdout:0/708: creat d11/d13/d14/d2c/d70/fe8 x:0 0 0 2024-09-19T06:40:42.349 INFO:tasks.workunit.client.1.smithi117.stdout:4/981: rename d3/d1b/d7d/d51/d95/f99 to d3/db/d20/d4a/f13f 0 2024-09-19T06:40:42.350 INFO:tasks.workunit.client.1.smithi117.stdout:1/700: symlink d3/d18/d23/dde/lf3 0 2024-09-19T06:40:42.351 INFO:tasks.workunit.client.0.smithi099.stdout:5/753: sync 2024-09-19T06:40:42.351 INFO:tasks.workunit.client.0.smithi099.stdout:1/609: sync 2024-09-19T06:40:42.353 INFO:tasks.workunit.client.1.smithi117.stdout:0/709: rmdir d11/d13/d1b/d27/d37/d6d 39 2024-09-19T06:40:42.353 INFO:tasks.workunit.client.1.smithi117.stdout:7/745: truncate d1/d3f/d92/fdd 971675 0 2024-09-19T06:40:42.354 INFO:tasks.workunit.client.1.smithi117.stdout:8/717: dread d1d/d1e/ff4 [0,4194304] 0 2024-09-19T06:40:42.356 INFO:tasks.workunit.client.1.smithi117.stdout:3/758: read d0/d8/f8b [13035,97567] 0 2024-09-19T06:40:42.360 INFO:tasks.workunit.client.1.smithi117.stdout:7/746: creat d1/d72/dd7/f10a x:0 0 0 2024-09-19T06:40:42.361 INFO:tasks.workunit.client.1.smithi117.stdout:4/982: dwrite d3/d65/f7c [0,4194304] 0 2024-09-19T06:40:42.361 INFO:tasks.workunit.client.0.smithi099.stdout:9/650: dread dd/d47/d40/f11 [0,4194304] 0 2024-09-19T06:40:42.362 INFO:tasks.workunit.client.1.smithi117.stdout:3/759: chown d0/d3d/d48 16 1 2024-09-19T06:40:42.367 INFO:tasks.workunit.client.1.smithi117.stdout:6/573: dread d1/d14/f2b [0,4194304] 0 2024-09-19T06:40:42.367 INFO:tasks.workunit.client.1.smithi117.stdout:7/747: creat d1/d72/dd7/f10b x:0 0 0 2024-09-19T06:40:42.369 INFO:tasks.workunit.client.1.smithi117.stdout:4/983: unlink d3/db/d20/d4a/d7b/l112 0 2024-09-19T06:40:42.370 INFO:tasks.workunit.client.1.smithi117.stdout:0/710: dwrite d11/d13/d1b/d67/fb5 [0,4194304] 0 2024-09-19T06:40:42.371 INFO:tasks.workunit.client.1.smithi117.stdout:8/718: rename d1d/d1e/l22 to d1d/d2a/d3f/d4b/d5f/dbf/dd0/db9/dd6/lf5 0 2024-09-19T06:40:42.371 INFO:tasks.workunit.client.1.smithi117.stdout:6/574: write d1/d5/d85/f93 [5528541,13881] 0 2024-09-19T06:40:42.374 INFO:tasks.workunit.client.1.smithi117.stdout:3/760: creat d0/ff4 x:0 0 0 2024-09-19T06:40:42.374 INFO:tasks.workunit.client.1.smithi117.stdout:6/575: chown d1/d5/d9a 1743060702 1 2024-09-19T06:40:42.376 INFO:tasks.workunit.client.1.smithi117.stdout:7/748: symlink d1/d4a/d81/d24/d49/dbf/dcf/l10c 0 2024-09-19T06:40:42.378 INFO:tasks.workunit.client.1.smithi117.stdout:8/719: creat d1d/d31/d83/dad/dc0/ff6 x:0 0 0 2024-09-19T06:40:42.379 INFO:tasks.workunit.client.1.smithi117.stdout:0/711: creat d11/d13/d1b/d27/d54/fe9 x:0 0 0 2024-09-19T06:40:42.381 INFO:tasks.workunit.client.0.smithi099.stdout:1/610: fdatasync d0/d17/d24/f55 0 2024-09-19T06:40:42.382 INFO:tasks.workunit.client.1.smithi117.stdout:3/761: creat d0/d8/ff5 x:0 0 0 2024-09-19T06:40:42.385 INFO:tasks.workunit.client.1.smithi117.stdout:7/749: write d1/d3f/f73 [1799336,14073] 0 2024-09-19T06:40:42.385 INFO:tasks.workunit.client.0.smithi099.stdout:5/754: unlink d3/d14/c60 0 2024-09-19T06:40:42.386 INFO:tasks.workunit.client.0.smithi099.stdout:5/755: dread - d3/d1f/ff8 zero size 2024-09-19T06:40:42.387 INFO:tasks.workunit.client.1.smithi117.stdout:6/576: dwrite d1/d5/d8/d5e/d6d/f71 [0,4194304] 0 2024-09-19T06:40:42.390 INFO:tasks.workunit.client.0.smithi099.stdout:9/651: dread dd/d2c/d79/f7c [0,4194304] 0 2024-09-19T06:40:42.391 INFO:tasks.workunit.client.1.smithi117.stdout:6/577: write d1/d3/f4b [4728537,6246] 0 2024-09-19T06:40:42.392 INFO:tasks.workunit.client.1.smithi117.stdout:0/712: rename d11/d13/d1b/d67/f80 to d11/d13/d1b/d27/d37/da9/fea 0 2024-09-19T06:40:42.392 INFO:tasks.workunit.client.0.smithi099.stdout:1/611: write d0/f16 [663659,17653] 0 2024-09-19T06:40:42.394 INFO:tasks.workunit.client.0.smithi099.stdout:1/612: write d0/d17/d5b/f5d [159435,10559] 0 2024-09-19T06:40:42.398 INFO:tasks.workunit.client.0.smithi099.stdout:1/613: creat d0/d12/d13/d37/d41/fc6 x:0 0 0 2024-09-19T06:40:42.399 INFO:tasks.workunit.client.1.smithi117.stdout:7/750: fsync d1/d4a/d81/d48/d5f/d82/fbb 0 2024-09-19T06:40:42.400 INFO:tasks.workunit.client.0.smithi099.stdout:9/652: mkdir dd/d2c/dd9 0 2024-09-19T06:40:42.403 INFO:tasks.workunit.client.0.smithi099.stdout:5/756: getdents d3/d7/d90 0 2024-09-19T06:40:42.406 INFO:tasks.workunit.client.0.smithi099.stdout:1/614: dwrite d0/d12/d13/d37/d41/fc6 [0,4194304] 0 2024-09-19T06:40:42.407 INFO:tasks.workunit.client.0.smithi099.stdout:9/653: mknod dd/d47/dc1/cda 0 2024-09-19T06:40:42.407 INFO:tasks.workunit.client.1.smithi117.stdout:6/578: truncate d1/d3/d25/f78 3351487 0 2024-09-19T06:40:42.409 INFO:tasks.workunit.client.1.smithi117.stdout:1/701: write d3/da1/db1/f95 [435878,65781] 0 2024-09-19T06:40:42.411 INFO:tasks.workunit.client.0.smithi099.stdout:5/757: mkdir d3/d16/d5e/db1/d106 0 2024-09-19T06:40:42.414 INFO:tasks.workunit.client.1.smithi117.stdout:4/984: dread d3/db/d20/d4a/f13f [0,4194304] 0 2024-09-19T06:40:42.417 INFO:tasks.workunit.client.0.smithi099.stdout:5/758: fdatasync d3/d16/d2f/d8c/fcc 0 2024-09-19T06:40:42.418 INFO:tasks.workunit.client.0.smithi099.stdout:1/615: link d0/d68/f1d d0/d12/d13/fc7 0 2024-09-19T06:40:42.419 INFO:tasks.workunit.client.0.smithi099.stdout:5/759: write d3/d16/d2f/f7f [4679466,53725] 0 2024-09-19T06:40:42.420 INFO:tasks.workunit.client.0.smithi099.stdout:1/616: write d0/d12/d13/f2b [6842995,48921] 0 2024-09-19T06:40:42.421 INFO:tasks.workunit.client.0.smithi099.stdout:9/654: getdents dd/d2c/d5c/d64 0 2024-09-19T06:40:42.422 INFO:tasks.workunit.client.0.smithi099.stdout:9/655: stat dd/d2c/d79/ld3 0 2024-09-19T06:40:42.422 INFO:tasks.workunit.client.0.smithi099.stdout:1/617: write d0/d17/d32/d7b/d99/fa9 [642579,33543] 0 2024-09-19T06:40:42.423 INFO:tasks.workunit.client.1.smithi117.stdout:8/720: dwrite d1d/d2a/d3f/d73/ddd/f51 [0,4194304] 0 2024-09-19T06:40:42.424 INFO:tasks.workunit.client.0.smithi099.stdout:0/568: sync 2024-09-19T06:40:42.424 INFO:tasks.workunit.client.0.smithi099.stdout:9/656: chown dd/d47/d40/f31 17008 1 2024-09-19T06:40:42.429 INFO:tasks.workunit.client.0.smithi099.stdout:0/569: write d0/db/d13/d1f/d39/f63 [2557572,12576] 0 2024-09-19T06:40:42.430 INFO:tasks.workunit.client.0.smithi099.stdout:8/523: write d4/de/d26/fa5 [72527,93294] 0 2024-09-19T06:40:42.433 INFO:tasks.workunit.client.0.smithi099.stdout:8/524: fsync d4/de/d1c/f8c 0 2024-09-19T06:40:42.433 INFO:tasks.workunit.client.0.smithi099.stdout:1/618: dwrite d0/d12/d13/f2b [4194304,4194304] 0 2024-09-19T06:40:42.434 INFO:tasks.workunit.client.0.smithi099.stdout:5/760: unlink d3/cd 0 2024-09-19T06:40:42.435 INFO:tasks.workunit.client.1.smithi117.stdout:8/721: dread d1d/d2a/d3f/d4b/fc2 [0,4194304] 0 2024-09-19T06:40:42.443 INFO:tasks.workunit.client.1.smithi117.stdout:7/751: mknod d1/d4a/d77/c10d 0 2024-09-19T06:40:42.443 INFO:tasks.workunit.client.1.smithi117.stdout:0/713: truncate d11/d13/d14/f4d 3896520 0 2024-09-19T06:40:42.444 INFO:tasks.workunit.client.1.smithi117.stdout:0/714: chown d11/d13/d14/d16/da1 7 1 2024-09-19T06:40:42.445 INFO:tasks.workunit.client.1.smithi117.stdout:4/985: creat d3/db/d106/f140 x:0 0 0 2024-09-19T06:40:42.446 INFO:tasks.workunit.client.1.smithi117.stdout:3/762: dread - d0/d8/d7f/fad zero size 2024-09-19T06:40:42.448 INFO:tasks.workunit.client.0.smithi099.stdout:1/619: dwrite d0/d17/d32/d7b/d99/fb6 [0,4194304] 0 2024-09-19T06:40:42.449 INFO:tasks.workunit.client.0.smithi099.stdout:5/761: dwrite d3/d16/d2f/d34/d3c/feb [0,4194304] 0 2024-09-19T06:40:42.449 INFO:tasks.workunit.client.1.smithi117.stdout:1/702: rename d3/d18/l2c to d3/d18/d23/d74/d89/lf4 0 2024-09-19T06:40:42.451 INFO:tasks.workunit.client.1.smithi117.stdout:4/986: dwrite d3/db/f13b [0,4194304] 0 2024-09-19T06:40:42.452 INFO:tasks.workunit.client.1.smithi117.stdout:0/715: truncate d11/d13/d14/d2c/d64/f81 984096 0 2024-09-19T06:40:42.454 INFO:tasks.workunit.client.1.smithi117.stdout:3/763: creat d0/d8/d7f/d40/d5b/ff6 x:0 0 0 2024-09-19T06:40:42.455 INFO:tasks.workunit.client.0.smithi099.stdout:5/762: mknod d3/d16/d2f/d34/da4/da5/c107 0 2024-09-19T06:40:42.455 INFO:tasks.workunit.client.1.smithi117.stdout:4/987: truncate d3/db/d20/d4a/d7b/da0/ffc 5780825 0 2024-09-19T06:40:42.457 INFO:tasks.workunit.client.1.smithi117.stdout:4/988: truncate d3/db/d106/f140 792541 0 2024-09-19T06:40:42.457 INFO:tasks.workunit.client.1.smithi117.stdout:0/716: truncate d11/d13/d28/d38/d5b/fd0 969229 0 2024-09-19T06:40:42.458 INFO:tasks.workunit.client.1.smithi117.stdout:3/764: dread d0/fc5 [0,4194304] 0 2024-09-19T06:40:42.459 INFO:tasks.workunit.client.1.smithi117.stdout:8/722: rename d1d/d1e/d3b/f6c to d1d/d2a/d3f/d4b/d5f/dbf/ff7 0 2024-09-19T06:40:42.463 INFO:tasks.workunit.client.0.smithi099.stdout:0/570: dread d0/db/d13/f42 [0,4194304] 0 2024-09-19T06:40:42.464 INFO:tasks.workunit.client.1.smithi117.stdout:1/703: rename d3/d18/d56/cc3 to d3/d18/d23/cf5 0 2024-09-19T06:40:42.464 INFO:tasks.workunit.client.1.smithi117.stdout:3/765: fdatasync d0/d19/f38 0 2024-09-19T06:40:42.465 INFO:tasks.workunit.client.1.smithi117.stdout:3/766: chown d0/d19/d2b/d8e/f93 112467 1 2024-09-19T06:40:42.467 INFO:tasks.workunit.client.1.smithi117.stdout:7/752: getdents d1/d4a/d81/d48 0 2024-09-19T06:40:42.468 INFO:tasks.workunit.client.1.smithi117.stdout:1/704: mknod d3/d18/d97/cf6 0 2024-09-19T06:40:42.469 INFO:tasks.workunit.client.0.smithi099.stdout:0/571: link d0/db/d36/c6e d0/db/d13/d1f/d8e/d9b/cba 0 2024-09-19T06:40:42.469 INFO:tasks.workunit.client.1.smithi117.stdout:3/767: chown d0/d9/fd 0 1 2024-09-19T06:40:42.472 INFO:tasks.workunit.client.0.smithi099.stdout:0/572: rename d0/db/d2f/f43 to d0/db/d13/d1f/d3a/fbb 0 2024-09-19T06:40:42.472 INFO:tasks.workunit.client.1.smithi117.stdout:3/768: symlink d0/d8/d64/lf7 0 2024-09-19T06:40:42.476 INFO:tasks.workunit.client.1.smithi117.stdout:3/769: mkdir d0/d9/d1c/df8 0 2024-09-19T06:40:42.476 INFO:tasks.workunit.client.1.smithi117.stdout:7/753: dwrite d1/d4a/d81/d24/d1c/d35/d4f/fb9 [0,4194304] 0 2024-09-19T06:40:42.481 INFO:tasks.workunit.client.1.smithi117.stdout:7/754: fsync d1/d3f/f4d 0 2024-09-19T06:40:42.484 INFO:tasks.workunit.client.1.smithi117.stdout:7/755: creat d1/d4a/d81/d24/d49/dbf/f10e x:0 0 0 2024-09-19T06:40:42.484 INFO:tasks.workunit.client.1.smithi117.stdout:3/770: link d0/d19/ca9 d0/d8/d7f/dbf/cf9 0 2024-09-19T06:40:42.485 INFO:tasks.workunit.client.1.smithi117.stdout:8/723: dread d1d/d2a/d3f/d4b/d5f/d95/f78 [0,4194304] 0 2024-09-19T06:40:42.488 INFO:tasks.workunit.client.1.smithi117.stdout:8/724: fsync d1d/d31/fe3 0 2024-09-19T06:40:42.489 INFO:tasks.workunit.client.1.smithi117.stdout:3/771: read d0/fc0 [164226,123401] 0 2024-09-19T06:40:42.492 INFO:tasks.workunit.client.1.smithi117.stdout:8/725: rename d1d/f27 to d1d/d2a/d3f/d73/ff8 0 2024-09-19T06:40:42.493 INFO:tasks.workunit.client.1.smithi117.stdout:3/772: rmdir d0/d9/d4e/d9e/dc9 39 2024-09-19T06:40:42.493 INFO:tasks.workunit.client.1.smithi117.stdout:3/773: write d0/d9/d1c/fd5 [208822,90747] 0 2024-09-19T06:40:42.498 INFO:tasks.workunit.client.1.smithi117.stdout:3/774: creat d0/d9/d4e/d9e/ffa x:0 0 0 2024-09-19T06:40:42.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.497+0000 7f3c3bdcd640 1 -- 172.21.15.99:0/1680771410 --> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3c341154a0 con 0x7f3c2006e880 2024-09-19T06:40:42.500 INFO:tasks.workunit.client.1.smithi117.stdout:3/775: mknod d0/d8/d7f/dbf/cfb 0 2024-09-19T06:40:42.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.499+0000 7f3c2a7fc640 1 -- 172.21.15.99:0/1680771410 <== mgr.24369 v2:172.21.15.117:6828/1735340892 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f3c341154a0 con 0x7f3c2006e880 2024-09-19T06:40:42.501 INFO:tasks.workunit.client.1.smithi117.stdout:0/717: dread d11/d13/d1b/d27/f40 [0,4194304] 0 2024-09-19T06:40:42.502 INFO:tasks.workunit.client.1.smithi117.stdout:0/718: readlink d11/d13/d1b/l8d 0 2024-09-19T06:40:42.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.502+0000 7f3c3bdcd640 1 -- 172.21.15.99:0/1680771410 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7f3c2006e880 msgr2=0x7f3c20070d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:42.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.502+0000 7f3c3bdcd640 1 --2- 172.21.15.99:0/1680771410 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7f3c2006e880 0x7f3c20070d30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3c24007fd0 tx=0x7f3c24009e90 comp rx=0 tx=0).stop 2024-09-19T06:40:42.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.502+0000 7f3c3bdcd640 1 -- 172.21.15.99:0/1680771410 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3c34102b60 msgr2=0x7f3c34113660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:42.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.502+0000 7f3c3bdcd640 1 --2- 172.21.15.99:0/1680771410 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3c34102b60 0x7f3c34113660 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3c30004a30 tx=0x7f3c30004d10 comp rx=0 tx=0).stop 2024-09-19T06:40:42.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.502+0000 7f3c3bdcd640 1 -- 172.21.15.99:0/1680771410 shutdown_connections 2024-09-19T06:40:42.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.502+0000 7f3c3bdcd640 1 --2- 172.21.15.99:0/1680771410 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7f3c2006e880 0x7f3c20070d30 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:42.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.502+0000 7f3c3bdcd640 1 --2- 172.21.15.99:0/1680771410 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3c34103e30 0x7f3c34113ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:42.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.502+0000 7f3c3bdcd640 1 --2- 172.21.15.99:0/1680771410 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3c34102b60 0x7f3c34113660 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:42.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.502+0000 7f3c3bdcd640 1 -- 172.21.15.99:0/1680771410 >> 172.21.15.99:0/1680771410 conn(0x7f3c34071dc0 msgr2=0x7f3c34073570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:42.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.502+0000 7f3c3bdcd640 1 -- 172.21.15.99:0/1680771410 shutdown_connections 2024-09-19T06:40:42.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.502+0000 7f3c3bdcd640 1 -- 172.21.15.99:0/1680771410 wait complete. 2024-09-19T06:40:42.505 INFO:tasks.workunit.client.0.smithi099.stdout:1/620: truncate d0/d17/d24/d3a/f81 3860911 0 2024-09-19T06:40:42.506 INFO:tasks.workunit.client.1.smithi117.stdout:3/776: rename d0/d9/d4e/db4/dcc/cc2 to d0/d19/d2b/d8e/dee/cfc 0 2024-09-19T06:40:42.506 INFO:tasks.workunit.client.1.smithi117.stdout:8/726: dread d1d/d2a/d3f/d4b/f6b [0,4194304] 0 2024-09-19T06:40:42.507 INFO:tasks.workunit.client.0.smithi099.stdout:0/573: rename d0/db/d13 to d0/db/d27/d5d/d87/da2/dbc 0 2024-09-19T06:40:42.507 INFO:tasks.workunit.client.1.smithi117.stdout:0/719: symlink d11/d13/leb 0 2024-09-19T06:40:42.507 INFO:tasks.workunit.client.0.smithi099.stdout:1/621: creat d0/d17/d32/fc8 x:0 0 0 2024-09-19T06:40:42.508 INFO:tasks.workunit.client.1.smithi117.stdout:8/727: fsync d1d/d2a/d3f/d4b/d66/dac/f9c 0 2024-09-19T06:40:42.509 INFO:tasks.workunit.client.1.smithi117.stdout:3/777: fdatasync d0/d19/f78 0 2024-09-19T06:40:42.510 INFO:tasks.workunit.client.0.smithi099.stdout:1/622: fsync d0/d17/d32/d7b/d99/fb6 0 2024-09-19T06:40:42.511 INFO:tasks.workunit.client.0.smithi099.stdout:5/763: dwrite d3/d16/d2f/d34/d3c/d65/fdf [0,4194304] 0 2024-09-19T06:40:42.512 INFO:tasks.workunit.client.1.smithi117.stdout:0/720: unlink d11/d13/leb 0 2024-09-19T06:40:42.514 INFO:tasks.workunit.client.0.smithi099.stdout:5/764: rename d3/d16/d2f/d34 to d3/d16/d2f/d34/da4/da5/d108 22 2024-09-19T06:40:42.514 INFO:tasks.workunit.client.0.smithi099.stdout:1/623: chown d0/d17/d24/d5e/d8a 1432467 1 2024-09-19T06:40:42.515 INFO:tasks.workunit.client.0.smithi099.stdout:1/624: dread - d0/d17/d24/f6e zero size 2024-09-19T06:40:42.516 INFO:tasks.workunit.client.0.smithi099.stdout:5/765: fsync d3/d16/d2f/d34/da4/da5/dcd/fff 0 2024-09-19T06:40:42.517 INFO:tasks.workunit.client.0.smithi099.stdout:1/625: readlink d0/d12/d13/d37/l44 0 2024-09-19T06:40:42.518 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-09-19T06:40:42.519 INFO:tasks.workunit.client.1.smithi117.stdout:3/778: creat d0/d3d/d48/dc7/ffd x:0 0 0 2024-09-19T06:40:42.520 INFO:tasks.workunit.client.1.smithi117.stdout:0/721: mknod d11/d13/d14/d2c/d64/cec 0 2024-09-19T06:40:42.521 INFO:tasks.workunit.client.0.smithi099.stdout:1/626: creat d0/d17/d24/d5e/d8a/fc9 x:0 0 0 2024-09-19T06:40:42.521 INFO:tasks.workunit.client.1.smithi117.stdout:0/722: chown ca 154610 1 2024-09-19T06:40:42.522 INFO:tasks.workunit.client.1.smithi117.stdout:8/728: symlink d1d/d1e/lf9 0 2024-09-19T06:40:42.523 INFO:tasks.workunit.client.0.smithi099.stdout:1/627: readlink d0/d17/d32/d7b/l86 0 2024-09-19T06:40:42.523 INFO:tasks.workunit.client.1.smithi117.stdout:8/729: chown d1d/d2a/d3f/d4b/d5f/d95/fe7 255897 1 2024-09-19T06:40:42.524 INFO:tasks.workunit.client.1.smithi117.stdout:3/779: fsync d0/d8/d7f/d40/fbb 0 2024-09-19T06:40:42.524 INFO:tasks.workunit.client.0.smithi099.stdout:5/766: link d3/d16/d2f/d8c/cd4 d3/d16/d2f/dd1/c109 0 2024-09-19T06:40:42.525 INFO:tasks.workunit.client.1.smithi117.stdout:8/730: chown d1d/d2a/d3f/d4b/d66/dac 15761188 1 2024-09-19T06:40:42.525 INFO:tasks.workunit.client.1.smithi117.stdout:0/723: symlink d11/d13/d1b/d27/d37/da9/led 0 2024-09-19T06:40:42.526 INFO:tasks.workunit.client.1.smithi117.stdout:3/780: write d0/d3d/d48/d77/fb2 [725202,123731] 0 2024-09-19T06:40:42.526 INFO:tasks.workunit.client.0.smithi099.stdout:0/574: dwrite d0/db/d27/d5d/d87/da2/dbc/d1f/f2b [0,4194304] 0 2024-09-19T06:40:42.527 INFO:tasks.workunit.client.1.smithi117.stdout:3/781: fdatasync d0/f63 0 2024-09-19T06:40:42.527 INFO:tasks.workunit.client.0.smithi099.stdout:5/767: write d3/d16/d2f/d34/da4/fea [611926,18332] 0 2024-09-19T06:40:42.528 INFO:tasks.workunit.client.1.smithi117.stdout:0/724: truncate d11/d13/d14/d2c/d64/fc3 120051 0 2024-09-19T06:40:42.529 INFO:tasks.workunit.client.0.smithi099.stdout:5/768: fsync d3/d16/d2f/f75 0 2024-09-19T06:40:42.531 INFO:tasks.workunit.client.1.smithi117.stdout:8/731: truncate d1d/fb1 4045953 0 2024-09-19T06:40:42.531 INFO:tasks.workunit.client.1.smithi117.stdout:0/725: truncate d11/d13/d28/d38/d5b/fb1 864032 0 2024-09-19T06:40:42.531 INFO:tasks.workunit.client.0.smithi099.stdout:0/575: mknod d0/db/d27/d5d/d87/da2/dbc/d1f/d4a/cbd 0 2024-09-19T06:40:42.531 INFO:tasks.workunit.client.0.smithi099.stdout:5/769: fdatasync d3/d16/d2f/d34/da4/fea 0 2024-09-19T06:40:42.532 INFO:tasks.workunit.client.1.smithi117.stdout:2/792: sync 2024-09-19T06:40:42.532 INFO:tasks.workunit.client.1.smithi117.stdout:3/782: fdatasync d0/d9/d1c/d53/fd9 0 2024-09-19T06:40:42.534 INFO:tasks.workunit.client.1.smithi117.stdout:2/793: dread - d0/d12/d32/da4/fe2 zero size 2024-09-19T06:40:42.535 INFO:tasks.workunit.client.1.smithi117.stdout:3/783: truncate d0/d8/ff5 821133 0 2024-09-19T06:40:42.536 INFO:tasks.workunit.client.0.smithi099.stdout:0/576: mknod d0/db/d27/d5d/d87/da2/dbc/d37/d3c/d3e/cbe 0 2024-09-19T06:40:42.538 INFO:tasks.workunit.client.1.smithi117.stdout:0/726: rename d11/d13/d1b/d27/d37/d6d/dd2/cd4 to d11/d13/d14/dbd/cee 0 2024-09-19T06:40:42.538 INFO:tasks.workunit.client.1.smithi117.stdout:0/727: readlink d11/d13/d14/d2c/d53/l98 0 2024-09-19T06:40:42.540 INFO:tasks.workunit.client.1.smithi117.stdout:0/728: truncate d11/d13/d7a/fe3 874899 0 2024-09-19T06:40:42.540 INFO:tasks.workunit.client.0.smithi099.stdout:5/770: read d3/d16/f83 [3715640,13708] 0 2024-09-19T06:40:42.540 INFO:tasks.workunit.client.1.smithi117.stdout:3/784: creat d0/d8/d7f/d40/dc4/ffe x:0 0 0 2024-09-19T06:40:42.544 INFO:tasks.workunit.client.0.smithi099.stdout:5/771: mknod d3/d16/d5e/db1/c10a 0 2024-09-19T06:40:42.544 INFO:tasks.workunit.client.0.smithi099.stdout:0/577: dwrite d0/db/d36/f5f [8388608,4194304] 0 2024-09-19T06:40:42.547 INFO:tasks.workunit.client.0.smithi099.stdout:5/772: write d3/d16/d2f/d34/d3c/feb [1652573,79635] 0 2024-09-19T06:40:42.547 INFO:tasks.workunit.client.1.smithi117.stdout:2/794: getdents d0/d7 0 2024-09-19T06:40:42.548 INFO:tasks.workunit.client.1.smithi117.stdout:2/795: read - d0/d64/dd9/f112 zero size 2024-09-19T06:40:42.550 INFO:tasks.workunit.client.0.smithi099.stdout:5/773: mknod d3/d7/c10b 0 2024-09-19T06:40:42.553 INFO:tasks.workunit.client.1.smithi117.stdout:8/732: dread d1d/d2a/d3f/d4b/f5b [0,4194304] 0 2024-09-19T06:40:42.553 INFO:tasks.workunit.client.0.smithi099.stdout:0/578: dwrite d0/db/d36/f67 [0,4194304] 0 2024-09-19T06:40:42.558 INFO:tasks.workunit.client.1.smithi117.stdout:2/796: link d0/d7/d29/d35/f97 d0/d12/d32/da4/f12c 0 2024-09-19T06:40:42.561 INFO:tasks.workunit.client.1.smithi117.stdout:8/733: creat d1d/d2a/d3f/d4b/d66/ffa x:0 0 0 2024-09-19T06:40:42.561 INFO:tasks.workunit.client.1.smithi117.stdout:3/785: link d0/d19/d2b/c84 d0/d3d/d48/d77/d81/cff 0 2024-09-19T06:40:42.561 INFO:tasks.workunit.client.0.smithi099.stdout:5/774: getdents d3/d7/d90/da6 0 2024-09-19T06:40:42.562 INFO:tasks.workunit.client.1.smithi117.stdout:2/797: truncate d0/d12/f3c 1223788 0 2024-09-19T06:40:42.562 INFO:tasks.workunit.client.0.smithi099.stdout:0/579: dread d0/db/f48 [0,4194304] 0 2024-09-19T06:40:42.563 INFO:tasks.workunit.client.1.smithi117.stdout:8/734: rmdir d1d/d31/d83/dad 39 2024-09-19T06:40:42.567 INFO:tasks.workunit.client.0.smithi099.stdout:5/775: read d3/d2a/f45 [1085882,130107] 0 2024-09-19T06:40:42.567 INFO:tasks.workunit.client.1.smithi117.stdout:2/798: rmdir d0/d7/d29/d100 39 2024-09-19T06:40:42.569 INFO:tasks.workunit.client.1.smithi117.stdout:3/786: rename d0/d3d/d48/d77/d81/df3 to d0/d100 0 2024-09-19T06:40:42.569 INFO:tasks.workunit.client.0.smithi099.stdout:5/776: rmdir d3/d16/d2f/d34/da4/da5/dce/de5 39 2024-09-19T06:40:42.570 INFO:tasks.workunit.client.1.smithi117.stdout:2/799: symlink d0/d7/d29/d71/l12d 0 2024-09-19T06:40:42.572 INFO:tasks.workunit.client.0.smithi099.stdout:5/777: rmdir d3/d16/d2f/d34/da4/da5/dce/de5 39 2024-09-19T06:40:42.572 INFO:tasks.workunit.client.1.smithi117.stdout:2/800: dread d0/d7/f8 [0,4194304] 0 2024-09-19T06:40:42.573 INFO:tasks.workunit.client.1.smithi117.stdout:2/801: stat d0/c30 0 2024-09-19T06:40:42.576 INFO:tasks.workunit.client.1.smithi117.stdout:8/735: rename d1d/d31/d83/fa6 to d1d/ffb 0 2024-09-19T06:40:42.577 INFO:tasks.workunit.client.0.smithi099.stdout:5/778: write d3/d1f/d4f/f5c [1004707,100413] 0 2024-09-19T06:40:42.577 INFO:tasks.workunit.client.1.smithi117.stdout:2/802: rmdir d0/d7/d29/d35/d61/d65 39 2024-09-19T06:40:42.578 INFO:tasks.workunit.client.1.smithi117.stdout:2/803: stat d0/d7/d29/d35/f77 0 2024-09-19T06:40:42.579 INFO:tasks.workunit.client.0.smithi099.stdout:0/580: dwrite d0/f57 [0,4194304] 0 2024-09-19T06:40:42.580 INFO:tasks.workunit.client.0.smithi099.stdout:5/779: dread - d3/d16/d2f/d8c/dd9/ff3 zero size 2024-09-19T06:40:42.583 INFO:tasks.workunit.client.1.smithi117.stdout:0/729: dwrite d11/d13/d14/d2c/d64/f81 [0,4194304] 0 2024-09-19T06:40:42.584 INFO:tasks.workunit.client.1.smithi117.stdout:2/804: creat d0/d64/dd9/f12e x:0 0 0 2024-09-19T06:40:42.585 INFO:tasks.workunit.client.0.smithi099.stdout:5/780: write d3/d16/d2f/f75 [176066,30529] 0 2024-09-19T06:40:42.587 INFO:tasks.workunit.client.1.smithi117.stdout:0/730: write d11/d13/d14/d16/fa7 [876211,65309] 0 2024-09-19T06:40:42.594 INFO:tasks.workunit.client.1.smithi117.stdout:0/731: rename d11/d13/d14/f33 to d11/d13/d14/d2c/d53/d7e/fef 0 2024-09-19T06:40:42.595 INFO:tasks.workunit.client.1.smithi117.stdout:2/805: truncate d0/d64/dd9/f80 2573466 0 2024-09-19T06:40:42.596 INFO:tasks.workunit.client.1.smithi117.stdout:8/736: write d1d/d1e/f3e [4811384,66530] 0 2024-09-19T06:40:42.601 INFO:tasks.workunit.client.1.smithi117.stdout:3/787: dread d0/d9/d1c/f42 [0,4194304] 0 2024-09-19T06:40:42.601 INFO:tasks.workunit.client.1.smithi117.stdout:2/806: dwrite d0/d7/d1e/d20/f44 [0,4194304] 0 2024-09-19T06:40:42.602 INFO:tasks.workunit.client.1.smithi117.stdout:3/788: dread - d0/d3d/d48/d77/fe5 zero size 2024-09-19T06:40:42.604 INFO:tasks.workunit.client.1.smithi117.stdout:8/737: link d1d/d1e/d3b/f7b d1d/d31/d83/dad/ffc 0 2024-09-19T06:40:42.609 INFO:tasks.workunit.client.1.smithi117.stdout:2/807: getdents d0/d7/d29/d35/dbd/d8d 0 2024-09-19T06:40:42.610 INFO:tasks.workunit.client.0.smithi099.stdout:4/612: sync 2024-09-19T06:40:42.610 INFO:tasks.workunit.client.0.smithi099.stdout:2/426: sync 2024-09-19T06:40:42.610 INFO:tasks.workunit.client.0.smithi099.stdout:7/741: sync 2024-09-19T06:40:42.610 INFO:tasks.workunit.client.0.smithi099.stdout:3/767: sync 2024-09-19T06:40:42.610 INFO:tasks.workunit.client.0.smithi099.stdout:6/619: sync 2024-09-19T06:40:42.610 INFO:tasks.workunit.client.0.smithi099.stdout:5/781: dwrite d3/d16/d2f/d34/da4/da5/dce/de5/fc5 [0,4194304] 0 2024-09-19T06:40:42.612 INFO:tasks.workunit.client.1.smithi117.stdout:2/808: write d0/d7/d29/d35/d61/def/f107 [765142,83170] 0 2024-09-19T06:40:42.613 INFO:tasks.workunit.client.0.smithi099.stdout:7/742: chown d7/dcf/d29/d1f/l46 722 1 2024-09-19T06:40:42.613 INFO:tasks.workunit.client.0.smithi099.stdout:5/782: write d3/d1f/d4f/f5c [403478,62371] 0 2024-09-19T06:40:42.614 INFO:tasks.workunit.client.0.smithi099.stdout:2/427: stat d1/d2/d5/d8f/d9 0 2024-09-19T06:40:42.614 INFO:tasks.workunit.client.1.smithi117.stdout:2/809: write d0/d7/d58/db1/fb3 [840398,1951] 0 2024-09-19T06:40:42.615 INFO:tasks.workunit.client.0.smithi099.stdout:7/743: fsync d7/dcf/d29/f4c 0 2024-09-19T06:40:42.620 INFO:tasks.workunit.client.1.smithi117.stdout:8/738: write d1d/ffb [1542736,9103] 0 2024-09-19T06:40:42.620 INFO:tasks.workunit.client.0.smithi099.stdout:4/613: write f11 [736000,126783] 0 2024-09-19T06:40:42.620 INFO:tasks.workunit.client.0.smithi099.stdout:3/768: mkdir d7/d34/d1d/d36/db3/de0/de9 0 2024-09-19T06:40:42.625 INFO:tasks.workunit.client.0.smithi099.stdout:3/769: write d7/d34/d1d/f78 [3522984,82625] 0 2024-09-19T06:40:42.625 INFO:tasks.workunit.client.0.smithi099.stdout:2/428: getdents d1/d2/d5/d8f/d18/d46 0 2024-09-19T06:40:42.626 INFO:tasks.workunit.client.0.smithi099.stdout:4/614: creat d12/fcf x:0 0 0 2024-09-19T06:40:42.627 INFO:tasks.workunit.client.0.smithi099.stdout:5/783: dwrite d3/d16/d2f/f9a [0,4194304] 0 2024-09-19T06:40:42.630 INFO:tasks.workunit.client.0.smithi099.stdout:5/784: write d3/f9 [4750845,2635] 0 2024-09-19T06:40:42.631 INFO:tasks.workunit.client.0.smithi099.stdout:4/615: creat d12/d32/d42/d97/fd0 x:0 0 0 2024-09-19T06:40:42.633 INFO:tasks.workunit.client.0.smithi099.stdout:7/744: write d7/dcf/d29/f1e [2773617,16108] 0 2024-09-19T06:40:42.634 INFO:tasks.workunit.client.0.smithi099.stdout:6/620: truncate d1/d5/d24/d2b/f84 122521 0 2024-09-19T06:40:42.636 INFO:tasks.workunit.client.0.smithi099.stdout:4/616: chown d12/d32/c78 13379 1 2024-09-19T06:40:42.638 INFO:tasks.workunit.client.0.smithi099.stdout:5/785: mkdir d3/d16/d2f/d34/d10c 0 2024-09-19T06:40:42.638 INFO:tasks.workunit.client.0.smithi099.stdout:4/617: readlink d12/d1b/d73/d81/d9b/lb7 0 2024-09-19T06:40:42.639 INFO:tasks.workunit.client.0.smithi099.stdout:3/770: dwrite d7/d34/d1d/d36/fcf [0,4194304] 0 2024-09-19T06:40:42.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.639+0000 7fd9ecd9f640 1 -- 172.21.15.99:0/2489366420 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9e80fc720 msgr2=0x7fd9e80fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:42.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.639+0000 7fd9ecd9f640 1 --2- 172.21.15.99:0/2489366420 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9e80fc720 0x7fd9e80fcb90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc0048d0 tx=0x7fd9dc009da0 comp rx=0 tx=0).stop 2024-09-19T06:40:42.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.639+0000 7fd9ecd9f640 1 -- 172.21.15.99:0/2489366420 shutdown_connections 2024-09-19T06:40:42.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.639+0000 7fd9ecd9f640 1 --2- 172.21.15.99:0/2489366420 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9e80fc720 0x7fd9e80fcb90 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:42.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.639+0000 7fd9ecd9f640 1 --2- 172.21.15.99:0/2489366420 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd9e80fb450 0x7fd9e80fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:42.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.639+0000 7fd9ecd9f640 1 -- 172.21.15.99:0/2489366420 >> 172.21.15.99:0/2489366420 conn(0x7fd9e80f6c10 msgr2=0x7fd9e80f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:42.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.640+0000 7fd9ecd9f640 1 -- 172.21.15.99:0/2489366420 shutdown_connections 2024-09-19T06:40:42.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.640+0000 7fd9ecd9f640 1 -- 172.21.15.99:0/2489366420 wait complete. 2024-09-19T06:40:42.642 INFO:tasks.workunit.client.0.smithi099.stdout:4/618: chown d12/d32/d42/d5c/d51 777004221 1 2024-09-19T06:40:42.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.640+0000 7fd9ecd9f640 1 Processor -- start 2024-09-19T06:40:42.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.640+0000 7fd9ecd9f640 1 -- start start 2024-09-19T06:40:42.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.641+0000 7fd9ecd9f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9e80fb450 0x7fd9e810d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:42.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.641+0000 7fd9ecd9f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd9e80fc720 0x7fd9e810d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:42.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.641+0000 7fd9ecd9f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e810dc90 con 0x7fd9e80fb450 2024-09-19T06:40:42.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.641+0000 7fd9ecd9f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e810e4b0 con 0x7fd9e80fc720 2024-09-19T06:40:42.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.641+0000 7fd9e659c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9e80fb450 0x7fd9e810d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:42.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.641+0000 7fd9e659c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9e80fb450 0x7fd9e810d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52048/0 (socket says 172.21.15.99:52048) 2024-09-19T06:40:42.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.641+0000 7fd9e659c640 1 -- 172.21.15.99:0/3390405180 learned_addr learned my addr 172.21.15.99:0/3390405180 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:40:42.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.641+0000 7fd9e5d9b640 1 --2- 172.21.15.99:0/3390405180 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd9e80fc720 0x7fd9e810d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:42.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.641+0000 7fd9e659c640 1 -- 172.21.15.99:0/3390405180 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd9e80fc720 msgr2=0x7fd9e810d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:42.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.641+0000 7fd9e659c640 1 --2- 172.21.15.99:0/3390405180 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd9e80fc720 0x7fd9e810d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:42.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.642+0000 7fd9e659c640 1 -- 172.21.15.99:0/3390405180 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9dc005040 con 0x7fd9e80fb450 2024-09-19T06:40:42.644 INFO:tasks.workunit.client.0.smithi099.stdout:3/771: dread - d7/d34/d1d/d20/d75/d9d/fd4 zero size 2024-09-19T06:40:42.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.642+0000 7fd9e659c640 1 --2- 172.21.15.99:0/3390405180 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9e80fb450 0x7fd9e810d100 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd9d8002a50 tx=0x7fd9d8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:42.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.642+0000 7fd9d6ffd640 1 -- 172.21.15.99:0/3390405180 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9d8007c30 con 0x7fd9e80fb450 2024-09-19T06:40:42.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.642+0000 7fd9d6ffd640 1 -- 172.21.15.99:0/3390405180 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd9d800f040 con 0x7fd9e80fb450 2024-09-19T06:40:42.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.642+0000 7fd9d6ffd640 1 -- 172.21.15.99:0/3390405180 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9d800da90 con 0x7fd9e80fb450 2024-09-19T06:40:42.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.642+0000 7fd9ecd9f640 1 -- 172.21.15.99:0/3390405180 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9e810e6e0 con 0x7fd9e80fb450 2024-09-19T06:40:42.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.642+0000 7fd9ecd9f640 1 -- 172.21.15.99:0/3390405180 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9e810ebb0 con 0x7fd9e80fb450 2024-09-19T06:40:42.645 INFO:tasks.workunit.client.0.smithi099.stdout:5/786: mknod d3/d16/d5e/c10d 0 2024-09-19T06:40:42.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.644+0000 7fd9ecd9f640 1 -- 172.21.15.99:0/3390405180 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9e80fa8b0 con 0x7fd9e80fb450 2024-09-19T06:40:42.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.645+0000 7fd9d6ffd640 1 -- 172.21.15.99:0/3390405180 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7fd9d800dc70 con 0x7fd9e80fb450 2024-09-19T06:40:42.646 INFO:tasks.workunit.client.0.smithi099.stdout:3/772: readlink d7/d34/d1d/d20/lb6 0 2024-09-19T06:40:42.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.646+0000 7fd9d6ffd640 1 --2- 172.21.15.99:0/3390405180 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7fd9d006e730 0x7fd9d0070be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:42.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.646+0000 7fd9d6ffd640 1 -- 172.21.15.99:0/3390405180 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fd9d808d750 con 0x7fd9e80fb450 2024-09-19T06:40:42.648 INFO:tasks.workunit.client.0.smithi099.stdout:4/619: fsync d12/f38 0 2024-09-19T06:40:42.648 INFO:tasks.workunit.client.0.smithi099.stdout:6/621: dwrite d1/d5/d24/d2e/f31 [0,4194304] 0 2024-09-19T06:40:42.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.647+0000 7fd9e5d9b640 1 --2- 172.21.15.99:0/3390405180 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7fd9d006e730 0x7fd9d0070be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:42.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.648+0000 7fd9e5d9b640 1 --2- 172.21.15.99:0/3390405180 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7fd9d006e730 0x7fd9d0070be0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc00b020 tx=0x7fd9dc009da0 comp rx=0 tx=0).ready entity=mgr.24369 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:42.649 INFO:tasks.workunit.client.0.smithi099.stdout:7/745: rename d7/dcf/d29/d1f/d45/d48/ddc/fe1 to d7/dcf/d29/d34/da1/dd5/f109 0 2024-09-19T06:40:42.654 INFO:tasks.workunit.client.0.smithi099.stdout:7/746: creat d7/d39/d7d/f10a x:0 0 0 2024-09-19T06:40:42.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.653+0000 7fd9d6ffd640 1 -- 172.21.15.99:0/3390405180 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7fd9d804f6d0 con 0x7fd9e80fb450 2024-09-19T06:40:42.656 INFO:tasks.workunit.client.0.smithi099.stdout:5/787: rmdir d3/d16/d2f/d34/d3c/d65/dd5 0 2024-09-19T06:40:42.658 INFO:tasks.workunit.client.0.smithi099.stdout:5/788: mkdir d3/d7/d90/da6/d10e 0 2024-09-19T06:40:42.659 INFO:tasks.workunit.client.0.smithi099.stdout:2/429: dread d1/d2/d5/d8f/d18/d27/d5b/f8c [0,4194304] 0 2024-09-19T06:40:42.660 INFO:tasks.workunit.client.0.smithi099.stdout:4/620: rename d12/d1b/d73/d81/d89/f9a to d12/d32/d42/fd1 0 2024-09-19T06:40:42.662 INFO:tasks.workunit.client.0.smithi099.stdout:4/621: write d12/d32/d42/d5c/d9d/fb2 [582913,57222] 0 2024-09-19T06:40:42.663 INFO:tasks.workunit.client.0.smithi099.stdout:2/430: symlink d1/d2/d5/d8f/d18/d2d/d88/l91 0 2024-09-19T06:40:42.665 INFO:tasks.workunit.client.0.smithi099.stdout:5/789: rename d3/d16/d5e/cc9 to d3/d16/d2f/d34/da4/da5/c10f 0 2024-09-19T06:40:42.671 INFO:tasks.workunit.client.0.smithi099.stdout:5/790: write d3/d1f/f8e [1993879,17502] 0 2024-09-19T06:40:42.672 INFO:tasks.workunit.client.0.smithi099.stdout:3/773: write d7/d34/d1d/d36/d69/d96/fa0 [1560390,122757] 0 2024-09-19T06:40:42.672 INFO:tasks.workunit.client.1.smithi117.stdout:5/813: sync 2024-09-19T06:40:42.676 INFO:tasks.workunit.client.0.smithi099.stdout:5/791: creat d3/d7/d90/dd2/f110 x:0 0 0 2024-09-19T06:40:42.676 INFO:tasks.workunit.client.0.smithi099.stdout:3/774: readlink d7/d34/d1d/d20/l8a 0 2024-09-19T06:40:42.681 INFO:tasks.workunit.client.0.smithi099.stdout:5/792: mknod d3/d7/d90/df4/c111 0 2024-09-19T06:40:42.681 INFO:tasks.workunit.client.0.smithi099.stdout:7/747: dwrite d7/dcf/d29/f2f [0,4194304] 0 2024-09-19T06:40:42.682 INFO:tasks.workunit.client.0.smithi099.stdout:3/775: mknod d7/d34/d1d/d36/d69/cea 0 2024-09-19T06:40:42.683 INFO:tasks.workunit.client.0.smithi099.stdout:4/622: dread d12/d1b/f44 [4194304,4194304] 0 2024-09-19T06:40:42.683 INFO:tasks.workunit.client.0.smithi099.stdout:6/622: dread d1/d5/d38/f59 [0,4194304] 0 2024-09-19T06:40:42.686 INFO:tasks.workunit.client.0.smithi099.stdout:3/776: write d7/d34/d1d/d36/fcf [2491093,92659] 0 2024-09-19T06:40:42.689 INFO:tasks.workunit.client.0.smithi099.stdout:2/431: dwrite d1/d2/d5/d8f/d9/f3c [0,4194304] 0 2024-09-19T06:40:42.693 INFO:tasks.workunit.client.0.smithi099.stdout:2/432: write d1/d2/d5/f40 [3208349,88363] 0 2024-09-19T06:40:42.694 INFO:tasks.workunit.client.0.smithi099.stdout:3/777: fsync d7/d34/d1d/d36/d42/f43 0 2024-09-19T06:40:42.697 INFO:tasks.workunit.client.0.smithi099.stdout:5/793: dwrite d3/d14/fac [0,4194304] 0 2024-09-19T06:40:42.698 INFO:tasks.workunit.client.0.smithi099.stdout:3/778: chown d7/d34/d1d/d36/f4f 650 1 2024-09-19T06:40:42.701 INFO:tasks.workunit.client.0.smithi099.stdout:7/748: link d7/dcf/d29/d34/da1/dd5/f109 d7/dcf/d29/d1f/d45/f10b 0 2024-09-19T06:40:42.704 INFO:tasks.workunit.client.0.smithi099.stdout:3/779: dread - d7/d34/d1d/d36/d69/d6d/f8d zero size 2024-09-19T06:40:42.704 INFO:tasks.workunit.client.0.smithi099.stdout:3/780: read - d7/d34/d1d/d20/d75/fe3 zero size 2024-09-19T06:40:42.706 INFO:tasks.workunit.client.0.smithi099.stdout:2/433: truncate d1/d2/d5/d13/d2c/f38 285129 0 2024-09-19T06:40:42.707 INFO:tasks.workunit.client.0.smithi099.stdout:5/794: creat d3/d16/f112 x:0 0 0 2024-09-19T06:40:42.709 INFO:tasks.workunit.client.0.smithi099.stdout:2/434: read d1/f47 [5720884,3062] 0 2024-09-19T06:40:42.710 INFO:tasks.workunit.client.0.smithi099.stdout:2/435: chown d1/d2/d4d/f66 28 1 2024-09-19T06:40:42.710 INFO:tasks.workunit.client.0.smithi099.stdout:5/795: creat d3/d16/d2f/d34/da4/f113 x:0 0 0 2024-09-19T06:40:42.711 INFO:tasks.workunit.client.0.smithi099.stdout:7/749: link d7/dcf/l90 d7/dcf/d29/d1f/d45/d48/d63/d75/l10c 0 2024-09-19T06:40:42.711 INFO:tasks.workunit.client.0.smithi099.stdout:3/781: symlink d7/d34/d1d/d36/d69/leb 0 2024-09-19T06:40:42.712 INFO:tasks.workunit.client.0.smithi099.stdout:2/436: readlink d1/d2/d5/d8f/d9/d63/l28 0 2024-09-19T06:40:42.712 INFO:tasks.workunit.client.0.smithi099.stdout:5/796: mkdir d3/d14/d114 0 2024-09-19T06:40:42.714 INFO:tasks.workunit.client.0.smithi099.stdout:2/437: write d1/d2/d5/d6/f87 [849878,100361] 0 2024-09-19T06:40:42.714 INFO:tasks.workunit.client.0.smithi099.stdout:7/750: mknod d7/dcf/d29/d1f/d45/d48/c10d 0 2024-09-19T06:40:42.716 INFO:tasks.workunit.client.0.smithi099.stdout:2/438: write d1/d2/d5/d8f/d9/f67 [515521,30081] 0 2024-09-19T06:40:42.716 INFO:tasks.workunit.client.0.smithi099.stdout:3/782: rename d7/fb2 to d7/d34/d1d/d36/d69/fec 0 2024-09-19T06:40:42.718 INFO:tasks.workunit.client.0.smithi099.stdout:7/751: unlink d7/dcf/d29/d1f/d45/d48/fbd 0 2024-09-19T06:40:42.719 INFO:tasks.workunit.client.0.smithi099.stdout:5/797: link d3/d16/f58 d3/d16/d2f/d34/da4/da5/dcd/f115 0 2024-09-19T06:40:42.719 INFO:tasks.workunit.client.0.smithi099.stdout:5/798: chown d3/d14 1 1 2024-09-19T06:40:42.720 INFO:tasks.workunit.client.0.smithi099.stdout:2/439: mkdir d1/d2/d5/d8f/d18/d27/d5b/d92 0 2024-09-19T06:40:42.721 INFO:tasks.workunit.client.0.smithi099.stdout:2/440: fdatasync d1/d2/d5/d8f/fa 0 2024-09-19T06:40:42.722 INFO:tasks.workunit.client.0.smithi099.stdout:5/799: truncate d3/d2a/fb2 109173 0 2024-09-19T06:40:42.722 INFO:tasks.workunit.client.0.smithi099.stdout:5/800: dread - d3/d16/f112 zero size 2024-09-19T06:40:42.723 INFO:tasks.workunit.client.0.smithi099.stdout:3/783: link d7/d34/d1d/l50 d7/d34/d1d/d36/db8/led 0 2024-09-19T06:40:42.725 INFO:tasks.workunit.client.0.smithi099.stdout:7/752: link d7/dcf/d29/c5a d7/dc7/d67/c10e 0 2024-09-19T06:40:42.726 INFO:tasks.workunit.client.0.smithi099.stdout:2/441: rename d1/d2/d4d/f66 to d1/d2/d5/d8f/f93 0 2024-09-19T06:40:42.728 INFO:tasks.workunit.client.0.smithi099.stdout:3/784: mkdir d7/d34/d1d/d36/d69/d6d/dee 0 2024-09-19T06:40:42.729 INFO:tasks.workunit.client.0.smithi099.stdout:2/442: symlink d1/d2/d5/d77/l94 0 2024-09-19T06:40:42.731 INFO:tasks.workunit.client.0.smithi099.stdout:5/801: dwrite d3/d7/d90/dd2/f110 [0,4194304] 0 2024-09-19T06:40:42.732 INFO:tasks.workunit.client.0.smithi099.stdout:7/753: dread d7/dcf/d29/d1f/fce [0,4194304] 0 2024-09-19T06:40:42.733 INFO:tasks.workunit.client.0.smithi099.stdout:3/785: fsync d7/d34/d1d/d20/d58/fce 0 2024-09-19T06:40:42.736 INFO:tasks.workunit.client.0.smithi099.stdout:2/443: fdatasync d1/d2/d5/d8f/d18/d27/d5b/f8c 0 2024-09-19T06:40:42.737 INFO:tasks.workunit.client.0.smithi099.stdout:3/786: truncate d7/f14 6181901 0 2024-09-19T06:40:42.738 INFO:tasks.workunit.client.0.smithi099.stdout:7/754: unlink d7/dcf/d29/d1f/d45/d48/d63/d75/fee 0 2024-09-19T06:40:42.738 INFO:tasks.workunit.client.0.smithi099.stdout:2/444: readlink d1/d2/d5/d8f/d9/l22 0 2024-09-19T06:40:42.739 INFO:tasks.workunit.client.0.smithi099.stdout:5/802: unlink d3/d16/d7d/cf5 0 2024-09-19T06:40:42.740 INFO:tasks.workunit.client.0.smithi099.stdout:2/445: read - d1/d2/d5/d8f/d18/d27/f72 zero size 2024-09-19T06:40:42.743 INFO:tasks.workunit.client.0.smithi099.stdout:3/787: unlink d7/d34/d1d/d36/d69/d6d/d8f/lc1 0 2024-09-19T06:40:42.744 INFO:tasks.workunit.client.0.smithi099.stdout:2/446: unlink d1/d2/d5/d8f/d9/l51 0 2024-09-19T06:40:42.745 INFO:tasks.workunit.client.0.smithi099.stdout:2/447: readlink d1/d2/d5/d77/l94 0 2024-09-19T06:40:42.746 INFO:tasks.workunit.client.0.smithi099.stdout:2/448: creat d1/d2/d4d/f95 x:0 0 0 2024-09-19T06:40:42.749 INFO:tasks.workunit.client.0.smithi099.stdout:2/449: creat d1/d2/d5/d8f/d18/d2d/d88/f96 x:0 0 0 2024-09-19T06:40:42.751 INFO:tasks.workunit.client.1.smithi117.stdout:2/810: rename d0/d7/d29/d35/d3d/c46 to d0/d7/d29/df4/c12f 0 2024-09-19T06:40:42.753 INFO:tasks.workunit.client.1.smithi117.stdout:8/739: write d1d/d2a/fa1 [2035990,94088] 0 2024-09-19T06:40:42.756 INFO:tasks.workunit.client.1.smithi117.stdout:8/740: creat d1d/d2a/d3f/d4b/d91/ffd x:0 0 0 2024-09-19T06:40:42.757 INFO:tasks.workunit.client.0.smithi099.stdout:2/450: write d1/d2/d5/d8f/d18/f23 [2973836,61869] 0 2024-09-19T06:40:42.757 INFO:tasks.workunit.client.1.smithi117.stdout:8/741: fdatasync d1d/d2a/d3f/d73/f85 0 2024-09-19T06:40:42.758 INFO:tasks.workunit.client.1.smithi117.stdout:5/814: write d17/d1b/d5d/d86/fae [1949029,58605] 0 2024-09-19T06:40:42.759 INFO:tasks.workunit.client.0.smithi099.stdout:7/755: dwrite d7/dcf/d29/f93 [0,4194304] 0 2024-09-19T06:40:42.761 INFO:tasks.workunit.client.0.smithi099.stdout:2/451: chown d1/d2/d5/d8f/d18/d27/d5b/f7e 0 1 2024-09-19T06:40:42.763 INFO:tasks.workunit.client.0.smithi099.stdout:7/756: creat d7/dcf/d29/d1f/d45/d48/d63/f10f x:0 0 0 2024-09-19T06:40:42.764 INFO:tasks.workunit.client.1.smithi117.stdout:8/742: dwrite d1d/d2a/d3f/d73/ddd/f43 [4194304,4194304] 0 2024-09-19T06:40:42.765 INFO:tasks.workunit.client.1.smithi117.stdout:8/743: readlink d1d/d2a/d3f/d4c/daa/lbb 0 2024-09-19T06:40:42.768 INFO:tasks.workunit.client.0.smithi099.stdout:7/757: symlink d7/d39/l110 0 2024-09-19T06:40:42.768 INFO:tasks.workunit.client.0.smithi099.stdout:2/452: mknod d1/d2/d5/d8f/d9/c97 0 2024-09-19T06:40:42.772 INFO:tasks.workunit.client.0.smithi099.stdout:3/788: dread d7/d34/d1d/d57/fbc [0,4194304] 0 2024-09-19T06:40:42.773 INFO:tasks.workunit.client.0.smithi099.stdout:7/758: creat d7/dcf/d29/d1f/dec/f111 x:0 0 0 2024-09-19T06:40:42.774 INFO:tasks.workunit.client.1.smithi117.stdout:8/744: dwrite d1d/d2a/d3f/d4b/d5f/dbf/fe6 [0,4194304] 0 2024-09-19T06:40:42.775 INFO:tasks.workunit.client.0.smithi099.stdout:3/789: write d7/f18 [1781435,42870] 0 2024-09-19T06:40:42.779 INFO:tasks.workunit.client.0.smithi099.stdout:7/759: dread d7/dcf/d29/d1f/f2a [0,4194304] 0 2024-09-19T06:40:42.781 INFO:tasks.workunit.client.0.smithi099.stdout:7/760: chown d7/dcf/d29/d1f/d45/d48/d63/d71/l102 2482 1 2024-09-19T06:40:42.781 INFO:tasks.workunit.client.1.smithi117.stdout:8/745: dwrite d1d/d2a/d3f/d4b/d66/ffa [0,4194304] 0 2024-09-19T06:40:42.783 INFO:tasks.workunit.client.1.smithi117.stdout:2/811: dread d0/d7/d1e/d20/dc9/fe8 [0,4194304] 0 2024-09-19T06:40:42.790 INFO:tasks.workunit.client.1.smithi117.stdout:2/812: dwrite d0/d7/d29/d35/dbd/fe4 [0,4194304] 0 2024-09-19T06:40:42.790 INFO:tasks.workunit.client.0.smithi099.stdout:7/761: link d7/d39/d7d/f10a d7/dcf/d29/d34/f112 0 2024-09-19T06:40:42.792 INFO:tasks.workunit.client.1.smithi117.stdout:2/813: symlink d0/d64/l130 0 2024-09-19T06:40:42.797 INFO:tasks.workunit.client.0.smithi099.stdout:2/453: dwrite d1/d2/d5/d8f/d9/f6f [8388608,4194304] 0 2024-09-19T06:40:42.800 INFO:tasks.workunit.client.0.smithi099.stdout:2/454: truncate d1/d2/d5/d8f/f80 423157 0 2024-09-19T06:40:42.807 INFO:tasks.workunit.client.0.smithi099.stdout:2/455: getdents d1/d2/d5/d8f/d18/d27/d5b/d92 0 2024-09-19T06:40:42.808 INFO:tasks.workunit.client.0.smithi099.stdout:2/456: dread - d1/f3e zero size 2024-09-19T06:40:42.811 INFO:tasks.workunit.client.0.smithi099.stdout:2/457: mkdir d1/d2/d5/d77/d98 0 2024-09-19T06:40:42.811 INFO:tasks.workunit.client.0.smithi099.stdout:2/458: dread - d1/f3e zero size 2024-09-19T06:40:42.813 INFO:tasks.workunit.client.0.smithi099.stdout:2/459: creat d1/d2/d5/d13/d2c/f99 x:0 0 0 2024-09-19T06:40:42.814 INFO:tasks.workunit.client.0.smithi099.stdout:7/762: getdents d7/dcf/d29/d34 0 2024-09-19T06:40:42.815 INFO:tasks.workunit.client.0.smithi099.stdout:2/460: mkdir d1/d2/d5/d8f/d18/d2d/d9a 0 2024-09-19T06:40:42.816 INFO:tasks.workunit.client.0.smithi099.stdout:7/763: mknod d7/dcf/d29/c113 0 2024-09-19T06:40:42.816 INFO:tasks.workunit.client.0.smithi099.stdout:2/461: write d1/d2/d5/d13/d2c/f49 [2697155,13788] 0 2024-09-19T06:40:42.819 INFO:tasks.workunit.client.1.smithi117.stdout:6/579: sync 2024-09-19T06:40:42.819 INFO:tasks.workunit.client.1.smithi117.stdout:9/776: sync 2024-09-19T06:40:42.819 INFO:tasks.workunit.client.0.smithi099.stdout:7/764: symlink d7/dcf/d29/d1f/d45/d48/dda/l114 0 2024-09-19T06:40:42.820 INFO:tasks.workunit.client.0.smithi099.stdout:7/765: chown d7/dcf/d29/d1f 184286682 1 2024-09-19T06:40:42.821 INFO:tasks.workunit.client.1.smithi117.stdout:9/777: creat d4/d1c/d7a/d52/d8d/dc1/f107 x:0 0 0 2024-09-19T06:40:42.823 INFO:tasks.workunit.client.0.smithi099.stdout:3/790: dread d7/d34/d28/f48 [0,4194304] 0 2024-09-19T06:40:42.824 INFO:tasks.workunit.client.1.smithi117.stdout:9/778: creat d4/d1c/f108 x:0 0 0 2024-09-19T06:40:42.826 INFO:tasks.workunit.client.0.smithi099.stdout:2/462: dread d1/d2/d5/d8f/d18/f2f [0,4194304] 0 2024-09-19T06:40:42.829 INFO:tasks.workunit.client.0.smithi099.stdout:7/766: dwrite d7/dc7/de7/ff0 [4194304,4194304] 0 2024-09-19T06:40:42.832 INFO:tasks.workunit.client.0.smithi099.stdout:7/767: write d7/dcf/d29/d34/f35 [2348918,62827] 0 2024-09-19T06:40:42.834 INFO:tasks.workunit.client.0.smithi099.stdout:2/463: unlink d1/d2/d5/d8f/d18/d46/c60 0 2024-09-19T06:40:42.836 INFO:tasks.workunit.client.0.smithi099.stdout:3/791: dwrite d7/d34/d1d/d20/d58/d5c/f5d [0,4194304] 0 2024-09-19T06:40:42.837 INFO:tasks.workunit.client.0.smithi099.stdout:7/768: mkdir d7/dcf/d29/d1f/d45/d48/dda/d115 0 2024-09-19T06:40:42.840 INFO:tasks.workunit.client.0.smithi099.stdout:7/769: symlink d7/d39/l116 0 2024-09-19T06:40:42.843 INFO:tasks.workunit.client.0.smithi099.stdout:3/792: mkdir d7/d34/d1d/d36/db3/de0/def 0 2024-09-19T06:40:42.844 INFO:tasks.workunit.client.0.smithi099.stdout:7/770: unlink d7/fc6 0 2024-09-19T06:40:42.846 INFO:tasks.workunit.client.0.smithi099.stdout:3/793: creat d7/d34/d1d/d36/db3/de0/de9/ff0 x:0 0 0 2024-09-19T06:40:42.846 INFO:tasks.workunit.client.0.smithi099.stdout:7/771: write d7/dcf/d97/fd4 [532806,82853] 0 2024-09-19T06:40:42.847 INFO:tasks.workunit.client.0.smithi099.stdout:7/772: chown d7/dcf/d29/d34/da1/fa9 1 1 2024-09-19T06:40:42.848 INFO:tasks.workunit.client.0.smithi099.stdout:3/794: truncate d7/d34/d1d/d36/d69/d6d/d8f/fd7 558598 0 2024-09-19T06:40:42.849 INFO:tasks.workunit.client.0.smithi099.stdout:7/773: symlink d7/dcf/d97/l117 0 2024-09-19T06:40:42.851 INFO:tasks.workunit.client.0.smithi099.stdout:2/464: truncate d1/d2/d5/d8f/d18/d27/f48 2676303 0 2024-09-19T06:40:42.852 INFO:tasks.workunit.client.0.smithi099.stdout:2/465: fdatasync d1/d2/d5/d8f/d18/d27/f72 0 2024-09-19T06:40:42.856 INFO:tasks.workunit.client.0.smithi099.stdout:2/466: mknod d1/d2/d5/d8f/d18/d2d/d88/c9b 0 2024-09-19T06:40:42.857 INFO:tasks.workunit.client.0.smithi099.stdout:7/774: dwrite d7/fd2 [0,4194304] 0 2024-09-19T06:40:42.859 INFO:tasks.workunit.client.0.smithi099.stdout:2/467: rename d1/f3e to d1/d2/d5/d8f/d18/d27/f9c 0 2024-09-19T06:40:42.860 INFO:tasks.workunit.client.0.smithi099.stdout:7/775: creat d7/dcf/d29/d1f/d45/d48/d63/f118 x:0 0 0 2024-09-19T06:40:42.863 INFO:tasks.workunit.client.0.smithi099.stdout:2/468: creat d1/d2/d4d/d55/f9d x:0 0 0 2024-09-19T06:40:42.864 INFO:tasks.workunit.client.0.smithi099.stdout:7/776: rmdir d7/dc7/d106 0 2024-09-19T06:40:42.865 INFO:tasks.workunit.client.0.smithi099.stdout:2/469: mknod d1/d2/d5/d13/c9e 0 2024-09-19T06:40:42.866 INFO:tasks.workunit.client.0.smithi099.stdout:2/470: dread - d1/d2/d4d/f95 zero size 2024-09-19T06:40:42.866 INFO:tasks.workunit.client.0.smithi099.stdout:2/471: chown d1/d2/d5/d8f/d18/d2d/d88/f96 30 1 2024-09-19T06:40:42.868 INFO:tasks.workunit.client.0.smithi099.stdout:2/472: creat d1/d2/d5/d13/d2c/f9f x:0 0 0 2024-09-19T06:40:42.871 INFO:tasks.workunit.client.0.smithi099.stdout:2/473: rename d1/d2/d5/d13/l50 to d1/d2/d5/d13/d2c/la0 0 2024-09-19T06:40:42.874 INFO:tasks.workunit.client.0.smithi099.stdout:2/474: creat d1/d2/d4d/d55/d79/fa1 x:0 0 0 2024-09-19T06:40:42.876 INFO:tasks.workunit.client.0.smithi099.stdout:3/795: dread d7/d34/d28/fa9 [0,4194304] 0 2024-09-19T06:40:42.878 INFO:tasks.workunit.client.0.smithi099.stdout:3/796: chown d7/d34/d1d/d36/d42/c63 0 1 2024-09-19T06:40:42.878 INFO:tasks.workunit.client.0.smithi099.stdout:7/777: truncate d7/dcf/d29/f2f 3305479 0 2024-09-19T06:40:42.881 INFO:tasks.workunit.client.0.smithi099.stdout:2/475: dwrite d1/d2/d5/d13/f1b [0,4194304] 0 2024-09-19T06:40:42.881 INFO:tasks.workunit.client.0.smithi099.stdout:7/778: chown d7/dcf/d29/d1f/d45/d48/d63/d75/dd8/df6/fff 79523840 1 2024-09-19T06:40:42.889 INFO:tasks.workunit.client.0.smithi099.stdout:3/797: write d7/d34/d1d/d36/d69/fec [940598,110906] 0 2024-09-19T06:40:42.893 INFO:tasks.workunit.client.0.smithi099.stdout:2/476: dwrite d1/d2/d5/d8f/d36/f53 [0,4194304] 0 2024-09-19T06:40:42.894 INFO:tasks.workunit.client.0.smithi099.stdout:7/779: dwrite d7/dcf/d29/d1f/d45/d48/d63/d75/dd8/df6/fff [0,4194304] 0 2024-09-19T06:40:42.894 INFO:tasks.workunit.client.0.smithi099.stdout:2/477: fsync d1/d2/f90 0 2024-09-19T06:40:42.899 INFO:tasks.workunit.client.0.smithi099.stdout:2/478: read - d1/d2/d5/d8f/d18/d27/f72 zero size 2024-09-19T06:40:42.899 INFO:tasks.workunit.client.0.smithi099.stdout:2/479: fdatasync d1/f47 0 2024-09-19T06:40:42.901 INFO:tasks.workunit.client.0.smithi099.stdout:3/798: rename d7/d34/d1d/d20/d75/d79/f86 to d7/d34/d1d/d20/d58/d5c/ff1 0 2024-09-19T06:40:42.901 INFO:tasks.workunit.client.0.smithi099.stdout:7/780: mknod d7/dcf/d29/d34/da1/dd5/c119 0 2024-09-19T06:40:42.904 INFO:tasks.workunit.client.0.smithi099.stdout:3/799: write d7/d34/d1d/d36/d69/d6d/d8f/fd7 [1551802,35163] 0 2024-09-19T06:40:42.905 INFO:tasks.workunit.client.0.smithi099.stdout:2/480: dread d1/d2/d5/d6/f87 [0,4194304] 0 2024-09-19T06:40:42.906 INFO:tasks.workunit.client.0.smithi099.stdout:7/781: truncate d7/dcf/d29/d1f/d45/d48/d63/d75/fa4 167938 0 2024-09-19T06:40:42.907 INFO:tasks.workunit.client.1.smithi117.stdout:9/779: dwrite d4/d1c/d54/feb [0,4194304] 0 2024-09-19T06:40:42.908 INFO:tasks.workunit.client.1.smithi117.stdout:9/780: fdatasync d4/d1c/f59 0 2024-09-19T06:40:42.909 INFO:tasks.workunit.client.0.smithi099.stdout:2/481: creat d1/d2/d5/d13/fa2 x:0 0 0 2024-09-19T06:40:42.910 INFO:tasks.workunit.client.1.smithi117.stdout:8/746: dwrite d1d/d2a/d3f/d4b/d66/dac/faf [0,4194304] 0 2024-09-19T06:40:42.912 INFO:tasks.workunit.client.1.smithi117.stdout:9/781: readlink d4/d1c/d7a/d16/lbd 0 2024-09-19T06:40:42.913 INFO:tasks.workunit.client.1.smithi117.stdout:2/814: dwrite d0/d7/d1e/f31 [0,4194304] 0 2024-09-19T06:40:42.916 INFO:tasks.workunit.client.1.smithi117.stdout:9/782: read d4/d20/f50 [437694,42592] 0 2024-09-19T06:40:42.918 INFO:tasks.workunit.client.0.smithi099.stdout:7/782: link d7/fde d7/dcf/d29/d1f/d45/d48/d63/d75/dd8/f11a 0 2024-09-19T06:40:42.920 INFO:tasks.workunit.client.0.smithi099.stdout:2/482: getdents d1/d2/d5/d8f/d18 0 2024-09-19T06:40:42.922 INFO:tasks.workunit.client.1.smithi117.stdout:2/815: dwrite d0/d12/d32/d7d/f90 [0,4194304] 0 2024-09-19T06:40:42.923 INFO:tasks.workunit.client.0.smithi099.stdout:7/783: mkdir d7/dcf/d29/d11b 0 2024-09-19T06:40:42.923 INFO:tasks.workunit.client.1.smithi117.stdout:9/783: dwrite d4/d1c/d73/d93/fa0 [4194304,4194304] 0 2024-09-19T06:40:42.924 INFO:tasks.workunit.client.1.smithi117.stdout:9/784: fsync d4/d1c/ffa 0 2024-09-19T06:40:42.925 INFO:tasks.workunit.client.1.smithi117.stdout:2/816: write d0/d12/d32/db5/f50 [4111054,1162] 0 2024-09-19T06:40:42.926 INFO:tasks.workunit.client.0.smithi099.stdout:2/483: mkdir d1/d2/d5/d8f/d9/da3 0 2024-09-19T06:40:42.930 INFO:tasks.workunit.client.0.smithi099.stdout:7/784: mknod d7/dcf/d29/d1f/deb/c11c 0 2024-09-19T06:40:42.933 INFO:tasks.workunit.client.0.smithi099.stdout:7/785: dread - d7/dcf/d29/d1f/fd7 zero size 2024-09-19T06:40:42.934 INFO:tasks.workunit.client.1.smithi117.stdout:9/785: creat d4/f109 x:0 0 0 2024-09-19T06:40:42.935 INFO:tasks.workunit.client.1.smithi117.stdout:2/817: dwrite d0/d7/d1e/d20/dbc/d116/d98/dd2/f108 [0,4194304] 0 2024-09-19T06:40:42.937 INFO:tasks.workunit.client.0.smithi099.stdout:2/484: dwrite d1/d2/d5/d8f/d9/f67 [0,4194304] 0 2024-09-19T06:40:42.939 INFO:tasks.workunit.client.0.smithi099.stdout:2/485: chown d1/d2/d5/f40 171 1 2024-09-19T06:40:42.940 INFO:tasks.workunit.client.1.smithi117.stdout:2/818: unlink d0/d7/c54 0 2024-09-19T06:40:42.941 INFO:tasks.workunit.client.0.smithi099.stdout:7/786: mkdir d7/dcf/d29/d34/da1/dd5/d11d 0 2024-09-19T06:40:42.951 INFO:tasks.workunit.client.1.smithi117.stdout:1/705: sync 2024-09-19T06:40:42.951 INFO:tasks.workunit.client.1.smithi117.stdout:4/989: sync 2024-09-19T06:40:42.951 INFO:tasks.workunit.client.0.smithi099.stdout:2/486: dwrite d1/d2/d5/d13/f54 [0,4194304] 0 2024-09-19T06:40:42.954 INFO:tasks.workunit.client.1.smithi117.stdout:4/990: symlink d3/db/d20/d35/d79/dd4/l141 0 2024-09-19T06:40:42.955 INFO:tasks.workunit.client.0.smithi099.stdout:3/800: dread d7/d34/d1d/d36/d42/f8b [0,4194304] 0 2024-09-19T06:40:42.958 INFO:tasks.workunit.client.0.smithi099.stdout:3/801: rmdir d7/d34/d1d/d20/d58/d5c 39 2024-09-19T06:40:42.959 INFO:tasks.workunit.client.1.smithi117.stdout:1/706: rename d3/d18/d23/l5a to d3/d18/d56/lf7 0 2024-09-19T06:40:42.960 INFO:tasks.workunit.client.1.smithi117.stdout:4/991: dwrite d3/d65/d66/dce/f124 [0,4194304] 0 2024-09-19T06:40:42.961 INFO:tasks.workunit.client.0.smithi099.stdout:3/802: rmdir d7/d34/d1d/d36/d42 39 2024-09-19T06:40:42.962 INFO:tasks.workunit.client.1.smithi117.stdout:1/707: mkdir d3/d18/d91/df8 0 2024-09-19T06:40:42.962 INFO:tasks.workunit.client.0.smithi099.stdout:3/803: dread - d7/d34/d1d/d20/d58/fb4 zero size 2024-09-19T06:40:42.962 INFO:tasks.workunit.client.0.smithi099.stdout:2/487: link d1/d2/d4d/l31 d1/d2/d5/d77/la4 0 2024-09-19T06:40:42.963 INFO:tasks.workunit.client.1.smithi117.stdout:4/992: write d3/db/d20/f12b [958593,38111] 0 2024-09-19T06:40:42.964 INFO:tasks.workunit.client.0.smithi099.stdout:3/804: fsync d7/d34/d1d/d57/fc8 0 2024-09-19T06:40:42.967 INFO:tasks.workunit.client.1.smithi117.stdout:8/747: dread d1d/f40 [0,4194304] 0 2024-09-19T06:40:42.970 INFO:tasks.workunit.client.1.smithi117.stdout:4/993: rmdir d3/d1b/d63/d8e/d116/d11a 0 2024-09-19T06:40:42.973 INFO:tasks.workunit.client.0.smithi099.stdout:3/805: rename d7/d34/d1d/d36/d42/c71 to d7/d34/d1d/d36/d69/d6d/d8f/cf2 0 2024-09-19T06:40:42.974 INFO:tasks.workunit.client.0.smithi099.stdout:3/806: chown d7/d34/d1d/l50 94 1 2024-09-19T06:40:42.975 INFO:tasks.workunit.client.0.smithi099.stdout:3/807: dread - d7/d34/d1d/fdc zero size 2024-09-19T06:40:42.977 INFO:tasks.workunit.client.0.smithi099.stdout:3/808: rmdir d7/d34/d28 39 2024-09-19T06:40:42.979 INFO:tasks.workunit.client.0.smithi099.stdout:3/809: creat d7/d34/d1d/d20/d75/ff3 x:0 0 0 2024-09-19T06:40:42.980 INFO:tasks.workunit.client.1.smithi117.stdout:4/994: dread d3/d1b/d63/fa1 [0,4194304] 0 2024-09-19T06:40:42.981 INFO:tasks.workunit.client.0.smithi099.stdout:3/810: dread - d7/d34/d1d/d20/d75/d9d/fd4 zero size 2024-09-19T06:40:42.984 INFO:tasks.workunit.client.1.smithi117.stdout:1/708: write d3/d22/d2f/f60 [75167,124082] 0 2024-09-19T06:40:42.986 INFO:tasks.workunit.client.0.smithi099.stdout:3/811: creat d7/d34/d1d/d20/d58/d5c/d98/ff4 x:0 0 0 2024-09-19T06:40:42.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.984+0000 7fd9ecd9f640 1 -- 172.21.15.99:0/3390405180 --> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd9e802abf0 con 0x7fd9d006e730 2024-09-19T06:40:42.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.986+0000 7fd9d6ffd640 1 -- 172.21.15.99:0/3390405180 <== mgr.24369 v2:172.21.15.117:6828/1735340892 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7fd9e802abf0 con 0x7fd9d006e730 2024-09-19T06:40:42.989 INFO:tasks.workunit.client.1.smithi117.stdout:1/709: mknod d3/d18/d23/d51/cf9 0 2024-09-19T06:40:42.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.989+0000 7fd9ecd9f640 1 -- 172.21.15.99:0/3390405180 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7fd9d006e730 msgr2=0x7fd9d0070be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:42.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.989+0000 7fd9ecd9f640 1 --2- 172.21.15.99:0/3390405180 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7fd9d006e730 0x7fd9d0070be0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc00b020 tx=0x7fd9dc009da0 comp rx=0 tx=0).stop 2024-09-19T06:40:42.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.989+0000 7fd9ecd9f640 1 -- 172.21.15.99:0/3390405180 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9e80fb450 msgr2=0x7fd9e810d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:42.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.989+0000 7fd9ecd9f640 1 --2- 172.21.15.99:0/3390405180 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9e80fb450 0x7fd9e810d100 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd9d8002a50 tx=0x7fd9d8004600 comp rx=0 tx=0).stop 2024-09-19T06:40:42.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.989+0000 7fd9ecd9f640 1 -- 172.21.15.99:0/3390405180 shutdown_connections 2024-09-19T06:40:42.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.989+0000 7fd9ecd9f640 1 --2- 172.21.15.99:0/3390405180 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7fd9d006e730 0x7fd9d0070be0 secure :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc00b020 tx=0x7fd9dc009da0 comp rx=0 tx=0).stop 2024-09-19T06:40:42.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.989+0000 7fd9ecd9f640 1 --2- 172.21.15.99:0/3390405180 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd9e80fc720 0x7fd9e810d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:42.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.989+0000 7fd9ecd9f640 1 --2- 172.21.15.99:0/3390405180 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9e80fb450 0x7fd9e810d100 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:42.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.989+0000 7fd9ecd9f640 1 -- 172.21.15.99:0/3390405180 >> 172.21.15.99:0/3390405180 conn(0x7fd9e80f6c10 msgr2=0x7fd9e80661b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:42.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.990+0000 7fd9ecd9f640 1 -- 172.21.15.99:0/3390405180 shutdown_connections 2024-09-19T06:40:42.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:42.990+0000 7fd9ecd9f640 1 -- 172.21.15.99:0/3390405180 wait complete. 2024-09-19T06:40:42.992 INFO:tasks.workunit.client.1.smithi117.stdout:2/819: dwrite d0/d7/d1e/f10d [0,4194304] 0 2024-09-19T06:40:42.993 INFO:tasks.workunit.client.0.smithi099.stdout:2/488: dread d1/d2/f7a [0,4194304] 0 2024-09-19T06:40:42.994 INFO:tasks.workunit.client.1.smithi117.stdout:8/748: dwrite d1d/d2a/f84 [0,4194304] 0 2024-09-19T06:40:42.994 INFO:tasks.workunit.client.0.smithi099.stdout:3/812: dread d7/d34/d1d/d36/d69/fec [0,4194304] 0 2024-09-19T06:40:42.995 INFO:tasks.workunit.client.0.smithi099.stdout:7/787: dwrite d7/ff [0,4194304] 0 2024-09-19T06:40:42.995 INFO:tasks.workunit.client.1.smithi117.stdout:8/749: chown d1d/d2a/d3f/d4b/d5f/dbf/ff7 1 1 2024-09-19T06:40:42.996 INFO:tasks.workunit.client.1.smithi117.stdout:2/820: creat d0/f131 x:0 0 0 2024-09-19T06:40:42.997 INFO:tasks.workunit.client.0.smithi099.stdout:3/813: fsync d7/d34/d1d/d20/d58/d5c/d98/ff4 0 2024-09-19T06:40:43.001 INFO:tasks.workunit.client.1.smithi117.stdout:1/710: rename d3/da1/db1/f9d to d3/ffa 0 2024-09-19T06:40:43.001 INFO:tasks.workunit.client.0.smithi099.stdout:2/489: rename d1/d2/d5/d8f to d1/d2/d4d/d55/da5 0 2024-09-19T06:40:43.003 INFO:tasks.workunit.client.1.smithi117.stdout:8/750: read - d1d/d31/d83/f9f zero size 2024-09-19T06:40:43.007 INFO:tasks.workunit.client.0.smithi099.stdout:2/490: symlink d1/d2/la6 0 2024-09-19T06:40:43.008 INFO:tasks.workunit.client.0.smithi099.stdout:2/491: write d1/d2/d4d/f5e [223859,75136] 0 2024-09-19T06:40:43.009 INFO:tasks.workunit.client.1.smithi117.stdout:8/751: dread d1d/d2a/d3f/d4b/d5f/dbf/fe6 [0,4194304] 0 2024-09-19T06:40:43.010 INFO:tasks.workunit.client.1.smithi117.stdout:1/711: link d3/f38 d3/da1/da5/ffb 0 2024-09-19T06:40:43.011 INFO:tasks.workunit.client.1.smithi117.stdout:2/821: link d0/d7/d29/d35/dbd/d8d/d9a/lce d0/d7/d29/db0/l132 0 2024-09-19T06:40:43.011 INFO:tasks.workunit.client.1.smithi117.stdout:1/712: fdatasync d3/d8e/fca 0 2024-09-19T06:40:43.013 INFO:tasks.workunit.client.0.smithi099.stdout:3/814: link d7/d34/d1d/d20/d75/d9d/cdb d7/d34/d1d/d36/db3/de0/def/cf5 0 2024-09-19T06:40:43.014 INFO:tasks.workunit.client.1.smithi117.stdout:4/995: dread d3/db/d20/d29/f31 [0,4194304] 0 2024-09-19T06:40:43.015 INFO:tasks.workunit.client.1.smithi117.stdout:8/752: rename d1d/d1e/d3b/c7e to d1d/d31/d83/dad/dc0/cfe 0 2024-09-19T06:40:43.015 INFO:tasks.workunit.client.1.smithi117.stdout:2/822: mknod d0/d7/c133 0 2024-09-19T06:40:43.016 INFO:tasks.workunit.client.1.smithi117.stdout:4/996: unlink d3/d65/d66/dce/f105 0 2024-09-19T06:40:43.017 INFO:tasks.workunit.client.1.smithi117.stdout:8/753: fdatasync d1d/d1e/fee 0 2024-09-19T06:40:43.020 INFO:tasks.workunit.client.1.smithi117.stdout:8/754: mkdir d1d/d1e/dbc/dff 0 2024-09-19T06:40:43.020 INFO:tasks.workunit.client.1.smithi117.stdout:2/823: symlink d0/d7/d1e/d20/dbc/d116/d98/dd2/l134 0 2024-09-19T06:40:43.024 INFO:tasks.workunit.client.1.smithi117.stdout:4/997: dwrite d3/db/d23/f57 [4194304,4194304] 0 2024-09-19T06:40:43.028 INFO:tasks.workunit.client.0.smithi099.stdout:2/492: creat d1/d2/d4d/d55/da5/d36/fa7 x:0 0 0 2024-09-19T06:40:43.028 INFO:tasks.workunit.client.0.smithi099.stdout:3/815: rename d7/d34/d1d/d36/d69/d6d/d7a/c84 to d7/d34/d1d/d36/d69/d96/cf6 0 2024-09-19T06:40:43.029 INFO:tasks.workunit.client.0.smithi099.stdout:2/493: stat d1/d2/d4d/d55/da5/d36/f41 0 2024-09-19T06:40:43.030 INFO:tasks.workunit.client.0.smithi099.stdout:2/494: chown d1/d2/d4d/d55/c8d 357409022 1 2024-09-19T06:40:43.032 INFO:tasks.workunit.client.0.smithi099.stdout:3/816: chown d7/d34/d1d/d20/d75/d9d/cdb 11668768 1 2024-09-19T06:40:43.035 INFO:tasks.workunit.client.0.smithi099.stdout:7/788: dread d7/dc7/f65 [0,4194304] 0 2024-09-19T06:40:43.036 INFO:tasks.workunit.client.0.smithi099.stdout:3/817: read d7/f15 [3994502,59450] 0 2024-09-19T06:40:43.038 INFO:tasks.workunit.client.1.smithi117.stdout:4/998: dread d3/db/d13/fcd [0,4194304] 0 2024-09-19T06:40:43.038 INFO:tasks.workunit.client.0.smithi099.stdout:2/495: mkdir d1/d2/d4d/d55/da5/da8 0 2024-09-19T06:40:43.038 INFO:tasks.workunit.client.0.smithi099.stdout:7/789: write d7/dcf/d29/d1f/d45/d48/d63/d75/dd8/df6/fff [1411612,60574] 0 2024-09-19T06:40:43.038 INFO:tasks.workunit.client.0.smithi099.stdout:2/496: chown d1/d2/d5/d13/d2c 36560 1 2024-09-19T06:40:43.039 INFO:tasks.workunit.client.0.smithi099.stdout:3/818: chown d7/d34/d1d/d20/d58/d5c/d98/dde/fe2 145010138 1 2024-09-19T06:40:43.040 INFO:tasks.workunit.client.0.smithi099.stdout:2/497: chown d1/d2/d5/d13/d2c/f49 3046 1 2024-09-19T06:40:43.040 INFO:tasks.workunit.client.0.smithi099.stdout:7/790: dread - d7/dcf/d29/d34/d8f/faf zero size 2024-09-19T06:40:43.042 INFO:tasks.workunit.client.1.smithi117.stdout:4/999: creat d3/d1b/d7d/d9e/f142 x:0 0 0 2024-09-19T06:40:43.043 INFO:tasks.workunit.client.0.smithi099.stdout:7/791: unlink d7/dc7/de7/led 0 2024-09-19T06:40:43.045 INFO:tasks.workunit.client.0.smithi099.stdout:3/819: link d7/d34/f70 d7/d34/d1d/d36/ff7 0 2024-09-19T06:40:43.045 INFO:tasks.workunit.client.1.smithi117.stdout:8/755: dwrite d1d/d2a/d3f/d73/ddd/fc5 [0,4194304] 0 2024-09-19T06:40:43.045 INFO:tasks.workunit.client.1.smithi117.stdout:2/824: dwrite d0/d7/d29/db0/fff [0,4194304] 0 2024-09-19T06:40:43.048 INFO:tasks.workunit.client.0.smithi099.stdout:2/498: rename d1/d2/d4d/d55/da5/d18/d27/f9c to d1/fa9 0 2024-09-19T06:40:43.050 INFO:tasks.workunit.client.0.smithi099.stdout:2/499: creat d1/faa x:0 0 0 2024-09-19T06:40:43.053 INFO:tasks.workunit.client.1.smithi117.stdout:2/825: dwrite d0/d64/dd9/df0/f111 [0,4194304] 0 2024-09-19T06:40:43.054 INFO:tasks.workunit.client.0.smithi099.stdout:7/792: rename d7/dcf/d29/d4e to d7/dcf/d29/d1f/d45/d48/ddc/d11e 0 2024-09-19T06:40:43.056 INFO:tasks.workunit.client.0.smithi099.stdout:2/500: write d1/d2/d4d/d55/da5/d18/d27/d5b/f8c [195408,44928] 0 2024-09-19T06:40:43.060 INFO:tasks.workunit.client.0.smithi099.stdout:9/657: sync 2024-09-19T06:40:43.060 INFO:tasks.workunit.client.0.smithi099.stdout:3/820: dwrite d7/d34/f70 [4194304,4194304] 0 2024-09-19T06:40:43.062 INFO:tasks.workunit.client.1.smithi117.stdout:2/826: dwrite d0/d7/d1e/d20/dbc/de6/fd0 [0,4194304] 0 2024-09-19T06:40:43.064 INFO:tasks.workunit.client.0.smithi099.stdout:3/821: readlink d7/d34/l61 0 2024-09-19T06:40:43.064 INFO:tasks.workunit.client.0.smithi099.stdout:3/822: dread - d7/d34/d1d/d36/d69/fc3 zero size 2024-09-19T06:40:43.065 INFO:tasks.workunit.client.0.smithi099.stdout:7/793: creat d7/dcf/d29/d1f/d45/d48/d63/f11f x:0 0 0 2024-09-19T06:40:43.066 INFO:tasks.workunit.client.0.smithi099.stdout:7/794: dread - d7/dcf/d97/f101 zero size 2024-09-19T06:40:43.066 INFO:tasks.workunit.client.0.smithi099.stdout:3/823: chown d7/d34/f70 27 1 2024-09-19T06:40:43.067 INFO:tasks.workunit.client.0.smithi099.stdout:9/658: read dd/d65/f92 [4004714,93634] 0 2024-09-19T06:40:43.068 INFO:tasks.workunit.client.0.smithi099.stdout:3/824: chown d7/d34/d1d/d20/d75/d9d/caf 943408 1 2024-09-19T06:40:43.069 INFO:tasks.workunit.client.0.smithi099.stdout:9/659: read dd/f5b [105748,46336] 0 2024-09-19T06:40:43.069 INFO:tasks.workunit.client.1.smithi117.stdout:8/756: dread d1d/d1e/f32 [0,4194304] 0 2024-09-19T06:40:43.072 INFO:tasks.workunit.client.0.smithi099.stdout:7/795: write d7/d39/d7d/f8e [3203092,9179] 0 2024-09-19T06:40:43.073 INFO:tasks.workunit.client.1.smithi117.stdout:8/757: mkdir d1d/d2a/d3f/d4b/d5f/dbf/d100 0 2024-09-19T06:40:43.075 INFO:tasks.workunit.client.0.smithi099.stdout:2/501: link d1/d2/d4d/d55/da5/d9/d63/l17 d1/d2/d4d/d55/da5/d18/d76/lab 0 2024-09-19T06:40:43.076 INFO:tasks.workunit.client.1.smithi117.stdout:2/827: rename d0/d7/d29/d35/d61/d65/l7c to d0/d7/d29/d71/l135 0 2024-09-19T06:40:43.076 INFO:tasks.workunit.client.0.smithi099.stdout:9/660: getdents dd/d2c/d5c/dd0 0 2024-09-19T06:40:43.077 INFO:tasks.workunit.client.1.smithi117.stdout:2/828: dread - d0/d12/f106 zero size 2024-09-19T06:40:43.078 INFO:tasks.workunit.client.0.smithi099.stdout:9/661: write dd/d62/d76/faf [27753,33083] 0 2024-09-19T06:40:43.078 INFO:tasks.workunit.client.0.smithi099.stdout:7/796: creat d7/dcf/d29/d1f/f120 x:0 0 0 2024-09-19T06:40:43.079 INFO:tasks.workunit.client.0.smithi099.stdout:3/825: getdents d7/d34/d1d/d57 0 2024-09-19T06:40:43.081 INFO:tasks.workunit.client.0.smithi099.stdout:7/797: write d7/dcf/fb9 [1639896,127566] 0 2024-09-19T06:40:43.082 INFO:tasks.workunit.client.0.smithi099.stdout:9/662: mkdir dd/d2c/d5c/ddb 0 2024-09-19T06:40:43.083 INFO:tasks.workunit.client.0.smithi099.stdout:3/826: dread - d7/d34/d1d/d36/db3/de0/de9/ff0 zero size 2024-09-19T06:40:43.083 INFO:tasks.workunit.client.0.smithi099.stdout:2/502: rename d1/d2/d4d/d55/da5/fa to d1/d2/d4d/d55/da5/fac 0 2024-09-19T06:40:43.085 INFO:tasks.workunit.client.0.smithi099.stdout:3/827: write d7/d34/d1d/d57/d76/fa8 [1613205,98351] 0 2024-09-19T06:40:43.085 INFO:tasks.workunit.client.0.smithi099.stdout:9/663: creat dd/d2c/d5c/d85/d8d/fdc x:0 0 0 2024-09-19T06:40:43.086 INFO:tasks.workunit.client.0.smithi099.stdout:9/664: unlink dd/f60 0 2024-09-19T06:40:43.087 INFO:tasks.workunit.client.0.smithi099.stdout:2/503: mkdir d1/d2/dad 0 2024-09-19T06:40:43.088 INFO:tasks.workunit.client.0.smithi099.stdout:9/665: creat dd/d62/d76/d9a/fdd x:0 0 0 2024-09-19T06:40:43.089 INFO:tasks.workunit.client.0.smithi099.stdout:3/828: creat d7/d34/d1d/d36/db8/ff8 x:0 0 0 2024-09-19T06:40:43.094 INFO:tasks.workunit.client.0.smithi099.stdout:3/829: link d7/d34/c59 d7/d34/d1d/d36/db3/de0/cf9 0 2024-09-19T06:40:43.096 INFO:tasks.workunit.client.0.smithi099.stdout:9/666: dwrite dd/f5d [0,4194304] 0 2024-09-19T06:40:43.097 INFO:tasks.workunit.client.0.smithi099.stdout:3/830: symlink d7/d34/d1d/d20/d75/lfa 0 2024-09-19T06:40:43.097 INFO:tasks.workunit.client.0.smithi099.stdout:9/667: truncate dd/d65/da3/fc8 943124 0 2024-09-19T06:40:43.098 INFO:tasks.workunit.client.0.smithi099.stdout:9/668: fdatasync dd/d47/d40/f52 0 2024-09-19T06:40:43.099 INFO:tasks.workunit.client.0.smithi099.stdout:3/831: write d7/d34/d1d/d36/d69/d6d/d7a/fe7 [836938,68952] 0 2024-09-19T06:40:43.103 INFO:tasks.workunit.client.0.smithi099.stdout:3/832: creat d7/d34/d1d/d20/d58/d5c/dbd/ffb x:0 0 0 2024-09-19T06:40:43.104 INFO:tasks.workunit.client.1.smithi117.stdout:8/758: truncate d1d/d2a/d3f/d4b/d66/f8d 222745 0 2024-09-19T06:40:43.105 INFO:tasks.workunit.client.0.smithi099.stdout:9/669: creat dd/d2c/d5c/ddb/fde x:0 0 0 2024-09-19T06:40:43.105 INFO:tasks.workunit.client.0.smithi099.stdout:3/833: write d7/d34/d1d/d57/fbc [113762,64651] 0 2024-09-19T06:40:43.105 INFO:tasks.workunit.client.1.smithi117.stdout:2/829: truncate d0/d7/d29/d35/d61/def/f107 651964 0 2024-09-19T06:40:43.109 INFO:tasks.workunit.client.1.smithi117.stdout:8/759: creat d1d/d1e/f101 x:0 0 0 2024-09-19T06:40:43.110 INFO:tasks.workunit.client.1.smithi117.stdout:8/760: rmdir d1d/d2a/d3f/d4c/daa 39 2024-09-19T06:40:43.111 INFO:tasks.workunit.client.1.smithi117.stdout:7/756: sync 2024-09-19T06:40:43.112 INFO:tasks.workunit.client.0.smithi099.stdout:9/670: dwrite dd/fe [0,4194304] 0 2024-09-19T06:40:43.114 INFO:tasks.workunit.client.0.smithi099.stdout:3/834: write d7/d34/d1d/d36/db8/fcc [3889462,127522] 0 2024-09-19T06:40:43.117 INFO:tasks.workunit.client.1.smithi117.stdout:7/757: mkdir d1/d72/d10f 0 2024-09-19T06:40:43.117 INFO:tasks.workunit.client.0.smithi099.stdout:3/835: rmdir d7/d34/d1d/d36/db8 39 2024-09-19T06:40:43.119 INFO:tasks.workunit.client.0.smithi099.stdout:3/836: chown d7/d34/lab 14460398 1 2024-09-19T06:40:43.120 INFO:tasks.workunit.client.1.smithi117.stdout:7/758: creat d1/d4a/d81/d24/d49/f110 x:0 0 0 2024-09-19T06:40:43.123 INFO:tasks.workunit.client.1.smithi117.stdout:2/830: dwrite d0/d7/d29/d35/d3d/f43 [0,4194304] 0 2024-09-19T06:40:43.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.122+0000 7f129d926640 1 -- 172.21.15.99:0/2696796476 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f129806dbf0 msgr2=0x7f129806e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:43.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.122+0000 7f129d926640 1 --2- 172.21.15.99:0/2696796476 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f129806dbf0 0x7f129806e000 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1290009c50 tx=0x7f1290004d10 comp rx=0 tx=0).stop 2024-09-19T06:40:43.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.122+0000 7f129d926640 1 -- 172.21.15.99:0/2696796476 shutdown_connections 2024-09-19T06:40:43.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.122+0000 7f129d926640 1 --2- 172.21.15.99:0/2696796476 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f129806e540 0x7f1298108730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:43.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.122+0000 7f129d926640 1 --2- 172.21.15.99:0/2696796476 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f129806dbf0 0x7f129806e000 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:43.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.122+0000 7f129d926640 1 -- 172.21.15.99:0/2696796476 >> 172.21.15.99:0/2696796476 conn(0x7f1298069560 msgr2=0x7f129806b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:43.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.122+0000 7f129d926640 1 -- 172.21.15.99:0/2696796476 shutdown_connections 2024-09-19T06:40:43.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.122+0000 7f129d926640 1 -- 172.21.15.99:0/2696796476 wait complete. 2024-09-19T06:40:43.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.123+0000 7f129d926640 1 Processor -- start 2024-09-19T06:40:43.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.124+0000 7f129d926640 1 -- start start 2024-09-19T06:40:43.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.124+0000 7f129d926640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f129806dbf0 0x7f12981117c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:43.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.124+0000 7f129d926640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f129806e540 0x7f1298111d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:43.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.124+0000 7f129d926640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1298112240 con 0x7f129806e540 2024-09-19T06:40:43.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.124+0000 7f129d926640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12981123b0 con 0x7f129806dbf0 2024-09-19T06:40:43.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.124+0000 7f12967fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f129806e540 0x7f1298111d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:43.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.124+0000 7f12967fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f129806e540 0x7f1298111d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52060/0 (socket says 172.21.15.99:52060) 2024-09-19T06:40:43.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.124+0000 7f12967fc640 1 -- 172.21.15.99:0/4027807938 learned_addr learned my addr 172.21.15.99:0/4027807938 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:40:43.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.125+0000 7f1296ffd640 1 --2- 172.21.15.99:0/4027807938 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f129806dbf0 0x7f12981117c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:43.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.125+0000 7f12967fc640 1 -- 172.21.15.99:0/4027807938 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f129806dbf0 msgr2=0x7f12981117c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:43.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.125+0000 7f12967fc640 1 --2- 172.21.15.99:0/4027807938 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f129806dbf0 0x7f12981117c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:43.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.125+0000 7f12967fc640 1 -- 172.21.15.99:0/4027807938 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12900098b0 con 0x7f129806e540 2024-09-19T06:40:43.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.125+0000 7f12967fc640 1 --2- 172.21.15.99:0/4027807938 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f129806e540 0x7f1298111d00 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f128800b790 tx=0x7f12880091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:43.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.125+0000 7f127f7fe640 1 -- 172.21.15.99:0/4027807938 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f128800c700 con 0x7f129806e540 2024-09-19T06:40:43.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.126+0000 7f129d926640 1 -- 172.21.15.99:0/4027807938 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f129812a190 con 0x7f129806e540 2024-09-19T06:40:43.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.126+0000 7f127f7fe640 1 -- 172.21.15.99:0/4027807938 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f128800cd00 con 0x7f129806e540 2024-09-19T06:40:43.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.126+0000 7f129d926640 1 -- 172.21.15.99:0/4027807938 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f129812a4c0 con 0x7f129806e540 2024-09-19T06:40:43.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.126+0000 7f127f7fe640 1 -- 172.21.15.99:0/4027807938 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1288015e70 con 0x7f129806e540 2024-09-19T06:40:43.128 INFO:tasks.workunit.client.1.smithi117.stdout:2/831: creat d0/d7/d29/df4/d105/d11b/d129/f136 x:0 0 0 2024-09-19T06:40:43.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.128+0000 7f129d926640 1 -- 172.21.15.99:0/4027807938 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f129806d1b0 con 0x7f129806e540 2024-09-19T06:40:43.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.128+0000 7f127f7fe640 1 -- 172.21.15.99:0/4027807938 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7f1288012070 con 0x7f129806e540 2024-09-19T06:40:43.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.130+0000 7f127f7fe640 1 --2- 172.21.15.99:0/4027807938 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7f128006e6e0 0x7f1280070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:43.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.130+0000 7f127f7fe640 1 -- 172.21.15.99:0/4027807938 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f128808d770 con 0x7f129806e540 2024-09-19T06:40:43.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.131+0000 7f1296ffd640 1 --2- 172.21.15.99:0/4027807938 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7f128006e6e0 0x7f1280070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:43.132 INFO:tasks.workunit.client.1.smithi117.stdout:8/761: write d1d/d2a/d3f/d4b/f59 [1065951,71380] 0 2024-09-19T06:40:43.133 INFO:tasks.workunit.client.1.smithi117.stdout:7/759: getdents d1/d4a/d81/d24/d26/d44 0 2024-09-19T06:40:43.134 INFO:tasks.workunit.client.1.smithi117.stdout:7/760: read - d1/d4a/d7c/fcd zero size 2024-09-19T06:40:43.134 INFO:tasks.workunit.client.1.smithi117.stdout:2/832: dread d0/d7/d1e/d20/dbc/de6/ff2 [0,4194304] 0 2024-09-19T06:40:43.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.133+0000 7f1296ffd640 1 --2- 172.21.15.99:0/4027807938 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7f128006e6e0 0x7f1280070b90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1290004a30 tx=0x7f1290004d10 comp rx=0 tx=0).ready entity=mgr.24369 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:43.136 INFO:tasks.workunit.client.1.smithi117.stdout:7/761: fsync d1/d4a/d7c/d95/ddc/ffd 0 2024-09-19T06:40:43.136 INFO:tasks.workunit.client.1.smithi117.stdout:8/762: symlink d1d/l102 0 2024-09-19T06:40:43.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.138+0000 7f127f7fe640 1 -- 172.21.15.99:0/4027807938 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f1288057100 con 0x7f129806e540 2024-09-19T06:40:43.139 INFO:tasks.workunit.client.1.smithi117.stdout:2/833: dread d0/d7/d29/db0/fff [0,4194304] 0 2024-09-19T06:40:43.140 INFO:tasks.workunit.client.1.smithi117.stdout:8/763: mknod d1d/d31/d83/dad/c103 0 2024-09-19T06:40:43.141 INFO:tasks.workunit.client.1.smithi117.stdout:2/834: creat d0/d7/d29/d35/dbd/d8d/f137 x:0 0 0 2024-09-19T06:40:43.143 INFO:tasks.workunit.client.1.smithi117.stdout:2/835: truncate d0/d7/d29/d35/dbd/fa2 681731 0 2024-09-19T06:40:43.145 INFO:tasks.workunit.client.1.smithi117.stdout:8/764: dread d1d/d2a/d3f/f72 [0,4194304] 0 2024-09-19T06:40:43.145 INFO:tasks.workunit.client.1.smithi117.stdout:2/836: readlink d0/d7/d29/d71/l135 0 2024-09-19T06:40:43.147 INFO:tasks.workunit.client.1.smithi117.stdout:0/732: sync 2024-09-19T06:40:43.147 INFO:tasks.workunit.client.1.smithi117.stdout:2/837: fsync d0/d7/d1e/d20/dbc/d116/f51 0 2024-09-19T06:40:43.148 INFO:tasks.workunit.client.0.smithi099.stdout:3/837: dread d7/f49 [0,4194304] 0 2024-09-19T06:40:43.149 INFO:tasks.workunit.client.0.smithi099.stdout:3/838: dread - d7/d34/d1d/d20/d58/d5c/dbd/ffb zero size 2024-09-19T06:40:43.149 INFO:tasks.workunit.client.1.smithi117.stdout:7/762: dwrite d1/d4a/f7b [0,4194304] 0 2024-09-19T06:40:43.149 INFO:tasks.workunit.client.1.smithi117.stdout:0/733: stat d11/d13/d14/d2c/d53/fc6 0 2024-09-19T06:40:43.150 INFO:tasks.workunit.client.1.smithi117.stdout:8/765: rename d1d/d2a/d3f/d4b/d91/fdf to d1d/d31/d83/dad/f104 0 2024-09-19T06:40:43.151 INFO:tasks.workunit.client.1.smithi117.stdout:2/838: mkdir d0/d7/d29/d35/dbd/d138 0 2024-09-19T06:40:43.152 INFO:tasks.workunit.client.1.smithi117.stdout:2/839: dread - d0/f131 zero size 2024-09-19T06:40:43.152 INFO:tasks.workunit.client.1.smithi117.stdout:0/734: creat d11/d13/d1b/d27/d37/da9/ff0 x:0 0 0 2024-09-19T06:40:43.152 INFO:tasks.workunit.client.0.smithi099.stdout:3/839: mknod d7/d34/d1d/d20/d58/d5c/cfc 0 2024-09-19T06:40:43.153 INFO:tasks.workunit.client.1.smithi117.stdout:7/763: mknod d1/d4a/c111 0 2024-09-19T06:40:43.153 INFO:tasks.workunit.client.1.smithi117.stdout:7/764: read - d1/d4a/d7c/d95/db5/fce zero size 2024-09-19T06:40:43.154 INFO:tasks.workunit.client.1.smithi117.stdout:2/840: creat d0/d12/d32/da4/f139 x:0 0 0 2024-09-19T06:40:43.155 INFO:tasks.workunit.client.1.smithi117.stdout:7/765: chown d1/d4a/d81/d48/d5f/d82 246479 1 2024-09-19T06:40:43.155 INFO:tasks.workunit.client.0.smithi099.stdout:3/840: creat d7/d34/d1d/d20/d58/ffd x:0 0 0 2024-09-19T06:40:43.157 INFO:tasks.workunit.client.0.smithi099.stdout:3/841: chown d7/d34/d1d/d36/d42/c63 1932 1 2024-09-19T06:40:43.158 INFO:tasks.workunit.client.1.smithi117.stdout:0/735: dwrite d11/d13/d14/d16/f1a [0,4194304] 0 2024-09-19T06:40:43.159 INFO:tasks.workunit.client.1.smithi117.stdout:7/766: symlink d1/d4a/d81/d24/d26/d44/dd2/l112 0 2024-09-19T06:40:43.159 INFO:tasks.workunit.client.0.smithi099.stdout:3/842: rmdir d7/d34/d1d/d20/d58/d5c 39 2024-09-19T06:40:43.162 INFO:tasks.workunit.client.1.smithi117.stdout:0/736: dread d11/d13/d1b/d27/d37/da9/fce [0,4194304] 0 2024-09-19T06:40:43.162 INFO:tasks.workunit.client.1.smithi117.stdout:7/767: rmdir d1/d3f/d92 39 2024-09-19T06:40:43.165 INFO:tasks.workunit.client.1.smithi117.stdout:7/768: mkdir d1/d4a/d81/d113 0 2024-09-19T06:40:43.168 INFO:tasks.workunit.client.1.smithi117.stdout:2/841: dread d0/d64/ff7 [0,4194304] 0 2024-09-19T06:40:43.169 INFO:tasks.workunit.client.1.smithi117.stdout:2/842: truncate d0/d64/dd9/f12e 694344 0 2024-09-19T06:40:43.169 INFO:tasks.workunit.client.1.smithi117.stdout:7/769: rename d1/d4a/d81/d48/d5f/f91 to d1/d4a/d81/d24/d49/dbf/dc4/f114 0 2024-09-19T06:40:43.170 INFO:tasks.workunit.client.1.smithi117.stdout:2/843: chown d0/d7/d29/d35/d61/ffa 182570335 1 2024-09-19T06:40:43.171 INFO:tasks.workunit.client.1.smithi117.stdout:0/737: creat d11/ff1 x:0 0 0 2024-09-19T06:40:43.173 INFO:tasks.workunit.client.1.smithi117.stdout:7/770: mkdir d1/d3f/d92/d115 0 2024-09-19T06:40:43.174 INFO:tasks.workunit.client.1.smithi117.stdout:7/771: dread - d1/d4a/d81/d24/d1c/d35/d4f/d9b/fea zero size 2024-09-19T06:40:43.176 INFO:tasks.workunit.client.1.smithi117.stdout:0/738: rename d11/d13/d14/d2c/d35/l78 to d11/d13/d28/d38/d5b/lf2 0 2024-09-19T06:40:43.177 INFO:tasks.workunit.client.1.smithi117.stdout:7/772: creat d1/d4a/d81/d24/d1c/d35/d4f/d9b/f116 x:0 0 0 2024-09-19T06:40:43.178 INFO:tasks.workunit.client.1.smithi117.stdout:7/773: fdatasync d1/d4a/d81/f47 0 2024-09-19T06:40:43.178 INFO:tasks.workunit.client.1.smithi117.stdout:0/739: read d11/f83 [158368,110799] 0 2024-09-19T06:40:43.179 INFO:tasks.workunit.client.1.smithi117.stdout:0/740: read - d11/d13/d1b/d27/d37/d6d/f95 zero size 2024-09-19T06:40:43.185 INFO:tasks.workunit.client.1.smithi117.stdout:7/774: dread d1/d72/f75 [0,4194304] 0 2024-09-19T06:40:43.186 INFO:tasks.workunit.client.1.smithi117.stdout:7/775: write d1/d4a/d81/f84 [1429662,39228] 0 2024-09-19T06:40:43.188 INFO:tasks.workunit.client.1.smithi117.stdout:0/741: dwrite d11/d13/d14/f86 [0,4194304] 0 2024-09-19T06:40:43.192 INFO:tasks.workunit.client.1.smithi117.stdout:2/844: dread d0/d64/fc8 [0,4194304] 0 2024-09-19T06:40:43.194 INFO:tasks.workunit.client.1.smithi117.stdout:0/742: dread d11/d13/d28/d38/d5b/fd0 [0,4194304] 0 2024-09-19T06:40:43.194 INFO:tasks.workunit.client.1.smithi117.stdout:2/845: chown d0/f6 467848 1 2024-09-19T06:40:43.194 INFO:tasks.workunit.client.1.smithi117.stdout:7/776: write d1/d4a/d81/d24/d1c/d55/f59 [4901446,30964] 0 2024-09-19T06:40:43.198 INFO:tasks.workunit.client.1.smithi117.stdout:7/777: symlink d1/d3f/l117 0 2024-09-19T06:40:43.199 INFO:tasks.workunit.client.1.smithi117.stdout:7/778: dread - d1/d4a/d81/fca zero size 2024-09-19T06:40:43.200 INFO:tasks.workunit.client.1.smithi117.stdout:0/743: dwrite d11/d13/d1b/d67/fb5 [0,4194304] 0 2024-09-19T06:40:43.201 INFO:tasks.workunit.client.0.smithi099.stdout:1/628: sync 2024-09-19T06:40:43.202 INFO:tasks.workunit.client.0.smithi099.stdout:6/623: sync 2024-09-19T06:40:43.202 INFO:tasks.workunit.client.0.smithi099.stdout:0/581: sync 2024-09-19T06:40:43.202 INFO:tasks.workunit.client.0.smithi099.stdout:5/803: sync 2024-09-19T06:40:43.202 INFO:tasks.workunit.client.0.smithi099.stdout:8/525: sync 2024-09-19T06:40:43.202 INFO:tasks.workunit.client.0.smithi099.stdout:4/623: sync 2024-09-19T06:40:43.202 INFO:tasks.workunit.client.1.smithi117.stdout:2/846: dwrite d0/d12/d32/db5/d114/f118 [0,4194304] 0 2024-09-19T06:40:43.204 INFO:tasks.workunit.client.1.smithi117.stdout:7/779: mkdir d1/d4a/d81/d24/d1c/d35/d118 0 2024-09-19T06:40:43.205 INFO:tasks.workunit.client.0.smithi099.stdout:6/624: symlink d1/d12/lce 0 2024-09-19T06:40:43.206 INFO:tasks.workunit.client.0.smithi099.stdout:5/804: fsync d3/d1f/f76 0 2024-09-19T06:40:43.206 INFO:tasks.workunit.client.1.smithi117.stdout:2/847: mknod d0/d12/d32/da4/c13a 0 2024-09-19T06:40:43.207 INFO:tasks.workunit.client.0.smithi099.stdout:5/805: stat d3/d7/c10b 0 2024-09-19T06:40:43.207 INFO:tasks.workunit.client.0.smithi099.stdout:1/629: dread d0/d17/d32/d7b/d99/fb6 [0,4194304] 0 2024-09-19T06:40:43.208 INFO:tasks.workunit.client.0.smithi099.stdout:6/625: chown d1/d5/d24/d2e/f70 182 1 2024-09-19T06:40:43.208 INFO:tasks.workunit.client.1.smithi117.stdout:7/780: creat d1/d4a/d81/d24/d26/d44/dd2/f119 x:0 0 0 2024-09-19T06:40:43.209 INFO:tasks.workunit.client.0.smithi099.stdout:6/626: stat d1/d5/d52/fb2 0 2024-09-19T06:40:43.210 INFO:tasks.workunit.client.1.smithi117.stdout:0/744: dread d11/d13/d1b/d4b/fa8 [0,4194304] 0 2024-09-19T06:40:43.211 INFO:tasks.workunit.client.0.smithi099.stdout:8/526: truncate d4/de/d26/d2b/f52 1965980 0 2024-09-19T06:40:43.213 INFO:tasks.workunit.client.1.smithi117.stdout:7/781: mkdir d1/d4a/d81/d24/d1c/d35/d4f/d11a 0 2024-09-19T06:40:43.213 INFO:tasks.workunit.client.0.smithi099.stdout:5/806: mknod d3/d7/d90/da6/c116 0 2024-09-19T06:40:43.215 INFO:tasks.workunit.client.1.smithi117.stdout:0/745: creat d11/d13/d14/d2c/ff3 x:0 0 0 2024-09-19T06:40:43.215 INFO:tasks.workunit.client.1.smithi117.stdout:2/848: dwrite d0/d7/d1e/f10d [0,4194304] 0 2024-09-19T06:40:43.216 INFO:tasks.workunit.client.1.smithi117.stdout:0/746: dread - d11/d13/d14/d2c/d35/d3e/fcb zero size 2024-09-19T06:40:43.217 INFO:tasks.workunit.client.0.smithi099.stdout:1/630: creat d0/d17/d24/d5e/fca x:0 0 0 2024-09-19T06:40:43.217 INFO:tasks.workunit.client.1.smithi117.stdout:7/782: stat d1/f50 0 2024-09-19T06:40:43.219 INFO:tasks.workunit.client.1.smithi117.stdout:2/849: symlink d0/d7/d29/d35/l13b 0 2024-09-19T06:40:43.220 INFO:tasks.workunit.client.1.smithi117.stdout:0/747: creat d11/d13/d14/d16/da1/ff4 x:0 0 0 2024-09-19T06:40:43.220 INFO:tasks.workunit.client.0.smithi099.stdout:1/631: mkdir d0/d17/d5b/dba/dcb 0 2024-09-19T06:40:43.221 INFO:tasks.workunit.client.0.smithi099.stdout:5/807: dread d3/d16/f2b [0,4194304] 0 2024-09-19T06:40:43.222 INFO:tasks.workunit.client.1.smithi117.stdout:0/748: write d11/d13/d1b/d27/d54/fb2 [67378,65818] 0 2024-09-19T06:40:43.222 INFO:tasks.workunit.client.0.smithi099.stdout:5/808: write d3/d16/d2f/f75 [145475,127546] 0 2024-09-19T06:40:43.223 INFO:tasks.workunit.client.0.smithi099.stdout:5/809: chown d3/d16/f83 0 1 2024-09-19T06:40:43.224 INFO:tasks.workunit.client.0.smithi099.stdout:1/632: symlink d0/d17/d5b/dba/dcb/lcc 0 2024-09-19T06:40:43.227 INFO:tasks.workunit.client.1.smithi117.stdout:0/749: dread d11/d13/d14/f86 [0,4194304] 0 2024-09-19T06:40:43.227 INFO:tasks.workunit.client.0.smithi099.stdout:6/627: write d1/da1/fca [89037,73257] 0 2024-09-19T06:40:43.229 INFO:tasks.workunit.client.0.smithi099.stdout:8/527: truncate d4/d11/d23/d3f/f55 3875159 0 2024-09-19T06:40:43.229 INFO:tasks.workunit.client.1.smithi117.stdout:0/750: mkdir d11/d13/d14/d2c/d53/d7e/df5 0 2024-09-19T06:40:43.276 INFO:tasks.workunit.client.1.smithi117.stdout:9/786: sync 2024-09-19T06:40:43.276 INFO:tasks.workunit.client.1.smithi117.stdout:3/789: sync 2024-09-19T06:40:43.276 INFO:tasks.workunit.client.1.smithi117.stdout:1/713: sync 2024-09-19T06:40:43.276 INFO:tasks.workunit.client.1.smithi117.stdout:6/580: sync 2024-09-19T06:40:43.276 INFO:tasks.workunit.client.1.smithi117.stdout:5/815: sync 2024-09-19T06:40:43.277 INFO:tasks.workunit.client.1.smithi117.stdout:9/787: write d4/d8/fea [689465,60932] 0 2024-09-19T06:40:43.277 INFO:tasks.workunit.client.1.smithi117.stdout:5/816: write d17/d1b/d3a/f68 [2099110,8145] 0 2024-09-19T06:40:43.278 INFO:tasks.workunit.client.1.smithi117.stdout:9/788: fdatasync d4/f19 0 2024-09-19T06:40:43.299 INFO:tasks.workunit.client.1.smithi117.stdout:8/766: sync 2024-09-19T06:40:43.317 INFO:tasks.workunit.client.0.smithi099.stdout:5/810: creat d3/d1f/f117 x:0 0 0 2024-09-19T06:40:43.318 INFO:tasks.workunit.client.0.smithi099.stdout:1/633: rename d0/d17/d24/f42 to d0/db/fcd 0 2024-09-19T06:40:43.318 INFO:tasks.workunit.client.0.smithi099.stdout:6/628: mkdir d1/d5/d24/d2e/d7b/dba/dcf 0 2024-09-19T06:40:43.318 INFO:tasks.workunit.client.0.smithi099.stdout:8/528: write d4/de/d14/f65 [586811,60949] 0 2024-09-19T06:40:43.319 INFO:tasks.workunit.client.0.smithi099.stdout:5/811: write d3/d16/d2f/f75 [1004949,57056] 0 2024-09-19T06:40:43.321 INFO:tasks.workunit.client.0.smithi099.stdout:1/634: creat d0/d17/d24/d3a/fce x:0 0 0 2024-09-19T06:40:43.322 INFO:tasks.workunit.client.0.smithi099.stdout:8/529: creat d4/de/d26/d2b/fb5 x:0 0 0 2024-09-19T06:40:43.323 INFO:tasks.workunit.client.0.smithi099.stdout:5/812: creat d3/d16/d2f/d34/f118 x:0 0 0 2024-09-19T06:40:43.324 INFO:tasks.workunit.client.0.smithi099.stdout:1/635: mknod d0/d12/d54/ccf 0 2024-09-19T06:40:43.325 INFO:tasks.workunit.client.1.smithi117.stdout:0/751: rename d11/d13/d14/d2c/ff3 to d11/d13/d14/d2c/d53/d7e/daa/dca/ff6 0 2024-09-19T06:40:43.325 INFO:tasks.workunit.client.0.smithi099.stdout:1/636: write d0/f21 [4401138,24656] 0 2024-09-19T06:40:43.328 INFO:tasks.workunit.client.1.smithi117.stdout:3/790: mkdir d0/d9/d1c/d53/d101 0 2024-09-19T06:40:43.329 INFO:tasks.workunit.client.1.smithi117.stdout:3/791: write d0/d8/d7f/f7a [4454017,75702] 0 2024-09-19T06:40:43.330 INFO:tasks.workunit.client.0.smithi099.stdout:5/813: mknod d3/d7/d90/da6/d10e/c119 0 2024-09-19T06:40:43.330 INFO:tasks.workunit.client.1.smithi117.stdout:3/792: dread - d0/d8/d7f/d40/fce zero size 2024-09-19T06:40:43.331 INFO:tasks.workunit.client.0.smithi099.stdout:5/814: chown d3/d2a/lba 62263 1 2024-09-19T06:40:43.332 INFO:tasks.workunit.client.0.smithi099.stdout:6/629: write d1/d12/f83 [2335700,98535] 0 2024-09-19T06:40:43.333 INFO:tasks.workunit.client.1.smithi117.stdout:7/783: write d1/d72/dd7/fee [465526,49232] 0 2024-09-19T06:40:43.333 INFO:tasks.workunit.client.1.smithi117.stdout:3/793: dread d0/f12 [0,4194304] 0 2024-09-19T06:40:43.333 INFO:tasks.workunit.client.1.smithi117.stdout:2/850: write d0/d7/d29/f5f [1121466,28124] 0 2024-09-19T06:40:43.333 INFO:tasks.workunit.client.1.smithi117.stdout:3/794: readlink d0/l79 0 2024-09-19T06:40:43.334 INFO:tasks.workunit.client.1.smithi117.stdout:8/767: mkdir d1d/d1e/dbc/dc1/d105 0 2024-09-19T06:40:43.334 INFO:tasks.workunit.client.0.smithi099.stdout:5/815: creat d3/d16/d5e/db1/f11a x:0 0 0 2024-09-19T06:40:43.336 INFO:tasks.workunit.client.1.smithi117.stdout:0/752: rmdir d11/d13/d14 39 2024-09-19T06:40:43.337 INFO:tasks.workunit.client.0.smithi099.stdout:1/637: write d0/f1a [409704,23469] 0 2024-09-19T06:40:43.338 INFO:tasks.workunit.client.0.smithi099.stdout:5/816: symlink d3/d7/d90/da6/d10e/l11b 0 2024-09-19T06:40:43.340 INFO:tasks.workunit.client.1.smithi117.stdout:6/581: write d1/d5/d8/d27/f47 [952744,37640] 0 2024-09-19T06:40:43.341 INFO:tasks.workunit.client.1.smithi117.stdout:5/817: symlink d17/d1b/d3a/d3c/dcb/dde/d65/d88/l10c 0 2024-09-19T06:40:43.342 INFO:tasks.workunit.client.0.smithi099.stdout:1/638: write d0/f82 [317661,109719] 0 2024-09-19T06:40:43.342 INFO:tasks.workunit.client.0.smithi099.stdout:5/817: creat d3/d14/f11c x:0 0 0 2024-09-19T06:40:43.342 INFO:tasks.workunit.client.1.smithi117.stdout:9/789: link d4/d1c/d73/d93/fff d4/d20/f10a 0 2024-09-19T06:40:43.345 INFO:tasks.workunit.client.1.smithi117.stdout:1/714: write d3/ffa [1397313,15317] 0 2024-09-19T06:40:43.346 INFO:tasks.workunit.client.1.smithi117.stdout:3/795: creat d0/d3d/d48/dc7/f102 x:0 0 0 2024-09-19T06:40:43.347 INFO:tasks.workunit.client.0.smithi099.stdout:8/530: dwrite d4/de/d26/d2b/f32 [0,4194304] 0 2024-09-19T06:40:43.347 INFO:tasks.workunit.client.0.smithi099.stdout:6/630: dwrite d1/d5/d24/d2e/d41/f8d [0,4194304] 0 2024-09-19T06:40:43.348 INFO:tasks.workunit.client.1.smithi117.stdout:0/753: write d11/d13/d14/d16/fa7 [1654910,1163] 0 2024-09-19T06:40:43.350 INFO:tasks.workunit.client.1.smithi117.stdout:6/582: mknod d1/d5/d85/ca2 0 2024-09-19T06:40:43.350 INFO:tasks.workunit.client.0.smithi099.stdout:6/631: chown d1/d5/d24/d2e/d41/caf 29574145 1 2024-09-19T06:40:43.350 INFO:tasks.workunit.client.0.smithi099.stdout:5/818: rmdir d3/d16/d2f/d34/d3c 39 2024-09-19T06:40:43.352 INFO:tasks.workunit.client.0.smithi099.stdout:6/632: truncate d1/f19 2653258 0 2024-09-19T06:40:43.353 INFO:tasks.workunit.client.1.smithi117.stdout:5/818: rename d17/d1b/d3a/d3c/d70/lfc to d17/d5c/db8/l10d 0 2024-09-19T06:40:43.353 INFO:tasks.workunit.client.1.smithi117.stdout:3/796: dwrite d0/d19/d2b/d8e/fc6 [0,4194304] 0 2024-09-19T06:40:43.353 INFO:tasks.workunit.client.1.smithi117.stdout:9/790: fdatasync d4/d8/fe 0 2024-09-19T06:40:43.353 INFO:tasks.workunit.client.0.smithi099.stdout:8/531: creat d4/de/d26/d8d/dac/fb6 x:0 0 0 2024-09-19T06:40:43.358 INFO:tasks.workunit.client.0.smithi099.stdout:1/639: dwrite d0/d17/d5b/f5d [0,4194304] 0 2024-09-19T06:40:43.363 INFO:tasks.workunit.client.1.smithi117.stdout:6/583: chown d1/d5/d8/d80/c89 121 1 2024-09-19T06:40:43.365 INFO:tasks.workunit.client.0.smithi099.stdout:8/532: creat d4/de/fb7 x:0 0 0 2024-09-19T06:40:43.366 INFO:tasks.workunit.client.0.smithi099.stdout:5/819: rename d3/d1f/d4f/c52 to d3/d16/c11d 0 2024-09-19T06:40:43.367 INFO:tasks.workunit.client.0.smithi099.stdout:8/533: fdatasync d4/de/d26/d8d/dac/fb1 0 2024-09-19T06:40:43.367 INFO:tasks.workunit.client.1.smithi117.stdout:1/715: write d3/d18/d23/f4f [920536,12228] 0 2024-09-19T06:40:43.369 INFO:tasks.workunit.client.1.smithi117.stdout:0/754: mknod d11/d13/d1b/d27/d37/cf7 0 2024-09-19T06:40:43.369 INFO:tasks.workunit.client.1.smithi117.stdout:3/797: write d0/d3d/d48/dd0/fd7 [4542254,64186] 0 2024-09-19T06:40:43.369 INFO:tasks.workunit.client.1.smithi117.stdout:7/784: getdents d1/d72/dd7 0 2024-09-19T06:40:43.370 INFO:tasks.workunit.client.0.smithi099.stdout:8/534: read d4/d11/d23/d92/fa4 [2511077,19150] 0 2024-09-19T06:40:43.372 INFO:tasks.workunit.client.1.smithi117.stdout:6/584: creat d1/d5/d8/d5e/d67/d98/fa3 x:0 0 0 2024-09-19T06:40:43.373 INFO:tasks.workunit.client.1.smithi117.stdout:8/768: getdents d1d/d2a/d3f/d4c 0 2024-09-19T06:40:43.373 INFO:tasks.workunit.client.1.smithi117.stdout:7/785: read d1/d4a/d81/d48/d5f/d82/fc3 [797028,70953] 0 2024-09-19T06:40:43.373 INFO:tasks.workunit.client.1.smithi117.stdout:3/798: fdatasync d0/d3d/d48/f7e 0 2024-09-19T06:40:43.375 INFO:tasks.workunit.client.1.smithi117.stdout:6/585: write d1/d5/d8/d5e/f92 [177772,105092] 0 2024-09-19T06:40:43.376 INFO:tasks.workunit.client.1.smithi117.stdout:3/799: write d0/ff4 [719896,29717] 0 2024-09-19T06:40:43.377 INFO:tasks.workunit.client.0.smithi099.stdout:6/633: dread d1/f19 [0,4194304] 0 2024-09-19T06:40:43.377 INFO:tasks.workunit.client.1.smithi117.stdout:0/755: rename d11/d13/d14/d2c/d35/d3e/fbc to d11/d13/d1b/d27/d54/ff8 0 2024-09-19T06:40:43.378 INFO:tasks.workunit.client.1.smithi117.stdout:9/791: getdents d4/d1c/d73/da8 0 2024-09-19T06:40:43.378 INFO:tasks.workunit.client.0.smithi099.stdout:5/820: link d3/l1d d3/d16/d2f/d34/d3c/de1/l11e 0 2024-09-19T06:40:43.380 INFO:tasks.workunit.client.1.smithi117.stdout:3/800: symlink d0/d3d/l103 0 2024-09-19T06:40:43.382 INFO:tasks.workunit.client.1.smithi117.stdout:6/586: creat d1/d5/d85/fa4 x:0 0 0 2024-09-19T06:40:43.383 INFO:tasks.workunit.client.1.smithi117.stdout:7/786: truncate d1/d4a/d81/f54 5294158 0 2024-09-19T06:40:43.384 INFO:tasks.workunit.client.1.smithi117.stdout:1/716: getdents d3/da1/db1/d93/dd0 0 2024-09-19T06:40:43.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.386+0000 7f129d926640 1 -- 172.21.15.99:0/4027807938 --> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1298107fe0 con 0x7f128006e6e0 2024-09-19T06:40:43.388 INFO:tasks.workunit.client.1.smithi117.stdout:9/792: creat d4/d8/d6a/f10b x:0 0 0 2024-09-19T06:40:43.391 INFO:tasks.workunit.client.1.smithi117.stdout:6/587: mknod d1/d14/ca5 0 2024-09-19T06:40:43.392 INFO:tasks.workunit.client.1.smithi117.stdout:7/787: creat d1/d4a/d81/d48/f11b x:0 0 0 2024-09-19T06:40:43.393 INFO:tasks.workunit.client.0.smithi099.stdout:6/634: truncate d1/d5/d24/d2e/f31 859334 0 2024-09-19T06:40:43.393 INFO:tasks.workunit.client.1.smithi117.stdout:2/851: write d0/d64/dd9/f80 [1990199,21888] 0 2024-09-19T06:40:43.394 INFO:tasks.workunit.client.1.smithi117.stdout:7/788: write d1/d4a/d7c/f9c [5123953,102597] 0 2024-09-19T06:40:43.395 INFO:tasks.workunit.client.1.smithi117.stdout:2/852: chown d0/d12/d32/da4/c13a 11952 1 2024-09-19T06:40:43.398 INFO:tasks.workunit.client.1.smithi117.stdout:3/801: rename d0/d8/f1a to d0/d8/d64/f104 0 2024-09-19T06:40:43.399 INFO:tasks.workunit.client.1.smithi117.stdout:5/819: dread d17/f76 [0,4194304] 0 2024-09-19T06:40:43.399 INFO:tasks.workunit.client.1.smithi117.stdout:5/820: stat ff 0 2024-09-19T06:40:43.399 INFO:tasks.workunit.client.0.smithi099.stdout:5/821: dwrite d3/d16/d2f/fc1 [0,4194304] 0 2024-09-19T06:40:43.400 INFO:tasks.workunit.client.0.smithi099.stdout:8/535: dread d4/de/d26/d2b/f52 [0,4194304] 0 2024-09-19T06:40:43.400 INFO:tasks.workunit.client.1.smithi117.stdout:5/821: write d17/d5c/fe1 [2825144,102228] 0 2024-09-19T06:40:43.401 INFO:tasks.workunit.client.0.smithi099.stdout:8/536: fdatasync d4/de/d10/f40 0 2024-09-19T06:40:43.402 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T06:40:43.402 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.smithi099 smithi099 *:9093,9094 running (6m) 25s ago 8m 24.8M - 0.25.0 c8568f914cd2 586edf6f2401 2024-09-19T06:40:43.402 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi099 smithi099 running (8m) 25s ago 8m 6895k - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 216ce2ef7f1e 2024-09-19T06:40:43.402 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi117 smithi117 running (7m) 27s ago 7m 6899k - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 b4c328bdec52 2024-09-19T06:40:43.402 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.smithi099 smithi099 *:3000 running (6m) 25s ago 7m 86.9M - 9.4.7 954c08fa6188 94ad8b9b7c91 2024-09-19T06:40:43.402 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.obarqf smithi099 running (2m) 25s ago 2m 11.9M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 e36c9b74004b 2024-09-19T06:40:43.402 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.xehbxe smithi099 running (2m) 25s ago 2m 99.7M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 d09eb3d306ae 2024-09-19T06:40:43.402 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.bheqzh smithi117 running (2m) 27s ago 2m 13.4M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 21253e27fdd3 2024-09-19T06:40:43.402 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.nooexo smithi117 running (2m) 27s ago 2m 107M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 ad1faeb3343c 2024-09-19T06:40:43.403 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi099.pgvkqi smithi099 *:9283,8765,8443 running (9m) 25s ago 9m 247M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 8e7ecb77f4cd 2024-09-19T06:40:43.403 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi117.ssmkcf smithi117 *:8443,9283 running (63s) 27s ago 7m 484M - 19.1.1-361-g2f599a46 d2baa855c067 e6f8e1afc98a 2024-09-19T06:40:43.403 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi099 smithi099 running (9m) 25s ago 9m 53.2M 2048M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 7375c241d067 2024-09-19T06:40:43.403 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi117 smithi117 running (7m) 27s ago 7m 40.0M 2048M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 bd4854d5213e 2024-09-19T06:40:43.403 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi099 smithi099 *:9100 running (8m) 25s ago 8m 14.0M - 1.5.0 0da6a335fe13 09c786facf49 2024-09-19T06:40:43.403 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi117 smithi117 *:9100 running (7m) 27s ago 7m 17.0M - 1.5.0 0da6a335fe13 04f52626cbca 2024-09-19T06:40:43.403 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (6m) 25s ago 6m 113M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 cf8d3dd4a987 2024-09-19T06:40:43.403 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (6m) 25s ago 6m 120M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 bc5b04b8bf9f 2024-09-19T06:40:43.403 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (5m) 25s ago 5m 101M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 cedc7e3698d8 2024-09-19T06:40:43.403 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi117 running (5m) 27s ago 5m 122M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 5984ed999c91 2024-09-19T06:40:43.403 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi117 running (4m) 27s ago 4m 115M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 6a2fc0c51c05 2024-09-19T06:40:43.403 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi117 running (4m) 27s ago 4m 105M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 39dcb7dbf0e3 2024-09-19T06:40:43.404 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.smithi099 smithi099 *:9095 running (6m) 25s ago 7m 59.0M - 2.43.0 a07b618ecd1d 82e83626cde9 2024-09-19T06:40:43.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.400+0000 7f127f7fe640 1 -- 172.21.15.99:0/4027807938 <== mgr.24369 v2:172.21.15.117:6828/1735340892 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f1298107fe0 con 0x7f128006e6e0 2024-09-19T06:40:43.404 INFO:tasks.workunit.client.0.smithi099.stdout:5/822: mkdir d3/d16/d2f/d34/d3c/d65/d11f 0 2024-09-19T06:40:43.405 INFO:tasks.workunit.client.1.smithi117.stdout:5/822: write d17/d1b/d3a/d3c/dcb/dde/d65/d88/de5/f80 [5171679,108412] 0 2024-09-19T06:40:43.405 INFO:tasks.workunit.client.1.smithi117.stdout:1/717: fdatasync d3/d18/d23/f9b 0 2024-09-19T06:40:43.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.403+0000 7f129d926640 1 -- 172.21.15.99:0/4027807938 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7f128006e6e0 msgr2=0x7f1280070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:43.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.403+0000 7f129d926640 1 --2- 172.21.15.99:0/4027807938 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7f128006e6e0 0x7f1280070b90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1290004a30 tx=0x7f1290004d10 comp rx=0 tx=0).stop 2024-09-19T06:40:43.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.403+0000 7f129d926640 1 -- 172.21.15.99:0/4027807938 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f129806e540 msgr2=0x7f1298111d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:43.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.403+0000 7f129d926640 1 --2- 172.21.15.99:0/4027807938 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f129806e540 0x7f1298111d00 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f128800b790 tx=0x7f12880091d0 comp rx=0 tx=0).stop 2024-09-19T06:40:43.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.403+0000 7f129d926640 1 -- 172.21.15.99:0/4027807938 shutdown_connections 2024-09-19T06:40:43.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.403+0000 7f129d926640 1 --2- 172.21.15.99:0/4027807938 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7f128006e6e0 0x7f1280070b90 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:43.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.403+0000 7f129d926640 1 --2- 172.21.15.99:0/4027807938 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f129806e540 0x7f1298111d00 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:43.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.403+0000 7f129d926640 1 --2- 172.21.15.99:0/4027807938 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f129806dbf0 0x7f12981117c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:43.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.403+0000 7f129d926640 1 -- 172.21.15.99:0/4027807938 >> 172.21.15.99:0/4027807938 conn(0x7f1298069560 msgr2=0x7f12981068c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:43.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.403+0000 7f129d926640 1 -- 172.21.15.99:0/4027807938 shutdown_connections 2024-09-19T06:40:43.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.403+0000 7f129d926640 1 -- 172.21.15.99:0/4027807938 wait complete. 2024-09-19T06:40:43.406 INFO:tasks.workunit.client.0.smithi099.stdout:5/823: symlink d3/d7/d90/dd2/l120 0 2024-09-19T06:40:43.407 INFO:tasks.workunit.client.0.smithi099.stdout:5/824: chown d3/d2a 16721 1 2024-09-19T06:40:43.408 INFO:tasks.workunit.client.0.smithi099.stdout:6/635: truncate d1/d5/d38/d76/f90 2270183 0 2024-09-19T06:40:43.413 INFO:tasks.workunit.client.0.smithi099.stdout:6/636: rename d1/d12/c5e to d1/d5/d24/d2b/dc2/cd0 0 2024-09-19T06:40:43.414 INFO:tasks.workunit.client.0.smithi099.stdout:8/537: write d4/fa [3719899,46991] 0 2024-09-19T06:40:43.415 INFO:tasks.workunit.client.0.smithi099.stdout:5/825: link d3/cc d3/d7/d90/df4/c121 0 2024-09-19T06:40:43.416 INFO:tasks.workunit.client.1.smithi117.stdout:8/769: dwrite d1d/d2a/f76 [0,4194304] 0 2024-09-19T06:40:43.417 INFO:tasks.workunit.client.1.smithi117.stdout:8/770: chown d1d/d31 359798902 1 2024-09-19T06:40:43.417 INFO:tasks.workunit.client.0.smithi099.stdout:6/637: fdatasync d1/d5/d38/d76/db0/d2a/f47 0 2024-09-19T06:40:43.417 INFO:tasks.workunit.client.0.smithi099.stdout:5/826: truncate d3/d7/f64 8944460 0 2024-09-19T06:40:43.420 INFO:tasks.workunit.client.1.smithi117.stdout:0/756: write d11/d13/d14/d2c/f50 [1463910,82558] 0 2024-09-19T06:40:43.421 INFO:tasks.workunit.client.0.smithi099.stdout:8/538: fsync d4/de/d26/d2b/f58 0 2024-09-19T06:40:43.426 INFO:tasks.workunit.client.0.smithi099.stdout:5/827: rename d3/d7/c69 to d3/d16/d2f/d34/da4/dd8/c122 0 2024-09-19T06:40:43.428 INFO:tasks.workunit.client.0.smithi099.stdout:6/638: dwrite d1/d5/d24/d2e/f8f [0,4194304] 0 2024-09-19T06:40:43.430 INFO:tasks.workunit.client.1.smithi117.stdout:6/588: truncate d1/d5/d8/f19 8352134 0 2024-09-19T06:40:43.431 INFO:tasks.workunit.client.0.smithi099.stdout:8/539: mknod d4/d11/d23/cb8 0 2024-09-19T06:40:43.432 INFO:tasks.workunit.client.1.smithi117.stdout:2/853: dread d0/d12/d32/f63 [0,4194304] 0 2024-09-19T06:40:43.433 INFO:tasks.workunit.client.1.smithi117.stdout:2/854: write d0/d7/d29/d35/d61/d65/fc6 [481649,57424] 0 2024-09-19T06:40:43.434 INFO:tasks.workunit.client.0.smithi099.stdout:5/828: read d3/d16/d2f/d34/d3c/d65/f84 [2139098,27583] 0 2024-09-19T06:40:43.436 INFO:tasks.workunit.client.1.smithi117.stdout:5/823: creat d17/d1b/d3a/d3c/dcb/dde/d65/d88/de5/d3b/d109/f10e x:0 0 0 2024-09-19T06:40:43.436 INFO:tasks.workunit.client.0.smithi099.stdout:8/540: getdents d4/de/d26/d2b/dae 0 2024-09-19T06:40:43.437 INFO:tasks.workunit.client.0.smithi099.stdout:5/829: mknod d3/d16/d2f/d8c/c123 0 2024-09-19T06:40:43.438 INFO:tasks.workunit.client.1.smithi117.stdout:8/771: mkdir d1d/d2a/d3f/d4b/d5f/dbf/dd0/db9/d106 0 2024-09-19T06:40:43.440 INFO:tasks.workunit.client.1.smithi117.stdout:6/589: mknod d1/d3d/ca6 0 2024-09-19T06:40:43.441 INFO:tasks.workunit.client.0.smithi099.stdout:8/541: creat d4/d11/d23/d4c/d93/fb9 x:0 0 0 2024-09-19T06:40:43.441 INFO:tasks.workunit.client.1.smithi117.stdout:6/590: truncate d1/d5/f8e 830107 0 2024-09-19T06:40:43.441 INFO:tasks.workunit.client.1.smithi117.stdout:9/793: getdents d4/d8/d6e/da4 0 2024-09-19T06:40:43.442 INFO:tasks.workunit.client.0.smithi099.stdout:5/830: creat d3/d16/d2f/d34/d3c/de1/f124 x:0 0 0 2024-09-19T06:40:43.442 INFO:tasks.workunit.client.1.smithi117.stdout:3/802: creat d0/f105 x:0 0 0 2024-09-19T06:40:43.443 INFO:tasks.workunit.client.1.smithi117.stdout:6/591: readlink d1/d5/d8/d27/d77/l97 0 2024-09-19T06:40:43.443 INFO:tasks.workunit.client.0.smithi099.stdout:6/639: write d1/d5/f50 [3907188,33626] 0 2024-09-19T06:40:43.443 INFO:tasks.workunit.client.0.smithi099.stdout:8/542: truncate d4/de/d1c/d99/fa2 3124626 0 2024-09-19T06:40:43.445 INFO:tasks.workunit.client.0.smithi099.stdout:6/640: chown d1/d5/d38/dbb/da7 180691 1 2024-09-19T06:40:43.446 INFO:tasks.workunit.client.0.smithi099.stdout:8/543: mkdir d4/de/d26/d2b/dba 0 2024-09-19T06:40:43.446 INFO:tasks.workunit.client.0.smithi099.stdout:6/641: rmdir d1/d5/d24/d2b 39 2024-09-19T06:40:43.448 INFO:tasks.workunit.client.0.smithi099.stdout:6/642: write d1/d5/d24/fbc [502616,116579] 0 2024-09-19T06:40:43.448 INFO:tasks.workunit.client.1.smithi117.stdout:8/772: creat d1d/d1e/dbc/dff/f107 x:0 0 0 2024-09-19T06:40:43.448 INFO:tasks.workunit.client.0.smithi099.stdout:8/544: mkdir d4/d5e/dbb 0 2024-09-19T06:40:43.450 INFO:tasks.workunit.client.1.smithi117.stdout:1/718: getdents d3/da1/dcc 0 2024-09-19T06:40:43.455 INFO:tasks.workunit.client.0.smithi099.stdout:6/643: creat d1/d5/d38/d76/db0/d54/fd1 x:0 0 0 2024-09-19T06:40:43.456 INFO:tasks.workunit.client.0.smithi099.stdout:8/545: rmdir d4/d11/d23/d4c/d93 39 2024-09-19T06:40:43.456 INFO:tasks.workunit.client.1.smithi117.stdout:3/803: chown d0/d8/d7f/dbf/ff0 1189 1 2024-09-19T06:40:43.456 INFO:tasks.workunit.client.1.smithi117.stdout:8/773: truncate d1d/d31/f79 715676 0 2024-09-19T06:40:43.458 INFO:tasks.workunit.client.0.smithi099.stdout:6/644: dread - d1/d5/d24/f85 zero size 2024-09-19T06:40:43.458 INFO:tasks.workunit.client.1.smithi117.stdout:9/794: dwrite d4/d1c/d5f/dbc/fed [0,4194304] 0 2024-09-19T06:40:43.459 INFO:tasks.workunit.client.1.smithi117.stdout:5/824: dwrite d17/d1b/d3a/d3c/dcb/dde/dab/fad [0,4194304] 0 2024-09-19T06:40:43.459 INFO:tasks.workunit.client.0.smithi099.stdout:8/546: mknod d4/de/d10/cbc 0 2024-09-19T06:40:43.460 INFO:tasks.workunit.client.1.smithi117.stdout:7/789: dwrite d1/d4a/d81/d48/d5f/d82/fc3 [4194304,4194304] 0 2024-09-19T06:40:43.461 INFO:tasks.workunit.client.1.smithi117.stdout:6/592: link d1/d5/d8/d5e/l6a d1/d3/d25/la7 0 2024-09-19T06:40:43.462 INFO:tasks.workunit.client.1.smithi117.stdout:0/757: write d11/d13/d1b/d27/fdf [927171,108055] 0 2024-09-19T06:40:43.465 INFO:tasks.workunit.client.1.smithi117.stdout:5/825: mkdir d17/d1b/d3a/d3c/d46/d10f 0 2024-09-19T06:40:43.465 INFO:tasks.workunit.client.1.smithi117.stdout:8/774: creat d1d/d2a/f108 x:0 0 0 2024-09-19T06:40:43.467 INFO:tasks.workunit.client.1.smithi117.stdout:6/593: readlink d1/d5/d8/d5e/l6a 0 2024-09-19T06:40:43.468 INFO:tasks.workunit.client.0.smithi099.stdout:8/547: dwrite d4/de/d26/d2b/fb5 [0,4194304] 0 2024-09-19T06:40:43.469 INFO:tasks.workunit.client.1.smithi117.stdout:1/719: getdents d3/d18/d91/df8 0 2024-09-19T06:40:43.470 INFO:tasks.workunit.client.0.smithi099.stdout:6/645: symlink d1/d5/d24/d2b/d86/da5/ld2 0 2024-09-19T06:40:43.471 INFO:tasks.workunit.client.1.smithi117.stdout:6/594: write d1/d5/d8/d5e/f8d [474197,91307] 0 2024-09-19T06:40:43.472 INFO:tasks.workunit.client.1.smithi117.stdout:3/804: dwrite d0/f92 [0,4194304] 0 2024-09-19T06:40:43.473 INFO:tasks.workunit.client.0.smithi099.stdout:8/548: creat d4/d66/fbd x:0 0 0 2024-09-19T06:40:43.474 INFO:tasks.workunit.client.1.smithi117.stdout:7/790: rename d1/d4a/d81/d24/d26/f37 to d1/d4a/d81/d24/d26/d44/dfb/f11c 0 2024-09-19T06:40:43.474 INFO:tasks.workunit.client.1.smithi117.stdout:7/791: readlink d1/d4a/d77/lb0 0 2024-09-19T06:40:43.475 INFO:tasks.workunit.client.1.smithi117.stdout:7/792: dread - d1/d4a/d81/fe4 zero size 2024-09-19T06:40:43.475 INFO:tasks.workunit.client.1.smithi117.stdout:7/793: chown d1/d4a/d7c/ld4 10 1 2024-09-19T06:40:43.476 INFO:tasks.workunit.client.1.smithi117.stdout:9/795: creat d4/f10c x:0 0 0 2024-09-19T06:40:43.477 INFO:tasks.workunit.client.0.smithi099.stdout:5/831: dread d3/d16/f83 [0,4194304] 0 2024-09-19T06:40:43.478 INFO:tasks.workunit.client.1.smithi117.stdout:8/775: mkdir d1d/d31/d83/dad/dc0/d109 0 2024-09-19T06:40:43.478 INFO:tasks.workunit.client.0.smithi099.stdout:6/646: rmdir d1/d5/d24/d2e/d7b/dba/dcf 0 2024-09-19T06:40:43.480 INFO:tasks.workunit.client.0.smithi099.stdout:5/832: stat d3/d2a/f5f 0 2024-09-19T06:40:43.484 INFO:tasks.workunit.client.1.smithi117.stdout:1/720: truncate d3/d18/d23/d74/d89/d9f/fdf 385106 0 2024-09-19T06:40:43.484 INFO:tasks.workunit.client.1.smithi117.stdout:0/758: creat d11/d13/d28/de6/ff9 x:0 0 0 2024-09-19T06:40:43.484 INFO:tasks.workunit.client.0.smithi099.stdout:5/833: truncate d3/d16/d2f/f75 2036262 0 2024-09-19T06:40:43.485 INFO:tasks.workunit.client.1.smithi117.stdout:6/595: mkdir d1/d5/d8/d27/d77/da8 0 2024-09-19T06:40:43.485 INFO:tasks.workunit.client.0.smithi099.stdout:6/647: mkdir d1/d5/d38/d76/db0/d54/d5d/d61/d65/dd3 0 2024-09-19T06:40:43.486 INFO:tasks.workunit.client.1.smithi117.stdout:9/796: creat d4/d1c/d46/de1/f10d x:0 0 0 2024-09-19T06:40:43.487 INFO:tasks.workunit.client.1.smithi117.stdout:7/794: truncate d1/d4a/d81/d24/d49/f62 1662696 0 2024-09-19T06:40:43.487 INFO:tasks.workunit.client.0.smithi099.stdout:5/834: fsync d3/d16/d2f/d34/d3c/fc8 0 2024-09-19T06:40:43.488 INFO:tasks.workunit.client.1.smithi117.stdout:0/759: stat d11/d13/d14/d2c/d53/d7e/daa/dca/ld8 0 2024-09-19T06:40:43.489 INFO:tasks.workunit.client.1.smithi117.stdout:9/797: fsync d4/d58/f9b 0 2024-09-19T06:40:43.491 INFO:tasks.workunit.client.1.smithi117.stdout:3/805: write d0/d9/d1c/fb0 [599858,23177] 0 2024-09-19T06:40:43.493 INFO:tasks.workunit.client.1.smithi117.stdout:6/596: truncate d1/d5/d8/d5e/d67/d98/fa3 368810 0 2024-09-19T06:40:43.493 INFO:tasks.workunit.client.0.smithi099.stdout:6/648: dwrite d1/d5/d38/d76/db0/d54/d5d/d61/f8a [0,4194304] 0 2024-09-19T06:40:43.494 INFO:tasks.workunit.client.0.smithi099.stdout:5/835: getdents d3/d16/d2f/d34/d3c 0 2024-09-19T06:40:43.496 INFO:tasks.workunit.client.1.smithi117.stdout:7/795: creat d1/d4a/d81/d24/d49/dbf/dcf/f11d x:0 0 0 2024-09-19T06:40:43.497 INFO:tasks.workunit.client.0.smithi099.stdout:6/649: mknod d1/cd4 0 2024-09-19T06:40:43.498 INFO:tasks.workunit.client.0.smithi099.stdout:7/798: sync 2024-09-19T06:40:43.499 INFO:tasks.workunit.client.1.smithi117.stdout:6/597: unlink d1/d3/f3e 0 2024-09-19T06:40:43.499 INFO:tasks.workunit.client.1.smithi117.stdout:1/721: dwrite d3/d18/d23/d74/d89/d9f/ff1 [0,4194304] 0 2024-09-19T06:40:43.499 INFO:tasks.workunit.client.1.smithi117.stdout:9/798: read d4/d1c/d73/d93/fa0 [570198,72216] 0 2024-09-19T06:40:43.500 INFO:tasks.workunit.client.1.smithi117.stdout:0/760: truncate d11/d13/d1b/d27/f7d 5012098 0 2024-09-19T06:40:43.501 INFO:tasks.workunit.client.0.smithi099.stdout:7/799: stat d7/dcf/d29/c1d 0 2024-09-19T06:40:43.501 INFO:tasks.workunit.client.1.smithi117.stdout:3/806: read - d0/d8/d64/f66 zero size 2024-09-19T06:40:43.502 INFO:tasks.workunit.client.0.smithi099.stdout:5/836: link d3/d1f/d4f/l54 d3/d16/d2f/d34/da4/dd8/l125 0 2024-09-19T06:40:43.503 INFO:tasks.workunit.client.0.smithi099.stdout:5/837: stat d3/d7/d90/dd2 0 2024-09-19T06:40:43.504 INFO:tasks.workunit.client.0.smithi099.stdout:6/650: dread d1/f1e [0,4194304] 0 2024-09-19T06:40:43.505 INFO:tasks.workunit.client.1.smithi117.stdout:7/796: creat d1/d4a/d81/d113/f11e x:0 0 0 2024-09-19T06:40:43.507 INFO:tasks.workunit.client.1.smithi117.stdout:9/799: creat d4/d17/dd7/f10e x:0 0 0 2024-09-19T06:40:43.508 INFO:tasks.workunit.client.0.smithi099.stdout:5/838: mknod d3/d16/d2f/d34/da4/c126 0 2024-09-19T06:40:43.509 INFO:tasks.workunit.client.1.smithi117.stdout:8/776: dread d1d/ffb [0,4194304] 0 2024-09-19T06:40:43.510 INFO:tasks.workunit.client.1.smithi117.stdout:6/598: mkdir d1/d5/d9a/da9 0 2024-09-19T06:40:43.510 INFO:tasks.workunit.client.0.smithi099.stdout:7/800: dread d7/dcf/d29/d1f/d45/d48/d63/d75/dd8/df6/fff [0,4194304] 0 2024-09-19T06:40:43.512 INFO:tasks.workunit.client.1.smithi117.stdout:7/797: dwrite d1/d4a/d81/f84 [0,4194304] 0 2024-09-19T06:40:43.512 INFO:tasks.workunit.client.0.smithi099.stdout:5/839: write d3/d7/d90/fe6 [1366079,103559] 0 2024-09-19T06:40:43.515 INFO:tasks.workunit.client.0.smithi099.stdout:6/651: getdents d1/d5/d24/d2e/d7b 0 2024-09-19T06:40:43.517 INFO:tasks.workunit.client.1.smithi117.stdout:5/826: dwrite d17/d1b/d3a/d3c/dcb/dde/d55/f98 [0,4194304] 0 2024-09-19T06:40:43.518 INFO:tasks.workunit.client.1.smithi117.stdout:0/761: fsync d11/d13/d28/f7f 0 2024-09-19T06:40:43.518 INFO:tasks.workunit.client.0.smithi099.stdout:8/549: dread d4/d11/d23/d4c/f69 [0,4194304] 0 2024-09-19T06:40:43.525 INFO:tasks.workunit.client.0.smithi099.stdout:7/801: write d7/dcf/d29/d1f/f9e [584869,43560] 0 2024-09-19T06:40:43.525 INFO:tasks.workunit.client.0.smithi099.stdout:5/840: dwrite d3/f37 [0,4194304] 0 2024-09-19T06:40:43.529 INFO:tasks.workunit.client.1.smithi117.stdout:3/807: mknod d0/d8/d64/c106 0 2024-09-19T06:40:43.529 INFO:tasks.workunit.client.0.smithi099.stdout:6/652: link d1/d5/f33 d1/d5/d38/dbb/fd5 0 2024-09-19T06:40:43.529 INFO:tasks.workunit.client.1.smithi117.stdout:1/722: mkdir d3/d18/d23/dfc 0 2024-09-19T06:40:43.530 INFO:tasks.workunit.client.1.smithi117.stdout:9/800: mknod d4/d1c/d5f/dbc/c10f 0 2024-09-19T06:40:43.531 INFO:tasks.workunit.client.0.smithi099.stdout:5/841: mknod d3/d16/d2f/d34/dfa/c127 0 2024-09-19T06:40:43.531 INFO:tasks.workunit.client.0.smithi099.stdout:7/802: write d7/dcf/d29/d1f/d45/d48/d63/d75/fa4 [200519,83272] 0 2024-09-19T06:40:43.532 INFO:tasks.workunit.client.1.smithi117.stdout:8/777: rename d1d/d1e/fee to d1d/d2a/d3f/d4b/d5f/dbf/dd0/db9/dd6/f10a 0 2024-09-19T06:40:43.534 INFO:tasks.workunit.client.0.smithi099.stdout:5/842: mkdir d3/d7/d90/dd2/d128 0 2024-09-19T06:40:43.537 INFO:tasks.workunit.client.1.smithi117.stdout:0/762: mkdir d11/d13/d7a/dfa 0 2024-09-19T06:40:43.544 INFO:tasks.workunit.client.0.smithi099.stdout:8/550: truncate d4/d66/f7d 2840597 0 2024-09-19T06:40:43.545 INFO:tasks.workunit.client.1.smithi117.stdout:6/599: symlink d1/d5/d8/laa 0 2024-09-19T06:40:43.545 INFO:tasks.workunit.client.1.smithi117.stdout:6/600: chown d1 640191 1 2024-09-19T06:40:43.545 INFO:tasks.workunit.client.0.smithi099.stdout:8/551: truncate d4/d66/f76 8720381 0 2024-09-19T06:40:43.546 INFO:tasks.workunit.client.0.smithi099.stdout:7/803: dread d7/dcf/d29/d1f/fd3 [0,4194304] 0 2024-09-19T06:40:43.546 INFO:tasks.workunit.client.1.smithi117.stdout:6/601: write d1/d5/d8/d5e/d6d/f71 [2475098,107424] 0 2024-09-19T06:40:43.548 INFO:tasks.workunit.client.1.smithi117.stdout:9/801: creat d4/d1c/d7a/d16/dac/f110 x:0 0 0 2024-09-19T06:40:43.549 INFO:tasks.workunit.client.1.smithi117.stdout:9/802: chown d4/d17/f7b 5145094 1 2024-09-19T06:40:43.550 INFO:tasks.workunit.client.1.smithi117.stdout:8/778: truncate d1d/d2a/d3f/d4b/d5f/d95/fab 92996 0 2024-09-19T06:40:43.550 INFO:tasks.workunit.client.0.smithi099.stdout:8/552: truncate d4/d11/d23/d4c/d93/fb9 878584 0 2024-09-19T06:40:43.551 INFO:tasks.workunit.client.1.smithi117.stdout:0/763: creat d11/d13/d1b/d27/d54/ffb x:0 0 0 2024-09-19T06:40:43.552 INFO:tasks.workunit.client.1.smithi117.stdout:0/764: write d11/d13/d14/d2c/d35/d3e/fcb [328227,73821] 0 2024-09-19T06:40:43.552 INFO:tasks.workunit.client.0.smithi099.stdout:7/804: dwrite d7/dcf/d29/d34/d8f/fc3 [4194304,4194304] 0 2024-09-19T06:40:43.553 INFO:tasks.workunit.client.1.smithi117.stdout:1/723: unlink d3/c30 0 2024-09-19T06:40:43.554 INFO:tasks.workunit.client.0.smithi099.stdout:8/553: write d4/de/d1c/d99/fa2 [3109844,104645] 0 2024-09-19T06:40:43.555 INFO:tasks.workunit.client.0.smithi099.stdout:7/805: fsync d7/dcf/d97/fe6 0 2024-09-19T06:40:43.555 INFO:tasks.workunit.client.0.smithi099.stdout:8/554: write d4/d11/d23/d4c/d93/f94 [3296692,38583] 0 2024-09-19T06:40:43.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.554+0000 7fca04ee3640 1 -- 172.21.15.99:0/1364708415 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca000fc3f0 msgr2=0x7fca000fc860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:43.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.554+0000 7fca04ee3640 1 --2- 172.21.15.99:0/1364708415 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca000fc3f0 0x7fca000fc860 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc9f4004c60 tx=0x7fc9f4009ad0 comp rx=0 tx=0).stop 2024-09-19T06:40:43.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.555+0000 7fca04ee3640 1 -- 172.21.15.99:0/1364708415 shutdown_connections 2024-09-19T06:40:43.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.555+0000 7fca04ee3640 1 --2- 172.21.15.99:0/1364708415 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca000fc3f0 0x7fca000fc860 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:43.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.555+0000 7fca04ee3640 1 --2- 172.21.15.99:0/1364708415 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fca000fbaa0 0x7fca000fbeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:43.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.555+0000 7fca04ee3640 1 -- 172.21.15.99:0/1364708415 >> 172.21.15.99:0/1364708415 conn(0x7fca000f6390 msgr2=0x7fca000f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:43.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.555+0000 7fca04ee3640 1 -- 172.21.15.99:0/1364708415 shutdown_connections 2024-09-19T06:40:43.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.555+0000 7fca04ee3640 1 -- 172.21.15.99:0/1364708415 wait complete. 2024-09-19T06:40:43.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.556+0000 7fca04ee3640 1 Processor -- start 2024-09-19T06:40:43.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.556+0000 7fca04ee3640 1 -- start start 2024-09-19T06:40:43.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.556+0000 7fca04ee3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca000fbaa0 0x7fca001134f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:43.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.557+0000 7fca04ee3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fca000fc3f0 0x7fca00113a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:43.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.557+0000 7fca04ee3640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca00114080 con 0x7fca000fc3f0 2024-09-19T06:40:43.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.557+0000 7fca04ee3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca001148a0 con 0x7fca000fbaa0 2024-09-19T06:40:43.558 INFO:tasks.workunit.client.0.smithi099.stdout:7/806: creat d7/dcf/d29/d1f/d45/d48/dda/f121 x:0 0 0 2024-09-19T06:40:43.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.557+0000 7fc9fe59c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca000fbaa0 0x7fca001134f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:43.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.557+0000 7fc9fe59c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca000fbaa0 0x7fca001134f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.99:55004/0 (socket says 172.21.15.99:55004) 2024-09-19T06:40:43.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.557+0000 7fc9fe59c640 1 -- 172.21.15.99:0/181926623 learned_addr learned my addr 172.21.15.99:0/181926623 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:40:43.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.557+0000 7fc9fe59c640 1 -- 172.21.15.99:0/181926623 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fca000fc3f0 msgr2=0x7fca00113a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:43.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.557+0000 7fc9fe59c640 1 --2- 172.21.15.99:0/181926623 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fca000fc3f0 0x7fca00113a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:43.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.557+0000 7fc9fe59c640 1 -- 172.21.15.99:0/181926623 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9f4005040 con 0x7fca000fbaa0 2024-09-19T06:40:43.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.558+0000 7fc9fe59c640 1 --2- 172.21.15.99:0/181926623 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca000fbaa0 0x7fca001134f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc9f0002a50 tx=0x7fc9f0009f50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:43.560 INFO:tasks.workunit.client.1.smithi117.stdout:1/724: fsync d3/d22/f88 0 2024-09-19T06:40:43.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.558+0000 7fc9eeffd640 1 -- 172.21.15.99:0/181926623 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9f0007c30 con 0x7fca000fbaa0 2024-09-19T06:40:43.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.558+0000 7fc9eeffd640 1 -- 172.21.15.99:0/181926623 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc9f000f040 con 0x7fca000fbaa0 2024-09-19T06:40:43.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.558+0000 7fca04ee3640 1 -- 172.21.15.99:0/181926623 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca00114b30 con 0x7fca000fbaa0 2024-09-19T06:40:43.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.558+0000 7fc9eeffd640 1 -- 172.21.15.99:0/181926623 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9f0007c30 con 0x7fca000fbaa0 2024-09-19T06:40:43.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.558+0000 7fca04ee3640 1 -- 172.21.15.99:0/181926623 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca00115080 con 0x7fca000fbaa0 2024-09-19T06:40:43.561 INFO:tasks.workunit.client.0.smithi099.stdout:8/555: rename d4/d11/d23/l41 to d4/de/d26/d8d/lbe 0 2024-09-19T06:40:43.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.560+0000 7fca04ee3640 1 -- 172.21.15.99:0/181926623 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca000fa010 con 0x7fca000fbaa0 2024-09-19T06:40:43.562 INFO:tasks.workunit.client.1.smithi117.stdout:7/798: rename d1/d72/dd7/f10b to d1/f11f 0 2024-09-19T06:40:43.562 INFO:tasks.workunit.client.1.smithi117.stdout:8/779: fdatasync d1d/d1e/d53/d6e/f92 0 2024-09-19T06:40:43.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.561+0000 7fc9eeffd640 1 -- 172.21.15.99:0/181926623 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7fc9f0009310 con 0x7fca000fbaa0 2024-09-19T06:40:43.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.562+0000 7fc9eeffd640 1 --2- 172.21.15.99:0/181926623 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7fc9e806e780 0x7fc9e8070c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:43.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.562+0000 7fc9eeffd640 1 -- 172.21.15.99:0/181926623 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fc9f008d690 con 0x7fca000fbaa0 2024-09-19T06:40:43.564 INFO:tasks.workunit.client.1.smithi117.stdout:0/765: link d11/d13/d1b/d27/d54/ffb d11/d13/d14/d2c/d53/d7e/daa/dca/ffc 0 2024-09-19T06:40:43.565 INFO:tasks.workunit.client.0.smithi099.stdout:8/556: creat d4/d11/fbf x:0 0 0 2024-09-19T06:40:43.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.563+0000 7fc9fdd9b640 1 --2- 172.21.15.99:0/181926623 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7fc9e806e780 0x7fc9e8070c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:43.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.564+0000 7fc9fdd9b640 1 --2- 172.21.15.99:0/181926623 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7fc9e806e780 0x7fc9e8070c30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc9f4004b80 tx=0x7fc9f4009ad0 comp rx=0 tx=0).ready entity=mgr.24369 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:43.565 INFO:tasks.workunit.client.0.smithi099.stdout:8/557: chown d4/d11/d23 5 1 2024-09-19T06:40:43.566 INFO:tasks.workunit.client.1.smithi117.stdout:8/780: creat d1d/d1e/dbc/dff/f10b x:0 0 0 2024-09-19T06:40:43.567 INFO:tasks.workunit.client.1.smithi117.stdout:1/725: rename d3/d18/d23/f9b to d3/d18/ffd 0 2024-09-19T06:40:43.568 INFO:tasks.workunit.client.0.smithi099.stdout:8/558: mkdir d4/d11/d38/dc0 0 2024-09-19T06:40:43.569 INFO:tasks.workunit.client.1.smithi117.stdout:0/766: write d11/d13/d1b/d27/f55 [23639,5288] 0 2024-09-19T06:40:43.569 INFO:tasks.workunit.client.1.smithi117.stdout:8/781: creat d1d/d2a/d3f/d4b/d5f/f10c x:0 0 0 2024-09-19T06:40:43.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.568+0000 7fc9eeffd640 1 -- 172.21.15.99:0/181926623 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7fc9f0056f10 con 0x7fca000fbaa0 2024-09-19T06:40:43.570 INFO:tasks.workunit.client.0.smithi099.stdout:8/559: symlink d4/d11/d38/lc1 0 2024-09-19T06:40:43.570 INFO:tasks.workunit.client.1.smithi117.stdout:7/799: dwrite d1/d4a/d81/d24/d1c/f79 [0,4194304] 0 2024-09-19T06:40:43.573 INFO:tasks.workunit.client.1.smithi117.stdout:0/767: write d11/f19 [2607721,11409] 0 2024-09-19T06:40:43.574 INFO:tasks.workunit.client.1.smithi117.stdout:7/800: chown d1/d4a/d81/d48/f11b 374511 1 2024-09-19T06:40:43.574 INFO:tasks.workunit.client.1.smithi117.stdout:8/782: truncate d1d/d31/d83/dad/dc0/fce 438704 0 2024-09-19T06:40:43.575 INFO:tasks.workunit.client.0.smithi099.stdout:8/560: mkdir d4/d5e/db4/dc2 0 2024-09-19T06:40:43.576 INFO:tasks.workunit.client.1.smithi117.stdout:7/801: write d1/d4a/d7c/fd8 [251062,85038] 0 2024-09-19T06:40:43.576 INFO:tasks.workunit.client.1.smithi117.stdout:1/726: rename d3/d18/d23/d74/d89/lcd to d3/lfe 0 2024-09-19T06:40:43.578 INFO:tasks.workunit.client.1.smithi117.stdout:0/768: symlink d11/d13/d7a/dfa/lfd 0 2024-09-19T06:40:43.579 INFO:tasks.workunit.client.0.smithi099.stdout:8/561: read d4/de/d26/f28 [2759792,40793] 0 2024-09-19T06:40:43.580 INFO:tasks.workunit.client.1.smithi117.stdout:1/727: creat d3/d22/d2f/fff x:0 0 0 2024-09-19T06:40:43.582 INFO:tasks.workunit.client.1.smithi117.stdout:8/783: dwrite d1d/d1e/f2c [4194304,4194304] 0 2024-09-19T06:40:43.585 INFO:tasks.workunit.client.0.smithi099.stdout:5/843: dread d3/d16/d5e/fbb [0,4194304] 0 2024-09-19T06:40:43.586 INFO:tasks.workunit.client.1.smithi117.stdout:1/728: symlink d3/d18/d23/dfc/l100 0 2024-09-19T06:40:43.587 INFO:tasks.workunit.client.1.smithi117.stdout:8/784: symlink d1d/d1e/dbc/dff/l10d 0 2024-09-19T06:40:43.589 INFO:tasks.workunit.client.0.smithi099.stdout:7/807: dread d7/dcf/d29/f4c [0,4194304] 0 2024-09-19T06:40:43.589 INFO:tasks.workunit.client.1.smithi117.stdout:2/855: sync 2024-09-19T06:40:43.590 INFO:tasks.workunit.client.1.smithi117.stdout:0/769: dwrite d11/d13/d14/d2c/d35/f6c [0,4194304] 0 2024-09-19T06:40:43.591 INFO:tasks.workunit.client.1.smithi117.stdout:8/785: mkdir d1d/d1e/dbc/dff/d10e 0 2024-09-19T06:40:43.593 INFO:tasks.workunit.client.1.smithi117.stdout:0/770: truncate d11/d13/d14/d16/f3a 5201677 0 2024-09-19T06:40:43.595 INFO:tasks.workunit.client.1.smithi117.stdout:8/786: creat d1d/d2a/d3f/d73/f10f x:0 0 0 2024-09-19T06:40:43.596 INFO:tasks.workunit.client.1.smithi117.stdout:0/771: rmdir d11/d13/d14 39 2024-09-19T06:40:43.596 INFO:tasks.workunit.client.1.smithi117.stdout:3/808: dread d0/d8/f20 [4194304,4194304] 0 2024-09-19T06:40:43.597 INFO:tasks.workunit.client.1.smithi117.stdout:8/787: write d1d/d31/f79 [789441,48183] 0 2024-09-19T06:40:43.599 INFO:tasks.workunit.client.0.smithi099.stdout:7/808: rename d7/dcf/d29/d1f/d45/d48/l74 to d7/dc7/l122 0 2024-09-19T06:40:43.600 INFO:tasks.workunit.client.1.smithi117.stdout:2/856: dread d0/d12/f3c [0,4194304] 0 2024-09-19T06:40:43.601 INFO:tasks.workunit.client.1.smithi117.stdout:2/857: fdatasync d0/d7/d29/f5f 0 2024-09-19T06:40:43.602 INFO:tasks.workunit.client.0.smithi099.stdout:7/809: mknod d7/d39/d7d/dd6/c123 0 2024-09-19T06:40:43.604 INFO:tasks.workunit.client.1.smithi117.stdout:3/809: mknod d0/d9/d4e/c107 0 2024-09-19T06:40:43.606 INFO:tasks.workunit.client.1.smithi117.stdout:3/810: readlink d0/d9/d4e/dcf/le7 0 2024-09-19T06:40:43.606 INFO:tasks.workunit.client.1.smithi117.stdout:9/803: dread d4/d1c/f35 [0,4194304] 0 2024-09-19T06:40:43.607 INFO:tasks.workunit.client.1.smithi117.stdout:5/827: write d17/d1b/d3a/d3c/dcb/dde/d65/d88/de5/d3b/f78 [3178287,69013] 0 2024-09-19T06:40:43.608 INFO:tasks.workunit.client.1.smithi117.stdout:3/811: chown d0/d3d/d48/dc7/ce1 1094833 1 2024-09-19T06:40:43.609 INFO:tasks.workunit.client.1.smithi117.stdout:2/858: rename d0/d7/c56 to d0/d64/dd9/c13c 0 2024-09-19T06:40:43.611 INFO:tasks.workunit.client.1.smithi117.stdout:9/804: mknod d4/d1c/d5f/c111 0 2024-09-19T06:40:43.614 INFO:tasks.workunit.client.1.smithi117.stdout:5/828: creat d17/d1b/d3a/d3c/dcb/dde/da6/f110 x:0 0 0 2024-09-19T06:40:43.616 INFO:tasks.workunit.client.1.smithi117.stdout:5/829: chown d17/d1b/d3a/d3c/f57 1200509354 1 2024-09-19T06:40:43.618 INFO:tasks.workunit.client.1.smithi117.stdout:2/859: mknod d0/d7/d29/d35/d61/c13d 0 2024-09-19T06:40:43.619 INFO:tasks.workunit.client.1.smithi117.stdout:9/805: dwrite d4/d1c/d36/d37/fde [0,4194304] 0 2024-09-19T06:40:43.621 INFO:tasks.workunit.client.1.smithi117.stdout:2/860: write d0/d12/f78 [1201208,73246] 0 2024-09-19T06:40:43.622 INFO:tasks.workunit.client.0.smithi099.stdout:8/562: dwrite d4/d11/d23/d92/fa4 [0,4194304] 0 2024-09-19T06:40:43.623 INFO:tasks.workunit.client.1.smithi117.stdout:9/806: dread - d4/d1c/d5f/f80 zero size 2024-09-19T06:40:43.624 INFO:tasks.workunit.client.0.smithi099.stdout:8/563: stat d4/de/d10/l87 0 2024-09-19T06:40:43.625 INFO:tasks.workunit.client.1.smithi117.stdout:6/602: dwrite d1/d3d/f5a [0,4194304] 0 2024-09-19T06:40:43.626 INFO:tasks.workunit.client.1.smithi117.stdout:2/861: creat d0/d7/d29/df4/d105/f13e x:0 0 0 2024-09-19T06:40:43.627 INFO:tasks.workunit.client.0.smithi099.stdout:8/564: creat d4/d5e/db4/fc3 x:0 0 0 2024-09-19T06:40:43.627 INFO:tasks.workunit.client.1.smithi117.stdout:9/807: creat d4/d17/dd7/f112 x:0 0 0 2024-09-19T06:40:43.628 INFO:tasks.workunit.client.0.smithi099.stdout:8/565: read d4/f5b [1298404,83330] 0 2024-09-19T06:40:43.629 INFO:tasks.workunit.client.0.smithi099.stdout:8/566: dread - d4/d11/d23/d4c/fa7 zero size 2024-09-19T06:40:43.629 INFO:tasks.workunit.client.1.smithi117.stdout:1/729: dread f1 [8388608,4194304] 0 2024-09-19T06:40:43.631 INFO:tasks.workunit.client.0.smithi099.stdout:8/567: creat d4/d5e/dbb/fc4 x:0 0 0 2024-09-19T06:40:43.631 INFO:tasks.workunit.client.1.smithi117.stdout:6/603: rename d1/l43 to d1/lab 0 2024-09-19T06:40:43.633 INFO:tasks.workunit.client.1.smithi117.stdout:2/862: mknod d0/d7/d29/d35/dbd/d138/c13f 0 2024-09-19T06:40:43.633 INFO:tasks.workunit.client.1.smithi117.stdout:9/808: mknod d4/d17/dd7/d100/c113 0 2024-09-19T06:40:43.634 INFO:tasks.workunit.client.0.smithi099.stdout:8/568: symlink d4/d11/d23/d4c/daf/lc5 0 2024-09-19T06:40:43.634 INFO:tasks.workunit.client.1.smithi117.stdout:1/730: mknod d3/d99/c101 0 2024-09-19T06:40:43.635 INFO:tasks.workunit.client.0.smithi099.stdout:8/569: dread - d4/d5e/db4/fc3 zero size 2024-09-19T06:40:43.635 INFO:tasks.workunit.client.1.smithi117.stdout:6/604: creat d1/d5/d8/d80/fac x:0 0 0 2024-09-19T06:40:43.636 INFO:tasks.workunit.client.0.smithi099.stdout:8/570: read d4/f5b [1881607,55869] 0 2024-09-19T06:40:43.636 INFO:tasks.workunit.client.1.smithi117.stdout:2/863: mknod d0/c140 0 2024-09-19T06:40:43.637 INFO:tasks.workunit.client.0.smithi099.stdout:8/571: truncate d4/de/d14/fa6 849852 0 2024-09-19T06:40:43.638 INFO:tasks.workunit.client.0.smithi099.stdout:8/572: write d4/de/d26/d2b/fb5 [4507867,71150] 0 2024-09-19T06:40:43.638 INFO:tasks.workunit.client.1.smithi117.stdout:1/731: truncate d3/fc5 470615 0 2024-09-19T06:40:43.639 INFO:tasks.workunit.client.0.smithi099.stdout:8/573: write d4/d66/f71 [1843077,19954] 0 2024-09-19T06:40:43.640 INFO:tasks.workunit.client.1.smithi117.stdout:1/732: write d3/f5c [3012355,71809] 0 2024-09-19T06:40:43.640 INFO:tasks.workunit.client.1.smithi117.stdout:9/809: rename d4/d1c/d7a/f64 to d4/d1c/d54/dd8/dae/f114 0 2024-09-19T06:40:43.642 INFO:tasks.workunit.client.0.smithi099.stdout:8/574: symlink d4/d11/d23/d4c/d93/lc6 0 2024-09-19T06:40:43.643 INFO:tasks.workunit.client.1.smithi117.stdout:1/733: chown d3/d18/d23/fc2 190 1 2024-09-19T06:40:43.643 INFO:tasks.workunit.client.0.smithi099.stdout:8/575: chown d4/de/c2f 14269018 1 2024-09-19T06:40:43.643 INFO:tasks.workunit.client.0.smithi099.stdout:8/576: chown d4/de/d10 659 1 2024-09-19T06:40:43.644 INFO:tasks.workunit.client.1.smithi117.stdout:2/864: dwrite d0/d7/d29/d35/dbd/d8d/d9a/ff3 [0,4194304] 0 2024-09-19T06:40:43.644 INFO:tasks.workunit.client.1.smithi117.stdout:9/810: mkdir d4/d8/d6e/ddb/d115 0 2024-09-19T06:40:43.645 INFO:tasks.workunit.client.1.smithi117.stdout:6/605: link d1/d5/d8/d5e/d6d/l75 d1/d5/d8/d27/d77/da8/lad 0 2024-09-19T06:40:43.645 INFO:tasks.workunit.client.0.smithi099.stdout:8/577: creat d4/d66/fc7 x:0 0 0 2024-09-19T06:40:43.645 INFO:tasks.workunit.client.0.smithi099.stdout:8/578: stat d4/d11/d23/d92/lab 0 2024-09-19T06:40:43.646 INFO:tasks.workunit.client.1.smithi117.stdout:6/606: read d1/d14/f23 [2601935,42443] 0 2024-09-19T06:40:43.650 INFO:tasks.workunit.client.0.smithi099.stdout:8/579: getdents d4/d11/d23 0 2024-09-19T06:40:43.654 INFO:tasks.workunit.client.0.smithi099.stdout:8/580: link d4/de/d1c/l6f d4/de/d14/lc8 0 2024-09-19T06:40:43.658 INFO:tasks.workunit.client.1.smithi117.stdout:5/830: dread d17/d1b/d3a/d3c/dcb/dde/d65/d88/de5/d3b/f78 [0,4194304] 0 2024-09-19T06:40:43.658 INFO:tasks.workunit.client.1.smithi117.stdout:5/831: chown ff 9307 1 2024-09-19T06:40:43.661 INFO:tasks.workunit.client.1.smithi117.stdout:5/832: link d17/d5c/f69 d17/f111 0 2024-09-19T06:40:43.666 INFO:tasks.workunit.client.0.smithi099.stdout:8/581: dwrite d4/de/f88 [0,4194304] 0 2024-09-19T06:40:43.666 INFO:tasks.workunit.client.1.smithi117.stdout:5/833: dwrite d17/d1b/ff0 [0,4194304] 0 2024-09-19T06:40:43.667 INFO:tasks.workunit.client.0.smithi099.stdout:8/582: chown d4/d11 418 1 2024-09-19T06:40:43.667 INFO:tasks.workunit.client.1.smithi117.stdout:5/834: dread - d17/d1b/fe9 zero size 2024-09-19T06:40:43.673 INFO:tasks.workunit.client.1.smithi117.stdout:5/835: rename d17/d1b/d3a/d3c/dcb/dde/d65/d88/de5/d3b/d109 to d17/d1b/d3a/d112 0 2024-09-19T06:40:43.676 INFO:tasks.workunit.client.0.smithi099.stdout:8/583: truncate d4/d11/d23/d92/fa4 155027 0 2024-09-19T06:40:43.678 INFO:tasks.workunit.client.0.smithi099.stdout:8/584: truncate d4/de/fa8 525664 0 2024-09-19T06:40:43.678 INFO:tasks.workunit.client.1.smithi117.stdout:5/836: creat d17/d1b/d3a/d3c/dcb/dde/da6/f113 x:0 0 0 2024-09-19T06:40:43.680 INFO:tasks.workunit.client.0.smithi099.stdout:8/585: mkdir d4/de/d26/d2b/dc9 0 2024-09-19T06:40:43.684 INFO:tasks.workunit.client.1.smithi117.stdout:5/837: symlink d17/d1b/d3a/d3c/dcb/dde/l114 0 2024-09-19T06:40:43.685 INFO:tasks.workunit.client.0.smithi099.stdout:8/586: link d4/de/d26/d2b/f82 d4/d66/fca 0 2024-09-19T06:40:43.687 INFO:tasks.workunit.client.0.smithi099.stdout:8/587: mknod d4/de/d26/d2b/dba/ccb 0 2024-09-19T06:40:43.688 INFO:tasks.workunit.client.1.smithi117.stdout:5/838: mkdir d17/d1b/d3a/dfe/d115 0 2024-09-19T06:40:43.690 INFO:tasks.workunit.client.0.smithi099.stdout:8/588: creat d4/d11/d23/d4c/daf/fcc x:0 0 0 2024-09-19T06:40:43.690 INFO:tasks.workunit.client.1.smithi117.stdout:3/812: truncate d0/f92 354266 0 2024-09-19T06:40:43.691 INFO:tasks.workunit.client.1.smithi117.stdout:5/839: mknod d17/d1b/d3a/d3c/dcb/dde/d55/dd1/c116 0 2024-09-19T06:40:43.692 INFO:tasks.workunit.client.1.smithi117.stdout:7/802: dread d1/d4a/d81/fa4 [0,4194304] 0 2024-09-19T06:40:43.694 INFO:tasks.workunit.client.1.smithi117.stdout:7/803: truncate d1/d4a/d81/d24/d49/f110 166053 0 2024-09-19T06:40:43.694 INFO:tasks.workunit.client.1.smithi117.stdout:5/840: rename d17/d1b/d3a/d112/f10e to d17/d1b/d3a/dfe/d115/f117 0 2024-09-19T06:40:43.696 INFO:tasks.workunit.client.1.smithi117.stdout:6/607: getdents d1/d5/d8/d80 0 2024-09-19T06:40:43.699 INFO:tasks.workunit.client.1.smithi117.stdout:7/804: creat d1/d4a/d81/d24/d1c/d35/f120 x:0 0 0 2024-09-19T06:40:43.701 INFO:tasks.workunit.client.1.smithi117.stdout:6/608: unlink d1/d5/d32/d45/f9e 0 2024-09-19T06:40:43.701 INFO:tasks.workunit.client.1.smithi117.stdout:5/841: dread d17/d1b/d3a/fa3 [0,4194304] 0 2024-09-19T06:40:43.704 INFO:tasks.workunit.client.1.smithi117.stdout:7/805: rename d1/d4a/d81/d24/cb6 to d1/d4a/d81/d24/d26/c121 0 2024-09-19T06:40:43.704 INFO:tasks.workunit.client.1.smithi117.stdout:9/811: readlink d4/d1c/d7a/d52/lda 0 2024-09-19T06:40:43.706 INFO:tasks.workunit.client.1.smithi117.stdout:7/806: chown d1/d4a/d81/d24/d1c/d35/d4f 4789 1 2024-09-19T06:40:43.706 INFO:tasks.workunit.client.1.smithi117.stdout:5/842: creat d17/d1b/d3a/d3c/dcb/dde/d55/f118 x:0 0 0 2024-09-19T06:40:43.706 INFO:tasks.workunit.client.1.smithi117.stdout:0/772: dread d11/d13/d14/d16/f4a [0,4194304] 0 2024-09-19T06:40:43.747 INFO:tasks.workunit.client.1.smithi117.stdout:3/813: truncate d0/d3d/d48/dd0/fd7 1408098 0 2024-09-19T06:40:43.749 INFO:tasks.workunit.client.1.smithi117.stdout:1/734: dwrite d3/d18/d23/d74/fb6 [0,4194304] 0 2024-09-19T06:40:43.749 INFO:tasks.workunit.client.1.smithi117.stdout:9/812: creat d4/d8/f116 x:0 0 0 2024-09-19T06:40:43.749 INFO:tasks.workunit.client.1.smithi117.stdout:7/807: fdatasync d1/d4a/d81/d24/fd3 0 2024-09-19T06:40:43.754 INFO:tasks.workunit.client.1.smithi117.stdout:0/773: rename d11/d13/d14/d2c/d70 to d11/d13/d28/dfe 0 2024-09-19T06:40:43.754 INFO:tasks.workunit.client.1.smithi117.stdout:7/808: dread d1/d4a/d81/f2a [0,4194304] 0 2024-09-19T06:40:43.757 INFO:tasks.workunit.client.1.smithi117.stdout:7/809: read d1/d3f/f4d [281080,53472] 0 2024-09-19T06:40:43.758 INFO:tasks.workunit.client.1.smithi117.stdout:3/814: creat d0/d9/d1c/d53/d101/f108 x:0 0 0 2024-09-19T06:40:43.759 INFO:tasks.workunit.client.1.smithi117.stdout:1/735: dwrite d3/d18/d23/d74/d89/d9f/fdf [0,4194304] 0 2024-09-19T06:40:43.759 INFO:tasks.workunit.client.1.smithi117.stdout:7/810: chown d1/d4a/d81/d24/d26/d44/dfb 22 1 2024-09-19T06:40:43.761 INFO:tasks.workunit.client.1.smithi117.stdout:5/843: rename d17/d1b/d3a/d3c/dcb/dde/d65/d88/de5/d6a to d17/d1b/d3a/d3c/dcb/dde/d55/dd1/d119 0 2024-09-19T06:40:43.765 INFO:tasks.workunit.client.1.smithi117.stdout:1/736: chown d3/d18/d23/f6b 35226 1 2024-09-19T06:40:43.766 INFO:tasks.workunit.client.1.smithi117.stdout:7/811: fdatasync d1/d4a/f9a 0 2024-09-19T06:40:43.767 INFO:tasks.workunit.client.0.smithi099.stdout:2/504: sync 2024-09-19T06:40:43.768 INFO:tasks.workunit.client.1.smithi117.stdout:9/813: rename d4/d8/d6a/f10b to d4/d1c/d54/f117 0 2024-09-19T06:40:43.768 INFO:tasks.workunit.client.1.smithi117.stdout:0/774: dwrite d11/d13/d1b/d27/f60 [0,4194304] 0 2024-09-19T06:40:43.771 INFO:tasks.workunit.client.1.smithi117.stdout:5/844: chown d17/d1b/d5d/d86/lb4 80 1 2024-09-19T06:40:43.771 INFO:tasks.workunit.client.0.smithi099.stdout:2/505: write d1/d2/d4d/d55/da5/d36/f45 [3369383,110126] 0 2024-09-19T06:40:43.772 INFO:tasks.workunit.client.0.smithi099.stdout:2/506: chown d1/d2/d4d/d55/da5/d9/da3 1195790 1 2024-09-19T06:40:43.773 INFO:tasks.workunit.client.1.smithi117.stdout:3/815: rmdir d0/d9 39 2024-09-19T06:40:43.777 INFO:tasks.workunit.client.1.smithi117.stdout:1/737: creat d3/d8e/f102 x:0 0 0 2024-09-19T06:40:43.780 INFO:tasks.workunit.client.1.smithi117.stdout:0/775: mkdir d11/d13/d1b/d27/d54/dff 0 2024-09-19T06:40:43.781 INFO:tasks.workunit.client.0.smithi099.stdout:2/507: write d1/d2/d4d/d55/da5/d18/f2f [22562,96740] 0 2024-09-19T06:40:43.781 INFO:tasks.workunit.client.1.smithi117.stdout:0/776: write d11/f19 [3476946,18111] 0 2024-09-19T06:40:43.782 INFO:tasks.workunit.client.1.smithi117.stdout:7/812: mknod d1/d4a/d81/c122 0 2024-09-19T06:40:43.784 INFO:tasks.workunit.client.0.smithi099.stdout:2/508: symlink d1/d2/d4d/d55/da5/d18/lae 0 2024-09-19T06:40:43.785 INFO:tasks.workunit.client.0.smithi099.stdout:2/509: rename d1 to d1/d2/d4d/d55/da5/d9/d63/daf 22 2024-09-19T06:40:43.789 INFO:tasks.workunit.client.0.smithi099.stdout:2/510: getdents d1/d2/d4d/d55 0 2024-09-19T06:40:43.790 INFO:tasks.workunit.client.1.smithi117.stdout:7/813: unlink d1/d4a/f96 0 2024-09-19T06:40:43.791 INFO:tasks.workunit.client.0.smithi099.stdout:2/511: mknod d1/cb0 0 2024-09-19T06:40:43.791 INFO:tasks.workunit.client.1.smithi117.stdout:3/816: rename d0/d9/d4e/fea to d0/f109 0 2024-09-19T06:40:43.793 INFO:tasks.workunit.client.1.smithi117.stdout:7/814: mknod d1/d4a/d81/d48/d5f/d82/c123 0 2024-09-19T06:40:43.796 INFO:tasks.workunit.client.1.smithi117.stdout:7/815: truncate d1/d72/f6a 911781 0 2024-09-19T06:40:43.799 INFO:tasks.workunit.client.1.smithi117.stdout:5/845: write d17/d1b/d5d/d7d/fa8 [1249359,113765] 0 2024-09-19T06:40:43.800 INFO:tasks.workunit.client.0.smithi099.stdout:2/512: dwrite d1/d2/d4d/d55/da5/d18/d27/d5b/f7e [0,4194304] 0 2024-09-19T06:40:43.800 INFO:tasks.workunit.client.1.smithi117.stdout:9/814: truncate d4/d1c/d36/d37/fde 2268753 0 2024-09-19T06:40:43.801 INFO:tasks.workunit.client.1.smithi117.stdout:9/815: chown d4/d8/d6a/d82/dc8/fca 577546801 1 2024-09-19T06:40:43.803 INFO:tasks.workunit.client.1.smithi117.stdout:9/816: truncate d4/d8/fea 847277 0 2024-09-19T06:40:43.804 INFO:tasks.workunit.client.1.smithi117.stdout:0/777: write d11/d13/d14/d2c/d53/d7e/fd7 [4398301,123394] 0 2024-09-19T06:40:43.804 INFO:tasks.workunit.client.0.smithi099.stdout:2/513: unlink d1/d2/d4d/d55/da5/f80 0 2024-09-19T06:40:43.806 INFO:tasks.workunit.client.1.smithi117.stdout:3/817: write d0/d8/d64/fb6 [1192756,83183] 0 2024-09-19T06:40:43.808 INFO:tasks.workunit.client.0.smithi099.stdout:2/514: creat d1/d2/d5/d77/d98/fb1 x:0 0 0 2024-09-19T06:40:43.810 INFO:tasks.workunit.client.1.smithi117.stdout:7/816: write d1/d4a/d81/fa4 [5029765,9156] 0 2024-09-19T06:40:43.813 INFO:tasks.workunit.client.1.smithi117.stdout:1/738: dwrite d3/d18/ffd [0,4194304] 0 2024-09-19T06:40:43.814 INFO:tasks.workunit.client.0.smithi099.stdout:2/515: rename d1/d2/d4d/d55/da5/d9/l22 to d1/d2/d4d/d55/da5/d18/d2d/lb2 0 2024-09-19T06:40:43.814 INFO:tasks.workunit.client.1.smithi117.stdout:1/739: write d3/d18/d56/fa8 [2321973,62331] 0 2024-09-19T06:40:43.816 INFO:tasks.workunit.client.1.smithi117.stdout:9/817: creat d4/d8/f118 x:0 0 0 2024-09-19T06:40:43.816 INFO:tasks.workunit.client.0.smithi099.stdout:2/516: fsync d1/d2/d4d/d55/da5/d18/f74 0 2024-09-19T06:40:43.817 INFO:tasks.workunit.client.1.smithi117.stdout:7/817: rename d1/d4a/d81/d24/d26/c9f to d1/d72/d10f/c124 0 2024-09-19T06:40:43.821 INFO:tasks.workunit.client.1.smithi117.stdout:5/846: dwrite d17/d1b/d5d/d7d/f8a [0,4194304] 0 2024-09-19T06:40:43.823 INFO:tasks.workunit.client.1.smithi117.stdout:3/818: symlink d0/d9/d4e/d9e/l10a 0 2024-09-19T06:40:43.823 INFO:tasks.workunit.client.0.smithi099.stdout:2/517: link d1/d2/d4d/d55/l7b d1/d2/d4d/d55/da5/d18/d2d/d88/lb3 0 2024-09-19T06:40:43.826 INFO:tasks.workunit.client.0.smithi099.stdout:2/518: creat d1/d2/d4d/d55/da5/d9/fb4 x:0 0 0 2024-09-19T06:40:43.826 INFO:tasks.workunit.client.1.smithi117.stdout:0/778: getdents d11/d13/d14/d2c 0 2024-09-19T06:40:43.827 INFO:tasks.workunit.client.1.smithi117.stdout:9/818: write d4/d1c/d73/d93/fa0 [1927526,84029] 0 2024-09-19T06:40:43.830 INFO:tasks.workunit.client.1.smithi117.stdout:5/847: symlink d17/d1b/d3a/d3c/dcb/dde/d65/l11a 0 2024-09-19T06:40:43.831 INFO:tasks.workunit.client.1.smithi117.stdout:1/740: truncate d3/d18/f48 1453406 0 2024-09-19T06:40:43.832 INFO:tasks.workunit.client.1.smithi117.stdout:0/779: fsync d11/d13/f90 0 2024-09-19T06:40:43.832 INFO:tasks.workunit.client.1.smithi117.stdout:2/865: sync 2024-09-19T06:40:43.832 INFO:tasks.workunit.client.1.smithi117.stdout:8/788: sync 2024-09-19T06:40:43.833 INFO:tasks.workunit.client.1.smithi117.stdout:1/741: rmdir d3/d18/d23 39 2024-09-19T06:40:43.835 INFO:tasks.workunit.client.1.smithi117.stdout:8/789: fdatasync d1d/d2a/d3f/d4b/f5b 0 2024-09-19T06:40:43.836 INFO:tasks.workunit.client.1.smithi117.stdout:0/780: creat d11/d13/d14/d2c/d35/d3e/f100 x:0 0 0 2024-09-19T06:40:43.837 INFO:tasks.workunit.client.1.smithi117.stdout:1/742: chown d3/d18/d23/d51/cf9 578 1 2024-09-19T06:40:43.837 INFO:tasks.workunit.client.1.smithi117.stdout:7/818: rename d1/d4a/d81/l36 to d1/d3f/l125 0 2024-09-19T06:40:43.839 INFO:tasks.workunit.client.1.smithi117.stdout:9/819: getdents d4/d1c/d73/db5 0 2024-09-19T06:40:43.841 INFO:tasks.workunit.client.0.smithi099.stdout:2/519: truncate d1/d2/d5/d13/d2c/f70 1838419 0 2024-09-19T06:40:43.847 INFO:tasks.workunit.client.0.smithi099.stdout:2/520: dwrite d1/d2/f12 [4194304,4194304] 0 2024-09-19T06:40:43.850 INFO:tasks.workunit.client.0.smithi099.stdout:2/521: fdatasync d1/fa9 0 2024-09-19T06:40:43.851 INFO:tasks.workunit.client.0.smithi099.stdout:2/522: readlink d1/d2/d5/d77/l94 0 2024-09-19T06:40:43.852 INFO:tasks.workunit.client.0.smithi099.stdout:2/523: dread - d1/d2/d5/d13/d2c/f9f zero size 2024-09-19T06:40:43.855 INFO:tasks.workunit.client.0.smithi099.stdout:2/524: creat d1/d2/d4d/d55/da5/d18/d27/d5b/fb5 x:0 0 0 2024-09-19T06:40:43.863 INFO:tasks.workunit.client.0.smithi099.stdout:2/525: dwrite d1/d2/d4d/d55/f9d [0,4194304] 0 2024-09-19T06:40:43.867 INFO:tasks.workunit.client.0.smithi099.stdout:2/526: unlink d1/d2/d4d/d55/f9d 0 2024-09-19T06:40:43.869 INFO:tasks.workunit.client.0.smithi099.stdout:2/527: truncate d1/d2/f90 174975 0 2024-09-19T06:40:43.869 INFO:tasks.workunit.client.0.smithi099.stdout:2/528: stat d1/d2/c4a 0 2024-09-19T06:40:43.871 INFO:tasks.workunit.client.0.smithi099.stdout:2/529: mkdir d1/d2/d4d/d8e/db6 0 2024-09-19T06:40:43.879 INFO:tasks.workunit.client.0.smithi099.stdout:2/530: write d1/fa9 [668693,76770] 0 2024-09-19T06:40:43.897 INFO:tasks.workunit.client.1.smithi117.stdout:2/866: dwrite d0/d7/d1e/d20/dbc/d116/f45 [0,4194304] 0 2024-09-19T06:40:43.897 INFO:tasks.workunit.client.1.smithi117.stdout:5/848: rename d17/d1b/d5d/fc9 to d17/d1b/d3a/d3c/dcb/dde/d55/dd1/f11b 0 2024-09-19T06:40:43.900 INFO:tasks.workunit.client.1.smithi117.stdout:2/867: readlink d0/d7/d29/d35/dbd/l123 0 2024-09-19T06:40:43.904 INFO:tasks.workunit.client.1.smithi117.stdout:1/743: creat d3/d18/d23/f103 x:0 0 0 2024-09-19T06:40:43.905 INFO:tasks.workunit.client.1.smithi117.stdout:3/819: dwrite d0/d8/d64/f66 [0,4194304] 0 2024-09-19T06:40:43.905 INFO:tasks.workunit.client.1.smithi117.stdout:2/868: fsync d0/d7/d29/d35/d61/def/f11f 0 2024-09-19T06:40:43.906 INFO:tasks.workunit.client.1.smithi117.stdout:5/849: mknod d17/d1b/d3a/d3c/dcb/dde/d55/dd1/c11c 0 2024-09-19T06:40:43.907 INFO:tasks.workunit.client.1.smithi117.stdout:9/820: rename d4/d8/l14 to d4/d1c/l119 0 2024-09-19T06:40:43.908 INFO:tasks.workunit.client.1.smithi117.stdout:3/820: write d0/d8/d64/f66 [3954289,69365] 0 2024-09-19T06:40:43.909 INFO:tasks.workunit.client.1.smithi117.stdout:1/744: creat d3/d18/d23/dfc/f104 x:0 0 0 2024-09-19T06:40:43.910 INFO:tasks.workunit.client.1.smithi117.stdout:7/819: dwrite d1/d3f/f85 [0,4194304] 0 2024-09-19T06:40:43.912 INFO:tasks.workunit.client.1.smithi117.stdout:2/869: rmdir d0/d7/d29/df4/d105 39 2024-09-19T06:40:43.916 INFO:tasks.workunit.client.1.smithi117.stdout:3/821: creat d0/d9/d4e/db4/dcc/f10b x:0 0 0 2024-09-19T06:40:43.920 INFO:tasks.workunit.client.1.smithi117.stdout:5/850: link d17/f89 d17/d1b/d3a/d3c/d70/d94/f11d 0 2024-09-19T06:40:43.925 INFO:tasks.workunit.client.1.smithi117.stdout:1/745: rename d3/da1/da5/ff0 to d3/da1/f105 0 2024-09-19T06:40:43.926 INFO:tasks.workunit.client.1.smithi117.stdout:3/822: creat d0/d9/d4e/d9e/ddc/f10c x:0 0 0 2024-09-19T06:40:43.929 INFO:tasks.workunit.client.1.smithi117.stdout:1/746: symlink d3/l106 0 2024-09-19T06:40:43.929 INFO:tasks.workunit.client.1.smithi117.stdout:3/823: creat d0/d19/d2b/d8e/ddb/f10d x:0 0 0 2024-09-19T06:40:43.929 INFO:tasks.workunit.client.1.smithi117.stdout:1/747: chown d3/d22/d2f/fff 1585698 1 2024-09-19T06:40:43.932 INFO:tasks.workunit.client.1.smithi117.stdout:9/821: dwrite d4/d20/f53 [0,4194304] 0 2024-09-19T06:40:43.933 INFO:tasks.workunit.client.1.smithi117.stdout:5/851: write d17/d1b/d5d/fbe [874910,17329] 0 2024-09-19T06:40:43.935 INFO:tasks.workunit.client.1.smithi117.stdout:7/820: dread d1/d4a/d81/d24/d49/f62 [0,4194304] 0 2024-09-19T06:40:43.937 INFO:tasks.workunit.client.1.smithi117.stdout:7/821: write d1/d4a/d81/d24/d1c/fe0 [577300,41221] 0 2024-09-19T06:40:43.938 INFO:tasks.workunit.client.1.smithi117.stdout:7/822: read - d1/d4a/d81/d48/f11b zero size 2024-09-19T06:40:43.941 INFO:tasks.workunit.client.1.smithi117.stdout:1/748: rename d3/d18/d56/f85 to d3/d18/d23/f107 0 2024-09-19T06:40:43.942 INFO:tasks.workunit.client.1.smithi117.stdout:3/824: link d0/d9/c55 d0/d8/d7f/c10e 0 2024-09-19T06:40:43.944 INFO:tasks.workunit.client.1.smithi117.stdout:3/825: write d0/d9/d4e/d9e/ffa [232972,94774] 0 2024-09-19T06:40:43.944 INFO:tasks.workunit.client.1.smithi117.stdout:9/822: write d4/d8/d6e/da4/fa6 [415317,11951] 0 2024-09-19T06:40:43.947 INFO:tasks.workunit.client.1.smithi117.stdout:6/609: sync 2024-09-19T06:40:43.948 INFO:tasks.workunit.client.1.smithi117.stdout:7/823: dwrite d1/d4a/d81/d24/d1c/d55/f59 [4194304,4194304] 0 2024-09-19T06:40:43.951 INFO:tasks.workunit.client.1.smithi117.stdout:2/870: dread d0/d7/d1e/d20/dc9/fe8 [0,4194304] 0 2024-09-19T06:40:43.951 INFO:tasks.workunit.client.1.smithi117.stdout:6/610: write d1/d3/f86 [476858,101551] 0 2024-09-19T06:40:43.953 INFO:tasks.workunit.client.1.smithi117.stdout:5/852: dwrite d17/f22 [0,4194304] 0 2024-09-19T06:40:43.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.952+0000 7fca04ee3640 1 -- 172.21.15.99:0/181926623 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fca00102d30 con 0x7fca000fbaa0 2024-09-19T06:40:43.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.953+0000 7fc9eeffd640 1 -- 172.21.15.99:0/181926623 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+855 (secure 0 0 0) 0x7fc9f000c0c0 con 0x7fca000fbaa0 2024-09-19T06:40:43.954 INFO:tasks.workunit.client.1.smithi117.stdout:2/871: write d0/d64/dd9/f88 [850436,100986] 0 2024-09-19T06:40:43.955 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:40:43.955 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-09-19T06:40:43.955 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 2 2024-09-19T06:40:43.956 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:40:43.956 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-09-19T06:40:43.956 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 1, 2024-09-19T06:40:43.956 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 1 2024-09-19T06:40:43.956 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:40:43.957 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-09-19T06:40:43.957 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 6 2024-09-19T06:40:43.957 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:40:43.957 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": { 2024-09-19T06:40:43.957 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 4 2024-09-19T06:40:43.958 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:40:43.958 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-09-19T06:40:43.958 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 13, 2024-09-19T06:40:43.958 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 1 2024-09-19T06:40:43.958 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T06:40:43.958 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:40:43.959 INFO:tasks.workunit.client.1.smithi117.stdout:3/826: rename d0/d9/d4e/db4/fec to d0/d9/d4e/f10f 0 2024-09-19T06:40:43.959 INFO:tasks.workunit.client.1.smithi117.stdout:3/827: stat d0/d9/d4e/l6c 0 2024-09-19T06:40:43.960 INFO:tasks.workunit.client.1.smithi117.stdout:2/872: mknod d0/d64/c141 0 2024-09-19T06:40:43.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.958+0000 7fca04ee3640 1 -- 172.21.15.99:0/181926623 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7fc9e806e780 msgr2=0x7fc9e8070c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:43.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.958+0000 7fca04ee3640 1 --2- 172.21.15.99:0/181926623 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7fc9e806e780 0x7fc9e8070c30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc9f4004b80 tx=0x7fc9f4009ad0 comp rx=0 tx=0).stop 2024-09-19T06:40:43.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.958+0000 7fca04ee3640 1 -- 172.21.15.99:0/181926623 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca000fbaa0 msgr2=0x7fca001134f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:43.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.958+0000 7fca04ee3640 1 --2- 172.21.15.99:0/181926623 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca000fbaa0 0x7fca001134f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc9f0002a50 tx=0x7fc9f0009f50 comp rx=0 tx=0).stop 2024-09-19T06:40:43.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.958+0000 7fca04ee3640 1 -- 172.21.15.99:0/181926623 shutdown_connections 2024-09-19T06:40:43.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.958+0000 7fca04ee3640 1 --2- 172.21.15.99:0/181926623 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7fc9e806e780 0x7fc9e8070c30 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:43.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.958+0000 7fca04ee3640 1 --2- 172.21.15.99:0/181926623 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fca000fc3f0 0x7fca00113a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:43.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.958+0000 7fca04ee3640 1 --2- 172.21.15.99:0/181926623 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca000fbaa0 0x7fca001134f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:43.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.958+0000 7fca04ee3640 1 -- 172.21.15.99:0/181926623 >> 172.21.15.99:0/181926623 conn(0x7fca000f6390 msgr2=0x7fca000f7980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:43.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.958+0000 7fca04ee3640 1 -- 172.21.15.99:0/181926623 shutdown_connections 2024-09-19T06:40:43.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:43.958+0000 7fca04ee3640 1 -- 172.21.15.99:0/181926623 wait complete. 2024-09-19T06:40:43.962 INFO:tasks.workunit.client.1.smithi117.stdout:3/828: stat d0/d19/d2b/d8e/f8d 0 2024-09-19T06:40:43.963 INFO:tasks.workunit.client.1.smithi117.stdout:6/611: dwrite d1/f1b [4194304,4194304] 0 2024-09-19T06:40:43.965 INFO:tasks.workunit.client.1.smithi117.stdout:6/612: fdatasync d1/f1d 0 2024-09-19T06:40:43.965 INFO:tasks.workunit.client.1.smithi117.stdout:7/824: rename d1/d4a/d7c/fc0 to d1/d4a/d81/d48/d5f/d82/f126 0 2024-09-19T06:40:43.965 INFO:tasks.workunit.client.1.smithi117.stdout:3/829: creat d0/d19/f110 x:0 0 0 2024-09-19T06:40:43.967 INFO:tasks.workunit.client.1.smithi117.stdout:2/873: creat d0/d7/d1e/d20/dc9/f142 x:0 0 0 2024-09-19T06:40:43.977 INFO:tasks.workunit.client.1.smithi117.stdout:6/613: dwrite d1/d3/d25/f7a [0,4194304] 0 2024-09-19T06:40:43.982 INFO:tasks.workunit.client.1.smithi117.stdout:7/825: dwrite d1/d4a/d81/d24/d1c/d35/d4f/f87 [0,4194304] 0 2024-09-19T06:40:43.984 INFO:tasks.workunit.client.1.smithi117.stdout:6/614: readlink d1/d5/d8/d27/d77/da8/lad 0 2024-09-19T06:40:43.988 INFO:tasks.workunit.client.1.smithi117.stdout:2/874: dwrite d0/d7/d29/d35/d61/def/f11f [0,4194304] 0 2024-09-19T06:40:43.989 INFO:tasks.workunit.client.1.smithi117.stdout:7/826: write d1/d4a/d81/d48/d5f/d82/fa9 [3933860,111493] 0 2024-09-19T06:40:43.989 INFO:tasks.workunit.client.1.smithi117.stdout:1/749: dread d3/f5 [0,4194304] 0 2024-09-19T06:40:43.990 INFO:tasks.workunit.client.1.smithi117.stdout:5/853: dread d17/f21 [4194304,4194304] 0 2024-09-19T06:40:43.991 INFO:tasks.workunit.client.1.smithi117.stdout:6/615: fsync d1/d14/f23 0 2024-09-19T06:40:43.993 INFO:tasks.workunit.client.1.smithi117.stdout:7/827: fdatasync d1/d4a/d81/d24/d49/f110 0 2024-09-19T06:40:43.994 INFO:tasks.workunit.client.1.smithi117.stdout:6/616: dread - d1/d5/d8/d80/fac zero size 2024-09-19T06:40:43.994 INFO:tasks.workunit.client.1.smithi117.stdout:9/823: dread d4/d1c/d46/f6b [0,4194304] 0 2024-09-19T06:40:43.995 INFO:tasks.workunit.client.1.smithi117.stdout:2/875: creat d0/d7/d1e/d20/d10a/ddf/f143 x:0 0 0 2024-09-19T06:40:43.997 INFO:tasks.workunit.client.1.smithi117.stdout:2/876: chown d0/d7/d1e/f11d 184786 1 2024-09-19T06:40:43.997 INFO:tasks.workunit.client.1.smithi117.stdout:7/828: mknod d1/d4a/d7c/d95/db5/c127 0 2024-09-19T06:40:43.998 INFO:tasks.workunit.client.1.smithi117.stdout:9/824: symlink d4/d1c/d36/l11a 0 2024-09-19T06:40:44.001 INFO:tasks.workunit.client.1.smithi117.stdout:5/854: rename f3 to d17/d1b/d3a/d3c/d46/d10f/f11e 0 2024-09-19T06:40:44.003 INFO:tasks.workunit.client.1.smithi117.stdout:2/877: dwrite d0/d12/d32/db5/f50 [0,4194304] 0 2024-09-19T06:40:44.003 INFO:tasks.workunit.client.1.smithi117.stdout:5/855: chown d17/d1b/d3a/d3c/dcb/dde/d65/l11a 108972 1 2024-09-19T06:40:44.004 INFO:tasks.workunit.client.1.smithi117.stdout:7/829: unlink d1/d4a/d81/d24/d1c/d35/d4f/d9b/fe5 0 2024-09-19T06:40:44.007 INFO:tasks.workunit.client.1.smithi117.stdout:5/856: mknod d17/d1b/d3a/c11f 0 2024-09-19T06:40:44.008 INFO:tasks.workunit.client.1.smithi117.stdout:9/825: link d4/d1c/d54/da5/daf/fcc d4/d1c/d5f/f11b 0 2024-09-19T06:40:44.010 INFO:tasks.workunit.client.1.smithi117.stdout:9/826: fsync d4/d1c/d73/d93/fd5 0 2024-09-19T06:40:44.011 INFO:tasks.workunit.client.1.smithi117.stdout:2/878: dwrite d0/d7/d1e/f41 [4194304,4194304] 0 2024-09-19T06:40:44.012 INFO:tasks.workunit.client.1.smithi117.stdout:7/830: rmdir d1/d4a/d81/d24/d1c/d35/d4f/d11a 0 2024-09-19T06:40:44.014 INFO:tasks.workunit.client.1.smithi117.stdout:2/879: write d0/d64/dd9/f80 [1810025,96377] 0 2024-09-19T06:40:44.015 INFO:tasks.workunit.client.1.smithi117.stdout:9/827: chown d4/d17/c9f 29 1 2024-09-19T06:40:44.015 INFO:tasks.workunit.client.1.smithi117.stdout:8/790: sync 2024-09-19T06:40:44.018 INFO:tasks.workunit.client.1.smithi117.stdout:2/880: readlink d0/d7/d29/d35/l36 0 2024-09-19T06:40:44.020 INFO:tasks.workunit.client.1.smithi117.stdout:7/831: mknod d1/d4a/d7c/d95/db5/de2/de3/c128 0 2024-09-19T06:40:44.021 INFO:tasks.workunit.client.1.smithi117.stdout:9/828: fsync d4/d1c/d73/d9a/fc4 0 2024-09-19T06:40:44.022 INFO:tasks.workunit.client.1.smithi117.stdout:5/857: dwrite d17/d1b/d3a/d3c/dcb/dde/d55/f118 [0,4194304] 0 2024-09-19T06:40:44.024 INFO:tasks.workunit.client.1.smithi117.stdout:2/881: getdents d0/d12/d32/db5 0 2024-09-19T06:40:44.026 INFO:tasks.workunit.client.1.smithi117.stdout:7/832: creat d1/d3f/f129 x:0 0 0 2024-09-19T06:40:44.026 INFO:tasks.workunit.client.1.smithi117.stdout:5/858: mkdir d17/d1b/d120 0 2024-09-19T06:40:44.029 INFO:tasks.workunit.client.1.smithi117.stdout:7/833: mkdir d1/d4a/d81/d48/d5f/d12a 0 2024-09-19T06:40:44.032 INFO:tasks.workunit.client.1.smithi117.stdout:6/617: dread d1/d5/d8/d5e/d6d/f79 [0,4194304] 0 2024-09-19T06:40:44.033 INFO:tasks.workunit.client.1.smithi117.stdout:5/859: rename d17/d5c/db8/l10d to d17/d1b/d3a/d3c/dcb/l121 0 2024-09-19T06:40:44.033 INFO:tasks.workunit.client.1.smithi117.stdout:2/882: dwrite d0/d7/d29/f5f [0,4194304] 0 2024-09-19T06:40:44.034 INFO:tasks.workunit.client.1.smithi117.stdout:5/860: chown d17/d1b/d3a/d3c/fd8 139 1 2024-09-19T06:40:44.035 INFO:tasks.workunit.client.1.smithi117.stdout:7/834: mkdir d1/d72/d100/d12b 0 2024-09-19T06:40:44.036 INFO:tasks.workunit.client.1.smithi117.stdout:6/618: creat d1/d5/d8/d5e/d67/fae x:0 0 0 2024-09-19T06:40:44.037 INFO:tasks.workunit.client.1.smithi117.stdout:7/835: creat d1/d4a/d81/d24/d1c/da8/f12c x:0 0 0 2024-09-19T06:40:44.038 INFO:tasks.workunit.client.1.smithi117.stdout:6/619: mknod d1/d5/d9a/da9/caf 0 2024-09-19T06:40:44.039 INFO:tasks.workunit.client.1.smithi117.stdout:7/836: fsync d1/d3f/d92/fdd 0 2024-09-19T06:40:44.041 INFO:tasks.workunit.client.1.smithi117.stdout:5/861: dwrite d17/d1b/f48 [0,4194304] 0 2024-09-19T06:40:44.043 INFO:tasks.workunit.client.1.smithi117.stdout:7/837: unlink d1/d4a/d81/d24/d1c/d35/d4f/ffc 0 2024-09-19T06:40:44.044 INFO:tasks.workunit.client.1.smithi117.stdout:6/620: rename d1/d3/d25 to d1/d5/d8/db0 0 2024-09-19T06:40:44.046 INFO:tasks.workunit.client.1.smithi117.stdout:7/838: mknod d1/d4a/d7c/c12d 0 2024-09-19T06:40:44.046 INFO:tasks.workunit.client.1.smithi117.stdout:5/862: symlink d17/d1b/d5d/d7d/dc6/l122 0 2024-09-19T06:40:44.047 INFO:tasks.workunit.client.1.smithi117.stdout:6/621: chown d1/d14/c29 25629910 1 2024-09-19T06:40:44.049 INFO:tasks.workunit.client.1.smithi117.stdout:5/863: creat d17/d1b/d3a/d3c/dcb/dde/d55/dd1/d119/f123 x:0 0 0 2024-09-19T06:40:44.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:44.057+0000 7fcd29ddd640 1 -- 172.21.15.99:0/1516858999 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd240ff700 msgr2=0x7fcd24101ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:44.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:44.057+0000 7fcd29ddd640 1 --2- 172.21.15.99:0/1516858999 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd240ff700 0x7fcd24101ae0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fcd180048d0 tx=0x7fcd18009da0 comp rx=0 tx=0).stop 2024-09-19T06:40:44.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:44.057+0000 7fcd29ddd640 1 -- 172.21.15.99:0/1516858999 shutdown_connections 2024-09-19T06:40:44.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:44.057+0000 7fcd29ddd640 1 --2- 172.21.15.99:0/1516858999 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd240ff700 0x7fcd24101ae0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:44.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:44.057+0000 7fcd29ddd640 1 --2- 172.21.15.99:0/1516858999 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd24065bc0 0x7fcd240ff1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:44.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:44.057+0000 7fcd29ddd640 1 -- 172.21.15.99:0/1516858999 >> 172.21.15.99:0/1516858999 conn(0x7fcd240f6c10 msgr2=0x7fcd240f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:44.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:44.057+0000 7fcd29ddd640 1 -- 172.21.15.99:0/1516858999 shutdown_connections 2024-09-19T06:40:44.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:44.057+0000 7fcd29ddd640 1 -- 172.21.15.99:0/1516858999 wait complete. 2024-09-19T06:40:44.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:44.057+0000 7fcd29ddd640 1 Processor -- start 2024-09-19T06:40:44.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:44.058+0000 7fcd29ddd640 1 -- start start 2024-09-19T06:40:44.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:44.058+0000 7fcd29ddd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd24065bc0 0x7fcd2410d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:44.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:44.058+0000 7fcd29ddd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd240ff700 0x7fcd2410d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:44.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:44.058+0000 7fcd29ddd640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2410dc10 con 0x7fcd240ff700 2024-09-19T06:40:44.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:44.058+0000 7fcd29ddd640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2410e430 con 0x7fcd24065bc0 2024-09-19T06:40:44.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:44.058+0000 7fcd22ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd240ff700 0x7fcd2410d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:44.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:44.058+0000 7fcd22ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd240ff700 0x7fcd2410d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52094/0 (socket says 172.21.15.99:52094) 2024-09-19T06:40:44.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:44.058+0000 7fcd22ffd640 1 -- 172.21.15.99:0/327748830 learned_addr learned my addr 172.21.15.99:0/327748830 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:40:44.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:44.058+0000 7fcd237fe640 1 --2- 172.21.15.99:0/327748830 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd24065bc0 0x7fcd2410d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:44.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:44.058+0000 7fcd22ffd640 1 -- 172.21.15.99:0/327748830 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd24065bc0 msgr2=0x7fcd2410d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:44.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:44.058+0000 7fcd22ffd640 1 --2- 172.21.15.99:0/327748830 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd24065bc0 0x7fcd2410d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:44.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:44.058+0000 7fcd22ffd640 1 -- 172.21.15.99:0/327748830 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd18005040 con 0x7fcd240ff700 2024-09-19T06:40:44.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:44.058+0000 7fcd22ffd640 1 --2- 172.21.15.99:0/327748830 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd240ff700 0x7fcd2410d5c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fcd180043d0 tx=0x7fcd18009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:44.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:44.059+0000 7fcd0bfff640 1 -- 172.21.15.99:0/327748830 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd18038070 con 0x7fcd240ff700 2024-09-19T06:40:44.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:44.059+0000 7fcd0bfff640 1 -- 172.21.15.99:0/327748830 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fcd1802ae90 con 0x7fcd240ff700 2024-09-19T06:40:44.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:44.059+0000 7fcd29ddd640 1 -- 172.21.15.99:0/327748830 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd2410e660 con 0x7fcd240ff700 2024-09-19T06:40:44.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:44.059+0000 7fcd0bfff640 1 -- 172.21.15.99:0/327748830 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd1803e670 con 0x7fcd240ff700 2024-09-19T06:40:44.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:44.059+0000 7fcd29ddd640 1 -- 172.21.15.99:0/327748830 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd2410ec00 con 0x7fcd240ff700 2024-09-19T06:40:44.064 INFO:tasks.workunit.client.1.smithi117.stdout:2/883: dread d0/d7/d29/d35/d61/d65/f8f [0,4194304] 0 2024-09-19T06:40:44.064 INFO:tasks.workunit.client.1.smithi117.stdout:2/884: chown d0/d7/d1e/d20/dbc/de6/ff2 8 1 2024-09-19T06:40:44.064 INFO:tasks.workunit.client.1.smithi117.stdout:2/885: write d0/d7/d29/d35/dbd/d8d/d9a/ff3 [4338079,47768] 0 2024-09-19T06:40:44.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:44.060+0000 7fcd29ddd640 1 -- 172.21.15.99:0/327748830 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd240fa890 con 0x7fcd240ff700 2024-09-19T06:40:44.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:44.060+0000 7fcd0bfff640 1 -- 172.21.15.99:0/327748830 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7fcd18030020 con 0x7fcd240ff700 2024-09-19T06:40:44.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:44.061+0000 7fcd0bfff640 1 --2- 172.21.15.99:0/327748830 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7fcd0c06e6e0 0x7fcd0c070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:40:44.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:44.061+0000 7fcd0bfff640 1 -- 172.21.15.99:0/327748830 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fcd180adec0 con 0x7fcd240ff700 2024-09-19T06:40:44.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:44.061+0000 7fcd237fe640 1 --2- 172.21.15.99:0/327748830 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7fcd0c06e6e0 0x7fcd0c070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:40:44.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:44.061+0000 7fcd237fe640 1 --2- 172.21.15.99:0/327748830 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7fcd0c06e6e0 0x7fcd0c070b90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fcd24065920 tx=0x7fcd1400b040 comp rx=0 tx=0).ready entity=mgr.24369 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:40:44.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:44.065+0000 7fcd0bfff640 1 -- 172.21.15.99:0/327748830 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7fcd18077980 con 0x7fcd240ff700 2024-09-19T06:40:44.080 INFO:tasks.workunit.client.0.smithi099.stdout:9/671: sync 2024-09-19T06:40:44.082 INFO:tasks.workunit.client.0.smithi099.stdout:9/672: mknod dd/d47/d40/d61/cdf 0 2024-09-19T06:40:44.083 INFO:tasks.workunit.client.0.smithi099.stdout:9/673: write dd/d2c/d79/fd4 [498093,103461] 0 2024-09-19T06:40:44.086 INFO:tasks.workunit.client.1.smithi117.stdout:1/750: read d3/d22/d2f/fdc [1013902,28746] 0 2024-09-19T06:40:44.086 INFO:tasks.workunit.client.1.smithi117.stdout:1/751: dread - d3/feb zero size 2024-09-19T06:40:44.089 INFO:tasks.workunit.client.0.smithi099.stdout:9/674: link dd/d2c/d5c/ddb/fde dd/d62/d76/fe0 0 2024-09-19T06:40:44.090 INFO:tasks.workunit.client.0.smithi099.stdout:9/675: write dd/d62/d76/fbb [136096,99935] 0 2024-09-19T06:40:44.091 INFO:tasks.workunit.client.1.smithi117.stdout:6/622: truncate d1/d5/d8/db0/f78 3212103 0 2024-09-19T06:40:44.091 INFO:tasks.workunit.client.1.smithi117.stdout:5/864: symlink d17/d1b/d3a/d3c/dcb/dde/d65/d88/dd0/l124 0 2024-09-19T06:40:44.093 INFO:tasks.workunit.client.0.smithi099.stdout:9/676: creat dd/d2c/d5c/d85/fe1 x:0 0 0 2024-09-19T06:40:44.093 INFO:tasks.workunit.client.1.smithi117.stdout:6/623: write d1/d5/d8/d5e/d67/fae [512448,46392] 0 2024-09-19T06:40:44.094 INFO:tasks.workunit.client.0.smithi099.stdout:9/677: readlink dd/d47/d40/d61/l7f 0 2024-09-19T06:40:44.094 INFO:tasks.workunit.client.1.smithi117.stdout:6/624: write d1/d3/f86 [847500,21643] 0 2024-09-19T06:40:44.096 INFO:tasks.workunit.client.1.smithi117.stdout:6/625: chown d1/d5/d8/d5e/c8f 414 1 2024-09-19T06:40:44.097 INFO:tasks.workunit.client.1.smithi117.stdout:2/886: mknod d0/d7/d58/db1/c144 0 2024-09-19T06:40:44.105 INFO:tasks.workunit.client.1.smithi117.stdout:5/865: link d17/d1b/d3a/d3c/dcb/dde/d65/d88/de5/fe8 d17/f125 0 2024-09-19T06:40:44.105 INFO:tasks.workunit.client.1.smithi117.stdout:3/830: write d0/d8/d7f/d40/f9d [972198,113600] 0 2024-09-19T06:40:44.106 INFO:tasks.workunit.client.1.smithi117.stdout:1/752: link d3/d18/d23/lce d3/d18/d23/d74/dcf/l108 0 2024-09-19T06:40:44.110 INFO:tasks.workunit.client.1.smithi117.stdout:1/753: read d3/d22/f2a [191670,131046] 0 2024-09-19T06:40:44.110 INFO:tasks.workunit.client.1.smithi117.stdout:3/831: truncate d0/d9/d4e/db4/dcc/f10b 926139 0 2024-09-19T06:40:44.110 INFO:tasks.workunit.client.1.smithi117.stdout:6/626: dwrite d1/d5/d8/db0/f7a [4194304,4194304] 0 2024-09-19T06:40:44.113 INFO:tasks.workunit.client.1.smithi117.stdout:1/754: mknod d3/d18/d23/d51/c109 0 2024-09-19T06:40:44.119 INFO:tasks.workunit.client.1.smithi117.stdout:3/832: dwrite d0/d19/f110 [0,4194304] 0 2024-09-19T06:40:44.121 INFO:tasks.workunit.client.1.smithi117.stdout:1/755: rename d3/d18/d23/f55 to d3/d8e/f10a 0 2024-09-19T06:40:44.122 INFO:tasks.workunit.client.1.smithi117.stdout:3/833: symlink d0/d19/l111 0 2024-09-19T06:40:44.123 INFO:tasks.workunit.client.1.smithi117.stdout:9/829: truncate d4/d1c/d5f/dbc/fed 325263 0 2024-09-19T06:40:44.124 INFO:tasks.workunit.client.1.smithi117.stdout:1/756: fsync d3/f38 0 2024-09-19T06:40:44.126 INFO:tasks.workunit.client.1.smithi117.stdout:3/834: fsync d0/d3d/d48/f91 0 2024-09-19T06:40:44.128 INFO:tasks.workunit.client.1.smithi117.stdout:9/830: rmdir d4/d1c/d36/d37 39 2024-09-19T06:40:44.128 INFO:tasks.workunit.client.1.smithi117.stdout:3/835: dread d0/d8/ff5 [0,4194304] 0 2024-09-19T06:40:44.129 INFO:tasks.workunit.client.1.smithi117.stdout:0/781: sync 2024-09-19T06:40:44.129 INFO:tasks.workunit.client.1.smithi117.stdout:3/836: chown d0/d8/d7f/dbf/ld6 189 1 2024-09-19T06:40:44.130 INFO:tasks.workunit.client.1.smithi117.stdout:1/757: fdatasync d3/da1/db1/fa7 0 2024-09-19T06:40:44.134 INFO:tasks.workunit.client.0.smithi099.stdout:9/678: dread dd/d2c/f5a [0,4194304] 0 2024-09-19T06:40:44.135 INFO:tasks.workunit.client.1.smithi117.stdout:0/782: rmdir d11/d13/d14/d16/da1 39 2024-09-19T06:40:44.136 INFO:tasks.workunit.client.0.smithi099.stdout:9/679: mkdir dd/d2c/d79/db4/de2 0 2024-09-19T06:40:44.137 INFO:tasks.workunit.client.0.smithi099.stdout:9/680: readlink dd/d2c/l43 0 2024-09-19T06:40:44.137 INFO:tasks.workunit.client.1.smithi117.stdout:0/783: write d11/d13/d14/d2c/d35/f6c [3344451,28756] 0 2024-09-19T06:40:44.137 INFO:tasks.workunit.client.0.smithi099.stdout:9/681: fdatasync dd/d62/d76/fbb 0 2024-09-19T06:40:44.138 INFO:tasks.workunit.client.1.smithi117.stdout:3/837: mkdir d0/d8/d7f/dbf/d112 0 2024-09-19T06:40:44.140 INFO:tasks.workunit.client.1.smithi117.stdout:1/758: creat d3/d18/d23/d74/f10b x:0 0 0 2024-09-19T06:40:44.145 INFO:tasks.workunit.client.1.smithi117.stdout:7/839: truncate d1/d4a/d81/d24/d1c/fe0 140564 0 2024-09-19T06:40:44.146 INFO:tasks.workunit.client.1.smithi117.stdout:9/831: dread d4/d1c/d7a/d52/f62 [0,4194304] 0 2024-09-19T06:40:44.146 INFO:tasks.workunit.client.1.smithi117.stdout:3/838: mkdir d0/d8/d64/d113 0 2024-09-19T06:40:44.147 INFO:tasks.workunit.client.1.smithi117.stdout:9/832: chown d4/d1c/d5f/f80 456114342 1 2024-09-19T06:40:44.147 INFO:tasks.workunit.client.1.smithi117.stdout:3/839: write d0/d9/ff2 [173366,97723] 0 2024-09-19T06:40:44.148 INFO:tasks.workunit.client.1.smithi117.stdout:3/840: write d0/d9/d4e/d9e/ffa [1096586,104274] 0 2024-09-19T06:40:44.148 INFO:tasks.workunit.client.1.smithi117.stdout:7/840: symlink d1/d4a/d81/d48/d5f/l12e 0 2024-09-19T06:40:44.150 INFO:tasks.workunit.client.1.smithi117.stdout:9/833: rmdir d4/d58 39 2024-09-19T06:40:44.154 INFO:tasks.workunit.client.1.smithi117.stdout:7/841: creat d1/d4a/d7c/d95/db5/f12f x:0 0 0 2024-09-19T06:40:44.155 INFO:tasks.workunit.client.1.smithi117.stdout:3/841: dwrite d0/d9/d4e/d9e/fa4 [0,4194304] 0 2024-09-19T06:40:44.155 INFO:tasks.workunit.client.1.smithi117.stdout:9/834: dread - d4/d1c/d36/d37/ff4 zero size 2024-09-19T06:40:44.155 INFO:tasks.workunit.client.0.smithi099.stdout:9/682: dread dd/f6a [0,4194304] 0 2024-09-19T06:40:44.156 INFO:tasks.workunit.client.1.smithi117.stdout:1/759: rename d3/d18/d23/l81 to d3/da1/l10c 0 2024-09-19T06:40:44.157 INFO:tasks.workunit.client.0.smithi099.stdout:9/683: mknod dd/d47/d68/ce3 0 2024-09-19T06:40:44.157 INFO:tasks.workunit.client.1.smithi117.stdout:6/627: write d1/d3/f20 [4441763,102079] 0 2024-09-19T06:40:44.160 INFO:tasks.workunit.client.1.smithi117.stdout:1/760: mknod d3/d18/d23/d51/c10d 0 2024-09-19T06:40:44.164 INFO:tasks.workunit.client.1.smithi117.stdout:7/842: truncate d1/d4a/d81/f58 951299 0 2024-09-19T06:40:44.168 INFO:tasks.workunit.client.1.smithi117.stdout:9/835: link d4/d58/f67 d4/d1c/d73/d9a/f11c 0 2024-09-19T06:40:44.171 INFO:tasks.workunit.client.1.smithi117.stdout:9/836: stat d4/d1c/c56 0 2024-09-19T06:40:44.171 INFO:tasks.workunit.client.1.smithi117.stdout:1/761: dwrite d3/fc5 [0,4194304] 0 2024-09-19T06:40:44.171 INFO:tasks.workunit.client.1.smithi117.stdout:3/842: dwrite d0/d3d/d48/d77/d81/f8f [0,4194304] 0 2024-09-19T06:40:44.180 INFO:tasks.workunit.client.1.smithi117.stdout:3/843: rename d0/faf to d0/d3d/d48/dc7/f114 0 2024-09-19T06:40:44.182 INFO:tasks.workunit.client.0.smithi099.stdout:9/684: dwrite dd/d47/d68/f9c [0,4194304] 0 2024-09-19T06:40:44.182 INFO:tasks.workunit.client.1.smithi117.stdout:0/784: dwrite d11/d13/d28/f7f [0,4194304] 0 2024-09-19T06:40:44.183 INFO:tasks.workunit.client.0.smithi099.stdout:9/685: fsync dd/d62/d78/f7b 0 2024-09-19T06:40:44.185 INFO:tasks.workunit.client.1.smithi117.stdout:9/837: mknod d4/d1c/d5f/d103/c11d 0 2024-09-19T06:40:44.186 INFO:tasks.workunit.client.0.smithi099.stdout:9/686: truncate dd/d62/d76/d9a/fce 492301 0 2024-09-19T06:40:44.187 INFO:tasks.workunit.client.0.smithi099.stdout:9/687: truncate dd/d62/d76/fe0 193504 0 2024-09-19T06:40:44.188 INFO:tasks.workunit.client.1.smithi117.stdout:3/844: rmdir d0/d8 39 2024-09-19T06:40:44.188 INFO:tasks.workunit.client.0.smithi099.stdout:9/688: chown dd/d47/l95 564855 1 2024-09-19T06:40:44.191 INFO:tasks.workunit.client.1.smithi117.stdout:6/628: dread d1/d3/f20 [0,4194304] 0 2024-09-19T06:40:44.191 INFO:tasks.workunit.client.0.smithi099.stdout:9/689: rmdir dd/d47 39 2024-09-19T06:40:44.191 INFO:tasks.workunit.client.1.smithi117.stdout:9/838: rmdir d4/d1c/d7a/d52/d8d 39 2024-09-19T06:40:44.192 INFO:tasks.workunit.client.1.smithi117.stdout:0/785: creat d11/d13/d28/dfe/f101 x:0 0 0 2024-09-19T06:40:44.196 INFO:tasks.workunit.client.1.smithi117.stdout:7/843: dwrite d1/d4a/d81/d24/fc8 [0,4194304] 0 2024-09-19T06:40:44.198 INFO:tasks.workunit.client.1.smithi117.stdout:9/839: write d4/d1c/d36/d37/faa [1104870,81832] 0 2024-09-19T06:40:44.199 INFO:tasks.workunit.client.1.smithi117.stdout:6/629: truncate d1/d14/f23 636830 0 2024-09-19T06:40:44.200 INFO:tasks.workunit.client.1.smithi117.stdout:0/786: truncate d11/d13/d1b/d27/d54/fe9 206831 0 2024-09-19T06:40:44.202 INFO:tasks.workunit.client.1.smithi117.stdout:6/630: write d1/d5/d85/f93 [12603006,6614] 0 2024-09-19T06:40:44.204 INFO:tasks.workunit.client.1.smithi117.stdout:3/845: link d0/d8/f8b d0/d3d/d48/dd0/f115 0 2024-09-19T06:40:44.205 INFO:tasks.workunit.client.1.smithi117.stdout:3/846: chown d0/d3d/d48/dd0/f115 8541271 1 2024-09-19T06:40:44.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:44 smithi099 ceph-mon[27651]: from='client.14620 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:40:44.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:44 smithi099 ceph-mon[27651]: from='client.14624 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:40:44.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:44 smithi099 ceph-mon[27651]: pgmap v20: 65 pgs: 65 active+clean; 2.8 GiB data, 9.8 GiB used, 527 GiB / 536 GiB avail; 106 MiB/s rd, 287 MiB/s wr, 534 op/s 2024-09-19T06:40:44.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:44 smithi099 ceph-mon[27651]: from='client.? 172.21.15.99:0/181926623' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:40:44.207 INFO:tasks.workunit.client.1.smithi117.stdout:0/787: symlink d11/d13/d14/l102 0 2024-09-19T06:40:44.207 INFO:tasks.workunit.client.1.smithi117.stdout:9/840: truncate d4/d8/d6e/ffe 2674852 0 2024-09-19T06:40:44.212 INFO:tasks.workunit.client.1.smithi117.stdout:3/847: rename d0/d9/d1c/f28 to d0/d8/d7f/f116 0 2024-09-19T06:40:44.213 INFO:tasks.workunit.client.1.smithi117.stdout:6/631: getdents d1 0 2024-09-19T06:40:44.213 INFO:tasks.workunit.client.1.smithi117.stdout:1/762: write d3/f3c [426794,1189] 0 2024-09-19T06:40:44.214 INFO:tasks.workunit.client.1.smithi117.stdout:1/763: dread - d3/d18/d23/d51/f86 zero size 2024-09-19T06:40:44.214 INFO:tasks.workunit.client.1.smithi117.stdout:1/764: read - d3/d18/d56/fdb zero size 2024-09-19T06:40:44.216 INFO:tasks.workunit.client.1.smithi117.stdout:1/765: write d3/da1/fd4 [1683479,118093] 0 2024-09-19T06:40:44.217 INFO:tasks.workunit.client.1.smithi117.stdout:9/841: link d4/d1c/f41 d4/d1c/d54/da5/f11e 0 2024-09-19T06:40:44.218 INFO:tasks.workunit.client.0.smithi099.stdout:9/690: dwrite dd/d2c/d5c/f73 [0,4194304] 0 2024-09-19T06:40:44.220 INFO:tasks.workunit.client.0.smithi099.stdout:9/691: mkdir dd/d65/de4 0 2024-09-19T06:40:44.225 INFO:tasks.workunit.client.1.smithi117.stdout:1/766: fdatasync d3/d18/d23/f70 0 2024-09-19T06:40:44.226 INFO:tasks.workunit.client.0.smithi099.stdout:9/692: dread dd/d47/d40/f52 [0,4194304] 0 2024-09-19T06:40:44.228 INFO:tasks.workunit.client.0.smithi099.stdout:9/693: symlink dd/le5 0 2024-09-19T06:40:44.231 INFO:tasks.workunit.client.1.smithi117.stdout:7/844: truncate d1/d4a/d81/d24/d1c/d55/f59 2352909 0 2024-09-19T06:40:44.232 INFO:tasks.workunit.client.1.smithi117.stdout:1/767: rmdir d3/d18/d23/d51 39 2024-09-19T06:40:44.235 INFO:tasks.workunit.client.1.smithi117.stdout:8/791: sync 2024-09-19T06:40:44.237 INFO:tasks.workunit.client.1.smithi117.stdout:8/792: fdatasync d1d/d1e/d53/fef 0 2024-09-19T06:40:44.237 INFO:tasks.workunit.client.1.smithi117.stdout:1/768: mkdir d3/d8e/d10e 0 2024-09-19T06:40:44.237 INFO:tasks.workunit.client.0.smithi099.stdout:3/843: sync 2024-09-19T06:40:44.237 INFO:tasks.workunit.client.0.smithi099.stdout:8/589: sync 2024-09-19T06:40:44.237 INFO:tasks.workunit.client.0.smithi099.stdout:0/582: sync 2024-09-19T06:40:44.238 INFO:tasks.workunit.client.1.smithi117.stdout:0/788: dwrite d11/f48 [0,4194304] 0 2024-09-19T06:40:44.238 INFO:tasks.workunit.client.0.smithi099.stdout:0/583: dread - d0/db/d36/d3f/fa1 zero size 2024-09-19T06:40:44.239 INFO:tasks.workunit.client.1.smithi117.stdout:7/845: truncate d1/d3f/f109 1177351 0 2024-09-19T06:40:44.240 INFO:tasks.workunit.client.1.smithi117.stdout:9/842: truncate d4/d1c/d73/fa7 2082330 0 2024-09-19T06:40:44.241 INFO:tasks.workunit.client.0.smithi099.stdout:8/590: readlink d4/de/d10/l87 0 2024-09-19T06:40:44.242 INFO:tasks.workunit.client.1.smithi117.stdout:1/769: rmdir d3/da1/da5 39 2024-09-19T06:40:44.245 INFO:tasks.workunit.client.1.smithi117.stdout:8/793: symlink d1d/d2a/d3f/d4b/d5f/dbf/dd0/l110 0 2024-09-19T06:40:44.246 INFO:tasks.workunit.client.0.smithi099.stdout:3/844: link d7/d34/d1d/d36/d69/d6d/d7a/lbe d7/d34/d1d/d20/d75/d79/lfe 0 2024-09-19T06:40:44.247 INFO:tasks.workunit.client.0.smithi099.stdout:8/591: truncate d4/d11/d23/d3f/f55 1969830 0 2024-09-19T06:40:44.248 INFO:tasks.workunit.client.1.smithi117.stdout:0/789: mkdir d11/d13/d14/d2c/d53/d103 0 2024-09-19T06:40:44.248 INFO:tasks.workunit.client.1.smithi117.stdout:6/632: write d1/d14/f23 [1191295,61112] 0 2024-09-19T06:40:44.250 INFO:tasks.workunit.client.0.smithi099.stdout:0/584: dwrite d0/db/d27/d5d/d87/da2/dbc/d1f/d39/f63 [0,4194304] 0 2024-09-19T06:40:44.252 INFO:tasks.workunit.client.0.smithi099.stdout:3/845: stat d7/d34/d1d/d36/db3/de0/cf9 0 2024-09-19T06:40:44.252 INFO:tasks.workunit.client.0.smithi099.stdout:0/585: stat d0/db/f86 0 2024-09-19T06:40:44.253 INFO:tasks.workunit.client.1.smithi117.stdout:0/790: dwrite d11/d13/d14/d2c/d53/d7e/fd7 [0,4194304] 0 2024-09-19T06:40:44.255 INFO:tasks.workunit.client.1.smithi117.stdout:9/843: mkdir d4/d1c/d36/d37/d11f 0 2024-09-19T06:40:44.256 INFO:tasks.workunit.client.0.smithi099.stdout:9/694: dread dd/f70 [0,4194304] 0 2024-09-19T06:40:44.257 INFO:tasks.workunit.client.0.smithi099.stdout:8/592: dwrite d4/d11/d23/d4c/daf/fcc [0,4194304] 0 2024-09-19T06:40:44.263 INFO:tasks.workunit.client.0.smithi099.stdout:8/593: chown d4/de/d10/l7a 33 1 2024-09-19T06:40:44.264 INFO:tasks.workunit.client.0.smithi099.stdout:9/695: rename dd/d62/d76/fb9 to dd/d2c/d5c/d64/d93/fe6 0 2024-09-19T06:40:44.265 INFO:tasks.workunit.client.1.smithi117.stdout:6/633: creat d1/d5/d8/d5e/d6d/fb1 x:0 0 0 2024-09-19T06:40:44.266 INFO:tasks.workunit.client.1.smithi117.stdout:7/846: rmdir d1/d3f 39 2024-09-19T06:40:44.268 INFO:tasks.workunit.client.1.smithi117.stdout:0/791: mkdir d11/d13/d7a/d104 0 2024-09-19T06:40:44.271 INFO:tasks.workunit.client.0.smithi099.stdout:8/594: rename d4/de/d10/f40 to d4/d11/d38/fcd 0 2024-09-19T06:40:44.271 INFO:tasks.workunit.client.0.smithi099.stdout:3/846: rmdir d7/d34/d1d/d36/d69/d6d/dee 0 2024-09-19T06:40:44.272 INFO:tasks.workunit.client.1.smithi117.stdout:1/770: creat d3/d18/d23/dde/f10f x:0 0 0 2024-09-19T06:40:44.272 INFO:tasks.workunit.client.0.smithi099.stdout:0/586: write d0/db/d27/d5d/d87/da2/dbc/d1f/f28 [3688562,112783] 0 2024-09-19T06:40:44.272 INFO:tasks.workunit.client.1.smithi117.stdout:8/794: symlink d1d/d1e/dbc/dc1/d105/l111 0 2024-09-19T06:40:44.275 INFO:tasks.workunit.client.1.smithi117.stdout:6/634: creat d1/d5/d9a/da9/fb2 x:0 0 0 2024-09-19T06:40:44.276 INFO:tasks.workunit.client.1.smithi117.stdout:8/795: fdatasync d1d/d1e/dbc/dff/f10b 0 2024-09-19T06:40:44.276 INFO:tasks.workunit.client.1.smithi117.stdout:6/635: stat d1/d3d/l8a 0 2024-09-19T06:40:44.277 INFO:tasks.workunit.client.0.smithi099.stdout:3/847: unlink d7/d34/d1d/d36/d69/d6d/f8d 0 2024-09-19T06:40:44.277 INFO:tasks.workunit.client.1.smithi117.stdout:0/792: dwrite d11/d13/d14/d2c/d35/d3e/f100 [0,4194304] 0 2024-09-19T06:40:44.278 INFO:tasks.workunit.client.0.smithi099.stdout:0/587: mkdir d0/db/d27/d5d/d87/da2/dbc/d1f/d3a/dbf 0 2024-09-19T06:40:44.279 INFO:tasks.workunit.client.0.smithi099.stdout:9/696: getdents dd/d2c/d5c/d85 0 2024-09-19T06:40:44.282 INFO:tasks.workunit.client.0.smithi099.stdout:9/697: write dd/d47/d40/f31 [1344601,127328] 0 2024-09-19T06:40:44.282 INFO:tasks.workunit.client.0.smithi099.stdout:8/595: dwrite d4/de/d10/f24 [4194304,4194304] 0 2024-09-19T06:40:44.284 INFO:tasks.workunit.client.0.smithi099.stdout:3/848: mkdir d7/d34/d1d/d36/d69/d6d/dff 0 2024-09-19T06:40:44.286 INFO:tasks.workunit.client.1.smithi117.stdout:9/844: rename d4/d1c/d73/d93/fa0 to d4/d1c/d7a/d52/d8d/dc1/f120 0 2024-09-19T06:40:44.286 INFO:tasks.workunit.client.1.smithi117.stdout:8/796: dread - d1d/d31/fa7 zero size 2024-09-19T06:40:44.287 INFO:tasks.workunit.client.0.smithi099.stdout:9/698: dread dd/d62/f66 [0,4194304] 0 2024-09-19T06:40:44.287 INFO:tasks.workunit.client.1.smithi117.stdout:6/636: creat d1/d5/d8/d5e/d67/fb3 x:0 0 0 2024-09-19T06:40:44.287 INFO:tasks.workunit.client.0.smithi099.stdout:8/596: creat d4/d5e/dbb/fce x:0 0 0 2024-09-19T06:40:44.288 INFO:tasks.workunit.client.1.smithi117.stdout:8/797: readlink d1d/d2a/d3f/d4b/d5f/l60 0 2024-09-19T06:40:44.289 INFO:tasks.workunit.client.1.smithi117.stdout:6/637: fsync d1/d5/d8/f5d 0 2024-09-19T06:40:44.290 INFO:tasks.workunit.client.1.smithi117.stdout:9/845: creat d4/d1c/d5f/d103/f121 x:0 0 0 2024-09-19T06:40:44.291 INFO:tasks.workunit.client.0.smithi099.stdout:9/699: dread dd/d62/d76/fe0 [0,4194304] 0 2024-09-19T06:40:44.291 INFO:tasks.workunit.client.1.smithi117.stdout:6/638: chown d1/d5/d32/d45/d7b/f9f 28376 1 2024-09-19T06:40:44.292 INFO:tasks.workunit.client.0.smithi099.stdout:9/700: chown dd/d2c/l43 599 1 2024-09-19T06:40:44.294 INFO:tasks.workunit.client.1.smithi117.stdout:8/798: fdatasync d1d/d31/d83/f9f 0 2024-09-19T06:40:44.296 INFO:tasks.workunit.client.1.smithi117.stdout:8/799: write d1d/d2a/d3f/d4b/f96 [3313408,75459] 0 2024-09-19T06:40:44.297 INFO:tasks.workunit.client.1.smithi117.stdout:8/800: chown d1d/d1e/dbc/dff/f107 0 1 2024-09-19T06:40:44.297 INFO:tasks.workunit.client.0.smithi099.stdout:9/701: link dd/f5b dd/d2c/d5c/dc3/fe7 0 2024-09-19T06:40:44.298 INFO:tasks.workunit.client.1.smithi117.stdout:1/771: getdents d3/d8e 0 2024-09-19T06:40:44.299 INFO:tasks.workunit.client.0.smithi099.stdout:0/588: dread d0/db/d27/d5d/d87/da2/dbc/f42 [0,4194304] 0 2024-09-19T06:40:44.299 INFO:tasks.workunit.client.0.smithi099.stdout:5/844: sync 2024-09-19T06:40:44.299 INFO:tasks.workunit.client.0.smithi099.stdout:1/640: sync 2024-09-19T06:40:44.299 INFO:tasks.workunit.client.0.smithi099.stdout:2/531: sync 2024-09-19T06:40:44.299 INFO:tasks.workunit.client.0.smithi099.stdout:7/810: sync 2024-09-19T06:40:44.299 INFO:tasks.workunit.client.0.smithi099.stdout:6/653: sync 2024-09-19T06:40:44.299 INFO:tasks.workunit.client.0.smithi099.stdout:4/624: sync 2024-09-19T06:40:44.300 INFO:tasks.workunit.client.1.smithi117.stdout:7/847: getdents d1/d4a/d81/d24/d49/dbf 0 2024-09-19T06:40:44.303 INFO:tasks.workunit.client.0.smithi099.stdout:1/641: fdatasync d0/f7d 0 2024-09-19T06:40:44.303 INFO:tasks.workunit.client.0.smithi099.stdout:4/625: symlink d12/d82/ld2 0 2024-09-19T06:40:44.304 INFO:tasks.workunit.client.0.smithi099.stdout:0/589: write d0/d17/d41/f89 [1694573,34769] 0 2024-09-19T06:40:44.306 INFO:tasks.workunit.client.1.smithi117.stdout:8/801: mkdir d1d/d2a/d3f/d73/ddd/d112 0 2024-09-19T06:40:44.309 INFO:tasks.workunit.client.0.smithi099.stdout:2/532: dread d1/d2/d5/d6/f87 [0,4194304] 0 2024-09-19T06:40:44.311 INFO:tasks.workunit.client.0.smithi099.stdout:3/849: write d7/f5f [4902898,76517] 0 2024-09-19T06:40:44.314 INFO:tasks.workunit.client.1.smithi117.stdout:1/772: mkdir d3/d110 0 2024-09-19T06:40:44.315 INFO:tasks.workunit.client.0.smithi099.stdout:6/654: rename d1/d12/l99 to d1/ld6 0 2024-09-19T06:40:44.316 INFO:tasks.workunit.client.1.smithi117.stdout:0/793: truncate d11/d13/d14/d16/f1a 2846060 0 2024-09-19T06:40:44.316 INFO:tasks.workunit.client.1.smithi117.stdout:7/848: truncate d1/d3f/f4d 1204016 0 2024-09-19T06:40:44.317 INFO:tasks.workunit.client.0.smithi099.stdout:4/626: write d12/d32/d42/f93 [1927802,26733] 0 2024-09-19T06:40:44.317 INFO:tasks.workunit.client.0.smithi099.stdout:0/590: truncate d0/d17/d41/f2d 1123006 0 2024-09-19T06:40:44.318 INFO:tasks.workunit.client.1.smithi117.stdout:9/846: dread d4/fa2 [0,4194304] 0 2024-09-19T06:40:44.318 INFO:tasks.workunit.client.1.smithi117.stdout:0/794: truncate d11/d13/d1b/d27/d37/da9/fea 315347 0 2024-09-19T06:40:44.319 INFO:tasks.workunit.client.0.smithi099.stdout:1/642: dwrite d0/d12/d13/f2b [8388608,4194304] 0 2024-09-19T06:40:44.321 INFO:tasks.workunit.client.1.smithi117.stdout:6/639: dread d1/d5/d8/d5e/f68 [0,4194304] 0 2024-09-19T06:40:44.321 INFO:tasks.workunit.client.0.smithi099.stdout:3/850: stat d7/d34/d1d/d36/d42/fae 0 2024-09-19T06:40:44.322 INFO:tasks.workunit.client.0.smithi099.stdout:2/533: mkdir d1/d2/d4d/d55/da5/d9/db7 0 2024-09-19T06:40:44.322 INFO:tasks.workunit.client.1.smithi117.stdout:6/640: chown d1/d5/d8/d27/f47 1474656 1 2024-09-19T06:40:44.322 INFO:tasks.workunit.client.1.smithi117.stdout:8/802: write d1d/d1e/ff4 [1571780,63813] 0 2024-09-19T06:40:44.323 INFO:tasks.workunit.client.0.smithi099.stdout:9/702: rename dd/d47/d40/d61/l7f to dd/d62/d76/d9a/le8 0 2024-09-19T06:40:44.324 INFO:tasks.workunit.client.1.smithi117.stdout:9/847: unlink c3 0 2024-09-19T06:40:44.325 INFO:tasks.workunit.client.1.smithi117.stdout:5/866: sync 2024-09-19T06:40:44.325 INFO:tasks.workunit.client.1.smithi117.stdout:2/887: sync 2024-09-19T06:40:44.325 INFO:tasks.workunit.client.0.smithi099.stdout:5/845: dwrite d3/d16/d5e/f62 [4194304,4194304] 0 2024-09-19T06:40:44.326 INFO:tasks.workunit.client.1.smithi117.stdout:2/888: readlink d0/lfe 0 2024-09-19T06:40:44.326 INFO:tasks.workunit.client.0.smithi099.stdout:1/643: stat d0/db/f19 0 2024-09-19T06:40:44.326 INFO:tasks.workunit.client.0.smithi099.stdout:0/591: mkdir d0/db/dc0 0 2024-09-19T06:40:44.327 INFO:tasks.workunit.client.1.smithi117.stdout:5/867: write d17/d1b/d5d/d86/fc5 [866688,33351] 0 2024-09-19T06:40:44.327 INFO:tasks.workunit.client.0.smithi099.stdout:8/597: dread d4/de/d1c/f6d [0,4194304] 0 2024-09-19T06:40:44.328 INFO:tasks.workunit.client.1.smithi117.stdout:5/868: fsync d17/d1b/d3a/d3c/dcb/dde/da6/f113 0 2024-09-19T06:40:44.329 INFO:tasks.workunit.client.0.smithi099.stdout:2/534: dread - d1/d2/d5/d13/f83 zero size 2024-09-19T06:40:44.330 INFO:tasks.workunit.client.0.smithi099.stdout:4/627: symlink d12/d1b/d73/ld3 0 2024-09-19T06:40:44.332 INFO:tasks.workunit.client.0.smithi099.stdout:6/655: write d1/d5/d38/d76/db0/d54/d5d/fc0 [755028,62265] 0 2024-09-19T06:40:44.333 INFO:tasks.workunit.client.0.smithi099.stdout:9/703: rmdir dd/d62/d78 39 2024-09-19T06:40:44.334 INFO:tasks.workunit.client.0.smithi099.stdout:7/811: rename d7/dcf/d29/d34/d8f/fc3 to d7/d39/d7d/dd6/f124 0 2024-09-19T06:40:44.334 INFO:tasks.workunit.client.0.smithi099.stdout:0/592: chown d0/db/c4b 7413640 1 2024-09-19T06:40:44.335 INFO:tasks.workunit.client.1.smithi117.stdout:0/795: symlink d11/d13/l105 0 2024-09-19T06:40:44.336 INFO:tasks.workunit.client.1.smithi117.stdout:7/849: truncate d1/d4a/d81/d48/d5f/d82/f126 390542 0 2024-09-19T06:40:44.337 INFO:tasks.workunit.client.0.smithi099.stdout:3/851: write d7/d34/d1d/d20/d58/d5c/f90 [29218,124000] 0 2024-09-19T06:40:44.338 INFO:tasks.workunit.client.1.smithi117.stdout:9/848: unlink d4/d1c/d73/d9a/ce4 0 2024-09-19T06:40:44.340 INFO:tasks.workunit.client.1.smithi117.stdout:0/796: dread - d11/d13/d1b/d27/d37/da9/ff0 zero size 2024-09-19T06:40:44.341 INFO:tasks.workunit.client.0.smithi099.stdout:4/628: mknod d12/d1b/d73/d81/d8a/da9/cd4 0 2024-09-19T06:40:44.341 INFO:tasks.workunit.client.1.smithi117.stdout:2/889: fsync d0/d7/d29/d35/f77 0 2024-09-19T06:40:44.342 INFO:tasks.workunit.client.0.smithi099.stdout:2/535: read - d1/d2/d4d/d55/da5/d18/d27/d5b/fb5 zero size 2024-09-19T06:40:44.344 INFO:tasks.workunit.client.1.smithi117.stdout:1/773: dwrite d3/d18/d56/f47 [0,4194304] 0 2024-09-19T06:40:44.344 INFO:tasks.workunit.client.1.smithi117.stdout:7/850: chown d1/d4a/d81/d24/d26/cf4 1838532411 1 2024-09-19T06:40:44.345 INFO:tasks.workunit.client.1.smithi117.stdout:5/869: creat d17/d1b/d3a/f126 x:0 0 0 2024-09-19T06:40:44.346 INFO:tasks.workunit.client.0.smithi099.stdout:5/846: symlink d3/d7/d90/dd2/d128/l129 0 2024-09-19T06:40:44.346 INFO:tasks.workunit.client.1.smithi117.stdout:7/851: readlink d1/d72/l8c 0 2024-09-19T06:40:44.347 INFO:tasks.workunit.client.1.smithi117.stdout:9/849: mkdir d4/d1c/d73/d9a/d122 0 2024-09-19T06:40:44.347 INFO:tasks.workunit.client.1.smithi117.stdout:8/803: dread d1d/ffb [0,4194304] 0 2024-09-19T06:40:44.347 INFO:tasks.workunit.client.1.smithi117.stdout:0/797: symlink d11/d13/d1b/d27/d37/d9d/l106 0 2024-09-19T06:40:44.348 INFO:tasks.workunit.client.0.smithi099.stdout:6/656: creat d1/d5/d24/d2e/d41/d81/fd7 x:0 0 0 2024-09-19T06:40:44.348 INFO:tasks.workunit.client.0.smithi099.stdout:8/598: dwrite d4/d66/fbd [0,4194304] 0 2024-09-19T06:40:44.348 INFO:tasks.workunit.client.1.smithi117.stdout:6/641: creat d1/d3/fb4 x:0 0 0 2024-09-19T06:40:44.349 INFO:tasks.workunit.client.1.smithi117.stdout:7/852: rmdir d1/d4a/d81/d24 39 2024-09-19T06:40:44.350 INFO:tasks.workunit.client.1.smithi117.stdout:1/774: chown d3/d18/d23/le3 332188 1 2024-09-19T06:40:44.351 INFO:tasks.workunit.client.1.smithi117.stdout:9/850: dread d4/fa2 [0,4194304] 0 2024-09-19T06:40:44.351 INFO:tasks.workunit.client.0.smithi099.stdout:2/536: chown d1/d2/d4d/f95 12 1 2024-09-19T06:40:44.353 INFO:tasks.workunit.client.0.smithi099.stdout:3/852: creat d7/d34/d1d/d20/d58/d5c/d98/f100 x:0 0 0 2024-09-19T06:40:44.356 INFO:tasks.workunit.client.1.smithi117.stdout:9/851: mkdir d4/d1c/d73/db5/d123 0 2024-09-19T06:40:44.357 INFO:tasks.workunit.client.1.smithi117.stdout:5/870: creat d17/d1b/d3a/d3c/f127 x:0 0 0 2024-09-19T06:40:44.359 INFO:tasks.workunit.client.1.smithi117.stdout:9/852: chown d4/d1c/d73/d93 17 1 2024-09-19T06:40:44.359 INFO:tasks.workunit.client.1.smithi117.stdout:7/853: fsync d1/d4a/d81/f58 0 2024-09-19T06:40:44.361 INFO:tasks.workunit.client.0.smithi099.stdout:8/599: truncate d4/de/d10/f68 880527 0 2024-09-19T06:40:44.361 INFO:tasks.workunit.client.1.smithi117.stdout:7/854: read d1/d4a/d81/fa4 [2787545,8349] 0 2024-09-19T06:40:44.363 INFO:tasks.workunit.client.0.smithi099.stdout:2/537: write d1/d2/d5/d13/fa2 [492601,97738] 0 2024-09-19T06:40:44.364 INFO:tasks.workunit.client.0.smithi099.stdout:6/657: mknod d1/d5/d24/d2b/dc2/cd8 0 2024-09-19T06:40:44.364 INFO:tasks.workunit.client.1.smithi117.stdout:6/642: dwrite d1/d3/f20 [0,4194304] 0 2024-09-19T06:40:44.364 INFO:tasks.workunit.client.1.smithi117.stdout:1/775: link d3/d18/d56/f68 d3/d18/d23/d74/f111 0 2024-09-19T06:40:44.366 INFO:tasks.workunit.client.0.smithi099.stdout:0/593: write d0/db/d27/d5d/d87/da2/dbc/d37/d3c/d3e/f4c [4163870,54628] 0 2024-09-19T06:40:44.369 INFO:tasks.workunit.client.1.smithi117.stdout:7/855: mkdir d1/d4a/d7c/d95/db5/de2/de3/d130 0 2024-09-19T06:40:44.370 INFO:tasks.workunit.client.0.smithi099.stdout:3/853: dread - d7/d34/d1d/d20/d75/ff3 zero size 2024-09-19T06:40:44.373 INFO:tasks.workunit.client.0.smithi099.stdout:6/658: write d1/d5/f50 [1500623,62905] 0 2024-09-19T06:40:44.374 INFO:tasks.workunit.client.1.smithi117.stdout:5/871: dwrite d17/d1b/d3a/d3c/dcb/dde/d55/dd1/d119/f8f [0,4194304] 0 2024-09-19T06:40:44.376 INFO:tasks.workunit.client.1.smithi117.stdout:8/804: dread d1d/d2a/f2f [0,4194304] 0 2024-09-19T06:40:44.377 INFO:tasks.workunit.client.1.smithi117.stdout:1/776: creat d3/d18/f112 x:0 0 0 2024-09-19T06:40:44.377 INFO:tasks.workunit.client.1.smithi117.stdout:6/643: mkdir d1/d5/d8/db5 0 2024-09-19T06:40:44.380 INFO:tasks.workunit.client.0.smithi099.stdout:7/812: dwrite d7/dcf/d29/d34/f35 [0,4194304] 0 2024-09-19T06:40:44.382 INFO:tasks.workunit.client.1.smithi117.stdout:7/856: readlink d1/d4a/d81/d24/d1c/d55/lff 0 2024-09-19T06:40:44.382 INFO:tasks.workunit.client.0.smithi099.stdout:8/600: creat d4/de/d26/d8d/fcf x:0 0 0 2024-09-19T06:40:44.383 INFO:tasks.workunit.client.1.smithi117.stdout:7/857: chown d1/d4a/d81/f8e 11407 1 2024-09-19T06:40:44.384 INFO:tasks.workunit.client.0.smithi099.stdout:1/644: dread d0/d12/d54/f7e [0,4194304] 0 2024-09-19T06:40:44.384 INFO:tasks.workunit.client.0.smithi099.stdout:2/538: write d1/d2/d4d/d55/da5/d18/d27/d5b/f8c [2631099,95131] 0 2024-09-19T06:40:44.385 INFO:tasks.workunit.client.1.smithi117.stdout:1/777: unlink d3/d8e/f102 0 2024-09-19T06:40:44.387 INFO:tasks.workunit.client.0.smithi099.stdout:5/847: dwrite d3/d16/d2f/fc1 [0,4194304] 0 2024-09-19T06:40:44.388 INFO:tasks.workunit.client.0.smithi099.stdout:3/854: mkdir d7/d34/d1d/d36/db8/d101 0 2024-09-19T06:40:44.389 INFO:tasks.workunit.client.0.smithi099.stdout:4/629: dwrite d12/d1b/db1/fc9 [0,4194304] 0 2024-09-19T06:40:44.389 INFO:tasks.workunit.client.0.smithi099.stdout:1/645: fsync d0/d17/d5b/f5d 0 2024-09-19T06:40:44.392 INFO:tasks.workunit.client.0.smithi099.stdout:0/594: write d0/db/d27/d5d/d87/da2/dbc/d1f/d39/f66 [921452,41315] 0 2024-09-19T06:40:44.393 INFO:tasks.workunit.client.1.smithi117.stdout:7/858: dwrite d1/d4a/d81/d24/d1c/f79 [0,4194304] 0 2024-09-19T06:40:44.395 INFO:tasks.workunit.client.0.smithi099.stdout:7/813: truncate d7/dcf/fb9 2712020 0 2024-09-19T06:40:44.395 INFO:tasks.workunit.client.1.smithi117.stdout:0/798: dwrite d11/d13/d28/f43 [0,4194304] 0 2024-09-19T06:40:44.396 INFO:tasks.workunit.client.0.smithi099.stdout:4/630: creat d12/d1b/d73/d81/d9b/da2/fd5 x:0 0 0 2024-09-19T06:40:44.397 INFO:tasks.workunit.client.0.smithi099.stdout:7/814: write d7/dcf/d29/d1f/f9e [1395334,24956] 0 2024-09-19T06:40:44.400 INFO:tasks.workunit.client.0.smithi099.stdout:8/601: symlink d4/de/d26/d2b/d91/ld0 0 2024-09-19T06:40:44.401 INFO:tasks.workunit.client.1.smithi117.stdout:0/799: dread d11/d13/d28/f43 [0,4194304] 0 2024-09-19T06:40:44.401 INFO:tasks.workunit.client.0.smithi099.stdout:3/855: unlink d7/d34/d1d/fdc 0 2024-09-19T06:40:44.403 INFO:tasks.workunit.client.1.smithi117.stdout:8/805: unlink d1d/d2a/d3f/d73/ff8 0 2024-09-19T06:40:44.405 INFO:tasks.workunit.client.0.smithi099.stdout:4/631: creat d12/d1b/d73/d81/d8a/fd6 x:0 0 0 2024-09-19T06:40:44.406 INFO:tasks.workunit.client.1.smithi117.stdout:6/644: link d1/d3d/l7f d1/d14/lb6 0 2024-09-19T06:40:44.406 INFO:tasks.workunit.client.0.smithi099.stdout:8/602: write d4/de/fb7 [1001510,126339] 0 2024-09-19T06:40:44.407 INFO:tasks.workunit.client.0.smithi099.stdout:8/603: readlink d4/de/l81 0 2024-09-19T06:40:44.407 INFO:tasks.workunit.client.0.smithi099.stdout:9/704: dread dd/d47/d40/d61/f63 [4194304,4194304] 0 2024-09-19T06:40:44.407 INFO:tasks.workunit.client.0.smithi099.stdout:3/856: mkdir d7/d34/d1d/d36/d42/d102 0 2024-09-19T06:40:44.408 INFO:tasks.workunit.client.1.smithi117.stdout:6/645: write d1/d5/d85/f93 [7755841,57285] 0 2024-09-19T06:40:44.408 INFO:tasks.workunit.client.1.smithi117.stdout:5/872: dwrite d17/f111 [0,4194304] 0 2024-09-19T06:40:44.410 INFO:tasks.workunit.client.0.smithi099.stdout:5/848: creat d3/d16/d2f/d34/d3c/d65/dbe/f12a x:0 0 0 2024-09-19T06:40:44.411 INFO:tasks.workunit.client.1.smithi117.stdout:0/800: rename d11/d13/d14/d2c/d64 to d11/d13/d1b/d67/d107 0 2024-09-19T06:40:44.414 INFO:tasks.workunit.client.0.smithi099.stdout:0/595: symlink d0/db/d27/d5d/d87/da2/dbc/d1f/d3a/lc1 0 2024-09-19T06:40:44.416 INFO:tasks.workunit.client.0.smithi099.stdout:2/539: write d1/d2/d5/d13/f54 [4671467,107650] 0 2024-09-19T06:40:44.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:44.415+0000 7fcd29ddd640 1 -- 172.21.15.99:0/327748830 --> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcd2410efe0 con 0x7fcd0c06e6e0 2024-09-19T06:40:44.417 INFO:tasks.workunit.client.0.smithi099.stdout:9/705: creat dd/d2c/d5c/d64/d93/fe9 x:0 0 0 2024-09-19T06:40:44.418 INFO:tasks.workunit.client.0.smithi099.stdout:8/604: dread d4/d11/d38/f9b [0,4194304] 0 2024-09-19T06:40:44.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:44.417+0000 7fcd0bfff640 1 -- 172.21.15.99:0/327748830 <== mgr.24369 v2:172.21.15.117:6828/1735340892 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7fcd2410efe0 con 0x7fcd0c06e6e0 2024-09-19T06:40:44.419 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:40:44.419 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T06:40:44.419 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": true, 2024-09-19T06:40:44.419 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-19T06:40:44.419 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [], 2024-09-19T06:40:44.419 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": "1/2 daemons upgraded", 2024-09-19T06:40:44.419 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "", 2024-09-19T06:40:44.420 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-09-19T06:40:44.420 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:40:44.420 INFO:tasks.workunit.client.0.smithi099.stdout:5/849: mkdir d3/d7/d90/dd2/d12b 0 2024-09-19T06:40:44.420 INFO:tasks.workunit.client.1.smithi117.stdout:0/801: dread - d11/d13/f8e zero size 2024-09-19T06:40:44.420 INFO:tasks.workunit.client.1.smithi117.stdout:7/859: getdents d1/d72/d10f 0 2024-09-19T06:40:44.421 INFO:tasks.workunit.client.0.smithi099.stdout:3/857: creat d7/d34/d1d/d36/d69/d6d/d7a/f103 x:0 0 0 2024-09-19T06:40:44.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:44.422+0000 7fcd29ddd640 1 -- 172.21.15.99:0/327748830 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7fcd0c06e6e0 msgr2=0x7fcd0c070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:44.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:44.422+0000 7fcd29ddd640 1 --2- 172.21.15.99:0/327748830 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7fcd0c06e6e0 0x7fcd0c070b90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fcd24065920 tx=0x7fcd1400b040 comp rx=0 tx=0).stop 2024-09-19T06:40:44.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:44.422+0000 7fcd29ddd640 1 -- 172.21.15.99:0/327748830 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd240ff700 msgr2=0x7fcd2410d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:40:44.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:44.422+0000 7fcd29ddd640 1 --2- 172.21.15.99:0/327748830 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd240ff700 0x7fcd2410d5c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fcd180043d0 tx=0x7fcd18009da0 comp rx=0 tx=0).stop 2024-09-19T06:40:44.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:44.423+0000 7fcd29ddd640 1 -- 172.21.15.99:0/327748830 shutdown_connections 2024-09-19T06:40:44.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:44.423+0000 7fcd29ddd640 1 --2- 172.21.15.99:0/327748830 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7fcd0c06e6e0 0x7fcd0c070b90 secure :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fcd24065920 tx=0x7fcd1400b040 comp rx=0 tx=0).stop 2024-09-19T06:40:44.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:44.423+0000 7fcd29ddd640 1 --2- 172.21.15.99:0/327748830 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcd240ff700 0x7fcd2410d5c0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:44.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:44.423+0000 7fcd29ddd640 1 --2- 172.21.15.99:0/327748830 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd24065bc0 0x7fcd2410d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:40:44.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:44.423+0000 7fcd29ddd640 1 -- 172.21.15.99:0/327748830 >> 172.21.15.99:0/327748830 conn(0x7fcd240f6c10 msgr2=0x7fcd240f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:40:44.425 INFO:tasks.workunit.client.0.smithi099.stdout:5/850: creat d3/d16/d2f/d34/d3c/f12c x:0 0 0 2024-09-19T06:40:44.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:44.424+0000 7fcd29ddd640 1 -- 172.21.15.99:0/327748830 shutdown_connections 2024-09-19T06:40:44.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:40:44.424+0000 7fcd29ddd640 1 -- 172.21.15.99:0/327748830 wait complete. 2024-09-19T06:40:44.426 INFO:tasks.workunit.client.0.smithi099.stdout:8/605: chown d4/de/d26/d2b/f82 37912 1 2024-09-19T06:40:44.428 INFO:tasks.workunit.client.1.smithi117.stdout:7/860: dwrite d1/d4a/d81/d24/d1c/d35/d4f/f87 [0,4194304] 0 2024-09-19T06:40:44.430 INFO:tasks.workunit.client.1.smithi117.stdout:7/861: write d1/d4a/d7c/fcd [706665,1233] 0 2024-09-19T06:40:44.431 INFO:tasks.workunit.client.1.smithi117.stdout:1/778: dwrite d3/d18/d56/f68 [0,4194304] 0 2024-09-19T06:40:44.436 INFO:tasks.workunit.client.0.smithi099.stdout:3/858: link d7/d34/d1d/d36/d69/d96/fe8 d7/d34/d1d/d20/d58/d5c/d98/dde/f104 0 2024-09-19T06:40:44.436 INFO:tasks.workunit.client.0.smithi099.stdout:5/851: write d3/d7/fb8 [994862,107729] 0 2024-09-19T06:40:44.437 INFO:tasks.workunit.client.1.smithi117.stdout:3/848: sync 2024-09-19T06:40:44.438 INFO:tasks.workunit.client.0.smithi099.stdout:9/706: dwrite dd/d47/f38 [0,4194304] 0 2024-09-19T06:40:44.438 INFO:tasks.workunit.client.1.smithi117.stdout:3/849: readlink d0/d9/d1c/d53/l82 0 2024-09-19T06:40:44.438 INFO:tasks.workunit.client.1.smithi117.stdout:3/850: fsync d0/d3d/d48/f7b 0 2024-09-19T06:40:44.440 INFO:tasks.workunit.client.0.smithi099.stdout:8/606: readlink d4/de/d26/d2b/la1 0 2024-09-19T06:40:44.446 INFO:tasks.workunit.client.0.smithi099.stdout:8/607: fsync d4/d5e/dbb/fc4 0 2024-09-19T06:40:44.448 INFO:tasks.workunit.client.0.smithi099.stdout:5/852: mknod d3/d7/d90/dd2/d12b/c12d 0 2024-09-19T06:40:44.449 INFO:tasks.workunit.client.1.smithi117.stdout:5/873: rename d17/d1b/d5d/d7d/ca5 to d17/d1b/d3a/d3c/dcb/dde/d55/c128 0 2024-09-19T06:40:44.450 INFO:tasks.workunit.client.0.smithi099.stdout:9/707: creat dd/d2c/fea x:0 0 0 2024-09-19T06:40:44.450 INFO:tasks.workunit.client.0.smithi099.stdout:6/659: truncate d1/d5/d38/d76/db0/d2a/f55 3165945 0 2024-09-19T06:40:44.453 INFO:tasks.workunit.client.1.smithi117.stdout:0/802: creat d11/d13/d14/d2c/d35/d3e/f108 x:0 0 0 2024-09-19T06:40:44.453 INFO:tasks.workunit.client.0.smithi099.stdout:3/859: dwrite d7/d34/d1d/d20/d58/d5c/fd0 [0,4194304] 0 2024-09-19T06:40:44.455 INFO:tasks.workunit.client.1.smithi117.stdout:7/862: symlink d1/d4a/d7c/l131 0 2024-09-19T06:40:44.457 INFO:tasks.workunit.client.1.smithi117.stdout:5/874: mknod d17/d1b/d5d/d86/c129 0 2024-09-19T06:40:44.460 INFO:tasks.workunit.client.1.smithi117.stdout:8/806: dwrite d1d/f52 [0,4194304] 0 2024-09-19T06:40:44.460 INFO:tasks.workunit.client.0.smithi099.stdout:8/608: rename d4/d11/d23/d4c/fa7 to d4/de/d26/d8d/fd1 0 2024-09-19T06:40:44.461 INFO:tasks.workunit.client.1.smithi117.stdout:1/779: fdatasync d3/d18/f48 0 2024-09-19T06:40:44.462 INFO:tasks.workunit.client.0.smithi099.stdout:8/609: chown d4/de/d10/l2a 227773 1 2024-09-19T06:40:44.462 INFO:tasks.workunit.client.0.smithi099.stdout:6/660: dwrite d1/d5/d38/dbb/da7/fbd [0,4194304] 0 2024-09-19T06:40:44.463 INFO:tasks.workunit.client.0.smithi099.stdout:5/853: dread d3/d16/d5e/f85 [0,4194304] 0 2024-09-19T06:40:44.463 INFO:tasks.workunit.client.1.smithi117.stdout:8/807: stat d1d/d2a/d3f/d4b/d66/dac/fe9 0 2024-09-19T06:40:44.463 INFO:tasks.workunit.client.1.smithi117.stdout:0/803: rmdir d11/d13/d14/d2c/d53 39 2024-09-19T06:40:44.464 INFO:tasks.workunit.client.1.smithi117.stdout:5/875: unlink d17/d1b/d5d/c10a 0 2024-09-19T06:40:44.464 INFO:tasks.workunit.client.1.smithi117.stdout:0/804: chown d11/d13/fc7 7 1 2024-09-19T06:40:44.465 INFO:tasks.workunit.client.0.smithi099.stdout:1/646: dread d0/d12/d13/d37/d48/f7c [0,4194304] 0 2024-09-19T06:40:44.466 INFO:tasks.workunit.client.0.smithi099.stdout:8/610: truncate d4/d11/d38/fcd 4220300 0 2024-09-19T06:40:44.467 INFO:tasks.workunit.client.1.smithi117.stdout:0/805: write d11/d13/d1b/d67/d107/f81 [4179514,9873] 0 2024-09-19T06:40:44.468 INFO:tasks.workunit.client.0.smithi099.stdout:8/611: read d4/de/d10/f68 [548340,120245] 0 2024-09-19T06:40:44.468 INFO:tasks.workunit.client.1.smithi117.stdout:1/780: mkdir d3/d18/d23/d74/d89/d9f/d113 0 2024-09-19T06:40:44.472 INFO:tasks.workunit.client.1.smithi117.stdout:8/808: read d1d/d2a/d3f/d73/ddd/f2b [12508387,112821] 0 2024-09-19T06:40:44.472 INFO:tasks.workunit.client.1.smithi117.stdout:7/863: creat d1/d4a/d7c/d95/f132 x:0 0 0 2024-09-19T06:40:44.473 INFO:tasks.workunit.client.1.smithi117.stdout:0/806: mkdir d11/d13/d1b/d67/d107/d109 0 2024-09-19T06:40:44.475 INFO:tasks.workunit.client.0.smithi099.stdout:6/661: getdents d1/da1 0 2024-09-19T06:40:44.475 INFO:tasks.workunit.client.1.smithi117.stdout:1/781: creat d3/d99/dd7/f114 x:0 0 0 2024-09-19T06:40:44.475 INFO:tasks.workunit.client.0.smithi099.stdout:8/612: read f2 [3576587,58698] 0 2024-09-19T06:40:44.476 INFO:tasks.workunit.client.1.smithi117.stdout:1/782: stat d3/da1 0 2024-09-19T06:40:44.479 INFO:tasks.workunit.client.0.smithi099.stdout:2/540: truncate d1/d2/d5/d13/d2c/f49 1798202 0 2024-09-19T06:40:44.479 INFO:tasks.workunit.client.1.smithi117.stdout:7/864: rmdir d1/d4a/d81 39 2024-09-19T06:40:44.482 INFO:tasks.workunit.client.0.smithi099.stdout:0/596: dwrite d0/db/d27/d5d/d87/da2/dbc/d47/f92 [0,4194304] 0 2024-09-19T06:40:44.482 INFO:tasks.workunit.client.1.smithi117.stdout:1/783: creat d3/d99/dd7/f115 x:0 0 0 2024-09-19T06:40:44.484 INFO:tasks.workunit.client.0.smithi099.stdout:5/854: rename d3/d16/d5e/l7b to d3/d16/d2f/d34/d3c/d65/dec/l12e 0 2024-09-19T06:40:44.486 INFO:tasks.workunit.client.1.smithi117.stdout:0/807: rename d11/d13/d1b/d27/f7d to d11/d13/d28/d38/d5b/f10a 0 2024-09-19T06:40:44.486 INFO:tasks.workunit.client.0.smithi099.stdout:8/613: creat d4/d11/fd2 x:0 0 0 2024-09-19T06:40:44.487 INFO:tasks.workunit.client.1.smithi117.stdout:7/865: rmdir d1/d4a/d81/d24/d1c/da8 39 2024-09-19T06:40:44.490 INFO:tasks.workunit.client.1.smithi117.stdout:1/784: creat d3/d8e/d10e/f116 x:0 0 0 2024-09-19T06:40:44.492 INFO:tasks.workunit.client.0.smithi099.stdout:0/597: creat d0/db/d27/d5d/d87/da2/dbc/d37/fc2 x:0 0 0 2024-09-19T06:40:44.493 INFO:tasks.workunit.client.1.smithi117.stdout:7/866: unlink d1/d4a/d81/d48/d5f/l65 0 2024-09-19T06:40:44.494 INFO:tasks.workunit.client.1.smithi117.stdout:1/785: symlink d3/d18/d23/dde/l117 0 2024-09-19T06:40:44.494 INFO:tasks.workunit.client.0.smithi099.stdout:6/662: rename d1/d5/d38/fae to d1/d5/d38/d76/db0/d54/d5d/fd9 0 2024-09-19T06:40:44.496 INFO:tasks.workunit.client.0.smithi099.stdout:0/598: truncate d0/db/d27/d5d/d87/da2/dbc/d37/d3c/faf 600279 0 2024-09-19T06:40:44.497 INFO:tasks.workunit.client.0.smithi099.stdout:0/599: chown d0/db/d27/d5d/d87/da2/dbc 12211659 1 2024-09-19T06:40:44.498 INFO:tasks.workunit.client.1.smithi117.stdout:1/786: symlink d3/d18/d23/dfc/l118 0 2024-09-19T06:40:44.498 INFO:tasks.workunit.client.0.smithi099.stdout:5/855: link d3/d1f/l2d d3/d7/d90/dd2/d128/l12f 0 2024-09-19T06:40:44.499 INFO:tasks.workunit.client.1.smithi117.stdout:0/808: dwrite d11/d13/d14/d16/f4a [4194304,4194304] 0 2024-09-19T06:40:44.501 INFO:tasks.workunit.client.0.smithi099.stdout:5/856: symlink d3/d16/d2f/d34/d3c/d65/dec/l130 0 2024-09-19T06:40:44.501 INFO:tasks.workunit.client.1.smithi117.stdout:6/646: write d1/d5/d8/f19 [4898971,4622] 0 2024-09-19T06:40:44.502 INFO:tasks.workunit.client.0.smithi099.stdout:8/614: dread d4/d11/d23/f4b [0,4194304] 0 2024-09-19T06:40:44.502 INFO:tasks.workunit.client.1.smithi117.stdout:5/876: dread d17/d1b/d3a/d3c/dcb/dde/f32 [0,4194304] 0 2024-09-19T06:40:44.504 INFO:tasks.workunit.client.0.smithi099.stdout:9/708: write dd/d2c/d5c/ddb/fde [878911,19537] 0 2024-09-19T06:40:44.504 INFO:tasks.workunit.client.1.smithi117.stdout:0/809: read d11/d13/fc7 [4579773,60746] 0 2024-09-19T06:40:44.505 INFO:tasks.workunit.client.1.smithi117.stdout:6/647: write d1/f64 [747452,117195] 0 2024-09-19T06:40:44.506 INFO:tasks.workunit.client.1.smithi117.stdout:3/851: write d0/d8/f8b [722549,116143] 0 2024-09-19T06:40:44.508 INFO:tasks.workunit.client.1.smithi117.stdout:6/648: write d1/d3/f4b [1763734,14139] 0 2024-09-19T06:40:44.508 INFO:tasks.workunit.client.1.smithi117.stdout:0/810: dread d11/d13/d28/f87 [0,4194304] 0 2024-09-19T06:40:44.508 INFO:tasks.workunit.client.0.smithi099.stdout:8/615: mknod d4/d11/d23/d4c/d93/cd3 0 2024-09-19T06:40:44.509 INFO:tasks.workunit.client.1.smithi117.stdout:5/877: chown d17/d1b/d3a/d3c/dcb/dde/d65/d88/de5/d3b/fc4 12 1 2024-09-19T06:40:44.509 INFO:tasks.workunit.client.0.smithi099.stdout:9/709: dread - dd/d62/d76/f8f zero size 2024-09-19T06:40:44.509 INFO:tasks.workunit.client.1.smithi117.stdout:0/811: readlink d11/d13/d14/d2c/d35/l3b 0 2024-09-19T06:40:44.510 INFO:tasks.workunit.client.0.smithi099.stdout:5/857: creat d3/d14/d100/f131 x:0 0 0 2024-09-19T06:40:44.511 INFO:tasks.workunit.client.0.smithi099.stdout:8/616: truncate d4/de/d26/d8d/fcf 898931 0 2024-09-19T06:40:44.516 INFO:tasks.workunit.client.1.smithi117.stdout:3/852: dread d0/d19/f110 [0,4194304] 0 2024-09-19T06:40:44.518 INFO:tasks.workunit.client.1.smithi117.stdout:6/649: link d1/d5/d8/d27/d77/da8/lad d1/d5/d32/lb7 0 2024-09-19T06:40:44.519 INFO:tasks.workunit.client.0.smithi099.stdout:5/858: creat d3/d16/d2f/d34/da4/da5/dce/de5/f132 x:0 0 0 2024-09-19T06:40:44.519 INFO:tasks.workunit.client.1.smithi117.stdout:0/812: mknod d11/d13/d14/d2c/d53/d7e/daa/c10b 0 2024-09-19T06:40:44.521 INFO:tasks.workunit.client.0.smithi099.stdout:2/541: dread d1/d2/d5/f40 [0,4194304] 0 2024-09-19T06:40:44.522 INFO:tasks.workunit.client.1.smithi117.stdout:6/650: rmdir d1/d3 39 2024-09-19T06:40:44.522 INFO:tasks.workunit.client.0.smithi099.stdout:1/647: dwrite d0/d12/d54/f6f [0,4194304] 0 2024-09-19T06:40:44.525 INFO:tasks.workunit.client.0.smithi099.stdout:1/648: read d0/d12/d13/d37/d48/fc4 [57053,44286] 0 2024-09-19T06:40:44.528 INFO:tasks.workunit.client.1.smithi117.stdout:3/853: dwrite d0/d9/d4e/db4/dcc/f10b [0,4194304] 0 2024-09-19T06:40:44.530 INFO:tasks.workunit.client.1.smithi117.stdout:0/813: dwrite d11/d13/d1b/d27/fdf [0,4194304] 0 2024-09-19T06:40:44.530 INFO:tasks.workunit.client.1.smithi117.stdout:3/854: chown d0/d9/d4e/lc1 501 1 2024-09-19T06:40:44.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:44 smithi117 ceph-mon[34564]: from='client.14620 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:40:44.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:44 smithi117 ceph-mon[34564]: from='client.14624 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:40:44.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:44 smithi117 ceph-mon[34564]: pgmap v20: 65 pgs: 65 active+clean; 2.8 GiB data, 9.8 GiB used, 527 GiB / 536 GiB avail; 106 MiB/s rd, 287 MiB/s wr, 534 op/s 2024-09-19T06:40:44.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:44 smithi117 ceph-mon[34564]: from='client.? 172.21.15.99:0/181926623' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:40:44.601 INFO:tasks.workunit.client.1.smithi117.stdout:2/890: sync 2024-09-19T06:40:44.693 INFO:tasks.workunit.client.1.smithi117.stdout:9/853: sync 2024-09-19T06:40:44.696 INFO:tasks.workunit.client.0.smithi099.stdout:8/617: rmdir d4/d11 39 2024-09-19T06:40:44.697 INFO:tasks.workunit.client.0.smithi099.stdout:5/859: dwrite d3/d14/faf [0,4194304] 0 2024-09-19T06:40:44.698 INFO:tasks.workunit.client.0.smithi099.stdout:1/649: write d0/d17/d32/f6c [1507070,69285] 0 2024-09-19T06:40:44.699 INFO:tasks.workunit.client.1.smithi117.stdout:2/891: fsync d0/d12/d32/db5/f4a 0 2024-09-19T06:40:44.699 INFO:tasks.workunit.client.0.smithi099.stdout:9/710: truncate dd/fe 563673 0 2024-09-19T06:40:44.701 INFO:tasks.workunit.client.0.smithi099.stdout:8/618: fsync d4/de/d26/d8d/dac/fb6 0 2024-09-19T06:40:44.703 INFO:tasks.workunit.client.1.smithi117.stdout:5/878: write d17/f89 [1507924,26957] 0 2024-09-19T06:40:44.704 INFO:tasks.workunit.client.1.smithi117.stdout:3/855: dwrite d0/d19/d2b/f9c [0,4194304] 0 2024-09-19T06:40:44.705 INFO:tasks.workunit.client.1.smithi117.stdout:0/814: mkdir d11/d13/d1b/d27/d54/dff/d10c 0 2024-09-19T06:40:44.706 INFO:tasks.workunit.client.0.smithi099.stdout:9/711: write dd/d47/d68/f9c [1682362,17685] 0 2024-09-19T06:40:44.707 INFO:tasks.workunit.client.0.smithi099.stdout:2/542: creat d1/d2/d5/fb8 x:0 0 0 2024-09-19T06:40:44.710 INFO:tasks.workunit.client.0.smithi099.stdout:1/650: unlink d0/d17/d32/c73 0 2024-09-19T06:40:44.710 INFO:tasks.workunit.client.0.smithi099.stdout:0/600: dwrite d0/db/d27/d5d/d87/da2/dbc/d1f/d4a/d61/f8c [0,4194304] 0 2024-09-19T06:40:44.711 INFO:tasks.workunit.client.0.smithi099.stdout:8/619: fdatasync d4/de/d26/d2b/f58 0 2024-09-19T06:40:44.711 INFO:tasks.workunit.client.0.smithi099.stdout:9/712: chown dd/d2c/d79/fbf 65 1 2024-09-19T06:40:44.712 INFO:tasks.workunit.client.0.smithi099.stdout:1/651: fsync d0/f82 0 2024-09-19T06:40:44.712 INFO:tasks.workunit.client.1.smithi117.stdout:5/879: rmdir d17/d1b/d3a/d3c/dcb/dde/d55 39 2024-09-19T06:40:44.712 INFO:tasks.workunit.client.0.smithi099.stdout:6/663: dwrite d1/d12/f39 [0,4194304] 0 2024-09-19T06:40:44.714 INFO:tasks.workunit.client.0.smithi099.stdout:8/620: fdatasync d4/d66/f71 0 2024-09-19T06:40:44.715 INFO:tasks.workunit.client.1.smithi117.stdout:9/854: rename d4/d1c/f108 to d4/d1c/d73/f124 0 2024-09-19T06:40:44.716 INFO:tasks.workunit.client.1.smithi117.stdout:3/856: mknod d0/d9/d1c/df8/c117 0 2024-09-19T06:40:44.717 INFO:tasks.workunit.client.0.smithi099.stdout:8/621: fdatasync d4/d5e/db4/fc3 0 2024-09-19T06:40:44.718 INFO:tasks.workunit.client.0.smithi099.stdout:5/860: dwrite d3/d14/fa1 [0,4194304] 0 2024-09-19T06:40:44.719 INFO:tasks.workunit.client.1.smithi117.stdout:3/857: fdatasync d0/d9/d4e/f98 0 2024-09-19T06:40:44.720 INFO:tasks.workunit.client.1.smithi117.stdout:3/858: fdatasync d0/d19/d2b/d8e/f8d 0 2024-09-19T06:40:44.721 INFO:tasks.workunit.client.0.smithi099.stdout:1/652: creat d0/d68/fd0 x:0 0 0 2024-09-19T06:40:44.722 INFO:tasks.workunit.client.1.smithi117.stdout:5/880: dwrite d17/d5c/fe1 [0,4194304] 0 2024-09-19T06:40:44.725 INFO:tasks.workunit.client.0.smithi099.stdout:6/664: mkdir d1/d12/dda 0 2024-09-19T06:40:44.726 INFO:tasks.workunit.client.0.smithi099.stdout:9/713: mkdir dd/d2c/d5c/d85/d8d/deb 0 2024-09-19T06:40:44.728 INFO:tasks.workunit.client.0.smithi099.stdout:9/714: write dd/d2c/d79/fd4 [468101,105765] 0 2024-09-19T06:40:44.730 INFO:tasks.workunit.client.1.smithi117.stdout:0/815: rename d11/d13/d1b/d67/d107 to d11/d13/d14/dbd/d10d 0 2024-09-19T06:40:44.730 INFO:tasks.workunit.client.1.smithi117.stdout:2/892: link d0/d7/d29/d35/d3d/d72/c6c d0/d7/d1e/d20/dbc/d116/c145 0 2024-09-19T06:40:44.731 INFO:tasks.workunit.client.0.smithi099.stdout:5/861: creat d3/d16/d2f/d34/d3c/d65/dec/f133 x:0 0 0 2024-09-19T06:40:44.731 INFO:tasks.workunit.client.1.smithi117.stdout:0/816: dread - d11/d13/f90 zero size 2024-09-19T06:40:44.732 INFO:tasks.workunit.client.1.smithi117.stdout:0/817: chown d11/d13/d7a/d104 1446795 1 2024-09-19T06:40:44.732 INFO:tasks.workunit.client.1.smithi117.stdout:2/893: chown d0/d7/d29/d35/dbd/d8d/f137 48692821 1 2024-09-19T06:40:44.732 INFO:tasks.workunit.client.1.smithi117.stdout:9/855: unlink d4/d1c/d7a/d16/lbd 0 2024-09-19T06:40:44.733 INFO:tasks.workunit.client.0.smithi099.stdout:6/665: mkdir d1/d5/d24/d2b/ddb 0 2024-09-19T06:40:44.733 INFO:tasks.workunit.client.1.smithi117.stdout:6/651: link d1/d14/f4c d1/d5/d8/d5e/d67/d98/fb8 0 2024-09-19T06:40:44.734 INFO:tasks.workunit.client.1.smithi117.stdout:5/881: mknod d17/d1b/d3a/d3c/dcb/dde/d65/d88/c12a 0 2024-09-19T06:40:44.735 INFO:tasks.workunit.client.1.smithi117.stdout:9/856: fsync d4/d1c/f35 0 2024-09-19T06:40:44.736 INFO:tasks.workunit.client.0.smithi099.stdout:8/622: creat d4/d11/d23/d92/fd4 x:0 0 0 2024-09-19T06:40:44.736 INFO:tasks.workunit.client.1.smithi117.stdout:0/818: rmdir d11/d13/d1b/d27/d37/d9d 39 2024-09-19T06:40:44.738 INFO:tasks.workunit.client.1.smithi117.stdout:5/882: write d17/d1b/d5d/d7d/f8a [1684727,97853] 0 2024-09-19T06:40:44.738 INFO:tasks.workunit.client.0.smithi099.stdout:1/653: symlink d0/d68/daf/ld1 0 2024-09-19T06:40:44.739 INFO:tasks.workunit.client.1.smithi117.stdout:2/894: symlink d0/d12/d32/d7d/l146 0 2024-09-19T06:40:44.739 INFO:tasks.workunit.client.0.smithi099.stdout:5/862: creat d3/d16/d2f/d34/da4/da5/f134 x:0 0 0 2024-09-19T06:40:44.740 INFO:tasks.workunit.client.1.smithi117.stdout:0/819: write d11/d13/d28/f5d [2052356,1373] 0 2024-09-19T06:40:44.740 INFO:tasks.workunit.client.0.smithi099.stdout:5/863: write d3/d1f/d4f/f5c [3551432,90585] 0 2024-09-19T06:40:44.740 INFO:tasks.workunit.client.0.smithi099.stdout:8/623: mkdir d4/d66/dd5 0 2024-09-19T06:40:44.744 INFO:tasks.workunit.client.1.smithi117.stdout:6/652: rename d1/d5/d8/d5e/d67/f8b to d1/d5/d8/db0/fb9 0 2024-09-19T06:40:44.744 INFO:tasks.workunit.client.0.smithi099.stdout:8/624: creat d4/de/d26/d8d/fd6 x:0 0 0 2024-09-19T06:40:44.745 INFO:tasks.workunit.client.1.smithi117.stdout:5/883: truncate d17/d5c/f90 4548383 0 2024-09-19T06:40:44.745 INFO:tasks.workunit.client.1.smithi117.stdout:0/820: symlink d11/d13/d1b/d27/d54/l10e 0 2024-09-19T06:40:44.746 INFO:tasks.workunit.client.0.smithi099.stdout:5/864: chown d3/d16/d2f/d34/d3c/de1/ce0 916005 1 2024-09-19T06:40:44.746 INFO:tasks.workunit.client.0.smithi099.stdout:5/865: read - d3/d16/f112 zero size 2024-09-19T06:40:44.747 INFO:tasks.workunit.client.1.smithi117.stdout:2/895: symlink d0/d7/d29/d35/d61/def/l147 0 2024-09-19T06:40:44.747 INFO:tasks.workunit.client.0.smithi099.stdout:5/866: fsync d3/d7/d90/fb5 0 2024-09-19T06:40:44.748 INFO:tasks.workunit.client.0.smithi099.stdout:1/654: creat d0/fd2 x:0 0 0 2024-09-19T06:40:44.749 INFO:tasks.workunit.client.1.smithi117.stdout:9/857: dwrite d4/d1c/d73/d93/fd5 [0,4194304] 0 2024-09-19T06:40:44.749 INFO:tasks.workunit.client.1.smithi117.stdout:6/653: mknod d1/d5/d32/d45/d7b/cba 0 2024-09-19T06:40:44.749 INFO:tasks.workunit.client.1.smithi117.stdout:3/859: dread d0/d3d/d48/f91 [0,4194304] 0 2024-09-19T06:40:44.749 INFO:tasks.workunit.client.1.smithi117.stdout:2/896: fsync d0/d64/dd9/f8b 0 2024-09-19T06:40:44.750 INFO:tasks.workunit.client.1.smithi117.stdout:5/884: fdatasync d17/d5c/f90 0 2024-09-19T06:40:44.752 INFO:tasks.workunit.client.1.smithi117.stdout:0/821: write d11/d13/d7a/fe3 [1887760,99215] 0 2024-09-19T06:40:44.753 INFO:tasks.workunit.client.0.smithi099.stdout:8/625: dwrite d4/de/d26/d2b/f58 [0,4194304] 0 2024-09-19T06:40:44.757 INFO:tasks.workunit.client.0.smithi099.stdout:5/867: creat d3/d16/d2f/d8c/dd9/d102/f135 x:0 0 0 2024-09-19T06:40:44.758 INFO:tasks.workunit.client.1.smithi117.stdout:2/897: creat d0/d7/d29/d35/dbd/f148 x:0 0 0 2024-09-19T06:40:44.758 INFO:tasks.workunit.client.1.smithi117.stdout:7/867: sync 2024-09-19T06:40:44.758 INFO:tasks.workunit.client.1.smithi117.stdout:8/809: sync 2024-09-19T06:40:44.758 INFO:tasks.workunit.client.1.smithi117.stdout:1/787: sync 2024-09-19T06:40:44.758 INFO:tasks.workunit.client.1.smithi117.stdout:6/654: mknod d1/d5/d8/d27/d77/da8/cbb 0 2024-09-19T06:40:44.759 INFO:tasks.workunit.client.1.smithi117.stdout:0/822: read - d11/d13/d14/d2c/d53/d7e/daa/dca/ff6 zero size 2024-09-19T06:40:44.760 INFO:tasks.workunit.client.1.smithi117.stdout:5/885: symlink d17/d1b/d3a/d3c/dcb/dde/d65/d88/dda/l12b 0 2024-09-19T06:40:44.761 INFO:tasks.workunit.client.0.smithi099.stdout:1/655: dwrite d0/db/fcd [0,4194304] 0 2024-09-19T06:40:44.763 INFO:tasks.workunit.client.0.smithi099.stdout:2/543: truncate d1/f15 5218681 0 2024-09-19T06:40:44.766 INFO:tasks.workunit.client.1.smithi117.stdout:2/898: stat d0/d12/d32/db5/f110 0 2024-09-19T06:40:44.767 INFO:tasks.workunit.client.0.smithi099.stdout:5/868: getdents d3/d7/d90/df4 0 2024-09-19T06:40:44.767 INFO:tasks.workunit.client.0.smithi099.stdout:0/601: write d0/db/d27/d5d/d87/da2/dbc/d1f/f24 [1894786,14778] 0 2024-09-19T06:40:44.769 INFO:tasks.workunit.client.0.smithi099.stdout:2/544: truncate d1/d2/d5/f81 1016075 0 2024-09-19T06:40:44.770 INFO:tasks.workunit.client.0.smithi099.stdout:9/715: write dd/d47/d40/f11 [2748287,112979] 0 2024-09-19T06:40:44.770 INFO:tasks.workunit.client.0.smithi099.stdout:8/626: dwrite d4/d11/d23/d4c/d93/fb9 [0,4194304] 0 2024-09-19T06:40:44.772 INFO:tasks.workunit.client.1.smithi117.stdout:3/860: dwrite d0/d8/d7f/f116 [0,4194304] 0 2024-09-19T06:40:44.776 INFO:tasks.workunit.client.1.smithi117.stdout:2/899: write d0/d64/dd9/f12e [1734885,63059] 0 2024-09-19T06:40:44.776 INFO:tasks.workunit.client.1.smithi117.stdout:9/858: dwrite d4/d1c/d5f/d103/f121 [0,4194304] 0 2024-09-19T06:40:44.776 INFO:tasks.workunit.client.1.smithi117.stdout:0/823: creat d11/d13/d28/d38/f10f x:0 0 0 2024-09-19T06:40:44.776 INFO:tasks.workunit.client.1.smithi117.stdout:6/655: rename d1/d5/d9a/da9/fb2 to d1/d5/d32/d45/fbc 0 2024-09-19T06:40:44.778 INFO:tasks.workunit.client.1.smithi117.stdout:1/788: unlink d3/d18/c72 0 2024-09-19T06:40:44.778 INFO:tasks.workunit.client.0.smithi099.stdout:5/869: dwrite d3/d16/d5e/db1/fc3 [0,4194304] 0 2024-09-19T06:40:44.779 INFO:tasks.workunit.client.0.smithi099.stdout:5/870: readlink d3/d2a/lba 0 2024-09-19T06:40:44.780 INFO:tasks.workunit.client.0.smithi099.stdout:2/545: mknod d1/d2/d4d/d55/da5/d36/cb9 0 2024-09-19T06:40:44.781 INFO:tasks.workunit.client.0.smithi099.stdout:9/716: chown dd/d2c/d5c/dc3/fe7 452295665 1 2024-09-19T06:40:44.781 INFO:tasks.workunit.client.0.smithi099.stdout:0/602: link d0/fa7 d0/db/d2f/fc3 0 2024-09-19T06:40:44.782 INFO:tasks.workunit.client.1.smithi117.stdout:0/824: chown d11/d13/d1b/d67/fbe 7 1 2024-09-19T06:40:44.783 INFO:tasks.workunit.client.0.smithi099.stdout:5/871: stat d3/d7/f10 0 2024-09-19T06:40:44.783 INFO:tasks.workunit.client.0.smithi099.stdout:8/627: fsync d4/de/d26/d2b/f52 0 2024-09-19T06:40:44.785 INFO:tasks.workunit.client.1.smithi117.stdout:3/861: rmdir d0/d3d/d48/dc7 39 2024-09-19T06:40:44.786 INFO:tasks.workunit.client.0.smithi099.stdout:1/656: link d0/d12/d13/d37/d41/fc6 d0/d17/d24/d5e/fd3 0 2024-09-19T06:40:44.787 INFO:tasks.workunit.client.0.smithi099.stdout:8/628: dread - d4/d5e/dbb/fc4 zero size 2024-09-19T06:40:44.791 INFO:tasks.workunit.client.1.smithi117.stdout:7/868: rename d1/d4a/d81/d24/d1c/d35/c53 to d1/d3f/d92/d115/c133 0 2024-09-19T06:40:44.791 INFO:tasks.workunit.client.1.smithi117.stdout:7/869: stat d1/d4a/d7c/ld4 0 2024-09-19T06:40:44.793 INFO:tasks.workunit.client.1.smithi117.stdout:1/789: rmdir d3/d18/d23/d74/d89/d9f 39 2024-09-19T06:40:44.796 INFO:tasks.workunit.client.0.smithi099.stdout:1/657: mkdir d0/d17/d24/d5e/d8a/dd4 0 2024-09-19T06:40:44.796 INFO:tasks.workunit.client.0.smithi099.stdout:8/629: getdents d4/d8a 0 2024-09-19T06:40:44.796 INFO:tasks.workunit.client.1.smithi117.stdout:9/859: link d4/d1c/d7a/d52/d8d/dc1/f107 d4/d1c/d54/da5/daf/f125 0 2024-09-19T06:40:44.798 INFO:tasks.workunit.client.1.smithi117.stdout:6/656: dwrite d1/d5/d32/d45/fbc [0,4194304] 0 2024-09-19T06:40:44.799 INFO:tasks.workunit.client.0.smithi099.stdout:1/658: mkdir d0/d17/d24/d3a/d58/d8d/dd5 0 2024-09-19T06:40:44.799 INFO:tasks.workunit.client.0.smithi099.stdout:5/872: dwrite d3/d16/d2f/d34/d3c/fc8 [0,4194304] 0 2024-09-19T06:40:44.801 INFO:tasks.workunit.client.1.smithi117.stdout:3/862: mknod d0/d9/d1c/c118 0 2024-09-19T06:40:44.803 INFO:tasks.workunit.client.1.smithi117.stdout:1/790: creat d3/d8e/db4/f119 x:0 0 0 2024-09-19T06:40:44.803 INFO:tasks.workunit.client.1.smithi117.stdout:3/863: dread - d0/d8/d7f/d40/d5b/ff6 zero size 2024-09-19T06:40:44.804 INFO:tasks.workunit.client.1.smithi117.stdout:3/864: chown d0/d8/d7f/d40/dc4/l2e 965 1 2024-09-19T06:40:44.807 INFO:tasks.workunit.client.0.smithi099.stdout:8/630: dwrite d4/de/d26/d8d/dac/fb1 [0,4194304] 0 2024-09-19T06:40:44.808 INFO:tasks.workunit.client.1.smithi117.stdout:6/657: write d1/d5/f56 [738356,61796] 0 2024-09-19T06:40:44.808 INFO:tasks.workunit.client.0.smithi099.stdout:5/873: mkdir d3/d14/d114/d136 0 2024-09-19T06:40:44.809 INFO:tasks.workunit.client.0.smithi099.stdout:8/631: rmdir d4/d11/d61 39 2024-09-19T06:40:44.811 INFO:tasks.workunit.client.1.smithi117.stdout:7/870: link d1/d4a/d81/d48/d5f/d82/fc3 d1/d4a/d81/d24/d26/d44/dfb/f134 0 2024-09-19T06:40:44.811 INFO:tasks.workunit.client.0.smithi099.stdout:5/874: write d3/d16/d2f/d8c/ffc [1024658,90724] 0 2024-09-19T06:40:44.813 INFO:tasks.workunit.client.1.smithi117.stdout:9/860: fdatasync d4/f24 0 2024-09-19T06:40:44.814 INFO:tasks.workunit.client.0.smithi099.stdout:8/632: dread - d4/d11/fd2 zero size 2024-09-19T06:40:44.814 INFO:tasks.workunit.client.1.smithi117.stdout:1/791: dwrite d3/d18/d56/fef [0,4194304] 0 2024-09-19T06:40:44.814 INFO:tasks.workunit.client.0.smithi099.stdout:5/875: mkdir d3/d137 0 2024-09-19T06:40:44.817 INFO:tasks.workunit.client.1.smithi117.stdout:2/900: rename d0/d7/d29/d35/l36 to d0/d7/d1e/l149 0 2024-09-19T06:40:44.819 INFO:tasks.workunit.client.0.smithi099.stdout:5/876: mkdir d3/d16/d7d/d138 0 2024-09-19T06:40:44.820 INFO:tasks.workunit.client.0.smithi099.stdout:8/633: read d4/d11/d38/fcd [347999,80987] 0 2024-09-19T06:40:44.822 INFO:tasks.workunit.client.1.smithi117.stdout:7/871: mknod d1/d4a/d7c/c135 0 2024-09-19T06:40:44.824 INFO:tasks.workunit.client.1.smithi117.stdout:9/861: fdatasync d4/d20/f53 0 2024-09-19T06:40:44.825 INFO:tasks.workunit.client.0.smithi099.stdout:8/634: mkdir d4/de/d26/d2b/dd7 0 2024-09-19T06:40:44.826 INFO:tasks.workunit.client.1.smithi117.stdout:1/792: rmdir d3/d18/d23/dde 39 2024-09-19T06:40:44.827 INFO:tasks.workunit.client.0.smithi099.stdout:2/546: write d1/f4f [632521,63981] 0 2024-09-19T06:40:44.827 INFO:tasks.workunit.client.1.smithi117.stdout:8/810: dwrite d1d/d2a/d3f/d4b/fa3 [0,4194304] 0 2024-09-19T06:40:44.828 INFO:tasks.workunit.client.0.smithi099.stdout:0/603: write d0/db/d2f/f30 [145021,82994] 0 2024-09-19T06:40:44.829 INFO:tasks.workunit.client.1.smithi117.stdout:6/658: symlink d1/d5/d8/d5e/d67/d98/da1/lbd 0 2024-09-19T06:40:44.831 INFO:tasks.workunit.client.0.smithi099.stdout:2/547: mknod d1/d2/d4d/d55/d79/cba 0 2024-09-19T06:40:44.833 INFO:tasks.workunit.client.1.smithi117.stdout:7/872: chown d1/d4a/d81/d24/d1c/d35/ld5 925 1 2024-09-19T06:40:44.834 INFO:tasks.workunit.client.1.smithi117.stdout:5/886: dwrite d17/d1b/d3a/fb0 [0,4194304] 0 2024-09-19T06:40:44.835 INFO:tasks.workunit.client.1.smithi117.stdout:1/793: chown d3/d22/d2f/l59 35712 1 2024-09-19T06:40:44.836 INFO:tasks.workunit.client.0.smithi099.stdout:0/604: rename d0/db/d27/d5d/d87/da2/dbc/d37/f9a to d0/db/d27/d5d/d87/da2/dbc/d1f/db4/fc4 0 2024-09-19T06:40:44.837 INFO:tasks.workunit.client.1.smithi117.stdout:1/794: fsync d3/d18/d23/fc2 0 2024-09-19T06:40:44.838 INFO:tasks.workunit.client.1.smithi117.stdout:2/901: link d0/d7/d1e/f10d d0/d7/d1e/d20/dbc/d116/f14a 0 2024-09-19T06:40:44.839 INFO:tasks.workunit.client.0.smithi099.stdout:0/605: mknod d0/db/d2f/cc5 0 2024-09-19T06:40:44.840 INFO:tasks.workunit.client.1.smithi117.stdout:6/659: write d1/d5/d8/db0/fb9 [856507,60924] 0 2024-09-19T06:40:44.840 INFO:tasks.workunit.client.1.smithi117.stdout:8/811: mkdir d1d/d1e/dbc/dc1/d105/d113 0 2024-09-19T06:40:44.841 INFO:tasks.workunit.client.1.smithi117.stdout:7/873: mknod d1/d4a/d7c/d95/db5/c136 0 2024-09-19T06:40:44.842 INFO:tasks.workunit.client.1.smithi117.stdout:5/887: fdatasync d17/d1b/d3a/d3c/d70/f79 0 2024-09-19T06:40:44.843 INFO:tasks.workunit.client.1.smithi117.stdout:7/874: chown d1/d4a/d81/d48 4560 1 2024-09-19T06:40:44.843 INFO:tasks.workunit.client.1.smithi117.stdout:8/812: write d1d/d2a/d3f/d73/ddd/f51 [2383110,79974] 0 2024-09-19T06:40:44.844 INFO:tasks.workunit.client.1.smithi117.stdout:9/862: rename d4/d1c/d7a/d52/d8d/dc1/f120 to d4/d17/dd7/d100/f126 0 2024-09-19T06:40:44.845 INFO:tasks.workunit.client.1.smithi117.stdout:1/795: read - d3/da1/fac zero size 2024-09-19T06:40:44.852 INFO:tasks.workunit.client.1.smithi117.stdout:8/813: mknod d1d/d2a/d3f/d73/ddd/c114 0 2024-09-19T06:40:44.853 INFO:tasks.workunit.client.0.smithi099.stdout:1/659: dwrite d0/d68/f1d [0,4194304] 0 2024-09-19T06:40:44.854 INFO:tasks.workunit.client.1.smithi117.stdout:9/863: readlink d4/d1c/d7a/l1b 0 2024-09-19T06:40:44.858 INFO:tasks.workunit.client.1.smithi117.stdout:2/902: link d0/d7/d29/d35/d3d/d72/ff8 d0/d7/d1e/d20/dbc/f14b 0 2024-09-19T06:40:44.859 INFO:tasks.workunit.client.1.smithi117.stdout:2/903: stat d0/d7/d1e/f31 0 2024-09-19T06:40:44.860 INFO:tasks.workunit.client.1.smithi117.stdout:2/904: fsync d0/d7/d58/fd3 0 2024-09-19T06:40:44.860 INFO:tasks.workunit.client.0.smithi099.stdout:1/660: creat d0/d17/fd6 x:0 0 0 2024-09-19T06:40:44.863 INFO:tasks.workunit.client.0.smithi099.stdout:5/877: dread d3/d14/fac [0,4194304] 0 2024-09-19T06:40:44.863 INFO:tasks.workunit.client.1.smithi117.stdout:3/865: dread d0/d8/d64/f104 [0,4194304] 0 2024-09-19T06:40:44.864 INFO:tasks.workunit.client.1.smithi117.stdout:6/660: link d1/d5/d8/d27/d77/f87 d1/d5/d8/db5/fbe 0 2024-09-19T06:40:44.865 INFO:tasks.workunit.client.0.smithi099.stdout:5/878: write d3/d16/d2f/f9a [5130683,36129] 0 2024-09-19T06:40:44.866 INFO:tasks.workunit.client.1.smithi117.stdout:5/888: truncate d17/d5c/f106 2304278 0 2024-09-19T06:40:44.867 INFO:tasks.workunit.client.1.smithi117.stdout:6/661: truncate d1/d5/d8/d5e/f96 752851 0 2024-09-19T06:40:44.868 INFO:tasks.workunit.client.0.smithi099.stdout:8/635: write d4/d11/f21 [637251,41519] 0 2024-09-19T06:40:44.868 INFO:tasks.workunit.client.1.smithi117.stdout:7/875: mknod d1/d4a/d81/d24/d1c/c137 0 2024-09-19T06:40:44.869 INFO:tasks.workunit.client.0.smithi099.stdout:1/661: dwrite d0/d17/d32/f6c [0,4194304] 0 2024-09-19T06:40:44.869 INFO:tasks.workunit.client.1.smithi117.stdout:7/876: chown d1/d4a/d81/d24/d49/dbf 262609163 1 2024-09-19T06:40:44.869 INFO:tasks.workunit.client.1.smithi117.stdout:7/877: chown d1/d4a/d81/d24/d1c/d35/d4f/d9b/f116 849 1 2024-09-19T06:40:44.870 INFO:tasks.workunit.client.1.smithi117.stdout:7/878: readlink d1/d4a/d7c/l131 0 2024-09-19T06:40:44.871 INFO:tasks.workunit.client.0.smithi099.stdout:2/548: dread d1/d2/d4d/f5e [0,4194304] 0 2024-09-19T06:40:44.871 INFO:tasks.workunit.client.0.smithi099.stdout:1/662: stat d0/d17/d32/d7b/f84 0 2024-09-19T06:40:44.871 INFO:tasks.workunit.client.0.smithi099.stdout:1/663: stat d0/db/f19 0 2024-09-19T06:40:44.872 INFO:tasks.workunit.client.1.smithi117.stdout:9/864: mknod d4/d1c/d7a/d52/d8d/dc1/c127 0 2024-09-19T06:40:44.875 INFO:tasks.workunit.client.0.smithi099.stdout:5/879: rename d3/d16/d2f/d34/da4/da5/dcd to d3/d16/d2f/d34/da4/da5/dce/de5/d139 0 2024-09-19T06:40:44.876 INFO:tasks.workunit.client.1.smithi117.stdout:2/905: symlink d0/d7/d1e/d20/dbc/d116/d98/l14c 0 2024-09-19T06:40:44.877 INFO:tasks.workunit.client.1.smithi117.stdout:7/879: dwrite d1/d4a/d81/d24/d1c/ff1 [0,4194304] 0 2024-09-19T06:40:44.879 INFO:tasks.workunit.client.0.smithi099.stdout:8/636: write d4/de/d26/f28 [3830789,73599] 0 2024-09-19T06:40:44.880 INFO:tasks.workunit.client.1.smithi117.stdout:3/866: rename d0/d8/d7f/d40/dc4/fe9 to d0/d9/d4e/d9e/ddc/f119 0 2024-09-19T06:40:44.880 INFO:tasks.workunit.client.0.smithi099.stdout:5/880: fdatasync d3/d16/d2f/d34/da4/f61 0 2024-09-19T06:40:44.881 INFO:tasks.workunit.client.1.smithi117.stdout:5/889: mkdir d17/d1b/d3a/d3c/dcb/dde/d65/d12c 0 2024-09-19T06:40:44.881 INFO:tasks.workunit.client.0.smithi099.stdout:5/881: chown d3/d16/d2f/d34/d10c 391929 1 2024-09-19T06:40:44.881 INFO:tasks.workunit.client.0.smithi099.stdout:1/664: link d0/fd2 d0/d17/d5b/fd7 0 2024-09-19T06:40:44.883 INFO:tasks.workunit.client.0.smithi099.stdout:8/637: rmdir d4/d66 39 2024-09-19T06:40:44.884 INFO:tasks.workunit.client.1.smithi117.stdout:6/662: creat d1/d14/fbf x:0 0 0 2024-09-19T06:40:44.884 INFO:tasks.workunit.client.0.smithi099.stdout:8/638: chown d4/de/d26/d8d/dac/fb6 13785 1 2024-09-19T06:40:44.885 INFO:tasks.workunit.client.1.smithi117.stdout:8/814: symlink d1d/d2a/d3f/l115 0 2024-09-19T06:40:44.886 INFO:tasks.workunit.client.0.smithi099.stdout:5/882: creat d3/d7/d90/da6/d10e/f13a x:0 0 0 2024-09-19T06:40:44.888 INFO:tasks.workunit.client.1.smithi117.stdout:9/865: write d4/d8/d6a/d82/dc8/fd6 [423019,99046] 0 2024-09-19T06:40:44.888 INFO:tasks.workunit.client.1.smithi117.stdout:2/906: dread - d0/d12/d32/da4/fdc zero size 2024-09-19T06:40:44.888 INFO:tasks.workunit.client.0.smithi099.stdout:1/665: mkdir d0/d17/d24/d3a/d58/d8d/dd8 0 2024-09-19T06:40:44.889 INFO:tasks.workunit.client.0.smithi099.stdout:2/549: write d1/d2/d4d/d55/da5/d18/d27/f48 [1468039,27208] 0 2024-09-19T06:40:44.889 INFO:tasks.workunit.client.0.smithi099.stdout:1/666: stat d0/d17/d5b/c5c 0 2024-09-19T06:40:44.891 INFO:tasks.workunit.client.1.smithi117.stdout:7/880: creat d1/d3f/d92/d115/f138 x:0 0 0 2024-09-19T06:40:44.891 INFO:tasks.workunit.client.0.smithi099.stdout:1/667: write d0/d12/d13/f89 [1896206,18592] 0 2024-09-19T06:40:44.892 INFO:tasks.workunit.client.1.smithi117.stdout:3/867: dwrite d0/d8/d7f/fcb [0,4194304] 0 2024-09-19T06:40:44.893 INFO:tasks.workunit.client.0.smithi099.stdout:8/639: creat d4/d11/d38/dc0/fd8 x:0 0 0 2024-09-19T06:40:44.894 INFO:tasks.workunit.client.0.smithi099.stdout:2/550: readlink d1/d2/d4d/d55/da5/d18/d2d/d88/lb3 0 2024-09-19T06:40:44.895 INFO:tasks.workunit.client.1.smithi117.stdout:1/796: write d3/d18/d23/f7f [1587713,44057] 0 2024-09-19T06:40:44.896 INFO:tasks.workunit.client.0.smithi099.stdout:1/668: mknod d0/d17/d24/d3a/d58/d8d/dae/cd9 0 2024-09-19T06:40:44.897 INFO:tasks.workunit.client.0.smithi099.stdout:1/669: write d0/d12/d13/f2b [12332758,127767] 0 2024-09-19T06:40:44.897 INFO:tasks.workunit.client.0.smithi099.stdout:8/640: symlink d4/de/d26/d2b/dba/ld9 0 2024-09-19T06:40:44.898 INFO:tasks.workunit.client.1.smithi117.stdout:2/907: rmdir d0/d7/d29/d35/dbd/d138 39 2024-09-19T06:40:44.899 INFO:tasks.workunit.client.0.smithi099.stdout:1/670: chown d0/d12/d54/f7e 1128452223 1 2024-09-19T06:40:44.899 INFO:tasks.workunit.client.0.smithi099.stdout:2/551: fdatasync d1/d2/d5/f40 0 2024-09-19T06:40:44.899 INFO:tasks.workunit.client.1.smithi117.stdout:1/797: chown d3/d18/d23/f103 0 1 2024-09-19T06:40:44.901 INFO:tasks.workunit.client.0.smithi099.stdout:1/671: write d0/d17/d24/f46 [396941,31510] 0 2024-09-19T06:40:44.909 INFO:tasks.workunit.client.1.smithi117.stdout:5/890: dwrite d17/d1b/d3a/d3c/dcb/dde/d55/dd1/d119/f123 [0,4194304] 0 2024-09-19T06:40:44.909 INFO:tasks.workunit.client.1.smithi117.stdout:3/868: read d0/d3d/d48/d77/fb2 [489512,87916] 0 2024-09-19T06:40:44.910 INFO:tasks.workunit.client.0.smithi099.stdout:5/883: dwrite d3/d7/ff [4194304,4194304] 0 2024-09-19T06:40:44.911 INFO:tasks.workunit.client.1.smithi117.stdout:6/663: dread d1/f64 [0,4194304] 0 2024-09-19T06:40:44.912 INFO:tasks.workunit.client.0.smithi099.stdout:8/641: dwrite d4/de/d26/d2b/f32 [0,4194304] 0 2024-09-19T06:40:44.912 INFO:tasks.workunit.client.1.smithi117.stdout:7/881: dwrite d1/d4a/d81/d24/d26/d44/dd2/f119 [0,4194304] 0 2024-09-19T06:40:44.915 INFO:tasks.workunit.client.1.smithi117.stdout:8/815: truncate d1d/d1e/f2c 3822741 0 2024-09-19T06:40:44.916 INFO:tasks.workunit.client.1.smithi117.stdout:1/798: getdents d3/da1/da5 0 2024-09-19T06:40:44.917 INFO:tasks.workunit.client.1.smithi117.stdout:5/891: write d17/d1b/d3a/d3c/dcb/dde/d55/f98 [5289018,9569] 0 2024-09-19T06:40:44.918 INFO:tasks.workunit.client.0.smithi099.stdout:1/672: write d0/d12/d13/f22 [1311477,55925] 0 2024-09-19T06:40:44.920 INFO:tasks.workunit.client.1.smithi117.stdout:0/825: sync 2024-09-19T06:40:44.923 INFO:tasks.workunit.client.0.smithi099.stdout:1/673: unlink d0/d12/c36 0 2024-09-19T06:40:44.923 INFO:tasks.workunit.client.0.smithi099.stdout:8/642: getdents d4/d11/d23 0 2024-09-19T06:40:44.924 INFO:tasks.workunit.client.1.smithi117.stdout:6/664: creat d1/d14/fc0 x:0 0 0 2024-09-19T06:40:44.925 INFO:tasks.workunit.client.1.smithi117.stdout:1/799: chown d3/d18/d23/f107 2 1 2024-09-19T06:40:44.926 INFO:tasks.workunit.client.1.smithi117.stdout:9/866: dwrite d4/d1c/d36/f6c [4194304,4194304] 0 2024-09-19T06:40:44.929 INFO:tasks.workunit.client.0.smithi099.stdout:1/674: rename d0/d17/d32/f50 to d0/d17/d24/d3a/da4/fda 0 2024-09-19T06:40:44.930 INFO:tasks.workunit.client.0.smithi099.stdout:1/675: read - d0/d68/fc2 zero size 2024-09-19T06:40:44.930 INFO:tasks.workunit.client.1.smithi117.stdout:3/869: dwrite d0/d8/d7f/f7a [0,4194304] 0 2024-09-19T06:40:44.931 INFO:tasks.workunit.client.1.smithi117.stdout:0/826: mknod d11/d13/d1b/d67/c110 0 2024-09-19T06:40:44.932 INFO:tasks.workunit.client.1.smithi117.stdout:1/800: chown d3/f13 1 1 2024-09-19T06:40:44.932 INFO:tasks.workunit.client.0.smithi099.stdout:1/676: truncate d0/d17/d24/f6e 681489 0 2024-09-19T06:40:44.933 INFO:tasks.workunit.client.0.smithi099.stdout:2/552: dread d1/d2/d4d/d55/da5/d18/d2d/f62 [0,4194304] 0 2024-09-19T06:40:44.936 INFO:tasks.workunit.client.1.smithi117.stdout:0/827: symlink d11/d13/d1b/d27/d37/da9/l111 0 2024-09-19T06:40:44.939 INFO:tasks.workunit.client.1.smithi117.stdout:3/870: rmdir d0/d9/d1c/de3 0 2024-09-19T06:40:44.939 INFO:tasks.workunit.client.1.smithi117.stdout:1/801: dwrite d3/d18/d56/fa8 [0,4194304] 0 2024-09-19T06:40:44.941 INFO:tasks.workunit.client.1.smithi117.stdout:3/871: chown d0/d9/d4e/d9e/fcd 24928046 1 2024-09-19T06:40:44.941 INFO:tasks.workunit.client.1.smithi117.stdout:0/828: symlink d11/d13/d14/l112 0 2024-09-19T06:40:44.941 INFO:tasks.workunit.client.1.smithi117.stdout:3/872: chown d0/d8/d64 57246993 1 2024-09-19T06:40:44.942 INFO:tasks.workunit.client.1.smithi117.stdout:1/802: creat d3/d110/f11a x:0 0 0 2024-09-19T06:40:44.945 INFO:tasks.workunit.client.1.smithi117.stdout:0/829: getdents d11/d13/d1b/d27/d54 0 2024-09-19T06:40:44.950 INFO:tasks.workunit.client.1.smithi117.stdout:0/830: mkdir d11/d13/d14/d2c/d53/d103/d113 0 2024-09-19T06:40:44.951 INFO:tasks.workunit.client.1.smithi117.stdout:3/873: dwrite d0/d9/d1c/d53/fd9 [0,4194304] 0 2024-09-19T06:40:44.952 INFO:tasks.workunit.client.1.smithi117.stdout:3/874: dread - d0/d9/d4e/d9e/fb8 zero size 2024-09-19T06:40:44.954 INFO:tasks.workunit.client.1.smithi117.stdout:3/875: symlink d0/d9/d4e/d9e/ddc/l11a 0 2024-09-19T06:40:44.954 INFO:tasks.workunit.client.0.smithi099.stdout:8/643: write d4/de/d26/d2b/f52 [1385367,118034] 0 2024-09-19T06:40:44.956 INFO:tasks.workunit.client.0.smithi099.stdout:8/644: write d4/de/d14/fa6 [398010,48979] 0 2024-09-19T06:40:44.956 INFO:tasks.workunit.client.1.smithi117.stdout:3/876: readlink d0/d8/l74 0 2024-09-19T06:40:44.958 INFO:tasks.workunit.client.0.smithi099.stdout:8/645: truncate d4/de/d26/d8d/dac/fb6 768296 0 2024-09-19T06:40:44.960 INFO:tasks.workunit.client.0.smithi099.stdout:8/646: mkdir d4/d8a/dda 0 2024-09-19T06:40:44.963 INFO:tasks.workunit.client.0.smithi099.stdout:8/647: unlink d4/d66/fca 0 2024-09-19T06:40:44.967 INFO:tasks.workunit.client.1.smithi117.stdout:5/892: write d17/d1b/d3a/d3c/dcb/dde/d65/d88/de5/d3b/daf/fd7 [536251,85640] 0 2024-09-19T06:40:44.967 INFO:tasks.workunit.client.0.smithi099.stdout:8/648: mknod d4/d8a/dda/cdb 0 2024-09-19T06:40:44.967 INFO:tasks.workunit.client.1.smithi117.stdout:6/665: truncate d1/d3d/f5a 236574 0 2024-09-19T06:40:44.968 INFO:tasks.workunit.client.1.smithi117.stdout:9/867: dread d4/d1c/d36/d37/fde [0,4194304] 0 2024-09-19T06:40:44.969 INFO:tasks.workunit.client.1.smithi117.stdout:6/666: write d1/d5/d8/f5d [128393,57485] 0 2024-09-19T06:40:44.971 INFO:tasks.workunit.client.1.smithi117.stdout:1/803: dread d3/d18/d23/d74/fb6 [0,4194304] 0 2024-09-19T06:40:44.973 INFO:tasks.workunit.client.1.smithi117.stdout:1/804: truncate d3/d18/d23/d74/fb6 4337072 0 2024-09-19T06:40:44.973 INFO:tasks.workunit.client.0.smithi099.stdout:8/649: read d4/f30 [2797463,43650] 0 2024-09-19T06:40:44.974 INFO:tasks.workunit.client.0.smithi099.stdout:1/677: dread d0/f21 [0,4194304] 0 2024-09-19T06:40:44.975 INFO:tasks.workunit.client.1.smithi117.stdout:0/831: write d11/d13/d28/d38/d5b/fd0 [1700038,40930] 0 2024-09-19T06:40:44.975 INFO:tasks.workunit.client.0.smithi099.stdout:8/650: dread - d4/d11/d38/dc0/fd8 zero size 2024-09-19T06:40:44.975 INFO:tasks.workunit.client.0.smithi099.stdout:8/651: chown d4/cc 418901091 1 2024-09-19T06:40:44.976 INFO:tasks.workunit.client.1.smithi117.stdout:5/893: rmdir d17/d1b/d120 0 2024-09-19T06:40:44.977 INFO:tasks.workunit.client.1.smithi117.stdout:0/832: stat d11/d13/d14/d2c/d35/d3e/f74 0 2024-09-19T06:40:44.979 INFO:tasks.workunit.client.0.smithi099.stdout:8/652: mknod d4/de/d1c/cdc 0 2024-09-19T06:40:44.981 INFO:tasks.workunit.client.1.smithi117.stdout:9/868: rename d4/d1c/d54/l81 to d4/d1c/d7a/l128 0 2024-09-19T06:40:44.982 INFO:tasks.workunit.client.0.smithi099.stdout:8/653: read d4/d11/d38/fcd [2456329,34455] 0 2024-09-19T06:40:44.983 INFO:tasks.workunit.client.1.smithi117.stdout:1/805: dwrite d3/da1/db1/f95 [0,4194304] 0 2024-09-19T06:40:44.984 INFO:tasks.workunit.client.0.smithi099.stdout:1/678: dwrite d0/d2d/f43 [4194304,4194304] 0 2024-09-19T06:40:44.985 INFO:tasks.workunit.client.0.smithi099.stdout:8/654: chown d4/de/d26 1512 1 2024-09-19T06:40:44.988 INFO:tasks.workunit.client.0.smithi099.stdout:8/655: stat d4/de/d26/d2b/f82 0 2024-09-19T06:40:44.989 INFO:tasks.workunit.client.1.smithi117.stdout:3/877: dwrite d0/d9/f90 [0,4194304] 0 2024-09-19T06:40:44.990 INFO:tasks.workunit.client.0.smithi099.stdout:8/656: truncate d4/d11/d23/f4b 1690351 0 2024-09-19T06:40:44.991 INFO:tasks.workunit.client.1.smithi117.stdout:1/806: chown d3/d22/d2f/f60 46 1 2024-09-19T06:40:44.992 INFO:tasks.workunit.client.1.smithi117.stdout:5/894: creat d17/d1b/d3a/d3c/dcb/dde/d65/d88/de5/f12d x:0 0 0 2024-09-19T06:40:44.996 INFO:tasks.workunit.client.1.smithi117.stdout:0/833: mknod d11/d13/d14/d2c/d53/d103/d113/c114 0 2024-09-19T06:40:44.997 INFO:tasks.workunit.client.1.smithi117.stdout:1/807: write d3/d8e/db4/f119 [971803,48221] 0 2024-09-19T06:40:44.997 INFO:tasks.workunit.client.1.smithi117.stdout:6/667: dwrite d1/d5/d8/db5/fbe [0,4194304] 0 2024-09-19T06:40:44.998 INFO:tasks.workunit.client.0.smithi099.stdout:8/657: rename d4/de/d26/d8d/dac to d4/d11/d23/d4c/ddd 0 2024-09-19T06:40:44.999 INFO:tasks.workunit.client.0.smithi099.stdout:8/658: chown d4/d11/d23/d4c/d93/cd3 34 1 2024-09-19T06:40:45.000 INFO:tasks.workunit.client.1.smithi117.stdout:3/878: creat d0/d9/d1c/d53/f11b x:0 0 0 2024-09-19T06:40:45.000 INFO:tasks.workunit.client.1.smithi117.stdout:5/895: creat d17/d1b/d5d/d86/f12e x:0 0 0 2024-09-19T06:40:45.002 INFO:tasks.workunit.client.1.smithi117.stdout:1/808: read - d3/d22/f88 zero size 2024-09-19T06:40:45.002 INFO:tasks.workunit.client.1.smithi117.stdout:6/668: readlink d1/d5/l61 0 2024-09-19T06:40:45.003 INFO:tasks.workunit.client.1.smithi117.stdout:0/834: chown d11/d13/d14/d2c/d35/d3e/fcb 1315836 1 2024-09-19T06:40:45.003 INFO:tasks.workunit.client.1.smithi117.stdout:3/879: chown d0/d19/d2b/d8e/ddb 15127 1 2024-09-19T06:40:45.006 INFO:tasks.workunit.client.1.smithi117.stdout:6/669: write d1/d3/f4b [1770835,106689] 0 2024-09-19T06:40:45.006 INFO:tasks.workunit.client.1.smithi117.stdout:9/869: dwrite d4/d20/f10a [0,4194304] 0 2024-09-19T06:40:45.007 INFO:tasks.workunit.client.1.smithi117.stdout:5/896: chown d17/d1b/d3a/d3c/dcb/dde/d65/d88/de5/d3b/ff4 328 1 2024-09-19T06:40:45.007 INFO:tasks.workunit.client.1.smithi117.stdout:1/809: chown d3/d18/d23/fe6 156 1 2024-09-19T06:40:45.008 INFO:tasks.workunit.client.1.smithi117.stdout:0/835: dread - d11/d13/d14/d2c/d53/d7e/daa/dca/ffc zero size 2024-09-19T06:40:45.010 INFO:tasks.workunit.client.1.smithi117.stdout:6/670: mkdir d1/d5/d32/dc1 0 2024-09-19T06:40:45.012 INFO:tasks.workunit.client.1.smithi117.stdout:9/870: chown d4/d1c/d5f/dbc/lfb 7 1 2024-09-19T06:40:45.013 INFO:tasks.workunit.client.1.smithi117.stdout:9/871: chown d4/d17/f97 57 1 2024-09-19T06:40:45.014 INFO:tasks.workunit.client.1.smithi117.stdout:0/836: creat d11/d13/d28/d38/d5b/f115 x:0 0 0 2024-09-19T06:40:45.014 INFO:tasks.workunit.client.1.smithi117.stdout:9/872: truncate d4/d20/f45 2317501 0 2024-09-19T06:40:45.015 INFO:tasks.workunit.client.1.smithi117.stdout:1/810: creat d3/da1/f11b x:0 0 0 2024-09-19T06:40:45.016 INFO:tasks.workunit.client.1.smithi117.stdout:6/671: mkdir d1/d5/dc2 0 2024-09-19T06:40:45.017 INFO:tasks.workunit.client.1.smithi117.stdout:5/897: getdents d17/d1b/d3a/d3c 0 2024-09-19T06:40:45.018 INFO:tasks.workunit.client.1.smithi117.stdout:9/873: stat d4/d1c/d7a/d52/d8d/dc1/dc6 0 2024-09-19T06:40:45.019 INFO:tasks.workunit.client.1.smithi117.stdout:9/874: dread - d4/d8/f116 zero size 2024-09-19T06:40:45.019 INFO:tasks.workunit.client.1.smithi117.stdout:1/811: unlink d3/d18/d23/f52 0 2024-09-19T06:40:45.020 INFO:tasks.workunit.client.1.smithi117.stdout:6/672: mkdir d1/d5/d8/dc3 0 2024-09-19T06:40:45.020 INFO:tasks.workunit.client.1.smithi117.stdout:1/812: write d3/f5c [4882361,121772] 0 2024-09-19T06:40:45.022 INFO:tasks.workunit.client.1.smithi117.stdout:9/875: fsync d4/d1c/d46/f88 0 2024-09-19T06:40:45.024 INFO:tasks.workunit.client.1.smithi117.stdout:9/876: read - d4/d1c/f94 zero size 2024-09-19T06:40:45.025 INFO:tasks.workunit.client.1.smithi117.stdout:5/898: dread d17/d1b/d3a/d3c/dcb/dde/d65/d88/de5/d3b/daf/fd7 [0,4194304] 0 2024-09-19T06:40:45.027 INFO:tasks.workunit.client.1.smithi117.stdout:1/813: rmdir d3/d18/d91/df8 0 2024-09-19T06:40:45.027 INFO:tasks.workunit.client.1.smithi117.stdout:6/673: dread d1/d5/d32/d45/fbc [0,4194304] 0 2024-09-19T06:40:45.029 INFO:tasks.workunit.client.1.smithi117.stdout:1/814: truncate d3/d22/f7c 484243 0 2024-09-19T06:40:45.029 INFO:tasks.workunit.client.1.smithi117.stdout:6/674: read d1/d5/d8/f4f [198748,25536] 0 2024-09-19T06:40:45.031 INFO:tasks.workunit.client.1.smithi117.stdout:6/675: write d1/d3/f17 [3851005,114793] 0 2024-09-19T06:40:45.031 INFO:tasks.workunit.client.0.smithi099.stdout:8/659: dwrite d4/de/d10/f68 [0,4194304] 0 2024-09-19T06:40:45.032 INFO:tasks.workunit.client.1.smithi117.stdout:5/899: creat d17/d1b/d3a/d3c/dcb/dde/f12f x:0 0 0 2024-09-19T06:40:45.032 INFO:tasks.workunit.client.1.smithi117.stdout:3/880: write d0/d9/f9a [630729,23589] 0 2024-09-19T06:40:45.035 INFO:tasks.workunit.client.1.smithi117.stdout:5/900: write d17/d1b/d3a/d3c/fd8 [254965,71064] 0 2024-09-19T06:40:45.035 INFO:tasks.workunit.client.1.smithi117.stdout:6/676: symlink d1/d5/d8/d5e/d6d/lc4 0 2024-09-19T06:40:45.039 INFO:tasks.workunit.client.0.smithi099.stdout:8/660: dwrite d4/d66/fbd [0,4194304] 0 2024-09-19T06:40:45.040 INFO:tasks.workunit.client.1.smithi117.stdout:5/901: dwrite d17/d1b/ff0 [0,4194304] 0 2024-09-19T06:40:45.044 INFO:tasks.workunit.client.1.smithi117.stdout:3/881: unlink d0/d9/d1c/d53/f11b 0 2024-09-19T06:40:45.044 INFO:tasks.workunit.client.1.smithi117.stdout:1/815: symlink d3/d18/d23/d74/d89/d9f/d113/l11c 0 2024-09-19T06:40:45.046 INFO:tasks.workunit.client.1.smithi117.stdout:5/902: creat d17/d1b/d3a/d3c/d46/d10f/f130 x:0 0 0 2024-09-19T06:40:45.048 INFO:tasks.workunit.client.1.smithi117.stdout:3/882: dread - d0/d3d/d48/dc7/f102 zero size 2024-09-19T06:40:45.050 INFO:tasks.workunit.client.1.smithi117.stdout:6/677: creat d1/d5/d8/db0/fc5 x:0 0 0 2024-09-19T06:40:45.051 INFO:tasks.workunit.client.1.smithi117.stdout:1/816: read d3/d18/d23/d51/fa6 [143557,2038] 0 2024-09-19T06:40:45.052 INFO:tasks.workunit.client.1.smithi117.stdout:5/903: creat d17/d1b/d3a/d3c/d46/f131 x:0 0 0 2024-09-19T06:40:45.056 INFO:tasks.workunit.client.1.smithi117.stdout:6/678: symlink d1/d5/d8/db0/lc6 0 2024-09-19T06:40:45.057 INFO:tasks.workunit.client.0.smithi099.stdout:8/661: unlink d4/d11/d23/f4b 0 2024-09-19T06:40:45.058 INFO:tasks.workunit.client.0.smithi099.stdout:8/662: mkdir d4/d8a/dde 0 2024-09-19T06:40:45.060 INFO:tasks.workunit.client.1.smithi117.stdout:6/679: stat d1/d5/d8/d27/l2a 0 2024-09-19T06:40:45.061 INFO:tasks.workunit.client.1.smithi117.stdout:9/877: dwrite d4/d1c/d36/fd3 [0,4194304] 0 2024-09-19T06:40:45.065 INFO:tasks.workunit.client.1.smithi117.stdout:1/817: dwrite d3/d18/d23/d74/f111 [0,4194304] 0 2024-09-19T06:40:45.065 INFO:tasks.workunit.client.1.smithi117.stdout:9/878: symlink d4/d17/l129 0 2024-09-19T06:40:45.065 INFO:tasks.workunit.client.1.smithi117.stdout:5/904: dwrite d17/d5c/fe1 [0,4194304] 0 2024-09-19T06:40:45.067 INFO:tasks.workunit.client.1.smithi117.stdout:1/818: dread - d3/d99/dd7/f115 zero size 2024-09-19T06:40:45.068 INFO:tasks.workunit.client.1.smithi117.stdout:6/680: mknod d1/d5/d8/d5e/d67/d98/da1/cc7 0 2024-09-19T06:40:45.068 INFO:tasks.workunit.client.1.smithi117.stdout:1/819: write d3/d8e/fb8 [644976,79784] 0 2024-09-19T06:40:45.069 INFO:tasks.workunit.client.1.smithi117.stdout:1/820: chown d3/d18/fba 56 1 2024-09-19T06:40:45.069 INFO:tasks.workunit.client.1.smithi117.stdout:5/905: dread - d17/ff7 zero size 2024-09-19T06:40:45.070 INFO:tasks.workunit.client.1.smithi117.stdout:9/879: creat d4/d1c/d46/f12a x:0 0 0 2024-09-19T06:40:45.070 INFO:tasks.workunit.client.1.smithi117.stdout:1/821: fsync d3/d99/dd7/f115 0 2024-09-19T06:40:45.073 INFO:tasks.workunit.client.1.smithi117.stdout:5/906: mkdir d17/d1b/d3a/d3c/dcb/dde/d55/d132 0 2024-09-19T06:40:45.074 INFO:tasks.workunit.client.1.smithi117.stdout:1/822: dread - d3/d18/d91/faa zero size 2024-09-19T06:40:45.076 INFO:tasks.workunit.client.1.smithi117.stdout:3/883: write d0/f14 [821507,48286] 0 2024-09-19T06:40:45.082 INFO:tasks.workunit.client.1.smithi117.stdout:5/907: dwrite d17/d1b/d3a/d3c/dcb/dde/f12f [0,4194304] 0 2024-09-19T06:40:45.086 INFO:tasks.workunit.client.1.smithi117.stdout:1/823: truncate d3/d18/d23/d51/f8b 5574 0 2024-09-19T06:40:45.086 INFO:tasks.workunit.client.1.smithi117.stdout:9/880: link d4/d1c/l92 d4/d17/dd7/d100/l12b 0 2024-09-19T06:40:45.088 INFO:tasks.workunit.client.1.smithi117.stdout:9/881: chown d4/d8/lc 0 1 2024-09-19T06:40:45.090 INFO:tasks.workunit.client.1.smithi117.stdout:1/824: mkdir d3/da1/d11d 0 2024-09-19T06:40:45.090 INFO:tasks.workunit.client.1.smithi117.stdout:9/882: read d4/d1c/d36/f77 [560641,8091] 0 2024-09-19T06:40:45.092 INFO:tasks.workunit.client.1.smithi117.stdout:5/908: dread d17/d1b/d3a/d3c/dcb/dde/f12f [0,4194304] 0 2024-09-19T06:40:45.093 INFO:tasks.workunit.client.1.smithi117.stdout:9/883: unlink d4/d1c/d5f/f80 0 2024-09-19T06:40:45.093 INFO:tasks.workunit.client.1.smithi117.stdout:5/909: write d17/d5c/f69 [4259010,62024] 0 2024-09-19T06:40:45.094 INFO:tasks.workunit.client.0.smithi099.stdout:8/663: dwrite f2 [0,4194304] 0 2024-09-19T06:40:45.095 INFO:tasks.workunit.client.1.smithi117.stdout:9/884: truncate d4/d17/dd7/f112 337363 0 2024-09-19T06:40:45.096 INFO:tasks.workunit.client.1.smithi117.stdout:5/910: write d17/d1b/d5d/d86/fc5 [823025,119533] 0 2024-09-19T06:40:45.097 INFO:tasks.workunit.client.1.smithi117.stdout:5/911: chown d17/d5c/db8/le4 15160589 1 2024-09-19T06:40:45.099 INFO:tasks.workunit.client.1.smithi117.stdout:5/912: write d17/d1b/d3a/d3c/dcb/dde/d65/fff [2541578,110631] 0 2024-09-19T06:40:45.101 INFO:tasks.workunit.client.1.smithi117.stdout:9/885: mkdir d4/d1c/d7a/d69/d12c 0 2024-09-19T06:40:45.102 INFO:tasks.workunit.client.1.smithi117.stdout:9/886: chown d4/d17/l32 47877 1 2024-09-19T06:40:45.102 INFO:tasks.workunit.client.1.smithi117.stdout:6/681: dread d1/d5/d8/d5e/d6d/f79 [0,4194304] 0 2024-09-19T06:40:45.103 INFO:tasks.workunit.client.1.smithi117.stdout:5/913: creat d17/d1b/d5d/f133 x:0 0 0 2024-09-19T06:40:45.103 INFO:tasks.workunit.client.1.smithi117.stdout:9/887: fsync d4/d1c/d36/d37/faa 0 2024-09-19T06:40:45.104 INFO:tasks.workunit.client.1.smithi117.stdout:5/914: chown d17/d1b/d3a/d3c/d46/f131 6146 1 2024-09-19T06:40:45.106 INFO:tasks.workunit.client.1.smithi117.stdout:9/888: write d4/d1c/d46/f6b [4684056,113522] 0 2024-09-19T06:40:45.106 INFO:tasks.workunit.client.1.smithi117.stdout:5/915: mknod d17/d1b/d5d/d86/c134 0 2024-09-19T06:40:45.107 INFO:tasks.workunit.client.1.smithi117.stdout:9/889: stat d4/d17/l32 0 2024-09-19T06:40:45.108 INFO:tasks.workunit.client.1.smithi117.stdout:5/916: read d17/d1b/d3a/d3c/dcb/dde/f32 [987172,80707] 0 2024-09-19T06:40:45.109 INFO:tasks.workunit.client.1.smithi117.stdout:9/890: mkdir d4/d8/d12d 0 2024-09-19T06:40:45.111 INFO:tasks.workunit.client.1.smithi117.stdout:9/891: mknod d4/d1c/d73/d9a/c12e 0 2024-09-19T06:40:45.114 INFO:tasks.workunit.client.1.smithi117.stdout:9/892: link d4/d20/f45 d4/d1c/d7a/d52/f12f 0 2024-09-19T06:40:45.114 INFO:tasks.workunit.client.1.smithi117.stdout:5/917: dwrite d17/d1b/d3a/d3c/dcb/dde/d55/dd1/d119/f8f [0,4194304] 0 2024-09-19T06:40:45.117 INFO:tasks.workunit.client.1.smithi117.stdout:9/893: write d4/d1c/d46/fdc [6784859,37552] 0 2024-09-19T06:40:45.119 INFO:tasks.workunit.client.1.smithi117.stdout:9/894: mknod d4/d1c/d7a/d52/d8d/c130 0 2024-09-19T06:40:45.120 INFO:tasks.workunit.client.1.smithi117.stdout:9/895: stat d4/d1c/d54/dd8/dae/db4 0 2024-09-19T06:40:45.122 INFO:tasks.workunit.client.1.smithi117.stdout:9/896: creat d4/d1c/d54/dd8/dae/db4/f131 x:0 0 0 2024-09-19T06:40:45.124 INFO:tasks.workunit.client.1.smithi117.stdout:9/897: readlink d4/d1c/d7a/d16/l34 0 2024-09-19T06:40:45.125 INFO:tasks.workunit.client.1.smithi117.stdout:9/898: read d4/d1c/f28 [1297298,69381] 0 2024-09-19T06:40:45.127 INFO:tasks.workunit.client.1.smithi117.stdout:9/899: mknod d4/d1c/d5f/d103/c132 0 2024-09-19T06:40:45.127 INFO:tasks.workunit.client.1.smithi117.stdout:9/900: fdatasync d4/d1c/d73/d9a/fc4 0 2024-09-19T06:40:45.129 INFO:tasks.workunit.client.1.smithi117.stdout:9/901: mkdir d4/d1c/d7a/d69/d12c/d133 0 2024-09-19T06:40:45.132 INFO:tasks.workunit.client.0.smithi099.stdout:8/664: truncate d4/d11/d23/d3f/f9f 1628679 0 2024-09-19T06:40:45.135 INFO:tasks.workunit.client.0.smithi099.stdout:8/665: rename d4/de/d14/c48 to d4/de/cdf 0 2024-09-19T06:40:45.135 INFO:tasks.workunit.client.1.smithi117.stdout:2/908: sync 2024-09-19T06:40:45.137 INFO:tasks.workunit.client.1.smithi117.stdout:9/902: getdents d4/d1c/d7a/d16 0 2024-09-19T06:40:45.137 INFO:tasks.workunit.client.1.smithi117.stdout:3/884: write d0/d19/f69 [117752,18188] 0 2024-09-19T06:40:45.138 INFO:tasks.workunit.client.0.smithi099.stdout:8/666: truncate d4/de/d26/d2b/f80 3809130 0 2024-09-19T06:40:45.139 INFO:tasks.workunit.client.1.smithi117.stdout:1/825: write d3/d18/d23/d74/f75 [5194771,93852] 0 2024-09-19T06:40:45.139 INFO:tasks.workunit.client.1.smithi117.stdout:2/909: unlink d0/d7/d1e/d20/c42 0 2024-09-19T06:40:45.141 INFO:tasks.workunit.client.1.smithi117.stdout:3/885: mkdir d0/d9/d1c/df8/d11c 0 2024-09-19T06:40:45.142 INFO:tasks.workunit.client.1.smithi117.stdout:1/826: creat d3/d110/f11e x:0 0 0 2024-09-19T06:40:45.143 INFO:tasks.workunit.client.0.smithi099.stdout:8/667: rename d4/d11/d61/c84 to d4/d11/d23/d3f/ce0 0 2024-09-19T06:40:45.144 INFO:tasks.workunit.client.0.smithi099.stdout:8/668: symlink d4/d8a/dde/le1 0 2024-09-19T06:40:45.145 INFO:tasks.workunit.client.1.smithi117.stdout:3/886: chown d0/d8/d7f/d40/f9d 126283058 1 2024-09-19T06:40:45.145 INFO:tasks.workunit.client.1.smithi117.stdout:9/903: dwrite d4/d8/d6e/da4/fc9 [0,4194304] 0 2024-09-19T06:40:45.147 INFO:tasks.workunit.client.1.smithi117.stdout:3/887: write d0/d8/d7f/f116 [3819054,17551] 0 2024-09-19T06:40:45.148 INFO:tasks.workunit.client.0.smithi099.stdout:4/632: sync 2024-09-19T06:40:45.149 INFO:tasks.workunit.client.0.smithi099.stdout:7/815: sync 2024-09-19T06:40:45.149 INFO:tasks.workunit.client.1.smithi117.stdout:5/918: write d17/d1b/f28 [4176078,74354] 0 2024-09-19T06:40:45.152 INFO:tasks.workunit.client.1.smithi117.stdout:3/888: creat d0/d9/d4e/db4/f11d x:0 0 0 2024-09-19T06:40:45.155 INFO:tasks.workunit.client.1.smithi117.stdout:9/904: creat d4/d58/f134 x:0 0 0 2024-09-19T06:40:45.155 INFO:tasks.workunit.client.0.smithi099.stdout:7/816: link d7/dcf/d29/d1f/d45/d48/d63/f10f d7/d39/d7d/f125 0 2024-09-19T06:40:45.156 INFO:tasks.workunit.client.1.smithi117.stdout:5/919: mknod d17/d1b/d5d/d7d/de7/c135 0 2024-09-19T06:40:45.156 INFO:tasks.workunit.client.0.smithi099.stdout:7/817: chown d7/dcf/d97/fe6 15679519 1 2024-09-19T06:40:45.157 INFO:tasks.workunit.client.0.smithi099.stdout:4/633: creat d12/d1b/d73/fd7 x:0 0 0 2024-09-19T06:40:45.159 INFO:tasks.workunit.client.0.smithi099.stdout:7/818: creat d7/dcf/d29/d1f/d45/d48/dda/f126 x:0 0 0 2024-09-19T06:40:45.160 INFO:tasks.workunit.client.0.smithi099.stdout:8/669: truncate d4/de/d26/d2b/f58 2588122 0 2024-09-19T06:40:45.160 INFO:tasks.workunit.client.1.smithi117.stdout:9/905: rename d4/d1c/f59 to d4/d8/d6e/da4/f135 0 2024-09-19T06:40:45.164 INFO:tasks.workunit.client.0.smithi099.stdout:7/819: fsync d7/dc7/f9d 0 2024-09-19T06:40:45.165 INFO:tasks.workunit.client.1.smithi117.stdout:5/920: mkdir d17/d1b/d3a/dfe/d136 0 2024-09-19T06:40:45.165 INFO:tasks.workunit.client.1.smithi117.stdout:3/889: mknod d0/d19/d2b/c11e 0 2024-09-19T06:40:45.165 INFO:tasks.workunit.client.1.smithi117.stdout:5/921: mkdir d17/d1b/d3a/dfe/d137 0 2024-09-19T06:40:45.167 INFO:tasks.workunit.client.1.smithi117.stdout:5/922: fsync d17/d1b/d3a/f3e 0 2024-09-19T06:40:45.169 INFO:tasks.workunit.client.1.smithi117.stdout:1/827: dwrite d3/d18/d56/f94 [0,4194304] 0 2024-09-19T06:40:45.169 INFO:tasks.workunit.client.0.smithi099.stdout:7/820: rename d7/cab to d7/dcf/d29/d1f/d45/d48/d63/d71/c127 0 2024-09-19T06:40:45.172 INFO:tasks.workunit.client.0.smithi099.stdout:8/670: getdents d4/de/d26/d2b 0 2024-09-19T06:40:45.175 INFO:tasks.workunit.client.1.smithi117.stdout:1/828: link d3/d22/f5f d3/d18/d91/f11f 0 2024-09-19T06:40:45.176 INFO:tasks.workunit.client.0.smithi099.stdout:7/821: creat d7/dcf/d29/d1f/d45/d48/dda/d115/f128 x:0 0 0 2024-09-19T06:40:45.178 INFO:tasks.workunit.client.0.smithi099.stdout:7/822: readlink d7/dcf/d29/d1f/d45/d48/d63/d75/ldd 0 2024-09-19T06:40:45.179 INFO:tasks.workunit.client.0.smithi099.stdout:4/634: dread d12/f38 [0,4194304] 0 2024-09-19T06:40:45.180 INFO:tasks.workunit.client.1.smithi117.stdout:1/829: write d3/da1/da5/fae [4673154,115515] 0 2024-09-19T06:40:45.181 INFO:tasks.workunit.client.0.smithi099.stdout:8/671: getdents d4/d11/d23 0 2024-09-19T06:40:45.181 INFO:tasks.workunit.client.0.smithi099.stdout:7/823: dread - d7/dcf/d29/d1f/d45/d48/d63/d75/f8d zero size 2024-09-19T06:40:45.182 INFO:tasks.workunit.client.0.smithi099.stdout:4/635: write d12/d1b/da4/faf [1280501,100906] 0 2024-09-19T06:40:45.183 INFO:tasks.workunit.client.0.smithi099.stdout:4/636: readlink d12/d32/d42/d5c/l3c 0 2024-09-19T06:40:45.184 INFO:tasks.workunit.client.0.smithi099.stdout:8/672: getdents d4/d5e/db4/dc2 0 2024-09-19T06:40:45.185 INFO:tasks.workunit.client.0.smithi099.stdout:7/824: creat d7/dcf/f129 x:0 0 0 2024-09-19T06:40:45.186 INFO:tasks.workunit.client.1.smithi117.stdout:3/890: dwrite d0/d19/d2b/d8e/f2f [4194304,4194304] 0 2024-09-19T06:40:45.186 INFO:tasks.workunit.client.1.smithi117.stdout:5/923: dwrite d17/d1b/d3a/d3c/f7f [0,4194304] 0 2024-09-19T06:40:45.187 INFO:tasks.workunit.client.1.smithi117.stdout:9/906: dread d4/d17/dd7/d100/f126 [0,4194304] 0 2024-09-19T06:40:45.189 INFO:tasks.workunit.client.1.smithi117.stdout:9/907: fsync d4/d1c/d54/dd8/dae/db4/f131 0 2024-09-19T06:40:45.190 INFO:tasks.workunit.client.0.smithi099.stdout:4/637: dwrite d12/d1b/d73/d81/d8a/fd6 [0,4194304] 0 2024-09-19T06:40:45.193 INFO:tasks.workunit.client.0.smithi099.stdout:7/825: rmdir d7/dcf/d29/d1f/d45/d48/d63/d75 39 2024-09-19T06:40:45.195 INFO:tasks.workunit.client.1.smithi117.stdout:5/924: mkdir d17/d1b/d3a/d3c/dcb/dde/d65/d88/dda/d138 0 2024-09-19T06:40:45.196 INFO:tasks.workunit.client.1.smithi117.stdout:5/925: stat d17/d1b/l1e 0 2024-09-19T06:40:45.197 INFO:tasks.workunit.client.0.smithi099.stdout:4/638: rename d12/d1b/d73/d81 to d12/d1b/da4/db4/dd8 0 2024-09-19T06:40:45.197 INFO:tasks.workunit.client.1.smithi117.stdout:9/908: symlink d4/d1c/l136 0 2024-09-19T06:40:45.199 INFO:tasks.workunit.client.1.smithi117.stdout:3/891: dwrite d0/f6 [0,4194304] 0 2024-09-19T06:40:45.200 INFO:tasks.workunit.client.0.smithi099.stdout:4/639: chown d12/d1b/da4/db4/dd8/d9b/dab/dbf/lc4 7581 1 2024-09-19T06:40:45.200 INFO:tasks.workunit.client.0.smithi099.stdout:7/826: symlink d7/dcf/d29/d1f/d45/d48/l12a 0 2024-09-19T06:40:45.201 INFO:tasks.workunit.client.0.smithi099.stdout:4/640: dread - d12/d1b/d88/fca zero size 2024-09-19T06:40:45.202 INFO:tasks.workunit.client.0.smithi099.stdout:7/827: mknod d7/dcf/d29/d1f/d45/d48/dda/d115/c12b 0 2024-09-19T06:40:45.204 INFO:tasks.workunit.client.1.smithi117.stdout:3/892: symlink d0/d9/d1c/df8/l11f 0 2024-09-19T06:40:45.209 INFO:tasks.workunit.client.1.smithi117.stdout:9/909: link d4/d1c/d46/c91 d4/d8/d6a/d82/c137 0 2024-09-19T06:40:45.210 INFO:tasks.workunit.client.1.smithi117.stdout:5/926: getdents d17/d1b/d3a/d3c/d46/d10f 0 2024-09-19T06:40:45.210 INFO:tasks.workunit.client.0.smithi099.stdout:4/641: link d12/d58/c7d d12/d1b/da4/db4/dd8/d89/d91/cd9 0 2024-09-19T06:40:45.211 INFO:tasks.workunit.client.1.smithi117.stdout:3/893: dwrite d0/d8/d7f/d40/dc4/f6d [0,4194304] 0 2024-09-19T06:40:45.212 INFO:tasks.workunit.client.0.smithi099.stdout:7/828: dwrite d7/dcf/d29/d34/da1/dd5/f100 [0,4194304] 0 2024-09-19T06:40:45.213 INFO:tasks.workunit.client.1.smithi117.stdout:9/910: symlink d4/d1c/d54/dd8/dae/db4/l138 0 2024-09-19T06:40:45.214 INFO:tasks.workunit.client.1.smithi117.stdout:5/927: creat d17/d1b/d3a/df8/f139 x:0 0 0 2024-09-19T06:40:45.217 INFO:tasks.workunit.client.1.smithi117.stdout:3/894: mknod d0/d9/d4e/d9e/c120 0 2024-09-19T06:40:45.220 INFO:tasks.workunit.client.1.smithi117.stdout:5/928: unlink d17/d1b/d3a/d3c/dcb/dde/dab/lf2 0 2024-09-19T06:40:45.221 INFO:tasks.workunit.client.0.smithi099.stdout:8/673: write d4/f54 [2451048,116378] 0 2024-09-19T06:40:45.221 INFO:tasks.workunit.client.1.smithi117.stdout:3/895: fsync d0/d9/f80 0 2024-09-19T06:40:45.222 INFO:tasks.workunit.client.0.smithi099.stdout:7/829: link d7/dcf/d29/d1f/d45/d48/ddc/d11e/d53/ff7 d7/dcf/d29/d34/f12c 0 2024-09-19T06:40:45.226 INFO:tasks.workunit.client.0.smithi099.stdout:7/830: unlink d7/dcf/d29/d1f/deb/c103 0 2024-09-19T06:40:45.229 INFO:tasks.workunit.client.1.smithi117.stdout:5/929: dwrite d17/d1b/d3a/d3c/dcb/dde/f12f [0,4194304] 0 2024-09-19T06:40:45.229 INFO:tasks.workunit.client.0.smithi099.stdout:8/674: dwrite d4/de/d14/fa6 [0,4194304] 0 2024-09-19T06:40:45.235 INFO:tasks.workunit.client.1.smithi117.stdout:5/930: rename d17/d1b/d5d/f133 to d17/d1b/d3a/d3c/d46/d102/f13a 0 2024-09-19T06:40:45.236 INFO:tasks.workunit.client.1.smithi117.stdout:5/931: write d17/d1b/f28 [2207751,124108] 0 2024-09-19T06:40:45.239 INFO:tasks.workunit.client.0.smithi099.stdout:8/675: dwrite d4/d11/d23/d4c/d93/fb9 [0,4194304] 0 2024-09-19T06:40:45.243 INFO:tasks.workunit.client.0.smithi099.stdout:8/676: mknod d4/d11/d38/dc0/ce2 0 2024-09-19T06:40:45.245 INFO:tasks.workunit.client.1.smithi117.stdout:5/932: link d17/d1b/d3a/lbf d17/d1b/d3a/d3c/dcb/dde/d55/dd1/l13b 0 2024-09-19T06:40:45.247 INFO:tasks.workunit.client.0.smithi099.stdout:8/677: unlink d4/d11/d38/f9b 0 2024-09-19T06:40:45.248 INFO:tasks.workunit.client.1.smithi117.stdout:1/830: dread d3/d18/d23/fc2 [0,4194304] 0 2024-09-19T06:40:45.249 INFO:tasks.workunit.client.0.smithi099.stdout:4/642: dread d12/d32/d39/f40 [0,4194304] 0 2024-09-19T06:40:45.250 INFO:tasks.workunit.client.1.smithi117.stdout:5/933: mkdir d17/d1b/d3a/d3c/dcb/dde/d65/d13c 0 2024-09-19T06:40:45.251 INFO:tasks.workunit.client.1.smithi117.stdout:1/831: mknod d3/da1/dcc/c120 0 2024-09-19T06:40:45.251 INFO:tasks.workunit.client.0.smithi099.stdout:8/678: rename d4/f30 to d4/d5e/dbb/fe3 0 2024-09-19T06:40:45.252 INFO:tasks.workunit.client.1.smithi117.stdout:1/832: readlink d3/l78 0 2024-09-19T06:40:45.252 INFO:tasks.workunit.client.0.smithi099.stdout:4/643: mknod d12/d32/d42/d80/cda 0 2024-09-19T06:40:45.254 INFO:tasks.workunit.client.1.smithi117.stdout:1/833: chown d3/da1/cbc 1421 1 2024-09-19T06:40:45.255 INFO:tasks.workunit.client.0.smithi099.stdout:4/644: read d12/f16 [5257857,33986] 0 2024-09-19T06:40:45.256 INFO:tasks.workunit.client.1.smithi117.stdout:9/911: rmdir d4/d1c/d54/dd8/dae/db4 39 2024-09-19T06:40:45.256 INFO:tasks.workunit.client.0.smithi099.stdout:4/645: write d12/d1b/db1/fc9 [723436,124196] 0 2024-09-19T06:40:45.256 INFO:tasks.workunit.client.0.smithi099.stdout:7/831: fsync d7/dcf/d29/d34/f12c 0 2024-09-19T06:40:45.257 INFO:tasks.workunit.client.1.smithi117.stdout:9/912: dread - d4/d20/fc2 zero size 2024-09-19T06:40:45.257 INFO:tasks.workunit.client.1.smithi117.stdout:5/934: dwrite d17/d1b/d5d/d7d/fe6 [0,4194304] 0 2024-09-19T06:40:45.261 INFO:tasks.workunit.client.1.smithi117.stdout:5/935: mkdir d17/d1b/d3a/d3c/d46/d102/d13d 0 2024-09-19T06:40:45.263 INFO:tasks.workunit.client.1.smithi117.stdout:9/913: unlink d4/d17/dd7/d100/l12b 0 2024-09-19T06:40:45.263 INFO:tasks.workunit.client.0.smithi099.stdout:7/832: mknod d7/dcf/d29/d34/da1/dd5/d11d/c12d 0 2024-09-19T06:40:45.264 INFO:tasks.workunit.client.1.smithi117.stdout:5/936: unlink d17/d1b/d3a/d3c/dcb/dde/c54 0 2024-09-19T06:40:45.266 INFO:tasks.workunit.client.1.smithi117.stdout:9/914: write d4/f10c [174635,21234] 0 2024-09-19T06:40:45.268 INFO:tasks.workunit.client.0.smithi099.stdout:7/833: creat d7/dcf/d29/d1f/f12e x:0 0 0 2024-09-19T06:40:45.270 INFO:tasks.workunit.client.0.smithi099.stdout:7/834: write d7/dcf/d29/d1f/f12e [845942,65929] 0 2024-09-19T06:40:45.271 INFO:tasks.workunit.client.1.smithi117.stdout:3/896: dwrite d0/f5e [0,4194304] 0 2024-09-19T06:40:45.272 INFO:tasks.workunit.client.1.smithi117.stdout:5/937: getdents d17/d1b/d3a/d3c 0 2024-09-19T06:40:45.272 INFO:tasks.workunit.client.0.smithi099.stdout:4/646: write d12/d58/f96 [1873511,23292] 0 2024-09-19T06:40:45.272 INFO:tasks.workunit.client.0.smithi099.stdout:7/835: getdents d7/dcf/d97/de5 0 2024-09-19T06:40:45.273 INFO:tasks.workunit.client.1.smithi117.stdout:5/938: write d17/f81 [3255742,69226] 0 2024-09-19T06:40:45.274 INFO:tasks.workunit.client.0.smithi099.stdout:7/836: write d7/dcf/d29/d1f/d45/fc2 [3549271,30243] 0 2024-09-19T06:40:45.275 INFO:tasks.workunit.client.0.smithi099.stdout:4/647: rename d12/d32/f4c to d12/d82/fdb 0 2024-09-19T06:40:45.276 INFO:tasks.workunit.client.1.smithi117.stdout:9/915: rmdir d4/d17 39 2024-09-19T06:40:45.278 INFO:tasks.workunit.client.1.smithi117.stdout:3/897: read d0/d8/d7f/d40/dc4/f43 [1919268,128983] 0 2024-09-19T06:40:45.280 INFO:tasks.workunit.client.1.smithi117.stdout:5/939: mknod d17/d1b/d5d/d7d/c13e 0 2024-09-19T06:40:45.280 INFO:tasks.workunit.client.1.smithi117.stdout:9/916: write d4/d1c/d73/d9a/fc4 [1674478,99213] 0 2024-09-19T06:40:45.281 INFO:tasks.workunit.client.0.smithi099.stdout:4/648: mknod d12/d1b/da4/db4/dd8/d8a/da9/cdc 0 2024-09-19T06:40:45.281 INFO:tasks.workunit.client.0.smithi099.stdout:7/837: symlink d7/dcf/d97/de5/l12f 0 2024-09-19T06:40:45.281 INFO:tasks.workunit.client.0.smithi099.stdout:4/649: fdatasync f11 0 2024-09-19T06:40:45.282 INFO:tasks.workunit.client.1.smithi117.stdout:3/898: creat d0/d9/d4e/db4/dcc/f121 x:0 0 0 2024-09-19T06:40:45.282 INFO:tasks.workunit.client.1.smithi117.stdout:9/917: creat d4/d20/f139 x:0 0 0 2024-09-19T06:40:45.282 INFO:tasks.workunit.client.1.smithi117.stdout:5/940: symlink d17/d1b/d3a/d3c/dcb/dde/d65/d88/dd0/l13f 0 2024-09-19T06:40:45.283 INFO:tasks.workunit.client.1.smithi117.stdout:7/882: sync 2024-09-19T06:40:45.283 INFO:tasks.workunit.client.1.smithi117.stdout:5/941: stat d17/d5c/fe1 0 2024-09-19T06:40:45.285 INFO:tasks.workunit.client.1.smithi117.stdout:9/918: creat d4/d1c/d36/d37/d11f/f13a x:0 0 0 2024-09-19T06:40:45.286 INFO:tasks.workunit.client.0.smithi099.stdout:7/838: symlink d7/dcf/d29/d1f/d45/d48/l130 0 2024-09-19T06:40:45.286 INFO:tasks.workunit.client.1.smithi117.stdout:9/919: write d4/d58/f68 [1541628,2123] 0 2024-09-19T06:40:45.287 INFO:tasks.workunit.client.1.smithi117.stdout:7/883: unlink d1/l34 0 2024-09-19T06:40:45.289 INFO:tasks.workunit.client.0.smithi099.stdout:4/650: read d12/d32/d42/d5c/f5d [3435,73706] 0 2024-09-19T06:40:45.290 INFO:tasks.workunit.client.1.smithi117.stdout:9/920: creat d4/d1c/d7a/d16/dac/f13b x:0 0 0 2024-09-19T06:40:45.291 INFO:tasks.workunit.client.0.smithi099.stdout:4/651: unlink d12/c6a 0 2024-09-19T06:40:45.291 INFO:tasks.workunit.client.1.smithi117.stdout:7/884: creat d1/d4a/d7c/d95/ddc/f139 x:0 0 0 2024-09-19T06:40:45.291 INFO:tasks.workunit.client.1.smithi117.stdout:5/942: dwrite d17/f81 [0,4194304] 0 2024-09-19T06:40:45.292 INFO:tasks.workunit.client.0.smithi099.stdout:4/652: write d12/d1b/da4/db4/dd8/d8a/fd6 [2127779,93747] 0 2024-09-19T06:40:45.292 INFO:tasks.workunit.client.1.smithi117.stdout:9/921: stat d4/d1c/d73/d9a/f87 0 2024-09-19T06:40:45.293 INFO:tasks.workunit.client.0.smithi099.stdout:4/653: write d12/f7e [7941683,95164] 0 2024-09-19T06:40:45.293 INFO:tasks.workunit.client.1.smithi117.stdout:9/922: read - d4/d1c/d54/f117 zero size 2024-09-19T06:40:45.295 INFO:tasks.workunit.client.0.smithi099.stdout:7/839: write d7/dcf/d29/d1f/d45/f5b [148241,24794] 0 2024-09-19T06:40:45.295 INFO:tasks.workunit.client.0.smithi099.stdout:4/654: chown l7 1993424 1 2024-09-19T06:40:45.299 INFO:tasks.workunit.client.0.smithi099.stdout:4/655: rename d12/d1b/da4/db4/dd8 to d12/d82/ddd 0 2024-09-19T06:40:45.300 INFO:tasks.workunit.client.1.smithi117.stdout:9/923: creat d4/d1c/d7a/f13c x:0 0 0 2024-09-19T06:40:45.301 INFO:tasks.workunit.client.0.smithi099.stdout:7/840: mkdir d7/dcf/d131 0 2024-09-19T06:40:45.305 INFO:tasks.workunit.client.0.smithi099.stdout:7/841: symlink d7/dcf/d29/d1f/d45/d48/d63/d71/l132 0 2024-09-19T06:40:45.306 INFO:tasks.workunit.client.1.smithi117.stdout:9/924: link d4/d20/f50 d4/d8/d12d/f13d 0 2024-09-19T06:40:45.306 INFO:tasks.workunit.client.1.smithi117.stdout:3/899: dread d0/f15 [0,4194304] 0 2024-09-19T06:40:45.307 INFO:tasks.workunit.client.0.smithi099.stdout:4/656: dwrite d12/d32/f61 [0,4194304] 0 2024-09-19T06:40:45.308 INFO:tasks.workunit.client.0.smithi099.stdout:4/657: fsync d12/d32/f3e 0 2024-09-19T06:40:45.308 INFO:tasks.workunit.client.0.smithi099.stdout:7/842: mknod d7/dcf/d29/df9/c133 0 2024-09-19T06:40:45.309 INFO:tasks.workunit.client.1.smithi117.stdout:9/925: mkdir d4/d1c/d7a/d69/d13e 0 2024-09-19T06:40:45.309 INFO:tasks.workunit.client.0.smithi099.stdout:7/843: readlink d7/d39/d7d/l86 0 2024-09-19T06:40:45.310 INFO:tasks.workunit.client.1.smithi117.stdout:3/900: fdatasync d0/d8/d7f/d40/fbb 0 2024-09-19T06:40:45.310 INFO:tasks.workunit.client.0.smithi099.stdout:4/658: dread - d12/d32/d42/d97/fd0 zero size 2024-09-19T06:40:45.311 INFO:tasks.workunit.client.1.smithi117.stdout:7/885: write d1/d4a/d81/d24/d49/fa0 [851372,111686] 0 2024-09-19T06:40:45.313 INFO:tasks.workunit.client.1.smithi117.stdout:5/943: truncate d17/f22 388901 0 2024-09-19T06:40:45.314 INFO:tasks.workunit.client.0.smithi099.stdout:7/844: mknod d7/dcf/d29/d1f/d45/d48/d63/d75/c134 0 2024-09-19T06:40:45.318 INFO:tasks.workunit.client.0.smithi099.stdout:7/845: mkdir d7/dcf/d29/df9/d135 0 2024-09-19T06:40:45.318 INFO:tasks.workunit.client.0.smithi099.stdout:4/659: dwrite d12/d32/f61 [0,4194304] 0 2024-09-19T06:40:45.319 INFO:tasks.workunit.client.0.smithi099.stdout:4/660: dread - d12/d1b/d73/fd7 zero size 2024-09-19T06:40:45.320 INFO:tasks.workunit.client.1.smithi117.stdout:3/901: link d0/d3d/c71 d0/d100/c122 0 2024-09-19T06:40:45.321 INFO:tasks.workunit.client.0.smithi099.stdout:4/661: dread - d12/d1b/d88/fbd zero size 2024-09-19T06:40:45.323 INFO:tasks.workunit.client.0.smithi099.stdout:7/846: unlink d7/dcf/d29/d1f/d45/d48/dda/l114 0 2024-09-19T06:40:45.323 INFO:tasks.workunit.client.1.smithi117.stdout:9/926: dwrite d4/d17/dd7/d100/f126 [4194304,4194304] 0 2024-09-19T06:40:45.325 INFO:tasks.workunit.client.0.smithi099.stdout:7/847: readlink d7/dc7/l122 0 2024-09-19T06:40:45.325 INFO:tasks.workunit.client.1.smithi117.stdout:7/886: rename d1/d4a/d81/d48/d5f/d82/fc3 to d1/f13a 0 2024-09-19T06:40:45.325 INFO:tasks.workunit.client.1.smithi117.stdout:5/944: dwrite d17/d1b/d3a/d3c/dcb/dde/d65/d88/de5/d3b/fc4 [4194304,4194304] 0 2024-09-19T06:40:45.326 INFO:tasks.workunit.client.0.smithi099.stdout:4/662: truncate d12/d1b/da4/db4/fbb 905316 0 2024-09-19T06:40:45.327 INFO:tasks.workunit.client.1.smithi117.stdout:9/927: creat d4/d8/d6a/f13f x:0 0 0 2024-09-19T06:40:45.327 INFO:tasks.workunit.client.1.smithi117.stdout:5/945: write d17/f9d [1438589,82058] 0 2024-09-19T06:40:45.328 INFO:tasks.workunit.client.1.smithi117.stdout:3/902: symlink d0/d8/d7f/d40/l123 0 2024-09-19T06:40:45.330 INFO:tasks.workunit.client.0.smithi099.stdout:7/848: creat d7/dcf/d29/d34/f136 x:0 0 0 2024-09-19T06:40:45.332 INFO:tasks.workunit.client.0.smithi099.stdout:4/663: getdents d12/d82/ddd/d8a/da9 0 2024-09-19T06:40:45.332 INFO:tasks.workunit.client.1.smithi117.stdout:7/887: chown d1/d4a/d81/d24/c45 1534 1 2024-09-19T06:40:45.334 INFO:tasks.workunit.client.0.smithi099.stdout:4/664: mknod d12/d82/ddd/d89/cde 0 2024-09-19T06:40:45.335 INFO:tasks.workunit.client.0.smithi099.stdout:4/665: truncate d12/d82/fdb 4639279 0 2024-09-19T06:40:45.335 INFO:tasks.workunit.client.1.smithi117.stdout:5/946: write d17/d1b/d3a/fa3 [430925,97719] 0 2024-09-19T06:40:45.336 INFO:tasks.workunit.client.1.smithi117.stdout:7/888: read - d1/d4a/d81/d24/d49/dbf/dcf/f11d zero size 2024-09-19T06:40:45.340 INFO:tasks.workunit.client.0.smithi099.stdout:4/666: dread d12/d32/d39/f40 [0,4194304] 0 2024-09-19T06:40:45.341 INFO:tasks.workunit.client.1.smithi117.stdout:7/889: write d1/f11f [628010,27236] 0 2024-09-19T06:40:45.341 INFO:tasks.workunit.client.1.smithi117.stdout:3/903: dwrite d0/f109 [0,4194304] 0 2024-09-19T06:40:45.342 INFO:tasks.workunit.client.1.smithi117.stdout:5/947: read d17/d1b/d3a/d3c/dcb/dde/d55/dd1/d119/f8f [237247,90008] 0 2024-09-19T06:40:45.343 INFO:tasks.workunit.client.1.smithi117.stdout:5/948: fsync d17/d1b/d3a/f68 0 2024-09-19T06:40:45.344 INFO:tasks.workunit.client.1.smithi117.stdout:3/904: write d0/d8/d64/fb6 [4535628,62619] 0 2024-09-19T06:40:45.344 INFO:tasks.workunit.client.1.smithi117.stdout:9/928: link d4/d58/f68 d4/d1c/d73/d93/f140 0 2024-09-19T06:40:45.345 INFO:tasks.workunit.client.1.smithi117.stdout:7/890: unlink d1/d4a/d81/d24/lb7 0 2024-09-19T06:40:45.346 INFO:tasks.workunit.client.0.smithi099.stdout:4/667: rename d12/d82/ddd/d89/d91/c94 to d12/d82/ddd/d8a/da9/cdf 0 2024-09-19T06:40:45.346 INFO:tasks.workunit.client.1.smithi117.stdout:7/891: read - d1/d4a/d7c/d95/ddc/f108 zero size 2024-09-19T06:40:45.348 INFO:tasks.workunit.client.1.smithi117.stdout:3/905: mknod d0/d3d/d48/dc7/c124 0 2024-09-19T06:40:45.348 INFO:tasks.workunit.client.0.smithi099.stdout:4/668: mknod d12/d82/ddd/d8a/da9/ce0 0 2024-09-19T06:40:45.349 INFO:tasks.workunit.client.0.smithi099.stdout:4/669: stat d12/d82/ddd/d89/c8c 0 2024-09-19T06:40:45.351 INFO:tasks.workunit.client.1.smithi117.stdout:9/929: rename d4/d20/f10a to d4/d1c/d7a/d69/d12c/f141 0 2024-09-19T06:40:45.351 INFO:tasks.workunit.client.0.smithi099.stdout:4/670: mknod d12/ce1 0 2024-09-19T06:40:45.352 INFO:tasks.workunit.client.1.smithi117.stdout:7/892: fdatasync d1/d4a/d81/d24/f20 0 2024-09-19T06:40:45.352 INFO:tasks.workunit.client.1.smithi117.stdout:9/930: read - d4/d1c/d36/fe0 zero size 2024-09-19T06:40:45.354 INFO:tasks.workunit.client.1.smithi117.stdout:7/893: dread - d1/d4a/d7c/d95/fe8 zero size 2024-09-19T06:40:45.354 INFO:tasks.workunit.client.1.smithi117.stdout:9/931: read - d4/d1c/d7a/d52/d8d/dc1/f107 zero size 2024-09-19T06:40:45.354 INFO:tasks.workunit.client.1.smithi117.stdout:3/906: rename d0/d9/d4e/d9e/l10a to d0/d3d/d48/dc7/l125 0 2024-09-19T06:40:45.355 INFO:tasks.workunit.client.1.smithi117.stdout:7/894: readlink d1/d4a/d77/lad 0 2024-09-19T06:40:45.355 INFO:tasks.workunit.client.1.smithi117.stdout:5/949: rmdir d17/d1b/d3a/dfe/d137 0 2024-09-19T06:40:45.357 INFO:tasks.workunit.client.1.smithi117.stdout:5/950: read d17/d1b/d3a/f3e [217420,128502] 0 2024-09-19T06:40:45.361 INFO:tasks.workunit.client.1.smithi117.stdout:5/951: mkdir d17/d1b/d5d/d140 0 2024-09-19T06:40:45.365 INFO:tasks.workunit.client.1.smithi117.stdout:9/932: dread d4/d20/f50 [0,4194304] 0 2024-09-19T06:40:45.365 INFO:tasks.workunit.client.1.smithi117.stdout:3/907: dwrite d0/d9/fc [0,4194304] 0 2024-09-19T06:40:45.367 INFO:tasks.workunit.client.1.smithi117.stdout:7/895: dwrite d1/d4a/d81/f84 [4194304,4194304] 0 2024-09-19T06:40:45.369 INFO:tasks.workunit.client.1.smithi117.stdout:5/952: write d17/d1b/d3a/d3c/d70/d94/f11d [2083969,104744] 0 2024-09-19T06:40:45.371 INFO:tasks.workunit.client.1.smithi117.stdout:9/933: rmdir d4/d8/d6e/da4 39 2024-09-19T06:40:45.372 INFO:tasks.workunit.client.1.smithi117.stdout:3/908: truncate d0/d8/d64/f104 844320 0 2024-09-19T06:40:45.374 INFO:tasks.workunit.client.0.smithi099.stdout:7/849: dwrite d7/dcf/d29/d1f/dec/ffe [0,4194304] 0 2024-09-19T06:40:45.374 INFO:tasks.workunit.client.1.smithi117.stdout:7/896: truncate d1/d4a/d7c/d95/db5/f12f 185653 0 2024-09-19T06:40:45.375 INFO:tasks.workunit.client.0.smithi099.stdout:7/850: write d7/fd2 [3995239,929] 0 2024-09-19T06:40:45.375 INFO:tasks.workunit.client.0.smithi099.stdout:4/671: write d12/f35 [4657704,78988] 0 2024-09-19T06:40:45.376 INFO:tasks.workunit.client.1.smithi117.stdout:5/953: write d17/d1b/d3a/d3c/dcb/dde/d55/dd1/f11b [4276719,84180] 0 2024-09-19T06:40:45.377 INFO:tasks.workunit.client.0.smithi099.stdout:7/851: write d7/dcf/d29/f93 [2353781,1366] 0 2024-09-19T06:40:45.377 INFO:tasks.workunit.client.1.smithi117.stdout:9/934: mkdir d4/d8/d6e/ddb/d142 0 2024-09-19T06:40:45.378 INFO:tasks.workunit.client.0.smithi099.stdout:7/852: chown d7/dc7/f6e 2231 1 2024-09-19T06:40:45.379 INFO:tasks.workunit.client.0.smithi099.stdout:7/853: chown d7/dcf/d29/d1f/d45/d48/d63/d75/dd8/df6 13170 1 2024-09-19T06:40:45.380 INFO:tasks.workunit.client.1.smithi117.stdout:3/909: truncate d0/d8/d7f/d40/dc4/f43 5683584 0 2024-09-19T06:40:45.380 INFO:tasks.workunit.client.1.smithi117.stdout:5/954: truncate d17/d1b/d5d/d86/f12e 856146 0 2024-09-19T06:40:45.380 INFO:tasks.workunit.client.0.smithi099.stdout:4/672: symlink d12/le2 0 2024-09-19T06:40:45.382 INFO:tasks.workunit.client.1.smithi117.stdout:7/897: rename d1/d4a/d81/d24/d1c/d35/ld5 to d1/d4a/d7c/dbc/l13b 0 2024-09-19T06:40:45.383 INFO:tasks.workunit.client.0.smithi099.stdout:7/854: creat d7/dcf/d29/df9/f137 x:0 0 0 2024-09-19T06:40:45.384 INFO:tasks.workunit.client.1.smithi117.stdout:9/935: mkdir d4/d1c/d7a/d69/d13e/d143 0 2024-09-19T06:40:45.385 INFO:tasks.workunit.client.1.smithi117.stdout:7/898: mkdir d1/d4a/d7c/d95/ddc/d13c 0 2024-09-19T06:40:45.385 INFO:tasks.workunit.client.0.smithi099.stdout:4/673: mknod d12/d1b/ce3 0 2024-09-19T06:40:45.385 INFO:tasks.workunit.client.0.smithi099.stdout:7/855: creat d7/dcf/d29/d1f/dec/f138 x:0 0 0 2024-09-19T06:40:45.386 INFO:tasks.workunit.client.0.smithi099.stdout:4/674: fdatasync d12/d82/ddd/d9b/da2/fd5 0 2024-09-19T06:40:45.386 INFO:tasks.workunit.client.1.smithi117.stdout:9/936: mknod d4/d58/c144 0 2024-09-19T06:40:45.389 INFO:tasks.workunit.client.0.smithi099.stdout:4/675: mkdir d12/d82/ddd/d89/de4 0 2024-09-19T06:40:45.389 INFO:tasks.workunit.client.1.smithi117.stdout:9/937: mkdir d4/d1c/d36/d145 0 2024-09-19T06:40:45.392 INFO:tasks.workunit.client.1.smithi117.stdout:7/899: dwrite d1/d4a/d7c/d95/db5/fd0 [0,4194304] 0 2024-09-19T06:40:45.392 INFO:tasks.workunit.client.1.smithi117.stdout:9/938: dread d4/d1c/d36/f4f [0,4194304] 0 2024-09-19T06:40:45.394 INFO:tasks.workunit.client.0.smithi099.stdout:4/676: dwrite d12/d32/d42/f55 [0,4194304] 0 2024-09-19T06:40:45.396 INFO:tasks.workunit.client.1.smithi117.stdout:7/900: mknod d1/d4a/d81/d24/c13d 0 2024-09-19T06:40:45.397 INFO:tasks.workunit.client.1.smithi117.stdout:7/901: readlink d1/d4a/d81/d24/d1c/l2b 0 2024-09-19T06:40:45.401 INFO:tasks.workunit.client.0.smithi099.stdout:4/677: creat d12/fe5 x:0 0 0 2024-09-19T06:40:45.403 INFO:tasks.workunit.client.0.smithi099.stdout:7/856: getdents d7/dcf/d29/df9 0 2024-09-19T06:40:45.404 INFO:tasks.workunit.client.1.smithi117.stdout:7/902: rmdir d1/d4a/d81/d24/d1c/d35/d4f 39 2024-09-19T06:40:45.405 INFO:tasks.workunit.client.0.smithi099.stdout:4/678: rename d12/d32/d42/fd1 to d12/d82/ddd/d8a/da9/dc7/fe6 0 2024-09-19T06:40:45.407 INFO:tasks.workunit.client.0.smithi099.stdout:3/860: sync 2024-09-19T06:40:45.407 INFO:tasks.workunit.client.1.smithi117.stdout:5/955: truncate d17/f22 671186 0 2024-09-19T06:40:45.407 INFO:tasks.workunit.client.0.smithi099.stdout:7/857: write d7/dcf/d29/d1f/d45/fdf [169840,75867] 0 2024-09-19T06:40:45.408 INFO:tasks.workunit.client.1.smithi117.stdout:7/903: fsync d1/d4a/d81/d24/d1c/d35/d4f/f87 0 2024-09-19T06:40:45.409 INFO:tasks.workunit.client.0.smithi099.stdout:4/679: creat d12/d32/fe7 x:0 0 0 2024-09-19T06:40:45.411 INFO:tasks.workunit.client.0.smithi099.stdout:7/858: unlink d7/dcf/d29/df9/c133 0 2024-09-19T06:40:45.411 INFO:tasks.workunit.client.1.smithi117.stdout:0/837: sync 2024-09-19T06:40:45.411 INFO:tasks.workunit.client.1.smithi117.stdout:8/816: sync 2024-09-19T06:40:45.412 INFO:tasks.workunit.client.1.smithi117.stdout:5/956: rename d17/d1b/d3a/d3c/dcb/dde/d65/d88/cfb to d17/d1b/d5d/c141 0 2024-09-19T06:40:45.412 INFO:tasks.workunit.client.1.smithi117.stdout:7/904: write d1/d4a/d81/d24/d49/fb3 [1301953,92653] 0 2024-09-19T06:40:45.414 INFO:tasks.workunit.client.0.smithi099.stdout:4/680: rename d12/d1b/db1 to d12/d32/d42/d5c/d51/de8 0 2024-09-19T06:40:45.415 INFO:tasks.workunit.client.1.smithi117.stdout:8/817: creat d1d/d31/f116 x:0 0 0 2024-09-19T06:40:45.415 INFO:tasks.workunit.client.0.smithi099.stdout:3/861: creat d7/d34/d1d/d36/dc5/f105 x:0 0 0 2024-09-19T06:40:45.416 INFO:tasks.workunit.client.0.smithi099.stdout:3/862: stat d7/d34/d1d/d20/d75/le5 0 2024-09-19T06:40:45.416 INFO:tasks.workunit.client.0.smithi099.stdout:7/859: creat d7/dcf/d29/df9/f139 x:0 0 0 2024-09-19T06:40:45.417 INFO:tasks.workunit.client.0.smithi099.stdout:4/681: dread - d12/d82/ddd/fa0 zero size 2024-09-19T06:40:45.418 INFO:tasks.workunit.client.1.smithi117.stdout:7/905: mkdir d1/d4a/d81/d24/d1c/d55/d13e 0 2024-09-19T06:40:45.420 INFO:tasks.workunit.client.0.smithi099.stdout:3/863: creat d7/d34/d1d/d36/db3/de0/de9/f106 x:0 0 0 2024-09-19T06:40:45.423 INFO:tasks.workunit.client.0.smithi099.stdout:7/860: write d7/dcf/d29/d34/fd9 [1380667,98759] 0 2024-09-19T06:40:45.425 INFO:tasks.workunit.client.1.smithi117.stdout:5/957: symlink d17/d1b/l142 0 2024-09-19T06:40:45.426 INFO:tasks.workunit.client.1.smithi117.stdout:0/838: creat d11/d13/d14/d2c/d53/d7e/df5/f116 x:0 0 0 2024-09-19T06:40:45.428 INFO:tasks.workunit.client.1.smithi117.stdout:9/939: dwrite d4/d1c/d7a/d52/d8d/dc1/f107 [0,4194304] 0 2024-09-19T06:40:45.429 INFO:tasks.workunit.client.0.smithi099.stdout:7/861: unlink d7/dcf/d29/d1f/d45/c4f 0 2024-09-19T06:40:45.429 INFO:tasks.workunit.client.1.smithi117.stdout:3/910: dwrite d0/d8/f10 [4194304,4194304] 0 2024-09-19T06:40:45.433 INFO:tasks.workunit.client.0.smithi099.stdout:7/862: rename d7/fd2 to d7/dcf/d97/de5/f13a 0 2024-09-19T06:40:45.436 INFO:tasks.workunit.client.1.smithi117.stdout:3/911: dread d0/ff4 [0,4194304] 0 2024-09-19T06:40:45.438 INFO:tasks.workunit.client.0.smithi099.stdout:3/864: dwrite d7/d34/d1d/d36/d42/fac [0,4194304] 0 2024-09-19T06:40:45.439 INFO:tasks.workunit.client.1.smithi117.stdout:8/818: dwrite d1d/d31/fa7 [0,4194304] 0 2024-09-19T06:40:45.440 INFO:tasks.workunit.client.0.smithi099.stdout:4/682: dread d12/d32/f72 [0,4194304] 0 2024-09-19T06:40:45.444 INFO:tasks.workunit.client.0.smithi099.stdout:3/865: creat d7/d34/d1d/d36/d69/d6d/d7a/f107 x:0 0 0 2024-09-19T06:40:45.448 INFO:tasks.workunit.client.0.smithi099.stdout:4/683: unlink f5 0 2024-09-19T06:40:45.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:45 smithi099 ceph-mon[27651]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:40:45.458 INFO:tasks.workunit.client.1.smithi117.stdout:7/906: creat d1/d4a/d81/d24/d49/dbf/f13f x:0 0 0 2024-09-19T06:40:45.459 INFO:tasks.workunit.client.0.smithi099.stdout:4/684: dread d12/d1b/da4/faf [0,4194304] 0 2024-09-19T06:40:45.459 INFO:tasks.workunit.client.1.smithi117.stdout:5/958: creat d17/d1b/d3a/df8/f143 x:0 0 0 2024-09-19T06:40:45.460 INFO:tasks.workunit.client.0.smithi099.stdout:4/685: fsync d12/d1b/d88/fbd 0 2024-09-19T06:40:45.460 INFO:tasks.workunit.client.1.smithi117.stdout:9/940: fsync d4/d1c/f28 0 2024-09-19T06:40:45.461 INFO:tasks.workunit.client.1.smithi117.stdout:3/912: read - d0/d9/d4e/fbe zero size 2024-09-19T06:40:45.461 INFO:tasks.workunit.client.1.smithi117.stdout:6/682: sync 2024-09-19T06:40:45.461 INFO:tasks.workunit.client.1.smithi117.stdout:1/834: sync 2024-09-19T06:40:45.461 INFO:tasks.workunit.client.1.smithi117.stdout:2/910: sync 2024-09-19T06:40:45.462 INFO:tasks.workunit.client.1.smithi117.stdout:8/819: dread - d1d/d2a/d3f/d4b/d66/dac/fcb zero size 2024-09-19T06:40:45.463 INFO:tasks.workunit.client.1.smithi117.stdout:0/839: mknod d11/d13/d1b/d27/d54/dff/d10c/c117 0 2024-09-19T06:40:45.463 INFO:tasks.workunit.client.1.smithi117.stdout:7/907: creat d1/d4a/d81/d24/d49/dbf/f140 x:0 0 0 2024-09-19T06:40:45.466 INFO:tasks.workunit.client.1.smithi117.stdout:6/683: mknod d1/d5/dc2/cc8 0 2024-09-19T06:40:45.466 INFO:tasks.workunit.client.1.smithi117.stdout:9/941: dread d4/d1c/d36/d37/faa [0,4194304] 0 2024-09-19T06:40:45.468 INFO:tasks.workunit.client.1.smithi117.stdout:2/911: creat d0/d64/dd9/df0/f14d x:0 0 0 2024-09-19T06:40:45.470 INFO:tasks.workunit.client.1.smithi117.stdout:9/942: read - d4/f109 zero size 2024-09-19T06:40:45.471 INFO:tasks.workunit.client.1.smithi117.stdout:6/684: symlink d1/d5/d9a/da9/lc9 0 2024-09-19T06:40:45.471 INFO:tasks.workunit.client.0.smithi099.stdout:3/866: write d7/f14 [189211,101851] 0 2024-09-19T06:40:45.472 INFO:tasks.workunit.client.1.smithi117.stdout:6/685: write d1/d5/d8/d80/fac [827133,84758] 0 2024-09-19T06:40:45.474 INFO:tasks.workunit.client.1.smithi117.stdout:0/840: rename d11/d13/d1b/c6f to d11/d13/d1b/d27/d37/d9d/c118 0 2024-09-19T06:40:45.475 INFO:tasks.workunit.client.1.smithi117.stdout:2/912: mkdir d0/d14e 0 2024-09-19T06:40:45.477 INFO:tasks.workunit.client.0.smithi099.stdout:4/686: dwrite d12/d1b/d73/f8e [0,4194304] 0 2024-09-19T06:40:45.478 INFO:tasks.workunit.client.1.smithi117.stdout:3/913: link d0/d9/d1c/c61 d0/d9/d1c/d53/d101/c126 0 2024-09-19T06:40:45.480 INFO:tasks.workunit.client.0.smithi099.stdout:4/687: chown d12/d58/c6d 21006422 1 2024-09-19T06:40:45.482 INFO:tasks.workunit.client.1.smithi117.stdout:6/686: mknod d1/d5/d32/dc1/cca 0 2024-09-19T06:40:45.483 INFO:tasks.workunit.client.1.smithi117.stdout:3/914: truncate d0/d19/f38 1765099 0 2024-09-19T06:40:45.484 INFO:tasks.workunit.client.1.smithi117.stdout:6/687: chown d1/d5/d32/c31 12330608 1 2024-09-19T06:40:45.484 INFO:tasks.workunit.client.1.smithi117.stdout:3/915: stat d0/d9/f9a 0 2024-09-19T06:40:45.485 INFO:tasks.workunit.client.1.smithi117.stdout:3/916: chown d0/d9/d4e/db4/dcc 2098 1 2024-09-19T06:40:45.485 INFO:tasks.workunit.client.1.smithi117.stdout:0/841: rename d11/d13/d1b/d27/d37/f58 to d11/d13/d14/f119 0 2024-09-19T06:40:45.488 INFO:tasks.workunit.client.1.smithi117.stdout:0/842: write d11/d13/f17 [5657583,55178] 0 2024-09-19T06:40:45.492 INFO:tasks.workunit.client.0.smithi099.stdout:4/688: dread d12/d32/d42/f93 [0,4194304] 0 2024-09-19T06:40:45.493 INFO:tasks.workunit.client.1.smithi117.stdout:0/843: symlink d11/d13/d7a/d104/l11a 0 2024-09-19T06:40:45.494 INFO:tasks.workunit.client.1.smithi117.stdout:3/917: getdents d0/d3d/d48/d77 0 2024-09-19T06:40:45.494 INFO:tasks.workunit.client.1.smithi117.stdout:0/844: dread - d11/d13/d14/d2c/d53/d7e/df5/f116 zero size 2024-09-19T06:40:45.495 INFO:tasks.workunit.client.0.smithi099.stdout:4/689: mkdir d12/d82/ddd/d8a/de9 0 2024-09-19T06:40:45.496 INFO:tasks.workunit.client.0.smithi099.stdout:4/690: chown d12/d82/ddd/d8a/fd6 915438 1 2024-09-19T06:40:45.496 INFO:tasks.workunit.client.1.smithi117.stdout:1/835: fsync d3/d18/d23/f28 0 2024-09-19T06:40:45.499 INFO:tasks.workunit.client.0.smithi099.stdout:4/691: mknod d12/d1b/d73/cea 0 2024-09-19T06:40:45.499 INFO:tasks.workunit.client.1.smithi117.stdout:0/845: read d11/d13/d14/f45 [1719166,247] 0 2024-09-19T06:40:45.499 INFO:tasks.workunit.client.1.smithi117.stdout:1/836: rename d3 to d3/d18/d23/d74/d89/d121 22 2024-09-19T06:40:45.501 INFO:tasks.workunit.client.0.smithi099.stdout:4/692: write d12/d32/d42/d5c/d51/de8/fc5 [427720,21747] 0 2024-09-19T06:40:45.501 INFO:tasks.workunit.client.1.smithi117.stdout:0/846: write d11/d13/d1b/d27/d37/d6d/fba [913711,74833] 0 2024-09-19T06:40:45.501 INFO:tasks.workunit.client.1.smithi117.stdout:3/918: creat d0/d19/d2b/f127 x:0 0 0 2024-09-19T06:40:45.503 INFO:tasks.workunit.client.1.smithi117.stdout:0/847: write d11/d13/d14/d2c/d35/d3e/f100 [1287718,10917] 0 2024-09-19T06:40:45.504 INFO:tasks.workunit.client.1.smithi117.stdout:3/919: rmdir d0/d8/d7f/d40/d5b 39 2024-09-19T06:40:45.505 INFO:tasks.workunit.client.0.smithi099.stdout:4/693: link d12/d82/c8d d12/d82/ddd/ceb 0 2024-09-19T06:40:45.505 INFO:tasks.workunit.client.0.smithi099.stdout:3/867: dread d7/d34/f1f [4194304,4194304] 0 2024-09-19T06:40:45.505 INFO:tasks.workunit.client.1.smithi117.stdout:1/837: dread d3/d18/d23/d74/f75 [4194304,4194304] 0 2024-09-19T06:40:45.506 INFO:tasks.workunit.client.1.smithi117.stdout:1/838: dread - d3/d110/f11a zero size 2024-09-19T06:40:45.508 INFO:tasks.workunit.client.0.smithi099.stdout:4/694: rename d12/d32/d42/d5c/l4d to d12/d1b/da4/db4/lec 0 2024-09-19T06:40:45.508 INFO:tasks.workunit.client.1.smithi117.stdout:3/920: dread d0/d3d/d48/dc7/f114 [0,4194304] 0 2024-09-19T06:40:45.509 INFO:tasks.workunit.client.0.smithi099.stdout:3/868: mkdir d7/d34/d1d/d108 0 2024-09-19T06:40:45.509 INFO:tasks.workunit.client.0.smithi099.stdout:4/695: write d12/d1b/d73/f8e [285558,120873] 0 2024-09-19T06:40:45.510 INFO:tasks.workunit.client.1.smithi117.stdout:1/839: rename d3/d110/f11a to d3/d18/d97/f122 0 2024-09-19T06:40:45.510 INFO:tasks.workunit.client.0.smithi099.stdout:4/696: readlink d12/d32/d42/d97/lb8 0 2024-09-19T06:40:45.511 INFO:tasks.workunit.client.0.smithi099.stdout:3/869: chown d7/d34/d1d/d36/l93 552405 1 2024-09-19T06:40:45.512 INFO:tasks.workunit.client.1.smithi117.stdout:3/921: chown d0/d9/d1c/l3f 1081 1 2024-09-19T06:40:45.513 INFO:tasks.workunit.client.1.smithi117.stdout:1/840: mkdir d3/d18/d97/d123 0 2024-09-19T06:40:45.513 INFO:tasks.workunit.client.0.smithi099.stdout:4/697: mknod d12/d32/d42/d5c/d9d/ced 0 2024-09-19T06:40:45.514 INFO:tasks.workunit.client.1.smithi117.stdout:1/841: write d3/da1/fd4 [380060,26417] 0 2024-09-19T06:40:45.515 INFO:tasks.workunit.client.0.smithi099.stdout:3/870: rename d7/d34/d1d/d20/d58/d5c/cfc to d7/d34/d1d/d20/d75/c109 0 2024-09-19T06:40:45.517 INFO:tasks.workunit.client.1.smithi117.stdout:3/922: rename d0/f109 to d0/d8/d7f/d40/d5b/f128 0 2024-09-19T06:40:45.517 INFO:tasks.workunit.client.0.smithi099.stdout:4/698: creat d12/d82/ddd/d9b/dab/fee x:0 0 0 2024-09-19T06:40:45.518 INFO:tasks.workunit.client.0.smithi099.stdout:4/699: chown d12/d32/f86 0 1 2024-09-19T06:40:45.519 INFO:tasks.workunit.client.1.smithi117.stdout:8/820: write d1d/d1e/f5c [702133,14038] 0 2024-09-19T06:40:45.519 INFO:tasks.workunit.client.1.smithi117.stdout:1/842: dread d3/d18/d23/d74/fb7 [0,4194304] 0 2024-09-19T06:40:45.519 INFO:tasks.workunit.client.0.smithi099.stdout:3/871: truncate d7/d34/d1d/d36/d42/f62 5035641 0 2024-09-19T06:40:45.519 INFO:tasks.workunit.client.1.smithi117.stdout:7/908: write d1/d4a/d81/d24/d1c/d55/fdb [302613,128781] 0 2024-09-19T06:40:45.520 INFO:tasks.workunit.client.0.smithi099.stdout:4/700: mknod d12/d32/d42/d5c/d51/cef 0 2024-09-19T06:40:45.522 INFO:tasks.workunit.client.1.smithi117.stdout:0/848: dread d11/d13/d28/f7f [0,4194304] 0 2024-09-19T06:40:45.523 INFO:tasks.workunit.client.1.smithi117.stdout:3/923: truncate d0/d9/d4e/fdd 469195 0 2024-09-19T06:40:45.524 INFO:tasks.workunit.client.0.smithi099.stdout:4/701: creat d12/d58/ff0 x:0 0 0 2024-09-19T06:40:45.525 INFO:tasks.workunit.client.1.smithi117.stdout:1/843: creat d3/d18/d91/f124 x:0 0 0 2024-09-19T06:40:45.526 INFO:tasks.workunit.client.1.smithi117.stdout:6/688: write d1/f41 [1419806,121127] 0 2024-09-19T06:40:45.526 INFO:tasks.workunit.client.1.smithi117.stdout:8/821: symlink d1d/d2a/d3f/d4b/d5f/l117 0 2024-09-19T06:40:45.526 INFO:tasks.workunit.client.0.smithi099.stdout:4/702: write d12/d82/ddd/d9b/da2/fd5 [897776,18295] 0 2024-09-19T06:40:45.527 INFO:tasks.workunit.client.0.smithi099.stdout:3/872: dwrite d7/d34/d1d/d20/d58/d5c/d98/dde/fe2 [0,4194304] 0 2024-09-19T06:40:45.528 INFO:tasks.workunit.client.1.smithi117.stdout:7/909: chown d1/d4a/d81/d24/c1b 1388008362 1 2024-09-19T06:40:45.531 INFO:tasks.workunit.client.0.smithi099.stdout:3/873: creat d7/d34/d1d/d36/db3/de0/def/f10a x:0 0 0 2024-09-19T06:40:45.532 INFO:tasks.workunit.client.1.smithi117.stdout:5/959: dwrite d17/d1b/d3a/d3c/d46/d10f/f11e [0,4194304] 0 2024-09-19T06:40:45.532 INFO:tasks.workunit.client.0.smithi099.stdout:4/703: mknod d12/d82/ddd/d89/de4/cf1 0 2024-09-19T06:40:45.533 INFO:tasks.workunit.client.1.smithi117.stdout:1/844: fdatasync d3/d8e/db4/fcb 0 2024-09-19T06:40:45.533 INFO:tasks.workunit.client.0.smithi099.stdout:4/704: readlink d12/d1b/l74 0 2024-09-19T06:40:45.533 INFO:tasks.workunit.client.0.smithi099.stdout:3/874: chown d7/d34/d1d/d20/d75/lfa 0 1 2024-09-19T06:40:45.533 INFO:tasks.workunit.client.0.smithi099.stdout:4/705: stat d12/d32/d39/l85 0 2024-09-19T06:40:45.534 INFO:tasks.workunit.client.1.smithi117.stdout:0/849: dread - d11/d13/d1b/d27/d37/da9/ff0 zero size 2024-09-19T06:40:45.534 INFO:tasks.workunit.client.0.smithi099.stdout:4/706: chown d12/d1b/d88/fbd 141699157 1 2024-09-19T06:40:45.536 INFO:tasks.workunit.client.0.smithi099.stdout:3/875: mknod d7/d34/d1d/d20/d58/d5c/d98/dde/c10b 0 2024-09-19T06:40:45.537 INFO:tasks.workunit.client.1.smithi117.stdout:8/822: chown d1d/d2a/d3f/d4b/d5f/dbf/dd0/db9/dd6/f10a 9 1 2024-09-19T06:40:45.538 INFO:tasks.workunit.client.0.smithi099.stdout:3/876: chown d7/d34/f3a 0 1 2024-09-19T06:40:45.540 INFO:tasks.workunit.client.0.smithi099.stdout:3/877: symlink d7/d34/l10c 0 2024-09-19T06:40:45.541 INFO:tasks.workunit.client.1.smithi117.stdout:9/943: dwrite d4/d20/f50 [0,4194304] 0 2024-09-19T06:40:45.541 INFO:tasks.workunit.client.1.smithi117.stdout:6/689: symlink d1/d5/lcb 0 2024-09-19T06:40:45.541 INFO:tasks.workunit.client.1.smithi117.stdout:3/924: write d0/ff4 [1026790,66573] 0 2024-09-19T06:40:45.542 INFO:tasks.workunit.client.1.smithi117.stdout:2/913: dwrite d0/d7/d29/d35/d3d/d72/ff8 [4194304,4194304] 0 2024-09-19T06:40:45.542 INFO:tasks.workunit.client.1.smithi117.stdout:8/823: read - d1d/d1e/d53/fef zero size 2024-09-19T06:40:45.543 INFO:tasks.workunit.client.0.smithi099.stdout:3/878: mkdir d7/d34/d1d/d20/d75/d10d 0 2024-09-19T06:40:45.544 INFO:tasks.workunit.client.1.smithi117.stdout:0/850: fsync d11/d13/d1b/d27/d37/da9/fde 0 2024-09-19T06:40:45.547 INFO:tasks.workunit.client.0.smithi099.stdout:3/879: symlink d7/d34/d1d/d57/d76/l10e 0 2024-09-19T06:40:45.548 INFO:tasks.workunit.client.0.smithi099.stdout:3/880: fsync d7/d34/d1d/d20/f7d 0 2024-09-19T06:40:45.549 INFO:tasks.workunit.client.1.smithi117.stdout:1/845: stat d3/d18/d23/c4d 0 2024-09-19T06:40:45.549 INFO:tasks.workunit.client.1.smithi117.stdout:9/944: write d4/d1c/ffa [835641,30623] 0 2024-09-19T06:40:45.552 INFO:tasks.workunit.client.1.smithi117.stdout:9/945: chown d4/d1c/d54/dd8/fbe 7 1 2024-09-19T06:40:45.552 INFO:tasks.workunit.client.1.smithi117.stdout:3/925: mknod d0/d9/d4e/d9e/ddc/c129 0 2024-09-19T06:40:45.552 INFO:tasks.workunit.client.1.smithi117.stdout:5/960: read d17/d1b/d3a/d3c/d70/d94/f11d [1149572,34333] 0 2024-09-19T06:40:45.552 INFO:tasks.workunit.client.0.smithi099.stdout:4/707: dwrite d12/d32/f72 [0,4194304] 0 2024-09-19T06:40:45.553 INFO:tasks.workunit.client.1.smithi117.stdout:6/690: symlink d1/d5/d8/d27/lcc 0 2024-09-19T06:40:45.553 INFO:tasks.workunit.client.1.smithi117.stdout:1/846: read - d3/da1/db1/d93/f9a zero size 2024-09-19T06:40:45.554 INFO:tasks.workunit.client.0.smithi099.stdout:3/881: symlink d7/d34/d1d/d36/d69/d6d/l10f 0 2024-09-19T06:40:45.558 INFO:tasks.workunit.client.1.smithi117.stdout:2/914: creat d0/d7/f14f x:0 0 0 2024-09-19T06:40:45.559 INFO:tasks.workunit.client.0.smithi099.stdout:3/882: rename d7/cca to d7/d34/d1d/d36/db3/de0/de9/c110 0 2024-09-19T06:40:45.561 INFO:tasks.workunit.client.1.smithi117.stdout:6/691: creat d1/d5/d8/d5e/fcd x:0 0 0 2024-09-19T06:40:45.561 INFO:tasks.workunit.client.1.smithi117.stdout:1/847: symlink d3/da1/db1/l125 0 2024-09-19T06:40:45.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:45 smithi117 ceph-mon[34564]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:40:45.562 INFO:tasks.workunit.client.1.smithi117.stdout:5/961: creat d17/d1b/d3a/d3c/dcb/dde/dab/f144 x:0 0 0 2024-09-19T06:40:45.562 INFO:tasks.workunit.client.1.smithi117.stdout:8/824: getdents d1d/d2a/d3f/d4b/d66 0 2024-09-19T06:40:45.563 INFO:tasks.workunit.client.0.smithi099.stdout:6/666: sync 2024-09-19T06:40:45.563 INFO:tasks.workunit.client.0.smithi099.stdout:9/717: sync 2024-09-19T06:40:45.563 INFO:tasks.workunit.client.0.smithi099.stdout:3/883: creat d7/d34/d1d/d36/db3/f111 x:0 0 0 2024-09-19T06:40:45.564 INFO:tasks.workunit.client.1.smithi117.stdout:6/692: chown d1/d3d/f5a 785880 1 2024-09-19T06:40:45.566 INFO:tasks.workunit.client.1.smithi117.stdout:1/848: rmdir d3/d18/d23/dde 39 2024-09-19T06:40:45.566 INFO:tasks.workunit.client.0.smithi099.stdout:9/718: truncate dd/f5b 602815 0 2024-09-19T06:40:45.566 INFO:tasks.workunit.client.1.smithi117.stdout:6/693: creat d1/d5/dc2/fce x:0 0 0 2024-09-19T06:40:45.567 INFO:tasks.workunit.client.1.smithi117.stdout:6/694: chown d1/d3d 15050667 1 2024-09-19T06:40:45.568 INFO:tasks.workunit.client.0.smithi099.stdout:3/884: creat d7/d34/d1d/d36/d69/f112 x:0 0 0 2024-09-19T06:40:45.568 INFO:tasks.workunit.client.1.smithi117.stdout:1/849: write d3/d22/d2f/fdc [2579820,59639] 0 2024-09-19T06:40:45.569 INFO:tasks.workunit.client.0.smithi099.stdout:9/719: creat dd/d2c/dd9/fec x:0 0 0 2024-09-19T06:40:45.570 INFO:tasks.workunit.client.0.smithi099.stdout:9/720: write dd/d2c/d5c/ddb/fde [244387,65974] 0 2024-09-19T06:40:45.571 INFO:tasks.workunit.client.1.smithi117.stdout:8/825: dread d1d/f50 [0,4194304] 0 2024-09-19T06:40:45.573 INFO:tasks.workunit.client.0.smithi099.stdout:9/721: mkdir dd/d2c/dd9/ded 0 2024-09-19T06:40:45.573 INFO:tasks.workunit.client.0.smithi099.stdout:6/667: dread d1/d7c/fad [0,4194304] 0 2024-09-19T06:40:45.574 INFO:tasks.workunit.client.0.smithi099.stdout:6/668: stat d1/d12/dda 0 2024-09-19T06:40:45.576 INFO:tasks.workunit.client.1.smithi117.stdout:8/826: symlink d1d/d1e/d53/l118 0 2024-09-19T06:40:45.577 INFO:tasks.workunit.client.0.smithi099.stdout:9/722: mknod dd/d62/d78/cee 0 2024-09-19T06:40:45.577 INFO:tasks.workunit.client.0.smithi099.stdout:9/723: rmdir dd/d47/d68 39 2024-09-19T06:40:45.578 INFO:tasks.workunit.client.0.smithi099.stdout:6/669: getdents d1/d5/d24/d2e/d7b/dba 0 2024-09-19T06:40:45.579 INFO:tasks.workunit.client.1.smithi117.stdout:8/827: truncate d1d/d2a/d3f/d4b/d5f/d95/f9b 3786049 0 2024-09-19T06:40:45.580 INFO:tasks.workunit.client.0.smithi099.stdout:9/724: creat dd/d2c/d5c/d64/d93/fef x:0 0 0 2024-09-19T06:40:45.582 INFO:tasks.workunit.client.1.smithi117.stdout:7/910: write d1/d4a/d81/d24/d49/dbf/dc4/f114 [5167376,82007] 0 2024-09-19T06:40:45.584 INFO:tasks.workunit.client.0.smithi099.stdout:6/670: mknod d1/d12/dda/cdc 0 2024-09-19T06:40:45.584 INFO:tasks.workunit.client.1.smithi117.stdout:7/911: chown d1/d4a/d81/d24/d1c/d55/lff 22963414 1 2024-09-19T06:40:45.586 INFO:tasks.workunit.client.1.smithi117.stdout:3/926: truncate d0/d8/d7f/d40/dc4/f6d 2750098 0 2024-09-19T06:40:45.586 INFO:tasks.workunit.client.1.smithi117.stdout:5/962: truncate d17/d1b/d3a/d3c/dcb/dde/d55/dd1/d119/f123 3946759 0 2024-09-19T06:40:45.588 INFO:tasks.workunit.client.0.smithi099.stdout:4/708: truncate d12/d1b/da4/faf 270404 0 2024-09-19T06:40:45.589 INFO:tasks.workunit.client.1.smithi117.stdout:1/850: write d3/da1/db1/d93/fd1 [776423,20823] 0 2024-09-19T06:40:45.589 INFO:tasks.workunit.client.0.smithi099.stdout:6/671: truncate d1/d5/d38/f59 35157 0 2024-09-19T06:40:45.591 INFO:tasks.workunit.client.1.smithi117.stdout:8/828: dwrite d1d/d31/fa7 [0,4194304] 0 2024-09-19T06:40:45.591 INFO:tasks.workunit.client.1.smithi117.stdout:9/946: dread d4/d1c/d46/fdc [0,4194304] 0 2024-09-19T06:40:45.591 INFO:tasks.workunit.client.0.smithi099.stdout:6/672: chown d1/d5/l7 349 1 2024-09-19T06:40:45.596 INFO:tasks.workunit.client.1.smithi117.stdout:7/912: rename d1/d4a/d81/d48/d5f/l12e to d1/d4a/d81/d113/l141 0 2024-09-19T06:40:45.596 INFO:tasks.workunit.client.1.smithi117.stdout:1/851: creat d3/da1/db1/f126 x:0 0 0 2024-09-19T06:40:45.599 INFO:tasks.workunit.client.1.smithi117.stdout:7/913: chown d1/d4a/d81/d8d/fc9 1819 1 2024-09-19T06:40:45.599 INFO:tasks.workunit.client.1.smithi117.stdout:6/695: dwrite d1/d3/f50 [0,4194304] 0 2024-09-19T06:40:45.599 INFO:tasks.workunit.client.1.smithi117.stdout:8/829: rmdir d1d/d1e/d53 39 2024-09-19T06:40:45.601 INFO:tasks.workunit.client.0.smithi099.stdout:3/885: dwrite d7/d34/d1d/d20/d58/d5c/d98/dde/f104 [0,4194304] 0 2024-09-19T06:40:45.602 INFO:tasks.workunit.client.1.smithi117.stdout:9/947: unlink d4/d8/d6e/c89 0 2024-09-19T06:40:45.602 INFO:tasks.workunit.client.0.smithi099.stdout:3/886: readlink d7/d34/d1d/d20/d75/le5 0 2024-09-19T06:40:45.603 INFO:tasks.workunit.client.1.smithi117.stdout:7/914: dread - d1/d4a/d81/d24/d26/d44/ff6 zero size 2024-09-19T06:40:45.603 INFO:tasks.workunit.client.0.smithi099.stdout:3/887: stat d7/d34/d1d/d20 0 2024-09-19T06:40:45.606 INFO:tasks.workunit.client.1.smithi117.stdout:1/852: mknod d3/da1/da5/c127 0 2024-09-19T06:40:45.607 INFO:tasks.workunit.client.1.smithi117.stdout:8/830: fsync d1d/d2a/d3f/d4b/d66/dac/fcb 0 2024-09-19T06:40:45.607 INFO:tasks.workunit.client.1.smithi117.stdout:9/948: rmdir d4/d8/d12d 39 2024-09-19T06:40:45.608 INFO:tasks.workunit.client.0.smithi099.stdout:3/888: chown d7/d34/d1d/d36/d42/cb9 939641 1 2024-09-19T06:40:45.608 INFO:tasks.workunit.client.1.smithi117.stdout:1/853: readlink d3/d18/d23/dfc/l118 0 2024-09-19T06:40:45.610 INFO:tasks.workunit.client.1.smithi117.stdout:6/696: symlink d1/d5/d8/d80/lcf 0 2024-09-19T06:40:45.610 INFO:tasks.workunit.client.0.smithi099.stdout:3/889: chown d7/d34/d1d 377397564 1 2024-09-19T06:40:45.611 INFO:tasks.workunit.client.1.smithi117.stdout:6/697: fdatasync d1/d5/d8/f19 0 2024-09-19T06:40:45.611 INFO:tasks.workunit.client.0.smithi099.stdout:9/725: dwrite dd/d47/d68/fb7 [0,4194304] 0 2024-09-19T06:40:45.613 INFO:tasks.workunit.client.1.smithi117.stdout:6/698: truncate d1/f41 2042226 0 2024-09-19T06:40:45.615 INFO:tasks.workunit.client.0.smithi099.stdout:3/890: dread - d7/d34/d1d/d36/d69/f72 zero size 2024-09-19T06:40:45.616 INFO:tasks.workunit.client.1.smithi117.stdout:8/831: mkdir d1d/d2a/d3f/d4c/d119 0 2024-09-19T06:40:45.617 INFO:tasks.workunit.client.1.smithi117.stdout:5/963: dread d17/d1b/d3a/d3c/dcb/dde/d55/dd1/d119/f75 [0,4194304] 0 2024-09-19T06:40:45.617 INFO:tasks.workunit.client.1.smithi117.stdout:8/832: dread - d1d/d2a/d3f/d4b/d5f/f10c zero size 2024-09-19T06:40:45.618 INFO:tasks.workunit.client.0.smithi099.stdout:9/726: mkdir dd/d2c/dd9/ded/df0 0 2024-09-19T06:40:45.618 INFO:tasks.workunit.client.1.smithi117.stdout:1/854: creat d3/d99/dd7/f128 x:0 0 0 2024-09-19T06:40:45.619 INFO:tasks.workunit.client.0.smithi099.stdout:9/727: dread - dd/d2c/d5c/d85/fe1 zero size 2024-09-19T06:40:45.619 INFO:tasks.workunit.client.1.smithi117.stdout:9/949: creat d4/d1c/d7a/d69/f146 x:0 0 0 2024-09-19T06:40:45.621 INFO:tasks.workunit.client.1.smithi117.stdout:5/964: dread - d17/d1b/d5d/d86/fdd zero size 2024-09-19T06:40:45.621 INFO:tasks.workunit.client.1.smithi117.stdout:6/699: creat d1/d5/d8/d99/fd0 x:0 0 0 2024-09-19T06:40:45.623 INFO:tasks.workunit.client.1.smithi117.stdout:8/833: unlink d1d/d1e/dbc/dff/l10d 0 2024-09-19T06:40:45.623 INFO:tasks.workunit.client.1.smithi117.stdout:9/950: readlink d4/d1c/d7a/l1b 0 2024-09-19T06:40:45.625 INFO:tasks.workunit.client.1.smithi117.stdout:9/951: readlink d4/d58/lf6 0 2024-09-19T06:40:45.625 INFO:tasks.workunit.client.1.smithi117.stdout:9/952: write d4/d8/f118 [493536,58941] 0 2024-09-19T06:40:45.628 INFO:tasks.workunit.client.0.smithi099.stdout:9/728: dwrite dd/d62/d76/d9a/fce [0,4194304] 0 2024-09-19T06:40:45.628 INFO:tasks.workunit.client.1.smithi117.stdout:9/953: mkdir d4/d1c/d73/db5/d147 0 2024-09-19T06:40:45.631 INFO:tasks.workunit.client.0.smithi099.stdout:4/709: dread d12/d82/fdb [0,4194304] 0 2024-09-19T06:40:45.632 INFO:tasks.workunit.client.1.smithi117.stdout:5/965: truncate d17/d1b/d3a/f68 3239131 0 2024-09-19T06:40:45.634 INFO:tasks.workunit.client.0.smithi099.stdout:9/729: read dd/d2c/d5c/d64/d93/f9b [117527,48244] 0 2024-09-19T06:40:45.634 INFO:tasks.workunit.client.0.smithi099.stdout:4/710: symlink d12/d1b/da4/lf2 0 2024-09-19T06:40:45.635 INFO:tasks.workunit.client.1.smithi117.stdout:6/700: creat d1/d5/d8/db0/fd1 x:0 0 0 2024-09-19T06:40:45.635 INFO:tasks.workunit.client.0.smithi099.stdout:4/711: readlink d12/d82/ld2 0 2024-09-19T06:40:45.636 INFO:tasks.workunit.client.0.smithi099.stdout:4/712: readlink d12/d1b/l92 0 2024-09-19T06:40:45.637 INFO:tasks.workunit.client.1.smithi117.stdout:9/954: mkdir d4/d8/d6a/d82/da3/d148 0 2024-09-19T06:40:45.638 INFO:tasks.workunit.client.0.smithi099.stdout:4/713: readlink d12/l14 0 2024-09-19T06:40:45.641 INFO:tasks.workunit.client.1.smithi117.stdout:9/955: readlink d4/d1c/d73/d93/l9c 0 2024-09-19T06:40:45.642 INFO:tasks.workunit.client.0.smithi099.stdout:4/714: rmdir d12/d32/d42/d97 39 2024-09-19T06:40:45.642 INFO:tasks.workunit.client.0.smithi099.stdout:9/730: dwrite dd/d2c/dd9/fec [0,4194304] 0 2024-09-19T06:40:45.643 INFO:tasks.workunit.client.0.smithi099.stdout:3/891: write d7/d34/d1d/d36/d69/d6d/d7a/f9f [43034,69927] 0 2024-09-19T06:40:45.645 INFO:tasks.workunit.client.0.smithi099.stdout:4/715: fdatasync d12/d82/ddd/fa0 0 2024-09-19T06:40:45.645 INFO:tasks.workunit.client.0.smithi099.stdout:3/892: chown d7/d34/d1d/d57/fbc 487 1 2024-09-19T06:40:45.647 INFO:tasks.workunit.client.0.smithi099.stdout:4/716: write d12/d32/fe7 [850203,128789] 0 2024-09-19T06:40:45.647 INFO:tasks.workunit.client.0.smithi099.stdout:3/893: fdatasync d7/d34/d1d/d20/d58/d5c/fd0 0 2024-09-19T06:40:45.648 INFO:tasks.workunit.client.1.smithi117.stdout:6/701: dwrite d1/d5/d8/f19 [0,4194304] 0 2024-09-19T06:40:45.648 INFO:tasks.workunit.client.0.smithi099.stdout:9/731: creat dd/d65/de4/ff1 x:0 0 0 2024-09-19T06:40:45.650 INFO:tasks.workunit.client.0.smithi099.stdout:3/894: write d7/d34/d1d/d20/d75/fe3 [622066,88161] 0 2024-09-19T06:40:45.650 INFO:tasks.workunit.client.1.smithi117.stdout:7/915: dwrite d1/d72/fab [4194304,4194304] 0 2024-09-19T06:40:45.653 INFO:tasks.workunit.client.1.smithi117.stdout:8/834: write d1d/d2a/d3f/d73/ddd/f89 [484889,93084] 0 2024-09-19T06:40:45.654 INFO:tasks.workunit.client.0.smithi099.stdout:4/717: creat d12/d82/ddd/d8a/da7/ff3 x:0 0 0 2024-09-19T06:40:45.654 INFO:tasks.workunit.client.0.smithi099.stdout:3/895: read - d7/d34/d1d/d20/d58/d5c/fa4 zero size 2024-09-19T06:40:45.654 INFO:tasks.workunit.client.0.smithi099.stdout:9/732: creat dd/dc9/ff2 x:0 0 0 2024-09-19T06:40:45.656 INFO:tasks.workunit.client.0.smithi099.stdout:3/896: readlink d7/d34/d1d/d57/d76/l10e 0 2024-09-19T06:40:45.656 INFO:tasks.workunit.client.0.smithi099.stdout:4/718: truncate d12/d32/f27 2024201 0 2024-09-19T06:40:45.657 INFO:tasks.workunit.client.1.smithi117.stdout:6/702: fdatasync d1/f1d 0 2024-09-19T06:40:45.657 INFO:tasks.workunit.client.1.smithi117.stdout:5/966: dwrite d17/d1b/d3a/d3c/dcb/dde/d55/dd1/d119/f75 [0,4194304] 0 2024-09-19T06:40:45.658 INFO:tasks.workunit.client.1.smithi117.stdout:7/916: mknod d1/d4a/d7c/d95/db5/de2/c142 0 2024-09-19T06:40:45.663 INFO:tasks.workunit.client.0.smithi099.stdout:3/897: read d7/ff [1644426,15207] 0 2024-09-19T06:40:45.667 INFO:tasks.workunit.client.1.smithi117.stdout:6/703: creat d1/d5/d8/d5e/d67/d98/da1/fd2 x:0 0 0 2024-09-19T06:40:45.667 INFO:tasks.workunit.client.1.smithi117.stdout:8/835: readlink d1d/d2a/d3f/d4b/d5f/dbf/dd0/db9/dd6/lf5 0 2024-09-19T06:40:45.667 INFO:tasks.workunit.client.1.smithi117.stdout:7/917: mkdir d1/d72/d100/d143 0 2024-09-19T06:40:45.668 INFO:tasks.workunit.client.0.smithi099.stdout:3/898: write d7/d34/d1d/d36/db8/fcc [4579086,2578] 0 2024-09-19T06:40:45.670 INFO:tasks.workunit.client.0.smithi099.stdout:3/899: truncate d7/d34/d1d/d57/d76/fa8 1939537 0 2024-09-19T06:40:45.670 INFO:tasks.workunit.client.1.smithi117.stdout:5/967: rename d17/d1b/d3a/d3c/dcb/dde/d65/d88/de5/c4d to d17/d1b/d3a/dfe/d136/c145 0 2024-09-19T06:40:45.672 INFO:tasks.workunit.client.1.smithi117.stdout:7/918: stat d1/d3f/d92/d115/c133 0 2024-09-19T06:40:45.673 INFO:tasks.workunit.client.1.smithi117.stdout:7/919: write d1/d4a/d7c/d95/f132 [7264,104943] 0 2024-09-19T06:40:45.675 INFO:tasks.workunit.client.1.smithi117.stdout:6/704: mknod d1/d5/d8/d5e/cd3 0 2024-09-19T06:40:45.675 INFO:tasks.workunit.client.1.smithi117.stdout:5/968: dread d17/d1b/d3a/d3c/dcb/dde/f12f [0,4194304] 0 2024-09-19T06:40:45.676 INFO:tasks.workunit.client.0.smithi099.stdout:3/900: read d7/ff [1693264,21341] 0 2024-09-19T06:40:45.677 INFO:tasks.workunit.client.1.smithi117.stdout:6/705: fsync d1/d5/d8/d80/fac 0 2024-09-19T06:40:45.678 INFO:tasks.workunit.client.1.smithi117.stdout:7/920: readlink d1/l12 0 2024-09-19T06:40:45.679 INFO:tasks.workunit.client.1.smithi117.stdout:8/836: creat d1d/d1e/dbc/dff/d10e/f11a x:0 0 0 2024-09-19T06:40:45.679 INFO:tasks.workunit.client.0.smithi099.stdout:3/901: creat d7/d34/d1d/d36/d69/f113 x:0 0 0 2024-09-19T06:40:45.680 INFO:tasks.workunit.client.0.smithi099.stdout:3/902: dread - d7/d34/d1d/d20/d58/d5c/d98/f100 zero size 2024-09-19T06:40:45.681 INFO:tasks.workunit.client.1.smithi117.stdout:9/956: dwrite d4/d1c/f94 [0,4194304] 0 2024-09-19T06:40:45.681 INFO:tasks.workunit.client.1.smithi117.stdout:9/957: chown d4/d1c/d36/d145 996 1 2024-09-19T06:40:45.682 INFO:tasks.workunit.client.1.smithi117.stdout:6/706: mknod d1/d3d/cd4 0 2024-09-19T06:40:45.683 INFO:tasks.workunit.client.1.smithi117.stdout:5/969: unlink d17/d1b/d5d/c141 0 2024-09-19T06:40:45.684 INFO:tasks.workunit.client.0.smithi099.stdout:3/903: fdatasync d7/d34/d1d/d20/d58/d5c/ff1 0 2024-09-19T06:40:45.686 INFO:tasks.workunit.client.1.smithi117.stdout:9/958: mknod d4/d1c/d7a/d16/dac/c149 0 2024-09-19T06:40:45.686 INFO:tasks.workunit.client.1.smithi117.stdout:6/707: read d1/d14/f4c [2240164,37749] 0 2024-09-19T06:40:45.687 INFO:tasks.workunit.client.1.smithi117.stdout:8/837: creat d1d/d31/dbe/f11b x:0 0 0 2024-09-19T06:40:45.687 INFO:tasks.workunit.client.0.smithi099.stdout:3/904: symlink d7/d34/d1d/d36/db3/l114 0 2024-09-19T06:40:45.688 INFO:tasks.workunit.client.1.smithi117.stdout:5/970: mknod d17/d5c/c146 0 2024-09-19T06:40:45.688 INFO:tasks.workunit.client.0.smithi099.stdout:9/733: write dd/f5b [583027,37246] 0 2024-09-19T06:40:45.692 INFO:tasks.workunit.client.0.smithi099.stdout:9/734: truncate dd/d62/d78/fbe 770482 0 2024-09-19T06:40:45.693 INFO:tasks.workunit.client.0.smithi099.stdout:3/905: creat d7/d34/dd6/f115 x:0 0 0 2024-09-19T06:40:45.694 INFO:tasks.workunit.client.0.smithi099.stdout:4/719: dwrite d12/d82/ddd/fa0 [0,4194304] 0 2024-09-19T06:40:45.694 INFO:tasks.workunit.client.1.smithi117.stdout:8/838: rename d1d/d2a/d3f/d73/feb to d1d/d2a/d3f/d4b/d5f/f11c 0 2024-09-19T06:40:45.694 INFO:tasks.workunit.client.1.smithi117.stdout:6/708: dwrite d1/d5/d8/d5e/f8d [0,4194304] 0 2024-09-19T06:40:45.695 INFO:tasks.workunit.client.0.smithi099.stdout:9/735: creat dd/d65/ff3 x:0 0 0 2024-09-19T06:40:45.697 INFO:tasks.workunit.client.1.smithi117.stdout:5/971: fdatasync d17/d1b/d3a/d3c/dcb/dde/d55/f6e 0 2024-09-19T06:40:45.698 INFO:tasks.workunit.client.1.smithi117.stdout:9/959: mkdir d4/d8/d6a/d82/da3/d148/d14a 0 2024-09-19T06:40:45.699 INFO:tasks.workunit.client.0.smithi099.stdout:3/906: mknod d7/d34/d1d/d20/d58/c116 0 2024-09-19T06:40:45.703 INFO:tasks.workunit.client.1.smithi117.stdout:8/839: symlink d1d/d2a/d3f/d4b/d5f/dbf/d100/l11d 0 2024-09-19T06:40:45.704 INFO:tasks.workunit.client.0.smithi099.stdout:4/720: link d12/d82/ddd/d9b/da2/fd5 d12/d82/ddd/d9b/ff4 0 2024-09-19T06:40:45.704 INFO:tasks.workunit.client.0.smithi099.stdout:9/736: mknod dd/d2c/d79/db4/de2/cf4 0 2024-09-19T06:40:45.705 INFO:tasks.workunit.client.1.smithi117.stdout:6/709: dwrite d1/d5/d8/f90 [0,4194304] 0 2024-09-19T06:40:45.706 INFO:tasks.workunit.client.0.smithi099.stdout:3/907: mkdir d7/d34/d1d/d36/d42/d102/d117 0 2024-09-19T06:40:45.707 INFO:tasks.workunit.client.0.smithi099.stdout:9/737: mkdir dd/dc9/df5 0 2024-09-19T06:40:45.708 INFO:tasks.workunit.client.1.smithi117.stdout:6/710: fsync d1/f41 0 2024-09-19T06:40:45.708 INFO:tasks.workunit.client.0.smithi099.stdout:9/738: chown lc 8652631 1 2024-09-19T06:40:45.708 INFO:tasks.workunit.client.0.smithi099.stdout:4/721: symlink d12/d82/ddd/d8a/da9/lf5 0 2024-09-19T06:40:45.709 INFO:tasks.workunit.client.0.smithi099.stdout:9/739: dread - dd/dc9/ff2 zero size 2024-09-19T06:40:45.710 INFO:tasks.workunit.client.1.smithi117.stdout:8/840: mkdir d1d/d31/d83/dad/d11e 0 2024-09-19T06:40:45.711 INFO:tasks.workunit.client.1.smithi117.stdout:6/711: mkdir d1/d14/dd5 0 2024-09-19T06:40:45.712 INFO:tasks.workunit.client.1.smithi117.stdout:6/712: readlink d1/d3/l62 0 2024-09-19T06:40:45.713 INFO:tasks.workunit.client.1.smithi117.stdout:7/921: dwrite d1/d3f/f109 [0,4194304] 0 2024-09-19T06:40:45.714 INFO:tasks.workunit.client.0.smithi099.stdout:3/908: link d7/d34/d1d/d36/d69/d6d/d7a/f107 d7/d34/d1d/d57/d76/ddf/f118 0 2024-09-19T06:40:45.716 INFO:tasks.workunit.client.0.smithi099.stdout:1/679: sync 2024-09-19T06:40:45.716 INFO:tasks.workunit.client.0.smithi099.stdout:8/679: sync 2024-09-19T06:40:45.716 INFO:tasks.workunit.client.0.smithi099.stdout:0/606: sync 2024-09-19T06:40:45.716 INFO:tasks.workunit.client.0.smithi099.stdout:2/553: sync 2024-09-19T06:40:45.716 INFO:tasks.workunit.client.0.smithi099.stdout:5/884: sync 2024-09-19T06:40:45.717 INFO:tasks.workunit.client.1.smithi117.stdout:6/713: creat d1/d14/fd6 x:0 0 0 2024-09-19T06:40:45.717 INFO:tasks.workunit.client.0.smithi099.stdout:9/740: link lc dd/d47/lf6 0 2024-09-19T06:40:45.718 INFO:tasks.workunit.client.0.smithi099.stdout:5/885: write d3/f9 [1197383,60179] 0 2024-09-19T06:40:45.718 INFO:tasks.workunit.client.0.smithi099.stdout:3/909: mknod d7/d34/d1d/d20/d75/d10d/c119 0 2024-09-19T06:40:45.720 INFO:tasks.workunit.client.0.smithi099.stdout:5/886: readlink d3/d14/l59 0 2024-09-19T06:40:45.720 INFO:tasks.workunit.client.0.smithi099.stdout:3/910: readlink d7/d34/d1d/d20/d75/lfa 0 2024-09-19T06:40:45.720 INFO:tasks.workunit.client.1.smithi117.stdout:8/841: getdents d1d/d2a/d3f/d4b/d91 0 2024-09-19T06:40:45.723 INFO:tasks.workunit.client.0.smithi099.stdout:8/680: stat d4/de/d1c/cdc 0 2024-09-19T06:40:45.726 INFO:tasks.workunit.client.0.smithi099.stdout:2/554: truncate d1/d2/f1f 155266 0 2024-09-19T06:40:45.726 INFO:tasks.workunit.client.1.smithi117.stdout:6/714: dwrite d1/d14/f2b [8388608,4194304] 0 2024-09-19T06:40:45.726 INFO:tasks.workunit.client.1.smithi117.stdout:8/842: truncate d1d/d2a/d3f/d73/ddd/f2b 313749 0 2024-09-19T06:40:45.727 INFO:tasks.workunit.client.0.smithi099.stdout:2/555: fsync d1/d2/d5/d13/d2c/f99 0 2024-09-19T06:40:45.730 INFO:tasks.workunit.client.1.smithi117.stdout:6/715: mknod d1/d5/d8/d27/d77/da8/cd7 0 2024-09-19T06:40:45.733 INFO:tasks.workunit.client.0.smithi099.stdout:1/680: rename d0/d68/c91 to d0/d12/cdb 0 2024-09-19T06:40:45.734 INFO:tasks.workunit.client.0.smithi099.stdout:8/681: dread d4/de/d14/fa6 [0,4194304] 0 2024-09-19T06:40:45.734 INFO:tasks.workunit.client.1.smithi117.stdout:9/960: truncate d4/d1c/d7a/d69/d12c/f141 1603843 0 2024-09-19T06:40:45.737 INFO:tasks.workunit.client.0.smithi099.stdout:3/911: link d7/d34/d1d/d20/d58/fc7 d7/d34/d1d/d20/d58/d5c/d98/f11a 0 2024-09-19T06:40:45.739 INFO:tasks.workunit.client.0.smithi099.stdout:5/887: getdents d3/d16 0 2024-09-19T06:40:45.739 INFO:tasks.workunit.client.1.smithi117.stdout:7/922: dread d1/d4a/d81/f2c [4194304,4194304] 0 2024-09-19T06:40:45.741 INFO:tasks.workunit.client.0.smithi099.stdout:8/682: mknod d4/d8a/dda/ce4 0 2024-09-19T06:40:45.742 INFO:tasks.workunit.client.0.smithi099.stdout:1/681: mknod d0/cdc 0 2024-09-19T06:40:45.743 INFO:tasks.workunit.client.1.smithi117.stdout:9/961: getdents d4/d1c/d7a/d69 0 2024-09-19T06:40:45.743 INFO:tasks.workunit.client.1.smithi117.stdout:8/843: write d1d/d1e/f58 [248836,41967] 0 2024-09-19T06:40:45.743 INFO:tasks.workunit.client.0.smithi099.stdout:1/682: chown d0/d17/d24/d75 192 1 2024-09-19T06:40:45.745 INFO:tasks.workunit.client.0.smithi099.stdout:4/722: truncate d12/d32/d42/f93 2868511 0 2024-09-19T06:40:45.746 INFO:tasks.workunit.client.1.smithi117.stdout:8/844: creat d1d/d1e/dbc/dff/d10e/f11f x:0 0 0 2024-09-19T06:40:45.746 INFO:tasks.workunit.client.0.smithi099.stdout:4/723: write d12/d32/f72 [3863430,126518] 0 2024-09-19T06:40:45.747 INFO:tasks.workunit.client.0.smithi099.stdout:4/724: stat l7 0 2024-09-19T06:40:45.747 INFO:tasks.workunit.client.0.smithi099.stdout:3/912: rename d7/f14 to d7/d34/d1d/d20/d58/d5c/d98/dde/f11b 0 2024-09-19T06:40:45.749 INFO:tasks.workunit.client.0.smithi099.stdout:5/888: getdents d3/d16/d5e/db1/d106 0 2024-09-19T06:40:45.750 INFO:tasks.workunit.client.1.smithi117.stdout:8/845: rmdir d1d/d2a/d3f/d4b/d66/dac 39 2024-09-19T06:40:45.750 INFO:tasks.workunit.client.0.smithi099.stdout:4/725: write d12/d1b/d88/fbd [887520,117812] 0 2024-09-19T06:40:45.752 INFO:tasks.workunit.client.1.smithi117.stdout:9/962: dwrite d4/d1c/d46/f12a [0,4194304] 0 2024-09-19T06:40:45.753 INFO:tasks.workunit.client.1.smithi117.stdout:9/963: dread - d4/d1c/d5f/f11b zero size 2024-09-19T06:40:45.753 INFO:tasks.workunit.client.1.smithi117.stdout:8/846: unlink d1d/d1e/dbc/dc1/d105/l111 0 2024-09-19T06:40:45.754 INFO:tasks.workunit.client.0.smithi099.stdout:1/683: dread d0/d12/d13/d37/d48/f4b [0,4194304] 0 2024-09-19T06:40:45.756 INFO:tasks.workunit.client.1.smithi117.stdout:8/847: chown d1d/d2a/d3f/d4b/d66/dac/l88 15190 1 2024-09-19T06:40:45.756 INFO:tasks.workunit.client.1.smithi117.stdout:9/964: dread - d4/d8/d6a/d82/dc8/fca zero size 2024-09-19T06:40:45.757 INFO:tasks.workunit.client.0.smithi099.stdout:0/607: dwrite d0/db/d27/f2c [0,4194304] 0 2024-09-19T06:40:45.758 INFO:tasks.workunit.client.1.smithi117.stdout:9/965: read - d4/d1c/d36/fe0 zero size 2024-09-19T06:40:45.760 INFO:tasks.workunit.client.0.smithi099.stdout:1/684: mknod d0/d12/d13/d37/d41/cdd 0 2024-09-19T06:40:45.763 INFO:tasks.workunit.client.0.smithi099.stdout:8/683: getdents d4/d11/d23/d4c/ddd 0 2024-09-19T06:40:45.763 INFO:tasks.workunit.client.0.smithi099.stdout:0/608: mkdir d0/d17/d41/dc6 0 2024-09-19T06:40:45.764 INFO:tasks.workunit.client.1.smithi117.stdout:8/848: rename d1d/d1e/d53/f7a to d1d/d1e/d3b/f120 0 2024-09-19T06:40:45.765 INFO:tasks.workunit.client.0.smithi099.stdout:3/913: rename d7/d34/d28/c85 to d7/d34/d1d/d20/d75/c11c 0 2024-09-19T06:40:45.766 INFO:tasks.workunit.client.0.smithi099.stdout:2/556: dread d1/d2/d4d/d55/da5/f2b [0,4194304] 0 2024-09-19T06:40:45.766 INFO:tasks.workunit.client.0.smithi099.stdout:0/609: chown d0/db/d27/fb7 317 1 2024-09-19T06:40:45.767 INFO:tasks.workunit.client.0.smithi099.stdout:1/685: creat d0/d68/fde x:0 0 0 2024-09-19T06:40:45.768 INFO:tasks.workunit.client.0.smithi099.stdout:4/726: creat d12/ff6 x:0 0 0 2024-09-19T06:40:45.768 INFO:tasks.workunit.client.1.smithi117.stdout:9/966: getdents d4/d8/d6e/da4 0 2024-09-19T06:40:45.772 INFO:tasks.workunit.client.0.smithi099.stdout:3/914: mknod d7/d34/d1d/d36/db3/de0/de9/c11d 0 2024-09-19T06:40:45.773 INFO:tasks.workunit.client.1.smithi117.stdout:8/849: dwrite d1d/d2a/d3f/d4b/d5f/dbf/ff7 [0,4194304] 0 2024-09-19T06:40:45.774 INFO:tasks.workunit.client.1.smithi117.stdout:9/967: link d4/d1c/d54/dd8/fb8 d4/d8/d6a/d82/dc8/f14b 0 2024-09-19T06:40:45.775 INFO:tasks.workunit.client.0.smithi099.stdout:1/686: write d0/d12/d54/f7e [4528597,87452] 0 2024-09-19T06:40:45.776 INFO:tasks.workunit.client.0.smithi099.stdout:1/687: chown d0/d12/d13/d37 0 1 2024-09-19T06:40:45.778 INFO:tasks.workunit.client.0.smithi099.stdout:2/557: rename d1/d2/d4d/d55/c8d to d1/d2/d4d/d55/da5/d18/d27/d5b/cbb 0 2024-09-19T06:40:45.779 INFO:tasks.workunit.client.1.smithi117.stdout:8/850: creat d1d/d31/d83/f121 x:0 0 0 2024-09-19T06:40:45.779 INFO:tasks.workunit.client.0.smithi099.stdout:2/558: stat d1/d2/d4d/d55/da5/d36 0 2024-09-19T06:40:45.781 INFO:tasks.workunit.client.0.smithi099.stdout:3/915: symlink d7/d34/d1d/d36/d42/l11e 0 2024-09-19T06:40:45.781 INFO:tasks.workunit.client.0.smithi099.stdout:1/688: creat d0/d68/daf/fdf x:0 0 0 2024-09-19T06:40:45.784 INFO:tasks.workunit.client.0.smithi099.stdout:2/559: readlink d1/d2/d5/l6e 0 2024-09-19T06:40:45.784 INFO:tasks.workunit.client.0.smithi099.stdout:3/916: rmdir d7/d34/d1d/d36/dc5 39 2024-09-19T06:40:45.785 INFO:tasks.workunit.client.0.smithi099.stdout:8/684: truncate d4/de/d14/f65 127041 0 2024-09-19T06:40:45.787 INFO:tasks.workunit.client.1.smithi117.stdout:9/968: dwrite d4/d1c/d73/d93/f140 [0,4194304] 0 2024-09-19T06:40:45.787 INFO:tasks.workunit.client.0.smithi099.stdout:2/560: symlink d1/d2/d4d/d55/da5/d18/d2d/d88/lbc 0 2024-09-19T06:40:45.790 INFO:tasks.workunit.client.0.smithi099.stdout:0/610: dwrite d0/fa7 [0,4194304] 0 2024-09-19T06:40:45.792 INFO:tasks.workunit.client.1.smithi117.stdout:9/969: truncate d4/d1c/d7a/d52/f12f 2226949 0 2024-09-19T06:40:45.793 INFO:tasks.workunit.client.0.smithi099.stdout:1/689: link d0/d12/d13/cb2 d0/d17/d5b/ce0 0 2024-09-19T06:40:45.794 INFO:tasks.workunit.client.1.smithi117.stdout:8/851: dwrite d1d/d1e/f32 [0,4194304] 0 2024-09-19T06:40:45.797 INFO:tasks.workunit.client.0.smithi099.stdout:2/561: dread d1/d2/d5/d6/f87 [0,4194304] 0 2024-09-19T06:40:45.798 INFO:tasks.workunit.client.0.smithi099.stdout:1/690: unlink d0/f7f 0 2024-09-19T06:40:45.799 INFO:tasks.workunit.client.0.smithi099.stdout:0/611: rmdir d0/db/d27/d5d/d87/da2/dbc/d1f/d39 39 2024-09-19T06:40:45.802 INFO:tasks.workunit.client.0.smithi099.stdout:8/685: dwrite d4/de/d26/d2b/f52 [0,4194304] 0 2024-09-19T06:40:45.803 INFO:tasks.workunit.client.1.smithi117.stdout:9/970: dwrite d4/d1c/d54/dd8/dae/db4/ffc [0,4194304] 0 2024-09-19T06:40:45.806 INFO:tasks.workunit.client.0.smithi099.stdout:1/691: mkdir d0/d17/d24/d75/dbb/de1 0 2024-09-19T06:40:45.806 INFO:tasks.workunit.client.0.smithi099.stdout:3/917: dread d7/f15 [0,4194304] 0 2024-09-19T06:40:45.809 INFO:tasks.workunit.client.0.smithi099.stdout:2/562: rename d1/d2/d4d/d55/da5/d18/d27/f72 to d1/d2/d4d/d55/da5/d18/d27/d5b/d92/fbd 0 2024-09-19T06:40:45.810 INFO:tasks.workunit.client.0.smithi099.stdout:8/686: creat d4/d66/fe5 x:0 0 0 2024-09-19T06:40:45.811 INFO:tasks.workunit.client.1.smithi117.stdout:9/971: dwrite d4/d20/f139 [0,4194304] 0 2024-09-19T06:40:45.813 INFO:tasks.workunit.client.1.smithi117.stdout:9/972: dread d4/d17/dd7/f112 [0,4194304] 0 2024-09-19T06:40:45.813 INFO:tasks.workunit.client.0.smithi099.stdout:2/563: dread - d1/d2/d5/d13/d2c/f99 zero size 2024-09-19T06:40:45.814 INFO:tasks.workunit.client.0.smithi099.stdout:3/918: rename d7/d34/d1d/d36/db8 to d7/d34/d1d/d20/d75/d10d/d11f 0 2024-09-19T06:40:45.815 INFO:tasks.workunit.client.0.smithi099.stdout:2/564: readlink d1/d2/d5/d13/d2c/l73 0 2024-09-19T06:40:45.816 INFO:tasks.workunit.client.1.smithi117.stdout:9/973: symlink d4/d1c/d54/dd8/dae/l14c 0 2024-09-19T06:40:45.816 INFO:tasks.workunit.client.0.smithi099.stdout:8/687: symlink d4/d11/le6 0 2024-09-19T06:40:45.817 INFO:tasks.workunit.client.0.smithi099.stdout:3/919: creat d7/d34/d1d/d36/d42/d102/f120 x:0 0 0 2024-09-19T06:40:45.818 INFO:tasks.workunit.client.1.smithi117.stdout:9/974: fdatasync d4/f24 0 2024-09-19T06:40:45.818 INFO:tasks.workunit.client.0.smithi099.stdout:2/565: creat d1/d2/d4d/d55/da5/d18/d2d/fbe x:0 0 0 2024-09-19T06:40:45.820 INFO:tasks.workunit.client.1.smithi117.stdout:9/975: write d4/d8/f118 [784423,13281] 0 2024-09-19T06:40:45.820 INFO:tasks.workunit.client.0.smithi099.stdout:2/566: rmdir d1/d2/d5/d77 39 2024-09-19T06:40:45.821 INFO:tasks.workunit.client.0.smithi099.stdout:2/567: chown d1/d2/d4d/d55/d79/cba 2262 1 2024-09-19T06:40:45.822 INFO:tasks.workunit.client.1.smithi117.stdout:9/976: creat d4/d8/d6a/d82/f14d x:0 0 0 2024-09-19T06:40:45.824 INFO:tasks.workunit.client.0.smithi099.stdout:2/568: mknod d1/d2/d4d/d55/da5/d18/d2d/cbf 0 2024-09-19T06:40:45.827 INFO:tasks.workunit.client.0.smithi099.stdout:2/569: creat d1/d2/fc0 x:0 0 0 2024-09-19T06:40:45.829 INFO:tasks.workunit.client.1.smithi117.stdout:9/977: dwrite d4/d1c/d54/dd8/fb7 [0,4194304] 0 2024-09-19T06:40:45.830 INFO:tasks.workunit.client.0.smithi099.stdout:2/570: dread d1/d2/d5/f81 [0,4194304] 0 2024-09-19T06:40:45.831 INFO:tasks.workunit.client.0.smithi099.stdout:2/571: dread - d1/d2/d4d/d55/da5/d18/d27/d5b/fb5 zero size 2024-09-19T06:40:45.831 INFO:tasks.workunit.client.1.smithi117.stdout:8/852: dread d1d/d2a/d3f/d73/ddd/fb4 [0,4194304] 0 2024-09-19T06:40:45.832 INFO:tasks.workunit.client.0.smithi099.stdout:2/572: chown d1/d2/d4d/d55/da5/d18/d2d/d88/lb3 343810 1 2024-09-19T06:40:45.835 INFO:tasks.workunit.client.1.smithi117.stdout:8/853: rename d1d/d31/c39 to d1d/d2a/d3f/d73/ddd/c122 0 2024-09-19T06:40:45.837 INFO:tasks.workunit.client.1.smithi117.stdout:9/978: write d4/d1c/d36/f4f [1953446,35143] 0 2024-09-19T06:40:45.838 INFO:tasks.workunit.client.1.smithi117.stdout:8/854: creat d1d/d2a/d3f/d4b/d5f/dbf/dd0/db9/f123 x:0 0 0 2024-09-19T06:40:45.838 INFO:tasks.workunit.client.1.smithi117.stdout:9/979: readlink d4/d1c/l92 0 2024-09-19T06:40:45.839 INFO:tasks.workunit.client.1.smithi117.stdout:9/980: chown d4/d1c/d36/f77 3964324 1 2024-09-19T06:40:45.840 INFO:tasks.workunit.client.1.smithi117.stdout:9/981: stat d4/d1c/d36/fad 0 2024-09-19T06:40:45.840 INFO:tasks.workunit.client.0.smithi099.stdout:3/920: dwrite d7/d34/f88 [4194304,4194304] 0 2024-09-19T06:40:45.841 INFO:tasks.workunit.client.1.smithi117.stdout:8/855: creat d1d/d1e/dbc/dff/d10e/f124 x:0 0 0 2024-09-19T06:40:45.841 INFO:tasks.workunit.client.1.smithi117.stdout:9/982: dread - d4/d17/dd7/f10e zero size 2024-09-19T06:40:45.841 INFO:tasks.workunit.client.0.smithi099.stdout:3/921: chown d7/d34/d1d/d20/d58/d5c/c60 43582294 1 2024-09-19T06:40:45.842 INFO:tasks.workunit.client.1.smithi117.stdout:9/983: truncate d4/d17/f97 4540228 0 2024-09-19T06:40:45.843 INFO:tasks.workunit.client.0.smithi099.stdout:3/922: mkdir d7/d34/dd6/d121 0 2024-09-19T06:40:45.844 INFO:tasks.workunit.client.1.smithi117.stdout:9/984: rmdir d4/d1c/d36/d37/d11f 39 2024-09-19T06:40:45.846 INFO:tasks.workunit.client.0.smithi099.stdout:3/923: symlink d7/d34/d1d/d36/db3/de0/l122 0 2024-09-19T06:40:45.846 INFO:tasks.workunit.client.1.smithi117.stdout:9/985: creat d4/d1c/d73/f14e x:0 0 0 2024-09-19T06:40:45.847 INFO:tasks.workunit.client.1.smithi117.stdout:9/986: chown d4/d8/d12d 141 1 2024-09-19T06:40:45.848 INFO:tasks.workunit.client.1.smithi117.stdout:9/987: write d4/d1c/d7a/f13c [30728,31824] 0 2024-09-19T06:40:45.848 INFO:tasks.workunit.client.0.smithi099.stdout:6/673: sync 2024-09-19T06:40:45.848 INFO:tasks.workunit.client.0.smithi099.stdout:7/863: sync 2024-09-19T06:40:45.853 INFO:tasks.workunit.client.1.smithi117.stdout:9/988: link d4/d20/fc2 d4/d17/dd7/d100/f14f 0 2024-09-19T06:40:45.854 INFO:tasks.workunit.client.0.smithi099.stdout:3/924: dwrite d7/d34/d1d/d36/db3/de0/de9/f106 [0,4194304] 0 2024-09-19T06:40:45.856 INFO:tasks.workunit.client.1.smithi117.stdout:9/989: symlink d4/d1c/d7a/d69/d12c/d133/l150 0 2024-09-19T06:40:45.860 INFO:tasks.workunit.client.1.smithi117.stdout:9/990: mkdir d4/d1c/d7a/d69/d13e/d151 0 2024-09-19T06:40:45.860 INFO:tasks.workunit.client.0.smithi099.stdout:6/674: dwrite d1/d5/d24/d2e/d41/f8d [4194304,4194304] 0 2024-09-19T06:40:45.862 INFO:tasks.workunit.client.0.smithi099.stdout:6/675: dread - d1/d5/d24/d2e/f70 zero size 2024-09-19T06:40:45.863 INFO:tasks.workunit.client.0.smithi099.stdout:7/864: rmdir d7/dcf/d29/d34/d8f 39 2024-09-19T06:40:45.872 INFO:tasks.workunit.client.0.smithi099.stdout:7/865: creat d7/dcf/d29/d1f/d45/d48/ddc/f13b x:0 0 0 2024-09-19T06:40:45.876 INFO:tasks.workunit.client.0.smithi099.stdout:6/676: link d1/d12/f27 d1/d5/d38/d76/db0/d54/d5d/d61/fdd 0 2024-09-19T06:40:45.878 INFO:tasks.workunit.client.0.smithi099.stdout:7/866: dwrite d7/dcf/d29/d1f/d45/fdf [4194304,4194304] 0 2024-09-19T06:40:45.881 INFO:tasks.workunit.client.0.smithi099.stdout:6/677: rename d1/d5/d24/d2e/d41/l4d to d1/d12/dda/lde 0 2024-09-19T06:40:45.884 INFO:tasks.workunit.client.0.smithi099.stdout:6/678: creat d1/d5/d24/d2e/d7b/dba/fdf x:0 0 0 2024-09-19T06:40:45.885 INFO:tasks.workunit.client.0.smithi099.stdout:6/679: write d1/f1e [454299,129797] 0 2024-09-19T06:40:45.888 INFO:tasks.workunit.client.0.smithi099.stdout:6/680: rmdir d1/d5/d38/d76/db0/d2a 39 2024-09-19T06:40:45.894 INFO:tasks.workunit.client.0.smithi099.stdout:6/681: dwrite d1/d5/d24/d2b/f80 [0,4194304] 0 2024-09-19T06:40:45.903 INFO:tasks.workunit.client.0.smithi099.stdout:6/682: dwrite d1/d5/d38/dbb/fbe [0,4194304] 0 2024-09-19T06:40:45.924 INFO:tasks.workunit.client.0.smithi099.stdout:0/612: dread d0/f3 [4194304,4194304] 0 2024-09-19T06:40:45.927 INFO:tasks.workunit.client.0.smithi099.stdout:0/613: creat d0/db/d27/d5d/d87/da2/dbc/d59/fc7 x:0 0 0 2024-09-19T06:40:45.933 INFO:tasks.workunit.client.0.smithi099.stdout:0/614: dwrite d0/db/d27/d5d/d87/da2/dbc/d1f/d4a/d61/f8c [0,4194304] 0 2024-09-19T06:40:45.935 INFO:tasks.workunit.client.0.smithi099.stdout:3/925: dread d7/f4d [0,4194304] 0 2024-09-19T06:40:45.938 INFO:tasks.workunit.client.1.smithi117.stdout:0/851: sync 2024-09-19T06:40:45.938 INFO:tasks.workunit.client.0.smithi099.stdout:3/926: write d7/d34/d1d/d36/d69/f112 [809472,91916] 0 2024-09-19T06:40:45.940 INFO:tasks.workunit.client.0.smithi099.stdout:7/867: dwrite d7/dcf/d29/d1f/d45/d48/fe2 [0,4194304] 0 2024-09-19T06:40:45.944 INFO:tasks.workunit.client.0.smithi099.stdout:7/868: mkdir d7/dcf/d29/d1f/deb/d13c 0 2024-09-19T06:40:45.946 INFO:tasks.workunit.client.0.smithi099.stdout:3/927: rename d7/d34/d1d/d36/d69/d96/fa0 to d7/d34/d1d/d57/d76/f123 0 2024-09-19T06:40:45.946 INFO:tasks.workunit.client.1.smithi117.stdout:0/852: dwrite d11/d13/d28/f92 [4194304,4194304] 0 2024-09-19T06:40:45.947 INFO:tasks.workunit.client.0.smithi099.stdout:3/928: chown d7/d34/l10c 10078 1 2024-09-19T06:40:45.947 INFO:tasks.workunit.client.0.smithi099.stdout:0/615: link d0/db/d27/d5d/d87/da2/dbc/d1f/lb9 d0/db/lc8 0 2024-09-19T06:40:45.953 INFO:tasks.workunit.client.1.smithi117.stdout:9/991: dwrite d4/d1c/d73/d93/fff [0,4194304] 0 2024-09-19T06:40:45.953 INFO:tasks.workunit.client.0.smithi099.stdout:3/929: stat d7/d34/d1d/d20/d75/ca1 0 2024-09-19T06:40:45.955 INFO:tasks.workunit.client.0.smithi099.stdout:0/616: creat d0/db/d2f/fc9 x:0 0 0 2024-09-19T06:40:45.955 INFO:tasks.workunit.client.0.smithi099.stdout:7/869: read - d7/dc7/fdb zero size 2024-09-19T06:40:45.957 INFO:tasks.workunit.client.1.smithi117.stdout:0/853: getdents d11/d13/d14/d2c/d53/d7e 0 2024-09-19T06:40:45.959 INFO:tasks.workunit.client.0.smithi099.stdout:0/617: rename d0/db/d36/f9f to d0/d17/fca 0 2024-09-19T06:40:45.960 INFO:tasks.workunit.client.1.smithi117.stdout:9/992: getdents d4/d8 0 2024-09-19T06:40:45.961 INFO:tasks.workunit.client.0.smithi099.stdout:3/930: link d7/d34/d1d/d20/d75/d79/fda d7/d34/d1d/d36/d42/d102/f124 0 2024-09-19T06:40:45.961 INFO:tasks.workunit.client.0.smithi099.stdout:3/931: chown d7/d34/l10c 122955170 1 2024-09-19T06:40:45.962 INFO:tasks.workunit.client.0.smithi099.stdout:0/618: fsync d0/db/d27/d5d/d87/da2/dbc/d1f/d4a/f50 0 2024-09-19T06:40:45.964 INFO:tasks.workunit.client.0.smithi099.stdout:7/870: mknod d7/dcf/d29/d1f/deb/d13c/c13d 0 2024-09-19T06:40:45.965 INFO:tasks.workunit.client.0.smithi099.stdout:3/932: write d7/d34/d1d/d36/d69/d6d/d7a/fe7 [87653,110123] 0 2024-09-19T06:40:45.965 INFO:tasks.workunit.client.0.smithi099.stdout:0/619: fdatasync d0/d17/d41/f49 0 2024-09-19T06:40:45.966 INFO:tasks.workunit.client.1.smithi117.stdout:0/854: dwrite d11/d13/d7a/fb4 [0,4194304] 0 2024-09-19T06:40:45.967 INFO:tasks.workunit.client.0.smithi099.stdout:0/620: truncate d0/db/d2f/fc9 864321 0 2024-09-19T06:40:45.968 INFO:tasks.workunit.client.0.smithi099.stdout:0/621: chown d0/db/d2f 1050582958 1 2024-09-19T06:40:45.969 INFO:tasks.workunit.client.1.smithi117.stdout:0/855: creat d11/d13/d28/d38/d5b/f11b x:0 0 0 2024-09-19T06:40:45.969 INFO:tasks.workunit.client.0.smithi099.stdout:7/871: symlink d7/d39/d7d/dd6/l13e 0 2024-09-19T06:40:45.970 INFO:tasks.workunit.client.0.smithi099.stdout:0/622: fsync d0/db/d27/d5d/d87/da2/dbc/d37/fc2 0 2024-09-19T06:40:45.970 INFO:tasks.workunit.client.1.smithi117.stdout:0/856: fdatasync d11/d13/d28/dfe/f101 0 2024-09-19T06:40:45.970 INFO:tasks.workunit.client.1.smithi117.stdout:0/857: stat d11/d13/d28/d38 0 2024-09-19T06:40:45.970 INFO:tasks.workunit.client.1.smithi117.stdout:0/858: stat d11/d13/d28/dfe/f101 0 2024-09-19T06:40:45.973 INFO:tasks.workunit.client.1.smithi117.stdout:0/859: mknod d11/d13/d14/dbd/d10d/c11c 0 2024-09-19T06:40:45.973 INFO:tasks.workunit.client.0.smithi099.stdout:7/872: dread - d7/dcf/d29/d34/fd1 zero size 2024-09-19T06:40:45.976 INFO:tasks.workunit.client.0.smithi099.stdout:0/623: creat d0/db/d27/d5d/d87/da2/dbc/d1f/d39/fcb x:0 0 0 2024-09-19T06:40:45.977 INFO:tasks.workunit.client.0.smithi099.stdout:3/933: dwrite d7/d34/d1d/d36/d42/d102/f124 [0,4194304] 0 2024-09-19T06:40:45.978 INFO:tasks.workunit.client.1.smithi117.stdout:9/993: write d4/d1c/d5f/f11b [375752,114870] 0 2024-09-19T06:40:45.978 INFO:tasks.workunit.client.0.smithi099.stdout:0/624: chown d0/db/d27/d5d/d87/da2 12761934 1 2024-09-19T06:40:45.979 INFO:tasks.workunit.client.0.smithi099.stdout:7/873: symlink d7/dcf/d29/l13f 0 2024-09-19T06:40:45.979 INFO:tasks.workunit.client.1.smithi117.stdout:9/994: readlink d4/d8/d6a/d82/da3/le9 0 2024-09-19T06:40:45.980 INFO:tasks.workunit.client.0.smithi099.stdout:3/934: chown d7/d34/d1d/d20/d75/d10d 33777 1 2024-09-19T06:40:45.980 INFO:tasks.workunit.client.0.smithi099.stdout:7/874: fdatasync d7/dc7/f6e 0 2024-09-19T06:40:45.983 INFO:tasks.workunit.client.0.smithi099.stdout:0/625: mknod d0/db/d27/d5d/d87/da2/dbc/d1f/d8e/ccc 0 2024-09-19T06:40:45.988 INFO:tasks.workunit.client.0.smithi099.stdout:7/875: creat d7/dcf/d29/d34/f140 x:0 0 0 2024-09-19T06:40:45.989 INFO:tasks.workunit.client.0.smithi099.stdout:7/876: readlink d7/dcf/d29/lb3 0 2024-09-19T06:40:45.989 INFO:tasks.workunit.client.0.smithi099.stdout:0/626: creat d0/db/d27/d5d/d87/da2/dbc/d1f/d3a/dbf/fcd x:0 0 0 2024-09-19T06:40:45.992 INFO:tasks.workunit.client.0.smithi099.stdout:7/877: fsync d7/dcf/d29/d1f/f2a 0 2024-09-19T06:40:45.993 INFO:tasks.workunit.client.0.smithi099.stdout:7/878: write d7/dcf/d29/f1e [5156788,99319] 0 2024-09-19T06:40:45.993 INFO:tasks.workunit.client.0.smithi099.stdout:0/627: rmdir d0/db/d27/d5d/d87/da2/dbc/d1f/d4a/d61 39 2024-09-19T06:40:45.995 INFO:tasks.workunit.client.0.smithi099.stdout:0/628: readlink d0/db/d2f/l7f 0 2024-09-19T06:40:45.997 INFO:tasks.workunit.client.0.smithi099.stdout:7/879: creat d7/dcf/d29/d1f/d45/d48/f141 x:0 0 0 2024-09-19T06:40:45.997 INFO:tasks.workunit.client.0.smithi099.stdout:0/629: fsync d0/db/d27/d5d/d87/da2/dbc/d1f/db4/fc4 0 2024-09-19T06:40:46.000 INFO:tasks.workunit.client.0.smithi099.stdout:0/630: symlink d0/db/d27/d5d/d87/da2/dbc/d37/d3c/lce 0 2024-09-19T06:40:46.002 INFO:tasks.workunit.client.1.smithi117.stdout:0/860: truncate d11/d13/d28/f43 3830474 0 2024-09-19T06:40:46.004 INFO:tasks.workunit.client.0.smithi099.stdout:0/631: dread d0/db/d2f/fc3 [0,4194304] 0 2024-09-19T06:40:46.005 INFO:tasks.workunit.client.0.smithi099.stdout:3/935: write d7/d34/d1d/d20/d58/d5c/d98/f11a [55168,106578] 0 2024-09-19T06:40:46.005 INFO:tasks.workunit.client.1.smithi117.stdout:0/861: creat d11/d13/d14/d2c/d53/d103/f11d x:0 0 0 2024-09-19T06:40:46.006 INFO:tasks.workunit.client.1.smithi117.stdout:0/862: fdatasync d11/d13/d1b/d27/d37/da9/fde 0 2024-09-19T06:40:46.007 INFO:tasks.workunit.client.0.smithi099.stdout:3/936: write d7/f49 [51134,16267] 0 2024-09-19T06:40:46.008 INFO:tasks.workunit.client.0.smithi099.stdout:7/880: write d7/dcf/d29/d1f/d45/d48/d63/f10f [587553,16864] 0 2024-09-19T06:40:46.008 INFO:tasks.workunit.client.1.smithi117.stdout:0/863: fsync d11/d13/d1b/d27/d54/ff8 0 2024-09-19T06:40:46.010 INFO:tasks.workunit.client.0.smithi099.stdout:0/632: mkdir d0/db/d27/d5d/d87/da2/dbc/d47/d75/da4/dcf 0 2024-09-19T06:40:46.011 INFO:tasks.workunit.client.1.smithi117.stdout:9/995: dread d4/d1c/f35 [0,4194304] 0 2024-09-19T06:40:46.012 INFO:tasks.workunit.client.0.smithi099.stdout:3/937: rename d7/d34/d1d/d36/d69/fc3 to d7/d34/d1d/d57/d76/f125 0 2024-09-19T06:40:46.013 INFO:tasks.workunit.client.1.smithi117.stdout:9/996: creat d4/d17/dd7/f152 x:0 0 0 2024-09-19T06:40:46.014 INFO:tasks.workunit.client.0.smithi099.stdout:7/881: write d7/dc7/f9d [1064823,130163] 0 2024-09-19T06:40:46.015 INFO:tasks.workunit.client.1.smithi117.stdout:0/864: rename d11/d13/d14/d2c/d53/d7e/daa/dca to d11/d13/d11e 0 2024-09-19T06:40:46.015 INFO:tasks.workunit.client.0.smithi099.stdout:0/633: read d0/d17/d41/f3d [3440406,88567] 0 2024-09-19T06:40:46.016 INFO:tasks.workunit.client.1.smithi117.stdout:0/865: chown d11/d13/d14/d2c/f36 6 1 2024-09-19T06:40:46.016 INFO:tasks.workunit.client.0.smithi099.stdout:3/938: rename d7/d34/d1d/d36/d69/d6d/d8f to d7/d34/d1d/d57/d76/d126 0 2024-09-19T06:40:46.017 INFO:tasks.workunit.client.0.smithi099.stdout:7/882: creat d7/dcf/d29/d1f/d45/d48/dda/d115/f142 x:0 0 0 2024-09-19T06:40:46.018 INFO:tasks.workunit.client.1.smithi117.stdout:9/997: rename d4/d17/l32 to d4/d8/d6e/da4/l153 0 2024-09-19T06:40:46.020 INFO:tasks.workunit.client.0.smithi099.stdout:7/883: mknod d7/dc7/d67/c143 0 2024-09-19T06:40:46.022 INFO:tasks.workunit.client.0.smithi099.stdout:7/884: chown d7/dcf/d29/d34/da1/fa9 6 1 2024-09-19T06:40:46.023 INFO:tasks.workunit.client.0.smithi099.stdout:0/634: link d0/db/d27/d5d/d87/da2/dbc/d1f/lb9 d0/db/d36/ld0 0 2024-09-19T06:40:46.025 INFO:tasks.workunit.client.1.smithi117.stdout:9/998: dwrite d4/d1c/d7a/d16/dac/f13b [0,4194304] 0 2024-09-19T06:40:46.026 INFO:tasks.workunit.client.1.smithi117.stdout:9/999: stat d4/d58/fc3 0 2024-09-19T06:40:46.031 INFO:tasks.workunit.client.1.smithi117.stdout:0/866: dwrite d11/d13/d1b/d27/d37/f91 [0,4194304] 0 2024-09-19T06:40:46.032 INFO:tasks.workunit.client.0.smithi099.stdout:3/939: dread d7/d34/d1d/d20/d58/d5c/f90 [0,4194304] 0 2024-09-19T06:40:46.033 INFO:tasks.workunit.client.0.smithi099.stdout:7/885: dread d7/dcf/d29/d1f/d45/d48/fe2 [0,4194304] 0 2024-09-19T06:40:46.034 INFO:tasks.workunit.client.1.smithi117.stdout:0/867: rmdir d11/d13/d14/d2c/d53/d7e/daa 39 2024-09-19T06:40:46.036 INFO:tasks.workunit.client.1.smithi117.stdout:0/868: truncate d11/d13/d1b/d27/d37/da9/fea 554434 0 2024-09-19T06:40:46.041 INFO:tasks.workunit.client.1.smithi117.stdout:0/869: rename d11/d13/d28/d38/d5b to d11/d13/d14/d16/da1/d11f 0 2024-09-19T06:40:46.044 INFO:tasks.workunit.client.1.smithi117.stdout:2/915: sync 2024-09-19T06:40:46.045 INFO:tasks.workunit.client.1.smithi117.stdout:2/916: symlink d0/d7/d1e/d20/l150 0 2024-09-19T06:40:46.046 INFO:tasks.workunit.client.1.smithi117.stdout:2/917: write d0/d12/f106 [38043,15075] 0 2024-09-19T06:40:46.048 INFO:tasks.workunit.client.1.smithi117.stdout:2/918: truncate d0/d12/d32/f10e 988245 0 2024-09-19T06:40:46.049 INFO:tasks.workunit.client.0.smithi099.stdout:0/635: mkdir d0/db/d27/d5d/d87/da2/dbc/d37/d3c/d3e/dd1 0 2024-09-19T06:40:46.049 INFO:tasks.workunit.client.0.smithi099.stdout:7/886: stat d7/dcf/d29/d34/d8f/ff1 0 2024-09-19T06:40:46.050 INFO:tasks.workunit.client.0.smithi099.stdout:3/940: creat d7/d34/d1d/d36/d69/d96/f127 x:0 0 0 2024-09-19T06:40:46.051 INFO:tasks.workunit.client.0.smithi099.stdout:0/636: mkdir d0/db/dc0/dd2 0 2024-09-19T06:40:46.051 INFO:tasks.workunit.client.0.smithi099.stdout:3/941: dread - d7/d34/d1d/d57/fc8 zero size 2024-09-19T06:40:46.051 INFO:tasks.workunit.client.0.smithi099.stdout:0/637: readlink d0/db/l69 0 2024-09-19T06:40:46.055 INFO:tasks.workunit.client.0.smithi099.stdout:0/638: mkdir d0/db/d27/d5d/d87/da2/dbc/d47/d75/da4/dcf/dd3 0 2024-09-19T06:40:46.058 INFO:tasks.workunit.client.0.smithi099.stdout:0/639: creat d0/db/d27/fd4 x:0 0 0 2024-09-19T06:40:46.058 INFO:tasks.workunit.client.1.smithi117.stdout:2/919: write d0/d64/dd9/fcd [672398,19283] 0 2024-09-19T06:40:46.062 INFO:tasks.workunit.client.1.smithi117.stdout:8/856: sync 2024-09-19T06:40:46.062 INFO:tasks.workunit.client.1.smithi117.stdout:6/716: sync 2024-09-19T06:40:46.062 INFO:tasks.workunit.client.1.smithi117.stdout:5/972: sync 2024-09-19T06:40:46.062 INFO:tasks.workunit.client.1.smithi117.stdout:3/927: sync 2024-09-19T06:40:46.062 INFO:tasks.workunit.client.1.smithi117.stdout:1/855: sync 2024-09-19T06:40:46.062 INFO:tasks.workunit.client.1.smithi117.stdout:7/923: sync 2024-09-19T06:40:46.064 INFO:tasks.workunit.client.1.smithi117.stdout:2/920: dread d0/d12/f3c [0,4194304] 0 2024-09-19T06:40:46.066 INFO:tasks.workunit.client.0.smithi099.stdout:3/942: truncate d7/d34/d1d/d36/d42/fae 88859 0 2024-09-19T06:40:46.066 INFO:tasks.workunit.client.1.smithi117.stdout:1/856: unlink d3/l78 0 2024-09-19T06:40:46.067 INFO:tasks.workunit.client.1.smithi117.stdout:8/857: rmdir d1d/d1e/dbc/dff/d10e 39 2024-09-19T06:40:46.068 INFO:tasks.workunit.client.0.smithi099.stdout:7/887: dread d7/dcf/d29/d1f/d45/d48/d63/d75/dd8/df6/fff [0,4194304] 0 2024-09-19T06:40:46.069 INFO:tasks.workunit.client.0.smithi099.stdout:3/943: creat d7/d34/d1d/d20/d58/d5c/d98/dde/f128 x:0 0 0 2024-09-19T06:40:46.069 INFO:tasks.workunit.client.1.smithi117.stdout:3/928: write d0/d8/d7f/d40/d5b/f128 [891851,47692] 0 2024-09-19T06:40:46.070 INFO:tasks.workunit.client.1.smithi117.stdout:0/870: dread d11/d13/d14/d16/f1a [0,4194304] 0 2024-09-19T06:40:46.071 INFO:tasks.workunit.client.1.smithi117.stdout:1/857: truncate d3/d22/d2f/fff 512407 0 2024-09-19T06:40:46.073 INFO:tasks.workunit.client.1.smithi117.stdout:7/924: dread d1/f50 [4194304,4194304] 0 2024-09-19T06:40:46.073 INFO:tasks.workunit.client.1.smithi117.stdout:8/858: write f1a [1081730,1449] 0 2024-09-19T06:40:46.074 INFO:tasks.workunit.client.1.smithi117.stdout:2/921: truncate d0/d7/d29/d35/fdd 706328 0 2024-09-19T06:40:46.074 INFO:tasks.workunit.client.1.smithi117.stdout:7/925: fsync d1/d3f/d92/d115/f138 0 2024-09-19T06:40:46.075 INFO:tasks.workunit.client.1.smithi117.stdout:6/717: link d1/l26 d1/d5/d32/dc1/ld8 0 2024-09-19T06:40:46.078 INFO:tasks.workunit.client.1.smithi117.stdout:5/973: link d17/d1b/d3a/d3c/d46/fa0 d17/d1b/d3a/d3c/f147 0 2024-09-19T06:40:46.081 INFO:tasks.workunit.client.1.smithi117.stdout:1/858: dwrite d3/d18/d23/d74/f75 [0,4194304] 0 2024-09-19T06:40:46.082 INFO:tasks.workunit.client.1.smithi117.stdout:8/859: mkdir d1d/d2a/d3f/d73/d125 0 2024-09-19T06:40:46.082 INFO:tasks.workunit.client.1.smithi117.stdout:8/860: stat d1d/d2a/d3f/f72 0 2024-09-19T06:40:46.085 INFO:tasks.workunit.client.1.smithi117.stdout:0/871: link d11/f12 d11/d13/d14/dbd/f120 0 2024-09-19T06:40:46.086 INFO:tasks.workunit.client.1.smithi117.stdout:7/926: symlink d1/d4a/d81/d24/d26/l144 0 2024-09-19T06:40:46.087 INFO:tasks.workunit.client.1.smithi117.stdout:0/872: read d11/d13/d1b/d27/d37/d6d/fba [410174,28413] 0 2024-09-19T06:40:46.089 INFO:tasks.workunit.client.1.smithi117.stdout:7/927: dread - d1/d4a/d7c/d95/ddc/ffd zero size 2024-09-19T06:40:46.089 INFO:tasks.workunit.client.1.smithi117.stdout:2/922: creat d0/d7/d29/d35/d61/d65/f151 x:0 0 0 2024-09-19T06:40:46.091 INFO:tasks.workunit.client.1.smithi117.stdout:5/974: write d17/d1b/d3a/dfe/d115/f117 [1015772,51824] 0 2024-09-19T06:40:46.092 INFO:tasks.workunit.client.1.smithi117.stdout:8/861: mknod d1d/d2a/d3f/d4b/d66/dac/de2/c126 0 2024-09-19T06:40:46.093 INFO:tasks.workunit.client.1.smithi117.stdout:2/923: fdatasync d0/d7/d1e/f41 0 2024-09-19T06:40:46.095 INFO:tasks.workunit.client.1.smithi117.stdout:0/873: link d11/f19 d11/d13/d14/dbd/f121 0 2024-09-19T06:40:46.095 INFO:tasks.workunit.client.1.smithi117.stdout:6/718: dwrite d1/d5/d8/d5e/f68 [0,4194304] 0 2024-09-19T06:40:46.098 INFO:tasks.workunit.client.1.smithi117.stdout:1/859: getdents d3/da1/db1 0 2024-09-19T06:40:46.100 INFO:tasks.workunit.client.1.smithi117.stdout:8/862: write d1d/d2a/d3f/d4b/d91/ffd [903679,123930] 0 2024-09-19T06:40:46.101 INFO:tasks.workunit.client.1.smithi117.stdout:2/924: symlink d0/d7/l152 0 2024-09-19T06:40:46.103 INFO:tasks.workunit.client.1.smithi117.stdout:6/719: write d1/d5/d8/db5/fbe [4279838,19104] 0 2024-09-19T06:40:46.103 INFO:tasks.workunit.client.1.smithi117.stdout:3/929: dwrite d0/d8/d7f/d40/dc4/f43 [4194304,4194304] 0 2024-09-19T06:40:46.104 INFO:tasks.workunit.client.1.smithi117.stdout:5/975: fsync d17/d1b/d3a/d3c/dcb/dde/d55/dd1/d119/fed 0 2024-09-19T06:40:46.105 INFO:tasks.workunit.client.1.smithi117.stdout:7/928: write d1/d4a/d81/d24/d1c/fe0 [642836,33581] 0 2024-09-19T06:40:46.105 INFO:tasks.workunit.client.1.smithi117.stdout:0/874: mkdir d11/d13/d1b/d27/d37/d9d/d122 0 2024-09-19T06:40:46.109 INFO:tasks.workunit.client.1.smithi117.stdout:8/863: write d1d/d1e/d3b/f120 [2076668,46937] 0 2024-09-19T06:40:46.110 INFO:tasks.workunit.client.1.smithi117.stdout:6/720: write d1/d5/d8/f90 [625133,26901] 0 2024-09-19T06:40:46.111 INFO:tasks.workunit.client.1.smithi117.stdout:2/925: mknod d0/d7/d1e/d20/d10a/ddf/c153 0 2024-09-19T06:40:46.112 INFO:tasks.workunit.client.1.smithi117.stdout:0/875: mkdir d11/d13/d28/dfe/d9e/d123 0 2024-09-19T06:40:46.115 INFO:tasks.workunit.client.1.smithi117.stdout:7/929: creat d1/d4a/d81/d24/d26/d44/dd2/f145 x:0 0 0 2024-09-19T06:40:46.115 INFO:tasks.workunit.client.1.smithi117.stdout:6/721: chown d1/d5/f56 1299 1 2024-09-19T06:40:46.116 INFO:tasks.workunit.client.1.smithi117.stdout:2/926: write d0/d7/d1e/f31 [4968343,87585] 0 2024-09-19T06:40:46.116 INFO:tasks.workunit.client.1.smithi117.stdout:8/864: mkdir d1d/d1e/dbc/dc1/d105/d113/d127 0 2024-09-19T06:40:46.117 INFO:tasks.workunit.client.1.smithi117.stdout:3/930: dwrite d0/f14 [0,4194304] 0 2024-09-19T06:40:46.118 INFO:tasks.workunit.client.1.smithi117.stdout:8/865: chown d1d/d31/d83/f121 9205 1 2024-09-19T06:40:46.118 INFO:tasks.workunit.client.1.smithi117.stdout:6/722: chown d1/d5/d9a/da9/lc9 0 1 2024-09-19T06:40:46.119 INFO:tasks.workunit.client.1.smithi117.stdout:6/723: dread - d1/d5/d8/d99/fd0 zero size 2024-09-19T06:40:46.120 INFO:tasks.workunit.client.1.smithi117.stdout:7/930: creat d1/d72/d100/d12b/f146 x:0 0 0 2024-09-19T06:40:46.121 INFO:tasks.workunit.client.0.smithi099.stdout:0/640: truncate d0/db/d27/d5d/d87/da2/dbc/d47/f92 2645299 0 2024-09-19T06:40:46.121 INFO:tasks.workunit.client.0.smithi099.stdout:3/944: chown d7/d34/d1d/d20/d58/d5c/f90 410733562 1 2024-09-19T06:40:46.122 INFO:tasks.workunit.client.1.smithi117.stdout:3/931: creat d0/d9/d1c/d53/f12a x:0 0 0 2024-09-19T06:40:46.122 INFO:tasks.workunit.client.1.smithi117.stdout:0/876: link d11/d13/d14/d2c/d53/d7e/fef d11/d13/d28/de6/f124 0 2024-09-19T06:40:46.123 INFO:tasks.workunit.client.1.smithi117.stdout:7/931: write d1/d4a/f9a [104826,11768] 0 2024-09-19T06:40:46.123 INFO:tasks.workunit.client.0.smithi099.stdout:0/641: chown d0/db/d27/d5d/d87/da2/dbc/d37/d3c/lce 120 1 2024-09-19T06:40:46.124 INFO:tasks.workunit.client.1.smithi117.stdout:3/932: stat d0/d8/d64/fb6 0 2024-09-19T06:40:46.124 INFO:tasks.workunit.client.0.smithi099.stdout:3/945: truncate d7/d34/d1d/d20/d58/d5c/f5d 8683162 0 2024-09-19T06:40:46.124 INFO:tasks.workunit.client.1.smithi117.stdout:6/724: creat d1/d5/d85/fd9 x:0 0 0 2024-09-19T06:40:46.125 INFO:tasks.workunit.client.0.smithi099.stdout:0/642: write d0/d17/d41/f89 [1940089,119457] 0 2024-09-19T06:40:46.126 INFO:tasks.workunit.client.0.smithi099.stdout:7/888: rename d7/dcf/d29/d1f/d45/d48/ddc/f13b to d7/dcf/d29/f144 0 2024-09-19T06:40:46.127 INFO:tasks.workunit.client.1.smithi117.stdout:2/927: link d0/d7/d1e/d20/d10a/f10c d0/d7/d1e/d20/dbc/d116/d98/dd2/f154 0 2024-09-19T06:40:46.127 INFO:tasks.workunit.client.1.smithi117.stdout:1/860: write d3/d22/f2a [1580036,19442] 0 2024-09-19T06:40:46.128 INFO:tasks.workunit.client.1.smithi117.stdout:7/932: mkdir d1/d4a/d7c/d147 0 2024-09-19T06:40:46.128 INFO:tasks.workunit.client.0.smithi099.stdout:7/889: chown d7/dcf/d29/d1f/d45/d48/d63/d75/fa4 54762978 1 2024-09-19T06:40:46.129 INFO:tasks.workunit.client.1.smithi117.stdout:6/725: symlink d1/d3d/lda 0 2024-09-19T06:40:46.130 INFO:tasks.workunit.client.0.smithi099.stdout:3/946: creat d7/d34/d1d/d36/d69/d6d/f129 x:0 0 0 2024-09-19T06:40:46.131 INFO:tasks.workunit.client.0.smithi099.stdout:7/890: dread - d7/dcf/d29/d1f/d45/d48/ddc/d11e/d53/fba zero size 2024-09-19T06:40:46.132 INFO:tasks.workunit.client.1.smithi117.stdout:7/933: mkdir d1/d4a/d81/d24/d26/d148 0 2024-09-19T06:40:46.133 INFO:tasks.workunit.client.0.smithi099.stdout:3/947: fsync d7/d34/d1d/d20/d75/f7e 0 2024-09-19T06:40:46.133 INFO:tasks.workunit.client.1.smithi117.stdout:7/934: fdatasync d1/d4a/f7b 0 2024-09-19T06:40:46.133 INFO:tasks.workunit.client.1.smithi117.stdout:6/726: rmdir d1 39 2024-09-19T06:40:46.134 INFO:tasks.workunit.client.0.smithi099.stdout:7/891: creat d7/dcf/d29/d1f/d45/d48/ddc/f145 x:0 0 0 2024-09-19T06:40:46.136 INFO:tasks.workunit.client.0.smithi099.stdout:7/892: mkdir d7/dcf/d29/d34/d8f/d146 0 2024-09-19T06:40:46.137 INFO:tasks.workunit.client.1.smithi117.stdout:1/861: dwrite d3/feb [0,4194304] 0 2024-09-19T06:40:46.137 INFO:tasks.workunit.client.1.smithi117.stdout:2/928: getdents d0/d7/d29/d35/dbd/d8d/d9a 0 2024-09-19T06:40:46.138 INFO:tasks.workunit.client.1.smithi117.stdout:7/935: unlink d1/d3f/f4d 0 2024-09-19T06:40:46.143 INFO:tasks.workunit.client.0.smithi099.stdout:0/643: truncate d0/db/f48 400417 0 2024-09-19T06:40:46.143 INFO:tasks.workunit.client.1.smithi117.stdout:7/936: chown d1/d4a/d81/d24/d1c/f22 17322418 1 2024-09-19T06:40:46.143 INFO:tasks.workunit.client.1.smithi117.stdout:1/862: rename d3/da1/dcc/c120 to d3/d8e/db4/c129 0 2024-09-19T06:40:46.144 INFO:tasks.workunit.client.1.smithi117.stdout:6/727: mknod d1/d5/cdb 0 2024-09-19T06:40:46.145 INFO:tasks.workunit.client.1.smithi117.stdout:5/976: dwrite d17/d1b/d3a/d3c/d46/f97 [0,4194304] 0 2024-09-19T06:40:46.145 INFO:tasks.workunit.client.1.smithi117.stdout:2/929: mkdir d0/d7/d1e/d20/d10a/ddf/d155 0 2024-09-19T06:40:46.146 INFO:tasks.workunit.client.1.smithi117.stdout:1/863: read d3/d8e/fca [245503,25035] 0 2024-09-19T06:40:46.147 INFO:tasks.workunit.client.1.smithi117.stdout:7/937: fsync d1/f13a 0 2024-09-19T06:40:46.148 INFO:tasks.workunit.client.1.smithi117.stdout:2/930: stat d0/d7/d29/d35/d61/lcc 0 2024-09-19T06:40:46.149 INFO:tasks.workunit.client.1.smithi117.stdout:6/728: chown d1/d5/d8/db0/f78 14 1 2024-09-19T06:40:46.149 INFO:tasks.workunit.client.1.smithi117.stdout:2/931: truncate d0/f131 507713 0 2024-09-19T06:40:46.151 INFO:tasks.workunit.client.1.smithi117.stdout:2/932: chown d0/d7/d1e/d20/dc9/fe8 17 1 2024-09-19T06:40:46.151 INFO:tasks.workunit.client.1.smithi117.stdout:2/933: fdatasync d0/d7/d1e/f41 0 2024-09-19T06:40:46.152 INFO:tasks.workunit.client.1.smithi117.stdout:5/977: unlink d17/d1b/d3a/d3c/l77 0 2024-09-19T06:40:46.152 INFO:tasks.workunit.client.0.smithi099.stdout:3/948: truncate d7/d34/d1d/d36/d69/fec 771411 0 2024-09-19T06:40:46.155 INFO:tasks.workunit.client.0.smithi099.stdout:3/949: write d7/d34/f1f [1909049,68838] 0 2024-09-19T06:40:46.159 INFO:tasks.workunit.client.0.smithi099.stdout:3/950: creat d7/d34/d1d/d108/f12a x:0 0 0 2024-09-19T06:40:46.159 INFO:tasks.workunit.client.0.smithi099.stdout:3/951: stat d7/l11 0 2024-09-19T06:40:46.159 INFO:tasks.workunit.client.1.smithi117.stdout:5/978: creat d17/d1b/d3a/d3c/dcb/dde/d65/d88/dda/f148 x:0 0 0 2024-09-19T06:40:46.161 INFO:tasks.workunit.client.1.smithi117.stdout:5/979: fdatasync d17/d1b/d3a/d3c/dcb/dde/d65/fff 0 2024-09-19T06:40:46.162 INFO:tasks.workunit.client.1.smithi117.stdout:1/864: mknod d3/d18/d23/dde/c12a 0 2024-09-19T06:40:46.163 INFO:tasks.workunit.client.1.smithi117.stdout:6/729: getdents d1/d5/d32/d45/d7b 0 2024-09-19T06:40:46.163 INFO:tasks.workunit.client.0.smithi099.stdout:3/952: rename d7/d34/d1d/d36/f4f to d7/d34/d1d/d36/db3/de0/f12b 0 2024-09-19T06:40:46.164 INFO:tasks.workunit.client.1.smithi117.stdout:2/934: getdents d0/d64/dd9/df0 0 2024-09-19T06:40:46.166 INFO:tasks.workunit.client.0.smithi099.stdout:3/953: symlink d7/d34/d1d/d36/db3/de0/de9/l12c 0 2024-09-19T06:40:46.166 INFO:tasks.workunit.client.1.smithi117.stdout:5/980: mkdir d17/d1b/d3a/d3c/d70/d94/d149 0 2024-09-19T06:40:46.167 INFO:tasks.workunit.client.1.smithi117.stdout:1/865: creat d3/da1/db1/d93/dd0/f12b x:0 0 0 2024-09-19T06:40:46.168 INFO:tasks.workunit.client.1.smithi117.stdout:7/938: write d1/d4a/d81/f8e [5169304,84584] 0 2024-09-19T06:40:46.168 INFO:tasks.workunit.client.0.smithi099.stdout:3/954: mknod d7/d34/d1d/d36/d69/d6d/c12d 0 2024-09-19T06:40:46.169 INFO:tasks.workunit.client.1.smithi117.stdout:2/935: dread d0/d7/d58/db1/fb3 [0,4194304] 0 2024-09-19T06:40:46.170 INFO:tasks.workunit.client.0.smithi099.stdout:0/644: dread d0/db/d2f/f4e [0,4194304] 0 2024-09-19T06:40:46.172 INFO:tasks.workunit.client.0.smithi099.stdout:0/645: truncate d0/db/d2f/fc3 4728787 0 2024-09-19T06:40:46.172 INFO:tasks.workunit.client.0.smithi099.stdout:3/955: creat d7/d34/d1d/d20/d58/f12e x:0 0 0 2024-09-19T06:40:46.174 INFO:tasks.workunit.client.0.smithi099.stdout:0/646: mkdir d0/db/dd5 0 2024-09-19T06:40:46.175 INFO:tasks.workunit.client.1.smithi117.stdout:7/939: fdatasync d1/f13a 0 2024-09-19T06:40:46.176 INFO:tasks.workunit.client.0.smithi099.stdout:3/956: truncate d7/d34/d1d/d20/d58/d5c/f99 1907709 0 2024-09-19T06:40:46.178 INFO:tasks.workunit.client.1.smithi117.stdout:5/981: write d17/d1b/d3a/d3c/dcb/dde/d55/f7a [2128332,76217] 0 2024-09-19T06:40:46.180 INFO:tasks.workunit.client.1.smithi117.stdout:6/730: dwrite d1/d5/d8/db0/f78 [0,4194304] 0 2024-09-19T06:40:46.180 INFO:tasks.workunit.client.1.smithi117.stdout:1/866: fsync d3/f3c 0 2024-09-19T06:40:46.182 INFO:tasks.workunit.client.1.smithi117.stdout:6/731: chown d1/d5/d8/d5e/d67/d98/da1/cc7 684585 1 2024-09-19T06:40:46.182 INFO:tasks.workunit.client.0.smithi099.stdout:9/741: sync 2024-09-19T06:40:46.183 INFO:tasks.workunit.client.1.smithi117.stdout:6/732: stat d1/d5/f8e 0 2024-09-19T06:40:46.184 INFO:tasks.workunit.client.1.smithi117.stdout:1/867: dread - d3/da1/f105 zero size 2024-09-19T06:40:46.188 INFO:tasks.workunit.client.0.smithi099.stdout:9/742: creat dd/d65/ff7 x:0 0 0 2024-09-19T06:40:46.192 INFO:tasks.workunit.client.1.smithi117.stdout:6/733: dwrite d1/d5/d85/fd9 [0,4194304] 0 2024-09-19T06:40:46.193 INFO:tasks.workunit.client.1.smithi117.stdout:2/936: dread d0/d7/d1e/d20/f7b [0,4194304] 0 2024-09-19T06:40:46.194 INFO:tasks.workunit.client.0.smithi099.stdout:9/743: rename dd/d47/d40/f31 to dd/d2c/d5c/ff8 0 2024-09-19T06:40:46.197 INFO:tasks.workunit.client.1.smithi117.stdout:6/734: rmdir d1/d5/d32 39 2024-09-19T06:40:46.197 INFO:tasks.workunit.client.0.smithi099.stdout:3/957: write d7/d34/d1d/d20/d58/fb5 [573644,67617] 0 2024-09-19T06:40:46.199 INFO:tasks.workunit.client.1.smithi117.stdout:6/735: stat d1/d5/d8/d5e/d67/fb3 0 2024-09-19T06:40:46.199 INFO:tasks.workunit.client.1.smithi117.stdout:5/982: write d17/d1b/d3a/d3c/dcb/dde/dab/fcf [1814690,77588] 0 2024-09-19T06:40:46.200 INFO:tasks.workunit.client.1.smithi117.stdout:6/736: fsync d1/d5/d85/f93 0 2024-09-19T06:40:46.203 INFO:tasks.workunit.client.1.smithi117.stdout:2/937: dread d0/d7/d29/db0/fc3 [0,4194304] 0 2024-09-19T06:40:46.204 INFO:tasks.workunit.client.1.smithi117.stdout:5/983: mknod d17/d1b/d3a/d3c/c14a 0 2024-09-19T06:40:46.204 INFO:tasks.workunit.client.1.smithi117.stdout:6/737: mknod d1/d5/dc2/cdc 0 2024-09-19T06:40:46.206 INFO:tasks.workunit.client.1.smithi117.stdout:5/984: symlink d17/d1b/d3a/df8/l14b 0 2024-09-19T06:40:46.207 INFO:tasks.workunit.client.1.smithi117.stdout:1/868: dwrite d3/d18/d23/f70 [0,4194304] 0 2024-09-19T06:40:46.207 INFO:tasks.workunit.client.1.smithi117.stdout:2/938: creat d0/d12/f156 x:0 0 0 2024-09-19T06:40:46.208 INFO:tasks.workunit.client.1.smithi117.stdout:5/985: chown d17/d1b/d3a/d3c/d46/d10f/f11e 23947 1 2024-09-19T06:40:46.210 INFO:tasks.workunit.client.1.smithi117.stdout:6/738: mkdir d1/d5/d8/d5e/d67/d98/ddd 0 2024-09-19T06:40:46.211 INFO:tasks.workunit.client.1.smithi117.stdout:2/939: mknod d0/d7/d29/d35/d61/d65/c157 0 2024-09-19T06:40:46.211 INFO:tasks.workunit.client.1.smithi117.stdout:1/869: readlink d3/lb 0 2024-09-19T06:40:46.213 INFO:tasks.workunit.client.1.smithi117.stdout:6/739: rmdir d1/d5/d8/d99 39 2024-09-19T06:40:46.214 INFO:tasks.workunit.client.1.smithi117.stdout:6/740: chown d1/d3d/f83 463089 1 2024-09-19T06:40:46.214 INFO:tasks.workunit.client.1.smithi117.stdout:5/986: truncate d17/d1b/d3a/d3c/dcb/dde/d55/dd1/d119/f8f 722548 0 2024-09-19T06:40:46.215 INFO:tasks.workunit.client.1.smithi117.stdout:6/741: chown d1/d3/f4b 820873 1 2024-09-19T06:40:46.215 INFO:tasks.workunit.client.1.smithi117.stdout:1/870: rmdir d3/d18/d56 39 2024-09-19T06:40:46.216 INFO:tasks.workunit.client.1.smithi117.stdout:2/940: mknod d0/d7/d29/d35/dbd/d8d/d115/c158 0 2024-09-19T06:40:46.216 INFO:tasks.workunit.client.1.smithi117.stdout:5/987: unlink d17/d1b/d5d/d7d/fa8 0 2024-09-19T06:40:46.217 INFO:tasks.workunit.client.1.smithi117.stdout:6/742: fdatasync d1/d3d/d6f/f7c 0 2024-09-19T06:40:46.218 INFO:tasks.workunit.client.1.smithi117.stdout:1/871: mknod d3/d18/d23/d74/dcf/c12c 0 2024-09-19T06:40:46.220 INFO:tasks.workunit.client.1.smithi117.stdout:1/872: mknod d3/da1/dcc/c12d 0 2024-09-19T06:40:46.222 INFO:tasks.workunit.client.1.smithi117.stdout:5/988: rename d17/d1b/d3a/d3c/dcb/dde/d55/f118 to d17/d1b/d3a/d3c/dcb/dde/d65/d88/dda/d138/f14c 0 2024-09-19T06:40:46.222 INFO:tasks.workunit.client.1.smithi117.stdout:2/941: dread d0/d7/d29/d35/dbd/d8d/fd6 [0,4194304] 0 2024-09-19T06:40:46.225 INFO:tasks.workunit.client.1.smithi117.stdout:5/989: stat d17/d1b/d3a/d3c/dcb/dde/d65/d88/de5/d3b/c4e 0 2024-09-19T06:40:46.227 INFO:tasks.workunit.client.1.smithi117.stdout:6/743: dwrite d1/d5/d8/d5e/d67/d98/da1/fd2 [0,4194304] 0 2024-09-19T06:40:46.228 INFO:tasks.workunit.client.1.smithi117.stdout:1/873: rename d3/d18/fbe to d3/da1/db1/d93/f12e 0 2024-09-19T06:40:46.229 INFO:tasks.workunit.client.1.smithi117.stdout:2/942: mknod d0/d7/d29/d35/dbd/d8d/d9a/c159 0 2024-09-19T06:40:46.230 INFO:tasks.workunit.client.1.smithi117.stdout:6/744: dread - d1/d5/d8/d27/d77/f7d zero size 2024-09-19T06:40:46.232 INFO:tasks.workunit.client.1.smithi117.stdout:2/943: creat d0/d12/d32/db5/d114/f15a x:0 0 0 2024-09-19T06:40:46.233 INFO:tasks.workunit.client.1.smithi117.stdout:6/745: creat d1/d5/d8/d5e/fde x:0 0 0 2024-09-19T06:40:46.234 INFO:tasks.workunit.client.1.smithi117.stdout:6/746: write d1/d5/d8/db0/f78 [1083448,90827] 0 2024-09-19T06:40:46.236 INFO:tasks.workunit.client.1.smithi117.stdout:1/874: write d3/f5e [4648916,12018] 0 2024-09-19T06:40:46.239 INFO:tasks.workunit.client.1.smithi117.stdout:6/747: creat d1/d14/dd5/fdf x:0 0 0 2024-09-19T06:40:46.240 INFO:tasks.workunit.client.1.smithi117.stdout:1/875: getdents d3/da1/db1/d93 0 2024-09-19T06:40:46.242 INFO:tasks.workunit.client.1.smithi117.stdout:6/748: unlink d1/d5/dc2/cdc 0 2024-09-19T06:40:46.244 INFO:tasks.workunit.client.1.smithi117.stdout:5/990: truncate d17/d1b/d3a/d3c/dcb/dde/d55/dd1/d119/ff6 359168 0 2024-09-19T06:40:46.245 INFO:tasks.workunit.client.1.smithi117.stdout:1/876: dread d3/d8e/fb8 [0,4194304] 0 2024-09-19T06:40:46.247 INFO:tasks.workunit.client.1.smithi117.stdout:5/991: symlink d17/d1b/d3a/d3c/dcb/dde/d65/d88/de5/d3b/l14d 0 2024-09-19T06:40:46.249 INFO:tasks.workunit.client.1.smithi117.stdout:6/749: link d1/l26 d1/d5/d32/dc1/le0 0 2024-09-19T06:40:46.249 INFO:tasks.workunit.client.1.smithi117.stdout:1/877: fdatasync d3/d18/d56/f94 0 2024-09-19T06:40:46.250 INFO:tasks.workunit.client.1.smithi117.stdout:2/944: dwrite d0/d7/d29/d35/dbd/ff1 [0,4194304] 0 2024-09-19T06:40:46.255 INFO:tasks.workunit.client.1.smithi117.stdout:5/992: write d17/f41 [903621,42675] 0 2024-09-19T06:40:46.255 INFO:tasks.workunit.client.1.smithi117.stdout:2/945: mknod d0/d7/d58/c15b 0 2024-09-19T06:40:46.256 INFO:tasks.workunit.client.1.smithi117.stdout:5/993: chown d17/d1b/d3a/d3c/dcb/dde/d65/d13c 5826842 1 2024-09-19T06:40:46.257 INFO:tasks.workunit.client.1.smithi117.stdout:5/994: chown d17/d1b/d3a/d3c/dcb/dde/da6/l10b 80178980 1 2024-09-19T06:40:46.258 INFO:tasks.workunit.client.1.smithi117.stdout:2/946: creat d0/d12/d32/db5/d114/f15c x:0 0 0 2024-09-19T06:40:46.260 INFO:tasks.workunit.client.1.smithi117.stdout:2/947: write d0/d7/d29/d35/d3d/f9b [3274458,13473] 0 2024-09-19T06:40:46.261 INFO:tasks.workunit.client.1.smithi117.stdout:6/750: dread d1/d3d/d6f/f7c [0,4194304] 0 2024-09-19T06:40:46.262 INFO:tasks.workunit.client.0.smithi099.stdout:0/647: dread d0/d17/d41/f49 [0,4194304] 0 2024-09-19T06:40:46.262 INFO:tasks.workunit.client.0.smithi099.stdout:3/958: mkdir d7/d34/d1d/d20/d58/d5c/dbd/d12f 0 2024-09-19T06:40:46.262 INFO:tasks.workunit.client.0.smithi099.stdout:9/744: dwrite dd/d2c/d5c/ddb/fde [0,4194304] 0 2024-09-19T06:40:46.264 INFO:tasks.workunit.client.0.smithi099.stdout:3/959: fdatasync d7/d34/d1d/d36/d69/f112 0 2024-09-19T06:40:46.265 INFO:tasks.workunit.client.1.smithi117.stdout:6/751: symlink d1/d5/d32/le1 0 2024-09-19T06:40:46.265 INFO:tasks.workunit.client.1.smithi117.stdout:2/948: creat d0/d7/d1e/d20/dbc/d116/d98/dd2/f15d x:0 0 0 2024-09-19T06:40:46.265 INFO:tasks.workunit.client.1.smithi117.stdout:5/995: link d17/d1b/d3a/d3c/dcb/dde/f32 d17/d1b/d3a/d3c/dcb/dde/d65/f14e 0 2024-09-19T06:40:46.267 INFO:tasks.workunit.client.0.smithi099.stdout:0/648: rmdir d0/db/d27/d5d/d87/da2/dbc/d1f/d8e/d9b 39 2024-09-19T06:40:46.268 INFO:tasks.workunit.client.1.smithi117.stdout:6/752: unlink d1/d5/d32/d45/fbc 0 2024-09-19T06:40:46.269 INFO:tasks.workunit.client.1.smithi117.stdout:2/949: symlink d0/d7/d1e/d20/dbc/d116/d98/l15e 0 2024-09-19T06:40:46.271 INFO:tasks.workunit.client.1.smithi117.stdout:5/996: chown d17/d1b/d3a/d3c/dcb/dde/d65/ldc 4174 1 2024-09-19T06:40:46.273 INFO:tasks.workunit.client.1.smithi117.stdout:2/950: mknod d0/d7/d29/d71/c15f 0 2024-09-19T06:40:46.273 INFO:tasks.workunit.client.1.smithi117.stdout:5/997: truncate d17/d1b/d3a/f126 539293 0 2024-09-19T06:40:46.274 INFO:tasks.workunit.client.1.smithi117.stdout:6/753: dread d1/d5/d8/db0/f78 [0,4194304] 0 2024-09-19T06:40:46.276 INFO:tasks.workunit.client.1.smithi117.stdout:2/951: mknod d0/d7/d1e/d20/dbc/de6/c160 0 2024-09-19T06:40:46.276 INFO:tasks.workunit.client.1.smithi117.stdout:2/952: stat d0/d7/d1e/d20/dbc/d116/f51 0 2024-09-19T06:40:46.278 INFO:tasks.workunit.client.1.smithi117.stdout:1/878: dread d3/d18/d23/d74/fe0 [4194304,4194304] 0 2024-09-19T06:40:46.279 INFO:tasks.workunit.client.1.smithi117.stdout:2/953: mknod d0/d7/d29/d35/dbd/c161 0 2024-09-19T06:40:46.281 INFO:tasks.workunit.client.1.smithi117.stdout:1/879: symlink d3/da1/l12f 0 2024-09-19T06:40:46.283 INFO:tasks.workunit.client.1.smithi117.stdout:1/880: creat d3/d99/dd7/f130 x:0 0 0 2024-09-19T06:40:46.283 INFO:tasks.workunit.client.1.smithi117.stdout:5/998: write d17/d1b/d3a/d3c/dcb/dde/d55/dd1/d119/f9f [1795022,108598] 0 2024-09-19T06:40:46.284 INFO:tasks.workunit.client.1.smithi117.stdout:5/999: chown l13 1 1 2024-09-19T06:40:46.285 INFO:tasks.workunit.client.1.smithi117.stdout:2/954: dwrite d0/d12/f106 [0,4194304] 0 2024-09-19T06:40:46.286 INFO:tasks.workunit.client.1.smithi117.stdout:1/881: mkdir d3/d18/d97/d131 0 2024-09-19T06:40:46.288 INFO:tasks.workunit.client.1.smithi117.stdout:1/882: rmdir d3/d18/d23/d51 39 2024-09-19T06:40:46.292 INFO:tasks.workunit.client.1.smithi117.stdout:2/955: dwrite d0/d7/d29/d35/dbd/d8d/f9e [4194304,4194304] 0 2024-09-19T06:40:46.297 INFO:tasks.workunit.client.1.smithi117.stdout:2/956: link d0/d7/d1e/d20/dbc/d116/f60 d0/d7/d29/db0/f162 0 2024-09-19T06:40:46.301 INFO:tasks.workunit.client.1.smithi117.stdout:2/957: creat d0/d7/d29/df4/d105/d11b/f163 x:0 0 0 2024-09-19T06:40:46.303 INFO:tasks.workunit.client.1.smithi117.stdout:2/958: readlink d0/d7/d29/d35/dbd/d8d/d9a/lce 0 2024-09-19T06:40:46.305 INFO:tasks.workunit.client.1.smithi117.stdout:2/959: mkdir d0/d7/d29/df4/d105/d164 0 2024-09-19T06:40:46.306 INFO:tasks.workunit.client.1.smithi117.stdout:1/883: dwrite d3/d22/f7c [0,4194304] 0 2024-09-19T06:40:46.308 INFO:tasks.workunit.client.1.smithi117.stdout:2/960: truncate d0/d64/dd9/df0/f111 4939149 0 2024-09-19T06:40:46.308 INFO:tasks.workunit.client.1.smithi117.stdout:1/884: mkdir d3/d18/d132 0 2024-09-19T06:40:46.315 INFO:tasks.workunit.client.1.smithi117.stdout:2/961: mkdir d0/d7/d29/d35/dbd/d8d/d115/d165 0 2024-09-19T06:40:46.316 INFO:tasks.workunit.client.1.smithi117.stdout:1/885: rmdir d3 39 2024-09-19T06:40:46.318 INFO:tasks.workunit.client.1.smithi117.stdout:2/962: link d0/d7/d29/d35/d3d/d72/cb4 d0/d7/d1e/d20/dbc/d116/d98/c166 0 2024-09-19T06:40:46.320 INFO:tasks.workunit.client.1.smithi117.stdout:1/886: getdents d3/da1 0 2024-09-19T06:40:46.320 INFO:tasks.workunit.client.1.smithi117.stdout:1/887: stat d3/d8e/fe4 0 2024-09-19T06:40:46.321 INFO:tasks.workunit.client.1.smithi117.stdout:1/888: getdents d3/d18/d132 0 2024-09-19T06:40:46.323 INFO:tasks.workunit.client.1.smithi117.stdout:1/889: fdatasync d3/f38 0 2024-09-19T06:40:46.326 INFO:tasks.workunit.client.1.smithi117.stdout:1/890: creat d3/d18/d91/f133 x:0 0 0 2024-09-19T06:40:46.327 INFO:tasks.workunit.client.0.smithi099.stdout:1/692: sync 2024-09-19T06:40:46.327 INFO:tasks.workunit.client.0.smithi099.stdout:5/889: sync 2024-09-19T06:40:46.327 INFO:tasks.workunit.client.0.smithi099.stdout:4/727: sync 2024-09-19T06:40:46.328 INFO:tasks.workunit.client.1.smithi117.stdout:1/891: link d3/d18/d56/f94 d3/d18/d97/f134 0 2024-09-19T06:40:46.332 INFO:tasks.workunit.client.1.smithi117.stdout:1/892: write d3/d18/d23/f28 [115373,1313] 0 2024-09-19T06:40:46.333 INFO:tasks.workunit.client.1.smithi117.stdout:2/963: dread d0/d7/d29/d35/dbd/d8d/f9e [0,4194304] 0 2024-09-19T06:40:46.334 INFO:tasks.workunit.client.1.smithi117.stdout:1/893: fdatasync d3/d18/d23/d74/d89/d9f/ff1 0 2024-09-19T06:40:46.343 INFO:tasks.workunit.client.0.smithi099.stdout:9/745: mkdir dd/dc9/df5/df9 0 2024-09-19T06:40:46.344 INFO:tasks.workunit.client.0.smithi099.stdout:5/890: fdatasync d3/d16/f6e 0 2024-09-19T06:40:46.345 INFO:tasks.workunit.client.1.smithi117.stdout:1/894: mknod d3/d18/c135 0 2024-09-19T06:40:46.347 INFO:tasks.workunit.client.0.smithi099.stdout:5/891: write d3/d14/f11c [423393,109094] 0 2024-09-19T06:40:46.347 INFO:tasks.workunit.client.0.smithi099.stdout:1/693: truncate d0/db/f31 1213144 0 2024-09-19T06:40:46.347 INFO:tasks.workunit.client.0.smithi099.stdout:0/649: creat d0/db/dc0/fd6 x:0 0 0 2024-09-19T06:40:46.348 INFO:tasks.workunit.client.1.smithi117.stdout:2/964: getdents d0/d7/d29/db0 0 2024-09-19T06:40:46.350 INFO:tasks.workunit.client.0.smithi099.stdout:1/694: chown d0/d2d/c2f 91 1 2024-09-19T06:40:46.350 INFO:tasks.workunit.client.0.smithi099.stdout:5/892: chown d3/d16/d2f/d34/l41 1930686 1 2024-09-19T06:40:46.352 INFO:tasks.workunit.client.1.smithi117.stdout:1/895: link d3/d18/f7a d3/f136 0 2024-09-19T06:40:46.354 INFO:tasks.workunit.client.1.smithi117.stdout:2/965: link d0/d7/d1e/c103 d0/d12/d32/db5/d114/c167 0 2024-09-19T06:40:46.356 INFO:tasks.workunit.client.0.smithi099.stdout:4/728: dread d12/d32/f27 [0,4194304] 0 2024-09-19T06:40:46.356 INFO:tasks.workunit.client.1.smithi117.stdout:1/896: fsync d3/d18/d23/f34 0 2024-09-19T06:40:46.356 INFO:tasks.workunit.client.1.smithi117.stdout:2/966: dread d0/d12/f3c [0,4194304] 0 2024-09-19T06:40:46.359 INFO:tasks.workunit.client.0.smithi099.stdout:1/695: write d0/d17/d32/d7b/db0/fb1 [665672,2716] 0 2024-09-19T06:40:46.359 INFO:tasks.workunit.client.1.smithi117.stdout:2/967: mkdir d0/d7/d1e/d20/d168 0 2024-09-19T06:40:46.361 INFO:tasks.workunit.client.1.smithi117.stdout:1/897: fdatasync d3/d18/d23/d51/f79 0 2024-09-19T06:40:46.363 INFO:tasks.workunit.client.0.smithi099.stdout:3/960: dread d7/d34/d1d/d20/d58/d5c/ff1 [0,4194304] 0 2024-09-19T06:40:46.364 INFO:tasks.workunit.client.0.smithi099.stdout:0/650: dwrite d0/f57 [0,4194304] 0 2024-09-19T06:40:46.364 INFO:tasks.workunit.client.0.smithi099.stdout:4/729: write d12/d32/d42/d5c/d51/de8/fc5 [1248756,1471] 0 2024-09-19T06:40:46.365 INFO:tasks.workunit.client.0.smithi099.stdout:9/746: dwrite dd/fe [0,4194304] 0 2024-09-19T06:40:46.366 INFO:tasks.workunit.client.0.smithi099.stdout:1/696: chown d0/d12/d13/d37/f94 488333366 1 2024-09-19T06:40:46.366 INFO:tasks.workunit.client.0.smithi099.stdout:0/651: read d0/fa7 [1819539,21588] 0 2024-09-19T06:40:46.367 INFO:tasks.workunit.client.1.smithi117.stdout:1/898: read d3/d18/ffd [632912,66022] 0 2024-09-19T06:40:46.369 INFO:tasks.workunit.client.1.smithi117.stdout:1/899: chown d3/d18/d23/d74/d89/d9f/d113/l11c 709 1 2024-09-19T06:40:46.370 INFO:tasks.workunit.client.0.smithi099.stdout:4/730: creat d12/d82/ddd/d89/de4/ff7 x:0 0 0 2024-09-19T06:40:46.370 INFO:tasks.workunit.client.0.smithi099.stdout:9/747: mkdir dd/d2c/d5c/d64/d93/dfa 0 2024-09-19T06:40:46.373 INFO:tasks.workunit.client.0.smithi099.stdout:3/961: mknod d7/d34/d1d/d36/c130 0 2024-09-19T06:40:46.374 INFO:tasks.workunit.client.1.smithi117.stdout:2/968: dwrite d0/d7/d1e/d20/dbc/d116/d98/dd2/f154 [0,4194304] 0 2024-09-19T06:40:46.378 INFO:tasks.workunit.client.1.smithi117.stdout:2/969: creat d0/d7/d58/db1/f169 x:0 0 0 2024-09-19T06:40:46.378 INFO:tasks.workunit.client.1.smithi117.stdout:2/970: stat d0/d64/dd9/f112 0 2024-09-19T06:40:46.379 INFO:tasks.workunit.client.0.smithi099.stdout:3/962: write d7/d34/d1d/d57/fbc [3339583,78743] 0 2024-09-19T06:40:46.381 INFO:tasks.workunit.client.0.smithi099.stdout:9/748: dwrite dd/f5b [0,4194304] 0 2024-09-19T06:40:46.381 INFO:tasks.workunit.client.0.smithi099.stdout:3/963: dread - d7/d34/d1d/d20/d58/d5c/d98/f100 zero size 2024-09-19T06:40:46.384 INFO:tasks.workunit.client.1.smithi117.stdout:2/971: dwrite d0/d12/d32/da4/f139 [0,4194304] 0 2024-09-19T06:40:46.384 INFO:tasks.workunit.client.0.smithi099.stdout:5/893: dread d3/d7/fb8 [0,4194304] 0 2024-09-19T06:40:46.385 INFO:tasks.workunit.client.0.smithi099.stdout:3/964: dread - d7/d34/d1d/d36/db3/f111 zero size 2024-09-19T06:40:46.386 INFO:tasks.workunit.client.0.smithi099.stdout:3/965: chown d7/ff 566 1 2024-09-19T06:40:46.388 INFO:tasks.workunit.client.0.smithi099.stdout:9/749: mkdir dd/d62/dfb 0 2024-09-19T06:40:46.390 INFO:tasks.workunit.client.0.smithi099.stdout:3/966: fsync d7/d34/d1d/d20/d75/f7e 0 2024-09-19T06:40:46.391 INFO:tasks.workunit.client.0.smithi099.stdout:9/750: mkdir dd/d2c/d5c/d85/dfc 0 2024-09-19T06:40:46.394 INFO:tasks.workunit.client.0.smithi099.stdout:9/751: symlink dd/dc9/lfd 0 2024-09-19T06:40:46.395 INFO:tasks.workunit.client.0.smithi099.stdout:9/752: read - dd/d65/f96 zero size 2024-09-19T06:40:46.400 INFO:tasks.workunit.client.0.smithi099.stdout:9/753: link dd/d62/l84 dd/d65/de4/lfe 0 2024-09-19T06:40:46.402 INFO:tasks.workunit.client.0.smithi099.stdout:9/754: mkdir dd/d2c/d5c/d85/d8d/dff 0 2024-09-19T06:40:46.404 INFO:tasks.workunit.client.0.smithi099.stdout:0/652: truncate d0/db/d27/d5d/d87/da2/dbc/d1f/f2b 3626910 0 2024-09-19T06:40:46.405 INFO:tasks.workunit.client.0.smithi099.stdout:0/653: getdents d0/d17/d41/dc6 0 2024-09-19T06:40:46.406 INFO:tasks.workunit.client.0.smithi099.stdout:9/755: dread dd/d2c/d5c/ddb/fde [0,4194304] 0 2024-09-19T06:40:46.407 INFO:tasks.workunit.client.0.smithi099.stdout:0/654: symlink d0/db/d27/d5d/d87/da2/dbc/d47/ld7 0 2024-09-19T06:40:46.410 INFO:tasks.workunit.client.0.smithi099.stdout:9/756: link dd/d47/l95 dd/d2c/d5c/dd0/l100 0 2024-09-19T06:40:46.411 INFO:tasks.workunit.client.0.smithi099.stdout:0/655: write d0/db/d27/d5d/d87/da2/dbc/d1f/d4a/d61/f8c [2336175,23465] 0 2024-09-19T06:40:46.411 INFO:tasks.workunit.client.0.smithi099.stdout:1/697: dread d0/d12/d13/d37/d41/fa0 [0,4194304] 0 2024-09-19T06:40:46.412 INFO:tasks.workunit.client.0.smithi099.stdout:0/656: fsync d0/db/d27/d5d/d87/da2/dbc/d37/fc2 0 2024-09-19T06:40:46.413 INFO:tasks.workunit.client.0.smithi099.stdout:9/757: write dd/d47/d40/da9/fd5 [555039,7628] 0 2024-09-19T06:40:46.415 INFO:tasks.workunit.client.0.smithi099.stdout:0/657: fsync d0/db/d36/f5f 0 2024-09-19T06:40:46.415 INFO:tasks.workunit.client.0.smithi099.stdout:1/698: creat d0/d17/d24/d75/dbb/de1/fe2 x:0 0 0 2024-09-19T06:40:46.417 INFO:tasks.workunit.client.0.smithi099.stdout:0/658: chown d0/db/d27/d38/fac 2 1 2024-09-19T06:40:46.417 INFO:tasks.workunit.client.0.smithi099.stdout:1/699: stat d0/d12/d13/l80 0 2024-09-19T06:40:46.419 INFO:tasks.workunit.client.0.smithi099.stdout:0/659: stat d0/db/d27/d38 0 2024-09-19T06:40:46.420 INFO:tasks.workunit.client.0.smithi099.stdout:4/731: dwrite d12/d32/f2e [0,4194304] 0 2024-09-19T06:40:46.420 INFO:tasks.workunit.client.0.smithi099.stdout:9/758: creat dd/d47/d40/f101 x:0 0 0 2024-09-19T06:40:46.422 INFO:tasks.workunit.client.1.smithi117.stdout:2/972: dread d0/d7/d29/d35/dbd/fe4 [0,4194304] 0 2024-09-19T06:40:46.426 INFO:tasks.workunit.client.0.smithi099.stdout:4/732: mknod d12/d82/ddd/d9b/dab/dbf/cf8 0 2024-09-19T06:40:46.429 INFO:tasks.workunit.client.0.smithi099.stdout:4/733: fdatasync d12/d58/ff0 0 2024-09-19T06:40:46.430 INFO:tasks.workunit.client.0.smithi099.stdout:1/700: dwrite d0/d2d/f43 [8388608,4194304] 0 2024-09-19T06:40:46.432 INFO:tasks.workunit.client.1.smithi117.stdout:2/973: mknod d0/d7/d29/d35/dbd/d8d/d115/d165/c16a 0 2024-09-19T06:40:46.432 INFO:tasks.workunit.client.0.smithi099.stdout:9/759: dwrite dd/d47/d68/f9c [4194304,4194304] 0 2024-09-19T06:40:46.439 INFO:tasks.workunit.client.0.smithi099.stdout:9/760: chown dd/d2c/d5c/d85/d8d/deb 202821207 1 2024-09-19T06:40:46.440 INFO:tasks.workunit.client.0.smithi099.stdout:1/701: link d0/d17/d32/c60 d0/d17/d24/d3a/da4/ce3 0 2024-09-19T06:40:46.442 INFO:tasks.workunit.client.0.smithi099.stdout:9/761: symlink dd/d2c/d5c/d85/l102 0 2024-09-19T06:40:46.444 INFO:tasks.workunit.client.0.smithi099.stdout:0/660: dwrite d0/db/d27/d5d/d87/f88 [0,4194304] 0 2024-09-19T06:40:46.447 INFO:tasks.workunit.client.0.smithi099.stdout:3/967: dread d7/d34/d1d/d57/fbc [0,4194304] 0 2024-09-19T06:40:46.447 INFO:tasks.workunit.client.0.smithi099.stdout:1/702: read d0/d12/f30 [1623345,49397] 0 2024-09-19T06:40:46.449 INFO:tasks.workunit.client.0.smithi099.stdout:0/661: truncate d0/d17/d41/f3d 9434357 0 2024-09-19T06:40:46.453 INFO:tasks.workunit.client.0.smithi099.stdout:9/762: dread dd/f5b [0,4194304] 0 2024-09-19T06:40:46.456 INFO:tasks.workunit.client.0.smithi099.stdout:9/763: chown dd/d47/d40/f3f 381699 1 2024-09-19T06:40:46.456 INFO:tasks.workunit.client.0.smithi099.stdout:3/968: dwrite d7/d34/d1d/d36/d69/d96/fe8 [0,4194304] 0 2024-09-19T06:40:46.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:46 smithi099 ceph-mon[27651]: from='client.14634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:40:46.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:46 smithi099 ceph-mon[27651]: pgmap v21: 65 pgs: 65 active+clean; 2.8 GiB data, 9.8 GiB used, 527 GiB / 536 GiB avail; 106 MiB/s rd, 287 MiB/s wr, 534 op/s 2024-09-19T06:40:46.456 INFO:tasks.workunit.client.1.smithi117.stdout:2/974: symlink d0/d12/d32/d7d/l16b 0 2024-09-19T06:40:46.458 INFO:tasks.workunit.client.1.smithi117.stdout:2/975: write d0/d7/d29/d35/dbd/d8d/f9d [4704106,62796] 0 2024-09-19T06:40:46.461 INFO:tasks.workunit.client.0.smithi099.stdout:3/969: creat d7/d34/d1d/d57/f131 x:0 0 0 2024-09-19T06:40:46.461 INFO:tasks.workunit.client.1.smithi117.stdout:2/976: creat d0/d7/d29/d35/d61/d65/d120/f16c x:0 0 0 2024-09-19T06:40:46.461 INFO:tasks.workunit.client.0.smithi099.stdout:3/970: readlink d7/d34/d1d/l1e 0 2024-09-19T06:40:46.463 INFO:tasks.workunit.client.0.smithi099.stdout:3/971: symlink d7/d34/d1d/d20/d75/d9d/l132 0 2024-09-19T06:40:46.464 INFO:tasks.workunit.client.0.smithi099.stdout:3/972: rename d7/d34 to d7/d34/d1d/d36/db3/de0/d133 22 2024-09-19T06:40:46.465 INFO:tasks.workunit.client.0.smithi099.stdout:3/973: chown d7/d34/d1d/d20/d75/ca1 4 1 2024-09-19T06:40:46.468 INFO:tasks.workunit.client.0.smithi099.stdout:3/974: mknod d7/d34/d1d/d36/c134 0 2024-09-19T06:40:46.469 INFO:tasks.workunit.client.0.smithi099.stdout:2/573: sync 2024-09-19T06:40:46.469 INFO:tasks.workunit.client.0.smithi099.stdout:8/688: sync 2024-09-19T06:40:46.473 INFO:tasks.workunit.client.0.smithi099.stdout:8/689: rename d4/de/d26/f28 to d4/de/d14/fe7 0 2024-09-19T06:40:46.473 INFO:tasks.workunit.client.0.smithi099.stdout:2/574: rename d1/d2/d4d/d55/da5/d9 to d1/d2/d4d/d55/da5/d9/da3/dc1 22 2024-09-19T06:40:46.475 INFO:tasks.workunit.client.0.smithi099.stdout:8/690: write d4/d11/d23/d92/fa4 [566969,89203] 0 2024-09-19T06:40:46.475 INFO:tasks.workunit.client.0.smithi099.stdout:2/575: rmdir d1/d2/d4d/d55/da5/d36 39 2024-09-19T06:40:46.476 INFO:tasks.workunit.client.0.smithi099.stdout:8/691: mknod d4/d8a/dde/ce8 0 2024-09-19T06:40:46.478 INFO:tasks.workunit.client.0.smithi099.stdout:8/692: write d4/d11/d23/d4c/f69 [3878092,104162] 0 2024-09-19T06:40:46.480 INFO:tasks.workunit.client.0.smithi099.stdout:8/693: symlink d4/d66/le9 0 2024-09-19T06:40:46.482 INFO:tasks.workunit.client.0.smithi099.stdout:9/764: dread dd/d47/d40/f2e [0,4194304] 0 2024-09-19T06:40:46.483 INFO:tasks.workunit.client.0.smithi099.stdout:2/576: dwrite d1/d2/d5/d13/f1b [0,4194304] 0 2024-09-19T06:40:46.483 INFO:tasks.workunit.client.0.smithi099.stdout:9/765: readlink dd/d62/d78/ld8 0 2024-09-19T06:40:46.485 INFO:tasks.workunit.client.0.smithi099.stdout:9/766: symlink dd/d2c/d79/l103 0 2024-09-19T06:40:46.487 INFO:tasks.workunit.client.0.smithi099.stdout:9/767: creat dd/d2c/d5c/d64/f104 x:0 0 0 2024-09-19T06:40:46.491 INFO:tasks.workunit.client.1.smithi117.stdout:2/977: dread d0/d12/d32/db5/f50 [0,4194304] 0 2024-09-19T06:40:46.492 INFO:tasks.workunit.client.1.smithi117.stdout:2/978: dread - d0/d7/d58/db1/f169 zero size 2024-09-19T06:40:46.494 INFO:tasks.workunit.client.1.smithi117.stdout:2/979: read d0/d12/fea [3740696,7286] 0 2024-09-19T06:40:46.495 INFO:tasks.workunit.client.1.smithi117.stdout:2/980: write d0/d64/dd9/df0/f14d [504868,65258] 0 2024-09-19T06:40:46.497 INFO:tasks.workunit.client.1.smithi117.stdout:2/981: rmdir d0/d7/d1e/d20/dbc/de6 39 2024-09-19T06:40:46.498 INFO:tasks.workunit.client.1.smithi117.stdout:2/982: read - d0/d7/d29/d35/d61/d65/f151 zero size 2024-09-19T06:40:46.499 INFO:tasks.workunit.client.1.smithi117.stdout:2/983: write d0/d12/d32/db5/f83 [1759093,55541] 0 2024-09-19T06:40:46.501 INFO:tasks.workunit.client.1.smithi117.stdout:2/984: mkdir d0/d16d 0 2024-09-19T06:40:46.503 INFO:tasks.workunit.client.1.smithi117.stdout:2/985: mknod d0/d7/d29/d71/c16e 0 2024-09-19T06:40:46.504 INFO:tasks.workunit.client.1.smithi117.stdout:2/986: write d0/d7/d58/db1/fbe [705856,43068] 0 2024-09-19T06:40:46.504 INFO:tasks.workunit.client.1.smithi117.stdout:3/933: sync 2024-09-19T06:40:46.505 INFO:tasks.workunit.client.1.smithi117.stdout:8/866: sync 2024-09-19T06:40:46.505 INFO:tasks.workunit.client.1.smithi117.stdout:0/877: sync 2024-09-19T06:40:46.505 INFO:tasks.workunit.client.1.smithi117.stdout:7/940: sync 2024-09-19T06:40:46.507 INFO:tasks.workunit.client.1.smithi117.stdout:8/867: mknod d1d/d31/dbe/c128 0 2024-09-19T06:40:46.508 INFO:tasks.workunit.client.1.smithi117.stdout:7/941: mknod d1/d3f/c149 0 2024-09-19T06:40:46.509 INFO:tasks.workunit.client.1.smithi117.stdout:3/934: symlink d0/d9/d4e/db4/l12b 0 2024-09-19T06:40:46.511 INFO:tasks.workunit.client.1.smithi117.stdout:2/987: creat d0/d7/d29/df4/f16f x:0 0 0 2024-09-19T06:40:46.512 INFO:tasks.workunit.client.1.smithi117.stdout:8/868: read d1d/d2a/d3f/d4b/d66/dac/f9c [1921934,11437] 0 2024-09-19T06:40:46.512 INFO:tasks.workunit.client.1.smithi117.stdout:7/942: creat d1/d4a/d7c/dbc/f14a x:0 0 0 2024-09-19T06:40:46.513 INFO:tasks.workunit.client.1.smithi117.stdout:8/869: dread - d1d/d1e/dbc/dff/f107 zero size 2024-09-19T06:40:46.514 INFO:tasks.workunit.client.1.smithi117.stdout:7/943: write d1/d4a/d81/d24/fd3 [1512436,127363] 0 2024-09-19T06:40:46.514 INFO:tasks.workunit.client.1.smithi117.stdout:2/988: creat d0/d12/d32/db5/f170 x:0 0 0 2024-09-19T06:40:46.515 INFO:tasks.workunit.client.1.smithi117.stdout:8/870: symlink d1d/d2a/d3f/d4b/d91/l129 0 2024-09-19T06:40:46.517 INFO:tasks.workunit.client.1.smithi117.stdout:8/871: mknod d1d/d31/d83/c12a 0 2024-09-19T06:40:46.522 INFO:tasks.workunit.client.1.smithi117.stdout:0/878: write d11/d13/d1b/d27/d37/d6d/f95 [5202539,50476] 0 2024-09-19T06:40:46.524 INFO:tasks.workunit.client.1.smithi117.stdout:8/872: truncate d1d/f52 1065109 0 2024-09-19T06:40:46.538 INFO:tasks.workunit.client.0.smithi099.stdout:9/768: write dd/d47/f38 [2561715,118539] 0 2024-09-19T06:40:46.539 INFO:tasks.workunit.client.0.smithi099.stdout:9/769: chown dd/d2c/d79/l103 16428373 1 2024-09-19T06:40:46.542 INFO:tasks.workunit.client.0.smithi099.stdout:9/770: rename dd/d2c/d5c/d85/d8d to dd/d2c/d5c/d64/d93/dfa/d105 0 2024-09-19T06:40:46.544 INFO:tasks.workunit.client.0.smithi099.stdout:3/975: dread d7/f5f [0,4194304] 0 2024-09-19T06:40:46.544 INFO:tasks.workunit.client.0.smithi099.stdout:9/771: write dd/d2c/d5c/d64/d93/fe9 [131814,7843] 0 2024-09-19T06:40:46.545 INFO:tasks.workunit.client.1.smithi117.stdout:1/900: sync 2024-09-19T06:40:46.545 INFO:tasks.workunit.client.1.smithi117.stdout:6/754: sync 2024-09-19T06:40:46.546 INFO:tasks.workunit.client.0.smithi099.stdout:9/772: dread - dd/d62/d76/d9a/fdd zero size 2024-09-19T06:40:46.548 INFO:tasks.workunit.client.0.smithi099.stdout:8/694: dread d4/d11/f1f [0,4194304] 0 2024-09-19T06:40:46.548 INFO:tasks.workunit.client.0.smithi099.stdout:9/773: mknod dd/d47/d68/c106 0 2024-09-19T06:40:46.549 INFO:tasks.workunit.client.0.smithi099.stdout:3/976: rename d7/d34/d1d/d20/d75/d10d/d11f to d7/d34/d1d/d36/d135 0 2024-09-19T06:40:46.551 INFO:tasks.workunit.client.0.smithi099.stdout:3/977: symlink d7/d34/d1d/d36/db3/de0/de9/l136 0 2024-09-19T06:40:46.552 INFO:tasks.workunit.client.0.smithi099.stdout:9/774: getdents dd/d2c/d5c 0 2024-09-19T06:40:46.554 INFO:tasks.workunit.client.0.smithi099.stdout:3/978: fsync d7/d34/f3a 0 2024-09-19T06:40:46.555 INFO:tasks.workunit.client.0.smithi099.stdout:3/979: readlink d7/d34/l10c 0 2024-09-19T06:40:46.555 INFO:tasks.workunit.client.0.smithi099.stdout:3/980: dread - d7/d34/d1d/d20/d75/d9d/fd4 zero size 2024-09-19T06:40:46.556 INFO:tasks.workunit.client.0.smithi099.stdout:9/775: creat dd/d2c/d5c/f107 x:0 0 0 2024-09-19T06:40:46.561 INFO:tasks.workunit.client.0.smithi099.stdout:8/695: dwrite d4/de/fa8 [0,4194304] 0 2024-09-19T06:40:46.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:46 smithi117 ceph-mon[34564]: from='client.14634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:40:46.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:46 smithi117 ceph-mon[34564]: pgmap v21: 65 pgs: 65 active+clean; 2.8 GiB data, 9.8 GiB used, 527 GiB / 536 GiB avail; 106 MiB/s rd, 287 MiB/s wr, 534 op/s 2024-09-19T06:40:46.562 INFO:tasks.workunit.client.0.smithi099.stdout:8/696: fdatasync d4/de/d1c/f1d 0 2024-09-19T06:40:46.563 INFO:tasks.workunit.client.0.smithi099.stdout:3/981: write d7/d34/d1d/d36/f4a [948072,119954] 0 2024-09-19T06:40:46.563 INFO:tasks.workunit.client.0.smithi099.stdout:8/697: mknod d4/de/d14/cea 0 2024-09-19T06:40:46.566 INFO:tasks.workunit.client.0.smithi099.stdout:3/982: write d7/d34/f70 [6209423,105214] 0 2024-09-19T06:40:46.567 INFO:tasks.workunit.client.0.smithi099.stdout:8/698: readlink d4/d11/d23/d4c/daf/lb0 0 2024-09-19T06:40:46.567 INFO:tasks.workunit.client.0.smithi099.stdout:8/699: stat d4/d66/fe5 0 2024-09-19T06:40:46.567 INFO:tasks.workunit.client.0.smithi099.stdout:8/700: dread - d4/d66/fe5 zero size 2024-09-19T06:40:46.569 INFO:tasks.workunit.client.0.smithi099.stdout:3/983: mkdir d7/d34/d1d/d36/d69/d6d/d7a/d137 0 2024-09-19T06:40:46.570 INFO:tasks.workunit.client.0.smithi099.stdout:8/701: fdatasync d4/de/d10/f68 0 2024-09-19T06:40:46.570 INFO:tasks.workunit.client.0.smithi099.stdout:9/776: getdents dd/d2c/d5c/d64/d93/dfa 0 2024-09-19T06:40:46.572 INFO:tasks.workunit.client.0.smithi099.stdout:8/702: mkdir d4/de/d14/deb 0 2024-09-19T06:40:46.574 INFO:tasks.workunit.client.0.smithi099.stdout:8/703: read d4/d11/f21 [553218,83120] 0 2024-09-19T06:40:46.575 INFO:tasks.workunit.client.0.smithi099.stdout:9/777: dread dd/d47/d68/f9c [4194304,4194304] 0 2024-09-19T06:40:46.576 INFO:tasks.workunit.client.0.smithi099.stdout:8/704: symlink d4/d11/d38/lec 0 2024-09-19T06:40:46.578 INFO:tasks.workunit.client.0.smithi099.stdout:9/778: unlink dd/d47/d40/c4a 0 2024-09-19T06:40:46.579 INFO:tasks.workunit.client.0.smithi099.stdout:9/779: creat dd/d2c/d5c/d64/d93/f108 x:0 0 0 2024-09-19T06:40:46.581 INFO:tasks.workunit.client.0.smithi099.stdout:8/705: getdents d4/d11/d38/dc0 0 2024-09-19T06:40:46.582 INFO:tasks.workunit.client.0.smithi099.stdout:9/780: fsync dd/d47/d68/f6c 0 2024-09-19T06:40:46.584 INFO:tasks.workunit.client.1.smithi117.stdout:3/935: dread d0/f5e [4194304,4194304] 0 2024-09-19T06:40:46.585 INFO:tasks.workunit.client.1.smithi117.stdout:8/873: chown d1d/d2a/d3f/d4b/d5f/d95/f9b 2951161 1 2024-09-19T06:40:46.585 INFO:tasks.workunit.client.1.smithi117.stdout:1/901: write d3/f13 [3228164,78855] 0 2024-09-19T06:40:46.587 INFO:tasks.workunit.client.1.smithi117.stdout:3/936: write d0/fb [8665306,64052] 0 2024-09-19T06:40:46.588 INFO:tasks.workunit.client.0.smithi099.stdout:8/706: rename d4/de/d1c/c90 to d4/de/d26/d2b/dae/ced 0 2024-09-19T06:40:46.590 INFO:tasks.workunit.client.1.smithi117.stdout:1/902: chown d3/d18/d91/f133 4043787 1 2024-09-19T06:40:46.591 INFO:tasks.workunit.client.1.smithi117.stdout:0/879: dwrite d11/d13/d14/d2c/f2f [0,4194304] 0 2024-09-19T06:40:46.593 INFO:tasks.workunit.client.0.smithi099.stdout:3/984: dwrite d7/d34/d1d/d36/d42/f62 [4194304,4194304] 0 2024-09-19T06:40:46.596 INFO:tasks.workunit.client.1.smithi117.stdout:6/755: dwrite d1/d14/dd5/fdf [0,4194304] 0 2024-09-19T06:40:46.597 INFO:tasks.workunit.client.0.smithi099.stdout:9/781: dwrite dd/f6a [0,4194304] 0 2024-09-19T06:40:46.598 INFO:tasks.workunit.client.1.smithi117.stdout:6/756: chown d1/d5/d32/c31 36876 1 2024-09-19T06:40:46.598 INFO:tasks.workunit.client.0.smithi099.stdout:9/782: chown dd/d47/d40/l46 29150051 1 2024-09-19T06:40:46.599 INFO:tasks.workunit.client.1.smithi117.stdout:8/874: symlink d1d/d2a/d3f/d4b/d5f/dbf/dd0/db9/dc4/l12b 0 2024-09-19T06:40:46.600 INFO:tasks.workunit.client.0.smithi099.stdout:5/894: sync 2024-09-19T06:40:46.600 INFO:tasks.workunit.client.0.smithi099.stdout:6/683: sync 2024-09-19T06:40:46.601 INFO:tasks.workunit.client.1.smithi117.stdout:1/903: symlink d3/da1/db1/d93/dd0/l137 0 2024-09-19T06:40:46.604 INFO:tasks.workunit.client.1.smithi117.stdout:6/757: mknod d1/d14/ce2 0 2024-09-19T06:40:46.604 INFO:tasks.workunit.client.1.smithi117.stdout:1/904: chown d3/da1/dcc/c12d 27 1 2024-09-19T06:40:46.605 INFO:tasks.workunit.client.0.smithi099.stdout:7/893: sync 2024-09-19T06:40:46.605 INFO:tasks.workunit.client.0.smithi099.stdout:3/985: symlink d7/d34/d1d/d36/d42/l138 0 2024-09-19T06:40:46.605 INFO:tasks.workunit.client.0.smithi099.stdout:3/986: write d7/d34/d1d/d36/d69/d6d/d7a/f9f [110542,30385] 0 2024-09-19T06:40:46.605 INFO:tasks.workunit.client.1.smithi117.stdout:3/937: getdents d0/d19/d2b/d8e 0 2024-09-19T06:40:46.607 INFO:tasks.workunit.client.1.smithi117.stdout:0/880: dwrite d11/d13/d14/d16/da1/ff4 [0,4194304] 0 2024-09-19T06:40:46.608 INFO:tasks.workunit.client.1.smithi117.stdout:3/938: write d0/d19/d2b/d8e/f2f [105981,12430] 0 2024-09-19T06:40:46.609 INFO:tasks.workunit.client.1.smithi117.stdout:6/758: rmdir d1/d5/d9a 39 2024-09-19T06:40:46.610 INFO:tasks.workunit.client.0.smithi099.stdout:5/895: mknod d3/d7/d90/c13b 0 2024-09-19T06:40:46.610 INFO:tasks.workunit.client.1.smithi117.stdout:0/881: write d11/d13/d14/dbd/d10d/f81 [4456777,69771] 0 2024-09-19T06:40:46.612 INFO:tasks.workunit.client.1.smithi117.stdout:3/939: dread - d0/fb5 zero size 2024-09-19T06:40:46.613 INFO:tasks.workunit.client.0.smithi099.stdout:3/987: dwrite d7/d34/d1d/d36/d69/f112 [0,4194304] 0 2024-09-19T06:40:46.614 INFO:tasks.workunit.client.0.smithi099.stdout:6/684: mkdir d1/d5/d24/d2b/d86/de0 0 2024-09-19T06:40:46.614 INFO:tasks.workunit.client.1.smithi117.stdout:6/759: truncate d1/d14/f4c 1615072 0 2024-09-19T06:40:46.615 INFO:tasks.workunit.client.0.smithi099.stdout:5/896: stat d3/l1d 0 2024-09-19T06:40:46.616 INFO:tasks.workunit.client.0.smithi099.stdout:7/894: mknod d7/dcf/d29/d1f/d45/d48/ddc/d11e/d82/c147 0 2024-09-19T06:40:46.617 INFO:tasks.workunit.client.1.smithi117.stdout:1/905: creat d3/d18/d23/f138 x:0 0 0 2024-09-19T06:40:46.617 INFO:tasks.workunit.client.0.smithi099.stdout:3/988: unlink d7/f68 0 2024-09-19T06:40:46.618 INFO:tasks.workunit.client.0.smithi099.stdout:6/685: creat d1/d5/d24/d2e/d41/d81/fe1 x:0 0 0 2024-09-19T06:40:46.618 INFO:tasks.workunit.client.0.smithi099.stdout:7/895: truncate d7/dcf/d29/f4a 6219704 0 2024-09-19T06:40:46.621 INFO:tasks.workunit.client.0.smithi099.stdout:6/686: creat d1/d5/d24/d2e/d7b/dba/fe2 x:0 0 0 2024-09-19T06:40:46.623 INFO:tasks.workunit.client.0.smithi099.stdout:7/896: mknod d7/dcf/d29/d1f/dec/dfd/c148 0 2024-09-19T06:40:46.624 INFO:tasks.workunit.client.1.smithi117.stdout:1/906: dwrite d3/d18/d23/f70 [0,4194304] 0 2024-09-19T06:40:46.626 INFO:tasks.workunit.client.0.smithi099.stdout:3/989: symlink d7/d34/d1d/d57/l139 0 2024-09-19T06:40:46.629 INFO:tasks.workunit.client.0.smithi099.stdout:5/897: dwrite d3/d1f/f91 [0,4194304] 0 2024-09-19T06:40:46.632 INFO:tasks.workunit.client.0.smithi099.stdout:5/898: chown d3/d16/d2f/d34/da4/da5/dce/de5/fc5 2604 1 2024-09-19T06:40:46.632 INFO:tasks.workunit.client.0.smithi099.stdout:7/897: rmdir d7/dcf/d97 39 2024-09-19T06:40:46.633 INFO:tasks.workunit.client.0.smithi099.stdout:3/990: mkdir d7/d34/d1d/d36/db3/d13a 0 2024-09-19T06:40:46.635 INFO:tasks.workunit.client.0.smithi099.stdout:3/991: truncate d7/d34/d1d/d57/f131 106724 0 2024-09-19T06:40:46.636 INFO:tasks.workunit.client.0.smithi099.stdout:7/898: dread - d7/dcf/d29/d1f/d45/d48/dda/f126 zero size 2024-09-19T06:40:46.642 INFO:tasks.workunit.client.0.smithi099.stdout:3/992: mkdir d7/d34/d1d/d20/d75/d10d/d13b 0 2024-09-19T06:40:46.642 INFO:tasks.workunit.client.0.smithi099.stdout:8/707: dread d4/de/d10/f24 [4194304,4194304] 0 2024-09-19T06:40:46.644 INFO:tasks.workunit.client.0.smithi099.stdout:7/899: truncate d7/f2c 892753 0 2024-09-19T06:40:46.646 INFO:tasks.workunit.client.0.smithi099.stdout:8/708: rename d4/d8a to d4/d11/d61/dee 0 2024-09-19T06:40:46.647 INFO:tasks.workunit.client.0.smithi099.stdout:3/993: mknod d7/d34/dd6/d121/c13c 0 2024-09-19T06:40:46.648 INFO:tasks.workunit.client.0.smithi099.stdout:8/709: chown d4/f54 66020916 1 2024-09-19T06:40:46.648 INFO:tasks.workunit.client.0.smithi099.stdout:3/994: chown d7/d34/l61 2875196 1 2024-09-19T06:40:46.649 INFO:tasks.workunit.client.0.smithi099.stdout:7/900: creat d7/f149 x:0 0 0 2024-09-19T06:40:46.650 INFO:tasks.workunit.client.0.smithi099.stdout:3/995: read - d7/d34/d1d/d20/d75/d9d/fd4 zero size 2024-09-19T06:40:46.651 INFO:tasks.workunit.client.0.smithi099.stdout:3/996: fsync d7/d34/d1d/d36/d135/ff8 0 2024-09-19T06:40:46.654 INFO:tasks.workunit.client.0.smithi099.stdout:8/710: rename d4/de/d26/d2b/fb5 to d4/de/d1c/fef 0 2024-09-19T06:40:46.656 INFO:tasks.workunit.client.0.smithi099.stdout:9/783: dread fa [0,4194304] 0 2024-09-19T06:40:46.658 INFO:tasks.workunit.client.0.smithi099.stdout:9/784: write dd/d47/d40/f52 [939513,93329] 0 2024-09-19T06:40:46.658 INFO:tasks.workunit.client.0.smithi099.stdout:8/711: creat d4/d11/d23/d3f/ff0 x:0 0 0 2024-09-19T06:40:46.659 INFO:tasks.workunit.client.0.smithi099.stdout:7/901: getdents d7/dcf/d29/d1f/dec 0 2024-09-19T06:40:46.660 INFO:tasks.workunit.client.0.smithi099.stdout:3/997: link d7/d34/d1d/d36/d42/c63 d7/d34/d1d/d57/d76/ddf/c13d 0 2024-09-19T06:40:46.661 INFO:tasks.workunit.client.0.smithi099.stdout:8/712: write d4/de/d10/f24 [9400293,95687] 0 2024-09-19T06:40:46.663 INFO:tasks.workunit.client.0.smithi099.stdout:7/902: truncate d7/dcf/d29/d1f/dec/ffe 4926944 0 2024-09-19T06:40:46.664 INFO:tasks.workunit.client.1.smithi117.stdout:3/940: dread d0/d8/d64/fde [0,4194304] 0 2024-09-19T06:40:46.664 INFO:tasks.workunit.client.0.smithi099.stdout:8/713: fsync d4/d11/d23/d92/fd4 0 2024-09-19T06:40:46.666 INFO:tasks.workunit.client.0.smithi099.stdout:3/998: mkdir d7/d34/d1d/d20/d58/d5c/dbd/d13e 0 2024-09-19T06:40:46.666 INFO:tasks.workunit.client.0.smithi099.stdout:5/899: dread d3/d7/f3b [0,4194304] 0 2024-09-19T06:40:46.668 INFO:tasks.workunit.client.0.smithi099.stdout:7/903: symlink d7/d39/d7d/dd6/l14a 0 2024-09-19T06:40:46.668 INFO:tasks.workunit.client.0.smithi099.stdout:9/785: link dd/d47/d40/f56 dd/d47/d40/da9/f109 0 2024-09-19T06:40:46.670 INFO:tasks.workunit.client.0.smithi099.stdout:8/714: truncate d4/d11/d23/d4c/ddd/fb6 851015 0 2024-09-19T06:40:46.671 INFO:tasks.workunit.client.1.smithi117.stdout:7/944: sync 2024-09-19T06:40:46.672 INFO:tasks.workunit.client.0.smithi099.stdout:3/999: rename d7/f15 to d7/d34/d1d/d36/d69/d6d/d7a/d137/f13f 0 2024-09-19T06:40:46.674 INFO:tasks.workunit.client.0.smithi099.stdout:9/786: creat dd/d62/d76/d9a/f10a x:0 0 0 2024-09-19T06:40:46.676 INFO:tasks.workunit.client.0.smithi099.stdout:6/687: write d1/d5/d38/dbb/fd5 [2965697,102239] 0 2024-09-19T06:40:46.680 INFO:tasks.workunit.client.0.smithi099.stdout:8/715: rename d4/de/d10/l7a to d4/d11/d61/lf1 0 2024-09-19T06:40:46.681 INFO:tasks.workunit.client.0.smithi099.stdout:8/716: write d4/d11/d23/d92/fd4 [155439,32739] 0 2024-09-19T06:40:46.682 INFO:tasks.workunit.client.0.smithi099.stdout:9/787: readlink dd/d47/lf6 0 2024-09-19T06:40:46.683 INFO:tasks.workunit.client.0.smithi099.stdout:8/717: dread - d4/d5e/dbb/fce zero size 2024-09-19T06:40:46.685 INFO:tasks.workunit.client.0.smithi099.stdout:1/703: sync 2024-09-19T06:40:46.685 INFO:tasks.workunit.client.0.smithi099.stdout:4/734: sync 2024-09-19T06:40:46.687 INFO:tasks.workunit.client.0.smithi099.stdout:9/788: mkdir dd/d47/d40/da9/d10b 0 2024-09-19T06:40:46.688 INFO:tasks.workunit.client.0.smithi099.stdout:8/718: creat d4/de/d26/d2b/ff2 x:0 0 0 2024-09-19T06:40:46.689 INFO:tasks.workunit.client.1.smithi117.stdout:7/945: read - d1/d4a/d7c/d95/db5/fda zero size 2024-09-19T06:40:46.690 INFO:tasks.workunit.client.0.smithi099.stdout:8/719: chown d4/d5e/dbb/fc4 1066939 1 2024-09-19T06:40:46.691 INFO:tasks.workunit.client.1.smithi117.stdout:7/946: readlink d1/d4a/d81/d24/d1c/d55/l6e 0 2024-09-19T06:40:46.692 INFO:tasks.workunit.client.1.smithi117.stdout:8/875: truncate d1d/ffb 1573709 0 2024-09-19T06:40:46.693 INFO:tasks.workunit.client.1.smithi117.stdout:8/876: fsync d1d/d1e/f101 0 2024-09-19T06:40:46.693 INFO:tasks.workunit.client.1.smithi117.stdout:3/941: truncate d0/d19/d2b/f6e 1300582 0 2024-09-19T06:40:46.696 INFO:tasks.workunit.client.0.smithi099.stdout:7/904: write d7/dcf/d29/d1f/d45/d48/ddc/d11e/d53/fba [776384,69504] 0 2024-09-19T06:40:46.697 INFO:tasks.workunit.client.1.smithi117.stdout:7/947: rename d1/d4a/d81/d48/d5f/d82/fd9 to d1/d4a/d81/d24/d26/d148/f14b 0 2024-09-19T06:40:46.698 INFO:tasks.workunit.client.1.smithi117.stdout:3/942: mknod d0/d3d/d48/dc7/c12c 0 2024-09-19T06:40:46.699 INFO:tasks.workunit.client.0.smithi099.stdout:5/900: truncate d3/d16/d2f/d34/d3c/fc8 4150917 0 2024-09-19T06:40:46.701 INFO:tasks.workunit.client.0.smithi099.stdout:9/789: dwrite dd/d47/d68/f9c [4194304,4194304] 0 2024-09-19T06:40:46.702 INFO:tasks.workunit.client.0.smithi099.stdout:6/688: dread d1/d12/faa [0,4194304] 0 2024-09-19T06:40:46.704 INFO:tasks.workunit.client.1.smithi117.stdout:0/882: truncate d11/f48 2020635 0 2024-09-19T06:40:46.705 INFO:tasks.workunit.client.0.smithi099.stdout:9/790: read dd/d62/f66 [28573,125120] 0 2024-09-19T06:40:46.706 INFO:tasks.workunit.client.0.smithi099.stdout:1/704: write d0/d12/d13/f49 [442026,34973] 0 2024-09-19T06:40:46.706 INFO:tasks.workunit.client.0.smithi099.stdout:6/689: chown d1/d5/d38/d76/db0/d54/fd1 917953 1 2024-09-19T06:40:46.706 INFO:tasks.workunit.client.0.smithi099.stdout:4/735: write d12/f16 [3932495,93145] 0 2024-09-19T06:40:46.706 INFO:tasks.workunit.client.0.smithi099.stdout:8/720: getdents d4/de/d10 0 2024-09-19T06:40:46.706 INFO:tasks.workunit.client.0.smithi099.stdout:7/905: symlink d7/dcf/d29/d1f/d45/d48/ddc/d11e/l14b 0 2024-09-19T06:40:46.706 INFO:tasks.workunit.client.1.smithi117.stdout:7/948: mknod d1/d4a/d81/d24/d26/d44/dd2/c14c 0 2024-09-19T06:40:46.708 INFO:tasks.workunit.client.1.smithi117.stdout:3/943: creat d0/d9/d1c/d53/f12d x:0 0 0 2024-09-19T06:40:46.708 INFO:tasks.workunit.client.0.smithi099.stdout:1/705: chown d0/d17/d24/d75 611 1 2024-09-19T06:40:46.709 INFO:tasks.workunit.client.1.smithi117.stdout:3/944: stat d0/d8/d64/f66 0 2024-09-19T06:40:46.710 INFO:tasks.workunit.client.0.smithi099.stdout:7/906: write d7/dcf/d29/d34/f98 [51387,61099] 0 2024-09-19T06:40:46.712 INFO:tasks.workunit.client.1.smithi117.stdout:0/883: write d11/f83 [4375637,109250] 0 2024-09-19T06:40:46.713 INFO:tasks.workunit.client.1.smithi117.stdout:7/949: dread - d1/d4a/d81/d24/fe7 zero size 2024-09-19T06:40:46.715 INFO:tasks.workunit.client.1.smithi117.stdout:7/950: write d1/d4a/d7c/d95/ddc/f108 [548059,111473] 0 2024-09-19T06:40:46.716 INFO:tasks.workunit.client.1.smithi117.stdout:0/884: symlink d11/d13/d1b/d27/d54/l125 0 2024-09-19T06:40:46.719 INFO:tasks.workunit.client.1.smithi117.stdout:7/951: creat d1/d4a/d81/d24/d26/d44/dd2/f14d x:0 0 0 2024-09-19T06:40:46.721 INFO:tasks.workunit.client.0.smithi099.stdout:6/690: dread d1/d5/d24/d2e/d41/f8d [4194304,4194304] 0 2024-09-19T06:40:46.722 INFO:tasks.workunit.client.1.smithi117.stdout:7/952: stat d1/d4a/d81/d24/c1b 0 2024-09-19T06:40:46.722 INFO:tasks.workunit.client.0.smithi099.stdout:7/907: truncate d7/dcf/d29/d1f/d45/d48/d63/f88 1353186 0 2024-09-19T06:40:46.722 INFO:tasks.workunit.client.0.smithi099.stdout:1/706: link d0/d17/d24/d3a/c9b d0/d17/d5b/dba/ce4 0 2024-09-19T06:40:46.725 INFO:tasks.workunit.client.1.smithi117.stdout:7/953: truncate d1/d4a/d7c/fd8 1298021 0 2024-09-19T06:40:46.725 INFO:tasks.workunit.client.0.smithi099.stdout:5/901: dwrite d3/d16/d2f/d34/da4/da5/dce/de5/fe9 [4194304,4194304] 0 2024-09-19T06:40:46.725 INFO:tasks.workunit.client.0.smithi099.stdout:4/736: write d12/d32/d42/d5c/d51/f7f [4256426,113024] 0 2024-09-19T06:40:46.726 INFO:tasks.workunit.client.1.smithi117.stdout:3/945: dwrite d0/d9/d1c/f39 [4194304,4194304] 0 2024-09-19T06:40:46.726 INFO:tasks.workunit.client.0.smithi099.stdout:1/707: readlink d0/d2d/l8b 0 2024-09-19T06:40:46.728 INFO:tasks.workunit.client.0.smithi099.stdout:4/737: fsync d12/fcf 0 2024-09-19T06:40:46.728 INFO:tasks.workunit.client.0.smithi099.stdout:8/721: dwrite d4/d66/f76 [0,4194304] 0 2024-09-19T06:40:46.730 INFO:tasks.workunit.client.0.smithi099.stdout:4/738: write d12/f1a [4670049,78124] 0 2024-09-19T06:40:46.731 INFO:tasks.workunit.client.1.smithi117.stdout:2/989: sync 2024-09-19T06:40:46.731 INFO:tasks.workunit.client.0.smithi099.stdout:4/739: fsync d12/d82/ddd/fa0 0 2024-09-19T06:40:46.733 INFO:tasks.workunit.client.1.smithi117.stdout:3/946: fdatasync d0/d9/d1c/fac 0 2024-09-19T06:40:46.733 INFO:tasks.workunit.client.0.smithi099.stdout:4/740: dread - d12/d1b/d73/fd7 zero size 2024-09-19T06:40:46.735 INFO:tasks.workunit.client.1.smithi117.stdout:3/947: dread - d0/d9/d4e/d9e/fb8 zero size 2024-09-19T06:40:46.736 INFO:tasks.workunit.client.0.smithi099.stdout:5/902: truncate d3/d16/f58 1061756 0 2024-09-19T06:40:46.737 INFO:tasks.workunit.client.0.smithi099.stdout:0/662: sync 2024-09-19T06:40:46.737 INFO:tasks.workunit.client.0.smithi099.stdout:2/577: sync 2024-09-19T06:40:46.737 INFO:tasks.workunit.client.0.smithi099.stdout:7/908: write d7/dcf/d97/de5/f13a [3976129,73337] 0 2024-09-19T06:40:46.738 INFO:tasks.workunit.client.0.smithi099.stdout:1/708: mknod d0/d17/d24/ce5 0 2024-09-19T06:40:46.740 INFO:tasks.workunit.client.1.smithi117.stdout:2/990: dwrite d0/d64/dd9/f112 [0,4194304] 0 2024-09-19T06:40:46.742 INFO:tasks.workunit.client.0.smithi099.stdout:7/909: readlink d7/dcf/d97/de5/l12f 0 2024-09-19T06:40:46.742 INFO:tasks.workunit.client.0.smithi099.stdout:2/578: stat d1/c61 0 2024-09-19T06:40:46.745 INFO:tasks.workunit.client.0.smithi099.stdout:9/791: truncate dd/d2c/dd9/fec 1574093 0 2024-09-19T06:40:46.746 INFO:tasks.workunit.client.0.smithi099.stdout:1/709: creat d0/d68/daf/fe6 x:0 0 0 2024-09-19T06:40:46.747 INFO:tasks.workunit.client.1.smithi117.stdout:3/948: creat d0/d9/f12e x:0 0 0 2024-09-19T06:40:46.747 INFO:tasks.workunit.client.0.smithi099.stdout:0/663: symlink d0/db/d36/d3f/d91/ld8 0 2024-09-19T06:40:46.748 INFO:tasks.workunit.client.0.smithi099.stdout:7/910: fsync d7/dcf/d29/d1f/d45/d48/dda/ff8 0 2024-09-19T06:40:46.749 INFO:tasks.workunit.client.1.smithi117.stdout:3/949: truncate d0/d9/d1c/d53/fd9 4994105 0 2024-09-19T06:40:46.749 INFO:tasks.workunit.client.0.smithi099.stdout:2/579: rmdir d1/d2/d4d/d55/da5/d9/d63 39 2024-09-19T06:40:46.752 INFO:tasks.workunit.client.0.smithi099.stdout:4/741: dread d12/d82/ddd/fa0 [0,4194304] 0 2024-09-19T06:40:46.753 INFO:tasks.workunit.client.0.smithi099.stdout:9/792: read dd/d2c/d5c/d64/d93/fe6 [221681,70040] 0 2024-09-19T06:40:46.753 INFO:tasks.workunit.client.0.smithi099.stdout:7/911: creat d7/dc7/d67/f14c x:0 0 0 2024-09-19T06:40:46.753 INFO:tasks.workunit.client.0.smithi099.stdout:5/903: dwrite d3/d16/d2f/fc6 [0,4194304] 0 2024-09-19T06:40:46.756 INFO:tasks.workunit.client.0.smithi099.stdout:7/912: dread - d7/dc7/d67/ffc zero size 2024-09-19T06:40:46.758 INFO:tasks.workunit.client.0.smithi099.stdout:7/913: dread - d7/dcf/d29/d1f/fd7 zero size 2024-09-19T06:40:46.760 INFO:tasks.workunit.client.0.smithi099.stdout:4/742: symlink d12/d82/ddd/d89/de4/lf9 0 2024-09-19T06:40:46.763 INFO:tasks.workunit.client.0.smithi099.stdout:7/914: rmdir d7/d39 39 2024-09-19T06:40:46.765 INFO:tasks.workunit.client.0.smithi099.stdout:2/580: mknod d1/d2/d4d/d55/da5/d18/d46/d65/cc2 0 2024-09-19T06:40:46.765 INFO:tasks.workunit.client.0.smithi099.stdout:1/710: dwrite d0/d12/d13/fc7 [4194304,4194304] 0 2024-09-19T06:40:46.767 INFO:tasks.workunit.client.0.smithi099.stdout:1/711: write d0/d17/d32/fc8 [197435,91938] 0 2024-09-19T06:40:46.768 INFO:tasks.workunit.client.0.smithi099.stdout:4/743: mknod d12/d82/ddd/d9b/da2/cfa 0 2024-09-19T06:40:46.768 INFO:tasks.workunit.client.0.smithi099.stdout:1/712: chown d0/d12 26653 1 2024-09-19T06:40:46.769 INFO:tasks.workunit.client.0.smithi099.stdout:1/713: chown d0/d2d/f96 2489 1 2024-09-19T06:40:46.769 INFO:tasks.workunit.client.0.smithi099.stdout:4/744: fsync d12/d1b/d73/f8e 0 2024-09-19T06:40:46.771 INFO:tasks.workunit.client.0.smithi099.stdout:4/745: write d12/d32/f2e [1101356,25062] 0 2024-09-19T06:40:46.772 INFO:tasks.workunit.client.0.smithi099.stdout:1/714: creat d0/d17/d24/d5e/d8a/fe7 x:0 0 0 2024-09-19T06:40:46.774 INFO:tasks.workunit.client.0.smithi099.stdout:1/715: write d0/d12/d13/d37/d48/fc1 [3155222,99120] 0 2024-09-19T06:40:46.774 INFO:tasks.workunit.client.0.smithi099.stdout:4/746: chown d12/d32/d39/f90 101 1 2024-09-19T06:40:46.775 INFO:tasks.workunit.client.0.smithi099.stdout:8/722: dread d4/d11/d23/d4c/f69 [0,4194304] 0 2024-09-19T06:40:46.776 INFO:tasks.workunit.client.0.smithi099.stdout:2/581: link d1/d2/d4d/d55/da5/d18/d2d/l84 d1/d2/d4d/d55/da5/d18/d46/d65/lc3 0 2024-09-19T06:40:46.777 INFO:tasks.workunit.client.0.smithi099.stdout:4/747: dread - d12/d32/d42/d5c/fb3 zero size 2024-09-19T06:40:46.778 INFO:tasks.workunit.client.0.smithi099.stdout:1/716: mknod d0/d17/d24/d5e/d8a/ce8 0 2024-09-19T06:40:46.779 INFO:tasks.workunit.client.0.smithi099.stdout:8/723: mkdir d4/de/d14/df3 0 2024-09-19T06:40:46.779 INFO:tasks.workunit.client.0.smithi099.stdout:8/724: fdatasync d4/d5e/dbb/fce 0 2024-09-19T06:40:46.780 INFO:tasks.workunit.client.0.smithi099.stdout:2/582: mkdir d1/d2/d4d/d55/dc4 0 2024-09-19T06:40:46.783 INFO:tasks.workunit.client.1.smithi117.stdout:1/907: truncate d3/d18/d23/f4f 865441 0 2024-09-19T06:40:46.783 INFO:tasks.workunit.client.0.smithi099.stdout:1/717: creat d0/d17/d24/d3a/d58/d8d/dae/fe9 x:0 0 0 2024-09-19T06:40:46.784 INFO:tasks.workunit.client.0.smithi099.stdout:6/691: write d1/d5/d38/d76/db0/d2a/f55 [1016349,111179] 0 2024-09-19T06:40:46.784 INFO:tasks.workunit.client.1.smithi117.stdout:1/908: write d3/d18/d23/f7f [3245856,67484] 0 2024-09-19T06:40:46.786 INFO:tasks.workunit.client.1.smithi117.stdout:1/909: chown d3/da1/db1/d93/fed 7 1 2024-09-19T06:40:46.788 INFO:tasks.workunit.client.1.smithi117.stdout:1/910: mkdir d3/d18/d56/d139 0 2024-09-19T06:40:46.789 INFO:tasks.workunit.client.1.smithi117.stdout:1/911: write d3/d8e/db4/fcb [1132771,98997] 0 2024-09-19T06:40:46.790 INFO:tasks.workunit.client.1.smithi117.stdout:6/760: write d1/d5/d8/d5e/d67/d98/fb8 [704147,70865] 0 2024-09-19T06:40:46.791 INFO:tasks.workunit.client.0.smithi099.stdout:1/718: rename d0/d17/d32/l64 to d0/d2d/lea 0 2024-09-19T06:40:46.791 INFO:tasks.workunit.client.1.smithi117.stdout:8/877: write d1d/d2a/d3f/d4b/d5f/d95/f78 [3836943,4247] 0 2024-09-19T06:40:46.793 INFO:tasks.workunit.client.1.smithi117.stdout:1/912: write d3/d18/d97/f122 [1023924,30977] 0 2024-09-19T06:40:46.793 INFO:tasks.workunit.client.0.smithi099.stdout:4/748: dread d12/d32/d42/f93 [0,4194304] 0 2024-09-19T06:40:46.794 INFO:tasks.workunit.client.0.smithi099.stdout:1/719: read d0/d17/d24/f46 [9111,125269] 0 2024-09-19T06:40:46.795 INFO:tasks.workunit.client.1.smithi117.stdout:1/913: write d3/d22/d2f/f92 [34014,9833] 0 2024-09-19T06:40:46.795 INFO:tasks.workunit.client.1.smithi117.stdout:6/761: rmdir d1/d5/d8/d5e/d67/d98 39 2024-09-19T06:40:46.795 INFO:tasks.workunit.client.1.smithi117.stdout:8/878: dread d1d/d31/d83/dad/dc0/fce [0,4194304] 0 2024-09-19T06:40:46.796 INFO:tasks.workunit.client.0.smithi099.stdout:1/720: truncate d0/d17/d32/d7b/f84 4328827 0 2024-09-19T06:40:46.798 INFO:tasks.workunit.client.0.smithi099.stdout:4/749: dread d12/d82/ddd/d9b/da2/fd5 [0,4194304] 0 2024-09-19T06:40:46.800 INFO:tasks.workunit.client.1.smithi117.stdout:1/914: creat d3/da1/db1/d93/f13a x:0 0 0 2024-09-19T06:40:46.807 INFO:tasks.workunit.client.0.smithi099.stdout:7/915: dread d7/dcf/d29/d1f/d45/d48/ddc/d11e/d53/fac [0,4194304] 0 2024-09-19T06:40:46.808 INFO:tasks.workunit.client.1.smithi117.stdout:6/762: rename d1/d14/f2b to d1/d5/d8/d5e/d67/d98/ddd/fe3 0 2024-09-19T06:40:46.809 INFO:tasks.workunit.client.1.smithi117.stdout:6/763: write d1/d5/f8e [814220,124702] 0 2024-09-19T06:40:46.809 INFO:tasks.workunit.client.1.smithi117.stdout:6/764: stat d1/d5/d8/db0/fc5 0 2024-09-19T06:40:46.810 INFO:tasks.workunit.client.1.smithi117.stdout:1/915: mknod d3/da1/d11d/c13b 0 2024-09-19T06:40:46.815 INFO:tasks.workunit.client.1.smithi117.stdout:0/885: mknod d11/d13/d14/d2c/c126 0 2024-09-19T06:40:46.817 INFO:tasks.workunit.client.0.smithi099.stdout:7/916: link d7/dcf/d29/df9/f137 d7/dcf/d29/d1f/d45/d48/d63/d75/dd8/f14d 0 2024-09-19T06:40:46.817 INFO:tasks.workunit.client.1.smithi117.stdout:0/886: stat d11/d13/d28/dfe/d9e 0 2024-09-19T06:40:46.817 INFO:tasks.workunit.client.1.smithi117.stdout:1/916: dwrite d3/fc5 [4194304,4194304] 0 2024-09-19T06:40:46.819 INFO:tasks.workunit.client.1.smithi117.stdout:1/917: fsync d3/d18/d91/f124 0 2024-09-19T06:40:46.819 INFO:tasks.workunit.client.1.smithi117.stdout:6/765: creat d1/d5/d8/d5e/d67/fe4 x:0 0 0 2024-09-19T06:40:46.821 INFO:tasks.workunit.client.0.smithi099.stdout:8/725: truncate d4/d66/f76 2371361 0 2024-09-19T06:40:46.821 INFO:tasks.workunit.client.1.smithi117.stdout:1/918: write d3/d8e/db4/f119 [834193,53751] 0 2024-09-19T06:40:46.823 INFO:tasks.workunit.client.1.smithi117.stdout:0/887: rename d11/d13/d11e/ffc to d11/d13/d1b/d27/d37/d6d/f127 0 2024-09-19T06:40:46.824 INFO:tasks.workunit.client.0.smithi099.stdout:6/692: write d1/d5/d24/f6a [1413151,48069] 0 2024-09-19T06:40:46.825 INFO:tasks.workunit.client.1.smithi117.stdout:0/888: dread d11/d13/d14/d16/f3a [4194304,4194304] 0 2024-09-19T06:40:46.826 INFO:tasks.workunit.client.1.smithi117.stdout:6/766: mknod d1/d3d/ce5 0 2024-09-19T06:40:46.827 INFO:tasks.workunit.client.0.smithi099.stdout:7/917: mkdir d7/dcf/d97/d14e 0 2024-09-19T06:40:46.827 INFO:tasks.workunit.client.0.smithi099.stdout:9/793: dwrite fa [0,4194304] 0 2024-09-19T06:40:46.827 INFO:tasks.workunit.client.0.smithi099.stdout:4/750: dread d12/f38 [0,4194304] 0 2024-09-19T06:40:46.827 INFO:tasks.workunit.client.0.smithi099.stdout:0/664: dwrite d0/db/d27/d5d/d87/da2/dbc/d47/f92 [0,4194304] 0 2024-09-19T06:40:46.828 INFO:tasks.workunit.client.1.smithi117.stdout:1/919: mkdir d3/d18/d97/d13c 0 2024-09-19T06:40:46.830 INFO:tasks.workunit.client.1.smithi117.stdout:0/889: rmdir d11/d13/d14/d2c/d53/d7e 39 2024-09-19T06:40:46.834 INFO:tasks.workunit.client.0.smithi099.stdout:8/726: mknod d4/de/d26/d2b/cf4 0 2024-09-19T06:40:46.835 INFO:tasks.workunit.client.0.smithi099.stdout:1/721: dread d0/d17/d24/d3a/da4/fda [0,4194304] 0 2024-09-19T06:40:46.835 INFO:tasks.workunit.client.1.smithi117.stdout:7/954: dwrite d1/d4a/d81/d24/f3a [0,4194304] 0 2024-09-19T06:40:46.835 INFO:tasks.workunit.client.0.smithi099.stdout:7/918: rmdir d7/dcf/d29/d1f/d45/d48/ddc/d11e/d53 39 2024-09-19T06:40:46.836 INFO:tasks.workunit.client.1.smithi117.stdout:6/767: mknod d1/d5/d8/d99/ce6 0 2024-09-19T06:40:46.836 INFO:tasks.workunit.client.0.smithi099.stdout:4/751: write d12/d32/f27 [2777796,118577] 0 2024-09-19T06:40:46.838 INFO:tasks.workunit.client.0.smithi099.stdout:9/794: mknod dd/d47/d40/da9/d10b/c10c 0 2024-09-19T06:40:46.838 INFO:tasks.workunit.client.1.smithi117.stdout:0/890: dread - d11/d13/d14/d2c/d53/fc6 zero size 2024-09-19T06:40:46.839 INFO:tasks.workunit.client.0.smithi099.stdout:4/752: rmdir d12/d82 39 2024-09-19T06:40:46.840 INFO:tasks.workunit.client.0.smithi099.stdout:6/693: link d1/d5/d24/d2e/f70 d1/d5/fe3 0 2024-09-19T06:40:46.841 INFO:tasks.workunit.client.1.smithi117.stdout:1/920: fsync d3/d18/d23/f2d 0 2024-09-19T06:40:46.843 INFO:tasks.workunit.client.0.smithi099.stdout:2/583: dread d1/d2/d4d/d55/da5/d18/d27/d5b/f8c [0,4194304] 0 2024-09-19T06:40:46.845 INFO:tasks.workunit.client.1.smithi117.stdout:3/950: write d0/d19/d2b/d8e/fa0 [3442123,32085] 0 2024-09-19T06:40:46.845 INFO:tasks.workunit.client.1.smithi117.stdout:1/921: readlink d3/da1/db1/l125 0 2024-09-19T06:40:46.846 INFO:tasks.workunit.client.0.smithi099.stdout:1/722: creat d0/d12/d13/d37/d41/d78/feb x:0 0 0 2024-09-19T06:40:46.847 INFO:tasks.workunit.client.0.smithi099.stdout:7/919: symlink d7/dcf/d29/d1f/dec/dfd/l14f 0 2024-09-19T06:40:46.847 INFO:tasks.workunit.client.0.smithi099.stdout:9/795: truncate dd/f34 1094701 0 2024-09-19T06:40:46.849 INFO:tasks.workunit.client.0.smithi099.stdout:6/694: rename d1/c91 to d1/d12/ce4 0 2024-09-19T06:40:46.849 INFO:tasks.workunit.client.0.smithi099.stdout:1/723: truncate d0/d68/fde 1026418 0 2024-09-19T06:40:46.850 INFO:tasks.workunit.client.1.smithi117.stdout:7/955: truncate d1/d4a/d81/d24/d1c/d35/d4f/f87 4129101 0 2024-09-19T06:40:46.851 INFO:tasks.workunit.client.0.smithi099.stdout:4/753: symlink d12/d82/ddd/d9b/dab/dbf/lfb 0 2024-09-19T06:40:46.854 INFO:tasks.workunit.client.1.smithi117.stdout:6/768: creat d1/d5/d9a/da9/fe7 x:0 0 0 2024-09-19T06:40:46.855 INFO:tasks.workunit.client.0.smithi099.stdout:6/695: chown d1/d12/dda/lde 1163134971 1 2024-09-19T06:40:46.857 INFO:tasks.workunit.client.1.smithi117.stdout:2/991: dwrite d0/d7/fba [0,4194304] 0 2024-09-19T06:40:46.858 INFO:tasks.workunit.client.0.smithi099.stdout:4/754: mkdir d12/d82/ddd/d8a/da9/dfc 0 2024-09-19T06:40:46.858 INFO:tasks.workunit.client.0.smithi099.stdout:7/920: dwrite d7/dcf/d29/f4a [0,4194304] 0 2024-09-19T06:40:46.858 INFO:tasks.workunit.client.0.smithi099.stdout:2/584: getdents d1/d2/d4d/d55/da5/d18/d27/d5b 0 2024-09-19T06:40:46.860 INFO:tasks.workunit.client.1.smithi117.stdout:0/891: creat d11/d13/d14/d2c/d53/d7e/daa/f128 x:0 0 0 2024-09-19T06:40:46.861 INFO:tasks.workunit.client.0.smithi099.stdout:7/921: write d7/dcf/d29/d1f/f12e [1056605,96499] 0 2024-09-19T06:40:46.862 INFO:tasks.workunit.client.0.smithi099.stdout:7/922: dread - d7/dcf/d97/fad zero size 2024-09-19T06:40:46.863 INFO:tasks.workunit.client.1.smithi117.stdout:1/922: dwrite d3/da1/db1/d93/f13a [0,4194304] 0 2024-09-19T06:40:46.867 INFO:tasks.workunit.client.0.smithi099.stdout:6/696: creat d1/d5/d24/d2b/d86/de0/fe5 x:0 0 0 2024-09-19T06:40:46.868 INFO:tasks.workunit.client.1.smithi117.stdout:2/992: stat d0/d7/d29/d35/d61/def/f107 0 2024-09-19T06:40:46.868 INFO:tasks.workunit.client.1.smithi117.stdout:0/892: chown d11/d13/d1b/d27/l9c 6 1 2024-09-19T06:40:46.871 INFO:tasks.workunit.client.0.smithi099.stdout:2/585: mknod d1/d2/d4d/d55/da5/d9/da3/cc5 0 2024-09-19T06:40:46.872 INFO:tasks.workunit.client.1.smithi117.stdout:3/951: dwrite d0/d9/d4e/f10f [0,4194304] 0 2024-09-19T06:40:46.874 INFO:tasks.workunit.client.1.smithi117.stdout:1/923: creat d3/d8e/d10e/f13d x:0 0 0 2024-09-19T06:40:46.875 INFO:tasks.workunit.client.1.smithi117.stdout:7/956: link d1/d4a/d81/d24/d1c/f4e d1/d4a/d7c/dbc/f14e 0 2024-09-19T06:40:46.876 INFO:tasks.workunit.client.0.smithi099.stdout:7/923: dwrite d7/dcf/d29/d1f/d45/f5b [0,4194304] 0 2024-09-19T06:40:46.877 INFO:tasks.workunit.client.1.smithi117.stdout:0/893: mkdir d11/d13/d1b/d27/d54/d129 0 2024-09-19T06:40:46.877 INFO:tasks.workunit.client.1.smithi117.stdout:3/952: truncate d0/d3d/d48/dc7/f114 1313354 0 2024-09-19T06:40:46.878 INFO:tasks.workunit.client.0.smithi099.stdout:7/924: fsync d7/dcf/d29/d34/d8f/ff1 0 2024-09-19T06:40:46.881 INFO:tasks.workunit.client.1.smithi117.stdout:2/993: rename d0/d7/d29/d35/f77 to d0/d7/d29/df4/d105/d11b/f171 0 2024-09-19T06:40:46.882 INFO:tasks.workunit.client.1.smithi117.stdout:8/879: dwrite d1d/d31/fe3 [0,4194304] 0 2024-09-19T06:40:46.885 INFO:tasks.workunit.client.1.smithi117.stdout:0/894: creat d11/d13/d28/de6/f12a x:0 0 0 2024-09-19T06:40:46.886 INFO:tasks.workunit.client.0.smithi099.stdout:2/586: dread d1/fa9 [0,4194304] 0 2024-09-19T06:40:46.887 INFO:tasks.workunit.client.1.smithi117.stdout:3/953: write d0/d9/d4e/d9e/ddc/f119 [714730,4789] 0 2024-09-19T06:40:46.889 INFO:tasks.workunit.client.1.smithi117.stdout:7/957: mknod d1/c14f 0 2024-09-19T06:40:46.889 INFO:tasks.workunit.client.0.smithi099.stdout:7/925: dwrite d7/dcf/d29/d1f/dec/f111 [0,4194304] 0 2024-09-19T06:40:46.890 INFO:tasks.workunit.client.1.smithi117.stdout:7/958: fsync d1/d3f/f109 0 2024-09-19T06:40:46.890 INFO:tasks.workunit.client.0.smithi099.stdout:2/587: chown d1/d2/d4d/l31 3 1 2024-09-19T06:40:46.895 INFO:tasks.workunit.client.1.smithi117.stdout:1/924: rename d3/da1/la4 to d3/d18/d23/l13e 0 2024-09-19T06:40:46.896 INFO:tasks.workunit.client.1.smithi117.stdout:7/959: mkdir d1/d4a/d81/d24/d26/d150 0 2024-09-19T06:40:46.898 INFO:tasks.workunit.client.1.smithi117.stdout:8/880: link d1d/fb0 d1d/d2a/d3f/d4b/d5f/dbf/dd0/f12c 0 2024-09-19T06:40:46.899 INFO:tasks.workunit.client.1.smithi117.stdout:2/994: rename d0/d7/d29/d35/d61/d65/f151 to d0/d12/d32/db5/d114/f172 0 2024-09-19T06:40:46.899 INFO:tasks.workunit.client.1.smithi117.stdout:1/925: symlink d3/d18/d56/l13f 0 2024-09-19T06:40:46.899 INFO:tasks.workunit.client.0.smithi099.stdout:2/588: rename d1/d2/d5 to d1/d2/d4d/d55/da5/d9/d63/dc6 0 2024-09-19T06:40:46.901 INFO:tasks.workunit.client.0.smithi099.stdout:2/589: chown d1/d2/d4d/d55/da5/d18/d27/d5b 14 1 2024-09-19T06:40:46.901 INFO:tasks.workunit.client.1.smithi117.stdout:1/926: chown d3/d99/c101 1 1 2024-09-19T06:40:46.901 INFO:tasks.workunit.client.1.smithi117.stdout:0/895: rename d11/d13/d14/d16/da1/d11f to d11/d13/d1b/d27/d54/d12b 0 2024-09-19T06:40:46.908 INFO:tasks.workunit.client.0.smithi099.stdout:2/590: dwrite d1/d2/d4d/d55/da5/d18/d27/d5b/f7e [4194304,4194304] 0 2024-09-19T06:40:46.908 INFO:tasks.workunit.client.1.smithi117.stdout:1/927: dwrite d3/d18/d23/f103 [0,4194304] 0 2024-09-19T06:40:46.911 INFO:tasks.workunit.client.0.smithi099.stdout:7/926: read d7/dcf/d29/d1f/d45/d48/ddc/d11e/d53/f66 [5101266,63922] 0 2024-09-19T06:40:46.911 INFO:tasks.workunit.client.1.smithi117.stdout:0/896: dwrite d11/d13/d1b/d27/d37/d6d/f95 [0,4194304] 0 2024-09-19T06:40:46.911 INFO:tasks.workunit.client.1.smithi117.stdout:6/769: dread d1/f1b [8388608,4194304] 0 2024-09-19T06:40:46.913 INFO:tasks.workunit.client.1.smithi117.stdout:6/770: write d1/d5/d8/d5e/d6d/f71 [374941,103331] 0 2024-09-19T06:40:46.914 INFO:tasks.workunit.client.1.smithi117.stdout:6/771: fsync d1/d5/d8/d5e/f96 0 2024-09-19T06:40:46.915 INFO:tasks.workunit.client.0.smithi099.stdout:7/927: creat d7/dcf/d29/d1f/deb/f150 x:0 0 0 2024-09-19T06:40:46.917 INFO:tasks.workunit.client.1.smithi117.stdout:0/897: truncate d11/d13/d1b/d27/d37/da9/fde 36161 0 2024-09-19T06:40:46.918 INFO:tasks.workunit.client.1.smithi117.stdout:6/772: fsync d1/d5/d8/d5e/d6d/f79 0 2024-09-19T06:40:46.919 INFO:tasks.workunit.client.1.smithi117.stdout:6/773: write d1/d5/d8/d5e/f92 [1012400,54109] 0 2024-09-19T06:40:46.920 INFO:tasks.workunit.client.0.smithi099.stdout:7/928: creat d7/dcf/d29/d1f/deb/d13c/f151 x:0 0 0 2024-09-19T06:40:46.925 INFO:tasks.workunit.client.1.smithi117.stdout:6/774: chown d1/d5/d8/d5e/l6a 116448 1 2024-09-19T06:40:46.925 INFO:tasks.workunit.client.1.smithi117.stdout:0/898: dwrite d11/d13/d1b/d27/d54/d12b/f73 [4194304,4194304] 0 2024-09-19T06:40:46.926 INFO:tasks.workunit.client.0.smithi099.stdout:7/929: unlink d7/dcf/d29/d1f/d45/d48/ddc/d11e/d53/f108 0 2024-09-19T06:40:46.927 INFO:tasks.workunit.client.0.smithi099.stdout:7/930: write d7/dcf/d29/d34/da1/fa9 [1927864,18397] 0 2024-09-19T06:40:46.932 INFO:tasks.workunit.client.0.smithi099.stdout:7/931: creat d7/dcf/d29/d1f/de9/f152 x:0 0 0 2024-09-19T06:40:46.932 INFO:tasks.workunit.client.1.smithi117.stdout:0/899: mkdir d11/d13/d14/d12c 0 2024-09-19T06:40:46.933 INFO:tasks.workunit.client.1.smithi117.stdout:6/775: dwrite d1/d5/d8/db0/fb9 [0,4194304] 0 2024-09-19T06:40:46.936 INFO:tasks.workunit.client.0.smithi099.stdout:7/932: mkdir d7/dcf/d29/d1f/d45/d48/df5/d153 0 2024-09-19T06:40:46.939 INFO:tasks.workunit.client.1.smithi117.stdout:6/776: rename d1/d5/d8/db0/f52 to d1/d3d/d6f/fe8 0 2024-09-19T06:40:46.939 INFO:tasks.workunit.client.1.smithi117.stdout:2/995: dread d0/d12/d32/db5/f4a [0,4194304] 0 2024-09-19T06:40:46.940 INFO:tasks.workunit.client.0.smithi099.stdout:7/933: mkdir d7/d39/d7d/d154 0 2024-09-19T06:40:46.941 INFO:tasks.workunit.client.1.smithi117.stdout:6/777: write d1/d5/d8/db0/f78 [4256027,76866] 0 2024-09-19T06:40:46.942 INFO:tasks.workunit.client.1.smithi117.stdout:2/996: mknod d0/d7/d29/d35/d61/d65/c173 0 2024-09-19T06:40:46.944 INFO:tasks.workunit.client.1.smithi117.stdout:6/778: creat d1/d14/dd5/fe9 x:0 0 0 2024-09-19T06:40:46.944 INFO:tasks.workunit.client.1.smithi117.stdout:2/997: chown d0/d7/d1e/d20/dbc/d116/d98/cc7 16538707 1 2024-09-19T06:40:46.947 INFO:tasks.workunit.client.1.smithi117.stdout:6/779: creat d1/d5/d9a/fea x:0 0 0 2024-09-19T06:40:46.948 INFO:tasks.workunit.client.1.smithi117.stdout:2/998: truncate d0/d64/fc8 1017393 0 2024-09-19T06:40:46.949 INFO:tasks.workunit.client.1.smithi117.stdout:8/881: dread d1d/d2a/d3f/d73/ddd/f51 [0,4194304] 0 2024-09-19T06:40:46.954 INFO:tasks.workunit.client.1.smithi117.stdout:6/780: dwrite d1/d5/d8/d5e/f68 [0,4194304] 0 2024-09-19T06:40:46.960 INFO:tasks.workunit.client.1.smithi117.stdout:6/781: dwrite d1/d5/d8/d5e/d6d/f79 [0,4194304] 0 2024-09-19T06:40:46.961 INFO:tasks.workunit.client.1.smithi117.stdout:6/782: fsync d1/d5/d8/db5/fbe 0 2024-09-19T06:40:46.963 INFO:tasks.workunit.client.1.smithi117.stdout:6/783: write d1/d3d/d6f/f8c [3425006,41666] 0 2024-09-19T06:40:46.965 INFO:tasks.workunit.client.1.smithi117.stdout:6/784: rmdir d1/d5/d32/dc1 39 2024-09-19T06:40:46.967 INFO:tasks.workunit.client.1.smithi117.stdout:6/785: mknod d1/d5/d8/d5e/d67/d98/ceb 0 2024-09-19T06:40:46.969 INFO:tasks.workunit.client.1.smithi117.stdout:6/786: stat d1/d3d/d6f/l9d 0 2024-09-19T06:40:46.970 INFO:tasks.workunit.client.1.smithi117.stdout:6/787: dread d1/d3d/d6f/f7c [0,4194304] 0 2024-09-19T06:40:46.999 INFO:tasks.workunit.client.1.smithi117.stdout:6/788: dread d1/d3/f17 [4194304,4194304] 0 2024-09-19T06:40:47.000 INFO:tasks.workunit.client.0.smithi099.stdout:1/724: write d0/f29 [414220,4003] 0 2024-09-19T06:40:47.002 INFO:tasks.workunit.client.0.smithi099.stdout:4/755: write d12/d32/d42/d5c/f5d [208715,106731] 0 2024-09-19T06:40:47.003 INFO:tasks.workunit.client.0.smithi099.stdout:8/727: dwrite d4/d11/d23/d3f/f55 [0,4194304] 0 2024-09-19T06:40:47.003 INFO:tasks.workunit.client.0.smithi099.stdout:2/591: getdents d1/d2/d4d/d55/da5/d9/da3 0 2024-09-19T06:40:47.005 INFO:tasks.workunit.client.0.smithi099.stdout:1/725: rename d0/d17 to d0/d17/d32/d7b/db0/dec 22 2024-09-19T06:40:47.008 INFO:tasks.workunit.client.0.smithi099.stdout:4/756: unlink d12/d32/f5b 0 2024-09-19T06:40:47.010 INFO:tasks.workunit.client.0.smithi099.stdout:8/728: getdents d4/d11/d38/dc0 0 2024-09-19T06:40:47.011 INFO:tasks.workunit.client.0.smithi099.stdout:1/726: chown d0/d17/d24/d5e/d8a/da3 241 1 2024-09-19T06:40:47.011 INFO:tasks.workunit.client.0.smithi099.stdout:9/796: dwrite dd/d65/da3/fa6 [0,4194304] 0 2024-09-19T06:40:47.013 INFO:tasks.workunit.client.0.smithi099.stdout:2/592: symlink d1/d2/d4d/d55/da5/d9/da3/lc7 0 2024-09-19T06:40:47.014 INFO:tasks.workunit.client.0.smithi099.stdout:6/697: dwrite d1/d5/d38/d76/db0/d54/d5d/d61/fc4 [0,4194304] 0 2024-09-19T06:40:47.016 INFO:tasks.workunit.client.0.smithi099.stdout:8/729: chown d4/de/d10/l87 22 1 2024-09-19T06:40:47.017 INFO:tasks.workunit.client.0.smithi099.stdout:4/757: symlink d12/d1b/lfd 0 2024-09-19T06:40:47.018 INFO:tasks.workunit.client.0.smithi099.stdout:1/727: mknod d0/d17/d24/d3a/d58/ced 0 2024-09-19T06:40:47.021 INFO:tasks.workunit.client.0.smithi099.stdout:9/797: symlink dd/d2c/dd9/l10d 0 2024-09-19T06:40:47.021 INFO:tasks.workunit.client.0.smithi099.stdout:2/593: creat d1/d2/d4d/d55/da5/d18/d46/d65/fc8 x:0 0 0 2024-09-19T06:40:47.022 INFO:tasks.workunit.client.0.smithi099.stdout:4/758: truncate d12/d1b/d88/fca 767995 0 2024-09-19T06:40:47.024 INFO:tasks.workunit.client.0.smithi099.stdout:8/730: unlink d4/d11/d23/d4c/d93/fb9 0 2024-09-19T06:40:47.024 INFO:tasks.workunit.client.0.smithi099.stdout:4/759: write d12/d82/ddd/d8a/fd6 [3592644,37108] 0 2024-09-19T06:40:47.026 INFO:tasks.workunit.client.0.smithi099.stdout:6/698: rename d1/d12/l5c to d1/d5/d24/d2b/ddb/le6 0 2024-09-19T06:40:47.027 INFO:tasks.workunit.client.1.smithi117.stdout:3/954: dwrite d0/fb5 [0,4194304] 0 2024-09-19T06:40:47.028 INFO:tasks.workunit.client.1.smithi117.stdout:7/960: truncate d1/d4a/d81/d24/d1c/ff1 1546602 0 2024-09-19T06:40:47.028 INFO:tasks.workunit.client.0.smithi099.stdout:1/728: symlink d0/lee 0 2024-09-19T06:40:47.029 INFO:tasks.workunit.client.1.smithi117.stdout:1/928: mkdir d3/da1/d11d/d140 0 2024-09-19T06:40:47.029 INFO:tasks.workunit.client.1.smithi117.stdout:3/955: truncate d0/d9/d4e/f98 559394 0 2024-09-19T06:40:47.030 INFO:tasks.workunit.client.0.smithi099.stdout:1/729: write d0/d17/d24/d75/dbb/de1/fe2 [130309,10716] 0 2024-09-19T06:40:47.031 INFO:tasks.workunit.client.1.smithi117.stdout:7/961: write d1/d4a/d7c/d95/ddc/ffd [419462,10564] 0 2024-09-19T06:40:47.031 INFO:tasks.workunit.client.1.smithi117.stdout:1/929: fdatasync d3/d22/d2f/f62 0 2024-09-19T06:40:47.033 INFO:tasks.workunit.client.1.smithi117.stdout:3/956: fsync d0/d9/ff2 0 2024-09-19T06:40:47.036 INFO:tasks.workunit.client.1.smithi117.stdout:1/930: dread d3/feb [0,4194304] 0 2024-09-19T06:40:47.037 INFO:tasks.workunit.client.1.smithi117.stdout:0/900: write d11/d13/d28/de6/f124 [4439015,69434] 0 2024-09-19T06:40:47.040 INFO:tasks.workunit.client.0.smithi099.stdout:4/760: rename d12/d32/d39/fba to d12/d82/ddd/d9b/ffe 0 2024-09-19T06:40:47.043 INFO:tasks.workunit.client.1.smithi117.stdout:0/901: creat d11/d13/d7a/dfa/f12d x:0 0 0 2024-09-19T06:40:47.044 INFO:tasks.workunit.client.1.smithi117.stdout:2/999: write d0/d7/d29/d35/ff5 [5239803,54064] 0 2024-09-19T06:40:47.044 INFO:tasks.workunit.client.0.smithi099.stdout:7/934: dwrite d7/f52 [0,4194304] 0 2024-09-19T06:40:47.045 INFO:tasks.workunit.client.1.smithi117.stdout:1/931: symlink d3/da1/l141 0 2024-09-19T06:40:47.047 INFO:tasks.workunit.client.0.smithi099.stdout:9/798: dwrite dd/d2c/d79/f7c [0,4194304] 0 2024-09-19T06:40:47.048 INFO:tasks.workunit.client.0.smithi099.stdout:9/799: chown dd/d62/d76/d9a/fdd 87 1 2024-09-19T06:40:47.048 INFO:tasks.workunit.client.1.smithi117.stdout:1/932: symlink d3/d18/d23/dde/l142 0 2024-09-19T06:40:47.049 INFO:tasks.workunit.client.1.smithi117.stdout:3/957: link d0/d3d/d48/dc7/c124 d0/d8/d7f/d40/c12f 0 2024-09-19T06:40:47.053 INFO:tasks.workunit.client.1.smithi117.stdout:1/933: truncate d3/d22/d2f/f92 835750 0 2024-09-19T06:40:47.054 INFO:tasks.workunit.client.1.smithi117.stdout:3/958: write d0/d9/d4e/f10f [1027437,50628] 0 2024-09-19T06:40:47.054 INFO:tasks.workunit.client.1.smithi117.stdout:8/882: dwrite d1d/d1e/dbc/dc1/fe5 [4194304,4194304] 0 2024-09-19T06:40:47.060 INFO:tasks.workunit.client.1.smithi117.stdout:8/883: truncate d1d/d2a/d3f/d4b/d5f/d95/fe7 237126 0 2024-09-19T06:40:47.060 INFO:tasks.workunit.client.1.smithi117.stdout:3/959: creat d0/d9/d1c/df8/d11c/f130 x:0 0 0 2024-09-19T06:40:47.063 INFO:tasks.workunit.client.1.smithi117.stdout:3/960: write d0/d3d/d48/d77/fe5 [209322,127599] 0 2024-09-19T06:40:47.066 INFO:tasks.workunit.client.1.smithi117.stdout:1/934: dwrite d3/d18/d23/d74/fb6 [0,4194304] 0 2024-09-19T06:40:47.066 INFO:tasks.workunit.client.1.smithi117.stdout:6/789: write d1/d5/d32/f6b [816607,29878] 0 2024-09-19T06:40:47.067 INFO:tasks.workunit.client.1.smithi117.stdout:3/961: write d0/d3d/d48/dc7/f102 [437268,62797] 0 2024-09-19T06:40:47.072 INFO:tasks.workunit.client.1.smithi117.stdout:6/790: rmdir d1/d14 39 2024-09-19T06:40:47.072 INFO:tasks.workunit.client.1.smithi117.stdout:1/935: write d3/da1/db1/d93/dd0/f12b [106475,74156] 0 2024-09-19T06:40:47.073 INFO:tasks.workunit.client.1.smithi117.stdout:3/962: mknod d0/d9/d1c/df8/c131 0 2024-09-19T06:40:47.075 INFO:tasks.workunit.client.1.smithi117.stdout:8/884: dwrite d1d/d2a/d3f/d4b/d5f/d95/f78 [0,4194304] 0 2024-09-19T06:40:47.076 INFO:tasks.workunit.client.0.smithi099.stdout:1/730: symlink d0/d17/d5b/lef 0 2024-09-19T06:40:47.077 INFO:tasks.workunit.client.0.smithi099.stdout:2/594: write d1/d2/d4d/d55/da5/d9/d63/dc6/f81 [480668,104771] 0 2024-09-19T06:40:47.077 INFO:tasks.workunit.client.0.smithi099.stdout:1/731: write d0/d12/d13/f22 [2206263,5106] 0 2024-09-19T06:40:47.079 INFO:tasks.workunit.client.0.smithi099.stdout:8/731: symlink d4/lf5 0 2024-09-19T06:40:47.080 INFO:tasks.workunit.client.1.smithi117.stdout:1/936: unlink d3/d18/d23/d74/d89/f8d 0 2024-09-19T06:40:47.083 INFO:tasks.workunit.client.1.smithi117.stdout:6/791: dwrite d1/d14/fd6 [0,4194304] 0 2024-09-19T06:40:47.084 INFO:tasks.workunit.client.1.smithi117.stdout:8/885: chown d1d/d2a/d3f/d4b/d5f/f10c 1990 1 2024-09-19T06:40:47.085 INFO:tasks.workunit.client.1.smithi117.stdout:1/937: write d3/d8e/fe4 [801251,94193] 0 2024-09-19T06:40:47.085 INFO:tasks.workunit.client.1.smithi117.stdout:6/792: stat d1/d5/d32/d45/d7b/f9f 0 2024-09-19T06:40:47.087 INFO:tasks.workunit.client.0.smithi099.stdout:1/732: dread - d0/d12/d13/d37/d41/d78/fc5 zero size 2024-09-19T06:40:47.087 INFO:tasks.workunit.client.0.smithi099.stdout:4/761: symlink d12/d82/ddd/d8a/da9/dfc/lff 0 2024-09-19T06:40:47.087 INFO:tasks.workunit.client.0.smithi099.stdout:6/699: dwrite d1/d5/d38/d76/db0/d54/d5d/d61/f7d [0,4194304] 0 2024-09-19T06:40:47.089 INFO:tasks.workunit.client.1.smithi117.stdout:6/793: rmdir d1/d5/d8/d99 39 2024-09-19T06:40:47.090 INFO:tasks.workunit.client.1.smithi117.stdout:1/938: truncate d3/da1/f11b 932195 0 2024-09-19T06:40:47.093 INFO:tasks.workunit.client.0.smithi099.stdout:2/595: mknod d1/d2/d4d/d55/da5/d9/d63/dc6/d77/d98/cc9 0 2024-09-19T06:40:47.095 INFO:tasks.workunit.client.1.smithi117.stdout:6/794: chown d1/d5/d8/d27/l2f 12834 1 2024-09-19T06:40:47.095 INFO:tasks.workunit.client.1.smithi117.stdout:0/902: truncate d11/d13/fc7 6226561 0 2024-09-19T06:40:47.097 INFO:tasks.workunit.client.1.smithi117.stdout:6/795: fsync d1/d5/d8/d5e/d67/d98/da1/fd2 0 2024-09-19T06:40:47.098 INFO:tasks.workunit.client.0.smithi099.stdout:6/700: symlink d1/d5/d24/d2b/d86/da5/le7 0 2024-09-19T06:40:47.098 INFO:tasks.workunit.client.0.smithi099.stdout:4/762: symlink d12/d82/ddd/d89/l100 0 2024-09-19T06:40:47.098 INFO:tasks.workunit.client.0.smithi099.stdout:2/596: mknod d1/d2/d4d/d55/da5/d9/d63/dc6/d77/d98/cca 0 2024-09-19T06:40:47.099 INFO:tasks.workunit.client.1.smithi117.stdout:7/962: dwrite d1/d4a/d81/d24/d1c/f22 [4194304,4194304] 0 2024-09-19T06:40:47.101 INFO:tasks.workunit.client.0.smithi099.stdout:6/701: creat d1/d5/d24/d2b/fe8 x:0 0 0 2024-09-19T06:40:47.102 INFO:tasks.workunit.client.0.smithi099.stdout:4/763: fdatasync d12/d82/ddd/d9b/fb0 0 2024-09-19T06:40:47.103 INFO:tasks.workunit.client.0.smithi099.stdout:7/935: link d7/dcf/d29/d34/f70 d7/f155 0 2024-09-19T06:40:47.105 INFO:tasks.workunit.client.0.smithi099.stdout:4/764: mkdir d12/d82/ddd/d8a/da9/d101 0 2024-09-19T06:40:47.108 INFO:tasks.workunit.client.0.smithi099.stdout:6/702: getdents d1/d5/d38/d76/db0/d54/d5d/d61 0 2024-09-19T06:40:47.109 INFO:tasks.workunit.client.0.smithi099.stdout:2/597: dwrite d1/d2/d4d/d55/da5/d9/d63/dc6/f81 [0,4194304] 0 2024-09-19T06:40:47.111 INFO:tasks.workunit.client.0.smithi099.stdout:7/936: mkdir d7/dcf/d156 0 2024-09-19T06:40:47.115 INFO:tasks.workunit.client.0.smithi099.stdout:2/598: creat d1/d2/d4d/d55/da5/d18/d27/fcb x:0 0 0 2024-09-19T06:40:47.116 INFO:tasks.workunit.client.0.smithi099.stdout:7/937: creat d7/dcf/d29/d1f/deb/d13c/f157 x:0 0 0 2024-09-19T06:40:47.120 INFO:tasks.workunit.client.0.smithi099.stdout:7/938: creat d7/dcf/d29/d1f/d45/d48/ddc/f158 x:0 0 0 2024-09-19T06:40:47.120 INFO:tasks.workunit.client.0.smithi099.stdout:2/599: link d1/d2/d4d/d55/da5/d18/d27/d5b/fb5 d1/d2/d4d/d8e/fcc 0 2024-09-19T06:40:47.121 INFO:tasks.workunit.client.0.smithi099.stdout:7/939: chown d7/dcf/d29/d34/l69 209923 1 2024-09-19T06:40:47.122 INFO:tasks.workunit.client.0.smithi099.stdout:2/600: mknod d1/d2/d4d/d55/da5/d9/d63/dc6/ccd 0 2024-09-19T06:40:47.129 INFO:tasks.workunit.client.0.smithi099.stdout:2/601: dwrite d1/d2/d4d/d55/da5/d18/d27/d5b/fb5 [0,4194304] 0 2024-09-19T06:40:47.133 INFO:tasks.workunit.client.0.smithi099.stdout:2/602: write d1/d2/d4d/d55/da5/d18/d27/d5b/f8c [143606,28189] 0 2024-09-19T06:40:47.134 INFO:tasks.workunit.client.0.smithi099.stdout:2/603: chown d1/d2/d4d/d55/da5/d18/c68 1 1 2024-09-19T06:40:47.138 INFO:tasks.workunit.client.0.smithi099.stdout:2/604: symlink d1/d2/d4d/d55/da5/d18/d27/lce 0 2024-09-19T06:40:47.139 INFO:tasks.workunit.client.0.smithi099.stdout:2/605: chown d1/c7d 948 1 2024-09-19T06:40:47.145 INFO:tasks.workunit.client.0.smithi099.stdout:2/606: dwrite d1/d2/fc0 [0,4194304] 0 2024-09-19T06:40:47.147 INFO:tasks.workunit.client.0.smithi099.stdout:8/732: rmdir d4 39 2024-09-19T06:40:47.151 INFO:tasks.workunit.client.0.smithi099.stdout:4/765: getdents d12/d82/ddd/d8a/da9/dfc 0 2024-09-19T06:40:47.152 INFO:tasks.workunit.client.0.smithi099.stdout:4/766: chown d12/f50 239130433 1 2024-09-19T06:40:47.153 INFO:tasks.workunit.client.0.smithi099.stdout:2/607: rename d1/d2/d4d/d55/da5/d18/d46/d65/lc3 to d1/d2/d4d/d55/da5/d9/d63/dc6/lcf 0 2024-09-19T06:40:47.156 INFO:tasks.workunit.client.0.smithi099.stdout:8/733: rename d4/d66/dd5 to d4/de/d14/df6 0 2024-09-19T06:40:47.157 INFO:tasks.workunit.client.0.smithi099.stdout:9/800: dwrite dd/d65/f75 [0,4194304] 0 2024-09-19T06:40:47.158 INFO:tasks.workunit.client.0.smithi099.stdout:4/767: truncate d12/d82/ddd/d9b/ff4 1432417 0 2024-09-19T06:40:47.159 INFO:tasks.workunit.client.0.smithi099.stdout:2/608: write d1/d2/d4d/d55/da5/d18/d27/f48 [1432692,118175] 0 2024-09-19T06:40:47.159 INFO:tasks.workunit.client.0.smithi099.stdout:6/703: write d1/f4c [1287467,9245] 0 2024-09-19T06:40:47.163 INFO:tasks.workunit.client.0.smithi099.stdout:8/734: unlink d4/d11/d23/d4c/d93/cd3 0 2024-09-19T06:40:47.164 INFO:tasks.workunit.client.0.smithi099.stdout:9/801: chown dd/d2c/d5c/d64/d93/dfa/d105/deb 89674987 1 2024-09-19T06:40:47.164 INFO:tasks.workunit.client.0.smithi099.stdout:1/733: dwrite d0/db/f23 [4194304,4194304] 0 2024-09-19T06:40:47.164 INFO:tasks.workunit.client.0.smithi099.stdout:4/768: rmdir d12/d32/d42/d5c 39 2024-09-19T06:40:47.169 INFO:tasks.workunit.client.0.smithi099.stdout:1/734: mkdir d0/d17/d24/d3a/df0 0 2024-09-19T06:40:47.169 INFO:tasks.workunit.client.0.smithi099.stdout:2/609: write d1/d2/d4d/d55/da5/d36/f53 [3136876,89814] 0 2024-09-19T06:40:47.169 INFO:tasks.workunit.client.0.smithi099.stdout:9/802: mkdir dd/d2c/d5c/d10e 0 2024-09-19T06:40:47.171 INFO:tasks.workunit.client.0.smithi099.stdout:5/904: sync 2024-09-19T06:40:47.171 INFO:tasks.workunit.client.0.smithi099.stdout:6/704: write d1/d5/d38/d76/db0/d54/d5d/d61/fdd [5016769,29813] 0 2024-09-19T06:40:47.172 INFO:tasks.workunit.client.0.smithi099.stdout:4/769: mkdir d12/d82/ddd/d8a/da9/dfc/d102 0 2024-09-19T06:40:47.173 INFO:tasks.workunit.client.0.smithi099.stdout:2/610: dread - d1/faa zero size 2024-09-19T06:40:47.176 INFO:tasks.workunit.client.0.smithi099.stdout:7/940: dwrite d7/dcf/d29/d34/d8f/faf [0,4194304] 0 2024-09-19T06:40:47.178 INFO:tasks.workunit.client.0.smithi099.stdout:0/665: sync 2024-09-19T06:40:47.181 INFO:tasks.workunit.client.0.smithi099.stdout:1/735: getdents d0/d12/d13/d37 0 2024-09-19T06:40:47.182 INFO:tasks.workunit.client.0.smithi099.stdout:8/735: dwrite d4/d5e/db4/fc3 [0,4194304] 0 2024-09-19T06:40:47.186 INFO:tasks.workunit.client.0.smithi099.stdout:2/611: write d1/d2/d4d/d55/da5/d9/d63/dc6/d13/d2c/f99 [803955,33340] 0 2024-09-19T06:40:47.189 INFO:tasks.workunit.client.0.smithi099.stdout:4/770: truncate d12/d32/d42/d5c/fb3 917380 0 2024-09-19T06:40:47.193 INFO:tasks.workunit.client.0.smithi099.stdout:5/905: dwrite d3/d16/d2f/fc1 [0,4194304] 0 2024-09-19T06:40:47.193 INFO:tasks.workunit.client.0.smithi099.stdout:0/666: creat d0/db/d27/d5d/d87/da2/dbc/d47/d75/da4/dcf/fd9 x:0 0 0 2024-09-19T06:40:47.194 INFO:tasks.workunit.client.0.smithi099.stdout:1/736: mknod d0/d17/d24/d5e/d8a/cf1 0 2024-09-19T06:40:47.194 INFO:tasks.workunit.client.0.smithi099.stdout:7/941: dread d7/dcf/d29/d1f/d45/d48/d63/f10f [0,4194304] 0 2024-09-19T06:40:47.195 INFO:tasks.workunit.client.0.smithi099.stdout:6/705: dwrite d1/d7c/fad [0,4194304] 0 2024-09-19T06:40:47.195 INFO:tasks.workunit.client.0.smithi099.stdout:2/612: stat d1/d2/d4d/d55/da5/d18/d2d/cbf 0 2024-09-19T06:40:47.197 INFO:tasks.workunit.client.0.smithi099.stdout:8/736: rename d4/de/d26/d2b/dae to d4/de/d1c/df7 0 2024-09-19T06:40:47.199 INFO:tasks.workunit.client.0.smithi099.stdout:1/737: symlink d0/d17/d32/d7b/d99/lf2 0 2024-09-19T06:40:47.199 INFO:tasks.workunit.client.0.smithi099.stdout:5/906: chown d3/d14/l55 562 1 2024-09-19T06:40:47.200 INFO:tasks.workunit.client.0.smithi099.stdout:2/613: fsync d1/d2/d4d/d55/da5/d9/d63/dc6/d13/f1b 0 2024-09-19T06:40:47.203 INFO:tasks.workunit.client.0.smithi099.stdout:6/706: truncate d1/d5/d24/f89 1309958 0 2024-09-19T06:40:47.203 INFO:tasks.workunit.client.0.smithi099.stdout:7/942: symlink d7/dcf/d156/l159 0 2024-09-19T06:40:47.204 INFO:tasks.workunit.client.1.smithi117.stdout:3/963: rename d0/d9/d1c/df8 to d0/d9/d4e/dcf/d132 0 2024-09-19T06:40:47.205 INFO:tasks.workunit.client.0.smithi099.stdout:7/943: truncate d7/dc7/d67/ffc 375691 0 2024-09-19T06:40:47.206 INFO:tasks.workunit.client.0.smithi099.stdout:2/614: creat d1/d2/d4d/d55/da5/d36/fd0 x:0 0 0 2024-09-19T06:40:47.207 INFO:tasks.workunit.client.1.smithi117.stdout:8/886: write d1d/ffb [381837,62718] 0 2024-09-19T06:40:47.208 INFO:tasks.workunit.client.0.smithi099.stdout:2/615: fdatasync d1/d2/d4d/d55/da5/d36/f45 0 2024-09-19T06:40:47.208 INFO:tasks.workunit.client.0.smithi099.stdout:6/707: mknod d1/d5/d24/d2b/d86/de0/ce9 0 2024-09-19T06:40:47.209 INFO:tasks.workunit.client.1.smithi117.stdout:8/887: read - d1d/d2a/d3f/f4d zero size 2024-09-19T06:40:47.211 INFO:tasks.workunit.client.0.smithi099.stdout:8/737: rename d4/d11/d23/d4c/f85 to d4/ff8 0 2024-09-19T06:40:47.211 INFO:tasks.workunit.client.0.smithi099.stdout:4/771: dread d12/d82/ddd/d8a/da9/dc7/fe6 [0,4194304] 0 2024-09-19T06:40:47.212 INFO:tasks.workunit.client.1.smithi117.stdout:8/888: symlink d1d/d1e/d3b/l12d 0 2024-09-19T06:40:47.212 INFO:tasks.workunit.client.0.smithi099.stdout:7/944: mknod d7/dc7/c15a 0 2024-09-19T06:40:47.213 INFO:tasks.workunit.client.0.smithi099.stdout:6/708: fsync d1/d5/d24/d2e/d41/f5a 0 2024-09-19T06:40:47.213 INFO:tasks.workunit.client.0.smithi099.stdout:2/616: symlink d1/d2/d4d/d55/da5/d18/d27/d5b/ld1 0 2024-09-19T06:40:47.214 INFO:tasks.workunit.client.1.smithi117.stdout:1/939: rename d3/d18/l69 to d3/d18/d23/l143 0 2024-09-19T06:40:47.214 INFO:tasks.workunit.client.1.smithi117.stdout:3/964: link d0/c27 d0/d8/d7f/dbf/d112/c133 0 2024-09-19T06:40:47.215 INFO:tasks.workunit.client.0.smithi099.stdout:1/738: rename d0/d68/f69 to d0/d17/d24/d5e/d8a/ff3 0 2024-09-19T06:40:47.215 INFO:tasks.workunit.client.1.smithi117.stdout:8/889: symlink d1d/d2a/d3f/d4b/d5f/dbf/d100/l12e 0 2024-09-19T06:40:47.216 INFO:tasks.workunit.client.0.smithi099.stdout:8/738: creat d4/d11/d61/ff9 x:0 0 0 2024-09-19T06:40:47.217 INFO:tasks.workunit.client.0.smithi099.stdout:1/739: chown d0/d12/d13/d37/d48/db9 2793914 1 2024-09-19T06:40:47.217 INFO:tasks.workunit.client.1.smithi117.stdout:6/796: rename d1/d5/d32/d45/d7b/cba to d1/d5/d8/d27/d77/cec 0 2024-09-19T06:40:47.220 INFO:tasks.workunit.client.0.smithi099.stdout:2/617: creat d1/d2/d4d/d55/da5/d9/d63/dc6/d77/fd2 x:0 0 0 2024-09-19T06:40:47.220 INFO:tasks.workunit.client.1.smithi117.stdout:3/965: unlink d0/fa1 0 2024-09-19T06:40:47.221 INFO:tasks.workunit.client.1.smithi117.stdout:1/940: creat d3/d18/d23/d74/f144 x:0 0 0 2024-09-19T06:40:47.221 INFO:tasks.workunit.client.1.smithi117.stdout:3/966: read - d0/d8/d7f/d40/dc4/ffe zero size 2024-09-19T06:40:47.221 INFO:tasks.workunit.client.1.smithi117.stdout:8/890: creat d1d/d31/f12f x:0 0 0 2024-09-19T06:40:47.221 INFO:tasks.workunit.client.0.smithi099.stdout:2/618: write d1/d2/d4d/d55/da5/d36/f41 [764921,105792] 0 2024-09-19T06:40:47.221 INFO:tasks.workunit.client.0.smithi099.stdout:1/740: symlink d0/d17/d24/d3a/d58/d8d/lf4 0 2024-09-19T06:40:47.222 INFO:tasks.workunit.client.1.smithi117.stdout:7/963: rename d1/d4a/d81/d24/d49/dbf to d1/d72/d100/d12b/d151 0 2024-09-19T06:40:47.223 INFO:tasks.workunit.client.0.smithi099.stdout:7/945: link d7/dc7/d67/f91 d7/dcf/d29/d1f/d45/d48/dda/d115/f15b 0 2024-09-19T06:40:47.223 INFO:tasks.workunit.client.1.smithi117.stdout:1/941: unlink d3/d8e/fe4 0 2024-09-19T06:40:47.224 INFO:tasks.workunit.client.0.smithi099.stdout:6/709: dread d1/f72 [0,4194304] 0 2024-09-19T06:40:47.225 INFO:tasks.workunit.client.0.smithi099.stdout:1/741: fdatasync d0/d12/d13/d37/f94 0 2024-09-19T06:40:47.225 INFO:tasks.workunit.client.0.smithi099.stdout:2/619: stat d1/c8b 0 2024-09-19T06:40:47.226 INFO:tasks.workunit.client.0.smithi099.stdout:6/710: chown d1/d5/f50 7754 1 2024-09-19T06:40:47.226 INFO:tasks.workunit.client.0.smithi099.stdout:7/946: dread - d7/dcf/d29/d1f/d45/d48/d63/d75/dd8/f11a zero size 2024-09-19T06:40:47.227 INFO:tasks.workunit.client.1.smithi117.stdout:7/964: unlink d1/d4a/d7c/d95/db5/c136 0 2024-09-19T06:40:47.228 INFO:tasks.workunit.client.1.smithi117.stdout:8/891: symlink d1d/d2a/d3f/d73/ddd/d112/l130 0 2024-09-19T06:40:47.231 INFO:tasks.workunit.client.0.smithi099.stdout:7/947: chown d7/d39/fb7 5661 1 2024-09-19T06:40:47.231 INFO:tasks.workunit.client.1.smithi117.stdout:3/967: truncate d0/d8/f10 2390295 0 2024-09-19T06:40:47.232 INFO:tasks.workunit.client.1.smithi117.stdout:6/797: rename d1/l13 to d1/d5/d8/dc3/led 0 2024-09-19T06:40:47.233 INFO:tasks.workunit.client.1.smithi117.stdout:1/942: fsync d3/f2e 0 2024-09-19T06:40:47.234 INFO:tasks.workunit.client.1.smithi117.stdout:8/892: read d1d/d2a/d3f/d4b/d5f/d95/f9b [2890202,29257] 0 2024-09-19T06:40:47.236 INFO:tasks.workunit.client.0.smithi099.stdout:2/620: dwrite d1/d2/d4d/d55/da5/d9/f3c [0,4194304] 0 2024-09-19T06:40:47.237 INFO:tasks.workunit.client.1.smithi117.stdout:7/965: dwrite d1/d4a/d81/d48/d5f/d82/ff8 [0,4194304] 0 2024-09-19T06:40:47.237 INFO:tasks.workunit.client.1.smithi117.stdout:1/943: write d3/d18/d56/fdb [291555,127653] 0 2024-09-19T06:40:47.238 INFO:tasks.workunit.client.0.smithi099.stdout:7/948: symlink d7/dcf/d29/d1f/d45/d48/ddc/l15c 0 2024-09-19T06:40:47.240 INFO:tasks.workunit.client.1.smithi117.stdout:3/968: creat d0/d9/f134 x:0 0 0 2024-09-19T06:40:47.241 INFO:tasks.workunit.client.0.smithi099.stdout:6/711: rename d1/c43 to d1/d5/d38/d76/db0/d54/d5d/cea 0 2024-09-19T06:40:47.242 INFO:tasks.workunit.client.0.smithi099.stdout:9/803: dread dd/d47/f38 [0,4194304] 0 2024-09-19T06:40:47.242 INFO:tasks.workunit.client.0.smithi099.stdout:6/712: chown d1/d5/d38 0 1 2024-09-19T06:40:47.243 INFO:tasks.workunit.client.0.smithi099.stdout:8/739: dread d4/de/d26/fa5 [0,4194304] 0 2024-09-19T06:40:47.244 INFO:tasks.workunit.client.1.smithi117.stdout:7/966: write d1/d4a/d81/d48/d5f/d82/fa5 [2477920,17742] 0 2024-09-19T06:40:47.244 INFO:tasks.workunit.client.0.smithi099.stdout:7/949: symlink d7/dcf/d29/d34/l15d 0 2024-09-19T06:40:47.245 INFO:tasks.workunit.client.1.smithi117.stdout:1/944: creat d3/da1/da5/f145 x:0 0 0 2024-09-19T06:40:47.246 INFO:tasks.workunit.client.0.smithi099.stdout:7/950: dread - d7/dcf/d29/df9/f137 zero size 2024-09-19T06:40:47.247 INFO:tasks.workunit.client.0.smithi099.stdout:7/951: write d7/dcf/d29/d34/d8f/ff1 [438303,66817] 0 2024-09-19T06:40:47.247 INFO:tasks.workunit.client.0.smithi099.stdout:8/740: creat d4/de/d14/ffa x:0 0 0 2024-09-19T06:40:47.248 INFO:tasks.workunit.client.1.smithi117.stdout:3/969: creat d0/d9/d4e/d9e/f135 x:0 0 0 2024-09-19T06:40:47.248 INFO:tasks.workunit.client.0.smithi099.stdout:9/804: creat dd/d2c/d79/db4/f10f x:0 0 0 2024-09-19T06:40:47.249 INFO:tasks.workunit.client.0.smithi099.stdout:8/741: chown d4/d5e/db4 320141 1 2024-09-19T06:40:47.250 INFO:tasks.workunit.client.1.smithi117.stdout:1/945: rename d3/d99/c101 to d3/d18/d91/c146 0 2024-09-19T06:40:47.251 INFO:tasks.workunit.client.1.smithi117.stdout:7/967: getdents d1/d4a/d81/d113 0 2024-09-19T06:40:47.252 INFO:tasks.workunit.client.0.smithi099.stdout:9/805: write dd/d62/d76/fe0 [1866887,71158] 0 2024-09-19T06:40:47.253 INFO:tasks.workunit.client.0.smithi099.stdout:7/952: symlink d7/dcf/d29/d1f/d45/d48/d63/d71/l15e 0 2024-09-19T06:40:47.253 INFO:tasks.workunit.client.1.smithi117.stdout:1/946: fdatasync d3/d18/d23/f107 0 2024-09-19T06:40:47.254 INFO:tasks.workunit.client.1.smithi117.stdout:6/798: dread d1/d14/f23 [0,4194304] 0 2024-09-19T06:40:47.255 INFO:tasks.workunit.client.1.smithi117.stdout:7/968: mkdir d1/d4a/d81/d24/d26/d44/dd2/d152 0 2024-09-19T06:40:47.255 INFO:tasks.workunit.client.1.smithi117.stdout:1/947: creat d3/d18/d91/f147 x:0 0 0 2024-09-19T06:40:47.258 INFO:tasks.workunit.client.1.smithi117.stdout:6/799: creat d1/d5/d8/fee x:0 0 0 2024-09-19T06:40:47.259 INFO:tasks.workunit.client.0.smithi099.stdout:8/742: dwrite d4/de/d14/fe7 [0,4194304] 0 2024-09-19T06:40:47.259 INFO:tasks.workunit.client.1.smithi117.stdout:6/800: fsync d1/d5/d8/d5e/f96 0 2024-09-19T06:40:47.261 INFO:tasks.workunit.client.1.smithi117.stdout:7/969: rename d1/d4a/d81/d24/d49/c66 to d1/d4a/d81/d8d/c153 0 2024-09-19T06:40:47.262 INFO:tasks.workunit.client.0.smithi099.stdout:8/743: mkdir d4/de/d14/deb/dfb 0 2024-09-19T06:40:47.262 INFO:tasks.workunit.client.1.smithi117.stdout:6/801: mkdir d1/d5/d85/def 0 2024-09-19T06:40:47.263 INFO:tasks.workunit.client.1.smithi117.stdout:6/802: write d1/f1d [975473,17041] 0 2024-09-19T06:40:47.264 INFO:tasks.workunit.client.0.smithi099.stdout:8/744: write d4/de/d26/d8d/fcf [539226,54987] 0 2024-09-19T06:40:47.264 INFO:tasks.workunit.client.1.smithi117.stdout:7/970: creat d1/d4a/d7c/d147/f154 x:0 0 0 2024-09-19T06:40:47.265 INFO:tasks.workunit.client.1.smithi117.stdout:6/803: read - d1/d5/d8/db0/f46 zero size 2024-09-19T06:40:47.267 INFO:tasks.workunit.client.0.smithi099.stdout:1/742: dread d0/d12/d13/d37/d41/f70 [0,4194304] 0 2024-09-19T06:40:47.270 INFO:tasks.workunit.client.1.smithi117.stdout:7/971: rename d1/d72/d100/d12b/d151/dc4/f114 to d1/d4a/d7c/d95/ddc/d13c/f155 0 2024-09-19T06:40:47.271 INFO:tasks.workunit.client.0.smithi099.stdout:1/743: link d0/d68/l9a d0/d17/d24/lf5 0 2024-09-19T06:40:47.271 INFO:tasks.workunit.client.1.smithi117.stdout:6/804: dwrite d1/d5/d8/d5e/d6d/f79 [0,4194304] 0 2024-09-19T06:40:47.272 INFO:tasks.workunit.client.0.smithi099.stdout:1/744: write d0/f1a [922085,90663] 0 2024-09-19T06:40:47.273 INFO:tasks.workunit.client.1.smithi117.stdout:6/805: write d1/d5/d8/f90 [2884744,49212] 0 2024-09-19T06:40:47.277 INFO:tasks.workunit.client.1.smithi117.stdout:7/972: link d1/d4a/d81/d8d/lc2 d1/d72/d100/d12b/d151/dcf/l156 0 2024-09-19T06:40:47.277 INFO:tasks.workunit.client.1.smithi117.stdout:6/806: creat d1/d5/d8/d27/d77/da8/ff0 x:0 0 0 2024-09-19T06:40:47.278 INFO:tasks.workunit.client.0.smithi099.stdout:1/745: rename d0/d17/d24/d5e/fd3 to d0/d17/d24/d3a/ff6 0 2024-09-19T06:40:47.279 INFO:tasks.workunit.client.1.smithi117.stdout:6/807: creat d1/d5/d8/d5e/d67/d98/ff1 x:0 0 0 2024-09-19T06:40:47.281 INFO:tasks.workunit.client.0.smithi099.stdout:1/746: creat d0/d12/d13/d37/d48/ff7 x:0 0 0 2024-09-19T06:40:47.282 INFO:tasks.workunit.client.1.smithi117.stdout:6/808: rename d1/d5/d8/d5e/cd3 to d1/d5/d8/d27/d77/cf2 0 2024-09-19T06:40:47.283 INFO:tasks.workunit.client.0.smithi099.stdout:1/747: mkdir d0/d2d/df8 0 2024-09-19T06:40:47.283 INFO:tasks.workunit.client.1.smithi117.stdout:7/973: read d1/d4a/d81/fa4 [4954025,90601] 0 2024-09-19T06:40:47.287 INFO:tasks.workunit.client.1.smithi117.stdout:6/809: read d1/d14/f4c [1393883,101871] 0 2024-09-19T06:40:47.287 INFO:tasks.workunit.client.0.smithi099.stdout:1/748: dread d0/d12/d13/f49 [0,4194304] 0 2024-09-19T06:40:47.288 INFO:tasks.workunit.client.0.smithi099.stdout:1/749: fdatasync d0/f21 0 2024-09-19T06:40:47.288 INFO:tasks.workunit.client.0.smithi099.stdout:0/667: write d0/db/d27/d5d/d87/da2/dbc/d1f/d3a/fa8 [776163,61764] 0 2024-09-19T06:40:47.293 INFO:tasks.workunit.client.0.smithi099.stdout:0/668: truncate d0/db/d27/d5d/d87/da2/dbc/d1f/d39/f54 1722541 0 2024-09-19T06:40:47.296 INFO:tasks.workunit.client.0.smithi099.stdout:5/907: write d3/d16/d5e/fbc [2019015,63859] 0 2024-09-19T06:40:47.297 INFO:tasks.workunit.client.0.smithi099.stdout:0/669: mknod d0/db/d27/d5d/d87/da2/dbc/cda 0 2024-09-19T06:40:47.300 INFO:tasks.workunit.client.0.smithi099.stdout:0/670: symlink d0/db/d27/d5d/d87/da2/dbc/d1f/d3a/ldb 0 2024-09-19T06:40:47.301 INFO:tasks.workunit.client.0.smithi099.stdout:5/908: link d3/d16/cab d3/d16/d2f/dd1/c13c 0 2024-09-19T06:40:47.301 INFO:tasks.workunit.client.0.smithi099.stdout:5/909: chown d3/l1d 21 1 2024-09-19T06:40:47.305 INFO:tasks.workunit.client.0.smithi099.stdout:4/772: write d12/d32/d42/d5c/d51/fa3 [723789,103903] 0 2024-09-19T06:40:47.305 INFO:tasks.workunit.client.0.smithi099.stdout:4/773: write d12/ff6 [134734,28312] 0 2024-09-19T06:40:47.311 INFO:tasks.workunit.client.0.smithi099.stdout:6/713: write d1/d12/f1f [457801,74222] 0 2024-09-19T06:40:47.311 INFO:tasks.workunit.client.0.smithi099.stdout:6/714: readlink d1/l11 0 2024-09-19T06:40:47.312 INFO:tasks.workunit.client.0.smithi099.stdout:9/806: write dd/d62/d76/f8f [552545,100314] 0 2024-09-19T06:40:47.313 INFO:tasks.workunit.client.0.smithi099.stdout:8/745: write d4/d11/d38/f3c [956085,48323] 0 2024-09-19T06:40:47.316 INFO:tasks.workunit.client.0.smithi099.stdout:9/807: chown dd/d2c/d5c/d85 0 1 2024-09-19T06:40:47.319 INFO:tasks.workunit.client.0.smithi099.stdout:0/671: read d0/db/d27/d5d/d87/da2/dbc/d1f/d39/f54 [789335,50694] 0 2024-09-19T06:40:47.323 INFO:tasks.workunit.client.0.smithi099.stdout:7/953: dwrite d7/dcf/ffa [0,4194304] 0 2024-09-19T06:40:47.323 INFO:tasks.workunit.client.0.smithi099.stdout:4/774: write d12/f38 [4859473,57473] 0 2024-09-19T06:40:47.325 INFO:tasks.workunit.client.0.smithi099.stdout:6/715: truncate d1/d5/d24/d2b/f80 868211 0 2024-09-19T06:40:47.330 INFO:tasks.workunit.client.0.smithi099.stdout:1/750: dwrite d0/d12/d13/d37/f94 [0,4194304] 0 2024-09-19T06:40:47.330 INFO:tasks.workunit.client.0.smithi099.stdout:0/672: truncate d0/db/d36/f67 4323897 0 2024-09-19T06:40:47.331 INFO:tasks.workunit.client.0.smithi099.stdout:8/746: dread d4/de/fb7 [0,4194304] 0 2024-09-19T06:40:47.333 INFO:tasks.workunit.client.0.smithi099.stdout:4/775: truncate d12/d32/f2e 5150036 0 2024-09-19T06:40:47.335 INFO:tasks.workunit.client.0.smithi099.stdout:1/751: chown d0/d12/d13/d37/d48/fc1 95613512 1 2024-09-19T06:40:47.337 INFO:tasks.workunit.client.0.smithi099.stdout:8/747: truncate d4/d11/d23/d92/fd4 323274 0 2024-09-19T06:40:47.337 INFO:tasks.workunit.client.0.smithi099.stdout:6/716: creat d1/d5/d38/feb x:0 0 0 2024-09-19T06:40:47.337 INFO:tasks.workunit.client.0.smithi099.stdout:9/808: dwrite dd/d2c/f98 [0,4194304] 0 2024-09-19T06:40:47.338 INFO:tasks.workunit.client.0.smithi099.stdout:7/954: mknod d7/dcf/d29/d1f/d45/d48/ddc/c15f 0 2024-09-19T06:40:47.339 INFO:tasks.workunit.client.0.smithi099.stdout:0/673: creat d0/d17/fdc x:0 0 0 2024-09-19T06:40:47.339 INFO:tasks.workunit.client.0.smithi099.stdout:4/776: dread - d12/d32/d42/d5c/d51/fcc zero size 2024-09-19T06:40:47.342 INFO:tasks.workunit.client.0.smithi099.stdout:7/955: write d7/dcf/d29/d1f/d45/fc2 [5004528,28081] 0 2024-09-19T06:40:47.344 INFO:tasks.workunit.client.0.smithi099.stdout:0/674: creat d0/db/dc0/fdd x:0 0 0 2024-09-19T06:40:47.346 INFO:tasks.workunit.client.0.smithi099.stdout:0/675: write d0/db/d27/d5d/d87/da2/dbc/d47/d75/da4/dcf/fd9 [469963,69964] 0 2024-09-19T06:40:47.349 INFO:tasks.workunit.client.0.smithi099.stdout:9/809: dread dd/d62/d78/fbe [0,4194304] 0 2024-09-19T06:40:47.376 INFO:tasks.workunit.client.1.smithi117.stdout:3/970: write d0/d9/d4e/d9e/fcd [757830,8718] 0 2024-09-19T06:40:47.378 INFO:tasks.workunit.client.1.smithi117.stdout:1/948: write d3/d18/d23/f65 [1211300,23793] 0 2024-09-19T06:40:47.380 INFO:tasks.workunit.client.1.smithi117.stdout:3/971: rmdir d0/d9/d4e/db4 39 2024-09-19T06:40:47.381 INFO:tasks.workunit.client.1.smithi117.stdout:1/949: stat d3/da1/d11d 0 2024-09-19T06:40:47.383 INFO:tasks.workunit.client.1.smithi117.stdout:3/972: mkdir d0/d3d/d48/d77/d81/d136 0 2024-09-19T06:40:47.384 INFO:tasks.workunit.client.1.smithi117.stdout:1/950: fsync d3/d22/f33 0 2024-09-19T06:40:47.384 INFO:tasks.workunit.client.1.smithi117.stdout:3/973: stat d0/d8/d64/d113 0 2024-09-19T06:40:47.390 INFO:tasks.workunit.client.1.smithi117.stdout:7/974: write d1/f4c [547632,128717] 0 2024-09-19T06:40:47.391 INFO:tasks.workunit.client.0.smithi099.stdout:9/810: mkdir dd/d65/de4/d110 0 2024-09-19T06:40:47.393 INFO:tasks.workunit.client.1.smithi117.stdout:7/975: dread - d1/d4a/d7c/fbe zero size 2024-09-19T06:40:47.394 INFO:tasks.workunit.client.1.smithi117.stdout:1/951: write d3/d22/f7d [1002369,19816] 0 2024-09-19T06:40:47.395 INFO:tasks.workunit.client.1.smithi117.stdout:1/952: dread - d3/da1/db1/d93/f9a zero size 2024-09-19T06:40:47.395 INFO:tasks.workunit.client.0.smithi099.stdout:0/676: rename d0/db/d27/d5d/d87/da2/dbc/d1f/d3a/fa8 to d0/db/d27/d5d/d87/da2/dbc/d37/d3c/fde 0 2024-09-19T06:40:47.396 INFO:tasks.workunit.client.1.smithi117.stdout:1/953: write d3/da1/f11b [1559365,15973] 0 2024-09-19T06:40:47.396 INFO:tasks.workunit.client.0.smithi099.stdout:7/956: mkdir d7/dcf/d29/d1f/d45/d48/df5/d153/d160 0 2024-09-19T06:40:47.397 INFO:tasks.workunit.client.1.smithi117.stdout:3/974: dread d0/d8/d7f/d40/f9d [0,4194304] 0 2024-09-19T06:40:47.397 INFO:tasks.workunit.client.1.smithi117.stdout:7/976: creat d1/d72/d100/d12b/d151/dc4/f157 x:0 0 0 2024-09-19T06:40:47.400 INFO:tasks.workunit.client.1.smithi117.stdout:7/977: symlink d1/d72/d10f/l158 0 2024-09-19T06:40:47.401 INFO:tasks.workunit.client.0.smithi099.stdout:8/748: link d4/d11/d23/d3f/l77 d4/d11/d61/dee/dda/lfc 0 2024-09-19T06:40:47.403 INFO:tasks.workunit.client.0.smithi099.stdout:6/717: write d1/d5/d38/d76/db0/d2a/fc5 [359106,103736] 0 2024-09-19T06:40:47.404 INFO:tasks.workunit.client.1.smithi117.stdout:7/978: creat d1/d4a/d81/d24/d26/d44/dfb/f159 x:0 0 0 2024-09-19T06:40:47.405 INFO:tasks.workunit.client.1.smithi117.stdout:1/954: dwrite d3/d18/d56/fef [4194304,4194304] 0 2024-09-19T06:40:47.409 INFO:tasks.workunit.client.1.smithi117.stdout:7/979: mknod d1/d3f/d92/c15a 0 2024-09-19T06:40:47.409 INFO:tasks.workunit.client.1.smithi117.stdout:1/955: dread - d3/d18/f53 zero size 2024-09-19T06:40:47.409 INFO:tasks.workunit.client.0.smithi099.stdout:1/752: dwrite d0/d17/d32/f53 [0,4194304] 0 2024-09-19T06:40:47.409 INFO:tasks.workunit.client.0.smithi099.stdout:0/677: readlink d0/db/d27/d5d/d87/da2/dbc/d1f/lb9 0 2024-09-19T06:40:47.410 INFO:tasks.workunit.client.0.smithi099.stdout:8/749: dread d4/d11/d23/f31 [0,4194304] 0 2024-09-19T06:40:47.410 INFO:tasks.workunit.client.0.smithi099.stdout:4/777: write d12/d32/d42/fcd [313469,108034] 0 2024-09-19T06:40:47.411 INFO:tasks.workunit.client.0.smithi099.stdout:8/750: fsync d4/d11/fbf 0 2024-09-19T06:40:47.413 INFO:tasks.workunit.client.1.smithi117.stdout:7/980: creat d1/d4a/d81/d24/d26/f15b x:0 0 0 2024-09-19T06:40:47.415 INFO:tasks.workunit.client.1.smithi117.stdout:1/956: link d3/d18/d23/d74/fb6 d3/d18/d97/d123/f148 0 2024-09-19T06:40:47.418 INFO:tasks.workunit.client.1.smithi117.stdout:7/981: rename d1/l12 to d1/d4a/d7c/d95/db5/de2/de3/d130/l15c 0 2024-09-19T06:40:47.419 INFO:tasks.workunit.client.0.smithi099.stdout:0/678: unlink d0/db/d27/d5d/d87/da2/dbc/d1f/c65 0 2024-09-19T06:40:47.419 INFO:tasks.workunit.client.1.smithi117.stdout:1/957: creat d3/d99/dd7/f149 x:0 0 0 2024-09-19T06:40:47.420 INFO:tasks.workunit.client.0.smithi099.stdout:0/679: readlink d0/db/d36/ld0 0 2024-09-19T06:40:47.421 INFO:tasks.workunit.client.0.smithi099.stdout:6/718: dwrite d1/f72 [0,4194304] 0 2024-09-19T06:40:47.422 INFO:tasks.workunit.client.1.smithi117.stdout:7/982: symlink d1/d4a/d81/d24/d1c/d35/l15d 0 2024-09-19T06:40:47.424 INFO:tasks.workunit.client.0.smithi099.stdout:8/751: creat d4/d11/d23/d4c/ddd/ffd x:0 0 0 2024-09-19T06:40:47.425 INFO:tasks.workunit.client.0.smithi099.stdout:0/680: truncate d0/db/d36/f67 4642471 0 2024-09-19T06:40:47.426 INFO:tasks.workunit.client.1.smithi117.stdout:1/958: rename d3/d18/d23/f7f to d3/da1/d11d/d140/f14a 0 2024-09-19T06:40:47.428 INFO:tasks.workunit.client.0.smithi099.stdout:8/752: mkdir d4/de/d10/dfe 0 2024-09-19T06:40:47.429 INFO:tasks.workunit.client.1.smithi117.stdout:7/983: mknod d1/d4a/d81/d24/d26/d44/dfb/c15e 0 2024-09-19T06:40:47.430 INFO:tasks.workunit.client.0.smithi099.stdout:0/681: write d0/db/d27/d5d/d87/da2/dbc/d47/f92 [607072,38833] 0 2024-09-19T06:40:47.433 INFO:tasks.workunit.client.0.smithi099.stdout:8/753: unlink d4/d66/fe5 0 2024-09-19T06:40:47.434 INFO:tasks.workunit.client.0.smithi099.stdout:6/719: dwrite d1/d12/f1f [0,4194304] 0 2024-09-19T06:40:47.438 INFO:tasks.workunit.client.0.smithi099.stdout:8/754: truncate d4/d11/d38/dc0/fd8 274367 0 2024-09-19T06:40:47.439 INFO:tasks.workunit.client.0.smithi099.stdout:0/682: read - d0/d17/fca zero size 2024-09-19T06:40:47.440 INFO:tasks.workunit.client.1.smithi117.stdout:1/959: creat d3/d22/f14b x:0 0 0 2024-09-19T06:40:47.443 INFO:tasks.workunit.client.1.smithi117.stdout:1/960: read d3/d18/d23/fc2 [4192663,12735] 0 2024-09-19T06:40:47.447 INFO:tasks.workunit.client.0.smithi099.stdout:8/755: getdents d4/d11/d61/dee 0 2024-09-19T06:40:47.448 INFO:tasks.workunit.client.1.smithi117.stdout:1/961: dread d3/f2e [4194304,4194304] 0 2024-09-19T06:40:47.449 INFO:tasks.workunit.client.0.smithi099.stdout:8/756: chown d4/de/d26 55190 1 2024-09-19T06:40:47.451 INFO:tasks.workunit.client.0.smithi099.stdout:0/683: dwrite d0/db/d27/d5d/d87/da2/dbc/d1f/db4/fc4 [0,4194304] 0 2024-09-19T06:40:47.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:47 smithi099 ceph-mon[27651]: pgmap v22: 65 pgs: 65 active+clean; 3.4 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 152 MiB/s rd, 406 MiB/s wr, 780 op/s 2024-09-19T06:40:47.458 INFO:tasks.workunit.client.0.smithi099.stdout:0/684: truncate d0/d17/f84 1152618 0 2024-09-19T06:40:47.460 INFO:tasks.workunit.client.0.smithi099.stdout:1/753: symlink d0/d17/d32/d7b/lf9 0 2024-09-19T06:40:47.461 INFO:tasks.workunit.client.0.smithi099.stdout:4/778: creat d12/d82/ddd/d9b/dab/f103 x:0 0 0 2024-09-19T06:40:47.463 INFO:tasks.workunit.client.0.smithi099.stdout:7/957: mknod d7/d39/d7d/c161 0 2024-09-19T06:40:47.467 INFO:tasks.workunit.client.0.smithi099.stdout:4/779: chown d12/d32/d42/d5c/d9d/fb2 2760 1 2024-09-19T06:40:47.467 INFO:tasks.workunit.client.0.smithi099.stdout:8/757: dwrite d4/d66/fc7 [0,4194304] 0 2024-09-19T06:40:47.469 INFO:tasks.workunit.client.0.smithi099.stdout:4/780: dread - d12/d82/ddd/d9b/dab/fee zero size 2024-09-19T06:40:47.470 INFO:tasks.workunit.client.0.smithi099.stdout:4/781: fdatasync d12/d32/f27 0 2024-09-19T06:40:47.471 INFO:tasks.workunit.client.0.smithi099.stdout:1/754: creat d0/db/ffa x:0 0 0 2024-09-19T06:40:47.472 INFO:tasks.workunit.client.0.smithi099.stdout:4/782: fdatasync d12/d1b/d88/fbd 0 2024-09-19T06:40:47.474 INFO:tasks.workunit.client.0.smithi099.stdout:0/685: creat d0/db/d27/d5d/d87/da2/dbc/d47/d75/da4/dcf/dd3/fdf x:0 0 0 2024-09-19T06:40:47.477 INFO:tasks.workunit.client.0.smithi099.stdout:1/755: mknod d0/d12/d13/d37/d41/cfb 0 2024-09-19T06:40:47.480 INFO:tasks.workunit.client.0.smithi099.stdout:8/758: getdents d4/de/d26/d2b/d91 0 2024-09-19T06:40:47.481 INFO:tasks.workunit.client.0.smithi099.stdout:6/720: dread d1/d5/d38/d76/db0/d54/d5d/d61/f8a [0,4194304] 0 2024-09-19T06:40:47.485 INFO:tasks.workunit.client.0.smithi099.stdout:4/783: dwrite d12/d82/ddd/d8a/da7/ff3 [0,4194304] 0 2024-09-19T06:40:47.488 INFO:tasks.workunit.client.1.smithi117.stdout:1/962: getdents d3/d18/d23/d74/dcf 0 2024-09-19T06:40:47.489 INFO:tasks.workunit.client.0.smithi099.stdout:6/721: chown d1/d5/d38/d76/db0/d2a/f8b 32277 1 2024-09-19T06:40:47.493 INFO:tasks.workunit.client.0.smithi099.stdout:4/784: mkdir d12/d82/ddd/d8a/de9/d104 0 2024-09-19T06:40:47.494 INFO:tasks.workunit.client.0.smithi099.stdout:0/686: dread d0/db/d27/d5d/d87/da2/dbc/d37/d3c/d3e/fa3 [0,4194304] 0 2024-09-19T06:40:47.497 INFO:tasks.workunit.client.0.smithi099.stdout:0/687: fsync d0/f1b 0 2024-09-19T06:40:47.498 INFO:tasks.workunit.client.0.smithi099.stdout:8/759: dwrite d4/d11/fbf [0,4194304] 0 2024-09-19T06:40:47.505 INFO:tasks.workunit.client.0.smithi099.stdout:7/958: truncate f2 955399 0 2024-09-19T06:40:47.507 INFO:tasks.workunit.client.0.smithi099.stdout:7/959: unlink d7/f52 0 2024-09-19T06:40:47.508 INFO:tasks.workunit.client.0.smithi099.stdout:7/960: chown d7/dc7/d67/f14c 5411 1 2024-09-19T06:40:47.509 INFO:tasks.workunit.client.0.smithi099.stdout:9/811: rename dd/c8e to dd/d2c/d5c/d64/d93/c111 0 2024-09-19T06:40:47.511 INFO:tasks.workunit.client.0.smithi099.stdout:9/812: truncate dd/dc9/fca 230466 0 2024-09-19T06:40:47.512 INFO:tasks.workunit.client.0.smithi099.stdout:6/722: symlink d1/d5/d24/d2b/lec 0 2024-09-19T06:40:47.513 INFO:tasks.workunit.client.0.smithi099.stdout:9/813: symlink dd/d2c/d5c/d64/d93/dfa/l112 0 2024-09-19T06:40:47.514 INFO:tasks.workunit.client.0.smithi099.stdout:2/621: sync 2024-09-19T06:40:47.514 INFO:tasks.workunit.client.0.smithi099.stdout:6/723: creat d1/d5/d38/dbb/fed x:0 0 0 2024-09-19T06:40:47.517 INFO:tasks.workunit.client.0.smithi099.stdout:4/785: rename d12/d32/d42/d5c/c79 to d12/d32/c105 0 2024-09-19T06:40:47.520 INFO:tasks.workunit.client.1.smithi117.stdout:7/984: write d1/d4a/d81/d24/d1c/d55/f59 [1156887,48183] 0 2024-09-19T06:40:47.520 INFO:tasks.workunit.client.0.smithi099.stdout:8/760: rename d4/de/d26/c33 to d4/d11/d61/cff 0 2024-09-19T06:40:47.520 INFO:tasks.workunit.client.0.smithi099.stdout:4/786: creat d12/d32/d39/f106 x:0 0 0 2024-09-19T06:40:47.521 INFO:tasks.workunit.client.1.smithi117.stdout:1/963: truncate d3/f5c 7298655 0 2024-09-19T06:40:47.522 INFO:tasks.workunit.client.0.smithi099.stdout:1/756: dread d0/db/fcd [0,4194304] 0 2024-09-19T06:40:47.522 INFO:tasks.workunit.client.0.smithi099.stdout:2/622: truncate d1/d2/d4d/d55/da5/fac 1088698 0 2024-09-19T06:40:47.522 INFO:tasks.workunit.client.1.smithi117.stdout:1/964: read d3/da1/db1/d93/fd1 [507808,77784] 0 2024-09-19T06:40:47.523 INFO:tasks.workunit.client.1.smithi117.stdout:7/985: rmdir d1/d4a/d77 39 2024-09-19T06:40:47.523 INFO:tasks.workunit.client.0.smithi099.stdout:6/724: creat d1/d5/d38/d76/db0/d54/d5d/fee x:0 0 0 2024-09-19T06:40:47.524 INFO:tasks.workunit.client.1.smithi117.stdout:1/965: write d3/d22/d2f/f92 [566445,33181] 0 2024-09-19T06:40:47.525 INFO:tasks.workunit.client.0.smithi099.stdout:9/814: rename l7 to dd/d2c/d5c/dc3/l113 0 2024-09-19T06:40:47.526 INFO:tasks.workunit.client.0.smithi099.stdout:2/623: write d1/d2/d4d/d55/da5/d18/f74 [433536,18910] 0 2024-09-19T06:40:47.529 INFO:tasks.workunit.client.0.smithi099.stdout:9/815: write dd/d2c/d5c/d64/f104 [921364,121327] 0 2024-09-19T06:40:47.531 INFO:tasks.workunit.client.1.smithi117.stdout:1/966: dwrite d3/d18/d56/f68 [0,4194304] 0 2024-09-19T06:40:47.532 INFO:tasks.workunit.client.0.smithi099.stdout:6/725: creat d1/d5/d38/dbb/fef x:0 0 0 2024-09-19T06:40:47.532 INFO:tasks.workunit.client.0.smithi099.stdout:2/624: dread - d1/d2/d4d/d55/da5/d9/fb4 zero size 2024-09-19T06:40:47.534 INFO:tasks.workunit.client.1.smithi117.stdout:1/967: read - d3/da1/db1/fe8 zero size 2024-09-19T06:40:47.536 INFO:tasks.workunit.client.1.smithi117.stdout:1/968: read - d3/d18/f53 zero size 2024-09-19T06:40:47.538 INFO:tasks.workunit.client.0.smithi099.stdout:4/787: creat d12/d32/d42/d97/f107 x:0 0 0 2024-09-19T06:40:47.538 INFO:tasks.workunit.client.1.smithi117.stdout:7/986: dwrite d1/d4a/d81/d24/d1c/f4e [0,4194304] 0 2024-09-19T06:40:47.538 INFO:tasks.workunit.client.0.smithi099.stdout:7/961: dread d7/fb2 [0,4194304] 0 2024-09-19T06:40:47.539 INFO:tasks.workunit.client.1.smithi117.stdout:7/987: write d1/f4c [809412,61170] 0 2024-09-19T06:40:47.539 INFO:tasks.workunit.client.0.smithi099.stdout:8/761: link d4/d11/d23/d4c/ddd/fb1 d4/de/d1c/df7/f100 0 2024-09-19T06:40:47.543 INFO:tasks.workunit.client.0.smithi099.stdout:4/788: dread - d12/d82/ddd/d9b/dab/fee zero size 2024-09-19T06:40:47.545 INFO:tasks.workunit.client.0.smithi099.stdout:1/757: dwrite d0/d17/d32/d7b/d99/fa9 [0,4194304] 0 2024-09-19T06:40:47.545 INFO:tasks.workunit.client.0.smithi099.stdout:6/726: rename d1/d5/cb to d1/d7c/cf0 0 2024-09-19T06:40:47.546 INFO:tasks.workunit.client.1.smithi117.stdout:1/969: dwrite d3/da1/da5/fae [0,4194304] 0 2024-09-19T06:40:47.546 INFO:tasks.workunit.client.1.smithi117.stdout:7/988: mkdir d1/d72/d15f 0 2024-09-19T06:40:47.546 INFO:tasks.workunit.client.0.smithi099.stdout:0/688: dwrite d0/db/d27/d5d/d87/da2/dbc/d59/f6c [0,4194304] 0 2024-09-19T06:40:47.547 INFO:tasks.workunit.client.1.smithi117.stdout:1/970: chown d3/d18/d23/fe6 626883 1 2024-09-19T06:40:47.551 INFO:tasks.workunit.client.1.smithi117.stdout:7/989: rename d1/d4a/d81/d24/d49 to d1/d4a/d81/d24/d49/d160 22 2024-09-19T06:40:47.553 INFO:tasks.workunit.client.1.smithi117.stdout:1/971: creat d3/da1/db1/d93/dd0/f14c x:0 0 0 2024-09-19T06:40:47.553 INFO:tasks.workunit.client.0.smithi099.stdout:4/789: chown d12/d32/d42/f55 5273785 1 2024-09-19T06:40:47.554 INFO:tasks.workunit.client.1.smithi117.stdout:7/990: creat d1/d4a/d81/d24/d26/d44/f161 x:0 0 0 2024-09-19T06:40:47.556 INFO:tasks.workunit.client.0.smithi099.stdout:7/962: symlink d7/dc7/d67/l162 0 2024-09-19T06:40:47.561 INFO:tasks.workunit.client.0.smithi099.stdout:6/727: write d1/d5/d38/d76/db0/d2a/f55 [2065869,122343] 0 2024-09-19T06:40:47.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:47 smithi117 ceph-mon[34564]: pgmap v22: 65 pgs: 65 active+clean; 3.4 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 152 MiB/s rd, 406 MiB/s wr, 780 op/s 2024-09-19T06:40:47.564 INFO:tasks.workunit.client.0.smithi099.stdout:9/816: link dd/d2c/c58 dd/d2c/d5c/dc3/c114 0 2024-09-19T06:40:47.564 INFO:tasks.workunit.client.0.smithi099.stdout:8/762: mkdir d4/d101 0 2024-09-19T06:40:47.565 INFO:tasks.workunit.client.0.smithi099.stdout:4/790: symlink d12/d82/ddd/d89/l108 0 2024-09-19T06:40:47.569 INFO:tasks.workunit.client.1.smithi117.stdout:1/972: link d3/d18/d23/d51/c109 d3/da1/db1/d93/dd0/c14d 0 2024-09-19T06:40:47.570 INFO:tasks.workunit.client.0.smithi099.stdout:4/791: fdatasync d12/d32/fe7 0 2024-09-19T06:40:47.572 INFO:tasks.workunit.client.0.smithi099.stdout:9/817: write dd/d2c/d79/db4/f10f [149853,102907] 0 2024-09-19T06:40:47.577 INFO:tasks.workunit.client.0.smithi099.stdout:9/818: read dd/d47/d40/f52 [854422,70175] 0 2024-09-19T06:40:47.577 INFO:tasks.workunit.client.0.smithi099.stdout:7/963: mkdir d7/dcf/d29/d1f/d45/d48/d63/d75/dd8/d163 0 2024-09-19T06:40:47.579 INFO:tasks.workunit.client.0.smithi099.stdout:6/728: mknod d1/d5/d24/d2b/cf1 0 2024-09-19T06:40:47.579 INFO:tasks.workunit.client.0.smithi099.stdout:0/689: fdatasync d0/db/d27/d5d/d87/da2/dbc/d37/d3c/d3e/f7c 0 2024-09-19T06:40:47.582 INFO:tasks.workunit.client.0.smithi099.stdout:7/964: symlink d7/dcf/d29/d1f/d45/d48/df5/l164 0 2024-09-19T06:40:47.583 INFO:tasks.workunit.client.0.smithi099.stdout:8/763: link d4/de/d26/d8d/fcf d4/d11/d61/dee/dde/f102 0 2024-09-19T06:40:47.584 INFO:tasks.workunit.client.0.smithi099.stdout:2/625: dread d1/d2/d4d/d55/da5/d9/d63/dc6/d13/f1b [0,4194304] 0 2024-09-19T06:40:47.586 INFO:tasks.workunit.client.0.smithi099.stdout:0/690: creat d0/db/d27/d38/fe0 x:0 0 0 2024-09-19T06:40:47.590 INFO:tasks.workunit.client.0.smithi099.stdout:7/965: getdents d7/dcf/d29/d1f/d45/d48/dda 0 2024-09-19T06:40:47.591 INFO:tasks.workunit.client.0.smithi099.stdout:2/626: creat d1/d2/d4d/d55/da5/d9/d63/dc6/d13/d2c/fd3 x:0 0 0 2024-09-19T06:40:47.592 INFO:tasks.workunit.client.1.smithi117.stdout:1/973: write d3/d22/f71 [4300084,59574] 0 2024-09-19T06:40:47.593 INFO:tasks.workunit.client.0.smithi099.stdout:5/910: sync 2024-09-19T06:40:47.595 INFO:tasks.workunit.client.1.smithi117.stdout:1/974: chown d3/da1/db1/d93/dd0/ld8 82 1 2024-09-19T06:40:47.596 INFO:tasks.workunit.client.1.smithi117.stdout:7/991: dwrite d1/d72/f75 [0,4194304] 0 2024-09-19T06:40:47.597 INFO:tasks.workunit.client.1.smithi117.stdout:7/992: stat d1/d4a/d7c/c135 0 2024-09-19T06:40:47.599 INFO:tasks.workunit.client.1.smithi117.stdout:1/975: mkdir d3/d18/d97/d14e 0 2024-09-19T06:40:47.599 INFO:tasks.workunit.client.0.smithi099.stdout:7/966: symlink d7/dcf/d29/d1f/d45/d48/d63/d75/dd8/df6/l165 0 2024-09-19T06:40:47.599 INFO:tasks.workunit.client.0.smithi099.stdout:1/758: dread d0/d12/d13/f89 [0,4194304] 0 2024-09-19T06:40:47.599 INFO:tasks.workunit.client.0.smithi099.stdout:5/911: mknod d3/d16/d5e/db1/c13d 0 2024-09-19T06:40:47.600 INFO:tasks.workunit.client.1.smithi117.stdout:7/993: creat d1/d3f/d92/d115/f162 x:0 0 0 2024-09-19T06:40:47.601 INFO:tasks.workunit.client.0.smithi099.stdout:7/967: chown d7/dcf/d97/fd0 14 1 2024-09-19T06:40:47.601 INFO:tasks.workunit.client.1.smithi117.stdout:7/994: read - d1/d4a/d81/d24/d26/d44/dd2/f14d zero size 2024-09-19T06:40:47.603 INFO:tasks.workunit.client.1.smithi117.stdout:7/995: write d1/d4a/d7c/fd8 [893080,104696] 0 2024-09-19T06:40:47.606 INFO:tasks.workunit.client.1.smithi117.stdout:7/996: mknod d1/d72/d100/d12b/d151/c163 0 2024-09-19T06:40:47.610 INFO:tasks.workunit.client.0.smithi099.stdout:7/968: creat d7/dcf/d29/df9/f166 x:0 0 0 2024-09-19T06:40:47.613 INFO:tasks.workunit.client.0.smithi099.stdout:6/729: dwrite d1/d5/d24/d2e/d6e/f87 [4194304,4194304] 0 2024-09-19T06:40:47.614 INFO:tasks.workunit.client.0.smithi099.stdout:2/627: write d1/d2/d4d/d55/da5/d9/d63/dc6/d13/d2c/f70 [1431307,30384] 0 2024-09-19T06:40:47.614 INFO:tasks.workunit.client.0.smithi099.stdout:8/764: dread d4/d11/d23/f9a [0,4194304] 0 2024-09-19T06:40:47.618 INFO:tasks.workunit.client.0.smithi099.stdout:9/819: dread dd/d2c/d5c/f73 [0,4194304] 0 2024-09-19T06:40:47.618 INFO:tasks.workunit.client.0.smithi099.stdout:0/691: dread d0/db/d27/d5d/d87/da2/dbc/d1f/f28 [0,4194304] 0 2024-09-19T06:40:47.618 INFO:tasks.workunit.client.0.smithi099.stdout:4/792: dread d12/d32/f29 [0,4194304] 0 2024-09-19T06:40:47.619 INFO:tasks.workunit.client.1.smithi117.stdout:7/997: dwrite d1/d4a/d81/d24/f69 [4194304,4194304] 0 2024-09-19T06:40:47.621 INFO:tasks.workunit.client.0.smithi099.stdout:4/793: chown d12/d32/d39/c3a 769 1 2024-09-19T06:40:47.622 INFO:tasks.workunit.client.0.smithi099.stdout:6/730: truncate d1/d5/d24/d2e/f70 870518 0 2024-09-19T06:40:47.622 INFO:tasks.workunit.client.0.smithi099.stdout:8/765: read d4/de/d14/f65 [60439,102279] 0 2024-09-19T06:40:47.622 INFO:tasks.workunit.client.0.smithi099.stdout:9/820: rmdir dd/d65 39 2024-09-19T06:40:47.623 INFO:tasks.workunit.client.0.smithi099.stdout:1/759: dwrite d0/d12/d13/d37/d41/f70 [0,4194304] 0 2024-09-19T06:40:47.628 INFO:tasks.workunit.client.0.smithi099.stdout:2/628: write d1/d2/d4d/d55/da5/d9/d63/dc6/d6/f87 [1772171,35326] 0 2024-09-19T06:40:47.629 INFO:tasks.workunit.client.1.smithi117.stdout:7/998: rename d1/d4a/d77/f86 to d1/d4a/d81/d24/d1c/da8/f164 0 2024-09-19T06:40:47.632 INFO:tasks.workunit.client.0.smithi099.stdout:9/821: creat dd/d62/d76/d9a/f115 x:0 0 0 2024-09-19T06:40:47.633 INFO:tasks.workunit.client.0.smithi099.stdout:1/760: creat d0/d17/d32/d7b/ffc x:0 0 0 2024-09-19T06:40:47.635 INFO:tasks.workunit.client.0.smithi099.stdout:4/794: creat d12/d82/ddd/d8a/da9/dfc/d102/f109 x:0 0 0 2024-09-19T06:40:47.635 INFO:tasks.workunit.client.0.smithi099.stdout:6/731: creat d1/d5/d38/d76/db0/d54/ff2 x:0 0 0 2024-09-19T06:40:47.636 INFO:tasks.workunit.client.0.smithi099.stdout:8/766: read d4/d11/d23/d4c/d93/f94 [1285546,30263] 0 2024-09-19T06:40:47.639 INFO:tasks.workunit.client.0.smithi099.stdout:9/822: truncate dd/d47/fc4 298709 0 2024-09-19T06:40:47.640 INFO:tasks.workunit.client.0.smithi099.stdout:1/761: write d0/d17/d24/d3a/d58/d8d/dae/fe9 [161963,37033] 0 2024-09-19T06:40:47.642 INFO:tasks.workunit.client.0.smithi099.stdout:2/629: dwrite d1/d2/d4d/d55/da5/d18/d2d/fbe [0,4194304] 0 2024-09-19T06:40:47.645 INFO:tasks.workunit.client.0.smithi099.stdout:6/732: write d1/d5/d24/d2e/d41/f8d [4245195,116926] 0 2024-09-19T06:40:47.645 INFO:tasks.workunit.client.0.smithi099.stdout:7/969: dread d7/dcf/d29/d1f/f2a [0,4194304] 0 2024-09-19T06:40:47.649 INFO:tasks.workunit.client.0.smithi099.stdout:1/762: creat d0/d17/d24/d3a/df0/ffd x:0 0 0 2024-09-19T06:40:47.653 INFO:tasks.workunit.client.1.smithi117.stdout:7/999: dwrite d1/d4a/d81/d24/d1c/f28 [0,4194304] 0 2024-09-19T06:40:47.654 INFO:tasks.workunit.client.0.smithi099.stdout:4/795: dwrite d12/d32/f3e [0,4194304] 0 2024-09-19T06:40:47.655 INFO:tasks.workunit.client.0.smithi099.stdout:1/763: dread - d0/d17/d32/d7b/ffc zero size 2024-09-19T06:40:47.658 INFO:tasks.workunit.client.0.smithi099.stdout:4/796: dread d12/d82/ddd/d8a/da9/dc7/fe6 [0,4194304] 0 2024-09-19T06:40:47.659 INFO:tasks.workunit.client.0.smithi099.stdout:6/733: unlink d1/d5/d24/d2e/d7b/dba/fdf 0 2024-09-19T06:40:47.665 INFO:tasks.workunit.client.0.smithi099.stdout:7/970: mkdir d7/dcf/d29/d1f/dec/d167 0 2024-09-19T06:40:47.668 INFO:tasks.workunit.client.0.smithi099.stdout:8/767: dwrite d4/d11/d23/f3b [0,4194304] 0 2024-09-19T06:40:47.670 INFO:tasks.workunit.client.0.smithi099.stdout:9/823: getdents dd/d65/de4 0 2024-09-19T06:40:47.670 INFO:tasks.workunit.client.0.smithi099.stdout:0/692: dread d0/db/d27/d5d/d87/da2/dbc/d1f/d39/f74 [0,4194304] 0 2024-09-19T06:40:47.671 INFO:tasks.workunit.client.0.smithi099.stdout:4/797: creat d12/d82/ddd/d8a/da9/d101/f10a x:0 0 0 2024-09-19T06:40:47.673 INFO:tasks.workunit.client.0.smithi099.stdout:8/768: mknod d4/d5e/db4/c103 0 2024-09-19T06:40:47.674 INFO:tasks.workunit.client.0.smithi099.stdout:6/734: truncate d1/d5/d24/d2e/f31 1758703 0 2024-09-19T06:40:47.674 INFO:tasks.workunit.client.0.smithi099.stdout:4/798: readlink d12/d1b/l7b 0 2024-09-19T06:40:47.674 INFO:tasks.workunit.client.0.smithi099.stdout:9/824: write dd/d2c/d5c/d64/d93/fe9 [341092,72659] 0 2024-09-19T06:40:47.677 INFO:tasks.workunit.client.0.smithi099.stdout:1/764: dread d0/d17/d32/d7b/d99/fa9 [0,4194304] 0 2024-09-19T06:40:47.678 INFO:tasks.workunit.client.0.smithi099.stdout:9/825: unlink dd/d62/fd6 0 2024-09-19T06:40:47.678 INFO:tasks.workunit.client.0.smithi099.stdout:2/630: dread d1/d2/d4d/d55/da5/d9/d63/dc6/d13/d2c/f70 [0,4194304] 0 2024-09-19T06:40:47.680 INFO:tasks.workunit.client.0.smithi099.stdout:7/971: getdents d7/dcf/d29/d1f/d45/d48/d63/d75/dd8 0 2024-09-19T06:40:47.681 INFO:tasks.workunit.client.0.smithi099.stdout:1/765: write d0/d12/d13/d37/d48/ff7 [209759,118629] 0 2024-09-19T06:40:47.689 INFO:tasks.workunit.client.0.smithi099.stdout:9/826: rename dd/d47/d40/f59 to dd/d62/f116 0 2024-09-19T06:40:47.689 INFO:tasks.workunit.client.0.smithi099.stdout:0/693: dwrite d0/db/d27/d38/fe0 [0,4194304] 0 2024-09-19T06:40:47.692 INFO:tasks.workunit.client.0.smithi099.stdout:9/827: chown dd/d62/d78/ld8 1 1 2024-09-19T06:40:47.692 INFO:tasks.workunit.client.0.smithi099.stdout:4/799: dwrite d12/d1b/f44 [0,4194304] 0 2024-09-19T06:40:47.693 INFO:tasks.workunit.client.0.smithi099.stdout:1/766: creat d0/d17/d24/d5e/ffe x:0 0 0 2024-09-19T06:40:47.695 INFO:tasks.workunit.client.0.smithi099.stdout:6/735: dwrite d1/d5/d24/d2e/d6e/f87 [4194304,4194304] 0 2024-09-19T06:40:47.696 INFO:tasks.workunit.client.0.smithi099.stdout:8/769: truncate d4/d11/d23/d4c/f69 4626628 0 2024-09-19T06:40:47.697 INFO:tasks.workunit.client.0.smithi099.stdout:6/736: chown d1/d5/d38/dbb/da7 0 1 2024-09-19T06:40:47.697 INFO:tasks.workunit.client.0.smithi099.stdout:0/694: symlink d0/db/d27/d5d/d87/da2/dbc/d1f/d99/le1 0 2024-09-19T06:40:47.698 INFO:tasks.workunit.client.0.smithi099.stdout:9/828: chown dd/c14 1104126056 1 2024-09-19T06:40:47.698 INFO:tasks.workunit.client.0.smithi099.stdout:1/767: dread - d0/d17/d24/d75/f90 zero size 2024-09-19T06:40:47.699 INFO:tasks.workunit.client.0.smithi099.stdout:9/829: fsync dd/d62/d76/d9a/f10a 0 2024-09-19T06:40:47.700 INFO:tasks.workunit.client.0.smithi099.stdout:4/800: mkdir d12/d82/ddd/d8a/da9/dfc/d10b 0 2024-09-19T06:40:47.702 INFO:tasks.workunit.client.0.smithi099.stdout:9/830: write dd/d2c/d79/db4/f10f [1035705,23887] 0 2024-09-19T06:40:47.712 INFO:tasks.workunit.client.0.smithi099.stdout:1/768: dwrite d0/f16 [0,4194304] 0 2024-09-19T06:40:47.717 INFO:tasks.workunit.client.0.smithi099.stdout:1/769: mkdir d0/d17/d32/d7b/d99/dff 0 2024-09-19T06:40:47.717 INFO:tasks.workunit.client.0.smithi099.stdout:4/801: dwrite d12/d82/ddd/d8a/da9/dfc/d102/f109 [0,4194304] 0 2024-09-19T06:40:47.719 INFO:tasks.workunit.client.0.smithi099.stdout:0/695: dwrite d0/db/d27/d5d/d87/da2/dbc/d1f/f28 [4194304,4194304] 0 2024-09-19T06:40:47.723 INFO:tasks.workunit.client.0.smithi099.stdout:0/696: stat d0/l18 0 2024-09-19T06:40:47.725 INFO:tasks.workunit.client.0.smithi099.stdout:0/697: readlink d0/db/d27/d5d/d87/da2/dbc/d1f/d3a/laa 0 2024-09-19T06:40:47.728 INFO:tasks.workunit.client.0.smithi099.stdout:4/802: getdents d12/d82/ddd/d8a/de9/d104 0 2024-09-19T06:40:47.731 INFO:tasks.workunit.client.0.smithi099.stdout:8/770: dread f2 [0,4194304] 0 2024-09-19T06:40:47.731 INFO:tasks.workunit.client.0.smithi099.stdout:1/770: read d0/db/f19 [2616428,129673] 0 2024-09-19T06:40:47.733 INFO:tasks.workunit.client.0.smithi099.stdout:1/771: truncate d0/d17/d32/f4e 191747 0 2024-09-19T06:40:47.736 INFO:tasks.workunit.client.0.smithi099.stdout:1/772: readlink d0/d2d/lea 0 2024-09-19T06:40:47.737 INFO:tasks.workunit.client.0.smithi099.stdout:1/773: chown d0/db/l27 716 1 2024-09-19T06:40:47.739 INFO:tasks.workunit.client.0.smithi099.stdout:1/774: dread d0/d12/d13/d37/d48/ff7 [0,4194304] 0 2024-09-19T06:40:47.740 INFO:tasks.workunit.client.0.smithi099.stdout:6/737: dread d1/f10 [0,4194304] 0 2024-09-19T06:40:47.745 INFO:tasks.workunit.client.0.smithi099.stdout:6/738: link d1/d5/d38/d76/lc8 d1/d5/d24/lf3 0 2024-09-19T06:40:47.746 INFO:tasks.workunit.client.0.smithi099.stdout:6/739: chown d1/d12/c23 7 1 2024-09-19T06:40:47.749 INFO:tasks.workunit.client.0.smithi099.stdout:6/740: chown d1/d7c/f9d 88725038 1 2024-09-19T06:40:47.753 INFO:tasks.workunit.client.0.smithi099.stdout:6/741: readlink d1/l4 0 2024-09-19T06:40:47.753 INFO:tasks.workunit.client.0.smithi099.stdout:0/698: dwrite d0/d17/fca [0,4194304] 0 2024-09-19T06:40:47.754 INFO:tasks.workunit.client.0.smithi099.stdout:6/742: readlink d1/ld6 0 2024-09-19T06:40:47.757 INFO:tasks.workunit.client.0.smithi099.stdout:8/771: dwrite d4/d5e/dbb/fe3 [0,4194304] 0 2024-09-19T06:40:47.759 INFO:tasks.workunit.client.0.smithi099.stdout:1/775: dwrite d0/d12/f79 [0,4194304] 0 2024-09-19T06:40:47.762 INFO:tasks.workunit.client.0.smithi099.stdout:6/743: write d1/d5/d38/d76/db0/d54/d5d/d61/f7d [369968,44756] 0 2024-09-19T06:40:47.764 INFO:tasks.workunit.client.0.smithi099.stdout:9/831: dread dd/d2c/d5c/dc3/fe7 [0,4194304] 0 2024-09-19T06:40:47.769 INFO:tasks.workunit.client.0.smithi099.stdout:8/772: rename d4/de/d14 to d4/d11/d23/d4c/d93/d104 0 2024-09-19T06:40:47.770 INFO:tasks.workunit.client.0.smithi099.stdout:0/699: fdatasync d0/db/d27/d5d/d87/da2/dbc/d1f/f2b 0 2024-09-19T06:40:47.771 INFO:tasks.workunit.client.0.smithi099.stdout:9/832: mknod dd/d62/d78/c117 0 2024-09-19T06:40:47.771 INFO:tasks.workunit.client.0.smithi099.stdout:6/744: read d1/d5/d38/d76/db0/d54/d5d/d61/fdd [2744785,65384] 0 2024-09-19T06:40:47.772 INFO:tasks.workunit.client.0.smithi099.stdout:8/773: readlink d4/de/d26/d8d/lbe 0 2024-09-19T06:40:47.773 INFO:tasks.workunit.client.0.smithi099.stdout:0/700: creat d0/db/d36/d3f/d91/fe2 x:0 0 0 2024-09-19T06:40:47.777 INFO:tasks.workunit.client.0.smithi099.stdout:0/701: write d0/db/d27/d5d/d87/da2/dbc/d37/d3c/faf [554859,59223] 0 2024-09-19T06:40:47.780 INFO:tasks.workunit.client.0.smithi099.stdout:9/833: dwrite dd/d65/f96 [0,4194304] 0 2024-09-19T06:40:47.780 INFO:tasks.workunit.client.0.smithi099.stdout:0/702: dread - d0/db/d27/d5d/d87/da2/dbc/d1f/d3a/dbf/fcd zero size 2024-09-19T06:40:47.781 INFO:tasks.workunit.client.0.smithi099.stdout:9/834: chown dd/d62/d76/d9a/fce 290 1 2024-09-19T06:40:47.784 INFO:tasks.workunit.client.0.smithi099.stdout:0/703: rmdir d0/d17 39 2024-09-19T06:40:47.788 INFO:tasks.workunit.client.0.smithi099.stdout:1/776: write d0/d17/d24/d3a/ff6 [3559533,25916] 0 2024-09-19T06:40:47.790 INFO:tasks.workunit.client.0.smithi099.stdout:1/777: creat d0/d17/d32/d7b/db0/f100 x:0 0 0 2024-09-19T06:40:47.794 INFO:tasks.workunit.client.0.smithi099.stdout:9/835: truncate dd/d62/d76/d9a/fce 3013552 0 2024-09-19T06:40:47.796 INFO:tasks.workunit.client.1.smithi117.stdout:0/903: sync 2024-09-19T06:40:47.796 INFO:tasks.workunit.client.0.smithi099.stdout:9/836: fdatasync dd/d65/da3/fc8 0 2024-09-19T06:40:47.798 INFO:tasks.workunit.client.0.smithi099.stdout:1/778: dwrite d0/db/f23 [0,4194304] 0 2024-09-19T06:40:47.801 INFO:tasks.workunit.client.0.smithi099.stdout:0/704: dwrite d0/db/d27/d5d/d87/da2/dbc/d1f/d39/f74 [0,4194304] 0 2024-09-19T06:40:47.802 INFO:tasks.workunit.client.1.smithi117.stdout:0/904: write d11/d13/d1b/f94 [1001274,126786] 0 2024-09-19T06:40:47.806 INFO:tasks.workunit.client.1.smithi117.stdout:0/905: fdatasync d11/fbb 0 2024-09-19T06:40:47.806 INFO:tasks.workunit.client.1.smithi117.stdout:0/906: read - d11/d13/d7a/dfa/f12d zero size 2024-09-19T06:40:47.811 INFO:tasks.workunit.client.0.smithi099.stdout:9/837: dwrite dd/d62/d76/d9a/fdd [0,4194304] 0 2024-09-19T06:40:47.811 INFO:tasks.workunit.client.1.smithi117.stdout:0/907: unlink d11/d13/d1b/d27/d54/d12b/fb1 0 2024-09-19T06:40:47.811 INFO:tasks.workunit.client.0.smithi099.stdout:9/838: readlink dd/l32 0 2024-09-19T06:40:47.814 INFO:tasks.workunit.client.1.smithi117.stdout:0/908: truncate d11/d13/d14/f45 5542864 0 2024-09-19T06:40:47.816 INFO:tasks.workunit.client.1.smithi117.stdout:1/976: sync 2024-09-19T06:40:47.816 INFO:tasks.workunit.client.1.smithi117.stdout:6/810: sync 2024-09-19T06:40:47.816 INFO:tasks.workunit.client.1.smithi117.stdout:8/893: sync 2024-09-19T06:40:47.816 INFO:tasks.workunit.client.1.smithi117.stdout:3/975: sync 2024-09-19T06:40:47.817 INFO:tasks.workunit.client.1.smithi117.stdout:0/909: mkdir d11/d13/d28/dfe/d9e/d12e 0 2024-09-19T06:40:47.818 INFO:tasks.workunit.client.1.smithi117.stdout:3/976: readlink d0/d8/d7f/dbf/ld6 0 2024-09-19T06:40:47.819 INFO:tasks.workunit.client.0.smithi099.stdout:1/779: truncate d0/db/f23 6306686 0 2024-09-19T06:40:47.819 INFO:tasks.workunit.client.0.smithi099.stdout:9/839: getdents dd/d47/dc1 0 2024-09-19T06:40:47.820 INFO:tasks.workunit.client.1.smithi117.stdout:8/894: fdatasync d1d/d1e/ff3 0 2024-09-19T06:40:47.821 INFO:tasks.workunit.client.1.smithi117.stdout:3/977: write d0/d9/f9a [433689,7099] 0 2024-09-19T06:40:47.823 INFO:tasks.workunit.client.1.smithi117.stdout:8/895: write d1d/d2a/d3f/d73/f85 [3136024,125958] 0 2024-09-19T06:40:47.823 INFO:tasks.workunit.client.0.smithi099.stdout:9/840: fdatasync dd/d47/f5f 0 2024-09-19T06:40:47.824 INFO:tasks.workunit.client.1.smithi117.stdout:8/896: chown d1d/d2a/d3f/d4b/d5f/dbf/dd0 1 1 2024-09-19T06:40:47.824 INFO:tasks.workunit.client.1.smithi117.stdout:8/897: stat d1d/d2a/d3f 0 2024-09-19T06:40:47.826 INFO:tasks.workunit.client.1.smithi117.stdout:0/910: rename d11/d13/d1b/d67/c110 to d11/d13/d28/dfe/c12f 0 2024-09-19T06:40:47.827 INFO:tasks.workunit.client.1.smithi117.stdout:8/898: rmdir d1d/d1e 39 2024-09-19T06:40:47.828 INFO:tasks.workunit.client.0.smithi099.stdout:9/841: mkdir dd/d2c/d5c/d64/d93/d118 0 2024-09-19T06:40:47.828 INFO:tasks.workunit.client.0.smithi099.stdout:0/705: dwrite d0/db/d27/f8b [0,4194304] 0 2024-09-19T06:40:47.832 INFO:tasks.workunit.client.1.smithi117.stdout:6/811: rename d1/d5/d9a/da9/lc9 to d1/d5/d8/d80/lf3 0 2024-09-19T06:40:47.832 INFO:tasks.workunit.client.0.smithi099.stdout:0/706: chown d0/db/d27/d5d/d87/da2/dbc/d1f/c5e 33935180 1 2024-09-19T06:40:47.832 INFO:tasks.workunit.client.0.smithi099.stdout:9/842: symlink dd/d65/de4/l119 0 2024-09-19T06:40:47.833 INFO:tasks.workunit.client.1.smithi117.stdout:6/812: dread - d1/d3/f76 zero size 2024-09-19T06:40:47.833 INFO:tasks.workunit.client.1.smithi117.stdout:1/977: dread d3/d18/d23/f28 [0,4194304] 0 2024-09-19T06:40:47.833 INFO:tasks.workunit.client.1.smithi117.stdout:3/978: symlink d0/d9/d4e/d9e/dc9/l137 0 2024-09-19T06:40:47.834 INFO:tasks.workunit.client.0.smithi099.stdout:9/843: truncate dd/d2c/f54 222413 0 2024-09-19T06:40:47.835 INFO:tasks.workunit.client.1.smithi117.stdout:6/813: write d1/d5/d8/d5e/d67/fae [718337,60549] 0 2024-09-19T06:40:47.835 INFO:tasks.workunit.client.0.smithi099.stdout:9/844: write dd/d47/d40/f101 [907835,85619] 0 2024-09-19T06:40:47.835 INFO:tasks.workunit.client.0.smithi099.stdout:0/707: truncate d0/db/d27/d38/fac 554195 0 2024-09-19T06:40:47.837 INFO:tasks.workunit.client.1.smithi117.stdout:1/978: mkdir d3/d18/d23/d74/d14f 0 2024-09-19T06:40:47.838 INFO:tasks.workunit.client.1.smithi117.stdout:1/979: write d3/da1/da5/f145 [45240,93332] 0 2024-09-19T06:40:47.839 INFO:tasks.workunit.client.0.smithi099.stdout:0/708: write d0/db/d27/d5d/d87/da2/dbc/d1f/f28 [4891659,84525] 0 2024-09-19T06:40:47.840 INFO:tasks.workunit.client.1.smithi117.stdout:6/814: creat d1/d5/d8/d5e/ff4 x:0 0 0 2024-09-19T06:40:47.841 INFO:tasks.workunit.client.1.smithi117.stdout:1/980: fsync f1 0 2024-09-19T06:40:47.841 INFO:tasks.workunit.client.1.smithi117.stdout:6/815: dread - d1/d5/dc2/fce zero size 2024-09-19T06:40:47.842 INFO:tasks.workunit.client.0.smithi099.stdout:1/780: truncate d0/d12/d13/d37/f3f 6464018 0 2024-09-19T06:40:47.842 INFO:tasks.workunit.client.1.smithi117.stdout:3/979: getdents d0/d3d 0 2024-09-19T06:40:47.842 INFO:tasks.workunit.client.0.smithi099.stdout:1/781: chown d0/d17/d24/d3a 5 1 2024-09-19T06:40:47.843 INFO:tasks.workunit.client.0.smithi099.stdout:9/845: fsync dd/d2c/dd9/fec 0 2024-09-19T06:40:47.843 INFO:tasks.workunit.client.1.smithi117.stdout:1/981: write d3/d8e/fb8 [25419,11681] 0 2024-09-19T06:40:47.844 INFO:tasks.workunit.client.0.smithi099.stdout:0/709: rename d0/db/d27/d5d/d87/da2/dbc/d1f/d3a/lc1 to d0/db/d2f/le3 0 2024-09-19T06:40:47.845 INFO:tasks.workunit.client.1.smithi117.stdout:6/816: mknod d1/d5/d8/d80/cf5 0 2024-09-19T06:40:47.845 INFO:tasks.workunit.client.1.smithi117.stdout:3/980: stat d0/d19/d2b/cd4 0 2024-09-19T06:40:47.846 INFO:tasks.workunit.client.0.smithi099.stdout:1/782: rmdir d0/d12/d54 39 2024-09-19T06:40:47.846 INFO:tasks.workunit.client.1.smithi117.stdout:3/981: readlink d0/d3d/l75 0 2024-09-19T06:40:47.847 INFO:tasks.workunit.client.1.smithi117.stdout:1/982: creat d3/d18/d23/dfc/f150 x:0 0 0 2024-09-19T06:40:47.847 INFO:tasks.workunit.client.0.smithi099.stdout:9/846: symlink dd/d47/l11a 0 2024-09-19T06:40:47.849 INFO:tasks.workunit.client.0.smithi099.stdout:1/783: mknod d0/d17/d24/d5e/d8a/dd4/c101 0 2024-09-19T06:40:47.850 INFO:tasks.workunit.client.0.smithi099.stdout:0/710: truncate d0/db/d27/d5d/d87/da2/dbc/d47/d75/da4/dcf/dd3/fdf 62750 0 2024-09-19T06:40:47.850 INFO:tasks.workunit.client.1.smithi117.stdout:1/983: creat d3/d18/d23/d74/f151 x:0 0 0 2024-09-19T06:40:47.851 INFO:tasks.workunit.client.0.smithi099.stdout:9/847: creat dd/d2c/d5c/d85/f11b x:0 0 0 2024-09-19T06:40:47.851 INFO:tasks.workunit.client.0.smithi099.stdout:0/711: stat d0/db/d27/d5d/d87/da2/dbc/d1f/d99/le1 0 2024-09-19T06:40:47.852 INFO:tasks.workunit.client.1.smithi117.stdout:1/984: dread d3/da1/db1/fa7 [0,4194304] 0 2024-09-19T06:40:47.854 INFO:tasks.workunit.client.1.smithi117.stdout:1/985: write d3/d22/d2f/fdc [4164504,25810] 0 2024-09-19T06:40:47.858 INFO:tasks.workunit.client.0.smithi099.stdout:0/712: fsync d0/db/d27/d5d/d87/da2/dbc/d37/d3c/d3e/f97 0 2024-09-19T06:40:47.859 INFO:tasks.workunit.client.1.smithi117.stdout:3/982: dwrite d0/d9/fdf [0,4194304] 0 2024-09-19T06:40:47.860 INFO:tasks.workunit.client.0.smithi099.stdout:9/848: dwrite dd/d47/d40/f11 [4194304,4194304] 0 2024-09-19T06:40:47.861 INFO:tasks.workunit.client.0.smithi099.stdout:0/713: fdatasync d0/db/d27/d5d/d87/da2/dbc/d1f/d39/f63 0 2024-09-19T06:40:47.863 INFO:tasks.workunit.client.0.smithi099.stdout:9/849: write dd/d62/d76/fe0 [4708973,109948] 0 2024-09-19T06:40:47.865 INFO:tasks.workunit.client.0.smithi099.stdout:9/850: truncate dd/d47/dc1/fcd 841827 0 2024-09-19T06:40:47.865 INFO:tasks.workunit.client.0.smithi099.stdout:9/851: chown dd/d47/l11a 1698531 1 2024-09-19T06:40:47.867 INFO:tasks.workunit.client.1.smithi117.stdout:3/983: getdents d0/d100 0 2024-09-19T06:40:47.867 INFO:tasks.workunit.client.0.smithi099.stdout:0/714: unlink d0/db/d27/f83 0 2024-09-19T06:40:47.867 INFO:tasks.workunit.client.0.smithi099.stdout:9/852: read dd/d2c/d5c/d64/d93/fe6 [210996,34872] 0 2024-09-19T06:40:47.869 INFO:tasks.workunit.client.1.smithi117.stdout:1/986: dwrite d3/f2e [4194304,4194304] 0 2024-09-19T06:40:47.872 INFO:tasks.workunit.client.0.smithi099.stdout:9/853: write dd/d2c/d5c/d64/d93/fe6 [874680,33924] 0 2024-09-19T06:40:47.873 INFO:tasks.workunit.client.0.smithi099.stdout:0/715: rmdir d0/db/d27/d5d/d87/da2/dbc/d59 39 2024-09-19T06:40:47.873 INFO:tasks.workunit.client.1.smithi117.stdout:6/817: dread d1/d3/f20 [0,4194304] 0 2024-09-19T06:40:47.878 INFO:tasks.workunit.client.1.smithi117.stdout:3/984: dwrite d0/d9/ff2 [0,4194304] 0 2024-09-19T06:40:47.880 INFO:tasks.workunit.client.0.smithi099.stdout:0/716: link d0/db/d36/ld0 d0/db/d27/d5d/d87/le4 0 2024-09-19T06:40:47.882 INFO:tasks.workunit.client.0.smithi099.stdout:9/854: dwrite dd/d2c/d5c/d64/d93/dfa/d105/fdc [0,4194304] 0 2024-09-19T06:40:47.882 INFO:tasks.workunit.client.1.smithi117.stdout:3/985: write d0/d19/d2b/d8e/fa0 [4216613,68997] 0 2024-09-19T06:40:47.884 INFO:tasks.workunit.client.1.smithi117.stdout:6/818: link d1/d5/d8/db0/c54 d1/d3d/cf6 0 2024-09-19T06:40:47.885 INFO:tasks.workunit.client.0.smithi099.stdout:0/717: symlink d0/d17/d41/le5 0 2024-09-19T06:40:47.885 INFO:tasks.workunit.client.1.smithi117.stdout:3/986: mknod d0/d9/d4e/d9e/ddc/c138 0 2024-09-19T06:40:47.886 INFO:tasks.workunit.client.0.smithi099.stdout:9/855: getdents dd/d2c/d5c/d64/d93/d118 0 2024-09-19T06:40:47.887 INFO:tasks.workunit.client.1.smithi117.stdout:3/987: read d0/d9/f80 [251428,85247] 0 2024-09-19T06:40:47.888 INFO:tasks.workunit.client.1.smithi117.stdout:6/819: symlink d1/d5/d9a/lf7 0 2024-09-19T06:40:47.889 INFO:tasks.workunit.client.1.smithi117.stdout:1/987: dread d3/f3c [0,4194304] 0 2024-09-19T06:40:47.890 INFO:tasks.workunit.client.1.smithi117.stdout:6/820: symlink d1/d3d/lf8 0 2024-09-19T06:40:47.891 INFO:tasks.workunit.client.0.smithi099.stdout:9/856: getdents dd/d2c/d5c/d10e 0 2024-09-19T06:40:47.892 INFO:tasks.workunit.client.1.smithi117.stdout:6/821: write d1/d5/d8/db5/fbe [1333351,36509] 0 2024-09-19T06:40:47.895 INFO:tasks.workunit.client.0.smithi099.stdout:9/857: fsync dd/d47/f38 0 2024-09-19T06:40:47.895 INFO:tasks.workunit.client.1.smithi117.stdout:1/988: unlink d3/da1/le9 0 2024-09-19T06:40:47.895 INFO:tasks.workunit.client.1.smithi117.stdout:3/988: creat d0/d3d/d48/f139 x:0 0 0 2024-09-19T06:40:47.897 INFO:tasks.workunit.client.0.smithi099.stdout:9/858: chown dd/d47/l51 825 1 2024-09-19T06:40:47.897 INFO:tasks.workunit.client.1.smithi117.stdout:6/822: rmdir d1/d5/d8/d5e/d6d 39 2024-09-19T06:40:47.898 INFO:tasks.workunit.client.1.smithi117.stdout:1/989: mkdir d3/d18/d97/d14e/d152 0 2024-09-19T06:40:47.899 INFO:tasks.workunit.client.0.smithi099.stdout:9/859: dread - dd/d2c/fea zero size 2024-09-19T06:40:47.899 INFO:tasks.workunit.client.0.smithi099.stdout:0/718: dwrite d0/db/d27/d5d/d87/da2/dbc/d1f/d4a/fb8 [0,4194304] 0 2024-09-19T06:40:47.901 INFO:tasks.workunit.client.0.smithi099.stdout:9/860: chown dd/d2c/d5c/d64/f104 128 1 2024-09-19T06:40:47.903 INFO:tasks.workunit.client.1.smithi117.stdout:3/989: link d0/fc0 d0/d8/d7f/d40/f13a 0 2024-09-19T06:40:47.905 INFO:tasks.workunit.client.0.smithi099.stdout:9/861: creat dd/d2c/d5c/d85/dfc/f11c x:0 0 0 2024-09-19T06:40:47.906 INFO:tasks.workunit.client.1.smithi117.stdout:3/990: creat d0/d8/d7f/dbf/f13b x:0 0 0 2024-09-19T06:40:47.906 INFO:tasks.workunit.client.0.smithi099.stdout:0/719: getdents d0/db/d27/d5d/d87/da2/dbc/d47/d75/da4 0 2024-09-19T06:40:47.907 INFO:tasks.workunit.client.0.smithi099.stdout:9/862: read dd/d47/d68/f6c [400760,2546] 0 2024-09-19T06:40:47.907 INFO:tasks.workunit.client.1.smithi117.stdout:6/823: getdents d1/d5/d8/db0 0 2024-09-19T06:40:47.908 INFO:tasks.workunit.client.1.smithi117.stdout:3/991: chown d0/d19/d2b/cd4 872 1 2024-09-19T06:40:47.908 INFO:tasks.workunit.client.0.smithi099.stdout:9/863: chown dd/d47/c53 13799029 1 2024-09-19T06:40:47.910 INFO:tasks.workunit.client.1.smithi117.stdout:3/992: write d0/d8/d7f/d40/fce [364082,85462] 0 2024-09-19T06:40:47.910 INFO:tasks.workunit.client.0.smithi099.stdout:9/864: fdatasync dd/d2c/d5c/f73 0 2024-09-19T06:40:47.912 INFO:tasks.workunit.client.1.smithi117.stdout:3/993: write d0/d9/d4e/d9e/ffa [1953598,27807] 0 2024-09-19T06:40:47.912 INFO:tasks.workunit.client.0.smithi099.stdout:0/720: getdents d0/db/d27/d5d/d87/da2/dbc 0 2024-09-19T06:40:47.913 INFO:tasks.workunit.client.0.smithi099.stdout:9/865: truncate dd/d2c/d79/fbf 678244 0 2024-09-19T06:40:47.914 INFO:tasks.workunit.client.0.smithi099.stdout:9/866: chown dd/d62/d76/faf 258461 1 2024-09-19T06:40:47.915 INFO:tasks.workunit.client.0.smithi099.stdout:9/867: dread - dd/d62/d76/d9a/f115 zero size 2024-09-19T06:40:47.915 INFO:tasks.workunit.client.1.smithi117.stdout:3/994: creat d0/d8/d64/df1/f13c x:0 0 0 2024-09-19T06:40:47.917 INFO:tasks.workunit.client.1.smithi117.stdout:1/990: write d3/f5c [8289914,39323] 0 2024-09-19T06:40:47.917 INFO:tasks.workunit.client.1.smithi117.stdout:3/995: write d0/d9/d1c/fb0 [417832,69191] 0 2024-09-19T06:40:47.919 INFO:tasks.workunit.client.1.smithi117.stdout:1/991: read d3/d18/d23/f107 [935562,97255] 0 2024-09-19T06:40:47.921 INFO:tasks.workunit.client.0.smithi099.stdout:0/721: write d0/db/f23 [3286497,121223] 0 2024-09-19T06:40:47.922 INFO:tasks.workunit.client.1.smithi117.stdout:1/992: rename d3/f38 to d3/d18/d23/d74/d14f/f153 0 2024-09-19T06:40:47.924 INFO:tasks.workunit.client.0.smithi099.stdout:0/722: unlink d0/db/d27/d5d/l6d 0 2024-09-19T06:40:47.924 INFO:tasks.workunit.client.1.smithi117.stdout:1/993: dread d3/d8e/fca [0,4194304] 0 2024-09-19T06:40:47.925 INFO:tasks.workunit.client.1.smithi117.stdout:1/994: truncate d3/d18/d23/dfc/f150 624610 0 2024-09-19T06:40:47.927 INFO:tasks.workunit.client.1.smithi117.stdout:1/995: creat d3/d18/d97/d13c/f154 x:0 0 0 2024-09-19T06:40:47.930 INFO:tasks.workunit.client.1.smithi117.stdout:6/824: dread d1/d5/d8/f19 [0,4194304] 0 2024-09-19T06:40:47.931 INFO:tasks.workunit.client.1.smithi117.stdout:1/996: dread d3/d22/d2f/fdc [4194304,4194304] 0 2024-09-19T06:40:47.933 INFO:tasks.workunit.client.1.smithi117.stdout:1/997: symlink d3/da1/da5/l155 0 2024-09-19T06:40:47.935 INFO:tasks.workunit.client.0.smithi099.stdout:9/868: dread dd/d2c/f4b [0,4194304] 0 2024-09-19T06:40:47.935 INFO:tasks.workunit.client.1.smithi117.stdout:1/998: chown d3/d18/d23/f4f 15 1 2024-09-19T06:40:47.936 INFO:tasks.workunit.client.1.smithi117.stdout:6/825: dwrite d1/d3/f17 [0,4194304] 0 2024-09-19T06:40:47.937 INFO:tasks.workunit.client.1.smithi117.stdout:1/999: write d3/d99/dd7/f128 [735405,29974] 0 2024-09-19T06:40:47.937 INFO:tasks.workunit.client.0.smithi099.stdout:9/869: chown dd/d2c/d5c/lbd 361845 1 2024-09-19T06:40:47.941 INFO:tasks.workunit.client.0.smithi099.stdout:9/870: dread dd/d2c/f98 [0,4194304] 0 2024-09-19T06:40:47.942 INFO:tasks.workunit.client.1.smithi117.stdout:6/826: rename d1/d5/d32/c66 to d1/cf9 0 2024-09-19T06:40:47.947 INFO:tasks.workunit.client.0.smithi099.stdout:9/871: truncate dd/d65/da3/fc8 283065 0 2024-09-19T06:40:47.949 INFO:tasks.workunit.client.0.smithi099.stdout:9/872: mknod dd/d2c/dd9/ded/c11d 0 2024-09-19T06:40:47.950 INFO:tasks.workunit.client.0.smithi099.stdout:9/873: chown dd/f5b 1 1 2024-09-19T06:40:47.952 INFO:tasks.workunit.client.0.smithi099.stdout:9/874: fsync dd/d2c/f49 0 2024-09-19T06:40:47.952 INFO:tasks.workunit.client.0.smithi099.stdout:9/875: read - dd/dc9/ff2 zero size 2024-09-19T06:40:47.953 INFO:tasks.workunit.client.1.smithi117.stdout:6/827: truncate d1/d5/d8/f19 3191394 0 2024-09-19T06:40:47.954 INFO:tasks.workunit.client.1.smithi117.stdout:6/828: chown d1/d5/d8/db0/fd1 23 1 2024-09-19T06:40:47.954 INFO:tasks.workunit.client.0.smithi099.stdout:9/876: write dd/f5b [392033,29905] 0 2024-09-19T06:40:47.958 INFO:tasks.workunit.client.0.smithi099.stdout:9/877: link dd/d47/lf6 dd/d2c/d5c/d85/dfc/l11e 0 2024-09-19T06:40:47.959 INFO:tasks.workunit.client.0.smithi099.stdout:9/878: mkdir dd/d2c/d79/d11f 0 2024-09-19T06:40:47.961 INFO:tasks.workunit.client.0.smithi099.stdout:9/879: truncate dd/d47/d40/f52 1553027 0 2024-09-19T06:40:47.962 INFO:tasks.workunit.client.0.smithi099.stdout:9/880: write dd/f6a [1080416,84347] 0 2024-09-19T06:40:47.964 INFO:tasks.workunit.client.0.smithi099.stdout:9/881: creat dd/d2c/dd9/ded/df0/f120 x:0 0 0 2024-09-19T06:40:47.966 INFO:tasks.workunit.client.0.smithi099.stdout:9/882: rmdir dd/d2c/d5c/d64/d93/dfa 39 2024-09-19T06:40:47.969 INFO:tasks.workunit.client.0.smithi099.stdout:9/883: rename dd/d2c/d79/db4/de2/cf4 to dd/dc9/df5/df9/c121 0 2024-09-19T06:40:47.975 INFO:tasks.workunit.client.0.smithi099.stdout:9/884: truncate dd/d47/d68/f9c 7332118 0 2024-09-19T06:40:47.979 INFO:tasks.workunit.client.0.smithi099.stdout:9/885: symlink dd/d2c/d5c/d64/d93/dfa/d105/deb/l122 0 2024-09-19T06:40:47.979 INFO:tasks.workunit.client.0.smithi099.stdout:9/886: rmdir dd 39 2024-09-19T06:40:47.981 INFO:tasks.workunit.client.0.smithi099.stdout:9/887: write dd/d2c/d5c/d64/f104 [1331892,48508] 0 2024-09-19T06:40:47.986 INFO:tasks.workunit.client.0.smithi099.stdout:9/888: dwrite dd/d2c/d79/fd4 [0,4194304] 0 2024-09-19T06:40:47.989 INFO:tasks.workunit.client.0.smithi099.stdout:9/889: stat dd/d2c/c58 0 2024-09-19T06:40:47.995 INFO:tasks.workunit.client.0.smithi099.stdout:9/890: dwrite dd/d47/d40/f3f [0,4194304] 0 2024-09-19T06:40:48.003 INFO:tasks.workunit.client.0.smithi099.stdout:9/891: dwrite dd/d2c/d5c/d64/f104 [0,4194304] 0 2024-09-19T06:40:48.006 INFO:tasks.workunit.client.0.smithi099.stdout:9/892: creat dd/d62/d78/f123 x:0 0 0 2024-09-19T06:40:48.008 INFO:tasks.workunit.client.0.smithi099.stdout:9/893: truncate dd/d65/de4/ff1 706597 0 2024-09-19T06:40:48.011 INFO:tasks.workunit.client.0.smithi099.stdout:9/894: rename dd/d65/da3/fc8 to dd/d2c/d79/db4/f124 0 2024-09-19T06:40:48.023 INFO:tasks.workunit.client.0.smithi099.stdout:9/895: dwrite dd/d47/fc4 [0,4194304] 0 2024-09-19T06:40:48.024 INFO:tasks.workunit.client.0.smithi099.stdout:9/896: readlink dd/d62/d78/ld8 0 2024-09-19T06:40:48.025 INFO:tasks.workunit.client.0.smithi099.stdout:9/897: dread - dd/d2c/fea zero size 2024-09-19T06:40:48.027 INFO:tasks.workunit.client.0.smithi099.stdout:9/898: dread dd/d2c/d5c/d85/fcc [0,4194304] 0 2024-09-19T06:40:48.032 INFO:tasks.workunit.client.0.smithi099.stdout:9/899: link dd/d47/d40/d61/cdf dd/d2c/d5c/ddb/c125 0 2024-09-19T06:40:48.033 INFO:tasks.workunit.client.0.smithi099.stdout:9/900: mkdir dd/d2c/d126 0 2024-09-19T06:40:48.036 INFO:tasks.workunit.client.0.smithi099.stdout:9/901: symlink dd/d2c/d5c/d64/d93/dfa/d105/deb/l127 0 2024-09-19T06:40:48.036 INFO:tasks.workunit.client.0.smithi099.stdout:9/902: truncate dd/d62/d76/d9a/f115 289662 0 2024-09-19T06:40:48.052 INFO:tasks.workunit.client.0.smithi099.stdout:9/903: link dd/d65/da3/fa6 dd/d2c/d5c/d10e/f128 0 2024-09-19T06:40:48.054 INFO:tasks.workunit.client.0.smithi099.stdout:9/904: rename dd/d2c/d79/d11f to dd/d2c/d5c/d64/d93/dfa/d105/dff/d129 0 2024-09-19T06:40:48.056 INFO:tasks.workunit.client.0.smithi099.stdout:9/905: symlink dd/l12a 0 2024-09-19T06:40:48.060 INFO:tasks.workunit.client.0.smithi099.stdout:9/906: dread dd/d2c/d79/db4/f10f [0,4194304] 0 2024-09-19T06:40:48.061 INFO:tasks.workunit.client.0.smithi099.stdout:9/907: mkdir dd/d2c/d5c/d85/d12b 0 2024-09-19T06:40:48.062 INFO:tasks.workunit.client.0.smithi099.stdout:9/908: fdatasync dd/d65/de4/ff1 0 2024-09-19T06:40:48.062 INFO:tasks.workunit.client.1.smithi117.stdout:8/899: sync 2024-09-19T06:40:48.062 INFO:tasks.workunit.client.1.smithi117.stdout:0/911: sync 2024-09-19T06:40:48.063 INFO:tasks.workunit.client.0.smithi099.stdout:9/909: mknod dd/d62/d78/c12c 0 2024-09-19T06:40:48.064 INFO:tasks.workunit.client.1.smithi117.stdout:8/900: write d1d/d1e/dbc/dc1/fe5 [5027489,50374] 0 2024-09-19T06:40:48.064 INFO:tasks.workunit.client.1.smithi117.stdout:0/912: symlink d11/d13/d14/dbd/l130 0 2024-09-19T06:40:48.065 INFO:tasks.workunit.client.0.smithi099.stdout:9/910: fsync dd/d2c/d5c/d64/d93/fa1 0 2024-09-19T06:40:48.076 INFO:tasks.workunit.client.1.smithi117.stdout:0/913: dwrite d11/d13/d14/d2c/d35/d3e/f62 [0,4194304] 0 2024-09-19T06:40:48.084 INFO:tasks.workunit.client.1.smithi117.stdout:8/901: dread d1d/d31/fa7 [0,4194304] 0 2024-09-19T06:40:48.087 INFO:tasks.workunit.client.1.smithi117.stdout:0/914: dwrite d11/f12 [0,4194304] 0 2024-09-19T06:40:48.091 INFO:tasks.workunit.client.1.smithi117.stdout:0/915: symlink d11/d13/d1b/d27/d37/d9d/l131 0 2024-09-19T06:40:48.093 INFO:tasks.workunit.client.1.smithi117.stdout:8/902: dwrite d1d/d2a/d3f/d4b/d91/ffd [0,4194304] 0 2024-09-19T06:40:48.098 INFO:tasks.workunit.client.1.smithi117.stdout:0/916: dwrite d11/d13/d28/f5d [0,4194304] 0 2024-09-19T06:40:48.100 INFO:tasks.workunit.client.1.smithi117.stdout:0/917: rmdir d11/d13/d28/dfe 39 2024-09-19T06:40:48.103 INFO:tasks.workunit.client.1.smithi117.stdout:0/918: mkdir d11/d13/d1b/d27/d37/d6d/dd2/d132 0 2024-09-19T06:40:48.105 INFO:tasks.workunit.client.1.smithi117.stdout:0/919: creat d11/d13/d28/d38/f133 x:0 0 0 2024-09-19T06:40:48.106 INFO:tasks.workunit.client.1.smithi117.stdout:8/903: write d1d/fb0 [737277,102298] 0 2024-09-19T06:40:48.120 INFO:tasks.workunit.client.0.smithi099.stdout:5/912: sync 2024-09-19T06:40:48.121 INFO:tasks.workunit.client.0.smithi099.stdout:2/631: sync 2024-09-19T06:40:48.121 INFO:tasks.workunit.client.0.smithi099.stdout:4/803: sync 2024-09-19T06:40:48.121 INFO:tasks.workunit.client.0.smithi099.stdout:7/972: sync 2024-09-19T06:40:48.121 INFO:tasks.workunit.client.1.smithi117.stdout:8/904: unlink d1d/d2a/d3f/d4c/c7d 0 2024-09-19T06:40:48.126 INFO:tasks.workunit.client.0.smithi099.stdout:7/973: creat d7/dcf/d29/d11b/f168 x:0 0 0 2024-09-19T06:40:48.126 INFO:tasks.workunit.client.1.smithi117.stdout:8/905: write d1d/d2a/d3f/d4b/fc2 [2298965,63308] 0 2024-09-19T06:40:48.127 INFO:tasks.workunit.client.1.smithi117.stdout:0/920: dwrite d11/d13/d1b/d27/d37/d6d/fba [0,4194304] 0 2024-09-19T06:40:48.130 INFO:tasks.workunit.client.0.smithi099.stdout:2/632: dwrite d1/d2/d4d/d55/da5/d36/f45 [0,4194304] 0 2024-09-19T06:40:48.130 INFO:tasks.workunit.client.0.smithi099.stdout:7/974: symlink d7/dcf/d29/d1f/d45/d48/df5/d153/l169 0 2024-09-19T06:40:48.131 INFO:tasks.workunit.client.1.smithi117.stdout:8/906: mkdir d1d/d2a/d3f/d4b/d5f/dbf/d100/d131 0 2024-09-19T06:40:48.131 INFO:tasks.workunit.client.1.smithi117.stdout:3/996: sync 2024-09-19T06:40:48.132 INFO:tasks.workunit.client.0.smithi099.stdout:4/804: dread d12/d82/ddd/d9b/da2/fd5 [0,4194304] 0 2024-09-19T06:40:48.134 INFO:tasks.workunit.client.0.smithi099.stdout:7/975: fdatasync d7/dc7/d67/f79 0 2024-09-19T06:40:48.134 INFO:tasks.workunit.client.0.smithi099.stdout:4/805: chown d12/d32/d42/d97/lb8 303083709 1 2024-09-19T06:40:48.135 INFO:tasks.workunit.client.0.smithi099.stdout:4/806: chown d12/d82/ddd/d89/d91 169909 1 2024-09-19T06:40:48.139 INFO:tasks.workunit.client.1.smithi117.stdout:8/907: link d1d/c28 d1d/d2a/d3f/d4b/d66/dac/de2/c132 0 2024-09-19T06:40:48.139 INFO:tasks.workunit.client.0.smithi099.stdout:5/913: dread d3/d16/d2f/fc6 [0,4194304] 0 2024-09-19T06:40:48.140 INFO:tasks.workunit.client.1.smithi117.stdout:0/921: dwrite d11/d13/d1b/d27/d54/d12b/f11b [0,4194304] 0 2024-09-19T06:40:48.143 INFO:tasks.workunit.client.1.smithi117.stdout:3/997: dwrite d0/d8/d7f/d40/d5b/ff6 [0,4194304] 0 2024-09-19T06:40:48.144 INFO:tasks.workunit.client.0.smithi099.stdout:7/976: dwrite d7/dcf/d29/d1f/d45/d48/dda/f126 [0,4194304] 0 2024-09-19T06:40:48.145 INFO:tasks.workunit.client.0.smithi099.stdout:2/633: dread d1/f15 [0,4194304] 0 2024-09-19T06:40:48.146 INFO:tasks.workunit.client.1.smithi117.stdout:8/908: read d1d/d1e/d53/d6e/f92 [78940,85397] 0 2024-09-19T06:40:48.147 INFO:tasks.workunit.client.1.smithi117.stdout:8/909: chown d1d/d1e/f58 2701 1 2024-09-19T06:40:48.149 INFO:tasks.workunit.client.1.smithi117.stdout:3/998: write d0/d3d/d48/dc7/f114 [1130596,86058] 0 2024-09-19T06:40:48.149 INFO:tasks.workunit.client.1.smithi117.stdout:0/922: mkdir d11/d13/d1b/d27/d37/da9/ddc/d134 0 2024-09-19T06:40:48.150 INFO:tasks.workunit.client.0.smithi099.stdout:2/634: mkdir d1/d2/d4d/d55/da5/d18/d27/d5b/dd4 0 2024-09-19T06:40:48.150 INFO:tasks.workunit.client.1.smithi117.stdout:8/910: symlink d1d/d2a/d3f/d4b/l133 0 2024-09-19T06:40:48.152 INFO:tasks.workunit.client.0.smithi099.stdout:2/635: creat d1/d2/d4d/d55/fd5 x:0 0 0 2024-09-19T06:40:48.156 INFO:tasks.workunit.client.0.smithi099.stdout:2/636: stat d1/d2/f1f 0 2024-09-19T06:40:48.158 INFO:tasks.workunit.client.1.smithi117.stdout:0/923: truncate d11/d13/d14/f4d 781887 0 2024-09-19T06:40:48.159 INFO:tasks.workunit.client.0.smithi099.stdout:2/637: write d1/d2/d4d/d55/da5/d9/d63/dc6/fb8 [909575,93710] 0 2024-09-19T06:40:48.159 INFO:tasks.workunit.client.1.smithi117.stdout:0/924: chown d11/d13/d1b/d27/d54/dff/d10c 29 1 2024-09-19T06:40:48.161 INFO:tasks.workunit.client.1.smithi117.stdout:3/999: rename d0/d9/d1c/d53/f12a to d0/d8/f13d 0 2024-09-19T06:40:48.162 INFO:tasks.workunit.client.0.smithi099.stdout:5/914: write d3/d1f/f20 [2186343,101069] 0 2024-09-19T06:40:48.163 INFO:tasks.workunit.client.0.smithi099.stdout:4/807: dwrite d12/f30 [0,4194304] 0 2024-09-19T06:40:48.164 INFO:tasks.workunit.client.0.smithi099.stdout:2/638: mkdir d1/d2/d4d/d55/da5/d18/d27/dd6 0 2024-09-19T06:40:48.165 INFO:tasks.workunit.client.0.smithi099.stdout:5/915: write d3/d1f/f117 [539544,20880] 0 2024-09-19T06:40:48.167 INFO:tasks.workunit.client.0.smithi099.stdout:5/916: readlink d3/d16/d2f/d34/d3c/d65/dec/l130 0 2024-09-19T06:40:48.169 INFO:tasks.workunit.client.0.smithi099.stdout:2/639: creat d1/d2/d4d/d55/da5/d18/d27/d5b/d92/fd7 x:0 0 0 2024-09-19T06:40:48.171 INFO:tasks.workunit.client.0.smithi099.stdout:5/917: mkdir d3/d16/d2f/d34/d3c/d13e 0 2024-09-19T06:40:48.171 INFO:tasks.workunit.client.0.smithi099.stdout:2/640: rmdir d1/d2/d4d/d55/da5 39 2024-09-19T06:40:48.174 INFO:tasks.workunit.client.0.smithi099.stdout:4/808: dread d12/d32/d42/d5c/d9d/fb2 [0,4194304] 0 2024-09-19T06:40:48.175 INFO:tasks.workunit.client.0.smithi099.stdout:5/918: creat d3/f13f x:0 0 0 2024-09-19T06:40:48.178 INFO:tasks.workunit.client.0.smithi099.stdout:5/919: mknod d3/d16/d2f/d34/da4/da5/dce/de5/d139/c140 0 2024-09-19T06:40:48.178 INFO:tasks.workunit.client.0.smithi099.stdout:7/977: dread d7/dcf/d29/d1f/d45/d48/d63/d75/dd8/df6/fff [0,4194304] 0 2024-09-19T06:40:48.181 INFO:tasks.workunit.client.0.smithi099.stdout:5/920: mknod d3/d16/d2f/d34/d3c/c141 0 2024-09-19T06:40:48.181 INFO:tasks.workunit.client.1.smithi117.stdout:6/829: sync 2024-09-19T06:40:48.181 INFO:tasks.workunit.client.0.smithi099.stdout:7/978: symlink d7/dcf/d29/d34/da1/dd5/d11d/l16a 0 2024-09-19T06:40:48.182 INFO:tasks.workunit.client.1.smithi117.stdout:8/911: write d1d/d1e/d53/d6e/f92 [280720,93070] 0 2024-09-19T06:40:48.183 INFO:tasks.workunit.client.0.smithi099.stdout:7/979: chown d7/dcf/d97/de5/f13a 6183 1 2024-09-19T06:40:48.183 INFO:tasks.workunit.client.0.smithi099.stdout:5/921: chown d3/d16/d2f/d34/d3c/d65/dbe/lfb 9855383 1 2024-09-19T06:40:48.185 INFO:tasks.workunit.client.1.smithi117.stdout:8/912: chown d1d/d2a/d3f/d4c/daa 5 1 2024-09-19T06:40:48.186 INFO:tasks.workunit.client.1.smithi117.stdout:6/830: mknod d1/d5/d8/d5e/d67/cfa 0 2024-09-19T06:40:48.187 INFO:tasks.workunit.client.0.smithi099.stdout:7/980: creat d7/dcf/d29/d1f/d45/d48/ddc/d11e/d53/f16b x:0 0 0 2024-09-19T06:40:48.189 INFO:tasks.workunit.client.1.smithi117.stdout:8/913: write d1d/d1e/dbc/dff/d10e/f124 [800304,102058] 0 2024-09-19T06:40:48.189 INFO:tasks.workunit.client.0.smithi099.stdout:7/981: read d7/dcf/d29/d1f/d45/d48/ddc/d11e/d53/fac [398334,53993] 0 2024-09-19T06:40:48.189 INFO:tasks.workunit.client.0.smithi099.stdout:2/641: truncate d1/d2/d4d/d55/da5/d18/f2f 1363654 0 2024-09-19T06:40:48.190 INFO:tasks.workunit.client.1.smithi117.stdout:6/831: truncate d1/d5/d8/d80/fac 1003549 0 2024-09-19T06:40:48.191 INFO:tasks.workunit.client.1.smithi117.stdout:0/925: dwrite d11/d13/f17 [4194304,4194304] 0 2024-09-19T06:40:48.191 INFO:tasks.workunit.client.1.smithi117.stdout:6/832: stat d1/c60 0 2024-09-19T06:40:48.192 INFO:tasks.workunit.client.1.smithi117.stdout:8/914: rmdir d1d/d2a/d3f/d4c/daa 39 2024-09-19T06:40:48.192 INFO:tasks.workunit.client.0.smithi099.stdout:7/982: mknod d7/dcf/d131/c16c 0 2024-09-19T06:40:48.193 INFO:tasks.workunit.client.0.smithi099.stdout:2/642: mkdir d1/d2/d4d/d55/da5/d18/d2d/dd8 0 2024-09-19T06:40:48.195 INFO:tasks.workunit.client.1.smithi117.stdout:0/926: creat d11/d13/d1b/d27/d37/f135 x:0 0 0 2024-09-19T06:40:48.196 INFO:tasks.workunit.client.1.smithi117.stdout:8/915: truncate d1d/d2a/d3f/d4b/d66/dac/fe1 839054 0 2024-09-19T06:40:48.197 INFO:tasks.workunit.client.1.smithi117.stdout:8/916: write d1d/d31/d83/f121 [549556,22569] 0 2024-09-19T06:40:48.198 INFO:tasks.workunit.client.0.smithi099.stdout:5/922: dwrite d3/d7/f1c [0,4194304] 0 2024-09-19T06:40:48.198 INFO:tasks.workunit.client.0.smithi099.stdout:7/983: rmdir d7/dcf/d97/d14e 0 2024-09-19T06:40:48.200 INFO:tasks.workunit.client.1.smithi117.stdout:8/917: mkdir d1d/d1e/dbc/d134 0 2024-09-19T06:40:48.203 INFO:tasks.workunit.client.1.smithi117.stdout:0/927: dwrite d11/d13/d14/dbd/d10d/fc3 [0,4194304] 0 2024-09-19T06:40:48.205 INFO:tasks.workunit.client.1.smithi117.stdout:8/918: creat d1d/d1e/dbc/d134/f135 x:0 0 0 2024-09-19T06:40:48.207 INFO:tasks.workunit.client.0.smithi099.stdout:5/923: dwrite d3/d1f/f91 [4194304,4194304] 0 2024-09-19T06:40:48.208 INFO:tasks.workunit.client.1.smithi117.stdout:8/919: fdatasync d1d/d1e/f1f 0 2024-09-19T06:40:48.210 INFO:tasks.workunit.client.0.smithi099.stdout:5/924: fsync d3/d7/f11 0 2024-09-19T06:40:48.216 INFO:tasks.workunit.client.0.smithi099.stdout:7/984: write d7/dcf/d29/d34/f112 [1024922,91367] 0 2024-09-19T06:40:48.219 INFO:tasks.workunit.client.0.smithi099.stdout:7/985: unlink d7/dc7/fdb 0 2024-09-19T06:40:48.219 INFO:tasks.workunit.client.0.smithi099.stdout:5/925: dwrite d3/d16/d2f/d34/d3c/f6d [0,4194304] 0 2024-09-19T06:40:48.220 INFO:tasks.workunit.client.0.smithi099.stdout:7/986: truncate d7/dcf/d97/fe6 514572 0 2024-09-19T06:40:48.221 INFO:tasks.workunit.client.0.smithi099.stdout:5/926: truncate d3/d7/f71 544774 0 2024-09-19T06:40:48.225 INFO:tasks.workunit.client.0.smithi099.stdout:5/927: dread - d3/d16/d2f/d34/d3c/de1/f124 zero size 2024-09-19T06:40:48.226 INFO:tasks.workunit.client.0.smithi099.stdout:5/928: dread - d3/d16/d5e/db1/f11a zero size 2024-09-19T06:40:48.229 INFO:tasks.workunit.client.0.smithi099.stdout:5/929: unlink d3/d16/d2f/d34/d3c/d65/fdf 0 2024-09-19T06:40:48.229 INFO:tasks.workunit.client.1.smithi117.stdout:8/920: write d1d/d2a/d3f/d73/ddd/f43 [220261,28250] 0 2024-09-19T06:40:48.231 INFO:tasks.workunit.client.0.smithi099.stdout:5/930: creat d3/d16/d2f/d34/d3c/de1/f142 x:0 0 0 2024-09-19T06:40:48.233 INFO:tasks.workunit.client.0.smithi099.stdout:5/931: readlink d3/d1f/l2d 0 2024-09-19T06:40:48.233 INFO:tasks.workunit.client.1.smithi117.stdout:8/921: write d1d/d2a/d3f/d4b/fc2 [4966364,92250] 0 2024-09-19T06:40:48.233 INFO:tasks.workunit.client.0.smithi099.stdout:5/932: fsync d3/d1f/d4f/f5c 0 2024-09-19T06:40:48.234 INFO:tasks.workunit.client.1.smithi117.stdout:0/928: dwrite d11/d13/d1b/d27/d37/da9/fce [0,4194304] 0 2024-09-19T06:40:48.234 INFO:tasks.workunit.client.0.smithi099.stdout:5/933: chown d3/d14/l59 166223 1 2024-09-19T06:40:48.235 INFO:tasks.workunit.client.1.smithi117.stdout:8/922: chown d1d/d2a/d3f/d4b/d5f/dbf/dd0/ccc 9 1 2024-09-19T06:40:48.235 INFO:tasks.workunit.client.0.smithi099.stdout:5/934: read d3/d7/d90/da6/fc0 [70410,868] 0 2024-09-19T06:40:48.238 INFO:tasks.workunit.client.1.smithi117.stdout:0/929: creat d11/d13/d28/dfe/d9e/f136 x:0 0 0 2024-09-19T06:40:48.239 INFO:tasks.workunit.client.0.smithi099.stdout:5/935: mknod d3/d16/d2f/d34/da4/da5/c143 0 2024-09-19T06:40:48.241 INFO:tasks.workunit.client.1.smithi117.stdout:0/930: mknod d11/d13/d14/d2c/d53/d103/c137 0 2024-09-19T06:40:48.244 INFO:tasks.workunit.client.1.smithi117.stdout:0/931: mkdir d11/d13/d1b/d27/d138 0 2024-09-19T06:40:48.245 INFO:tasks.workunit.client.1.smithi117.stdout:0/932: mkdir d11/d13/d28/dfe/d9e/d139 0 2024-09-19T06:40:48.245 INFO:tasks.workunit.client.1.smithi117.stdout:0/933: dread - d11/d13/d7a/dfa/f12d zero size 2024-09-19T06:40:48.247 INFO:tasks.workunit.client.1.smithi117.stdout:8/923: write d1d/d2a/fe4 [629984,62855] 0 2024-09-19T06:40:48.254 INFO:tasks.workunit.client.0.smithi099.stdout:7/987: dread d7/dcf/d29/d1f/dec/ffe [0,4194304] 0 2024-09-19T06:40:48.256 INFO:tasks.workunit.client.0.smithi099.stdout:7/988: mkdir d7/dcf/d29/df9/d135/d16d 0 2024-09-19T06:40:48.257 INFO:tasks.workunit.client.0.smithi099.stdout:7/989: mknod d7/dc7/d67/c16e 0 2024-09-19T06:40:48.257 INFO:tasks.workunit.client.1.smithi117.stdout:0/934: truncate d11/d13/d28/f5d 2922322 0 2024-09-19T06:40:48.259 INFO:tasks.workunit.client.0.smithi099.stdout:7/990: mkdir d7/dcf/d29/d1f/de9/d16f 0 2024-09-19T06:40:48.260 INFO:tasks.workunit.client.1.smithi117.stdout:0/935: creat d11/d13/d28/dfe/d9e/d12e/f13a x:0 0 0 2024-09-19T06:40:48.261 INFO:tasks.workunit.client.0.smithi099.stdout:7/991: creat d7/dc7/d67/f170 x:0 0 0 2024-09-19T06:40:48.261 INFO:tasks.workunit.client.1.smithi117.stdout:0/936: stat d11/d13/d28/dfe/f101 0 2024-09-19T06:40:48.262 INFO:tasks.workunit.client.1.smithi117.stdout:8/924: dwrite d1d/d2a/d3f/d4b/d5f/d95/fe7 [0,4194304] 0 2024-09-19T06:40:48.263 INFO:tasks.workunit.client.1.smithi117.stdout:0/937: chown d11/d13/d1b/d27/d54 1 1 2024-09-19T06:40:48.265 INFO:tasks.workunit.client.1.smithi117.stdout:0/938: write d11/d13/d1b/d27/d54/d12b/f115 [416306,97309] 0 2024-09-19T06:40:48.268 INFO:tasks.workunit.client.1.smithi117.stdout:0/939: dread - d11/d13/d1b/d27/d54/f8f zero size 2024-09-19T06:40:48.268 INFO:tasks.workunit.client.1.smithi117.stdout:8/925: link d1d/d2a/d3f/d4b/d91/l129 d1d/d2a/d3f/d4c/d119/l136 0 2024-09-19T06:40:48.269 INFO:tasks.workunit.client.1.smithi117.stdout:0/940: chown d11/d13/d14/d16/da1/ccd 250809 1 2024-09-19T06:40:48.272 INFO:tasks.workunit.client.1.smithi117.stdout:0/941: symlink d11/d13/d28/dfe/d9e/d123/l13b 0 2024-09-19T06:40:48.276 INFO:tasks.workunit.client.1.smithi117.stdout:8/926: dwrite d1d/d1e/d53/d6e/f92 [0,4194304] 0 2024-09-19T06:40:48.277 INFO:tasks.workunit.client.1.smithi117.stdout:8/927: read - d1d/d2a/d3f/d4b/d5f/f11c zero size 2024-09-19T06:40:48.277 INFO:tasks.workunit.client.1.smithi117.stdout:0/942: mkdir d11/d13/d1b/d27/d37/d6d/dd2/d13c 0 2024-09-19T06:40:48.278 INFO:tasks.workunit.client.1.smithi117.stdout:8/928: fsync d1d/d2a/d3f/d4b/d5f/dbf/ff7 0 2024-09-19T06:40:48.278 INFO:tasks.workunit.client.0.smithi099.stdout:7/992: dwrite d7/dcf/d29/d1f/d45/d48/ddc/d11e/fbc [0,4194304] 0 2024-09-19T06:40:48.281 INFO:tasks.workunit.client.0.smithi099.stdout:7/993: fsync d7/dcf/d29/d1f/f55 0 2024-09-19T06:40:48.282 INFO:tasks.workunit.client.0.smithi099.stdout:7/994: stat d7/dcf/d29/d1f/deb/f150 0 2024-09-19T06:40:48.286 INFO:tasks.workunit.client.0.smithi099.stdout:7/995: truncate d7/dcf/d29/d1f/d45/d48/ddc/d11e/f73 939957 0 2024-09-19T06:40:48.289 INFO:tasks.workunit.client.0.smithi099.stdout:7/996: rename d7/c22 to d7/dcf/d29/d11b/c171 0 2024-09-19T06:40:48.290 INFO:tasks.workunit.client.0.smithi099.stdout:7/997: chown d7/dcf/d29/d1f/dec/dfd 6 1 2024-09-19T06:40:48.294 INFO:tasks.workunit.client.0.smithi099.stdout:7/998: link d7/dcf/d29/d1f/deb/d13c/c13d d7/dcf/d29/d1f/d45/d48/d63/c172 0 2024-09-19T06:40:48.295 INFO:tasks.workunit.client.0.smithi099.stdout:7/999: rmdir d7/dcf/d29/d1f/d45/d48/ddc/d11e/d82 39 2024-09-19T06:40:48.304 INFO:tasks.workunit.client.1.smithi117.stdout:0/943: dwrite d11/d13/d14/d16/f4a [4194304,4194304] 0 2024-09-19T06:40:48.305 INFO:tasks.workunit.client.1.smithi117.stdout:8/929: dwrite d1d/d2a/d3f/d4b/d66/dac/fe1 [0,4194304] 0 2024-09-19T06:40:48.307 INFO:tasks.workunit.client.1.smithi117.stdout:6/833: sync 2024-09-19T06:40:48.308 INFO:tasks.workunit.client.1.smithi117.stdout:8/930: creat d1d/d1e/dbc/f137 x:0 0 0 2024-09-19T06:40:48.309 INFO:tasks.workunit.client.1.smithi117.stdout:0/944: mkdir d11/d13/d1b/d27/d37/da9/ddc/d134/d13d 0 2024-09-19T06:40:48.311 INFO:tasks.workunit.client.1.smithi117.stdout:6/834: mknod d1/d5/d8/d5e/d67/cfb 0 2024-09-19T06:40:48.311 INFO:tasks.workunit.client.1.smithi117.stdout:6/835: dread - d1/d14/dd5/fe9 zero size 2024-09-19T06:40:48.313 INFO:tasks.workunit.client.1.smithi117.stdout:8/931: creat d1d/d2a/d3f/d73/ddd/d112/f138 x:0 0 0 2024-09-19T06:40:48.313 INFO:tasks.workunit.client.1.smithi117.stdout:6/836: fsync d1/d5/d8/fee 0 2024-09-19T06:40:48.315 INFO:tasks.workunit.client.1.smithi117.stdout:6/837: write d1/d14/f4c [265216,68004] 0 2024-09-19T06:40:48.316 INFO:tasks.workunit.client.1.smithi117.stdout:8/932: dread d1d/d31/d83/f121 [0,4194304] 0 2024-09-19T06:40:48.317 INFO:tasks.workunit.client.1.smithi117.stdout:0/945: link d11/d13/d14/d2c/d35/la6 d11/d13/d1b/d27/d37/d6d/dd2/d13c/l13e 0 2024-09-19T06:40:48.318 INFO:tasks.workunit.client.1.smithi117.stdout:0/946: read d11/f12 [483721,117690] 0 2024-09-19T06:40:48.319 INFO:tasks.workunit.client.1.smithi117.stdout:6/838: write d1/d5/d8/d5e/d67/d98/da1/fd2 [2027728,6438] 0 2024-09-19T06:40:48.320 INFO:tasks.workunit.client.1.smithi117.stdout:8/933: mkdir d1d/d1e/dbc/dc1/d105/d139 0 2024-09-19T06:40:48.325 INFO:tasks.workunit.client.1.smithi117.stdout:6/839: rename d1/d5/d8/d5e/f68 to d1/ffc 0 2024-09-19T06:40:48.327 INFO:tasks.workunit.client.1.smithi117.stdout:6/840: dread - d1/d5/d8/d27/d77/da8/ff0 zero size 2024-09-19T06:40:48.327 INFO:tasks.workunit.client.1.smithi117.stdout:0/947: dwrite d11/d13/d14/d2c/d53/d7e/daa/f128 [0,4194304] 0 2024-09-19T06:40:48.333 INFO:tasks.workunit.client.1.smithi117.stdout:0/948: mkdir d11/d13/d1b/d27/d37/d13f 0 2024-09-19T06:40:48.334 INFO:tasks.workunit.client.1.smithi117.stdout:0/949: chown d11/d13/d14/d16/da1/cc5 3594 1 2024-09-19T06:40:48.336 INFO:tasks.workunit.client.1.smithi117.stdout:8/934: dwrite d1d/d2a/d3f/d4b/d5f/d95/f9b [0,4194304] 0 2024-09-19T06:40:48.337 INFO:tasks.workunit.client.1.smithi117.stdout:0/950: mkdir d11/d13/d14/d12c/d140 0 2024-09-19T06:40:48.341 INFO:tasks.workunit.client.1.smithi117.stdout:0/951: mkdir d11/d13/d14/dbd/d10d/d141 0 2024-09-19T06:40:48.341 INFO:tasks.workunit.client.1.smithi117.stdout:6/841: dwrite d1/d3d/d6f/fe8 [0,4194304] 0 2024-09-19T06:40:48.342 INFO:tasks.workunit.client.1.smithi117.stdout:8/935: truncate d1d/d31/d83/dad/dc0/fce 368045 0 2024-09-19T06:40:48.343 INFO:tasks.workunit.client.1.smithi117.stdout:0/952: symlink d11/d13/d7a/dfa/l142 0 2024-09-19T06:40:48.345 INFO:tasks.workunit.client.1.smithi117.stdout:6/842: write d1/f1d [1697778,54440] 0 2024-09-19T06:40:48.356 INFO:tasks.workunit.client.0.smithi099.stdout:8/774: sync 2024-09-19T06:40:48.356 INFO:tasks.workunit.client.0.smithi099.stdout:6/745: sync 2024-09-19T06:40:48.357 INFO:tasks.workunit.client.0.smithi099.stdout:8/775: stat d4/d11/d23/d4c/d93/d104 0 2024-09-19T06:40:48.358 INFO:tasks.workunit.client.1.smithi117.stdout:8/936: mknod d1d/d2a/d3f/d4b/d91/c13a 0 2024-09-19T06:40:48.360 INFO:tasks.workunit.client.1.smithi117.stdout:6/843: rename d1/d5/d8/db0/la7 to d1/d5/dc2/lfd 0 2024-09-19T06:40:48.360 INFO:tasks.workunit.client.0.smithi099.stdout:6/746: rename d1/lb4 to d1/d5/lf4 0 2024-09-19T06:40:48.360 INFO:tasks.workunit.client.1.smithi117.stdout:0/953: mknod d11/d13/d14/d2c/d53/d7e/c143 0 2024-09-19T06:40:48.363 INFO:tasks.workunit.client.0.smithi099.stdout:6/747: creat d1/d5/d38/ff5 x:0 0 0 2024-09-19T06:40:48.363 INFO:tasks.workunit.client.1.smithi117.stdout:8/937: getdents d1d/d2a/d3f 0 2024-09-19T06:40:48.365 INFO:tasks.workunit.client.1.smithi117.stdout:6/844: dwrite d1/d3/f50 [0,4194304] 0 2024-09-19T06:40:48.366 INFO:tasks.workunit.client.1.smithi117.stdout:8/938: symlink d1d/d31/d83/dad/l13b 0 2024-09-19T06:40:48.366 INFO:tasks.workunit.client.1.smithi117.stdout:6/845: fdatasync d1/d14/fd6 0 2024-09-19T06:40:48.367 INFO:tasks.workunit.client.1.smithi117.stdout:8/939: readlink d1d/d2a/d3f/d4b/d91/lec 0 2024-09-19T06:40:48.369 INFO:tasks.workunit.client.0.smithi099.stdout:6/748: dwrite d1/f1e [0,4194304] 0 2024-09-19T06:40:48.383 INFO:tasks.workunit.client.0.smithi099.stdout:6/749: dwrite d1/d5/d38/d76/db0/d54/d5d/d61/f68 [0,4194304] 0 2024-09-19T06:40:48.387 INFO:tasks.workunit.client.0.smithi099.stdout:6/750: creat d1/d5/d24/d2e/d41/ff6 x:0 0 0 2024-09-19T06:40:48.388 INFO:tasks.workunit.client.0.smithi099.stdout:6/751: mknod d1/d5/d38/d76/db0/d54/d5d/d61/cf7 0 2024-09-19T06:40:48.390 INFO:tasks.workunit.client.0.smithi099.stdout:6/752: fdatasync d1/d5/d24/d2e/d41/fb8 0 2024-09-19T06:40:48.395 INFO:tasks.workunit.client.1.smithi117.stdout:8/940: dread - d1d/d2a/d3f/d4b/d5f/d95/fa2 zero size 2024-09-19T06:40:48.397 INFO:tasks.workunit.client.1.smithi117.stdout:8/941: write d1d/d2a/d3f/d4b/d66/dac/fe1 [4031605,105625] 0 2024-09-19T06:40:48.397 INFO:tasks.workunit.client.0.smithi099.stdout:6/753: write d1/d5/d38/d76/db0/d2a/f30 [4001416,85765] 0 2024-09-19T06:40:48.398 INFO:tasks.workunit.client.0.smithi099.stdout:6/754: write d1/d7c/fad [3677810,118995] 0 2024-09-19T06:40:48.401 INFO:tasks.workunit.client.0.smithi099.stdout:6/755: creat d1/d5/d38/d76/ff8 x:0 0 0 2024-09-19T06:40:48.402 INFO:tasks.workunit.client.1.smithi117.stdout:6/846: dwrite d1/d5/d8/db0/f78 [0,4194304] 0 2024-09-19T06:40:48.403 INFO:tasks.workunit.client.0.smithi099.stdout:6/756: creat d1/d5/d24/d2b/ff9 x:0 0 0 2024-09-19T06:40:48.406 INFO:tasks.workunit.client.1.smithi117.stdout:8/942: dwrite d1d/d1e/dbc/dff/f10b [0,4194304] 0 2024-09-19T06:40:48.409 INFO:tasks.workunit.client.1.smithi117.stdout:6/847: truncate d1/d5/d8/d5e/d67/fae 1708800 0 2024-09-19T06:40:48.409 INFO:tasks.workunit.client.1.smithi117.stdout:6/848: readlink d1/d5/d8/d27/l2f 0 2024-09-19T06:40:48.412 INFO:tasks.workunit.client.1.smithi117.stdout:6/849: symlink d1/d5/d9a/lfe 0 2024-09-19T06:40:48.413 INFO:tasks.workunit.client.1.smithi117.stdout:8/943: getdents d1d/d2a/d3f/d4b/d91/d97 0 2024-09-19T06:40:48.415 INFO:tasks.workunit.client.1.smithi117.stdout:6/850: creat d1/d5/d85/def/fff x:0 0 0 2024-09-19T06:40:48.416 INFO:tasks.workunit.client.1.smithi117.stdout:8/944: mkdir d1d/d2a/d3f/d4b/d66/dac/de2/d13c 0 2024-09-19T06:40:48.417 INFO:tasks.workunit.client.1.smithi117.stdout:6/851: symlink d1/d5/d9a/da9/l100 0 2024-09-19T06:40:48.419 INFO:tasks.workunit.client.1.smithi117.stdout:6/852: mkdir d1/d5/d8/d27/d77/d101 0 2024-09-19T06:40:48.420 INFO:tasks.workunit.client.1.smithi117.stdout:8/945: rename d1d/d2a/d3f/d4c/daa to d1d/d1e/d3b/d13d 0 2024-09-19T06:40:48.422 INFO:tasks.workunit.client.1.smithi117.stdout:6/853: truncate d1/d5/d8/d5e/d6d/fb1 68774 0 2024-09-19T06:40:48.428 INFO:tasks.workunit.client.1.smithi117.stdout:8/946: dread d1d/d2a/d3f/d4b/f6b [0,4194304] 0 2024-09-19T06:40:48.428 INFO:tasks.workunit.client.1.smithi117.stdout:6/854: dwrite d1/d5/d8/d5e/d6d/f79 [0,4194304] 0 2024-09-19T06:40:48.430 INFO:tasks.workunit.client.1.smithi117.stdout:6/855: symlink d1/d14/dd5/l102 0 2024-09-19T06:40:48.434 INFO:tasks.workunit.client.1.smithi117.stdout:6/856: dread d1/d5/d8/d5e/d6d/f79 [0,4194304] 0 2024-09-19T06:40:48.437 INFO:tasks.workunit.client.1.smithi117.stdout:8/947: write d1d/d2a/d3f/d73/fea [1304116,103363] 0 2024-09-19T06:40:48.438 INFO:tasks.workunit.client.1.smithi117.stdout:6/857: getdents d1/d5/d8/d5e/d67/d98/ddd 0 2024-09-19T06:40:48.438 INFO:tasks.workunit.client.1.smithi117.stdout:6/858: stat d1/d14/l5f 0 2024-09-19T06:40:48.439 INFO:tasks.workunit.client.1.smithi117.stdout:8/948: chown d1d/d2a/d3f/d4b/d5f/d95/la4 213 1 2024-09-19T06:40:48.439 INFO:tasks.workunit.client.1.smithi117.stdout:6/859: truncate d1/d3/fb4 823230 0 2024-09-19T06:40:48.464 INFO:tasks.workunit.client.1.smithi117.stdout:8/949: creat d1d/d1e/dbc/dc1/d105/d113/f13e x:0 0 0 2024-09-19T06:40:48.465 INFO:tasks.workunit.client.1.smithi117.stdout:6/860: stat d1/d5/d32/dc1/le0 0 2024-09-19T06:40:48.466 INFO:tasks.workunit.client.1.smithi117.stdout:0/954: sync 2024-09-19T06:40:48.470 INFO:tasks.workunit.client.1.smithi117.stdout:8/950: dwrite d1d/d1e/f101 [0,4194304] 0 2024-09-19T06:40:48.471 INFO:tasks.workunit.client.1.smithi117.stdout:6/861: dread d1/f41 [0,4194304] 0 2024-09-19T06:40:48.472 INFO:tasks.workunit.client.1.smithi117.stdout:0/955: link d11/d13/d1b/d27/d54/fe9 d11/d13/d14/d16/da1/f144 0 2024-09-19T06:40:48.472 INFO:tasks.workunit.client.1.smithi117.stdout:8/951: symlink d1d/d1e/dbc/dff/d10e/l13f 0 2024-09-19T06:40:48.473 INFO:tasks.workunit.client.1.smithi117.stdout:6/862: mkdir d1/d5/d9a/d103 0 2024-09-19T06:40:48.476 INFO:tasks.workunit.client.1.smithi117.stdout:6/863: write d1/d5/d8/f5d [1902332,16544] 0 2024-09-19T06:40:48.482 INFO:tasks.workunit.client.1.smithi117.stdout:0/956: dwrite d11/ff1 [0,4194304] 0 2024-09-19T06:40:48.485 INFO:tasks.workunit.client.1.smithi117.stdout:0/957: creat d11/d13/d7a/dfa/f145 x:0 0 0 2024-09-19T06:40:48.486 INFO:tasks.workunit.client.1.smithi117.stdout:6/864: dwrite d1/d5/d8/d5e/fde [0,4194304] 0 2024-09-19T06:40:48.487 INFO:tasks.workunit.client.1.smithi117.stdout:0/958: readlink d11/d13/d1b/d27/d54/ld3 0 2024-09-19T06:40:48.488 INFO:tasks.workunit.client.1.smithi117.stdout:0/959: dread - d11/d13/d7a/dfa/f145 zero size 2024-09-19T06:40:48.491 INFO:tasks.workunit.client.1.smithi117.stdout:8/952: write d1d/f61 [3064345,115944] 0 2024-09-19T06:40:48.495 INFO:tasks.workunit.client.1.smithi117.stdout:8/953: mkdir d1d/d2a/d3f/d73/d125/d140 0 2024-09-19T06:40:48.497 INFO:tasks.workunit.client.1.smithi117.stdout:8/954: fdatasync d1d/d1e/d3b/f7b 0 2024-09-19T06:40:48.499 INFO:tasks.workunit.client.1.smithi117.stdout:8/955: mkdir d1d/d2a/d3f/d4b/d91/d141 0 2024-09-19T06:40:48.501 INFO:tasks.workunit.client.1.smithi117.stdout:8/956: chown d1d/d1e/d53/l8f 54712793 1 2024-09-19T06:40:48.502 INFO:tasks.workunit.client.1.smithi117.stdout:8/957: symlink d1d/d2a/d3f/d4b/d5f/dbf/l142 0 2024-09-19T06:40:48.503 INFO:tasks.workunit.client.1.smithi117.stdout:8/958: dread - d1d/d2a/d3f/d4b/d66/dac/fcb zero size 2024-09-19T06:40:48.505 INFO:tasks.workunit.client.1.smithi117.stdout:6/865: write d1/d3d/f83 [587270,115160] 0 2024-09-19T06:40:48.506 INFO:tasks.workunit.client.1.smithi117.stdout:8/959: dread d1d/d2a/fe4 [0,4194304] 0 2024-09-19T06:40:48.509 INFO:tasks.workunit.client.1.smithi117.stdout:6/866: creat d1/d5/d9a/d103/f104 x:0 0 0 2024-09-19T06:40:48.510 INFO:tasks.workunit.client.1.smithi117.stdout:0/960: dread d11/d13/d1b/d27/d54/d12b/f73 [0,4194304] 0 2024-09-19T06:40:48.510 INFO:tasks.workunit.client.1.smithi117.stdout:6/867: write d1/d5/d8/d5e/d67/fe4 [216592,92601] 0 2024-09-19T06:40:48.510 INFO:tasks.workunit.client.1.smithi117.stdout:8/960: link d1d/d2a/d3f/d4b/d91/d97/ccd d1d/d1e/d53/c143 0 2024-09-19T06:40:48.511 INFO:tasks.workunit.client.1.smithi117.stdout:8/961: write d1d/d1e/d53/d6e/f92 [2782009,119331] 0 2024-09-19T06:40:48.514 INFO:tasks.workunit.client.1.smithi117.stdout:6/868: creat d1/d5/d32/f105 x:0 0 0 2024-09-19T06:40:48.515 INFO:tasks.workunit.client.1.smithi117.stdout:8/962: fsync d1d/d2a/d3f/d4b/d66/dac/fe1 0 2024-09-19T06:40:48.517 INFO:tasks.workunit.client.1.smithi117.stdout:8/963: dread - d1d/d31/dbe/f11b zero size 2024-09-19T06:40:48.518 INFO:tasks.workunit.client.1.smithi117.stdout:0/961: dwrite d11/d13/d1b/d27/f60 [0,4194304] 0 2024-09-19T06:40:48.518 INFO:tasks.workunit.client.1.smithi117.stdout:8/964: read - d1d/d1e/d53/fe8 zero size 2024-09-19T06:40:48.519 INFO:tasks.workunit.client.1.smithi117.stdout:8/965: stat d1d/d2a/d3f/d73/ddd 0 2024-09-19T06:40:48.520 INFO:tasks.workunit.client.1.smithi117.stdout:6/869: rename d1/d5/d8/d27/l2f to d1/d3d/d6f/l106 0 2024-09-19T06:40:48.521 INFO:tasks.workunit.client.1.smithi117.stdout:0/962: creat d11/d13/d14/d2c/d53/d103/f146 x:0 0 0 2024-09-19T06:40:48.521 INFO:tasks.workunit.client.1.smithi117.stdout:8/966: mkdir d1d/d1e/d3b/d144 0 2024-09-19T06:40:48.522 INFO:tasks.workunit.client.1.smithi117.stdout:0/963: mkdir d11/d13/d1b/d27/d37/d6d/d147 0 2024-09-19T06:40:48.524 INFO:tasks.workunit.client.1.smithi117.stdout:6/870: getdents d1/d14 0 2024-09-19T06:40:48.526 INFO:tasks.workunit.client.1.smithi117.stdout:0/964: fdatasync d11/d13/d28/dfe/fe8 0 2024-09-19T06:40:48.527 INFO:tasks.workunit.client.1.smithi117.stdout:0/965: fsync d11/d13/d1b/f94 0 2024-09-19T06:40:48.529 INFO:tasks.workunit.client.1.smithi117.stdout:8/967: rename d1d/d1e/f32 to d1d/d2a/d3f/d4b/d66/f145 0 2024-09-19T06:40:48.530 INFO:tasks.workunit.client.1.smithi117.stdout:6/871: rmdir d1/d5/d8 39 2024-09-19T06:40:48.533 INFO:tasks.workunit.client.1.smithi117.stdout:0/966: mknod d11/d13/d14/d12c/d140/c148 0 2024-09-19T06:40:48.534 INFO:tasks.workunit.client.1.smithi117.stdout:8/968: getdents d1d/d1e/dbc 0 2024-09-19T06:40:48.535 INFO:tasks.workunit.client.1.smithi117.stdout:0/967: dread - d11/d13/d14/dbd/d10d/fe2 zero size 2024-09-19T06:40:48.542 INFO:tasks.workunit.client.1.smithi117.stdout:8/969: dwrite d1d/d1e/dbc/dff/f107 [0,4194304] 0 2024-09-19T06:40:48.545 INFO:tasks.workunit.client.1.smithi117.stdout:8/970: rmdir d1d/d2a/d3f/d4b/d66/dac/de2/d13c 0 2024-09-19T06:40:48.547 INFO:tasks.workunit.client.1.smithi117.stdout:8/971: chown d1d/d31/d83/c12a 150 1 2024-09-19T06:40:48.549 INFO:tasks.workunit.client.1.smithi117.stdout:8/972: creat d1d/d1e/d53/f146 x:0 0 0 2024-09-19T06:40:48.553 INFO:tasks.workunit.client.1.smithi117.stdout:6/872: dread d1/d5/d8/d27/f47 [0,4194304] 0 2024-09-19T06:40:48.554 INFO:tasks.workunit.client.1.smithi117.stdout:6/873: dread - d1/d14/dd5/fe9 zero size 2024-09-19T06:40:48.555 INFO:tasks.workunit.client.1.smithi117.stdout:0/968: dread d11/d13/d1b/fd5 [0,4194304] 0 2024-09-19T06:40:48.555 INFO:tasks.workunit.client.1.smithi117.stdout:6/874: mknod d1/d14/c107 0 2024-09-19T06:40:48.557 INFO:tasks.workunit.client.1.smithi117.stdout:6/875: mkdir d1/d5/d8/d5e/d67/d98/da1/d108 0 2024-09-19T06:40:48.559 INFO:tasks.workunit.client.1.smithi117.stdout:6/876: rename d1/d5/l36 to d1/d5/d32/dc1/l109 0 2024-09-19T06:40:48.561 INFO:tasks.workunit.client.1.smithi117.stdout:0/969: write d11/f12 [1059133,27294] 0 2024-09-19T06:40:48.563 INFO:tasks.workunit.client.1.smithi117.stdout:0/970: chown d11/d13/d1b/d67/cae 2187 1 2024-09-19T06:40:48.563 INFO:tasks.workunit.client.1.smithi117.stdout:6/877: link d1/lab d1/d5/d8/l10a 0 2024-09-19T06:40:48.563 INFO:tasks.workunit.client.1.smithi117.stdout:0/971: chown d11/c9a 1791878 1 2024-09-19T06:40:48.565 INFO:tasks.workunit.client.1.smithi117.stdout:8/973: dwrite d1d/d2a/d3f/d4b/d66/dac/faf [0,4194304] 0 2024-09-19T06:40:48.565 INFO:tasks.workunit.client.1.smithi117.stdout:8/974: chown d1d/d2a/d3f/d73 19 1 2024-09-19T06:40:48.567 INFO:tasks.workunit.client.1.smithi117.stdout:6/878: creat d1/d5/d9a/d103/f10b x:0 0 0 2024-09-19T06:40:48.568 INFO:tasks.workunit.client.1.smithi117.stdout:8/975: creat d1d/d2a/d3f/d4b/d66/dac/f147 x:0 0 0 2024-09-19T06:40:48.571 INFO:tasks.workunit.client.1.smithi117.stdout:8/976: unlink d1d/c46 0 2024-09-19T06:40:48.573 INFO:tasks.workunit.client.1.smithi117.stdout:6/879: write d1/d3/f76 [488394,88625] 0 2024-09-19T06:40:48.579 INFO:tasks.workunit.client.1.smithi117.stdout:8/977: dwrite d1d/d2a/d3f/d73/f10f [0,4194304] 0 2024-09-19T06:40:48.580 INFO:tasks.workunit.client.1.smithi117.stdout:6/880: dread d1/d5/d8/d5e/d6d/f79 [0,4194304] 0 2024-09-19T06:40:48.581 INFO:tasks.workunit.client.1.smithi117.stdout:0/972: dread d11/d13/d14/d2c/d35/fa3 [0,4194304] 0 2024-09-19T06:40:48.584 INFO:tasks.workunit.client.1.smithi117.stdout:8/978: getdents d1d/d1e/dbc/dc1/d105/d113/d127 0 2024-09-19T06:40:48.585 INFO:tasks.workunit.client.1.smithi117.stdout:0/973: symlink d11/d13/d28/de6/l149 0 2024-09-19T06:40:48.587 INFO:tasks.workunit.client.1.smithi117.stdout:0/974: read d11/d13/d1b/d27/d54/d12b/f11b [3484413,101055] 0 2024-09-19T06:40:48.589 INFO:tasks.workunit.client.1.smithi117.stdout:6/881: dwrite d1/d5/d32/f6b [0,4194304] 0 2024-09-19T06:40:48.589 INFO:tasks.workunit.client.1.smithi117.stdout:0/975: chown d11/d13/d1b/d27/d37/da9/ddc/d134 0 1 2024-09-19T06:40:48.589 INFO:tasks.workunit.client.1.smithi117.stdout:6/882: chown d1/d5/d8/dc3 1 1 2024-09-19T06:40:48.597 INFO:tasks.workunit.client.1.smithi117.stdout:6/883: dwrite d1/d5/d8/d5e/d67/d98/fb8 [0,4194304] 0 2024-09-19T06:40:48.598 INFO:tasks.workunit.client.1.smithi117.stdout:6/884: write d1/d5/d8/d5e/d67/d98/fa3 [293267,85108] 0 2024-09-19T06:40:48.602 INFO:tasks.workunit.client.1.smithi117.stdout:6/885: mkdir d1/d5/d8/d5e/d67/d98/da1/d10c 0 2024-09-19T06:40:48.603 INFO:tasks.workunit.client.1.smithi117.stdout:6/886: dread - d1/d5/d32/d45/f53 zero size 2024-09-19T06:40:48.606 INFO:tasks.workunit.client.1.smithi117.stdout:6/887: creat d1/d3d/f10d x:0 0 0 2024-09-19T06:40:48.607 INFO:tasks.workunit.client.1.smithi117.stdout:6/888: write d1/d5/d8/d80/fac [1375593,63506] 0 2024-09-19T06:40:48.609 INFO:tasks.workunit.client.1.smithi117.stdout:6/889: creat d1/d5/d8/d5e/d67/d98/ddd/f10e x:0 0 0 2024-09-19T06:40:48.617 INFO:tasks.workunit.client.1.smithi117.stdout:6/890: dwrite d1/d5/d9a/d103/f10b [0,4194304] 0 2024-09-19T06:40:48.619 INFO:tasks.workunit.client.1.smithi117.stdout:0/976: dwrite d11/d13/d14/f86 [0,4194304] 0 2024-09-19T06:40:48.619 INFO:tasks.workunit.client.1.smithi117.stdout:8/979: dwrite d1d/d2a/d3f/d4b/f5b [0,4194304] 0 2024-09-19T06:40:48.623 INFO:tasks.workunit.client.1.smithi117.stdout:8/980: dread - d1d/d31/f12f zero size 2024-09-19T06:40:48.626 INFO:tasks.workunit.client.1.smithi117.stdout:8/981: chown d1d/d1e/l23 95 1 2024-09-19T06:40:48.627 INFO:tasks.workunit.client.0.smithi099.stdout:9/911: sync 2024-09-19T06:40:48.627 INFO:tasks.workunit.client.0.smithi099.stdout:1/784: sync 2024-09-19T06:40:48.627 INFO:tasks.workunit.client.0.smithi099.stdout:0/723: sync 2024-09-19T06:40:48.630 INFO:tasks.workunit.client.0.smithi099.stdout:0/724: write d0/db/d27/d5d/d87/da2/dbc/d1f/d4a/d61/f8c [2221605,21521] 0 2024-09-19T06:40:48.630 INFO:tasks.workunit.client.1.smithi117.stdout:6/891: dwrite d1/d14/fbf [0,4194304] 0 2024-09-19T06:40:48.630 INFO:tasks.workunit.client.1.smithi117.stdout:8/982: truncate d1d/d1e/f1f 5042834 0 2024-09-19T06:40:48.631 INFO:tasks.workunit.client.1.smithi117.stdout:8/983: write d1d/d31/fe3 [2020418,35968] 0 2024-09-19T06:40:48.632 INFO:tasks.workunit.client.0.smithi099.stdout:1/785: mknod d0/db/c102 0 2024-09-19T06:40:48.632 INFO:tasks.workunit.client.0.smithi099.stdout:1/786: dread - d0/d17/d24/d5e/fca zero size 2024-09-19T06:40:48.638 INFO:tasks.workunit.client.1.smithi117.stdout:8/984: mkdir d1d/d2a/d3f/d4b/d148 0 2024-09-19T06:40:48.638 INFO:tasks.workunit.client.1.smithi117.stdout:6/892: creat d1/f10f x:0 0 0 2024-09-19T06:40:48.638 INFO:tasks.workunit.client.1.smithi117.stdout:8/985: write d1d/d2a/d3f/d4b/d5f/f10c [1024756,72477] 0 2024-09-19T06:40:48.639 INFO:tasks.workunit.client.0.smithi099.stdout:1/787: creat d0/d17/d24/d5e/f103 x:0 0 0 2024-09-19T06:40:48.641 INFO:tasks.workunit.client.1.smithi117.stdout:8/986: creat d1d/d2a/d3f/d73/ddd/f149 x:0 0 0 2024-09-19T06:40:48.646 INFO:tasks.workunit.client.0.smithi099.stdout:1/788: dread d0/db/f31 [0,4194304] 0 2024-09-19T06:40:48.646 INFO:tasks.workunit.client.0.smithi099.stdout:1/789: fdatasync d0/d68/fd0 0 2024-09-19T06:40:48.646 INFO:tasks.workunit.client.1.smithi117.stdout:6/893: dwrite d1/d5/d8/d5e/fcd [0,4194304] 0 2024-09-19T06:40:48.649 INFO:tasks.workunit.client.0.smithi099.stdout:1/790: creat d0/d12/d54/f104 x:0 0 0 2024-09-19T06:40:48.649 INFO:tasks.workunit.client.1.smithi117.stdout:8/987: dwrite d1d/d1e/dbc/dff/f107 [0,4194304] 0 2024-09-19T06:40:48.651 INFO:tasks.workunit.client.1.smithi117.stdout:6/894: rename d1/d5/d8/d5e/ff4 to d1/d5/d8/d27/f110 0 2024-09-19T06:40:48.653 INFO:tasks.workunit.client.1.smithi117.stdout:8/988: creat d1d/d2a/d3f/d4b/d5f/f14a x:0 0 0 2024-09-19T06:40:48.654 INFO:tasks.workunit.client.1.smithi117.stdout:6/895: write d1/d5/d8/d27/d77/da8/ff0 [192922,123170] 0 2024-09-19T06:40:48.659 INFO:tasks.workunit.client.1.smithi117.stdout:0/977: truncate d11/d13/d14/f86 1864344 0 2024-09-19T06:40:48.659 INFO:tasks.workunit.client.0.smithi099.stdout:4/809: sync 2024-09-19T06:40:48.662 INFO:tasks.workunit.client.1.smithi117.stdout:6/896: rename d1/d5/d8/d5e/c8f to d1/d5/d8/d5e/d67/c111 0 2024-09-19T06:40:48.662 INFO:tasks.workunit.client.0.smithi099.stdout:4/810: symlink d12/d82/ddd/dcb/l10c 0 2024-09-19T06:40:48.663 INFO:tasks.workunit.client.0.smithi099.stdout:1/791: truncate d0/d2d/f43 623656 0 2024-09-19T06:40:48.666 INFO:tasks.workunit.client.1.smithi117.stdout:8/989: write d1d/d1e/d53/f82 [237651,54501] 0 2024-09-19T06:40:48.667 INFO:tasks.workunit.client.0.smithi099.stdout:0/725: dwrite d0/d17/d41/f2d [0,4194304] 0 2024-09-19T06:40:48.667 INFO:tasks.workunit.client.1.smithi117.stdout:6/897: dread d1/d5/d8/d5e/d67/d98/fb8 [0,4194304] 0 2024-09-19T06:40:48.668 INFO:tasks.workunit.client.1.smithi117.stdout:6/898: write d1/f10f [385201,72549] 0 2024-09-19T06:40:48.668 INFO:tasks.workunit.client.1.smithi117.stdout:8/990: creat d1d/d1e/d3b/f14b x:0 0 0 2024-09-19T06:40:48.671 INFO:tasks.workunit.client.0.smithi099.stdout:4/811: read f10 [1523177,102203] 0 2024-09-19T06:40:48.673 INFO:tasks.workunit.client.1.smithi117.stdout:8/991: mkdir d1d/d1e/d3b/d14c 0 2024-09-19T06:40:48.674 INFO:tasks.workunit.client.0.smithi099.stdout:4/812: unlink d12/d58/ff0 0 2024-09-19T06:40:48.675 INFO:tasks.workunit.client.1.smithi117.stdout:6/899: dwrite d1/d5/d8/f5d [0,4194304] 0 2024-09-19T06:40:48.682 INFO:tasks.workunit.client.0.smithi099.stdout:0/726: write d0/db/d27/d5d/d87/da2/dbc/d1f/d3a/f7e [1651622,57914] 0 2024-09-19T06:40:48.683 INFO:tasks.workunit.client.1.smithi117.stdout:6/900: symlink d1/d5/d32/l112 0 2024-09-19T06:40:48.684 INFO:tasks.workunit.client.1.smithi117.stdout:0/978: write d11/d13/d14/d2c/d53/d7e/daa/fb0 [853346,26628] 0 2024-09-19T06:40:48.684 INFO:tasks.workunit.client.1.smithi117.stdout:0/979: readlink d11/d13/d1b/l8d 0 2024-09-19T06:40:48.685 INFO:tasks.workunit.client.0.smithi099.stdout:0/727: write d0/db/d27/d5d/d87/da2/dbc/f7d [1103271,83469] 0 2024-09-19T06:40:48.687 INFO:tasks.workunit.client.0.smithi099.stdout:4/813: write d12/d1b/f75 [2136100,117651] 0 2024-09-19T06:40:48.688 INFO:tasks.workunit.client.1.smithi117.stdout:6/901: mkdir d1/d5/d32/d113 0 2024-09-19T06:40:48.688 INFO:tasks.workunit.client.0.smithi099.stdout:4/814: readlink d12/l84 0 2024-09-19T06:40:48.689 INFO:tasks.workunit.client.1.smithi117.stdout:6/902: chown d1/d3d 521244595 1 2024-09-19T06:40:48.690 INFO:tasks.workunit.client.1.smithi117.stdout:0/980: creat d11/d13/d14/dbd/d10d/d109/f14a x:0 0 0 2024-09-19T06:40:48.691 INFO:tasks.workunit.client.1.smithi117.stdout:8/992: dwrite d1d/d2a/f76 [0,4194304] 0 2024-09-19T06:40:48.693 INFO:tasks.workunit.client.0.smithi099.stdout:0/728: dwrite d0/db/dc0/fdd [0,4194304] 0 2024-09-19T06:40:48.699 INFO:tasks.workunit.client.1.smithi117.stdout:8/993: rmdir d1d 39 2024-09-19T06:40:48.701 INFO:tasks.workunit.client.0.smithi099.stdout:0/729: write d0/db/d27/d5d/d87/da2/dbc/d1f/d4a/f50 [3341815,83710] 0 2024-09-19T06:40:48.702 INFO:tasks.workunit.client.1.smithi117.stdout:0/981: unlink d11/d13/d1b/d27/d37/d6d/fba 0 2024-09-19T06:40:48.704 INFO:tasks.workunit.client.1.smithi117.stdout:6/903: link d1/d3d/d6f/l9d d1/d14/l114 0 2024-09-19T06:40:48.706 INFO:tasks.workunit.client.0.smithi099.stdout:0/730: getdents d0/d17/d41 0 2024-09-19T06:40:48.707 INFO:tasks.workunit.client.1.smithi117.stdout:6/904: read d1/d3d/f5a [37536,61909] 0 2024-09-19T06:40:48.707 INFO:tasks.workunit.client.0.smithi099.stdout:0/731: chown d0/db/d27/d5d/d87/da2/dbc/d1f/c62 97445301 1 2024-09-19T06:40:48.709 INFO:tasks.workunit.client.1.smithi117.stdout:0/982: mknod d11/d13/d1b/d27/d37/d13f/c14b 0 2024-09-19T06:40:48.710 INFO:tasks.workunit.client.0.smithi099.stdout:0/732: getdents d0/db/dc0/dd2 0 2024-09-19T06:40:48.711 INFO:tasks.workunit.client.0.smithi099.stdout:0/733: creat d0/db/d36/fe6 x:0 0 0 2024-09-19T06:40:48.712 INFO:tasks.workunit.client.0.smithi099.stdout:0/734: stat d0/db/d27/d5d/d87/da2/dbc/d47/d75/da4/dcf 0 2024-09-19T06:40:48.713 INFO:tasks.workunit.client.0.smithi099.stdout:0/735: write d0/db/d27/d5d/d87/da2/dbc/d1f/d4a/fb8 [4388930,24406] 0 2024-09-19T06:40:48.717 INFO:tasks.workunit.client.0.smithi099.stdout:0/736: link d0/db/d27/d5d/d87/da2/dbc/f1e d0/db/d27/d5d/d87/da2/dbc/d1f/d3a/da0/fe7 0 2024-09-19T06:40:48.719 INFO:tasks.workunit.client.0.smithi099.stdout:0/737: symlink d0/db/d27/d5d/d87/da2/dbc/d47/le8 0 2024-09-19T06:40:48.721 INFO:tasks.workunit.client.0.smithi099.stdout:0/738: chown d0/db/d27/d5d/d87/da2/dbc/d1f/d3a/fbb 234 1 2024-09-19T06:40:48.722 INFO:tasks.workunit.client.0.smithi099.stdout:0/739: write d0/db/d36/fe6 [996781,87136] 0 2024-09-19T06:40:48.723 INFO:tasks.workunit.client.1.smithi117.stdout:8/994: dwrite d1d/d1e/d53/d6e/fde [0,4194304] 0 2024-09-19T06:40:48.727 INFO:tasks.workunit.client.0.smithi099.stdout:0/740: link d0/l18 d0/db/d2f/le9 0 2024-09-19T06:40:48.728 INFO:tasks.workunit.client.1.smithi117.stdout:8/995: truncate d1d/d2a/d3f/d4b/f6b 4124952 0 2024-09-19T06:40:48.729 INFO:tasks.workunit.client.1.smithi117.stdout:6/905: dread d1/d5/d8/f4f [0,4194304] 0 2024-09-19T06:40:48.735 INFO:tasks.workunit.client.1.smithi117.stdout:6/906: creat d1/d5/d8/d99/f115 x:0 0 0 2024-09-19T06:40:48.736 INFO:tasks.workunit.client.1.smithi117.stdout:0/983: dread d11/d13/d28/de6/f124 [0,4194304] 0 2024-09-19T06:40:48.737 INFO:tasks.workunit.client.1.smithi117.stdout:6/907: chown d1/d5/d8/d5e/d67/d98/ddd 71710 1 2024-09-19T06:40:48.738 INFO:tasks.workunit.client.0.smithi099.stdout:0/741: dwrite d0/f3 [4194304,4194304] 0 2024-09-19T06:40:48.740 INFO:tasks.workunit.client.1.smithi117.stdout:8/996: dwrite d1d/d2a/d3f/d4b/d5f/dbf/dd0/db9/dd6/f10a [4194304,4194304] 0 2024-09-19T06:40:48.740 INFO:tasks.workunit.client.1.smithi117.stdout:0/984: read d11/d13/d1b/d27/d54/d12b/f115 [165541,39357] 0 2024-09-19T06:40:48.742 INFO:tasks.workunit.client.1.smithi117.stdout:0/985: chown d11/d13/d28/f87 45044 1 2024-09-19T06:40:48.742 INFO:tasks.workunit.client.0.smithi099.stdout:0/742: stat d0/d17/f84 0 2024-09-19T06:40:48.745 INFO:tasks.workunit.client.0.smithi099.stdout:0/743: creat d0/db/d27/d5d/d87/da2/dbc/d47/d75/da4/dcf/fea x:0 0 0 2024-09-19T06:40:48.746 INFO:tasks.workunit.client.0.smithi099.stdout:0/744: chown d0/f2a 1022141 1 2024-09-19T06:40:48.748 INFO:tasks.workunit.client.1.smithi117.stdout:8/997: write d1d/d2a/d3f/d4b/d91/d97/ff2 [13704,35749] 0 2024-09-19T06:40:48.750 INFO:tasks.workunit.client.0.smithi099.stdout:0/745: symlink d0/db/d27/d5d/d87/da2/dbc/d47/d75/da4/dcf/dd3/leb 0 2024-09-19T06:40:48.750 INFO:tasks.workunit.client.1.smithi117.stdout:8/998: write d1d/d2a/d3f/d4b/d66/f74 [1582998,19159] 0 2024-09-19T06:40:48.753 INFO:tasks.workunit.client.0.smithi099.stdout:0/746: mknod d0/db/d2f/cec 0 2024-09-19T06:40:48.753 INFO:tasks.workunit.client.1.smithi117.stdout:0/986: dwrite d11/d13/d14/f86 [0,4194304] 0 2024-09-19T06:40:48.754 INFO:tasks.workunit.client.1.smithi117.stdout:0/987: chown d11/d13/d28 127 1 2024-09-19T06:40:48.755 INFO:tasks.workunit.client.0.smithi099.stdout:0/747: readlink d0/db/d27/d5d/d87/da2/dbc/d1f/lb9 0 2024-09-19T06:40:48.755 INFO:tasks.workunit.client.1.smithi117.stdout:0/988: fdatasync d11/d13/d1b/d27/d37/da9/fce 0 2024-09-19T06:40:48.756 INFO:tasks.workunit.client.1.smithi117.stdout:8/999: mkdir d1d/d1e/dbc/dff/d14d 0 2024-09-19T06:40:48.759 INFO:tasks.workunit.client.1.smithi117.stdout:0/989: getdents d11/d13/d7a 0 2024-09-19T06:40:48.763 INFO:tasks.workunit.client.1.smithi117.stdout:0/990: dread d11/d13/d14/d2c/d35/d3e/f62 [0,4194304] 0 2024-09-19T06:40:48.766 INFO:tasks.workunit.client.1.smithi117.stdout:0/991: creat d11/d13/d1b/d27/d138/f14c x:0 0 0 2024-09-19T06:40:48.767 INFO:tasks.workunit.client.1.smithi117.stdout:0/992: fsync d11/d13/d14/d2c/f32 0 2024-09-19T06:40:48.770 INFO:tasks.workunit.client.1.smithi117.stdout:0/993: truncate d11/d13/d1b/d27/d54/f8f 341884 0 2024-09-19T06:40:48.775 INFO:tasks.workunit.client.0.smithi099.stdout:0/748: truncate d0/db/d27/d5d/d87/da2/dbc/d47/f92 37609 0 2024-09-19T06:40:48.781 INFO:tasks.workunit.client.0.smithi099.stdout:0/749: dwrite d0/db/d36/d3f/d91/fe2 [0,4194304] 0 2024-09-19T06:40:48.789 INFO:tasks.workunit.client.0.smithi099.stdout:0/750: dread d0/db/d27/d5d/d87/da2/dbc/d37/d3c/fde [0,4194304] 0 2024-09-19T06:40:48.794 INFO:tasks.workunit.client.0.smithi099.stdout:0/751: dwrite d0/db/d36/f67 [0,4194304] 0 2024-09-19T06:40:48.799 INFO:tasks.workunit.client.0.smithi099.stdout:0/752: link d0/db/d27/d38/c40 d0/db/d27/d5d/d87/da2/dbc/d1f/db4/ced 0 2024-09-19T06:40:48.801 INFO:tasks.workunit.client.0.smithi099.stdout:0/753: truncate d0/db/d2f/f30 1104560 0 2024-09-19T06:40:48.804 INFO:tasks.workunit.client.0.smithi099.stdout:0/754: getdents d0/db/d27/d38 0 2024-09-19T06:40:48.827 INFO:tasks.workunit.client.0.smithi099.stdout:0/755: dread d0/db/d36/f5f [8388608,4194304] 0 2024-09-19T06:40:48.829 INFO:tasks.workunit.client.0.smithi099.stdout:0/756: truncate d0/db/d27/d5d/d87/da2/dbc/d1f/d39/f66 1988392 0 2024-09-19T06:40:48.831 INFO:tasks.workunit.client.0.smithi099.stdout:0/757: dread d0/db/d2f/fc9 [0,4194304] 0 2024-09-19T06:40:48.836 INFO:tasks.workunit.client.0.smithi099.stdout:0/758: write d0/db/d27/d5d/d87/da2/dbc/d1f/d3a/da0/fe7 [3416526,104270] 0 2024-09-19T06:40:48.838 INFO:tasks.workunit.client.0.smithi099.stdout:0/759: mknod d0/db/d27/d5d/d87/da2/dbc/d37/d3c/cee 0 2024-09-19T06:40:48.843 INFO:tasks.workunit.client.0.smithi099.stdout:6/757: sync 2024-09-19T06:40:48.843 INFO:tasks.workunit.client.0.smithi099.stdout:5/936: sync 2024-09-19T06:40:48.843 INFO:tasks.workunit.client.0.smithi099.stdout:8/776: sync 2024-09-19T06:40:48.843 INFO:tasks.workunit.client.0.smithi099.stdout:2/643: sync 2024-09-19T06:40:48.844 INFO:tasks.workunit.client.0.smithi099.stdout:0/760: dwrite d0/db/d27/d5d/d87/da2/dbc/d1f/d39/f74 [0,4194304] 0 2024-09-19T06:40:48.845 INFO:tasks.workunit.client.0.smithi099.stdout:8/777: stat d4/de/d1c/df7/ced 0 2024-09-19T06:40:48.846 INFO:tasks.workunit.client.0.smithi099.stdout:5/937: mknod d3/d16/d2f/d8c/dd9/d102/c144 0 2024-09-19T06:40:48.848 INFO:tasks.workunit.client.0.smithi099.stdout:5/938: read - d3/d16/d2f/d34/d3c/de1/f124 zero size 2024-09-19T06:40:48.849 INFO:tasks.workunit.client.0.smithi099.stdout:6/758: rename d1/d5/c2c to d1/d5/d38/d76/cfa 0 2024-09-19T06:40:48.851 INFO:tasks.workunit.client.0.smithi099.stdout:8/778: unlink d4/d11/d23/l5f 0 2024-09-19T06:40:48.852 INFO:tasks.workunit.client.0.smithi099.stdout:0/761: dwrite d0/db/d27/d5d/d87/da2/dbc/d37/fc2 [0,4194304] 0 2024-09-19T06:40:48.853 INFO:tasks.workunit.client.0.smithi099.stdout:2/644: creat d1/d2/d4d/d55/da5/da8/fd9 x:0 0 0 2024-09-19T06:40:48.853 INFO:tasks.workunit.client.0.smithi099.stdout:8/779: dread - d4/de/d26/d2b/ff2 zero size 2024-09-19T06:40:48.854 INFO:tasks.workunit.client.0.smithi099.stdout:5/939: truncate d3/d7/f10 5893845 0 2024-09-19T06:40:48.855 INFO:tasks.workunit.client.0.smithi099.stdout:6/759: creat d1/d5/d24/d2b/d86/da5/ffb x:0 0 0 2024-09-19T06:40:48.858 INFO:tasks.workunit.client.0.smithi099.stdout:6/760: chown d1/d5/d38/d76/db0/d54/d5d/d61/d65/l6b 2794 1 2024-09-19T06:40:48.859 INFO:tasks.workunit.client.0.smithi099.stdout:6/761: readlink d1/d12/l62 0 2024-09-19T06:40:48.861 INFO:tasks.workunit.client.0.smithi099.stdout:5/940: unlink d3/d1f/l40 0 2024-09-19T06:40:48.864 INFO:tasks.workunit.client.0.smithi099.stdout:2/645: dwrite d1/d2/d4d/d55/da5/d18/d27/d5b/d92/fbd [0,4194304] 0 2024-09-19T06:40:48.864 INFO:tasks.workunit.client.0.smithi099.stdout:8/780: rename d4/d11/d23/d4c/d93/d104/df3 to d4/d11/d23/d3f/d105 0 2024-09-19T06:40:48.866 INFO:tasks.workunit.client.0.smithi099.stdout:5/941: dread d3/d1f/f117 [0,4194304] 0 2024-09-19T06:40:48.866 INFO:tasks.workunit.client.0.smithi099.stdout:5/942: stat d3/d7/f26 0 2024-09-19T06:40:48.866 INFO:tasks.workunit.client.0.smithi099.stdout:6/762: mknod d1/d5/d24/d2e/d41/d81/cfc 0 2024-09-19T06:40:48.872 INFO:tasks.workunit.client.0.smithi099.stdout:0/762: dread d0/db/d27/d5d/d87/da2/dbc/f1e [0,4194304] 0 2024-09-19T06:40:48.872 INFO:tasks.workunit.client.0.smithi099.stdout:8/781: dread d4/d11/d23/f3b [0,4194304] 0 2024-09-19T06:40:48.875 INFO:tasks.workunit.client.0.smithi099.stdout:2/646: creat d1/d2/d4d/d55/da5/d18/d76/fda x:0 0 0 2024-09-19T06:40:48.878 INFO:tasks.workunit.client.0.smithi099.stdout:8/782: fdatasync d4/de/d26/d2b/f58 0 2024-09-19T06:40:48.878 INFO:tasks.workunit.client.0.smithi099.stdout:5/943: link d3/d16/d5e/db1/c13d d3/d16/d2f/d34/d3c/c145 0 2024-09-19T06:40:48.881 INFO:tasks.workunit.client.0.smithi099.stdout:5/944: mkdir d3/d16/d7d/d146 0 2024-09-19T06:40:48.882 INFO:tasks.workunit.client.0.smithi099.stdout:0/763: dwrite d0/db/d27/d5d/d87/da2/dbc/d1f/d39/f63 [0,4194304] 0 2024-09-19T06:40:48.884 INFO:tasks.workunit.client.0.smithi099.stdout:0/764: read d0/f2a [2476275,58211] 0 2024-09-19T06:40:48.885 INFO:tasks.workunit.client.0.smithi099.stdout:8/783: rename d4/d11/d38/f3c to d4/d11/f106 0 2024-09-19T06:40:48.888 INFO:tasks.workunit.client.0.smithi099.stdout:0/765: write d0/db/d27/d5d/d87/da2/dbc/d59/f6c [4394927,121831] 0 2024-09-19T06:40:48.889 INFO:tasks.workunit.client.0.smithi099.stdout:5/945: dread d3/d16/d2f/d34/da4/da5/ff2 [0,4194304] 0 2024-09-19T06:40:48.891 INFO:tasks.workunit.client.0.smithi099.stdout:5/946: unlink c2 0 2024-09-19T06:40:48.891 INFO:tasks.workunit.client.0.smithi099.stdout:9/912: sync 2024-09-19T06:40:48.892 INFO:tasks.workunit.client.0.smithi099.stdout:0/766: fdatasync d0/db/f48 0 2024-09-19T06:40:48.893 INFO:tasks.workunit.client.0.smithi099.stdout:8/784: truncate d4/d11/d23/d4c/f69 4709604 0 2024-09-19T06:40:48.895 INFO:tasks.workunit.client.0.smithi099.stdout:9/913: symlink dd/l12d 0 2024-09-19T06:40:48.897 INFO:tasks.workunit.client.0.smithi099.stdout:8/785: getdents d4/d101 0 2024-09-19T06:40:48.898 INFO:tasks.workunit.client.0.smithi099.stdout:0/767: mkdir d0/db/d27/d5d/d87/da2/def 0 2024-09-19T06:40:48.899 INFO:tasks.workunit.client.0.smithi099.stdout:2/647: dwrite d1/d2/d4d/d55/da5/d9/f67 [0,4194304] 0 2024-09-19T06:40:48.899 INFO:tasks.workunit.client.0.smithi099.stdout:6/763: dread d1/d5/d24/d2e/d41/f9e [0,4194304] 0 2024-09-19T06:40:48.900 INFO:tasks.workunit.client.0.smithi099.stdout:6/764: stat d1/f1d 0 2024-09-19T06:40:48.901 INFO:tasks.workunit.client.0.smithi099.stdout:0/768: stat d0/db/d27/d5d/d87/da2/dbc/d1f/d39/f54 0 2024-09-19T06:40:48.903 INFO:tasks.workunit.client.0.smithi099.stdout:0/769: fdatasync d0/db/d27/d5d/d87/da2/dbc/f7d 0 2024-09-19T06:40:48.903 INFO:tasks.workunit.client.0.smithi099.stdout:8/786: mknod d4/de/d26/d2b/d91/c107 0 2024-09-19T06:40:48.903 INFO:tasks.workunit.client.0.smithi099.stdout:5/947: write d3/d16/d2f/d8c/fcc [476933,41339] 0 2024-09-19T06:40:48.904 INFO:tasks.workunit.client.0.smithi099.stdout:9/914: creat dd/d2c/d5c/d64/d93/f12e x:0 0 0 2024-09-19T06:40:48.905 INFO:tasks.workunit.client.0.smithi099.stdout:0/770: chown d0/db/d27/d5d/d87/da2/dbc/d1f/d3a/da0 322522 1 2024-09-19T06:40:48.907 INFO:tasks.workunit.client.0.smithi099.stdout:2/648: symlink d1/d2/d4d/d55/da5/d9/db7/ldb 0 2024-09-19T06:40:48.907 INFO:tasks.workunit.client.0.smithi099.stdout:6/765: read d1/d5/d38/d76/db0/d54/d5d/d61/fdd [1174410,34504] 0 2024-09-19T06:40:48.908 INFO:tasks.workunit.client.0.smithi099.stdout:8/787: truncate d4/de/d1c/f6d 3187534 0 2024-09-19T06:40:48.909 INFO:tasks.workunit.client.0.smithi099.stdout:2/649: chown d1/d2/d4d/d55/da5 682514183 1 2024-09-19T06:40:48.911 INFO:tasks.workunit.client.0.smithi099.stdout:5/948: mkdir d3/d16/d2f/d34/da4/da5/dce/d147 0 2024-09-19T06:40:48.912 INFO:tasks.workunit.client.0.smithi099.stdout:0/771: rename d0/db/d27/d5d/d87/da2/dbc/d1f/c5e to d0/db/d27/d5d/d87/da2/dbc/d47/cf0 0 2024-09-19T06:40:48.916 INFO:tasks.workunit.client.0.smithi099.stdout:8/788: dwrite d4/de/fa8 [0,4194304] 0 2024-09-19T06:40:48.954 INFO:tasks.workunit.client.0.smithi099.stdout:5/949: write d3/d16/f2b [583661,6164] 0 2024-09-19T06:40:48.955 INFO:tasks.workunit.client.0.smithi099.stdout:0/772: creat d0/db/d27/d5d/d87/da2/dbc/d37/d3c/d3e/dd1/ff1 x:0 0 0 2024-09-19T06:40:48.956 INFO:tasks.workunit.client.0.smithi099.stdout:8/789: symlink d4/d11/d23/d92/l108 0 2024-09-19T06:40:48.959 INFO:tasks.workunit.client.0.smithi099.stdout:8/790: stat d4/de/c8f 0 2024-09-19T06:40:48.962 INFO:tasks.workunit.client.0.smithi099.stdout:9/915: dread dd/d62/d78/f7b [0,4194304] 0 2024-09-19T06:40:48.962 INFO:tasks.workunit.client.0.smithi099.stdout:5/950: link d3/d7/f64 d3/d14/f148 0 2024-09-19T06:40:48.963 INFO:tasks.workunit.client.0.smithi099.stdout:2/650: dwrite d1/f15 [0,4194304] 0 2024-09-19T06:40:48.965 INFO:tasks.workunit.client.0.smithi099.stdout:8/791: rename d4/d11/d23/c47 to d4/d11/d38/dc0/c109 0 2024-09-19T06:40:48.965 INFO:tasks.workunit.client.0.smithi099.stdout:0/773: write d0/db/d27/d5d/d87/da2/dbc/d1f/d4a/d61/f8c [2987822,91953] 0 2024-09-19T06:40:48.966 INFO:tasks.workunit.client.0.smithi099.stdout:9/916: chown dd/d2c/d5c/l9e 225 1 2024-09-19T06:40:48.967 INFO:tasks.workunit.client.0.smithi099.stdout:9/917: chown dd 194234873 1 2024-09-19T06:40:48.969 INFO:tasks.workunit.client.0.smithi099.stdout:0/774: chown d0/db/d27/d5d/d87/da2/dbc/d1f/d3a/da0/cb0 4069193 1 2024-09-19T06:40:48.969 INFO:tasks.workunit.client.0.smithi099.stdout:9/918: write dd/d2c/d5c/f73 [546194,24690] 0 2024-09-19T06:40:48.971 INFO:tasks.workunit.client.0.smithi099.stdout:2/651: creat d1/d2/d4d/d55/da5/d18/d27/d5b/dd4/fdc x:0 0 0 2024-09-19T06:40:48.981 INFO:tasks.workunit.client.0.smithi099.stdout:9/919: fdatasync dd/d2c/d5c/f73 0 2024-09-19T06:40:48.982 INFO:tasks.workunit.client.0.smithi099.stdout:9/920: chown dd/d47/l11a 32589374 1 2024-09-19T06:40:48.982 INFO:tasks.workunit.client.0.smithi099.stdout:9/921: write dd/d65/f96 [274486,63341] 0 2024-09-19T06:40:48.984 INFO:tasks.workunit.client.0.smithi099.stdout:5/951: truncate d3/d14/fa1 2662141 0 2024-09-19T06:40:48.985 INFO:tasks.workunit.client.0.smithi099.stdout:8/792: write d4/ff8 [118168,100535] 0 2024-09-19T06:40:48.987 INFO:tasks.workunit.client.0.smithi099.stdout:5/952: fdatasync d3/d16/fb6 0 2024-09-19T06:40:48.988 INFO:tasks.workunit.client.0.smithi099.stdout:8/793: symlink d4/d11/d23/d4c/ddd/l10a 0 2024-09-19T06:40:48.990 INFO:tasks.workunit.client.0.smithi099.stdout:8/794: dread - d4/de/d26/d2b/f82 zero size 2024-09-19T06:40:48.993 INFO:tasks.workunit.client.1.smithi117.stdout:0/994: sync 2024-09-19T06:40:48.994 INFO:tasks.workunit.client.1.smithi117.stdout:6/908: sync 2024-09-19T06:40:48.994 INFO:tasks.workunit.client.0.smithi099.stdout:8/795: read - d4/d11/d61/ff9 zero size 2024-09-19T06:40:48.994 INFO:tasks.workunit.client.0.smithi099.stdout:0/775: dwrite d0/db/d27/d5d/d87/da2/dbc/d59/fb2 [0,4194304] 0 2024-09-19T06:40:48.997 INFO:tasks.workunit.client.0.smithi099.stdout:5/953: write d3/d1f/f21 [1754392,58045] 0 2024-09-19T06:40:48.997 INFO:tasks.workunit.client.0.smithi099.stdout:0/776: dread - d0/db/d27/d5d/d87/da2/dbc/d1f/d3a/dbf/fcd zero size 2024-09-19T06:40:48.997 INFO:tasks.workunit.client.0.smithi099.stdout:1/792: sync 2024-09-19T06:40:48.998 INFO:tasks.workunit.client.0.smithi099.stdout:4/815: sync 2024-09-19T06:40:48.998 INFO:tasks.workunit.client.1.smithi117.stdout:0/995: mknod d11/d13/d28/d38/c14d 0 2024-09-19T06:40:49.001 INFO:tasks.workunit.client.1.smithi117.stdout:6/909: dwrite d1/d5/d8/f5d [0,4194304] 0 2024-09-19T06:40:49.002 INFO:tasks.workunit.client.0.smithi099.stdout:0/777: truncate d0/db/d27/fb7 110592 0 2024-09-19T06:40:49.003 INFO:tasks.workunit.client.0.smithi099.stdout:2/652: dread d1/d2/d4d/d55/da5/d36/f53 [0,4194304] 0 2024-09-19T06:40:49.004 INFO:tasks.workunit.client.0.smithi099.stdout:4/816: unlink d12/d82/ddd/d8a/da9/cdc 0 2024-09-19T06:40:49.004 INFO:tasks.workunit.client.1.smithi117.stdout:0/996: symlink d11/d13/d14/dbd/d10d/d109/l14e 0 2024-09-19T06:40:49.006 INFO:tasks.workunit.client.1.smithi117.stdout:0/997: mknod d11/d13/d1b/d27/d138/c14f 0 2024-09-19T06:40:49.007 INFO:tasks.workunit.client.0.smithi099.stdout:8/796: truncate d4/d11/f21 344244 0 2024-09-19T06:40:49.009 INFO:tasks.workunit.client.0.smithi099.stdout:0/778: truncate d0/db/d27/d5d/d87/da2/dbc/d37/d3c/fde 1399517 0 2024-09-19T06:40:49.009 INFO:tasks.workunit.client.1.smithi117.stdout:6/910: dwrite d1/d5/d8/d80/fac [0,4194304] 0 2024-09-19T06:40:49.011 INFO:tasks.workunit.client.1.smithi117.stdout:0/998: creat d11/d13/d14/d2c/f150 x:0 0 0 2024-09-19T06:40:49.012 INFO:tasks.workunit.client.0.smithi099.stdout:8/797: chown d4/d11/d38/fcd 1326 1 2024-09-19T06:40:49.012 INFO:tasks.workunit.client.0.smithi099.stdout:4/817: fsync d12/d32/f48 0 2024-09-19T06:40:49.013 INFO:tasks.workunit.client.1.smithi117.stdout:6/911: mkdir d1/d5/d85/d116 0 2024-09-19T06:40:49.013 INFO:tasks.workunit.client.0.smithi099.stdout:8/798: chown d4/de/d26/d2b/f82 4009647 1 2024-09-19T06:40:49.014 INFO:tasks.workunit.client.1.smithi117.stdout:6/912: read d1/d3/f76 [405832,46577] 0 2024-09-19T06:40:49.018 INFO:tasks.workunit.client.1.smithi117.stdout:6/913: fsync d1/d14/f94 0 2024-09-19T06:40:49.019 INFO:tasks.workunit.client.1.smithi117.stdout:6/914: fsync d1/d5/d8/d27/d77/da8/ff0 0 2024-09-19T06:40:49.020 INFO:tasks.workunit.client.0.smithi099.stdout:4/818: mknod d12/d82/ddd/d9b/dab/dbf/c10d 0 2024-09-19T06:40:49.021 INFO:tasks.workunit.client.1.smithi117.stdout:0/999: getdents d11/d13/d1b/d27 0 2024-09-19T06:40:49.022 INFO:tasks.workunit.client.0.smithi099.stdout:9/922: dread dd/d47/d40/f56 [0,4194304] 0 2024-09-19T06:40:49.023 INFO:tasks.workunit.client.0.smithi099.stdout:1/793: dwrite d0/d17/d24/d3a/f81 [0,4194304] 0 2024-09-19T06:40:49.025 INFO:tasks.workunit.client.1.smithi117.stdout:6/915: link d1/d5/d32/d45/f53 d1/d5/d8/d80/f117 0 2024-09-19T06:40:49.027 INFO:tasks.workunit.client.1.smithi117.stdout:6/916: write d1/d14/f23 [1489454,49022] 0 2024-09-19T06:40:49.027 INFO:tasks.workunit.client.0.smithi099.stdout:4/819: creat d12/d58/f10e x:0 0 0 2024-09-19T06:40:49.030 INFO:tasks.workunit.client.0.smithi099.stdout:0/779: dwrite d0/f1b [0,4194304] 0 2024-09-19T06:40:49.031 INFO:tasks.workunit.client.0.smithi099.stdout:0/780: stat d0/d17/d41/f89 0 2024-09-19T06:40:49.033 INFO:tasks.workunit.client.0.smithi099.stdout:4/820: unlink d12/d82/ddd/d8a/da9/d101/f10a 0 2024-09-19T06:40:49.034 INFO:tasks.workunit.client.0.smithi099.stdout:4/821: write d12/d32/d39/f106 [318559,74098] 0 2024-09-19T06:40:49.037 INFO:tasks.workunit.client.0.smithi099.stdout:4/822: read - d12/d82/ddd/d9b/ffe zero size 2024-09-19T06:40:49.037 INFO:tasks.workunit.client.1.smithi117.stdout:6/917: dwrite d1/d5/d8/d5e/d67/d98/fb8 [0,4194304] 0 2024-09-19T06:40:49.037 INFO:tasks.workunit.client.0.smithi099.stdout:5/954: dread d3/d16/d2f/d34/da4/f88 [0,4194304] 0 2024-09-19T06:40:49.038 INFO:tasks.workunit.client.1.smithi117.stdout:6/918: chown d1/d5/d8/d80 208537146 1 2024-09-19T06:40:49.039 INFO:tasks.workunit.client.0.smithi099.stdout:4/823: write d12/ff6 [313583,59334] 0 2024-09-19T06:40:49.040 INFO:tasks.workunit.client.0.smithi099.stdout:0/781: rename d0/db/d27/d5d/d87/da2/dbc/d1f/d99 to d0/db/d27/d5d/d87/da2/dbc/d37/df2 0 2024-09-19T06:40:49.042 INFO:tasks.workunit.client.1.smithi117.stdout:6/919: creat d1/d5/d8/d27/d77/d101/f118 x:0 0 0 2024-09-19T06:40:49.047 INFO:tasks.workunit.client.0.smithi099.stdout:0/782: creat d0/db/d27/d5d/d87/da2/dbc/d1f/d4a/d61/ff3 x:0 0 0 2024-09-19T06:40:49.050 INFO:tasks.workunit.client.0.smithi099.stdout:0/783: truncate d0/db/d27/d5d/d87/f88 5141549 0 2024-09-19T06:40:49.051 INFO:tasks.workunit.client.0.smithi099.stdout:1/794: dwrite d0/d12/d13/d37/d48/f7c [0,4194304] 0 2024-09-19T06:40:49.053 INFO:tasks.workunit.client.0.smithi099.stdout:1/795: fdatasync d0/d12/d13/d37/d41/d78/feb 0 2024-09-19T06:40:49.054 INFO:tasks.workunit.client.0.smithi099.stdout:8/799: dread d4/d11/fbf [0,4194304] 0 2024-09-19T06:40:49.061 INFO:tasks.workunit.client.0.smithi099.stdout:2/653: dread d1/d2/d4d/d55/da5/d9/f6f [4194304,4194304] 0 2024-09-19T06:40:49.061 INFO:tasks.workunit.client.0.smithi099.stdout:4/824: mknod d12/c10f 0 2024-09-19T06:40:49.065 INFO:tasks.workunit.client.0.smithi099.stdout:8/800: chown d4/d11/l5d 121865256 1 2024-09-19T06:40:49.065 INFO:tasks.workunit.client.0.smithi099.stdout:2/654: unlink d1/d2/d4d/d55/da5/d18/d27/fcb 0 2024-09-19T06:40:49.066 INFO:tasks.workunit.client.0.smithi099.stdout:5/955: rename d3/d16/d2f/d34/d3c/d65/f81 to d3/d137/f149 0 2024-09-19T06:40:49.099 INFO:tasks.workunit.client.0.smithi099.stdout:6/766: sync 2024-09-19T06:40:49.105 INFO:tasks.workunit.client.0.smithi099.stdout:8/801: mkdir d4/de/d10/d10b 0 2024-09-19T06:40:49.105 INFO:tasks.workunit.client.0.smithi099.stdout:0/784: creat d0/db/d27/d5d/d87/da2/dbc/d37/ff4 x:0 0 0 2024-09-19T06:40:49.106 INFO:tasks.workunit.client.0.smithi099.stdout:5/956: readlink d3/d16/d2f/dd1/lb9 0 2024-09-19T06:40:49.108 INFO:tasks.workunit.client.0.smithi099.stdout:5/957: fdatasync d3/d16/d5e/db1/f11a 0 2024-09-19T06:40:49.150 INFO:tasks.workunit.client.0.smithi099.stdout:8/802: rename d4/de/d1c/fef to d4/d11/d23/d3f/d105/f10c 0 2024-09-19T06:40:49.150 INFO:tasks.workunit.client.0.smithi099.stdout:4/825: dread d12/f50 [0,4194304] 0 2024-09-19T06:40:49.150 INFO:tasks.workunit.client.0.smithi099.stdout:0/785: stat d0/db/d27/d5d/d87/da2/dbc/d47/d75/da4/dcf 0 2024-09-19T06:40:49.152 INFO:tasks.workunit.client.0.smithi099.stdout:4/826: chown d12/d82/ddd/d8a/da9/dfc/d102 30 1 2024-09-19T06:40:49.153 INFO:tasks.workunit.client.0.smithi099.stdout:5/958: rename d3/d7/f64 to d3/d16/d2f/d34/dfa/f14a 0 2024-09-19T06:40:49.153 INFO:tasks.workunit.client.0.smithi099.stdout:0/786: chown d0/db/d27/d5d/d87/da2/dbc/d37/df2/cad 22881 1 2024-09-19T06:40:49.154 INFO:tasks.workunit.client.0.smithi099.stdout:2/655: dwrite d1/d2/d4d/d55/da5/d36/f8a [0,4194304] 0 2024-09-19T06:40:49.155 INFO:tasks.workunit.client.0.smithi099.stdout:4/827: mkdir d12/d32/d42/d80/d110 0 2024-09-19T06:40:49.157 INFO:tasks.workunit.client.0.smithi099.stdout:4/828: mkdir d12/d82/d111 0 2024-09-19T06:40:49.158 INFO:tasks.workunit.client.0.smithi099.stdout:0/787: creat d0/db/d27/d5d/d87/da2/dbc/d37/d3c/d3e/dd1/ff5 x:0 0 0 2024-09-19T06:40:49.160 INFO:tasks.workunit.client.0.smithi099.stdout:5/959: dread d3/d14/f11c [0,4194304] 0 2024-09-19T06:40:49.162 INFO:tasks.workunit.client.0.smithi099.stdout:4/829: rename d12/d32/d42/d5c/d9d/caa to d12/d82/ddd/d8a/da9/d101/c112 0 2024-09-19T06:40:49.164 INFO:tasks.workunit.client.0.smithi099.stdout:2/656: truncate d1/d2/d4d/d55/da5/d9/d63/dc6/f40 1898562 0 2024-09-19T06:40:49.164 INFO:tasks.workunit.client.0.smithi099.stdout:5/960: fdatasync d3/d16/d2f/f75 0 2024-09-19T06:40:49.165 INFO:tasks.workunit.client.0.smithi099.stdout:4/830: unlink d12/d32/f29 0 2024-09-19T06:40:49.166 INFO:tasks.workunit.client.0.smithi099.stdout:5/961: write d3/d16/d2f/d34/da4/f88 [4278983,90547] 0 2024-09-19T06:40:49.166 INFO:tasks.workunit.client.0.smithi099.stdout:0/788: mknod d0/db/d27/d5d/d87/da2/dbc/d1f/d8e/cf6 0 2024-09-19T06:40:49.167 INFO:tasks.workunit.client.0.smithi099.stdout:2/657: mkdir d1/d2/d4d/d55/da5/d18/d27/ddd 0 2024-09-19T06:40:49.168 INFO:tasks.workunit.client.0.smithi099.stdout:0/789: write d0/db/d36/d3f/fa1 [627106,85504] 0 2024-09-19T06:40:49.169 INFO:tasks.workunit.client.0.smithi099.stdout:4/831: rename d12/d32/d42/d80/cda to d12/d82/ddd/d89/d91/c113 0 2024-09-19T06:40:49.172 INFO:tasks.workunit.client.0.smithi099.stdout:4/832: mkdir d12/d1b/d88/d114 0 2024-09-19T06:40:49.173 INFO:tasks.workunit.client.0.smithi099.stdout:4/833: write d12/d58/f10e [204415,80382] 0 2024-09-19T06:40:49.174 INFO:tasks.workunit.client.0.smithi099.stdout:4/834: stat d12/d32/d39/l53 0 2024-09-19T06:40:49.175 INFO:tasks.workunit.client.1.smithi117.stdout:6/920: sync 2024-09-19T06:40:49.175 INFO:tasks.workunit.client.0.smithi099.stdout:5/962: dread d3/d16/d2f/d34/da4/da5/dce/de5/d139/f115 [0,4194304] 0 2024-09-19T06:40:49.176 INFO:tasks.workunit.client.0.smithi099.stdout:9/923: sync 2024-09-19T06:40:49.177 INFO:tasks.workunit.client.0.smithi099.stdout:2/658: creat d1/d2/fde x:0 0 0 2024-09-19T06:40:49.177 INFO:tasks.workunit.client.1.smithi117.stdout:6/921: mkdir d1/d5/d8/d5e/d119 0 2024-09-19T06:40:49.179 INFO:tasks.workunit.client.0.smithi099.stdout:0/790: getdents d0/db/d27/d5d/d87/da2/dbc/d47/d75/da4 0 2024-09-19T06:40:49.180 INFO:tasks.workunit.client.1.smithi117.stdout:6/922: creat d1/d5/d85/d116/f11a x:0 0 0 2024-09-19T06:40:49.180 INFO:tasks.workunit.client.0.smithi099.stdout:4/835: mkdir d12/d115 0 2024-09-19T06:40:49.181 INFO:tasks.workunit.client.1.smithi117.stdout:6/923: creat d1/d3d/d6f/f11b x:0 0 0 2024-09-19T06:40:49.183 INFO:tasks.workunit.client.1.smithi117.stdout:6/924: creat d1/d14/dd5/f11c x:0 0 0 2024-09-19T06:40:49.183 INFO:tasks.workunit.client.0.smithi099.stdout:0/791: rename d0/db/d2f/fc9 to d0/db/dd5/ff7 0 2024-09-19T06:40:49.184 INFO:tasks.workunit.client.1.smithi117.stdout:6/925: chown d1/d3d/ca6 1920 1 2024-09-19T06:40:49.186 INFO:tasks.workunit.client.1.smithi117.stdout:6/926: link d1/d5/d8/d27/d77/da8/ff0 d1/d5/d32/d45/f11d 0 2024-09-19T06:40:49.187 INFO:tasks.workunit.client.1.smithi117.stdout:6/927: chown d1/d5/d8/d80/fac 85 1 2024-09-19T06:40:49.188 INFO:tasks.workunit.client.1.smithi117.stdout:6/928: fsync d1/d5/d8/d5e/d6d/f79 0 2024-09-19T06:40:49.190 INFO:tasks.workunit.client.0.smithi099.stdout:5/963: getdents d3/d7 0 2024-09-19T06:40:49.191 INFO:tasks.workunit.client.0.smithi099.stdout:4/836: creat d12/f116 x:0 0 0 2024-09-19T06:40:49.192 INFO:tasks.workunit.client.1.smithi117.stdout:6/929: link d1/d5/d32/f6b d1/d5/d9a/f11e 0 2024-09-19T06:40:49.192 INFO:tasks.workunit.client.1.smithi117.stdout:6/930: read - d1/d3d/d6f/f11b zero size 2024-09-19T06:40:49.193 INFO:tasks.workunit.client.0.smithi099.stdout:9/924: link dd/d65/da3/fa6 dd/d2c/f12f 0 2024-09-19T06:40:49.193 INFO:tasks.workunit.client.0.smithi099.stdout:4/837: read d12/f38 [3285863,39135] 0 2024-09-19T06:40:49.193 INFO:tasks.workunit.client.0.smithi099.stdout:4/838: stat d12/d32/f3e 0 2024-09-19T06:40:49.193 INFO:tasks.workunit.client.0.smithi099.stdout:2/659: truncate d1/d2/d4d/d55/da5/d36/f41 4022516 0 2024-09-19T06:40:49.194 INFO:tasks.workunit.client.0.smithi099.stdout:5/964: write d3/d16/d2f/d34/da4/da5/dce/de5/d139/f115 [802168,113970] 0 2024-09-19T06:40:49.196 INFO:tasks.workunit.client.0.smithi099.stdout:4/839: fdatasync f10 0 2024-09-19T06:40:49.199 INFO:tasks.workunit.client.1.smithi117.stdout:6/931: dwrite d1/d5/d8/d5e/d67/d98/ddd/f10e [0,4194304] 0 2024-09-19T06:40:49.199 INFO:tasks.workunit.client.0.smithi099.stdout:9/925: symlink dd/d2c/d5c/d85/d12b/l130 0 2024-09-19T06:40:49.200 INFO:tasks.workunit.client.0.smithi099.stdout:0/792: dwrite d0/db/d27/d5d/d87/da2/dbc/d1f/d39/f54 [0,4194304] 0 2024-09-19T06:40:49.201 INFO:tasks.workunit.client.0.smithi099.stdout:5/965: mknod d3/d16/d2f/dd1/c14b 0 2024-09-19T06:40:49.201 INFO:tasks.workunit.client.1.smithi117.stdout:6/932: fsync d1/d3/f76 0 2024-09-19T06:40:49.202 INFO:tasks.workunit.client.1.smithi117.stdout:6/933: readlink d1/d14/l5f 0 2024-09-19T06:40:49.204 INFO:tasks.workunit.client.1.smithi117.stdout:6/934: symlink d1/d5/d32/d45/d7b/l11f 0 2024-09-19T06:40:49.210 INFO:tasks.workunit.client.1.smithi117.stdout:6/935: mknod d1/d5/d8/d5e/c120 0 2024-09-19T06:40:49.211 INFO:tasks.workunit.client.0.smithi099.stdout:0/793: creat d0/db/d2f/ff8 x:0 0 0 2024-09-19T06:40:49.211 INFO:tasks.workunit.client.0.smithi099.stdout:4/840: mkdir d12/d32/d42/d5c/d117 0 2024-09-19T06:40:49.213 INFO:tasks.workunit.client.1.smithi117.stdout:6/936: chown d1/d5/d8/db0/lc6 1667670 1 2024-09-19T06:40:49.213 INFO:tasks.workunit.client.0.smithi099.stdout:2/660: dwrite d1/d2/d4d/d55/d79/fa1 [0,4194304] 0 2024-09-19T06:40:49.216 INFO:tasks.workunit.client.0.smithi099.stdout:0/794: write d0/db/d27/d5d/d87/da2/dbc/d47/d75/da4/dcf/fd9 [742594,113765] 0 2024-09-19T06:40:49.219 INFO:tasks.workunit.client.0.smithi099.stdout:4/841: dwrite d12/d32/f72 [0,4194304] 0 2024-09-19T06:40:49.221 INFO:tasks.workunit.client.0.smithi099.stdout:0/795: creat d0/db/d27/d5d/d87/da2/dbc/ff9 x:0 0 0 2024-09-19T06:40:49.223 INFO:tasks.workunit.client.0.smithi099.stdout:4/842: mkdir d12/d82/ddd/d8a/da9/d118 0 2024-09-19T06:40:49.223 INFO:tasks.workunit.client.1.smithi117.stdout:6/937: dwrite d1/d3/f76 [0,4194304] 0 2024-09-19T06:40:49.224 INFO:tasks.workunit.client.0.smithi099.stdout:4/843: read - d12/d82/ddd/d9b/dab/fee zero size 2024-09-19T06:40:49.227 INFO:tasks.workunit.client.0.smithi099.stdout:5/966: write d3/d16/d2f/d34/d3c/fc8 [1959804,69908] 0 2024-09-19T06:40:49.229 INFO:tasks.workunit.client.1.smithi117.stdout:6/938: creat d1/d5/d8/db0/f121 x:0 0 0 2024-09-19T06:40:49.230 INFO:tasks.workunit.client.0.smithi099.stdout:4/844: symlink d12/d82/ddd/d8a/da9/d118/l119 0 2024-09-19T06:40:49.231 INFO:tasks.workunit.client.0.smithi099.stdout:9/926: dwrite dd/d47/f5f [0,4194304] 0 2024-09-19T06:40:49.232 INFO:tasks.workunit.client.0.smithi099.stdout:4/845: write d12/fe5 [320009,123676] 0 2024-09-19T06:40:49.232 INFO:tasks.workunit.client.0.smithi099.stdout:5/967: rename d3/d16/d2f/fcf to d3/d16/d5e/db1/d106/f14c 0 2024-09-19T06:40:49.233 INFO:tasks.workunit.client.1.smithi117.stdout:6/939: rename d1/d14/c29 to d1/d5/d8/d5e/d67/d98/da1/c122 0 2024-09-19T06:40:49.235 INFO:tasks.workunit.client.0.smithi099.stdout:9/927: creat dd/d2c/d5c/d85/dfc/f131 x:0 0 0 2024-09-19T06:40:49.236 INFO:tasks.workunit.client.1.smithi117.stdout:6/940: symlink d1/d5/d8/d5e/d67/d98/da1/d108/l123 0 2024-09-19T06:40:49.237 INFO:tasks.workunit.client.0.smithi099.stdout:4/846: unlink d12/f30 0 2024-09-19T06:40:49.238 INFO:tasks.workunit.client.0.smithi099.stdout:4/847: chown d12/d1b/da4 4 1 2024-09-19T06:40:49.238 INFO:tasks.workunit.client.0.smithi099.stdout:9/928: truncate dd/d2c/d5c/d64/d93/f108 473356 0 2024-09-19T06:40:49.244 INFO:tasks.workunit.client.0.smithi099.stdout:2/661: dwrite d1/d2/f90 [0,4194304] 0 2024-09-19T06:40:49.244 INFO:tasks.workunit.client.0.smithi099.stdout:4/848: dread d12/d82/ddd/d9b/da2/fd5 [0,4194304] 0 2024-09-19T06:40:49.247 INFO:tasks.workunit.client.0.smithi099.stdout:0/796: symlink d0/db/d27/d5d/d87/da2/dbc/d1f/d8e/lfa 0 2024-09-19T06:40:49.248 INFO:tasks.workunit.client.0.smithi099.stdout:0/797: read d0/f1b [1811672,84107] 0 2024-09-19T06:40:49.249 INFO:tasks.workunit.client.0.smithi099.stdout:2/662: unlink d1/d2/f64 0 2024-09-19T06:40:49.251 INFO:tasks.workunit.client.0.smithi099.stdout:4/849: dread d12/ff6 [0,4194304] 0 2024-09-19T06:40:49.251 INFO:tasks.workunit.client.0.smithi099.stdout:0/798: symlink d0/db/d27/d5d/d87/da2/dbc/d1f/d3a/lfb 0 2024-09-19T06:40:49.255 INFO:tasks.workunit.client.0.smithi099.stdout:5/968: dread d3/d16/d2f/d8c/fcc [0,4194304] 0 2024-09-19T06:40:49.256 INFO:tasks.workunit.client.0.smithi099.stdout:0/799: symlink d0/db/d27/d5d/d87/da2/dbc/d1f/d8e/lfc 0 2024-09-19T06:40:49.256 INFO:tasks.workunit.client.0.smithi099.stdout:5/969: chown d3/d7/fb 3 1 2024-09-19T06:40:49.257 INFO:tasks.workunit.client.0.smithi099.stdout:4/850: link d12/d82/ddd/d9b/da2/lc3 d12/d32/d42/d5c/d51/de8/l11a 0 2024-09-19T06:40:49.257 INFO:tasks.workunit.client.0.smithi099.stdout:5/970: rmdir d3/d14/d114 39 2024-09-19T06:40:49.258 INFO:tasks.workunit.client.0.smithi099.stdout:0/800: creat d0/db/d27/d5d/d87/da2/dbc/d1f/d4a/d61/ffd x:0 0 0 2024-09-19T06:40:49.258 INFO:tasks.workunit.client.0.smithi099.stdout:4/851: rmdir d12/d82/ddd/d8a/de9 39 2024-09-19T06:40:49.259 INFO:tasks.workunit.client.0.smithi099.stdout:4/852: chown d12/d32/d42/d5c/d9d 989 1 2024-09-19T06:40:49.259 INFO:tasks.workunit.client.0.smithi099.stdout:0/801: readlink d0/db/d27/d5d/d87/da2/dbc/d1f/d39/l78 0 2024-09-19T06:40:49.260 INFO:tasks.workunit.client.0.smithi099.stdout:4/853: dread - d12/fb5 zero size 2024-09-19T06:40:49.265 INFO:tasks.workunit.client.0.smithi099.stdout:0/802: dread - d0/db/d27/d5d/d87/da2/dbc/d1f/d4a/d61/ffd zero size 2024-09-19T06:40:49.265 INFO:tasks.workunit.client.0.smithi099.stdout:4/854: read d12/d82/ddd/d9b/ff4 [867080,86732] 0 2024-09-19T06:40:49.265 INFO:tasks.workunit.client.0.smithi099.stdout:4/855: rmdir d12/d1b 39 2024-09-19T06:40:49.266 INFO:tasks.workunit.client.0.smithi099.stdout:4/856: creat d12/d82/ddd/d8a/da9/dc7/f11b x:0 0 0 2024-09-19T06:40:49.270 INFO:tasks.workunit.client.0.smithi099.stdout:4/857: symlink d12/d32/d42/d5c/d51/de8/l11c 0 2024-09-19T06:40:49.274 INFO:tasks.workunit.client.0.smithi099.stdout:4/858: chown d12/d82/ddd/d89/l108 4 1 2024-09-19T06:40:49.275 INFO:tasks.workunit.client.0.smithi099.stdout:9/929: dwrite dd/d2c/d5c/d85/fc7 [0,4194304] 0 2024-09-19T06:40:49.277 INFO:tasks.workunit.client.0.smithi099.stdout:9/930: stat dd/dc9 0 2024-09-19T06:40:49.277 INFO:tasks.workunit.client.0.smithi099.stdout:2/663: dwrite d1/d2/d4d/d55/da5/d9/d63/dc6/d77/d98/fb1 [0,4194304] 0 2024-09-19T06:40:49.278 INFO:tasks.workunit.client.0.smithi099.stdout:5/971: dread d3/d16/f30 [0,4194304] 0 2024-09-19T06:40:49.279 INFO:tasks.workunit.client.0.smithi099.stdout:0/803: dread d0/db/d36/f5f [4194304,4194304] 0 2024-09-19T06:40:49.279 INFO:tasks.workunit.client.0.smithi099.stdout:9/931: write dd/d65/f75 [1950934,80327] 0 2024-09-19T06:40:49.284 INFO:tasks.workunit.client.0.smithi099.stdout:2/664: getdents d1/d2/dad 0 2024-09-19T06:40:49.285 INFO:tasks.workunit.client.0.smithi099.stdout:5/972: creat d3/f14d x:0 0 0 2024-09-19T06:40:49.285 INFO:tasks.workunit.client.0.smithi099.stdout:4/859: dread d12/d32/f72 [0,4194304] 0 2024-09-19T06:40:49.286 INFO:tasks.workunit.client.0.smithi099.stdout:5/973: chown d3/d7/d90/dd2/d128 12771 1 2024-09-19T06:40:49.287 INFO:tasks.workunit.client.0.smithi099.stdout:9/932: unlink dd/dc9/df5/df9/c121 0 2024-09-19T06:40:49.288 INFO:tasks.workunit.client.0.smithi099.stdout:2/665: symlink d1/d2/d4d/d55/d79/ldf 0 2024-09-19T06:40:49.290 INFO:tasks.workunit.client.0.smithi099.stdout:0/804: creat d0/db/d27/d5d/d87/da2/dbc/d37/d3c/d3e/ffe x:0 0 0 2024-09-19T06:40:49.295 INFO:tasks.workunit.client.0.smithi099.stdout:9/933: dread dd/d2c/d79/db4/f124 [0,4194304] 0 2024-09-19T06:40:49.296 INFO:tasks.workunit.client.0.smithi099.stdout:4/860: getdents d12/d1b/d88 0 2024-09-19T06:40:49.297 INFO:tasks.workunit.client.0.smithi099.stdout:2/666: dwrite d1/f15 [0,4194304] 0 2024-09-19T06:40:49.297 INFO:tasks.workunit.client.0.smithi099.stdout:9/934: stat dd/d2c/d5c/d64/d93/f12e 0 2024-09-19T06:40:49.297 INFO:tasks.workunit.client.0.smithi099.stdout:0/805: getdents d0/db/d27/d5d/d87/da2/dbc/d1f/d4a 0 2024-09-19T06:40:49.298 INFO:tasks.workunit.client.0.smithi099.stdout:9/935: chown dd/d2c/f5a 99583 1 2024-09-19T06:40:49.301 INFO:tasks.workunit.client.0.smithi099.stdout:2/667: mkdir d1/d2/d4d/d55/da5/d9/d63/dc6/d77/d98/de0 0 2024-09-19T06:40:49.301 INFO:tasks.workunit.client.0.smithi099.stdout:9/936: truncate dd/d47/dc1/fcd 619563 0 2024-09-19T06:40:49.302 INFO:tasks.workunit.client.0.smithi099.stdout:2/668: dread - d1/faa zero size 2024-09-19T06:40:49.302 INFO:tasks.workunit.client.0.smithi099.stdout:1/796: sync 2024-09-19T06:40:49.304 INFO:tasks.workunit.client.0.smithi099.stdout:9/937: write dd/d62/d76/d9a/fdd [79629,44239] 0 2024-09-19T06:40:49.309 INFO:tasks.workunit.client.0.smithi099.stdout:0/806: truncate d0/db/d2f/fc3 2159125 0 2024-09-19T06:40:49.310 INFO:tasks.workunit.client.0.smithi099.stdout:5/974: dwrite d3/d16/d2f/d34/da4/da5/dce/f105 [0,4194304] 0 2024-09-19T06:40:49.310 INFO:tasks.workunit.client.0.smithi099.stdout:9/938: truncate dd/d2c/f5a 2825059 0 2024-09-19T06:40:49.312 INFO:tasks.workunit.client.0.smithi099.stdout:9/939: chown dd/d47/d40/f11 59228578 1 2024-09-19T06:40:49.313 INFO:tasks.workunit.client.0.smithi099.stdout:1/797: getdents d0/d17/d24 0 2024-09-19T06:40:49.314 INFO:tasks.workunit.client.0.smithi099.stdout:2/669: getdents d1/d2/d4d/d8e 0 2024-09-19T06:40:49.315 INFO:tasks.workunit.client.0.smithi099.stdout:5/975: chown d3/d16/d2f/d34/d3c/f12c 13797 1 2024-09-19T06:40:49.315 INFO:tasks.workunit.client.0.smithi099.stdout:4/861: dread f10 [0,4194304] 0 2024-09-19T06:40:49.315 INFO:tasks.workunit.client.0.smithi099.stdout:0/807: rmdir d0/db/d27/d5d/d87/da2/dbc/d1f/db4 39 2024-09-19T06:40:49.316 INFO:tasks.workunit.client.0.smithi099.stdout:4/862: chown f11 248 1 2024-09-19T06:40:49.317 INFO:tasks.workunit.client.0.smithi099.stdout:8/803: sync 2024-09-19T06:40:49.317 INFO:tasks.workunit.client.0.smithi099.stdout:6/767: sync 2024-09-19T06:40:49.320 INFO:tasks.workunit.client.0.smithi099.stdout:1/798: symlink d0/d17/d24/l105 0 2024-09-19T06:40:49.323 INFO:tasks.workunit.client.0.smithi099.stdout:2/670: creat d1/d2/d4d/d55/da5/d18/d27/fe1 x:0 0 0 2024-09-19T06:40:49.324 INFO:tasks.workunit.client.0.smithi099.stdout:4/863: symlink d12/d32/d42/d5c/d51/de8/l11d 0 2024-09-19T06:40:49.326 INFO:tasks.workunit.client.0.smithi099.stdout:5/976: creat d3/d16/d2f/d34/d3c/d13e/f14e x:0 0 0 2024-09-19T06:40:49.327 INFO:tasks.workunit.client.0.smithi099.stdout:8/804: dread d4/de/fb7 [0,4194304] 0 2024-09-19T06:40:49.328 INFO:tasks.workunit.client.0.smithi099.stdout:6/768: symlink d1/d5/d24/d2e/d41/lfd 0 2024-09-19T06:40:49.329 INFO:tasks.workunit.client.0.smithi099.stdout:9/940: creat dd/d2c/d5c/d64/d93/f132 x:0 0 0 2024-09-19T06:40:49.329 INFO:tasks.workunit.client.0.smithi099.stdout:8/805: chown d4/d11/d23/d92/lab 395509 1 2024-09-19T06:40:49.329 INFO:tasks.workunit.client.0.smithi099.stdout:6/769: dread - d1/d5/d24/f85 zero size 2024-09-19T06:40:49.330 INFO:tasks.workunit.client.0.smithi099.stdout:2/671: dwrite d1/d2/d4d/d55/da5/d9/f3c [0,4194304] 0 2024-09-19T06:40:49.331 INFO:tasks.workunit.client.0.smithi099.stdout:4/864: link d12/d32/d42/d5c/c1e d12/d82/ddd/d89/c11e 0 2024-09-19T06:40:49.332 INFO:tasks.workunit.client.0.smithi099.stdout:9/941: creat dd/d2c/d5c/ddb/f133 x:0 0 0 2024-09-19T06:40:49.334 INFO:tasks.workunit.client.0.smithi099.stdout:8/806: creat d4/d11/d61/dee/dde/f10d x:0 0 0 2024-09-19T06:40:49.335 INFO:tasks.workunit.client.0.smithi099.stdout:6/770: mkdir d1/d5/d24/d2e/d41/d81/dfe 0 2024-09-19T06:40:49.339 INFO:tasks.workunit.client.0.smithi099.stdout:1/799: chown d0/d17/d24/f6e 0 1 2024-09-19T06:40:49.342 INFO:tasks.workunit.client.0.smithi099.stdout:5/977: write d3/d16/f30 [3020109,18158] 0 2024-09-19T06:40:49.343 INFO:tasks.workunit.client.1.smithi117.stdout:6/941: sync 2024-09-19T06:40:49.344 INFO:tasks.workunit.client.1.smithi117.stdout:6/942: read d1/d14/fd6 [2177024,35280] 0 2024-09-19T06:40:49.348 INFO:tasks.workunit.client.0.smithi099.stdout:2/672: dwrite d1/fa9 [0,4194304] 0 2024-09-19T06:40:49.349 INFO:tasks.workunit.client.1.smithi117.stdout:6/943: creat d1/f124 x:0 0 0 2024-09-19T06:40:49.351 INFO:tasks.workunit.client.0.smithi099.stdout:1/800: mknod d0/d17/d24/c106 0 2024-09-19T06:40:49.352 INFO:tasks.workunit.client.0.smithi099.stdout:5/978: chown d3/d16/d2f/d34/da4/da5/c107 10 1 2024-09-19T06:40:49.352 INFO:tasks.workunit.client.0.smithi099.stdout:0/808: dwrite d0/d17/f84 [0,4194304] 0 2024-09-19T06:40:49.352 INFO:tasks.workunit.client.0.smithi099.stdout:9/942: write dd/d62/d78/fad [793368,100423] 0 2024-09-19T06:40:49.357 INFO:tasks.workunit.client.0.smithi099.stdout:8/807: dwrite d4/d11/d23/d92/fd4 [0,4194304] 0 2024-09-19T06:40:49.360 INFO:tasks.workunit.client.0.smithi099.stdout:4/865: dwrite d12/d32/f72 [0,4194304] 0 2024-09-19T06:40:49.361 INFO:tasks.workunit.client.0.smithi099.stdout:0/809: write d0/db/d27/d5d/d87/da2/dbc/d1f/d4a/fb8 [2010268,113612] 0 2024-09-19T06:40:49.367 INFO:tasks.workunit.client.0.smithi099.stdout:9/943: rename dd/d47/d68/f9c to dd/d2c/dd9/f134 0 2024-09-19T06:40:49.371 INFO:tasks.workunit.client.0.smithi099.stdout:6/771: dwrite d1/d5/d24/d2b/f45 [0,4194304] 0 2024-09-19T06:40:49.371 INFO:tasks.workunit.client.0.smithi099.stdout:0/810: fdatasync d0/db/f48 0 2024-09-19T06:40:49.371 INFO:tasks.workunit.client.0.smithi099.stdout:2/673: getdents d1/d2/d4d/d55/da5/d18/d27/d5b/d92 0 2024-09-19T06:40:49.373 INFO:tasks.workunit.client.0.smithi099.stdout:9/944: write dd/dc9/ff2 [649197,28516] 0 2024-09-19T06:40:49.378 INFO:tasks.workunit.client.0.smithi099.stdout:2/674: write d1/f4f [418787,49213] 0 2024-09-19T06:40:49.380 INFO:tasks.workunit.client.0.smithi099.stdout:0/811: truncate d0/db/d2f/f9d 335444 0 2024-09-19T06:40:49.381 INFO:tasks.workunit.client.0.smithi099.stdout:8/808: write d4/d66/f76 [2866384,41361] 0 2024-09-19T06:40:49.381 INFO:tasks.workunit.client.0.smithi099.stdout:4/866: dwrite d12/d82/ddd/d89/de4/ff7 [0,4194304] 0 2024-09-19T06:40:49.383 INFO:tasks.workunit.client.0.smithi099.stdout:9/945: mkdir dd/d2c/d5c/d64/d93/dfa/d105/deb/d135 0 2024-09-19T06:40:49.386 INFO:tasks.workunit.client.0.smithi099.stdout:0/812: symlink d0/d17/d41/lff 0 2024-09-19T06:40:49.386 INFO:tasks.workunit.client.0.smithi099.stdout:5/979: dwrite d3/f37 [4194304,4194304] 0 2024-09-19T06:40:49.388 INFO:tasks.workunit.client.0.smithi099.stdout:2/675: mknod d1/d2/d4d/d55/da5/d18/d46/d65/ce2 0 2024-09-19T06:40:49.389 INFO:tasks.workunit.client.0.smithi099.stdout:6/772: dwrite d1/d5/f33 [0,4194304] 0 2024-09-19T06:40:49.389 INFO:tasks.workunit.client.0.smithi099.stdout:5/980: chown d3/d16/d2f/d34/d3c 219 1 2024-09-19T06:40:49.394 INFO:tasks.workunit.client.0.smithi099.stdout:5/981: dread - d3/d16/d2f/d34/d3c/de1/f124 zero size 2024-09-19T06:40:49.395 INFO:tasks.workunit.client.0.smithi099.stdout:0/813: readlink d0/db/d27/d5d/d87/da2/dbc/l16 0 2024-09-19T06:40:49.395 INFO:tasks.workunit.client.0.smithi099.stdout:6/773: mkdir d1/d5/d24/d2b/d86/da5/dff 0 2024-09-19T06:40:49.398 INFO:tasks.workunit.client.0.smithi099.stdout:2/676: rename d1/d2/d4d/d55/d79 to d1/d2/d4d/d55/da5/d18/d2d/de3 0 2024-09-19T06:40:49.399 INFO:tasks.workunit.client.0.smithi099.stdout:4/867: dwrite d12/d82/ddd/fa0 [0,4194304] 0 2024-09-19T06:40:49.399 INFO:tasks.workunit.client.0.smithi099.stdout:5/982: fsync d3/d2a/f2e 0 2024-09-19T06:40:49.402 INFO:tasks.workunit.client.0.smithi099.stdout:6/774: chown d1/d5/d38/c44 608826 1 2024-09-19T06:40:49.403 INFO:tasks.workunit.client.0.smithi099.stdout:4/868: truncate d12/d1b/f44 9794008 0 2024-09-19T06:40:49.406 INFO:tasks.workunit.client.0.smithi099.stdout:6/775: write d1/f4c [1793223,4960] 0 2024-09-19T06:40:49.410 INFO:tasks.workunit.client.0.smithi099.stdout:2/677: truncate d1/d2/d4d/d55/da5/d18/d27/d5b/f8c 936080 0 2024-09-19T06:40:49.410 INFO:tasks.workunit.client.0.smithi099.stdout:0/814: dread d0/f1b [0,4194304] 0 2024-09-19T06:40:49.414 INFO:tasks.workunit.client.0.smithi099.stdout:2/678: write d1/d2/d4d/d55/da5/da8/fd9 [402581,43211] 0 2024-09-19T06:40:49.416 INFO:tasks.workunit.client.0.smithi099.stdout:5/983: dwrite d3/d16/d2f/d8c/ffc [0,4194304] 0 2024-09-19T06:40:49.418 INFO:tasks.workunit.client.0.smithi099.stdout:6/776: rename d1/d5/d24/d2b/f45 to d1/d5/d38/d76/db0/f100 0 2024-09-19T06:40:49.420 INFO:tasks.workunit.client.0.smithi099.stdout:4/869: dwrite d12/d32/d42/d80/f83 [0,4194304] 0 2024-09-19T06:40:49.420 INFO:tasks.workunit.client.0.smithi099.stdout:5/984: chown d3/d16/d2f/d8c/dd9/d102 1320 1 2024-09-19T06:40:49.421 INFO:tasks.workunit.client.0.smithi099.stdout:4/870: chown d12/d82/ddd/d9b 150127 1 2024-09-19T06:40:49.422 INFO:tasks.workunit.client.0.smithi099.stdout:6/777: creat d1/d5/d24/d2e/d41/d81/f101 x:0 0 0 2024-09-19T06:40:49.422 INFO:tasks.workunit.client.0.smithi099.stdout:2/679: truncate d1/d2/d4d/d55/da5/d9/d63/dc6/d13/f83 600957 0 2024-09-19T06:40:49.426 INFO:tasks.workunit.client.0.smithi099.stdout:9/946: dread dd/d2c/f5a [0,4194304] 0 2024-09-19T06:40:49.429 INFO:tasks.workunit.client.0.smithi099.stdout:6/778: creat d1/d5/d38/d76/db0/d54/f102 x:0 0 0 2024-09-19T06:40:49.430 INFO:tasks.workunit.client.0.smithi099.stdout:9/947: mknod dd/dc9/df5/df9/c136 0 2024-09-19T06:40:49.431 INFO:tasks.workunit.client.0.smithi099.stdout:4/871: dwrite d12/d82/ddd/d8a/da9/dc7/f11b [0,4194304] 0 2024-09-19T06:40:49.434 INFO:tasks.workunit.client.0.smithi099.stdout:4/872: fdatasync d12/d82/ddd/d9b/dab/f103 0 2024-09-19T06:40:49.435 INFO:tasks.workunit.client.0.smithi099.stdout:6/779: unlink d1/d5/d38/d76/db0/d54/d5d/l78 0 2024-09-19T06:40:49.437 INFO:tasks.workunit.client.0.smithi099.stdout:0/815: dwrite d0/db/d36/d3f/f8a [0,4194304] 0 2024-09-19T06:40:49.437 INFO:tasks.workunit.client.0.smithi099.stdout:9/948: creat dd/d2c/dd9/ded/df0/f137 x:0 0 0 2024-09-19T06:40:49.440 INFO:tasks.workunit.client.0.smithi099.stdout:2/680: write d1/d2/d4d/f95 [388385,122662] 0 2024-09-19T06:40:49.440 INFO:tasks.workunit.client.0.smithi099.stdout:8/809: dread d4/de/d1c/f1d [0,4194304] 0 2024-09-19T06:40:49.443 INFO:tasks.workunit.client.0.smithi099.stdout:6/780: unlink d1/d5/d24/d2e/d41/c94 0 2024-09-19T06:40:49.444 INFO:tasks.workunit.client.0.smithi099.stdout:0/816: symlink d0/db/d36/db1/l100 0 2024-09-19T06:40:49.445 INFO:tasks.workunit.client.0.smithi099.stdout:8/810: symlink d4/d11/d61/dee/l10e 0 2024-09-19T06:40:49.447 INFO:tasks.workunit.client.0.smithi099.stdout:9/949: creat dd/d2c/d5c/d85/dfc/f138 x:0 0 0 2024-09-19T06:40:49.447 INFO:tasks.workunit.client.0.smithi099.stdout:8/811: dread - d4/d5e/dbb/fce zero size 2024-09-19T06:40:49.447 INFO:tasks.workunit.client.0.smithi099.stdout:6/781: fsync d1/d5/d38/d76/db0/d54/d5d/fd9 0 2024-09-19T06:40:49.447 INFO:tasks.workunit.client.0.smithi099.stdout:2/681: truncate d1/d2/d4d/d55/da5/d9/d63/dc6/d13/f83 1513411 0 2024-09-19T06:40:49.448 INFO:tasks.workunit.client.0.smithi099.stdout:0/817: creat d0/db/dc0/dd2/f101 x:0 0 0 2024-09-19T06:40:49.450 INFO:tasks.workunit.client.0.smithi099.stdout:2/682: chown d1/d2/d4d/d55/da5/d9/d63/dc6/d77/d98/fb1 168 1 2024-09-19T06:40:49.451 INFO:tasks.workunit.client.0.smithi099.stdout:9/950: symlink dd/d2c/d5c/d64/d93/dfa/d105/dff/d129/l139 0 2024-09-19T06:40:49.452 INFO:tasks.workunit.client.0.smithi099.stdout:8/812: truncate d4/d11/f21 391025 0 2024-09-19T06:40:49.453 INFO:tasks.workunit.client.0.smithi099.stdout:2/683: write d1/d2/d4d/d55/da5/d9/d63/dc6/d13/d2c/fd3 [908685,44062] 0 2024-09-19T06:40:49.455 INFO:tasks.workunit.client.0.smithi099.stdout:8/813: mknod d4/d11/d23/d4c/d93/d104/c10f 0 2024-09-19T06:40:49.457 INFO:tasks.workunit.client.0.smithi099.stdout:9/951: mknod dd/d2c/d5c/dd0/c13a 0 2024-09-19T06:40:49.459 INFO:tasks.workunit.client.0.smithi099.stdout:0/818: rename d0/db/d27/d5d/d87/da2/dbc/d1f/db4/ced to d0/db/d27/d5d/d87/da2/c102 0 2024-09-19T06:40:49.460 INFO:tasks.workunit.client.0.smithi099.stdout:2/684: rename d1/d2/d4d/d55/da5/d18/d27/d5b to d1/d2/d4d/d55/da5/d18/d27/d5b/d92/de4 22 2024-09-19T06:40:49.460 INFO:tasks.workunit.client.0.smithi099.stdout:0/819: read d0/db/d36/f5f [10283280,25199] 0 2024-09-19T06:40:49.463 INFO:tasks.workunit.client.0.smithi099.stdout:8/814: symlink d4/de/d26/d2b/dd7/l110 0 2024-09-19T06:40:49.465 INFO:tasks.workunit.client.0.smithi099.stdout:8/815: write d4/de/d1c/f1d [3631168,11226] 0 2024-09-19T06:40:49.469 INFO:tasks.workunit.client.0.smithi099.stdout:2/685: getdents d1 0 2024-09-19T06:40:49.470 INFO:tasks.workunit.client.0.smithi099.stdout:0/820: dwrite d0/db/d2f/f6f [0,4194304] 0 2024-09-19T06:40:49.470 INFO:tasks.workunit.client.0.smithi099.stdout:9/952: write dd/d2c/d79/db4/f124 [1328425,85694] 0 2024-09-19T06:40:49.473 INFO:tasks.workunit.client.0.smithi099.stdout:8/816: read d4/d11/d38/fcd [2300153,78230] 0 2024-09-19T06:40:49.473 INFO:tasks.workunit.client.0.smithi099.stdout:6/782: dwrite d1/d5/d24/d2b/f58 [0,4194304] 0 2024-09-19T06:40:49.474 INFO:tasks.workunit.client.0.smithi099.stdout:8/817: chown d4/de/d1c/df7/ced 3 1 2024-09-19T06:40:49.475 INFO:tasks.workunit.client.1.smithi117.stdout:6/944: sync 2024-09-19T06:40:49.477 INFO:tasks.workunit.client.0.smithi099.stdout:6/783: chown d1/f35 18707031 1 2024-09-19T06:40:49.479 INFO:tasks.workunit.client.0.smithi099.stdout:9/953: rename dd/f5b to dd/d47/d40/da9/f13b 0 2024-09-19T06:40:49.479 INFO:tasks.workunit.client.0.smithi099.stdout:2/686: mknod d1/d2/d4d/d55/da5/d18/d2d/ce5 0 2024-09-19T06:40:49.480 INFO:tasks.workunit.client.0.smithi099.stdout:8/818: dread - d4/de/d10/f9c zero size 2024-09-19T06:40:49.486 INFO:tasks.workunit.client.0.smithi099.stdout:0/821: dwrite d0/db/d27/d5d/d87/da2/dbc/d1f/d4a/d61/ffd [0,4194304] 0 2024-09-19T06:40:49.486 INFO:tasks.workunit.client.0.smithi099.stdout:6/784: creat d1/d5/d24/d2e/f103 x:0 0 0 2024-09-19T06:40:49.487 INFO:tasks.workunit.client.0.smithi099.stdout:8/819: write d4/d11/d23/d4c/d93/d104/fe7 [1205190,46343] 0 2024-09-19T06:40:49.490 INFO:tasks.workunit.client.0.smithi099.stdout:2/687: mkdir d1/d2/d4d/d55/da5/d18/d2d/de3/de6 0 2024-09-19T06:40:49.490 INFO:tasks.workunit.client.0.smithi099.stdout:0/822: stat d0/db/d27/d5d/d87/da2 0 2024-09-19T06:40:49.493 INFO:tasks.workunit.client.0.smithi099.stdout:8/820: getdents d4/de/d26/d2b/dc9 0 2024-09-19T06:40:49.495 INFO:tasks.workunit.client.0.smithi099.stdout:2/688: getdents d1/d2/d4d/d8e/db6 0 2024-09-19T06:40:49.497 INFO:tasks.workunit.client.0.smithi099.stdout:8/821: readlink d4/d11/d61/dee/dde/le1 0 2024-09-19T06:40:49.499 INFO:tasks.workunit.client.0.smithi099.stdout:9/954: dwrite dd/d2c/d5c/ff8 [0,4194304] 0 2024-09-19T06:40:49.500 INFO:tasks.workunit.client.0.smithi099.stdout:6/785: dwrite d1/d5/d24/d2b/fe8 [0,4194304] 0 2024-09-19T06:40:49.507 INFO:tasks.workunit.client.0.smithi099.stdout:8/822: dwrite d4/d66/fc7 [0,4194304] 0 2024-09-19T06:40:49.514 INFO:tasks.workunit.client.0.smithi099.stdout:6/786: dwrite d1/d5/d38/d76/db0/d54/d5d/d61/fc4 [0,4194304] 0 2024-09-19T06:40:49.514 INFO:tasks.workunit.client.0.smithi099.stdout:6/787: readlink d1/d5/d38/d76/db0/d54/d5d/d61/d65/l6b 0 2024-09-19T06:40:49.518 INFO:tasks.workunit.client.0.smithi099.stdout:9/955: dwrite dd/d62/d78/f7b [0,4194304] 0 2024-09-19T06:40:49.519 INFO:tasks.workunit.client.0.smithi099.stdout:2/689: unlink d1/f47 0 2024-09-19T06:40:49.521 INFO:tasks.workunit.client.0.smithi099.stdout:0/823: mknod d0/db/d27/d5d/d87/da2/dbc/d1f/d3a/da0/c103 0 2024-09-19T06:40:49.523 INFO:tasks.workunit.client.1.smithi117.stdout:6/945: getdents d1 0 2024-09-19T06:40:49.533 INFO:tasks.workunit.client.0.smithi099.stdout:9/956: dwrite dd/d65/ff7 [0,4194304] 0 2024-09-19T06:40:49.533 INFO:tasks.workunit.client.0.smithi099.stdout:6/788: getdents d1/d5/d38/d76 0 2024-09-19T06:40:49.534 INFO:tasks.workunit.client.0.smithi099.stdout:0/824: symlink d0/db/d27/d5d/d87/da2/dbc/d37/d3c/d3e/dd1/l104 0 2024-09-19T06:40:49.534 INFO:tasks.workunit.client.0.smithi099.stdout:2/690: dread d1/d2/d4d/d55/da5/d36/f53 [0,4194304] 0 2024-09-19T06:40:49.537 INFO:tasks.workunit.client.0.smithi099.stdout:9/957: rmdir dd/d2c/d79/db4 39 2024-09-19T06:40:49.542 INFO:tasks.workunit.client.0.smithi099.stdout:2/691: write d1/d2/d4d/d55/da5/d18/d2d/f62 [106419,83070] 0 2024-09-19T06:40:49.544 INFO:tasks.workunit.client.0.smithi099.stdout:6/789: dwrite d1/d12/f39 [4194304,4194304] 0 2024-09-19T06:40:49.545 INFO:tasks.workunit.client.0.smithi099.stdout:2/692: truncate d1/d2/d4d/f95 973880 0 2024-09-19T06:40:49.547 INFO:tasks.workunit.client.0.smithi099.stdout:6/790: stat d1/d5/d24/d2e/f32 0 2024-09-19T06:40:49.548 INFO:tasks.workunit.client.0.smithi099.stdout:6/791: stat d1/d5/d38/d76/db0/d54/d5d/d61/cf7 0 2024-09-19T06:40:49.549 INFO:tasks.workunit.client.1.smithi117.stdout:6/946: dwrite d1/d5/d32/d45/f11d [0,4194304] 0 2024-09-19T06:40:49.550 INFO:tasks.workunit.client.0.smithi099.stdout:9/958: dread dd/d62/d78/fad [0,4194304] 0 2024-09-19T06:40:49.551 INFO:tasks.workunit.client.1.smithi117.stdout:6/947: write d1/d5/d8/d27/d77/f87 [4505946,47805] 0 2024-09-19T06:40:49.551 INFO:tasks.workunit.client.0.smithi099.stdout:6/792: write d1/d5/d38/d76/db0/d54/ff2 [213546,128463] 0 2024-09-19T06:40:49.553 INFO:tasks.workunit.client.1.smithi117.stdout:6/948: stat d1/d5/d8/d5e/d67/d98/ddd/fe3 0 2024-09-19T06:40:49.553 INFO:tasks.workunit.client.0.smithi099.stdout:2/693: read d1/d2/d4d/d55/da5/d18/f23 [3656947,7485] 0 2024-09-19T06:40:49.555 INFO:tasks.workunit.client.0.smithi099.stdout:2/694: chown d1/d2/c19 945571457 1 2024-09-19T06:40:49.556 INFO:tasks.workunit.client.0.smithi099.stdout:6/793: mknod d1/d5/d24/d2e/c104 0 2024-09-19T06:40:49.557 INFO:tasks.workunit.client.0.smithi099.stdout:9/959: mknod dd/d2c/d5c/d64/d93/dfa/d105/deb/d135/c13c 0 2024-09-19T06:40:49.560 INFO:tasks.workunit.client.1.smithi117.stdout:6/949: rename d1/d5/d9a/c81 to d1/d5/d32/c125 0 2024-09-19T06:40:49.561 INFO:tasks.workunit.client.0.smithi099.stdout:6/794: read d1/d5/d38/d76/db0/f6d [509053,103093] 0 2024-09-19T06:40:49.561 INFO:tasks.workunit.client.1.smithi117.stdout:6/950: fsync d1/d5/d8/d5e/d67/d98/da1/fd2 0 2024-09-19T06:40:49.562 INFO:tasks.workunit.client.0.smithi099.stdout:8/823: dread d4/d11/d23/d4c/daf/fcc [0,4194304] 0 2024-09-19T06:40:49.562 INFO:tasks.workunit.client.0.smithi099.stdout:8/824: readlink d4/de/d10/l4f 0 2024-09-19T06:40:49.563 INFO:tasks.workunit.client.0.smithi099.stdout:8/825: chown d4/de/d26/d2b/dba/ccb 253496820 1 2024-09-19T06:40:49.568 INFO:tasks.workunit.client.1.smithi117.stdout:6/951: dwrite d1/d5/d85/f93 [4194304,4194304] 0 2024-09-19T06:40:49.569 INFO:tasks.workunit.client.0.smithi099.stdout:8/826: rename d4/d11/d23/d4c/d93/d104/l9e to d4/d5e/l111 0 2024-09-19T06:40:49.570 INFO:tasks.workunit.client.1.smithi117.stdout:6/952: rmdir d1/d5/d8/d5e/d6d 39 2024-09-19T06:40:49.573 INFO:tasks.workunit.client.1.smithi117.stdout:6/953: unlink d1/d3d/l8a 0 2024-09-19T06:40:49.574 INFO:tasks.workunit.client.0.smithi099.stdout:2/695: mkdir d1/d2/d4d/d55/da5/d9/d63/dc6/d13/de7 0 2024-09-19T06:40:49.576 INFO:tasks.workunit.client.1.smithi117.stdout:6/954: dread - d1/d5/d8/d80/f117 zero size 2024-09-19T06:40:49.577 INFO:tasks.workunit.client.0.smithi099.stdout:2/696: write d1/d2/d4d/d55/da5/da8/fd9 [1417801,53701] 0 2024-09-19T06:40:49.580 INFO:tasks.workunit.client.0.smithi099.stdout:2/697: write d1/d2/d4d/d55/da5/d18/d27/d5b/d92/fbd [3487197,93409] 0 2024-09-19T06:40:49.581 INFO:tasks.workunit.client.0.smithi099.stdout:0/825: dread d0/d17/f6a [0,4194304] 0 2024-09-19T06:40:49.584 INFO:tasks.workunit.client.0.smithi099.stdout:8/827: dread d4/d11/d23/d4c/d93/d104/fe7 [0,4194304] 0 2024-09-19T06:40:49.585 INFO:tasks.workunit.client.0.smithi099.stdout:2/698: read d1/d2/d4d/d55/da5/d9/d63/dc6/d13/fa2 [77113,128150] 0 2024-09-19T06:40:49.586 INFO:tasks.workunit.client.0.smithi099.stdout:8/828: write d4/de/d26/d2b/ff2 [328729,25154] 0 2024-09-19T06:40:49.587 INFO:tasks.workunit.client.1.smithi117.stdout:6/955: write d1/d5/d8/db0/f7a [4960050,48215] 0 2024-09-19T06:40:49.588 INFO:tasks.workunit.client.0.smithi099.stdout:8/829: symlink d4/de/d26/d2b/l112 0 2024-09-19T06:40:49.589 INFO:tasks.workunit.client.0.smithi099.stdout:8/830: readlink d4/d11/d23/d92/lab 0 2024-09-19T06:40:49.595 INFO:tasks.workunit.client.0.smithi099.stdout:9/960: dread dd/d47/d40/f36 [0,4194304] 0 2024-09-19T06:40:49.596 INFO:tasks.workunit.client.0.smithi099.stdout:9/961: readlink dd/d47/d40/l3e 0 2024-09-19T06:40:49.596 INFO:tasks.workunit.client.1.smithi117.stdout:6/956: dwrite d1/d5/d32/f6b [4194304,4194304] 0 2024-09-19T06:40:49.597 INFO:tasks.workunit.client.0.smithi099.stdout:9/962: chown dd/d2c/d5c/d85/fe1 8 1 2024-09-19T06:40:49.597 INFO:tasks.workunit.client.0.smithi099.stdout:9/963: chown dd/d65/de4/d110 41 1 2024-09-19T06:40:49.599 INFO:tasks.workunit.client.1.smithi117.stdout:6/957: read d1/ffc [3271172,55991] 0 2024-09-19T06:40:49.600 INFO:tasks.workunit.client.0.smithi099.stdout:9/964: fsync dd/f44 0 2024-09-19T06:40:49.600 INFO:tasks.workunit.client.0.smithi099.stdout:0/826: dread d0/db/d27/d5d/d87/da2/dbc/d37/d3c/d3e/f7c [4194304,4194304] 0 2024-09-19T06:40:49.603 INFO:tasks.workunit.client.1.smithi117.stdout:6/958: rename d1/d5/d32 to d1/d126 0 2024-09-19T06:40:49.603 INFO:tasks.workunit.client.0.smithi099.stdout:9/965: mkdir dd/d13d 0 2024-09-19T06:40:49.604 INFO:tasks.workunit.client.0.smithi099.stdout:0/827: read d0/db/d27/d5d/d87/da2/dbc/d1f/f28 [2228873,110090] 0 2024-09-19T06:40:49.605 INFO:tasks.workunit.client.0.smithi099.stdout:8/831: dread d4/d11/d23/d3f/f55 [0,4194304] 0 2024-09-19T06:40:49.605 INFO:tasks.workunit.client.0.smithi099.stdout:0/828: stat d0/db/dc0/fdd 0 2024-09-19T06:40:49.608 INFO:tasks.workunit.client.0.smithi099.stdout:0/829: creat d0/db/dd5/f105 x:0 0 0 2024-09-19T06:40:49.610 INFO:tasks.workunit.client.0.smithi099.stdout:0/830: dread - d0/db/d27/d5d/d87/da2/dbc/d37/d3c/d3e/ffe zero size 2024-09-19T06:40:49.611 INFO:tasks.workunit.client.0.smithi099.stdout:9/966: getdents dd/d2c/d79/db4/de2 0 2024-09-19T06:40:49.611 INFO:tasks.workunit.client.0.smithi099.stdout:8/832: dwrite d4/d5e/dbb/fce [0,4194304] 0 2024-09-19T06:40:49.614 INFO:tasks.workunit.client.0.smithi099.stdout:9/967: symlink dd/d2c/d5c/d64/l13e 0 2024-09-19T06:40:49.616 INFO:tasks.workunit.client.0.smithi099.stdout:9/968: chown dd/d62/d76/l91 2 1 2024-09-19T06:40:49.618 INFO:tasks.workunit.client.0.smithi099.stdout:9/969: creat dd/d62/d78/f13f x:0 0 0 2024-09-19T06:40:49.620 INFO:tasks.workunit.client.0.smithi099.stdout:9/970: creat dd/d2c/d5c/d85/dfc/f140 x:0 0 0 2024-09-19T06:40:49.622 INFO:tasks.workunit.client.0.smithi099.stdout:9/971: mknod dd/d62/c141 0 2024-09-19T06:40:49.623 INFO:tasks.workunit.client.0.smithi099.stdout:9/972: stat dd/d2c/dd9/l10d 0 2024-09-19T06:40:49.627 INFO:tasks.workunit.client.0.smithi099.stdout:8/833: dwrite d4/de/fa0 [0,4194304] 0 2024-09-19T06:40:49.631 INFO:tasks.workunit.client.0.smithi099.stdout:8/834: readlink d4/d11/l35 0 2024-09-19T06:40:49.634 INFO:tasks.workunit.client.0.smithi099.stdout:8/835: mknod d4/de/d10/d10b/c113 0 2024-09-19T06:40:49.636 INFO:tasks.workunit.client.0.smithi099.stdout:8/836: chown d4/de/d10/f24 4860 1 2024-09-19T06:40:49.636 INFO:tasks.workunit.client.0.smithi099.stdout:9/973: dwrite dd/d2c/d5c/d85/fcc [0,4194304] 0 2024-09-19T06:40:49.636 INFO:tasks.workunit.client.0.smithi099.stdout:0/831: dread d0/db/d36/d3f/d91/fe2 [0,4194304] 0 2024-09-19T06:40:49.641 INFO:tasks.workunit.client.0.smithi099.stdout:9/974: rename fa to dd/d65/da3/f142 0 2024-09-19T06:40:49.642 INFO:tasks.workunit.client.0.smithi099.stdout:9/975: write dd/d2c/d79/db4/f124 [2401786,63116] 0 2024-09-19T06:40:49.643 INFO:tasks.workunit.client.0.smithi099.stdout:8/837: getdents d4/de/d10/dfe 0 2024-09-19T06:40:49.644 INFO:tasks.workunit.client.0.smithi099.stdout:8/838: write d4/de/fa8 [1381956,80387] 0 2024-09-19T06:40:49.645 INFO:tasks.workunit.client.0.smithi099.stdout:0/832: mknod d0/db/d27/d5d/d87/da2/dbc/d1f/d8e/c106 0 2024-09-19T06:40:49.647 INFO:tasks.workunit.client.0.smithi099.stdout:0/833: chown d0/db/d27/d5d/d87/da2/dbc/d37/d3c/cee 11965901 1 2024-09-19T06:40:49.648 INFO:tasks.workunit.client.0.smithi099.stdout:9/976: creat dd/d65/de4/d110/f143 x:0 0 0 2024-09-19T06:40:49.649 INFO:tasks.workunit.client.0.smithi099.stdout:9/977: chown dd/d65/de4 1426 1 2024-09-19T06:40:49.650 INFO:tasks.workunit.client.0.smithi099.stdout:0/834: unlink d0/db/d36/d3f/fa1 0 2024-09-19T06:40:49.652 INFO:tasks.workunit.client.0.smithi099.stdout:9/978: mknod dd/d2c/d126/c144 0 2024-09-19T06:40:49.653 INFO:tasks.workunit.client.0.smithi099.stdout:9/979: symlink dd/d47/d40/da9/l145 0 2024-09-19T06:40:49.656 INFO:tasks.workunit.client.0.smithi099.stdout:9/980: creat dd/d47/d40/da9/f146 x:0 0 0 2024-09-19T06:40:49.657 INFO:tasks.workunit.client.0.smithi099.stdout:8/839: dread d4/d66/f76 [0,4194304] 0 2024-09-19T06:40:49.658 INFO:tasks.workunit.client.0.smithi099.stdout:8/840: chown d4/d11/d23/d3f/ff0 595719 1 2024-09-19T06:40:49.658 INFO:tasks.workunit.client.0.smithi099.stdout:9/981: symlink dd/d2c/d5c/l147 0 2024-09-19T06:40:49.659 INFO:tasks.workunit.client.0.smithi099.stdout:8/841: chown d4/d11/d23/d4c/ddd/ffd 3531241 1 2024-09-19T06:40:49.660 INFO:tasks.workunit.client.0.smithi099.stdout:8/842: symlink d4/d5e/db4/l114 0 2024-09-19T06:40:49.663 INFO:tasks.workunit.client.0.smithi099.stdout:8/843: creat d4/d11/d61/dee/dda/f115 x:0 0 0 2024-09-19T06:40:49.666 INFO:tasks.workunit.client.0.smithi099.stdout:0/835: dread d0/db/d36/f67 [0,4194304] 0 2024-09-19T06:40:49.667 INFO:tasks.workunit.client.0.smithi099.stdout:0/836: chown d0/db/dc0/dd2 108117 1 2024-09-19T06:40:49.667 INFO:tasks.workunit.client.0.smithi099.stdout:8/844: rename d4/d5e/l111 to d4/de/d26/l116 0 2024-09-19T06:40:49.668 INFO:tasks.workunit.client.0.smithi099.stdout:8/845: rmdir d4/de 39 2024-09-19T06:40:49.669 INFO:tasks.workunit.client.0.smithi099.stdout:0/837: chown d0/db/d27/d5d/d87/da2/dbc/f42 35325 1 2024-09-19T06:40:49.671 INFO:tasks.workunit.client.0.smithi099.stdout:9/982: dread dd/d2c/d5c/f73 [0,4194304] 0 2024-09-19T06:40:49.671 INFO:tasks.workunit.client.0.smithi099.stdout:8/846: symlink d4/d11/d23/d4c/d93/d104/deb/dfb/l117 0 2024-09-19T06:40:49.673 INFO:tasks.workunit.client.0.smithi099.stdout:8/847: fsync d4/d11/f1f 0 2024-09-19T06:40:49.673 INFO:tasks.workunit.client.0.smithi099.stdout:0/838: creat d0/db/d27/d5d/d87/da2/dbc/d47/d75/da4/dcf/f107 x:0 0 0 2024-09-19T06:40:49.676 INFO:tasks.workunit.client.0.smithi099.stdout:8/848: fsync d4/de/fa8 0 2024-09-19T06:40:49.676 INFO:tasks.workunit.client.0.smithi099.stdout:9/983: creat dd/d47/d40/f148 x:0 0 0 2024-09-19T06:40:49.677 INFO:tasks.workunit.client.0.smithi099.stdout:9/984: stat dd/d2c/c4d 0 2024-09-19T06:40:49.677 INFO:tasks.workunit.client.0.smithi099.stdout:0/839: rename d0/db/d27/f8b to d0/d17/d41/f108 0 2024-09-19T06:40:49.682 INFO:tasks.workunit.client.0.smithi099.stdout:0/840: rename d0/db/dc0/dd2/f101 to d0/db/d27/d5d/d87/f109 0 2024-09-19T06:40:49.686 INFO:tasks.workunit.client.0.smithi099.stdout:0/841: dwrite d0/db/d27/d5d/d87/f88 [4194304,4194304] 0 2024-09-19T06:40:49.691 INFO:tasks.workunit.client.0.smithi099.stdout:0/842: creat d0/db/d2f/f10a x:0 0 0 2024-09-19T06:40:49.694 INFO:tasks.workunit.client.0.smithi099.stdout:8/849: dwrite d4/f17 [4194304,4194304] 0 2024-09-19T06:40:49.697 INFO:tasks.workunit.client.0.smithi099.stdout:0/843: dread d0/db/d27/d5d/d87/f88 [4194304,4194304] 0 2024-09-19T06:40:49.699 INFO:tasks.workunit.client.0.smithi099.stdout:8/850: creat d4/d5e/db4/dc2/f118 x:0 0 0 2024-09-19T06:40:49.699 INFO:tasks.workunit.client.0.smithi099.stdout:0/844: rmdir d0/db/d27/d5d/d87/da2/dbc/d47/d75 39 2024-09-19T06:40:49.701 INFO:tasks.workunit.client.0.smithi099.stdout:8/851: mknod d4/d11/d23/d3f/d105/c119 0 2024-09-19T06:40:49.703 INFO:tasks.workunit.client.0.smithi099.stdout:8/852: creat d4/d11/d23/d3f/d105/f11a x:0 0 0 2024-09-19T06:40:49.703 INFO:tasks.workunit.client.0.smithi099.stdout:0/845: creat d0/db/d27/d5d/d87/da2/dbc/d59/f10b x:0 0 0 2024-09-19T06:40:49.704 INFO:tasks.workunit.client.0.smithi099.stdout:0/846: readlink d0/l98 0 2024-09-19T06:40:49.708 INFO:tasks.workunit.client.0.smithi099.stdout:8/853: dwrite d4/d5e/dbb/fe3 [0,4194304] 0 2024-09-19T06:40:49.711 INFO:tasks.workunit.client.0.smithi099.stdout:0/847: read d0/fa7 [938470,4128] 0 2024-09-19T06:40:49.711 INFO:tasks.workunit.client.0.smithi099.stdout:8/854: fdatasync d4/de/d10/f9c 0 2024-09-19T06:40:49.712 INFO:tasks.workunit.client.0.smithi099.stdout:0/848: chown d0/db/d27/d5d/d87/da2/dbc/d59/fb2 10463503 1 2024-09-19T06:40:49.714 INFO:tasks.workunit.client.0.smithi099.stdout:0/849: truncate d0/db/d27/fd4 365795 0 2024-09-19T06:40:49.715 INFO:tasks.workunit.client.0.smithi099.stdout:0/850: write d0/db/f23 [4880687,63710] 0 2024-09-19T06:40:49.718 INFO:tasks.workunit.client.0.smithi099.stdout:0/851: symlink d0/db/d27/d5d/d87/da2/dbc/d47/l10c 0 2024-09-19T06:40:49.719 INFO:tasks.workunit.client.0.smithi099.stdout:0/852: mkdir d0/db/d2f/d10d 0 2024-09-19T06:40:49.722 INFO:tasks.workunit.client.0.smithi099.stdout:0/853: creat d0/db/d27/d5d/d87/da2/dbc/d37/df2/f10e x:0 0 0 2024-09-19T06:40:49.726 INFO:tasks.workunit.client.0.smithi099.stdout:0/854: link d0/db/d27/d5d/d87/da2/dbc/d1f/d39/l78 d0/db/d27/d5d/d87/da2/dbc/l10f 0 2024-09-19T06:40:49.726 INFO:tasks.workunit.client.0.smithi099.stdout:0/855: write d0/d17/d41/f2d [4914366,30553] 0 2024-09-19T06:40:49.730 INFO:tasks.workunit.client.0.smithi099.stdout:0/856: unlink d0/db/d27/d5d/d87/da2/dbc/d37/d3c/d3e/f7c 0 2024-09-19T06:40:49.733 INFO:tasks.workunit.client.0.smithi099.stdout:8/855: dread d4/d11/d23/d4c/ddd/fb1 [0,4194304] 0 2024-09-19T06:40:49.734 INFO:tasks.workunit.client.0.smithi099.stdout:8/856: readlink d4/de/l5a 0 2024-09-19T06:40:49.735 INFO:tasks.workunit.client.0.smithi099.stdout:8/857: chown d4/d5e/dbb/fe3 2764540 1 2024-09-19T06:40:49.736 INFO:tasks.workunit.client.0.smithi099.stdout:8/858: creat d4/de/d26/f11b x:0 0 0 2024-09-19T06:40:49.738 INFO:tasks.workunit.client.0.smithi099.stdout:8/859: creat d4/d5e/db4/dc2/f11c x:0 0 0 2024-09-19T06:40:49.739 INFO:tasks.workunit.client.0.smithi099.stdout:8/860: read d4/de/d10/f24 [515454,35300] 0 2024-09-19T06:40:49.743 INFO:tasks.workunit.client.1.smithi117.stdout:6/959: sync 2024-09-19T06:40:49.744 INFO:tasks.workunit.client.0.smithi099.stdout:0/857: dread d0/f57 [0,4194304] 0 2024-09-19T06:40:49.745 INFO:tasks.workunit.client.1.smithi117.stdout:6/960: stat d1/d5/d8/d99/f115 0 2024-09-19T06:40:49.746 INFO:tasks.workunit.client.0.smithi099.stdout:0/858: symlink d0/db/l110 0 2024-09-19T06:40:49.747 INFO:tasks.workunit.client.0.smithi099.stdout:8/861: rename d4/d5e/db4 to d4/d11/d23/d4c/d11d 0 2024-09-19T06:40:49.748 INFO:tasks.workunit.client.0.smithi099.stdout:8/862: write d4/d11/f1f [586683,61820] 0 2024-09-19T06:40:49.750 INFO:tasks.workunit.client.0.smithi099.stdout:0/859: unlink d0/db/d27/d5d/d87/da2/dbc/d47/d75/da4/dcf/dd3/fdf 0 2024-09-19T06:40:49.751 INFO:tasks.workunit.client.0.smithi099.stdout:8/863: mknod d4/c11e 0 2024-09-19T06:40:49.751 INFO:tasks.workunit.client.0.smithi099.stdout:8/864: readlink d4/de/d26/d2b/la1 0 2024-09-19T06:40:49.752 INFO:tasks.workunit.client.0.smithi099.stdout:0/860: chown d0/db/d27/d5d/d87/da2/dbc/l16 12079 1 2024-09-19T06:40:49.753 INFO:tasks.workunit.client.0.smithi099.stdout:8/865: fsync d4/de/fb7 0 2024-09-19T06:40:49.754 INFO:tasks.workunit.client.0.smithi099.stdout:0/861: chown d0/db/d27/d5d/d87/da2/dbc/d1f/d3a/l56 223188 1 2024-09-19T06:40:49.756 INFO:tasks.workunit.client.0.smithi099.stdout:8/866: rename d4/f54 to d4/de/d26/f11f 0 2024-09-19T06:40:49.756 INFO:tasks.workunit.client.0.smithi099.stdout:8/867: fdatasync d4/d11/d23/d3f/ff0 0 2024-09-19T06:40:49.758 INFO:tasks.workunit.client.0.smithi099.stdout:0/862: read d0/db/d27/d5d/d87/da2/dbc/f7d [1135602,49250] 0 2024-09-19T06:40:49.762 INFO:tasks.workunit.client.0.smithi099.stdout:0/863: creat d0/db/d27/d5d/d87/da2/dbc/d1f/d8e/f111 x:0 0 0 2024-09-19T06:40:49.762 INFO:tasks.workunit.client.0.smithi099.stdout:8/868: dwrite d4/d11/d61/dee/dde/f10d [0,4194304] 0 2024-09-19T06:40:49.769 INFO:tasks.workunit.client.0.smithi099.stdout:0/864: rename d0/db/d27/d5d/d87/da2/dbc/d47 to d0/d112 0 2024-09-19T06:40:49.771 INFO:tasks.workunit.client.0.smithi099.stdout:8/869: dwrite d4/d11/f1f [0,4194304] 0 2024-09-19T06:40:49.775 INFO:tasks.workunit.client.0.smithi099.stdout:0/865: chown d0/db/d27/d5d/d87/da2/dbc/d59/f10b 227638672 1 2024-09-19T06:40:49.778 INFO:tasks.workunit.client.0.smithi099.stdout:0/866: symlink d0/db/d27/l113 0 2024-09-19T06:40:49.779 INFO:tasks.workunit.client.0.smithi099.stdout:8/870: dwrite d4/de/d10/f24 [0,4194304] 0 2024-09-19T06:40:49.781 INFO:tasks.workunit.client.0.smithi099.stdout:0/867: read d0/db/d27/d5d/d87/da2/dbc/d37/d3c/fde [940000,128639] 0 2024-09-19T06:40:49.784 INFO:tasks.workunit.client.0.smithi099.stdout:8/871: rename d4/d11/f106 to d4/d11/d23/d92/f120 0 2024-09-19T06:40:49.785 INFO:tasks.workunit.client.0.smithi099.stdout:0/868: rmdir d0/db/d27/d38 39 2024-09-19T06:40:49.785 INFO:tasks.workunit.client.0.smithi099.stdout:8/872: write d4/f5b [4491036,117914] 0 2024-09-19T06:40:49.788 INFO:tasks.workunit.client.0.smithi099.stdout:0/869: creat d0/d112/d75/da4/dcf/f114 x:0 0 0 2024-09-19T06:40:49.790 INFO:tasks.workunit.client.0.smithi099.stdout:0/870: fdatasync d0/db/d27/d5d/d87/da2/dbc/ff9 0 2024-09-19T06:40:49.790 INFO:tasks.workunit.client.0.smithi099.stdout:8/873: getdents d4/de/d26/d2b/dba 0 2024-09-19T06:40:49.792 INFO:tasks.workunit.client.0.smithi099.stdout:0/871: mkdir d0/d17/d41/d115 0 2024-09-19T06:40:49.794 INFO:tasks.workunit.client.0.smithi099.stdout:0/872: fdatasync d0/db/dd5/ff7 0 2024-09-19T06:40:49.796 INFO:tasks.workunit.client.0.smithi099.stdout:8/874: dwrite d4/d11/d23/d4c/d11d/fc3 [0,4194304] 0 2024-09-19T06:40:49.797 INFO:tasks.workunit.client.0.smithi099.stdout:8/875: chown d4/d66/le9 517010602 1 2024-09-19T06:40:49.798 INFO:tasks.workunit.client.0.smithi099.stdout:0/873: write d0/db/d27/d5d/d87/da2/dbc/d37/d3c/fde [1256777,105414] 0 2024-09-19T06:40:49.819 INFO:tasks.workunit.client.0.smithi099.stdout:8/876: dread d4/d11/d23/f3b [0,4194304] 0 2024-09-19T06:40:49.819 INFO:tasks.workunit.client.0.smithi099.stdout:0/874: dread d0/db/d27/d5d/d87/da2/dbc/f20 [0,4194304] 0 2024-09-19T06:40:49.821 INFO:tasks.workunit.client.0.smithi099.stdout:8/877: unlink d4/de/d26/f11b 0 2024-09-19T06:40:49.821 INFO:tasks.workunit.client.0.smithi099.stdout:8/878: fdatasync d4/d11/d23/d4c/d93/d104/ffa 0 2024-09-19T06:40:49.822 INFO:tasks.workunit.client.0.smithi099.stdout:0/875: write d0/db/d27/d5d/d87/da2/dbc/d1f/d3a/da0/fe7 [2440739,115700] 0 2024-09-19T06:40:49.822 INFO:tasks.workunit.client.0.smithi099.stdout:8/879: readlink d4/de/l5a 0 2024-09-19T06:40:49.823 INFO:tasks.workunit.client.0.smithi099.stdout:0/876: dread - d0/db/d27/d5d/d87/da2/dbc/d59/fc7 zero size 2024-09-19T06:40:49.825 INFO:tasks.workunit.client.0.smithi099.stdout:8/880: creat d4/d11/d23/d4c/d11d/f121 x:0 0 0 2024-09-19T06:40:49.826 INFO:tasks.workunit.client.0.smithi099.stdout:0/877: stat d0/db/d27/d5d/d87/da2/dbc/d37/ff4 0 2024-09-19T06:40:49.826 INFO:tasks.workunit.client.0.smithi099.stdout:8/881: chown d4/de/d26/d2b/ff2 803 1 2024-09-19T06:40:49.826 INFO:tasks.workunit.client.0.smithi099.stdout:0/878: readlink d0/db/lc8 0 2024-09-19T06:40:49.827 INFO:tasks.workunit.client.0.smithi099.stdout:0/879: symlink d0/db/d36/l116 0 2024-09-19T06:40:49.828 INFO:tasks.workunit.client.0.smithi099.stdout:8/882: mknod d4/d11/d23/d4c/d11d/c122 0 2024-09-19T06:40:49.829 INFO:tasks.workunit.client.0.smithi099.stdout:0/880: creat d0/db/d27/d5d/d87/da2/dbc/d59/f117 x:0 0 0 2024-09-19T06:40:49.830 INFO:tasks.workunit.client.0.smithi099.stdout:8/883: mkdir d4/de/d1c/d123 0 2024-09-19T06:40:49.833 INFO:tasks.workunit.client.0.smithi099.stdout:8/884: dread d4/d5e/dbb/fce [0,4194304] 0 2024-09-19T06:40:49.837 INFO:tasks.workunit.client.0.smithi099.stdout:8/885: dwrite f2 [0,4194304] 0 2024-09-19T06:40:49.839 INFO:tasks.workunit.client.0.smithi099.stdout:8/886: mkdir d4/d11/d61/d124 0 2024-09-19T06:40:49.840 INFO:tasks.workunit.client.0.smithi099.stdout:8/887: chown d4/de/d26/f11f 57678766 1 2024-09-19T06:40:49.845 INFO:tasks.workunit.client.0.smithi099.stdout:5/985: sync 2024-09-19T06:40:49.845 INFO:tasks.workunit.client.0.smithi099.stdout:4/873: sync 2024-09-19T06:40:49.845 INFO:tasks.workunit.client.0.smithi099.stdout:1/801: sync 2024-09-19T06:40:49.846 INFO:tasks.workunit.client.0.smithi099.stdout:8/888: readlink d4/d11/d38/lc1 0 2024-09-19T06:40:49.847 INFO:tasks.workunit.client.0.smithi099.stdout:4/874: mknod d12/d82/ddd/d9b/dab/c11f 0 2024-09-19T06:40:49.849 INFO:tasks.workunit.client.0.smithi099.stdout:8/889: rename d4/d11/d23/d92/l108 to d4/d11/d23/d4c/d93/d104/l125 0 2024-09-19T06:40:49.885 INFO:tasks.workunit.client.1.smithi117.stdout:6/961: sync 2024-09-19T06:40:49.887 INFO:tasks.workunit.client.1.smithi117.stdout:6/962: mknod d1/d5/d9a/da9/c127 0 2024-09-19T06:40:49.901 INFO:tasks.workunit.client.0.smithi099.stdout:9/985: sync 2024-09-19T06:40:49.902 INFO:tasks.workunit.client.0.smithi099.stdout:2/699: sync 2024-09-19T06:40:49.902 INFO:tasks.workunit.client.0.smithi099.stdout:6/795: sync 2024-09-19T06:40:49.917 INFO:tasks.workunit.client.0.smithi099.stdout:1/802: rename d0/d17/d32/d7b/db0/f100 to d0/d17/d24/d3a/df0/f107 0 2024-09-19T06:40:49.917 INFO:tasks.workunit.client.0.smithi099.stdout:8/890: mkdir d4/d11/d23/d92/d126 0 2024-09-19T06:40:49.917 INFO:tasks.workunit.client.0.smithi099.stdout:4/875: getdents d12/d82/ddd/dcb 0 2024-09-19T06:40:49.920 INFO:tasks.workunit.client.0.smithi099.stdout:2/700: chown d1/d2/d4d/d55/da5/d18/d27/c6c 6 1 2024-09-19T06:40:49.920 INFO:tasks.workunit.client.0.smithi099.stdout:1/803: creat d0/d17/d32/d7b/db0/f108 x:0 0 0 2024-09-19T06:40:49.920 INFO:tasks.workunit.client.0.smithi099.stdout:9/986: mknod dd/d2c/d5c/d64/d93/dfa/d105/c149 0 2024-09-19T06:40:49.922 INFO:tasks.workunit.client.0.smithi099.stdout:6/796: creat d1/d5/d38/f105 x:0 0 0 2024-09-19T06:40:49.923 INFO:tasks.workunit.client.0.smithi099.stdout:9/987: stat dd/d2c/d5c/d85/lac 0 2024-09-19T06:40:49.923 INFO:tasks.workunit.client.0.smithi099.stdout:4/876: rename d12/d58/c5e to d12/d1b/da4/db4/c120 0 2024-09-19T06:40:49.924 INFO:tasks.workunit.client.0.smithi099.stdout:2/701: creat d1/d2/d4d/d55/da5/d9/d63/dc6/d13/fe8 x:0 0 0 2024-09-19T06:40:49.926 INFO:tasks.workunit.client.0.smithi099.stdout:9/988: mknod dd/d2c/d5c/d85/c14a 0 2024-09-19T06:40:49.926 INFO:tasks.workunit.client.0.smithi099.stdout:1/804: creat d0/d17/d24/d5e/f109 x:0 0 0 2024-09-19T06:40:49.927 INFO:tasks.workunit.client.0.smithi099.stdout:2/702: truncate d1/d2/d4d/d8e/fcc 4636547 0 2024-09-19T06:40:49.928 INFO:tasks.workunit.client.0.smithi099.stdout:9/989: rmdir dd/d2c/d126 39 2024-09-19T06:40:49.928 INFO:tasks.workunit.client.0.smithi099.stdout:4/877: mkdir d12/d1b/d88/d114/d121 0 2024-09-19T06:40:49.929 INFO:tasks.workunit.client.0.smithi099.stdout:6/797: getdents d1/d5/d38/d76/db0 0 2024-09-19T06:40:49.930 INFO:tasks.workunit.client.0.smithi099.stdout:5/986: dread d3/f9 [0,4194304] 0 2024-09-19T06:40:49.930 INFO:tasks.workunit.client.0.smithi099.stdout:1/805: creat d0/d12/d54/f10a x:0 0 0 2024-09-19T06:40:49.931 INFO:tasks.workunit.client.0.smithi099.stdout:9/990: write dd/d65/f75 [4087193,19702] 0 2024-09-19T06:40:49.931 INFO:tasks.workunit.client.0.smithi099.stdout:2/703: fdatasync d1/d2/d4d/d55/da5/d18/d2d/fbe 0 2024-09-19T06:40:49.932 INFO:tasks.workunit.client.0.smithi099.stdout:6/798: readlink d1/d5/d38/d76/db0/l75 0 2024-09-19T06:40:49.932 INFO:tasks.workunit.client.0.smithi099.stdout:1/806: chown d0/fd2 576878649 1 2024-09-19T06:40:49.934 INFO:tasks.workunit.client.0.smithi099.stdout:9/991: truncate dd/d65/ff3 368070 0 2024-09-19T06:40:49.935 INFO:tasks.workunit.client.0.smithi099.stdout:5/987: unlink d3/d137/f149 0 2024-09-19T06:40:49.936 INFO:tasks.workunit.client.0.smithi099.stdout:8/891: dread d4/d5e/f7b [0,4194304] 0 2024-09-19T06:40:49.939 INFO:tasks.workunit.client.0.smithi099.stdout:9/992: mkdir dd/d2c/d5c/d64/d93/dfa/d105/dff/d14b 0 2024-09-19T06:40:49.941 INFO:tasks.workunit.client.0.smithi099.stdout:4/878: link d12/d1b/da4/db4/fbb d12/d32/d39/f122 0 2024-09-19T06:40:49.941 INFO:tasks.workunit.client.0.smithi099.stdout:8/892: write d4/d11/d23/f3b [1694591,56238] 0 2024-09-19T06:40:49.944 INFO:tasks.workunit.client.0.smithi099.stdout:1/807: dwrite d0/d17/d24/d3a/ff6 [0,4194304] 0 2024-09-19T06:40:49.946 INFO:tasks.workunit.client.0.smithi099.stdout:2/704: dwrite d1/d2/d4d/d55/da5/d9/d63/dc6/d13/d2c/fd3 [0,4194304] 0 2024-09-19T06:40:49.946 INFO:tasks.workunit.client.0.smithi099.stdout:4/879: mknod d12/d82/ddd/d9b/da2/c123 0 2024-09-19T06:40:49.947 INFO:tasks.workunit.client.0.smithi099.stdout:6/799: truncate d1/d5/d38/d76/db0/d54/d5d/d61/fdd 3135630 0 2024-09-19T06:40:49.952 INFO:tasks.workunit.client.0.smithi099.stdout:8/893: creat d4/d11/d23/d4c/d93/d104/f127 x:0 0 0 2024-09-19T06:40:49.955 INFO:tasks.workunit.client.0.smithi099.stdout:4/880: creat d12/d1b/d88/f124 x:0 0 0 2024-09-19T06:40:49.955 INFO:tasks.workunit.client.0.smithi099.stdout:6/800: rmdir d1/d5/d24/d2e/d6e 39 2024-09-19T06:40:49.959 INFO:tasks.workunit.client.0.smithi099.stdout:4/881: chown d12/d32/d42/d5c/d117 59632 1 2024-09-19T06:40:49.960 INFO:tasks.workunit.client.0.smithi099.stdout:2/705: getdents d1/d2/d4d/d55/da5/da8 0 2024-09-19T06:40:49.960 INFO:tasks.workunit.client.0.smithi099.stdout:9/993: dwrite dd/d62/d76/d9a/fdd [0,4194304] 0 2024-09-19T06:40:49.963 INFO:tasks.workunit.client.0.smithi099.stdout:1/808: dwrite d0/d12/d54/f6f [4194304,4194304] 0 2024-09-19T06:40:49.964 INFO:tasks.workunit.client.0.smithi099.stdout:4/882: creat d12/d82/ddd/d8a/da9/dfc/d102/f125 x:0 0 0 2024-09-19T06:40:49.964 INFO:tasks.workunit.client.0.smithi099.stdout:2/706: write d1/d2/d4d/d55/da5/fac [1327181,11395] 0 2024-09-19T06:40:49.965 INFO:tasks.workunit.client.0.smithi099.stdout:6/801: truncate d1/d5/d38/d76/db0/d54/f57 825199 0 2024-09-19T06:40:49.966 INFO:tasks.workunit.client.0.smithi099.stdout:1/809: chown d0/d17/d32/c74 1366 1 2024-09-19T06:40:49.968 INFO:tasks.workunit.client.0.smithi099.stdout:2/707: fsync d1/d2/d4d/d55/da5/d9/d63/dc6/d13/fa2 0 2024-09-19T06:40:49.969 INFO:tasks.workunit.client.0.smithi099.stdout:4/883: read d12/d82/ddd/d9b/ff4 [1091869,127410] 0 2024-09-19T06:40:49.974 INFO:tasks.workunit.client.0.smithi099.stdout:1/810: creat d0/d17/d24/d3a/d58/d8d/dae/db8/f10b x:0 0 0 2024-09-19T06:40:49.974 INFO:tasks.workunit.client.0.smithi099.stdout:2/708: write d1/d2/d4d/d55/da5/d9/d63/dc6/f81 [4085602,102313] 0 2024-09-19T06:40:49.976 INFO:tasks.workunit.client.0.smithi099.stdout:4/884: unlink d12/d82/ddd/d89/d91/cad 0 2024-09-19T06:40:49.978 INFO:tasks.workunit.client.0.smithi099.stdout:6/802: dwrite d1/d5/d38/d76/ff8 [0,4194304] 0 2024-09-19T06:40:49.980 INFO:tasks.workunit.client.0.smithi099.stdout:2/709: mknod d1/d2/d4d/d55/dc4/ce9 0 2024-09-19T06:40:49.985 INFO:tasks.workunit.client.0.smithi099.stdout:2/710: creat d1/d2/d4d/d55/da5/d18/d2d/de3/fea x:0 0 0 2024-09-19T06:40:49.986 INFO:tasks.workunit.client.0.smithi099.stdout:6/803: creat d1/d5/d38/f106 x:0 0 0 2024-09-19T06:40:49.988 INFO:tasks.workunit.client.0.smithi099.stdout:2/711: write d1/d2/f90 [1914664,19224] 0 2024-09-19T06:40:49.993 INFO:tasks.workunit.client.1.smithi117.stdout:6/963: sync 2024-09-19T06:40:49.994 INFO:tasks.workunit.client.1.smithi117.stdout:6/964: chown d1/d5/d9a/d103/f10b 1832427278 1 2024-09-19T06:40:49.995 INFO:tasks.workunit.client.1.smithi117.stdout:6/965: dread d1/d5/f40 [0,4194304] 0 2024-09-19T06:40:49.996 INFO:tasks.workunit.client.1.smithi117.stdout:6/966: chown d1/d5/d8/d5e/d67/l9b 178 1 2024-09-19T06:40:49.998 INFO:tasks.workunit.client.1.smithi117.stdout:6/967: creat d1/d5/d8/d5e/d67/d98/da1/f128 x:0 0 0 2024-09-19T06:40:50.000 INFO:tasks.workunit.client.1.smithi117.stdout:6/968: symlink d1/d5/d8/d5e/d67/d98/da1/d108/l129 0 2024-09-19T06:40:50.002 INFO:tasks.workunit.client.1.smithi117.stdout:6/969: creat d1/d5/d8/d99/f12a x:0 0 0 2024-09-19T06:40:50.018 INFO:tasks.workunit.client.1.smithi117.stdout:6/970: dread d1/d3/f17 [0,4194304] 0 2024-09-19T06:40:50.019 INFO:tasks.workunit.client.1.smithi117.stdout:6/971: chown d1/d5/d8/d5e/d6d 323310 1 2024-09-19T06:40:50.020 INFO:tasks.workunit.client.1.smithi117.stdout:6/972: read d1/d5/d8/d27/f47 [2041623,103253] 0 2024-09-19T06:40:50.027 INFO:tasks.workunit.client.1.smithi117.stdout:6/973: dwrite d1/d14/fc0 [0,4194304] 0 2024-09-19T06:40:50.027 INFO:tasks.workunit.client.0.smithi099.stdout:4/885: dread d12/d82/ddd/d9b/ff4 [0,4194304] 0 2024-09-19T06:40:50.029 INFO:tasks.workunit.client.0.smithi099.stdout:8/894: dread d4/f17 [0,4194304] 0 2024-09-19T06:40:50.031 INFO:tasks.workunit.client.1.smithi117.stdout:6/974: mkdir d1/d126/d12b 0 2024-09-19T06:40:50.031 INFO:tasks.workunit.client.0.smithi099.stdout:8/895: write d4/d66/f71 [1949642,53089] 0 2024-09-19T06:40:50.033 INFO:tasks.workunit.client.0.smithi099.stdout:4/886: rename d12/d32/d42/d5c to d12/d115/d126 0 2024-09-19T06:40:50.034 INFO:tasks.workunit.client.1.smithi117.stdout:6/975: creat d1/d126/d12b/f12c x:0 0 0 2024-09-19T06:40:50.036 INFO:tasks.workunit.client.0.smithi099.stdout:8/896: mkdir d4/d101/d128 0 2024-09-19T06:40:50.038 INFO:tasks.workunit.client.0.smithi099.stdout:2/712: dwrite d1/d2/d4d/d55/da5/d36/f8a [4194304,4194304] 0 2024-09-19T06:40:50.040 INFO:tasks.workunit.client.0.smithi099.stdout:2/713: read d1/d2/d4d/d55/da5/d9/d63/dc6/d13/fa2 [258981,49092] 0 2024-09-19T06:40:50.043 INFO:tasks.workunit.client.0.smithi099.stdout:2/714: unlink d1/d2/d4d/d55/da5/f1a 0 2024-09-19T06:40:50.046 INFO:tasks.workunit.client.1.smithi117.stdout:6/976: truncate d1/d5/d8/d80/fac 3338175 0 2024-09-19T06:40:50.048 INFO:tasks.workunit.client.1.smithi117.stdout:6/977: chown d1/f1d 10218 1 2024-09-19T06:40:50.050 INFO:tasks.workunit.client.1.smithi117.stdout:6/978: mkdir d1/d3d/d6f/d12d 0 2024-09-19T06:40:50.052 INFO:tasks.workunit.client.0.smithi099.stdout:6/804: truncate d1/d5/d38/d76/db0/d54/d5d/fc0 545615 0 2024-09-19T06:40:50.053 INFO:tasks.workunit.client.0.smithi099.stdout:2/715: truncate d1/d2/d4d/d55/da5/d9/d63/dc6/d13/d2c/fd3 4382782 0 2024-09-19T06:40:50.057 INFO:tasks.workunit.client.1.smithi117.stdout:6/979: truncate d1/d5/d8/f4f 595374 0 2024-09-19T06:40:50.058 INFO:tasks.workunit.client.1.smithi117.stdout:6/980: dread - d1/d5/d8/db0/f121 zero size 2024-09-19T06:40:50.058 INFO:tasks.workunit.client.0.smithi099.stdout:2/716: chown d1/d2/d4d/d55/da5/d18/d27/d5b/dd4 2274 1 2024-09-19T06:40:50.059 INFO:tasks.workunit.client.1.smithi117.stdout:6/981: fdatasync d1/d5/d8/d27/d77/d101/f118 0 2024-09-19T06:40:50.060 INFO:tasks.workunit.client.0.smithi099.stdout:8/897: dwrite d4/d11/d23/d4c/d93/d104/f65 [0,4194304] 0 2024-09-19T06:40:50.060 INFO:tasks.workunit.client.0.smithi099.stdout:4/887: dwrite d12/d82/f8f [4194304,4194304] 0 2024-09-19T06:40:50.064 INFO:tasks.workunit.client.1.smithi117.stdout:6/982: dwrite d1/d5/d9a/f11e [0,4194304] 0 2024-09-19T06:40:50.068 INFO:tasks.workunit.client.1.smithi117.stdout:6/983: mknod d1/d5/d8/dc3/c12e 0 2024-09-19T06:40:50.070 INFO:tasks.workunit.client.1.smithi117.stdout:6/984: write d1/d5/d8/db0/f121 [312950,82178] 0 2024-09-19T06:40:50.072 INFO:tasks.workunit.client.1.smithi117.stdout:6/985: fsync d1/d5/d8/d5e/d67/d98/da1/fd2 0 2024-09-19T06:40:50.074 INFO:tasks.workunit.client.0.smithi099.stdout:4/888: mkdir d12/d82/ddd/d8a/da9/dfc/d10b/d127 0 2024-09-19T06:40:50.074 INFO:tasks.workunit.client.0.smithi099.stdout:4/889: write d12/d115/d126/d51/fa3 [1605828,112561] 0 2024-09-19T06:40:50.075 INFO:tasks.workunit.client.0.smithi099.stdout:4/890: chown d12/d32/d42/d97 23992 1 2024-09-19T06:40:50.076 INFO:tasks.workunit.client.0.smithi099.stdout:2/717: link d1/d2/d4d/d55/da5/d9/d63/dc6/d13/fa2 d1/d2/d4d/d55/feb 0 2024-09-19T06:40:50.078 INFO:tasks.workunit.client.0.smithi099.stdout:4/891: mknod d12/d82/ddd/d8a/da7/c128 0 2024-09-19T06:40:50.079 INFO:tasks.workunit.client.1.smithi117.stdout:6/986: dwrite d1/d14/dd5/fdf [0,4194304] 0 2024-09-19T06:40:50.080 INFO:tasks.workunit.client.0.smithi099.stdout:2/718: dread - d1/d2/d4d/d55/da5/d18/d2d/d88/f96 zero size 2024-09-19T06:40:50.080 INFO:tasks.workunit.client.0.smithi099.stdout:2/719: chown d1/d2/d4d/d55/da5/d18/d2d/de3 214651 1 2024-09-19T06:40:50.081 INFO:tasks.workunit.client.0.smithi099.stdout:4/892: mkdir d12/d32/d42/d80/d129 0 2024-09-19T06:40:50.082 INFO:tasks.workunit.client.1.smithi117.stdout:6/987: unlink d1/d3d/f10d 0 2024-09-19T06:40:50.083 INFO:tasks.workunit.client.1.smithi117.stdout:6/988: fsync d1/d5/f56 0 2024-09-19T06:40:50.088 INFO:tasks.workunit.client.0.smithi099.stdout:2/720: symlink d1/d2/d4d/d55/da5/d9/db7/lec 0 2024-09-19T06:40:50.090 INFO:tasks.workunit.client.0.smithi099.stdout:2/721: mknod d1/d2/d4d/d55/da5/d9/d63/dc6/d6/ced 0 2024-09-19T06:40:50.091 INFO:tasks.workunit.client.1.smithi117.stdout:6/989: dwrite d1/d5/d8/d5e/d67/d98/da1/f128 [0,4194304] 0 2024-09-19T06:40:50.091 INFO:tasks.workunit.client.0.smithi099.stdout:2/722: truncate d1/d2/d4d/d55/da5/d18/d76/fda 662540 0 2024-09-19T06:40:50.096 INFO:tasks.workunit.client.0.smithi099.stdout:2/723: truncate d1/d2/d4d/d55/da5/d9/d63/dc6/d13/d2c/f9f 554929 0 2024-09-19T06:40:50.099 INFO:tasks.workunit.client.0.smithi099.stdout:6/805: write d1/d5/d38/d76/db0/d2a/f47 [812198,54362] 0 2024-09-19T06:40:50.099 INFO:tasks.workunit.client.0.smithi099.stdout:2/724: creat d1/d2/d4d/d55/da5/d18/fee x:0 0 0 2024-09-19T06:40:50.101 INFO:tasks.workunit.client.0.smithi099.stdout:2/725: chown d1/d2/d4d/d55/da5/da8 637796 1 2024-09-19T06:40:50.101 INFO:tasks.workunit.client.0.smithi099.stdout:6/806: read d1/d5/d24/d2b/fe8 [3009935,40262] 0 2024-09-19T06:40:50.104 INFO:tasks.workunit.client.0.smithi099.stdout:8/898: write d4/de/d1c/f8c [368366,110986] 0 2024-09-19T06:40:50.106 INFO:tasks.workunit.client.1.smithi117.stdout:6/990: dread d1/d5/d8/d5e/f92 [0,4194304] 0 2024-09-19T06:40:50.107 INFO:tasks.workunit.client.0.smithi099.stdout:6/807: read d1/d5/d24/d2e/f8f [2108472,126251] 0 2024-09-19T06:40:50.108 INFO:tasks.workunit.client.0.smithi099.stdout:4/893: dread d12/d32/d39/f90 [0,4194304] 0 2024-09-19T06:40:50.109 INFO:tasks.workunit.client.0.smithi099.stdout:8/899: dread f2 [0,4194304] 0 2024-09-19T06:40:50.111 INFO:tasks.workunit.client.0.smithi099.stdout:6/808: mkdir d1/d5/d38/dbb/d9c/d107 0 2024-09-19T06:40:50.111 INFO:tasks.workunit.client.1.smithi117.stdout:6/991: getdents d1/d5/d8/d5e/d67 0 2024-09-19T06:40:50.112 INFO:tasks.workunit.client.0.smithi099.stdout:4/894: truncate d12/d32/d39/f40 3804833 0 2024-09-19T06:40:50.113 INFO:tasks.workunit.client.0.smithi099.stdout:8/900: mknod d4/d11/d61/dee/c129 0 2024-09-19T06:40:50.113 INFO:tasks.workunit.client.1.smithi117.stdout:6/992: read d1/d5/d8/db0/fb9 [2556570,66736] 0 2024-09-19T06:40:50.114 INFO:tasks.workunit.client.0.smithi099.stdout:6/809: mknod d1/d5/d38/d76/db0/d2a/c108 0 2024-09-19T06:40:50.114 INFO:tasks.workunit.client.0.smithi099.stdout:4/895: readlink la 0 2024-09-19T06:40:50.117 INFO:tasks.workunit.client.0.smithi099.stdout:4/896: symlink d12/d82/ddd/d8a/da9/l12a 0 2024-09-19T06:40:50.118 INFO:tasks.workunit.client.0.smithi099.stdout:8/901: dread d4/d11/f21 [0,4194304] 0 2024-09-19T06:40:50.119 INFO:tasks.workunit.client.1.smithi117.stdout:6/993: dwrite d1/d5/d8/db0/fb9 [0,4194304] 0 2024-09-19T06:40:50.119 INFO:tasks.workunit.client.0.smithi099.stdout:2/726: truncate d1/d2/d4d/d55/da5/d9/d63/dc6/d77/d98/fb1 1170366 0 2024-09-19T06:40:50.119 INFO:tasks.workunit.client.0.smithi099.stdout:4/897: write d12/d32/f3e [2493147,96005] 0 2024-09-19T06:40:50.122 INFO:tasks.workunit.client.1.smithi117.stdout:6/994: creat d1/d5/d9a/d103/f12f x:0 0 0 2024-09-19T06:40:50.123 INFO:tasks.workunit.client.0.smithi099.stdout:6/810: dwrite d1/d5/d24/d2b/d86/de0/fe5 [0,4194304] 0 2024-09-19T06:40:50.123 INFO:tasks.workunit.client.0.smithi099.stdout:8/902: mkdir d4/d11/d23/d4c/d93/d12a 0 2024-09-19T06:40:50.124 INFO:tasks.workunit.client.0.smithi099.stdout:4/898: chown d12/d1b/d73/f8e 100 1 2024-09-19T06:40:50.125 INFO:tasks.workunit.client.0.smithi099.stdout:0/881: sync 2024-09-19T06:40:50.125 INFO:tasks.workunit.client.1.smithi117.stdout:6/995: symlink d1/d5/d8/d5e/l130 0 2024-09-19T06:40:50.126 INFO:tasks.workunit.client.0.smithi099.stdout:4/899: fsync d12/d82/ddd/d8a/da7/ff3 0 2024-09-19T06:40:50.128 INFO:tasks.workunit.client.0.smithi099.stdout:2/727: write d1/d2/d4d/d55/da5/d9/f67 [103177,85503] 0 2024-09-19T06:40:50.128 INFO:tasks.workunit.client.0.smithi099.stdout:6/811: write d1/d5/d38/d76/db0/d2a/f55 [2420060,124582] 0 2024-09-19T06:40:50.129 INFO:tasks.workunit.client.0.smithi099.stdout:4/900: chown d12/d1b/f75 142346 1 2024-09-19T06:40:50.133 INFO:tasks.workunit.client.1.smithi117.stdout:6/996: dwrite d1/d5/d9a/d103/f104 [0,4194304] 0 2024-09-19T06:40:50.135 INFO:tasks.workunit.client.1.smithi117.stdout:6/997: write d1/d14/f4c [2553904,12804] 0 2024-09-19T06:40:50.136 INFO:tasks.workunit.client.0.smithi099.stdout:8/903: creat d4/de/f12b x:0 0 0 2024-09-19T06:40:50.137 INFO:tasks.workunit.client.0.smithi099.stdout:0/882: creat d0/f118 x:0 0 0 2024-09-19T06:40:50.138 INFO:tasks.workunit.client.0.smithi099.stdout:6/812: mknod d1/d5/d24/d2e/c109 0 2024-09-19T06:40:50.139 INFO:tasks.workunit.client.1.smithi117.stdout:6/998: creat d1/d5/d8/d27/f131 x:0 0 0 2024-09-19T06:40:50.140 INFO:tasks.workunit.client.0.smithi099.stdout:2/728: creat d1/d2/d4d/d55/da5/d18/d27/dd6/fef x:0 0 0 2024-09-19T06:40:50.143 INFO:tasks.workunit.client.0.smithi099.stdout:0/883: symlink d0/db/dd5/l119 0 2024-09-19T06:40:50.143 INFO:tasks.workunit.client.1.smithi117.stdout:6/999: dread d1/d5/f39 [4194304,4194304] 0 2024-09-19T06:40:50.144 INFO:tasks.workunit.client.0.smithi099.stdout:6/813: read d1/f1e [1650241,92491] 0 2024-09-19T06:40:50.145 INFO:tasks.workunit.client.0.smithi099.stdout:4/901: rename d12/d82/ddd/dcb to d12/d32/d12b 0 2024-09-19T06:40:50.145 INFO:tasks.workunit.client.0.smithi099.stdout:4/902: chown d12/d82/ddd/d8a/da7 41 1 2024-09-19T06:40:50.146 INFO:tasks.workunit.client.0.smithi099.stdout:4/903: chown d12/d82/ddd/d8a/da7 83661 1 2024-09-19T06:40:50.147 INFO:tasks.workunit.client.1.smithi117.stderr:+ rm -rf -- ./tmp.EsLok3Sz2E 2024-09-19T06:40:50.148 INFO:tasks.workunit.client.0.smithi099.stdout:6/814: rmdir d1/d5/d38/d76/db0/d54/d5d 39 2024-09-19T06:40:50.148 INFO:tasks.workunit.client.0.smithi099.stdout:8/904: link d4/d11/d38/c74 d4/d11/d23/d4c/d93/d12a/c12c 0 2024-09-19T06:40:50.150 INFO:tasks.workunit.client.0.smithi099.stdout:8/905: write d4/d11/d61/dee/dda/f115 [525180,35924] 0 2024-09-19T06:40:50.151 INFO:tasks.workunit.client.0.smithi099.stdout:4/904: getdents d12/d58 0 2024-09-19T06:40:50.154 INFO:tasks.workunit.client.0.smithi099.stdout:4/905: rmdir d12/d82/ddd/d8a/da9/dc7 39 2024-09-19T06:40:50.155 INFO:tasks.workunit.client.0.smithi099.stdout:5/988: sync 2024-09-19T06:40:50.155 INFO:tasks.workunit.client.0.smithi099.stdout:9/994: sync 2024-09-19T06:40:50.155 INFO:tasks.workunit.client.0.smithi099.stdout:4/906: write d12/d32/f72 [2343877,83479] 0 2024-09-19T06:40:50.160 INFO:tasks.workunit.client.0.smithi099.stdout:5/989: mknod d3/d16/d2f/d34/c14f 0 2024-09-19T06:40:50.160 INFO:tasks.workunit.client.0.smithi099.stdout:9/995: mknod dd/d2c/d5c/d10e/c14c 0 2024-09-19T06:40:50.162 INFO:tasks.workunit.client.0.smithi099.stdout:5/990: write d3/d16/d2f/fc1 [2312752,102386] 0 2024-09-19T06:40:50.162 INFO:tasks.workunit.client.0.smithi099.stdout:9/996: chown dd/d62/d76/fbb 37166 1 2024-09-19T06:40:50.165 INFO:tasks.workunit.client.0.smithi099.stdout:6/815: write d1/d5/d24/d2b/fe8 [2951420,3045] 0 2024-09-19T06:40:50.167 INFO:tasks.workunit.client.0.smithi099.stdout:9/997: truncate dd/d62/d78/f13f 993549 0 2024-09-19T06:40:50.167 INFO:tasks.workunit.client.0.smithi099.stdout:8/906: truncate d4/de/d1c/f8c 349093 0 2024-09-19T06:40:50.172 INFO:tasks.workunit.client.0.smithi099.stdout:2/729: dread d1/d2/d4d/d55/da5/d9/d63/dc6/d77/d98/fb1 [0,4194304] 0 2024-09-19T06:40:50.173 INFO:tasks.workunit.client.0.smithi099.stdout:5/991: mkdir d3/d16/d2f/d34/da4/da5/dce/de5/d139/d150 0 2024-09-19T06:40:50.174 INFO:tasks.workunit.client.0.smithi099.stdout:0/884: dwrite d0/db/f48 [0,4194304] 0 2024-09-19T06:40:50.176 INFO:tasks.workunit.client.0.smithi099.stdout:8/907: creat d4/de/d26/d8d/f12d x:0 0 0 2024-09-19T06:40:50.178 INFO:tasks.workunit.client.0.smithi099.stdout:4/907: dread d12/d82/f8f [0,4194304] 0 2024-09-19T06:40:50.180 INFO:tasks.workunit.client.0.smithi099.stdout:0/885: dread - d0/d112/d75/da4/dcf/f114 zero size 2024-09-19T06:40:50.180 INFO:tasks.workunit.client.0.smithi099.stdout:6/816: dread d1/d5/d38/d76/db0/d54/ff2 [0,4194304] 0 2024-09-19T06:40:50.180 INFO:tasks.workunit.client.0.smithi099.stdout:4/908: fdatasync d12/f116 0 2024-09-19T06:40:50.181 INFO:tasks.workunit.client.0.smithi099.stdout:2/730: rmdir d1/d2/d4d/d55/da5/d9/d63/dc6/d13/d2c 39 2024-09-19T06:40:50.181 INFO:tasks.workunit.client.0.smithi099.stdout:9/998: dread dd/d62/d76/fbb [0,4194304] 0 2024-09-19T06:40:50.182 INFO:tasks.workunit.client.0.smithi099.stdout:4/909: stat d12/le2 0 2024-09-19T06:40:50.184 INFO:tasks.workunit.client.0.smithi099.stdout:5/992: mkdir d3/d16/d2f/d34/d10c/d151 0 2024-09-19T06:40:50.185 INFO:tasks.workunit.client.0.smithi099.stdout:5/993: readlink d3/d16/l44 0 2024-09-19T06:40:50.185 INFO:tasks.workunit.client.0.smithi099.stdout:9/999: fsync dd/d65/da3/f142 0 2024-09-19T06:40:50.188 INFO:tasks.workunit.client.0.smithi099.stdout:6/817: creat d1/d5/d38/d76/db0/d54/d5d/d61/f10a x:0 0 0 2024-09-19T06:40:50.188 INFO:tasks.workunit.client.0.smithi099.stdout:8/908: rmdir d4/de/d26/d8d 39 2024-09-19T06:40:50.190 INFO:tasks.workunit.client.0.smithi099.stdout:5/994: dread - d3/d16/d2f/d34/f6f zero size 2024-09-19T06:40:50.191 INFO:tasks.workunit.client.0.smithi099.stdout:4/910: dread d12/d115/d126/d51/fa3 [0,4194304] 0 2024-09-19T06:40:50.191 INFO:tasks.workunit.client.0.smithi099.stdout:0/886: truncate d0/db/d27/d5d/d87/da2/dbc/f7d 1509580 0 2024-09-19T06:40:50.191 INFO:tasks.workunit.client.0.smithi099.stdout:6/818: mknod d1/da1/c10b 0 2024-09-19T06:40:50.192 INFO:tasks.workunit.client.0.smithi099.stdout:4/911: readlink d12/d1b/da4/la5 0 2024-09-19T06:40:50.192 INFO:tasks.workunit.client.0.smithi099.stdout:5/995: symlink d3/d2a/l152 0 2024-09-19T06:40:50.193 INFO:tasks.workunit.client.0.smithi099.stdout:8/909: symlink d4/d11/l12e 0 2024-09-19T06:40:50.194 INFO:tasks.workunit.client.0.smithi099.stdout:6/819: stat d1/d5/d38/d76/db0/d54/l71 0 2024-09-19T06:40:50.194 INFO:tasks.workunit.client.0.smithi099.stdout:0/887: dread - d0/db/d27/d5d/d87/da2/dbc/d1f/d3a/dbf/fcd zero size 2024-09-19T06:40:50.195 INFO:tasks.workunit.client.0.smithi099.stdout:0/888: readlink d0/db/d2f/l7f 0 2024-09-19T06:40:50.197 INFO:tasks.workunit.client.0.smithi099.stdout:8/910: creat d4/d11/d23/d4c/f12f x:0 0 0 2024-09-19T06:40:50.198 INFO:tasks.workunit.client.0.smithi099.stdout:4/912: dread d12/d82/f8f [4194304,4194304] 0 2024-09-19T06:40:50.201 INFO:tasks.workunit.client.0.smithi099.stdout:5/996: write d3/d16/d5e/db1/fc3 [3725446,89191] 0 2024-09-19T06:40:50.201 INFO:tasks.workunit.client.0.smithi099.stdout:6/820: write d1/f10 [1107680,62553] 0 2024-09-19T06:40:50.205 INFO:tasks.workunit.client.0.smithi099.stdout:4/913: getdents d12/d32 0 2024-09-19T06:40:50.207 INFO:tasks.workunit.client.0.smithi099.stdout:6/821: rmdir d1/d5/d24/d2b/d86/da5/dff 0 2024-09-19T06:40:50.210 INFO:tasks.workunit.client.0.smithi099.stdout:6/822: write d1/da1/fca [3288991,112131] 0 2024-09-19T06:40:50.210 INFO:tasks.workunit.client.0.smithi099.stdout:0/889: dwrite d0/db/dd5/ff7 [0,4194304] 0 2024-09-19T06:40:50.212 INFO:tasks.workunit.client.0.smithi099.stdout:4/914: dread d12/d32/d39/f106 [0,4194304] 0 2024-09-19T06:40:50.215 INFO:tasks.workunit.client.0.smithi099.stdout:6/823: write d1/d5/d24/d2b/d86/de0/fe5 [5229349,94740] 0 2024-09-19T06:40:50.215 INFO:tasks.workunit.client.0.smithi099.stdout:0/890: write d0/db/d27/d5d/d87/da2/dbc/d59/f6c [3145925,4495] 0 2024-09-19T06:40:50.217 INFO:tasks.workunit.client.0.smithi099.stdout:4/915: truncate d12/d32/f86 474333 0 2024-09-19T06:40:50.218 INFO:tasks.workunit.client.0.smithi099.stdout:0/891: chown d0/db/d27/d5d/d87/da2/dbc/d37/d3c/d3e/fa3 469724 1 2024-09-19T06:40:50.219 INFO:tasks.workunit.client.0.smithi099.stdout:0/892: read - d0/db/d2f/f10a zero size 2024-09-19T06:40:50.220 INFO:tasks.workunit.client.0.smithi099.stdout:6/824: dread - d1/d5/d38/d76/db0/d54/fd1 zero size 2024-09-19T06:40:50.221 INFO:tasks.workunit.client.0.smithi099.stdout:4/916: creat d12/d115/d126/d9d/f12c x:0 0 0 2024-09-19T06:40:50.222 INFO:tasks.workunit.client.0.smithi099.stdout:0/893: mknod d0/db/d36/c11a 0 2024-09-19T06:40:50.222 INFO:tasks.workunit.client.0.smithi099.stdout:8/911: dread d4/f5b [0,4194304] 0 2024-09-19T06:40:50.225 INFO:tasks.workunit.client.0.smithi099.stdout:6/825: rmdir d1/d5/d24/d2b/d86/de0 39 2024-09-19T06:40:50.225 INFO:tasks.workunit.client.0.smithi099.stdout:8/912: unlink d4/c2c 0 2024-09-19T06:40:50.226 INFO:tasks.workunit.client.0.smithi099.stdout:6/826: chown d1/d5/cc 364491173 1 2024-09-19T06:40:50.228 INFO:tasks.workunit.client.0.smithi099.stdout:4/917: getdents d12/d82/ddd/d8a/da7 0 2024-09-19T06:40:50.229 INFO:tasks.workunit.client.0.smithi099.stdout:8/913: fdatasync d4/de/d26/f89 0 2024-09-19T06:40:50.230 INFO:tasks.workunit.client.0.smithi099.stdout:4/918: dread - d12/d115/d126/d9d/f12c zero size 2024-09-19T06:40:50.234 INFO:tasks.workunit.client.0.smithi099.stdout:4/919: mknod d12/d82/ddd/d9b/dab/c12d 0 2024-09-19T06:40:50.236 INFO:tasks.workunit.client.0.smithi099.stdout:6/827: dwrite d1/d5/d38/f105 [0,4194304] 0 2024-09-19T06:40:50.236 INFO:tasks.workunit.client.0.smithi099.stdout:8/914: rename d4/d11/d61/lf1 to d4/de/d26/d2b/d91/l130 0 2024-09-19T06:40:50.237 INFO:tasks.workunit.client.0.smithi099.stdout:4/920: stat d12/d82/ddd/d89/d91/c113 0 2024-09-19T06:40:50.246 INFO:tasks.workunit.client.0.smithi099.stdout:4/921: dwrite d12/d1b/f75 [0,4194304] 0 2024-09-19T06:40:50.249 INFO:tasks.workunit.client.0.smithi099.stdout:0/894: dwrite d0/d112/f92 [0,4194304] 0 2024-09-19T06:40:50.249 INFO:tasks.workunit.client.0.smithi099.stdout:4/922: write d12/f38 [3801878,10055] 0 2024-09-19T06:40:50.252 INFO:tasks.workunit.client.0.smithi099.stdout:4/923: rmdir d12/d1b/d88 39 2024-09-19T06:40:50.253 INFO:tasks.workunit.client.0.smithi099.stdout:4/924: chown d12/d115/d126/d51/fcc 7715 1 2024-09-19T06:40:50.254 INFO:tasks.workunit.client.0.smithi099.stdout:0/895: creat d0/db/dc0/f11b x:0 0 0 2024-09-19T06:40:50.255 INFO:tasks.workunit.client.0.smithi099.stdout:8/915: truncate d4/d5e/dbb/fe3 1426529 0 2024-09-19T06:40:50.256 INFO:tasks.workunit.client.0.smithi099.stdout:6/828: write d1/d5/d38/d76/db0/d54/d5d/fc0 [420885,92442] 0 2024-09-19T06:40:50.259 INFO:tasks.workunit.client.0.smithi099.stdout:4/925: rename la to d12/d115/d126/d9d/l12e 0 2024-09-19T06:40:50.260 INFO:tasks.workunit.client.0.smithi099.stdout:8/916: dread d4/f5b [0,4194304] 0 2024-09-19T06:40:50.261 INFO:tasks.workunit.client.0.smithi099.stdout:0/896: symlink d0/db/d27/d5d/d87/da2/dbc/d37/l11c 0 2024-09-19T06:40:50.265 INFO:tasks.workunit.client.0.smithi099.stdout:4/926: symlink d12/d1b/d88/l12f 0 2024-09-19T06:40:50.267 INFO:tasks.workunit.client.0.smithi099.stdout:4/927: mknod d12/d115/d126/d51/c130 0 2024-09-19T06:40:50.268 INFO:tasks.workunit.client.0.smithi099.stdout:4/928: chown d12/d82/ddd/d8a/da9/dfc/d102/f109 209 1 2024-09-19T06:40:50.269 INFO:tasks.workunit.client.0.smithi099.stdout:4/929: dread - d12/d115/d126/d9d/f12c zero size 2024-09-19T06:40:50.271 INFO:tasks.workunit.client.0.smithi099.stdout:4/930: mknod d12/d115/d126/d51/c131 0 2024-09-19T06:40:50.274 INFO:tasks.workunit.client.0.smithi099.stdout:4/931: truncate d12/d82/ddd/d9b/da2/fd5 1591111 0 2024-09-19T06:40:50.278 INFO:tasks.workunit.client.0.smithi099.stdout:6/829: write d1/d5/d24/d2e/f8f [4854196,75026] 0 2024-09-19T06:40:50.279 INFO:tasks.workunit.client.0.smithi099.stdout:8/917: write d4/de/d26/d2b/f82 [1006271,7128] 0 2024-09-19T06:40:50.282 INFO:tasks.workunit.client.0.smithi099.stdout:8/918: unlink d4/d11/d38/lec 0 2024-09-19T06:40:50.285 INFO:tasks.workunit.client.0.smithi099.stdout:0/897: dwrite d0/db/d27/d5d/d87/da2/dbc/d1f/d4a/f7b [0,4194304] 0 2024-09-19T06:40:50.289 INFO:tasks.workunit.client.0.smithi099.stdout:4/932: dwrite d12/d32/d39/f90 [4194304,4194304] 0 2024-09-19T06:40:50.291 INFO:tasks.workunit.client.0.smithi099.stdout:8/919: rename d4/de/d26/d2b/dd7 to d4/d101/d128/d131 0 2024-09-19T06:40:50.292 INFO:tasks.workunit.client.0.smithi099.stdout:0/898: rmdir d0/db/d27/d5d/d87/da2/dbc/d37/d3c/d3e/dd1 39 2024-09-19T06:40:50.294 INFO:tasks.workunit.client.0.smithi099.stdout:4/933: unlink d12/d32/c64 0 2024-09-19T06:40:50.297 INFO:tasks.workunit.client.0.smithi099.stdout:0/899: mkdir d0/d17/d11d 0 2024-09-19T06:40:50.310 INFO:tasks.workunit.client.0.smithi099.stdout:6/830: dread d1/d5/d24/d2b/f58 [0,4194304] 0 2024-09-19T06:40:50.311 INFO:tasks.workunit.client.0.smithi099.stdout:6/831: rename d1 to d1/d5/d38/d76/d10c 22 2024-09-19T06:40:50.312 INFO:tasks.workunit.client.0.smithi099.stdout:8/920: write d4/d66/fbd [1619452,85168] 0 2024-09-19T06:40:50.314 INFO:tasks.workunit.client.0.smithi099.stdout:8/921: fdatasync d4/d66/f76 0 2024-09-19T06:40:50.315 INFO:tasks.workunit.client.0.smithi099.stdout:8/922: chown d4/de/d26/d8d/f12d 17 1 2024-09-19T06:40:50.317 INFO:tasks.workunit.client.0.smithi099.stdout:6/832: write d1/d5/d38/d76/db0/d54/fd1 [492787,20633] 0 2024-09-19T06:40:50.317 INFO:tasks.workunit.client.0.smithi099.stdout:8/923: fdatasync d4/d66/f7d 0 2024-09-19T06:40:50.321 INFO:tasks.workunit.client.0.smithi099.stdout:6/833: dread d1/d5/d38/d76/db0/d54/fd1 [0,4194304] 0 2024-09-19T06:40:50.321 INFO:tasks.workunit.client.0.smithi099.stdout:8/924: read d4/d11/fbf [846707,27511] 0 2024-09-19T06:40:50.323 INFO:tasks.workunit.client.0.smithi099.stdout:8/925: stat d4/d11/d23/d4c/daf/lb0 0 2024-09-19T06:40:50.325 INFO:tasks.workunit.client.0.smithi099.stdout:6/834: link d1/d5/d24/d2b/l77 d1/d5/d24/d2e/d41/d81/dfe/l10d 0 2024-09-19T06:40:50.326 INFO:tasks.workunit.client.0.smithi099.stdout:8/926: link d4/d101/d128/d131/l110 d4/d101/d128/l132 0 2024-09-19T06:40:50.327 INFO:tasks.workunit.client.0.smithi099.stdout:8/927: readlink d4/d11/l35 0 2024-09-19T06:40:50.330 INFO:tasks.workunit.client.0.smithi099.stdout:4/934: dread d12/d32/f2e [0,4194304] 0 2024-09-19T06:40:50.330 INFO:tasks.workunit.client.0.smithi099.stdout:1/811: sync 2024-09-19T06:40:50.333 INFO:tasks.workunit.client.0.smithi099.stdout:6/835: dwrite d1/d5/d38/d76/db0/d2a/fc5 [0,4194304] 0 2024-09-19T06:40:50.334 INFO:tasks.workunit.client.0.smithi099.stdout:6/836: chown d1/f1d 1 1 2024-09-19T06:40:50.334 INFO:tasks.workunit.client.0.smithi099.stdout:4/935: creat d12/d82/ddd/d8a/da9/dfc/d10b/d127/f132 x:0 0 0 2024-09-19T06:40:50.338 INFO:tasks.workunit.client.0.smithi099.stdout:4/936: unlink d12/d1b/d73/f8e 0 2024-09-19T06:40:50.343 INFO:tasks.workunit.client.0.smithi099.stdout:4/937: fdatasync d12/d82/ddd/d9b/fb0 0 2024-09-19T06:40:50.345 INFO:tasks.workunit.client.0.smithi099.stdout:1/812: dwrite d0/d12/d13/d37/d48/ff7 [0,4194304] 0 2024-09-19T06:40:50.346 INFO:tasks.workunit.client.0.smithi099.stdout:6/837: dwrite d1/f10 [0,4194304] 0 2024-09-19T06:40:50.346 INFO:tasks.workunit.client.0.smithi099.stdout:8/928: dread d4/fa [0,4194304] 0 2024-09-19T06:40:50.347 INFO:tasks.workunit.client.0.smithi099.stdout:1/813: stat d0/d17/d5b/fd7 0 2024-09-19T06:40:50.348 INFO:tasks.workunit.client.0.smithi099.stdout:1/814: dread - d0/d17/d24/d5e/fca zero size 2024-09-19T06:40:50.349 INFO:tasks.workunit.client.0.smithi099.stdout:4/938: rmdir d12/d82/ddd/d8a 39 2024-09-19T06:40:50.351 INFO:tasks.workunit.client.0.smithi099.stdout:8/929: read d4/de/d1c/d99/fa2 [1865791,10144] 0 2024-09-19T06:40:50.351 INFO:tasks.workunit.client.0.smithi099.stdout:6/838: read d1/d5/d24/fbc [556922,15499] 0 2024-09-19T06:40:50.354 INFO:tasks.workunit.client.0.smithi099.stdout:8/930: readlink d4/d11/d61/dee/l10e 0 2024-09-19T06:40:50.354 INFO:tasks.workunit.client.0.smithi099.stdout:4/939: write d12/f116 [906729,29012] 0 2024-09-19T06:40:50.356 INFO:tasks.workunit.client.0.smithi099.stdout:8/931: symlink d4/de/d10/dfe/l133 0 2024-09-19T06:40:50.358 INFO:tasks.workunit.client.0.smithi099.stdout:4/940: chown d12/d82/ddd/d8a/da9/dc7/f11b 35797357 1 2024-09-19T06:40:50.359 INFO:tasks.workunit.client.0.smithi099.stdout:8/932: fsync d4/d5e/dbb/fc4 0 2024-09-19T06:40:50.360 INFO:tasks.workunit.client.0.smithi099.stdout:6/839: creat d1/d5/f10e x:0 0 0 2024-09-19T06:40:50.362 INFO:tasks.workunit.client.0.smithi099.stdout:8/933: rmdir d4/d11/d23/d4c 39 2024-09-19T06:40:50.363 INFO:tasks.workunit.client.0.smithi099.stdout:6/840: symlink d1/d5/d24/d2b/dc2/l10f 0 2024-09-19T06:40:50.365 INFO:tasks.workunit.client.0.smithi099.stdout:4/941: rename d12/d82/ddd/d9b/la1 to d12/d82/ddd/d8a/de9/d104/l133 0 2024-09-19T06:40:50.366 INFO:tasks.workunit.client.0.smithi099.stdout:4/942: write d12/f7e [2574576,10321] 0 2024-09-19T06:40:50.370 INFO:tasks.workunit.client.0.smithi099.stdout:1/815: write d0/d17/d24/f6a [5034996,33114] 0 2024-09-19T06:40:50.372 INFO:tasks.workunit.client.0.smithi099.stdout:1/816: rmdir d0/d17/d24 39 2024-09-19T06:40:50.373 INFO:tasks.workunit.client.0.smithi099.stdout:6/841: write d1/d5/d38/d76/db0/d54/fc7 [1142926,17580] 0 2024-09-19T06:40:50.373 INFO:tasks.workunit.client.0.smithi099.stdout:1/817: chown d0/f82 1018792 1 2024-09-19T06:40:50.376 INFO:tasks.workunit.client.0.smithi099.stdout:4/943: dread f11 [0,4194304] 0 2024-09-19T06:40:50.376 INFO:tasks.workunit.client.0.smithi099.stdout:1/818: mknod d0/d68/c10c 0 2024-09-19T06:40:50.379 INFO:tasks.workunit.client.0.smithi099.stdout:8/934: dwrite d4/d11/d23/d3f/f9f [0,4194304] 0 2024-09-19T06:40:50.379 INFO:tasks.workunit.client.0.smithi099.stdout:6/842: truncate d1/d5/d38/dbb/da7/fbd 2887135 0 2024-09-19T06:40:50.382 INFO:tasks.workunit.client.0.smithi099.stdout:4/944: mkdir d12/d1b/d88/d114/d134 0 2024-09-19T06:40:50.382 INFO:tasks.workunit.client.0.smithi099.stdout:1/819: mkdir d0/d17/d32/d10d 0 2024-09-19T06:40:50.383 INFO:tasks.workunit.client.0.smithi099.stdout:6/843: mkdir d1/d5/d24/d2b/dc2/d110 0 2024-09-19T06:40:50.385 INFO:tasks.workunit.client.0.smithi099.stdout:6/844: chown d1/da1/c10b 61232322 1 2024-09-19T06:40:50.386 INFO:tasks.workunit.client.0.smithi099.stdout:1/820: rename d0/d17/d32/d7b/d99/dff to d0/d68/daf/d10e 0 2024-09-19T06:40:50.388 INFO:tasks.workunit.client.0.smithi099.stdout:6/845: rename d1/da1 to d1/d5/d52/d111 0 2024-09-19T06:40:50.389 INFO:tasks.workunit.client.0.smithi099.stdout:8/935: link d4/de/d10/l87 d4/d11/l134 0 2024-09-19T06:40:50.391 INFO:tasks.workunit.client.0.smithi099.stdout:4/945: dwrite d12/d82/ddd/d8a/da9/dfc/d10b/d127/f132 [0,4194304] 0 2024-09-19T06:40:50.395 INFO:tasks.workunit.client.0.smithi099.stdout:4/946: creat d12/d32/d12b/f135 x:0 0 0 2024-09-19T06:40:50.397 INFO:tasks.workunit.client.0.smithi099.stdout:4/947: truncate d12/d82/ddd/d8a/fd6 4611361 0 2024-09-19T06:40:50.399 INFO:tasks.workunit.client.0.smithi099.stdout:6/846: write d1/d5/d24/fbc [295280,92665] 0 2024-09-19T06:40:50.402 INFO:tasks.workunit.client.0.smithi099.stdout:4/948: link d12/d82/ddd/d8a/da9/dfc/lff d12/d115/d126/d117/l136 0 2024-09-19T06:40:50.402 INFO:tasks.workunit.client.0.smithi099.stdout:4/949: dread - d12/d82/ddd/d9b/dab/fee zero size 2024-09-19T06:40:50.402 INFO:tasks.workunit.client.0.smithi099.stdout:6/847: mkdir d1/d5/d38/dbb/da7/d112 0 2024-09-19T06:40:50.404 INFO:tasks.workunit.client.0.smithi099.stdout:4/950: chown d12/d32/c78 238386083 1 2024-09-19T06:40:50.405 INFO:tasks.workunit.client.0.smithi099.stdout:8/936: write d4/de/d26/d8d/fd6 [1034674,59800] 0 2024-09-19T06:40:50.406 INFO:tasks.workunit.client.0.smithi099.stdout:4/951: readlink d12/d32/lac 0 2024-09-19T06:40:50.407 INFO:tasks.workunit.client.0.smithi099.stdout:4/952: chown d12/d82/ddd/d8a/da9/dfc 0 1 2024-09-19T06:40:50.407 INFO:tasks.workunit.client.0.smithi099.stdout:8/937: mkdir d4/de/d1c/df7/d135 0 2024-09-19T06:40:50.409 INFO:tasks.workunit.client.0.smithi099.stdout:6/848: rename d1/d5/d38/d76/db0/f6d to d1/d5/d38/d76/db0/d54/d5d/f113 0 2024-09-19T06:40:50.410 INFO:tasks.workunit.client.0.smithi099.stdout:6/849: creat d1/d5/d52/d111/f114 x:0 0 0 2024-09-19T06:40:50.411 INFO:tasks.workunit.client.0.smithi099.stdout:4/953: rename d12/f35 to d12/d32/d42/d80/d110/f137 0 2024-09-19T06:40:50.413 INFO:tasks.workunit.client.0.smithi099.stdout:6/850: creat d1/d12/dda/f115 x:0 0 0 2024-09-19T06:40:50.413 INFO:tasks.workunit.client.0.smithi099.stdout:4/954: dread - d12/d32/d42/d97/fd0 zero size 2024-09-19T06:40:50.415 INFO:tasks.workunit.client.0.smithi099.stdout:8/938: dwrite d4/d11/d38/fcd [0,4194304] 0 2024-09-19T06:40:50.419 INFO:tasks.workunit.client.0.smithi099.stdout:4/955: mkdir d12/d82/ddd/d8a/da9/d118/d138 0 2024-09-19T06:40:50.419 INFO:tasks.workunit.client.0.smithi099.stdout:8/939: rmdir d4/d11/d38 39 2024-09-19T06:40:50.421 INFO:tasks.workunit.client.0.smithi099.stdout:4/956: truncate d12/d32/fe7 1698432 0 2024-09-19T06:40:50.423 INFO:tasks.workunit.client.0.smithi099.stdout:6/851: read - d1/d5/d38/d76/db0/d54/d5d/fee zero size 2024-09-19T06:40:50.428 INFO:tasks.workunit.client.0.smithi099.stdout:6/852: rename d1/d5/d24/d2e/c69 to d1/d5/d38/d76/db0/d2a/c116 0 2024-09-19T06:40:50.430 INFO:tasks.workunit.client.0.smithi099.stdout:6/853: mknod d1/d5/d24/d2b/c117 0 2024-09-19T06:40:50.433 INFO:tasks.workunit.client.0.smithi099.stdout:8/940: truncate d4/de/d10/f24 2158679 0 2024-09-19T06:40:50.433 INFO:tasks.workunit.client.0.smithi099.stdout:6/854: read d1/d5/d38/d76/db0/d54/d5d/f113 [791069,84066] 0 2024-09-19T06:40:50.435 INFO:tasks.workunit.client.0.smithi099.stdout:8/941: write d4/d11/d23/d4c/d11d/fc3 [5225298,11250] 0 2024-09-19T06:40:50.436 INFO:tasks.workunit.client.0.smithi099.stdout:6/855: creat d1/d5/d38/dbb/da7/d112/f118 x:0 0 0 2024-09-19T06:40:50.438 INFO:tasks.workunit.client.0.smithi099.stdout:8/942: getdents d4/d101/d128 0 2024-09-19T06:40:50.439 INFO:tasks.workunit.client.0.smithi099.stdout:6/856: rmdir d1/d5/d24/d2b/dc2/d110 0 2024-09-19T06:40:50.440 INFO:tasks.workunit.client.0.smithi099.stdout:6/857: readlink d1/d5/d24/d2b/lec 0 2024-09-19T06:40:50.443 INFO:tasks.workunit.client.0.smithi099.stdout:6/858: write d1/d5/d38/d76/db0/d54/d5d/fd9 [782257,85296] 0 2024-09-19T06:40:50.445 INFO:tasks.workunit.client.0.smithi099.stdout:8/943: dwrite d4/d11/d23/d4c/d93/d104/f127 [0,4194304] 0 2024-09-19T06:40:50.449 INFO:tasks.workunit.client.0.smithi099.stdout:6/859: chown d1/d5/d38/d76/db0/d54/f57 736173 1 2024-09-19T06:40:50.451 INFO:tasks.workunit.client.0.smithi099.stdout:8/944: stat d4/d11/d61/dee/dda/lfc 0 2024-09-19T06:40:50.455 INFO:tasks.workunit.client.0.smithi099.stdout:6/860: creat d1/d5/f119 x:0 0 0 2024-09-19T06:40:50.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:50 smithi099 ceph-mon[27651]: pgmap v23: 65 pgs: 65 active+clean; 3.4 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 102 MiB/s rd, 264 MiB/s wr, 515 op/s 2024-09-19T06:40:50.456 INFO:tasks.workunit.client.0.smithi099.stdout:6/861: readlink d1/d5/l4a 0 2024-09-19T06:40:50.457 INFO:tasks.workunit.client.0.smithi099.stdout:6/862: stat d1/c6c 0 2024-09-19T06:40:50.460 INFO:tasks.workunit.client.0.smithi099.stdout:8/945: dwrite d4/d11/d23/d3f/d105/f10c [0,4194304] 0 2024-09-19T06:40:50.463 INFO:tasks.workunit.client.0.smithi099.stdout:8/946: symlink d4/d11/d23/d4c/ddd/l136 0 2024-09-19T06:40:50.467 INFO:tasks.workunit.client.0.smithi099.stdout:6/863: dwrite d1/d5/d38/d76/db0/d54/d5d/d61/f8a [0,4194304] 0 2024-09-19T06:40:50.473 INFO:tasks.workunit.client.0.smithi099.stdout:8/947: dwrite d4/d11/d23/d4c/d11d/dc2/f118 [0,4194304] 0 2024-09-19T06:40:50.486 INFO:tasks.workunit.client.0.smithi099.stdout:6/864: dwrite d1/d5/d24/d2e/d41/f5a [0,4194304] 0 2024-09-19T06:40:50.490 INFO:tasks.workunit.client.0.smithi099.stdout:6/865: mkdir d1/d5/d38/dbb/d9c/d11a 0 2024-09-19T06:40:50.497 INFO:tasks.workunit.client.0.smithi099.stdout:6/866: getdents d1/d5/d24 0 2024-09-19T06:40:50.497 INFO:tasks.workunit.client.0.smithi099.stdout:6/867: mknod d1/d5/d38/d76/c11b 0 2024-09-19T06:40:50.498 INFO:tasks.workunit.client.0.smithi099.stdout:6/868: mknod d1/d5/d24/d2b/d86/c11c 0 2024-09-19T06:40:50.499 INFO:tasks.workunit.client.0.smithi099.stdout:6/869: creat d1/d5/d24/d2e/d7b/f11d x:0 0 0 2024-09-19T06:40:50.504 INFO:tasks.workunit.client.0.smithi099.stdout:6/870: rename d1/d5/d24/d2b/fe8 to d1/d5/d38/d76/db0/f11e 0 2024-09-19T06:40:50.506 INFO:tasks.workunit.client.0.smithi099.stdout:6/871: creat d1/d5/d38/dbb/d9c/f11f x:0 0 0 2024-09-19T06:40:50.508 INFO:tasks.workunit.client.0.smithi099.stdout:6/872: dread - d1/d5/d38/d76/db0/d54/d5d/fee zero size 2024-09-19T06:40:50.510 INFO:tasks.workunit.client.0.smithi099.stdout:6/873: symlink d1/d5/d38/dbb/da7/l120 0 2024-09-19T06:40:50.510 INFO:tasks.workunit.client.0.smithi099.stdout:6/874: chown d1/f4c 13749 1 2024-09-19T06:40:50.512 INFO:tasks.workunit.client.0.smithi099.stdout:6/875: mkdir d1/d12/dda/d121 0 2024-09-19T06:40:50.514 INFO:tasks.workunit.client.0.smithi099.stdout:6/876: creat d1/d5/d24/d2e/d41/d81/dfe/f122 x:0 0 0 2024-09-19T06:40:50.515 INFO:tasks.workunit.client.0.smithi099.stdout:6/877: dread - d1/d5/d38/dbb/d9c/f11f zero size 2024-09-19T06:40:50.517 INFO:tasks.workunit.client.0.smithi099.stdout:6/878: write d1/d5/d38/d76/db0/d2a/f30 [3372799,61501] 0 2024-09-19T06:40:50.521 INFO:tasks.workunit.client.0.smithi099.stdout:6/879: creat d1/d5/d38/d76/db0/d54/f123 x:0 0 0 2024-09-19T06:40:50.521 INFO:tasks.workunit.client.0.smithi099.stdout:6/880: write d1/f4c [2828746,92700] 0 2024-09-19T06:40:50.523 INFO:tasks.workunit.client.0.smithi099.stdout:6/881: write d1/d5/d24/d2e/d41/f8d [6760423,75532] 0 2024-09-19T06:40:50.525 INFO:tasks.workunit.client.0.smithi099.stdout:6/882: creat d1/d5/d52/f124 x:0 0 0 2024-09-19T06:40:50.528 INFO:tasks.workunit.client.0.smithi099.stdout:6/883: link d1/d5/d38/d76/db0/d54/d5d/d61/f10a d1/d5/d52/d111/f125 0 2024-09-19T06:40:50.530 INFO:tasks.workunit.client.0.smithi099.stdout:6/884: creat d1/d5/d38/d76/db0/d54/d5d/d61/d65/dd3/f126 x:0 0 0 2024-09-19T06:40:50.536 INFO:tasks.workunit.client.0.smithi099.stdout:6/885: dwrite d1/d7c/fac [0,4194304] 0 2024-09-19T06:40:50.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:50 smithi117 ceph-mon[34564]: pgmap v23: 65 pgs: 65 active+clean; 3.4 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 102 MiB/s rd, 264 MiB/s wr, 515 op/s 2024-09-19T06:40:50.891 INFO:tasks.workunit.client.0.smithi099.stdout:2/731: sync 2024-09-19T06:40:50.893 INFO:tasks.workunit.client.0.smithi099.stdout:2/732: rmdir d1/d2/d4d/d55/da5/d9/d63/dc6/d77/d98 39 2024-09-19T06:40:50.902 INFO:tasks.workunit.client.0.smithi099.stdout:2/733: write d1/d2/d4d/d55/da5/d9/d63/dc6/d13/f54 [221730,42561] 0 2024-09-19T06:40:50.905 INFO:tasks.workunit.client.0.smithi099.stdout:2/734: creat d1/d2/d4d/d55/da5/d18/d2d/dd8/ff0 x:0 0 0 2024-09-19T06:40:50.906 INFO:tasks.workunit.client.0.smithi099.stdout:2/735: dread - d1/d2/d4d/d55/da5/d18/d2d/de3/fea zero size 2024-09-19T06:40:50.909 INFO:tasks.workunit.client.0.smithi099.stdout:2/736: getdents d1 0 2024-09-19T06:40:50.910 INFO:tasks.workunit.client.0.smithi099.stdout:2/737: rmdir d1/d2/d4d/d55/da5/d9/d63/dc6/d13 39 2024-09-19T06:40:50.911 INFO:tasks.workunit.client.0.smithi099.stdout:2/738: write d1/d2/d4d/d55/da5/d18/d27/d5b/d92/fd7 [263620,130588] 0 2024-09-19T06:40:50.914 INFO:tasks.workunit.client.0.smithi099.stdout:2/739: dread - d1/d2/d4d/d55/da5/d18/d46/d65/fc8 zero size 2024-09-19T06:40:50.918 INFO:tasks.workunit.client.0.smithi099.stdout:2/740: dwrite d1/d2/d4d/d55/da5/da8/fd9 [0,4194304] 0 2024-09-19T06:40:50.921 INFO:tasks.workunit.client.0.smithi099.stdout:2/741: write d1/d2/d4d/d55/da5/d9/d63/dc6/d13/f54 [372588,6099] 0 2024-09-19T06:40:50.924 INFO:tasks.workunit.client.0.smithi099.stdout:2/742: unlink d1/d2/f90 0 2024-09-19T06:40:50.926 INFO:tasks.workunit.client.0.smithi099.stdout:2/743: chown d1/d2/d4d/d55/da5/d9/d63/dc6/d6/ced 2151 1 2024-09-19T06:40:50.929 INFO:tasks.workunit.client.0.smithi099.stdout:2/744: symlink d1/d2/d4d/d55/da5/d18/d2d/de3/de6/lf1 0 2024-09-19T06:40:50.930 INFO:tasks.workunit.client.0.smithi099.stdout:2/745: readlink d1/d2/d4d/d55/da5/d18/d2d/de3/ldf 0 2024-09-19T06:40:50.931 INFO:tasks.workunit.client.0.smithi099.stdout:2/746: write d1/d2/d4d/d55/da5/d18/d27/dd6/fef [119669,110106] 0 2024-09-19T06:40:50.934 INFO:tasks.workunit.client.0.smithi099.stdout:2/747: symlink d1/d2/d4d/d55/da5/d9/d63/dc6/d13/de7/lf2 0 2024-09-19T06:40:50.936 INFO:tasks.workunit.client.0.smithi099.stdout:2/748: symlink d1/d2/d4d/d55/da5/d9/da3/lf3 0 2024-09-19T06:40:50.937 INFO:tasks.workunit.client.0.smithi099.stdout:2/749: readlink d1/d2/d4d/d55/da5/d9/da3/lc7 0 2024-09-19T06:40:50.948 INFO:tasks.workunit.client.0.smithi099.stdout:2/750: dwrite d1/d2/d4d/d55/da5/f2b [0,4194304] 0 2024-09-19T06:40:50.951 INFO:tasks.workunit.client.0.smithi099.stdout:2/751: creat d1/d2/d4d/d55/da5/d9/d63/dc6/d13/d2c/ff4 x:0 0 0 2024-09-19T06:40:50.956 INFO:tasks.workunit.client.0.smithi099.stdout:2/752: dread d1/d2/d4d/d55/feb [0,4194304] 0 2024-09-19T06:40:50.959 INFO:tasks.workunit.client.0.smithi099.stdout:2/753: symlink d1/d2/lf5 0 2024-09-19T06:40:50.961 INFO:tasks.workunit.client.0.smithi099.stdout:2/754: symlink d1/d2/d4d/d55/da5/d18/d2d/d9a/lf6 0 2024-09-19T06:40:50.962 INFO:tasks.workunit.client.0.smithi099.stdout:2/755: fsync d1/d2/d4d/f5e 0 2024-09-19T06:40:50.981 INFO:tasks.workunit.client.0.smithi099.stdout:2/756: dread d1/d2/d4d/d55/da5/d18/d2d/f62 [0,4194304] 0 2024-09-19T06:40:50.982 INFO:tasks.workunit.client.0.smithi099.stdout:2/757: chown d1/d2/d4d/d55/da5/d9/f67 4757 1 2024-09-19T06:40:50.984 INFO:tasks.workunit.client.0.smithi099.stdout:2/758: symlink d1/d2/d4d/lf7 0 2024-09-19T06:40:50.987 INFO:tasks.workunit.client.0.smithi099.stdout:2/759: truncate d1/d2/d4d/d55/da5/fac 3225828 0 2024-09-19T06:40:50.989 INFO:tasks.workunit.client.0.smithi099.stdout:2/760: mknod d1/d2/d4d/d55/da5/d18/d2d/d9a/cf8 0 2024-09-19T06:40:50.991 INFO:tasks.workunit.client.0.smithi099.stdout:2/761: creat d1/d2/d4d/d55/da5/d9/d63/dc6/d13/de7/ff9 x:0 0 0 2024-09-19T06:40:50.992 INFO:tasks.workunit.client.0.smithi099.stdout:2/762: fdatasync d1/d2/d4d/d55/da5/d18/f74 0 2024-09-19T06:40:50.997 INFO:tasks.workunit.client.0.smithi099.stdout:2/763: link d1/d2/d4d/d8e/fcc d1/d2/d4d/d55/ffa 0 2024-09-19T06:40:50.998 INFO:tasks.workunit.client.0.smithi099.stdout:5/997: sync 2024-09-19T06:40:51.007 INFO:tasks.workunit.client.0.smithi099.stdout:2/764: write d1/d2/d4d/d55/da5/d36/fa7 [303424,119136] 0 2024-09-19T06:40:51.007 INFO:tasks.workunit.client.0.smithi099.stdout:5/998: write d3/d16/f28 [4056218,38677] 0 2024-09-19T06:40:51.018 INFO:tasks.workunit.client.0.smithi099.stdout:2/765: dread d1/d2/d4d/d55/da5/d18/f2f [0,4194304] 0 2024-09-19T06:40:51.018 INFO:tasks.workunit.client.0.smithi099.stdout:5/999: dwrite d3/d16/d2f/d34/d3c/d65/dec/f133 [0,4194304] 0 2024-09-19T06:40:51.021 INFO:tasks.workunit.client.0.smithi099.stdout:2/766: dread d1/d2/d4d/d55/da5/d18/d2d/f62 [0,4194304] 0 2024-09-19T06:40:51.023 INFO:tasks.workunit.client.0.smithi099.stdout:2/767: rmdir d1/d2/d4d/d55/da5 39 2024-09-19T06:40:51.033 INFO:tasks.workunit.client.0.smithi099.stdout:2/768: truncate d1/d2/d4d/d55/da5/f2b 4081765 0 2024-09-19T06:40:51.035 INFO:tasks.workunit.client.0.smithi099.stdout:2/769: creat d1/d2/d4d/d55/da5/d18/d76/ffb x:0 0 0 2024-09-19T06:40:51.037 INFO:tasks.workunit.client.0.smithi099.stdout:2/770: mknod d1/d2/d4d/d55/da5/d18/d2d/de3/cfc 0 2024-09-19T06:40:51.042 INFO:tasks.workunit.client.0.smithi099.stdout:2/771: link d1/d2/d4d/d55/da5/c78 d1/d2/d4d/d55/da5/d9/d63/dc6/d13/d2c/cfd 0 2024-09-19T06:40:51.047 INFO:tasks.workunit.client.0.smithi099.stdout:6/886: sync 2024-09-19T06:40:51.047 INFO:tasks.workunit.client.0.smithi099.stdout:0/900: sync 2024-09-19T06:40:51.047 INFO:tasks.workunit.client.0.smithi099.stdout:8/948: sync 2024-09-19T06:40:51.047 INFO:tasks.workunit.client.0.smithi099.stdout:4/957: sync 2024-09-19T06:40:51.047 INFO:tasks.workunit.client.0.smithi099.stdout:1/821: sync 2024-09-19T06:40:51.048 INFO:tasks.workunit.client.0.smithi099.stdout:2/772: rename d1/d2/d4d/d55/da5/d9/d63/dc6/d13/d2c/f9f to d1/d2/d4d/d55/da5/da8/ffe 0 2024-09-19T06:40:51.049 INFO:tasks.workunit.client.0.smithi099.stdout:4/958: chown d12/d32/d12b/l10c 162229 1 2024-09-19T06:40:51.051 INFO:tasks.workunit.client.0.smithi099.stdout:1/822: truncate d0/d12/d54/f10a 135415 0 2024-09-19T06:40:51.058 INFO:tasks.workunit.client.0.smithi099.stdout:6/887: dread - d1/d5/d24/d2e/d41/d81/fd7 zero size 2024-09-19T06:40:51.058 INFO:tasks.workunit.client.0.smithi099.stdout:4/959: write d12/d32/d42/f67 [96764,122892] 0 2024-09-19T06:40:51.058 INFO:tasks.workunit.client.0.smithi099.stdout:0/901: write d0/db/d27/d5d/d87/da2/dbc/d37/d3c/d3e/ffe [66015,1733] 0 2024-09-19T06:40:51.060 INFO:tasks.workunit.client.0.smithi099.stdout:8/949: truncate d4/f17 66230 0 2024-09-19T06:40:51.063 INFO:tasks.workunit.client.0.smithi099.stdout:1/823: write d0/d17/d24/d3a/d58/d8d/dae/db8/f10b [452401,94136] 0 2024-09-19T06:40:51.065 INFO:tasks.workunit.client.0.smithi099.stdout:6/888: write d1/d5/d38/d76/db0/d54/d5d/d61/f8a [273498,46628] 0 2024-09-19T06:40:51.066 INFO:tasks.workunit.client.0.smithi099.stdout:2/773: dwrite d1/d2/d4d/d55/da5/d18/d27/d5b/d92/fbd [0,4194304] 0 2024-09-19T06:40:51.084 INFO:tasks.workunit.client.0.smithi099.stdout:4/960: write d12/d32/d42/f55 [1776950,85504] 0 2024-09-19T06:40:51.084 INFO:tasks.workunit.client.0.smithi099.stdout:8/950: creat d4/d5e/f137 x:0 0 0 2024-09-19T06:40:51.086 INFO:tasks.workunit.client.0.smithi099.stdout:0/902: truncate d0/db/d27/d5d/f81 1015473 0 2024-09-19T06:40:51.086 INFO:tasks.workunit.client.0.smithi099.stdout:1/824: creat d0/d2d/f10f x:0 0 0 2024-09-19T06:40:51.086 INFO:tasks.workunit.client.0.smithi099.stdout:0/903: fdatasync d0/f3 0 2024-09-19T06:40:51.088 INFO:tasks.workunit.client.0.smithi099.stdout:8/951: read d4/d11/d23/d92/fd4 [52222,51295] 0 2024-09-19T06:40:51.088 INFO:tasks.workunit.client.0.smithi099.stdout:4/961: creat d12/d82/ddd/d89/f139 x:0 0 0 2024-09-19T06:40:51.091 INFO:tasks.workunit.client.0.smithi099.stdout:6/889: rename d1/d5/d24/d2e/d41/d81/fe1 to d1/f127 0 2024-09-19T06:40:51.091 INFO:tasks.workunit.client.0.smithi099.stdout:8/952: mknod d4/de/c138 0 2024-09-19T06:40:51.092 INFO:tasks.workunit.client.0.smithi099.stdout:1/825: creat d0/d17/d32/d7b/db0/f110 x:0 0 0 2024-09-19T06:40:51.092 INFO:tasks.workunit.client.0.smithi099.stdout:8/953: readlink d4/l3d 0 2024-09-19T06:40:51.093 INFO:tasks.workunit.client.0.smithi099.stdout:4/962: unlink d12/d1b/d73/cea 0 2024-09-19T06:40:51.097 INFO:tasks.workunit.client.0.smithi099.stdout:2/774: rename d1/d2/d4d/f5e to d1/d2/d4d/d55/da5/d9/d63/dc6/d13/d2c/fff 0 2024-09-19T06:40:51.099 INFO:tasks.workunit.client.0.smithi099.stdout:1/826: write d0/d17/d32/d7b/d99/fa9 [1671721,125535] 0 2024-09-19T06:40:51.101 INFO:tasks.workunit.client.0.smithi099.stdout:8/954: creat d4/de/d26/d2b/d91/f139 x:0 0 0 2024-09-19T06:40:51.105 INFO:tasks.workunit.client.0.smithi099.stdout:6/890: link d1/d5/d38/d76/db0/d54/ff2 d1/d5/d38/dbb/d9c/d107/f128 0 2024-09-19T06:40:51.107 INFO:tasks.workunit.client.0.smithi099.stdout:4/963: dread d12/d32/d39/f90 [4194304,4194304] 0 2024-09-19T06:40:51.108 INFO:tasks.workunit.client.0.smithi099.stdout:1/827: rename d0/d17/d24/d3a/d58/ced to d0/d68/daf/d10e/c111 0 2024-09-19T06:40:51.109 INFO:tasks.workunit.client.0.smithi099.stdout:1/828: chown d0/d17/d24 1834991606 1 2024-09-19T06:40:51.109 INFO:tasks.workunit.client.0.smithi099.stdout:8/955: mkdir d4/d11/d23/d4c/d93/d104/deb/dfb/d13a 0 2024-09-19T06:40:51.110 INFO:tasks.workunit.client.0.smithi099.stdout:6/891: rmdir d1/d12/dda 39 2024-09-19T06:40:51.113 INFO:tasks.workunit.client.0.smithi099.stdout:8/956: mkdir d4/d66/d13b 0 2024-09-19T06:40:51.113 INFO:tasks.workunit.client.0.smithi099.stdout:0/904: dread d0/db/d27/d5d/d87/da2/dbc/d1f/d39/f66 [0,4194304] 0 2024-09-19T06:40:51.114 INFO:tasks.workunit.client.0.smithi099.stdout:1/829: dread - d0/d12/d13/d37/d41/d78/f8f zero size 2024-09-19T06:40:51.115 INFO:tasks.workunit.client.0.smithi099.stdout:8/957: symlink d4/d11/d23/d92/d126/l13c 0 2024-09-19T06:40:51.115 INFO:tasks.workunit.client.0.smithi099.stdout:6/892: creat d1/d5/d38/f129 x:0 0 0 2024-09-19T06:40:51.116 INFO:tasks.workunit.client.0.smithi099.stdout:0/905: creat d0/db/d27/d5d/d87/da2/dbc/d1f/d3a/dbf/f11e x:0 0 0 2024-09-19T06:40:51.117 INFO:tasks.workunit.client.0.smithi099.stdout:8/958: truncate d4/d11/d61/ff9 747897 0 2024-09-19T06:40:51.119 INFO:tasks.workunit.client.0.smithi099.stdout:8/959: dread - d4/d11/fd2 zero size 2024-09-19T06:40:51.122 INFO:tasks.workunit.client.0.smithi099.stdout:0/906: write d0/db/d27/d5d/d87/da2/dbc/d1f/d4a/d61/ffd [584453,53785] 0 2024-09-19T06:40:51.122 INFO:tasks.workunit.client.0.smithi099.stdout:0/907: dread - d0/db/dc0/fd6 zero size 2024-09-19T06:40:51.124 INFO:tasks.workunit.client.0.smithi099.stdout:6/893: getdents d1/d5/d38/d76/db0/d2a 0 2024-09-19T06:40:51.127 INFO:tasks.workunit.client.0.smithi099.stdout:6/894: fdatasync d1/d5/d38/d76/db0/d2a/f55 0 2024-09-19T06:40:51.130 INFO:tasks.workunit.client.0.smithi099.stdout:8/960: dwrite d4/d11/d23/d92/fd4 [0,4194304] 0 2024-09-19T06:40:51.132 INFO:tasks.workunit.client.0.smithi099.stdout:1/830: dread d0/db/f23 [0,4194304] 0 2024-09-19T06:40:51.141 INFO:tasks.workunit.client.0.smithi099.stdout:2/775: dwrite d1/d2/d4d/d55/da5/d9/d63/dc6/d13/d2c/f38 [0,4194304] 0 2024-09-19T06:40:51.146 INFO:tasks.workunit.client.0.smithi099.stdout:6/895: dread d1/f1d [0,4194304] 0 2024-09-19T06:40:51.151 INFO:tasks.workunit.client.0.smithi099.stdout:8/961: dwrite d4/d11/d23/d4c/ddd/ffd [0,4194304] 0 2024-09-19T06:40:51.152 INFO:tasks.workunit.client.0.smithi099.stdout:2/776: chown d1/d2/d4d/d55/da5/d18/d27/d5b/dd4/fdc 23994 1 2024-09-19T06:40:51.152 INFO:tasks.workunit.client.0.smithi099.stdout:1/831: dwrite d0/d17/d24/d5e/ffe [0,4194304] 0 2024-09-19T06:40:51.155 INFO:tasks.workunit.client.0.smithi099.stdout:6/896: creat d1/d5/d24/d2b/d86/de0/f12a x:0 0 0 2024-09-19T06:40:51.156 INFO:tasks.workunit.client.0.smithi099.stdout:8/962: write d4/d66/fbd [2697204,124113] 0 2024-09-19T06:40:51.158 INFO:tasks.workunit.client.0.smithi099.stdout:1/832: stat d0/d17/d24/d75/dbb/de1 0 2024-09-19T06:40:51.160 INFO:tasks.workunit.client.0.smithi099.stdout:1/833: read d0/d12/d13/d37/d41/fc6 [3773075,117890] 0 2024-09-19T06:40:51.163 INFO:tasks.workunit.client.0.smithi099.stdout:6/897: symlink d1/d5/d38/d76/db0/l12b 0 2024-09-19T06:40:51.176 INFO:tasks.workunit.client.0.smithi099.stdout:2/777: write d1/d2/d4d/d55/da5/d18/d27/d5b/f8c [1395097,119717] 0 2024-09-19T06:40:51.179 INFO:tasks.workunit.client.0.smithi099.stdout:6/898: write d1/d5/d24/d2e/d41/d81/fd7 [486655,130001] 0 2024-09-19T06:40:51.179 INFO:tasks.workunit.client.0.smithi099.stdout:2/778: creat d1/d2/d4d/d8e/f100 x:0 0 0 2024-09-19T06:40:51.179 INFO:tasks.workunit.client.0.smithi099.stdout:6/899: readlink d1/d5/l92 0 2024-09-19T06:40:51.183 INFO:tasks.workunit.client.0.smithi099.stdout:2/779: mkdir d1/d2/d4d/d55/da5/d9/d63/dc6/d13/d2c/d101 0 2024-09-19T06:40:51.185 INFO:tasks.workunit.client.0.smithi099.stdout:6/900: write d1/f4f [4426247,47871] 0 2024-09-19T06:40:51.187 INFO:tasks.workunit.client.0.smithi099.stdout:2/780: creat d1/d2/d4d/d55/da5/d18/d2d/dd8/f102 x:0 0 0 2024-09-19T06:40:51.188 INFO:tasks.workunit.client.0.smithi099.stdout:6/901: write d1/f127 [835463,25886] 0 2024-09-19T06:40:51.190 INFO:tasks.workunit.client.0.smithi099.stdout:8/963: dread d4/de/d1c/f6b [0,4194304] 0 2024-09-19T06:40:51.191 INFO:tasks.workunit.client.0.smithi099.stdout:6/902: fdatasync d1/d5/d38/d76/db0/f11e 0 2024-09-19T06:40:51.191 INFO:tasks.workunit.client.0.smithi099.stdout:8/964: chown d4/d11/d23 0 1 2024-09-19T06:40:51.193 INFO:tasks.workunit.client.0.smithi099.stdout:8/965: write d4/de/d10/f68 [4523913,130326] 0 2024-09-19T06:40:51.193 INFO:tasks.workunit.client.0.smithi099.stdout:2/781: write d1/d2/d4d/d55/da5/d9/d63/dc6/d13/d2c/f70 [1938315,95071] 0 2024-09-19T06:40:51.196 INFO:tasks.workunit.client.0.smithi099.stdout:6/903: unlink d1/d5/d24/d2b/dc2/cd0 0 2024-09-19T06:40:51.197 INFO:tasks.workunit.client.0.smithi099.stdout:2/782: write d1/d2/d4d/d55/da5/d18/d46/d65/fc8 [107165,9469] 0 2024-09-19T06:40:51.197 INFO:tasks.workunit.client.0.smithi099.stdout:8/966: creat d4/de/d26/d2b/f13d x:0 0 0 2024-09-19T06:40:51.200 INFO:tasks.workunit.client.0.smithi099.stdout:8/967: mkdir d4/d66/d13e 0 2024-09-19T06:40:51.205 INFO:tasks.workunit.client.0.smithi099.stdout:6/904: dwrite d1/f127 [0,4194304] 0 2024-09-19T06:40:51.206 INFO:tasks.workunit.client.0.smithi099.stdout:8/968: getdents d4/d11/d23/d4c/d93/d12a 0 2024-09-19T06:40:51.207 INFO:tasks.workunit.client.0.smithi099.stdout:8/969: readlink d4/de/d26/d2b/d91/ld0 0 2024-09-19T06:40:51.209 INFO:tasks.workunit.client.0.smithi099.stdout:2/783: truncate d1/d2/d4d/d55/da5/d9/f3c 1178107 0 2024-09-19T06:40:51.211 INFO:tasks.workunit.client.0.smithi099.stdout:8/970: rename d4/c15 to d4/d11/d23/d4c/ddd/c13f 0 2024-09-19T06:40:51.211 INFO:tasks.workunit.client.0.smithi099.stdout:2/784: symlink d1/d2/d4d/d55/da5/d18/d46/l103 0 2024-09-19T06:40:51.214 INFO:tasks.workunit.client.0.smithi099.stdout:6/905: rename d1/d5/d38/d76/db0/d54/fd1 to d1/d5/d24/d2e/d41/d81/f12c 0 2024-09-19T06:40:51.215 INFO:tasks.workunit.client.0.smithi099.stdout:2/785: unlink d1/d2/fde 0 2024-09-19T06:40:51.215 INFO:tasks.workunit.client.0.smithi099.stdout:6/906: chown d1/d5/d38/dbb/fd5 6053 1 2024-09-19T06:40:51.217 INFO:tasks.workunit.client.0.smithi099.stdout:6/907: unlink d1/d12/lce 0 2024-09-19T06:40:51.221 INFO:tasks.workunit.client.0.smithi099.stdout:2/786: read d1/d2/d4d/d55/da5/d9/d63/dc6/d13/f1b [953818,90704] 0 2024-09-19T06:40:51.232 INFO:tasks.workunit.client.0.smithi099.stdout:2/787: dwrite d1/d2/d4d/d55/da5/d9/d63/dc6/d13/d2c/f38 [0,4194304] 0 2024-09-19T06:40:51.235 INFO:tasks.workunit.client.0.smithi099.stdout:8/971: dread d4/de/d26/d2b/f32 [0,4194304] 0 2024-09-19T06:40:51.236 INFO:tasks.workunit.client.0.smithi099.stdout:8/972: chown d4/de/fa0 2895 1 2024-09-19T06:40:51.236 INFO:tasks.workunit.client.0.smithi099.stdout:2/788: unlink d1/d2/d4d/d55/da5/d9/d63/dc6/d77/d98/cca 0 2024-09-19T06:40:51.239 INFO:tasks.workunit.client.0.smithi099.stdout:8/973: symlink d4/d101/d128/l140 0 2024-09-19T06:40:51.240 INFO:tasks.workunit.client.0.smithi099.stdout:2/789: symlink d1/d2/d4d/d55/da5/d18/d27/d5b/l104 0 2024-09-19T06:40:51.240 INFO:tasks.workunit.client.0.smithi099.stdout:8/974: rmdir d4/de/d1c/d99 39 2024-09-19T06:40:51.241 INFO:tasks.workunit.client.0.smithi099.stdout:2/790: stat d1/d2/d4d/d55/da5/d9/d63/dc6/d77/fd2 0 2024-09-19T06:40:51.242 INFO:tasks.workunit.client.0.smithi099.stdout:8/975: chown d4/de/d26/d2b/d91/f139 12570 1 2024-09-19T06:40:51.244 INFO:tasks.workunit.client.0.smithi099.stdout:2/791: mknod d1/d2/d4d/d8e/db6/c105 0 2024-09-19T06:40:51.245 INFO:tasks.workunit.client.0.smithi099.stdout:6/908: dread d1/d5/d38/d76/db0/d2a/f8b [0,4194304] 0 2024-09-19T06:40:51.246 INFO:tasks.workunit.client.0.smithi099.stdout:6/909: fdatasync d1/d12/f1f 0 2024-09-19T06:40:51.246 INFO:tasks.workunit.client.0.smithi099.stdout:2/792: fsync d1/d2/d4d/d55/da5/d36/f45 0 2024-09-19T06:40:51.248 INFO:tasks.workunit.client.0.smithi099.stdout:2/793: chown d1/d2/d4d/d55/da5/d18/d27/lce 243402 1 2024-09-19T06:40:51.253 INFO:tasks.workunit.client.0.smithi099.stdout:8/976: truncate d4/d11/d23/d92/fd4 3270274 0 2024-09-19T06:40:51.254 INFO:tasks.workunit.client.0.smithi099.stdout:6/910: write d1/d5/d38/dbb/d9c/d107/f128 [1083673,65081] 0 2024-09-19T06:40:51.256 INFO:tasks.workunit.client.0.smithi099.stdout:8/977: unlink d4/de/c8f 0 2024-09-19T06:40:51.256 INFO:tasks.workunit.client.0.smithi099.stdout:2/794: dwrite d1/d2/d4d/d55/da5/d18/d27/d5b/f7e [4194304,4194304] 0 2024-09-19T06:40:51.264 INFO:tasks.workunit.client.0.smithi099.stdout:6/911: rename d1/d5/d38/d76/db0/d54/d5d/d61/f7d to d1/d5/d38/d76/db0/d54/f12d 0 2024-09-19T06:40:51.267 INFO:tasks.workunit.client.0.smithi099.stdout:6/912: mknod d1/d5/d38/d76/db0/d2a/c12e 0 2024-09-19T06:40:51.268 INFO:tasks.workunit.client.0.smithi099.stdout:8/978: dwrite d4/de/d26/d2b/f52 [0,4194304] 0 2024-09-19T06:40:51.268 INFO:tasks.workunit.client.0.smithi099.stdout:6/913: fdatasync d1/d5/d38/f106 0 2024-09-19T06:40:51.275 INFO:tasks.workunit.client.0.smithi099.stdout:2/795: truncate d1/d2/d4d/d55/da5/d36/f8a 1713126 0 2024-09-19T06:40:51.278 INFO:tasks.workunit.client.0.smithi099.stdout:2/796: symlink d1/d2/d4d/d55/da5/d9/d63/l106 0 2024-09-19T06:40:51.280 INFO:tasks.workunit.client.0.smithi099.stdout:2/797: mknod d1/d2/d4d/d8e/db6/c107 0 2024-09-19T06:40:51.281 INFO:tasks.workunit.client.0.smithi099.stdout:6/914: write d1/d5/d24/f89 [2220240,125466] 0 2024-09-19T06:40:51.284 INFO:tasks.workunit.client.0.smithi099.stdout:2/798: creat d1/d2/d4d/d55/da5/d18/d2d/dd8/f108 x:0 0 0 2024-09-19T06:40:51.284 INFO:tasks.workunit.client.0.smithi099.stdout:6/915: creat d1/d5/d24/d2b/d86/da5/f12f x:0 0 0 2024-09-19T06:40:51.290 INFO:tasks.workunit.client.0.smithi099.stdout:2/799: rename d1/d2/d4d/d55/da5/d9/d63/dc6/d13/de7/ff9 to d1/d2/f109 0 2024-09-19T06:40:51.292 INFO:tasks.workunit.client.0.smithi099.stdout:8/979: dread d4/d66/fbd [0,4194304] 0 2024-09-19T06:40:51.294 INFO:tasks.workunit.client.0.smithi099.stdout:6/916: write d1/d5/d52/fb2 [99483,103272] 0 2024-09-19T06:40:51.294 INFO:tasks.workunit.client.0.smithi099.stdout:2/800: mkdir d1/d2/d4d/d55/da5/d18/d27/ddd/d10a 0 2024-09-19T06:40:51.296 INFO:tasks.workunit.client.0.smithi099.stdout:2/801: mknod d1/d2/d4d/c10b 0 2024-09-19T06:40:51.299 INFO:tasks.workunit.client.0.smithi099.stdout:6/917: truncate d1/d5/d38/d76/db0/d54/d5d/d61/f8a 4344154 0 2024-09-19T06:40:51.299 INFO:tasks.workunit.client.0.smithi099.stdout:8/980: dread d4/d11/d23/d92/f120 [0,4194304] 0 2024-09-19T06:40:51.302 INFO:tasks.workunit.client.0.smithi099.stdout:6/918: creat d1/d12/f130 x:0 0 0 2024-09-19T06:40:51.305 INFO:tasks.workunit.client.0.smithi099.stdout:6/919: chown d1/d5/d24/d2b/d86/de0/fe5 269 1 2024-09-19T06:40:51.305 INFO:tasks.workunit.client.0.smithi099.stdout:2/802: dwrite d1/d2/d4d/d55/da5/d36/f41 [0,4194304] 0 2024-09-19T06:40:51.311 INFO:tasks.workunit.client.0.smithi099.stdout:6/920: symlink d1/d5/d38/d76/db0/d54/l131 0 2024-09-19T06:40:51.314 INFO:tasks.workunit.client.0.smithi099.stdout:6/921: mkdir d1/d5/d132 0 2024-09-19T06:40:51.317 INFO:tasks.workunit.client.0.smithi099.stdout:6/922: creat d1/d5/d38/d76/db0/d54/f133 x:0 0 0 2024-09-19T06:40:51.320 INFO:tasks.workunit.client.0.smithi099.stdout:6/923: fdatasync d1/d5/d38/d76/db0/d54/fb3 0 2024-09-19T06:40:51.321 INFO:tasks.workunit.client.0.smithi099.stdout:8/981: dread d4/d11/d23/d4c/daf/fcc [0,4194304] 0 2024-09-19T06:40:51.322 INFO:tasks.workunit.client.0.smithi099.stdout:2/803: write d1/d2/d4d/d55/da5/da8/fd9 [4985559,126351] 0 2024-09-19T06:40:51.327 INFO:tasks.workunit.client.0.smithi099.stdout:6/924: getdents d1 0 2024-09-19T06:40:51.328 INFO:tasks.workunit.client.0.smithi099.stdout:2/804: mknod d1/d2/d4d/d55/da5/c10c 0 2024-09-19T06:40:51.331 INFO:tasks.workunit.client.0.smithi099.stdout:2/805: read d1/d2/f1f [17590,6025] 0 2024-09-19T06:40:51.333 INFO:tasks.workunit.client.0.smithi099.stdout:8/982: dwrite d4/d11/d23/d4c/d93/d104/fe7 [0,4194304] 0 2024-09-19T06:40:51.338 INFO:tasks.workunit.client.0.smithi099.stdout:6/925: dwrite d1/d5/d24/d2e/d41/d81/dfe/f122 [0,4194304] 0 2024-09-19T06:40:51.347 INFO:tasks.workunit.client.0.smithi099.stdout:2/806: truncate d1/d2/d4d/d55/da5/d36/f8a 1619688 0 2024-09-19T06:40:51.347 INFO:tasks.workunit.client.0.smithi099.stdout:8/983: dwrite d4/de/d10/f68 [0,4194304] 0 2024-09-19T06:40:51.349 INFO:tasks.workunit.client.0.smithi099.stdout:2/807: truncate d1/d2/fc0 5127360 0 2024-09-19T06:40:51.351 INFO:tasks.workunit.client.0.smithi099.stdout:2/808: truncate d1/d2/d4d/d55/da5/da8/fd9 5959716 0 2024-09-19T06:40:51.370 INFO:tasks.workunit.client.0.smithi099.stdout:6/926: write d1/d5/d38/d76/db0/d54/d5d/d61/f10a [944382,101388] 0 2024-09-19T06:40:51.371 INFO:tasks.workunit.client.0.smithi099.stdout:2/809: write d1/d2/d4d/d55/da5/d9/f3c [1230668,44327] 0 2024-09-19T06:40:51.373 INFO:tasks.workunit.client.0.smithi099.stdout:2/810: fsync d1/d2/d4d/d55/feb 0 2024-09-19T06:40:51.374 INFO:tasks.workunit.client.0.smithi099.stdout:6/927: creat d1/d5/d24/d2b/d86/de0/f134 x:0 0 0 2024-09-19T06:40:51.376 INFO:tasks.workunit.client.0.smithi099.stdout:2/811: creat d1/d2/d4d/d55/da5/d9/d63/dc6/d13/d2c/d101/f10d x:0 0 0 2024-09-19T06:40:51.377 INFO:tasks.workunit.client.0.smithi099.stdout:6/928: symlink d1/d5/d24/d2b/l135 0 2024-09-19T06:40:51.381 INFO:tasks.workunit.client.0.smithi099.stdout:6/929: rename d1/d5/d38/d76/db0/d54/f123 to d1/d5/d52/f136 0 2024-09-19T06:40:51.382 INFO:tasks.workunit.client.0.smithi099.stdout:2/812: write d1/d2/d4d/d55/da5/d9/d63/dc6/f40 [1381621,83036] 0 2024-09-19T06:40:51.385 INFO:tasks.workunit.client.0.smithi099.stdout:6/930: rename d1/d12/l62 to d1/d5/d24/d2b/d86/l137 0 2024-09-19T06:40:51.385 INFO:tasks.workunit.client.0.smithi099.stdout:2/813: mknod d1/d2/d4d/d55/da5/d18/d46/c10e 0 2024-09-19T06:40:51.386 INFO:tasks.workunit.client.0.smithi099.stdout:6/931: write d1/f10 [4703977,82520] 0 2024-09-19T06:40:51.387 INFO:tasks.workunit.client.0.smithi099.stdout:6/932: dread - d1/d5/d24/d2e/d41/ff6 zero size 2024-09-19T06:40:51.390 INFO:tasks.workunit.client.0.smithi099.stdout:2/814: getdents d1/d2/d4d/d8e 0 2024-09-19T06:40:51.391 INFO:tasks.workunit.client.0.smithi099.stdout:6/933: mkdir d1/d5/d38/dbb/d9c/d107/d138 0 2024-09-19T06:40:51.392 INFO:tasks.workunit.client.0.smithi099.stdout:2/815: stat d1/d2/d4d/d55/da5/d18/d2d/d88/l91 0 2024-09-19T06:40:51.394 INFO:tasks.workunit.client.0.smithi099.stdout:6/934: getdents d1/d5/d24/d2e/d41/d81/dfe 0 2024-09-19T06:40:51.395 INFO:tasks.workunit.client.0.smithi099.stdout:2/816: truncate d1/d2/d4d/d55/da5/d9/d63/dc6/d13/d2c/d101/f10d 783040 0 2024-09-19T06:40:51.396 INFO:tasks.workunit.client.0.smithi099.stdout:6/935: creat d1/d7c/f139 x:0 0 0 2024-09-19T06:40:51.397 INFO:tasks.workunit.client.0.smithi099.stdout:6/936: write d1/d12/f130 [370922,25323] 0 2024-09-19T06:40:51.398 INFO:tasks.workunit.client.0.smithi099.stdout:2/817: mkdir d1/d2/d4d/d55/da5/d18/d10f 0 2024-09-19T06:40:51.399 INFO:tasks.workunit.client.0.smithi099.stdout:6/937: mknod d1/d5/d38/dbb/d9c/d107/d138/c13a 0 2024-09-19T06:40:51.401 INFO:tasks.workunit.client.0.smithi099.stdout:6/938: stat d1/d5/d38/f59 0 2024-09-19T06:40:51.401 INFO:tasks.workunit.client.0.smithi099.stdout:6/939: stat d1/d5/la 0 2024-09-19T06:40:51.402 INFO:tasks.workunit.client.0.smithi099.stdout:2/818: rename d1/d2/d4d/d8e/db6 to d1/d2/d4d/d55/da5/d36/d110 0 2024-09-19T06:40:51.405 INFO:tasks.workunit.client.0.smithi099.stdout:2/819: creat d1/d2/d4d/d55/da5/d9/db7/f111 x:0 0 0 2024-09-19T06:40:51.408 INFO:tasks.workunit.client.0.smithi099.stdout:6/940: dwrite d1/d5/d38/d76/db0/d2a/fc5 [0,4194304] 0 2024-09-19T06:40:51.412 INFO:tasks.workunit.client.0.smithi099.stdout:2/820: rename d1/d2/d4d/d55/da5/d9/c59 to d1/d2/d4d/d55/da5/d18/d2d/de3/c112 0 2024-09-19T06:40:51.412 INFO:tasks.workunit.client.0.smithi099.stdout:6/941: creat d1/d5/d24/d2b/f13b x:0 0 0 2024-09-19T06:40:51.415 INFO:tasks.workunit.client.0.smithi099.stdout:2/821: creat d1/d2/d4d/d55/da5/d18/d27/d5b/dd4/f113 x:0 0 0 2024-09-19T06:40:51.416 INFO:tasks.workunit.client.0.smithi099.stdout:6/942: getdents d1/d5/d24/d2e/d7b/dba 0 2024-09-19T06:40:51.422 INFO:tasks.workunit.client.0.smithi099.stdout:2/822: rename d1/d2/d4d/d55/da5/d9/c82 to d1/d2/d4d/d55/da5/d18/d27/ddd/c114 0 2024-09-19T06:40:51.425 INFO:tasks.workunit.client.0.smithi099.stdout:2/823: write d1/d2/d4d/d55/da5/d18/d27/d5b/d92/fd7 [1239828,98692] 0 2024-09-19T06:40:51.427 INFO:tasks.workunit.client.0.smithi099.stdout:2/824: rmdir d1/d2/d4d/d55/da5/d18/d2d/de3 39 2024-09-19T06:40:51.429 INFO:tasks.workunit.client.0.smithi099.stdout:6/943: truncate d1/d5/d38/dbb/d9c/d107/f128 934124 0 2024-09-19T06:40:51.430 INFO:tasks.workunit.client.0.smithi099.stdout:2/825: mknod d1/d2/d4d/d55/da5/d18/d2d/de3/c115 0 2024-09-19T06:40:51.435 INFO:tasks.workunit.client.0.smithi099.stdout:6/944: write d1/d5/d38/dbb/fbe [325940,88990] 0 2024-09-19T06:40:51.438 INFO:tasks.workunit.client.0.smithi099.stdout:2/826: dwrite d1/d2/d4d/d55/da5/d18/d2d/de3/fa1 [0,4194304] 0 2024-09-19T06:40:51.442 INFO:tasks.workunit.client.0.smithi099.stdout:6/945: dread d1/d5/d24/d2b/f58 [0,4194304] 0 2024-09-19T06:40:51.443 INFO:tasks.workunit.client.0.smithi099.stdout:6/946: readlink d1/d5/d24/d2b/d86/la8 0 2024-09-19T06:40:51.444 INFO:tasks.workunit.client.0.smithi099.stdout:6/947: chown d1/d5/d38/d76 19 1 2024-09-19T06:40:51.446 INFO:tasks.workunit.client.0.smithi099.stdout:2/827: rename d1/d2/d4d/d55/da5/d18/d2d/d88/l91 to d1/d2/d4d/d55/da5/d18/d2d/l116 0 2024-09-19T06:40:51.447 INFO:tasks.workunit.client.0.smithi099.stdout:6/948: symlink d1/d5/d38/d76/db0/d54/d5d/d61/d65/dd3/l13c 0 2024-09-19T06:40:51.449 INFO:tasks.workunit.client.0.smithi099.stdout:2/828: symlink d1/d2/d4d/d55/da5/d36/d110/l117 0 2024-09-19T06:40:51.455 INFO:tasks.workunit.client.0.smithi099.stdout:2/829: link d1/d2/d4d/d55/da5/d9/d63/dc6/d13/d2c/l73 d1/d2/d4d/l118 0 2024-09-19T06:40:51.458 INFO:tasks.workunit.client.0.smithi099.stdout:2/830: truncate d1/d2/d4d/d55/da5/d18/d2d/dd8/f108 79116 0 2024-09-19T06:40:51.462 INFO:tasks.workunit.client.0.smithi099.stdout:6/949: truncate d1/d5/d38/d76/db0/d54/d5d/d61/fc4 1317925 0 2024-09-19T06:40:51.463 INFO:tasks.workunit.client.0.smithi099.stdout:2/831: getdents d1/d2/d4d/d55/da5/d18/d2d/dd8 0 2024-09-19T06:40:51.467 INFO:tasks.workunit.client.0.smithi099.stdout:2/832: rmdir d1/d2/d4d/d55/da5/d18/d27/ddd 39 2024-09-19T06:40:51.469 INFO:tasks.workunit.client.0.smithi099.stdout:1/834: sync 2024-09-19T06:40:51.470 INFO:tasks.workunit.client.0.smithi099.stdout:4/964: sync 2024-09-19T06:40:51.470 INFO:tasks.workunit.client.0.smithi099.stdout:0/908: sync 2024-09-19T06:40:51.470 INFO:tasks.workunit.client.0.smithi099.stdout:8/984: sync 2024-09-19T06:40:51.470 INFO:tasks.workunit.client.0.smithi099.stdout:2/833: unlink d1/d2/d4d/d8e/fcc 0 2024-09-19T06:40:51.473 INFO:tasks.workunit.client.0.smithi099.stdout:8/985: rmdir d4/d11/d61 39 2024-09-19T06:40:51.476 INFO:tasks.workunit.client.0.smithi099.stdout:4/965: read d12/d115/d126/d51/de8/fc9 [1772828,92079] 0 2024-09-19T06:40:51.479 INFO:tasks.workunit.client.0.smithi099.stdout:0/909: rename d0/db/d27/d5d/d87/da2/dbc/d1f/d8e to d0/db/dc0/d11f 0 2024-09-19T06:40:51.480 INFO:tasks.workunit.client.0.smithi099.stdout:1/835: dread d0/d12/d13/d37/d41/fc6 [0,4194304] 0 2024-09-19T06:40:51.481 INFO:tasks.workunit.client.0.smithi099.stdout:2/834: write d1/d2/d4d/d55/da5/d18/d2d/d88/f96 [894523,104160] 0 2024-09-19T06:40:51.482 INFO:tasks.workunit.client.0.smithi099.stdout:4/966: write d12/d32/f2e [3939120,79070] 0 2024-09-19T06:40:51.483 INFO:tasks.workunit.client.0.smithi099.stdout:8/986: mkdir d4/d11/d61/dee/dda/d141 0 2024-09-19T06:40:51.484 INFO:tasks.workunit.client.0.smithi099.stdout:4/967: chown d12/d58/l68 63 1 2024-09-19T06:40:51.485 INFO:tasks.workunit.client.0.smithi099.stdout:1/836: symlink d0/d17/d32/d7b/d99/l112 0 2024-09-19T06:40:51.486 INFO:tasks.workunit.client.0.smithi099.stdout:6/950: dread d1/d5/d38/d76/db0/d54/d5d/d61/f68 [0,4194304] 0 2024-09-19T06:40:51.486 INFO:tasks.workunit.client.0.smithi099.stdout:8/987: write d4/d5e/f137 [751926,133] 0 2024-09-19T06:40:51.488 INFO:tasks.workunit.client.0.smithi099.stdout:2/835: write d1/fa9 [2954237,6417] 0 2024-09-19T06:40:51.493 INFO:tasks.workunit.client.0.smithi099.stdout:8/988: write d4/d11/d61/dee/dde/f10d [2208683,116596] 0 2024-09-19T06:40:51.495 INFO:tasks.workunit.client.0.smithi099.stdout:2/836: mknod d1/d2/d4d/d55/da5/d18/d2d/de3/de6/c119 0 2024-09-19T06:40:51.496 INFO:tasks.workunit.client.0.smithi099.stdout:8/989: fdatasync d4/d66/f71 0 2024-09-19T06:40:51.497 INFO:tasks.workunit.client.0.smithi099.stdout:6/951: unlink d1/d5/d38/d76/db0/d54/d5d/c93 0 2024-09-19T06:40:51.504 INFO:tasks.workunit.client.0.smithi099.stdout:1/837: dwrite d0/d68/daf/fdf [0,4194304] 0 2024-09-19T06:40:51.506 INFO:tasks.workunit.client.0.smithi099.stdout:4/968: dread d12/d58/f96 [0,4194304] 0 2024-09-19T06:40:51.506 INFO:tasks.workunit.client.0.smithi099.stdout:8/990: symlink d4/de/d10/dfe/l142 0 2024-09-19T06:40:51.510 INFO:tasks.workunit.client.0.smithi099.stdout:8/991: creat d4/de/d26/d8d/f143 x:0 0 0 2024-09-19T06:40:51.511 INFO:tasks.workunit.client.0.smithi099.stdout:1/838: rmdir d0/d12/d13/d37/d48 39 2024-09-19T06:40:51.516 INFO:tasks.workunit.client.0.smithi099.stdout:4/969: mkdir d12/d1b/d88/d114/d13a 0 2024-09-19T06:40:51.518 INFO:tasks.workunit.client.0.smithi099.stdout:8/992: mkdir d4/d11/d23/d4c/d93/d12a/d144 0 2024-09-19T06:40:51.520 INFO:tasks.workunit.client.0.smithi099.stdout:6/952: truncate d1/d5/d24/d2e/d41/f5a 3488870 0 2024-09-19T06:40:51.520 INFO:tasks.workunit.client.0.smithi099.stdout:2/837: getdents d1/d2/d4d/d55/da5/d9/d63/dc6/d6 0 2024-09-19T06:40:51.523 INFO:tasks.workunit.client.0.smithi099.stdout:0/910: dread d0/f3 [4194304,4194304] 0 2024-09-19T06:40:51.524 INFO:tasks.workunit.client.0.smithi099.stdout:4/970: fsync d12/d115/d126/d9d/fb2 0 2024-09-19T06:40:51.524 INFO:tasks.workunit.client.0.smithi099.stdout:6/953: stat d1/d5/d24/d2e/d41/ff6 0 2024-09-19T06:40:51.527 INFO:tasks.workunit.client.0.smithi099.stdout:1/839: dwrite d0/d17/d32/d7b/d99/fa9 [4194304,4194304] 0 2024-09-19T06:40:51.530 INFO:tasks.workunit.client.0.smithi099.stdout:8/993: truncate d4/d11/d23/d92/fa4 573283 0 2024-09-19T06:40:51.533 INFO:tasks.workunit.client.0.smithi099.stdout:4/971: mkdir d12/d115/d126/d13b 0 2024-09-19T06:40:51.534 INFO:tasks.workunit.client.0.smithi099.stdout:2/838: creat d1/d2/d4d/d55/da5/d9/d63/dc6/d13/de7/f11a x:0 0 0 2024-09-19T06:40:51.534 INFO:tasks.workunit.client.0.smithi099.stdout:8/994: stat d4/de/d26/d2b/dba 0 2024-09-19T06:40:51.537 INFO:tasks.workunit.client.0.smithi099.stdout:4/972: chown d12/d32/d39/l85 20537947 1 2024-09-19T06:40:51.540 INFO:tasks.workunit.client.0.smithi099.stdout:6/954: creat d1/d5/d38/d76/db0/d54/d5d/f13d x:0 0 0 2024-09-19T06:40:51.543 INFO:tasks.workunit.client.0.smithi099.stdout:6/955: read - d1/d5/d24/d2b/d86/de0/f12a zero size 2024-09-19T06:40:51.544 INFO:tasks.workunit.client.0.smithi099.stdout:1/840: getdents d0/d17/d24 0 2024-09-19T06:40:51.545 INFO:tasks.workunit.client.0.smithi099.stdout:6/956: chown d1/d5/d24/d2b/f13b 2393 1 2024-09-19T06:40:51.545 INFO:tasks.workunit.client.0.smithi099.stdout:1/841: chown d0/d17/d24 91316646 1 2024-09-19T06:40:51.547 INFO:tasks.workunit.client.0.smithi099.stdout:8/995: dread d4/de/fb7 [0,4194304] 0 2024-09-19T06:40:51.548 INFO:tasks.workunit.client.0.smithi099.stdout:0/911: rename d0/db/d27/d5d/d87/da2/dbc/d37/d3c/d3e/fa3 to d0/db/d27/d5d/d87/da2/dbc/d37/d3c/d3e/f120 0 2024-09-19T06:40:51.548 INFO:tasks.workunit.client.0.smithi099.stdout:1/842: write d0/d17/d24/d5e/fca [543680,23222] 0 2024-09-19T06:40:51.549 INFO:tasks.workunit.client.0.smithi099.stdout:2/839: link d1/d2/d4d/d55/da5/d9/f67 d1/d2/d4d/d55/da5/d18/d27/d5b/f11b 0 2024-09-19T06:40:51.549 INFO:tasks.workunit.client.0.smithi099.stdout:6/957: write d1/d5/d24/d2e/d7b/dba/fe2 [41312,32702] 0 2024-09-19T06:40:51.550 INFO:tasks.workunit.client.0.smithi099.stdout:0/912: fdatasync d0/f57 0 2024-09-19T06:40:51.555 INFO:tasks.workunit.client.0.smithi099.stdout:0/913: fsync d0/d17/d41/f108 0 2024-09-19T06:40:51.557 INFO:tasks.workunit.client.0.smithi099.stdout:0/914: stat d0/db/d36/db1/cb3 0 2024-09-19T06:40:51.560 INFO:tasks.workunit.client.0.smithi099.stdout:2/840: dread d1/d2/d4d/d55/da5/da8/fd9 [0,4194304] 0 2024-09-19T06:40:51.562 INFO:tasks.workunit.client.0.smithi099.stdout:1/843: getdents d0/d17/d32 0 2024-09-19T06:40:51.568 INFO:tasks.workunit.client.0.smithi099.stdout:0/915: rename d0/d112/d75/da4/dcf/fd9 to d0/db/d36/d3f/f121 0 2024-09-19T06:40:51.568 INFO:tasks.workunit.client.0.smithi099.stdout:4/973: dwrite d12/d1b/da4/faf [0,4194304] 0 2024-09-19T06:40:51.571 INFO:tasks.workunit.client.0.smithi099.stdout:1/844: read d0/d12/f30 [422513,73962] 0 2024-09-19T06:40:51.577 INFO:tasks.workunit.client.0.smithi099.stdout:8/996: dread d4/de/fa8 [0,4194304] 0 2024-09-19T06:40:51.578 INFO:tasks.workunit.client.0.smithi099.stdout:6/958: dwrite d1/d5/d24/d2b/f74 [0,4194304] 0 2024-09-19T06:40:51.578 INFO:tasks.workunit.client.0.smithi099.stdout:4/974: creat d12/d82/f13c x:0 0 0 2024-09-19T06:40:51.582 INFO:tasks.workunit.client.0.smithi099.stdout:0/916: truncate d0/db/d27/d5d/d87/da2/dbc/d1f/d3a/dbf/fcd 1048265 0 2024-09-19T06:40:51.582 INFO:tasks.workunit.client.0.smithi099.stdout:8/997: dread - d4/d11/fd2 zero size 2024-09-19T06:40:51.582 INFO:tasks.workunit.client.0.smithi099.stdout:1/845: chown d0/d17/d24/d3a/d58/d8d/la7 2 1 2024-09-19T06:40:51.584 INFO:tasks.workunit.client.0.smithi099.stdout:1/846: readlink d0/d68/l47 0 2024-09-19T06:40:51.585 INFO:tasks.workunit.client.0.smithi099.stdout:2/841: dwrite d1/d2/d4d/d55/da5/da8/fd9 [4194304,4194304] 0 2024-09-19T06:40:51.588 INFO:tasks.workunit.client.0.smithi099.stdout:2/842: dread - d1/d2/d4d/d55/fd5 zero size 2024-09-19T06:40:51.594 INFO:tasks.workunit.client.0.smithi099.stdout:8/998: symlink d4/d11/d23/d4c/l145 0 2024-09-19T06:40:51.595 INFO:tasks.workunit.client.0.smithi099.stdout:6/959: link d1/d5/d24/d2e/d41/f8d d1/d5/d38/dbb/d9c/f13e 0 2024-09-19T06:40:51.595 INFO:tasks.workunit.client.0.smithi099.stdout:2/843: stat d1/d2/d4d/d55/da5/d18/d2d/ce5 0 2024-09-19T06:40:51.596 INFO:tasks.workunit.client.0.smithi099.stdout:8/999: truncate d4/d5e/dbb/fce 5220250 0 2024-09-19T06:40:51.596 INFO:tasks.workunit.client.0.smithi099.stdout:1/847: rename d0/d17/d32/d7b/ffc to d0/d17/d24/d75/dbb/de1/f113 0 2024-09-19T06:40:51.597 INFO:tasks.workunit.client.0.smithi099.stdout:0/917: write d0/db/d27/d5d/d87/da2/dbc/d1f/f28 [5773798,107657] 0 2024-09-19T06:40:51.601 INFO:tasks.workunit.client.0.smithi099.stdout:4/975: truncate d12/d32/f72 3554106 0 2024-09-19T06:40:51.601 INFO:tasks.workunit.client.0.smithi099.stdout:1/848: creat d0/d17/d32/d10d/f114 x:0 0 0 2024-09-19T06:40:51.602 INFO:tasks.workunit.client.0.smithi099.stdout:0/918: symlink d0/db/d27/d5d/d87/da2/dbc/d37/d3c/l122 0 2024-09-19T06:40:51.603 INFO:tasks.workunit.client.0.smithi099.stdout:0/919: readlink d0/d112/le8 0 2024-09-19T06:40:51.606 INFO:tasks.workunit.client.0.smithi099.stdout:0/920: mknod d0/d112/d75/da4/dcf/c123 0 2024-09-19T06:40:51.608 INFO:tasks.workunit.client.0.smithi099.stdout:6/960: write d1/d5/d38/d76/db0/d54/ff2 [1864769,91044] 0 2024-09-19T06:40:51.610 INFO:tasks.workunit.client.0.smithi099.stdout:6/961: chown d1/d5/d24/d2b/d86/c11c 40969 1 2024-09-19T06:40:51.611 INFO:tasks.workunit.client.0.smithi099.stdout:4/976: write d12/d115/d126/d9d/fb2 [194052,103985] 0 2024-09-19T06:40:51.615 INFO:tasks.workunit.client.0.smithi099.stdout:0/921: creat d0/db/dc0/d11f/f124 x:0 0 0 2024-09-19T06:40:51.615 INFO:tasks.workunit.client.0.smithi099.stdout:6/962: truncate d1/f127 4565954 0 2024-09-19T06:40:51.616 INFO:tasks.workunit.client.0.smithi099.stdout:1/849: dwrite d0/d12/d13/f89 [4194304,4194304] 0 2024-09-19T06:40:51.619 INFO:tasks.workunit.client.0.smithi099.stdout:0/922: write d0/db/d27/fd4 [688367,39976] 0 2024-09-19T06:40:51.620 INFO:tasks.workunit.client.0.smithi099.stdout:1/850: read d0/d12/d13/f89 [8058152,25079] 0 2024-09-19T06:40:51.621 INFO:tasks.workunit.client.0.smithi099.stdout:6/963: rmdir d1/d5/d24/d2e/d7b/dba 39 2024-09-19T06:40:51.624 INFO:tasks.workunit.client.0.smithi099.stdout:2/844: dread d1/d2/d4d/d55/da5/d18/d2d/fbe [0,4194304] 0 2024-09-19T06:40:51.626 INFO:tasks.workunit.client.0.smithi099.stdout:2/845: truncate d1/d2/d4d/d55/da5/d36/fd0 222142 0 2024-09-19T06:40:51.626 INFO:tasks.workunit.client.0.smithi099.stdout:0/923: mkdir d0/db/d27/d5d/d87/da2/def/d125 0 2024-09-19T06:40:51.635 INFO:tasks.workunit.client.0.smithi099.stdout:2/846: dwrite d1/d2/d4d/d55/da5/d18/d2d/dd8/f102 [0,4194304] 0 2024-09-19T06:40:51.639 INFO:tasks.workunit.client.0.smithi099.stdout:2/847: truncate d1/d2/d4d/d8e/f100 711918 0 2024-09-19T06:40:51.641 INFO:tasks.workunit.client.0.smithi099.stdout:1/851: write d0/d17/d24/d75/f90 [626724,39922] 0 2024-09-19T06:40:51.642 INFO:tasks.workunit.client.0.smithi099.stdout:4/977: truncate d12/d32/d42/d80/f83 2101181 0 2024-09-19T06:40:51.649 INFO:tasks.workunit.client.0.smithi099.stdout:4/978: unlink d12/d82/ddd/d9b/da2/c123 0 2024-09-19T06:40:51.651 INFO:tasks.workunit.client.0.smithi099.stdout:0/924: dwrite d0/db/d2f/f4e [0,4194304] 0 2024-09-19T06:40:51.651 INFO:tasks.workunit.client.0.smithi099.stdout:2/848: write d1/d2/d4d/d55/ffa [1389070,77154] 0 2024-09-19T06:40:51.652 INFO:tasks.workunit.client.0.smithi099.stdout:4/979: dread - d12/d1b/d88/f124 zero size 2024-09-19T06:40:51.654 INFO:tasks.workunit.client.0.smithi099.stdout:2/849: chown d1/l30 20253 1 2024-09-19T06:40:51.655 INFO:tasks.workunit.client.0.smithi099.stdout:1/852: dwrite d0/d17/d24/d75/dbb/de1/fe2 [0,4194304] 0 2024-09-19T06:40:51.658 INFO:tasks.workunit.client.0.smithi099.stdout:0/925: symlink d0/d112/l126 0 2024-09-19T06:40:51.661 INFO:tasks.workunit.client.0.smithi099.stdout:4/980: mkdir d12/d115/d126/d51/d13d 0 2024-09-19T06:40:51.662 INFO:tasks.workunit.client.0.smithi099.stdout:2/850: rmdir d1/d2/d4d/d55/da5/d9/d63/dc6/d13/de7 39 2024-09-19T06:40:51.663 INFO:tasks.workunit.client.0.smithi099.stdout:1/853: creat d0/d17/d5b/dba/f115 x:0 0 0 2024-09-19T06:40:51.664 INFO:tasks.workunit.client.0.smithi099.stdout:0/926: rename d0/db/d2f/cc5 to d0/d112/d75/da4/dcf/dd3/c127 0 2024-09-19T06:40:51.666 INFO:tasks.workunit.client.0.smithi099.stdout:4/981: fsync d12/d82/fdb 0 2024-09-19T06:40:51.667 INFO:tasks.workunit.client.0.smithi099.stdout:1/854: truncate d0/d68/fc2 385547 0 2024-09-19T06:40:51.670 INFO:tasks.workunit.client.0.smithi099.stdout:0/927: creat d0/d112/d75/da4/dcf/dd3/f128 x:0 0 0 2024-09-19T06:40:51.673 INFO:tasks.workunit.client.0.smithi099.stdout:1/855: symlink d0/d17/d24/l116 0 2024-09-19T06:40:51.675 INFO:tasks.workunit.client.0.smithi099.stdout:2/851: dwrite d1/d2/d4d/d55/da5/d9/d63/dc6/d13/fe8 [0,4194304] 0 2024-09-19T06:40:51.679 INFO:tasks.workunit.client.0.smithi099.stdout:1/856: readlink d0/d12/d13/d37/d41/l7a 0 2024-09-19T06:40:51.680 INFO:tasks.workunit.client.0.smithi099.stdout:0/928: creat d0/db/d27/d5d/d87/da2/dbc/d1f/d3a/dbf/f129 x:0 0 0 2024-09-19T06:40:51.680 INFO:tasks.workunit.client.0.smithi099.stdout:2/852: rmdir d1/d2/d4d/d55/da5/d18/d27/d5b/d92 39 2024-09-19T06:40:51.680 INFO:tasks.workunit.client.0.smithi099.stdout:2/853: stat d1/d2/d4d/d55/da5/d36 0 2024-09-19T06:40:51.682 INFO:tasks.workunit.client.0.smithi099.stdout:1/857: mkdir d0/d17/d5b/dba/d117 0 2024-09-19T06:40:51.683 INFO:tasks.workunit.client.0.smithi099.stdout:2/854: fsync d1/d2/d4d/d55/da5/d18/d27/d5b/f8c 0 2024-09-19T06:40:51.684 INFO:tasks.workunit.client.0.smithi099.stdout:4/982: write d12/f50 [2702043,91793] 0 2024-09-19T06:40:51.685 INFO:tasks.workunit.client.0.smithi099.stdout:2/855: truncate d1/faa 591966 0 2024-09-19T06:40:51.690 INFO:tasks.workunit.client.0.smithi099.stdout:4/983: symlink d12/d82/ddd/l13e 0 2024-09-19T06:40:51.692 INFO:tasks.workunit.client.0.smithi099.stdout:2/856: symlink d1/d2/d4d/d55/da5/d18/d27/dd6/l11c 0 2024-09-19T06:40:51.692 INFO:tasks.workunit.client.0.smithi099.stdout:1/858: dwrite d0/d68/daf/fdf [0,4194304] 0 2024-09-19T06:40:51.696 INFO:tasks.workunit.client.0.smithi099.stdout:4/984: read d12/d32/f3e [1299038,115916] 0 2024-09-19T06:40:51.697 INFO:tasks.workunit.client.0.smithi099.stdout:0/929: truncate d0/db/d27/d5d/d87/da2/dbc/d59/f6c 653754 0 2024-09-19T06:40:51.698 INFO:tasks.workunit.client.0.smithi099.stdout:2/857: write d1/d2/d4d/d55/da5/d9/d63/dc6/d13/d2c/fd3 [4046659,13899] 0 2024-09-19T06:40:51.699 INFO:tasks.workunit.client.0.smithi099.stdout:1/859: rename d0/d17/d32/d7b/d99/f9e to d0/d17/d5b/dba/dcb/f118 0 2024-09-19T06:40:51.699 INFO:tasks.workunit.client.0.smithi099.stdout:4/985: dread - d12/d82/ddd/d8a/da9/dfc/d102/f125 zero size 2024-09-19T06:40:51.703 INFO:tasks.workunit.client.0.smithi099.stdout:0/930: creat d0/db/d27/d5d/d87/da2/dbc/d37/d3c/f12a x:0 0 0 2024-09-19T06:40:51.706 INFO:tasks.workunit.client.0.smithi099.stdout:2/858: mknod d1/d2/d4d/d55/da5/c11d 0 2024-09-19T06:40:51.707 INFO:tasks.workunit.client.0.smithi099.stdout:4/986: link d12/d82/ddd/d8a/da9/ce0 d12/d115/c13f 0 2024-09-19T06:40:51.709 INFO:tasks.workunit.client.0.smithi099.stdout:4/987: stat d12/d32/d12b/l10c 0 2024-09-19T06:40:51.710 INFO:tasks.workunit.client.0.smithi099.stdout:1/860: dwrite d0/f29 [0,4194304] 0 2024-09-19T06:40:51.713 INFO:tasks.workunit.client.0.smithi099.stdout:2/859: fsync d1/d2/d4d/d55/da5/d9/d63/dc6/d13/d2c/fd3 0 2024-09-19T06:40:51.714 INFO:tasks.workunit.client.0.smithi099.stdout:1/861: chown d0/d12/d13/f45 36955988 1 2024-09-19T06:40:51.715 INFO:tasks.workunit.client.0.smithi099.stdout:2/860: rmdir d1 39 2024-09-19T06:40:51.724 INFO:tasks.workunit.client.0.smithi099.stdout:2/861: symlink d1/d2/d4d/d55/da5/d18/d27/d5b/l11e 0 2024-09-19T06:40:51.724 INFO:tasks.workunit.client.0.smithi099.stdout:1/862: dwrite d0/d12/d13/fc7 [0,4194304] 0 2024-09-19T06:40:51.726 INFO:tasks.workunit.client.0.smithi099.stdout:0/931: truncate d0/db/d27/d5d/d87/da2/dbc/d1f/d39/f74 1610280 0 2024-09-19T06:40:51.729 INFO:tasks.workunit.client.0.smithi099.stdout:2/862: mkdir d1/d2/d4d/d55/da5/d18/d2d/dd8/d11f 0 2024-09-19T06:40:51.731 INFO:tasks.workunit.client.0.smithi099.stdout:2/863: read d1/d2/d4d/d55/da5/d9/d63/dc6/d13/d2c/f38 [515363,74322] 0 2024-09-19T06:40:51.731 INFO:tasks.workunit.client.0.smithi099.stdout:1/863: readlink d0/d17/d24/d75/la8 0 2024-09-19T06:40:51.732 INFO:tasks.workunit.client.0.smithi099.stdout:1/864: fdatasync d0/f16 0 2024-09-19T06:40:51.736 INFO:tasks.workunit.client.0.smithi099.stdout:0/932: getdents d0/db/d36/d3f/d91 0 2024-09-19T06:40:51.740 INFO:tasks.workunit.client.0.smithi099.stdout:1/865: write d0/d17/d24/d5e/f92 [757935,79473] 0 2024-09-19T06:40:51.741 INFO:tasks.workunit.client.0.smithi099.stdout:2/864: dwrite d1/d2/d4d/d55/feb [0,4194304] 0 2024-09-19T06:40:51.743 INFO:tasks.workunit.client.0.smithi099.stdout:0/933: dread - d0/db/dc0/d11f/f111 zero size 2024-09-19T06:40:51.744 INFO:tasks.workunit.client.0.smithi099.stdout:1/866: write d0/f1a [1780522,96302] 0 2024-09-19T06:40:51.746 INFO:tasks.workunit.client.0.smithi099.stdout:4/988: dread d12/d82/ddd/d8a/fd6 [0,4194304] 0 2024-09-19T06:40:51.747 INFO:tasks.workunit.client.0.smithi099.stdout:4/989: fdatasync d12/d32/d42/d97/f107 0 2024-09-19T06:40:51.753 INFO:tasks.workunit.client.0.smithi099.stdout:0/934: creat d0/db/f12b x:0 0 0 2024-09-19T06:40:51.757 INFO:tasks.workunit.client.0.smithi099.stdout:1/867: write d0/d17/d5b/f5d [212001,68939] 0 2024-09-19T06:40:51.759 INFO:tasks.workunit.client.0.smithi099.stdout:4/990: dwrite d12/d82/ddd/d8a/da9/dfc/d10b/d127/f132 [4194304,4194304] 0 2024-09-19T06:40:51.760 INFO:tasks.workunit.client.0.smithi099.stdout:0/935: chown d0/db/d2f/le9 121353 1 2024-09-19T06:40:51.761 INFO:tasks.workunit.client.0.smithi099.stdout:2/865: write d1/d2/d4d/d55/da5/d9/f6f [8925500,84016] 0 2024-09-19T06:40:51.764 INFO:tasks.workunit.client.0.smithi099.stdout:0/936: mknod d0/d112/d75/da4/c12c 0 2024-09-19T06:40:51.766 INFO:tasks.workunit.client.0.smithi099.stdout:1/868: dread d0/d68/f1d [0,4194304] 0 2024-09-19T06:40:51.768 INFO:tasks.workunit.client.0.smithi099.stdout:4/991: rename d12/f38 to d12/d1b/da4/db4/f140 0 2024-09-19T06:40:51.768 INFO:tasks.workunit.client.0.smithi099.stdout:2/866: unlink d1/d2/f12 0 2024-09-19T06:40:51.773 INFO:tasks.workunit.client.0.smithi099.stdout:4/992: dread d12/d32/f2e [4194304,4194304] 0 2024-09-19T06:40:51.773 INFO:tasks.workunit.client.0.smithi099.stdout:2/867: stat d1/d2/d4d/d55/da5/d18/d27/d5b/cbb 0 2024-09-19T06:40:51.777 INFO:tasks.workunit.client.0.smithi099.stdout:4/993: symlink d12/d115/d126/d51/d13d/l141 0 2024-09-19T06:40:51.778 INFO:tasks.workunit.client.0.smithi099.stdout:2/868: mknod d1/d2/d4d/d55/da5/d18/d27/c120 0 2024-09-19T06:40:51.779 INFO:tasks.workunit.client.0.smithi099.stdout:4/994: write d12/f16 [6163808,89135] 0 2024-09-19T06:40:51.784 INFO:tasks.workunit.client.0.smithi099.stdout:0/937: dwrite d0/db/d2f/fc3 [0,4194304] 0 2024-09-19T06:40:51.789 INFO:tasks.workunit.client.0.smithi099.stdout:4/995: mknod d12/d1b/d88/d114/d13a/c142 0 2024-09-19T06:40:51.790 INFO:tasks.workunit.client.0.smithi099.stdout:0/938: mknod d0/db/d27/d5d/d87/da2/dbc/c12d 0 2024-09-19T06:40:51.793 INFO:tasks.workunit.client.0.smithi099.stdout:1/869: dread d0/d12/d13/d37/f3f [4194304,4194304] 0 2024-09-19T06:40:51.794 INFO:tasks.workunit.client.0.smithi099.stdout:0/939: write d0/db/d27/d5d/d87/da2/dbc/d1f/d4a/f7b [3801095,113101] 0 2024-09-19T06:40:51.798 INFO:tasks.workunit.client.0.smithi099.stdout:0/940: creat d0/db/d27/d5d/d87/da2/dbc/d1f/d3a/f12e x:0 0 0 2024-09-19T06:40:51.799 INFO:tasks.workunit.client.0.smithi099.stdout:1/870: readlink d0/d17/d24/d3a/d58/d8d/lc3 0 2024-09-19T06:40:51.811 INFO:tasks.workunit.client.0.smithi099.stdout:2/869: dread d1/d2/d4d/d55/da5/d9/d63/dc6/d13/f54 [0,4194304] 0 2024-09-19T06:40:51.817 INFO:tasks.workunit.client.0.smithi099.stdout:4/996: dwrite d12/d82/ddd/d9b/da2/fd5 [0,4194304] 0 2024-09-19T06:40:51.818 INFO:tasks.workunit.client.0.smithi099.stdout:1/871: dwrite d0/d17/d24/d5e/d8a/ff3 [0,4194304] 0 2024-09-19T06:40:51.818 INFO:tasks.workunit.client.0.smithi099.stdout:0/941: dwrite d0/db/d27/d5d/d87/da2/dbc/f20 [4194304,4194304] 0 2024-09-19T06:40:51.823 INFO:tasks.workunit.client.0.smithi099.stdout:0/942: write d0/db/d27/d5d/d87/da2/dbc/f20 [7434175,115162] 0 2024-09-19T06:40:51.824 INFO:tasks.workunit.client.0.smithi099.stdout:2/870: mknod d1/d2/d4d/d55/da5/d9/d63/dc6/d6/c121 0 2024-09-19T06:40:51.825 INFO:tasks.workunit.client.0.smithi099.stdout:4/997: mknod d12/d82/ddd/d9b/dab/c143 0 2024-09-19T06:40:51.826 INFO:tasks.workunit.client.0.smithi099.stdout:1/872: symlink d0/d17/d24/d5e/d8a/dd4/l119 0 2024-09-19T06:40:51.828 INFO:tasks.workunit.client.0.smithi099.stdout:2/871: creat d1/d2/d4d/d55/da5/d9/db7/f122 x:0 0 0 2024-09-19T06:40:51.828 INFO:tasks.workunit.client.0.smithi099.stdout:0/943: creat d0/db/d27/d5d/d87/f12f x:0 0 0 2024-09-19T06:40:51.835 INFO:tasks.workunit.client.0.smithi099.stdout:1/873: truncate d0/d17/d32/d7b/d99/fb6 4532014 0 2024-09-19T06:40:51.836 INFO:tasks.workunit.client.0.smithi099.stdout:2/872: read d1/d2/d4d/d55/da5/d18/f2f [859625,92498] 0 2024-09-19T06:40:51.841 INFO:tasks.workunit.client.0.smithi099.stdout:4/998: dwrite d12/d1b/d73/fd7 [0,4194304] 0 2024-09-19T06:40:51.843 INFO:tasks.workunit.client.0.smithi099.stdout:1/874: creat d0/d2d/f11a x:0 0 0 2024-09-19T06:40:51.844 INFO:tasks.workunit.client.0.smithi099.stdout:2/873: creat d1/f123 x:0 0 0 2024-09-19T06:40:51.844 INFO:tasks.workunit.client.0.smithi099.stdout:4/999: unlink d12/d82/ddd/d8a/da9/cd4 0 2024-09-19T06:40:51.845 INFO:tasks.workunit.client.0.smithi099.stdout:0/944: dwrite d0/db/d2f/f4e [0,4194304] 0 2024-09-19T06:40:51.854 INFO:tasks.workunit.client.0.smithi099.stdout:0/945: truncate d0/db/d36/f5f 4934973 0 2024-09-19T06:40:51.858 INFO:tasks.workunit.client.0.smithi099.stdout:0/946: stat d0/d17/l22 0 2024-09-19T06:40:51.861 INFO:tasks.workunit.client.0.smithi099.stdout:2/874: dread d1/d2/d4d/d55/da5/d18/d27/d5b/d92/fd7 [0,4194304] 0 2024-09-19T06:40:51.866 INFO:tasks.workunit.client.0.smithi099.stdout:2/875: symlink d1/d2/d4d/d55/da5/d9/d63/l124 0 2024-09-19T06:40:51.866 INFO:tasks.workunit.client.0.smithi099.stdout:0/947: dwrite d0/db/d2f/f10a [0,4194304] 0 2024-09-19T06:40:51.868 INFO:tasks.workunit.client.0.smithi099.stdout:2/876: chown d1/d2/d4d/d55/da5/c78 1529398080 1 2024-09-19T06:40:51.869 INFO:tasks.workunit.client.0.smithi099.stdout:0/948: write d0/db/d27/d5d/d87/da2/dbc/d1f/f28 [5947555,92891] 0 2024-09-19T06:40:51.875 INFO:tasks.workunit.client.0.smithi099.stdout:0/949: mknod d0/db/d27/d5d/c130 0 2024-09-19T06:40:51.883 INFO:tasks.workunit.client.0.smithi099.stdout:0/950: getdents d0/db/dc0/d11f 0 2024-09-19T06:40:51.895 INFO:tasks.workunit.client.0.smithi099.stdout:0/951: dwrite d0/db/d27/d5d/d87/da2/dbc/d1f/f2b [0,4194304] 0 2024-09-19T06:40:51.897 INFO:tasks.workunit.client.0.smithi099.stdout:0/952: dread - d0/db/d27/d5d/d87/da2/dbc/d37/d3c/f12a zero size 2024-09-19T06:40:51.900 INFO:tasks.workunit.client.0.smithi099.stdout:0/953: read d0/db/d2f/f10a [938604,37688] 0 2024-09-19T06:40:51.908 INFO:tasks.workunit.client.0.smithi099.stdout:2/877: dread d1/d2/d4d/d55/da5/d18/d27/d5b/f7e [0,4194304] 0 2024-09-19T06:40:51.916 INFO:tasks.workunit.client.0.smithi099.stdout:2/878: dwrite d1/d2/d4d/f95 [0,4194304] 0 2024-09-19T06:40:51.921 INFO:tasks.workunit.client.0.smithi099.stdout:2/879: creat d1/d2/d4d/d55/da5/d9/d63/dc6/d13/d2c/d101/f125 x:0 0 0 2024-09-19T06:40:51.921 INFO:tasks.workunit.client.0.smithi099.stdout:2/880: dread - d1/f7f zero size 2024-09-19T06:40:51.925 INFO:tasks.workunit.client.0.smithi099.stdout:2/881: creat d1/d2/d4d/d8e/f126 x:0 0 0 2024-09-19T06:40:51.928 INFO:tasks.workunit.client.0.smithi099.stdout:2/882: creat d1/d2/d4d/d55/da5/d9/d63/dc6/d13/d2c/d101/f127 x:0 0 0 2024-09-19T06:40:51.938 INFO:tasks.workunit.client.0.smithi099.stdout:0/954: dread d0/d17/f84 [0,4194304] 0 2024-09-19T06:40:51.939 INFO:tasks.workunit.client.0.smithi099.stdout:0/955: read - d0/f118 zero size 2024-09-19T06:40:51.944 INFO:tasks.workunit.client.0.smithi099.stdout:0/956: rename d0/db/d2f/f6f to d0/d17/d11d/f131 0 2024-09-19T06:40:51.952 INFO:tasks.workunit.client.0.smithi099.stdout:0/957: dwrite d0/db/d27/d5d/d87/da2/dbc/d1f/d4a/f50 [0,4194304] 0 2024-09-19T06:40:51.961 INFO:tasks.workunit.client.0.smithi099.stdout:0/958: getdents d0/db/d36 0 2024-09-19T06:40:51.965 INFO:tasks.workunit.client.0.smithi099.stdout:0/959: creat d0/db/d27/d5d/d87/da2/dbc/d1f/d39/f132 x:0 0 0 2024-09-19T06:40:51.967 INFO:tasks.workunit.client.0.smithi099.stdout:2/883: dread d1/d2/d4d/d55/da5/d9/f67 [0,4194304] 0 2024-09-19T06:40:51.968 INFO:tasks.workunit.client.0.smithi099.stdout:0/960: mkdir d0/db/dd5/d133 0 2024-09-19T06:40:51.969 INFO:tasks.workunit.client.0.smithi099.stdout:2/884: chown d1/d2/d4d/d55/da5/d9/d63/dc6/l7c 28553 1 2024-09-19T06:40:51.970 INFO:tasks.workunit.client.0.smithi099.stdout:0/961: creat d0/db/d27/d5d/d87/da2/dbc/d37/df2/f134 x:0 0 0 2024-09-19T06:40:51.973 INFO:tasks.workunit.client.0.smithi099.stdout:2/885: write d1/d2/d4d/d55/da5/d36/f53 [1242249,76671] 0 2024-09-19T06:40:51.973 INFO:tasks.workunit.client.0.smithi099.stdout:0/962: mkdir d0/db/d27/d5d/d87/da2/dbc/d37/df2/d135 0 2024-09-19T06:40:51.975 INFO:tasks.workunit.client.0.smithi099.stdout:0/963: stat d0/db/d2f/l7f 0 2024-09-19T06:40:51.978 INFO:tasks.workunit.client.0.smithi099.stdout:0/964: write d0/db/d27/d5d/d87/da2/dbc/d59/f10b [655142,33243] 0 2024-09-19T06:40:51.985 INFO:tasks.workunit.client.0.smithi099.stdout:0/965: creat d0/db/d27/d5d/d87/da2/def/d125/f136 x:0 0 0 2024-09-19T06:40:51.985 INFO:tasks.workunit.client.0.smithi099.stdout:2/886: dwrite d1/d2/d4d/d55/da5/d9/d63/dc6/d13/d2c/d101/f127 [0,4194304] 0 2024-09-19T06:40:51.989 INFO:tasks.workunit.client.0.smithi099.stdout:0/966: chown d0/db/d27/d5d/f81 8796 1 2024-09-19T06:40:51.991 INFO:tasks.workunit.client.0.smithi099.stdout:0/967: dread - d0/db/d27/d5d/d87/f12f zero size 2024-09-19T06:40:51.994 INFO:tasks.workunit.client.0.smithi099.stdout:2/887: rename d1/d2/d4d/d55/da5/d9/d63/c14 to d1/d2/d4d/d55/da5/d18/d2d/dd8/d11f/c128 0 2024-09-19T06:40:52.002 INFO:tasks.workunit.client.0.smithi099.stdout:2/888: dread d1/d2/d4d/d55/da5/d9/d63/dc6/d13/fe8 [0,4194304] 0 2024-09-19T06:40:52.006 INFO:tasks.workunit.client.0.smithi099.stdout:0/968: write d0/db/d27/d5d/d87/da2/dbc/d1f/d39/f74 [2414802,102077] 0 2024-09-19T06:40:52.010 INFO:tasks.workunit.client.0.smithi099.stdout:0/969: mknod d0/db/d27/d5d/d87/c137 0 2024-09-19T06:40:52.011 INFO:tasks.workunit.client.0.smithi099.stdout:2/889: dwrite d1/d2/d4d/d55/da5/d36/f41 [0,4194304] 0 2024-09-19T06:40:52.012 INFO:tasks.workunit.client.0.smithi099.stdout:0/970: readlink d0/db/dc0/d11f/lfc 0 2024-09-19T06:40:52.015 INFO:tasks.workunit.client.0.smithi099.stdout:0/971: creat d0/db/d36/d3f/f138 x:0 0 0 2024-09-19T06:40:52.016 INFO:tasks.workunit.client.0.smithi099.stdout:2/890: rmdir d1/d2/d4d/d55/da5/d9/d63/dc6/d13 39 2024-09-19T06:40:52.020 INFO:tasks.workunit.client.0.smithi099.stdout:2/891: truncate d1/d2/d4d/d55/da5/d36/fd0 298012 0 2024-09-19T06:40:52.023 INFO:tasks.workunit.client.0.smithi099.stdout:2/892: readlink d1/d2/d4d/d55/da5/d9/d63/dc6/d6/l35 0 2024-09-19T06:40:52.023 INFO:tasks.workunit.client.0.smithi099.stdout:0/972: truncate d0/db/d27/d5d/d87/da2/dbc/d1f/db4/fc4 2663571 0 2024-09-19T06:40:52.026 INFO:tasks.workunit.client.0.smithi099.stdout:0/973: creat d0/db/f139 x:0 0 0 2024-09-19T06:40:52.026 INFO:tasks.workunit.client.0.smithi099.stdout:2/893: fsync d1/d2/d4d/d55/da5/d9/d63/dc6/d13/d2c/d101/f10d 0 2024-09-19T06:40:52.032 INFO:tasks.workunit.client.0.smithi099.stdout:0/974: link d0/db/d27/d5d/d87/da2/dbc/d37/ff4 d0/db/dc0/d11f/f13a 0 2024-09-19T06:40:52.033 INFO:tasks.workunit.client.0.smithi099.stdout:2/894: rename d1/d2/d4d/d55/da5/d18/d46/d65 to d1/d2/d4d/d55/da5/d9/d63/dc6/d6/d129 0 2024-09-19T06:40:52.039 INFO:tasks.workunit.client.0.smithi099.stdout:0/975: getdents d0/d112/d75/da4/dcf/dd3 0 2024-09-19T06:40:52.040 INFO:tasks.workunit.client.0.smithi099.stdout:2/895: rename d1/d2/d4d/d55/da5/d18/d2d/fbe to d1/d2/d4d/d55/da5/d18/d27/f12a 0 2024-09-19T06:40:52.041 INFO:tasks.workunit.client.0.smithi099.stdout:2/896: chown d1/d2/d4d/d55/da5/d9/d63/dc6/d13/d2c/d101 50384 1 2024-09-19T06:40:52.042 INFO:tasks.workunit.client.0.smithi099.stdout:0/976: symlink d0/db/d27/d5d/d87/da2/dbc/d1f/d3a/l13b 0 2024-09-19T06:40:52.043 INFO:tasks.workunit.client.0.smithi099.stdout:2/897: chown d1/d2/d4d/d55/da5/d18/d76 2896983 1 2024-09-19T06:40:52.044 INFO:tasks.workunit.client.0.smithi099.stdout:2/898: chown d1/d2/d4d/d55/da5/d18/d2d/de3/cfc 423247536 1 2024-09-19T06:40:52.044 INFO:tasks.workunit.client.0.smithi099.stdout:0/977: mkdir d0/db/d27/d5d/d87/da2/dbc/d1f/d4a/d13c 0 2024-09-19T06:40:52.046 INFO:tasks.workunit.client.0.smithi099.stdout:2/899: chown d1/d2/d4d/d55/da5/d18/d2d/de3/cba 4309 1 2024-09-19T06:40:52.047 INFO:tasks.workunit.client.0.smithi099.stdout:0/978: rename d0/db/d27/d5d/d87/c137 to d0/db/d36/d3f/d91/c13d 0 2024-09-19T06:40:52.050 INFO:tasks.workunit.client.0.smithi099.stdout:0/979: creat d0/db/d36/f13e x:0 0 0 2024-09-19T06:40:52.055 INFO:tasks.workunit.client.0.smithi099.stdout:0/980: getdents d0/db/d36 0 2024-09-19T06:40:52.063 INFO:tasks.workunit.client.0.smithi099.stdout:2/900: dwrite d1/d2/d4d/d55/da5/d36/f8a [0,4194304] 0 2024-09-19T06:40:52.082 INFO:tasks.workunit.client.0.smithi099.stdout:0/981: write d0/db/d27/d5d/d87/da2/dbc/d1f/d4a/d61/f8c [2835287,114091] 0 2024-09-19T06:40:52.085 INFO:tasks.workunit.client.0.smithi099.stdout:0/982: fsync d0/db/d27/d5d/d87/da2/dbc/d1f/d4a/f7b 0 2024-09-19T06:40:52.087 INFO:tasks.workunit.client.0.smithi099.stdout:0/983: creat d0/db/d36/d3f/f13f x:0 0 0 2024-09-19T06:40:52.089 INFO:tasks.workunit.client.0.smithi099.stdout:0/984: chown d0/db/d27/d5d/d87/da2/dbc/d1f/d39/f63 430666 1 2024-09-19T06:40:52.090 INFO:tasks.workunit.client.0.smithi099.stdout:0/985: write d0/fa7 [4291218,106264] 0 2024-09-19T06:40:52.093 INFO:tasks.workunit.client.0.smithi099.stdout:0/986: fdatasync d0/db/dc0/d11f/f124 0 2024-09-19T06:40:52.094 INFO:tasks.workunit.client.0.smithi099.stdout:0/987: write d0/d112/f92 [2580078,52533] 0 2024-09-19T06:40:52.095 INFO:tasks.workunit.client.0.smithi099.stdout:0/988: readlink d0/db/d36/ld0 0 2024-09-19T06:40:52.096 INFO:tasks.workunit.client.0.smithi099.stdout:0/989: rmdir d0/d17/d41 39 2024-09-19T06:40:52.097 INFO:tasks.workunit.client.0.smithi099.stdout:0/990: chown d0/db/d36/ld0 0 1 2024-09-19T06:40:52.098 INFO:tasks.workunit.client.0.smithi099.stdout:0/991: fsync d0/db/dd5/f105 0 2024-09-19T06:40:52.099 INFO:tasks.workunit.client.0.smithi099.stdout:0/992: write d0/d112/d75/da4/dcf/fea [293760,78123] 0 2024-09-19T06:40:52.104 INFO:tasks.workunit.client.0.smithi099.stdout:2/901: dwrite d1/f15 [0,4194304] 0 2024-09-19T06:40:52.104 INFO:tasks.workunit.client.0.smithi099.stdout:0/993: creat d0/db/d27/d5d/d87/da2/dbc/d37/f140 x:0 0 0 2024-09-19T06:40:52.105 INFO:tasks.workunit.client.0.smithi099.stdout:0/994: fdatasync d0/d17/fdc 0 2024-09-19T06:40:52.107 INFO:tasks.workunit.client.0.smithi099.stdout:2/902: dread - d1/d2/d4d/d55/da5/d18/fee zero size 2024-09-19T06:40:52.113 INFO:tasks.workunit.client.0.smithi099.stdout:2/903: truncate d1/d2/d4d/d55/da5/d18/d27/d5b/d92/fd7 1494712 0 2024-09-19T06:40:52.113 INFO:tasks.workunit.client.0.smithi099.stdout:0/995: dwrite d0/db/dc0/fdd [0,4194304] 0 2024-09-19T06:40:52.117 INFO:tasks.workunit.client.0.smithi099.stdout:2/904: unlink d1/d2/d4d/d55/da5/d9/d63/l124 0 2024-09-19T06:40:52.117 INFO:tasks.workunit.client.0.smithi099.stdout:0/996: mkdir d0/db/d27/d38/d141 0 2024-09-19T06:40:52.119 INFO:tasks.workunit.client.0.smithi099.stdout:2/905: mknod d1/d2/d4d/d55/da5/d18/d2d/dd8/c12b 0 2024-09-19T06:40:52.122 INFO:tasks.workunit.client.0.smithi099.stdout:0/997: getdents d0/db/d27/d5d/d87/da2/def/d125 0 2024-09-19T06:40:52.123 INFO:tasks.workunit.client.0.smithi099.stdout:2/906: read d1/d2/d4d/d55/da5/d18/d27/d5b/d92/fbd [1121681,103913] 0 2024-09-19T06:40:52.127 INFO:tasks.workunit.client.0.smithi099.stdout:2/907: creat d1/d2/d4d/d55/da5/d18/d2d/d88/f12c x:0 0 0 2024-09-19T06:40:52.129 INFO:tasks.workunit.client.0.smithi099.stdout:2/908: write d1/d2/d4d/d55/da5/d9/d63/dc6/d13/d2c/fff [5213842,45864] 0 2024-09-19T06:40:52.130 INFO:tasks.workunit.client.0.smithi099.stdout:0/998: write d0/d17/f6a [1063334,19453] 0 2024-09-19T06:40:52.132 INFO:tasks.workunit.client.0.smithi099.stdout:0/999: symlink d0/d17/d11d/l142 0 2024-09-19T06:40:52.132 INFO:tasks.workunit.client.0.smithi099.stdout:2/909: truncate d1/d2/d4d/d55/da5/d18/d27/fe1 1029861 0 2024-09-19T06:40:52.137 INFO:tasks.workunit.client.0.smithi099.stdout:2/910: creat d1/d2/d4d/d55/da5/d9/d63/dc6/d13/d2c/f12d x:0 0 0 2024-09-19T06:40:52.137 INFO:tasks.workunit.client.0.smithi099.stdout:2/911: unlink d1/d2/d4d/d55/da5/d36/d110/l117 0 2024-09-19T06:40:52.139 INFO:tasks.workunit.client.0.smithi099.stdout:2/912: truncate d1/d2/d4d/d55/da5/fac 5118127 0 2024-09-19T06:40:52.142 INFO:tasks.workunit.client.0.smithi099.stdout:2/913: rename d1/d2/d4d/d55/da5/d9/d63/l28 to d1/d2/d4d/d55/da5/d36/l12e 0 2024-09-19T06:40:52.144 INFO:tasks.workunit.client.0.smithi099.stdout:2/914: mkdir d1/d2/d4d/d55/da5/d9/d63/dc6/d77/d98/de0/d12f 0 2024-09-19T06:40:52.147 INFO:tasks.workunit.client.0.smithi099.stdout:2/915: mknod d1/d2/d4d/d55/da5/d9/d63/dc6/d77/d98/de0/d12f/c130 0 2024-09-19T06:40:52.150 INFO:tasks.workunit.client.0.smithi099.stdout:2/916: creat d1/d2/d4d/d55/da5/d18/d27/d5b/f131 x:0 0 0 2024-09-19T06:40:52.154 INFO:tasks.workunit.client.0.smithi099.stdout:2/917: link d1/d2/d4d/f95 d1/d2/d4d/d55/da5/d9/da3/f132 0 2024-09-19T06:40:52.161 INFO:tasks.workunit.client.0.smithi099.stdout:2/918: dwrite d1/d2/d4d/d55/da5/d9/d63/dc6/d13/f54 [0,4194304] 0 2024-09-19T06:40:52.162 INFO:tasks.workunit.client.0.smithi099.stdout:2/919: write d1/d2/d4d/d55/da5/d9/db7/f122 [630368,91258] 0 2024-09-19T06:40:52.171 INFO:tasks.workunit.client.0.smithi099.stdout:2/920: dread d1/d2/d4d/d55/da5/d9/f3c [0,4194304] 0 2024-09-19T06:40:52.173 INFO:tasks.workunit.client.0.smithi099.stdout:2/921: mknod d1/d2/d4d/d55/c133 0 2024-09-19T06:40:52.175 INFO:tasks.workunit.client.0.smithi099.stdout:2/922: rmdir d1/d2/d4d/d55/da5/d18/d27/ddd 39 2024-09-19T06:40:52.181 INFO:tasks.workunit.client.0.smithi099.stdout:2/923: dread d1/d2/d4d/d55/da5/d9/d63/dc6/d13/d2c/f49 [0,4194304] 0 2024-09-19T06:40:52.183 INFO:tasks.workunit.client.0.smithi099.stdout:2/924: mknod d1/d2/d4d/d55/da5/d18/d2d/de3/c134 0 2024-09-19T06:40:52.188 INFO:tasks.workunit.client.0.smithi099.stdout:2/925: dwrite d1/d2/d4d/d55/da5/d18/d2d/d88/f96 [0,4194304] 0 2024-09-19T06:40:52.197 INFO:tasks.workunit.client.0.smithi099.stdout:2/926: dwrite d1/d2/d4d/d55/ffa [4194304,4194304] 0 2024-09-19T06:40:52.200 INFO:tasks.workunit.client.0.smithi099.stdout:2/927: mkdir d1/d2/d4d/d55/da5/d18/d27/d5b/dd4/d135 0 2024-09-19T06:40:52.200 INFO:tasks.workunit.client.0.smithi099.stdout:2/928: read - d1/d2/d4d/d8e/f126 zero size 2024-09-19T06:40:52.201 INFO:tasks.workunit.client.0.smithi099.stdout:2/929: read d1/faa [172715,4688] 0 2024-09-19T06:40:52.205 INFO:tasks.workunit.client.0.smithi099.stdout:2/930: mknod d1/d2/d4d/d55/da5/d9/d63/dc6/d77/d98/de0/d12f/c136 0 2024-09-19T06:40:52.206 INFO:tasks.workunit.client.0.smithi099.stdout:2/931: read d1/d2/d4d/d8e/f100 [234636,86825] 0 2024-09-19T06:40:52.210 INFO:tasks.workunit.client.0.smithi099.stdout:2/932: mkdir d1/d2/d4d/d55/da5/d9/d63/dc6/d77/d98/de0/d12f/d137 0 2024-09-19T06:40:52.210 INFO:tasks.workunit.client.0.smithi099.stdout:2/933: stat d1/d2/d4d/d55/da5/c78 0 2024-09-19T06:40:52.213 INFO:tasks.workunit.client.0.smithi099.stdout:2/934: symlink d1/d2/d4d/d55/da5/d9/d63/dc6/d6/d129/l138 0 2024-09-19T06:40:52.213 INFO:tasks.workunit.client.0.smithi099.stdout:2/935: chown d1/d2/d4d/d55/da5/d9/da3/cc5 0 1 2024-09-19T06:40:52.215 INFO:tasks.workunit.client.0.smithi099.stdout:2/936: write d1/d2/d4d/d55/da5/d36/f53 [309854,122333] 0 2024-09-19T06:40:52.221 INFO:tasks.workunit.client.0.smithi099.stdout:2/937: dwrite d1/d2/d4d/d55/da5/d18/d2d/de3/fa1 [0,4194304] 0 2024-09-19T06:40:52.222 INFO:tasks.workunit.client.0.smithi099.stdout:2/938: dread - d1/f7f zero size 2024-09-19T06:40:52.226 INFO:tasks.workunit.client.0.smithi099.stdout:2/939: link d1/c7d d1/d2/d4d/d55/da5/d18/d2d/d88/c139 0 2024-09-19T06:40:52.228 INFO:tasks.workunit.client.0.smithi099.stdout:2/940: creat d1/d2/d4d/d55/da5/d18/d27/d5b/dd4/f13a x:0 0 0 2024-09-19T06:40:52.232 INFO:tasks.workunit.client.0.smithi099.stdout:2/941: getdents d1/d2 0 2024-09-19T06:40:52.235 INFO:tasks.workunit.client.0.smithi099.stdout:2/942: mknod d1/d2/d4d/d55/da5/d18/d27/ddd/d10a/c13b 0 2024-09-19T06:40:52.236 INFO:tasks.workunit.client.0.smithi099.stdout:2/943: chown d1/d2/d4d/d55/da5/d18/d2d/de3/c134 229883 1 2024-09-19T06:40:52.238 INFO:tasks.workunit.client.0.smithi099.stdout:2/944: creat d1/d2/d4d/d55/da5/da8/f13c x:0 0 0 2024-09-19T06:40:52.241 INFO:tasks.workunit.client.0.smithi099.stdout:2/945: mknod d1/d2/d4d/d55/da5/d18/d2d/c13d 0 2024-09-19T06:40:52.243 INFO:tasks.workunit.client.0.smithi099.stdout:2/946: read d1/faa [139738,95059] 0 2024-09-19T06:40:52.244 INFO:tasks.workunit.client.0.smithi099.stdout:2/947: chown d1/d2/d4d/d55/da5/d18/d46/c10e 34268 1 2024-09-19T06:40:52.249 INFO:tasks.workunit.client.0.smithi099.stdout:2/948: dwrite d1/f15 [0,4194304] 0 2024-09-19T06:40:52.251 INFO:tasks.workunit.client.0.smithi099.stdout:2/949: chown d1/d2/d4d/d55/da5/d18/d27/d5b/fb5 99199 1 2024-09-19T06:40:52.259 INFO:tasks.workunit.client.0.smithi099.stdout:2/950: truncate d1/d2/d4d/d55/da5/d18/d27/d5b/d92/fd7 1213819 0 2024-09-19T06:40:52.277 INFO:tasks.workunit.client.0.smithi099.stdout:1/875: sync 2024-09-19T06:40:52.277 INFO:tasks.workunit.client.0.smithi099.stdout:6/964: sync 2024-09-19T06:40:52.280 INFO:tasks.workunit.client.0.smithi099.stdout:1/876: mkdir d0/d17/d24/d3a/d11b 0 2024-09-19T06:40:52.284 INFO:tasks.workunit.client.0.smithi099.stdout:6/965: dwrite d1/d5/f10e [0,4194304] 0 2024-09-19T06:40:52.284 INFO:tasks.workunit.client.0.smithi099.stdout:1/877: dread d0/d17/d24/d75/f90 [0,4194304] 0 2024-09-19T06:40:52.286 INFO:tasks.workunit.client.0.smithi099.stdout:6/966: dread - d1/d5/d38/ff5 zero size 2024-09-19T06:40:52.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:52 smithi117 ceph-mon[34564]: pgmap v24: 65 pgs: 65 active+clean; 4.2 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 147 MiB/s rd, 380 MiB/s wr, 767 op/s 2024-09-19T06:40:52.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:52 smithi117 ceph-mon[34564]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:40:52.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:52 smithi117 ceph-mon[34564]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:40:52.411 INFO:tasks.workunit.client.0.smithi099.stdout:1/878: dread d0/d17/d32/d7b/d99/fb6 [4194304,4194304] 0 2024-09-19T06:40:52.411 INFO:tasks.workunit.client.0.smithi099.stdout:6/967: unlink d1/d5/d24/d2b/d86/de0/f12a 0 2024-09-19T06:40:52.416 INFO:tasks.workunit.client.0.smithi099.stdout:1/879: mkdir d0/d17/d24/d3a/d58/d8d/dae/d11c 0 2024-09-19T06:40:52.419 INFO:tasks.workunit.client.0.smithi099.stdout:1/880: symlink d0/d17/d24/d75/dbb/de1/l11d 0 2024-09-19T06:40:52.423 INFO:tasks.workunit.client.0.smithi099.stdout:6/968: rmdir d1/d12/dda/d121 0 2024-09-19T06:40:52.424 INFO:tasks.workunit.client.0.smithi099.stdout:6/969: write d1/d5/d24/d2e/d41/d81/f101 [753506,62984] 0 2024-09-19T06:40:52.428 INFO:tasks.workunit.client.0.smithi099.stdout:6/970: rmdir d1/d5/d24/d2b/dc2 39 2024-09-19T06:40:52.445 INFO:tasks.workunit.client.0.smithi099.stdout:1/881: mkdir d0/d17/d5b/dba/d11e 0 2024-09-19T06:40:52.446 INFO:tasks.workunit.client.0.smithi099.stdout:1/882: stat d0/d17/d24/d75/f90 0 2024-09-19T06:40:52.448 INFO:tasks.workunit.client.0.smithi099.stdout:6/971: dread d1/d5/d38/d76/db0/d2a/f55 [0,4194304] 0 2024-09-19T06:40:52.448 INFO:tasks.workunit.client.0.smithi099.stdout:1/883: creat d0/d17/d24/d3a/d58/d8d/dd8/f11f x:0 0 0 2024-09-19T06:40:52.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:52 smithi099 ceph-mon[27651]: pgmap v24: 65 pgs: 65 active+clean; 4.2 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 147 MiB/s rd, 380 MiB/s wr, 767 op/s 2024-09-19T06:40:52.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:52 smithi099 ceph-mon[27651]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:40:52.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:52 smithi099 ceph-mon[27651]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:40:52.459 INFO:tasks.workunit.client.0.smithi099.stdout:6/972: dread d1/f10 [0,4194304] 0 2024-09-19T06:40:52.471 INFO:tasks.workunit.client.0.smithi099.stdout:6/973: write d1/d5/d24/f6a [2468341,112346] 0 2024-09-19T06:40:52.476 INFO:tasks.workunit.client.0.smithi099.stdout:6/974: dwrite d1/d5/d38/dbb/fef [0,4194304] 0 2024-09-19T06:40:52.479 INFO:tasks.workunit.client.0.smithi099.stdout:6/975: read d1/d5/d38/d76/db0/d54/f57 [586440,115689] 0 2024-09-19T06:40:52.481 INFO:tasks.workunit.client.0.smithi099.stdout:6/976: creat d1/d7c/f13f x:0 0 0 2024-09-19T06:40:52.484 INFO:tasks.workunit.client.0.smithi099.stdout:6/977: mkdir d1/d5/d24/d2e/d140 0 2024-09-19T06:40:52.487 INFO:tasks.workunit.client.0.smithi099.stdout:6/978: link d1/d5/d38/d76/db0/d54/f12d d1/d12/dda/f141 0 2024-09-19T06:40:52.489 INFO:tasks.workunit.client.0.smithi099.stdout:6/979: write d1/d5/d38/ff5 [83329,42505] 0 2024-09-19T06:40:52.490 INFO:tasks.workunit.client.0.smithi099.stdout:6/980: creat d1/d5/d52/f142 x:0 0 0 2024-09-19T06:40:52.493 INFO:tasks.workunit.client.0.smithi099.stdout:6/981: mknod d1/d5/d24/d2e/d6e/c143 0 2024-09-19T06:40:52.497 INFO:tasks.workunit.client.0.smithi099.stdout:6/982: write d1/f9 [228317,56188] 0 2024-09-19T06:40:52.499 INFO:tasks.workunit.client.0.smithi099.stdout:6/983: write d1/d5/d38/d76/db0/d54/d5d/fee [420812,36098] 0 2024-09-19T06:40:52.503 INFO:tasks.workunit.client.0.smithi099.stdout:6/984: rename d1/d5/f10e to d1/d5/d38/dbb/d9c/d107/d138/f144 0 2024-09-19T06:40:52.504 INFO:tasks.workunit.client.0.smithi099.stdout:6/985: write d1/d7c/f13f [26390,24576] 0 2024-09-19T06:40:52.505 INFO:tasks.workunit.client.0.smithi099.stdout:6/986: mkdir d1/d5/d52/d111/d145 0 2024-09-19T06:40:52.508 INFO:tasks.workunit.client.0.smithi099.stdout:6/987: write d1/d12/f83 [3292279,20811] 0 2024-09-19T06:40:52.509 INFO:tasks.workunit.client.0.smithi099.stdout:6/988: chown d1/d5/d24/d2e/d41/fb8 51665913 1 2024-09-19T06:40:52.512 INFO:tasks.workunit.client.0.smithi099.stdout:6/989: truncate d1/d5/d38/d76/db0/d2a/f8b 3583426 0 2024-09-19T06:40:52.513 INFO:tasks.workunit.client.0.smithi099.stdout:6/990: chown d1/d5/d24/d2e/d41/d81/dfe 317 1 2024-09-19T06:40:52.515 INFO:tasks.workunit.client.0.smithi099.stdout:6/991: creat d1/d5/d24/d2e/d41/f146 x:0 0 0 2024-09-19T06:40:52.517 INFO:tasks.workunit.client.0.smithi099.stdout:6/992: write d1/d5/d24/d2e/d41/d81/dfe/f122 [2043139,63890] 0 2024-09-19T06:40:52.518 INFO:tasks.workunit.client.0.smithi099.stdout:6/993: write d1/d5/d38/dbb/fef [2160551,43448] 0 2024-09-19T06:40:52.519 INFO:tasks.workunit.client.0.smithi099.stdout:6/994: chown d1/d5/d24/d2b/ff9 0 1 2024-09-19T06:40:52.523 INFO:tasks.workunit.client.0.smithi099.stdout:6/995: symlink d1/d5/d38/d76/db0/d54/d5d/l147 0 2024-09-19T06:40:52.525 INFO:tasks.workunit.client.0.smithi099.stdout:6/996: truncate d1/d5/d38/d76/db0/d54/f133 46272 0 2024-09-19T06:40:52.525 INFO:tasks.workunit.client.0.smithi099.stdout:6/997: dread - d1/d5/d38/dbb/d9c/f11f zero size 2024-09-19T06:40:52.528 INFO:tasks.workunit.client.0.smithi099.stdout:6/998: rename d1/l18 to d1/d5/d38/dbb/d9c/l148 0 2024-09-19T06:40:52.535 INFO:tasks.workunit.client.0.smithi099.stdout:6/999: rename d1/d5/d24/f89 to d1/d5/d38/d76/f149 0 2024-09-19T06:40:52.879 INFO:tasks.workunit.client.0.smithi099.stdout:1/884: sync 2024-09-19T06:40:52.879 INFO:tasks.workunit.client.0.smithi099.stdout:2/951: sync 2024-09-19T06:40:52.881 INFO:tasks.workunit.client.0.smithi099.stdout:2/952: creat d1/d2/d4d/d55/da5/d18/d76/f13e x:0 0 0 2024-09-19T06:40:52.883 INFO:tasks.workunit.client.0.smithi099.stdout:2/953: symlink d1/d2/d4d/d55/da5/d9/db7/l13f 0 2024-09-19T06:40:52.883 INFO:tasks.workunit.client.0.smithi099.stdout:1/885: link d0/d17/d24/d5e/d8a/ce8 d0/d17/d24/d75/c120 0 2024-09-19T06:40:52.885 INFO:tasks.workunit.client.0.smithi099.stdout:1/886: symlink d0/d17/d24/d5e/d8a/l121 0 2024-09-19T06:40:52.889 INFO:tasks.workunit.client.0.smithi099.stdout:1/887: dread d0/d68/daf/fdf [0,4194304] 0 2024-09-19T06:40:52.892 INFO:tasks.workunit.client.0.smithi099.stdout:1/888: rename d0/d17/d24/d3a/c4f to d0/d17/d24/d3a/c122 0 2024-09-19T06:40:52.893 INFO:tasks.workunit.client.0.smithi099.stdout:2/954: dwrite d1/d2/f7a [0,4194304] 0 2024-09-19T06:40:52.895 INFO:tasks.workunit.client.0.smithi099.stdout:2/955: mknod d1/d2/d4d/d55/da5/d18/d76/c140 0 2024-09-19T06:40:52.899 INFO:tasks.workunit.client.0.smithi099.stdout:2/956: creat d1/d2/d4d/d55/da5/d9/d63/dc6/d6/d129/f141 x:0 0 0 2024-09-19T06:40:52.903 INFO:tasks.workunit.client.0.smithi099.stdout:2/957: getdents d1/d2/d4d 0 2024-09-19T06:40:52.907 INFO:tasks.workunit.client.0.smithi099.stdout:2/958: creat d1/d2/d4d/d55/da5/d18/d76/f142 x:0 0 0 2024-09-19T06:40:52.907 INFO:tasks.workunit.client.0.smithi099.stdout:1/889: dwrite d0/d68/fc2 [0,4194304] 0 2024-09-19T06:40:52.908 INFO:tasks.workunit.client.0.smithi099.stdout:1/890: chown d0/d12/f79 43 1 2024-09-19T06:40:52.909 INFO:tasks.workunit.client.0.smithi099.stdout:2/959: fdatasync d1/d2/d4d/d55/da5/d9/d63/dc6/d6/d129/f141 0 2024-09-19T06:40:52.910 INFO:tasks.workunit.client.0.smithi099.stdout:1/891: mkdir d0/d17/d5b/dba/d117/d123 0 2024-09-19T06:40:52.912 INFO:tasks.workunit.client.0.smithi099.stdout:2/960: unlink d1/d2/d4d/d55/da5/d9/d63/dc6/d6/ced 0 2024-09-19T06:40:52.914 INFO:tasks.workunit.client.0.smithi099.stdout:1/892: mkdir d0/d17/d5b/dba/d11e/d124 0 2024-09-19T06:40:52.914 INFO:tasks.workunit.client.0.smithi099.stdout:2/961: fdatasync d1/d2/d4d/d55/da5/d18/d27/d5b/f8c 0 2024-09-19T06:40:52.915 INFO:tasks.workunit.client.0.smithi099.stdout:2/962: dread - d1/d2/d4d/d55/da5/d18/d76/f142 zero size 2024-09-19T06:40:52.916 INFO:tasks.workunit.client.0.smithi099.stdout:1/893: creat d0/d17/d32/d10d/f125 x:0 0 0 2024-09-19T06:40:52.917 INFO:tasks.workunit.client.0.smithi099.stdout:1/894: read d0/d17/d24/d75/dbb/de1/fe2 [1767436,50799] 0 2024-09-19T06:40:52.917 INFO:tasks.workunit.client.0.smithi099.stdout:1/895: chown d0 423 1 2024-09-19T06:40:52.919 INFO:tasks.workunit.client.0.smithi099.stdout:2/963: creat d1/d2/d4d/d55/f143 x:0 0 0 2024-09-19T06:40:52.922 INFO:tasks.workunit.client.0.smithi099.stdout:1/896: getdents d0/d17/d24/d3a/da4 0 2024-09-19T06:40:52.924 INFO:tasks.workunit.client.0.smithi099.stdout:2/964: creat d1/d2/d4d/d55/da5/d9/d63/dc6/d77/d98/de0/d12f/f144 x:0 0 0 2024-09-19T06:40:52.925 INFO:tasks.workunit.client.0.smithi099.stdout:1/897: rename d0/d17/d32/d7b/lf9 to d0/d17/d24/d3a/l126 0 2024-09-19T06:40:52.926 INFO:tasks.workunit.client.0.smithi099.stdout:1/898: fsync d0/d17/d24/d5e/f103 0 2024-09-19T06:40:52.927 INFO:tasks.workunit.client.0.smithi099.stdout:2/965: rename d1/d2/d4d/d55/da5/d18/d2d/de3/de6/c119 to d1/d2/d4d/d55/da5/d18/d46/c145 0 2024-09-19T06:40:52.927 INFO:tasks.workunit.client.0.smithi099.stdout:1/899: unlink d0/d17/d24/d5e/d8a/cb7 0 2024-09-19T06:40:52.929 INFO:tasks.workunit.client.0.smithi099.stdout:2/966: fsync d1/d2/d4d/d55/da5/d9/d63/dc6/d13/d2c/f38 0 2024-09-19T06:40:52.930 INFO:tasks.workunit.client.0.smithi099.stdout:1/900: mkdir d0/d17/d24/d75/dbb/de1/d127 0 2024-09-19T06:40:52.931 INFO:tasks.workunit.client.0.smithi099.stdout:1/901: fdatasync d0/d17/d24/d3a/df0/ffd 0 2024-09-19T06:40:52.933 INFO:tasks.workunit.client.0.smithi099.stdout:1/902: creat d0/d17/d24/d3a/d58/d8d/dae/d11c/f128 x:0 0 0 2024-09-19T06:40:52.936 INFO:tasks.workunit.client.0.smithi099.stdout:2/967: dwrite d1/f7f [0,4194304] 0 2024-09-19T06:40:52.942 INFO:tasks.workunit.client.0.smithi099.stdout:2/968: rename d1/d2/d4d/d55/da5/d9/d63/dc6/ce to d1/d2/d4d/d55/c146 0 2024-09-19T06:40:52.944 INFO:tasks.workunit.client.0.smithi099.stdout:1/903: dwrite d0/f82 [0,4194304] 0 2024-09-19T06:40:52.949 INFO:tasks.workunit.client.0.smithi099.stdout:1/904: rename d0/d17/d24/c9c to d0/d12/d54/c129 0 2024-09-19T06:40:52.970 INFO:tasks.workunit.client.0.smithi099.stdout:1/905: dread d0/d17/d24/f55 [0,4194304] 0 2024-09-19T06:40:52.971 INFO:tasks.workunit.client.0.smithi099.stdout:1/906: symlink d0/d17/d24/d75/dbb/l12a 0 2024-09-19T06:40:52.972 INFO:tasks.workunit.client.0.smithi099.stdout:1/907: write d0/d68/fc2 [2876007,77019] 0 2024-09-19T06:40:52.974 INFO:tasks.workunit.client.0.smithi099.stdout:1/908: chown d0/d17/d24/d5e/d8a/da3 225 1 2024-09-19T06:40:52.977 INFO:tasks.workunit.client.0.smithi099.stdout:1/909: dread d0/d12/d13/f2b [4194304,4194304] 0 2024-09-19T06:40:52.981 INFO:tasks.workunit.client.0.smithi099.stdout:1/910: rmdir d0/d17/d5b/dba/d117/d123 0 2024-09-19T06:40:52.982 INFO:tasks.workunit.client.0.smithi099.stdout:1/911: stat d0/d17/d24/f55 0 2024-09-19T06:40:52.983 INFO:tasks.workunit.client.0.smithi099.stdout:1/912: fdatasync d0/d17/d32/d7b/db0/f108 0 2024-09-19T06:40:52.985 INFO:tasks.workunit.client.0.smithi099.stdout:1/913: unlink d0/d17/d24/d75/dbb/de1/l11d 0 2024-09-19T06:40:52.986 INFO:tasks.workunit.client.0.smithi099.stdout:1/914: write d0/d17/d24/d3a/d58/d8d/dae/fe9 [814392,19004] 0 2024-09-19T06:40:52.988 INFO:tasks.workunit.client.0.smithi099.stdout:1/915: read - d0/d12/d13/d37/d41/d78/feb zero size 2024-09-19T06:40:52.990 INFO:tasks.workunit.client.0.smithi099.stdout:1/916: rename d0/d17/d32/fc8 to d0/f12b 0 2024-09-19T06:40:52.996 INFO:tasks.workunit.client.0.smithi099.stdout:1/917: write d0/f7d [990481,115603] 0 2024-09-19T06:40:52.997 INFO:tasks.workunit.client.0.smithi099.stdout:1/918: mkdir d0/d17/d32/d7b/d99/d12c 0 2024-09-19T06:40:52.999 INFO:tasks.workunit.client.0.smithi099.stdout:1/919: rmdir d0/d17/d5b/dba/d11e 39 2024-09-19T06:40:53.001 INFO:tasks.workunit.client.0.smithi099.stdout:1/920: truncate d0/d17/d32/d7b/d99/fb6 3696525 0 2024-09-19T06:40:53.006 INFO:tasks.workunit.client.0.smithi099.stdout:1/921: dwrite d0/d12/d54/f104 [0,4194304] 0 2024-09-19T06:40:53.009 INFO:tasks.workunit.client.0.smithi099.stdout:1/922: readlink d0/d17/d24/lf5 0 2024-09-19T06:40:53.016 INFO:tasks.workunit.client.0.smithi099.stdout:1/923: dwrite d0/d12/d13/fc7 [0,4194304] 0 2024-09-19T06:40:53.018 INFO:tasks.workunit.client.0.smithi099.stdout:1/924: write d0/d17/d32/d7b/db0/f110 [790529,68376] 0 2024-09-19T06:40:53.019 INFO:tasks.workunit.client.0.smithi099.stdout:1/925: rmdir d0/d17/d24/d3a/da4 39 2024-09-19T06:40:53.042 INFO:tasks.workunit.client.0.smithi099.stdout:1/926: dread d0/d17/d32/d7b/d99/fb6 [0,4194304] 0 2024-09-19T06:40:53.043 INFO:tasks.workunit.client.0.smithi099.stdout:1/927: readlink d0/d17/d24/d75/dbb/l12a 0 2024-09-19T06:40:53.045 INFO:tasks.workunit.client.0.smithi099.stdout:1/928: creat d0/d17/f12d x:0 0 0 2024-09-19T06:40:53.049 INFO:tasks.workunit.client.0.smithi099.stdout:1/929: link d0/d12/f79 d0/d12/d13/d37/d48/f12e 0 2024-09-19T06:40:53.050 INFO:tasks.workunit.client.0.smithi099.stdout:1/930: mkdir d0/d68/d12f 0 2024-09-19T06:40:53.052 INFO:tasks.workunit.client.0.smithi099.stdout:1/931: creat d0/d17/d24/d3a/d58/d8d/f130 x:0 0 0 2024-09-19T06:40:53.057 INFO:tasks.workunit.client.0.smithi099.stdout:1/932: truncate d0/d17/d32/f53 766480 0 2024-09-19T06:40:53.059 INFO:tasks.workunit.client.0.smithi099.stdout:1/933: truncate d0/d17/d32/d7b/db0/fb1 1476843 0 2024-09-19T06:40:53.061 INFO:tasks.workunit.client.0.smithi099.stdout:1/934: mkdir d0/d17/d24/d3a/d58/d8d/dd5/d131 0 2024-09-19T06:40:53.085 INFO:tasks.workunit.client.0.smithi099.stdout:1/935: getdents d0/d17/d24/d3a/da4 0 2024-09-19T06:40:53.087 INFO:tasks.workunit.client.0.smithi099.stdout:1/936: creat d0/d17/d24/d3a/f132 x:0 0 0 2024-09-19T06:40:53.089 INFO:tasks.workunit.client.0.smithi099.stdout:1/937: rename d0/d68/fd0 to d0/d17/d32/d7b/d99/d12c/f133 0 2024-09-19T06:40:53.090 INFO:tasks.workunit.client.0.smithi099.stdout:1/938: stat d0/d17/d24/d3a/f81 0 2024-09-19T06:40:53.096 INFO:tasks.workunit.client.0.smithi099.stdout:1/939: dwrite d0/f29 [0,4194304] 0 2024-09-19T06:40:53.097 INFO:tasks.workunit.client.0.smithi099.stdout:1/940: chown d0/d17/d24/d3a/d58/d8d/dd5/d131 10 1 2024-09-19T06:40:53.100 INFO:tasks.workunit.client.0.smithi099.stdout:1/941: creat d0/d17/d24/d3a/d58/d8d/dd5/d131/f134 x:0 0 0 2024-09-19T06:40:53.114 INFO:tasks.workunit.client.0.smithi099.stdout:1/942: dwrite d0/d12/d13/d37/d41/fc6 [0,4194304] 0 2024-09-19T06:40:53.116 INFO:tasks.workunit.client.0.smithi099.stdout:1/943: mknod d0/d17/d24/d75/dbb/de1/d127/c135 0 2024-09-19T06:40:53.120 INFO:tasks.workunit.client.0.smithi099.stdout:1/944: creat d0/d17/d5b/dba/f136 x:0 0 0 2024-09-19T06:40:53.318 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:53 smithi099 ceph-mon[27651]: Reconfiguring alertmanager.smithi099 (dependencies changed)... 2024-09-19T06:40:53.318 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:53 smithi099 ceph-mon[27651]: Deploying daemon alertmanager.smithi099 on smithi099 2024-09-19T06:40:53.345 INFO:tasks.workunit.client.0.smithi099.stdout:2/969: sync 2024-09-19T06:40:53.346 INFO:tasks.workunit.client.0.smithi099.stdout:1/945: sync 2024-09-19T06:40:53.346 INFO:tasks.workunit.client.0.smithi099.stdout:2/970: write d1/f4f [911891,78641] 0 2024-09-19T06:40:53.347 INFO:tasks.workunit.client.0.smithi099.stdout:1/946: write d0/d17/d24/d5e/f92 [622058,81219] 0 2024-09-19T06:40:53.349 INFO:tasks.workunit.client.0.smithi099.stdout:2/971: mknod d1/d2/d4d/d55/da5/d18/d76/c147 0 2024-09-19T06:40:53.350 INFO:tasks.workunit.client.0.smithi099.stdout:1/947: unlink d0/d17/d32/d7b/db0/f110 0 2024-09-19T06:40:53.351 INFO:tasks.workunit.client.0.smithi099.stdout:2/972: write d1/d2/d4d/d55/da5/d18/d27/d5b/dd4/f13a [928679,74899] 0 2024-09-19T06:40:53.354 INFO:tasks.workunit.client.0.smithi099.stdout:1/948: rename d0/d17/c65 to d0/d17/d24/d75/dbb/c137 0 2024-09-19T06:40:53.357 INFO:tasks.workunit.client.0.smithi099.stdout:1/949: getdents d0/d17/d24/d3a 0 2024-09-19T06:40:53.358 INFO:tasks.workunit.client.0.smithi099.stdout:1/950: chown d0/d17/d24/d5e/f92 106950546 1 2024-09-19T06:40:53.359 INFO:tasks.workunit.client.0.smithi099.stdout:1/951: symlink d0/d17/d5b/dba/d117/l138 0 2024-09-19T06:40:53.361 INFO:tasks.workunit.client.0.smithi099.stdout:1/952: write d0/d12/d13/d37/d48/f7c [4141865,116804] 0 2024-09-19T06:40:53.366 INFO:tasks.workunit.client.0.smithi099.stdout:1/953: truncate d0/d68/daf/fdf 600236 0 2024-09-19T06:40:53.368 INFO:tasks.workunit.client.0.smithi099.stdout:1/954: link d0/d17/d5b/c83 d0/d17/d24/d3a/d58/d8d/dae/d11c/c139 0 2024-09-19T06:40:53.369 INFO:tasks.workunit.client.0.smithi099.stdout:1/955: fsync d0/d17/d24/f6a 0 2024-09-19T06:40:53.370 INFO:tasks.workunit.client.0.smithi099.stdout:1/956: dread - d0/fd2 zero size 2024-09-19T06:40:53.371 INFO:tasks.workunit.client.0.smithi099.stdout:1/957: dread - d0/d17/d24/d3a/d58/d8d/dae/d11c/f128 zero size 2024-09-19T06:40:53.374 INFO:tasks.workunit.client.0.smithi099.stdout:1/958: creat d0/d17/d24/d3a/d58/d8d/dae/f13a x:0 0 0 2024-09-19T06:40:53.374 INFO:tasks.workunit.client.0.smithi099.stdout:1/959: stat d0/d17/d24/d5e/d8a/fe7 0 2024-09-19T06:40:53.377 INFO:tasks.workunit.client.0.smithi099.stdout:1/960: creat d0/d12/d13/d37/d48/db9/f13b x:0 0 0 2024-09-19T06:40:53.378 INFO:tasks.workunit.client.0.smithi099.stdout:1/961: symlink d0/db/l13c 0 2024-09-19T06:40:53.381 INFO:tasks.workunit.client.0.smithi099.stdout:1/962: rmdir d0/d17/d24/d5e/d8a/da3 0 2024-09-19T06:40:53.389 INFO:tasks.workunit.client.0.smithi099.stdout:1/963: dwrite d0/d12/f79 [0,4194304] 0 2024-09-19T06:40:53.396 INFO:tasks.workunit.client.0.smithi099.stdout:1/964: dwrite d0/d17/d24/d3a/d58/d8d/dae/db8/f10b [0,4194304] 0 2024-09-19T06:40:53.399 INFO:tasks.workunit.client.0.smithi099.stdout:1/965: rename d0/d17/d24/d75/la8 to d0/d2d/l13d 0 2024-09-19T06:40:53.401 INFO:tasks.workunit.client.0.smithi099.stdout:1/966: truncate d0/db/f31 1831562 0 2024-09-19T06:40:53.403 INFO:tasks.workunit.client.0.smithi099.stdout:1/967: dread - d0/d68/daf/fe6 zero size 2024-09-19T06:40:53.407 INFO:tasks.workunit.client.0.smithi099.stdout:1/968: read d0/d17/d24/f46 [135693,45141] 0 2024-09-19T06:40:53.408 INFO:tasks.workunit.client.0.smithi099.stdout:1/969: unlink d0/d17/d32/c74 0 2024-09-19T06:40:53.410 INFO:tasks.workunit.client.0.smithi099.stdout:1/970: truncate d0/fd2 267263 0 2024-09-19T06:40:53.410 INFO:tasks.workunit.client.0.smithi099.stdout:1/971: readlink d0/d17/d24/d3a/d58/d8d/la7 0 2024-09-19T06:40:53.412 INFO:tasks.workunit.client.0.smithi099.stdout:1/972: mkdir d0/d17/d24/d5e/d13e 0 2024-09-19T06:40:53.417 INFO:tasks.workunit.client.0.smithi099.stdout:1/973: rmdir d0/d2d 39 2024-09-19T06:40:53.418 INFO:tasks.workunit.client.0.smithi099.stdout:1/974: read d0/d17/d24/d5e/d8a/ff3 [938806,19200] 0 2024-09-19T06:40:53.421 INFO:tasks.workunit.client.0.smithi099.stdout:1/975: creat d0/d2d/df8/f13f x:0 0 0 2024-09-19T06:40:53.423 INFO:tasks.workunit.client.0.smithi099.stdout:1/976: truncate d0/d17/d24/d3a/d58/d8d/dd5/d131/f134 461863 0 2024-09-19T06:40:53.424 INFO:tasks.workunit.client.0.smithi099.stdout:1/977: fdatasync d0/d12/d13/d37/d41/fa0 0 2024-09-19T06:40:53.428 INFO:tasks.workunit.client.0.smithi099.stdout:1/978: write d0/d12/d13/d37/d41/d78/fc5 [657341,30023] 0 2024-09-19T06:40:53.428 INFO:tasks.workunit.client.0.smithi099.stdout:1/979: readlink d0/d17/d24/d5e/d8a/l121 0 2024-09-19T06:40:53.429 INFO:tasks.workunit.client.0.smithi099.stdout:1/980: dread - d0/d17/d5b/dba/f115 zero size 2024-09-19T06:40:53.430 INFO:tasks.workunit.client.0.smithi099.stdout:1/981: chown d0/d17/d24/d3a/df0/ffd 1694816 1 2024-09-19T06:40:53.433 INFO:tasks.workunit.client.0.smithi099.stdout:1/982: creat d0/d17/d24/f140 x:0 0 0 2024-09-19T06:40:53.435 INFO:tasks.workunit.client.0.smithi099.stdout:1/983: unlink d0/d17/d24/d5e/lb3 0 2024-09-19T06:40:53.441 INFO:tasks.workunit.client.0.smithi099.stdout:1/984: dwrite d0/d17/f12d [0,4194304] 0 2024-09-19T06:40:53.444 INFO:tasks.workunit.client.0.smithi099.stdout:1/985: symlink d0/d68/l141 0 2024-09-19T06:40:53.449 INFO:tasks.workunit.client.0.smithi099.stdout:1/986: dwrite d0/d17/d24/d5e/f92 [0,4194304] 0 2024-09-19T06:40:53.459 INFO:tasks.workunit.client.0.smithi099.stdout:1/987: write d0/d17/d5b/dba/dcb/f118 [397472,49754] 0 2024-09-19T06:40:53.463 INFO:tasks.workunit.client.0.smithi099.stdout:1/988: unlink d0/d17/d24/d3a/d58/d8d/dae/f13a 0 2024-09-19T06:40:53.464 INFO:tasks.workunit.client.0.smithi099.stdout:1/989: chown d0/d12/d13/f89 16037 1 2024-09-19T06:40:53.466 INFO:tasks.workunit.client.0.smithi099.stdout:1/990: mkdir d0/d17/d32/d10d/d142 0 2024-09-19T06:40:53.466 INFO:tasks.workunit.client.0.smithi099.stdout:1/991: fdatasync d0/d2d/f11a 0 2024-09-19T06:40:53.469 INFO:tasks.workunit.client.0.smithi099.stdout:1/992: unlink d0/d12/d13/d37/d41/c52 0 2024-09-19T06:40:53.470 INFO:tasks.workunit.client.0.smithi099.stdout:1/993: write d0/d17/d24/d3a/df0/ffd [724925,75828] 0 2024-09-19T06:40:53.471 INFO:tasks.workunit.client.0.smithi099.stdout:1/994: write d0/d2d/f10f [852744,9589] 0 2024-09-19T06:40:53.474 INFO:tasks.workunit.client.0.smithi099.stdout:1/995: symlink d0/d17/d24/d3a/d58/d8d/dae/db8/l143 0 2024-09-19T06:40:53.475 INFO:tasks.workunit.client.0.smithi099.stdout:1/996: fdatasync d0/d17/d32/d7b/d99/d12c/f133 0 2024-09-19T06:40:53.476 INFO:tasks.workunit.client.0.smithi099.stdout:1/997: read - d0/d12/d13/d37/d41/d78/f8f zero size 2024-09-19T06:40:53.478 INFO:tasks.workunit.client.0.smithi099.stdout:1/998: creat d0/d17/d24/d3a/d11b/f144 x:0 0 0 2024-09-19T06:40:53.479 INFO:tasks.workunit.client.0.smithi099.stdout:1/999: truncate d0/d17/d24/d5e/f103 374289 0 2024-09-19T06:40:53.557 INFO:tasks.workunit.client.0.smithi099.stdout:2/973: sync 2024-09-19T06:40:53.557 INFO:tasks.workunit.client.0.smithi099.stdout:2/974: stat d1 0 2024-09-19T06:40:53.559 INFO:tasks.workunit.client.0.smithi099.stdout:2/975: write d1/d2/d4d/d55/da5/d9/d63/dc6/d13/de7/f11a [1023251,41853] 0 2024-09-19T06:40:53.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:53 smithi117 ceph-mon[34564]: Reconfiguring alertmanager.smithi099 (dependencies changed)... 2024-09-19T06:40:53.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:53 smithi117 ceph-mon[34564]: Deploying daemon alertmanager.smithi099 on smithi099 2024-09-19T06:40:53.562 INFO:tasks.workunit.client.0.smithi099.stdout:2/976: symlink d1/d2/d4d/d55/da5/d18/d76/l148 0 2024-09-19T06:40:53.567 INFO:tasks.workunit.client.0.smithi099.stdout:2/977: dwrite d1/d2/d4d/d55/da5/da8/fd9 [0,4194304] 0 2024-09-19T06:40:53.573 INFO:tasks.workunit.client.0.smithi099.stdout:2/978: dwrite d1/d2/d4d/d55/da5/d18/d76/ffb [0,4194304] 0 2024-09-19T06:40:53.577 INFO:tasks.workunit.client.0.smithi099.stdout:2/979: mkdir d1/d2/d4d/d55/da5/d18/d27/ddd/d10a/d149 0 2024-09-19T06:40:53.584 INFO:tasks.workunit.client.0.smithi099.stdout:2/980: write d1/d2/d4d/d8e/f100 [1511067,83379] 0 2024-09-19T06:40:53.586 INFO:tasks.workunit.client.0.smithi099.stdout:2/981: write d1/d2/d4d/d55/da5/d36/fa7 [462543,60894] 0 2024-09-19T06:40:53.586 INFO:tasks.workunit.client.0.smithi099.stdout:2/982: chown d1/c43 1888 1 2024-09-19T06:40:53.589 INFO:tasks.workunit.client.0.smithi099.stdout:2/983: symlink d1/d2/d4d/d55/da5/d9/d63/dc6/d77/d98/l14a 0 2024-09-19T06:40:53.589 INFO:tasks.workunit.client.0.smithi099.stdout:2/984: chown d1/d2/l85 603185 1 2024-09-19T06:40:53.591 INFO:tasks.workunit.client.0.smithi099.stdout:2/985: write d1/d2/d4d/d55/da5/d18/d76/fda [1588963,84155] 0 2024-09-19T06:40:53.594 INFO:tasks.workunit.client.0.smithi099.stdout:2/986: creat d1/d2/d4d/d55/da5/d18/d27/f14b x:0 0 0 2024-09-19T06:40:53.598 INFO:tasks.workunit.client.0.smithi099.stdout:2/987: dread d1/d2/d4d/d55/da5/d36/f41 [0,4194304] 0 2024-09-19T06:40:53.604 INFO:tasks.workunit.client.0.smithi099.stdout:2/988: dwrite d1/d2/d4d/d55/da5/d9/d63/dc6/d13/d2c/f12d [0,4194304] 0 2024-09-19T06:40:53.611 INFO:tasks.workunit.client.0.smithi099.stdout:2/989: dwrite d1/d2/d4d/d55/da5/d9/d63/dc6/d13/f54 [0,4194304] 0 2024-09-19T06:40:53.614 INFO:tasks.workunit.client.0.smithi099.stdout:2/990: mkdir d1/d2/d4d/d55/da5/d18/d46/d14c 0 2024-09-19T06:40:53.627 INFO:tasks.workunit.client.0.smithi099.stdout:2/991: dwrite d1/d2/d4d/d55/da5/d18/f2f [0,4194304] 0 2024-09-19T06:40:53.631 INFO:tasks.workunit.client.0.smithi099.stdout:2/992: creat d1/d2/d4d/d55/da5/d18/d46/d14c/f14d x:0 0 0 2024-09-19T06:40:53.633 INFO:tasks.workunit.client.0.smithi099.stdout:2/993: mknod d1/d2/d4d/d55/da5/d18/d46/c14e 0 2024-09-19T06:40:53.638 INFO:tasks.workunit.client.0.smithi099.stdout:2/994: link d1/d2/d4d/d55/da5/d9/d63/dc6/d13/d2c/f49 d1/d2/d4d/f14f 0 2024-09-19T06:40:53.644 INFO:tasks.workunit.client.0.smithi099.stdout:2/995: dwrite d1/d2/d4d/d55/da5/d36/fd0 [0,4194304] 0 2024-09-19T06:40:53.649 INFO:tasks.workunit.client.0.smithi099.stdout:2/996: rename d1/d2/d4d/d55/da5/d9/d63/l106 to d1/d2/d4d/d55/da5/d9/d63/dc6/d77/d98/de0/d12f/d137/l150 0 2024-09-19T06:40:53.656 INFO:tasks.workunit.client.0.smithi099.stdout:2/997: truncate d1/d2/d4d/d55/da5/d9/d63/dc6/d13/d2c/fff 2607185 0 2024-09-19T06:40:53.657 INFO:tasks.workunit.client.0.smithi099.stdout:2/998: chown d1/d2/d4d/d55 1662 1 2024-09-19T06:40:53.659 INFO:tasks.workunit.client.0.smithi099.stdout:2/999: mknod d1/d2/d4d/d55/da5/d9/d63/dc6/d77/c151 0 2024-09-19T06:40:53.663 INFO:tasks.workunit.client.0.smithi099.stderr:+ rm -rf -- ./tmp.U6D5mw6kxU 2024-09-19T06:40:54.401 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:54 smithi099 ceph-mon[27651]: pgmap v25: 65 pgs: 65 active+clean; 4.2 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 91 MiB/s rd, 236 MiB/s wr, 497 op/s 2024-09-19T06:40:54.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:54 smithi117 ceph-mon[34564]: pgmap v25: 65 pgs: 65 active+clean; 4.2 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 91 MiB/s rd, 236 MiB/s wr, 497 op/s 2024-09-19T06:40:55.373 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:55 smithi099 ceph-mon[27651]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:40:55.373 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:55 smithi099 ceph-mon[27651]: pgmap v26: 65 pgs: 65 active+clean; 4.2 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 91 MiB/s rd, 236 MiB/s wr, 497 op/s 2024-09-19T06:40:55.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:55 smithi117 ceph-mon[34564]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:40:55.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:55 smithi117 ceph-mon[34564]: pgmap v26: 65 pgs: 65 active+clean; 4.2 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 91 MiB/s rd, 236 MiB/s wr, 497 op/s 2024-09-19T06:40:58.190 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:40:58 smithi099 ceph-mon[27651]: pgmap v27: 65 pgs: 65 active+clean; 3.8 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 102 MiB/s rd, 270 MiB/s wr, 632 op/s 2024-09-19T06:40:58.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:40:58 smithi117 ceph-mon[34564]: pgmap v27: 65 pgs: 65 active+clean; 3.8 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 102 MiB/s rd, 270 MiB/s wr, 632 op/s 2024-09-19T06:41:00.083 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:00 smithi099 ceph-mon[27651]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:41:00.083 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:00 smithi099 ceph-mon[27651]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:41:00.083 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:00 smithi099 ceph-mon[27651]: Reconfiguring grafana.smithi099 (dependencies changed)... 2024-09-19T06:41:00.083 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:00 smithi099 ceph-mon[27651]: pgmap v28: 65 pgs: 65 active+clean; 3.8 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 56 MiB/s rd, 150 MiB/s wr, 386 op/s 2024-09-19T06:41:00.083 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:00 smithi099 ceph-mon[27651]: Reconfiguring daemon grafana.smithi099 on smithi099 2024-09-19T06:41:00.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:00 smithi117 ceph-mon[34564]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:41:00.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:00 smithi117 ceph-mon[34564]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:41:00.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:00 smithi117 ceph-mon[34564]: Reconfiguring grafana.smithi099 (dependencies changed)... 2024-09-19T06:41:00.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:00 smithi117 ceph-mon[34564]: pgmap v28: 65 pgs: 65 active+clean; 3.8 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 56 MiB/s rd, 150 MiB/s wr, 386 op/s 2024-09-19T06:41:00.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:00 smithi117 ceph-mon[34564]: Reconfiguring daemon grafana.smithi099 on smithi099 2024-09-19T06:41:01.463 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T06:41:01.463 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-09-19T06:41:02.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:02 smithi117 ceph-mon[34564]: pgmap v29: 65 pgs: 65 active+clean; 2.1 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 56 MiB/s rd, 151 MiB/s wr, 520 op/s 2024-09-19T06:41:02.439 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:02 smithi099 ceph-mon[27651]: pgmap v29: 65 pgs: 65 active+clean; 2.1 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 56 MiB/s rd, 151 MiB/s wr, 520 op/s 2024-09-19T06:41:03.993 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T06:41:03.993 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T06:41:04.426 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:04 smithi099 ceph-mon[27651]: pgmap v30: 65 pgs: 65 active+clean; 2.1 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 11 MiB/s rd, 36 MiB/s wr, 268 op/s 2024-09-19T06:41:04.426 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:04 smithi099 ceph-mon[27651]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:41:04.426 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:04 smithi099 ceph-mon[27651]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:41:04.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:04 smithi117 ceph-mon[34564]: pgmap v30: 65 pgs: 65 active+clean; 2.1 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 11 MiB/s rd, 36 MiB/s wr, 268 op/s 2024-09-19T06:41:04.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:04 smithi117 ceph-mon[34564]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:41:04.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:04 smithi117 ceph-mon[34564]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:41:05.362 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:05 smithi099 ceph-mon[27651]: Reconfiguring prometheus.smithi099 (dependencies changed)... 2024-09-19T06:41:05.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:05 smithi117 ceph-mon[34564]: Reconfiguring prometheus.smithi099 (dependencies changed)... 2024-09-19T06:41:06.289 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:06 smithi099 ceph-mon[27651]: Deploying daemon prometheus.smithi099 on smithi099 2024-09-19T06:41:06.289 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:06 smithi099 ceph-mon[27651]: pgmap v31: 65 pgs: 65 active+clean; 2.1 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 11 MiB/s rd, 36 MiB/s wr, 268 op/s 2024-09-19T06:41:06.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:06 smithi117 ceph-mon[34564]: Deploying daemon prometheus.smithi099 on smithi099 2024-09-19T06:41:06.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:06 smithi117 ceph-mon[34564]: pgmap v31: 65 pgs: 65 active+clean; 2.1 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 11 MiB/s rd, 36 MiB/s wr, 268 op/s 2024-09-19T06:41:07.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:07 smithi099 ceph-mon[27651]: pgmap v32: 65 pgs: 65 active+clean; 643 MiB data, 3.8 GiB used, 533 GiB / 536 GiB avail; 11 MiB/s rd, 36 MiB/s wr, 405 op/s 2024-09-19T06:41:07.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:07 smithi117 ceph-mon[34564]: pgmap v32: 65 pgs: 65 active+clean; 643 MiB data, 3.8 GiB used, 533 GiB / 536 GiB avail; 11 MiB/s rd, 36 MiB/s wr, 405 op/s 2024-09-19T06:41:10.268 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:10 smithi099 ceph-mon[27651]: pgmap v33: 65 pgs: 65 active+clean; 643 MiB data, 3.8 GiB used, 533 GiB / 536 GiB avail; 40 KiB/s rd, 1.9 MiB/s wr, 271 op/s 2024-09-19T06:41:10.268 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:10 smithi099 ceph-mon[27651]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:41:10.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:10 smithi117 ceph-mon[34564]: pgmap v33: 65 pgs: 65 active+clean; 643 MiB data, 3.8 GiB used, 533 GiB / 536 GiB avail; 40 KiB/s rd, 1.9 MiB/s wr, 271 op/s 2024-09-19T06:41:10.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:10 smithi117 ceph-mon[34564]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:41:11.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:11 smithi099 ceph-mon[27651]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:41:11.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:11 smithi099 ceph-mon[27651]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:41:11.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:11 smithi099 ceph-mon[27651]: Reconfiguring node-exporter.smithi117 (dependencies changed)... 2024-09-19T06:41:11.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:11 smithi099 ceph-mon[27651]: Deploying daemon node-exporter.smithi117 on smithi117 2024-09-19T06:41:11.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:11 smithi099 ceph-mon[27651]: pgmap v34: 65 pgs: 65 active+clean; 284 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 62 KiB/s rd, 2.9 MiB/s wr, 509 op/s 2024-09-19T06:41:11.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:11 smithi117 ceph-mon[34564]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:41:11.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:11 smithi117 ceph-mon[34564]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:41:11.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:11 smithi117 ceph-mon[34564]: Reconfiguring node-exporter.smithi117 (dependencies changed)... 2024-09-19T06:41:11.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:11 smithi117 ceph-mon[34564]: Deploying daemon node-exporter.smithi117 on smithi117 2024-09-19T06:41:11.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:11 smithi117 ceph-mon[34564]: pgmap v34: 65 pgs: 65 active+clean; 284 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 62 KiB/s rd, 2.9 MiB/s wr, 509 op/s 2024-09-19T06:41:14.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:14 smithi099 ceph-mon[27651]: pgmap v35: 65 pgs: 65 active+clean; 284 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 43 KiB/s rd, 1.9 MiB/s wr, 376 op/s 2024-09-19T06:41:14.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.527+0000 7f6fa2a69640 1 -- 172.21.15.99:0/1691780003 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f9c0fc700 msgr2=0x7f6f9c0fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:14.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.527+0000 7f6fa2a69640 1 --2- 172.21.15.99:0/1691780003 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f9c0fc700 0x7f6f9c0fcb70 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6f880048d0 tx=0x7f6f88009da0 comp rx=0 tx=0).stop 2024-09-19T06:41:14.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.527+0000 7f6fa2a69640 1 -- 172.21.15.99:0/1691780003 shutdown_connections 2024-09-19T06:41:14.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.527+0000 7f6fa2a69640 1 --2- 172.21.15.99:0/1691780003 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f9c0fc700 0x7f6f9c0fcb70 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:14.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.527+0000 7f6fa2a69640 1 --2- 172.21.15.99:0/1691780003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f9c0fb430 0x7f6f9c0fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:14.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.527+0000 7f6fa2a69640 1 -- 172.21.15.99:0/1691780003 >> 172.21.15.99:0/1691780003 conn(0x7f6f9c0f6c10 msgr2=0x7f6f9c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:14.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.527+0000 7f6fa2a69640 1 -- 172.21.15.99:0/1691780003 shutdown_connections 2024-09-19T06:41:14.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.527+0000 7f6fa2a69640 1 -- 172.21.15.99:0/1691780003 wait complete. 2024-09-19T06:41:14.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.527+0000 7f6fa2a69640 1 Processor -- start 2024-09-19T06:41:14.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.527+0000 7f6fa2a69640 1 -- start start 2024-09-19T06:41:14.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.528+0000 7f6fa2a69640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f9c0fb430 0x7f6f9c10d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:14.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.528+0000 7f6fa2a69640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f9c0fc700 0x7f6f9c10d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:14.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.528+0000 7f6fa2a69640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9c10dc20 con 0x7f6f9c0fb430 2024-09-19T06:41:14.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.528+0000 7f6fa2a69640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9c10e440 con 0x7f6f9c0fc700 2024-09-19T06:41:14.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.528+0000 7f6fa0805640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f9c0fb430 0x7f6f9c10d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:14.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.528+0000 7f6fa0805640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f9c0fb430 0x7f6f9c10d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60918/0 (socket says 172.21.15.99:60918) 2024-09-19T06:41:14.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.528+0000 7f6fa0805640 1 -- 172.21.15.99:0/2063070426 learned_addr learned my addr 172.21.15.99:0/2063070426 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:41:14.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.528+0000 7f6f9bfff640 1 --2- 172.21.15.99:0/2063070426 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f9c0fc700 0x7f6f9c10d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:14.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.528+0000 7f6fa0805640 1 -- 172.21.15.99:0/2063070426 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f9c0fc700 msgr2=0x7f6f9c10d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:14.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.528+0000 7f6fa0805640 1 --2- 172.21.15.99:0/2063070426 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f9c0fc700 0x7f6f9c10d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:14.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.528+0000 7f6fa0805640 1 -- 172.21.15.99:0/2063070426 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f88005040 con 0x7f6f9c0fb430 2024-09-19T06:41:14.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.529+0000 7f6fa0805640 1 --2- 172.21.15.99:0/2063070426 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f9c0fb430 0x7f6f9c10d090 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6f9000eb70 tx=0x7f6f9000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:14.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.529+0000 7f6f997fa640 1 -- 172.21.15.99:0/2063070426 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f90007c30 con 0x7f6f9c0fb430 2024-09-19T06:41:14.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.529+0000 7f6fa2a69640 1 -- 172.21.15.99:0/2063070426 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f9c10e670 con 0x7f6f9c0fb430 2024-09-19T06:41:14.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.529+0000 7f6f997fa640 1 -- 172.21.15.99:0/2063070426 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6f9000f040 con 0x7f6f9c0fb430 2024-09-19T06:41:14.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.529+0000 7f6f997fa640 1 -- 172.21.15.99:0/2063070426 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f9000ca60 con 0x7f6f9c0fb430 2024-09-19T06:41:14.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.529+0000 7f6fa2a69640 1 -- 172.21.15.99:0/2063070426 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f9c10ec10 con 0x7f6f9c0fb430 2024-09-19T06:41:14.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.530+0000 7f6fa2a69640 1 -- 172.21.15.99:0/2063070426 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f9c0fa890 con 0x7f6f9c0fb430 2024-09-19T06:41:14.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.530+0000 7f6f997fa640 1 -- 172.21.15.99:0/2063070426 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7f6f9000cbc0 con 0x7f6f9c0fb430 2024-09-19T06:41:14.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.531+0000 7f6f997fa640 1 --2- 172.21.15.99:0/2063070426 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7f6f8c06e6e0 0x7f6f8c070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:14.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.531+0000 7f6f997fa640 1 -- 172.21.15.99:0/2063070426 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f6f9008db30 con 0x7f6f9c0fb430 2024-09-19T06:41:14.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.531+0000 7f6f9bfff640 1 --2- 172.21.15.99:0/2063070426 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7f6f8c06e6e0 0x7f6f8c070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:14.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.532+0000 7f6f9bfff640 1 --2- 172.21.15.99:0/2063070426 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7f6f8c06e6e0 0x7f6f8c070b90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6f88007ac0 tx=0x7f6f88035040 comp rx=0 tx=0).ready entity=mgr.24369 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:14.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.536+0000 7f6f997fa640 1 -- 172.21.15.99:0/2063070426 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f6f90057460 con 0x7f6f9c0fb430 2024-09-19T06:41:14.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:14 smithi117 ceph-mon[34564]: pgmap v35: 65 pgs: 65 active+clean; 284 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 43 KiB/s rd, 1.9 MiB/s wr, 376 op/s 2024-09-19T06:41:14.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.728+0000 7f6fa2a69640 1 -- 172.21.15.99:0/2063070426 --> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6f9c103f60 con 0x7f6f8c06e6e0 2024-09-19T06:41:14.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.730+0000 7f6f997fa640 1 -- 172.21.15.99:0/2063070426 <== mgr.24369 v2:172.21.15.117:6828/1735340892 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f6f9c103f60 con 0x7f6f8c06e6e0 2024-09-19T06:41:14.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.732+0000 7f6fa2a69640 1 -- 172.21.15.99:0/2063070426 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7f6f8c06e6e0 msgr2=0x7f6f8c070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:14.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.732+0000 7f6fa2a69640 1 --2- 172.21.15.99:0/2063070426 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7f6f8c06e6e0 0x7f6f8c070b90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6f88007ac0 tx=0x7f6f88035040 comp rx=0 tx=0).stop 2024-09-19T06:41:14.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.732+0000 7f6fa2a69640 1 -- 172.21.15.99:0/2063070426 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f9c0fb430 msgr2=0x7f6f9c10d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:14.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.732+0000 7f6fa2a69640 1 --2- 172.21.15.99:0/2063070426 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f9c0fb430 0x7f6f9c10d090 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6f9000eb70 tx=0x7f6f9000b040 comp rx=0 tx=0).stop 2024-09-19T06:41:14.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.732+0000 7f6fa2a69640 1 -- 172.21.15.99:0/2063070426 shutdown_connections 2024-09-19T06:41:14.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.732+0000 7f6fa2a69640 1 --2- 172.21.15.99:0/2063070426 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7f6f8c06e6e0 0x7f6f8c070b90 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:14.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.732+0000 7f6fa2a69640 1 --2- 172.21.15.99:0/2063070426 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f9c0fc700 0x7f6f9c10d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:14.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.732+0000 7f6fa2a69640 1 --2- 172.21.15.99:0/2063070426 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f9c0fb430 0x7f6f9c10d090 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:14.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.732+0000 7f6fa2a69640 1 -- 172.21.15.99:0/2063070426 >> 172.21.15.99:0/2063070426 conn(0x7f6f9c0f6c10 msgr2=0x7f6f9c0655b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:14.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.732+0000 7f6fa2a69640 1 -- 172.21.15.99:0/2063070426 shutdown_connections 2024-09-19T06:41:14.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.732+0000 7f6fa2a69640 1 -- 172.21.15.99:0/2063070426 wait complete. 2024-09-19T06:41:14.742 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-09-19T06:41:14.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.815+0000 7fa580d9a640 1 -- 172.21.15.99:0/989188267 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa57c0fc700 msgr2=0x7fa57c0fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:14.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.815+0000 7fa580d9a640 1 --2- 172.21.15.99:0/989188267 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa57c0fc700 0x7fa57c0fcb70 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa5700048d0 tx=0x7fa570009da0 comp rx=0 tx=0).stop 2024-09-19T06:41:14.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.816+0000 7fa580d9a640 1 -- 172.21.15.99:0/989188267 shutdown_connections 2024-09-19T06:41:14.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.816+0000 7fa580d9a640 1 --2- 172.21.15.99:0/989188267 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa57c0fc700 0x7fa57c0fcb70 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:14.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.816+0000 7fa580d9a640 1 --2- 172.21.15.99:0/989188267 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa57c0fb430 0x7fa57c0fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:14.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.816+0000 7fa580d9a640 1 -- 172.21.15.99:0/989188267 >> 172.21.15.99:0/989188267 conn(0x7fa57c0f6c10 msgr2=0x7fa57c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:14.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.816+0000 7fa580d9a640 1 -- 172.21.15.99:0/989188267 shutdown_connections 2024-09-19T06:41:14.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.816+0000 7fa580d9a640 1 -- 172.21.15.99:0/989188267 wait complete. 2024-09-19T06:41:14.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.816+0000 7fa580d9a640 1 Processor -- start 2024-09-19T06:41:14.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.816+0000 7fa580d9a640 1 -- start start 2024-09-19T06:41:14.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.817+0000 7fa580d9a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa57c0fb430 0x7fa57c0ff550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:14.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.817+0000 7fa580d9a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa57c0fc700 0x7fa57c0fda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:14.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.817+0000 7fa580d9a640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa57c0fdfd0 con 0x7fa57c0fc700 2024-09-19T06:41:14.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.817+0000 7fa580d9a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa57c0fe110 con 0x7fa57c0fb430 2024-09-19T06:41:14.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.817+0000 7fa579d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa57c0fc700 0x7fa57c0fda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:14.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.817+0000 7fa579d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa57c0fc700 0x7fa57c0fda40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60948/0 (socket says 172.21.15.99:60948) 2024-09-19T06:41:14.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.817+0000 7fa57a59c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa57c0fb430 0x7fa57c0ff550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:14.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.817+0000 7fa579d9b640 1 -- 172.21.15.99:0/1951728275 learned_addr learned my addr 172.21.15.99:0/1951728275 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:41:14.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.817+0000 7fa579d9b640 1 -- 172.21.15.99:0/1951728275 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa57c0fb430 msgr2=0x7fa57c0ff550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:14.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.817+0000 7fa579d9b640 1 --2- 172.21.15.99:0/1951728275 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa57c0fb430 0x7fa57c0ff550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:14.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.817+0000 7fa579d9b640 1 -- 172.21.15.99:0/1951728275 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa570005040 con 0x7fa57c0fc700 2024-09-19T06:41:14.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.817+0000 7fa57a59c640 1 --2- 172.21.15.99:0/1951728275 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa57c0fb430 0x7fa57c0ff550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:41:14.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.817+0000 7fa579d9b640 1 --2- 172.21.15.99:0/1951728275 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa57c0fc700 0x7fa57c0fda40 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa5700043d0 tx=0x7fa570009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:14.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.817+0000 7fa56affd640 1 -- 172.21.15.99:0/1951728275 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa570038070 con 0x7fa57c0fc700 2024-09-19T06:41:14.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.817+0000 7fa56affd640 1 -- 172.21.15.99:0/1951728275 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa57002ae90 con 0x7fa57c0fc700 2024-09-19T06:41:14.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.818+0000 7fa580d9a640 1 -- 172.21.15.99:0/1951728275 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa57c0fe390 con 0x7fa57c0fc700 2024-09-19T06:41:14.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.818+0000 7fa56affd640 1 -- 172.21.15.99:0/1951728275 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa57003e670 con 0x7fa57c0fc700 2024-09-19T06:41:14.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.818+0000 7fa580d9a640 1 -- 172.21.15.99:0/1951728275 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa57c0fe8b0 con 0x7fa57c0fc700 2024-09-19T06:41:14.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.819+0000 7fa580d9a640 1 -- 172.21.15.99:0/1951728275 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa57c0fa890 con 0x7fa57c0fc700 2024-09-19T06:41:14.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.819+0000 7fa56affd640 1 -- 172.21.15.99:0/1951728275 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7fa570030020 con 0x7fa57c0fc700 2024-09-19T06:41:14.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.820+0000 7fa56affd640 1 --2- 172.21.15.99:0/1951728275 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7fa56406e6e0 0x7fa564070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:14.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.820+0000 7fa56affd640 1 -- 172.21.15.99:0/1951728275 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fa5700addc0 con 0x7fa57c0fc700 2024-09-19T06:41:14.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.820+0000 7fa57a59c640 1 --2- 172.21.15.99:0/1951728275 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7fa56406e6e0 0x7fa564070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:14.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.820+0000 7fa57a59c640 1 --2- 172.21.15.99:0/1951728275 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7fa56406e6e0 0x7fa564070b90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa57c0ff300 tx=0x7fa56c00b040 comp rx=0 tx=0).ready entity=mgr.24369 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:14.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:14.824+0000 7fa56affd640 1 -- 172.21.15.99:0/1951728275 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7fa570077880 con 0x7fa57c0fc700 2024-09-19T06:41:15.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.054+0000 7fa580d9a640 1 -- 172.21.15.99:0/1951728275 --> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa57c0fe8b0 con 0x7fa56406e6e0 2024-09-19T06:41:15.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.056+0000 7fa56affd640 1 -- 172.21.15.99:0/1951728275 <== mgr.24369 v2:172.21.15.117:6828/1735340892 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7fa57c0fe8b0 con 0x7fa56406e6e0 2024-09-19T06:41:15.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.060+0000 7fa580d9a640 1 -- 172.21.15.99:0/1951728275 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7fa56406e6e0 msgr2=0x7fa564070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:15.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.060+0000 7fa580d9a640 1 --2- 172.21.15.99:0/1951728275 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7fa56406e6e0 0x7fa564070b90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa57c0ff300 tx=0x7fa56c00b040 comp rx=0 tx=0).stop 2024-09-19T06:41:15.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.060+0000 7fa580d9a640 1 -- 172.21.15.99:0/1951728275 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa57c0fc700 msgr2=0x7fa57c0fda40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:15.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.060+0000 7fa580d9a640 1 --2- 172.21.15.99:0/1951728275 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa57c0fc700 0x7fa57c0fda40 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa5700043d0 tx=0x7fa570009da0 comp rx=0 tx=0).stop 2024-09-19T06:41:15.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.060+0000 7fa580d9a640 1 -- 172.21.15.99:0/1951728275 shutdown_connections 2024-09-19T06:41:15.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.060+0000 7fa580d9a640 1 --2- 172.21.15.99:0/1951728275 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7fa56406e6e0 0x7fa564070b90 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:15.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.060+0000 7fa580d9a640 1 --2- 172.21.15.99:0/1951728275 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa57c0fc700 0x7fa57c0fda40 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:15.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.060+0000 7fa580d9a640 1 --2- 172.21.15.99:0/1951728275 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa57c0fb430 0x7fa57c0ff550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:15.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.060+0000 7fa580d9a640 1 -- 172.21.15.99:0/1951728275 >> 172.21.15.99:0/1951728275 conn(0x7fa57c0f6c10 msgr2=0x7fa57c0655e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:15.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.061+0000 7fa580d9a640 1 -- 172.21.15.99:0/1951728275 shutdown_connections 2024-09-19T06:41:15.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.061+0000 7fa580d9a640 1 -- 172.21.15.99:0/1951728275 wait complete. 2024-09-19T06:41:15.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.171+0000 7fd88ea63640 1 -- 172.21.15.99:0/139176236 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8880ff720 msgr2=0x7fd888101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:15.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.171+0000 7fd88ea63640 1 --2- 172.21.15.99:0/139176236 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8880ff720 0x7fd888101b00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fd8700048d0 tx=0x7fd870009da0 comp rx=0 tx=0).stop 2024-09-19T06:41:15.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.171+0000 7fd88ea63640 1 -- 172.21.15.99:0/139176236 shutdown_connections 2024-09-19T06:41:15.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.171+0000 7fd88ea63640 1 --2- 172.21.15.99:0/139176236 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8880ff720 0x7fd888101b00 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:15.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.171+0000 7fd88ea63640 1 --2- 172.21.15.99:0/139176236 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd888065ba0 0x7fd8880ff1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:15.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.171+0000 7fd88ea63640 1 -- 172.21.15.99:0/139176236 >> 172.21.15.99:0/139176236 conn(0x7fd8880f6c10 msgr2=0x7fd8880f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:15.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.171+0000 7fd88ea63640 1 -- 172.21.15.99:0/139176236 shutdown_connections 2024-09-19T06:41:15.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.171+0000 7fd88ea63640 1 -- 172.21.15.99:0/139176236 wait complete. 2024-09-19T06:41:15.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.171+0000 7fd88ea63640 1 Processor -- start 2024-09-19T06:41:15.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.172+0000 7fd88ea63640 1 -- start start 2024-09-19T06:41:15.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.172+0000 7fd88ea63640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd888065ba0 0x7fd88810d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:15.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.172+0000 7fd88ea63640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8880ff720 0x7fd88810d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:15.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.172+0000 7fd88ea63640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd88810dc30 con 0x7fd8880ff720 2024-09-19T06:41:15.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.172+0000 7fd88ea63640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd88810e450 con 0x7fd888065ba0 2024-09-19T06:41:15.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.172+0000 7fd8877fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8880ff720 0x7fd88810d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:15.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.172+0000 7fd8877fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8880ff720 0x7fd88810d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60970/0 (socket says 172.21.15.99:60970) 2024-09-19T06:41:15.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.172+0000 7fd8877fe640 1 -- 172.21.15.99:0/1909256128 learned_addr learned my addr 172.21.15.99:0/1909256128 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:41:15.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.172+0000 7fd887fff640 1 --2- 172.21.15.99:0/1909256128 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd888065ba0 0x7fd88810d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:15.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.172+0000 7fd8877fe640 1 -- 172.21.15.99:0/1909256128 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd888065ba0 msgr2=0x7fd88810d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:15.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.172+0000 7fd8877fe640 1 --2- 172.21.15.99:0/1909256128 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd888065ba0 0x7fd88810d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:15.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.172+0000 7fd8877fe640 1 -- 172.21.15.99:0/1909256128 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd870005040 con 0x7fd8880ff720 2024-09-19T06:41:15.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.172+0000 7fd8877fe640 1 --2- 172.21.15.99:0/1909256128 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8880ff720 0x7fd88810d5e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd87002d040 tx=0x7fd870009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:15.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.173+0000 7fd884ff9640 1 -- 172.21.15.99:0/1909256128 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd870038070 con 0x7fd8880ff720 2024-09-19T06:41:15.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.173+0000 7fd884ff9640 1 -- 172.21.15.99:0/1909256128 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd87002ae90 con 0x7fd8880ff720 2024-09-19T06:41:15.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.173+0000 7fd88ea63640 1 -- 172.21.15.99:0/1909256128 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd88810e680 con 0x7fd8880ff720 2024-09-19T06:41:15.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.173+0000 7fd884ff9640 1 -- 172.21.15.99:0/1909256128 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd87003e670 con 0x7fd8880ff720 2024-09-19T06:41:15.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.173+0000 7fd88ea63640 1 -- 172.21.15.99:0/1909256128 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd88810ec20 con 0x7fd8880ff720 2024-09-19T06:41:15.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.174+0000 7fd88ea63640 1 -- 172.21.15.99:0/1909256128 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8880fa890 con 0x7fd8880ff720 2024-09-19T06:41:15.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.175+0000 7fd884ff9640 1 -- 172.21.15.99:0/1909256128 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7fd870030020 con 0x7fd8880ff720 2024-09-19T06:41:15.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.175+0000 7fd884ff9640 1 --2- 172.21.15.99:0/1909256128 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7fd87406e6e0 0x7fd874070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:15.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.175+0000 7fd884ff9640 1 -- 172.21.15.99:0/1909256128 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fd8700adea0 con 0x7fd8880ff720 2024-09-19T06:41:15.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.176+0000 7fd887fff640 1 --2- 172.21.15.99:0/1909256128 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7fd87406e6e0 0x7fd874070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:15.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.176+0000 7fd887fff640 1 --2- 172.21.15.99:0/1909256128 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7fd87406e6e0 0x7fd874070b90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd888065900 tx=0x7fd88000b040 comp rx=0 tx=0).ready entity=mgr.24369 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:15.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.181+0000 7fd884ff9640 1 -- 172.21.15.99:0/1909256128 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7fd8700778b0 con 0x7fd8880ff720 2024-09-19T06:41:15.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.400+0000 7fd88ea63640 1 -- 172.21.15.99:0/1909256128 --> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd88810f060 con 0x7fd87406e6e0 2024-09-19T06:41:15.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.409+0000 7fd884ff9640 1 -- 172.21.15.99:0/1909256128 <== mgr.24369 v2:172.21.15.117:6828/1735340892 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fd88810f060 con 0x7fd87406e6e0 2024-09-19T06:41:15.411 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T06:41:15.411 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.smithi099 smithi099 *:9093,9094 starting - - - - 2024-09-19T06:41:15.411 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi099 smithi099 running (8m) 57s ago 8m 6895k - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 216ce2ef7f1e 2024-09-19T06:41:15.411 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi117 smithi117 running (8m) 59s ago 8m 6899k - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 b4c328bdec52 2024-09-19T06:41:15.411 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.smithi099 smithi099 *:3000 starting - - - - 2024-09-19T06:41:15.411 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.obarqf smithi099 running (3m) 57s ago 3m 11.9M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 e36c9b74004b 2024-09-19T06:41:15.411 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.xehbxe smithi099 running (3m) 57s ago 3m 99.7M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 d09eb3d306ae 2024-09-19T06:41:15.411 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.bheqzh smithi117 running (3m) 59s ago 3m 13.4M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 21253e27fdd3 2024-09-19T06:41:15.412 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.nooexo smithi117 running (3m) 59s ago 3m 107M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 ad1faeb3343c 2024-09-19T06:41:15.412 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi099.pgvkqi smithi099 *:9283,8765,8443 running (10m) 57s ago 10m 247M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 8e7ecb77f4cd 2024-09-19T06:41:15.412 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi117.ssmkcf smithi117 *:8443,9283 running (95s) 59s ago 7m 484M - 19.1.1-361-g2f599a46 d2baa855c067 e6f8e1afc98a 2024-09-19T06:41:15.412 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi099 smithi099 running (10m) 57s ago 10m 53.2M 2048M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 7375c241d067 2024-09-19T06:41:15.412 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi117 smithi117 running (7m) 59s ago 7m 40.0M 2048M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 bd4854d5213e 2024-09-19T06:41:15.412 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi099 smithi099 *:9100 starting - - - - 2024-09-19T06:41:15.412 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi117 smithi117 *:9100 running (7m) 59s ago 7m 17.0M - 1.5.0 0da6a335fe13 04f52626cbca 2024-09-19T06:41:15.412 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (7m) 57s ago 7m 113M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 cf8d3dd4a987 2024-09-19T06:41:15.412 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (6m) 57s ago 6m 120M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 bc5b04b8bf9f 2024-09-19T06:41:15.412 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (6m) 57s ago 6m 101M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 cedc7e3698d8 2024-09-19T06:41:15.412 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi117 running (5m) 59s ago 5m 122M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 5984ed999c91 2024-09-19T06:41:15.412 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi117 running (5m) 59s ago 5m 115M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 6a2fc0c51c05 2024-09-19T06:41:15.412 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi117 running (4m) 59s ago 4m 105M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 39dcb7dbf0e3 2024-09-19T06:41:15.412 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.smithi099 smithi099 *:9095 starting - - - - 2024-09-19T06:41:15.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.412+0000 7fd88ea63640 1 -- 172.21.15.99:0/1909256128 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7fd87406e6e0 msgr2=0x7fd874070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:15.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.412+0000 7fd88ea63640 1 --2- 172.21.15.99:0/1909256128 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7fd87406e6e0 0x7fd874070b90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd888065900 tx=0x7fd88000b040 comp rx=0 tx=0).stop 2024-09-19T06:41:15.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.412+0000 7fd88ea63640 1 -- 172.21.15.99:0/1909256128 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8880ff720 msgr2=0x7fd88810d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:15.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.412+0000 7fd88ea63640 1 --2- 172.21.15.99:0/1909256128 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8880ff720 0x7fd88810d5e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd87002d040 tx=0x7fd870009da0 comp rx=0 tx=0).stop 2024-09-19T06:41:15.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.412+0000 7fd88ea63640 1 -- 172.21.15.99:0/1909256128 shutdown_connections 2024-09-19T06:41:15.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.412+0000 7fd88ea63640 1 --2- 172.21.15.99:0/1909256128 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7fd87406e6e0 0x7fd874070b90 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:15.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.412+0000 7fd88ea63640 1 --2- 172.21.15.99:0/1909256128 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8880ff720 0x7fd88810d5e0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:15.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.412+0000 7fd88ea63640 1 --2- 172.21.15.99:0/1909256128 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd888065ba0 0x7fd88810d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:15.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.412+0000 7fd88ea63640 1 -- 172.21.15.99:0/1909256128 >> 172.21.15.99:0/1909256128 conn(0x7fd8880f6c10 msgr2=0x7fd8880f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:15.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.412+0000 7fd88ea63640 1 -- 172.21.15.99:0/1909256128 shutdown_connections 2024-09-19T06:41:15.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.412+0000 7fd88ea63640 1 -- 172.21.15.99:0/1909256128 wait complete. 2024-09-19T06:41:15.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.494+0000 7fc154eb3640 1 -- 172.21.15.99:0/915803080 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc150065be0 msgr2=0x7fc1500ff1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:15.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.494+0000 7fc154eb3640 1 --2- 172.21.15.99:0/915803080 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc150065be0 0x7fc1500ff1a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc140009c50 tx=0x7fc140004d10 comp rx=0 tx=0).stop 2024-09-19T06:41:15.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.494+0000 7fc154eb3640 1 -- 172.21.15.99:0/915803080 shutdown_connections 2024-09-19T06:41:15.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.494+0000 7fc154eb3640 1 --2- 172.21.15.99:0/915803080 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1500ff6e0 0x7fc150101ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:15.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.494+0000 7fc154eb3640 1 --2- 172.21.15.99:0/915803080 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc150065be0 0x7fc1500ff1a0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:15.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.494+0000 7fc154eb3640 1 -- 172.21.15.99:0/915803080 >> 172.21.15.99:0/915803080 conn(0x7fc1500f6c10 msgr2=0x7fc1500f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:15.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.494+0000 7fc154eb3640 1 -- 172.21.15.99:0/915803080 shutdown_connections 2024-09-19T06:41:15.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.494+0000 7fc154eb3640 1 -- 172.21.15.99:0/915803080 wait complete. 2024-09-19T06:41:15.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.495+0000 7fc154eb3640 1 Processor -- start 2024-09-19T06:41:15.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.495+0000 7fc154eb3640 1 -- start start 2024-09-19T06:41:15.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.495+0000 7fc154eb3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc150065be0 0x7fc15010d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:15.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.495+0000 7fc154eb3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1500ff6e0 0x7fc15010d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:15.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.495+0000 7fc154eb3640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc15010dcb0 con 0x7fc150065be0 2024-09-19T06:41:15.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.495+0000 7fc154eb3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc15010e480 con 0x7fc1500ff6e0 2024-09-19T06:41:15.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.495+0000 7fc14e59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc150065be0 0x7fc15010d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:15.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.495+0000 7fc14e59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc150065be0 0x7fc15010d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56224/0 (socket says 172.21.15.99:56224) 2024-09-19T06:41:15.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.495+0000 7fc14e59c640 1 -- 172.21.15.99:0/3334134115 learned_addr learned my addr 172.21.15.99:0/3334134115 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:41:15.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.495+0000 7fc14dd9b640 1 --2- 172.21.15.99:0/3334134115 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1500ff6e0 0x7fc15010d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:15.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.496+0000 7fc14e59c640 1 -- 172.21.15.99:0/3334134115 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1500ff6e0 msgr2=0x7fc15010d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:15.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.496+0000 7fc14e59c640 1 --2- 172.21.15.99:0/3334134115 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1500ff6e0 0x7fc15010d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:15.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.496+0000 7fc14e59c640 1 -- 172.21.15.99:0/3334134115 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc144005040 con 0x7fc150065be0 2024-09-19T06:41:15.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.496+0000 7fc14e59c640 1 --2- 172.21.15.99:0/3334134115 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc150065be0 0x7fc15010d120 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc140004a30 tx=0x7fc140004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:15.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.496+0000 7fc13effd640 1 -- 172.21.15.99:0/3334134115 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc140032a60 con 0x7fc150065be0 2024-09-19T06:41:15.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.496+0000 7fc13effd640 1 -- 172.21.15.99:0/3334134115 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc140004610 con 0x7fc150065be0 2024-09-19T06:41:15.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.496+0000 7fc154eb3640 1 -- 172.21.15.99:0/3334134115 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1400098b0 con 0x7fc150065be0 2024-09-19T06:41:15.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.496+0000 7fc13effd640 1 -- 172.21.15.99:0/3334134115 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc14003dea0 con 0x7fc150065be0 2024-09-19T06:41:15.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.496+0000 7fc154eb3640 1 -- 172.21.15.99:0/3334134115 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc15010eac0 con 0x7fc150065be0 2024-09-19T06:41:15.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.497+0000 7fc154eb3640 1 -- 172.21.15.99:0/3334134115 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc150105750 con 0x7fc150065be0 2024-09-19T06:41:15.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.498+0000 7fc13effd640 1 -- 172.21.15.99:0/3334134115 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7fc14002f030 con 0x7fc150065be0 2024-09-19T06:41:15.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.498+0000 7fc13effd640 1 --2- 172.21.15.99:0/3334134115 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7fc13806e670 0x7fc138070b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:15.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.498+0000 7fc13effd640 1 -- 172.21.15.99:0/3334134115 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fc1400af2c0 con 0x7fc150065be0 2024-09-19T06:41:15.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.498+0000 7fc14dd9b640 1 --2- 172.21.15.99:0/3334134115 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7fc13806e670 0x7fc138070b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:15.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.499+0000 7fc14dd9b640 1 --2- 172.21.15.99:0/3334134115 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7fc13806e670 0x7fc138070b20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc15010ced0 tx=0x7fc14400b040 comp rx=0 tx=0).ready entity=mgr.24369 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:15.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.503+0000 7fc13effd640 1 -- 172.21.15.99:0/3334134115 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7fc140078b40 con 0x7fc150065be0 2024-09-19T06:41:15.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.777+0000 7fc154eb3640 1 -- 172.21.15.99:0/3334134115 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc15004b720 con 0x7fc150065be0 2024-09-19T06:41:15.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.778+0000 7fc13effd640 1 -- 172.21.15.99:0/3334134115 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+855 (secure 0 0 0) 0x7fc14007c200 con 0x7fc150065be0 2024-09-19T06:41:15.779 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:41:15.779 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-09-19T06:41:15.779 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 2 2024-09-19T06:41:15.780 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:41:15.780 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-09-19T06:41:15.780 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 1, 2024-09-19T06:41:15.780 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 1 2024-09-19T06:41:15.780 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:41:15.780 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-09-19T06:41:15.780 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 6 2024-09-19T06:41:15.780 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:41:15.780 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": { 2024-09-19T06:41:15.780 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 4 2024-09-19T06:41:15.780 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:41:15.780 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-09-19T06:41:15.781 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 13, 2024-09-19T06:41:15.781 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 1 2024-09-19T06:41:15.781 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T06:41:15.781 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:41:15.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.781+0000 7fc154eb3640 1 -- 172.21.15.99:0/3334134115 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7fc13806e670 msgr2=0x7fc138070b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:15.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.781+0000 7fc154eb3640 1 --2- 172.21.15.99:0/3334134115 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7fc13806e670 0x7fc138070b20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc15010ced0 tx=0x7fc14400b040 comp rx=0 tx=0).stop 2024-09-19T06:41:15.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.781+0000 7fc154eb3640 1 -- 172.21.15.99:0/3334134115 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc150065be0 msgr2=0x7fc15010d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:15.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.781+0000 7fc154eb3640 1 --2- 172.21.15.99:0/3334134115 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc150065be0 0x7fc15010d120 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc140004a30 tx=0x7fc140004d10 comp rx=0 tx=0).stop 2024-09-19T06:41:15.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.781+0000 7fc154eb3640 1 -- 172.21.15.99:0/3334134115 shutdown_connections 2024-09-19T06:41:15.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.781+0000 7fc154eb3640 1 --2- 172.21.15.99:0/3334134115 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7fc13806e670 0x7fc138070b20 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:15.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.781+0000 7fc154eb3640 1 --2- 172.21.15.99:0/3334134115 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1500ff6e0 0x7fc15010d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:15.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.781+0000 7fc154eb3640 1 --2- 172.21.15.99:0/3334134115 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc150065be0 0x7fc15010d120 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:15.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.781+0000 7fc154eb3640 1 -- 172.21.15.99:0/3334134115 >> 172.21.15.99:0/3334134115 conn(0x7fc1500f6c10 msgr2=0x7fc1500f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:15.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.781+0000 7fc154eb3640 1 -- 172.21.15.99:0/3334134115 shutdown_connections 2024-09-19T06:41:15.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.781+0000 7fc154eb3640 1 -- 172.21.15.99:0/3334134115 wait complete. 2024-09-19T06:41:15.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.887+0000 7f3ccb10f640 1 -- 172.21.15.99:0/3520873431 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3cc40fc520 msgr2=0x7f3cc40fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:15.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.887+0000 7f3ccb10f640 1 --2- 172.21.15.99:0/3520873431 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3cc40fc520 0x7f3cc40fc930 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f3cc00048d0 tx=0x7f3cc0009da0 comp rx=0 tx=0).stop 2024-09-19T06:41:15.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.887+0000 7f3ccb10f640 1 -- 172.21.15.99:0/3520873431 shutdown_connections 2024-09-19T06:41:15.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.887+0000 7f3ccb10f640 1 --2- 172.21.15.99:0/3520873431 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cc40fd7f0 0x7f3cc40fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:15.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.887+0000 7f3ccb10f640 1 --2- 172.21.15.99:0/3520873431 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3cc40fc520 0x7f3cc40fc930 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:15.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.887+0000 7f3ccb10f640 1 -- 172.21.15.99:0/3520873431 >> 172.21.15.99:0/3520873431 conn(0x7f3cc40f7ce0 msgr2=0x7f3cc40fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:15.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.887+0000 7f3ccb10f640 1 -- 172.21.15.99:0/3520873431 shutdown_connections 2024-09-19T06:41:15.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.887+0000 7f3ccb10f640 1 -- 172.21.15.99:0/3520873431 wait complete. 2024-09-19T06:41:15.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.887+0000 7f3ccb10f640 1 Processor -- start 2024-09-19T06:41:15.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.887+0000 7f3ccb10f640 1 -- start start 2024-09-19T06:41:15.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.888+0000 7f3ccb10f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3cc40fc520 0x7f3cc410d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:15.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.888+0000 7f3ccb10f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cc40fd7f0 0x7f3cc410d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:15.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.888+0000 7f3ccb10f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc410dc40 con 0x7f3cc40fc520 2024-09-19T06:41:15.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.888+0000 7f3ccb10f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc410e460 con 0x7f3cc40fd7f0 2024-09-19T06:41:15.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.888+0000 7f3cc8eab640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3cc40fc520 0x7f3cc410d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:15.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.888+0000 7f3cc8eab640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3cc40fc520 0x7f3cc410d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56234/0 (socket says 172.21.15.99:56234) 2024-09-19T06:41:15.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.888+0000 7f3cbbfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cc40fd7f0 0x7f3cc410d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:15.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.888+0000 7f3cc8eab640 1 -- 172.21.15.99:0/821208800 learned_addr learned my addr 172.21.15.99:0/821208800 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:41:15.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.888+0000 7f3cc8eab640 1 -- 172.21.15.99:0/821208800 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cc40fd7f0 msgr2=0x7f3cc410d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:15.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.888+0000 7f3cc8eab640 1 --2- 172.21.15.99:0/821208800 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cc40fd7f0 0x7f3cc410d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:15.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.888+0000 7f3cc8eab640 1 -- 172.21.15.99:0/821208800 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cc0005040 con 0x7f3cc40fc520 2024-09-19T06:41:15.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.888+0000 7f3cbbfff640 1 --2- 172.21.15.99:0/821208800 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cc40fd7f0 0x7f3cc410d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:41:15.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.889+0000 7f3cc8eab640 1 --2- 172.21.15.99:0/821208800 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3cc40fc520 0x7f3cc410d0b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3cc00048a0 tx=0x7f3cc0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:15.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.889+0000 7f3cb97fa640 1 -- 172.21.15.99:0/821208800 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3cc0038070 con 0x7f3cc40fc520 2024-09-19T06:41:15.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.889+0000 7f3ccb10f640 1 -- 172.21.15.99:0/821208800 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cc410e690 con 0x7f3cc40fc520 2024-09-19T06:41:15.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.889+0000 7f3cb97fa640 1 -- 172.21.15.99:0/821208800 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3cc0004290 con 0x7f3cc40fc520 2024-09-19T06:41:15.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.889+0000 7f3cb97fa640 1 -- 172.21.15.99:0/821208800 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3cc0033660 con 0x7f3cc40fc520 2024-09-19T06:41:15.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.889+0000 7f3ccb10f640 1 -- 172.21.15.99:0/821208800 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cc410ec30 con 0x7f3cc40fc520 2024-09-19T06:41:15.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.890+0000 7f3ccb10f640 1 -- 172.21.15.99:0/821208800 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cc40fb980 con 0x7f3cc40fc520 2024-09-19T06:41:15.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.891+0000 7f3cb97fa640 1 -- 172.21.15.99:0/821208800 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7f3cc0030020 con 0x7f3cc40fc520 2024-09-19T06:41:15.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.891+0000 7f3cb97fa640 1 --2- 172.21.15.99:0/821208800 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7f3cac06e6e0 0x7f3cac070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:15.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.891+0000 7f3cb97fa640 1 -- 172.21.15.99:0/821208800 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f3cc00adfc0 con 0x7f3cc40fc520 2024-09-19T06:41:15.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.891+0000 7f3cbbfff640 1 --2- 172.21.15.99:0/821208800 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7f3cac06e6e0 0x7f3cac070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:15.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.892+0000 7f3cbbfff640 1 --2- 172.21.15.99:0/821208800 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7f3cac06e6e0 0x7f3cac070b90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3cb4004fd0 tx=0x7f3cb400b040 comp rx=0 tx=0).ready entity=mgr.24369 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:15.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:15.897+0000 7f3cb97fa640 1 -- 172.21.15.99:0/821208800 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f3cc0077a00 con 0x7f3cc40fc520 2024-09-19T06:41:16.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:16.136+0000 7f3ccb10f640 1 -- 172.21.15.99:0/821208800 --> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3cc410ef10 con 0x7f3cac06e6e0 2024-09-19T06:41:16.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:16.138+0000 7f3cb97fa640 1 -- 172.21.15.99:0/821208800 <== mgr.24369 v2:172.21.15.117:6828/1735340892 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f3cc410ef10 con 0x7f3cac06e6e0 2024-09-19T06:41:16.139 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:41:16.139 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T06:41:16.139 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": true, 2024-09-19T06:41:16.139 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-19T06:41:16.139 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [], 2024-09-19T06:41:16.139 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": "1/2 daemons upgraded", 2024-09-19T06:41:16.139 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "", 2024-09-19T06:41:16.140 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-09-19T06:41:16.140 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:41:16.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:16.140+0000 7f3ccb10f640 1 -- 172.21.15.99:0/821208800 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7f3cac06e6e0 msgr2=0x7f3cac070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:16.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:16.140+0000 7f3ccb10f640 1 --2- 172.21.15.99:0/821208800 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7f3cac06e6e0 0x7f3cac070b90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3cb4004fd0 tx=0x7f3cb400b040 comp rx=0 tx=0).stop 2024-09-19T06:41:16.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:16.140+0000 7f3ccb10f640 1 -- 172.21.15.99:0/821208800 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3cc40fc520 msgr2=0x7f3cc410d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:16.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:16.140+0000 7f3ccb10f640 1 --2- 172.21.15.99:0/821208800 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3cc40fc520 0x7f3cc410d0b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3cc00048a0 tx=0x7f3cc0009da0 comp rx=0 tx=0).stop 2024-09-19T06:41:16.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:16.140+0000 7f3ccb10f640 1 -- 172.21.15.99:0/821208800 shutdown_connections 2024-09-19T06:41:16.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:16.140+0000 7f3ccb10f640 1 --2- 172.21.15.99:0/821208800 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7f3cac06e6e0 0x7f3cac070b90 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:16.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:16.140+0000 7f3ccb10f640 1 --2- 172.21.15.99:0/821208800 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cc40fd7f0 0x7f3cc410d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:16.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:16.140+0000 7f3ccb10f640 1 --2- 172.21.15.99:0/821208800 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3cc40fc520 0x7f3cc410d0b0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:16.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:16.140+0000 7f3ccb10f640 1 -- 172.21.15.99:0/821208800 >> 172.21.15.99:0/821208800 conn(0x7f3cc40f7ce0 msgr2=0x7f3cc40f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:16.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:16.140+0000 7f3ccb10f640 1 -- 172.21.15.99:0/821208800 shutdown_connections 2024-09-19T06:41:16.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:16.140+0000 7f3ccb10f640 1 -- 172.21.15.99:0/821208800 wait complete. 2024-09-19T06:41:16.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:16 smithi099 ceph-mon[27651]: from='client.14638 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:41:16.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:16 smithi099 ceph-mon[27651]: from='client.14642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:41:16.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:16 smithi099 ceph-mon[27651]: pgmap v36: 65 pgs: 65 active+clean; 284 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 43 KiB/s rd, 1.9 MiB/s wr, 376 op/s 2024-09-19T06:41:16.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:16 smithi099 ceph-mon[27651]: from='client.? 172.21.15.99:0/3334134115' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:41:16.463 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:16 smithi117 ceph-mon[34564]: from='client.14638 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:41:16.464 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:16 smithi117 ceph-mon[34564]: from='client.14642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:41:16.464 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:16 smithi117 ceph-mon[34564]: pgmap v36: 65 pgs: 65 active+clean; 284 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 43 KiB/s rd, 1.9 MiB/s wr, 376 op/s 2024-09-19T06:41:16.464 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:16 smithi117 ceph-mon[34564]: from='client.? 172.21.15.99:0/3334134115' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:41:17.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:17 smithi099 ceph-mon[27651]: from='client.14646 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:41:17.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:17 smithi099 ceph-mon[27651]: from='client.14654 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:41:17.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:17 smithi117 ceph-mon[34564]: from='client.14646 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:41:17.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:17 smithi117 ceph-mon[34564]: from='client.14654 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:41:18.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:18 smithi099 ceph-mon[27651]: pgmap v37: 65 pgs: 65 active+clean; 289 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 70 KiB/s rd, 2.7 MiB/s wr, 642 op/s 2024-09-19T06:41:18.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:18 smithi117 ceph-mon[34564]: pgmap v37: 65 pgs: 65 active+clean; 289 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 70 KiB/s rd, 2.7 MiB/s wr, 642 op/s 2024-09-19T06:41:19.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:19 smithi117 ceph-mon[34564]: fsmap cephfs:2 {0=cephfs.smithi099.xehbxe=up:active,1=cephfs.smithi117.nooexo=up:active} 2 up:standby 2024-09-19T06:41:19.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:19 smithi117 ceph-mon[34564]: pgmap v38: 65 pgs: 65 active+clean; 289 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 49 KiB/s rd, 1.9 MiB/s wr, 505 op/s 2024-09-19T06:41:19.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:19 smithi099 ceph-mon[27651]: fsmap cephfs:2 {0=cephfs.smithi099.xehbxe=up:active,1=cephfs.smithi117.nooexo=up:active} 2 up:standby 2024-09-19T06:41:19.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:19 smithi099 ceph-mon[27651]: pgmap v38: 65 pgs: 65 active+clean; 289 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 49 KiB/s rd, 1.9 MiB/s wr, 505 op/s 2024-09-19T06:41:22.378 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:22 smithi117 ceph-mon[34564]: pgmap v39: 65 pgs: 65 active+clean; 288 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 72 KiB/s rd, 2.7 MiB/s wr, 707 op/s 2024-09-19T06:41:22.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:22 smithi099 ceph-mon[27651]: pgmap v39: 65 pgs: 65 active+clean; 288 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 72 KiB/s rd, 2.7 MiB/s wr, 707 op/s 2024-09-19T06:41:24.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:24 smithi117 ceph-mon[34564]: pgmap v40: 65 pgs: 65 active+clean; 288 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 49 KiB/s rd, 1.7 MiB/s wr, 469 op/s 2024-09-19T06:41:24.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:24 smithi099 ceph-mon[27651]: pgmap v40: 65 pgs: 65 active+clean; 288 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 49 KiB/s rd, 1.7 MiB/s wr, 469 op/s 2024-09-19T06:41:25.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:25 smithi099 ceph-mon[27651]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:41:25.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:25 smithi117 ceph-mon[34564]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:41:26.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:26 smithi099 ceph-mon[27651]: pgmap v41: 65 pgs: 65 active+clean; 288 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 49 KiB/s rd, 1.7 MiB/s wr, 469 op/s 2024-09-19T06:41:26.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:26 smithi117 ceph-mon[34564]: pgmap v41: 65 pgs: 65 active+clean; 288 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 49 KiB/s rd, 1.7 MiB/s wr, 469 op/s 2024-09-19T06:41:28.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:27 smithi117 ceph-mon[34564]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:41:28.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:27 smithi117 ceph-mon[34564]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:41:28.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:27 smithi117 ceph-mon[34564]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-19T06:41:28.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:27 smithi117 ceph-mon[34564]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-19T06:41:28.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:27 smithi117 ceph-mon[34564]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-19T06:41:28.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:27 smithi117 ceph-mon[34564]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-19T06:41:28.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:27 smithi117 ceph-mon[34564]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-19T06:41:28.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:27 smithi117 ceph-mon[34564]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-19T06:41:28.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:27 smithi117 ceph-mon[34564]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:41:28.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:27 smithi117 ceph-mon[34564]: Upgrade: Need to upgrade myself (mgr.smithi117.ssmkcf) 2024-09-19T06:41:28.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:27 smithi117 ceph-mon[34564]: Upgrade: Need to upgrade myself (mgr.smithi117.ssmkcf) 2024-09-19T06:41:28.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:27 smithi117 ceph-mon[34564]: pgmap v42: 65 pgs: 65 active+clean; 270 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 74 KiB/s rd, 2.5 MiB/s wr, 734 op/s 2024-09-19T06:41:28.074 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:27 smithi099 ceph-mon[27651]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:41:28.074 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:27 smithi099 ceph-mon[27651]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:41:28.074 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:27 smithi099 ceph-mon[27651]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-19T06:41:28.075 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:27 smithi099 ceph-mon[27651]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-19T06:41:28.075 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:27 smithi099 ceph-mon[27651]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-19T06:41:28.075 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:27 smithi099 ceph-mon[27651]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-19T06:41:28.075 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:27 smithi099 ceph-mon[27651]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-19T06:41:28.075 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:27 smithi099 ceph-mon[27651]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-19T06:41:28.075 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:27 smithi099 ceph-mon[27651]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:41:28.075 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:27 smithi099 ceph-mon[27651]: Upgrade: Need to upgrade myself (mgr.smithi117.ssmkcf) 2024-09-19T06:41:28.075 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:27 smithi099 ceph-mon[27651]: Upgrade: Need to upgrade myself (mgr.smithi117.ssmkcf) 2024-09-19T06:41:28.075 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:27 smithi099 ceph-mon[27651]: pgmap v42: 65 pgs: 65 active+clean; 270 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 74 KiB/s rd, 2.5 MiB/s wr, 734 op/s 2024-09-19T06:41:30.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:30 smithi099 ceph-mon[27651]: pgmap v43: 65 pgs: 65 active+clean; 270 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 47 KiB/s rd, 1.7 MiB/s wr, 467 op/s 2024-09-19T06:41:30.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:30 smithi099 ceph-mon[27651]: Upgrade: Updating mgr.smithi099.pgvkqi 2024-09-19T06:41:30.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:30 smithi099 ceph-mon[27651]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:41:30.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:30 smithi099 ceph-mon[27651]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi099.pgvkqi", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T06:41:30.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:30 smithi099 ceph-mon[27651]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi099.pgvkqi", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T06:41:30.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:30 smithi099 ceph-mon[27651]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T06:41:30.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:30 smithi099 ceph-mon[27651]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:41:30.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:30 smithi099 ceph-mon[27651]: Deploying daemon mgr.smithi099.pgvkqi on smithi099 2024-09-19T06:41:30.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:30 smithi117 ceph-mon[34564]: pgmap v43: 65 pgs: 65 active+clean; 270 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 47 KiB/s rd, 1.7 MiB/s wr, 467 op/s 2024-09-19T06:41:30.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:30 smithi117 ceph-mon[34564]: Upgrade: Updating mgr.smithi099.pgvkqi 2024-09-19T06:41:30.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:30 smithi117 ceph-mon[34564]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:41:30.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:30 smithi117 ceph-mon[34564]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi099.pgvkqi", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T06:41:30.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:30 smithi117 ceph-mon[34564]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi099.pgvkqi", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T06:41:30.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:30 smithi117 ceph-mon[34564]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T06:41:30.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:30 smithi117 ceph-mon[34564]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:41:30.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:30 smithi117 ceph-mon[34564]: Deploying daemon mgr.smithi099.pgvkqi on smithi099 2024-09-19T06:41:32.442 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:32 smithi099 ceph-mon[27651]: pgmap v44: 65 pgs: 65 active+clean; 273 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 67 KiB/s rd, 2.5 MiB/s wr, 681 op/s 2024-09-19T06:41:32.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:32 smithi117 ceph-mon[34564]: pgmap v44: 65 pgs: 65 active+clean; 273 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 67 KiB/s rd, 2.5 MiB/s wr, 681 op/s 2024-09-19T06:41:34.454 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:34 smithi099 ceph-mon[27651]: pgmap v45: 65 pgs: 65 active+clean; 273 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 44 KiB/s rd, 1.7 MiB/s wr, 478 op/s 2024-09-19T06:41:34.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:34 smithi117 ceph-mon[34564]: pgmap v45: 65 pgs: 65 active+clean; 273 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 44 KiB/s rd, 1.7 MiB/s wr, 478 op/s 2024-09-19T06:41:36.448 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:36 smithi099 ceph-mon[27651]: pgmap v46: 65 pgs: 65 active+clean; 273 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 44 KiB/s rd, 1.7 MiB/s wr, 479 op/s 2024-09-19T06:41:36.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:36 smithi117 ceph-mon[34564]: pgmap v46: 65 pgs: 65 active+clean; 273 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 44 KiB/s rd, 1.7 MiB/s wr, 479 op/s 2024-09-19T06:41:37.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:37 smithi117 ceph-mon[34564]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:41:37.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:37 smithi117 ceph-mon[34564]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:41:37.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:37 smithi117 ceph-mon[34564]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:41:37.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:37 smithi117 ceph-mon[34564]: pgmap v47: 65 pgs: 65 active+clean; 272 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 67 KiB/s rd, 2.5 MiB/s wr, 719 op/s 2024-09-19T06:41:37.425 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:37 smithi099 ceph-mon[27651]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:41:37.425 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:37 smithi099 ceph-mon[27651]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:41:37.425 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:37 smithi099 ceph-mon[27651]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:41:37.425 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:37 smithi099 ceph-mon[27651]: pgmap v47: 65 pgs: 65 active+clean; 272 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 67 KiB/s rd, 2.5 MiB/s wr, 719 op/s 2024-09-19T06:41:40.258 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:40 smithi099 ceph-mon[27651]: pgmap v48: 65 pgs: 65 active+clean; 272 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 43 KiB/s rd, 1.6 MiB/s wr, 454 op/s 2024-09-19T06:41:40.258 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:40 smithi099 ceph-mon[27651]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:41:40.258 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:40 smithi099 ceph-mon[27651]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:41:40.258 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:40 smithi099 ceph-mon[27651]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:41:40.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:40 smithi117 ceph-mon[34564]: pgmap v48: 65 pgs: 65 active+clean; 272 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 43 KiB/s rd, 1.6 MiB/s wr, 454 op/s 2024-09-19T06:41:40.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:40 smithi117 ceph-mon[34564]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:41:40.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:40 smithi117 ceph-mon[34564]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:41:40.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:40 smithi117 ceph-mon[34564]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:41:42.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:42 smithi099 ceph-mon[27651]: pgmap v49: 65 pgs: 65 active+clean; 269 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 64 KiB/s rd, 2.4 MiB/s wr, 680 op/s 2024-09-19T06:41:42.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:42 smithi117 ceph-mon[34564]: pgmap v49: 65 pgs: 65 active+clean; 269 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 64 KiB/s rd, 2.4 MiB/s wr, 680 op/s 2024-09-19T06:41:43.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:43 smithi099 ceph-mon[27651]: mgrmap e26: smithi117.ssmkcf(active, since 93s), standbys: smithi099.pgvkqi 2024-09-19T06:41:43.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:43 smithi099 ceph-mon[27651]: Standby manager daemon smithi099.pgvkqi restarted 2024-09-19T06:41:43.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:43 smithi099 ceph-mon[27651]: Standby manager daemon smithi099.pgvkqi started 2024-09-19T06:41:43.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:43 smithi099 ceph-mon[27651]: from='mgr.? 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi099.pgvkqi/crt"}]: dispatch 2024-09-19T06:41:43.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:43 smithi099 ceph-mon[27651]: from='mgr.? 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T06:41:43.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:43 smithi099 ceph-mon[27651]: from='mgr.? 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi099.pgvkqi/key"}]: dispatch 2024-09-19T06:41:43.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:43 smithi099 ceph-mon[27651]: from='mgr.? 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T06:41:43.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:43 smithi117 ceph-mon[34564]: mgrmap e26: smithi117.ssmkcf(active, since 93s), standbys: smithi099.pgvkqi 2024-09-19T06:41:43.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:43 smithi117 ceph-mon[34564]: Standby manager daemon smithi099.pgvkqi restarted 2024-09-19T06:41:43.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:43 smithi117 ceph-mon[34564]: Standby manager daemon smithi099.pgvkqi started 2024-09-19T06:41:43.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:43 smithi117 ceph-mon[34564]: from='mgr.? 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi099.pgvkqi/crt"}]: dispatch 2024-09-19T06:41:43.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:43 smithi117 ceph-mon[34564]: from='mgr.? 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T06:41:43.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:43 smithi117 ceph-mon[34564]: from='mgr.? 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi099.pgvkqi/key"}]: dispatch 2024-09-19T06:41:43.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:43 smithi117 ceph-mon[34564]: from='mgr.? 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T06:41:44.454 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:44 smithi099 ceph-mon[27651]: pgmap v50: 65 pgs: 65 active+clean; 269 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 44 KiB/s rd, 1.6 MiB/s wr, 466 op/s 2024-09-19T06:41:44.455 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:44 smithi099 ceph-mon[27651]: mgrmap e27: smithi117.ssmkcf(active, since 94s), standbys: smithi099.pgvkqi 2024-09-19T06:41:44.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:44 smithi117 ceph-mon[34564]: pgmap v50: 65 pgs: 65 active+clean; 269 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 44 KiB/s rd, 1.6 MiB/s wr, 466 op/s 2024-09-19T06:41:44.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:44 smithi117 ceph-mon[34564]: mgrmap e27: smithi117.ssmkcf(active, since 94s), standbys: smithi099.pgvkqi 2024-09-19T06:41:46.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.250+0000 7f5840b93640 1 -- 172.21.15.99:0/2084369756 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f583c0fdb70 msgr2=0x7f583c0fdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:46.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.250+0000 7f5840b93640 1 --2- 172.21.15.99:0/2084369756 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f583c0fdb70 0x7f583c0fdf80 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f582c0048d0 tx=0x7f582c009da0 comp rx=0 tx=0).stop 2024-09-19T06:41:46.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.251+0000 7f5840b93640 1 -- 172.21.15.99:0/2084369756 shutdown_connections 2024-09-19T06:41:46.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.251+0000 7f5840b93640 1 --2- 172.21.15.99:0/2084369756 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f583c0fe4c0 0x7f583c0fa620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:46.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.251+0000 7f5840b93640 1 --2- 172.21.15.99:0/2084369756 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f583c0fdb70 0x7f583c0fdf80 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:46.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.251+0000 7f5840b93640 1 -- 172.21.15.99:0/2084369756 >> 172.21.15.99:0/2084369756 conn(0x7f583c0f6390 msgr2=0x7f583c0f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:46.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.251+0000 7f5840b93640 1 -- 172.21.15.99:0/2084369756 shutdown_connections 2024-09-19T06:41:46.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.251+0000 7f5840b93640 1 -- 172.21.15.99:0/2084369756 wait complete. 2024-09-19T06:41:46.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.252+0000 7f5840b93640 1 Processor -- start 2024-09-19T06:41:46.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.252+0000 7f5840b93640 1 -- start start 2024-09-19T06:41:46.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.252+0000 7f5840b93640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f583c0fdb70 0x7f583c10d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:46.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.252+0000 7f5840b93640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f583c0fe4c0 0x7f583c10d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:46.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.252+0000 7f583a59c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f583c0fdb70 0x7f583c10d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:46.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.253+0000 7f583a59c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f583c0fdb70 0x7f583c10d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.99:47986/0 (socket says 172.21.15.99:47986) 2024-09-19T06:41:46.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.253+0000 7f583a59c640 1 -- 172.21.15.99:0/1169846343 learned_addr learned my addr 172.21.15.99:0/1169846343 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:41:46.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.253+0000 7f5840b93640 1 -- 172.21.15.99:0/1169846343 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f583c10dc00 con 0x7f583c0fe4c0 2024-09-19T06:41:46.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.253+0000 7f5840b93640 1 -- 172.21.15.99:0/1169846343 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f583c10e420 con 0x7f583c0fdb70 2024-09-19T06:41:46.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.253+0000 7f5839d9b640 1 --2- 172.21.15.99:0/1169846343 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f583c0fe4c0 0x7f583c10d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:46.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.253+0000 7f583a59c640 1 -- 172.21.15.99:0/1169846343 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f583c0fe4c0 msgr2=0x7f583c10d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:46.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.253+0000 7f583a59c640 1 --2- 172.21.15.99:0/1169846343 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f583c0fe4c0 0x7f583c10d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:46.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.253+0000 7f583a59c640 1 -- 172.21.15.99:0/1169846343 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5830005040 con 0x7f583c0fdb70 2024-09-19T06:41:46.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.253+0000 7f583a59c640 1 --2- 172.21.15.99:0/1169846343 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f583c0fdb70 0x7f583c10d070 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f582c0048a0 tx=0x7f582c009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:46.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.254+0000 7f582affd640 1 -- 172.21.15.99:0/1169846343 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f582c038070 con 0x7f583c0fdb70 2024-09-19T06:41:46.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.254+0000 7f582affd640 1 -- 172.21.15.99:0/1169846343 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f582c02ae90 con 0x7f583c0fdb70 2024-09-19T06:41:46.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.254+0000 7f582affd640 1 -- 172.21.15.99:0/1169846343 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f582c03e670 con 0x7f583c0fdb70 2024-09-19T06:41:46.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.254+0000 7f5840b93640 1 -- 172.21.15.99:0/1169846343 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f582c005040 con 0x7f583c0fdb70 2024-09-19T06:41:46.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.254+0000 7f5840b93640 1 -- 172.21.15.99:0/1169846343 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f583c10e950 con 0x7f583c0fdb70 2024-09-19T06:41:46.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.255+0000 7f5840b93640 1 -- 172.21.15.99:0/1169846343 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f583c1057a0 con 0x7f583c0fdb70 2024-09-19T06:41:46.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.256+0000 7f582affd640 1 -- 172.21.15.99:0/1169846343 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 27) v1 ==== 92275+0+0 (secure 0 0 0) 0x7f582c030020 con 0x7f583c0fdb70 2024-09-19T06:41:46.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.256+0000 7f582affd640 1 --2- 172.21.15.99:0/1169846343 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7f582406de70 0x7f5824070320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:46.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.256+0000 7f582affd640 1 -- 172.21.15.99:0/1169846343 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f582c0ad680 con 0x7f583c0fdb70 2024-09-19T06:41:46.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.257+0000 7f5839d9b640 1 --2- 172.21.15.99:0/1169846343 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7f582406de70 0x7f5824070320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:46.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.257+0000 7f5839d9b640 1 --2- 172.21.15.99:0/1169846343 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7f582406de70 0x7f5824070320 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f583c10ce20 tx=0x7f583000b040 comp rx=0 tx=0).ready entity=mgr.24369 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:46.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.261+0000 7f582affd640 1 -- 172.21.15.99:0/1169846343 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f582c0771d0 con 0x7f583c0fdb70 2024-09-19T06:41:46.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:46 smithi099 ceph-mon[27651]: pgmap v51: 65 pgs: 65 active+clean; 269 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 44 KiB/s rd, 1.6 MiB/s wr, 466 op/s 2024-09-19T06:41:46.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:46 smithi099 ceph-mon[27651]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:41:46.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:46 smithi099 ceph-mon[27651]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:41:46.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:46 smithi099 ceph-mon[27651]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:41:46.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:46 smithi099 ceph-mon[27651]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:41:46.482 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-09-19T06:41:46.482 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-09-19T06:41:46.483 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:46 smithi117 ceph-mon[34564]: pgmap v51: 65 pgs: 65 active+clean; 269 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 44 KiB/s rd, 1.6 MiB/s wr, 466 op/s 2024-09-19T06:41:46.483 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:46 smithi117 ceph-mon[34564]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:41:46.483 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:46 smithi117 ceph-mon[34564]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:41:46.483 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:46 smithi117 ceph-mon[34564]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:41:46.483 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:46 smithi117 ceph-mon[34564]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:41:46.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.551+0000 7f5840b93640 1 -- 172.21.15.99:0/1169846343 --> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f583c10ed30 con 0x7f582406de70 2024-09-19T06:41:46.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.552+0000 7f582affd640 1 -- 172.21.15.99:0/1169846343 <== mgr.24369 v2:172.21.15.117:6828/1735340892 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7f583c10ed30 con 0x7f582406de70 2024-09-19T06:41:46.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.554+0000 7f5840b93640 1 -- 172.21.15.99:0/1169846343 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7f582406de70 msgr2=0x7f5824070320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:46.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.554+0000 7f5840b93640 1 --2- 172.21.15.99:0/1169846343 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7f582406de70 0x7f5824070320 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f583c10ce20 tx=0x7f583000b040 comp rx=0 tx=0).stop 2024-09-19T06:41:46.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.554+0000 7f5840b93640 1 -- 172.21.15.99:0/1169846343 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f583c0fdb70 msgr2=0x7f583c10d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:46.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.554+0000 7f5840b93640 1 --2- 172.21.15.99:0/1169846343 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f583c0fdb70 0x7f583c10d070 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f582c0048a0 tx=0x7f582c009da0 comp rx=0 tx=0).stop 2024-09-19T06:41:46.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.554+0000 7f5840b93640 1 -- 172.21.15.99:0/1169846343 shutdown_connections 2024-09-19T06:41:46.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.554+0000 7f5840b93640 1 --2- 172.21.15.99:0/1169846343 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7f582406de70 0x7f5824070320 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:46.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.554+0000 7f5840b93640 1 --2- 172.21.15.99:0/1169846343 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f583c0fe4c0 0x7f583c10d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:46.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.554+0000 7f5840b93640 1 --2- 172.21.15.99:0/1169846343 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f583c0fdb70 0x7f583c10d070 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:46.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.554+0000 7f5840b93640 1 -- 172.21.15.99:0/1169846343 >> 172.21.15.99:0/1169846343 conn(0x7f583c0f6390 msgr2=0x7f583c0f7b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:46.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.554+0000 7f5840b93640 1 -- 172.21.15.99:0/1169846343 shutdown_connections 2024-09-19T06:41:46.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.554+0000 7f5840b93640 1 -- 172.21.15.99:0/1169846343 wait complete. 2024-09-19T06:41:46.564 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-09-19T06:41:46.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.662+0000 7f0583e99640 1 -- 172.21.15.99:0/3196074061 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f057c103e50 msgr2=0x7f057c1042c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:46.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.662+0000 7f0583e99640 1 --2- 172.21.15.99:0/3196074061 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f057c103e50 0x7f057c1042c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f056c0048d0 tx=0x7f056c009da0 comp rx=0 tx=0).stop 2024-09-19T06:41:46.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.662+0000 7f0583e99640 1 -- 172.21.15.99:0/3196074061 shutdown_connections 2024-09-19T06:41:46.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.662+0000 7f0583e99640 1 --2- 172.21.15.99:0/3196074061 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f057c103e50 0x7f057c1042c0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:46.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.662+0000 7f0583e99640 1 --2- 172.21.15.99:0/3196074061 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f057c102b80 0x7f057c102f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:46.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.662+0000 7f0583e99640 1 -- 172.21.15.99:0/3196074061 >> 172.21.15.99:0/3196074061 conn(0x7f057c071d90 msgr2=0x7f057c0741a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:46.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.663+0000 7f0583e99640 1 -- 172.21.15.99:0/3196074061 shutdown_connections 2024-09-19T06:41:46.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.663+0000 7f0583e99640 1 -- 172.21.15.99:0/3196074061 wait complete. 2024-09-19T06:41:46.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.664+0000 7f0583e99640 1 Processor -- start 2024-09-19T06:41:46.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.664+0000 7f0583e99640 1 -- start start 2024-09-19T06:41:46.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.664+0000 7f0583e99640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f057c102b80 0x7f057c07c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:46.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.664+0000 7f0583e99640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f057c103e50 0x7f057c07cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:46.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.664+0000 7f0583e99640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f057c07e590 con 0x7f057c103e50 2024-09-19T06:41:46.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.664+0000 7f0583e99640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f057c07d440 con 0x7f057c102b80 2024-09-19T06:41:46.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.665+0000 7f0581434640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f057c103e50 0x7f057c07cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:46.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.665+0000 7f0581434640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f057c103e50 0x7f057c07cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35974/0 (socket says 172.21.15.99:35974) 2024-09-19T06:41:46.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.665+0000 7f0581434640 1 -- 172.21.15.99:0/2540952487 learned_addr learned my addr 172.21.15.99:0/2540952487 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:41:46.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.665+0000 7f0581c35640 1 --2- 172.21.15.99:0/2540952487 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f057c102b80 0x7f057c07c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:46.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.665+0000 7f0581c35640 1 -- 172.21.15.99:0/2540952487 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f057c103e50 msgr2=0x7f057c07cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:46.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.665+0000 7f0581c35640 1 --2- 172.21.15.99:0/2540952487 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f057c103e50 0x7f057c07cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:46.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.665+0000 7f0581c35640 1 -- 172.21.15.99:0/2540952487 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f056c005040 con 0x7f057c102b80 2024-09-19T06:41:46.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.665+0000 7f0581434640 1 --2- 172.21.15.99:0/2540952487 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f057c103e50 0x7f057c07cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:41:46.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.666+0000 7f0581c35640 1 --2- 172.21.15.99:0/2540952487 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f057c102b80 0x7f057c07c9c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f057400ebf0 tx=0x7f057400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:46.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.666+0000 7f05727fc640 1 -- 172.21.15.99:0/2540952487 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f057400cb30 con 0x7f057c102b80 2024-09-19T06:41:46.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.667+0000 7f0583e99640 1 -- 172.21.15.99:0/2540952487 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f057c07d6d0 con 0x7f057c102b80 2024-09-19T06:41:46.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.667+0000 7f05727fc640 1 -- 172.21.15.99:0/2540952487 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f057400f040 con 0x7f057c102b80 2024-09-19T06:41:46.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.667+0000 7f05727fc640 1 -- 172.21.15.99:0/2540952487 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05740095b0 con 0x7f057c102b80 2024-09-19T06:41:46.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.668+0000 7f0583e99640 1 -- 172.21.15.99:0/2540952487 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f057c067400 con 0x7f057c102b80 2024-09-19T06:41:46.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.669+0000 7f05727fc640 1 -- 172.21.15.99:0/2540952487 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 27) v1 ==== 92275+0+0 (secure 0 0 0) 0x7f0574007890 con 0x7f057c102b80 2024-09-19T06:41:46.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.670+0000 7f05727fc640 1 --2- 172.21.15.99:0/2540952487 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7f056806de30 0x7f05680702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:46.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.670+0000 7f05727fc640 1 -- 172.21.15.99:0/2540952487 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f057408d3a0 con 0x7f057c102b80 2024-09-19T06:41:46.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.670+0000 7f0581434640 1 --2- 172.21.15.99:0/2540952487 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7f056806de30 0x7f05680702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:46.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.670+0000 7f0583e99640 1 -- 172.21.15.99:0/2540952487 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f057c075a10 con 0x7f057c102b80 2024-09-19T06:41:46.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.671+0000 7f0581434640 1 --2- 172.21.15.99:0/2540952487 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7f056806de30 0x7f05680702e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f056c000c00 tx=0x7f056c035040 comp rx=0 tx=0).ready entity=mgr.24369 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:46.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.680+0000 7f05727fc640 1 -- 172.21.15.99:0/2540952487 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f0574056e30 con 0x7f057c102b80 2024-09-19T06:41:46.872 DEBUG:teuthology.parallel:result is None 2024-09-19T06:41:46.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.911+0000 7f0583e99640 1 -- 172.21.15.99:0/2540952487 --> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f057c108220 con 0x7f056806de30 2024-09-19T06:41:46.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.912+0000 7f05727fc640 1 -- 172.21.15.99:0/2540952487 <== mgr.24369 v2:172.21.15.117:6828/1735340892 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7f057c108220 con 0x7f056806de30 2024-09-19T06:41:46.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.914+0000 7f0583e99640 1 -- 172.21.15.99:0/2540952487 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7f056806de30 msgr2=0x7f05680702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:46.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.914+0000 7f0583e99640 1 --2- 172.21.15.99:0/2540952487 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7f056806de30 0x7f05680702e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f056c000c00 tx=0x7f056c035040 comp rx=0 tx=0).stop 2024-09-19T06:41:46.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.914+0000 7f0583e99640 1 -- 172.21.15.99:0/2540952487 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f057c102b80 msgr2=0x7f057c07c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:46.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.914+0000 7f0583e99640 1 --2- 172.21.15.99:0/2540952487 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f057c102b80 0x7f057c07c9c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f057400ebf0 tx=0x7f057400b040 comp rx=0 tx=0).stop 2024-09-19T06:41:46.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.914+0000 7f0583e99640 1 -- 172.21.15.99:0/2540952487 shutdown_connections 2024-09-19T06:41:46.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.914+0000 7f0583e99640 1 --2- 172.21.15.99:0/2540952487 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7f056806de30 0x7f05680702e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:46.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.914+0000 7f0583e99640 1 --2- 172.21.15.99:0/2540952487 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f057c103e50 0x7f057c07cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:46.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.914+0000 7f0583e99640 1 --2- 172.21.15.99:0/2540952487 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f057c102b80 0x7f057c07c9c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:46.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.914+0000 7f0583e99640 1 -- 172.21.15.99:0/2540952487 >> 172.21.15.99:0/2540952487 conn(0x7f057c071d90 msgr2=0x7f057c073530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:46.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.914+0000 7f0583e99640 1 -- 172.21.15.99:0/2540952487 shutdown_connections 2024-09-19T06:41:46.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.914+0000 7f0583e99640 1 -- 172.21.15.99:0/2540952487 wait complete. 2024-09-19T06:41:47.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.999+0000 7faafcc08640 1 -- 172.21.15.99:0/445282971 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faaf80fd7f0 msgr2=0x7faaf80fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:47.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.999+0000 7faafcc08640 1 --2- 172.21.15.99:0/445282971 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faaf80fd7f0 0x7faaf80fdc60 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7faaec0048d0 tx=0x7faaec009da0 comp rx=0 tx=0).stop 2024-09-19T06:41:47.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.999+0000 7faafcc08640 1 -- 172.21.15.99:0/445282971 shutdown_connections 2024-09-19T06:41:47.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.999+0000 7faafcc08640 1 --2- 172.21.15.99:0/445282971 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faaf80fd7f0 0x7faaf80fdc60 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:47.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.999+0000 7faafcc08640 1 --2- 172.21.15.99:0/445282971 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faaf80fc520 0x7faaf80fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:47.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.999+0000 7faafcc08640 1 -- 172.21.15.99:0/445282971 >> 172.21.15.99:0/445282971 conn(0x7faaf80f7ce0 msgr2=0x7faaf80fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:47.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.999+0000 7faafcc08640 1 -- 172.21.15.99:0/445282971 shutdown_connections 2024-09-19T06:41:47.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:46.999+0000 7faafcc08640 1 -- 172.21.15.99:0/445282971 wait complete. 2024-09-19T06:41:47.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.000+0000 7faafcc08640 1 Processor -- start 2024-09-19T06:41:47.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.000+0000 7faafcc08640 1 -- start start 2024-09-19T06:41:47.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.000+0000 7faafcc08640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faaf80fc520 0x7faaf8071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:47.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.000+0000 7faafcc08640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faaf80fd7f0 0x7faaf806fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:47.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.000+0000 7faafcc08640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf806fff0 con 0x7faaf80fd7f0 2024-09-19T06:41:47.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.000+0000 7faafcc08640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf8070130 con 0x7faaf80fc520 2024-09-19T06:41:47.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.000+0000 7faaf5d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faaf80fd7f0 0x7faaf806fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:47.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.000+0000 7faaf659c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faaf80fc520 0x7faaf8071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:47.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.000+0000 7faaf5d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faaf80fd7f0 0x7faaf806fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35984/0 (socket says 172.21.15.99:35984) 2024-09-19T06:41:47.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.000+0000 7faaf5d9b640 1 -- 172.21.15.99:0/2707587313 learned_addr learned my addr 172.21.15.99:0/2707587313 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:41:47.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.001+0000 7faaf659c640 1 -- 172.21.15.99:0/2707587313 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faaf80fd7f0 msgr2=0x7faaf806fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:47.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.001+0000 7faaf659c640 1 --2- 172.21.15.99:0/2707587313 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faaf80fd7f0 0x7faaf806fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:47.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.001+0000 7faaf659c640 1 -- 172.21.15.99:0/2707587313 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaec005040 con 0x7faaf80fc520 2024-09-19T06:41:47.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.001+0000 7faaf5d9b640 1 --2- 172.21.15.99:0/2707587313 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faaf80fd7f0 0x7faaf806fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:41:47.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.001+0000 7faaf659c640 1 --2- 172.21.15.99:0/2707587313 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faaf80fc520 0x7faaf8071570 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7faae80027d0 tx=0x7faae8009f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:47.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.001+0000 7faae6ffd640 1 -- 172.21.15.99:0/2707587313 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faae8002dc0 con 0x7faaf80fc520 2024-09-19T06:41:47.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.001+0000 7faae6ffd640 1 -- 172.21.15.99:0/2707587313 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7faae800f040 con 0x7faaf80fc520 2024-09-19T06:41:47.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.001+0000 7faafcc08640 1 -- 172.21.15.99:0/2707587313 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaf8070410 con 0x7faaf80fc520 2024-09-19T06:41:47.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.001+0000 7faae6ffd640 1 -- 172.21.15.99:0/2707587313 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faae8009470 con 0x7faaf80fc520 2024-09-19T06:41:47.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.001+0000 7faafcc08640 1 -- 172.21.15.99:0/2707587313 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaf81150d0 con 0x7faaf80fc520 2024-09-19T06:41:47.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.002+0000 7faafcc08640 1 -- 172.21.15.99:0/2707587313 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaf80fb980 con 0x7faaf80fc520 2024-09-19T06:41:47.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.003+0000 7faae6ffd640 1 -- 172.21.15.99:0/2707587313 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 27) v1 ==== 92275+0+0 (secure 0 0 0) 0x7faae8007c30 con 0x7faaf80fc520 2024-09-19T06:41:47.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.003+0000 7faae6ffd640 1 --2- 172.21.15.99:0/2707587313 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7faae006de30 0x7faae00702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:47.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.003+0000 7faae6ffd640 1 -- 172.21.15.99:0/2707587313 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7faae808cec0 con 0x7faaf80fc520 2024-09-19T06:41:47.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.003+0000 7faaf5d9b640 1 --2- 172.21.15.99:0/2707587313 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7faae006de30 0x7faae00702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:47.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.004+0000 7faaf5d9b640 1 --2- 172.21.15.99:0/2707587313 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7faae006de30 0x7faae00702e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7faaec000c00 tx=0x7faaec035040 comp rx=0 tx=0).ready entity=mgr.24369 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:47.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.009+0000 7faae6ffd640 1 -- 172.21.15.99:0/2707587313 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7faae8056990 con 0x7faaf80fc520 2024-09-19T06:41:47.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.204+0000 7faafcc08640 1 -- 172.21.15.99:0/2707587313 --> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7faaf8101c00 con 0x7faae006de30 2024-09-19T06:41:47.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.214+0000 7faae6ffd640 1 -- 172.21.15.99:0/2707587313 <== mgr.24369 v2:172.21.15.117:6828/1735340892 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7faaf8101c00 con 0x7faae006de30 2024-09-19T06:41:47.215 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T06:41:47.215 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.smithi099 smithi099 *:9093,9094 running (48s) 2s ago 9m 17.3M - 0.25.0 c8568f914cd2 e7c1774d56b0 2024-09-19T06:41:47.215 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi099 smithi099 running (9m) 2s ago 9m 6895k - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 216ce2ef7f1e 2024-09-19T06:41:47.215 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi117 smithi117 running (8m) 7s ago 8m 6899k - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 b4c328bdec52 2024-09-19T06:41:47.216 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.smithi099 smithi099 *:3000 running (43s) 2s ago 8m 77.2M - 9.4.7 954c08fa6188 83ccd57a918c 2024-09-19T06:41:47.216 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.obarqf smithi099 running (4m) 2s ago 4m 12.3M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 e36c9b74004b 2024-09-19T06:41:47.216 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.xehbxe smithi099 running (3m) 2s ago 3m 141M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 d09eb3d306ae 2024-09-19T06:41:47.216 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.bheqzh smithi117 running (3m) 7s ago 3m 13.8M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 21253e27fdd3 2024-09-19T06:41:47.216 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.nooexo smithi117 running (4m) 7s ago 3m 129M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 ad1faeb3343c 2024-09-19T06:41:47.216 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi099.pgvkqi smithi099 *:8443,9283,8765 running (14s) 2s ago 10m 63.6M - 19.1.1-361-g2f599a46 d2baa855c067 d5de99cb7e78 2024-09-19T06:41:47.216 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi117.ssmkcf smithi117 *:8443,9283 running (2m) 7s ago 8m 504M - 19.1.1-361-g2f599a46 d2baa855c067 e6f8e1afc98a 2024-09-19T06:41:47.216 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi099 smithi099 running (10m) 2s ago 10m 56.2M 2048M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 7375c241d067 2024-09-19T06:41:47.216 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi117 smithi117 running (8m) 7s ago 8m 38.4M 2048M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 bd4854d5213e 2024-09-19T06:41:47.216 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi099 smithi099 *:9100 running (59s) 2s ago 9m 7726k - 1.5.0 0da6a335fe13 dca7b4517dcc 2024-09-19T06:41:47.216 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi117 smithi117 *:9100 running (24s) 7s ago 8m 8544k - 1.5.0 0da6a335fe13 8233ce3835d2 2024-09-19T06:41:47.216 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (7m) 2s ago 7m 208M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 cf8d3dd4a987 2024-09-19T06:41:47.217 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (7m) 2s ago 7m 225M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 bc5b04b8bf9f 2024-09-19T06:41:47.217 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (6m) 2s ago 6m 186M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 cedc7e3698d8 2024-09-19T06:41:47.217 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi117 running (6m) 7s ago 6m 245M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 5984ed999c91 2024-09-19T06:41:47.217 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi117 running (5m) 7s ago 5m 221M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 6a2fc0c51c05 2024-09-19T06:41:47.217 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi117 running (5m) 7s ago 5m 219M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 39dcb7dbf0e3 2024-09-19T06:41:47.217 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.smithi099 smithi099 *:9095 running (37s) 2s ago 8m 48.8M - 2.43.0 a07b618ecd1d 51933ae4fa45 2024-09-19T06:41:47.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.216+0000 7faafcc08640 1 -- 172.21.15.99:0/2707587313 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7faae006de30 msgr2=0x7faae00702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:47.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.216+0000 7faafcc08640 1 --2- 172.21.15.99:0/2707587313 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7faae006de30 0x7faae00702e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7faaec000c00 tx=0x7faaec035040 comp rx=0 tx=0).stop 2024-09-19T06:41:47.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.216+0000 7faafcc08640 1 -- 172.21.15.99:0/2707587313 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faaf80fc520 msgr2=0x7faaf8071570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:47.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.216+0000 7faafcc08640 1 --2- 172.21.15.99:0/2707587313 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faaf80fc520 0x7faaf8071570 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7faae80027d0 tx=0x7faae8009f70 comp rx=0 tx=0).stop 2024-09-19T06:41:47.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.216+0000 7faafcc08640 1 -- 172.21.15.99:0/2707587313 shutdown_connections 2024-09-19T06:41:47.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.216+0000 7faafcc08640 1 --2- 172.21.15.99:0/2707587313 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7faae006de30 0x7faae00702e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:47.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.216+0000 7faafcc08640 1 --2- 172.21.15.99:0/2707587313 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faaf80fd7f0 0x7faaf806fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:47.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.216+0000 7faafcc08640 1 --2- 172.21.15.99:0/2707587313 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faaf80fc520 0x7faaf8071570 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:47.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.216+0000 7faafcc08640 1 -- 172.21.15.99:0/2707587313 >> 172.21.15.99:0/2707587313 conn(0x7faaf80f7ce0 msgr2=0x7faaf80f9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:47.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.216+0000 7faafcc08640 1 -- 172.21.15.99:0/2707587313 shutdown_connections 2024-09-19T06:41:47.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.216+0000 7faafcc08640 1 -- 172.21.15.99:0/2707587313 wait complete. 2024-09-19T06:41:47.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.299+0000 7f0ccc963640 1 -- 172.21.15.99:0/1157239387 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0cc80fc700 msgr2=0x7f0cc80fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:47.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.299+0000 7f0ccc963640 1 --2- 172.21.15.99:0/1157239387 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0cc80fc700 0x7f0cc80fcb70 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f0cb00048d0 tx=0x7f0cb0009da0 comp rx=0 tx=0).stop 2024-09-19T06:41:47.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.299+0000 7f0ccc963640 1 -- 172.21.15.99:0/1157239387 shutdown_connections 2024-09-19T06:41:47.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.299+0000 7f0ccc963640 1 --2- 172.21.15.99:0/1157239387 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0cc80fc700 0x7f0cc80fcb70 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:47.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.299+0000 7f0ccc963640 1 --2- 172.21.15.99:0/1157239387 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cc80fb430 0x7f0cc80fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:47.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.299+0000 7f0ccc963640 1 -- 172.21.15.99:0/1157239387 >> 172.21.15.99:0/1157239387 conn(0x7f0cc80f6c10 msgr2=0x7f0cc80f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:47.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.299+0000 7f0ccc963640 1 -- 172.21.15.99:0/1157239387 shutdown_connections 2024-09-19T06:41:47.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.299+0000 7f0ccc963640 1 -- 172.21.15.99:0/1157239387 wait complete. 2024-09-19T06:41:47.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.300+0000 7f0ccc963640 1 Processor -- start 2024-09-19T06:41:47.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.300+0000 7f0ccc963640 1 -- start start 2024-09-19T06:41:47.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.300+0000 7f0ccc963640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0cc80fb430 0x7f0cc810fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:47.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.300+0000 7f0ccc963640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cc80fc700 0x7f0cc8112310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:47.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.300+0000 7f0ccc963640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc8065c60 con 0x7f0cc80fb430 2024-09-19T06:41:47.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.300+0000 7f0ccc963640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc8065dd0 con 0x7f0cc80fc700 2024-09-19T06:41:47.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.300+0000 7f0cc659c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0cc80fb430 0x7f0cc810fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:47.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.300+0000 7f0cbffff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cc80fc700 0x7f0cc8112310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:47.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.300+0000 7f0cc659c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0cc80fb430 0x7f0cc810fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35988/0 (socket says 172.21.15.99:35988) 2024-09-19T06:41:47.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.300+0000 7f0cc659c640 1 -- 172.21.15.99:0/2955157767 learned_addr learned my addr 172.21.15.99:0/2955157767 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:41:47.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.301+0000 7f0cbffff640 1 -- 172.21.15.99:0/2955157767 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0cc80fb430 msgr2=0x7f0cc810fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:47.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.301+0000 7f0cbffff640 1 --2- 172.21.15.99:0/2955157767 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0cc80fb430 0x7f0cc810fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:47.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.301+0000 7f0cbffff640 1 -- 172.21.15.99:0/2955157767 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb0005040 con 0x7f0cc80fc700 2024-09-19T06:41:47.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.301+0000 7f0cbffff640 1 --2- 172.21.15.99:0/2955157767 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cc80fc700 0x7f0cc8112310 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0cb002a530 tx=0x7f0cb0009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:47.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.301+0000 7f0cbeffd640 1 -- 172.21.15.99:0/2955157767 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cb0038070 con 0x7f0cc80fc700 2024-09-19T06:41:47.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.301+0000 7f0cbeffd640 1 -- 172.21.15.99:0/2955157767 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0cb002ae90 con 0x7f0cc80fc700 2024-09-19T06:41:47.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.301+0000 7f0ccc963640 1 -- 172.21.15.99:0/2955157767 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cc8112850 con 0x7f0cc80fc700 2024-09-19T06:41:47.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.301+0000 7f0cbeffd640 1 -- 172.21.15.99:0/2955157767 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cb003e670 con 0x7f0cc80fc700 2024-09-19T06:41:47.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.301+0000 7f0ccc963640 1 -- 172.21.15.99:0/2955157767 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cc8112dc0 con 0x7f0cc80fc700 2024-09-19T06:41:47.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.302+0000 7f0ccc963640 1 -- 172.21.15.99:0/2955157767 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cc80fa890 con 0x7f0cc80fc700 2024-09-19T06:41:47.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.303+0000 7f0cbeffd640 1 -- 172.21.15.99:0/2955157767 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 27) v1 ==== 92275+0+0 (secure 0 0 0) 0x7f0cb0030020 con 0x7f0cc80fc700 2024-09-19T06:41:47.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.303+0000 7f0cbeffd640 1 --2- 172.21.15.99:0/2955157767 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7f0cb406de30 0x7f0cb40702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:47.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.303+0000 7f0cbeffd640 1 -- 172.21.15.99:0/2955157767 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f0cb00ad740 con 0x7f0cc80fc700 2024-09-19T06:41:47.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.303+0000 7f0cc659c640 1 --2- 172.21.15.99:0/2955157767 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7f0cb406de30 0x7f0cb40702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:47.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.304+0000 7f0cc659c640 1 --2- 172.21.15.99:0/2955157767 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7f0cb406de30 0x7f0cb40702e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0cc8065950 tx=0x7f0cb800b040 comp rx=0 tx=0).ready entity=mgr.24369 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:47.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.309+0000 7f0cbeffd640 1 -- 172.21.15.99:0/2955157767 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f0cb00772a0 con 0x7f0cc80fc700 2024-09-19T06:41:47.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.673+0000 7f0ccc963640 1 -- 172.21.15.99:0/2955157767 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0cc804b720 con 0x7f0cc80fc700 2024-09-19T06:41:47.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.675+0000 7f0cbeffd640 1 -- 172.21.15.99:0/2955157767 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+747 (secure 0 0 0) 0x7f0cb007a960 con 0x7f0cc80fc700 2024-09-19T06:41:47.677 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:41:47.677 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-09-19T06:41:47.677 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 2 2024-09-19T06:41:47.677 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:41:47.677 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-09-19T06:41:47.677 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T06:41:47.677 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:41:47.677 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-09-19T06:41:47.677 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 6 2024-09-19T06:41:47.677 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:41:47.678 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": { 2024-09-19T06:41:47.678 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 4 2024-09-19T06:41:47.678 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:41:47.678 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-09-19T06:41:47.678 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 12, 2024-09-19T06:41:47.678 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T06:41:47.678 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T06:41:47.678 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:41:47.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.679+0000 7f0ccc963640 1 -- 172.21.15.99:0/2955157767 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7f0cb406de30 msgr2=0x7f0cb40702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:47.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.679+0000 7f0ccc963640 1 --2- 172.21.15.99:0/2955157767 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7f0cb406de30 0x7f0cb40702e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0cc8065950 tx=0x7f0cb800b040 comp rx=0 tx=0).stop 2024-09-19T06:41:47.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.679+0000 7f0ccc963640 1 -- 172.21.15.99:0/2955157767 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cc80fc700 msgr2=0x7f0cc8112310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:47.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.679+0000 7f0ccc963640 1 --2- 172.21.15.99:0/2955157767 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cc80fc700 0x7f0cc8112310 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0cb002a530 tx=0x7f0cb0009da0 comp rx=0 tx=0).stop 2024-09-19T06:41:47.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.679+0000 7f0ccc963640 1 -- 172.21.15.99:0/2955157767 shutdown_connections 2024-09-19T06:41:47.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.679+0000 7f0ccc963640 1 --2- 172.21.15.99:0/2955157767 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7f0cb406de30 0x7f0cb40702e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:47.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.679+0000 7f0ccc963640 1 --2- 172.21.15.99:0/2955157767 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cc80fc700 0x7f0cc8112310 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:47.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.679+0000 7f0ccc963640 1 --2- 172.21.15.99:0/2955157767 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0cc80fb430 0x7f0cc810fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:47.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.679+0000 7f0ccc963640 1 -- 172.21.15.99:0/2955157767 >> 172.21.15.99:0/2955157767 conn(0x7f0cc80f6c10 msgr2=0x7f0cc80f83f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:47.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.679+0000 7f0ccc963640 1 -- 172.21.15.99:0/2955157767 shutdown_connections 2024-09-19T06:41:47.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.679+0000 7f0ccc963640 1 -- 172.21.15.99:0/2955157767 wait complete. 2024-09-19T06:41:47.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.771+0000 7fe3dcc1a640 1 -- 172.21.15.99:0/2320463778 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3d80ff680 msgr2=0x7fe3d8101a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:47.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.771+0000 7fe3dcc1a640 1 --2- 172.21.15.99:0/2320463778 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3d80ff680 0x7fe3d8101a60 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe3c00048d0 tx=0x7fe3c0009da0 comp rx=0 tx=0).stop 2024-09-19T06:41:47.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.771+0000 7fe3dcc1a640 1 -- 172.21.15.99:0/2320463778 shutdown_connections 2024-09-19T06:41:47.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.771+0000 7fe3dcc1a640 1 --2- 172.21.15.99:0/2320463778 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3d80ff680 0x7fe3d8101a60 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:47.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.771+0000 7fe3dcc1a640 1 --2- 172.21.15.99:0/2320463778 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3d8065c40 0x7fe3d80ff140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:47.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.771+0000 7fe3dcc1a640 1 -- 172.21.15.99:0/2320463778 >> 172.21.15.99:0/2320463778 conn(0x7fe3d80f6c10 msgr2=0x7fe3d80f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:47.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.771+0000 7fe3dcc1a640 1 -- 172.21.15.99:0/2320463778 shutdown_connections 2024-09-19T06:41:47.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.771+0000 7fe3dcc1a640 1 -- 172.21.15.99:0/2320463778 wait complete. 2024-09-19T06:41:47.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.772+0000 7fe3dcc1a640 1 Processor -- start 2024-09-19T06:41:47.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.772+0000 7fe3dcc1a640 1 -- start start 2024-09-19T06:41:47.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.772+0000 7fe3dcc1a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3d8065c40 0x7fe3d80fcab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:47.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.772+0000 7fe3dcc1a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3d80ff680 0x7fe3d80fb040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:47.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.772+0000 7fe3dcc1a640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d80fb580 con 0x7fe3d8065c40 2024-09-19T06:41:47.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.772+0000 7fe3dcc1a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d80fb6f0 con 0x7fe3d80ff680 2024-09-19T06:41:47.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.772+0000 7fe3d659c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3d8065c40 0x7fe3d80fcab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:47.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.772+0000 7fe3d659c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3d8065c40 0x7fe3d80fcab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36004/0 (socket says 172.21.15.99:36004) 2024-09-19T06:41:47.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.772+0000 7fe3cffff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3d80ff680 0x7fe3d80fb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:47.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.772+0000 7fe3d659c640 1 -- 172.21.15.99:0/2804475162 learned_addr learned my addr 172.21.15.99:0/2804475162 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:41:47.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.772+0000 7fe3d659c640 1 -- 172.21.15.99:0/2804475162 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3d80ff680 msgr2=0x7fe3d80fb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:47.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.772+0000 7fe3d659c640 1 --2- 172.21.15.99:0/2804475162 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3d80ff680 0x7fe3d80fb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:47.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.772+0000 7fe3d659c640 1 -- 172.21.15.99:0/2804475162 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c0005040 con 0x7fe3d8065c40 2024-09-19T06:41:47.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.772+0000 7fe3d659c640 1 --2- 172.21.15.99:0/2804475162 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3d8065c40 0x7fe3d80fcab0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe3c800eb70 tx=0x7fe3c800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:47.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.773+0000 7fe3ceffd640 1 -- 172.21.15.99:0/2804475162 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe3c8007c30 con 0x7fe3d8065c40 2024-09-19T06:41:47.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.773+0000 7fe3ceffd640 1 -- 172.21.15.99:0/2804475162 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe3c800f040 con 0x7fe3d8065c40 2024-09-19T06:41:47.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.773+0000 7fe3dcc1a640 1 -- 172.21.15.99:0/2804475162 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3d80fb9d0 con 0x7fe3d8065c40 2024-09-19T06:41:47.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.773+0000 7fe3ceffd640 1 -- 172.21.15.99:0/2804475162 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe3c800cb80 con 0x7fe3d8065c40 2024-09-19T06:41:47.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.773+0000 7fe3dcc1a640 1 -- 172.21.15.99:0/2804475162 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3d8115140 con 0x7fe3d8065c40 2024-09-19T06:41:47.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.774+0000 7fe3dcc1a640 1 -- 172.21.15.99:0/2804475162 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3d80fa890 con 0x7fe3d8065c40 2024-09-19T06:41:47.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.774+0000 7fe3ceffd640 1 -- 172.21.15.99:0/2804475162 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 27) v1 ==== 92275+0+0 (secure 0 0 0) 0x7fe3c800cd00 con 0x7fe3d8065c40 2024-09-19T06:41:47.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.775+0000 7fe3ceffd640 1 --2- 172.21.15.99:0/2804475162 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7fe3c406de30 0x7fe3c40702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:41:47.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.775+0000 7fe3ceffd640 1 -- 172.21.15.99:0/2804475162 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fe3c808d6e0 con 0x7fe3d8065c40 2024-09-19T06:41:47.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.775+0000 7fe3cffff640 1 --2- 172.21.15.99:0/2804475162 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7fe3c406de30 0x7fe3c40702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:41:47.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.776+0000 7fe3cffff640 1 --2- 172.21.15.99:0/2804475162 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7fe3c406de30 0x7fe3c40702e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe3c0004540 tx=0x7fe3c0035040 comp rx=0 tx=0).ready entity=mgr.24369 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:41:47.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:47.780+0000 7fe3ceffd640 1 -- 172.21.15.99:0/2804475162 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7fe3c8057200 con 0x7fe3d8065c40 2024-09-19T06:41:48.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:48.015+0000 7fe3dcc1a640 1 -- 172.21.15.99:0/2804475162 --> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe3d80f8700 con 0x7fe3c406de30 2024-09-19T06:41:48.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:48.016+0000 7fe3ceffd640 1 -- 172.21.15.99:0/2804475162 <== mgr.24369 v2:172.21.15.117:6828/1735340892 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7fe3d80f8700 con 0x7fe3c406de30 2024-09-19T06:41:48.017 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:41:48.017 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T06:41:48.018 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": true, 2024-09-19T06:41:48.018 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-19T06:41:48.018 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [ 2024-09-19T06:41:48.018 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr" 2024-09-19T06:41:48.018 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-19T06:41:48.018 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": "2/2 daemons upgraded", 2024-09-19T06:41:48.018 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "Currently upgrading mgr daemons", 2024-09-19T06:41:48.018 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-09-19T06:41:48.018 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:41:48.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:48.018+0000 7fe3dcc1a640 1 -- 172.21.15.99:0/2804475162 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7fe3c406de30 msgr2=0x7fe3c40702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:48.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:48.018+0000 7fe3dcc1a640 1 --2- 172.21.15.99:0/2804475162 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7fe3c406de30 0x7fe3c40702e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe3c0004540 tx=0x7fe3c0035040 comp rx=0 tx=0).stop 2024-09-19T06:41:48.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:48.018+0000 7fe3dcc1a640 1 -- 172.21.15.99:0/2804475162 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3d8065c40 msgr2=0x7fe3d80fcab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:41:48.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:48.018+0000 7fe3dcc1a640 1 --2- 172.21.15.99:0/2804475162 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3d8065c40 0x7fe3d80fcab0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe3c800eb70 tx=0x7fe3c800b040 comp rx=0 tx=0).stop 2024-09-19T06:41:48.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:48.018+0000 7fe3dcc1a640 1 -- 172.21.15.99:0/2804475162 shutdown_connections 2024-09-19T06:41:48.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:48.018+0000 7fe3dcc1a640 1 --2- 172.21.15.99:0/2804475162 >> [v2:172.21.15.117:6828/1735340892,v1:172.21.15.117:6829/1735340892] conn(0x7fe3c406de30 0x7fe3c40702e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:48.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:48.018+0000 7fe3dcc1a640 1 --2- 172.21.15.99:0/2804475162 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3d80ff680 0x7fe3d80fb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:48.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:48.018+0000 7fe3dcc1a640 1 --2- 172.21.15.99:0/2804475162 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3d8065c40 0x7fe3d80fcab0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:41:48.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:48.018+0000 7fe3dcc1a640 1 -- 172.21.15.99:0/2804475162 >> 172.21.15.99:0/2804475162 conn(0x7fe3d80f6c10 msgr2=0x7fe3d80f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:41:48.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:48.018+0000 7fe3dcc1a640 1 -- 172.21.15.99:0/2804475162 shutdown_connections 2024-09-19T06:41:48.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:41:48.018+0000 7fe3dcc1a640 1 -- 172.21.15.99:0/2804475162 wait complete. 2024-09-19T06:41:48.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:48 smithi099 ceph-mon[27651]: from='client.24461 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:41:48.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:48 smithi099 ceph-mon[27651]: from='client.24465 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:41:48.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:48 smithi099 ceph-mon[27651]: pgmap v52: 65 pgs: 65 active+clean; 267 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 65 KiB/s rd, 2.4 MiB/s wr, 697 op/s 2024-09-19T06:41:48.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:48 smithi099 ceph-mon[27651]: from='client.? 172.21.15.99:0/2955157767' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:41:48.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:48 smithi117 ceph-mon[34564]: from='client.24461 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:41:48.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:48 smithi117 ceph-mon[34564]: from='client.24465 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:41:48.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:48 smithi117 ceph-mon[34564]: pgmap v52: 65 pgs: 65 active+clean; 267 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 65 KiB/s rd, 2.4 MiB/s wr, 697 op/s 2024-09-19T06:41:48.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:48 smithi117 ceph-mon[34564]: from='client.? 172.21.15.99:0/2955157767' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:41:49.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:49 smithi099 ceph-mon[27651]: from='client.24469 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:41:49.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:49 smithi099 ceph-mon[27651]: from='client.14678 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:41:49.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:49 smithi117 ceph-mon[34564]: from='client.24469 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:41:49.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:49 smithi117 ceph-mon[34564]: from='client.14678 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:41:50.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:50 smithi099 ceph-mon[27651]: pgmap v53: 65 pgs: 65 active+clean; 267 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 1.5 MiB/s wr, 457 op/s 2024-09-19T06:41:50.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:50 smithi117 ceph-mon[34564]: pgmap v53: 65 pgs: 65 active+clean; 267 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 1.5 MiB/s wr, 457 op/s 2024-09-19T06:41:51.942 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-09-19T06:41:51.942 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-19T06:41:52.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:51 smithi117 ceph-mon[34564]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:41:52.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:51 smithi117 ceph-mon[34564]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:41:52.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:51 smithi117 ceph-mon[34564]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:41:52.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:51 smithi117 ceph-mon[34564]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:41:52.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:51 smithi117 ceph-mon[34564]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:41:52.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:51 smithi117 ceph-mon[34564]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:41:52.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:51 smithi117 ceph-mon[34564]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "mgr fail", "who": "smithi117.ssmkcf"}]: dispatch 2024-09-19T06:41:52.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:51 smithi117 ceph-mon[34564]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "mgr fail", "who": "smithi117.ssmkcf"}]: dispatch 2024-09-19T06:41:52.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:51 smithi117 ceph-mon[34564]: Activating manager daemon smithi099.pgvkqi 2024-09-19T06:41:52.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:51 smithi117 ceph-mon[34564]: osdmap e47: 6 total, 6 up, 6 in 2024-09-19T06:41:52.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:51 smithi117 ceph-mon[34564]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' cmd='[{"prefix": "mgr fail", "who": "smithi117.ssmkcf"}]': finished 2024-09-19T06:41:52.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:51 smithi117 ceph-mon[34564]: mgrmap e28: smithi099.pgvkqi(active, starting, since 0.00780603s) 2024-09-19T06:41:52.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:51 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mon metadata", "id": "smithi099"}]: dispatch 2024-09-19T06:41:52.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:51 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mon metadata", "id": "smithi117"}]: dispatch 2024-09-19T06:41:52.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:51 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi099.xehbxe"}]: dispatch 2024-09-19T06:41:52.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:51 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi099.obarqf"}]: dispatch 2024-09-19T06:41:52.064 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:51 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi117.nooexo"}]: dispatch 2024-09-19T06:41:52.064 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:51 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi117.bheqzh"}]: dispatch 2024-09-19T06:41:52.064 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:51 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mgr metadata", "who": "smithi099.pgvkqi", "id": "smithi099.pgvkqi"}]: dispatch 2024-09-19T06:41:52.064 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:51 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:41:52.064 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:51 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:41:52.064 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:51 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:41:52.064 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:51 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:41:52.064 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:51 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:41:52.064 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:51 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:41:52.064 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:51 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T06:41:52.064 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:51 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T06:41:52.064 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:51 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T06:41:52.064 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:51 smithi117 ceph-mon[34564]: Manager daemon smithi099.pgvkqi is now available 2024-09-19T06:41:52.065 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:51 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:41:52.065 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:51 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:41:52.065 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:51 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi099.pgvkqi/mirror_snapshot_schedule"}]: dispatch 2024-09-19T06:41:52.065 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:51 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi099.pgvkqi/trash_purge_schedule"}]: dispatch 2024-09-19T06:41:52.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:51 smithi099 ceph-mon[27651]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:41:52.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:51 smithi099 ceph-mon[27651]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:41:52.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:51 smithi099 ceph-mon[27651]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:41:52.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:51 smithi099 ceph-mon[27651]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:41:52.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:51 smithi099 ceph-mon[27651]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' 2024-09-19T06:41:52.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:51 smithi099 ceph-mon[27651]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:41:52.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:51 smithi099 ceph-mon[27651]: from='mgr.24369 172.21.15.117:0/3273500997' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "mgr fail", "who": "smithi117.ssmkcf"}]: dispatch 2024-09-19T06:41:52.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:51 smithi099 ceph-mon[27651]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "mgr fail", "who": "smithi117.ssmkcf"}]: dispatch 2024-09-19T06:41:52.208 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:51 smithi099 ceph-mon[27651]: Activating manager daemon smithi099.pgvkqi 2024-09-19T06:41:52.208 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:51 smithi099 ceph-mon[27651]: osdmap e47: 6 total, 6 up, 6 in 2024-09-19T06:41:52.208 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:51 smithi099 ceph-mon[27651]: from='mgr.24369 ' entity='mgr.smithi117.ssmkcf' cmd='[{"prefix": "mgr fail", "who": "smithi117.ssmkcf"}]': finished 2024-09-19T06:41:52.208 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:51 smithi099 ceph-mon[27651]: mgrmap e28: smithi099.pgvkqi(active, starting, since 0.00780603s) 2024-09-19T06:41:52.208 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:51 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mon metadata", "id": "smithi099"}]: dispatch 2024-09-19T06:41:52.208 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:51 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mon metadata", "id": "smithi117"}]: dispatch 2024-09-19T06:41:52.208 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:51 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi099.xehbxe"}]: dispatch 2024-09-19T06:41:52.208 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:51 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi099.obarqf"}]: dispatch 2024-09-19T06:41:52.208 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:51 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi117.nooexo"}]: dispatch 2024-09-19T06:41:52.208 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:51 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi117.bheqzh"}]: dispatch 2024-09-19T06:41:52.208 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:51 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mgr metadata", "who": "smithi099.pgvkqi", "id": "smithi099.pgvkqi"}]: dispatch 2024-09-19T06:41:52.208 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:51 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:41:52.208 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:51 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:41:52.209 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:51 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:41:52.209 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:51 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:41:52.209 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:51 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:41:52.209 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:51 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:41:52.209 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:51 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T06:41:52.209 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:51 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T06:41:52.209 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:51 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T06:41:52.209 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:51 smithi099 ceph-mon[27651]: Manager daemon smithi099.pgvkqi is now available 2024-09-19T06:41:52.209 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:51 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:41:52.209 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:51 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:41:52.209 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:51 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi099.pgvkqi/mirror_snapshot_schedule"}]: dispatch 2024-09-19T06:41:52.209 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:51 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi099.pgvkqi/trash_purge_schedule"}]: dispatch 2024-09-19T06:41:52.267 DEBUG:teuthology.parallel:result is None 2024-09-19T06:41:52.268 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T06:41:52.319 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T06:41:52.319 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-09-19T06:41:52.359 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-09-19T06:41:52.359 DEBUG:teuthology.parallel:result is None 2024-09-19T06:41:53.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:53 smithi117 ceph-mon[34564]: mgrmap e29: smithi099.pgvkqi(active, since 1.00954s) 2024-09-19T06:41:53.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:53 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:41:53.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:53 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:41:53.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:53 smithi117 ceph-mon[34564]: [19/Sep/2024:06:41:52] ENGINE Bus STARTING 2024-09-19T06:41:53.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:53 smithi117 ceph-mon[34564]: [19/Sep/2024:06:41:52] ENGINE Serving on https://172.21.15.99:7150 2024-09-19T06:41:53.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:53 smithi117 ceph-mon[34564]: [19/Sep/2024:06:41:52] ENGINE Error in HTTPServer.serve 2024-09-19T06:41:53.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: Traceback (most recent call last): 2024-09-19T06:41:53.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T06:41:53.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: self._connections.run(self.expiration_interval) 2024-09-19T06:41:53.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T06:41:53.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: self._run(expiration_interval) 2024-09-19T06:41:53.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T06:41:53.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T06:41:53.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T06:41:53.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T06:41:53.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T06:41:53.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: s = self.context.wrap_socket( 2024-09-19T06:41:53.314 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T06:41:53.314 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: return self.sslsocket_class._create( 2024-09-19T06:41:53.314 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T06:41:53.314 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: self.do_handshake() 2024-09-19T06:41:53.314 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T06:41:53.314 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: self._sslobj.do_handshake() 2024-09-19T06:41:53.314 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T06:41:53.314 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:53 smithi117 ceph-mon[34564]: [19/Sep/2024:06:41:52] ENGINE Serving on http://172.21.15.99:8765 2024-09-19T06:41:53.314 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:53 smithi117 ceph-mon[34564]: [19/Sep/2024:06:41:52] ENGINE Bus STARTED 2024-09-19T06:41:53.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:53 smithi099 ceph-mon[27651]: mgrmap e29: smithi099.pgvkqi(active, since 1.00954s) 2024-09-19T06:41:53.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:53 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:41:53.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:53 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:41:53.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:53 smithi099 ceph-mon[27651]: [19/Sep/2024:06:41:52] ENGINE Bus STARTING 2024-09-19T06:41:53.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:53 smithi099 ceph-mon[27651]: [19/Sep/2024:06:41:52] ENGINE Serving on https://172.21.15.99:7150 2024-09-19T06:41:53.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:53 smithi099 ceph-mon[27651]: [19/Sep/2024:06:41:52] ENGINE Error in HTTPServer.serve 2024-09-19T06:41:53.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Traceback (most recent call last): 2024-09-19T06:41:53.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T06:41:53.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: self._connections.run(self.expiration_interval) 2024-09-19T06:41:53.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T06:41:53.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: self._run(expiration_interval) 2024-09-19T06:41:53.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T06:41:53.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T06:41:53.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T06:41:53.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T06:41:53.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T06:41:53.458 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: s = self.context.wrap_socket( 2024-09-19T06:41:53.458 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T06:41:53.458 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: return self.sslsocket_class._create( 2024-09-19T06:41:53.458 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T06:41:53.458 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: self.do_handshake() 2024-09-19T06:41:53.458 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T06:41:53.458 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: self._sslobj.do_handshake() 2024-09-19T06:41:53.458 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T06:41:53.458 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:53 smithi099 ceph-mon[27651]: [19/Sep/2024:06:41:52] ENGINE Serving on http://172.21.15.99:8765 2024-09-19T06:41:53.458 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:53 smithi099 ceph-mon[27651]: [19/Sep/2024:06:41:52] ENGINE Bus STARTED 2024-09-19T06:41:54.620 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:54 smithi099 ceph-mon[27651]: pgmap v4: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:41:54.620 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:54 smithi099 ceph-mon[27651]: mgrmap e30: smithi099.pgvkqi(active, since 2s) 2024-09-19T06:41:54.653 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:54 smithi117 ceph-mon[34564]: pgmap v4: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:41:54.653 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:54 smithi117 ceph-mon[34564]: mgrmap e30: smithi099.pgvkqi(active, since 2s) 2024-09-19T06:41:56.609 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:56 smithi117 ceph-mon[34564]: pgmap v5: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:41:56.609 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:56 smithi117 ceph-mon[34564]: mgrmap e31: smithi099.pgvkqi(active, since 4s) 2024-09-19T06:41:56.609 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:56 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:41:56.609 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:56 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:41:56.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:56 smithi099 ceph-mon[27651]: pgmap v5: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:41:56.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:56 smithi099 ceph-mon[27651]: mgrmap e31: smithi099.pgvkqi(active, since 4s) 2024-09-19T06:41:56.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:56 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:41:56.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:56 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:41:57.708 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:57 smithi099 ceph-mon[27651]: Standby manager daemon smithi117.ssmkcf started 2024-09-19T06:41:57.708 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:57 smithi099 ceph-mon[27651]: from='mgr.? 172.21.15.117:0/1678723971' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi117.ssmkcf/crt"}]: dispatch 2024-09-19T06:41:57.708 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:57 smithi099 ceph-mon[27651]: from='mgr.? 172.21.15.117:0/1678723971' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T06:41:57.708 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:57 smithi099 ceph-mon[27651]: from='mgr.? 172.21.15.117:0/1678723971' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi117.ssmkcf/key"}]: dispatch 2024-09-19T06:41:57.708 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:57 smithi099 ceph-mon[27651]: from='mgr.? 172.21.15.117:0/1678723971' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T06:41:57.709 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:57 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:41:57.709 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:57 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:41:57.811 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:57 smithi117 ceph-mon[34564]: Standby manager daemon smithi117.ssmkcf started 2024-09-19T06:41:57.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:57 smithi117 ceph-mon[34564]: from='mgr.? 172.21.15.117:0/1678723971' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi117.ssmkcf/crt"}]: dispatch 2024-09-19T06:41:57.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:57 smithi117 ceph-mon[34564]: from='mgr.? 172.21.15.117:0/1678723971' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T06:41:57.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:57 smithi117 ceph-mon[34564]: from='mgr.? 172.21.15.117:0/1678723971' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi117.ssmkcf/key"}]: dispatch 2024-09-19T06:41:57.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:57 smithi117 ceph-mon[34564]: from='mgr.? 172.21.15.117:0/1678723971' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T06:41:57.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:57 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:41:57.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:57 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:41:58.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:58 smithi117 ceph-mon[34564]: pgmap v6: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:41:58.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:58 smithi117 ceph-mon[34564]: mgrmap e32: smithi099.pgvkqi(active, since 6s), standbys: smithi117.ssmkcf 2024-09-19T06:41:58.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:58 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mgr metadata", "who": "smithi117.ssmkcf", "id": "smithi117.ssmkcf"}]: dispatch 2024-09-19T06:41:58.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:58 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:41:58.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:58 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:41:58.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:58 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:41:58.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:41:58 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:41:58.615 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:58 smithi099 ceph-mon[27651]: pgmap v6: 65 pgs: 65 active+clean; 259 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:41:58.615 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:58 smithi099 ceph-mon[27651]: mgrmap e32: smithi099.pgvkqi(active, since 6s), standbys: smithi117.ssmkcf 2024-09-19T06:41:58.615 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:58 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mgr metadata", "who": "smithi117.ssmkcf", "id": "smithi117.ssmkcf"}]: dispatch 2024-09-19T06:41:58.615 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:58 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:41:58.615 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:58 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:41:58.616 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:58 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:41:58.616 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:41:58 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:00.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:00 smithi099 ceph-mon[27651]: pgmap v7: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 38 KiB/s rd, 31 KiB/s wr, 89 op/s 2024-09-19T06:42:00.811 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:00 smithi117 ceph-mon[34564]: pgmap v7: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 38 KiB/s rd, 31 KiB/s wr, 89 op/s 2024-09-19T06:42:02.935 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:02 smithi117 ceph-mon[34564]: pgmap v8: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 24 KiB/s wr, 69 op/s 2024-09-19T06:42:02.935 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:02 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:02.935 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:02 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:02.936 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:02 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:42:02.936 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:02 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:42:02.936 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:02 smithi117 ceph-mon[34564]: Updating smithi099:/etc/ceph/ceph.conf 2024-09-19T06:42:02.936 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:02 smithi117 ceph-mon[34564]: Updating smithi117:/etc/ceph/ceph.conf 2024-09-19T06:42:02.936 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:02 smithi117 ceph-mon[34564]: Updating smithi099:/var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:42:02.936 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:02 smithi117 ceph-mon[34564]: Updating smithi117:/var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:42:02.936 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:02 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:02.936 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:02 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:02.936 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:02 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:02.936 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:02 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:02.936 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:02 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:02.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:02 smithi099 ceph-mon[27651]: pgmap v8: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 24 KiB/s wr, 69 op/s 2024-09-19T06:42:02.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:02 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:02.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:02 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:02.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:02 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:42:02.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:02 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:42:02.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:02 smithi099 ceph-mon[27651]: Updating smithi099:/etc/ceph/ceph.conf 2024-09-19T06:42:02.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:02 smithi099 ceph-mon[27651]: Updating smithi117:/etc/ceph/ceph.conf 2024-09-19T06:42:02.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:02 smithi099 ceph-mon[27651]: Updating smithi099:/var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:42:02.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:02 smithi099 ceph-mon[27651]: Updating smithi117:/var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:42:02.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:02 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:02.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:02 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:02.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:02 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:02.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:02 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:02.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:02 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:03.764 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:03 smithi099 ceph-mon[27651]: Updating smithi099:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:42:03.764 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:03 smithi099 ceph-mon[27651]: Updating smithi117:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:42:03.764 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:03 smithi099 ceph-mon[27651]: Updating smithi099:/var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:42:03.765 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:03 smithi099 ceph-mon[27651]: Updating smithi117:/var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:42:03.765 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:03 smithi099 ceph-mon[27651]: Reconfiguring prometheus.smithi099 (dependencies changed)... 2024-09-19T06:42:03.765 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:03 smithi099 ceph-mon[27651]: Reconfiguring daemon prometheus.smithi099 on smithi099 2024-09-19T06:42:04.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:03 smithi117 ceph-mon[34564]: Updating smithi099:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:42:04.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:03 smithi117 ceph-mon[34564]: Updating smithi117:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:42:04.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:03 smithi117 ceph-mon[34564]: Updating smithi099:/var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:42:04.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:03 smithi117 ceph-mon[34564]: Updating smithi117:/var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:42:04.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:03 smithi117 ceph-mon[34564]: Reconfiguring prometheus.smithi099 (dependencies changed)... 2024-09-19T06:42:04.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:03 smithi117 ceph-mon[34564]: Reconfiguring daemon prometheus.smithi099 on smithi099 2024-09-19T06:42:04.936 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:04 smithi099 ceph-mon[27651]: pgmap v9: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 37 KiB/s wr, 57 op/s 2024-09-19T06:42:05.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:04 smithi117 ceph-mon[34564]: pgmap v9: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 37 KiB/s wr, 57 op/s 2024-09-19T06:42:06.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:06 smithi099 ceph-mon[27651]: pgmap v10: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 22 KiB/s rd, 34 KiB/s wr, 52 op/s 2024-09-19T06:42:06.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:06 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:42:07.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:06 smithi117 ceph-mon[34564]: pgmap v10: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 22 KiB/s rd, 34 KiB/s wr, 52 op/s 2024-09-19T06:42:07.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:06 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:42:09.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:08 smithi117 ceph-mon[34564]: pgmap v11: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 22 KiB/s rd, 34 KiB/s wr, 52 op/s 2024-09-19T06:42:09.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:08 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:09.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:08 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:09.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:08 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-19T06:42:09.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:08 smithi117 ceph-mon[34564]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-19T06:42:09.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:08 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:42:09.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:08 smithi099 ceph-mon[27651]: pgmap v11: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 22 KiB/s rd, 34 KiB/s wr, 52 op/s 2024-09-19T06:42:09.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:08 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:09.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:08 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:09.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:08 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-19T06:42:09.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:08 smithi099 ceph-mon[27651]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-19T06:42:09.208 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:08 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:42:09.811 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:09 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi117.ssmkcf", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T06:42:09.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:09 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T06:42:09.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:09 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:42:10.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:09 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi117.ssmkcf", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T06:42:10.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:09 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T06:42:10.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:09 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:42:10.938 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:10 smithi117 ceph-mon[34564]: pgmap v12: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 22 KiB/s rd, 34 KiB/s wr, 52 op/s 2024-09-19T06:42:10.938 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:10 smithi117 ceph-mon[34564]: Upgrade: Updating mgr.smithi117.ssmkcf 2024-09-19T06:42:10.938 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:10 smithi117 ceph-mon[34564]: Deploying daemon mgr.smithi117.ssmkcf on smithi117 2024-09-19T06:42:11.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:10 smithi099 ceph-mon[27651]: pgmap v12: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 22 KiB/s rd, 34 KiB/s wr, 52 op/s 2024-09-19T06:42:11.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:10 smithi099 ceph-mon[27651]: Upgrade: Updating mgr.smithi117.ssmkcf 2024-09-19T06:42:11.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:10 smithi099 ceph-mon[27651]: Deploying daemon mgr.smithi117.ssmkcf on smithi117 2024-09-19T06:42:12.811 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:12 smithi117 ceph-mon[34564]: pgmap v13: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 15 KiB/s wr, 0 op/s 2024-09-19T06:42:12.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:12 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:12.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:12 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:12.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:12 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:42:13.088 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:12 smithi099 ceph-mon[27651]: pgmap v13: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 15 KiB/s wr, 0 op/s 2024-09-19T06:42:13.089 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:12 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:13.089 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:12 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:13.089 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:12 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:42:14.874 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:14 smithi117 ceph-mon[34564]: pgmap v14: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 15 KiB/s wr, 0 op/s 2024-09-19T06:42:15.162 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:14 smithi099 ceph-mon[27651]: pgmap v14: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 15 KiB/s wr, 0 op/s 2024-09-19T06:42:16.622 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:16 smithi117 ceph-mon[34564]: pgmap v15: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:42:16.622 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:16 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:16.622 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:16 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:16.623 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:16 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:16.623 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:16 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:16.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:16 smithi099 ceph-mon[27651]: pgmap v15: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:42:16.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:16 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:16.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:16 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:16.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:16 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:16.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:16 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:17.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:17 smithi099 ceph-mon[27651]: Standby manager daemon smithi117.ssmkcf restarted 2024-09-19T06:42:17.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:17 smithi099 ceph-mon[27651]: Standby manager daemon smithi117.ssmkcf started 2024-09-19T06:42:17.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:17 smithi099 ceph-mon[27651]: from='mgr.? 172.21.15.117:0/2174925842' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi117.ssmkcf/crt"}]: dispatch 2024-09-19T06:42:17.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:17 smithi099 ceph-mon[27651]: from='mgr.? 172.21.15.117:0/2174925842' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T06:42:17.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:17 smithi099 ceph-mon[27651]: from='mgr.? 172.21.15.117:0/2174925842' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi117.ssmkcf/key"}]: dispatch 2024-09-19T06:42:17.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:17 smithi099 ceph-mon[27651]: from='mgr.? 172.21.15.117:0/2174925842' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T06:42:17.763 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:17 smithi117 ceph-mon[34564]: Standby manager daemon smithi117.ssmkcf restarted 2024-09-19T06:42:17.763 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:17 smithi117 ceph-mon[34564]: Standby manager daemon smithi117.ssmkcf started 2024-09-19T06:42:17.763 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:17 smithi117 ceph-mon[34564]: from='mgr.? 172.21.15.117:0/2174925842' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi117.ssmkcf/crt"}]: dispatch 2024-09-19T06:42:17.763 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:17 smithi117 ceph-mon[34564]: from='mgr.? 172.21.15.117:0/2174925842' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T06:42:17.763 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:17 smithi117 ceph-mon[34564]: from='mgr.? 172.21.15.117:0/2174925842' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi117.ssmkcf/key"}]: dispatch 2024-09-19T06:42:17.764 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:17 smithi117 ceph-mon[34564]: from='mgr.? 172.21.15.117:0/2174925842' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T06:42:18.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.099+0000 7f734c324640 1 -- 172.21.15.99:0/509454437 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f73440fe4e0 msgr2=0x7f73440fa640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:18.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.099+0000 7f734c324640 1 --2- 172.21.15.99:0/509454437 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f73440fe4e0 0x7f73440fa640 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f73340048d0 tx=0x7f7334009da0 comp rx=0 tx=0).stop 2024-09-19T06:42:18.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.100+0000 7f734c324640 1 -- 172.21.15.99:0/509454437 shutdown_connections 2024-09-19T06:42:18.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.100+0000 7f734c324640 1 --2- 172.21.15.99:0/509454437 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f73440fe4e0 0x7f73440fa640 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:18.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.100+0000 7f734c324640 1 --2- 172.21.15.99:0/509454437 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73440fdb90 0x7f73440fdfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:18.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.100+0000 7f734c324640 1 -- 172.21.15.99:0/509454437 >> 172.21.15.99:0/509454437 conn(0x7f73440f6390 msgr2=0x7f73440f87c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:18.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.100+0000 7f734c324640 1 -- 172.21.15.99:0/509454437 shutdown_connections 2024-09-19T06:42:18.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.100+0000 7f734c324640 1 -- 172.21.15.99:0/509454437 wait complete. 2024-09-19T06:42:18.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.100+0000 7f734c324640 1 Processor -- start 2024-09-19T06:42:18.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.100+0000 7f734c324640 1 -- start start 2024-09-19T06:42:18.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.100+0000 7f734c324640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73440fdb90 0x7f734410d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:18.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.100+0000 7f734c324640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f73440fe4e0 0x7f734410d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:18.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.100+0000 7f734c324640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f734410dc30 con 0x7f73440fe4e0 2024-09-19T06:42:18.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.100+0000 7f734c324640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f734410e450 con 0x7f73440fdb90 2024-09-19T06:42:18.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.100+0000 7f73498bf640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f73440fe4e0 0x7f734410d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:18.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.100+0000 7f73498bf640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f73440fe4e0 0x7f734410d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47780/0 (socket says 172.21.15.99:47780) 2024-09-19T06:42:18.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.100+0000 7f73498bf640 1 -- 172.21.15.99:0/3846698522 learned_addr learned my addr 172.21.15.99:0/3846698522 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:42:18.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.101+0000 7f734a0c0640 1 --2- 172.21.15.99:0/3846698522 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73440fdb90 0x7f734410d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:18.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.101+0000 7f73498bf640 1 -- 172.21.15.99:0/3846698522 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73440fdb90 msgr2=0x7f734410d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:18.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.101+0000 7f73498bf640 1 --2- 172.21.15.99:0/3846698522 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73440fdb90 0x7f734410d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:18.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.101+0000 7f73498bf640 1 -- 172.21.15.99:0/3846698522 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7334005040 con 0x7f73440fe4e0 2024-09-19T06:42:18.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.101+0000 7f73498bf640 1 --2- 172.21.15.99:0/3846698522 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f73440fe4e0 0x7f734410d5e0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f73340043d0 tx=0x7f7334009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:18.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.101+0000 7f733affd640 1 -- 172.21.15.99:0/3846698522 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7334038070 con 0x7f73440fe4e0 2024-09-19T06:42:18.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.101+0000 7f733affd640 1 -- 172.21.15.99:0/3846698522 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f733402ae90 con 0x7f73440fe4e0 2024-09-19T06:42:18.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.101+0000 7f734c324640 1 -- 172.21.15.99:0/3846698522 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f734410e680 con 0x7f73440fe4e0 2024-09-19T06:42:18.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.101+0000 7f733affd640 1 -- 172.21.15.99:0/3846698522 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f733403e670 con 0x7f73440fe4e0 2024-09-19T06:42:18.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.101+0000 7f734c324640 1 -- 172.21.15.99:0/3846698522 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f734410eba0 con 0x7f73440fe4e0 2024-09-19T06:42:18.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.102+0000 7f734c324640 1 -- 172.21.15.99:0/3846698522 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73440fa030 con 0x7f73440fe4e0 2024-09-19T06:42:18.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.103+0000 7f733affd640 1 -- 172.21.15.99:0/3846698522 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 33) v1 ==== 92375+0+0 (secure 0 0 0) 0x7f7334030020 con 0x7f73440fe4e0 2024-09-19T06:42:18.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.103+0000 7f733affd640 1 --2- 172.21.15.99:0/3846698522 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f733006df60 0x7f7330070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:18.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.103+0000 7f733affd640 1 -- 172.21.15.99:0/3846698522 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f73340ada00 con 0x7f73440fe4e0 2024-09-19T06:42:18.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.103+0000 7f734a0c0640 1 --2- 172.21.15.99:0/3846698522 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f733006df60 0x7f7330070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:18.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.104+0000 7f734a0c0640 1 --2- 172.21.15.99:0/3846698522 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f733006df60 0x7f7330070410 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7340009fd0 tx=0x7f734000b040 comp rx=0 tx=0).ready entity=mgr.14658 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:18.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.108+0000 7f733affd640 1 -- 172.21.15.99:0/3846698522 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f73340773b0 con 0x7f73440fe4e0 2024-09-19T06:42:18.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.288+0000 7f734c324640 1 -- 172.21.15.99:0/3846698522 --> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f734410efe0 con 0x7f733006df60 2024-09-19T06:42:18.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.289+0000 7f733affd640 1 -- 172.21.15.99:0/3846698522 <== mgr.14658 v2:172.21.15.99:6800/3542536515 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7f734410efe0 con 0x7f733006df60 2024-09-19T06:42:18.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.291+0000 7f734c324640 1 -- 172.21.15.99:0/3846698522 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f733006df60 msgr2=0x7f7330070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:18.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.291+0000 7f734c324640 1 --2- 172.21.15.99:0/3846698522 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f733006df60 0x7f7330070410 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7340009fd0 tx=0x7f734000b040 comp rx=0 tx=0).stop 2024-09-19T06:42:18.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.291+0000 7f734c324640 1 -- 172.21.15.99:0/3846698522 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f73440fe4e0 msgr2=0x7f734410d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:18.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.291+0000 7f734c324640 1 --2- 172.21.15.99:0/3846698522 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f73440fe4e0 0x7f734410d5e0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f73340043d0 tx=0x7f7334009da0 comp rx=0 tx=0).stop 2024-09-19T06:42:18.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.291+0000 7f734c324640 1 -- 172.21.15.99:0/3846698522 shutdown_connections 2024-09-19T06:42:18.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.291+0000 7f734c324640 1 --2- 172.21.15.99:0/3846698522 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f733006df60 0x7f7330070410 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:18.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.291+0000 7f734c324640 1 --2- 172.21.15.99:0/3846698522 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f73440fe4e0 0x7f734410d5e0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:18.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.291+0000 7f734c324640 1 --2- 172.21.15.99:0/3846698522 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73440fdb90 0x7f734410d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:18.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.291+0000 7f734c324640 1 -- 172.21.15.99:0/3846698522 >> 172.21.15.99:0/3846698522 conn(0x7f73440f6390 msgr2=0x7f73440f7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:18.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.292+0000 7f734c324640 1 -- 172.21.15.99:0/3846698522 shutdown_connections 2024-09-19T06:42:18.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.292+0000 7f734c324640 1 -- 172.21.15.99:0/3846698522 wait complete. 2024-09-19T06:42:18.302 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-09-19T06:42:18.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.371+0000 7f28c6988640 1 -- 172.21.15.99:0/1467058798 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28c00fb450 msgr2=0x7f28c00fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:18.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.371+0000 7f28c6988640 1 --2- 172.21.15.99:0/1467058798 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28c00fb450 0x7f28c00fb860 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f28b00048d0 tx=0x7f28b0009da0 comp rx=0 tx=0).stop 2024-09-19T06:42:18.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.371+0000 7f28c6988640 1 -- 172.21.15.99:0/1467058798 shutdown_connections 2024-09-19T06:42:18.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.371+0000 7f28c6988640 1 --2- 172.21.15.99:0/1467058798 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28c00fc720 0x7f28c00fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:18.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.371+0000 7f28c6988640 1 --2- 172.21.15.99:0/1467058798 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28c00fb450 0x7f28c00fb860 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:18.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.371+0000 7f28c6988640 1 -- 172.21.15.99:0/1467058798 >> 172.21.15.99:0/1467058798 conn(0x7f28c00f6c10 msgr2=0x7f28c00f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:18.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.371+0000 7f28c6988640 1 -- 172.21.15.99:0/1467058798 shutdown_connections 2024-09-19T06:42:18.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.371+0000 7f28c6988640 1 -- 172.21.15.99:0/1467058798 wait complete. 2024-09-19T06:42:18.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.372+0000 7f28c6988640 1 Processor -- start 2024-09-19T06:42:18.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.372+0000 7f28c6988640 1 -- start start 2024-09-19T06:42:18.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.372+0000 7f28c6988640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28c00fb450 0x7f28c010fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:18.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.372+0000 7f28c6988640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28c00fc720 0x7f28c0112330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:18.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.372+0000 7f28c6988640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c0066750 con 0x7f28c00fb450 2024-09-19T06:42:18.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.372+0000 7f28c6988640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c00668c0 con 0x7f28c00fc720 2024-09-19T06:42:18.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.372+0000 7f28bffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28c00fb450 0x7f28c010fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:18.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.372+0000 7f28bffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28c00fb450 0x7f28c010fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47800/0 (socket says 172.21.15.99:47800) 2024-09-19T06:42:18.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.372+0000 7f28bffff640 1 -- 172.21.15.99:0/971974547 learned_addr learned my addr 172.21.15.99:0/971974547 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:42:18.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.372+0000 7f28b7fff640 1 --2- 172.21.15.99:0/971974547 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28c00fc720 0x7f28c0112330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:18.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.372+0000 7f28bffff640 1 -- 172.21.15.99:0/971974547 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28c00fc720 msgr2=0x7f28c0112330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:18.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.372+0000 7f28bffff640 1 --2- 172.21.15.99:0/971974547 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28c00fc720 0x7f28c0112330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:18.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.372+0000 7f28bffff640 1 -- 172.21.15.99:0/971974547 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b0005040 con 0x7f28c00fb450 2024-09-19T06:42:18.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.373+0000 7f28bffff640 1 --2- 172.21.15.99:0/971974547 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28c00fb450 0x7f28c010fde0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f28b00048a0 tx=0x7f28b0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:18.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.373+0000 7f28bd7fa640 1 -- 172.21.15.99:0/971974547 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f28b0038070 con 0x7f28c00fb450 2024-09-19T06:42:18.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.373+0000 7f28c6988640 1 -- 172.21.15.99:0/971974547 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28c0112870 con 0x7f28c00fb450 2024-09-19T06:42:18.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.373+0000 7f28bd7fa640 1 -- 172.21.15.99:0/971974547 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f28b0004290 con 0x7f28c00fb450 2024-09-19T06:42:18.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.373+0000 7f28bd7fa640 1 -- 172.21.15.99:0/971974547 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f28b0033660 con 0x7f28c00fb450 2024-09-19T06:42:18.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.373+0000 7f28c6988640 1 -- 172.21.15.99:0/971974547 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28c0112de0 con 0x7f28c00fb450 2024-09-19T06:42:18.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.374+0000 7f28c6988640 1 -- 172.21.15.99:0/971974547 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28c00fa8b0 con 0x7f28c00fb450 2024-09-19T06:42:18.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.375+0000 7f28bd7fa640 1 -- 172.21.15.99:0/971974547 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 33) v1 ==== 92375+0+0 (secure 0 0 0) 0x7f28b0030020 con 0x7f28c00fb450 2024-09-19T06:42:18.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.375+0000 7f28bd7fa640 1 --2- 172.21.15.99:0/971974547 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f28ac06df60 0x7f28ac070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:18.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.375+0000 7f28b7fff640 1 --2- 172.21.15.99:0/971974547 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f28ac06df60 0x7f28ac070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:18.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.375+0000 7f28bd7fa640 1 -- 172.21.15.99:0/971974547 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f28b00adad0 con 0x7f28c00fb450 2024-09-19T06:42:18.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.376+0000 7f28b7fff640 1 --2- 172.21.15.99:0/971974547 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f28ac06df60 0x7f28ac070410 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f28a8009af0 tx=0x7f28a800b040 comp rx=0 tx=0).ready entity=mgr.14658 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:18.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.379+0000 7f28bd7fa640 1 -- 172.21.15.99:0/971974547 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f28b00773a0 con 0x7f28c00fb450 2024-09-19T06:42:18.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.561+0000 7f28c6988640 1 -- 172.21.15.99:0/971974547 --> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f28c0100b30 con 0x7f28ac06df60 2024-09-19T06:42:18.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.562+0000 7f28bd7fa640 1 -- 172.21.15.99:0/971974547 <== mgr.14658 v2:172.21.15.99:6800/3542536515 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7f28c0100b30 con 0x7f28ac06df60 2024-09-19T06:42:18.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.564+0000 7f28c6988640 1 -- 172.21.15.99:0/971974547 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f28ac06df60 msgr2=0x7f28ac070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:18.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.564+0000 7f28c6988640 1 --2- 172.21.15.99:0/971974547 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f28ac06df60 0x7f28ac070410 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f28a8009af0 tx=0x7f28a800b040 comp rx=0 tx=0).stop 2024-09-19T06:42:18.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.564+0000 7f28c6988640 1 -- 172.21.15.99:0/971974547 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28c00fb450 msgr2=0x7f28c010fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:18.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.564+0000 7f28c6988640 1 --2- 172.21.15.99:0/971974547 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28c00fb450 0x7f28c010fde0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f28b00048a0 tx=0x7f28b0009da0 comp rx=0 tx=0).stop 2024-09-19T06:42:18.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.564+0000 7f28c6988640 1 -- 172.21.15.99:0/971974547 shutdown_connections 2024-09-19T06:42:18.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.564+0000 7f28c6988640 1 --2- 172.21.15.99:0/971974547 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f28ac06df60 0x7f28ac070410 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:18.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.564+0000 7f28c6988640 1 --2- 172.21.15.99:0/971974547 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28c00fc720 0x7f28c0112330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:18.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.564+0000 7f28c6988640 1 --2- 172.21.15.99:0/971974547 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28c00fb450 0x7f28c010fde0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:18.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.564+0000 7f28c6988640 1 -- 172.21.15.99:0/971974547 >> 172.21.15.99:0/971974547 conn(0x7f28c00f6c10 msgr2=0x7f28c00f8410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:18.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.564+0000 7f28c6988640 1 -- 172.21.15.99:0/971974547 shutdown_connections 2024-09-19T06:42:18.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.564+0000 7f28c6988640 1 -- 172.21.15.99:0/971974547 wait complete. 2024-09-19T06:42:18.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.642+0000 7f0769d02640 1 -- 172.21.15.99:0/38652359 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f07640fdba0 msgr2=0x7f07640fdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:18.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.642+0000 7f0769d02640 1 --2- 172.21.15.99:0/38652359 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f07640fdba0 0x7f07640fdfb0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f07580048d0 tx=0x7f0758009da0 comp rx=0 tx=0).stop 2024-09-19T06:42:18.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.642+0000 7f0769d02640 1 -- 172.21.15.99:0/38652359 shutdown_connections 2024-09-19T06:42:18.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.642+0000 7f0769d02640 1 --2- 172.21.15.99:0/38652359 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07640fe4f0 0x7f07640fa650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:18.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.642+0000 7f0769d02640 1 --2- 172.21.15.99:0/38652359 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f07640fdba0 0x7f07640fdfb0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:18.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.642+0000 7f0769d02640 1 -- 172.21.15.99:0/38652359 >> 172.21.15.99:0/38652359 conn(0x7f07640f63a0 msgr2=0x7f07640f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:18.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.642+0000 7f0769d02640 1 -- 172.21.15.99:0/38652359 shutdown_connections 2024-09-19T06:42:18.644 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:18 smithi099 ceph-mon[27651]: pgmap v16: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:42:18.644 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:18 smithi099 ceph-mon[27651]: mgrmap e33: smithi099.pgvkqi(active, since 26s), standbys: smithi117.ssmkcf 2024-09-19T06:42:18.644 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:18 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:18.645 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:18 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:18.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.642+0000 7f0769d02640 1 -- 172.21.15.99:0/38652359 wait complete. 2024-09-19T06:42:18.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.642+0000 7f0769d02640 1 Processor -- start 2024-09-19T06:42:18.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.643+0000 7f0769d02640 1 -- start start 2024-09-19T06:42:18.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.643+0000 7f0769d02640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f07640fdba0 0x7f076410d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:18.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.643+0000 7f0769d02640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07640fe4f0 0x7f076410d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:18.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.643+0000 7f0769d02640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f076410dc00 con 0x7f07640fdba0 2024-09-19T06:42:18.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.643+0000 7f0769d02640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f076410e420 con 0x7f07640fe4f0 2024-09-19T06:42:18.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.643+0000 7f07637fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f07640fdba0 0x7f076410d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:18.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.643+0000 7f07637fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f07640fdba0 0x7f076410d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47818/0 (socket says 172.21.15.99:47818) 2024-09-19T06:42:18.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.643+0000 7f07637fe640 1 -- 172.21.15.99:0/902346378 learned_addr learned my addr 172.21.15.99:0/902346378 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:42:18.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.643+0000 7f0762ffd640 1 --2- 172.21.15.99:0/902346378 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07640fe4f0 0x7f076410d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:18.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.643+0000 7f07637fe640 1 -- 172.21.15.99:0/902346378 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07640fe4f0 msgr2=0x7f076410d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:18.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.643+0000 7f07637fe640 1 --2- 172.21.15.99:0/902346378 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07640fe4f0 0x7f076410d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:18.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.643+0000 7f07637fe640 1 -- 172.21.15.99:0/902346378 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0758005040 con 0x7f07640fdba0 2024-09-19T06:42:18.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.643+0000 7f0762ffd640 1 --2- 172.21.15.99:0/902346378 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07640fe4f0 0x7f076410d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:42:18.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.643+0000 7f07637fe640 1 --2- 172.21.15.99:0/902346378 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f07640fdba0 0x7f076410d070 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f07580043d0 tx=0x7f0758009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:18.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.644+0000 7f074bfff640 1 -- 172.21.15.99:0/902346378 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0758038070 con 0x7f07640fdba0 2024-09-19T06:42:18.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.644+0000 7f0769d02640 1 -- 172.21.15.99:0/902346378 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f076410e650 con 0x7f07640fdba0 2024-09-19T06:42:18.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.644+0000 7f074bfff640 1 -- 172.21.15.99:0/902346378 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f075802ae90 con 0x7f07640fdba0 2024-09-19T06:42:18.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.644+0000 7f074bfff640 1 -- 172.21.15.99:0/902346378 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f075803e670 con 0x7f07640fdba0 2024-09-19T06:42:18.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.644+0000 7f0769d02640 1 -- 172.21.15.99:0/902346378 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f076410ebf0 con 0x7f07640fdba0 2024-09-19T06:42:18.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.645+0000 7f0769d02640 1 -- 172.21.15.99:0/902346378 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07640fa040 con 0x7f07640fdba0 2024-09-19T06:42:18.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.645+0000 7f074bfff640 1 -- 172.21.15.99:0/902346378 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 33) v1 ==== 92375+0+0 (secure 0 0 0) 0x7f0758030020 con 0x7f07640fdba0 2024-09-19T06:42:18.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.646+0000 7f074bfff640 1 --2- 172.21.15.99:0/902346378 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f074c06df60 0x7f074c070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:18.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.646+0000 7f074bfff640 1 -- 172.21.15.99:0/902346378 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f07580adaf0 con 0x7f07640fdba0 2024-09-19T06:42:18.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.646+0000 7f0762ffd640 1 --2- 172.21.15.99:0/902346378 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f074c06df60 0x7f074c070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:18.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.646+0000 7f0762ffd640 1 --2- 172.21.15.99:0/902346378 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f074c06df60 0x7f074c070410 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0754007fd0 tx=0x7f0754009e90 comp rx=0 tx=0).ready entity=mgr.14658 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:18.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.650+0000 7f074bfff640 1 -- 172.21.15.99:0/902346378 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f07580773f0 con 0x7f07640fdba0 2024-09-19T06:42:18.759 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:18 smithi117 ceph-mon[34564]: pgmap v16: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:42:18.759 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:18 smithi117 ceph-mon[34564]: mgrmap e33: smithi099.pgvkqi(active, since 26s), standbys: smithi117.ssmkcf 2024-09-19T06:42:18.759 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:18 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:18.759 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:18 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:18.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.826+0000 7f0769d02640 1 -- 172.21.15.99:0/902346378 --> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f076410ef20 con 0x7f074c06df60 2024-09-19T06:42:18.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.835+0000 7f074bfff640 1 -- 172.21.15.99:0/902346378 <== mgr.14658 v2:172.21.15.99:6800/3542536515 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f076410ef20 con 0x7f074c06df60 2024-09-19T06:42:18.836 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T06:42:18.836 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.smithi099 smithi099 *:9093,9094 running (80s) 1s ago 9m 17.3M - 0.25.0 c8568f914cd2 e7c1774d56b0 2024-09-19T06:42:18.836 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi099 smithi099 running (9m) 1s ago 9m 6895k - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 216ce2ef7f1e 2024-09-19T06:42:18.836 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi117 smithi117 running (9m) 3s ago 9m 6899k - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 b4c328bdec52 2024-09-19T06:42:18.837 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.smithi099 smithi099 *:3000 running (75s) 1s ago 9m 74.7M - 9.4.7 954c08fa6188 83ccd57a918c 2024-09-19T06:42:18.837 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.obarqf smithi099 running (4m) 1s ago 4m 12.6M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 e36c9b74004b 2024-09-19T06:42:18.837 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.xehbxe smithi099 running (4m) 1s ago 4m 121M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 d09eb3d306ae 2024-09-19T06:42:18.837 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.bheqzh smithi117 running (4m) 3s ago 4m 14.2M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 21253e27fdd3 2024-09-19T06:42:18.837 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.nooexo smithi117 running (4m) 3s ago 4m 109M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 ad1faeb3343c 2024-09-19T06:42:18.837 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi099.pgvkqi smithi099 *:8443,9283,8765 running (45s) 1s ago 11m 488M - 19.1.1-361-g2f599a46 d2baa855c067 d5de99cb7e78 2024-09-19T06:42:18.837 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi117.ssmkcf smithi117 *:8443,9283,8765 running (6s) 3s ago 8m 69.0M - 19.1.1-361-g2f599a46 d2baa855c067 8b7ee0f871f5 2024-09-19T06:42:18.837 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi099 smithi099 running (11m) 1s ago 11m 58.0M 2048M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 7375c241d067 2024-09-19T06:42:18.837 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi117 smithi117 running (8m) 3s ago 8m 42.7M 2048M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 bd4854d5213e 2024-09-19T06:42:18.837 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi099 smithi099 *:9100 running (90s) 1s ago 9m 8342k - 1.5.0 0da6a335fe13 dca7b4517dcc 2024-09-19T06:42:18.837 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi117 smithi117 *:9100 running (56s) 3s ago 8m 15.8M - 1.5.0 0da6a335fe13 8233ce3835d2 2024-09-19T06:42:18.838 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (8m) 1s ago 8m 217M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 cf8d3dd4a987 2024-09-19T06:42:18.838 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (7m) 1s ago 7m 236M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 bc5b04b8bf9f 2024-09-19T06:42:18.838 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (7m) 1s ago 7m 200M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 cedc7e3698d8 2024-09-19T06:42:18.838 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi117 running (6m) 3s ago 6m 259M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 5984ed999c91 2024-09-19T06:42:18.838 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi117 running (6m) 3s ago 6m 230M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 6a2fc0c51c05 2024-09-19T06:42:18.838 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi117 running (5m) 3s ago 5m 225M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 39dcb7dbf0e3 2024-09-19T06:42:18.838 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.smithi099 smithi099 *:9095 running (11s) 1s ago 9m 43.5M - 2.43.0 a07b618ecd1d 15ad26ec6fb4 2024-09-19T06:42:18.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.837+0000 7f0769d02640 1 -- 172.21.15.99:0/902346378 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f074c06df60 msgr2=0x7f074c070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:18.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.837+0000 7f0769d02640 1 --2- 172.21.15.99:0/902346378 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f074c06df60 0x7f074c070410 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0754007fd0 tx=0x7f0754009e90 comp rx=0 tx=0).stop 2024-09-19T06:42:18.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.837+0000 7f0769d02640 1 -- 172.21.15.99:0/902346378 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f07640fdba0 msgr2=0x7f076410d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:18.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.837+0000 7f0769d02640 1 --2- 172.21.15.99:0/902346378 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f07640fdba0 0x7f076410d070 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f07580043d0 tx=0x7f0758009da0 comp rx=0 tx=0).stop 2024-09-19T06:42:18.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.837+0000 7f0769d02640 1 -- 172.21.15.99:0/902346378 shutdown_connections 2024-09-19T06:42:18.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.837+0000 7f0769d02640 1 --2- 172.21.15.99:0/902346378 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f074c06df60 0x7f074c070410 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:18.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.837+0000 7f0769d02640 1 --2- 172.21.15.99:0/902346378 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07640fe4f0 0x7f076410d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:18.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.837+0000 7f0769d02640 1 --2- 172.21.15.99:0/902346378 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f07640fdba0 0x7f076410d070 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:18.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.837+0000 7f0769d02640 1 -- 172.21.15.99:0/902346378 >> 172.21.15.99:0/902346378 conn(0x7f07640f63a0 msgr2=0x7f07640f7b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:18.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.837+0000 7f0769d02640 1 -- 172.21.15.99:0/902346378 shutdown_connections 2024-09-19T06:42:18.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.837+0000 7f0769d02640 1 -- 172.21.15.99:0/902346378 wait complete. 2024-09-19T06:42:18.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.914+0000 7f90fc859640 1 -- 172.21.15.99:0/1145961076 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f90f80fb430 msgr2=0x7f90f80fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:18.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.914+0000 7f90fc859640 1 --2- 172.21.15.99:0/1145961076 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f90f80fb430 0x7f90f80fb840 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f90e80048d0 tx=0x7f90e8009da0 comp rx=0 tx=0).stop 2024-09-19T06:42:18.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.915+0000 7f90fc859640 1 -- 172.21.15.99:0/1145961076 shutdown_connections 2024-09-19T06:42:18.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.915+0000 7f90fc859640 1 --2- 172.21.15.99:0/1145961076 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90f80fc700 0x7f90f80fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:18.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.915+0000 7f90fc859640 1 --2- 172.21.15.99:0/1145961076 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f90f80fb430 0x7f90f80fb840 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:18.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.915+0000 7f90fc859640 1 -- 172.21.15.99:0/1145961076 >> 172.21.15.99:0/1145961076 conn(0x7f90f80f6c10 msgr2=0x7f90f80f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:18.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.915+0000 7f90fc859640 1 -- 172.21.15.99:0/1145961076 shutdown_connections 2024-09-19T06:42:18.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.915+0000 7f90fc859640 1 -- 172.21.15.99:0/1145961076 wait complete. 2024-09-19T06:42:18.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.915+0000 7f90fc859640 1 Processor -- start 2024-09-19T06:42:18.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.915+0000 7f90fc859640 1 -- start start 2024-09-19T06:42:18.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.916+0000 7f90fc859640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f90f80fb430 0x7f90f810fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:18.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.916+0000 7f90fc859640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90f80fc700 0x7f90f81122f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:18.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.916+0000 7f90fc859640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f8065c80 con 0x7f90f80fb430 2024-09-19T06:42:18.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.916+0000 7f90fc859640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f8065df0 con 0x7f90f80fc700 2024-09-19T06:42:18.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.916+0000 7f90f659c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f90f80fb430 0x7f90f810fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:18.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.916+0000 7f90f659c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f90f80fb430 0x7f90f810fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47842/0 (socket says 172.21.15.99:47842) 2024-09-19T06:42:18.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.916+0000 7f90f659c640 1 -- 172.21.15.99:0/640683792 learned_addr learned my addr 172.21.15.99:0/640683792 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:42:18.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.916+0000 7f90f5d9b640 1 --2- 172.21.15.99:0/640683792 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90f80fc700 0x7f90f81122f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:18.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.916+0000 7f90f659c640 1 -- 172.21.15.99:0/640683792 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90f80fc700 msgr2=0x7f90f81122f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:18.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.916+0000 7f90f659c640 1 --2- 172.21.15.99:0/640683792 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90f80fc700 0x7f90f81122f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:18.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.916+0000 7f90f659c640 1 -- 172.21.15.99:0/640683792 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e8005040 con 0x7f90f80fb430 2024-09-19T06:42:18.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.916+0000 7f90f659c640 1 --2- 172.21.15.99:0/640683792 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f90f80fb430 0x7f90f810fda0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f90e80043d0 tx=0x7f90e8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:18.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.916+0000 7f90e6ffd640 1 -- 172.21.15.99:0/640683792 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90e8038070 con 0x7f90f80fb430 2024-09-19T06:42:18.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.916+0000 7f90fc859640 1 -- 172.21.15.99:0/640683792 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90f8112830 con 0x7f90f80fb430 2024-09-19T06:42:18.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.917+0000 7f90e6ffd640 1 -- 172.21.15.99:0/640683792 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f90e802ae90 con 0x7f90f80fb430 2024-09-19T06:42:18.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.917+0000 7f90e6ffd640 1 -- 172.21.15.99:0/640683792 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90e803e670 con 0x7f90f80fb430 2024-09-19T06:42:18.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.917+0000 7f90fc859640 1 -- 172.21.15.99:0/640683792 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90f8112dd0 con 0x7f90f80fb430 2024-09-19T06:42:18.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.918+0000 7f90fc859640 1 -- 172.21.15.99:0/640683792 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90f80fa890 con 0x7f90f80fb430 2024-09-19T06:42:18.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.918+0000 7f90e6ffd640 1 -- 172.21.15.99:0/640683792 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 33) v1 ==== 92375+0+0 (secure 0 0 0) 0x7f90e8030020 con 0x7f90f80fb430 2024-09-19T06:42:18.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.919+0000 7f90e6ffd640 1 --2- 172.21.15.99:0/640683792 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f90e006df60 0x7f90e0070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:18.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.919+0000 7f90e6ffd640 1 -- 172.21.15.99:0/640683792 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f90e80adaf0 con 0x7f90f80fb430 2024-09-19T06:42:18.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.919+0000 7f90f5d9b640 1 --2- 172.21.15.99:0/640683792 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f90e006df60 0x7f90e0070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:18.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.919+0000 7f90f5d9b640 1 --2- 172.21.15.99:0/640683792 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f90e006df60 0x7f90e0070410 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f90ec004ed0 tx=0x7f90ec00b040 comp rx=0 tx=0).ready entity=mgr.14658 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:18.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:18.924+0000 7f90e6ffd640 1 -- 172.21.15.99:0/640683792 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f90e8077420 con 0x7f90f80fb430 2024-09-19T06:42:19.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:19.153+0000 7f90fc859640 1 -- 172.21.15.99:0/640683792 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f90f8113050 con 0x7f90f80fb430 2024-09-19T06:42:19.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:19.154+0000 7f90e6ffd640 1 -- 172.21.15.99:0/640683792 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+747 (secure 0 0 0) 0x7f90e807aae0 con 0x7f90f80fb430 2024-09-19T06:42:19.155 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:42:19.155 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-09-19T06:42:19.155 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 2 2024-09-19T06:42:19.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:42:19.156 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-09-19T06:42:19.156 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T06:42:19.156 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:42:19.156 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-09-19T06:42:19.156 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 6 2024-09-19T06:42:19.156 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:42:19.156 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": { 2024-09-19T06:42:19.156 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 4 2024-09-19T06:42:19.156 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:42:19.156 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-09-19T06:42:19.156 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 12, 2024-09-19T06:42:19.156 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T06:42:19.156 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T06:42:19.156 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:42:19.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:19.156+0000 7f90fc859640 1 -- 172.21.15.99:0/640683792 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f90e006df60 msgr2=0x7f90e0070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:19.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:19.156+0000 7f90fc859640 1 --2- 172.21.15.99:0/640683792 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f90e006df60 0x7f90e0070410 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f90ec004ed0 tx=0x7f90ec00b040 comp rx=0 tx=0).stop 2024-09-19T06:42:19.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:19.156+0000 7f90fc859640 1 -- 172.21.15.99:0/640683792 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f90f80fb430 msgr2=0x7f90f810fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:19.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:19.156+0000 7f90fc859640 1 --2- 172.21.15.99:0/640683792 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f90f80fb430 0x7f90f810fda0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f90e80043d0 tx=0x7f90e8009da0 comp rx=0 tx=0).stop 2024-09-19T06:42:19.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:19.156+0000 7f90fc859640 1 -- 172.21.15.99:0/640683792 shutdown_connections 2024-09-19T06:42:19.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:19.156+0000 7f90fc859640 1 --2- 172.21.15.99:0/640683792 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f90e006df60 0x7f90e0070410 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:19.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:19.156+0000 7f90fc859640 1 --2- 172.21.15.99:0/640683792 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90f80fc700 0x7f90f81122f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:19.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:19.156+0000 7f90fc859640 1 --2- 172.21.15.99:0/640683792 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f90f80fb430 0x7f90f810fda0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:19.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:19.156+0000 7f90fc859640 1 -- 172.21.15.99:0/640683792 >> 172.21.15.99:0/640683792 conn(0x7f90f80f6c10 msgr2=0x7f90f80f83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:19.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:19.156+0000 7f90fc859640 1 -- 172.21.15.99:0/640683792 shutdown_connections 2024-09-19T06:42:19.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:19.156+0000 7f90fc859640 1 -- 172.21.15.99:0/640683792 wait complete. 2024-09-19T06:42:19.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:19.239+0000 7fbf9b6dc640 1 -- 172.21.15.99:0/2728630381 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbf940ff740 msgr2=0x7fbf94101b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:19.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:19.239+0000 7fbf9b6dc640 1 --2- 172.21.15.99:0/2728630381 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbf940ff740 0x7fbf94101b20 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fbf840048d0 tx=0x7fbf84009da0 comp rx=0 tx=0).stop 2024-09-19T06:42:19.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:19.239+0000 7fbf9b6dc640 1 -- 172.21.15.99:0/2728630381 shutdown_connections 2024-09-19T06:42:19.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:19.239+0000 7fbf9b6dc640 1 --2- 172.21.15.99:0/2728630381 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbf940ff740 0x7fbf94101b20 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:19.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:19.239+0000 7fbf9b6dc640 1 --2- 172.21.15.99:0/2728630381 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf94065b80 0x7fbf940ff200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:19.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:19.239+0000 7fbf9b6dc640 1 -- 172.21.15.99:0/2728630381 >> 172.21.15.99:0/2728630381 conn(0x7fbf940f6c10 msgr2=0x7fbf940f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:19.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:19.239+0000 7fbf9b6dc640 1 -- 172.21.15.99:0/2728630381 shutdown_connections 2024-09-19T06:42:19.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:19.239+0000 7fbf9b6dc640 1 -- 172.21.15.99:0/2728630381 wait complete. 2024-09-19T06:42:19.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:19.240+0000 7fbf9b6dc640 1 Processor -- start 2024-09-19T06:42:19.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:19.240+0000 7fbf9b6dc640 1 -- start start 2024-09-19T06:42:19.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:19.240+0000 7fbf9b6dc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbf94065b80 0x7fbf940fcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:19.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:19.240+0000 7fbf9b6dc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf940ff740 0x7fbf940fb100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:19.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:19.240+0000 7fbf9b6dc640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf940fb640 con 0x7fbf94065b80 2024-09-19T06:42:19.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:19.240+0000 7fbf9b6dc640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf940fb780 con 0x7fbf940ff740 2024-09-19T06:42:19.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:19.240+0000 7fbf99478640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbf94065b80 0x7fbf940fcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:19.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:19.240+0000 7fbf99478640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbf94065b80 0x7fbf940fcbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47860/0 (socket says 172.21.15.99:47860) 2024-09-19T06:42:19.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:19.240+0000 7fbf99478640 1 -- 172.21.15.99:0/1354220484 learned_addr learned my addr 172.21.15.99:0/1354220484 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:42:19.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:19.240+0000 7fbf98c77640 1 --2- 172.21.15.99:0/1354220484 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf940ff740 0x7fbf940fb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:19.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:19.240+0000 7fbf99478640 1 -- 172.21.15.99:0/1354220484 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf940ff740 msgr2=0x7fbf940fb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:19.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:19.240+0000 7fbf99478640 1 --2- 172.21.15.99:0/1354220484 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf940ff740 0x7fbf940fb100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:19.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:19.240+0000 7fbf99478640 1 -- 172.21.15.99:0/1354220484 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf84005040 con 0x7fbf94065b80 2024-09-19T06:42:19.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:19.241+0000 7fbf99478640 1 --2- 172.21.15.99:0/1354220484 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbf94065b80 0x7fbf940fcbc0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fbf9000eb70 tx=0x7fbf9000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:19.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:19.241+0000 7fbf89ffb640 1 -- 172.21.15.99:0/1354220484 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf90007c30 con 0x7fbf94065b80 2024-09-19T06:42:19.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:19.241+0000 7fbf89ffb640 1 -- 172.21.15.99:0/1354220484 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fbf9000f040 con 0x7fbf94065b80 2024-09-19T06:42:19.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:19.241+0000 7fbf9b6dc640 1 -- 172.21.15.99:0/1354220484 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf940fba60 con 0x7fbf94065b80 2024-09-19T06:42:19.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:19.241+0000 7fbf89ffb640 1 -- 172.21.15.99:0/1354220484 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf9000caa0 con 0x7fbf94065b80 2024-09-19T06:42:19.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:19.241+0000 7fbf9b6dc640 1 -- 172.21.15.99:0/1354220484 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf94115120 con 0x7fbf94065b80 2024-09-19T06:42:19.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:19.242+0000 7fbf9b6dc640 1 -- 172.21.15.99:0/1354220484 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf940fa890 con 0x7fbf94065b80 2024-09-19T06:42:19.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:19.243+0000 7fbf89ffb640 1 -- 172.21.15.99:0/1354220484 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 33) v1 ==== 92375+0+0 (secure 0 0 0) 0x7fbf90009110 con 0x7fbf94065b80 2024-09-19T06:42:19.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:19.243+0000 7fbf89ffb640 1 --2- 172.21.15.99:0/1354220484 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7fbf8006df60 0x7fbf80070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:19.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:19.243+0000 7fbf89ffb640 1 -- 172.21.15.99:0/1354220484 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fbf9008dd10 con 0x7fbf94065b80 2024-09-19T06:42:19.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:19.243+0000 7fbf98c77640 1 --2- 172.21.15.99:0/1354220484 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7fbf8006df60 0x7fbf80070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:19.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:19.244+0000 7fbf98c77640 1 --2- 172.21.15.99:0/1354220484 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7fbf8006df60 0x7fbf80070410 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbf84004540 tx=0x7fbf84035040 comp rx=0 tx=0).ready entity=mgr.14658 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:19.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:19.247+0000 7fbf89ffb640 1 -- 172.21.15.99:0/1354220484 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7fbf90057480 con 0x7fbf94065b80 2024-09-19T06:42:19.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:19.445+0000 7fbf9b6dc640 1 -- 172.21.15.99:0/1354220484 --> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbf940f8700 con 0x7fbf8006df60 2024-09-19T06:42:19.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:19.446+0000 7fbf89ffb640 1 -- 172.21.15.99:0/1354220484 <== mgr.14658 v2:172.21.15.99:6800/3542536515 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7fbf940f8700 con 0x7fbf8006df60 2024-09-19T06:42:19.447 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:42:19.447 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T06:42:19.448 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": true, 2024-09-19T06:42:19.448 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-19T06:42:19.448 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [ 2024-09-19T06:42:19.448 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr" 2024-09-19T06:42:19.448 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-19T06:42:19.448 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": "2/2 daemons upgraded", 2024-09-19T06:42:19.448 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "Currently upgrading grafana daemons", 2024-09-19T06:42:19.448 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-09-19T06:42:19.448 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:42:19.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:19.449+0000 7fbf9b6dc640 1 -- 172.21.15.99:0/1354220484 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7fbf8006df60 msgr2=0x7fbf80070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:19.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:19.449+0000 7fbf9b6dc640 1 --2- 172.21.15.99:0/1354220484 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7fbf8006df60 0x7fbf80070410 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbf84004540 tx=0x7fbf84035040 comp rx=0 tx=0).stop 2024-09-19T06:42:19.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:19.449+0000 7fbf9b6dc640 1 -- 172.21.15.99:0/1354220484 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbf94065b80 msgr2=0x7fbf940fcbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:19.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:19.449+0000 7fbf9b6dc640 1 --2- 172.21.15.99:0/1354220484 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbf94065b80 0x7fbf940fcbc0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fbf9000eb70 tx=0x7fbf9000b040 comp rx=0 tx=0).stop 2024-09-19T06:42:19.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:19.449+0000 7fbf9b6dc640 1 -- 172.21.15.99:0/1354220484 shutdown_connections 2024-09-19T06:42:19.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:19.449+0000 7fbf9b6dc640 1 --2- 172.21.15.99:0/1354220484 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7fbf8006df60 0x7fbf80070410 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:19.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:19.449+0000 7fbf9b6dc640 1 --2- 172.21.15.99:0/1354220484 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf940ff740 0x7fbf940fb100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:19.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:19.449+0000 7fbf9b6dc640 1 --2- 172.21.15.99:0/1354220484 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbf94065b80 0x7fbf940fcbc0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:19.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:19.449+0000 7fbf9b6dc640 1 -- 172.21.15.99:0/1354220484 >> 172.21.15.99:0/1354220484 conn(0x7fbf940f6c10 msgr2=0x7fbf940f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:19.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:19.449+0000 7fbf9b6dc640 1 -- 172.21.15.99:0/1354220484 shutdown_connections 2024-09-19T06:42:19.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:19.449+0000 7fbf9b6dc640 1 -- 172.21.15.99:0/1354220484 wait complete. 2024-09-19T06:42:19.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:19 smithi099 ceph-mon[27651]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:42:19.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:19 smithi099 ceph-mon[27651]: from='client.14716 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:42:19.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:19 smithi099 ceph-mon[27651]: from='client.14720 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:42:19.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:19 smithi099 ceph-mon[27651]: from='client.? 172.21.15.99:0/640683792' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:42:19.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:19 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:19.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:19 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:19.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:19 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:42:19.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:19 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:42:19.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:19 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:19.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:19 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:42:19.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:19 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:42:19.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:19 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:19.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:19 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi099.pgvkqi"}]: dispatch 2024-09-19T06:42:19.708 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:19 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi099.pgvkqi"}]': finished 2024-09-19T06:42:19.708 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:19 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi117.ssmkcf"}]: dispatch 2024-09-19T06:42:19.708 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:19 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi117.ssmkcf"}]': finished 2024-09-19T06:42:19.708 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:19 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:42:19.708 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:19 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:19.708 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:19 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:42:19.708 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:19 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:19.708 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:19 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:42:19.708 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:19 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:19.708 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:19 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:42:19.708 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:19 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:19.708 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:19 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:42:19.708 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:19 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:19.709 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:19 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:42:19.709 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:19 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:19.709 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:19 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:42:19.709 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:19 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:19.709 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:19 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:42:19.709 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:19 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:42:19.709 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:19 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:42:19.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:19 smithi117 ceph-mon[34564]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:42:19.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:19 smithi117 ceph-mon[34564]: from='client.14716 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:42:19.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:19 smithi117 ceph-mon[34564]: from='client.14720 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:42:19.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:19 smithi117 ceph-mon[34564]: from='client.? 172.21.15.99:0/640683792' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:42:19.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:19 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:19.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:19 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:19.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:19 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:42:19.813 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:19 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:42:19.813 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:19 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:19.813 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:19 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:42:19.813 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:19 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:42:19.813 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:19 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:19.813 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:19 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi099.pgvkqi"}]: dispatch 2024-09-19T06:42:19.813 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:19 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi099.pgvkqi"}]': finished 2024-09-19T06:42:19.813 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:19 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi117.ssmkcf"}]: dispatch 2024-09-19T06:42:19.813 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:19 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi117.ssmkcf"}]': finished 2024-09-19T06:42:19.813 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:19 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:42:19.813 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:19 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:19.813 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:19 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:42:19.813 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:19 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:19.814 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:19 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:42:19.814 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:19 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:19.814 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:19 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:42:19.814 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:19 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:19.814 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:19 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:42:19.814 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:19 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:19.814 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:19 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:42:19.814 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:19 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:19.814 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:19 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:42:19.814 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:19 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:19.814 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:19 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:42:19.814 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:19 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:42:19.814 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:19 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:42:20.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:20 smithi099 ceph-mon[27651]: pgmap v17: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:42:20.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:20 smithi099 ceph-mon[27651]: Upgrade: Setting container_image for all mgr 2024-09-19T06:42:20.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:20 smithi099 ceph-mon[27651]: Upgrade: Setting container_image for all rgw 2024-09-19T06:42:20.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:20 smithi099 ceph-mon[27651]: Upgrade: Setting container_image for all rbd-mirror 2024-09-19T06:42:20.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:20 smithi099 ceph-mon[27651]: Upgrade: Setting container_image for all cephfs-mirror 2024-09-19T06:42:20.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:20 smithi099 ceph-mon[27651]: Upgrade: Setting container_image for all ceph-exporter 2024-09-19T06:42:20.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:20 smithi099 ceph-mon[27651]: Upgrade: Setting container_image for all iscsi 2024-09-19T06:42:20.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:20 smithi099 ceph-mon[27651]: Upgrade: Setting container_image for all nfs 2024-09-19T06:42:20.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:20 smithi099 ceph-mon[27651]: Upgrade: Setting container_image for all nvmeof 2024-09-19T06:42:20.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:20 smithi099 ceph-mon[27651]: Upgrade: Setting container_image for all node-exporter 2024-09-19T06:42:20.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:20 smithi099 ceph-mon[27651]: Upgrade: Setting container_image for all prometheus 2024-09-19T06:42:20.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:20 smithi099 ceph-mon[27651]: Upgrade: Setting container_image for all alertmanager 2024-09-19T06:42:20.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:20 smithi099 ceph-mon[27651]: from='client.14728 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:42:20.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:20 smithi117 ceph-mon[34564]: pgmap v17: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:42:20.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:20 smithi117 ceph-mon[34564]: Upgrade: Setting container_image for all mgr 2024-09-19T06:42:20.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:20 smithi117 ceph-mon[34564]: Upgrade: Setting container_image for all rgw 2024-09-19T06:42:20.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:20 smithi117 ceph-mon[34564]: Upgrade: Setting container_image for all rbd-mirror 2024-09-19T06:42:20.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:20 smithi117 ceph-mon[34564]: Upgrade: Setting container_image for all cephfs-mirror 2024-09-19T06:42:20.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:20 smithi117 ceph-mon[34564]: Upgrade: Setting container_image for all ceph-exporter 2024-09-19T06:42:20.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:20 smithi117 ceph-mon[34564]: Upgrade: Setting container_image for all iscsi 2024-09-19T06:42:20.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:20 smithi117 ceph-mon[34564]: Upgrade: Setting container_image for all nfs 2024-09-19T06:42:20.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:20 smithi117 ceph-mon[34564]: Upgrade: Setting container_image for all nvmeof 2024-09-19T06:42:20.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:20 smithi117 ceph-mon[34564]: Upgrade: Setting container_image for all node-exporter 2024-09-19T06:42:20.813 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:20 smithi117 ceph-mon[34564]: Upgrade: Setting container_image for all prometheus 2024-09-19T06:42:20.813 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:20 smithi117 ceph-mon[34564]: Upgrade: Setting container_image for all alertmanager 2024-09-19T06:42:20.813 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:20 smithi117 ceph-mon[34564]: from='client.14728 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:42:21.811 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:21 smithi117 ceph-mon[34564]: Upgrade: Updating grafana.smithi099 2024-09-19T06:42:21.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:21 smithi117 ceph-mon[34564]: Deploying daemon grafana.smithi099 on smithi099 2024-09-19T06:42:21.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:21 smithi099 ceph-mon[27651]: Upgrade: Updating grafana.smithi099 2024-09-19T06:42:21.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:21 smithi099 ceph-mon[27651]: Deploying daemon grafana.smithi099 on smithi099 2024-09-19T06:42:22.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:22 smithi099 ceph-mon[27651]: pgmap v18: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:42:22.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:22 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:42:22.713 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:22 smithi117 ceph-mon[34564]: pgmap v18: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:42:22.713 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:22 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:42:24.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:24 smithi099 ceph-mon[27651]: pgmap v19: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:42:24.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:24 smithi117 ceph-mon[34564]: pgmap v19: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:42:26.811 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:26 smithi117 ceph-mon[34564]: pgmap v20: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:42:26.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:26 smithi099 ceph-mon[27651]: pgmap v20: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:42:28.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:28 smithi117 ceph-mon[34564]: pgmap v21: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:42:28.845 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:28 smithi099 ceph-mon[27651]: pgmap v21: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:42:30.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:30 smithi117 ceph-mon[34564]: pgmap v22: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:42:30.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:30 smithi099 ceph-mon[27651]: pgmap v22: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:42:32.781 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:32 smithi099 ceph-mon[27651]: pgmap v23: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:42:32.811 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:32 smithi117 ceph-mon[34564]: pgmap v23: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:42:34.454 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:34 smithi099 ceph-mon[27651]: pgmap v24: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:42:34.455 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:34 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:34.455 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:34 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:34.455 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:34 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:42:34.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:34 smithi117 ceph-mon[34564]: pgmap v24: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:42:34.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:34 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:34.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:34 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:34.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:34 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:42:36.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:36 smithi099 ceph-mon[27651]: pgmap v25: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:42:36.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:36 smithi117 ceph-mon[34564]: pgmap v25: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:42:37.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:37 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:42:37.608 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:37 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:42:38.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:38 smithi117 ceph-mon[34564]: pgmap v26: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:42:38.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:38 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:38.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:38 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:38.660 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:38 smithi099 ceph-mon[27651]: pgmap v26: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:42:38.660 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:38 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:38.660 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:38 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:40.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:39 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:40.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:39 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:40.140 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:39 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:40.141 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:39 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:41.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:40 smithi117 ceph-mon[34564]: pgmap v27: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:42:41.191 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:40 smithi099 ceph-mon[27651]: pgmap v27: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:42:43.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:42 smithi117 ceph-mon[34564]: pgmap v28: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:42:43.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:42 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:43.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:42 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:43.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:42 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:42:43.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:42 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:42:43.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:42 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:43.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:42 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-19T06:42:43.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:42 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:42:43.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:42 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:42:43.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:42 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:42:43.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:42 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:42:43.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:42 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:42:43.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:42 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:42:43.314 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:42 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:42:43.314 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:42 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:42:43.314 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:42 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:42:43.314 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:42 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:42:43.314 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:42 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:42:43.314 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:42 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:42:43.314 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:42 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:42:43.314 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:42 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:42:43.314 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:42 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:42:43.314 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:42 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:43.314 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:42 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-19T06:42:43.314 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:42 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-19T06:42:43.315 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:42 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T06:42:43.315 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:42 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-19T06:42:43.315 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:42 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-19T06:42:43.315 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:42 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-19T06:42:43.315 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:42 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-19T06:42:43.315 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:42 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-19T06:42:43.315 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:42 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-19T06:42:43.315 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:42 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-19T06:42:43.315 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:42 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-19T06:42:43.315 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:42 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T06:42:43.315 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:42 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-19T06:42:43.315 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:42 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-19T06:42:43.315 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:42 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-19T06:42:43.315 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:42 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-19T06:42:43.316 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:42 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-19T06:42:43.316 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:42 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-19T06:42:43.316 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:42 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-19T06:42:43.316 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:42 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-19T06:42:43.316 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:42 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T06:42:43.316 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:42 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T06:42:43.316 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:42 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T06:42:43.316 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:42 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T06:42:43.316 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:42 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T06:42:43.316 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:42 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T06:42:43.316 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:42 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-19T06:42:43.316 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:42 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-19T06:42:43.317 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:42 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:42:43.317 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:42 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:42:43.317 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:42 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:42:43.317 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:42 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:43.317 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:42 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:42:43.317 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:42 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:42:43.317 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:42 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:42:43.317 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:42 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:43.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:42 smithi099 ceph-mon[27651]: pgmap v28: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:42:43.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:42 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:43.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:42 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:43.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:42 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:42:43.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:42 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:42:43.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:42 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:43.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:42 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-19T06:42:43.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:42 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:42:43.458 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:42 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:42:43.458 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:42 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:42:43.458 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:42 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:42:43.458 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:42 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:42:43.458 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:42 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:42:43.458 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:42 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:42:43.458 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:42 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:42:43.458 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:42 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:42:43.458 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:42 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:42:43.458 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:42 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:42:43.458 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:42 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:42:43.459 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:42 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:42:43.459 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:42 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:42:43.459 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:42 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:42:43.459 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:42 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:43.459 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:42 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-19T06:42:43.459 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:42 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-19T06:42:43.459 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:42 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T06:42:43.459 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:42 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-19T06:42:43.459 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:42 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-19T06:42:43.459 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:42 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-19T06:42:43.459 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:42 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-19T06:42:43.459 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:42 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-19T06:42:43.459 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:42 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-19T06:42:43.459 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:42 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-19T06:42:43.460 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:42 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-19T06:42:43.460 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:42 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T06:42:43.460 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:42 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-19T06:42:43.460 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:42 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-19T06:42:43.460 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:42 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-19T06:42:43.460 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:42 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-19T06:42:43.460 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:42 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-19T06:42:43.460 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:42 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-19T06:42:43.460 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:42 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-19T06:42:43.460 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:42 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-19T06:42:43.460 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:42 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T06:42:43.460 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:42 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T06:42:43.461 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:42 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T06:42:43.461 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:42 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T06:42:43.461 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:42 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T06:42:43.461 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:42 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T06:42:43.461 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:42 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-19T06:42:43.461 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:42 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-19T06:42:43.461 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:42 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:42:43.461 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:42 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:42:43.461 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:42 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:42:43.461 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:42 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:43.461 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:42 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:42:43.461 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:42 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:42:43.461 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:42 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:42:43.461 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:42 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:44.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:43 smithi117 ceph-mon[34564]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-19T06:42:44.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:43 smithi117 ceph-mon[34564]: Upgrade: Finalizing container_image settings 2024-09-19T06:42:44.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:43 smithi117 ceph-mon[34564]: Upgrade: Complete! 2024-09-19T06:42:44.454 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:43 smithi099 ceph-mon[27651]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-19T06:42:44.454 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:43 smithi099 ceph-mon[27651]: Upgrade: Finalizing container_image settings 2024-09-19T06:42:44.455 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:43 smithi099 ceph-mon[27651]: Upgrade: Complete! 2024-09-19T06:42:45.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:44 smithi117 ceph-mon[34564]: pgmap v29: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:42:45.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:44 smithi099 ceph-mon[27651]: pgmap v29: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:42:47.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:46 smithi117 ceph-mon[34564]: pgmap v30: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:42:47.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:46 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:47.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:46 smithi099 ceph-mon[27651]: pgmap v30: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:42:47.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:46 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:42:49.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:48 smithi117 ceph-mon[34564]: pgmap v31: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:42:49.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:48 smithi099 ceph-mon[27651]: pgmap v31: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:42:49.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:49.538+0000 7fea8c955640 1 -- 172.21.15.99:0/3807004831 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea880fc520 msgr2=0x7fea880fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:49.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:49.538+0000 7fea8c955640 1 --2- 172.21.15.99:0/3807004831 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea880fc520 0x7fea880fc930 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fea78009c50 tx=0x7fea78004d10 comp rx=0 tx=0).stop 2024-09-19T06:42:49.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:49.538+0000 7fea8c955640 1 -- 172.21.15.99:0/3807004831 shutdown_connections 2024-09-19T06:42:49.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:49.538+0000 7fea8c955640 1 --2- 172.21.15.99:0/3807004831 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea880fd7f0 0x7fea880fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:49.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:49.538+0000 7fea8c955640 1 --2- 172.21.15.99:0/3807004831 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea880fc520 0x7fea880fc930 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:49.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:49.538+0000 7fea8c955640 1 -- 172.21.15.99:0/3807004831 >> 172.21.15.99:0/3807004831 conn(0x7fea880f7ce0 msgr2=0x7fea880fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:49.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:49.538+0000 7fea8c955640 1 -- 172.21.15.99:0/3807004831 shutdown_connections 2024-09-19T06:42:49.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:49.538+0000 7fea8c955640 1 -- 172.21.15.99:0/3807004831 wait complete. 2024-09-19T06:42:49.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:49.539+0000 7fea8c955640 1 Processor -- start 2024-09-19T06:42:49.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:49.539+0000 7fea8c955640 1 -- start start 2024-09-19T06:42:49.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:49.539+0000 7fea8c955640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea880fc520 0x7fea8810d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:49.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:49.539+0000 7fea8c955640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea880fd7f0 0x7fea8810d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:49.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:49.539+0000 7fea8c955640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea8810dc40 con 0x7fea880fd7f0 2024-09-19T06:42:49.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:49.539+0000 7fea8c955640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea8810e460 con 0x7fea880fc520 2024-09-19T06:42:49.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:49.539+0000 7fea85d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea880fd7f0 0x7fea8810d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:49.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:49.539+0000 7fea85d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea880fd7f0 0x7fea8810d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34576/0 (socket says 172.21.15.99:34576) 2024-09-19T06:42:49.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:49.539+0000 7fea85d9b640 1 -- 172.21.15.99:0/1891848155 learned_addr learned my addr 172.21.15.99:0/1891848155 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:42:49.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:49.539+0000 7fea8659c640 1 --2- 172.21.15.99:0/1891848155 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea880fc520 0x7fea8810d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:49.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:49.539+0000 7fea85d9b640 1 -- 172.21.15.99:0/1891848155 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea880fc520 msgr2=0x7fea8810d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:49.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:49.539+0000 7fea85d9b640 1 --2- 172.21.15.99:0/1891848155 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea880fc520 0x7fea8810d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:49.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:49.539+0000 7fea85d9b640 1 -- 172.21.15.99:0/1891848155 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea780098b0 con 0x7fea880fd7f0 2024-09-19T06:42:49.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:49.539+0000 7fea85d9b640 1 --2- 172.21.15.99:0/1891848155 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea880fd7f0 0x7fea8810d5f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fea70002a50 tx=0x7fea70004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:49.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:49.540+0000 7fea7effd640 1 -- 172.21.15.99:0/1891848155 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea70007c30 con 0x7fea880fd7f0 2024-09-19T06:42:49.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:49.540+0000 7fea7effd640 1 -- 172.21.15.99:0/1891848155 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fea7000f040 con 0x7fea880fd7f0 2024-09-19T06:42:49.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:49.540+0000 7fea7effd640 1 -- 172.21.15.99:0/1891848155 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea7000da90 con 0x7fea880fd7f0 2024-09-19T06:42:49.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:49.540+0000 7fea8c955640 1 -- 172.21.15.99:0/1891848155 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea8810e6f0 con 0x7fea880fd7f0 2024-09-19T06:42:49.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:49.540+0000 7fea8c955640 1 -- 172.21.15.99:0/1891848155 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea8810ec90 con 0x7fea880fd7f0 2024-09-19T06:42:49.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:49.541+0000 7fea8c955640 1 -- 172.21.15.99:0/1891848155 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea880fb980 con 0x7fea880fd7f0 2024-09-19T06:42:49.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:49.541+0000 7fea7effd640 1 -- 172.21.15.99:0/1891848155 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 33) v1 ==== 92375+0+0 (secure 0 0 0) 0x7fea7000dc30 con 0x7fea880fd7f0 2024-09-19T06:42:49.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:49.542+0000 7fea7effd640 1 --2- 172.21.15.99:0/1891848155 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7fea7406df60 0x7fea74070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:49.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:49.542+0000 7fea7effd640 1 -- 172.21.15.99:0/1891848155 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fea7008d1e0 con 0x7fea880fd7f0 2024-09-19T06:42:49.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:49.542+0000 7fea8659c640 1 --2- 172.21.15.99:0/1891848155 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7fea7406df60 0x7fea74070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:49.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:49.542+0000 7fea8659c640 1 --2- 172.21.15.99:0/1891848155 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7fea7406df60 0x7fea74070410 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fea78000f80 tx=0x7fea78004d10 comp rx=0 tx=0).ready entity=mgr.14658 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:49.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:49.546+0000 7fea7effd640 1 -- 172.21.15.99:0/1891848155 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7fea70056a80 con 0x7fea880fd7f0 2024-09-19T06:42:49.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:49.726+0000 7fea8c955640 1 -- 172.21.15.99:0/1891848155 --> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fea8810f010 con 0x7fea7406df60 2024-09-19T06:42:49.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:49.727+0000 7fea7effd640 1 -- 172.21.15.99:0/1891848155 <== mgr.14658 v2:172.21.15.99:6800/3542536515 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7fea8810f010 con 0x7fea7406df60 2024-09-19T06:42:49.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:49.729+0000 7fea8c955640 1 -- 172.21.15.99:0/1891848155 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7fea7406df60 msgr2=0x7fea74070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:49.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:49.729+0000 7fea8c955640 1 --2- 172.21.15.99:0/1891848155 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7fea7406df60 0x7fea74070410 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fea78000f80 tx=0x7fea78004d10 comp rx=0 tx=0).stop 2024-09-19T06:42:49.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:49.729+0000 7fea8c955640 1 -- 172.21.15.99:0/1891848155 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea880fd7f0 msgr2=0x7fea8810d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:49.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:49.729+0000 7fea8c955640 1 --2- 172.21.15.99:0/1891848155 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea880fd7f0 0x7fea8810d5f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fea70002a50 tx=0x7fea70004600 comp rx=0 tx=0).stop 2024-09-19T06:42:49.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:49.729+0000 7fea8c955640 1 -- 172.21.15.99:0/1891848155 shutdown_connections 2024-09-19T06:42:49.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:49.729+0000 7fea8c955640 1 --2- 172.21.15.99:0/1891848155 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7fea7406df60 0x7fea74070410 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:49.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:49.729+0000 7fea8c955640 1 --2- 172.21.15.99:0/1891848155 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea880fd7f0 0x7fea8810d5f0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:49.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:49.729+0000 7fea8c955640 1 --2- 172.21.15.99:0/1891848155 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea880fc520 0x7fea8810d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:49.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:49.729+0000 7fea8c955640 1 -- 172.21.15.99:0/1891848155 >> 172.21.15.99:0/1891848155 conn(0x7fea880f7ce0 msgr2=0x7fea880f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:49.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:49.729+0000 7fea8c955640 1 -- 172.21.15.99:0/1891848155 shutdown_connections 2024-09-19T06:42:49.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:49.729+0000 7fea8c955640 1 -- 172.21.15.99:0/1891848155 wait complete. 2024-09-19T06:42:50.443 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -e sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 -- bash -c 'ceph versions | jq -e '"'"'.mgr | length == 1'"'"'' 2024-09-19T06:42:50.689 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T06:42:51.155 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:50 smithi099 ceph-mon[27651]: pgmap v32: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:42:51.156 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:50 smithi099 ceph-mon[27651]: from='client.14732 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:42:51.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:50 smithi117 ceph-mon[34564]: pgmap v32: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:42:51.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:50 smithi117 ceph-mon[34564]: from='client.14732 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:42:52.194 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:51 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:42:52.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:51 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:42:52.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:52.380+0000 7ff7c3abc640 1 -- 172.21.15.99:0/880244716 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff7bc0fcf80 msgr2=0x7ff7bc0fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:52.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:52.380+0000 7ff7c3abc640 1 --2- 172.21.15.99:0/880244716 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff7bc0fcf80 0x7ff7bc0fd3d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff7b00048d0 tx=0x7ff7b0009da0 comp rx=0 tx=0).stop 2024-09-19T06:42:52.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:52.380+0000 7ff7c3abc640 1 -- 172.21.15.99:0/880244716 shutdown_connections 2024-09-19T06:42:52.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:52.380+0000 7ff7c3abc640 1 --2- 172.21.15.99:0/880244716 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff7bc0fcf80 0x7ff7bc0fd3d0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:52.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:52.380+0000 7ff7c3abc640 1 --2- 172.21.15.99:0/880244716 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7bc0fb810 0x7ff7bc0fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:52.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:52.380+0000 7ff7c3abc640 1 -- 172.21.15.99:0/880244716 >> 172.21.15.99:0/880244716 conn(0x7ff7bc0723b0 msgr2=0x7ff7bc0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:52.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:52.380+0000 7ff7c3abc640 1 -- 172.21.15.99:0/880244716 shutdown_connections 2024-09-19T06:42:52.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:52.380+0000 7ff7c3abc640 1 -- 172.21.15.99:0/880244716 wait complete. 2024-09-19T06:42:52.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:52.380+0000 7ff7c3abc640 1 Processor -- start 2024-09-19T06:42:52.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:52.380+0000 7ff7c3abc640 1 -- start start 2024-09-19T06:42:52.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:52.380+0000 7ff7c3abc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7bc0fb810 0x7ff7bc1120b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:52.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:52.380+0000 7ff7c3abc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff7bc0fcf80 0x7ff7bc1125f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:52.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:52.380+0000 7ff7c3abc640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc112bf0 con 0x7ff7bc0fcf80 2024-09-19T06:42:52.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:52.380+0000 7ff7c3abc640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc10c030 con 0x7ff7bc0fb810 2024-09-19T06:42:52.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:52.381+0000 7ff7c1057640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff7bc0fcf80 0x7ff7bc1125f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:52.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:52.381+0000 7ff7c1057640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff7bc0fcf80 0x7ff7bc1125f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34606/0 (socket says 172.21.15.99:34606) 2024-09-19T06:42:52.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:52.381+0000 7ff7c1057640 1 -- 172.21.15.99:0/122862337 learned_addr learned my addr 172.21.15.99:0/122862337 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:42:52.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:52.381+0000 7ff7c1858640 1 --2- 172.21.15.99:0/122862337 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7bc0fb810 0x7ff7bc1120b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:52.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:52.381+0000 7ff7c1057640 1 -- 172.21.15.99:0/122862337 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7bc0fb810 msgr2=0x7ff7bc1120b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:52.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:52.381+0000 7ff7c1057640 1 --2- 172.21.15.99:0/122862337 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7bc0fb810 0x7ff7bc1120b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:52.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:52.381+0000 7ff7c1057640 1 -- 172.21.15.99:0/122862337 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b0005040 con 0x7ff7bc0fcf80 2024-09-19T06:42:52.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:52.381+0000 7ff7c1057640 1 --2- 172.21.15.99:0/122862337 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff7bc0fcf80 0x7ff7bc1125f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff7b0000c00 tx=0x7ff7b0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:52.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:52.381+0000 7ff7ba7fc640 1 -- 172.21.15.99:0/122862337 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7b0038070 con 0x7ff7bc0fcf80 2024-09-19T06:42:52.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:52.381+0000 7ff7ba7fc640 1 -- 172.21.15.99:0/122862337 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff7b002ade0 con 0x7ff7bc0fcf80 2024-09-19T06:42:52.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:52.381+0000 7ff7c3abc640 1 -- 172.21.15.99:0/122862337 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7bc10c2b0 con 0x7ff7bc0fcf80 2024-09-19T06:42:52.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:52.381+0000 7ff7ba7fc640 1 -- 172.21.15.99:0/122862337 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7b002c7e0 con 0x7ff7bc0fcf80 2024-09-19T06:42:52.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:52.381+0000 7ff7c3abc640 1 -- 172.21.15.99:0/122862337 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7bc10c770 con 0x7ff7bc0fcf80 2024-09-19T06:42:52.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:52.382+0000 7ff7c3abc640 1 -- 172.21.15.99:0/122862337 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7bc0fcbc0 con 0x7ff7bc0fcf80 2024-09-19T06:42:52.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:52.383+0000 7ff7ba7fc640 1 -- 172.21.15.99:0/122862337 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 33) v1 ==== 92375+0+0 (secure 0 0 0) 0x7ff7b0030020 con 0x7ff7bc0fcf80 2024-09-19T06:42:52.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:52.383+0000 7ff7ba7fc640 1 --2- 172.21.15.99:0/122862337 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7ff7a406df60 0x7ff7a4070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:52.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:52.383+0000 7ff7ba7fc640 1 -- 172.21.15.99:0/122862337 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6066+0+0 (secure 0 0 0) 0x7ff7b00ad5b0 con 0x7ff7bc0fcf80 2024-09-19T06:42:52.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:52.383+0000 7ff7c1858640 1 --2- 172.21.15.99:0/122862337 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7ff7a406df60 0x7ff7a4070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:52.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:52.384+0000 7ff7c1858640 1 --2- 172.21.15.99:0/122862337 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7ff7a406df60 0x7ff7a4070410 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4009fd0 tx=0x7ff7b400b040 comp rx=0 tx=0).ready entity=mgr.14658 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:52.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:52.387+0000 7ff7ba7fc640 1 -- 172.21.15.99:0/122862337 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7ff7b0076ee0 con 0x7ff7bc0fcf80 2024-09-19T06:42:52.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:52.618+0000 7ff7c3abc640 1 -- 172.21.15.99:0/122862337 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff7bc10d750 con 0x7ff7bc0fcf80 2024-09-19T06:42:52.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:52.619+0000 7ff7ba7fc640 1 -- 172.21.15.99:0/122862337 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+747 (secure 0 0 0) 0x7ff7b007a5a0 con 0x7ff7bc0fcf80 2024-09-19T06:42:52.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:52.621+0000 7ff7c3abc640 1 -- 172.21.15.99:0/122862337 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7ff7a406df60 msgr2=0x7ff7a4070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:52.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:52.621+0000 7ff7c3abc640 1 --2- 172.21.15.99:0/122862337 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7ff7a406df60 0x7ff7a4070410 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4009fd0 tx=0x7ff7b400b040 comp rx=0 tx=0).stop 2024-09-19T06:42:52.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:52.621+0000 7ff7c3abc640 1 -- 172.21.15.99:0/122862337 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff7bc0fcf80 msgr2=0x7ff7bc1125f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:52.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:52.621+0000 7ff7c3abc640 1 --2- 172.21.15.99:0/122862337 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff7bc0fcf80 0x7ff7bc1125f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff7b0000c00 tx=0x7ff7b0009da0 comp rx=0 tx=0).stop 2024-09-19T06:42:52.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:52.621+0000 7ff7c3abc640 1 -- 172.21.15.99:0/122862337 shutdown_connections 2024-09-19T06:42:52.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:52.621+0000 7ff7c3abc640 1 --2- 172.21.15.99:0/122862337 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7ff7a406df60 0x7ff7a4070410 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:52.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:52.621+0000 7ff7c3abc640 1 --2- 172.21.15.99:0/122862337 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff7bc0fcf80 0x7ff7bc1125f0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:52.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:52.621+0000 7ff7c3abc640 1 --2- 172.21.15.99:0/122862337 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7bc0fb810 0x7ff7bc1120b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:52.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:52.621+0000 7ff7c3abc640 1 -- 172.21.15.99:0/122862337 >> 172.21.15.99:0/122862337 conn(0x7ff7bc0723b0 msgr2=0x7ff7bc0fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:52.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:52.621+0000 7ff7c3abc640 1 -- 172.21.15.99:0/122862337 shutdown_connections 2024-09-19T06:42:52.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:52.621+0000 7ff7c3abc640 1 -- 172.21.15.99:0/122862337 wait complete. 2024-09-19T06:42:52.631 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-09-19T06:42:53.309 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:52 smithi099 ceph-mon[27651]: pgmap v33: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:42:53.309 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:52 smithi099 ceph-mon[27651]: from='client.? 172.21.15.99:0/122862337' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:42:53.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:52 smithi117 ceph-mon[34564]: pgmap v33: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:42:53.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:52 smithi117 ceph-mon[34564]: from='client.? 172.21.15.99:0/122862337' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:42:53.334 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -e sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 -- bash -c 'ceph versions | jq -e '"'"'.mgr | keys'"'"' | grep $sha1' 2024-09-19T06:42:53.581 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T06:42:55.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:55.194+0000 7f268b3e3640 1 -- 172.21.15.99:0/3705482019 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2684064fc0 msgr2=0x7f2684065430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:55.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:55.194+0000 7f268b3e3640 1 --2- 172.21.15.99:0/3705482019 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2684064fc0 0x7f2684065430 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f26800048d0 tx=0x7f2680009da0 comp rx=0 tx=0).stop 2024-09-19T06:42:55.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:55.194+0000 7f268b3e3640 1 -- 172.21.15.99:0/3705482019 shutdown_connections 2024-09-19T06:42:55.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:55.194+0000 7f268b3e3640 1 --2- 172.21.15.99:0/3705482019 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2684064fc0 0x7f2684065430 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:55.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:55.194+0000 7f268b3e3640 1 --2- 172.21.15.99:0/3705482019 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26840fe460 0x7f26840fe830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:55.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:55.194+0000 7f268b3e3640 1 -- 172.21.15.99:0/3705482019 >> 172.21.15.99:0/3705482019 conn(0x7f26840723b0 msgr2=0x7f26840727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:55.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:55.194+0000 7f268b3e3640 1 -- 172.21.15.99:0/3705482019 shutdown_connections 2024-09-19T06:42:55.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:55.194+0000 7f268b3e3640 1 -- 172.21.15.99:0/3705482019 wait complete. 2024-09-19T06:42:55.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:55.194+0000 7f268b3e3640 1 Processor -- start 2024-09-19T06:42:55.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:55.194+0000 7f268b3e3640 1 -- start start 2024-09-19T06:42:55.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:55.195+0000 7f268b3e3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2684064fc0 0x7f26841131b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:55.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:55.195+0000 7f268b3e3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26840fe460 0x7f26841136f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:55.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:55.195+0000 7f268b3e3640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2684113cf0 con 0x7f2684064fc0 2024-09-19T06:42:55.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:55.195+0000 7f268b3e3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f268410d180 con 0x7f26840fe460 2024-09-19T06:42:55.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:55.195+0000 7f268917f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2684064fc0 0x7f26841131b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:55.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:55.195+0000 7f268917f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2684064fc0 0x7f26841131b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34638/0 (socket says 172.21.15.99:34638) 2024-09-19T06:42:55.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:55.195+0000 7f268917f640 1 -- 172.21.15.99:0/1261821179 learned_addr learned my addr 172.21.15.99:0/1261821179 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:42:55.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:55.195+0000 7f268897e640 1 --2- 172.21.15.99:0/1261821179 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26840fe460 0x7f26841136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:55.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:55.195+0000 7f268917f640 1 -- 172.21.15.99:0/1261821179 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26840fe460 msgr2=0x7f26841136f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:55.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:55.195+0000 7f268917f640 1 --2- 172.21.15.99:0/1261821179 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26840fe460 0x7f26841136f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:55.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:55.195+0000 7f268917f640 1 -- 172.21.15.99:0/1261821179 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2680005040 con 0x7f2684064fc0 2024-09-19T06:42:55.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:55.195+0000 7f268917f640 1 --2- 172.21.15.99:0/1261821179 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2684064fc0 0x7f26841131b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f267800c830 tx=0x7f2678004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:55.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:55.195+0000 7f2675ffb640 1 -- 172.21.15.99:0/1261821179 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f267800a850 con 0x7f2684064fc0 2024-09-19T06:42:55.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:55.195+0000 7f2675ffb640 1 -- 172.21.15.99:0/1261821179 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f267800ae50 con 0x7f2684064fc0 2024-09-19T06:42:55.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:55.195+0000 7f268b3e3640 1 -- 172.21.15.99:0/1261821179 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f268410d460 con 0x7f2684064fc0 2024-09-19T06:42:55.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:55.195+0000 7f2675ffb640 1 -- 172.21.15.99:0/1261821179 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f26780113a0 con 0x7f2684064fc0 2024-09-19T06:42:55.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:55.196+0000 7f268b3e3640 1 -- 172.21.15.99:0/1261821179 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f268410d9d0 con 0x7f2684064fc0 2024-09-19T06:42:55.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:55.196+0000 7f268b3e3640 1 -- 172.21.15.99:0/1261821179 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26840fdcf0 con 0x7f2684064fc0 2024-09-19T06:42:55.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:55.197+0000 7f2675ffb640 1 -- 172.21.15.99:0/1261821179 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 33) v1 ==== 92375+0+0 (secure 0 0 0) 0x7f2678012400 con 0x7f2684064fc0 2024-09-19T06:42:55.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:55.197+0000 7f2675ffb640 1 --2- 172.21.15.99:0/1261821179 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f267006df60 0x7f2670070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:42:55.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:55.197+0000 7f2675ffb640 1 -- 172.21.15.99:0/1261821179 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f267808db70 con 0x7f2684064fc0 2024-09-19T06:42:55.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:55.197+0000 7f268897e640 1 --2- 172.21.15.99:0/1261821179 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f267006df60 0x7f2670070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:42:55.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:55.198+0000 7f268897e640 1 --2- 172.21.15.99:0/1261821179 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f267006df60 0x7f2670070410 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2684072d60 tx=0x7f2680035040 comp rx=0 tx=0).ready entity=mgr.14658 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:42:55.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:55.202+0000 7f2675ffb640 1 -- 172.21.15.99:0/1261821179 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f2678057470 con 0x7f2684064fc0 2024-09-19T06:42:55.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:54 smithi117 ceph-mon[34564]: pgmap v34: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:42:55.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:55.431+0000 7f268b3e3640 1 -- 172.21.15.99:0/1261821179 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f268404b720 con 0x7f2684064fc0 2024-09-19T06:42:55.433 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:54 smithi099 ceph-mon[27651]: pgmap v34: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:42:55.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:55.432+0000 7f2675ffb640 1 -- 172.21.15.99:0/1261821179 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+747 (secure 0 0 0) 0x7f267805ab30 con 0x7f2684064fc0 2024-09-19T06:42:55.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:55.434+0000 7f268b3e3640 1 -- 172.21.15.99:0/1261821179 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f267006df60 msgr2=0x7f2670070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:55.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:55.434+0000 7f268b3e3640 1 --2- 172.21.15.99:0/1261821179 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f267006df60 0x7f2670070410 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2684072d60 tx=0x7f2680035040 comp rx=0 tx=0).stop 2024-09-19T06:42:55.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:55.434+0000 7f268b3e3640 1 -- 172.21.15.99:0/1261821179 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2684064fc0 msgr2=0x7f26841131b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:42:55.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:55.434+0000 7f268b3e3640 1 --2- 172.21.15.99:0/1261821179 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2684064fc0 0x7f26841131b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f267800c830 tx=0x7f2678004430 comp rx=0 tx=0).stop 2024-09-19T06:42:55.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:55.434+0000 7f268b3e3640 1 -- 172.21.15.99:0/1261821179 shutdown_connections 2024-09-19T06:42:55.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:55.434+0000 7f268b3e3640 1 --2- 172.21.15.99:0/1261821179 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f267006df60 0x7f2670070410 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:55.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:55.434+0000 7f268b3e3640 1 --2- 172.21.15.99:0/1261821179 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26840fe460 0x7f26841136f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:55.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:55.434+0000 7f268b3e3640 1 --2- 172.21.15.99:0/1261821179 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2684064fc0 0x7f26841131b0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:42:55.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:55.434+0000 7f268b3e3640 1 -- 172.21.15.99:0/1261821179 >> 172.21.15.99:0/1261821179 conn(0x7f26840723b0 msgr2=0x7f26841053f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:42:55.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:55.434+0000 7f268b3e3640 1 -- 172.21.15.99:0/1261821179 shutdown_connections 2024-09-19T06:42:55.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:42:55.434+0000 7f268b3e3640 1 -- 172.21.15.99:0/1261821179 wait complete. 2024-09-19T06:42:55.444 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)" 2024-09-19T06:42:56.089 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:56 smithi099 ceph-mon[27651]: from='client.? 172.21.15.99:0/1261821179' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:42:56.113 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -e sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 2'"'"'' 2024-09-19T06:42:56.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:56 smithi117 ceph-mon[34564]: from='client.? 172.21.15.99:0/1261821179' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:42:56.360 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T06:42:57.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:57 smithi099 ceph-mon[27651]: pgmap v35: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:42:57.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:57 smithi117 ceph-mon[34564]: pgmap v35: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:42:58.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:42:58 smithi117 ceph-mon[34564]: pgmap v36: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:42:58.424 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:42:58 smithi099 ceph-mon[27651]: pgmap v36: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:43:00.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:00.112+0000 7f7730a92640 1 -- 172.21.15.99:0/1160313602 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f772c102f00 msgr2=0x7f772c0fc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:00.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:00.112+0000 7f7730a92640 1 --2- 172.21.15.99:0/1160313602 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f772c102f00 0x7f772c0fc5c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f77140048d0 tx=0x7f7714009da0 comp rx=0 tx=0).stop 2024-09-19T06:43:00.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:00.113+0000 7f7730a92640 1 -- 172.21.15.99:0/1160313602 shutdown_connections 2024-09-19T06:43:00.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:00.113+0000 7f7730a92640 1 --2- 172.21.15.99:0/1160313602 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f772c102f00 0x7f772c0fc5c0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:00.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:00.113+0000 7f7730a92640 1 --2- 172.21.15.99:0/1160313602 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f772c102560 0x7f772c102930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:00.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:00.113+0000 7f7730a92640 1 -- 172.21.15.99:0/1160313602 >> 172.21.15.99:0/1160313602 conn(0x7f772c0f8100 msgr2=0x7f772c0fa510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:00.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:00.113+0000 7f7730a92640 1 -- 172.21.15.99:0/1160313602 shutdown_connections 2024-09-19T06:43:00.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:00.113+0000 7f7730a92640 1 -- 172.21.15.99:0/1160313602 wait complete. 2024-09-19T06:43:00.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:00.113+0000 7f7730a92640 1 Processor -- start 2024-09-19T06:43:00.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:00.113+0000 7f7730a92640 1 -- start start 2024-09-19T06:43:00.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:00.113+0000 7f7730a92640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f772c102560 0x7f772c06fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:00.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:00.113+0000 7f7730a92640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f772c102f00 0x7f772c06ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:00.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:00.114+0000 7f7730a92640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f772c070490 con 0x7f772c102560 2024-09-19T06:43:00.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:00.114+0000 7f7730a92640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f772c070600 con 0x7f772c102f00 2024-09-19T06:43:00.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:00.114+0000 7f772a59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f772c102560 0x7f772c06fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:00.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:00.114+0000 7f772a59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f772c102560 0x7f772c06fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:39904/0 (socket says 172.21.15.99:39904) 2024-09-19T06:43:00.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:00.114+0000 7f772a59c640 1 -- 172.21.15.99:0/3811420577 learned_addr learned my addr 172.21.15.99:0/3811420577 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:43:00.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:00.114+0000 7f7729d9b640 1 --2- 172.21.15.99:0/3811420577 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f772c102f00 0x7f772c06ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:00.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:00.114+0000 7f772a59c640 1 -- 172.21.15.99:0/3811420577 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f772c102f00 msgr2=0x7f772c06ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:00.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:00.114+0000 7f772a59c640 1 --2- 172.21.15.99:0/3811420577 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f772c102f00 0x7f772c06ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:00.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:00.114+0000 7f772a59c640 1 -- 172.21.15.99:0/3811420577 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7714005040 con 0x7f772c102560 2024-09-19T06:43:00.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:00.114+0000 7f7729d9b640 1 --2- 172.21.15.99:0/3811420577 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f772c102f00 0x7f772c06ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:43:00.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:00.114+0000 7f772a59c640 1 --2- 172.21.15.99:0/3811420577 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f772c102560 0x7f772c06fa10 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f771c00cae0 tx=0x7f771c007e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:00.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:00.114+0000 7f7722ffd640 1 -- 172.21.15.99:0/3811420577 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f771c00ab00 con 0x7f772c102560 2024-09-19T06:43:00.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:00.114+0000 7f7722ffd640 1 -- 172.21.15.99:0/3811420577 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f771c00ac60 con 0x7f772c102560 2024-09-19T06:43:00.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:00.114+0000 7f7730a92640 1 -- 172.21.15.99:0/3811420577 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f772c070890 con 0x7f772c102560 2024-09-19T06:43:00.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:00.114+0000 7f7722ffd640 1 -- 172.21.15.99:0/3811420577 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f771c0115e0 con 0x7f772c102560 2024-09-19T06:43:00.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:00.114+0000 7f7730a92640 1 -- 172.21.15.99:0/3811420577 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f772c1198e0 con 0x7f772c102560 2024-09-19T06:43:00.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:00.115+0000 7f7730a92640 1 -- 172.21.15.99:0/3811420577 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f772c0fdce0 con 0x7f772c102560 2024-09-19T06:43:00.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:00.116+0000 7f7722ffd640 1 -- 172.21.15.99:0/3811420577 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 33) v1 ==== 92375+0+0 (secure 0 0 0) 0x7f771c0129e0 con 0x7f772c102560 2024-09-19T06:43:00.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:00.116+0000 7f7722ffd640 1 --2- 172.21.15.99:0/3811420577 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f771806df60 0x7f7718070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:00.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:00.117+0000 7f7722ffd640 1 -- 172.21.15.99:0/3811420577 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f771c08e230 con 0x7f772c102560 2024-09-19T06:43:00.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:00.117+0000 7f7729d9b640 1 --2- 172.21.15.99:0/3811420577 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f771806df60 0x7f7718070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:00.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:00.117+0000 7f7729d9b640 1 --2- 172.21.15.99:0/3811420577 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f771806df60 0x7f7718070410 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7714000c00 tx=0x7f7714035040 comp rx=0 tx=0).ready entity=mgr.14658 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:00.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:00.121+0000 7f7722ffd640 1 -- 172.21.15.99:0/3811420577 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f771c057ab0 con 0x7f772c102560 2024-09-19T06:43:00.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:00 smithi099 ceph-mon[27651]: pgmap v37: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:43:00.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:00.350+0000 7f7730a92640 1 -- 172.21.15.99:0/3811420577 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f772c071100 con 0x7f772c102560 2024-09-19T06:43:00.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:00.351+0000 7f7722ffd640 1 -- 172.21.15.99:0/3811420577 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+747 (secure 0 0 0) 0x7f771c05b170 con 0x7f772c102560 2024-09-19T06:43:00.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:00.353+0000 7f7730a92640 1 -- 172.21.15.99:0/3811420577 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f771806df60 msgr2=0x7f7718070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:00.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:00.353+0000 7f7730a92640 1 --2- 172.21.15.99:0/3811420577 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f771806df60 0x7f7718070410 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7714000c00 tx=0x7f7714035040 comp rx=0 tx=0).stop 2024-09-19T06:43:00.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:00.353+0000 7f7730a92640 1 -- 172.21.15.99:0/3811420577 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f772c102560 msgr2=0x7f772c06fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:00.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:00.353+0000 7f7730a92640 1 --2- 172.21.15.99:0/3811420577 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f772c102560 0x7f772c06fa10 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f771c00cae0 tx=0x7f771c007e50 comp rx=0 tx=0).stop 2024-09-19T06:43:00.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:00.353+0000 7f7730a92640 1 -- 172.21.15.99:0/3811420577 shutdown_connections 2024-09-19T06:43:00.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:00.353+0000 7f7730a92640 1 --2- 172.21.15.99:0/3811420577 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f771806df60 0x7f7718070410 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:00.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:00.353+0000 7f7730a92640 1 --2- 172.21.15.99:0/3811420577 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f772c102f00 0x7f772c06ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:00.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:00.353+0000 7f7730a92640 1 --2- 172.21.15.99:0/3811420577 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f772c102560 0x7f772c06fa10 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:00.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:00.353+0000 7f7730a92640 1 -- 172.21.15.99:0/3811420577 >> 172.21.15.99:0/3811420577 conn(0x7f772c0f8100 msgr2=0x7f772c0f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:00.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:00.353+0000 7f7730a92640 1 -- 172.21.15.99:0/3811420577 shutdown_connections 2024-09-19T06:43:00.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:00.353+0000 7f7730a92640 1 -- 172.21.15.99:0/3811420577 wait complete. 2024-09-19T06:43:00.363 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-09-19T06:43:00.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:00 smithi117 ceph-mon[34564]: pgmap v37: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:43:01.096 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -e sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 -- bash -c 'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '"'"'.up_to_date | length == 2'"'"'' 2024-09-19T06:43:01.345 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T06:43:01.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:01 smithi099 ceph-mon[27651]: from='client.? 172.21.15.99:0/3811420577' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:43:01.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:01 smithi117 ceph-mon[34564]: from='client.? 172.21.15.99:0/3811420577' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:43:02.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:02 smithi099 ceph-mon[27651]: pgmap v38: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:43:02.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:02 smithi117 ceph-mon[34564]: pgmap v38: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:43:03.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:03.016+0000 7fbce3168640 1 -- 172.21.15.99:0/3677677280 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbcdc0fcf80 msgr2=0x7fbcdc0fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:03.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:03.016+0000 7fbce3168640 1 --2- 172.21.15.99:0/3677677280 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbcdc0fcf80 0x7fbcdc0fd3d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fbcc80048d0 tx=0x7fbcc8009da0 comp rx=0 tx=0).stop 2024-09-19T06:43:03.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:03.016+0000 7fbce3168640 1 -- 172.21.15.99:0/3677677280 shutdown_connections 2024-09-19T06:43:03.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:03.016+0000 7fbce3168640 1 --2- 172.21.15.99:0/3677677280 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbcdc0fcf80 0x7fbcdc0fd3d0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:03.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:03.016+0000 7fbce3168640 1 --2- 172.21.15.99:0/3677677280 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbcdc0fb810 0x7fbcdc0fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:03.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:03.016+0000 7fbce3168640 1 -- 172.21.15.99:0/3677677280 >> 172.21.15.99:0/3677677280 conn(0x7fbcdc0723b0 msgr2=0x7fbcdc0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:03.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:03.016+0000 7fbce3168640 1 -- 172.21.15.99:0/3677677280 shutdown_connections 2024-09-19T06:43:03.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:03.016+0000 7fbce3168640 1 -- 172.21.15.99:0/3677677280 wait complete. 2024-09-19T06:43:03.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:03.016+0000 7fbce3168640 1 Processor -- start 2024-09-19T06:43:03.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:03.016+0000 7fbce3168640 1 -- start start 2024-09-19T06:43:03.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:03.017+0000 7fbce3168640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbcdc0fb810 0x7fbcdc113160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:03.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:03.017+0000 7fbce3168640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbcdc0fcf80 0x7fbcdc1136a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:03.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:03.017+0000 7fbce3168640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcdc113ca0 con 0x7fbcdc0fcf80 2024-09-19T06:43:03.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:03.017+0000 7fbce3168640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcdc10d0e0 con 0x7fbcdc0fb810 2024-09-19T06:43:03.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:03.017+0000 7fbcdbfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbcdc0fcf80 0x7fbcdc1136a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:03.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:03.017+0000 7fbcdbfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbcdc0fcf80 0x7fbcdc1136a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:39918/0 (socket says 172.21.15.99:39918) 2024-09-19T06:43:03.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:03.017+0000 7fbcdbfff640 1 -- 172.21.15.99:0/83560429 learned_addr learned my addr 172.21.15.99:0/83560429 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:43:03.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:03.017+0000 7fbce0f04640 1 --2- 172.21.15.99:0/83560429 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbcdc0fb810 0x7fbcdc113160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:03.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:03.017+0000 7fbcdbfff640 1 -- 172.21.15.99:0/83560429 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbcdc0fb810 msgr2=0x7fbcdc113160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:03.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:03.017+0000 7fbcdbfff640 1 --2- 172.21.15.99:0/83560429 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbcdc0fb810 0x7fbcdc113160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:03.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:03.017+0000 7fbcdbfff640 1 -- 172.21.15.99:0/83560429 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcc8005040 con 0x7fbcdc0fcf80 2024-09-19T06:43:03.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:03.017+0000 7fbcdbfff640 1 --2- 172.21.15.99:0/83560429 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbcdc0fcf80 0x7fbcdc1136a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fbcc8003080 tx=0x7fbcc8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:03.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:03.017+0000 7fbcd97fa640 1 -- 172.21.15.99:0/83560429 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbcc8038070 con 0x7fbcdc0fcf80 2024-09-19T06:43:03.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:03.017+0000 7fbcd97fa640 1 -- 172.21.15.99:0/83560429 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fbcc80097e0 con 0x7fbcdc0fcf80 2024-09-19T06:43:03.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:03.017+0000 7fbce3168640 1 -- 172.21.15.99:0/83560429 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcdc10d360 con 0x7fbcdc0fcf80 2024-09-19T06:43:03.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:03.017+0000 7fbcd97fa640 1 -- 172.21.15.99:0/83560429 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbcc803d420 con 0x7fbcdc0fcf80 2024-09-19T06:43:03.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:03.017+0000 7fbce3168640 1 -- 172.21.15.99:0/83560429 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcdc10d8a0 con 0x7fbcdc0fcf80 2024-09-19T06:43:03.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:03.018+0000 7fbce3168640 1 -- 172.21.15.99:0/83560429 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcdc0fcbc0 con 0x7fbcdc0fcf80 2024-09-19T06:43:03.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:03.019+0000 7fbcd97fa640 1 -- 172.21.15.99:0/83560429 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 33) v1 ==== 92375+0+0 (secure 0 0 0) 0x7fbcc8030020 con 0x7fbcdc0fcf80 2024-09-19T06:43:03.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:03.019+0000 7fbcd97fa640 1 --2- 172.21.15.99:0/83560429 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7fbccc06df60 0x7fbccc070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:03.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:03.019+0000 7fbcd97fa640 1 -- 172.21.15.99:0/83560429 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fbcc80adee0 con 0x7fbcdc0fcf80 2024-09-19T06:43:03.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:03.020+0000 7fbce0f04640 1 --2- 172.21.15.99:0/83560429 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7fbccc06df60 0x7fbccc070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:03.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:03.020+0000 7fbce0f04640 1 --2- 172.21.15.99:0/83560429 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7fbccc06df60 0x7fbccc070410 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fbcd0004c40 tx=0x7fbcd0009040 comp rx=0 tx=0).ready entity=mgr.14658 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:03.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:03.024+0000 7fbcd97fa640 1 -- 172.21.15.99:0/83560429 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7fbcc8077760 con 0x7fbcdc0fcf80 2024-09-19T06:43:03.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:03.206+0000 7fbce3168640 1 -- 172.21.15.99:0/83560429 --> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] -- mgr_command(tid 0: {"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961", "target": ["mon-mgr", ""]}) v1 -- 0x7fbcdc10e870 con 0x7fbccc06df60 2024-09-19T06:43:04.188 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:04 smithi099 ceph-mon[27651]: pgmap v39: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:43:04.188 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:04 smithi099 ceph-mon[27651]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:43:04.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:04 smithi117 ceph-mon[34564]: pgmap v39: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:43:04.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:04 smithi117 ceph-mon[34564]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:43:05.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:05.091+0000 7fbcd97fa640 1 -- 172.21.15.99:0/83560429 <== mgr.14658 v2:172.21.15.99:6800/3542536515 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+5108 (secure 0 0 0) 0x7fbcdc10e870 con 0x7fbccc06df60 2024-09-19T06:43:05.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:05.094+0000 7fbce3168640 1 -- 172.21.15.99:0/83560429 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7fbccc06df60 msgr2=0x7fbccc070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:05.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:05.094+0000 7fbce3168640 1 --2- 172.21.15.99:0/83560429 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7fbccc06df60 0x7fbccc070410 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fbcd0004c40 tx=0x7fbcd0009040 comp rx=0 tx=0).stop 2024-09-19T06:43:05.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:05.094+0000 7fbce3168640 1 -- 172.21.15.99:0/83560429 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbcdc0fcf80 msgr2=0x7fbcdc1136a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:05.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:05.094+0000 7fbce3168640 1 --2- 172.21.15.99:0/83560429 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbcdc0fcf80 0x7fbcdc1136a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fbcc8003080 tx=0x7fbcc8009da0 comp rx=0 tx=0).stop 2024-09-19T06:43:05.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:05.094+0000 7fbce3168640 1 -- 172.21.15.99:0/83560429 shutdown_connections 2024-09-19T06:43:05.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:05.094+0000 7fbce3168640 1 --2- 172.21.15.99:0/83560429 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7fbccc06df60 0x7fbccc070410 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:05.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:05.094+0000 7fbce3168640 1 --2- 172.21.15.99:0/83560429 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbcdc0fcf80 0x7fbcdc1136a0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:05.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:05.094+0000 7fbce3168640 1 --2- 172.21.15.99:0/83560429 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbcdc0fb810 0x7fbcdc113160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:05.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:05.094+0000 7fbce3168640 1 -- 172.21.15.99:0/83560429 >> 172.21.15.99:0/83560429 conn(0x7fbcdc0723b0 msgr2=0x7fbcdc065810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:05.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:05.094+0000 7fbce3168640 1 -- 172.21.15.99:0/83560429 shutdown_connections 2024-09-19T06:43:05.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:05.094+0000 7fbce3168640 1 -- 172.21.15.99:0/83560429 wait complete. 2024-09-19T06:43:05.105 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-09-19T06:43:05.664 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -e sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 -- bash -c 'ceph orch ps' 2024-09-19T06:43:05.910 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T06:43:06.281 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:06 smithi099 ceph-mon[27651]: pgmap v40: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:43:06.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:06 smithi117 ceph-mon[34564]: pgmap v40: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:43:07.393 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:07 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:43:07.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:07 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:43:07.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:07.610+0000 7fe78e8d9640 1 -- 172.21.15.99:0/3743965260 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe788102620 msgr2=0x7fe7881029f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:07.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:07.610+0000 7fe78e8d9640 1 --2- 172.21.15.99:0/3743965260 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe788102620 0x7fe7881029f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fe7780048d0 tx=0x7fe778009da0 comp rx=0 tx=0).stop 2024-09-19T06:43:07.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:07.610+0000 7fe78e8d9640 1 -- 172.21.15.99:0/3743965260 shutdown_connections 2024-09-19T06:43:07.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:07.610+0000 7fe78e8d9640 1 --2- 172.21.15.99:0/3743965260 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe788102fc0 0x7fe7880facf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:07.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:07.610+0000 7fe78e8d9640 1 --2- 172.21.15.99:0/3743965260 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe788102620 0x7fe7881029f0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:07.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:07.610+0000 7fe78e8d9640 1 -- 172.21.15.99:0/3743965260 >> 172.21.15.99:0/3743965260 conn(0x7fe788070d50 msgr2=0x7fe788071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:07.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:07.610+0000 7fe78e8d9640 1 -- 172.21.15.99:0/3743965260 shutdown_connections 2024-09-19T06:43:07.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:07.610+0000 7fe78e8d9640 1 -- 172.21.15.99:0/3743965260 wait complete. 2024-09-19T06:43:07.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:07.611+0000 7fe78e8d9640 1 Processor -- start 2024-09-19T06:43:07.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:07.611+0000 7fe78e8d9640 1 -- start start 2024-09-19T06:43:07.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:07.611+0000 7fe78e8d9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe788102620 0x7fe788113280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:07.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:07.611+0000 7fe78e8d9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe788102fc0 0x7fe7881137c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:07.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:07.611+0000 7fe78e8d9640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe788113e50 con 0x7fe788102620 2024-09-19T06:43:07.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:07.611+0000 7fe78e8d9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe78810d200 con 0x7fe788102fc0 2024-09-19T06:43:07.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:07.611+0000 7fe787fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe788102620 0x7fe788113280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:07.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:07.611+0000 7fe787fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe788102620 0x7fe788113280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34234/0 (socket says 172.21.15.99:34234) 2024-09-19T06:43:07.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:07.611+0000 7fe787fff640 1 -- 172.21.15.99:0/309510407 learned_addr learned my addr 172.21.15.99:0/309510407 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:43:07.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:07.611+0000 7fe77ffff640 1 --2- 172.21.15.99:0/309510407 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe788102fc0 0x7fe7881137c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:07.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:07.612+0000 7fe787fff640 1 -- 172.21.15.99:0/309510407 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe788102fc0 msgr2=0x7fe7881137c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:07.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:07.612+0000 7fe787fff640 1 --2- 172.21.15.99:0/309510407 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe788102fc0 0x7fe7881137c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:07.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:07.612+0000 7fe787fff640 1 -- 172.21.15.99:0/309510407 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe778005040 con 0x7fe788102620 2024-09-19T06:43:07.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:07.612+0000 7fe787fff640 1 --2- 172.21.15.99:0/309510407 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe788102620 0x7fe788113280 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fe778000c00 tx=0x7fe778009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:07.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:07.612+0000 7fe7857fa640 1 -- 172.21.15.99:0/309510407 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe778038070 con 0x7fe788102620 2024-09-19T06:43:07.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:07.612+0000 7fe7857fa640 1 -- 172.21.15.99:0/309510407 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe77803daf0 con 0x7fe788102620 2024-09-19T06:43:07.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:07.612+0000 7fe7857fa640 1 -- 172.21.15.99:0/309510407 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe778033b20 con 0x7fe788102620 2024-09-19T06:43:07.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:07.612+0000 7fe78e8d9640 1 -- 172.21.15.99:0/309510407 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe78810d480 con 0x7fe788102620 2024-09-19T06:43:07.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:07.612+0000 7fe78e8d9640 1 -- 172.21.15.99:0/309510407 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe78810d9a0 con 0x7fe788102620 2024-09-19T06:43:07.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:07.613+0000 7fe78e8d9640 1 -- 172.21.15.99:0/309510407 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7880657c0 con 0x7fe788102620 2024-09-19T06:43:07.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:07.613+0000 7fe7857fa640 1 -- 172.21.15.99:0/309510407 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 33) v1 ==== 92375+0+0 (secure 0 0 0) 0x7fe778030020 con 0x7fe788102620 2024-09-19T06:43:07.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:07.614+0000 7fe7857fa640 1 --2- 172.21.15.99:0/309510407 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7fe77406df60 0x7fe774070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:07.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:07.614+0000 7fe7857fa640 1 -- 172.21.15.99:0/309510407 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fe7780ada80 con 0x7fe788102620 2024-09-19T06:43:07.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:07.614+0000 7fe77ffff640 1 --2- 172.21.15.99:0/309510407 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7fe77406df60 0x7fe774070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:07.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:07.614+0000 7fe77ffff640 1 --2- 172.21.15.99:0/309510407 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7fe77406df60 0x7fe774070410 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe78810eb40 tx=0x7fe770009120 comp rx=0 tx=0).ready entity=mgr.14658 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:07.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:07.618+0000 7fe7857fa640 1 -- 172.21.15.99:0/309510407 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7fe778077300 con 0x7fe788102620 2024-09-19T06:43:07.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:07.793+0000 7fe78e8d9640 1 -- 172.21.15.99:0/309510407 --> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe78810e8f0 con 0x7fe77406df60 2024-09-19T06:43:07.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:07.802+0000 7fe7857fa640 1 -- 172.21.15.99:0/309510407 <== mgr.14658 v2:172.21.15.99:6800/3542536515 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fe78810e8f0 con 0x7fe77406df60 2024-09-19T06:43:07.804 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T06:43:07.804 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.smithi099 smithi099 *:9093,9094 running (2m) 29s ago 10m 17.3M - 0.25.0 c8568f914cd2 e7c1774d56b0 2024-09-19T06:43:07.804 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi099 smithi099 running (10m) 29s ago 10m 6895k - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 216ce2ef7f1e 2024-09-19T06:43:07.804 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi117 smithi117 running (9m) 52s ago 9m 6899k - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 b4c328bdec52 2024-09-19T06:43:07.804 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.smithi099 smithi099 *:3000 running (35s) 29s ago 10m 47.9M - 9.4.12 2bacad6d85d8 cd53a18d5410 2024-09-19T06:43:07.804 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.obarqf smithi099 running (5m) 29s ago 5m 12.7M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 e36c9b74004b 2024-09-19T06:43:07.805 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.xehbxe smithi099 running (5m) 29s ago 5m 121M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 d09eb3d306ae 2024-09-19T06:43:07.805 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.bheqzh smithi117 running (5m) 52s ago 5m 14.2M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 21253e27fdd3 2024-09-19T06:43:07.805 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.nooexo smithi117 running (5m) 52s ago 5m 109M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 ad1faeb3343c 2024-09-19T06:43:07.805 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi099.pgvkqi smithi099 *:8443,9283,8765 running (94s) 29s ago 11m 497M - 19.1.1-361-g2f599a46 d2baa855c067 d5de99cb7e78 2024-09-19T06:43:07.805 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi117.ssmkcf smithi117 *:8443,9283,8765 running (55s) 52s ago 9m 69.0M - 19.1.1-361-g2f599a46 d2baa855c067 8b7ee0f871f5 2024-09-19T06:43:07.806 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi099 smithi099 running (11m) 29s ago 11m 58.8M 2048M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 7375c241d067 2024-09-19T06:43:07.806 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi117 smithi117 running (9m) 52s ago 9m 42.7M 2048M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 bd4854d5213e 2024-09-19T06:43:07.806 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi099 smithi099 *:9100 running (2m) 29s ago 10m 8296k - 1.5.0 0da6a335fe13 dca7b4517dcc 2024-09-19T06:43:07.806 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi117 smithi117 *:9100 running (105s) 52s ago 9m 15.8M - 1.5.0 0da6a335fe13 8233ce3835d2 2024-09-19T06:43:07.806 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (8m) 29s ago 8m 217M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 cf8d3dd4a987 2024-09-19T06:43:07.806 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (8m) 29s ago 8m 236M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 bc5b04b8bf9f 2024-09-19T06:43:07.806 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (8m) 29s ago 7m 200M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 cedc7e3698d8 2024-09-19T06:43:07.806 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi117 running (7m) 52s ago 7m 259M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 5984ed999c91 2024-09-19T06:43:07.807 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi117 running (7m) 52s ago 7m 230M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 6a2fc0c51c05 2024-09-19T06:43:07.807 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi117 running (6m) 52s ago 6m 225M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 39dcb7dbf0e3 2024-09-19T06:43:07.807 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.smithi099 smithi099 *:9095 running (60s) 29s ago 10m 48.8M - 2.43.0 a07b618ecd1d 15ad26ec6fb4 2024-09-19T06:43:07.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:07.804+0000 7fe78e8d9640 1 -- 172.21.15.99:0/309510407 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7fe77406df60 msgr2=0x7fe774070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:07.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:07.804+0000 7fe78e8d9640 1 --2- 172.21.15.99:0/309510407 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7fe77406df60 0x7fe774070410 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe78810eb40 tx=0x7fe770009120 comp rx=0 tx=0).stop 2024-09-19T06:43:07.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:07.804+0000 7fe78e8d9640 1 -- 172.21.15.99:0/309510407 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe788102620 msgr2=0x7fe788113280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:07.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:07.804+0000 7fe78e8d9640 1 --2- 172.21.15.99:0/309510407 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe788102620 0x7fe788113280 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fe778000c00 tx=0x7fe778009da0 comp rx=0 tx=0).stop 2024-09-19T06:43:07.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:07.804+0000 7fe78e8d9640 1 -- 172.21.15.99:0/309510407 shutdown_connections 2024-09-19T06:43:07.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:07.804+0000 7fe78e8d9640 1 --2- 172.21.15.99:0/309510407 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7fe77406df60 0x7fe774070410 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:07.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:07.804+0000 7fe78e8d9640 1 --2- 172.21.15.99:0/309510407 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe788102fc0 0x7fe7881137c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:07.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:07.804+0000 7fe78e8d9640 1 --2- 172.21.15.99:0/309510407 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe788102620 0x7fe788113280 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:07.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:07.804+0000 7fe78e8d9640 1 -- 172.21.15.99:0/309510407 >> 172.21.15.99:0/309510407 conn(0x7fe788070d50 msgr2=0x7fe7880fa180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:07.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:07.804+0000 7fe78e8d9640 1 -- 172.21.15.99:0/309510407 shutdown_connections 2024-09-19T06:43:07.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:07.804+0000 7fe78e8d9640 1 -- 172.21.15.99:0/309510407 wait complete. 2024-09-19T06:43:08.394 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-19T06:43:08.395 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi099.front.sepia.ceph.com 2024-09-19T06:43:08.395 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -e sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs true' 2024-09-19T06:43:08.417 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:08 smithi099 ceph-mon[27651]: pgmap v41: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:43:08.417 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:08 smithi099 ceph-mon[27651]: from='client.14752 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:43:08.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:08 smithi117 ceph-mon[34564]: pgmap v41: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:43:08.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:08 smithi117 ceph-mon[34564]: from='client.14752 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:43:08.637 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T06:43:10.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:10.277+0000 7f334c25a640 1 -- 172.21.15.99:0/837885203 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3344102ed0 msgr2=0x7f33440fc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:10.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:10.277+0000 7f334c25a640 1 --2- 172.21.15.99:0/837885203 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3344102ed0 0x7f33440fc590 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f33380048d0 tx=0x7f3338009da0 comp rx=0 tx=0).stop 2024-09-19T06:43:10.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:10.277+0000 7f334c25a640 1 -- 172.21.15.99:0/837885203 shutdown_connections 2024-09-19T06:43:10.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:10.277+0000 7f334c25a640 1 --2- 172.21.15.99:0/837885203 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3344102ed0 0x7f33440fc590 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:10.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:10.277+0000 7f334c25a640 1 --2- 172.21.15.99:0/837885203 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3344102530 0x7f3344102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:10.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:10.277+0000 7f334c25a640 1 -- 172.21.15.99:0/837885203 >> 172.21.15.99:0/837885203 conn(0x7f33440f80f0 msgr2=0x7f33440fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:10.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:10.277+0000 7f334c25a640 1 -- 172.21.15.99:0/837885203 shutdown_connections 2024-09-19T06:43:10.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:10.277+0000 7f334c25a640 1 -- 172.21.15.99:0/837885203 wait complete. 2024-09-19T06:43:10.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:10.277+0000 7f334c25a640 1 Processor -- start 2024-09-19T06:43:10.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:10.278+0000 7f334c25a640 1 -- start start 2024-09-19T06:43:10.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:10.278+0000 7f334c25a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3344102530 0x7f33441132b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:10.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:10.278+0000 7f334c25a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3344102ed0 0x7f33441137f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:10.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:10.278+0000 7f334c25a640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3344113e80 con 0x7f3344102ed0 2024-09-19T06:43:10.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:10.278+0000 7f334c25a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f334410d230 con 0x7f3344102530 2024-09-19T06:43:10.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:10.278+0000 7f33497f5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3344102ed0 0x7f33441137f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:10.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:10.278+0000 7f33497f5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3344102ed0 0x7f33441137f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34256/0 (socket says 172.21.15.99:34256) 2024-09-19T06:43:10.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:10.278+0000 7f33497f5640 1 -- 172.21.15.99:0/3595405558 learned_addr learned my addr 172.21.15.99:0/3595405558 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:43:10.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:10.278+0000 7f33497f5640 1 -- 172.21.15.99:0/3595405558 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3344102530 msgr2=0x7f33441132b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:10.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:10.278+0000 7f3349ff6640 1 --2- 172.21.15.99:0/3595405558 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3344102530 0x7f33441132b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:10.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:10.278+0000 7f33497f5640 1 --2- 172.21.15.99:0/3595405558 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3344102530 0x7f33441132b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:10.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:10.278+0000 7f33497f5640 1 -- 172.21.15.99:0/3595405558 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3338005040 con 0x7f3344102ed0 2024-09-19T06:43:10.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:10.278+0000 7f33497f5640 1 --2- 172.21.15.99:0/3595405558 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3344102ed0 0x7f33441137f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3338003080 tx=0x7f3338009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:10.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:10.278+0000 7f33367fc640 1 -- 172.21.15.99:0/3595405558 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3338038070 con 0x7f3344102ed0 2024-09-19T06:43:10.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:10.278+0000 7f33367fc640 1 -- 172.21.15.99:0/3595405558 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3338009760 con 0x7f3344102ed0 2024-09-19T06:43:10.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:10.278+0000 7f334c25a640 1 -- 172.21.15.99:0/3595405558 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f334410d4b0 con 0x7f3344102ed0 2024-09-19T06:43:10.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:10.278+0000 7f33367fc640 1 -- 172.21.15.99:0/3595405558 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3338033420 con 0x7f3344102ed0 2024-09-19T06:43:10.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:10.278+0000 7f334c25a640 1 -- 172.21.15.99:0/3595405558 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f334410d910 con 0x7f3344102ed0 2024-09-19T06:43:10.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:10.280+0000 7f334c25a640 1 -- 172.21.15.99:0/3595405558 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33440fdcb0 con 0x7f3344102ed0 2024-09-19T06:43:10.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:10.280+0000 7f33367fc640 1 -- 172.21.15.99:0/3595405558 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 33) v1 ==== 92375+0+0 (secure 0 0 0) 0x7f3338030020 con 0x7f3344102ed0 2024-09-19T06:43:10.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:10.280+0000 7f33367fc640 1 --2- 172.21.15.99:0/3595405558 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f333006df60 0x7f3330070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:10.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:10.280+0000 7f33367fc640 1 -- 172.21.15.99:0/3595405558 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f33380ad580 con 0x7f3344102ed0 2024-09-19T06:43:10.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:10.280+0000 7f3349ff6640 1 --2- 172.21.15.99:0/3595405558 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f333006df60 0x7f3330070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:10.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:10.281+0000 7f3349ff6640 1 --2- 172.21.15.99:0/3595405558 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f333006df60 0x7f3330070410 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f334000a900 tx=0x7f3340008040 comp rx=0 tx=0).ready entity=mgr.14658 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:10.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:10.285+0000 7f33367fc640 1 -- 172.21.15.99:0/3595405558 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f3338076e80 con 0x7f3344102ed0 2024-09-19T06:43:10.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:10.453+0000 7f334c25a640 1 -- 172.21.15.99:0/3595405558 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7f3344109620 con 0x7f3344102ed0 2024-09-19T06:43:10.454 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:10 smithi099 ceph-mon[27651]: pgmap v42: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:43:10.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:10.457+0000 7f33367fc640 1 -- 172.21.15.99:0/3595405558 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=0 v47)=0 v47) v1 ==== 125+0+0 (secure 0 0 0) 0x7f333807a540 con 0x7f3344102ed0 2024-09-19T06:43:10.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:10.459+0000 7f334c25a640 1 -- 172.21.15.99:0/3595405558 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f333006df60 msgr2=0x7f3330070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:10.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:10.459+0000 7f334c25a640 1 --2- 172.21.15.99:0/3595405558 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f333006df60 0x7f3330070410 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f334000a900 tx=0x7f3340008040 comp rx=0 tx=0).stop 2024-09-19T06:43:10.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:10.459+0000 7f334c25a640 1 -- 172.21.15.99:0/3595405558 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3344102ed0 msgr2=0x7f33441137f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:10.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:10.459+0000 7f334c25a640 1 --2- 172.21.15.99:0/3595405558 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3344102ed0 0x7f33441137f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3338003080 tx=0x7f3338009da0 comp rx=0 tx=0).stop 2024-09-19T06:43:10.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:10.460+0000 7f334c25a640 1 -- 172.21.15.99:0/3595405558 shutdown_connections 2024-09-19T06:43:10.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:10.460+0000 7f334c25a640 1 --2- 172.21.15.99:0/3595405558 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f333006df60 0x7f3330070410 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:10.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:10.460+0000 7f334c25a640 1 --2- 172.21.15.99:0/3595405558 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3344102ed0 0x7f33441137f0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:10.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:10.460+0000 7f334c25a640 1 --2- 172.21.15.99:0/3595405558 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3344102530 0x7f33441132b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:10.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:10.460+0000 7f334c25a640 1 -- 172.21.15.99:0/3595405558 >> 172.21.15.99:0/3595405558 conn(0x7f33440f80f0 msgr2=0x7f33440f9130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:10.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:10.460+0000 7f334c25a640 1 -- 172.21.15.99:0/3595405558 shutdown_connections 2024-09-19T06:43:10.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:10.460+0000 7f334c25a640 1 -- 172.21.15.99:0/3595405558 wait complete. 2024-09-19T06:43:10.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:10 smithi117 ceph-mon[34564]: pgmap v42: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:43:11.110 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-19T06:43:11.111 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi099.front.sepia.ceph.com 2024-09-19T06:43:11.111 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -e sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-09-19T06:43:11.397 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T06:43:11.783 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:11 smithi099 ceph-mon[27651]: from='client.? 172.21.15.99:0/3595405558' entity='client.admin' 2024-09-19T06:43:11.784 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:11 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:43:11.784 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:11 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:43:11.784 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:11 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:43:11.784 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:11 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:43:11.784 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:11 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:43:11.784 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:11 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:43:11.811 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:11 smithi117 ceph-mon[34564]: from='client.? 172.21.15.99:0/3595405558' entity='client.admin' 2024-09-19T06:43:11.811 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:11 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:43:11.811 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:11 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:43:11.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:11 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:43:11.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:11 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:43:11.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:11 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:43:11.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:11 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:43:12.898 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:12 smithi099 ceph-mon[27651]: pgmap v43: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:43:13.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:12 smithi117 ceph-mon[34564]: pgmap v43: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:43:13.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:13.118+0000 7f5be2968640 1 -- 172.21.15.99:0/1676576658 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5bdc102ef0 msgr2=0x7f5bdc0fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:13.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:13.118+0000 7f5be2968640 1 --2- 172.21.15.99:0/1676576658 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5bdc102ef0 0x7f5bdc0fc5b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5bc40048d0 tx=0x7f5bc4009da0 comp rx=0 tx=0).stop 2024-09-19T06:43:13.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:13.118+0000 7f5be2968640 1 -- 172.21.15.99:0/1676576658 shutdown_connections 2024-09-19T06:43:13.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:13.118+0000 7f5be2968640 1 --2- 172.21.15.99:0/1676576658 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5bdc102ef0 0x7f5bdc0fc5b0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:13.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:13.118+0000 7f5be2968640 1 --2- 172.21.15.99:0/1676576658 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5bdc102550 0x7f5bdc102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:13.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:13.118+0000 7f5be2968640 1 -- 172.21.15.99:0/1676576658 >> 172.21.15.99:0/1676576658 conn(0x7f5bdc0f80f0 msgr2=0x7f5bdc0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:13.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:13.118+0000 7f5be2968640 1 -- 172.21.15.99:0/1676576658 shutdown_connections 2024-09-19T06:43:13.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:13.118+0000 7f5be2968640 1 -- 172.21.15.99:0/1676576658 wait complete. 2024-09-19T06:43:13.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:13.119+0000 7f5be2968640 1 Processor -- start 2024-09-19T06:43:13.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:13.119+0000 7f5be2968640 1 -- start start 2024-09-19T06:43:13.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:13.119+0000 7f5be2968640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5bdc102550 0x7f5bdc113590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:13.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:13.119+0000 7f5be2968640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5bdc102ef0 0x7f5bdc113ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:13.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:13.119+0000 7f5be2968640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bdc114120 con 0x7f5bdc102550 2024-09-19T06:43:13.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:13.119+0000 7f5be2968640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bdc10d530 con 0x7f5bdc102ef0 2024-09-19T06:43:13.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:13.119+0000 7f5bdbfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5bdc102550 0x7f5bdc113590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:13.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:13.119+0000 7f5bdbfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5bdc102550 0x7f5bdc113590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34266/0 (socket says 172.21.15.99:34266) 2024-09-19T06:43:13.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:13.119+0000 7f5bdbfff640 1 -- 172.21.15.99:0/2736511617 learned_addr learned my addr 172.21.15.99:0/2736511617 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:43:13.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:13.119+0000 7f5bd3fff640 1 --2- 172.21.15.99:0/2736511617 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5bdc102ef0 0x7f5bdc113ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:13.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:13.120+0000 7f5bdbfff640 1 -- 172.21.15.99:0/2736511617 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5bdc102ef0 msgr2=0x7f5bdc113ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:13.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:13.120+0000 7f5bdbfff640 1 --2- 172.21.15.99:0/2736511617 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5bdc102ef0 0x7f5bdc113ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:13.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:13.120+0000 7f5bdbfff640 1 -- 172.21.15.99:0/2736511617 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bc4005040 con 0x7f5bdc102550 2024-09-19T06:43:13.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:13.120+0000 7f5bd3fff640 1 --2- 172.21.15.99:0/2736511617 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5bdc102ef0 0x7f5bdc113ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:43:13.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:13.120+0000 7f5bdbfff640 1 --2- 172.21.15.99:0/2736511617 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5bdc102550 0x7f5bdc113590 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc002a50 tx=0x7f5bcc004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:13.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:13.120+0000 7f5bd97fa640 1 -- 172.21.15.99:0/2736511617 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5bcc007c30 con 0x7f5bdc102550 2024-09-19T06:43:13.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:13.120+0000 7f5bd97fa640 1 -- 172.21.15.99:0/2736511617 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5bcc00f040 con 0x7f5bdc102550 2024-09-19T06:43:13.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:13.120+0000 7f5be2968640 1 -- 172.21.15.99:0/2736511617 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bdc10d810 con 0x7f5bdc102550 2024-09-19T06:43:13.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:13.120+0000 7f5bd97fa640 1 -- 172.21.15.99:0/2736511617 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5bcc00da90 con 0x7f5bdc102550 2024-09-19T06:43:13.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:13.120+0000 7f5be2968640 1 -- 172.21.15.99:0/2736511617 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bdc10dd80 con 0x7f5bdc102550 2024-09-19T06:43:13.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:13.121+0000 7f5be2968640 1 -- 172.21.15.99:0/2736511617 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bdc0fdcd0 con 0x7f5bdc102550 2024-09-19T06:43:13.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:13.121+0000 7f5bd97fa640 1 -- 172.21.15.99:0/2736511617 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 33) v1 ==== 92375+0+0 (secure 0 0 0) 0x7f5bcc00dd00 con 0x7f5bdc102550 2024-09-19T06:43:13.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:13.122+0000 7f5bd97fa640 1 --2- 172.21.15.99:0/2736511617 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f5bc806df60 0x7f5bc8070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:13.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:13.122+0000 7f5bd3fff640 1 --2- 172.21.15.99:0/2736511617 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f5bc806df60 0x7f5bc8070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:13.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:13.122+0000 7f5bd97fa640 1 -- 172.21.15.99:0/2736511617 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f5bcc08d340 con 0x7f5bdc102550 2024-09-19T06:43:13.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:13.123+0000 7f5bd3fff640 1 --2- 172.21.15.99:0/2736511617 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f5bc806df60 0x7f5bc8070410 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5bc4000c00 tx=0x7f5bc4035040 comp rx=0 tx=0).ready entity=mgr.14658 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:13.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:13.127+0000 7f5bd97fa640 1 -- 172.21.15.99:0/2736511617 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f5bcc056ab0 con 0x7f5bdc102550 2024-09-19T06:43:13.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:13.292+0000 7f5be2968640 1 -- 172.21.15.99:0/2736511617 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f5bdc04b750 con 0x7f5bdc102550 2024-09-19T06:43:13.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:13.293+0000 7f5bd97fa640 1 -- 172.21.15.99:0/2736511617 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v47)=0 v47) v1 ==== 155+0+0 (secure 0 0 0) 0x7f5bcc05a170 con 0x7f5bdc102550 2024-09-19T06:43:13.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:13.295+0000 7f5be2968640 1 -- 172.21.15.99:0/2736511617 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f5bc806df60 msgr2=0x7f5bc8070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:13.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:13.295+0000 7f5be2968640 1 --2- 172.21.15.99:0/2736511617 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f5bc806df60 0x7f5bc8070410 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5bc4000c00 tx=0x7f5bc4035040 comp rx=0 tx=0).stop 2024-09-19T06:43:13.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:13.295+0000 7f5be2968640 1 -- 172.21.15.99:0/2736511617 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5bdc102550 msgr2=0x7f5bdc113590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:13.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:13.295+0000 7f5be2968640 1 --2- 172.21.15.99:0/2736511617 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5bdc102550 0x7f5bdc113590 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc002a50 tx=0x7f5bcc004600 comp rx=0 tx=0).stop 2024-09-19T06:43:13.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:13.295+0000 7f5be2968640 1 -- 172.21.15.99:0/2736511617 shutdown_connections 2024-09-19T06:43:13.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:13.295+0000 7f5be2968640 1 --2- 172.21.15.99:0/2736511617 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f5bc806df60 0x7f5bc8070410 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:13.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:13.295+0000 7f5be2968640 1 --2- 172.21.15.99:0/2736511617 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5bdc102ef0 0x7f5bdc113ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:13.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:13.295+0000 7f5be2968640 1 --2- 172.21.15.99:0/2736511617 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5bdc102550 0x7f5bdc113590 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:13.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:13.295+0000 7f5be2968640 1 -- 172.21.15.99:0/2736511617 >> 172.21.15.99:0/2736511617 conn(0x7f5bdc0f80f0 msgr2=0x7f5bdc0f91b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:13.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:13.295+0000 7f5be2968640 1 -- 172.21.15.99:0/2736511617 shutdown_connections 2024-09-19T06:43:13.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:13.295+0000 7f5be2968640 1 -- 172.21.15.99:0/2736511617 wait complete. 2024-09-19T06:43:13.996 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -e sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-09-19T06:43:14.242 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T06:43:14.786 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:14 smithi099 ceph-mon[27651]: pgmap v44: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:43:15.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:14 smithi117 ceph-mon[34564]: pgmap v44: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:43:15.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:15.834+0000 7f30d2117640 1 -- 172.21.15.99:0/662395613 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f30cc102ef0 msgr2=0x7f30cc0fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:15.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:15.834+0000 7f30d2117640 1 --2- 172.21.15.99:0/662395613 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f30cc102ef0 0x7f30cc0fc5b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f30b40048d0 tx=0x7f30b4009da0 comp rx=0 tx=0).stop 2024-09-19T06:43:15.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:15.834+0000 7f30d2117640 1 -- 172.21.15.99:0/662395613 shutdown_connections 2024-09-19T06:43:15.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:15.834+0000 7f30d2117640 1 --2- 172.21.15.99:0/662395613 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f30cc102ef0 0x7f30cc0fc5b0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:15.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:15.834+0000 7f30d2117640 1 --2- 172.21.15.99:0/662395613 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30cc102550 0x7f30cc102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:15.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:15.834+0000 7f30d2117640 1 -- 172.21.15.99:0/662395613 >> 172.21.15.99:0/662395613 conn(0x7f30cc0f80f0 msgr2=0x7f30cc0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:15.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:15.834+0000 7f30d2117640 1 -- 172.21.15.99:0/662395613 shutdown_connections 2024-09-19T06:43:15.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:15.834+0000 7f30d2117640 1 -- 172.21.15.99:0/662395613 wait complete. 2024-09-19T06:43:15.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:15.834+0000 7f30d2117640 1 Processor -- start 2024-09-19T06:43:15.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:15.835+0000 7f30d2117640 1 -- start start 2024-09-19T06:43:15.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:15.835+0000 7f30d2117640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f30cc102550 0x7f30cc113590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:15.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:15.835+0000 7f30d2117640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30cc102ef0 0x7f30cc113ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:15.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:15.835+0000 7f30d2117640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30cc114120 con 0x7f30cc102550 2024-09-19T06:43:15.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:15.835+0000 7f30d2117640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30cc10d530 con 0x7f30cc102ef0 2024-09-19T06:43:15.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:15.835+0000 7f30cb7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f30cc102550 0x7f30cc113590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:15.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:15.835+0000 7f30cb7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f30cc102550 0x7f30cc113590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41072/0 (socket says 172.21.15.99:41072) 2024-09-19T06:43:15.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:15.835+0000 7f30cb7fe640 1 -- 172.21.15.99:0/599541201 learned_addr learned my addr 172.21.15.99:0/599541201 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:43:15.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:15.835+0000 7f30caffd640 1 --2- 172.21.15.99:0/599541201 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30cc102ef0 0x7f30cc113ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:15.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:15.835+0000 7f30cb7fe640 1 -- 172.21.15.99:0/599541201 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30cc102ef0 msgr2=0x7f30cc113ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:15.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:15.835+0000 7f30cb7fe640 1 --2- 172.21.15.99:0/599541201 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30cc102ef0 0x7f30cc113ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:15.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:15.835+0000 7f30cb7fe640 1 -- 172.21.15.99:0/599541201 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30b4005040 con 0x7f30cc102550 2024-09-19T06:43:15.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:15.835+0000 7f30caffd640 1 --2- 172.21.15.99:0/599541201 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30cc102ef0 0x7f30cc113ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:43:15.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:15.835+0000 7f30cb7fe640 1 --2- 172.21.15.99:0/599541201 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f30cc102550 0x7f30cc113590 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f30bc00db00 tx=0x7f30bc004e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:15.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:15.835+0000 7f30c3fff640 1 -- 172.21.15.99:0/599541201 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30bc017070 con 0x7f30cc102550 2024-09-19T06:43:15.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:15.835+0000 7f30d2117640 1 -- 172.21.15.99:0/599541201 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30cc10d810 con 0x7f30cc102550 2024-09-19T06:43:15.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:15.835+0000 7f30c3fff640 1 -- 172.21.15.99:0/599541201 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f30bc00f040 con 0x7f30cc102550 2024-09-19T06:43:15.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:15.835+0000 7f30c3fff640 1 -- 172.21.15.99:0/599541201 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30bc003940 con 0x7f30cc102550 2024-09-19T06:43:15.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:15.836+0000 7f30d2117640 1 -- 172.21.15.99:0/599541201 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30cc10dd80 con 0x7f30cc102550 2024-09-19T06:43:15.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:15.836+0000 7f30d2117640 1 -- 172.21.15.99:0/599541201 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30cc0fdcd0 con 0x7f30cc102550 2024-09-19T06:43:15.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:15.837+0000 7f30c3fff640 1 -- 172.21.15.99:0/599541201 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 33) v1 ==== 92375+0+0 (secure 0 0 0) 0x7f30bc003b70 con 0x7f30cc102550 2024-09-19T06:43:15.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:15.838+0000 7f30c3fff640 1 --2- 172.21.15.99:0/599541201 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f30b806df60 0x7f30b8070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:15.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:15.838+0000 7f30c3fff640 1 -- 172.21.15.99:0/599541201 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f30bc08dc00 con 0x7f30cc102550 2024-09-19T06:43:15.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:15.838+0000 7f30caffd640 1 --2- 172.21.15.99:0/599541201 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f30b806df60 0x7f30b8070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:15.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:15.838+0000 7f30caffd640 1 --2- 172.21.15.99:0/599541201 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f30b806df60 0x7f30b8070410 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f30b4000c00 tx=0x7f30b4035040 comp rx=0 tx=0).ready entity=mgr.14658 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:15.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:15.842+0000 7f30c3fff640 1 -- 172.21.15.99:0/599541201 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f30bc05ae40 con 0x7f30cc102550 2024-09-19T06:43:16.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:16.009+0000 7f30d2117640 1 -- 172.21.15.99:0/599541201 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f30cc04b720 con 0x7f30cc102550 2024-09-19T06:43:16.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:16.009+0000 7f30c3fff640 1 -- 172.21.15.99:0/599541201 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v47)=0 v47) v1 ==== 163+0+0 (secure 0 0 0) 0x7f30bc003e20 con 0x7f30cc102550 2024-09-19T06:43:16.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:16.011+0000 7f30d2117640 1 -- 172.21.15.99:0/599541201 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f30b806df60 msgr2=0x7f30b8070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:16.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:16.011+0000 7f30d2117640 1 --2- 172.21.15.99:0/599541201 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f30b806df60 0x7f30b8070410 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f30b4000c00 tx=0x7f30b4035040 comp rx=0 tx=0).stop 2024-09-19T06:43:16.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:16.011+0000 7f30d2117640 1 -- 172.21.15.99:0/599541201 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f30cc102550 msgr2=0x7f30cc113590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:16.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:16.011+0000 7f30d2117640 1 --2- 172.21.15.99:0/599541201 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f30cc102550 0x7f30cc113590 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f30bc00db00 tx=0x7f30bc004e60 comp rx=0 tx=0).stop 2024-09-19T06:43:16.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:16.011+0000 7f30d2117640 1 -- 172.21.15.99:0/599541201 shutdown_connections 2024-09-19T06:43:16.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:16.011+0000 7f30d2117640 1 --2- 172.21.15.99:0/599541201 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f30b806df60 0x7f30b8070410 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:16.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:16.011+0000 7f30d2117640 1 --2- 172.21.15.99:0/599541201 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30cc102ef0 0x7f30cc113ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:16.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:16.011+0000 7f30d2117640 1 --2- 172.21.15.99:0/599541201 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f30cc102550 0x7f30cc113590 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:16.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:16.011+0000 7f30d2117640 1 -- 172.21.15.99:0/599541201 >> 172.21.15.99:0/599541201 conn(0x7f30cc0f80f0 msgr2=0x7f30cc0f91b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:16.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:16.012+0000 7f30d2117640 1 -- 172.21.15.99:0/599541201 shutdown_connections 2024-09-19T06:43:16.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:16.012+0000 7f30d2117640 1 -- 172.21.15.99:0/599541201 wait complete. 2024-09-19T06:43:16.616 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -e sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 -- bash -c 'ceph config set global log_to_journald false --force' 2024-09-19T06:43:16.864 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T06:43:16.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:16 smithi099 ceph-mon[27651]: pgmap v45: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:43:17.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:16 smithi117 ceph-mon[34564]: pgmap v45: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:43:18.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:18.701+0000 7f57e045a640 1 -- 172.21.15.99:0/1109737194 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f57d80fb060 msgr2=0x7f57d80fb4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:18.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:18.701+0000 7f57e045a640 1 --2- 172.21.15.99:0/1109737194 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f57d80fb060 0x7f57d80fb4b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f57c80048d0 tx=0x7f57c8009da0 comp rx=0 tx=0).stop 2024-09-19T06:43:18.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:18.701+0000 7f57e045a640 1 -- 172.21.15.99:0/1109737194 shutdown_connections 2024-09-19T06:43:18.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:18.701+0000 7f57e045a640 1 --2- 172.21.15.99:0/1109737194 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f57d80fb060 0x7f57d80fb4b0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:18.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:18.701+0000 7f57e045a640 1 --2- 172.21.15.99:0/1109737194 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57d8100c20 0x7f57d8100ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:18.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:18.701+0000 7f57e045a640 1 -- 172.21.15.99:0/1109737194 >> 172.21.15.99:0/1109737194 conn(0x7f57d8072740 msgr2=0x7f57d8072b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:18.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:18.701+0000 7f57e045a640 1 -- 172.21.15.99:0/1109737194 shutdown_connections 2024-09-19T06:43:18.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:18.701+0000 7f57e045a640 1 -- 172.21.15.99:0/1109737194 wait complete. 2024-09-19T06:43:18.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:18.702+0000 7f57e045a640 1 Processor -- start 2024-09-19T06:43:18.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:18.702+0000 7f57e045a640 1 -- start start 2024-09-19T06:43:18.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:18.702+0000 7f57e045a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f57d80fb060 0x7f57d8112110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:18.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:18.702+0000 7f57e045a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57d8100c20 0x7f57d8112650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:18.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:18.702+0000 7f57e045a640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d8112ce0 con 0x7f57d80fb060 2024-09-19T06:43:18.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:18.702+0000 7f57e045a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d810c090 con 0x7f57d8100c20 2024-09-19T06:43:18.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:18.702+0000 7f57de1f6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f57d80fb060 0x7f57d8112110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:18.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:18.702+0000 7f57de1f6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f57d80fb060 0x7f57d8112110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41092/0 (socket says 172.21.15.99:41092) 2024-09-19T06:43:18.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:18.702+0000 7f57de1f6640 1 -- 172.21.15.99:0/1053448463 learned_addr learned my addr 172.21.15.99:0/1053448463 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:43:18.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:18.702+0000 7f57dd9f5640 1 --2- 172.21.15.99:0/1053448463 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57d8100c20 0x7f57d8112650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:18.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:18.702+0000 7f57de1f6640 1 -- 172.21.15.99:0/1053448463 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57d8100c20 msgr2=0x7f57d8112650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:18.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:18.702+0000 7f57de1f6640 1 --2- 172.21.15.99:0/1053448463 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57d8100c20 0x7f57d8112650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:18.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:18.702+0000 7f57de1f6640 1 -- 172.21.15.99:0/1053448463 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c8005040 con 0x7f57d80fb060 2024-09-19T06:43:18.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:18.702+0000 7f57dd9f5640 1 --2- 172.21.15.99:0/1053448463 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57d8100c20 0x7f57d8112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:43:18.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:18.703+0000 7f57de1f6640 1 --2- 172.21.15.99:0/1053448463 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f57d80fb060 0x7f57d8112110 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f57d400b790 tx=0x7f57d40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:18.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:18.703+0000 7f57ceffd640 1 -- 172.21.15.99:0/1053448463 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f57d400c700 con 0x7f57d80fb060 2024-09-19T06:43:18.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:18.703+0000 7f57ceffd640 1 -- 172.21.15.99:0/1053448463 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f57d400cd00 con 0x7f57d80fb060 2024-09-19T06:43:18.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:18.703+0000 7f57e045a640 1 -- 172.21.15.99:0/1053448463 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57d810c370 con 0x7f57d80fb060 2024-09-19T06:43:18.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:18.703+0000 7f57ceffd640 1 -- 172.21.15.99:0/1053448463 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f57d4015e70 con 0x7f57d80fb060 2024-09-19T06:43:18.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:18.703+0000 7f57e045a640 1 -- 172.21.15.99:0/1053448463 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57d810c890 con 0x7f57d80fb060 2024-09-19T06:43:18.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:18.704+0000 7f57e045a640 1 -- 172.21.15.99:0/1053448463 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57d80fc320 con 0x7f57d80fb060 2024-09-19T06:43:18.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:18.704+0000 7f57ceffd640 1 -- 172.21.15.99:0/1053448463 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 33) v1 ==== 92375+0+0 (secure 0 0 0) 0x7f57d4012070 con 0x7f57d80fb060 2024-09-19T06:43:18.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:18.705+0000 7f57ceffd640 1 --2- 172.21.15.99:0/1053448463 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f57c406df60 0x7f57c4070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:18.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:18.705+0000 7f57dd9f5640 1 --2- 172.21.15.99:0/1053448463 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f57c406df60 0x7f57c4070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:18.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:18.705+0000 7f57ceffd640 1 -- 172.21.15.99:0/1053448463 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f57d408d240 con 0x7f57d80fb060 2024-09-19T06:43:18.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:18.705+0000 7f57dd9f5640 1 --2- 172.21.15.99:0/1053448463 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f57c406df60 0x7f57c4070410 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f57c800b020 tx=0x7f57c8009da0 comp rx=0 tx=0).ready entity=mgr.14658 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:18.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:18.709+0000 7f57ceffd640 1 -- 172.21.15.99:0/1053448463 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f57d4056b40 con 0x7f57d80fb060 2024-09-19T06:43:18.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:18.875+0000 7f57e045a640 1 -- 172.21.15.99:0/1053448463 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f57d8073250 con 0x7f57d80fb060 2024-09-19T06:43:18.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:18.876+0000 7f57ceffd640 1 -- 172.21.15.99:0/1053448463 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v47)=0 v47) v1 ==== 135+0+0 (secure 0 0 0) 0x7f57d405a200 con 0x7f57d80fb060 2024-09-19T06:43:18.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:18.877+0000 7f57e045a640 1 -- 172.21.15.99:0/1053448463 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f57c406df60 msgr2=0x7f57c4070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:18.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:18.878+0000 7f57e045a640 1 --2- 172.21.15.99:0/1053448463 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f57c406df60 0x7f57c4070410 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f57c800b020 tx=0x7f57c8009da0 comp rx=0 tx=0).stop 2024-09-19T06:43:18.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:18.878+0000 7f57e045a640 1 -- 172.21.15.99:0/1053448463 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f57d80fb060 msgr2=0x7f57d8112110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:18.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:18.878+0000 7f57e045a640 1 --2- 172.21.15.99:0/1053448463 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f57d80fb060 0x7f57d8112110 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f57d400b790 tx=0x7f57d40091d0 comp rx=0 tx=0).stop 2024-09-19T06:43:18.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:18.878+0000 7f57e045a640 1 -- 172.21.15.99:0/1053448463 shutdown_connections 2024-09-19T06:43:18.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:18.878+0000 7f57e045a640 1 --2- 172.21.15.99:0/1053448463 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f57c406df60 0x7f57c4070410 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:18.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:18.878+0000 7f57e045a640 1 --2- 172.21.15.99:0/1053448463 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57d8100c20 0x7f57d8112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:18.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:18.878+0000 7f57e045a640 1 --2- 172.21.15.99:0/1053448463 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f57d80fb060 0x7f57d8112110 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:18.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:18.878+0000 7f57e045a640 1 -- 172.21.15.99:0/1053448463 >> 172.21.15.99:0/1053448463 conn(0x7f57d8072740 msgr2=0x7f57d80fa170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:18.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:18.878+0000 7f57e045a640 1 -- 172.21.15.99:0/1053448463 shutdown_connections 2024-09-19T06:43:18.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:18.878+0000 7f57e045a640 1 -- 172.21.15.99:0/1053448463 wait complete. 2024-09-19T06:43:19.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:18 smithi117 ceph-mon[34564]: pgmap v46: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:43:19.182 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:18 smithi099 ceph-mon[27651]: pgmap v46: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:43:19.618 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -e sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-09-19T06:43:19.866 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T06:43:21.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:20 smithi117 ceph-mon[34564]: pgmap v47: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:43:21.083 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:20 smithi099 ceph-mon[27651]: pgmap v47: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:43:21.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:21.430+0000 7f82bc85c640 1 -- 172.21.15.99:0/3878557772 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82b80fdf00 msgr2=0x7f82b81065d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:21.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:21.430+0000 7f82bc85c640 1 --2- 172.21.15.99:0/3878557772 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82b80fdf00 0x7f82b81065d0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f82a8004900 tx=0x7f82a8009da0 comp rx=0 tx=0).stop 2024-09-19T06:43:21.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:21.430+0000 7f82bc85c640 1 -- 172.21.15.99:0/3878557772 shutdown_connections 2024-09-19T06:43:21.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:21.430+0000 7f82bc85c640 1 --2- 172.21.15.99:0/3878557772 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82b80fdf00 0x7f82b81065d0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:21.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:21.430+0000 7f82bc85c640 1 --2- 172.21.15.99:0/3878557772 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f82b80fd560 0x7f82b80fd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:21.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:21.430+0000 7f82bc85c640 1 -- 172.21.15.99:0/3878557772 >> 172.21.15.99:0/3878557772 conn(0x7f82b80f7020 msgr2=0x7f82b80f9430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:21.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:21.430+0000 7f82bc85c640 1 -- 172.21.15.99:0/3878557772 shutdown_connections 2024-09-19T06:43:21.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:21.430+0000 7f82bc85c640 1 -- 172.21.15.99:0/3878557772 wait complete. 2024-09-19T06:43:21.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:21.431+0000 7f82bc85c640 1 Processor -- start 2024-09-19T06:43:21.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:21.431+0000 7f82bc85c640 1 -- start start 2024-09-19T06:43:21.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:21.431+0000 7f82bc85c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82b80fd560 0x7f82b80fb420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:21.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:21.431+0000 7f82bc85c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f82b80fdf00 0x7f82b80fb960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:21.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:21.431+0000 7f82bc85c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b80fbf30 con 0x7f82b80fd560 2024-09-19T06:43:21.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:21.431+0000 7f82bc85c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b80fc0a0 con 0x7f82b80fdf00 2024-09-19T06:43:21.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:21.431+0000 7f82b659c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82b80fd560 0x7f82b80fb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:21.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:21.431+0000 7f82b659c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82b80fd560 0x7f82b80fb420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41116/0 (socket says 172.21.15.99:41116) 2024-09-19T06:43:21.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:21.431+0000 7f82b659c640 1 -- 172.21.15.99:0/924445101 learned_addr learned my addr 172.21.15.99:0/924445101 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:43:21.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:21.431+0000 7f82b659c640 1 -- 172.21.15.99:0/924445101 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f82b80fdf00 msgr2=0x7f82b80fb960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:21.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:21.431+0000 7f82b659c640 1 --2- 172.21.15.99:0/924445101 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f82b80fdf00 0x7f82b80fb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:21.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:21.431+0000 7f82b659c640 1 -- 172.21.15.99:0/924445101 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82a8005040 con 0x7f82b80fd560 2024-09-19T06:43:21.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:21.432+0000 7f82b659c640 1 --2- 172.21.15.99:0/924445101 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82b80fd560 0x7f82b80fb420 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f82ac00b790 tx=0x7f82ac0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:21.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:21.432+0000 7f82a6ffd640 1 -- 172.21.15.99:0/924445101 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82ac00c700 con 0x7f82b80fd560 2024-09-19T06:43:21.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:21.432+0000 7f82bc85c640 1 -- 172.21.15.99:0/924445101 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82b8119610 con 0x7f82b80fd560 2024-09-19T06:43:21.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:21.432+0000 7f82a6ffd640 1 -- 172.21.15.99:0/924445101 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f82ac00cd00 con 0x7f82b80fd560 2024-09-19T06:43:21.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:21.432+0000 7f82a6ffd640 1 -- 172.21.15.99:0/924445101 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82ac015e70 con 0x7f82b80fd560 2024-09-19T06:43:21.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:21.432+0000 7f82bc85c640 1 -- 172.21.15.99:0/924445101 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82b8119a50 con 0x7f82b80fd560 2024-09-19T06:43:21.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:21.433+0000 7f82bc85c640 1 -- 172.21.15.99:0/924445101 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82b80662f0 con 0x7f82b80fd560 2024-09-19T06:43:21.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:21.433+0000 7f82a6ffd640 1 -- 172.21.15.99:0/924445101 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 33) v1 ==== 92375+0+0 (secure 0 0 0) 0x7f82ac012070 con 0x7f82b80fd560 2024-09-19T06:43:21.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:21.434+0000 7f82a6ffd640 1 --2- 172.21.15.99:0/924445101 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f82a006df60 0x7f82a0070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:21.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:21.434+0000 7f82a6ffd640 1 -- 172.21.15.99:0/924445101 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f82ac08d4f0 con 0x7f82b80fd560 2024-09-19T06:43:21.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:21.434+0000 7f82b5d9b640 1 --2- 172.21.15.99:0/924445101 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f82a006df60 0x7f82a0070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:21.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:21.434+0000 7f82b5d9b640 1 --2- 172.21.15.99:0/924445101 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f82a006df60 0x7f82a0070410 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f82a8003080 tx=0x7f82a8009da0 comp rx=0 tx=0).ready entity=mgr.14658 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:21.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:21.438+0000 7f82a6ffd640 1 -- 172.21.15.99:0/924445101 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f82ac05a8a0 con 0x7f82b80fd560 2024-09-19T06:43:21.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:21.619+0000 7f82bc85c640 1 -- 172.21.15.99:0/924445101 --> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961", "target": ["mon-mgr", ""]}) v1 -- 0x7f82b804b720 con 0x7f82a006df60 2024-09-19T06:43:21.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:21.624+0000 7f82a6ffd640 1 -- 172.21.15.99:0/924445101 <== mgr.14658 v2:172.21.15.99:6800/3542536515 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f82b804b720 con 0x7f82a006df60 2024-09-19T06:43:21.625 INFO:teuthology.orchestra.run.smithi099.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:43:21.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:21.626+0000 7f82bc85c640 1 -- 172.21.15.99:0/924445101 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f82a006df60 msgr2=0x7f82a0070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:21.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:21.626+0000 7f82bc85c640 1 --2- 172.21.15.99:0/924445101 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f82a006df60 0x7f82a0070410 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f82a8003080 tx=0x7f82a8009da0 comp rx=0 tx=0).stop 2024-09-19T06:43:21.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:21.626+0000 7f82bc85c640 1 -- 172.21.15.99:0/924445101 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82b80fd560 msgr2=0x7f82b80fb420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:21.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:21.626+0000 7f82bc85c640 1 --2- 172.21.15.99:0/924445101 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82b80fd560 0x7f82b80fb420 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f82ac00b790 tx=0x7f82ac0091d0 comp rx=0 tx=0).stop 2024-09-19T06:43:21.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:21.626+0000 7f82bc85c640 1 -- 172.21.15.99:0/924445101 shutdown_connections 2024-09-19T06:43:21.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:21.626+0000 7f82bc85c640 1 --2- 172.21.15.99:0/924445101 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f82a006df60 0x7f82a0070410 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:21.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:21.626+0000 7f82bc85c640 1 --2- 172.21.15.99:0/924445101 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f82b80fdf00 0x7f82b80fb960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:21.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:21.626+0000 7f82bc85c640 1 --2- 172.21.15.99:0/924445101 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82b80fd560 0x7f82b80fb420 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:21.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:21.626+0000 7f82bc85c640 1 -- 172.21.15.99:0/924445101 >> 172.21.15.99:0/924445101 conn(0x7f82b80f7020 msgr2=0x7f82b80f8540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:21.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:21.626+0000 7f82bc85c640 1 -- 172.21.15.99:0/924445101 shutdown_connections 2024-09-19T06:43:21.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:21.626+0000 7f82bc85c640 1 -- 172.21.15.99:0/924445101 wait complete. 2024-09-19T06:43:21.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:21 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:43:21.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:21 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:43:21.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:21 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:43:22.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:21 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:43:22.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:21 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:43:22.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:21 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:43:22.375 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-19T06:43:22.376 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi099.front.sepia.ceph.com 2024-09-19T06:43:22.376 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -e sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-09-19T06:43:22.628 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T06:43:23.010 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:22 smithi099 ceph-mon[27651]: pgmap v48: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:43:23.011 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:22 smithi099 ceph-mon[27651]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:43:23.011 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:22 smithi099 ceph-mon[27651]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:43:23.011 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:22 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:43:23.011 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:22 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:43:23.011 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:22 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:43:23.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:22 smithi117 ceph-mon[34564]: pgmap v48: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:43:23.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:22 smithi117 ceph-mon[34564]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:43:23.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:22 smithi117 ceph-mon[34564]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:43:23.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:22 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:43:23.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:22 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:43:23.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:22 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:43:24.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:23 smithi117 ceph-mon[34564]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:43:24.141 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:23 smithi099 ceph-mon[27651]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T06:43:24.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.710+0000 7f989b917640 1 -- 172.21.15.99:0/711513585 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98940fb810 msgr2=0x7f98940fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:24.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.710+0000 7f989b917640 1 --2- 172.21.15.99:0/711513585 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98940fb810 0x7f98940fbbe0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f988c0048d0 tx=0x7f988c009da0 comp rx=0 tx=0).stop 2024-09-19T06:43:24.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.710+0000 7f989b917640 1 -- 172.21.15.99:0/711513585 shutdown_connections 2024-09-19T06:43:24.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.710+0000 7f989b917640 1 --2- 172.21.15.99:0/711513585 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98940fcf80 0x7f98940fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:24.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.710+0000 7f989b917640 1 --2- 172.21.15.99:0/711513585 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98940fb810 0x7f98940fbbe0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:24.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.710+0000 7f989b917640 1 -- 172.21.15.99:0/711513585 >> 172.21.15.99:0/711513585 conn(0x7f98940723b0 msgr2=0x7f98940727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:24.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.710+0000 7f989b917640 1 -- 172.21.15.99:0/711513585 shutdown_connections 2024-09-19T06:43:24.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.710+0000 7f989b917640 1 -- 172.21.15.99:0/711513585 wait complete. 2024-09-19T06:43:24.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.710+0000 7f989b917640 1 Processor -- start 2024-09-19T06:43:24.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.710+0000 7f989b917640 1 -- start start 2024-09-19T06:43:24.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.711+0000 7f989b917640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98940fb810 0x7f989410e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:24.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.711+0000 7f989b917640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98940fcf80 0x7f989410e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:24.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.711+0000 7f989b917640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f989410ede0 con 0x7f98940fcf80 2024-09-19T06:43:24.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.711+0000 7f989b917640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f989410ef50 con 0x7f98940fb810 2024-09-19T06:43:24.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.711+0000 7f9898eb2640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98940fcf80 0x7f989410e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:24.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.711+0000 7f9898eb2640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98940fcf80 0x7f989410e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41130/0 (socket says 172.21.15.99:41130) 2024-09-19T06:43:24.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.711+0000 7f9898eb2640 1 -- 172.21.15.99:0/3998703789 learned_addr learned my addr 172.21.15.99:0/3998703789 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:43:24.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.711+0000 7f98996b3640 1 --2- 172.21.15.99:0/3998703789 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98940fb810 0x7f989410e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:24.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.711+0000 7f9898eb2640 1 -- 172.21.15.99:0/3998703789 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98940fb810 msgr2=0x7f989410e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:24.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.711+0000 7f9898eb2640 1 --2- 172.21.15.99:0/3998703789 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98940fb810 0x7f989410e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:24.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.711+0000 7f9898eb2640 1 -- 172.21.15.99:0/3998703789 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f988c005040 con 0x7f98940fcf80 2024-09-19T06:43:24.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.711+0000 7f9898eb2640 1 --2- 172.21.15.99:0/3998703789 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98940fcf80 0x7f989410e700 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f988800b790 tx=0x7f98880091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:24.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.711+0000 7f9891ffb640 1 -- 172.21.15.99:0/3998703789 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f988800c700 con 0x7f98940fcf80 2024-09-19T06:43:24.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.711+0000 7f9891ffb640 1 -- 172.21.15.99:0/3998703789 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f988800cd00 con 0x7f98940fcf80 2024-09-19T06:43:24.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.711+0000 7f9891ffb640 1 -- 172.21.15.99:0/3998703789 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9888015e80 con 0x7f98940fcf80 2024-09-19T06:43:24.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.711+0000 7f989b917640 1 -- 172.21.15.99:0/3998703789 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9894117230 con 0x7f98940fcf80 2024-09-19T06:43:24.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.712+0000 7f989b917640 1 -- 172.21.15.99:0/3998703789 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9894117700 con 0x7f98940fcf80 2024-09-19T06:43:24.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.713+0000 7f989b917640 1 -- 172.21.15.99:0/3998703789 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98940fcbc0 con 0x7f98940fcf80 2024-09-19T06:43:24.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.713+0000 7f9891ffb640 1 -- 172.21.15.99:0/3998703789 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 34) v1 ==== 92273+0+0 (secure 0 0 0) 0x7f9888012070 con 0x7f98940fcf80 2024-09-19T06:43:24.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.713+0000 7f9891ffb640 1 --2- 172.21.15.99:0/3998703789 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f987c06de30 0x7f987c0702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:24.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.713+0000 7f9891ffb640 1 -- 172.21.15.99:0/3998703789 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f988808d0e0 con 0x7f98940fcf80 2024-09-19T06:43:24.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.713+0000 7f98996b3640 1 --2- 172.21.15.99:0/3998703789 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f987c06de30 0x7f987c0702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:24.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.714+0000 7f98996b3640 1 --2- 172.21.15.99:0/3998703789 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f987c06de30 0x7f987c0702e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f988c009ac0 tx=0x7f988c035040 comp rx=0 tx=0).ready entity=mgr.14658 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:24.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.718+0000 7f9891ffb640 1 -- 172.21.15.99:0/3998703789 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f9888056a70 con 0x7f98940fcf80 2024-09-19T06:43:24.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.905+0000 7f989b917640 1 -- 172.21.15.99:0/3998703789 --> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f98940657a0 con 0x7f987c06de30 2024-09-19T06:43:24.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.906+0000 7f9891ffb640 1 -- 172.21.15.99:0/3998703789 <== mgr.14658 v2:172.21.15.99:6800/3542536515 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f98940657a0 con 0x7f987c06de30 2024-09-19T06:43:24.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.908+0000 7f989b917640 1 -- 172.21.15.99:0/3998703789 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f987c06de30 msgr2=0x7f987c0702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:24.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.908+0000 7f989b917640 1 --2- 172.21.15.99:0/3998703789 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f987c06de30 0x7f987c0702e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f988c009ac0 tx=0x7f988c035040 comp rx=0 tx=0).stop 2024-09-19T06:43:24.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.908+0000 7f989b917640 1 -- 172.21.15.99:0/3998703789 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98940fcf80 msgr2=0x7f989410e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:24.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.908+0000 7f989b917640 1 --2- 172.21.15.99:0/3998703789 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98940fcf80 0x7f989410e700 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f988800b790 tx=0x7f98880091d0 comp rx=0 tx=0).stop 2024-09-19T06:43:24.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.908+0000 7f989b917640 1 -- 172.21.15.99:0/3998703789 shutdown_connections 2024-09-19T06:43:24.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.908+0000 7f989b917640 1 --2- 172.21.15.99:0/3998703789 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f987c06de30 0x7f987c0702e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:24.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.908+0000 7f989b917640 1 --2- 172.21.15.99:0/3998703789 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98940fcf80 0x7f989410e700 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:24.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.908+0000 7f989b917640 1 --2- 172.21.15.99:0/3998703789 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98940fb810 0x7f989410e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:24.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.908+0000 7f989b917640 1 -- 172.21.15.99:0/3998703789 >> 172.21.15.99:0/3998703789 conn(0x7f98940723b0 msgr2=0x7f98940fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:24.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.908+0000 7f989b917640 1 -- 172.21.15.99:0/3998703789 shutdown_connections 2024-09-19T06:43:24.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.908+0000 7f989b917640 1 -- 172.21.15.99:0/3998703789 wait complete. 2024-09-19T06:43:24.918 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-09-19T06:43:24.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.988+0000 7fc728fd5640 1 -- 172.21.15.99:0/2838451939 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc7240fe450 msgr2=0x7fc7240fe820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:24.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.988+0000 7fc728fd5640 1 --2- 172.21.15.99:0/2838451939 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc7240fe450 0x7fc7240fe820 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fc7140048d0 tx=0x7fc714009da0 comp rx=0 tx=0).stop 2024-09-19T06:43:24.990 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:24 smithi099 ceph-mon[27651]: pgmap v49: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-19T06:43:24.990 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:24 smithi099 ceph-mon[27651]: mgrmap e34: smithi099.pgvkqi(active, since 92s), standbys: smithi117.ssmkcf 2024-09-19T06:43:24.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.989+0000 7fc728fd5640 1 -- 172.21.15.99:0/2838451939 shutdown_connections 2024-09-19T06:43:24.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.989+0000 7fc728fd5640 1 --2- 172.21.15.99:0/2838451939 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc724064fe0 0x7fc724065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:24.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.989+0000 7fc728fd5640 1 --2- 172.21.15.99:0/2838451939 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc7240fe450 0x7fc7240fe820 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:24.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.989+0000 7fc728fd5640 1 -- 172.21.15.99:0/2838451939 >> 172.21.15.99:0/2838451939 conn(0x7fc7240723b0 msgr2=0x7fc7240727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:24.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.989+0000 7fc728fd5640 1 -- 172.21.15.99:0/2838451939 shutdown_connections 2024-09-19T06:43:24.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.989+0000 7fc728fd5640 1 -- 172.21.15.99:0/2838451939 wait complete. 2024-09-19T06:43:24.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.989+0000 7fc728fd5640 1 Processor -- start 2024-09-19T06:43:24.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.989+0000 7fc728fd5640 1 -- start start 2024-09-19T06:43:24.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.990+0000 7fc728fd5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc724064fe0 0x7fc724113250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:24.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.990+0000 7fc728fd5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7240fe450 0x7fc724113790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:24.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.990+0000 7fc728fd5640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc724113e20 con 0x7fc724064fe0 2024-09-19T06:43:24.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.990+0000 7fc728fd5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc72410d1d0 con 0x7fc7240fe450 2024-09-19T06:43:24.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.990+0000 7fc72259c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc724064fe0 0x7fc724113250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:24.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.990+0000 7fc72259c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc724064fe0 0x7fc724113250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41134/0 (socket says 172.21.15.99:41134) 2024-09-19T06:43:24.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.990+0000 7fc72259c640 1 -- 172.21.15.99:0/1222201598 learned_addr learned my addr 172.21.15.99:0/1222201598 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:43:24.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.990+0000 7fc721d9b640 1 --2- 172.21.15.99:0/1222201598 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7240fe450 0x7fc724113790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:24.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.990+0000 7fc72259c640 1 -- 172.21.15.99:0/1222201598 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7240fe450 msgr2=0x7fc724113790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:24.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.990+0000 7fc72259c640 1 --2- 172.21.15.99:0/1222201598 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7240fe450 0x7fc724113790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:24.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.990+0000 7fc72259c640 1 -- 172.21.15.99:0/1222201598 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc714005040 con 0x7fc724064fe0 2024-09-19T06:43:24.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.990+0000 7fc72259c640 1 --2- 172.21.15.99:0/1222201598 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc724064fe0 0x7fc724113250 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc714003080 tx=0x7fc714009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:24.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.990+0000 7fc712ffd640 1 -- 172.21.15.99:0/1222201598 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc714038070 con 0x7fc724064fe0 2024-09-19T06:43:24.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.990+0000 7fc712ffd640 1 -- 172.21.15.99:0/1222201598 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc7140097e0 con 0x7fc724064fe0 2024-09-19T06:43:24.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.990+0000 7fc728fd5640 1 -- 172.21.15.99:0/1222201598 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc72410d450 con 0x7fc724064fe0 2024-09-19T06:43:24.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.990+0000 7fc712ffd640 1 -- 172.21.15.99:0/1222201598 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc71403d420 con 0x7fc724064fe0 2024-09-19T06:43:24.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.990+0000 7fc728fd5640 1 -- 172.21.15.99:0/1222201598 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc72410d910 con 0x7fc724064fe0 2024-09-19T06:43:24.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.991+0000 7fc728fd5640 1 -- 172.21.15.99:0/1222201598 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7240fdce0 con 0x7fc724064fe0 2024-09-19T06:43:24.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.992+0000 7fc712ffd640 1 -- 172.21.15.99:0/1222201598 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 34) v1 ==== 92273+0+0 (secure 0 0 0) 0x7fc714030020 con 0x7fc724064fe0 2024-09-19T06:43:24.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.992+0000 7fc712ffd640 1 --2- 172.21.15.99:0/1222201598 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7fc70c06de30 0x7fc70c0702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:24.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.992+0000 7fc712ffd640 1 -- 172.21.15.99:0/1222201598 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fc7140adcc0 con 0x7fc724064fe0 2024-09-19T06:43:24.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.992+0000 7fc721d9b640 1 --2- 172.21.15.99:0/1222201598 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7fc70c06de30 0x7fc70c0702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:24.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.993+0000 7fc721d9b640 1 --2- 172.21.15.99:0/1222201598 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7fc70c06de30 0x7fc70c0702e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc72410eb10 tx=0x7fc718009120 comp rx=0 tx=0).ready entity=mgr.14658 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:24.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:24.997+0000 7fc712ffd640 1 -- 172.21.15.99:0/1222201598 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7fc714077650 con 0x7fc724064fe0 2024-09-19T06:43:25.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:24 smithi117 ceph-mon[34564]: pgmap v49: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-19T06:43:25.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:24 smithi117 ceph-mon[34564]: mgrmap e34: smithi099.pgvkqi(active, since 92s), standbys: smithi117.ssmkcf 2024-09-19T06:43:25.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.191+0000 7fc728fd5640 1 -- 172.21.15.99:0/1222201598 --> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc72404b720 con 0x7fc70c06de30 2024-09-19T06:43:25.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.192+0000 7fc712ffd640 1 -- 172.21.15.99:0/1222201598 <== mgr.14658 v2:172.21.15.99:6800/3542536515 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7fc72404b720 con 0x7fc70c06de30 2024-09-19T06:43:25.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.194+0000 7fc728fd5640 1 -- 172.21.15.99:0/1222201598 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7fc70c06de30 msgr2=0x7fc70c0702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:25.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.194+0000 7fc728fd5640 1 --2- 172.21.15.99:0/1222201598 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7fc70c06de30 0x7fc70c0702e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc72410eb10 tx=0x7fc718009120 comp rx=0 tx=0).stop 2024-09-19T06:43:25.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.194+0000 7fc728fd5640 1 -- 172.21.15.99:0/1222201598 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc724064fe0 msgr2=0x7fc724113250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:25.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.194+0000 7fc728fd5640 1 --2- 172.21.15.99:0/1222201598 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc724064fe0 0x7fc724113250 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc714003080 tx=0x7fc714009da0 comp rx=0 tx=0).stop 2024-09-19T06:43:25.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.194+0000 7fc728fd5640 1 -- 172.21.15.99:0/1222201598 shutdown_connections 2024-09-19T06:43:25.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.194+0000 7fc728fd5640 1 --2- 172.21.15.99:0/1222201598 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7fc70c06de30 0x7fc70c0702e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:25.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.194+0000 7fc728fd5640 1 --2- 172.21.15.99:0/1222201598 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7240fe450 0x7fc724113790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:25.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.194+0000 7fc728fd5640 1 --2- 172.21.15.99:0/1222201598 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc724064fe0 0x7fc724113250 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:25.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.194+0000 7fc728fd5640 1 -- 172.21.15.99:0/1222201598 >> 172.21.15.99:0/1222201598 conn(0x7fc7240723b0 msgr2=0x7fc7240fa290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:25.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.194+0000 7fc728fd5640 1 -- 172.21.15.99:0/1222201598 shutdown_connections 2024-09-19T06:43:25.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.194+0000 7fc728fd5640 1 -- 172.21.15.99:0/1222201598 wait complete. 2024-09-19T06:43:25.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.272+0000 7fb5553fd640 1 -- 172.21.15.99:0/1858671066 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5500fb490 msgr2=0x7fb5500fb900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:25.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.272+0000 7fb5553fd640 1 --2- 172.21.15.99:0/1858671066 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5500fb490 0x7fb5500fb900 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fb5380048d0 tx=0x7fb538009da0 comp rx=0 tx=0).stop 2024-09-19T06:43:25.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.272+0000 7fb5553fd640 1 -- 172.21.15.99:0/1858671066 shutdown_connections 2024-09-19T06:43:25.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.272+0000 7fb5553fd640 1 --2- 172.21.15.99:0/1858671066 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5500fb490 0x7fb5500fb900 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:25.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.272+0000 7fb5553fd640 1 --2- 172.21.15.99:0/1858671066 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5501014d0 0x7fb5501018a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:25.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.272+0000 7fb5553fd640 1 -- 172.21.15.99:0/1858671066 >> 172.21.15.99:0/1858671066 conn(0x7fb5500f7010 msgr2=0x7fb5500f9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:25.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.273+0000 7fb5553fd640 1 -- 172.21.15.99:0/1858671066 shutdown_connections 2024-09-19T06:43:25.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.273+0000 7fb5553fd640 1 -- 172.21.15.99:0/1858671066 wait complete. 2024-09-19T06:43:25.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.273+0000 7fb5553fd640 1 Processor -- start 2024-09-19T06:43:25.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.273+0000 7fb5553fd640 1 -- start start 2024-09-19T06:43:25.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.273+0000 7fb5553fd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5500fb490 0x7fb5501131a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:25.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.273+0000 7fb5553fd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5501014d0 0x7fb5501136e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:25.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.274+0000 7fb5553fd640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb550113d70 con 0x7fb5500fb490 2024-09-19T06:43:25.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.274+0000 7fb5553fd640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55010d160 con 0x7fb5501014d0 2024-09-19T06:43:25.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.274+0000 7fb54effd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5500fb490 0x7fb5501131a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:25.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.274+0000 7fb54effd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5500fb490 0x7fb5501131a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41146/0 (socket says 172.21.15.99:41146) 2024-09-19T06:43:25.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.274+0000 7fb54effd640 1 -- 172.21.15.99:0/313283374 learned_addr learned my addr 172.21.15.99:0/313283374 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:43:25.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.274+0000 7fb54e7fc640 1 --2- 172.21.15.99:0/313283374 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5501014d0 0x7fb5501136e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:25.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.274+0000 7fb54effd640 1 -- 172.21.15.99:0/313283374 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5501014d0 msgr2=0x7fb5501136e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:25.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.274+0000 7fb54effd640 1 --2- 172.21.15.99:0/313283374 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5501014d0 0x7fb5501136e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:25.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.274+0000 7fb54effd640 1 -- 172.21.15.99:0/313283374 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb538005040 con 0x7fb5500fb490 2024-09-19T06:43:25.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.274+0000 7fb54effd640 1 --2- 172.21.15.99:0/313283374 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5500fb490 0x7fb5501131a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb54000b790 tx=0x7fb5400091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:25.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.274+0000 7fb5477fe640 1 -- 172.21.15.99:0/313283374 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb54000c700 con 0x7fb5500fb490 2024-09-19T06:43:25.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.274+0000 7fb5553fd640 1 -- 172.21.15.99:0/313283374 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb55010d440 con 0x7fb5500fb490 2024-09-19T06:43:25.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.274+0000 7fb5477fe640 1 -- 172.21.15.99:0/313283374 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb54000cd00 con 0x7fb5500fb490 2024-09-19T06:43:25.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.274+0000 7fb5477fe640 1 -- 172.21.15.99:0/313283374 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb540015e80 con 0x7fb5500fb490 2024-09-19T06:43:25.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.274+0000 7fb5553fd640 1 -- 172.21.15.99:0/313283374 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb55010d930 con 0x7fb5500fb490 2024-09-19T06:43:25.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.275+0000 7fb5553fd640 1 -- 172.21.15.99:0/313283374 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5500fcbd0 con 0x7fb5500fb490 2024-09-19T06:43:25.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.276+0000 7fb5477fe640 1 -- 172.21.15.99:0/313283374 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 34) v1 ==== 92273+0+0 (secure 0 0 0) 0x7fb540012070 con 0x7fb5500fb490 2024-09-19T06:43:25.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.276+0000 7fb5477fe640 1 --2- 172.21.15.99:0/313283374 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7fb53c06de30 0x7fb53c0702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:25.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.277+0000 7fb5477fe640 1 -- 172.21.15.99:0/313283374 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fb54008cfe0 con 0x7fb5500fb490 2024-09-19T06:43:25.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.277+0000 7fb54e7fc640 1 --2- 172.21.15.99:0/313283374 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7fb53c06de30 0x7fb53c0702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:25.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.277+0000 7fb54e7fc640 1 --2- 172.21.15.99:0/313283374 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7fb53c06de30 0x7fb53c0702e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb538009ac0 tx=0x7fb538035040 comp rx=0 tx=0).ready entity=mgr.14658 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:25.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.281+0000 7fb5477fe640 1 -- 172.21.15.99:0/313283374 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7fb5400569f0 con 0x7fb5500fb490 2024-09-19T06:43:25.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.456+0000 7fb5553fd640 1 -- 172.21.15.99:0/313283374 --> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb55004b750 con 0x7fb53c06de30 2024-09-19T06:43:25.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.465+0000 7fb5477fe640 1 -- 172.21.15.99:0/313283374 <== mgr.14658 v2:172.21.15.99:6800/3542536515 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fb55004b750 con 0x7fb53c06de30 2024-09-19T06:43:25.466 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T06:43:25.466 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.smithi099 smithi099 *:9093,9094 running (2m) 47s ago 10m 17.3M - 0.25.0 c8568f914cd2 e7c1774d56b0 2024-09-19T06:43:25.467 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi099 smithi099 running (11m) 47s ago 11m 6895k - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 216ce2ef7f1e 2024-09-19T06:43:25.467 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi117 smithi117 running (10m) 70s ago 10m 6899k - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 b4c328bdec52 2024-09-19T06:43:25.467 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.smithi099 smithi099 *:3000 running (52s) 47s ago 10m 47.9M - 9.4.12 2bacad6d85d8 cd53a18d5410 2024-09-19T06:43:25.467 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.obarqf smithi099 running (5m) 47s ago 5m 12.7M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 e36c9b74004b 2024-09-19T06:43:25.467 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.xehbxe smithi099 running (5m) 47s ago 5m 121M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 d09eb3d306ae 2024-09-19T06:43:25.467 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.bheqzh smithi117 running (5m) 70s ago 5m 14.2M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 21253e27fdd3 2024-09-19T06:43:25.467 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.nooexo smithi117 running (5m) 70s ago 5m 109M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 ad1faeb3343c 2024-09-19T06:43:25.467 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi099.pgvkqi smithi099 *:8443,9283,8765 running (112s) 47s ago 12m 497M - 19.1.1-361-g2f599a46 d2baa855c067 d5de99cb7e78 2024-09-19T06:43:25.467 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi117.ssmkcf smithi117 *:8443,9283,8765 running (73s) 70s ago 10m 69.0M - 19.1.1-361-g2f599a46 d2baa855c067 8b7ee0f871f5 2024-09-19T06:43:25.467 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi099 smithi099 running (12m) 47s ago 12m 58.8M 2048M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 7375c241d067 2024-09-19T06:43:25.467 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi117 smithi117 running (9m) 70s ago 9m 42.7M 2048M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 bd4854d5213e 2024-09-19T06:43:25.467 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi099 smithi099 *:9100 running (2m) 47s ago 10m 8296k - 1.5.0 0da6a335fe13 dca7b4517dcc 2024-09-19T06:43:25.467 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi117 smithi117 *:9100 running (2m) 70s ago 10m 15.8M - 1.5.0 0da6a335fe13 8233ce3835d2 2024-09-19T06:43:25.468 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (9m) 47s ago 9m 217M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 cf8d3dd4a987 2024-09-19T06:43:25.468 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (8m) 47s ago 8m 236M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 bc5b04b8bf9f 2024-09-19T06:43:25.468 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (8m) 47s ago 8m 200M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 cedc7e3698d8 2024-09-19T06:43:25.468 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi117 running (7m) 70s ago 7m 259M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 5984ed999c91 2024-09-19T06:43:25.468 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi117 running (7m) 70s ago 7m 230M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 6a2fc0c51c05 2024-09-19T06:43:25.468 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi117 running (7m) 70s ago 7m 225M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 39dcb7dbf0e3 2024-09-19T06:43:25.468 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.smithi099 smithi099 *:9095 running (78s) 47s ago 10m 48.8M - 2.43.0 a07b618ecd1d 15ad26ec6fb4 2024-09-19T06:43:25.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.467+0000 7fb5553fd640 1 -- 172.21.15.99:0/313283374 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7fb53c06de30 msgr2=0x7fb53c0702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:25.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.467+0000 7fb5553fd640 1 --2- 172.21.15.99:0/313283374 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7fb53c06de30 0x7fb53c0702e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb538009ac0 tx=0x7fb538035040 comp rx=0 tx=0).stop 2024-09-19T06:43:25.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.467+0000 7fb5553fd640 1 -- 172.21.15.99:0/313283374 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5500fb490 msgr2=0x7fb5501131a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:25.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.467+0000 7fb5553fd640 1 --2- 172.21.15.99:0/313283374 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5500fb490 0x7fb5501131a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb54000b790 tx=0x7fb5400091d0 comp rx=0 tx=0).stop 2024-09-19T06:43:25.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.467+0000 7fb5553fd640 1 -- 172.21.15.99:0/313283374 shutdown_connections 2024-09-19T06:43:25.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.467+0000 7fb5553fd640 1 --2- 172.21.15.99:0/313283374 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7fb53c06de30 0x7fb53c0702e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:25.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.467+0000 7fb5553fd640 1 --2- 172.21.15.99:0/313283374 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5501014d0 0x7fb5501136e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:25.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.467+0000 7fb5553fd640 1 --2- 172.21.15.99:0/313283374 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb5500fb490 0x7fb5501131a0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:25.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.467+0000 7fb5553fd640 1 -- 172.21.15.99:0/313283374 >> 172.21.15.99:0/313283374 conn(0x7fb5500f7010 msgr2=0x7fb550065a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:25.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.467+0000 7fb5553fd640 1 -- 172.21.15.99:0/313283374 shutdown_connections 2024-09-19T06:43:25.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.467+0000 7fb5553fd640 1 -- 172.21.15.99:0/313283374 wait complete. 2024-09-19T06:43:25.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.561+0000 7f19f4f87640 1 -- 172.21.15.99:0/3320497907 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f19f00fcf80 msgr2=0x7f19f00fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:25.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.561+0000 7f19f4f87640 1 --2- 172.21.15.99:0/3320497907 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f19f00fcf80 0x7f19f00fd3d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f19e40048d0 tx=0x7f19e4009da0 comp rx=0 tx=0).stop 2024-09-19T06:43:25.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.561+0000 7f19f4f87640 1 -- 172.21.15.99:0/3320497907 shutdown_connections 2024-09-19T06:43:25.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.561+0000 7f19f4f87640 1 --2- 172.21.15.99:0/3320497907 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f19f00fcf80 0x7f19f00fd3d0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:25.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.561+0000 7f19f4f87640 1 --2- 172.21.15.99:0/3320497907 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19f00fb810 0x7f19f00fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:25.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.561+0000 7f19f4f87640 1 -- 172.21.15.99:0/3320497907 >> 172.21.15.99:0/3320497907 conn(0x7f19f00723b0 msgr2=0x7f19f00727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:25.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.561+0000 7f19f4f87640 1 -- 172.21.15.99:0/3320497907 shutdown_connections 2024-09-19T06:43:25.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.561+0000 7f19f4f87640 1 -- 172.21.15.99:0/3320497907 wait complete. 2024-09-19T06:43:25.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.561+0000 7f19f4f87640 1 Processor -- start 2024-09-19T06:43:25.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.561+0000 7f19f4f87640 1 -- start start 2024-09-19T06:43:25.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.562+0000 7f19f4f87640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19f00fb810 0x7f19f0115440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:25.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.562+0000 7f19f4f87640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f19f00fcf80 0x7f19f0115980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:25.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.562+0000 7f19f4f87640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f0115f80 con 0x7f19f00fcf80 2024-09-19T06:43:25.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.562+0000 7f19f4f87640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f010f390 con 0x7f19f00fb810 2024-09-19T06:43:25.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.562+0000 7f19edd9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f19f00fcf80 0x7f19f0115980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:25.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.562+0000 7f19edd9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f19f00fcf80 0x7f19f0115980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42148/0 (socket says 172.21.15.99:42148) 2024-09-19T06:43:25.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.562+0000 7f19edd9b640 1 -- 172.21.15.99:0/3291209065 learned_addr learned my addr 172.21.15.99:0/3291209065 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:43:25.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.562+0000 7f19ee59c640 1 --2- 172.21.15.99:0/3291209065 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19f00fb810 0x7f19f0115440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:25.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.562+0000 7f19edd9b640 1 -- 172.21.15.99:0/3291209065 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19f00fb810 msgr2=0x7f19f0115440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:25.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.562+0000 7f19edd9b640 1 --2- 172.21.15.99:0/3291209065 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19f00fb810 0x7f19f0115440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:25.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.562+0000 7f19edd9b640 1 -- 172.21.15.99:0/3291209065 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e4005040 con 0x7f19f00fcf80 2024-09-19T06:43:25.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.562+0000 7f19ee59c640 1 --2- 172.21.15.99:0/3291209065 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19f00fb810 0x7f19f0115440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:43:25.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.562+0000 7f19edd9b640 1 --2- 172.21.15.99:0/3291209065 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f19f00fcf80 0x7f19f0115980 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f19e4000c00 tx=0x7f19e4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:25.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.564+0000 7f19deffd640 1 -- 172.21.15.99:0/3291209065 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19e4038070 con 0x7f19f00fcf80 2024-09-19T06:43:25.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.564+0000 7f19deffd640 1 -- 172.21.15.99:0/3291209065 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f19e402ade0 con 0x7f19f00fcf80 2024-09-19T06:43:25.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.564+0000 7f19deffd640 1 -- 172.21.15.99:0/3291209065 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19e402c7b0 con 0x7f19f00fcf80 2024-09-19T06:43:25.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.564+0000 7f19f4f87640 1 -- 172.21.15.99:0/3291209065 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19f010f610 con 0x7f19f00fcf80 2024-09-19T06:43:25.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.565+0000 7f19f4f87640 1 -- 172.21.15.99:0/3291209065 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19f010fad0 con 0x7f19f00fcf80 2024-09-19T06:43:25.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.566+0000 7f19deffd640 1 -- 172.21.15.99:0/3291209065 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 34) v1 ==== 92273+0+0 (secure 0 0 0) 0x7f19e4030020 con 0x7f19f00fcf80 2024-09-19T06:43:25.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.566+0000 7f19f4f87640 1 -- 172.21.15.99:0/3291209065 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19f00fcbc0 con 0x7f19f00fcf80 2024-09-19T06:43:25.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.566+0000 7f19deffd640 1 --2- 172.21.15.99:0/3291209065 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f19d806de30 0x7f19d80702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:25.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.566+0000 7f19ee59c640 1 --2- 172.21.15.99:0/3291209065 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f19d806de30 0x7f19d80702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:25.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.566+0000 7f19deffd640 1 -- 172.21.15.99:0/3291209065 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f19e40adbb0 con 0x7f19f00fcf80 2024-09-19T06:43:25.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.567+0000 7f19ee59c640 1 --2- 172.21.15.99:0/3291209065 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f19d806de30 0x7f19d80702e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f19e0004ab0 tx=0x7f19e000b040 comp rx=0 tx=0).ready entity=mgr.14658 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:25.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.571+0000 7f19deffd640 1 -- 172.21.15.99:0/3291209065 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f19e40b4080 con 0x7f19f00fcf80 2024-09-19T06:43:25.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.806+0000 7f19f4f87640 1 -- 172.21.15.99:0/3291209065 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f19f0110a80 con 0x7f19f00fcf80 2024-09-19T06:43:25.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.808+0000 7f19deffd640 1 -- 172.21.15.99:0/3291209065 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+747 (secure 0 0 0) 0x7f19e40775c0 con 0x7f19f00fcf80 2024-09-19T06:43:25.810 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:43:25.810 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-09-19T06:43:25.810 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 2 2024-09-19T06:43:25.810 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:43:25.810 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-09-19T06:43:25.810 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T06:43:25.810 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:43:25.810 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-09-19T06:43:25.810 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 6 2024-09-19T06:43:25.810 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:43:25.811 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": { 2024-09-19T06:43:25.811 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 4 2024-09-19T06:43:25.811 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:43:25.811 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-09-19T06:43:25.811 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 12, 2024-09-19T06:43:25.811 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T06:43:25.811 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T06:43:25.811 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:43:25.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.811+0000 7f19f4f87640 1 -- 172.21.15.99:0/3291209065 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f19d806de30 msgr2=0x7f19d80702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:25.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.811+0000 7f19f4f87640 1 --2- 172.21.15.99:0/3291209065 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f19d806de30 0x7f19d80702e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f19e0004ab0 tx=0x7f19e000b040 comp rx=0 tx=0).stop 2024-09-19T06:43:25.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.811+0000 7f19f4f87640 1 -- 172.21.15.99:0/3291209065 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f19f00fcf80 msgr2=0x7f19f0115980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:25.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.811+0000 7f19f4f87640 1 --2- 172.21.15.99:0/3291209065 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f19f00fcf80 0x7f19f0115980 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f19e4000c00 tx=0x7f19e4009da0 comp rx=0 tx=0).stop 2024-09-19T06:43:25.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.811+0000 7f19f4f87640 1 -- 172.21.15.99:0/3291209065 shutdown_connections 2024-09-19T06:43:25.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.811+0000 7f19f4f87640 1 --2- 172.21.15.99:0/3291209065 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f19d806de30 0x7f19d80702e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:25.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.811+0000 7f19f4f87640 1 --2- 172.21.15.99:0/3291209065 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f19f00fcf80 0x7f19f0115980 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:25.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.811+0000 7f19f4f87640 1 --2- 172.21.15.99:0/3291209065 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19f00fb810 0x7f19f0115440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:25.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.811+0000 7f19f4f87640 1 -- 172.21.15.99:0/3291209065 >> 172.21.15.99:0/3291209065 conn(0x7f19f00723b0 msgr2=0x7f19f0065810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:25.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.812+0000 7f19f4f87640 1 -- 172.21.15.99:0/3291209065 shutdown_connections 2024-09-19T06:43:25.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.812+0000 7f19f4f87640 1 -- 172.21.15.99:0/3291209065 wait complete. 2024-09-19T06:43:25.814 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:25 smithi099 ceph-mon[27651]: from='client.14776 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:43:25.814 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:25 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:43:25.814 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:25 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:43:25.814 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:25 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:43:25.814 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:25 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:43:25.814 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:25 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-19T06:43:25.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.895+0000 7fd00e27b640 1 -- 172.21.15.99:0/1316862350 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd0080fcf80 msgr2=0x7fd0080fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:25.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.895+0000 7fd00e27b640 1 --2- 172.21.15.99:0/1316862350 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd0080fcf80 0x7fd0080fd3d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fcffc0048d0 tx=0x7fcffc009da0 comp rx=0 tx=0).stop 2024-09-19T06:43:25.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.895+0000 7fd00e27b640 1 -- 172.21.15.99:0/1316862350 shutdown_connections 2024-09-19T06:43:25.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.895+0000 7fd00e27b640 1 --2- 172.21.15.99:0/1316862350 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd0080fcf80 0x7fd0080fd3d0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:25.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.895+0000 7fd00e27b640 1 --2- 172.21.15.99:0/1316862350 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0080fb810 0x7fd0080fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:25.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.895+0000 7fd00e27b640 1 -- 172.21.15.99:0/1316862350 >> 172.21.15.99:0/1316862350 conn(0x7fd0080723b0 msgr2=0x7fd0080727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:25.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.895+0000 7fd00e27b640 1 -- 172.21.15.99:0/1316862350 shutdown_connections 2024-09-19T06:43:25.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.895+0000 7fd00e27b640 1 -- 172.21.15.99:0/1316862350 wait complete. 2024-09-19T06:43:25.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.896+0000 7fd00e27b640 1 Processor -- start 2024-09-19T06:43:25.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.896+0000 7fd00e27b640 1 -- start start 2024-09-19T06:43:25.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.896+0000 7fd00e27b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd0080fb810 0x7fd00810e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:25.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.896+0000 7fd00e27b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0080fcf80 0x7fd00810e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:25.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.896+0000 7fd00e27b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd00810ee80 con 0x7fd0080fb810 2024-09-19T06:43:25.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.896+0000 7fd00e27b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd00810eff0 con 0x7fd0080fcf80 2024-09-19T06:43:25.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.897+0000 7fd007fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd0080fb810 0x7fd00810e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:25.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.897+0000 7fd007fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd0080fb810 0x7fd00810e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42162/0 (socket says 172.21.15.99:42162) 2024-09-19T06:43:25.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.897+0000 7fd007fff640 1 -- 172.21.15.99:0/3226923373 learned_addr learned my addr 172.21.15.99:0/3226923373 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:43:25.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.897+0000 7fd0077fe640 1 --2- 172.21.15.99:0/3226923373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0080fcf80 0x7fd00810e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:25.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.897+0000 7fd007fff640 1 -- 172.21.15.99:0/3226923373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0080fcf80 msgr2=0x7fd00810e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:25.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.897+0000 7fd007fff640 1 --2- 172.21.15.99:0/3226923373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0080fcf80 0x7fd00810e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:25.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.897+0000 7fd007fff640 1 -- 172.21.15.99:0/3226923373 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcffc005040 con 0x7fd0080fb810 2024-09-19T06:43:25.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.897+0000 7fd007fff640 1 --2- 172.21.15.99:0/3226923373 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd0080fb810 0x7fd00810e240 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fcff800b790 tx=0x7fcff80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:25.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.897+0000 7fd004ff9640 1 -- 172.21.15.99:0/3226923373 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcff800c700 con 0x7fd0080fb810 2024-09-19T06:43:25.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.897+0000 7fd004ff9640 1 -- 172.21.15.99:0/3226923373 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fcff800cd00 con 0x7fd0080fb810 2024-09-19T06:43:25.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.897+0000 7fd00e27b640 1 -- 172.21.15.99:0/3226923373 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd008117370 con 0x7fd0080fb810 2024-09-19T06:43:25.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.897+0000 7fd004ff9640 1 -- 172.21.15.99:0/3226923373 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcff8015e70 con 0x7fd0080fb810 2024-09-19T06:43:25.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.897+0000 7fd00e27b640 1 -- 172.21.15.99:0/3226923373 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd008117860 con 0x7fd0080fb810 2024-09-19T06:43:25.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.898+0000 7fd00e27b640 1 -- 172.21.15.99:0/3226923373 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0080fcbc0 con 0x7fd0080fb810 2024-09-19T06:43:25.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.899+0000 7fd004ff9640 1 -- 172.21.15.99:0/3226923373 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 34) v1 ==== 92273+0+0 (secure 0 0 0) 0x7fcff8012070 con 0x7fd0080fb810 2024-09-19T06:43:25.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.899+0000 7fd004ff9640 1 --2- 172.21.15.99:0/3226923373 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7fcff006de30 0x7fcff00702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:25.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.899+0000 7fd004ff9640 1 -- 172.21.15.99:0/3226923373 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fcff808d300 con 0x7fd0080fb810 2024-09-19T06:43:25.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.899+0000 7fd0077fe640 1 --2- 172.21.15.99:0/3226923373 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7fcff006de30 0x7fcff00702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:25.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.900+0000 7fd0077fe640 1 --2- 172.21.15.99:0/3226923373 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7fcff006de30 0x7fcff00702e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd008065980 tx=0x7fcffc035040 comp rx=0 tx=0).ready entity=mgr.14658 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:25.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:25.903+0000 7fd004ff9640 1 -- 172.21.15.99:0/3226923373 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7fcff8056d10 con 0x7fd0080fb810 2024-09-19T06:43:26.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:25 smithi117 ceph-mon[34564]: from='client.14776 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:43:26.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:25 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:43:26.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:25 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:43:26.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:25 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:43:26.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:25 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:43:26.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:25 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-19T06:43:26.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.107+0000 7fd00e27b640 1 -- 172.21.15.99:0/3226923373 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd008072ec0 con 0x7fd0080fb810 2024-09-19T06:43:26.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.108+0000 7fd004ff9640 1 -- 172.21.15.99:0/3226923373 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 17 v17) v1 ==== 76+0+1852 (secure 0 0 0) 0x7fcff805a3d0 con 0x7fd0080fb810 2024-09-19T06:43:26.109 INFO:teuthology.orchestra.run.smithi099.stdout:e17 2024-09-19T06:43:26.110 INFO:teuthology.orchestra.run.smithi099.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T06:43:26.110 INFO:teuthology.orchestra.run.smithi099.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T06:43:26.110 INFO:teuthology.orchestra.run.smithi099.stdout:legacy client fscid: 1 2024-09-19T06:43:26.110 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:43:26.110 INFO:teuthology.orchestra.run.smithi099.stdout:Filesystem 'cephfs' (1) 2024-09-19T06:43:26.110 INFO:teuthology.orchestra.run.smithi099.stdout:fs_name cephfs 2024-09-19T06:43:26.110 INFO:teuthology.orchestra.run.smithi099.stdout:epoch 17 2024-09-19T06:43:26.110 INFO:teuthology.orchestra.run.smithi099.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-19T06:43:26.110 INFO:teuthology.orchestra.run.smithi099.stdout:created 2024-09-19T06:37:40.838146+0000 2024-09-19T06:43:26.110 INFO:teuthology.orchestra.run.smithi099.stdout:modified 2024-09-19T06:41:18.134083+0000 2024-09-19T06:43:26.110 INFO:teuthology.orchestra.run.smithi099.stdout:tableserver 0 2024-09-19T06:43:26.110 INFO:teuthology.orchestra.run.smithi099.stdout:root 0 2024-09-19T06:43:26.111 INFO:teuthology.orchestra.run.smithi099.stdout:session_timeout 60 2024-09-19T06:43:26.111 INFO:teuthology.orchestra.run.smithi099.stdout:session_autoclose 300 2024-09-19T06:43:26.111 INFO:teuthology.orchestra.run.smithi099.stdout:max_file_size 1099511627776 2024-09-19T06:43:26.111 INFO:teuthology.orchestra.run.smithi099.stdout:required_client_features {} 2024-09-19T06:43:26.111 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure 0 2024-09-19T06:43:26.111 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure_osd_epoch 45 2024-09-19T06:43:26.111 INFO:teuthology.orchestra.run.smithi099.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T06:43:26.111 INFO:teuthology.orchestra.run.smithi099.stdout:max_mds 2 2024-09-19T06:43:26.111 INFO:teuthology.orchestra.run.smithi099.stdout:in 0,1 2024-09-19T06:43:26.111 INFO:teuthology.orchestra.run.smithi099.stdout:up {0=14482,1=24269} 2024-09-19T06:43:26.111 INFO:teuthology.orchestra.run.smithi099.stdout:failed 2024-09-19T06:43:26.111 INFO:teuthology.orchestra.run.smithi099.stdout:damaged 2024-09-19T06:43:26.111 INFO:teuthology.orchestra.run.smithi099.stdout:stopped 2024-09-19T06:43:26.111 INFO:teuthology.orchestra.run.smithi099.stdout:data_pools [3] 2024-09-19T06:43:26.112 INFO:teuthology.orchestra.run.smithi099.stdout:metadata_pool 2 2024-09-19T06:43:26.112 INFO:teuthology.orchestra.run.smithi099.stdout:inline_data disabled 2024-09-19T06:43:26.112 INFO:teuthology.orchestra.run.smithi099.stdout:balancer 2024-09-19T06:43:26.112 INFO:teuthology.orchestra.run.smithi099.stdout:standby_count_wanted 1 2024-09-19T06:43:26.112 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.xehbxe{0:14482} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.99:6828/1508711176,v1:172.21.15.99:6829/1508711176] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T06:43:26.112 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.nooexo{1:24269} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.117:6824/2367330767,v1:172.21.15.117:6825/2367330767] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T06:43:26.112 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:43:26.112 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:43:26.112 INFO:teuthology.orchestra.run.smithi099.stdout:Standby daemons: 2024-09-19T06:43:26.112 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:43:26.112 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.obarqf{-1:14490} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6826/388324528,v1:172.21.15.99:6827/388324528] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T06:43:26.112 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.bheqzh{-1:24283} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.117:6826/4072877365,v1:172.21.15.117:6827/4072877365] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T06:43:26.113 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 17 2024-09-19T06:43:26.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.111+0000 7fd00e27b640 1 -- 172.21.15.99:0/3226923373 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7fcff006de30 msgr2=0x7fcff00702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:26.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.111+0000 7fd00e27b640 1 --2- 172.21.15.99:0/3226923373 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7fcff006de30 0x7fcff00702e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd008065980 tx=0x7fcffc035040 comp rx=0 tx=0).stop 2024-09-19T06:43:26.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.111+0000 7fd00e27b640 1 -- 172.21.15.99:0/3226923373 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd0080fb810 msgr2=0x7fd00810e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:26.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.111+0000 7fd00e27b640 1 --2- 172.21.15.99:0/3226923373 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd0080fb810 0x7fd00810e240 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fcff800b790 tx=0x7fcff80091d0 comp rx=0 tx=0).stop 2024-09-19T06:43:26.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.111+0000 7fd00e27b640 1 -- 172.21.15.99:0/3226923373 shutdown_connections 2024-09-19T06:43:26.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.111+0000 7fd00e27b640 1 --2- 172.21.15.99:0/3226923373 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7fcff006de30 0x7fcff00702e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:26.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.111+0000 7fd00e27b640 1 --2- 172.21.15.99:0/3226923373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0080fcf80 0x7fd00810e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:26.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.111+0000 7fd00e27b640 1 --2- 172.21.15.99:0/3226923373 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd0080fb810 0x7fd00810e240 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:26.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.111+0000 7fd00e27b640 1 -- 172.21.15.99:0/3226923373 >> 172.21.15.99:0/3226923373 conn(0x7fd0080723b0 msgr2=0x7fd0080fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:26.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.111+0000 7fd00e27b640 1 -- 172.21.15.99:0/3226923373 shutdown_connections 2024-09-19T06:43:26.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.111+0000 7fd00e27b640 1 -- 172.21.15.99:0/3226923373 wait complete. 2024-09-19T06:43:26.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.192+0000 7fd2c3f58640 1 -- 172.21.15.99:0/4004864869 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd2bc065300 msgr2=0x7fd2bc0656d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:26.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.192+0000 7fd2c3f58640 1 --2- 172.21.15.99:0/4004864869 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd2bc065300 0x7fd2bc0656d0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd2b80048d0 tx=0x7fd2b8009da0 comp rx=0 tx=0).stop 2024-09-19T06:43:26.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.192+0000 7fd2c3f58640 1 -- 172.21.15.99:0/4004864869 shutdown_connections 2024-09-19T06:43:26.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.192+0000 7fd2c3f58640 1 --2- 172.21.15.99:0/4004864869 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2bc065c10 0x7fd2bc0fe0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:26.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.192+0000 7fd2c3f58640 1 --2- 172.21.15.99:0/4004864869 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd2bc065300 0x7fd2bc0656d0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:26.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.192+0000 7fd2c3f58640 1 -- 172.21.15.99:0/4004864869 >> 172.21.15.99:0/4004864869 conn(0x7fd2bc0723b0 msgr2=0x7fd2bc0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:26.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.192+0000 7fd2c3f58640 1 -- 172.21.15.99:0/4004864869 shutdown_connections 2024-09-19T06:43:26.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.192+0000 7fd2c3f58640 1 -- 172.21.15.99:0/4004864869 wait complete. 2024-09-19T06:43:26.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.193+0000 7fd2c3f58640 1 Processor -- start 2024-09-19T06:43:26.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.193+0000 7fd2c3f58640 1 -- start start 2024-09-19T06:43:26.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.193+0000 7fd2c3f58640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd2bc065300 0x7fd2bc113190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:26.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.193+0000 7fd2c3f58640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2bc065c10 0x7fd2bc1136d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:26.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.193+0000 7fd2c3f58640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2bc113cd0 con 0x7fd2bc065300 2024-09-19T06:43:26.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.193+0000 7fd2c3f58640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2bc10d110 con 0x7fd2bc065c10 2024-09-19T06:43:26.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.193+0000 7fd2c1cf4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd2bc065300 0x7fd2bc113190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:26.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.193+0000 7fd2c1cf4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd2bc065300 0x7fd2bc113190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42186/0 (socket says 172.21.15.99:42186) 2024-09-19T06:43:26.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.193+0000 7fd2c1cf4640 1 -- 172.21.15.99:0/2148062175 learned_addr learned my addr 172.21.15.99:0/2148062175 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:43:26.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.193+0000 7fd2c14f3640 1 --2- 172.21.15.99:0/2148062175 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2bc065c10 0x7fd2bc1136d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:26.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.193+0000 7fd2c1cf4640 1 -- 172.21.15.99:0/2148062175 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2bc065c10 msgr2=0x7fd2bc1136d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:26.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.193+0000 7fd2c1cf4640 1 --2- 172.21.15.99:0/2148062175 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2bc065c10 0x7fd2bc1136d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:26.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.193+0000 7fd2c1cf4640 1 -- 172.21.15.99:0/2148062175 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2b8005040 con 0x7fd2bc065300 2024-09-19T06:43:26.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.194+0000 7fd2c1cf4640 1 --2- 172.21.15.99:0/2148062175 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd2bc065300 0x7fd2bc113190 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fd2b8000c00 tx=0x7fd2b8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:26.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.194+0000 7fd2b27fc640 1 -- 172.21.15.99:0/2148062175 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2b8038070 con 0x7fd2bc065300 2024-09-19T06:43:26.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.194+0000 7fd2c3f58640 1 -- 172.21.15.99:0/2148062175 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2bc10d390 con 0x7fd2bc065300 2024-09-19T06:43:26.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.194+0000 7fd2b27fc640 1 -- 172.21.15.99:0/2148062175 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd2b802ade0 con 0x7fd2bc065300 2024-09-19T06:43:26.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.194+0000 7fd2b27fc640 1 -- 172.21.15.99:0/2148062175 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2b802c7e0 con 0x7fd2bc065300 2024-09-19T06:43:26.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.194+0000 7fd2c3f58640 1 -- 172.21.15.99:0/2148062175 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2bc10d850 con 0x7fd2bc065300 2024-09-19T06:43:26.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.195+0000 7fd2c3f58640 1 -- 172.21.15.99:0/2148062175 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2bc0fdce0 con 0x7fd2bc065300 2024-09-19T06:43:26.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.195+0000 7fd2b27fc640 1 -- 172.21.15.99:0/2148062175 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 34) v1 ==== 92273+0+0 (secure 0 0 0) 0x7fd2b8030020 con 0x7fd2bc065300 2024-09-19T06:43:26.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.196+0000 7fd2b27fc640 1 --2- 172.21.15.99:0/2148062175 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7fd2a806de30 0x7fd2a80702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:26.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.196+0000 7fd2b27fc640 1 -- 172.21.15.99:0/2148062175 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6066+0+0 (secure 0 0 0) 0x7fd2b80ad440 con 0x7fd2bc065300 2024-09-19T06:43:26.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.196+0000 7fd2c14f3640 1 --2- 172.21.15.99:0/2148062175 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7fd2a806de30 0x7fd2a80702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:26.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.196+0000 7fd2c14f3640 1 --2- 172.21.15.99:0/2148062175 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7fd2a806de30 0x7fd2a80702e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc10ea50 tx=0x7fd2ac00b040 comp rx=0 tx=0).ready entity=mgr.14658 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:26.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.204+0000 7fd2b27fc640 1 -- 172.21.15.99:0/2148062175 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7fd2b8076e80 con 0x7fd2bc065300 2024-09-19T06:43:26.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.392+0000 7fd2c3f58640 1 -- 172.21.15.99:0/2148062175 --> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd2bc04b750 con 0x7fd2a806de30 2024-09-19T06:43:26.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.393+0000 7fd2b27fc640 1 -- 172.21.15.99:0/2148062175 <== mgr.14658 v2:172.21.15.99:6800/3542536515 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fd2bc04b750 con 0x7fd2a806de30 2024-09-19T06:43:26.396 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:43:26.396 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T06:43:26.396 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": true, 2024-09-19T06:43:26.396 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T06:43:26.397 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [ 2024-09-19T06:43:26.397 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr" 2024-09-19T06:43:26.397 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-19T06:43:26.397 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": "2/21 daemons upgraded", 2024-09-19T06:43:26.397 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "Currently upgrading mon daemons", 2024-09-19T06:43:26.397 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-09-19T06:43:26.397 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:43:26.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.395+0000 7fd2c3f58640 1 -- 172.21.15.99:0/2148062175 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7fd2a806de30 msgr2=0x7fd2a80702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:26.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.395+0000 7fd2c3f58640 1 --2- 172.21.15.99:0/2148062175 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7fd2a806de30 0x7fd2a80702e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc10ea50 tx=0x7fd2ac00b040 comp rx=0 tx=0).stop 2024-09-19T06:43:26.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.395+0000 7fd2c3f58640 1 -- 172.21.15.99:0/2148062175 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd2bc065300 msgr2=0x7fd2bc113190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:26.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.395+0000 7fd2c3f58640 1 --2- 172.21.15.99:0/2148062175 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd2bc065300 0x7fd2bc113190 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fd2b8000c00 tx=0x7fd2b8009da0 comp rx=0 tx=0).stop 2024-09-19T06:43:26.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.395+0000 7fd2c3f58640 1 -- 172.21.15.99:0/2148062175 shutdown_connections 2024-09-19T06:43:26.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.395+0000 7fd2c3f58640 1 --2- 172.21.15.99:0/2148062175 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7fd2a806de30 0x7fd2a80702e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:26.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.395+0000 7fd2c3f58640 1 --2- 172.21.15.99:0/2148062175 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd2bc065c10 0x7fd2bc1136d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:26.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.396+0000 7fd2c3f58640 1 --2- 172.21.15.99:0/2148062175 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd2bc065300 0x7fd2bc113190 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:26.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.396+0000 7fd2c3f58640 1 -- 172.21.15.99:0/2148062175 >> 172.21.15.99:0/2148062175 conn(0x7fd2bc0723b0 msgr2=0x7fd2bc105420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:26.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.396+0000 7fd2c3f58640 1 -- 172.21.15.99:0/2148062175 shutdown_connections 2024-09-19T06:43:26.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.396+0000 7fd2c3f58640 1 -- 172.21.15.99:0/2148062175 wait complete. 2024-09-19T06:43:26.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.474+0000 7f8a948bb640 1 -- 172.21.15.99:0/3053822365 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a90102ed0 msgr2=0x7f8a900fc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:26.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.474+0000 7f8a948bb640 1 --2- 172.21.15.99:0/3053822365 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a90102ed0 0x7f8a900fc590 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f8a840048d0 tx=0x7f8a84009da0 comp rx=0 tx=0).stop 2024-09-19T06:43:26.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.474+0000 7f8a948bb640 1 -- 172.21.15.99:0/3053822365 shutdown_connections 2024-09-19T06:43:26.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.474+0000 7f8a948bb640 1 --2- 172.21.15.99:0/3053822365 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a90102ed0 0x7f8a900fc590 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:26.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.474+0000 7f8a948bb640 1 --2- 172.21.15.99:0/3053822365 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a90102530 0x7f8a90102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:26.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.474+0000 7f8a948bb640 1 -- 172.21.15.99:0/3053822365 >> 172.21.15.99:0/3053822365 conn(0x7f8a900f8110 msgr2=0x7f8a900fa520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:26.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.474+0000 7f8a948bb640 1 -- 172.21.15.99:0/3053822365 shutdown_connections 2024-09-19T06:43:26.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.474+0000 7f8a948bb640 1 -- 172.21.15.99:0/3053822365 wait complete. 2024-09-19T06:43:26.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.475+0000 7f8a948bb640 1 Processor -- start 2024-09-19T06:43:26.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.475+0000 7f8a948bb640 1 -- start start 2024-09-19T06:43:26.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.475+0000 7f8a948bb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a90102530 0x7f8a901131f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:26.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.475+0000 7f8a948bb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a90102ed0 0x7f8a90113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:26.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.475+0000 7f8a948bb640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a90113d30 con 0x7f8a90102530 2024-09-19T06:43:26.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.475+0000 7f8a948bb640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9010d170 con 0x7f8a90102ed0 2024-09-19T06:43:26.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.475+0000 7f8a8e59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a90102530 0x7f8a901131f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:26.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.475+0000 7f8a8e59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a90102530 0x7f8a901131f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42202/0 (socket says 172.21.15.99:42202) 2024-09-19T06:43:26.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.475+0000 7f8a8e59c640 1 -- 172.21.15.99:0/4219718389 learned_addr learned my addr 172.21.15.99:0/4219718389 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:43:26.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.475+0000 7f8a8dd9b640 1 --2- 172.21.15.99:0/4219718389 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a90102ed0 0x7f8a90113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:26.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.475+0000 7f8a8e59c640 1 -- 172.21.15.99:0/4219718389 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a90102ed0 msgr2=0x7f8a90113730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:26.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.475+0000 7f8a8e59c640 1 --2- 172.21.15.99:0/4219718389 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a90102ed0 0x7f8a90113730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:26.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.475+0000 7f8a8e59c640 1 -- 172.21.15.99:0/4219718389 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a84005040 con 0x7f8a90102530 2024-09-19T06:43:26.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.475+0000 7f8a8e59c640 1 --2- 172.21.15.99:0/4219718389 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a90102530 0x7f8a901131f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f8a80002a50 tx=0x7f8a80004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:26.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.476+0000 7f8a7effd640 1 -- 172.21.15.99:0/4219718389 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a80007c30 con 0x7f8a90102530 2024-09-19T06:43:26.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.476+0000 7f8a7effd640 1 -- 172.21.15.99:0/4219718389 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8a8000f040 con 0x7f8a90102530 2024-09-19T06:43:26.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.476+0000 7f8a948bb640 1 -- 172.21.15.99:0/4219718389 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a9010d450 con 0x7f8a90102530 2024-09-19T06:43:26.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.476+0000 7f8a7effd640 1 -- 172.21.15.99:0/4219718389 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a8000dad0 con 0x7f8a90102530 2024-09-19T06:43:26.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.476+0000 7f8a948bb640 1 -- 172.21.15.99:0/4219718389 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a9010d9c0 con 0x7f8a90102530 2024-09-19T06:43:26.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.477+0000 7f8a948bb640 1 -- 172.21.15.99:0/4219718389 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a900fdcb0 con 0x7f8a90102530 2024-09-19T06:43:26.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.477+0000 7f8a7effd640 1 -- 172.21.15.99:0/4219718389 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 34) v1 ==== 92273+0+0 (secure 0 0 0) 0x7f8a8000dc30 con 0x7f8a90102530 2024-09-19T06:43:26.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.478+0000 7f8a7effd640 1 --2- 172.21.15.99:0/4219718389 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f8a7806df00 0x7f8a780703b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:26.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.478+0000 7f8a7effd640 1 -- 172.21.15.99:0/4219718389 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6066+0+0 (secure 0 0 0) 0x7f8a8008d650 con 0x7f8a90102530 2024-09-19T06:43:26.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.478+0000 7f8a8dd9b640 1 --2- 172.21.15.99:0/4219718389 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f8a7806df00 0x7f8a780703b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:26.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.479+0000 7f8a8dd9b640 1 --2- 172.21.15.99:0/4219718389 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f8a7806df00 0x7f8a780703b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8a840048a0 tx=0x7f8a84035040 comp rx=0 tx=0).ready entity=mgr.14658 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:26.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.482+0000 7f8a7effd640 1 -- 172.21.15.99:0/4219718389 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186034 (secure 0 0 0) 0x7f8a80056fc0 con 0x7f8a90102530 2024-09-19T06:43:26.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.714+0000 7f8a948bb640 1 -- 172.21.15.99:0/4219718389 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f8a9004b7b0 con 0x7f8a90102530 2024-09-19T06:43:26.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.714+0000 7f8a7effd640 1 -- 172.21.15.99:0/4219718389 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f8a8005a680 con 0x7f8a90102530 2024-09-19T06:43:26.716 INFO:teuthology.orchestra.run.smithi099.stdout:HEALTH_OK 2024-09-19T06:43:26.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.716+0000 7f8a948bb640 1 -- 172.21.15.99:0/4219718389 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f8a7806df00 msgr2=0x7f8a780703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:26.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.716+0000 7f8a948bb640 1 --2- 172.21.15.99:0/4219718389 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f8a7806df00 0x7f8a780703b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8a840048a0 tx=0x7f8a84035040 comp rx=0 tx=0).stop 2024-09-19T06:43:26.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.716+0000 7f8a948bb640 1 -- 172.21.15.99:0/4219718389 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a90102530 msgr2=0x7f8a901131f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:26.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.716+0000 7f8a948bb640 1 --2- 172.21.15.99:0/4219718389 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a90102530 0x7f8a901131f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f8a80002a50 tx=0x7f8a80004600 comp rx=0 tx=0).stop 2024-09-19T06:43:26.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.716+0000 7f8a948bb640 1 -- 172.21.15.99:0/4219718389 shutdown_connections 2024-09-19T06:43:26.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.716+0000 7f8a948bb640 1 --2- 172.21.15.99:0/4219718389 >> [v2:172.21.15.99:6800/3542536515,v1:172.21.15.99:6801/3542536515] conn(0x7f8a7806df00 0x7f8a780703b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:26.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.716+0000 7f8a948bb640 1 --2- 172.21.15.99:0/4219718389 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a90102ed0 0x7f8a90113730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:26.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.716+0000 7f8a948bb640 1 --2- 172.21.15.99:0/4219718389 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a90102530 0x7f8a901131f0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:26.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.716+0000 7f8a948bb640 1 -- 172.21.15.99:0/4219718389 >> 172.21.15.99:0/4219718389 conn(0x7f8a900f8110 msgr2=0x7f8a900f91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:26.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.716+0000 7f8a948bb640 1 -- 172.21.15.99:0/4219718389 shutdown_connections 2024-09-19T06:43:26.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:26.717+0000 7f8a948bb640 1 -- 172.21.15.99:0/4219718389 wait complete. 2024-09-19T06:43:26.979 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:26 smithi099 ceph-mon[27651]: pgmap v50: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-19T06:43:26.980 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:26 smithi099 ceph-mon[27651]: from='client.14780 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:43:26.980 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:26 smithi099 ceph-mon[27651]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:43:26.980 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:26 smithi099 ceph-mon[27651]: Upgrade: Target is version 19.1.1-361-g2f599a46 (squid) 2024-09-19T06:43:26.980 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:26 smithi099 ceph-mon[27651]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, digests ['quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e'] 2024-09-19T06:43:26.980 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:26 smithi099 ceph-mon[27651]: Upgrade: Setting container_image for all mgr 2024-09-19T06:43:26.980 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:26 smithi099 ceph-mon[27651]: from='client.? 172.21.15.99:0/3291209065' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:43:26.980 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:26 smithi099 ceph-mon[27651]: from='client.? 172.21.15.99:0/3226923373' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:43:26.980 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:26 smithi099 ceph-mon[27651]: from='client.? 172.21.15.99:0/4219718389' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T06:43:27.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:26 smithi117 ceph-mon[34564]: pgmap v50: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-19T06:43:27.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:26 smithi117 ceph-mon[34564]: from='client.14780 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:43:27.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:26 smithi117 ceph-mon[34564]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:43:27.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:26 smithi117 ceph-mon[34564]: Upgrade: Target is version 19.1.1-361-g2f599a46 (squid) 2024-09-19T06:43:27.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:26 smithi117 ceph-mon[34564]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, digests ['quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e'] 2024-09-19T06:43:27.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:26 smithi117 ceph-mon[34564]: Upgrade: Setting container_image for all mgr 2024-09-19T06:43:27.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:26 smithi117 ceph-mon[34564]: from='client.? 172.21.15.99:0/3291209065' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:43:27.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:26 smithi117 ceph-mon[34564]: from='client.? 172.21.15.99:0/3226923373' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:43:27.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:26 smithi117 ceph-mon[34564]: from='client.? 172.21.15.99:0/4219718389' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T06:43:27.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:27 smithi099 ceph-mon[27651]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:43:27.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:27 smithi099 ceph-mon[27651]: Upgrade: Updating mon.smithi099 2024-09-19T06:43:27.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:27 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:43:27.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:27 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T06:43:27.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:27 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T06:43:27.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:27 smithi099 ceph-mon[27651]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:43:28.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:27 smithi117 ceph-mon[34564]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:43:28.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:27 smithi117 ceph-mon[34564]: Upgrade: Updating mon.smithi099 2024-09-19T06:43:28.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:27 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:43:28.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:27 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T06:43:28.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:27 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T06:43:28.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:27 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:43:28.884 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:28 smithi099 systemd[1]: Stopping Ceph mon.smithi099 for a73eb958-7650-11ef-bceb-c7b262605968... 2024-09-19T06:43:28.885 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:28 smithi099 ceph-mon[27651]: Deploying daemon mon.smithi099 on smithi099 2024-09-19T06:43:28.885 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:28 smithi099 ceph-mon[27651]: pgmap v51: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-19T06:43:29.157 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:28 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-mon-smithi099[27647]: 2024-09-19T06:43:28.883+0000 7fb96d68d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi099 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:43:29.158 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:28 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-mon-smithi099[27647]: 2024-09-19T06:43:28.883+0000 7fb96d68d640 -1 mon.smithi099@0(leader) e2 *** Got Signal Terminated *** 2024-09-19T06:43:29.158 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:28 smithi099 podman[96860]: 2024-09-19 06:43:28.965741722 +0000 UTC m=+0.210973514 container died 7375c241d06759b2dc0543cd12b20d4bfcb158602f94adb764007b9dc99ec803 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-mon-smithi099, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=quincy-6e06d1e, org.label-schema.build-date=20240731) 2024-09-19T06:43:29.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:28 smithi117 ceph-mon[34564]: Deploying daemon mon.smithi099 on smithi099 2024-09-19T06:43:29.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:28 smithi117 ceph-mon[34564]: pgmap v51: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-19T06:43:29.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:29 smithi099 podman[96860]: 2024-09-19 06:43:29.316504734 +0000 UTC m=+0.561736524 container cleanup 7375c241d06759b2dc0543cd12b20d4bfcb158602f94adb764007b9dc99ec803 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-mon-smithi099, RELEASE=quincy-6e06d1e, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2) 2024-09-19T06:43:29.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:29 smithi099 bash[96860]: ceph-a73eb958-7650-11ef-bceb-c7b262605968-mon-smithi099 2024-09-19T06:43:29.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:29 smithi099 podman[96872]: 2024-09-19 06:43:29.618282904 +0000 UTC m=+0.649355905 container remove 7375c241d06759b2dc0543cd12b20d4bfcb158602f94adb764007b9dc99ec803 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-mon-smithi099, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-6e06d1e, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-19T06:43:29.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:29 smithi099 systemd[1]: ceph-a73eb958-7650-11ef-bceb-c7b262605968@mon.smithi099.service: Deactivated successfully. 2024-09-19T06:43:29.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:29 smithi099 systemd[1]: Stopped Ceph mon.smithi099 for a73eb958-7650-11ef-bceb-c7b262605968. 2024-09-19T06:43:29.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:29 smithi099 systemd[1]: ceph-a73eb958-7650-11ef-bceb-c7b262605968@mon.smithi099.service: Consumed 10.905s CPU time. 2024-09-19T06:43:30.352 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 systemd[1]: Starting Ceph mon.smithi099 for a73eb958-7650-11ef-bceb-c7b262605968... 2024-09-19T06:43:30.352 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 podman[97012]: 2024-09-19 06:43:30.112348709 +0000 UTC m=+0.015995795 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:43:30.352 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 podman[97012]: 2024-09-19 06:43:30.244725507 +0000 UTC m=+0.148372581 container create ffe067438824ccd8af87fa6b0d5cc583e61608ecd5ff04a978f9f68499a4a2a9 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-mon-smithi099, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-19T06:43:30.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 podman[97012]: 2024-09-19 06:43:30.46424209 +0000 UTC m=+0.367889181 container init ffe067438824ccd8af87fa6b0d5cc583e61608ecd5ff04a978f9f68499a4a2a9 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-mon-smithi099, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-19T06:43:30.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 podman[97012]: 2024-09-19 06:43:30.467795802 +0000 UTC m=+0.371442884 container start ffe067438824ccd8af87fa6b0d5cc583e61608ecd5ff04a978f9f68499a4a2a9 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-mon-smithi099, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731) 2024-09-19T06:43:30.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: set uid:gid to 167:167 (ceph:ceph) 2024-09-19T06:43:30.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable), process ceph-mon, pid 2 2024-09-19T06:43:30.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: pidfile_write: ignore empty --pid-file 2024-09-19T06:43:30.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: load: jerasure load: lrc 2024-09-19T06:43:30.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: RocksDB version: 7.9.2 2024-09-19T06:43:30.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Git sha 0 2024-09-19T06:43:30.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Compile date 2024-09-18 16:29:48 2024-09-19T06:43:30.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: DB SUMMARY 2024-09-19T06:43:30.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: DB Session ID: JGPHSB8C2QAB016SJ5Q3 2024-09-19T06:43:30.958 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: CURRENT file: CURRENT 2024-09-19T06:43:30.958 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: IDENTITY file: IDENTITY 2024-09-19T06:43:30.958 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1173 Bytes 2024-09-19T06:43:30.958 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi099/store.db dir, Total Num: 1, files: 000033.sst 2024-09-19T06:43:30.958 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi099/store.db: 000031.log size: 464104 ; 2024-09-19T06:43:30.958 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.error_if_exists: 0 2024-09-19T06:43:30.958 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.create_if_missing: 0 2024-09-19T06:43:30.958 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.paranoid_checks: 1 2024-09-19T06:43:30.958 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-19T06:43:30.958 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-19T06:43:30.958 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-19T06:43:30.958 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.env: 0x55eeb9c58940 2024-09-19T06:43:30.958 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.fs: PosixFileSystem 2024-09-19T06:43:30.958 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.info_log: 0x55eebb8138c0 2024-09-19T06:43:30.959 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.max_file_opening_threads: 16 2024-09-19T06:43:30.960 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.statistics: (nil) 2024-09-19T06:43:30.960 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.use_fsync: 0 2024-09-19T06:43:30.960 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.max_log_file_size: 0 2024-09-19T06:43:30.960 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-19T06:43:30.960 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-19T06:43:30.961 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.keep_log_file_num: 1000 2024-09-19T06:43:30.961 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.recycle_log_file_num: 0 2024-09-19T06:43:30.961 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.allow_fallocate: 1 2024-09-19T06:43:30.961 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.allow_mmap_reads: 0 2024-09-19T06:43:30.961 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.allow_mmap_writes: 0 2024-09-19T06:43:30.961 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.use_direct_reads: 0 2024-09-19T06:43:30.961 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-19T06:43:30.961 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.create_missing_column_families: 0 2024-09-19T06:43:30.961 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.db_log_dir: 2024-09-19T06:43:30.961 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.wal_dir: 2024-09-19T06:43:30.961 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-19T06:43:30.961 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-19T06:43:30.961 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-19T06:43:30.962 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-19T06:43:30.962 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-19T06:43:30.962 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-19T06:43:30.962 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.advise_random_on_open: 1 2024-09-19T06:43:30.962 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.db_write_buffer_size: 0 2024-09-19T06:43:30.962 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.write_buffer_manager: 0x55eebb822dc0 2024-09-19T06:43:30.962 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-19T06:43:30.962 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-19T06:43:30.962 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-19T06:43:30.962 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.rate_limiter: (nil) 2024-09-19T06:43:30.962 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-19T06:43:30.962 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.wal_recovery_mode: 2 2024-09-19T06:43:30.962 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.enable_thread_tracking: 0 2024-09-19T06:43:30.962 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.enable_pipelined_write: 0 2024-09-19T06:43:30.963 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.unordered_write: 0 2024-09-19T06:43:30.963 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-19T06:43:30.963 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-19T06:43:30.963 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-19T06:43:30.963 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-19T06:43:30.963 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.row_cache: None 2024-09-19T06:43:30.963 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.wal_filter: None 2024-09-19T06:43:30.963 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-19T06:43:30.963 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.allow_ingest_behind: 0 2024-09-19T06:43:30.963 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.two_write_queues: 0 2024-09-19T06:43:30.963 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.manual_wal_flush: 0 2024-09-19T06:43:30.963 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.wal_compression: 0 2024-09-19T06:43:30.963 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.atomic_flush: 0 2024-09-19T06:43:30.964 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-19T06:43:30.964 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-19T06:43:30.964 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-19T06:43:30.964 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.log_readahead_size: 0 2024-09-19T06:43:30.964 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-19T06:43:30.964 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.best_efforts_recovery: 0 2024-09-19T06:43:30.964 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-19T06:43:30.964 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-19T06:43:30.964 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.allow_data_in_errors: 0 2024-09-19T06:43:30.964 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.db_host_id: __hostname__ 2024-09-19T06:43:30.964 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-19T06:43:30.964 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.max_background_jobs: 2 2024-09-19T06:43:30.964 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.max_background_compactions: -1 2024-09-19T06:43:30.964 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.max_subcompactions: 1 2024-09-19T06:43:30.965 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-19T06:43:30.965 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-19T06:43:30.965 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-19T06:43:30.965 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.max_total_wal_size: 0 2024-09-19T06:43:30.965 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-19T06:43:30.965 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-19T06:43:30.965 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-19T06:43:30.965 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-19T06:43:30.965 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.max_open_files: -1 2024-09-19T06:43:30.965 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.bytes_per_sync: 0 2024-09-19T06:43:30.965 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-19T06:43:30.965 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-19T06:43:30.965 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.compaction_readahead_size: 0 2024-09-19T06:43:30.966 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.max_background_flushes: -1 2024-09-19T06:43:30.966 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Compression algorithms supported: 2024-09-19T06:43:30.966 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: kZSTD supported: 0 2024-09-19T06:43:30.966 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: kXpressCompression supported: 0 2024-09-19T06:43:30.966 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: kBZip2Compression supported: 0 2024-09-19T06:43:30.966 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-19T06:43:30.966 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: kLZ4Compression supported: 1 2024-09-19T06:43:30.966 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: kZlibCompression supported: 1 2024-09-19T06:43:30.966 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: kLZ4HCCompression supported: 1 2024-09-19T06:43:30.966 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: kSnappyCompression supported: 1 2024-09-19T06:43:30.966 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-19T06:43:30.966 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-19T06:43:30.966 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi099/store.db/MANIFEST-000015 2024-09-19T06:43:30.966 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-19T06:43:30.967 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-19T06:43:30.967 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.merge_operator: 2024-09-19T06:43:30.967 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.compaction_filter: None 2024-09-19T06:43:30.967 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.compaction_filter_factory: None 2024-09-19T06:43:30.967 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.sst_partitioner_factory: None 2024-09-19T06:43:30.967 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-19T06:43:30.967 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-19T06:43:30.967 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55eebb813520) 2024-09-19T06:43:30.967 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: cache_index_and_filter_blocks: 1 2024-09-19T06:43:30.967 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-19T06:43:30.967 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-19T06:43:30.967 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: pin_top_level_index_and_filter: 1 2024-09-19T06:43:30.968 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: index_type: 0 2024-09-19T06:43:30.968 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: data_block_index_type: 0 2024-09-19T06:43:30.968 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: index_shortening: 1 2024-09-19T06:43:30.968 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-19T06:43:30.968 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: checksum: 4 2024-09-19T06:43:30.968 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: no_block_cache: 0 2024-09-19T06:43:30.968 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: block_cache: 0x55eebb8071f0 2024-09-19T06:43:30.968 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: block_cache_name: BinnedLRUCache 2024-09-19T06:43:30.969 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: block_cache_options: 2024-09-19T06:43:30.969 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: capacity : 536870912 2024-09-19T06:43:30.969 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: num_shard_bits : 4 2024-09-19T06:43:30.969 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: strict_capacity_limit : 0 2024-09-19T06:43:30.969 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: high_pri_pool_ratio: 0.000 2024-09-19T06:43:30.969 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: block_cache_compressed: (nil) 2024-09-19T06:43:30.969 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: persistent_cache: (nil) 2024-09-19T06:43:30.969 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: block_size: 4096 2024-09-19T06:43:30.969 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: block_size_deviation: 10 2024-09-19T06:43:30.969 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: block_restart_interval: 16 2024-09-19T06:43:30.969 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: index_block_restart_interval: 1 2024-09-19T06:43:30.969 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: metadata_block_size: 4096 2024-09-19T06:43:30.969 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: partition_filters: 0 2024-09-19T06:43:30.969 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: use_delta_encoding: 1 2024-09-19T06:43:30.970 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: filter_policy: bloomfilter 2024-09-19T06:43:30.970 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: whole_key_filtering: 1 2024-09-19T06:43:30.970 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: verify_compression: 0 2024-09-19T06:43:30.970 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: read_amp_bytes_per_bit: 0 2024-09-19T06:43:30.970 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: format_version: 5 2024-09-19T06:43:30.970 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: enable_index_compression: 1 2024-09-19T06:43:30.970 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: block_align: 0 2024-09-19T06:43:30.970 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: max_auto_readahead_size: 262144 2024-09-19T06:43:30.970 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: prepopulate_block_cache: 0 2024-09-19T06:43:30.970 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: initial_auto_readahead_size: 8192 2024-09-19T06:43:30.970 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: num_file_reads_for_auto_readahead: 2 2024-09-19T06:43:30.971 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.write_buffer_size: 33554432 2024-09-19T06:43:30.971 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.max_write_buffer_number: 2 2024-09-19T06:43:30.971 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.compression: NoCompression 2024-09-19T06:43:30.971 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.bottommost_compression: Disabled 2024-09-19T06:43:30.971 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.prefix_extractor: nullptr 2024-09-19T06:43:30.971 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-19T06:43:30.971 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.num_levels: 7 2024-09-19T06:43:30.971 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-19T06:43:30.971 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-19T06:43:30.971 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-19T06:43:30.971 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-19T06:43:30.971 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-19T06:43:30.972 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-19T06:43:30.972 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-19T06:43:30.972 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-19T06:43:30.972 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-19T06:43:30.972 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-19T06:43:30.972 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-19T06:43:30.972 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-19T06:43:30.972 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-19T06:43:30.972 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.compression_opts.level: 32767 2024-09-19T06:43:30.972 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.compression_opts.strategy: 0 2024-09-19T06:43:30.972 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-19T06:43:30.972 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-19T06:43:30.972 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-19T06:43:30.973 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-19T06:43:30.973 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.compression_opts.enabled: false 2024-09-19T06:43:30.973 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-19T06:43:30.973 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-19T06:43:30.973 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-19T06:43:30.973 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-19T06:43:30.973 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.target_file_size_base: 67108864 2024-09-19T06:43:30.973 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-19T06:43:30.973 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-19T06:43:30.973 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-19T06:43:30.973 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-19T06:43:30.973 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-19T06:43:30.973 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-19T06:43:30.974 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-19T06:43:30.974 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-19T06:43:30.974 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-19T06:43:30.974 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-19T06:43:30.974 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-19T06:43:30.974 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-19T06:43:30.974 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-19T06:43:30.974 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-19T06:43:30.974 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.arena_block_size: 1048576 2024-09-19T06:43:30.974 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-19T06:43:30.974 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-19T06:43:30.974 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.disable_auto_compactions: 0 2024-09-19T06:43:30.974 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-19T06:43:30.975 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-19T06:43:30.975 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-19T06:43:30.975 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-19T06:43:30.975 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-19T06:43:30.975 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-19T06:43:30.975 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-19T06:43:30.975 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-19T06:43:30.975 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-19T06:43:30.975 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-19T06:43:30.975 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-19T06:43:30.975 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.inplace_update_support: 0 2024-09-19T06:43:30.975 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-19T06:43:30.975 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-19T06:43:30.976 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-19T06:43:30.976 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-19T06:43:30.976 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.bloom_locality: 0 2024-09-19T06:43:30.976 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.max_successive_merges: 0 2024-09-19T06:43:30.976 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-19T06:43:30.976 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.paranoid_file_checks: 0 2024-09-19T06:43:30.976 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.force_consistency_checks: 1 2024-09-19T06:43:30.976 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.report_bg_io_stats: 0 2024-09-19T06:43:30.976 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.ttl: 2592000 2024-09-19T06:43:30.976 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-19T06:43:30.976 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-19T06:43:30.976 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-19T06:43:30.977 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.enable_blob_files: false 2024-09-19T06:43:30.977 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.min_blob_size: 0 2024-09-19T06:43:30.977 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.blob_file_size: 268435456 2024-09-19T06:43:30.977 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-19T06:43:30.977 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-19T06:43:30.977 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-19T06:43:30.977 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-19T06:43:30.977 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-19T06:43:30.977 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.blob_file_starting_level: 0 2024-09-19T06:43:30.977 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-19T06:43:30.977 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 33.sst 2024-09-19T06:43:30.977 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-19T06:43:30.977 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi099/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 35, last_sequence is 12061, log_number is 31,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-19T06:43:30.978 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 31 2024-09-19T06:43:30.978 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 941c0389-fc11-4bce-91b4-5987fd6cc181 2024-09-19T06:43:30.978 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726728210494054, "job": 1, "event": "recovery_started", "wal_files": [31]} 2024-09-19T06:43:30.978 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #31 mode 2 2024-09-19T06:43:30.978 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726728210496251, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 36, "file_size": 458262, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12062, "largest_seqno": 12463, "table_properties": {"data_size": 455597, "index_size": 1113, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 517, "raw_key_size": 4475, "raw_average_key_size": 23, "raw_value_size": 451501, "raw_average_value_size": 2401, "num_data_blocks": 50, "num_entries": 188, "num_filter_entries": 188, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726728210, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "941c0389-fc11-4bce-91b4-5987fd6cc181", "db_session_id": "JGPHSB8C2QAB016SJ5Q3", "orig_file_number": 36, "seqno_to_time_mapping": "N/A"}} 2024-09-19T06:43:30.978 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726728210496349, "job": 1, "event": "recovery_finished"} 2024-09-19T06:43:30.978 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: [db/version_set.cc:5047] Creating manifest 38 2024-09-19T06:43:30.978 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-19T06:43:30.978 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi099/store.db/000031.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-19T06:43:30.978 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55eebb834e00 2024-09-19T06:43:30.978 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: DB pointer 0x55eebb930000 2024-09-19T06:43:30.978 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-19T06:43:30.978 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-19T06:43:30.979 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: ** DB Stats ** 2024-09-19T06:43:30.979 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T06:43:30.979 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-19T06:43:30.979 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T06:43:30.979 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T06:43:30.979 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-19T06:43:30.979 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T06:43:30.979 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T06:43:30.979 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: 2024-09-19T06:43:30.979 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: ** Compaction Stats [default] ** 2024-09-19T06:43:30.979 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T06:43:30.979 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-19T06:43:30.979 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: L0 1/0 447.52 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 336.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T06:43:30.980 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: L6 1/0 7.01 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-19T06:43:30.980 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Sum 2/0 7.45 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 336.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T06:43:30.980 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 336.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T06:43:30.980 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: 2024-09-19T06:43:30.980 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: ** Compaction Stats [default] ** 2024-09-19T06:43:30.980 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T06:43:30.980 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-19T06:43:30.980 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 336.4 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T06:43:30.980 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: 2024-09-19T06:43:30.980 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-19T06:43:30.980 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: 2024-09-19T06:43:30.980 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T06:43:30.980 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-19T06:43:30.981 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-19T06:43:30.981 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-19T06:43:30.981 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-19T06:43:30.981 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-19T06:43:30.981 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Cumulative compaction: 0.00 GB write, 99.26 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T06:43:30.981 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Interval compaction: 0.00 GB write, 99.26 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T06:43:30.981 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-19T06:43:30.981 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Block cache BinnedLRUCache@0x55eebb8071f0#2 capacity: 512.00 MB usage: 1.80 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-19T06:43:30.981 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.59 KB,0.000113249%) IndexBlock(1,1.20 KB,0.000229478%) Misc(1,0.00 KB,0%) 2024-09-19T06:43:30.981 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: 2024-09-19T06:43:30.981 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-19T06:43:30.981 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: starting mon.smithi099 rank 0 at public addrs [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] at bind addrs [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi099 fsid a73eb958-7650-11ef-bceb-c7b262605968 2024-09-19T06:43:30.982 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: mon.smithi099@-1(???) e2 preinit fsid a73eb958-7650-11ef-bceb-c7b262605968 2024-09-19T06:43:30.982 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: mon.smithi099@-1(???).mds e17 new map 2024-09-19T06:43:30.982 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: mon.smithi099@-1(???).mds e17 print_map 2024-09-19T06:43:30.982 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: e17 2024-09-19T06:43:30.982 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: btime 1970-01-01T00:00:00:000000+0000 2024-09-19T06:43:30.982 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T06:43:30.982 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T06:43:30.982 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: legacy client fscid: 1 2024-09-19T06:43:30.982 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: 2024-09-19T06:43:30.982 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Filesystem 'cephfs' (1) 2024-09-19T06:43:30.982 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: fs_name cephfs 2024-09-19T06:43:30.982 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: epoch 17 2024-09-19T06:43:30.982 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-19T06:43:30.983 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: created 2024-09-19T06:37:40.838146+0000 2024-09-19T06:43:30.983 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: modified 2024-09-19T06:41:18.134083+0000 2024-09-19T06:43:30.983 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: tableserver 0 2024-09-19T06:43:30.983 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: root 0 2024-09-19T06:43:30.983 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: session_timeout 60 2024-09-19T06:43:30.983 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: session_autoclose 300 2024-09-19T06:43:30.983 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: max_file_size 1099511627776 2024-09-19T06:43:30.983 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: max_xattr_size 65536 2024-09-19T06:43:30.983 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: required_client_features {} 2024-09-19T06:43:30.983 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: last_failure 0 2024-09-19T06:43:30.983 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: last_failure_osd_epoch 45 2024-09-19T06:43:30.983 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T06:43:30.983 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: max_mds 2 2024-09-19T06:43:30.983 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: in 0,1 2024-09-19T06:43:30.984 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: up {0=14482,1=24269} 2024-09-19T06:43:30.984 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: failed 2024-09-19T06:43:30.984 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: damaged 2024-09-19T06:43:30.984 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: stopped 2024-09-19T06:43:30.984 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: data_pools [3] 2024-09-19T06:43:30.984 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: metadata_pool 2 2024-09-19T06:43:30.984 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: inline_data disabled 2024-09-19T06:43:30.984 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: balancer 2024-09-19T06:43:30.984 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: bal_rank_mask -1 2024-09-19T06:43:30.984 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: standby_count_wanted 1 2024-09-19T06:43:30.984 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: qdb_cluster leader: 0 members: 2024-09-19T06:43:30.984 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: [mds.cephfs.smithi099.xehbxe{0:14482} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.99:6828/1508711176,v1:172.21.15.99:6829/1508711176] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T06:43:30.984 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: [mds.cephfs.smithi117.nooexo{1:24269} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.117:6824/2367330767,v1:172.21.15.117:6825/2367330767] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T06:43:30.985 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: 2024-09-19T06:43:30.985 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: 2024-09-19T06:43:30.985 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Standby daemons: 2024-09-19T06:43:30.985 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: 2024-09-19T06:43:30.985 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: [mds.cephfs.smithi099.obarqf{-1:14490} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6826/388324528,v1:172.21.15.99:6827/388324528] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T06:43:30.985 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: [mds.cephfs.smithi117.bheqzh{-1:24283} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.117:6826/4072877365,v1:172.21.15.117:6827/4072877365] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T06:43:30.985 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: mon.smithi099@-1(???).osd e47 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-19T06:43:30.985 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: mon.smithi099@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-19T06:43:30.985 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: mon.smithi099@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-19T06:43:30.985 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: mon.smithi099@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-19T06:43:30.985 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 ceph-mon[97031]: mon.smithi099@-1(???).paxosservice(auth 1..21) refresh upgraded, format 0 -> 3 2024-09-19T06:43:30.985 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 bash[97012]: ffe067438824ccd8af87fa6b0d5cc583e61608ecd5ff04a978f9f68499a4a2a9 2024-09-19T06:43:30.985 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:30 smithi099 systemd[1]: Started Ceph mon.smithi099 for a73eb958-7650-11ef-bceb-c7b262605968. 2024-09-19T06:43:32.280 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:31 smithi099 ceph-mon[97031]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mon metadata", "id": "smithi099"}]: dispatch 2024-09-19T06:43:32.281 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:31 smithi099 ceph-mon[97031]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mon metadata", "id": "smithi117"}]: dispatch 2024-09-19T06:43:32.281 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:31 smithi099 ceph-mon[97031]: pgmap v52: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-19T06:43:32.281 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:31 smithi099 ceph-mon[97031]: mon.smithi099 calling monitor election 2024-09-19T06:43:32.281 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:31 smithi099 ceph-mon[97031]: mon.smithi099 is new leader, mons smithi099,smithi117 in quorum (ranks 0,1) 2024-09-19T06:43:32.281 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:31 smithi099 ceph-mon[97031]: monmap epoch 2 2024-09-19T06:43:32.281 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:31 smithi099 ceph-mon[97031]: fsid a73eb958-7650-11ef-bceb-c7b262605968 2024-09-19T06:43:32.281 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:31 smithi099 ceph-mon[97031]: last_changed 2024-09-19T06:33:28.374622+0000 2024-09-19T06:43:32.281 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:31 smithi099 ceph-mon[97031]: created 2024-09-19T06:31:05.093105+0000 2024-09-19T06:43:32.281 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:31 smithi099 ceph-mon[97031]: min_mon_release 17 (quincy) 2024-09-19T06:43:32.281 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:31 smithi099 ceph-mon[97031]: election_strategy: 1 2024-09-19T06:43:32.281 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:31 smithi099 ceph-mon[97031]: 0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.smithi099 2024-09-19T06:43:32.281 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:31 smithi099 ceph-mon[97031]: 1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.smithi117 2024-09-19T06:43:32.281 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:31 smithi099 ceph-mon[97031]: fsmap cephfs:2 {0=cephfs.smithi099.xehbxe=up:active,1=cephfs.smithi117.nooexo=up:active} 2 up:standby 2024-09-19T06:43:32.282 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:31 smithi099 ceph-mon[97031]: osdmap e47: 6 total, 6 up, 6 in 2024-09-19T06:43:32.282 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:31 smithi099 ceph-mon[97031]: mgrmap e34: smithi099.pgvkqi(active, since 100s), standbys: smithi117.ssmkcf 2024-09-19T06:43:32.282 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:31 smithi099 ceph-mon[97031]: overall HEALTH_OK 2024-09-19T06:43:32.282 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:31 smithi099 ceph-mon[97031]: from='mgr.14658 ' entity='' 2024-09-19T06:43:32.282 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:31 smithi099 ceph-mon[97031]: mgrmap e35: smithi099.pgvkqi(active, since 100s), standbys: smithi117.ssmkcf 2024-09-19T06:43:32.282 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:31 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mon metadata", "id": "smithi099"}]: dispatch 2024-09-19T06:43:32.282 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:31 smithi117 ceph-mon[34564]: from='mgr.14658 172.21.15.99:0/3247563575' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mon metadata", "id": "smithi117"}]: dispatch 2024-09-19T06:43:32.282 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:31 smithi117 ceph-mon[34564]: pgmap v52: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-19T06:43:32.282 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:31 smithi117 ceph-mon[34564]: mon.smithi099 calling monitor election 2024-09-19T06:43:32.283 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:31 smithi117 ceph-mon[34564]: mon.smithi099 is new leader, mons smithi099,smithi117 in quorum (ranks 0,1) 2024-09-19T06:43:32.283 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:31 smithi117 ceph-mon[34564]: monmap epoch 2 2024-09-19T06:43:32.283 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:31 smithi117 ceph-mon[34564]: fsid a73eb958-7650-11ef-bceb-c7b262605968 2024-09-19T06:43:32.283 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:31 smithi117 ceph-mon[34564]: last_changed 2024-09-19T06:33:28.374622+0000 2024-09-19T06:43:32.283 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:31 smithi117 ceph-mon[34564]: created 2024-09-19T06:31:05.093105+0000 2024-09-19T06:43:32.283 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:31 smithi117 ceph-mon[34564]: min_mon_release 17 (quincy) 2024-09-19T06:43:32.283 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:31 smithi117 ceph-mon[34564]: election_strategy: 1 2024-09-19T06:43:32.283 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:31 smithi117 ceph-mon[34564]: 0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.smithi099 2024-09-19T06:43:32.283 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:31 smithi117 ceph-mon[34564]: 1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.smithi117 2024-09-19T06:43:32.283 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:31 smithi117 ceph-mon[34564]: fsmap cephfs:2 {0=cephfs.smithi099.xehbxe=up:active,1=cephfs.smithi117.nooexo=up:active} 2 up:standby 2024-09-19T06:43:32.283 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:31 smithi117 ceph-mon[34564]: osdmap e47: 6 total, 6 up, 6 in 2024-09-19T06:43:32.283 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:31 smithi117 ceph-mon[34564]: mgrmap e34: smithi099.pgvkqi(active, since 100s), standbys: smithi117.ssmkcf 2024-09-19T06:43:32.283 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:31 smithi117 ceph-mon[34564]: overall HEALTH_OK 2024-09-19T06:43:32.283 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:31 smithi117 ceph-mon[34564]: from='mgr.14658 ' entity='' 2024-09-19T06:43:32.284 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:31 smithi117 ceph-mon[34564]: mgrmap e35: smithi099.pgvkqi(active, since 100s), standbys: smithi117.ssmkcf 2024-09-19T06:43:37.015 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:36 smithi117 ceph-mon[34564]: Standby manager daemon smithi117.ssmkcf restarted 2024-09-19T06:43:37.015 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:36 smithi117 ceph-mon[34564]: Standby manager daemon smithi117.ssmkcf started 2024-09-19T06:43:37.015 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:36 smithi117 ceph-mon[34564]: from='mgr.? 172.21.15.117:0/1182847373' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi117.ssmkcf/crt"}]: dispatch 2024-09-19T06:43:37.016 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:36 smithi117 ceph-mon[34564]: from='mgr.? 172.21.15.117:0/1182847373' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T06:43:37.016 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:36 smithi117 ceph-mon[34564]: from='mgr.? 172.21.15.117:0/1182847373' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi117.ssmkcf/key"}]: dispatch 2024-09-19T06:43:37.016 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:36 smithi117 ceph-mon[34564]: from='mgr.? 172.21.15.117:0/1182847373' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T06:43:37.033 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:36 smithi099 ceph-mon[97031]: Standby manager daemon smithi117.ssmkcf restarted 2024-09-19T06:43:37.033 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:36 smithi099 ceph-mon[97031]: Standby manager daemon smithi117.ssmkcf started 2024-09-19T06:43:37.034 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:36 smithi099 ceph-mon[97031]: from='mgr.? 172.21.15.117:0/1182847373' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi117.ssmkcf/crt"}]: dispatch 2024-09-19T06:43:37.034 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:36 smithi099 ceph-mon[97031]: from='mgr.? 172.21.15.117:0/1182847373' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T06:43:37.034 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:36 smithi099 ceph-mon[97031]: from='mgr.? 172.21.15.117:0/1182847373' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi117.ssmkcf/key"}]: dispatch 2024-09-19T06:43:37.034 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:36 smithi099 ceph-mon[97031]: from='mgr.? 172.21.15.117:0/1182847373' entity='mgr.smithi117.ssmkcf' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T06:43:38.060 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:37 smithi099 ceph-mon[97031]: mgrmap e36: smithi099.pgvkqi(active, since 105s), standbys: smithi117.ssmkcf 2024-09-19T06:43:38.060 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:37 smithi099 ceph-mon[97031]: Active manager daemon smithi099.pgvkqi restarted 2024-09-19T06:43:38.060 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:37 smithi099 ceph-mon[97031]: Activating manager daemon smithi099.pgvkqi 2024-09-19T06:43:38.060 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:37 smithi099 ceph-mon[97031]: osdmap e48: 6 total, 6 up, 6 in 2024-09-19T06:43:38.060 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:37 smithi099 ceph-mon[97031]: mgrmap e37: smithi099.pgvkqi(active, starting, since 0.00527002s), standbys: smithi117.ssmkcf 2024-09-19T06:43:38.060 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:37 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mon metadata", "id": "smithi099"}]: dispatch 2024-09-19T06:43:38.060 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:37 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mon metadata", "id": "smithi117"}]: dispatch 2024-09-19T06:43:38.060 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:37 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi099.xehbxe"}]: dispatch 2024-09-19T06:43:38.060 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:37 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi099.obarqf"}]: dispatch 2024-09-19T06:43:38.060 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:37 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi117.nooexo"}]: dispatch 2024-09-19T06:43:38.061 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:37 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi117.bheqzh"}]: dispatch 2024-09-19T06:43:38.061 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:37 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mgr metadata", "who": "smithi099.pgvkqi", "id": "smithi099.pgvkqi"}]: dispatch 2024-09-19T06:43:38.061 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:37 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mgr metadata", "who": "smithi117.ssmkcf", "id": "smithi117.ssmkcf"}]: dispatch 2024-09-19T06:43:38.061 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:37 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:43:38.061 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:37 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:43:38.061 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:37 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:43:38.061 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:37 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:43:38.061 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:37 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:43:38.061 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:37 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:43:38.061 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:37 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T06:43:38.061 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:37 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T06:43:38.061 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:37 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T06:43:38.061 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:37 smithi099 ceph-mon[97031]: Manager daemon smithi099.pgvkqi is now available 2024-09-19T06:43:38.061 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:37 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:43:38.062 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:37 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:43:38.062 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:37 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi099.pgvkqi/mirror_snapshot_schedule"}]: dispatch 2024-09-19T06:43:38.062 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:37 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi099.pgvkqi/trash_purge_schedule"}]: dispatch 2024-09-19T06:43:38.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:37 smithi117 ceph-mon[34564]: mgrmap e36: smithi099.pgvkqi(active, since 105s), standbys: smithi117.ssmkcf 2024-09-19T06:43:38.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:37 smithi117 ceph-mon[34564]: Active manager daemon smithi099.pgvkqi restarted 2024-09-19T06:43:38.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:37 smithi117 ceph-mon[34564]: Activating manager daemon smithi099.pgvkqi 2024-09-19T06:43:38.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:37 smithi117 ceph-mon[34564]: osdmap e48: 6 total, 6 up, 6 in 2024-09-19T06:43:38.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:37 smithi117 ceph-mon[34564]: mgrmap e37: smithi099.pgvkqi(active, starting, since 0.00527002s), standbys: smithi117.ssmkcf 2024-09-19T06:43:38.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:37 smithi117 ceph-mon[34564]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mon metadata", "id": "smithi099"}]: dispatch 2024-09-19T06:43:38.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:37 smithi117 ceph-mon[34564]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mon metadata", "id": "smithi117"}]: dispatch 2024-09-19T06:43:38.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:37 smithi117 ceph-mon[34564]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi099.xehbxe"}]: dispatch 2024-09-19T06:43:38.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:37 smithi117 ceph-mon[34564]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi099.obarqf"}]: dispatch 2024-09-19T06:43:38.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:37 smithi117 ceph-mon[34564]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi117.nooexo"}]: dispatch 2024-09-19T06:43:38.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:37 smithi117 ceph-mon[34564]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi117.bheqzh"}]: dispatch 2024-09-19T06:43:38.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:37 smithi117 ceph-mon[34564]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mgr metadata", "who": "smithi099.pgvkqi", "id": "smithi099.pgvkqi"}]: dispatch 2024-09-19T06:43:38.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:37 smithi117 ceph-mon[34564]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mgr metadata", "who": "smithi117.ssmkcf", "id": "smithi117.ssmkcf"}]: dispatch 2024-09-19T06:43:38.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:37 smithi117 ceph-mon[34564]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:43:38.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:37 smithi117 ceph-mon[34564]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:43:38.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:37 smithi117 ceph-mon[34564]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:43:38.064 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:37 smithi117 ceph-mon[34564]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:43:38.064 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:37 smithi117 ceph-mon[34564]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:43:38.064 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:37 smithi117 ceph-mon[34564]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:43:38.064 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:37 smithi117 ceph-mon[34564]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T06:43:38.064 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:37 smithi117 ceph-mon[34564]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T06:43:38.064 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:37 smithi117 ceph-mon[34564]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T06:43:38.064 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:37 smithi117 ceph-mon[34564]: Manager daemon smithi099.pgvkqi is now available 2024-09-19T06:43:38.064 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:37 smithi117 ceph-mon[34564]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:43:38.064 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:37 smithi117 ceph-mon[34564]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:43:38.064 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:37 smithi117 ceph-mon[34564]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi099.pgvkqi/mirror_snapshot_schedule"}]: dispatch 2024-09-19T06:43:38.064 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:37 smithi117 ceph-mon[34564]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi099.pgvkqi/trash_purge_schedule"}]: dispatch 2024-09-19T06:43:39.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:38 smithi117 ceph-mon[34564]: mgrmap e38: smithi099.pgvkqi(active, since 1.00954s), standbys: smithi117.ssmkcf 2024-09-19T06:43:39.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:38 smithi117 ceph-mon[34564]: pgmap v3: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:43:39.072 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:38 smithi099 ceph-mon[97031]: mgrmap e38: smithi099.pgvkqi(active, since 1.00954s), standbys: smithi117.ssmkcf 2024-09-19T06:43:39.072 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:38 smithi099 ceph-mon[97031]: pgmap v3: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:43:39.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:39 smithi099 ceph-mon[97031]: [19/Sep/2024:06:43:38] ENGINE Bus STARTING 2024-09-19T06:43:39.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:39 smithi099 ceph-mon[97031]: [19/Sep/2024:06:43:38] ENGINE Serving on https://172.21.15.99:7150 2024-09-19T06:43:39.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:39 smithi099 ceph-mon[97031]: [19/Sep/2024:06:43:38] ENGINE Error in HTTPServer.serve 2024-09-19T06:43:39.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: Traceback (most recent call last): 2024-09-19T06:43:39.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T06:43:39.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: self._connections.run(self.expiration_interval) 2024-09-19T06:43:39.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T06:43:39.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: self._run(expiration_interval) 2024-09-19T06:43:39.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T06:43:39.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T06:43:39.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T06:43:39.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T06:43:39.958 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T06:43:39.958 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: s = self.context.wrap_socket( 2024-09-19T06:43:39.958 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T06:43:39.958 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: return self.sslsocket_class._create( 2024-09-19T06:43:39.958 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T06:43:39.958 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: self.do_handshake() 2024-09-19T06:43:39.958 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T06:43:39.958 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: self._sslobj.do_handshake() 2024-09-19T06:43:39.958 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T06:43:39.958 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:39 smithi099 ceph-mon[97031]: [19/Sep/2024:06:43:38] ENGINE Serving on http://172.21.15.99:8765 2024-09-19T06:43:39.958 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:39 smithi099 ceph-mon[97031]: [19/Sep/2024:06:43:38] ENGINE Bus STARTED 2024-09-19T06:43:39.958 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:39 smithi099 ceph-mon[97031]: pgmap v4: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:43:39.958 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:39 smithi099 ceph-mon[97031]: mgrmap e39: smithi099.pgvkqi(active, since 2s), standbys: smithi117.ssmkcf 2024-09-19T06:43:40.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:39 smithi117 ceph-mon[34564]: [19/Sep/2024:06:43:38] ENGINE Bus STARTING 2024-09-19T06:43:40.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:39 smithi117 ceph-mon[34564]: [19/Sep/2024:06:43:38] ENGINE Serving on https://172.21.15.99:7150 2024-09-19T06:43:40.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:39 smithi117 ceph-mon[34564]: [19/Sep/2024:06:43:38] ENGINE Error in HTTPServer.serve 2024-09-19T06:43:40.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: Traceback (most recent call last): 2024-09-19T06:43:40.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T06:43:40.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: self._connections.run(self.expiration_interval) 2024-09-19T06:43:40.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T06:43:40.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: self._run(expiration_interval) 2024-09-19T06:43:40.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T06:43:40.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T06:43:40.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T06:43:40.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T06:43:40.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T06:43:40.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: s = self.context.wrap_socket( 2024-09-19T06:43:40.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T06:43:40.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: return self.sslsocket_class._create( 2024-09-19T06:43:40.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T06:43:40.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: self.do_handshake() 2024-09-19T06:43:40.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T06:43:40.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: self._sslobj.do_handshake() 2024-09-19T06:43:40.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T06:43:40.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:39 smithi117 ceph-mon[34564]: [19/Sep/2024:06:43:38] ENGINE Serving on http://172.21.15.99:8765 2024-09-19T06:43:40.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:39 smithi117 ceph-mon[34564]: [19/Sep/2024:06:43:38] ENGINE Bus STARTED 2024-09-19T06:43:40.314 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:39 smithi117 ceph-mon[34564]: pgmap v4: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:43:40.314 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:39 smithi117 ceph-mon[34564]: mgrmap e39: smithi099.pgvkqi(active, since 2s), standbys: smithi117.ssmkcf 2024-09-19T06:43:41.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:41 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:43:41.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:41 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:43:41.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:41 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:43:41.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:41 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:43:41.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:41 smithi099 ceph-mon[97031]: pgmap v5: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:43:41.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:41 smithi117 ceph-mon[34564]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:43:41.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:41 smithi117 ceph-mon[34564]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:43:41.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:41 smithi117 ceph-mon[34564]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:43:41.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:41 smithi117 ceph-mon[34564]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:43:41.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:41 smithi117 ceph-mon[34564]: pgmap v5: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:43:43.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:42 smithi117 ceph-mon[34564]: mgrmap e40: smithi099.pgvkqi(active, since 4s), standbys: smithi117.ssmkcf 2024-09-19T06:43:43.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:42 smithi117 ceph-mon[34564]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:43:43.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:42 smithi117 ceph-mon[34564]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:43:43.149 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:42 smithi099 ceph-mon[97031]: mgrmap e40: smithi099.pgvkqi(active, since 4s), standbys: smithi117.ssmkcf 2024-09-19T06:43:43.149 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:42 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:43:43.149 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:42 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:43:44.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:43 smithi117 ceph-mon[34564]: pgmap v6: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 41 KiB/s rd, 0 B/s wr, 23 op/s 2024-09-19T06:43:44.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:43 smithi117 ceph-mon[34564]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:43:44.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:43 smithi117 ceph-mon[34564]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:43:44.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:43 smithi099 ceph-mon[97031]: pgmap v6: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 41 KiB/s rd, 0 B/s wr, 23 op/s 2024-09-19T06:43:44.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:43 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:43:44.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:43 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:43:46.038 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:45 smithi099 ceph-mon[97031]: pgmap v7: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2024-09-19T06:43:46.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:45 smithi117 ceph-mon[34564]: pgmap v7: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2024-09-19T06:43:47.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:47 smithi099 ceph-mon[97031]: Detected new or changed devices on smithi099 2024-09-19T06:43:47.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:47 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:43:47.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:47 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:43:47.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:47 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:43:47.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:47 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:43:47.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:47 smithi099 ceph-mon[97031]: Updating smithi099:/etc/ceph/ceph.conf 2024-09-19T06:43:47.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:47 smithi099 ceph-mon[97031]: Updating smithi117:/etc/ceph/ceph.conf 2024-09-19T06:43:47.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:47 smithi099 ceph-mon[97031]: Updating smithi099:/var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:43:47.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:47 smithi099 ceph-mon[97031]: Updating smithi117:/var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:43:47.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:47 smithi099 ceph-mon[97031]: pgmap v8: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-19T06:43:47.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:47 smithi099 ceph-mon[97031]: Updating smithi099:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:43:47.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:47 smithi099 ceph-mon[97031]: Updating smithi117:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:43:47.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:47 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:43:47.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:47 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:43:47.708 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:47 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:43:47.708 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:47 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:43:47.708 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:47 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:43:47.708 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:47 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:43:47.708 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:47 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:43:47.708 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:47 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-19T06:43:47.731 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:47 smithi117 ceph-mon[34564]: Detected new or changed devices on smithi099 2024-09-19T06:43:47.731 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:47 smithi117 ceph-mon[34564]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:43:47.731 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:47 smithi117 ceph-mon[34564]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:43:47.731 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:47 smithi117 ceph-mon[34564]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:43:47.731 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:47 smithi117 ceph-mon[34564]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:43:47.731 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:47 smithi117 ceph-mon[34564]: Updating smithi099:/etc/ceph/ceph.conf 2024-09-19T06:43:47.731 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:47 smithi117 ceph-mon[34564]: Updating smithi117:/etc/ceph/ceph.conf 2024-09-19T06:43:47.731 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:47 smithi117 ceph-mon[34564]: Updating smithi099:/var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:43:47.732 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:47 smithi117 ceph-mon[34564]: Updating smithi117:/var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T06:43:47.732 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:47 smithi117 ceph-mon[34564]: pgmap v8: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-19T06:43:47.732 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:47 smithi117 ceph-mon[34564]: Updating smithi099:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:43:47.732 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:47 smithi117 ceph-mon[34564]: Updating smithi117:/etc/ceph/ceph.client.admin.keyring 2024-09-19T06:43:47.732 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:47 smithi117 ceph-mon[34564]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:43:47.732 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:47 smithi117 ceph-mon[34564]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:43:47.732 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:47 smithi117 ceph-mon[34564]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:43:47.732 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:47 smithi117 ceph-mon[34564]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:43:47.732 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:47 smithi117 ceph-mon[34564]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:43:47.732 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:47 smithi117 ceph-mon[34564]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:43:47.732 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:47 smithi117 ceph-mon[34564]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:43:47.732 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:47 smithi117 ceph-mon[34564]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-19T06:43:48.661 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:48 smithi099 ceph-mon[97031]: Updating smithi099:/var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:43:48.662 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:48 smithi099 ceph-mon[97031]: Updating smithi117:/var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:43:48.662 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:48 smithi099 ceph-mon[97031]: fsmap cephfs:2 {0=cephfs.smithi099.xehbxe=up:active,1=cephfs.smithi117.nooexo=up:active} 2 up:standby 2024-09-19T06:43:48.717 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:48 smithi117 ceph-mon[34564]: Updating smithi099:/var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:43:48.718 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:48 smithi117 ceph-mon[34564]: Updating smithi117:/var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T06:43:48.718 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:48 smithi117 ceph-mon[34564]: fsmap cephfs:2 {0=cephfs.smithi099.xehbxe=up:active,1=cephfs.smithi117.nooexo=up:active} 2 up:standby 2024-09-19T06:43:50.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:49 smithi117 ceph-mon[34564]: Upgrade: Updating mon.smithi117 2024-09-19T06:43:50.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:49 smithi117 ceph-mon[34564]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:43:50.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:49 smithi117 ceph-mon[34564]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T06:43:50.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:49 smithi117 ceph-mon[34564]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T06:43:50.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:49 smithi117 ceph-mon[34564]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:43:50.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:49 smithi117 ceph-mon[34564]: Deploying daemon mon.smithi117 on smithi117 2024-09-19T06:43:50.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:49 smithi117 ceph-mon[34564]: pgmap v9: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-19T06:43:50.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:49 smithi099 ceph-mon[97031]: Upgrade: Updating mon.smithi117 2024-09-19T06:43:50.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:49 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:43:50.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:49 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T06:43:50.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:49 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T06:43:50.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:49 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:43:50.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:49 smithi099 ceph-mon[97031]: Deploying daemon mon.smithi117 on smithi117 2024-09-19T06:43:50.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:49 smithi099 ceph-mon[97031]: pgmap v9: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-19T06:43:50.505 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:50 smithi117 systemd[1]: Stopping Ceph mon.smithi117 for a73eb958-7650-11ef-bceb-c7b262605968... 2024-09-19T06:43:50.769 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:50 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-mon-smithi117[34560]: 2024-09-19T06:43:50.502+0000 7f62d076d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi117 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:43:50.770 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:50 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-mon-smithi117[34560]: 2024-09-19T06:43:50.502+0000 7f62d076d640 -1 mon.smithi117@1(peon) e2 *** Got Signal Terminated *** 2024-09-19T06:43:51.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:50 smithi117 podman[76611]: 2024-09-19 06:43:50.768996895 +0000 UTC m=+0.373477228 container died bd4854d5213ea0818d5f287a548539479dcfe2513ccdb85934e17f2b09042d58 (image=quay.ceph.io/ceph-ci/ceph@sha256:4d922a456af336b23156460d93b8143eb9c977eee7e72f2e9e44c816e5b46ac8, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-mon-smithi117, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=quincy-6e06d1e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-19T06:43:51.346 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:51 smithi117 podman[76611]: 2024-09-19 06:43:51.169661148 +0000 UTC m=+0.774141480 container cleanup bd4854d5213ea0818d5f287a548539479dcfe2513ccdb85934e17f2b09042d58 (image=quay.ceph.io/ceph-ci/ceph@sha256:4d922a456af336b23156460d93b8143eb9c977eee7e72f2e9e44c816e5b46ac8, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-mon-smithi117, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=quincy-6e06d1e, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-19T06:43:51.346 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:51 smithi117 bash[76611]: ceph-a73eb958-7650-11ef-bceb-c7b262605968-mon-smithi117 2024-09-19T06:43:51.603 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:51 smithi117 podman[76624]: 2024-09-19 06:43:51.346048827 +0000 UTC m=+0.576025945 container remove bd4854d5213ea0818d5f287a548539479dcfe2513ccdb85934e17f2b09042d58 (image=quay.ceph.io/ceph-ci/ceph@sha256:4d922a456af336b23156460d93b8143eb9c977eee7e72f2e9e44c816e5b46ac8, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-mon-smithi117, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-6e06d1e, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-19T06:43:52.018 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:51 smithi117 systemd[1]: ceph-a73eb958-7650-11ef-bceb-c7b262605968@mon.smithi117.service: Deactivated successfully. 2024-09-19T06:43:52.018 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:51 smithi117 systemd[1]: Stopped Ceph mon.smithi117 for a73eb958-7650-11ef-bceb-c7b262605968. 2024-09-19T06:43:52.018 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:51 smithi117 systemd[1]: ceph-a73eb958-7650-11ef-bceb-c7b262605968@mon.smithi117.service: Consumed 6.253s CPU time. 2024-09-19T06:43:52.019 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:51 smithi117 systemd[1]: Starting Ceph mon.smithi117 for a73eb958-7650-11ef-bceb-c7b262605968... 2024-09-19T06:43:52.283 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 podman[76752]: 2024-09-19 06:43:51.920595669 +0000 UTC m=+0.015699333 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:43:52.283 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 podman[76752]: 2024-09-19 06:43:52.030458446 +0000 UTC m=+0.125562141 container create 4cb7455e3ee7cfd4b771ad5abb6bf92aa1128f744dd13f3362cb80ca68f3d70e (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-mon-smithi117, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:43:52.283 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 podman[76752]: 2024-09-19 06:43:52.28297026 +0000 UTC m=+0.378073920 container init 4cb7455e3ee7cfd4b771ad5abb6bf92aa1128f744dd13f3362cb80ca68f3d70e (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-mon-smithi117, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.build-date=20240731) 2024-09-19T06:43:52.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 podman[76752]: 2024-09-19 06:43:52.28691552 +0000 UTC m=+0.382019173 container start 4cb7455e3ee7cfd4b771ad5abb6bf92aa1128f744dd13f3362cb80ca68f3d70e (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-mon-smithi117, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-19T06:43:52.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: set uid:gid to 167:167 (ceph:ceph) 2024-09-19T06:43:52.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable), process ceph-mon, pid 2 2024-09-19T06:43:52.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: pidfile_write: ignore empty --pid-file 2024-09-19T06:43:52.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: load: jerasure load: lrc 2024-09-19T06:43:52.563 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: RocksDB version: 7.9.2 2024-09-19T06:43:52.563 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Git sha 0 2024-09-19T06:43:52.563 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Compile date 2024-09-18 16:29:48 2024-09-19T06:43:52.563 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: DB SUMMARY 2024-09-19T06:43:52.563 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: DB Session ID: 5SD9IRSXWNEE56LXDL2I 2024-09-19T06:43:52.563 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: CURRENT file: CURRENT 2024-09-19T06:43:52.563 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: IDENTITY file: IDENTITY 2024-09-19T06:43:52.563 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: MANIFEST file: MANIFEST-000009 size: 1097 Bytes 2024-09-19T06:43:52.563 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi117/store.db dir, Total Num: 1, files: 000027.sst 2024-09-19T06:43:52.563 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi117/store.db: 000025.log size: 3572174 ; 2024-09-19T06:43:52.563 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.error_if_exists: 0 2024-09-19T06:43:52.563 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.create_if_missing: 0 2024-09-19T06:43:52.563 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.paranoid_checks: 1 2024-09-19T06:43:52.564 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-19T06:43:52.564 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-19T06:43:52.564 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-19T06:43:52.564 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.env: 0x55843ec17940 2024-09-19T06:43:52.564 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.fs: PosixFileSystem 2024-09-19T06:43:52.564 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.info_log: 0x55843fc6f8c0 2024-09-19T06:43:52.564 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.max_file_opening_threads: 16 2024-09-19T06:43:52.564 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.statistics: (nil) 2024-09-19T06:43:52.564 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.use_fsync: 0 2024-09-19T06:43:52.564 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.max_log_file_size: 0 2024-09-19T06:43:52.564 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-19T06:43:52.564 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-19T06:43:52.564 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.keep_log_file_num: 1000 2024-09-19T06:43:52.565 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.recycle_log_file_num: 0 2024-09-19T06:43:52.565 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.allow_fallocate: 1 2024-09-19T06:43:52.565 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.allow_mmap_reads: 0 2024-09-19T06:43:52.565 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.allow_mmap_writes: 0 2024-09-19T06:43:52.565 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.use_direct_reads: 0 2024-09-19T06:43:52.565 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-19T06:43:52.565 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.create_missing_column_families: 0 2024-09-19T06:43:52.565 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.db_log_dir: 2024-09-19T06:43:52.565 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.wal_dir: 2024-09-19T06:43:52.565 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-19T06:43:52.565 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-19T06:43:52.565 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-19T06:43:52.565 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-19T06:43:52.565 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-19T06:43:52.566 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-19T06:43:52.566 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.advise_random_on_open: 1 2024-09-19T06:43:52.566 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.db_write_buffer_size: 0 2024-09-19T06:43:52.566 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.write_buffer_manager: 0x55843fc7edc0 2024-09-19T06:43:52.566 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-19T06:43:52.566 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-19T06:43:52.566 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-19T06:43:52.566 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.rate_limiter: (nil) 2024-09-19T06:43:52.566 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-19T06:43:52.566 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.wal_recovery_mode: 2 2024-09-19T06:43:52.566 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.enable_thread_tracking: 0 2024-09-19T06:43:52.566 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.enable_pipelined_write: 0 2024-09-19T06:43:52.566 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.unordered_write: 0 2024-09-19T06:43:52.566 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-19T06:43:52.567 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-19T06:43:52.567 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-19T06:43:52.567 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-19T06:43:52.567 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.row_cache: None 2024-09-19T06:43:52.567 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.wal_filter: None 2024-09-19T06:43:52.567 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-19T06:43:52.567 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.allow_ingest_behind: 0 2024-09-19T06:43:52.567 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.two_write_queues: 0 2024-09-19T06:43:52.567 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.manual_wal_flush: 0 2024-09-19T06:43:52.567 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.wal_compression: 0 2024-09-19T06:43:52.567 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.atomic_flush: 0 2024-09-19T06:43:52.567 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-19T06:43:52.567 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-19T06:43:52.567 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-19T06:43:52.569 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.log_readahead_size: 0 2024-09-19T06:43:52.569 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-19T06:43:52.569 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.best_efforts_recovery: 0 2024-09-19T06:43:52.569 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-19T06:43:52.569 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-19T06:43:52.569 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.allow_data_in_errors: 0 2024-09-19T06:43:52.569 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.db_host_id: __hostname__ 2024-09-19T06:43:52.569 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-19T06:43:52.569 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.max_background_jobs: 2 2024-09-19T06:43:52.569 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.max_background_compactions: -1 2024-09-19T06:43:52.569 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.max_subcompactions: 1 2024-09-19T06:43:52.570 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-19T06:43:52.570 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-19T06:43:52.570 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-19T06:43:52.570 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.max_total_wal_size: 0 2024-09-19T06:43:52.570 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-19T06:43:52.570 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-19T06:43:52.570 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-19T06:43:52.570 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-19T06:43:52.570 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.max_open_files: -1 2024-09-19T06:43:52.570 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.bytes_per_sync: 0 2024-09-19T06:43:52.570 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-19T06:43:52.570 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-19T06:43:52.570 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.compaction_readahead_size: 0 2024-09-19T06:43:52.571 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.max_background_flushes: -1 2024-09-19T06:43:52.571 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Compression algorithms supported: 2024-09-19T06:43:52.571 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: kZSTD supported: 0 2024-09-19T06:43:52.571 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: kXpressCompression supported: 0 2024-09-19T06:43:52.571 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: kBZip2Compression supported: 0 2024-09-19T06:43:52.571 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-19T06:43:52.571 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: kLZ4Compression supported: 1 2024-09-19T06:43:52.571 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: kZlibCompression supported: 1 2024-09-19T06:43:52.571 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: kLZ4HCCompression supported: 1 2024-09-19T06:43:52.571 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: kSnappyCompression supported: 1 2024-09-19T06:43:52.571 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-19T06:43:52.571 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-19T06:43:52.571 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi117/store.db/MANIFEST-000009 2024-09-19T06:43:52.571 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-19T06:43:52.572 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-19T06:43:52.572 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.merge_operator: 2024-09-19T06:43:52.572 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.compaction_filter: None 2024-09-19T06:43:52.572 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.compaction_filter_factory: None 2024-09-19T06:43:52.572 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.sst_partitioner_factory: None 2024-09-19T06:43:52.572 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-19T06:43:52.572 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-19T06:43:52.572 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55843fc6f520) 2024-09-19T06:43:52.572 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: cache_index_and_filter_blocks: 1 2024-09-19T06:43:52.572 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-19T06:43:52.572 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-19T06:43:52.572 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: pin_top_level_index_and_filter: 1 2024-09-19T06:43:52.572 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: index_type: 0 2024-09-19T06:43:52.572 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: data_block_index_type: 0 2024-09-19T06:43:52.573 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: index_shortening: 1 2024-09-19T06:43:52.573 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-19T06:43:52.573 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: checksum: 4 2024-09-19T06:43:52.573 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: no_block_cache: 0 2024-09-19T06:43:52.573 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: block_cache: 0x55843fc631f0 2024-09-19T06:43:52.573 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: block_cache_name: BinnedLRUCache 2024-09-19T06:43:52.573 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: block_cache_options: 2024-09-19T06:43:52.573 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: capacity : 536870912 2024-09-19T06:43:52.573 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: num_shard_bits : 4 2024-09-19T06:43:52.573 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: strict_capacity_limit : 0 2024-09-19T06:43:52.573 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: high_pri_pool_ratio: 0.000 2024-09-19T06:43:52.573 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: block_cache_compressed: (nil) 2024-09-19T06:43:52.573 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: persistent_cache: (nil) 2024-09-19T06:43:52.573 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: block_size: 4096 2024-09-19T06:43:52.574 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: block_size_deviation: 10 2024-09-19T06:43:52.574 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: block_restart_interval: 16 2024-09-19T06:43:52.574 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: index_block_restart_interval: 1 2024-09-19T06:43:52.574 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: metadata_block_size: 4096 2024-09-19T06:43:52.574 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: partition_filters: 0 2024-09-19T06:43:52.574 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: use_delta_encoding: 1 2024-09-19T06:43:52.574 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: filter_policy: bloomfilter 2024-09-19T06:43:52.574 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: whole_key_filtering: 1 2024-09-19T06:43:52.574 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: verify_compression: 0 2024-09-19T06:43:52.574 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: read_amp_bytes_per_bit: 0 2024-09-19T06:43:52.574 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: format_version: 5 2024-09-19T06:43:52.574 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: enable_index_compression: 1 2024-09-19T06:43:52.574 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: block_align: 0 2024-09-19T06:43:52.574 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: max_auto_readahead_size: 262144 2024-09-19T06:43:52.575 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: prepopulate_block_cache: 0 2024-09-19T06:43:52.575 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: initial_auto_readahead_size: 8192 2024-09-19T06:43:52.575 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: num_file_reads_for_auto_readahead: 2 2024-09-19T06:43:52.575 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.write_buffer_size: 33554432 2024-09-19T06:43:52.575 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.max_write_buffer_number: 2 2024-09-19T06:43:52.575 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.compression: NoCompression 2024-09-19T06:43:52.575 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.bottommost_compression: Disabled 2024-09-19T06:43:52.575 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.prefix_extractor: nullptr 2024-09-19T06:43:52.575 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-19T06:43:52.575 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.num_levels: 7 2024-09-19T06:43:52.575 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-19T06:43:52.575 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-19T06:43:52.575 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-19T06:43:52.576 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-19T06:43:52.576 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-19T06:43:52.576 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-19T06:43:52.576 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-19T06:43:52.576 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-19T06:43:52.576 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-19T06:43:52.576 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-19T06:43:52.576 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-19T06:43:52.576 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-19T06:43:52.576 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-19T06:43:52.576 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.compression_opts.level: 32767 2024-09-19T06:43:52.576 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.compression_opts.strategy: 0 2024-09-19T06:43:52.576 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-19T06:43:52.576 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-19T06:43:52.577 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-19T06:43:52.577 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-19T06:43:52.577 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.compression_opts.enabled: false 2024-09-19T06:43:52.577 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-19T06:43:52.577 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-19T06:43:52.577 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-19T06:43:52.577 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-19T06:43:52.577 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.target_file_size_base: 67108864 2024-09-19T06:43:52.577 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-19T06:43:52.577 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-19T06:43:52.577 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-19T06:43:52.577 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-19T06:43:52.577 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-19T06:43:52.578 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-19T06:43:52.578 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-19T06:43:52.578 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-19T06:43:52.578 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-19T06:43:52.578 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-19T06:43:52.578 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-19T06:43:52.578 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-19T06:43:52.578 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-19T06:43:52.578 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-19T06:43:52.578 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.arena_block_size: 1048576 2024-09-19T06:43:52.579 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-19T06:43:52.579 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-19T06:43:52.579 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.disable_auto_compactions: 0 2024-09-19T06:43:52.579 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-19T06:43:52.579 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-19T06:43:52.579 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-19T06:43:52.579 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-19T06:43:52.579 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-19T06:43:52.579 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-19T06:43:52.579 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-19T06:43:52.579 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-19T06:43:52.579 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-19T06:43:52.580 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-19T06:43:52.580 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-19T06:43:52.580 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.inplace_update_support: 0 2024-09-19T06:43:52.580 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-19T06:43:52.580 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-19T06:43:52.580 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-19T06:43:52.580 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-19T06:43:52.580 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.bloom_locality: 0 2024-09-19T06:43:52.580 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.max_successive_merges: 0 2024-09-19T06:43:52.580 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-19T06:43:52.580 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.paranoid_file_checks: 0 2024-09-19T06:43:52.580 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.force_consistency_checks: 1 2024-09-19T06:43:52.580 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.report_bg_io_stats: 0 2024-09-19T06:43:52.581 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.ttl: 2592000 2024-09-19T06:43:52.581 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-19T06:43:52.581 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-19T06:43:52.581 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-19T06:43:52.581 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.enable_blob_files: false 2024-09-19T06:43:52.581 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.min_blob_size: 0 2024-09-19T06:43:52.581 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.blob_file_size: 268435456 2024-09-19T06:43:52.581 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-19T06:43:52.581 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-19T06:43:52.581 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-19T06:43:52.581 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-19T06:43:52.581 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-19T06:43:52.581 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.blob_file_starting_level: 0 2024-09-19T06:43:52.582 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-19T06:43:52.582 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 27.sst 2024-09-19T06:43:52.582 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-19T06:43:52.582 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi117/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 29, last_sequence is 12319, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-19T06:43:52.582 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2024-09-19T06:43:52.582 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 84f85d3f-5627-4cf0-9f46-1b19c11a3de7 2024-09-19T06:43:52.582 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726728232314244, "job": 1, "event": "recovery_started", "wal_files": [25]} 2024-09-19T06:43:52.582 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2024-09-19T06:43:52.582 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726728232324177, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 2290564, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12324, "largest_seqno": 13246, "table_properties": {"data_size": 2285887, "index_size": 2609, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1029, "raw_key_size": 9681, "raw_average_key_size": 23, "raw_value_size": 2277071, "raw_average_value_size": 5608, "num_data_blocks": 118, "num_entries": 406, "num_filter_entries": 406, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726728232, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "84f85d3f-5627-4cf0-9f46-1b19c11a3de7", "db_session_id": "5SD9IRSXWNEE56LXDL2I", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2024-09-19T06:43:52.582 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726728232324313, "job": 1, "event": "recovery_finished"} 2024-09-19T06:43:52.582 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2024-09-19T06:43:52.582 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-19T06:43:52.582 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi117/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-19T06:43:52.583 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55843fc90e00 2024-09-19T06:43:52.583 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: DB pointer 0x55843fd8c000 2024-09-19T06:43:52.583 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-19T06:43:52.583 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-19T06:43:52.583 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: ** DB Stats ** 2024-09-19T06:43:52.583 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T06:43:52.583 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-19T06:43:52.583 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T06:43:52.583 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T06:43:52.583 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-19T06:43:52.583 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T06:43:52.583 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T06:43:52.583 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: 2024-09-19T06:43:52.584 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: ** Compaction Stats [default] ** 2024-09-19T06:43:52.584 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T06:43:52.584 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-19T06:43:52.584 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: L0 1/0 2.18 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 656.8 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-19T06:43:52.584 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: L6 1/0 7.01 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-19T06:43:52.584 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: Sum 2/0 9.20 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 656.8 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-19T06:43:52.584 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 656.8 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-19T06:43:52.584 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: 2024-09-19T06:43:52.584 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: ** Compaction Stats [default] ** 2024-09-19T06:43:52.584 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T06:43:52.584 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-19T06:43:52.584 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 656.8 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-19T06:43:52.584 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: 2024-09-19T06:43:52.584 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-19T06:43:52.585 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: 2024-09-19T06:43:52.585 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T06:43:52.585 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: Flush(GB): cumulative 0.002, interval 0.002 2024-09-19T06:43:52.585 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-19T06:43:52.585 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-19T06:43:52.585 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-19T06:43:52.585 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-19T06:43:52.585 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: Cumulative compaction: 0.00 GB write, 170.45 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T06:43:52.585 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: Interval compaction: 0.00 GB write, 170.45 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T06:43:52.585 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-19T06:43:52.585 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: Block cache BinnedLRUCache@0x55843fc631f0#2 capacity: 512.00 MB usage: 3.98 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-09-19T06:43:52.585 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.16 KB,0.000220537%) IndexBlock(1,2.83 KB,0.000539422%) Misc(1,0.00 KB,0%) 2024-09-19T06:43:52.585 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: 2024-09-19T06:43:52.586 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-19T06:43:52.586 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: starting mon.smithi117 rank 1 at public addrs [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] at bind addrs [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi117 fsid a73eb958-7650-11ef-bceb-c7b262605968 2024-09-19T06:43:52.586 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: mon.smithi117@-1(???) e2 preinit fsid a73eb958-7650-11ef-bceb-c7b262605968 2024-09-19T06:43:52.586 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: mon.smithi117@-1(???).mds e18 new map 2024-09-19T06:43:52.586 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: mon.smithi117@-1(???).mds e18 print_map 2024-09-19T06:43:52.586 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: e18 2024-09-19T06:43:52.586 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: btime 2024-09-19T06:43:47:392296+0000 2024-09-19T06:43:52.586 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T06:43:52.586 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T06:43:52.586 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: legacy client fscid: 1 2024-09-19T06:43:52.586 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: 2024-09-19T06:43:52.586 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: Filesystem 'cephfs' (1) 2024-09-19T06:43:52.586 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: fs_name cephfs 2024-09-19T06:43:52.586 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: epoch 18 2024-09-19T06:43:52.587 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-19T06:43:52.587 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: created 2024-09-19T06:37:40.838146+0000 2024-09-19T06:43:52.587 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: modified 2024-09-19T06:43:47.392294+0000 2024-09-19T06:43:52.587 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: tableserver 0 2024-09-19T06:43:52.587 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: root 0 2024-09-19T06:43:52.587 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: session_timeout 60 2024-09-19T06:43:52.587 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: session_autoclose 300 2024-09-19T06:43:52.587 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: max_file_size 1099511627776 2024-09-19T06:43:52.587 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: max_xattr_size 65536 2024-09-19T06:43:52.587 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: required_client_features {} 2024-09-19T06:43:52.587 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: last_failure 0 2024-09-19T06:43:52.587 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: last_failure_osd_epoch 45 2024-09-19T06:43:52.587 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T06:43:52.587 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: max_mds 2 2024-09-19T06:43:52.588 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: in 0,1 2024-09-19T06:43:52.588 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: up {0=14482,1=24269} 2024-09-19T06:43:52.588 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: failed 2024-09-19T06:43:52.588 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: damaged 2024-09-19T06:43:52.588 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: stopped 2024-09-19T06:43:52.588 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: data_pools [3] 2024-09-19T06:43:52.588 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: metadata_pool 2 2024-09-19T06:43:52.588 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: inline_data disabled 2024-09-19T06:43:52.588 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: balancer 2024-09-19T06:43:52.588 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: bal_rank_mask -1 2024-09-19T06:43:52.588 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: standby_count_wanted 1 2024-09-19T06:43:52.588 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: qdb_cluster leader: 14482 members: 14482,24269 2024-09-19T06:43:52.588 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: [mds.cephfs.smithi099.xehbxe{0:14482} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.99:6828/1508711176,v1:172.21.15.99:6829/1508711176] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T06:43:52.589 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: [mds.cephfs.smithi117.nooexo{1:24269} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.117:6824/2367330767,v1:172.21.15.117:6825/2367330767] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T06:43:52.589 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: 2024-09-19T06:43:52.589 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: 2024-09-19T06:43:52.589 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: Standby daemons: 2024-09-19T06:43:52.589 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: 2024-09-19T06:43:52.589 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: [mds.cephfs.smithi099.obarqf{-1:14490} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6826/388324528,v1:172.21.15.99:6827/388324528] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T06:43:52.589 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout: [mds.cephfs.smithi117.bheqzh{-1:24283} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.117:6826/4072877365,v1:172.21.15.117:6827/4072877365] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T06:43:52.589 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: mon.smithi117@-1(???).osd e48 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-19T06:43:52.589 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: mon.smithi117@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-09-19T06:43:52.589 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: mon.smithi117@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-09-19T06:43:52.589 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: mon.smithi117@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-09-19T06:43:52.589 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 ceph-mon[76771]: mon.smithi117@-1(???).paxosservice(auth 1..22) refresh upgraded, format 0 -> 3 2024-09-19T06:43:52.589 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 bash[76752]: 4cb7455e3ee7cfd4b771ad5abb6bf92aa1128f744dd13f3362cb80ca68f3d70e 2024-09-19T06:43:52.589 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:52 smithi117 systemd[1]: Started Ceph mon.smithi117 for a73eb958-7650-11ef-bceb-c7b262605968. 2024-09-19T06:43:55.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:54 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mon metadata", "id": "smithi099"}]: dispatch 2024-09-19T06:43:55.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:54 smithi117 ceph-mon[76771]: mon.smithi099 calling monitor election 2024-09-19T06:43:55.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:54 smithi117 ceph-mon[76771]: mon.smithi117 calling monitor election 2024-09-19T06:43:55.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:54 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mon metadata", "id": "smithi117"}]: dispatch 2024-09-19T06:43:55.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:54 smithi117 ceph-mon[76771]: mon.smithi099 is new leader, mons smithi099,smithi117 in quorum (ranks 0,1) 2024-09-19T06:43:55.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:54 smithi117 ceph-mon[76771]: monmap epoch 3 2024-09-19T06:43:55.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:54 smithi117 ceph-mon[76771]: fsid a73eb958-7650-11ef-bceb-c7b262605968 2024-09-19T06:43:55.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:54 smithi117 ceph-mon[76771]: last_changed 2024-09-19T06:43:53.873040+0000 2024-09-19T06:43:55.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:54 smithi117 ceph-mon[76771]: created 2024-09-19T06:31:05.093105+0000 2024-09-19T06:43:55.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:54 smithi117 ceph-mon[76771]: min_mon_release 19 (squid) 2024-09-19T06:43:55.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:54 smithi117 ceph-mon[76771]: election_strategy: 1 2024-09-19T06:43:55.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:54 smithi117 ceph-mon[76771]: 0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.smithi099 2024-09-19T06:43:55.063 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:54 smithi117 ceph-mon[76771]: 1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.smithi117 2024-09-19T06:43:55.064 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:54 smithi117 ceph-mon[76771]: fsmap cephfs:2 {0=cephfs.smithi099.xehbxe=up:active,1=cephfs.smithi117.nooexo=up:active} 2 up:standby 2024-09-19T06:43:55.064 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:54 smithi117 ceph-mon[76771]: osdmap e48: 6 total, 6 up, 6 in 2024-09-19T06:43:55.064 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:54 smithi117 ceph-mon[76771]: mgrmap e40: smithi099.pgvkqi(active, since 17s), standbys: smithi117.ssmkcf 2024-09-19T06:43:55.064 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:54 smithi117 ceph-mon[76771]: overall HEALTH_OK 2024-09-19T06:43:55.064 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:54 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:43:55.064 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:54 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:43:55.064 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:54 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:43:55.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:54 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mon metadata", "id": "smithi099"}]: dispatch 2024-09-19T06:43:55.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:54 smithi099 ceph-mon[97031]: mon.smithi099 calling monitor election 2024-09-19T06:43:55.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:54 smithi099 ceph-mon[97031]: mon.smithi117 calling monitor election 2024-09-19T06:43:55.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:54 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mon metadata", "id": "smithi117"}]: dispatch 2024-09-19T06:43:55.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:54 smithi099 ceph-mon[97031]: mon.smithi099 is new leader, mons smithi099,smithi117 in quorum (ranks 0,1) 2024-09-19T06:43:55.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:54 smithi099 ceph-mon[97031]: monmap epoch 3 2024-09-19T06:43:55.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:54 smithi099 ceph-mon[97031]: fsid a73eb958-7650-11ef-bceb-c7b262605968 2024-09-19T06:43:55.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:54 smithi099 ceph-mon[97031]: last_changed 2024-09-19T06:43:53.873040+0000 2024-09-19T06:43:55.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:54 smithi099 ceph-mon[97031]: created 2024-09-19T06:31:05.093105+0000 2024-09-19T06:43:55.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:54 smithi099 ceph-mon[97031]: min_mon_release 19 (squid) 2024-09-19T06:43:55.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:54 smithi099 ceph-mon[97031]: election_strategy: 1 2024-09-19T06:43:55.208 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:54 smithi099 ceph-mon[97031]: 0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.smithi099 2024-09-19T06:43:55.208 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:54 smithi099 ceph-mon[97031]: 1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.smithi117 2024-09-19T06:43:55.208 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:54 smithi099 ceph-mon[97031]: fsmap cephfs:2 {0=cephfs.smithi099.xehbxe=up:active,1=cephfs.smithi117.nooexo=up:active} 2 up:standby 2024-09-19T06:43:55.208 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:54 smithi099 ceph-mon[97031]: osdmap e48: 6 total, 6 up, 6 in 2024-09-19T06:43:55.208 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:54 smithi099 ceph-mon[97031]: mgrmap e40: smithi099.pgvkqi(active, since 17s), standbys: smithi117.ssmkcf 2024-09-19T06:43:55.208 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:54 smithi099 ceph-mon[97031]: overall HEALTH_OK 2024-09-19T06:43:55.208 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:54 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:43:55.208 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:54 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:43:55.208 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:54 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:43:56.195 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:55 smithi117 ceph-mon[76771]: pgmap v12: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:43:56.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:55 smithi099 ceph-mon[97031]: pgmap v12: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:43:56.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:56.804+0000 7f8cd4cd1640 1 -- 172.21.15.99:0/3646290439 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8cd0102580 msgr2=0x7f8cd0102950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:56.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:56.804+0000 7f8cd4cd1640 1 --2- 172.21.15.99:0/3646290439 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8cd0102580 0x7f8cd0102950 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8cc00048d0 tx=0x7f8cc0009da0 comp rx=0 tx=0).stop 2024-09-19T06:43:56.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:56.805+0000 7f8cd4cd1640 1 -- 172.21.15.99:0/3646290439 shutdown_connections 2024-09-19T06:43:56.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:56.805+0000 7f8cd4cd1640 1 --2- 172.21.15.99:0/3646290439 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8cd0102f20 0x7f8cd00fc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:56.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:56.805+0000 7f8cd4cd1640 1 --2- 172.21.15.99:0/3646290439 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8cd0102580 0x7f8cd0102950 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:56.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:56.805+0000 7f8cd4cd1640 1 -- 172.21.15.99:0/3646290439 >> 172.21.15.99:0/3646290439 conn(0x7f8cd00f81a0 msgr2=0x7f8cd00fa5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:56.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:56.805+0000 7f8cd4cd1640 1 -- 172.21.15.99:0/3646290439 shutdown_connections 2024-09-19T06:43:56.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:56.805+0000 7f8cd4cd1640 1 -- 172.21.15.99:0/3646290439 wait complete. 2024-09-19T06:43:56.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:56.805+0000 7f8cd4cd1640 1 Processor -- start 2024-09-19T06:43:56.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:56.805+0000 7f8cd4cd1640 1 -- start start 2024-09-19T06:43:56.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:56.805+0000 7f8cd4cd1640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8cd0102580 0x7f8cd006fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:56.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:56.805+0000 7f8cd4cd1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8cd0102f20 0x7f8cd006ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:56.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:56.805+0000 7f8cd4cd1640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd0070490 con 0x7f8cd0102580 2024-09-19T06:43:56.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:56.805+0000 7f8cd4cd1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd0070600 con 0x7f8cd0102f20 2024-09-19T06:43:56.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:56.806+0000 7f8cce59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8cd0102580 0x7f8cd006fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:56.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:56.806+0000 7f8cce59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8cd0102580 0x7f8cd006fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47154/0 (socket says 172.21.15.99:47154) 2024-09-19T06:43:56.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:56.806+0000 7f8cce59c640 1 -- 172.21.15.99:0/1954210742 learned_addr learned my addr 172.21.15.99:0/1954210742 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:43:56.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:56.806+0000 7f8ccdd9b640 1 --2- 172.21.15.99:0/1954210742 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8cd0102f20 0x7f8cd006ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:56.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:56.806+0000 7f8ccdd9b640 1 -- 172.21.15.99:0/1954210742 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8cd0102f20 msgr2=0x7f8cd006ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-19T06:43:56.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:56.806+0000 7f8cce59c640 1 -- 172.21.15.99:0/1954210742 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8cd0102f20 msgr2=0x7f8cd006ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:56.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:56.806+0000 7f8ccdd9b640 1 -- 172.21.15.99:0/1954210742 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8cd0102f20 msgr2=0x7f8cd006ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T06:43:56.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:56.806+0000 7f8ccdd9b640 1 --2- 172.21.15.99:0/1954210742 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8cd0102f20 0x7f8cd006ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-09-19T06:43:56.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:56.806+0000 7f8ccdd9b640 1 --2- 172.21.15.99:0/1954210742 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8cd0102f20 0x7f8cd006ff50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T06:43:56.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:56.806+0000 7f8cce59c640 1 --2- 172.21.15.99:0/1954210742 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8cd0102f20 0x7f8cd006ff50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:56.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:56.806+0000 7f8cce59c640 1 -- 172.21.15.99:0/1954210742 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc0005040 con 0x7f8cd0102580 2024-09-19T06:43:56.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:56.806+0000 7f8cce59c640 1 --2- 172.21.15.99:0/1954210742 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8cd0102580 0x7f8cd006fa10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8cc00043d0 tx=0x7f8cc0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:56.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:56.806+0000 7f8cbeffd640 1 -- 172.21.15.99:0/1954210742 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8cc0038070 con 0x7f8cd0102580 2024-09-19T06:43:56.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:56.806+0000 7f8cbeffd640 1 -- 172.21.15.99:0/1954210742 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8cc00096e0 con 0x7f8cd0102580 2024-09-19T06:43:56.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:56.806+0000 7f8cbeffd640 1 -- 172.21.15.99:0/1954210742 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8cc003d420 con 0x7f8cd0102580 2024-09-19T06:43:56.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:56.806+0000 7f8cd4cd1640 1 -- 172.21.15.99:0/1954210742 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cd0070830 con 0x7f8cd0102580 2024-09-19T06:43:56.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:56.806+0000 7f8cd4cd1640 1 -- 172.21.15.99:0/1954210742 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cd0119900 con 0x7f8cd0102580 2024-09-19T06:43:56.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:56.808+0000 7f8cd4cd1640 1 -- 172.21.15.99:0/1954210742 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cd00fdd00 con 0x7f8cd0102580 2024-09-19T06:43:56.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:56.808+0000 7f8cbeffd640 1 -- 172.21.15.99:0/1954210742 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 40) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f8cc0030020 con 0x7f8cd0102580 2024-09-19T06:43:56.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:56.808+0000 7f8cbeffd640 1 --2- 172.21.15.99:0/1954210742 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f8cb806e660 0x7f8cb8070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:56.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:56.809+0000 7f8cbeffd640 1 -- 172.21.15.99:0/1954210742 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f8cc00ae6c0 con 0x7f8cd0102580 2024-09-19T06:43:56.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:56.809+0000 7f8ccdd9b640 1 --2- 172.21.15.99:0/1954210742 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f8cb806e660 0x7f8cb8070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:56.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:56.809+0000 7f8ccdd9b640 1 --2- 172.21.15.99:0/1954210742 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f8cb806e660 0x7f8cb8070b10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8cc4007fd0 tx=0x7f8cc4009e90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:56.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:56.813+0000 7f8cbeffd640 1 -- 172.21.15.99:0/1954210742 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f8cc00777c0 con 0x7f8cd0102580 2024-09-19T06:43:57.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.000+0000 7f8cd4cd1640 1 -- 172.21.15.99:0/1954210742 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8cd0071100 con 0x7f8cb806e660 2024-09-19T06:43:57.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.003+0000 7f8cbeffd640 1 -- 172.21.15.99:0/1954210742 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f8cd0071100 con 0x7f8cb806e660 2024-09-19T06:43:57.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.005+0000 7f8cd4cd1640 1 -- 172.21.15.99:0/1954210742 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f8cb806e660 msgr2=0x7f8cb8070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:57.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.005+0000 7f8cd4cd1640 1 --2- 172.21.15.99:0/1954210742 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f8cb806e660 0x7f8cb8070b10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8cc4007fd0 tx=0x7f8cc4009e90 comp rx=0 tx=0).stop 2024-09-19T06:43:57.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.005+0000 7f8cd4cd1640 1 -- 172.21.15.99:0/1954210742 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8cd0102580 msgr2=0x7f8cd006fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:57.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.005+0000 7f8cd4cd1640 1 --2- 172.21.15.99:0/1954210742 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8cd0102580 0x7f8cd006fa10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8cc00043d0 tx=0x7f8cc0009da0 comp rx=0 tx=0).stop 2024-09-19T06:43:57.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.005+0000 7f8cd4cd1640 1 -- 172.21.15.99:0/1954210742 shutdown_connections 2024-09-19T06:43:57.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.005+0000 7f8cd4cd1640 1 --2- 172.21.15.99:0/1954210742 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f8cb806e660 0x7f8cb8070b10 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:57.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.005+0000 7f8cd4cd1640 1 --2- 172.21.15.99:0/1954210742 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8cd0102f20 0x7f8cd006ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:57.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.005+0000 7f8cd4cd1640 1 --2- 172.21.15.99:0/1954210742 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8cd0102580 0x7f8cd006fa10 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:57.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.005+0000 7f8cd4cd1640 1 -- 172.21.15.99:0/1954210742 >> 172.21.15.99:0/1954210742 conn(0x7f8cd00f81a0 msgr2=0x7f8cd00f9160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:57.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.005+0000 7f8cd4cd1640 1 -- 172.21.15.99:0/1954210742 shutdown_connections 2024-09-19T06:43:57.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.005+0000 7f8cd4cd1640 1 -- 172.21.15.99:0/1954210742 wait complete. 2024-09-19T06:43:57.015 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-09-19T06:43:57.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.084+0000 7ff2adffb640 1 -- 172.21.15.99:0/842415825 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff298032610 con 0x7ff2b0102ef0 2024-09-19T06:43:57.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.085+0000 7ff2b5580640 1 -- 172.21.15.99:0/842415825 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff2b0102ef0 msgr2=0x7ff2b00fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:57.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.085+0000 7ff2b5580640 1 --2- 172.21.15.99:0/842415825 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff2b0102ef0 0x7ff2b00fc5b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff2980048d0 tx=0x7ff298009da0 comp rx=0 tx=0).stop 2024-09-19T06:43:57.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.085+0000 7ff2b5580640 1 -- 172.21.15.99:0/842415825 shutdown_connections 2024-09-19T06:43:57.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.085+0000 7ff2b5580640 1 --2- 172.21.15.99:0/842415825 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff2b0102ef0 0x7ff2b00fc5b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:57.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.085+0000 7ff2b5580640 1 --2- 172.21.15.99:0/842415825 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2b0102550 0x7ff2b0102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:57.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.085+0000 7ff2b5580640 1 -- 172.21.15.99:0/842415825 >> 172.21.15.99:0/842415825 conn(0x7ff2b00f80f0 msgr2=0x7ff2b00fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:57.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.085+0000 7ff2b5580640 1 -- 172.21.15.99:0/842415825 shutdown_connections 2024-09-19T06:43:57.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.085+0000 7ff2b5580640 1 -- 172.21.15.99:0/842415825 wait complete. 2024-09-19T06:43:57.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.086+0000 7ff2b5580640 1 Processor -- start 2024-09-19T06:43:57.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.086+0000 7ff2b5580640 1 -- start start 2024-09-19T06:43:57.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.086+0000 7ff2b5580640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2b0102550 0x7ff2b0113530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:57.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.086+0000 7ff2b5580640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff2b0102ef0 0x7ff2b0113a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:57.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.086+0000 7ff2b5580640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b01140c0 con 0x7ff2b0102ef0 2024-09-19T06:43:57.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.086+0000 7ff2b5580640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b010d4d0 con 0x7ff2b0102550 2024-09-19T06:43:57.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.086+0000 7ff2aeffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2b0102550 0x7ff2b0113530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:57.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.086+0000 7ff2aeffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2b0102550 0x7ff2b0113530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.99:49406/0 (socket says 172.21.15.99:49406) 2024-09-19T06:43:57.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.086+0000 7ff2aeffd640 1 -- 172.21.15.99:0/2395978441 learned_addr learned my addr 172.21.15.99:0/2395978441 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:43:57.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.086+0000 7ff2ae7fc640 1 --2- 172.21.15.99:0/2395978441 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff2b0102ef0 0x7ff2b0113a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:57.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.086+0000 7ff2aeffd640 1 -- 172.21.15.99:0/2395978441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2b0102550 msgr2=0x7ff2b0113530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-19T06:43:57.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.086+0000 7ff2aeffd640 1 -- 172.21.15.99:0/2395978441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2b0102550 msgr2=0x7ff2b0113530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T06:43:57.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.086+0000 7ff2aeffd640 1 --2- 172.21.15.99:0/2395978441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2b0102550 0x7ff2b0113530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-09-19T06:43:57.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.086+0000 7ff2aeffd640 1 --2- 172.21.15.99:0/2395978441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2b0102550 0x7ff2b0113530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T06:43:57.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.087+0000 7ff2ae7fc640 1 -- 172.21.15.99:0/2395978441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2b0102550 msgr2=0x7ff2b0113530 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T06:43:57.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.087+0000 7ff2ae7fc640 1 --2- 172.21.15.99:0/2395978441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2b0102550 0x7ff2b0113530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:57.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.087+0000 7ff2ae7fc640 1 -- 172.21.15.99:0/2395978441 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff298005040 con 0x7ff2b0102ef0 2024-09-19T06:43:57.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.087+0000 7ff2ae7fc640 1 --2- 172.21.15.99:0/2395978441 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff2b0102ef0 0x7ff2b0113a70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff29802a530 tx=0x7ff298009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:57.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.087+0000 7ff2a77fe640 1 -- 172.21.15.99:0/2395978441 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff298038070 con 0x7ff2b0102ef0 2024-09-19T06:43:57.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.087+0000 7ff2a77fe640 1 -- 172.21.15.99:0/2395978441 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff29802c070 con 0x7ff2b0102ef0 2024-09-19T06:43:57.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.087+0000 7ff2a77fe640 1 -- 172.21.15.99:0/2395978441 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff298033660 con 0x7ff2b0102ef0 2024-09-19T06:43:57.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.087+0000 7ff2b5580640 1 -- 172.21.15.99:0/2395978441 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2b010d750 con 0x7ff2b0102ef0 2024-09-19T06:43:57.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.087+0000 7ff2b5580640 1 -- 172.21.15.99:0/2395978441 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2b010db80 con 0x7ff2b0102ef0 2024-09-19T06:43:57.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.088+0000 7ff2b5580640 1 -- 172.21.15.99:0/2395978441 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2b00fdcd0 con 0x7ff2b0102ef0 2024-09-19T06:43:57.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.089+0000 7ff2a77fe640 1 -- 172.21.15.99:0/2395978441 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 40) v1 ==== 92653+0+0 (secure 0 0 0) 0x7ff298030020 con 0x7ff2b0102ef0 2024-09-19T06:43:57.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.089+0000 7ff2a77fe640 1 --2- 172.21.15.99:0/2395978441 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ff29c072a70 0x7ff29c074f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:57.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.089+0000 7ff2a77fe640 1 -- 172.21.15.99:0/2395978441 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6324+0+0 (secure 0 0 0) 0x7ff2980ae120 con 0x7ff2b0102ef0 2024-09-19T06:43:57.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.089+0000 7ff2aeffd640 1 --2- 172.21.15.99:0/2395978441 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ff29c072a70 0x7ff29c074f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:57.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.090+0000 7ff2aeffd640 1 --2- 172.21.15.99:0/2395978441 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ff29c072a70 0x7ff29c074f20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff2a00041d0 tx=0x7ff2a0009f70 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:57.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.094+0000 7ff2a77fe640 1 -- 172.21.15.99:0/2395978441 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7ff298077220 con 0x7ff2b0102ef0 2024-09-19T06:43:57.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.277+0000 7ff2b5580640 1 -- 172.21.15.99:0/2395978441 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff2b0113220 con 0x7ff29c072a70 2024-09-19T06:43:57.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.278+0000 7ff2a77fe640 1 -- 172.21.15.99:0/2395978441 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7ff2b0113220 con 0x7ff29c072a70 2024-09-19T06:43:57.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.280+0000 7ff2b5580640 1 -- 172.21.15.99:0/2395978441 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ff29c072a70 msgr2=0x7ff29c074f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:57.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.280+0000 7ff2b5580640 1 --2- 172.21.15.99:0/2395978441 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ff29c072a70 0x7ff29c074f20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff2a00041d0 tx=0x7ff2a0009f70 comp rx=0 tx=0).stop 2024-09-19T06:43:57.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.280+0000 7ff2b5580640 1 -- 172.21.15.99:0/2395978441 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff2b0102ef0 msgr2=0x7ff2b0113a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:57.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.280+0000 7ff2b5580640 1 --2- 172.21.15.99:0/2395978441 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff2b0102ef0 0x7ff2b0113a70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff29802a530 tx=0x7ff298009da0 comp rx=0 tx=0).stop 2024-09-19T06:43:57.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.280+0000 7ff2b5580640 1 -- 172.21.15.99:0/2395978441 shutdown_connections 2024-09-19T06:43:57.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.280+0000 7ff2b5580640 1 --2- 172.21.15.99:0/2395978441 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ff29c072a70 0x7ff29c074f20 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:57.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.280+0000 7ff2b5580640 1 --2- 172.21.15.99:0/2395978441 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff2b0102ef0 0x7ff2b0113a70 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:57.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.280+0000 7ff2b5580640 1 --2- 172.21.15.99:0/2395978441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2b0102550 0x7ff2b0113530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:57.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.280+0000 7ff2b5580640 1 -- 172.21.15.99:0/2395978441 >> 172.21.15.99:0/2395978441 conn(0x7ff2b00f80f0 msgr2=0x7ff2b00f9120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:57.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.280+0000 7ff2b5580640 1 -- 172.21.15.99:0/2395978441 shutdown_connections 2024-09-19T06:43:57.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.280+0000 7ff2b5580640 1 -- 172.21.15.99:0/2395978441 wait complete. 2024-09-19T06:43:57.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.360+0000 7f46b3e6c640 1 -- 172.21.15.99:0/3469494687 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46ac0fb7c0 msgr2=0x7f46ac10cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:57.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.360+0000 7f46b3e6c640 1 --2- 172.21.15.99:0/3469494687 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46ac0fb7c0 0x7f46ac10cbd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f469c0048d0 tx=0x7f469c009da0 comp rx=0 tx=0).stop 2024-09-19T06:43:57.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.360+0000 7f46b3e6c640 1 -- 172.21.15.99:0/3469494687 shutdown_connections 2024-09-19T06:43:57.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.360+0000 7f46b3e6c640 1 --2- 172.21.15.99:0/3469494687 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46ac0fb7c0 0x7f46ac10cbd0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:57.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.360+0000 7f46b3e6c640 1 --2- 172.21.15.99:0/3469494687 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46ac0faeb0 0x7f46ac0fb280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:57.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.360+0000 7f46b3e6c640 1 -- 172.21.15.99:0/3469494687 >> 172.21.15.99:0/3469494687 conn(0x7f46ac070ce0 msgr2=0x7f46ac0710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:57.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.361+0000 7f46b3e6c640 1 -- 172.21.15.99:0/3469494687 shutdown_connections 2024-09-19T06:43:57.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.361+0000 7f46b3e6c640 1 -- 172.21.15.99:0/3469494687 wait complete. 2024-09-19T06:43:57.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.361+0000 7f46b3e6c640 1 Processor -- start 2024-09-19T06:43:57.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.361+0000 7f46b3e6c640 1 -- start start 2024-09-19T06:43:57.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.361+0000 7f46b3e6c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46ac0faeb0 0x7f46ac119820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:57.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.361+0000 7f46b3e6c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46ac0fb7c0 0x7f46ac119d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:57.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.361+0000 7f46b3e6c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46ac11a3b0 con 0x7f46ac0faeb0 2024-09-19T06:43:57.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.361+0000 7f46b3e6c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46ac1137c0 con 0x7f46ac0fb7c0 2024-09-19T06:43:57.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.361+0000 7f46b1c08640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46ac0faeb0 0x7f46ac119820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:57.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.361+0000 7f46b1c08640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46ac0faeb0 0x7f46ac119820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47180/0 (socket says 172.21.15.99:47180) 2024-09-19T06:43:57.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.361+0000 7f46b1c08640 1 -- 172.21.15.99:0/2772313401 learned_addr learned my addr 172.21.15.99:0/2772313401 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:43:57.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.361+0000 7f46b1407640 1 --2- 172.21.15.99:0/2772313401 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46ac0fb7c0 0x7f46ac119d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:57.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.362+0000 7f46b1c08640 1 -- 172.21.15.99:0/2772313401 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46ac0fb7c0 msgr2=0x7f46ac119d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:57.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.362+0000 7f46b1c08640 1 --2- 172.21.15.99:0/2772313401 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46ac0fb7c0 0x7f46ac119d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:57.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.362+0000 7f46b1c08640 1 -- 172.21.15.99:0/2772313401 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f469c005040 con 0x7f46ac0faeb0 2024-09-19T06:43:57.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.362+0000 7f46b1c08640 1 --2- 172.21.15.99:0/2772313401 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46ac0faeb0 0x7f46ac119820 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f46a800eb70 tx=0x7f46a800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:57.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.362+0000 7f46a27fc640 1 -- 172.21.15.99:0/2772313401 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46a8007c30 con 0x7f46ac0faeb0 2024-09-19T06:43:57.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.362+0000 7f46a27fc640 1 -- 172.21.15.99:0/2772313401 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f46a800f040 con 0x7f46ac0faeb0 2024-09-19T06:43:57.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.362+0000 7f46b3e6c640 1 -- 172.21.15.99:0/2772313401 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46ac113a40 con 0x7f46ac0faeb0 2024-09-19T06:43:57.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.362+0000 7f46a27fc640 1 -- 172.21.15.99:0/2772313401 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46a800ca60 con 0x7f46ac0faeb0 2024-09-19T06:43:57.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.362+0000 7f46b3e6c640 1 -- 172.21.15.99:0/2772313401 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46ac113f60 con 0x7f46ac0faeb0 2024-09-19T06:43:57.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.363+0000 7f46b3e6c640 1 -- 172.21.15.99:0/2772313401 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46ac0fbc90 con 0x7f46ac0faeb0 2024-09-19T06:43:57.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.364+0000 7f46a27fc640 1 -- 172.21.15.99:0/2772313401 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 40) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f46a800cbc0 con 0x7f46ac0faeb0 2024-09-19T06:43:57.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.364+0000 7f46a27fc640 1 --2- 172.21.15.99:0/2772313401 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f469806e660 0x7f4698070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:57.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.364+0000 7f46a27fc640 1 -- 172.21.15.99:0/2772313401 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f46a808ded0 con 0x7f46ac0faeb0 2024-09-19T06:43:57.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.365+0000 7f46b1407640 1 --2- 172.21.15.99:0/2772313401 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f469806e660 0x7f4698070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:57.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.365+0000 7f46b1407640 1 --2- 172.21.15.99:0/2772313401 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f469806e660 0x7f4698070b10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f469c004540 tx=0x7f469c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:57.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.369+0000 7f46a27fc640 1 -- 172.21.15.99:0/2772313401 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f46a8056f70 con 0x7f46ac0faeb0 2024-09-19T06:43:57.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.542+0000 7f46b3e6c640 1 -- 172.21.15.99:0/2772313401 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f46ac10fbe0 con 0x7f469806e660 2024-09-19T06:43:57.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.551+0000 7f46a27fc640 1 -- 172.21.15.99:0/2772313401 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f46ac10fbe0 con 0x7f469806e660 2024-09-19T06:43:57.552 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T06:43:57.553 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.smithi099 smithi099 *:9093,9094 running (2m) 15s ago 11m 22.8M - 0.25.0 c8568f914cd2 e7c1774d56b0 2024-09-19T06:43:57.553 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi099 smithi099 running (11m) 15s ago 11m 6895k - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 216ce2ef7f1e 2024-09-19T06:43:57.553 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi117 smithi117 running (10m) 0s ago 10m 6899k - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 b4c328bdec52 2024-09-19T06:43:57.553 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.smithi099 smithi099 *:3000 running (84s) 15s ago 11m 75.3M - 9.4.12 2bacad6d85d8 cd53a18d5410 2024-09-19T06:43:57.553 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.obarqf smithi099 running (6m) 15s ago 6m 13.1M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 e36c9b74004b 2024-09-19T06:43:57.553 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.xehbxe smithi099 running (6m) 15s ago 6m 122M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 d09eb3d306ae 2024-09-19T06:43:57.553 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.bheqzh smithi117 running (6m) 0s ago 6m 15.2M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 21253e27fdd3 2024-09-19T06:43:57.553 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.nooexo smithi117 running (6m) 0s ago 6m 109M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 ad1faeb3343c 2024-09-19T06:43:57.553 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi099.pgvkqi smithi099 *:8443,9283,8765 running (2m) 15s ago 12m 473M - 19.1.1-361-g2f599a46 d2baa855c067 d5de99cb7e78 2024-09-19T06:43:57.554 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi117.ssmkcf smithi117 *:8443,9283,8765 running (105s) 0s ago 10m 440M - 19.1.1-361-g2f599a46 d2baa855c067 8b7ee0f871f5 2024-09-19T06:43:57.554 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi099 smithi099 running (27s) 15s ago 12m 29.9M 2048M 19.1.1-361-g2f599a46 d2baa855c067 ffe067438824 2024-09-19T06:43:57.554 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi117 smithi117 running (5s) 0s ago 10m 20.0M 2048M 19.1.1-361-g2f599a46 d2baa855c067 4cb7455e3ee7 2024-09-19T06:43:57.554 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi099 smithi099 *:9100 running (3m) 15s ago 11m 15.3M - 1.5.0 0da6a335fe13 dca7b4517dcc 2024-09-19T06:43:57.554 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi117 smithi117 *:9100 running (2m) 0s ago 10m 16.3M - 1.5.0 0da6a335fe13 8233ce3835d2 2024-09-19T06:43:57.554 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (9m) 15s ago 9m 218M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 cf8d3dd4a987 2024-09-19T06:43:57.554 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (9m) 15s ago 9m 237M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 bc5b04b8bf9f 2024-09-19T06:43:57.554 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (8m) 15s ago 8m 201M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 cedc7e3698d8 2024-09-19T06:43:57.554 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi117 running (8m) 0s ago 8m 260M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 5984ed999c91 2024-09-19T06:43:57.554 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi117 running (8m) 0s ago 8m 231M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 6a2fc0c51c05 2024-09-19T06:43:57.554 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi117 running (7m) 0s ago 7m 226M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 39dcb7dbf0e3 2024-09-19T06:43:57.554 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.smithi099 smithi099 *:9095 running (110s) 15s ago 10m 51.7M - 2.43.0 a07b618ecd1d 15ad26ec6fb4 2024-09-19T06:43:57.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.553+0000 7f46b3e6c640 1 -- 172.21.15.99:0/2772313401 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f469806e660 msgr2=0x7f4698070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:57.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.553+0000 7f46b3e6c640 1 --2- 172.21.15.99:0/2772313401 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f469806e660 0x7f4698070b10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f469c004540 tx=0x7f469c035040 comp rx=0 tx=0).stop 2024-09-19T06:43:57.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.553+0000 7f46b3e6c640 1 -- 172.21.15.99:0/2772313401 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46ac0faeb0 msgr2=0x7f46ac119820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:57.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.553+0000 7f46b3e6c640 1 --2- 172.21.15.99:0/2772313401 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46ac0faeb0 0x7f46ac119820 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f46a800eb70 tx=0x7f46a800b040 comp rx=0 tx=0).stop 2024-09-19T06:43:57.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.554+0000 7f46b3e6c640 1 -- 172.21.15.99:0/2772313401 shutdown_connections 2024-09-19T06:43:57.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.554+0000 7f46b3e6c640 1 --2- 172.21.15.99:0/2772313401 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f469806e660 0x7f4698070b10 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:57.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.554+0000 7f46b3e6c640 1 --2- 172.21.15.99:0/2772313401 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46ac0fb7c0 0x7f46ac119d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:57.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.554+0000 7f46b3e6c640 1 --2- 172.21.15.99:0/2772313401 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46ac0faeb0 0x7f46ac119820 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:57.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.554+0000 7f46b3e6c640 1 -- 172.21.15.99:0/2772313401 >> 172.21.15.99:0/2772313401 conn(0x7f46ac070ce0 msgr2=0x7f46ac0f9740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:57.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.554+0000 7f46b3e6c640 1 -- 172.21.15.99:0/2772313401 shutdown_connections 2024-09-19T06:43:57.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.554+0000 7f46b3e6c640 1 -- 172.21.15.99:0/2772313401 wait complete. 2024-09-19T06:43:57.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.631+0000 7ffa31d40640 1 -- 172.21.15.99:0/2876985381 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa2c0fcf80 msgr2=0x7ffa2c0fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:57.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.631+0000 7ffa31d40640 1 --2- 172.21.15.99:0/2876985381 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa2c0fcf80 0x7ffa2c0fd3d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ffa140048d0 tx=0x7ffa14009da0 comp rx=0 tx=0).stop 2024-09-19T06:43:57.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.631+0000 7ffa31d40640 1 -- 172.21.15.99:0/2876985381 shutdown_connections 2024-09-19T06:43:57.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.631+0000 7ffa31d40640 1 --2- 172.21.15.99:0/2876985381 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa2c0fcf80 0x7ffa2c0fd3d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:57.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.631+0000 7ffa31d40640 1 --2- 172.21.15.99:0/2876985381 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa2c0fb810 0x7ffa2c0fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:57.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.631+0000 7ffa31d40640 1 -- 172.21.15.99:0/2876985381 >> 172.21.15.99:0/2876985381 conn(0x7ffa2c0723b0 msgr2=0x7ffa2c0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:57.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.631+0000 7ffa31d40640 1 -- 172.21.15.99:0/2876985381 shutdown_connections 2024-09-19T06:43:57.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.631+0000 7ffa31d40640 1 -- 172.21.15.99:0/2876985381 wait complete. 2024-09-19T06:43:57.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.631+0000 7ffa31d40640 1 Processor -- start 2024-09-19T06:43:57.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.632+0000 7ffa31d40640 1 -- start start 2024-09-19T06:43:57.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.632+0000 7ffa31d40640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa2c0fb810 0x7ffa2c10e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:57.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.632+0000 7ffa31d40640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa2c0fcf80 0x7ffa2c10e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:57.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.632+0000 7ffa31d40640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2c10ee80 con 0x7ffa2c0fb810 2024-09-19T06:43:57.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.632+0000 7ffa31d40640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2c10eff0 con 0x7ffa2c0fcf80 2024-09-19T06:43:57.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.632+0000 7ffa2b7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa2c0fb810 0x7ffa2c10e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:57.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.632+0000 7ffa2b7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa2c0fb810 0x7ffa2c10e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47200/0 (socket says 172.21.15.99:47200) 2024-09-19T06:43:57.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.632+0000 7ffa2b7fe640 1 -- 172.21.15.99:0/3588918212 learned_addr learned my addr 172.21.15.99:0/3588918212 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:43:57.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.632+0000 7ffa23fff640 1 --2- 172.21.15.99:0/3588918212 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa2c0fcf80 0x7ffa2c10e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:57.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.632+0000 7ffa2b7fe640 1 -- 172.21.15.99:0/3588918212 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa2c0fcf80 msgr2=0x7ffa2c10e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:57.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.632+0000 7ffa2b7fe640 1 --2- 172.21.15.99:0/3588918212 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa2c0fcf80 0x7ffa2c10e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:57.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.632+0000 7ffa2b7fe640 1 -- 172.21.15.99:0/3588918212 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa14005040 con 0x7ffa2c0fb810 2024-09-19T06:43:57.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.632+0000 7ffa2b7fe640 1 --2- 172.21.15.99:0/3588918212 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa2c0fb810 0x7ffa2c10e240 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c00b790 tx=0x7ffa1c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:57.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.633+0000 7ffa28ff9640 1 -- 172.21.15.99:0/3588918212 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa1c00c700 con 0x7ffa2c0fb810 2024-09-19T06:43:57.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.633+0000 7ffa28ff9640 1 -- 172.21.15.99:0/3588918212 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ffa1c00cd00 con 0x7ffa2c0fb810 2024-09-19T06:43:57.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.633+0000 7ffa31d40640 1 -- 172.21.15.99:0/3588918212 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa2c117370 con 0x7ffa2c0fb810 2024-09-19T06:43:57.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.633+0000 7ffa28ff9640 1 -- 172.21.15.99:0/3588918212 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa1c015e70 con 0x7ffa2c0fb810 2024-09-19T06:43:57.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.633+0000 7ffa31d40640 1 -- 172.21.15.99:0/3588918212 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa2c117860 con 0x7ffa2c0fb810 2024-09-19T06:43:57.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.634+0000 7ffa31d40640 1 -- 172.21.15.99:0/3588918212 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa2c0fcbc0 con 0x7ffa2c0fb810 2024-09-19T06:43:57.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.634+0000 7ffa28ff9640 1 -- 172.21.15.99:0/3588918212 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 40) v1 ==== 92653+0+0 (secure 0 0 0) 0x7ffa1c012070 con 0x7ffa2c0fb810 2024-09-19T06:43:57.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.635+0000 7ffa28ff9640 1 --2- 172.21.15.99:0/3588918212 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ffa1806e660 0x7ffa18070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:57.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.635+0000 7ffa28ff9640 1 -- 172.21.15.99:0/3588918212 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6324+0+0 (secure 0 0 0) 0x7ffa1c08dc00 con 0x7ffa2c0fb810 2024-09-19T06:43:57.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.635+0000 7ffa23fff640 1 --2- 172.21.15.99:0/3588918212 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ffa1806e660 0x7ffa18070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:57.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.635+0000 7ffa23fff640 1 --2- 172.21.15.99:0/3588918212 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ffa1806e660 0x7ffa18070b10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c065980 tx=0x7ffa14035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:57.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.639+0000 7ffa28ff9640 1 -- 172.21.15.99:0/3588918212 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7ffa1c056c80 con 0x7ffa2c0fb810 2024-09-19T06:43:57.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.873+0000 7ffa31d40640 1 -- 172.21.15.99:0/3588918212 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ffa2c04b720 con 0x7ffa2c0fb810 2024-09-19T06:43:57.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.873+0000 7ffa28ff9640 1 -- 172.21.15.99:0/3588918212 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+745 (secure 0 0 0) 0x7ffa1c05a340 con 0x7ffa2c0fb810 2024-09-19T06:43:57.875 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:43:57.875 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-09-19T06:43:57.875 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T06:43:57.875 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:43:57.875 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-09-19T06:43:57.875 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T06:43:57.875 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:43:57.875 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-09-19T06:43:57.875 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 6 2024-09-19T06:43:57.876 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:43:57.876 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": { 2024-09-19T06:43:57.876 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 4 2024-09-19T06:43:57.876 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:43:57.876 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-09-19T06:43:57.876 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 10, 2024-09-19T06:43:57.876 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 4 2024-09-19T06:43:57.876 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T06:43:57.876 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:43:57.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.875+0000 7ffa31d40640 1 -- 172.21.15.99:0/3588918212 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ffa1806e660 msgr2=0x7ffa18070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:57.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.875+0000 7ffa31d40640 1 --2- 172.21.15.99:0/3588918212 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ffa1806e660 0x7ffa18070b10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c065980 tx=0x7ffa14035040 comp rx=0 tx=0).stop 2024-09-19T06:43:57.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.876+0000 7ffa31d40640 1 -- 172.21.15.99:0/3588918212 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa2c0fb810 msgr2=0x7ffa2c10e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:57.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.876+0000 7ffa31d40640 1 --2- 172.21.15.99:0/3588918212 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa2c0fb810 0x7ffa2c10e240 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c00b790 tx=0x7ffa1c0091d0 comp rx=0 tx=0).stop 2024-09-19T06:43:57.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.876+0000 7ffa31d40640 1 -- 172.21.15.99:0/3588918212 shutdown_connections 2024-09-19T06:43:57.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.876+0000 7ffa31d40640 1 --2- 172.21.15.99:0/3588918212 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ffa1806e660 0x7ffa18070b10 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:57.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.876+0000 7ffa31d40640 1 --2- 172.21.15.99:0/3588918212 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa2c0fcf80 0x7ffa2c10e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:57.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.876+0000 7ffa31d40640 1 --2- 172.21.15.99:0/3588918212 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa2c0fb810 0x7ffa2c10e240 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:57.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.876+0000 7ffa31d40640 1 -- 172.21.15.99:0/3588918212 >> 172.21.15.99:0/3588918212 conn(0x7ffa2c0723b0 msgr2=0x7ffa2c0fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:57.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.876+0000 7ffa31d40640 1 -- 172.21.15.99:0/3588918212 shutdown_connections 2024-09-19T06:43:57.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.876+0000 7ffa31d40640 1 -- 172.21.15.99:0/3588918212 wait complete. 2024-09-19T06:43:57.941 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:57 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:43:57.941 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:57 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:43:57.941 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:57 smithi117 ceph-mon[76771]: pgmap v13: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:43:57.941 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:57 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:43:57.941 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:57 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:43:57.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.954+0000 7f32692a2640 1 -- 172.21.15.99:0/2815048222 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32640fb4c0 msgr2=0x7f32640fb930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:57.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.954+0000 7f32692a2640 1 --2- 172.21.15.99:0/2815048222 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32640fb4c0 0x7f32640fb930 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f324c004950 tx=0x7f324c009da0 comp rx=0 tx=0).stop 2024-09-19T06:43:57.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.954+0000 7f32692a2640 1 -- 172.21.15.99:0/2815048222 shutdown_connections 2024-09-19T06:43:57.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.954+0000 7f32692a2640 1 --2- 172.21.15.99:0/2815048222 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32640fb4c0 0x7f32640fb930 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:57.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.954+0000 7f32692a2640 1 --2- 172.21.15.99:0/2815048222 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3264101500 0x7f32641018d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:57.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.954+0000 7f32692a2640 1 -- 172.21.15.99:0/2815048222 >> 172.21.15.99:0/2815048222 conn(0x7f32640f7000 msgr2=0x7f32640f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:57.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.954+0000 7f32692a2640 1 -- 172.21.15.99:0/2815048222 shutdown_connections 2024-09-19T06:43:57.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:57 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:43:57.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:57 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:43:57.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:57 smithi099 ceph-mon[97031]: pgmap v13: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:43:57.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:57 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:43:57.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:57 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:43:57.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.954+0000 7f32692a2640 1 -- 172.21.15.99:0/2815048222 wait complete. 2024-09-19T06:43:57.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.955+0000 7f32692a2640 1 Processor -- start 2024-09-19T06:43:57.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.955+0000 7f32692a2640 1 -- start start 2024-09-19T06:43:57.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.955+0000 7f32692a2640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32640fb4c0 0x7f3264110fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:57.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.955+0000 7f32692a2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3264101500 0x7f3264111510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:57.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.955+0000 7f32692a2640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3264111b10 con 0x7f32640fb4c0 2024-09-19T06:43:57.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.955+0000 7f32692a2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f326410af50 con 0x7f3264101500 2024-09-19T06:43:57.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.955+0000 7f3262ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32640fb4c0 0x7f3264110fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:57.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.955+0000 7f3262ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32640fb4c0 0x7f3264110fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47208/0 (socket says 172.21.15.99:47208) 2024-09-19T06:43:57.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.955+0000 7f3262ffd640 1 -- 172.21.15.99:0/1576302061 learned_addr learned my addr 172.21.15.99:0/1576302061 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:43:57.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.955+0000 7f325a7fc640 1 --2- 172.21.15.99:0/1576302061 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3264101500 0x7f3264111510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:57.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.955+0000 7f3262ffd640 1 -- 172.21.15.99:0/1576302061 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3264101500 msgr2=0x7f3264111510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:57.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.956+0000 7f3262ffd640 1 --2- 172.21.15.99:0/1576302061 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3264101500 0x7f3264111510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:57.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.956+0000 7f3262ffd640 1 -- 172.21.15.99:0/1576302061 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f324c005040 con 0x7f32640fb4c0 2024-09-19T06:43:57.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.956+0000 7f325a7fc640 1 --2- 172.21.15.99:0/1576302061 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3264101500 0x7f3264111510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:43:57.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.956+0000 7f3262ffd640 1 --2- 172.21.15.99:0/1576302061 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32640fb4c0 0x7f3264110fd0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f325400eb70 tx=0x7f325400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:57.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.956+0000 7f325bfff640 1 -- 172.21.15.99:0/1576302061 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3254007c30 con 0x7f32640fb4c0 2024-09-19T06:43:57.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.956+0000 7f32692a2640 1 -- 172.21.15.99:0/1576302061 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f326410b1d0 con 0x7f32640fb4c0 2024-09-19T06:43:57.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.956+0000 7f325bfff640 1 -- 172.21.15.99:0/1576302061 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f325400f040 con 0x7f32640fb4c0 2024-09-19T06:43:57.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.956+0000 7f325bfff640 1 -- 172.21.15.99:0/1576302061 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32540094e0 con 0x7f32640fb4c0 2024-09-19T06:43:57.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.956+0000 7f32692a2640 1 -- 172.21.15.99:0/1576302061 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f326410b740 con 0x7f32640fb4c0 2024-09-19T06:43:57.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.957+0000 7f32692a2640 1 -- 172.21.15.99:0/1576302061 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32640fcc00 con 0x7f32640fb4c0 2024-09-19T06:43:57.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.958+0000 7f325bfff640 1 -- 172.21.15.99:0/1576302061 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 40) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f3254009640 con 0x7f32640fb4c0 2024-09-19T06:43:57.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.958+0000 7f325bfff640 1 --2- 172.21.15.99:0/1576302061 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f325006e660 0x7f3250070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:57.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.959+0000 7f325bfff640 1 -- 172.21.15.99:0/1576302061 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f325408dff0 con 0x7f32640fb4c0 2024-09-19T06:43:57.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.959+0000 7f325a7fc640 1 --2- 172.21.15.99:0/1576302061 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f325006e660 0x7f3250070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:57.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.959+0000 7f325a7fc640 1 --2- 172.21.15.99:0/1576302061 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f325006e660 0x7f3250070b10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f32640fa670 tx=0x7f324c009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:57.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:57.963+0000 7f325bfff640 1 -- 172.21.15.99:0/1576302061 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f3254056fe0 con 0x7f32640fb4c0 2024-09-19T06:43:58.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.171+0000 7f32692a2640 1 -- 172.21.15.99:0/1576302061 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f326404b750 con 0x7f32640fb4c0 2024-09-19T06:43:58.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.172+0000 7f325bfff640 1 -- 172.21.15.99:0/1576302061 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1958 (secure 0 0 0) 0x7f325405a6a0 con 0x7f32640fb4c0 2024-09-19T06:43:58.173 INFO:teuthology.orchestra.run.smithi099.stdout:e18 2024-09-19T06:43:58.173 INFO:teuthology.orchestra.run.smithi099.stdout:btime 2024-09-19T06:43:47:392296+0000 2024-09-19T06:43:58.173 INFO:teuthology.orchestra.run.smithi099.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T06:43:58.173 INFO:teuthology.orchestra.run.smithi099.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T06:43:58.173 INFO:teuthology.orchestra.run.smithi099.stdout:legacy client fscid: 1 2024-09-19T06:43:58.174 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:43:58.174 INFO:teuthology.orchestra.run.smithi099.stdout:Filesystem 'cephfs' (1) 2024-09-19T06:43:58.174 INFO:teuthology.orchestra.run.smithi099.stdout:fs_name cephfs 2024-09-19T06:43:58.174 INFO:teuthology.orchestra.run.smithi099.stdout:epoch 18 2024-09-19T06:43:58.174 INFO:teuthology.orchestra.run.smithi099.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-19T06:43:58.174 INFO:teuthology.orchestra.run.smithi099.stdout:created 2024-09-19T06:37:40.838146+0000 2024-09-19T06:43:58.174 INFO:teuthology.orchestra.run.smithi099.stdout:modified 2024-09-19T06:43:47.392294+0000 2024-09-19T06:43:58.174 INFO:teuthology.orchestra.run.smithi099.stdout:tableserver 0 2024-09-19T06:43:58.174 INFO:teuthology.orchestra.run.smithi099.stdout:root 0 2024-09-19T06:43:58.174 INFO:teuthology.orchestra.run.smithi099.stdout:session_timeout 60 2024-09-19T06:43:58.174 INFO:teuthology.orchestra.run.smithi099.stdout:session_autoclose 300 2024-09-19T06:43:58.174 INFO:teuthology.orchestra.run.smithi099.stdout:max_file_size 1099511627776 2024-09-19T06:43:58.174 INFO:teuthology.orchestra.run.smithi099.stdout:max_xattr_size 65536 2024-09-19T06:43:58.175 INFO:teuthology.orchestra.run.smithi099.stdout:required_client_features {} 2024-09-19T06:43:58.175 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure 0 2024-09-19T06:43:58.175 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure_osd_epoch 45 2024-09-19T06:43:58.175 INFO:teuthology.orchestra.run.smithi099.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T06:43:58.175 INFO:teuthology.orchestra.run.smithi099.stdout:max_mds 2 2024-09-19T06:43:58.175 INFO:teuthology.orchestra.run.smithi099.stdout:in 0,1 2024-09-19T06:43:58.175 INFO:teuthology.orchestra.run.smithi099.stdout:up {0=14482,1=24269} 2024-09-19T06:43:58.175 INFO:teuthology.orchestra.run.smithi099.stdout:failed 2024-09-19T06:43:58.175 INFO:teuthology.orchestra.run.smithi099.stdout:damaged 2024-09-19T06:43:58.175 INFO:teuthology.orchestra.run.smithi099.stdout:stopped 2024-09-19T06:43:58.175 INFO:teuthology.orchestra.run.smithi099.stdout:data_pools [3] 2024-09-19T06:43:58.175 INFO:teuthology.orchestra.run.smithi099.stdout:metadata_pool 2 2024-09-19T06:43:58.175 INFO:teuthology.orchestra.run.smithi099.stdout:inline_data disabled 2024-09-19T06:43:58.175 INFO:teuthology.orchestra.run.smithi099.stdout:balancer 2024-09-19T06:43:58.175 INFO:teuthology.orchestra.run.smithi099.stdout:bal_rank_mask -1 2024-09-19T06:43:58.176 INFO:teuthology.orchestra.run.smithi099.stdout:standby_count_wanted 1 2024-09-19T06:43:58.176 INFO:teuthology.orchestra.run.smithi099.stdout:qdb_cluster leader: 14482 members: 14482,24269 2024-09-19T06:43:58.176 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.xehbxe{0:14482} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.99:6828/1508711176,v1:172.21.15.99:6829/1508711176] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T06:43:58.176 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.nooexo{1:24269} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.117:6824/2367330767,v1:172.21.15.117:6825/2367330767] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T06:43:58.176 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:43:58.176 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:43:58.176 INFO:teuthology.orchestra.run.smithi099.stdout:Standby daemons: 2024-09-19T06:43:58.176 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:43:58.176 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.obarqf{-1:14490} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6826/388324528,v1:172.21.15.99:6827/388324528] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T06:43:58.176 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.bheqzh{-1:24283} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.117:6826/4072877365,v1:172.21.15.117:6827/4072877365] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T06:43:58.177 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 18 2024-09-19T06:43:58.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.173+0000 7f32692a2640 1 -- 172.21.15.99:0/1576302061 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f325006e660 msgr2=0x7f3250070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:58.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.173+0000 7f32692a2640 1 --2- 172.21.15.99:0/1576302061 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f325006e660 0x7f3250070b10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f32640fa670 tx=0x7f324c009da0 comp rx=0 tx=0).stop 2024-09-19T06:43:58.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.173+0000 7f32692a2640 1 -- 172.21.15.99:0/1576302061 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32640fb4c0 msgr2=0x7f3264110fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:58.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.173+0000 7f32692a2640 1 --2- 172.21.15.99:0/1576302061 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32640fb4c0 0x7f3264110fd0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f325400eb70 tx=0x7f325400b040 comp rx=0 tx=0).stop 2024-09-19T06:43:58.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.173+0000 7f32692a2640 1 -- 172.21.15.99:0/1576302061 shutdown_connections 2024-09-19T06:43:58.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.173+0000 7f32692a2640 1 --2- 172.21.15.99:0/1576302061 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f325006e660 0x7f3250070b10 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:58.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.173+0000 7f32692a2640 1 --2- 172.21.15.99:0/1576302061 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3264101500 0x7f3264111510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:58.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.173+0000 7f32692a2640 1 --2- 172.21.15.99:0/1576302061 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32640fb4c0 0x7f3264110fd0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:58.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.174+0000 7f32692a2640 1 -- 172.21.15.99:0/1576302061 >> 172.21.15.99:0/1576302061 conn(0x7f32640f7000 msgr2=0x7f32640f8900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:58.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.174+0000 7f32692a2640 1 -- 172.21.15.99:0/1576302061 shutdown_connections 2024-09-19T06:43:58.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.174+0000 7f32692a2640 1 -- 172.21.15.99:0/1576302061 wait complete. 2024-09-19T06:43:58.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.252+0000 7fd091776640 1 -- 172.21.15.99:0/260410865 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd08c102ef0 msgr2=0x7fd08c0fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:58.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.252+0000 7fd091776640 1 --2- 172.21.15.99:0/260410865 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd08c102ef0 0x7fd08c0fc5b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd0800048d0 tx=0x7fd080009da0 comp rx=0 tx=0).stop 2024-09-19T06:43:58.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.252+0000 7fd091776640 1 -- 172.21.15.99:0/260410865 shutdown_connections 2024-09-19T06:43:58.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.252+0000 7fd091776640 1 --2- 172.21.15.99:0/260410865 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd08c102ef0 0x7fd08c0fc5b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:58.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.252+0000 7fd091776640 1 --2- 172.21.15.99:0/260410865 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd08c102550 0x7fd08c102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:58.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.252+0000 7fd091776640 1 -- 172.21.15.99:0/260410865 >> 172.21.15.99:0/260410865 conn(0x7fd08c0f80f0 msgr2=0x7fd08c0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:58.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.252+0000 7fd091776640 1 -- 172.21.15.99:0/260410865 shutdown_connections 2024-09-19T06:43:58.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.252+0000 7fd091776640 1 -- 172.21.15.99:0/260410865 wait complete. 2024-09-19T06:43:58.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.253+0000 7fd091776640 1 Processor -- start 2024-09-19T06:43:58.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.253+0000 7fd091776640 1 -- start start 2024-09-19T06:43:58.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.253+0000 7fd091776640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd08c102550 0x7fd08c113550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:58.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.253+0000 7fd091776640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd08c102ef0 0x7fd08c113a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:58.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.253+0000 7fd091776640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd08c1140e0 con 0x7fd08c102ef0 2024-09-19T06:43:58.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.253+0000 7fd091776640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd08c10d4f0 con 0x7fd08c102550 2024-09-19T06:43:58.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.253+0000 7fd08a7fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd08c102ef0 0x7fd08c113a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:58.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.253+0000 7fd08a7fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd08c102ef0 0x7fd08c113a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47226/0 (socket says 172.21.15.99:47226) 2024-09-19T06:43:58.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.253+0000 7fd08a7fc640 1 -- 172.21.15.99:0/3808316784 learned_addr learned my addr 172.21.15.99:0/3808316784 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:43:58.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.253+0000 7fd08affd640 1 --2- 172.21.15.99:0/3808316784 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd08c102550 0x7fd08c113550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:58.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.254+0000 7fd08a7fc640 1 -- 172.21.15.99:0/3808316784 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd08c102550 msgr2=0x7fd08c113550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:58.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.254+0000 7fd08a7fc640 1 --2- 172.21.15.99:0/3808316784 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd08c102550 0x7fd08c113550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:58.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.254+0000 7fd08a7fc640 1 -- 172.21.15.99:0/3808316784 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd080005040 con 0x7fd08c102ef0 2024-09-19T06:43:58.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.254+0000 7fd08affd640 1 --2- 172.21.15.99:0/3808316784 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd08c102550 0x7fd08c113550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:43:58.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.254+0000 7fd08a7fc640 1 --2- 172.21.15.99:0/3808316784 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd08c102ef0 0x7fd08c113a90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd080003080 tx=0x7fd080009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:58.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.254+0000 7fd0737fe640 1 -- 172.21.15.99:0/3808316784 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd080038070 con 0x7fd08c102ef0 2024-09-19T06:43:58.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.254+0000 7fd091776640 1 -- 172.21.15.99:0/3808316784 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd08c10d770 con 0x7fd08c102ef0 2024-09-19T06:43:58.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.254+0000 7fd0737fe640 1 -- 172.21.15.99:0/3808316784 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd080009760 con 0x7fd08c102ef0 2024-09-19T06:43:58.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.254+0000 7fd0737fe640 1 -- 172.21.15.99:0/3808316784 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd080033420 con 0x7fd08c102ef0 2024-09-19T06:43:58.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.254+0000 7fd091776640 1 -- 172.21.15.99:0/3808316784 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd08c10dc50 con 0x7fd08c102ef0 2024-09-19T06:43:58.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.255+0000 7fd091776640 1 -- 172.21.15.99:0/3808316784 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd08c0fdcd0 con 0x7fd08c102ef0 2024-09-19T06:43:58.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.255+0000 7fd0737fe640 1 -- 172.21.15.99:0/3808316784 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 40) v1 ==== 92653+0+0 (secure 0 0 0) 0x7fd080030020 con 0x7fd08c102ef0 2024-09-19T06:43:58.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.256+0000 7fd0737fe640 1 --2- 172.21.15.99:0/3808316784 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd07406e660 0x7fd074070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:58.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.256+0000 7fd0737fe640 1 -- 172.21.15.99:0/3808316784 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fd0800ae000 con 0x7fd08c102ef0 2024-09-19T06:43:58.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.256+0000 7fd08affd640 1 --2- 172.21.15.99:0/3808316784 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd07406e660 0x7fd074070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:58.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.256+0000 7fd08affd640 1 --2- 172.21.15.99:0/3808316784 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd07406e660 0x7fd074070b10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd07c004550 tx=0x7fd07c009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:58.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.260+0000 7fd0737fe640 1 -- 172.21.15.99:0/3808316784 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fd080077080 con 0x7fd08c102ef0 2024-09-19T06:43:58.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.444+0000 7fd091776640 1 -- 172.21.15.99:0/3808316784 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd08c113240 con 0x7fd07406e660 2024-09-19T06:43:58.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.445+0000 7fd0737fe640 1 -- 172.21.15.99:0/3808316784 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fd08c113240 con 0x7fd07406e660 2024-09-19T06:43:58.447 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:43:58.447 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T06:43:58.447 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": true, 2024-09-19T06:43:58.447 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T06:43:58.447 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [ 2024-09-19T06:43:58.447 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr", 2024-09-19T06:43:58.447 INFO:teuthology.orchestra.run.smithi099.stdout: "mon" 2024-09-19T06:43:58.447 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-19T06:43:58.447 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": "4/21 daemons upgraded", 2024-09-19T06:43:58.448 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "Currently upgrading mon daemons", 2024-09-19T06:43:58.448 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-09-19T06:43:58.448 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:43:58.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.448+0000 7fd091776640 1 -- 172.21.15.99:0/3808316784 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd07406e660 msgr2=0x7fd074070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:58.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.448+0000 7fd091776640 1 --2- 172.21.15.99:0/3808316784 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd07406e660 0x7fd074070b10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd07c004550 tx=0x7fd07c009040 comp rx=0 tx=0).stop 2024-09-19T06:43:58.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.448+0000 7fd091776640 1 -- 172.21.15.99:0/3808316784 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd08c102ef0 msgr2=0x7fd08c113a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:58.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.448+0000 7fd091776640 1 --2- 172.21.15.99:0/3808316784 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd08c102ef0 0x7fd08c113a90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd080003080 tx=0x7fd080009da0 comp rx=0 tx=0).stop 2024-09-19T06:43:58.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.448+0000 7fd091776640 1 -- 172.21.15.99:0/3808316784 shutdown_connections 2024-09-19T06:43:58.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.448+0000 7fd091776640 1 --2- 172.21.15.99:0/3808316784 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd07406e660 0x7fd074070b10 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:58.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.448+0000 7fd091776640 1 --2- 172.21.15.99:0/3808316784 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd08c102ef0 0x7fd08c113a90 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:58.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.448+0000 7fd091776640 1 --2- 172.21.15.99:0/3808316784 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd08c102550 0x7fd08c113550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:58.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.448+0000 7fd091776640 1 -- 172.21.15.99:0/3808316784 >> 172.21.15.99:0/3808316784 conn(0x7fd08c0f80f0 msgr2=0x7fd08c0f9100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:58.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.448+0000 7fd091776640 1 -- 172.21.15.99:0/3808316784 shutdown_connections 2024-09-19T06:43:58.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.448+0000 7fd091776640 1 -- 172.21.15.99:0/3808316784 wait complete. 2024-09-19T06:43:58.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.526+0000 7ff6988d8640 1 -- 172.21.15.99:0/2766889688 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6940fcf80 msgr2=0x7ff6940fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:58.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.526+0000 7ff6988d8640 1 --2- 172.21.15.99:0/2766889688 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6940fcf80 0x7ff6940fd3d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff6880048d0 tx=0x7ff688009da0 comp rx=0 tx=0).stop 2024-09-19T06:43:58.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.526+0000 7ff6988d8640 1 -- 172.21.15.99:0/2766889688 shutdown_connections 2024-09-19T06:43:58.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.526+0000 7ff6988d8640 1 --2- 172.21.15.99:0/2766889688 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6940fcf80 0x7ff6940fd3d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:58.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.526+0000 7ff6988d8640 1 --2- 172.21.15.99:0/2766889688 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6940fb810 0x7ff6940fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:58.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.526+0000 7ff6988d8640 1 -- 172.21.15.99:0/2766889688 >> 172.21.15.99:0/2766889688 conn(0x7ff6940723b0 msgr2=0x7ff6940727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:58.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.526+0000 7ff6988d8640 1 -- 172.21.15.99:0/2766889688 shutdown_connections 2024-09-19T06:43:58.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.526+0000 7ff6988d8640 1 -- 172.21.15.99:0/2766889688 wait complete. 2024-09-19T06:43:58.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.526+0000 7ff6988d8640 1 Processor -- start 2024-09-19T06:43:58.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.527+0000 7ff6988d8640 1 -- start start 2024-09-19T06:43:58.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.527+0000 7ff6988d8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6940fb810 0x7ff69410e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:58.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.527+0000 7ff6988d8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6940fcf80 0x7ff69410e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:58.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.527+0000 7ff6988d8640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff69410ecb0 con 0x7ff6940fb810 2024-09-19T06:43:58.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.527+0000 7ff6988d8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff69410ee20 con 0x7ff6940fcf80 2024-09-19T06:43:58.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.527+0000 7ff69259c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6940fb810 0x7ff69410e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:58.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.527+0000 7ff69259c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6940fb810 0x7ff69410e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47234/0 (socket says 172.21.15.99:47234) 2024-09-19T06:43:58.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.527+0000 7ff69259c640 1 -- 172.21.15.99:0/4112954885 learned_addr learned my addr 172.21.15.99:0/4112954885 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:43:58.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.527+0000 7ff69259c640 1 -- 172.21.15.99:0/4112954885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6940fcf80 msgr2=0x7ff69410e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:58.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.527+0000 7ff691d9b640 1 --2- 172.21.15.99:0/4112954885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6940fcf80 0x7ff69410e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:58.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.527+0000 7ff69259c640 1 --2- 172.21.15.99:0/4112954885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6940fcf80 0x7ff69410e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:58.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.527+0000 7ff69259c640 1 -- 172.21.15.99:0/4112954885 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff688005040 con 0x7ff6940fb810 2024-09-19T06:43:58.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.527+0000 7ff69259c640 1 --2- 172.21.15.99:0/4112954885 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6940fb810 0x7ff69410e170 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff684002a50 tx=0x7ff684004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:58.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.527+0000 7ff682ffd640 1 -- 172.21.15.99:0/4112954885 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff684007c30 con 0x7ff6940fb810 2024-09-19T06:43:58.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.528+0000 7ff682ffd640 1 -- 172.21.15.99:0/4112954885 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff68400f040 con 0x7ff6940fb810 2024-09-19T06:43:58.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.528+0000 7ff6988d8640 1 -- 172.21.15.99:0/4112954885 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6941171e0 con 0x7ff6940fb810 2024-09-19T06:43:58.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.528+0000 7ff682ffd640 1 -- 172.21.15.99:0/4112954885 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff68400da90 con 0x7ff6940fb810 2024-09-19T06:43:58.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.528+0000 7ff6988d8640 1 -- 172.21.15.99:0/4112954885 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff694117720 con 0x7ff6940fb810 2024-09-19T06:43:58.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.529+0000 7ff6988d8640 1 -- 172.21.15.99:0/4112954885 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6940fcbc0 con 0x7ff6940fb810 2024-09-19T06:43:58.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.529+0000 7ff682ffd640 1 -- 172.21.15.99:0/4112954885 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 40) v1 ==== 92653+0+0 (secure 0 0 0) 0x7ff68400dc30 con 0x7ff6940fb810 2024-09-19T06:43:58.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.529+0000 7ff682ffd640 1 --2- 172.21.15.99:0/4112954885 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ff67c06e660 0x7ff67c070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:43:58.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.530+0000 7ff682ffd640 1 -- 172.21.15.99:0/4112954885 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6324+0+0 (secure 0 0 0) 0x7ff68408dba0 con 0x7ff6940fb810 2024-09-19T06:43:58.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.530+0000 7ff691d9b640 1 --2- 172.21.15.99:0/4112954885 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ff67c06e660 0x7ff67c070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:43:58.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.530+0000 7ff691d9b640 1 --2- 172.21.15.99:0/4112954885 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ff67c06e660 0x7ff67c070b10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff688004540 tx=0x7ff688009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:43:58.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.534+0000 7ff682ffd640 1 -- 172.21.15.99:0/4112954885 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7ff684056b90 con 0x7ff6940fb810 2024-09-19T06:43:58.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.763+0000 7ff6988d8640 1 -- 172.21.15.99:0/4112954885 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7ff69410efe0 con 0x7ff6940fb810 2024-09-19T06:43:58.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.763+0000 7ff682ffd640 1 -- 172.21.15.99:0/4112954885 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7ff69410efe0 con 0x7ff6940fb810 2024-09-19T06:43:58.765 INFO:teuthology.orchestra.run.smithi099.stdout:HEALTH_OK 2024-09-19T06:43:58.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.765+0000 7ff6988d8640 1 -- 172.21.15.99:0/4112954885 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ff67c06e660 msgr2=0x7ff67c070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:58.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.765+0000 7ff6988d8640 1 --2- 172.21.15.99:0/4112954885 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ff67c06e660 0x7ff67c070b10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff688004540 tx=0x7ff688009da0 comp rx=0 tx=0).stop 2024-09-19T06:43:58.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.765+0000 7ff6988d8640 1 -- 172.21.15.99:0/4112954885 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6940fb810 msgr2=0x7ff69410e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:43:58.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.765+0000 7ff6988d8640 1 --2- 172.21.15.99:0/4112954885 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6940fb810 0x7ff69410e170 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff684002a50 tx=0x7ff684004600 comp rx=0 tx=0).stop 2024-09-19T06:43:58.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.765+0000 7ff6988d8640 1 -- 172.21.15.99:0/4112954885 shutdown_connections 2024-09-19T06:43:58.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.765+0000 7ff6988d8640 1 --2- 172.21.15.99:0/4112954885 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ff67c06e660 0x7ff67c070b10 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:58.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.765+0000 7ff6988d8640 1 --2- 172.21.15.99:0/4112954885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff6940fcf80 0x7ff69410e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:58.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.765+0000 7ff6988d8640 1 --2- 172.21.15.99:0/4112954885 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff6940fb810 0x7ff69410e170 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:43:58.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.765+0000 7ff6988d8640 1 -- 172.21.15.99:0/4112954885 >> 172.21.15.99:0/4112954885 conn(0x7ff6940723b0 msgr2=0x7ff6940fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:43:58.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.766+0000 7ff6988d8640 1 -- 172.21.15.99:0/4112954885 shutdown_connections 2024-09-19T06:43:58.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:43:58.766+0000 7ff6988d8640 1 -- 172.21.15.99:0/4112954885 wait complete. 2024-09-19T06:43:58.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:58 smithi099 ceph-mon[97031]: from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:43:58.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:58 smithi099 ceph-mon[97031]: from='client.34134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:43:58.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:58 smithi099 ceph-mon[97031]: from='client.34138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:43:58.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:58 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/3588918212' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:43:58.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:58 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/1576302061' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:43:58.966 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:58 smithi117 ceph-mon[76771]: from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:43:58.966 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:58 smithi117 ceph-mon[76771]: from='client.34134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:43:58.966 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:58 smithi117 ceph-mon[76771]: from='client.34138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:43:58.966 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:58 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/3588918212' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:43:58.966 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:58 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/1576302061' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:43:59.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:59 smithi099 ceph-mon[97031]: from='client.34150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:43:59.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:59 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/4112954885' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T06:43:59.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:43:59 smithi099 ceph-mon[97031]: pgmap v14: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:44:00.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:59 smithi117 ceph-mon[76771]: from='client.34150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:44:00.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:59 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/4112954885' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T06:44:00.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:43:59 smithi117 ceph-mon[76771]: pgmap v14: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:44:01.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:01 smithi099 ceph-mon[97031]: Detected new or changed devices on smithi117 2024-09-19T06:44:01.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:01 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:01.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:01 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:01.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:01 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:01.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:01 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:44:01.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:01 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:01.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:01 smithi099 ceph-mon[97031]: Reconfiguring mon.smithi099 (monmap changed)... 2024-09-19T06:44:01.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:01 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T06:44:01.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:01 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T06:44:01.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:01 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:01.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:01 smithi099 ceph-mon[97031]: Reconfiguring daemon mon.smithi099 on smithi099 2024-09-19T06:44:01.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:01 smithi099 ceph-mon[97031]: pgmap v15: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:44:01.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:01 smithi117 ceph-mon[76771]: Detected new or changed devices on smithi117 2024-09-19T06:44:01.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:01 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:01.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:01 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:01.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:01 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:01.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:01 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:44:01.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:01 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:01.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:01 smithi117 ceph-mon[76771]: Reconfiguring mon.smithi099 (monmap changed)... 2024-09-19T06:44:01.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:01 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T06:44:01.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:01 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T06:44:01.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:01 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:01.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:01 smithi117 ceph-mon[76771]: Reconfiguring daemon mon.smithi099 on smithi099 2024-09-19T06:44:01.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:01 smithi117 ceph-mon[76771]: pgmap v15: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:44:03.505 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:03 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:03.505 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:03 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:03.505 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:03 smithi099 ceph-mon[97031]: Reconfiguring mgr.smithi099.pgvkqi (monmap changed)... 2024-09-19T06:44:03.505 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:03 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi099.pgvkqi", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T06:44:03.505 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:03 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T06:44:03.505 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:03 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:03.505 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:03 smithi099 ceph-mon[97031]: Reconfiguring daemon mgr.smithi099.pgvkqi on smithi099 2024-09-19T06:44:03.505 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:03 smithi099 ceph-mon[97031]: pgmap v16: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:44:03.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:03 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:03.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:03 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:03.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:03 smithi117 ceph-mon[76771]: Reconfiguring mgr.smithi099.pgvkqi (monmap changed)... 2024-09-19T06:44:03.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:03 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi099.pgvkqi", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T06:44:03.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:03 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T06:44:03.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:03 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:03.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:03 smithi117 ceph-mon[76771]: Reconfiguring daemon mgr.smithi099.pgvkqi on smithi099 2024-09-19T06:44:03.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:03 smithi117 ceph-mon[76771]: pgmap v16: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:44:04.426 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:04 smithi099 ceph-mon[97031]: fsmap cephfs:2 {0=cephfs.smithi099.xehbxe=up:active,1=cephfs.smithi117.nooexo=up:active} 2 up:standby 2024-09-19T06:44:04.426 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:04 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:04.426 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:04 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:04.426 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:04 smithi099 ceph-mon[97031]: Reconfiguring crash.smithi099 (monmap changed)... 2024-09-19T06:44:04.427 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:04 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi099", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-19T06:44:04.427 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:04 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:04.427 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:04 smithi099 ceph-mon[97031]: Reconfiguring daemon crash.smithi099 on smithi099 2024-09-19T06:44:04.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:04 smithi117 ceph-mon[76771]: fsmap cephfs:2 {0=cephfs.smithi099.xehbxe=up:active,1=cephfs.smithi117.nooexo=up:active} 2 up:standby 2024-09-19T06:44:04.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:04 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:04.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:04 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:04.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:04 smithi117 ceph-mon[76771]: Reconfiguring crash.smithi099 (monmap changed)... 2024-09-19T06:44:04.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:04 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi099", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-19T06:44:04.563 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:04 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:04.563 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:04 smithi117 ceph-mon[76771]: Reconfiguring daemon crash.smithi099 on smithi099 2024-09-19T06:44:05.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:05 smithi099 ceph-mon[97031]: pgmap v17: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:44:05.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:05 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:05.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:05 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:05.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:05 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T06:44:05.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:05 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:05.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:05 smithi117 ceph-mon[76771]: pgmap v17: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:44:05.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:05 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:05.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:05 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:05.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:05 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T06:44:05.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:05 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:06.505 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:06 smithi099 ceph-mon[97031]: Reconfiguring osd.0 (monmap changed)... 2024-09-19T06:44:06.505 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:06 smithi099 ceph-mon[97031]: Reconfiguring daemon osd.0 on smithi099 2024-09-19T06:44:06.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:06 smithi117 ceph-mon[76771]: Reconfiguring osd.0 (monmap changed)... 2024-09-19T06:44:06.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:06 smithi117 ceph-mon[76771]: Reconfiguring daemon osd.0 on smithi099 2024-09-19T06:44:07.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:07 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:07.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:07 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:07.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:07 smithi099 ceph-mon[97031]: Reconfiguring osd.1 (monmap changed)... 2024-09-19T06:44:07.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:07 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T06:44:07.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:07 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:07.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:07 smithi099 ceph-mon[97031]: Reconfiguring daemon osd.1 on smithi099 2024-09-19T06:44:07.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:07 smithi099 ceph-mon[97031]: pgmap v18: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:44:07.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:07 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:44:08.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:07 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:08.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:07 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:08.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:07 smithi117 ceph-mon[76771]: Reconfiguring osd.1 (monmap changed)... 2024-09-19T06:44:08.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:07 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T06:44:08.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:07 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:08.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:07 smithi117 ceph-mon[76771]: Reconfiguring daemon osd.1 on smithi099 2024-09-19T06:44:08.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:07 smithi117 ceph-mon[76771]: pgmap v18: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:44:08.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:07 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:44:09.412 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:09 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:09.412 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:09 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:09.412 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:09 smithi099 ceph-mon[97031]: Reconfiguring osd.2 (monmap changed)... 2024-09-19T06:44:09.412 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:09 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T06:44:09.412 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:09 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:09.412 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:09 smithi099 ceph-mon[97031]: Reconfiguring daemon osd.2 on smithi099 2024-09-19T06:44:09.412 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:09 smithi099 ceph-mon[97031]: pgmap v19: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:44:09.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:09 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:09.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:09 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:09.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:09 smithi117 ceph-mon[76771]: Reconfiguring osd.2 (monmap changed)... 2024-09-19T06:44:09.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:09 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T06:44:09.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:09 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:09.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:09 smithi117 ceph-mon[76771]: Reconfiguring daemon osd.2 on smithi099 2024-09-19T06:44:09.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:09 smithi117 ceph-mon[76771]: pgmap v19: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:44:10.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:10 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:10.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:10 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:10.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:10 smithi117 ceph-mon[76771]: Reconfiguring mds.cephfs.smithi099.obarqf (monmap changed)... 2024-09-19T06:44:10.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:10 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi099.obarqf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:44:10.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:10 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:10.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:10 smithi117 ceph-mon[76771]: Reconfiguring daemon mds.cephfs.smithi099.obarqf on smithi099 2024-09-19T06:44:10.846 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:10 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:10.846 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:10 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:10.847 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:10 smithi099 ceph-mon[97031]: Reconfiguring mds.cephfs.smithi099.obarqf (monmap changed)... 2024-09-19T06:44:10.847 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:10 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi099.obarqf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:44:10.847 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:10 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:10.847 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:10 smithi099 ceph-mon[97031]: Reconfiguring daemon mds.cephfs.smithi099.obarqf on smithi099 2024-09-19T06:44:12.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:11 smithi099 ceph-mon[97031]: pgmap v20: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:44:12.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:11 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:12.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:11 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:12.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:11 smithi099 ceph-mon[97031]: Reconfiguring mds.cephfs.smithi099.xehbxe (monmap changed)... 2024-09-19T06:44:12.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:11 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi099.xehbxe", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:44:12.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:11 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:12.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:11 smithi099 ceph-mon[97031]: Reconfiguring daemon mds.cephfs.smithi099.xehbxe on smithi099 2024-09-19T06:44:12.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:11 smithi117 ceph-mon[76771]: pgmap v20: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:44:12.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:11 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:12.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:11 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:12.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:11 smithi117 ceph-mon[76771]: Reconfiguring mds.cephfs.smithi099.xehbxe (monmap changed)... 2024-09-19T06:44:12.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:11 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi099.xehbxe", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:44:12.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:11 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:12.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:11 smithi117 ceph-mon[76771]: Reconfiguring daemon mds.cephfs.smithi099.xehbxe on smithi099 2024-09-19T06:44:13.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:13 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:13.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:13 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:13.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:13 smithi099 ceph-mon[97031]: Reconfiguring crash.smithi117 (monmap changed)... 2024-09-19T06:44:13.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:13 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi117", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-19T06:44:13.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:13 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:13.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:13 smithi099 ceph-mon[97031]: Reconfiguring daemon crash.smithi117 on smithi117 2024-09-19T06:44:13.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:13 smithi099 ceph-mon[97031]: pgmap v21: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:44:13.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:13 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:13.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:13 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:13.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:13 smithi117 ceph-mon[76771]: Reconfiguring crash.smithi117 (monmap changed)... 2024-09-19T06:44:13.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:13 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi117", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-19T06:44:13.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:13 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:13.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:13 smithi117 ceph-mon[76771]: Reconfiguring daemon crash.smithi117 on smithi117 2024-09-19T06:44:13.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:13 smithi117 ceph-mon[76771]: pgmap v21: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:44:14.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:14 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:14.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:14 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:14.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:14 smithi099 ceph-mon[97031]: Reconfiguring mgr.smithi117.ssmkcf (monmap changed)... 2024-09-19T06:44:14.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:14 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi117.ssmkcf", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T06:44:14.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:14 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T06:44:14.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:14 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:14.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:14 smithi099 ceph-mon[97031]: Reconfiguring daemon mgr.smithi117.ssmkcf on smithi117 2024-09-19T06:44:14.964 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:14 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:14.964 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:14 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:14.964 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:14 smithi117 ceph-mon[76771]: Reconfiguring mgr.smithi117.ssmkcf (monmap changed)... 2024-09-19T06:44:14.964 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:14 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi117.ssmkcf", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T06:44:14.964 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:14 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T06:44:14.964 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:14 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:14.965 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:14 smithi117 ceph-mon[76771]: Reconfiguring daemon mgr.smithi117.ssmkcf on smithi117 2024-09-19T06:44:15.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:15 smithi099 ceph-mon[97031]: pgmap v22: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:44:15.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:15 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:15.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:15 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:15.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:15 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T06:44:15.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:15 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T06:44:15.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:15 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:16.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:15 smithi117 ceph-mon[76771]: pgmap v22: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:44:16.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:15 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:16.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:15 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:16.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:15 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T06:44:16.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:15 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T06:44:16.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:15 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:16.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:16 smithi099 ceph-mon[97031]: Reconfiguring mon.smithi117 (monmap changed)... 2024-09-19T06:44:16.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:16 smithi099 ceph-mon[97031]: Reconfiguring daemon mon.smithi117 on smithi117 2024-09-19T06:44:16.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:16 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:16.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:16 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:16.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:16 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T06:44:16.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:16 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:17.040 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:16 smithi117 ceph-mon[76771]: Reconfiguring mon.smithi117 (monmap changed)... 2024-09-19T06:44:17.040 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:16 smithi117 ceph-mon[76771]: Reconfiguring daemon mon.smithi117 on smithi117 2024-09-19T06:44:17.040 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:16 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:17.040 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:16 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:17.040 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:16 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T06:44:17.040 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:16 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:17.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:17 smithi099 ceph-mon[97031]: Reconfiguring osd.3 (monmap changed)... 2024-09-19T06:44:17.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:17 smithi099 ceph-mon[97031]: Reconfiguring daemon osd.3 on smithi117 2024-09-19T06:44:17.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:17 smithi099 ceph-mon[97031]: pgmap v23: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:44:18.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:17 smithi117 ceph-mon[76771]: Reconfiguring osd.3 (monmap changed)... 2024-09-19T06:44:18.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:17 smithi117 ceph-mon[76771]: Reconfiguring daemon osd.3 on smithi117 2024-09-19T06:44:18.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:17 smithi117 ceph-mon[76771]: pgmap v23: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:44:18.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:18 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:18.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:18 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:18.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:18 smithi099 ceph-mon[97031]: Reconfiguring osd.4 (monmap changed)... 2024-09-19T06:44:18.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:18 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T06:44:18.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:18 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:18.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:18 smithi099 ceph-mon[97031]: Reconfiguring daemon osd.4 on smithi117 2024-09-19T06:44:19.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:18 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:19.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:18 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:19.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:18 smithi117 ceph-mon[76771]: Reconfiguring osd.4 (monmap changed)... 2024-09-19T06:44:19.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:18 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T06:44:19.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:18 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:19.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:18 smithi117 ceph-mon[76771]: Reconfiguring daemon osd.4 on smithi117 2024-09-19T06:44:19.904 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:19 smithi117 ceph-mon[76771]: pgmap v24: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:44:19.904 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:19 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:19.904 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:19 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:19.904 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:19 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T06:44:19.904 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:19 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:20.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:19 smithi099 ceph-mon[97031]: pgmap v24: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:44:20.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:19 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:20.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:19 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:20.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:19 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T06:44:20.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:19 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:21.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:20 smithi117 ceph-mon[76771]: Reconfiguring osd.5 (monmap changed)... 2024-09-19T06:44:21.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:20 smithi117 ceph-mon[76771]: Reconfiguring daemon osd.5 on smithi117 2024-09-19T06:44:21.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:20 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:21.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:20 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:21.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:20 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi117.nooexo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:44:21.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:20 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:21.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:20 smithi099 ceph-mon[97031]: Reconfiguring osd.5 (monmap changed)... 2024-09-19T06:44:21.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:20 smithi099 ceph-mon[97031]: Reconfiguring daemon osd.5 on smithi117 2024-09-19T06:44:21.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:20 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:21.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:20 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:21.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:20 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi117.nooexo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:44:21.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:20 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:21.913 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:21 smithi117 ceph-mon[76771]: Reconfiguring mds.cephfs.smithi117.nooexo (monmap changed)... 2024-09-19T06:44:21.914 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:21 smithi117 ceph-mon[76771]: Reconfiguring daemon mds.cephfs.smithi117.nooexo on smithi117 2024-09-19T06:44:21.914 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:21 smithi117 ceph-mon[76771]: pgmap v25: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:44:22.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:21 smithi099 ceph-mon[97031]: Reconfiguring mds.cephfs.smithi117.nooexo (monmap changed)... 2024-09-19T06:44:22.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:21 smithi099 ceph-mon[97031]: Reconfiguring daemon mds.cephfs.smithi117.nooexo on smithi117 2024-09-19T06:44:22.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:21 smithi099 ceph-mon[97031]: pgmap v25: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:44:23.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:22 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:44:23.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:22 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:23.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:22 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:23.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:22 smithi117 ceph-mon[76771]: Reconfiguring mds.cephfs.smithi117.bheqzh (monmap changed)... 2024-09-19T06:44:23.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:22 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi117.bheqzh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:44:23.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:22 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:23.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:22 smithi117 ceph-mon[76771]: Reconfiguring daemon mds.cephfs.smithi117.bheqzh on smithi117 2024-09-19T06:44:23.149 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:22 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:44:23.150 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:22 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:23.150 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:22 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:23.150 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:22 smithi099 ceph-mon[97031]: Reconfiguring mds.cephfs.smithi117.bheqzh (monmap changed)... 2024-09-19T06:44:23.150 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:22 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi117.bheqzh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:44:23.150 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:22 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:23.150 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:22 smithi099 ceph-mon[97031]: Reconfiguring daemon mds.cephfs.smithi117.bheqzh on smithi117 2024-09-19T06:44:23.817 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:23 smithi117 ceph-mon[76771]: pgmap v26: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:44:23.817 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:23 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:23.817 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:23 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:23.817 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:23 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:44:23.817 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:23 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:44:23.818 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:23 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:44:23.818 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:23 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:23.818 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:23 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi099"}]: dispatch 2024-09-19T06:44:23.818 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:23 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi099"}]': finished 2024-09-19T06:44:23.818 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:23 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi117"}]: dispatch 2024-09-19T06:44:23.818 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:23 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi117"}]': finished 2024-09-19T06:44:24.090 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:23 smithi099 ceph-mon[97031]: pgmap v26: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:44:24.090 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:23 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:24.090 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:23 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:24.090 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:23 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:44:24.090 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:23 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:44:24.091 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:23 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:44:24.091 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:23 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:24.091 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:23 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi099"}]: dispatch 2024-09-19T06:44:24.091 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:23 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi099"}]': finished 2024-09-19T06:44:24.091 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:23 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi117"}]: dispatch 2024-09-19T06:44:24.091 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:23 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi117"}]': finished 2024-09-19T06:44:25.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:24 smithi117 ceph-mon[76771]: Upgrade: Setting container_image for all mon 2024-09-19T06:44:25.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:24 smithi099 ceph-mon[97031]: Upgrade: Setting container_image for all mon 2024-09-19T06:44:26.177 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:25 smithi099 ceph-mon[97031]: pgmap v27: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:44:26.177 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:25 smithi099 ceph-mon[97031]: Upgrade: Updating crash.smithi099 (1/2) 2024-09-19T06:44:26.177 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:25 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:26.177 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:25 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi099", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-19T06:44:26.177 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:25 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:26.177 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:25 smithi099 ceph-mon[97031]: Deploying daemon crash.smithi099 on smithi099 2024-09-19T06:44:26.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:25 smithi117 ceph-mon[76771]: pgmap v27: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:44:26.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:25 smithi117 ceph-mon[76771]: Upgrade: Updating crash.smithi099 (1/2) 2024-09-19T06:44:26.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:25 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:26.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:25 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi099", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-19T06:44:26.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:25 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:26.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:25 smithi117 ceph-mon[76771]: Deploying daemon crash.smithi099 on smithi099 2024-09-19T06:44:28.066 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:27 smithi099 ceph-mon[97031]: pgmap v28: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:44:28.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:27 smithi117 ceph-mon[76771]: pgmap v28: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:44:28.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:28.848+0000 7fa2118fa640 1 -- 172.21.15.99:0/3441505283 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa20c102ef0 msgr2=0x7fa20c0fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:28.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:28.848+0000 7fa2118fa640 1 --2- 172.21.15.99:0/3441505283 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa20c102ef0 0x7fa20c0fc5b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa1f40048d0 tx=0x7fa1f4009da0 comp rx=0 tx=0).stop 2024-09-19T06:44:28.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:28.848+0000 7fa2118fa640 1 -- 172.21.15.99:0/3441505283 shutdown_connections 2024-09-19T06:44:28.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:28.848+0000 7fa2118fa640 1 --2- 172.21.15.99:0/3441505283 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa20c102ef0 0x7fa20c0fc5b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:28.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:28.848+0000 7fa2118fa640 1 --2- 172.21.15.99:0/3441505283 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa20c102550 0x7fa20c102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:28.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:28.848+0000 7fa2118fa640 1 -- 172.21.15.99:0/3441505283 >> 172.21.15.99:0/3441505283 conn(0x7fa20c0f80f0 msgr2=0x7fa20c0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:28.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:28.848+0000 7fa2118fa640 1 -- 172.21.15.99:0/3441505283 shutdown_connections 2024-09-19T06:44:28.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:28.848+0000 7fa2118fa640 1 -- 172.21.15.99:0/3441505283 wait complete. 2024-09-19T06:44:28.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:28.849+0000 7fa2118fa640 1 Processor -- start 2024-09-19T06:44:28.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:28.849+0000 7fa2118fa640 1 -- start start 2024-09-19T06:44:28.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:28.849+0000 7fa2118fa640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa20c102550 0x7fa20c06fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:28.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:28.849+0000 7fa2118fa640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa20c102ef0 0x7fa20c06ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:28.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:28.849+0000 7fa2118fa640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa20c070520 con 0x7fa20c102ef0 2024-09-19T06:44:28.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:28.849+0000 7fa2118fa640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa20c070690 con 0x7fa20c102550 2024-09-19T06:44:28.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:28.849+0000 7fa20a7fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa20c102ef0 0x7fa20c06ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:28.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:28.849+0000 7fa20a7fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa20c102ef0 0x7fa20c06ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40494/0 (socket says 172.21.15.99:40494) 2024-09-19T06:44:28.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:28.849+0000 7fa20a7fc640 1 -- 172.21.15.99:0/2474505542 learned_addr learned my addr 172.21.15.99:0/2474505542 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:44:28.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:28.849+0000 7fa20affd640 1 --2- 172.21.15.99:0/2474505542 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa20c102550 0x7fa20c06fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:28.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:28.849+0000 7fa20a7fc640 1 -- 172.21.15.99:0/2474505542 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa20c102550 msgr2=0x7fa20c06fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:28.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:28.849+0000 7fa20a7fc640 1 --2- 172.21.15.99:0/2474505542 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa20c102550 0x7fa20c06fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:28.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:28.849+0000 7fa20a7fc640 1 -- 172.21.15.99:0/2474505542 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f4005040 con 0x7fa20c102ef0 2024-09-19T06:44:28.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:28.849+0000 7fa20a7fc640 1 --2- 172.21.15.99:0/2474505542 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa20c102ef0 0x7fa20c06ff50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4003080 tx=0x7fa1f4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:28.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:28.850+0000 7fa2037fe640 1 -- 172.21.15.99:0/2474505542 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1f4038070 con 0x7fa20c102ef0 2024-09-19T06:44:28.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:28.850+0000 7fa2037fe640 1 -- 172.21.15.99:0/2474505542 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa1f4009760 con 0x7fa20c102ef0 2024-09-19T06:44:28.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:28.850+0000 7fa2118fa640 1 -- 172.21.15.99:0/2474505542 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa20c1198d0 con 0x7fa20c102ef0 2024-09-19T06:44:28.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:28.850+0000 7fa2037fe640 1 -- 172.21.15.99:0/2474505542 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1f403d420 con 0x7fa20c102ef0 2024-09-19T06:44:28.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:28.850+0000 7fa2118fa640 1 -- 172.21.15.99:0/2474505542 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa20c119c50 con 0x7fa20c102ef0 2024-09-19T06:44:28.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:28.851+0000 7fa2118fa640 1 -- 172.21.15.99:0/2474505542 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa20c0fdcd0 con 0x7fa20c102ef0 2024-09-19T06:44:28.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:28.851+0000 7fa2037fe640 1 -- 172.21.15.99:0/2474505542 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 40) v1 ==== 92653+0+0 (secure 0 0 0) 0x7fa1f4030020 con 0x7fa20c102ef0 2024-09-19T06:44:28.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:28.852+0000 7fa2037fe640 1 --2- 172.21.15.99:0/2474505542 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa1f806e660 0x7fa1f8070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:28.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:28.852+0000 7fa2037fe640 1 -- 172.21.15.99:0/2474505542 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fa1f40ae690 con 0x7fa20c102ef0 2024-09-19T06:44:28.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:28.852+0000 7fa20affd640 1 --2- 172.21.15.99:0/2474505542 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa1f806e660 0x7fa1f8070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:28.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:28.852+0000 7fa20affd640 1 --2- 172.21.15.99:0/2474505542 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa1f806e660 0x7fa1f8070b10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa204007580 tx=0x7fa204009780 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:28.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:28.857+0000 7fa2037fe640 1 -- 172.21.15.99:0/2474505542 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fa1f4077710 con 0x7fa20c102ef0 2024-09-19T06:44:29.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.044+0000 7fa2118fa640 1 -- 172.21.15.99:0/2474505542 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa20c109680 con 0x7fa1f806e660 2024-09-19T06:44:29.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.045+0000 7fa2037fe640 1 -- 172.21.15.99:0/2474505542 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7fa20400f040 con 0x7fa1f806e660 2024-09-19T06:44:29.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.047+0000 7fa2118fa640 1 -- 172.21.15.99:0/2474505542 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa1f806e660 msgr2=0x7fa1f8070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:29.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.047+0000 7fa2118fa640 1 --2- 172.21.15.99:0/2474505542 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa1f806e660 0x7fa1f8070b10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa204007580 tx=0x7fa204009780 comp rx=0 tx=0).stop 2024-09-19T06:44:29.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.047+0000 7fa2118fa640 1 -- 172.21.15.99:0/2474505542 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa20c102ef0 msgr2=0x7fa20c06ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:29.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.047+0000 7fa2118fa640 1 --2- 172.21.15.99:0/2474505542 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa20c102ef0 0x7fa20c06ff50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4003080 tx=0x7fa1f4009da0 comp rx=0 tx=0).stop 2024-09-19T06:44:29.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.047+0000 7fa2118fa640 1 -- 172.21.15.99:0/2474505542 shutdown_connections 2024-09-19T06:44:29.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.047+0000 7fa2118fa640 1 --2- 172.21.15.99:0/2474505542 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa1f806e660 0x7fa1f8070b10 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:29.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.047+0000 7fa2118fa640 1 --2- 172.21.15.99:0/2474505542 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa20c102ef0 0x7fa20c06ff50 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:29.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.047+0000 7fa2118fa640 1 --2- 172.21.15.99:0/2474505542 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa20c102550 0x7fa20c06fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:29.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.047+0000 7fa2118fa640 1 -- 172.21.15.99:0/2474505542 >> 172.21.15.99:0/2474505542 conn(0x7fa20c0f80f0 msgr2=0x7fa20c0f91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:29.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.047+0000 7fa2118fa640 1 -- 172.21.15.99:0/2474505542 shutdown_connections 2024-09-19T06:44:29.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.047+0000 7fa2118fa640 1 -- 172.21.15.99:0/2474505542 wait complete. 2024-09-19T06:44:29.057 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-09-19T06:44:29.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.126+0000 7fed41e83640 1 -- 172.21.15.99:0/3825744033 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fed3c0fcf80 msgr2=0x7fed3c0fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:29.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.126+0000 7fed41e83640 1 --2- 172.21.15.99:0/3825744033 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fed3c0fcf80 0x7fed3c0fd3d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fed300048d0 tx=0x7fed30009da0 comp rx=0 tx=0).stop 2024-09-19T06:44:29.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.127+0000 7fed41e83640 1 -- 172.21.15.99:0/3825744033 shutdown_connections 2024-09-19T06:44:29.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.127+0000 7fed41e83640 1 --2- 172.21.15.99:0/3825744033 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fed3c0fcf80 0x7fed3c0fd3d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:29.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.127+0000 7fed41e83640 1 --2- 172.21.15.99:0/3825744033 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed3c0fb810 0x7fed3c0fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:29.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.127+0000 7fed41e83640 1 -- 172.21.15.99:0/3825744033 >> 172.21.15.99:0/3825744033 conn(0x7fed3c0723b0 msgr2=0x7fed3c0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:29.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.127+0000 7fed41e83640 1 -- 172.21.15.99:0/3825744033 shutdown_connections 2024-09-19T06:44:29.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.127+0000 7fed41e83640 1 -- 172.21.15.99:0/3825744033 wait complete. 2024-09-19T06:44:29.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.127+0000 7fed41e83640 1 Processor -- start 2024-09-19T06:44:29.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.127+0000 7fed41e83640 1 -- start start 2024-09-19T06:44:29.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.127+0000 7fed41e83640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed3c0fb810 0x7fed3c10bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:29.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.127+0000 7fed41e83640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fed3c0fcf80 0x7fed3c10c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:29.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.127+0000 7fed41e83640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed3c10c9e0 con 0x7fed3c0fcf80 2024-09-19T06:44:29.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.127+0000 7fed41e83640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed3c10cb20 con 0x7fed3c0fb810 2024-09-19T06:44:29.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.128+0000 7fed3affd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fed3c0fcf80 0x7fed3c10c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:29.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.128+0000 7fed3affd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fed3c0fcf80 0x7fed3c10c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40518/0 (socket says 172.21.15.99:40518) 2024-09-19T06:44:29.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.128+0000 7fed3affd640 1 -- 172.21.15.99:0/3009598643 learned_addr learned my addr 172.21.15.99:0/3009598643 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:44:29.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.128+0000 7fed3b7fe640 1 --2- 172.21.15.99:0/3009598643 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed3c0fb810 0x7fed3c10bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:29.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.128+0000 7fed3affd640 1 -- 172.21.15.99:0/3009598643 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed3c0fb810 msgr2=0x7fed3c10bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:29.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.128+0000 7fed3affd640 1 --2- 172.21.15.99:0/3009598643 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed3c0fb810 0x7fed3c10bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:29.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.128+0000 7fed3affd640 1 -- 172.21.15.99:0/3009598643 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed30005040 con 0x7fed3c0fcf80 2024-09-19T06:44:29.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.128+0000 7fed3affd640 1 --2- 172.21.15.99:0/3009598643 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fed3c0fcf80 0x7fed3c10c4a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fed30000c00 tx=0x7fed30009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:29.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.128+0000 7fed23fff640 1 -- 172.21.15.99:0/3009598643 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed30038070 con 0x7fed3c0fcf80 2024-09-19T06:44:29.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.128+0000 7fed23fff640 1 -- 172.21.15.99:0/3009598643 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fed3002ade0 con 0x7fed3c0fcf80 2024-09-19T06:44:29.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.128+0000 7fed41e83640 1 -- 172.21.15.99:0/3009598643 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed3c10cda0 con 0x7fed3c0fcf80 2024-09-19T06:44:29.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.128+0000 7fed23fff640 1 -- 172.21.15.99:0/3009598643 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed3002c7e0 con 0x7fed3c0fcf80 2024-09-19T06:44:29.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.128+0000 7fed41e83640 1 -- 172.21.15.99:0/3009598643 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed3c1198a0 con 0x7fed3c0fcf80 2024-09-19T06:44:29.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.129+0000 7fed41e83640 1 -- 172.21.15.99:0/3009598643 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed3c0fcbc0 con 0x7fed3c0fcf80 2024-09-19T06:44:29.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.130+0000 7fed23fff640 1 -- 172.21.15.99:0/3009598643 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 40) v1 ==== 92653+0+0 (secure 0 0 0) 0x7fed30030020 con 0x7fed3c0fcf80 2024-09-19T06:44:29.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.130+0000 7fed23fff640 1 --2- 172.21.15.99:0/3009598643 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fed2406e660 0x7fed24070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:29.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.130+0000 7fed23fff640 1 -- 172.21.15.99:0/3009598643 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fed300ade40 con 0x7fed3c0fcf80 2024-09-19T06:44:29.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.130+0000 7fed3b7fe640 1 --2- 172.21.15.99:0/3009598643 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fed2406e660 0x7fed24070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:29.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.131+0000 7fed3b7fe640 1 --2- 172.21.15.99:0/3009598643 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fed2406e660 0x7fed24070b10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fed2c009fd0 tx=0x7fed2c009e50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:29.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.135+0000 7fed23fff640 1 -- 172.21.15.99:0/3009598643 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fed30076ff0 con 0x7fed3c0fcf80 2024-09-19T06:44:29.296 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:29 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:29.296 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:29 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:29.296 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:29 smithi099 ceph-mon[97031]: pgmap v29: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:44:29.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.323+0000 7fed41e83640 1 -- 172.21.15.99:0/3009598643 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fed3c04b720 con 0x7fed2406e660 2024-09-19T06:44:29.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.324+0000 7fed23fff640 1 -- 172.21.15.99:0/3009598643 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7fed3c04b720 con 0x7fed2406e660 2024-09-19T06:44:29.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.326+0000 7fed41e83640 1 -- 172.21.15.99:0/3009598643 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fed2406e660 msgr2=0x7fed24070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:29.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.326+0000 7fed41e83640 1 --2- 172.21.15.99:0/3009598643 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fed2406e660 0x7fed24070b10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fed2c009fd0 tx=0x7fed2c009e50 comp rx=0 tx=0).stop 2024-09-19T06:44:29.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.326+0000 7fed41e83640 1 -- 172.21.15.99:0/3009598643 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fed3c0fcf80 msgr2=0x7fed3c10c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:29.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.326+0000 7fed41e83640 1 --2- 172.21.15.99:0/3009598643 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fed3c0fcf80 0x7fed3c10c4a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fed30000c00 tx=0x7fed30009da0 comp rx=0 tx=0).stop 2024-09-19T06:44:29.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.326+0000 7fed41e83640 1 -- 172.21.15.99:0/3009598643 shutdown_connections 2024-09-19T06:44:29.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.326+0000 7fed41e83640 1 --2- 172.21.15.99:0/3009598643 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fed2406e660 0x7fed24070b10 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:29.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.326+0000 7fed41e83640 1 --2- 172.21.15.99:0/3009598643 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fed3c0fcf80 0x7fed3c10c4a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:29.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.326+0000 7fed41e83640 1 --2- 172.21.15.99:0/3009598643 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fed3c0fb810 0x7fed3c10bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:29.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.326+0000 7fed41e83640 1 -- 172.21.15.99:0/3009598643 >> 172.21.15.99:0/3009598643 conn(0x7fed3c0723b0 msgr2=0x7fed3c0fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:29.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.327+0000 7fed41e83640 1 -- 172.21.15.99:0/3009598643 shutdown_connections 2024-09-19T06:44:29.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.327+0000 7fed41e83640 1 -- 172.21.15.99:0/3009598643 wait complete. 2024-09-19T06:44:29.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.407+0000 7f4c95925640 1 -- 172.21.15.99:0/1430885643 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4c90102f10 msgr2=0x7f4c900fc5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:29.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.407+0000 7f4c95925640 1 --2- 172.21.15.99:0/1430885643 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4c90102f10 0x7f4c900fc5d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4c840048d0 tx=0x7f4c84009da0 comp rx=0 tx=0).stop 2024-09-19T06:44:29.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.407+0000 7f4c95925640 1 -- 172.21.15.99:0/1430885643 shutdown_connections 2024-09-19T06:44:29.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.407+0000 7f4c95925640 1 --2- 172.21.15.99:0/1430885643 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4c90102f10 0x7f4c900fc5d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:29.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.407+0000 7f4c95925640 1 --2- 172.21.15.99:0/1430885643 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c90102570 0x7f4c90102940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:29.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.407+0000 7f4c95925640 1 -- 172.21.15.99:0/1430885643 >> 172.21.15.99:0/1430885643 conn(0x7f4c900f8110 msgr2=0x7f4c900fa520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:29.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.407+0000 7f4c95925640 1 -- 172.21.15.99:0/1430885643 shutdown_connections 2024-09-19T06:44:29.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.407+0000 7f4c95925640 1 -- 172.21.15.99:0/1430885643 wait complete. 2024-09-19T06:44:29.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.408+0000 7f4c95925640 1 Processor -- start 2024-09-19T06:44:29.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.408+0000 7f4c95925640 1 -- start start 2024-09-19T06:44:29.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.408+0000 7f4c95925640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c90102570 0x7f4c901131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:29.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.409+0000 7f4c95925640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4c90102f10 0x7f4c90113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:29.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.409+0000 7f4c95925640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c90113d10 con 0x7f4c90102f10 2024-09-19T06:44:29.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.409+0000 7f4c95925640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9010d150 con 0x7f4c90102570 2024-09-19T06:44:29.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.409+0000 7f4c8e7fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4c90102f10 0x7f4c90113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:29.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.409+0000 7f4c8e7fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4c90102f10 0x7f4c90113710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40524/0 (socket says 172.21.15.99:40524) 2024-09-19T06:44:29.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.409+0000 7f4c8e7fc640 1 -- 172.21.15.99:0/458285474 learned_addr learned my addr 172.21.15.99:0/458285474 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:44:29.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.409+0000 7f4c8effd640 1 --2- 172.21.15.99:0/458285474 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c90102570 0x7f4c901131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:29.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.409+0000 7f4c8e7fc640 1 -- 172.21.15.99:0/458285474 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c90102570 msgr2=0x7f4c901131d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:29.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.409+0000 7f4c8e7fc640 1 --2- 172.21.15.99:0/458285474 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c90102570 0x7f4c901131d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:29.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.409+0000 7f4c8e7fc640 1 -- 172.21.15.99:0/458285474 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c84005040 con 0x7f4c90102f10 2024-09-19T06:44:29.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.409+0000 7f4c8e7fc640 1 --2- 172.21.15.99:0/458285474 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4c90102f10 0x7f4c90113710 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4c8402a530 tx=0x7f4c84009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:29.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.409+0000 7f4c777fe640 1 -- 172.21.15.99:0/458285474 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c84038070 con 0x7f4c90102f10 2024-09-19T06:44:29.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.409+0000 7f4c777fe640 1 -- 172.21.15.99:0/458285474 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4c8402ade0 con 0x7f4c90102f10 2024-09-19T06:44:29.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.409+0000 7f4c777fe640 1 -- 172.21.15.99:0/458285474 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c8402c7a0 con 0x7f4c90102f10 2024-09-19T06:44:29.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.409+0000 7f4c95925640 1 -- 172.21.15.99:0/458285474 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c9010d3d0 con 0x7f4c90102f10 2024-09-19T06:44:29.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.409+0000 7f4c95925640 1 -- 172.21.15.99:0/458285474 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c9010d910 con 0x7f4c90102f10 2024-09-19T06:44:29.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.411+0000 7f4c95925640 1 -- 172.21.15.99:0/458285474 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c900fdcf0 con 0x7f4c90102f10 2024-09-19T06:44:29.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.411+0000 7f4c777fe640 1 -- 172.21.15.99:0/458285474 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 40) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f4c84030020 con 0x7f4c90102f10 2024-09-19T06:44:29.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.412+0000 7f4c777fe640 1 --2- 172.21.15.99:0/458285474 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f4c7806e660 0x7f4c78070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:29.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.412+0000 7f4c777fe640 1 -- 172.21.15.99:0/458285474 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f4c840ae670 con 0x7f4c90102f10 2024-09-19T06:44:29.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.412+0000 7f4c8effd640 1 --2- 172.21.15.99:0/458285474 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f4c7806e660 0x7f4c78070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:29.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.412+0000 7f4c8effd640 1 --2- 172.21.15.99:0/458285474 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f4c7806e660 0x7f4c78070b10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4c80009af0 tx=0x7f4c8000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:29.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.416+0000 7f4c777fe640 1 -- 172.21.15.99:0/458285474 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f4c840776f0 con 0x7f4c90102f10 2024-09-19T06:44:29.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:29 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:29.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:29 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:29.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:29 smithi117 ceph-mon[76771]: pgmap v29: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:44:29.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.597+0000 7f4c95925640 1 -- 172.21.15.99:0/458285474 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4c901095a0 con 0x7f4c7806e660 2024-09-19T06:44:29.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.608+0000 7f4c777fe640 1 -- 172.21.15.99:0/458285474 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f4c901095a0 con 0x7f4c7806e660 2024-09-19T06:44:29.610 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T06:44:29.610 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.smithi099 smithi099 *:9093,9094 running (3m) 47s ago 11m 22.8M - 0.25.0 c8568f914cd2 e7c1774d56b0 2024-09-19T06:44:29.610 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi099 smithi099 starting - - - - 2024-09-19T06:44:29.610 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi117 smithi117 running (11m) 32s ago 11m 6899k - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 b4c328bdec52 2024-09-19T06:44:29.610 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.smithi099 smithi099 *:3000 running (116s) 47s ago 11m 75.3M - 9.4.12 2bacad6d85d8 cd53a18d5410 2024-09-19T06:44:29.610 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.obarqf smithi099 running (6m) 47s ago 6m 13.1M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 e36c9b74004b 2024-09-19T06:44:29.610 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.xehbxe smithi099 running (6m) 47s ago 6m 122M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 d09eb3d306ae 2024-09-19T06:44:29.610 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.bheqzh smithi117 running (6m) 32s ago 6m 15.2M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 21253e27fdd3 2024-09-19T06:44:29.610 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.nooexo smithi117 running (6m) 32s ago 6m 109M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 ad1faeb3343c 2024-09-19T06:44:29.610 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi099.pgvkqi smithi099 *:8443,9283,8765 running (2m) 47s ago 13m 473M - 19.1.1-361-g2f599a46 d2baa855c067 d5de99cb7e78 2024-09-19T06:44:29.610 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi117.ssmkcf smithi117 *:8443,9283,8765 running (2m) 32s ago 11m 440M - 19.1.1-361-g2f599a46 d2baa855c067 8b7ee0f871f5 2024-09-19T06:44:29.610 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi099 smithi099 running (59s) 47s ago 13m 29.9M 2048M 19.1.1-361-g2f599a46 d2baa855c067 ffe067438824 2024-09-19T06:44:29.611 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi117 smithi117 running (37s) 32s ago 11m 20.0M 2048M 19.1.1-361-g2f599a46 d2baa855c067 4cb7455e3ee7 2024-09-19T06:44:29.611 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi099 smithi099 *:9100 running (3m) 47s ago 12m 15.3M - 1.5.0 0da6a335fe13 dca7b4517dcc 2024-09-19T06:44:29.611 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi117 smithi117 *:9100 running (3m) 32s ago 11m 16.3M - 1.5.0 0da6a335fe13 8233ce3835d2 2024-09-19T06:44:29.611 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (10m) 47s ago 10m 218M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 cf8d3dd4a987 2024-09-19T06:44:29.611 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (9m) 47s ago 9m 237M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 bc5b04b8bf9f 2024-09-19T06:44:29.611 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (9m) 47s ago 9m 201M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 cedc7e3698d8 2024-09-19T06:44:29.611 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi117 running (9m) 32s ago 8m 260M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 5984ed999c91 2024-09-19T06:44:29.611 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi117 running (8m) 32s ago 8m 231M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 6a2fc0c51c05 2024-09-19T06:44:29.611 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi117 running (8m) 32s ago 8m 226M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 39dcb7dbf0e3 2024-09-19T06:44:29.611 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.smithi099 smithi099 *:9095 running (2m) 47s ago 11m 51.7M - 2.43.0 a07b618ecd1d 15ad26ec6fb4 2024-09-19T06:44:29.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.610+0000 7f4c95925640 1 -- 172.21.15.99:0/458285474 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f4c7806e660 msgr2=0x7f4c78070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:29.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.610+0000 7f4c95925640 1 --2- 172.21.15.99:0/458285474 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f4c7806e660 0x7f4c78070b10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4c80009af0 tx=0x7f4c8000b040 comp rx=0 tx=0).stop 2024-09-19T06:44:29.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.610+0000 7f4c95925640 1 -- 172.21.15.99:0/458285474 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4c90102f10 msgr2=0x7f4c90113710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:29.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.610+0000 7f4c95925640 1 --2- 172.21.15.99:0/458285474 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4c90102f10 0x7f4c90113710 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4c8402a530 tx=0x7f4c84009da0 comp rx=0 tx=0).stop 2024-09-19T06:44:29.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.610+0000 7f4c95925640 1 -- 172.21.15.99:0/458285474 shutdown_connections 2024-09-19T06:44:29.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.610+0000 7f4c95925640 1 --2- 172.21.15.99:0/458285474 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f4c7806e660 0x7f4c78070b10 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:29.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.610+0000 7f4c95925640 1 --2- 172.21.15.99:0/458285474 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4c90102f10 0x7f4c90113710 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:29.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.610+0000 7f4c95925640 1 --2- 172.21.15.99:0/458285474 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c90102570 0x7f4c901131d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:29.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.610+0000 7f4c95925640 1 -- 172.21.15.99:0/458285474 >> 172.21.15.99:0/458285474 conn(0x7f4c900f8110 msgr2=0x7f4c900f90a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:29.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.610+0000 7f4c95925640 1 -- 172.21.15.99:0/458285474 shutdown_connections 2024-09-19T06:44:29.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.610+0000 7f4c95925640 1 -- 172.21.15.99:0/458285474 wait complete. 2024-09-19T06:44:29.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.692+0000 7fef079f5640 1 -- 172.21.15.99:0/2202903741 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef000fe460 msgr2=0x7fef000fe830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:29.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.692+0000 7fef079f5640 1 --2- 172.21.15.99:0/2202903741 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef000fe460 0x7fef000fe830 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7feefc0048d0 tx=0x7feefc009da0 comp rx=0 tx=0).stop 2024-09-19T06:44:29.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.692+0000 7fef079f5640 1 -- 172.21.15.99:0/2202903741 shutdown_connections 2024-09-19T06:44:29.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.692+0000 7fef079f5640 1 --2- 172.21.15.99:0/2202903741 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef00064fc0 0x7fef00065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:29.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.692+0000 7fef079f5640 1 --2- 172.21.15.99:0/2202903741 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef000fe460 0x7fef000fe830 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:29.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.692+0000 7fef079f5640 1 -- 172.21.15.99:0/2202903741 >> 172.21.15.99:0/2202903741 conn(0x7fef000723b0 msgr2=0x7fef000727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:29.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.692+0000 7fef079f5640 1 -- 172.21.15.99:0/2202903741 shutdown_connections 2024-09-19T06:44:29.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.692+0000 7fef079f5640 1 -- 172.21.15.99:0/2202903741 wait complete. 2024-09-19T06:44:29.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.693+0000 7fef079f5640 1 Processor -- start 2024-09-19T06:44:29.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.693+0000 7fef079f5640 1 -- start start 2024-09-19T06:44:29.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.693+0000 7fef079f5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef00064fc0 0x7fef001131b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:29.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.693+0000 7fef079f5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef000fe460 0x7fef001136f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:29.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.693+0000 7fef079f5640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef00113cf0 con 0x7fef000fe460 2024-09-19T06:44:29.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.693+0000 7fef079f5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef0010d130 con 0x7fef00064fc0 2024-09-19T06:44:29.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.693+0000 7fef04f90640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef000fe460 0x7fef001136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:29.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.693+0000 7fef05791640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef00064fc0 0x7fef001131b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:29.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.693+0000 7fef04f90640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef000fe460 0x7fef001136f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40546/0 (socket says 172.21.15.99:40546) 2024-09-19T06:44:29.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.693+0000 7fef04f90640 1 -- 172.21.15.99:0/1537884045 learned_addr learned my addr 172.21.15.99:0/1537884045 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:44:29.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.693+0000 7fef05791640 1 -- 172.21.15.99:0/1537884045 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef000fe460 msgr2=0x7fef001136f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:29.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.693+0000 7fef05791640 1 --2- 172.21.15.99:0/1537884045 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef000fe460 0x7fef001136f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:29.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.694+0000 7fef05791640 1 -- 172.21.15.99:0/1537884045 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feefc005040 con 0x7fef00064fc0 2024-09-19T06:44:29.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.694+0000 7fef04f90640 1 --2- 172.21.15.99:0/1537884045 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef000fe460 0x7fef001136f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:44:29.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.694+0000 7fef05791640 1 --2- 172.21.15.99:0/1537884045 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef00064fc0 0x7fef001131b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7feefc02a530 tx=0x7feefc009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:29.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.694+0000 7feef5ffb640 1 -- 172.21.15.99:0/1537884045 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feefc038070 con 0x7fef00064fc0 2024-09-19T06:44:29.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.694+0000 7feef5ffb640 1 -- 172.21.15.99:0/1537884045 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7feefc02ade0 con 0x7fef00064fc0 2024-09-19T06:44:29.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.694+0000 7fef079f5640 1 -- 172.21.15.99:0/1537884045 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef0010d3b0 con 0x7fef00064fc0 2024-09-19T06:44:29.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.694+0000 7feef5ffb640 1 -- 172.21.15.99:0/1537884045 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feefc02c770 con 0x7fef00064fc0 2024-09-19T06:44:29.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.694+0000 7fef079f5640 1 -- 172.21.15.99:0/1537884045 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef0010d8f0 con 0x7fef00064fc0 2024-09-19T06:44:29.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.695+0000 7fef079f5640 1 -- 172.21.15.99:0/1537884045 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef000fdcf0 con 0x7fef00064fc0 2024-09-19T06:44:29.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.696+0000 7feef5ffb640 1 -- 172.21.15.99:0/1537884045 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 40) v1 ==== 92653+0+0 (secure 0 0 0) 0x7feefc030020 con 0x7fef00064fc0 2024-09-19T06:44:29.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.696+0000 7feef5ffb640 1 --2- 172.21.15.99:0/1537884045 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7feeec06e660 0x7feeec070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:29.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.696+0000 7feef5ffb640 1 -- 172.21.15.99:0/1537884045 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6324+0+0 (secure 0 0 0) 0x7feefc0ae620 con 0x7fef00064fc0 2024-09-19T06:44:29.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.696+0000 7fef04f90640 1 --2- 172.21.15.99:0/1537884045 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7feeec06e660 0x7feeec070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:29.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.697+0000 7fef04f90640 1 --2- 172.21.15.99:0/1537884045 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7feeec06e660 0x7feeec070b10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fef0010ea70 tx=0x7feef000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:29.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.701+0000 7feef5ffb640 1 -- 172.21.15.99:0/1537884045 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7feefc0776c0 con 0x7fef00064fc0 2024-09-19T06:44:29.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.945+0000 7fef079f5640 1 -- 172.21.15.99:0/1537884045 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fef0004b720 con 0x7fef00064fc0 2024-09-19T06:44:29.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.946+0000 7feef5ffb640 1 -- 172.21.15.99:0/1537884045 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+745 (secure 0 0 0) 0x7feefc07ad80 con 0x7fef00064fc0 2024-09-19T06:44:29.948 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:44:29.948 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-09-19T06:44:29.948 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T06:44:29.948 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:44:29.949 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-09-19T06:44:29.949 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T06:44:29.949 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:44:29.949 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-09-19T06:44:29.949 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 6 2024-09-19T06:44:29.949 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:44:29.949 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": { 2024-09-19T06:44:29.949 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 4 2024-09-19T06:44:29.949 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:44:29.949 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-09-19T06:44:29.949 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 10, 2024-09-19T06:44:29.949 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 4 2024-09-19T06:44:29.949 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T06:44:29.950 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:44:29.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.948+0000 7fef079f5640 1 -- 172.21.15.99:0/1537884045 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7feeec06e660 msgr2=0x7feeec070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:29.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.948+0000 7fef079f5640 1 --2- 172.21.15.99:0/1537884045 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7feeec06e660 0x7feeec070b10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fef0010ea70 tx=0x7feef000b040 comp rx=0 tx=0).stop 2024-09-19T06:44:29.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.948+0000 7fef079f5640 1 -- 172.21.15.99:0/1537884045 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef00064fc0 msgr2=0x7fef001131b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:29.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.948+0000 7fef079f5640 1 --2- 172.21.15.99:0/1537884045 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef00064fc0 0x7fef001131b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7feefc02a530 tx=0x7feefc009da0 comp rx=0 tx=0).stop 2024-09-19T06:44:29.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.949+0000 7fef079f5640 1 -- 172.21.15.99:0/1537884045 shutdown_connections 2024-09-19T06:44:29.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.949+0000 7fef079f5640 1 --2- 172.21.15.99:0/1537884045 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7feeec06e660 0x7feeec070b10 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:29.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.949+0000 7fef079f5640 1 --2- 172.21.15.99:0/1537884045 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef000fe460 0x7fef001136f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:29.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.949+0000 7fef079f5640 1 --2- 172.21.15.99:0/1537884045 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef00064fc0 0x7fef001131b0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:29.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.949+0000 7fef079f5640 1 -- 172.21.15.99:0/1537884045 >> 172.21.15.99:0/1537884045 conn(0x7fef000723b0 msgr2=0x7fef00105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:29.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.949+0000 7fef079f5640 1 -- 172.21.15.99:0/1537884045 shutdown_connections 2024-09-19T06:44:29.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:29.949+0000 7fef079f5640 1 -- 172.21.15.99:0/1537884045 wait complete. 2024-09-19T06:44:30.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.029+0000 7faa0e8b4640 1 -- 172.21.15.99:0/2575240488 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa080fcf80 msgr2=0x7faa080fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:30.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.029+0000 7faa0e8b4640 1 --2- 172.21.15.99:0/2575240488 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa080fcf80 0x7faa080fd3d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc0048d0 tx=0x7fa9fc009da0 comp rx=0 tx=0).stop 2024-09-19T06:44:30.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.029+0000 7faa0e8b4640 1 -- 172.21.15.99:0/2575240488 shutdown_connections 2024-09-19T06:44:30.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.029+0000 7faa0e8b4640 1 --2- 172.21.15.99:0/2575240488 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa080fcf80 0x7faa080fd3d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:30.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.029+0000 7faa0e8b4640 1 --2- 172.21.15.99:0/2575240488 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa080fb810 0x7faa080fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:30.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.029+0000 7faa0e8b4640 1 -- 172.21.15.99:0/2575240488 >> 172.21.15.99:0/2575240488 conn(0x7faa080723b0 msgr2=0x7faa080727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:30.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.029+0000 7faa0e8b4640 1 -- 172.21.15.99:0/2575240488 shutdown_connections 2024-09-19T06:44:30.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.029+0000 7faa0e8b4640 1 -- 172.21.15.99:0/2575240488 wait complete. 2024-09-19T06:44:30.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.030+0000 7faa0e8b4640 1 Processor -- start 2024-09-19T06:44:30.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.030+0000 7faa0e8b4640 1 -- start start 2024-09-19T06:44:30.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.030+0000 7faa0e8b4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa080fb810 0x7faa0810e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:30.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.030+0000 7faa0e8b4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa080fcf80 0x7faa0810e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:30.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.030+0000 7faa0e8b4640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa0810ed20 con 0x7faa080fcf80 2024-09-19T06:44:30.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.030+0000 7faa0e8b4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa0810ee90 con 0x7faa080fb810 2024-09-19T06:44:30.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.030+0000 7faa077fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa080fcf80 0x7faa0810e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:30.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.031+0000 7faa077fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa080fcf80 0x7faa0810e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40572/0 (socket says 172.21.15.99:40572) 2024-09-19T06:44:30.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.031+0000 7faa077fe640 1 -- 172.21.15.99:0/758654565 learned_addr learned my addr 172.21.15.99:0/758654565 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:44:30.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.031+0000 7faa07fff640 1 --2- 172.21.15.99:0/758654565 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa080fb810 0x7faa0810e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:30.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.031+0000 7faa077fe640 1 -- 172.21.15.99:0/758654565 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa080fb810 msgr2=0x7faa0810e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:30.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.031+0000 7faa077fe640 1 --2- 172.21.15.99:0/758654565 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa080fb810 0x7faa0810e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:30.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.031+0000 7faa077fe640 1 -- 172.21.15.99:0/758654565 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9fc005040 con 0x7faa080fcf80 2024-09-19T06:44:30.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.031+0000 7faa077fe640 1 --2- 172.21.15.99:0/758654565 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa080fcf80 0x7faa0810e6d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc000c00 tx=0x7fa9fc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:30.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.031+0000 7faa04ff9640 1 -- 172.21.15.99:0/758654565 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9fc038070 con 0x7faa080fcf80 2024-09-19T06:44:30.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.031+0000 7faa04ff9640 1 -- 172.21.15.99:0/758654565 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa9fc02ade0 con 0x7faa080fcf80 2024-09-19T06:44:30.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.031+0000 7faa0e8b4640 1 -- 172.21.15.99:0/758654565 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa08117200 con 0x7faa080fcf80 2024-09-19T06:44:30.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.031+0000 7faa04ff9640 1 -- 172.21.15.99:0/758654565 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9fc02c7b0 con 0x7faa080fcf80 2024-09-19T06:44:30.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.031+0000 7faa0e8b4640 1 -- 172.21.15.99:0/758654565 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa08117660 con 0x7faa080fcf80 2024-09-19T06:44:30.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.032+0000 7faa0e8b4640 1 -- 172.21.15.99:0/758654565 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa080fcbc0 con 0x7faa080fcf80 2024-09-19T06:44:30.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.033+0000 7faa04ff9640 1 -- 172.21.15.99:0/758654565 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 40) v1 ==== 92653+0+0 (secure 0 0 0) 0x7fa9fc030020 con 0x7faa080fcf80 2024-09-19T06:44:30.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.034+0000 7faa04ff9640 1 --2- 172.21.15.99:0/758654565 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa9f006e660 0x7fa9f0070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:30.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.034+0000 7faa04ff9640 1 -- 172.21.15.99:0/758654565 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fa9fc0ae5a0 con 0x7faa080fcf80 2024-09-19T06:44:30.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.034+0000 7faa07fff640 1 --2- 172.21.15.99:0/758654565 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa9f006e660 0x7fa9f0070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:30.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.034+0000 7faa07fff640 1 --2- 172.21.15.99:0/758654565 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa9f006e660 0x7fa9f0070b10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa9f8009af0 tx=0x7fa9f800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:30.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.038+0000 7faa04ff9640 1 -- 172.21.15.99:0/758654565 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fa9fc0776a0 con 0x7faa080fcf80 2024-09-19T06:44:30.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.241+0000 7faa0e8b4640 1 -- 172.21.15.99:0/758654565 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7faa0804b720 con 0x7faa080fcf80 2024-09-19T06:44:30.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.242+0000 7faa04ff9640 1 -- 172.21.15.99:0/758654565 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1941 (secure 0 0 0) 0x7fa9fc07ad60 con 0x7faa080fcf80 2024-09-19T06:44:30.243 INFO:teuthology.orchestra.run.smithi099.stdout:e19 2024-09-19T06:44:30.243 INFO:teuthology.orchestra.run.smithi099.stdout:btime 2024-09-19T06:44:03:270764+0000 2024-09-19T06:44:30.244 INFO:teuthology.orchestra.run.smithi099.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T06:44:30.244 INFO:teuthology.orchestra.run.smithi099.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T06:44:30.244 INFO:teuthology.orchestra.run.smithi099.stdout:legacy client fscid: 1 2024-09-19T06:44:30.244 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:44:30.244 INFO:teuthology.orchestra.run.smithi099.stdout:Filesystem 'cephfs' (1) 2024-09-19T06:44:30.244 INFO:teuthology.orchestra.run.smithi099.stdout:fs_name cephfs 2024-09-19T06:44:30.244 INFO:teuthology.orchestra.run.smithi099.stdout:epoch 19 2024-09-19T06:44:30.245 INFO:teuthology.orchestra.run.smithi099.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-19T06:44:30.245 INFO:teuthology.orchestra.run.smithi099.stdout:created 2024-09-19T06:37:40.838146+0000 2024-09-19T06:44:30.245 INFO:teuthology.orchestra.run.smithi099.stdout:modified 2024-09-19T06:44:02.356718+0000 2024-09-19T06:44:30.245 INFO:teuthology.orchestra.run.smithi099.stdout:tableserver 0 2024-09-19T06:44:30.245 INFO:teuthology.orchestra.run.smithi099.stdout:root 0 2024-09-19T06:44:30.245 INFO:teuthology.orchestra.run.smithi099.stdout:session_timeout 60 2024-09-19T06:44:30.245 INFO:teuthology.orchestra.run.smithi099.stdout:session_autoclose 300 2024-09-19T06:44:30.245 INFO:teuthology.orchestra.run.smithi099.stdout:max_file_size 1099511627776 2024-09-19T06:44:30.245 INFO:teuthology.orchestra.run.smithi099.stdout:max_xattr_size 65536 2024-09-19T06:44:30.245 INFO:teuthology.orchestra.run.smithi099.stdout:required_client_features {} 2024-09-19T06:44:30.245 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure 0 2024-09-19T06:44:30.246 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure_osd_epoch 45 2024-09-19T06:44:30.246 INFO:teuthology.orchestra.run.smithi099.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T06:44:30.246 INFO:teuthology.orchestra.run.smithi099.stdout:max_mds 2 2024-09-19T06:44:30.246 INFO:teuthology.orchestra.run.smithi099.stdout:in 0,1 2024-09-19T06:44:30.246 INFO:teuthology.orchestra.run.smithi099.stdout:up {0=14482,1=24269} 2024-09-19T06:44:30.246 INFO:teuthology.orchestra.run.smithi099.stdout:failed 2024-09-19T06:44:30.246 INFO:teuthology.orchestra.run.smithi099.stdout:damaged 2024-09-19T06:44:30.246 INFO:teuthology.orchestra.run.smithi099.stdout:stopped 2024-09-19T06:44:30.247 INFO:teuthology.orchestra.run.smithi099.stdout:data_pools [3] 2024-09-19T06:44:30.247 INFO:teuthology.orchestra.run.smithi099.stdout:metadata_pool 2 2024-09-19T06:44:30.247 INFO:teuthology.orchestra.run.smithi099.stdout:inline_data disabled 2024-09-19T06:44:30.247 INFO:teuthology.orchestra.run.smithi099.stdout:balancer 2024-09-19T06:44:30.247 INFO:teuthology.orchestra.run.smithi099.stdout:bal_rank_mask -1 2024-09-19T06:44:30.247 INFO:teuthology.orchestra.run.smithi099.stdout:standby_count_wanted 1 2024-09-19T06:44:30.247 INFO:teuthology.orchestra.run.smithi099.stdout:qdb_cluster leader: 14482 members: 24269,14482 2024-09-19T06:44:30.247 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.xehbxe{0:14482} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.99:6828/1508711176,v1:172.21.15.99:6829/1508711176] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T06:44:30.247 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.nooexo{1:24269} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.117:6824/2367330767,v1:172.21.15.117:6825/2367330767] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T06:44:30.247 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:44:30.247 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:44:30.248 INFO:teuthology.orchestra.run.smithi099.stdout:Standby daemons: 2024-09-19T06:44:30.248 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:44:30.248 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.obarqf{-1:14490} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6826/388324528,v1:172.21.15.99:6827/388324528] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T06:44:30.248 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.bheqzh{-1:24283} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.117:6826/4072877365,v1:172.21.15.117:6827/4072877365] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T06:44:30.249 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 19 2024-09-19T06:44:30.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.244+0000 7faa0e8b4640 1 -- 172.21.15.99:0/758654565 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa9f006e660 msgr2=0x7fa9f0070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:30.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.244+0000 7faa0e8b4640 1 --2- 172.21.15.99:0/758654565 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa9f006e660 0x7fa9f0070b10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa9f8009af0 tx=0x7fa9f800b040 comp rx=0 tx=0).stop 2024-09-19T06:44:30.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.244+0000 7faa0e8b4640 1 -- 172.21.15.99:0/758654565 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa080fcf80 msgr2=0x7faa0810e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:30.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.244+0000 7faa0e8b4640 1 --2- 172.21.15.99:0/758654565 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa080fcf80 0x7faa0810e6d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc000c00 tx=0x7fa9fc009da0 comp rx=0 tx=0).stop 2024-09-19T06:44:30.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.244+0000 7faa0e8b4640 1 -- 172.21.15.99:0/758654565 shutdown_connections 2024-09-19T06:44:30.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.244+0000 7faa0e8b4640 1 --2- 172.21.15.99:0/758654565 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa9f006e660 0x7fa9f0070b10 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:30.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.244+0000 7faa0e8b4640 1 --2- 172.21.15.99:0/758654565 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa080fcf80 0x7faa0810e6d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:30.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.244+0000 7faa0e8b4640 1 --2- 172.21.15.99:0/758654565 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa080fb810 0x7faa0810e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:30.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.244+0000 7faa0e8b4640 1 -- 172.21.15.99:0/758654565 >> 172.21.15.99:0/758654565 conn(0x7faa080723b0 msgr2=0x7faa080fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:30.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.244+0000 7faa0e8b4640 1 -- 172.21.15.99:0/758654565 shutdown_connections 2024-09-19T06:44:30.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.244+0000 7faa0e8b4640 1 -- 172.21.15.99:0/758654565 wait complete. 2024-09-19T06:44:30.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.324+0000 7f3788859640 1 -- 172.21.15.99:0/2026068918 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37840fb810 msgr2=0x7f37840fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:30.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.324+0000 7f3788859640 1 --2- 172.21.15.99:0/2026068918 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37840fb810 0x7f37840fbbe0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f37740048d0 tx=0x7f3774009da0 comp rx=0 tx=0).stop 2024-09-19T06:44:30.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.324+0000 7f3788859640 1 -- 172.21.15.99:0/2026068918 shutdown_connections 2024-09-19T06:44:30.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.324+0000 7f3788859640 1 --2- 172.21.15.99:0/2026068918 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f37840fcf80 0x7f37840fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:30.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.324+0000 7f3788859640 1 --2- 172.21.15.99:0/2026068918 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37840fb810 0x7f37840fbbe0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:30.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.324+0000 7f3788859640 1 -- 172.21.15.99:0/2026068918 >> 172.21.15.99:0/2026068918 conn(0x7f37840723b0 msgr2=0x7f37840727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:30.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.324+0000 7f3788859640 1 -- 172.21.15.99:0/2026068918 shutdown_connections 2024-09-19T06:44:30.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.324+0000 7f3788859640 1 -- 172.21.15.99:0/2026068918 wait complete. 2024-09-19T06:44:30.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.324+0000 7f3788859640 1 Processor -- start 2024-09-19T06:44:30.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.324+0000 7f3788859640 1 -- start start 2024-09-19T06:44:30.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.325+0000 7f3788859640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f37840fb810 0x7f378410e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:30.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.325+0000 7f3788859640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37840fcf80 0x7f378410e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:30.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.325+0000 7f3788859640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f378410ede0 con 0x7f37840fcf80 2024-09-19T06:44:30.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.325+0000 7f3788859640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f378410ef50 con 0x7f37840fb810 2024-09-19T06:44:30.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.325+0000 7f3781d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37840fcf80 0x7f378410e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:30.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.325+0000 7f3781d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37840fcf80 0x7f378410e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40588/0 (socket says 172.21.15.99:40588) 2024-09-19T06:44:30.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.325+0000 7f3781d9b640 1 -- 172.21.15.99:0/2187596795 learned_addr learned my addr 172.21.15.99:0/2187596795 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:44:30.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.325+0000 7f378259c640 1 --2- 172.21.15.99:0/2187596795 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f37840fb810 0x7f378410e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:30.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.325+0000 7f3781d9b640 1 -- 172.21.15.99:0/2187596795 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f37840fb810 msgr2=0x7f378410e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:30.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.325+0000 7f3781d9b640 1 --2- 172.21.15.99:0/2187596795 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f37840fb810 0x7f378410e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:30.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.325+0000 7f3781d9b640 1 -- 172.21.15.99:0/2187596795 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3774005040 con 0x7f37840fcf80 2024-09-19T06:44:30.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.325+0000 7f3781d9b640 1 --2- 172.21.15.99:0/2187596795 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37840fcf80 0x7f378410e700 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f377800b790 tx=0x7f37780091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:30.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.325+0000 7f3772ffd640 1 -- 172.21.15.99:0/2187596795 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f377800c700 con 0x7f37840fcf80 2024-09-19T06:44:30.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.325+0000 7f3788859640 1 -- 172.21.15.99:0/2187596795 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3784117230 con 0x7f37840fcf80 2024-09-19T06:44:30.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.325+0000 7f3772ffd640 1 -- 172.21.15.99:0/2187596795 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f377800cd00 con 0x7f37840fcf80 2024-09-19T06:44:30.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.325+0000 7f3772ffd640 1 -- 172.21.15.99:0/2187596795 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3778015e80 con 0x7f37840fcf80 2024-09-19T06:44:30.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.325+0000 7f3788859640 1 -- 172.21.15.99:0/2187596795 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3784117750 con 0x7f37840fcf80 2024-09-19T06:44:30.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.327+0000 7f3788859640 1 -- 172.21.15.99:0/2187596795 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37840fcbc0 con 0x7f37840fcf80 2024-09-19T06:44:30.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.327+0000 7f3772ffd640 1 -- 172.21.15.99:0/2187596795 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 40) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f3778012070 con 0x7f37840fcf80 2024-09-19T06:44:30.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.328+0000 7f3772ffd640 1 --2- 172.21.15.99:0/2187596795 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f376c06e660 0x7f376c070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:30.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.328+0000 7f3772ffd640 1 -- 172.21.15.99:0/2187596795 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f377808db30 con 0x7f37840fcf80 2024-09-19T06:44:30.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.328+0000 7f378259c640 1 --2- 172.21.15.99:0/2187596795 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f376c06e660 0x7f376c070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:30.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.328+0000 7f378259c640 1 --2- 172.21.15.99:0/2187596795 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f376c06e660 0x7f376c070b10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3774009ac0 tx=0x7f3774035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:30.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.332+0000 7f3772ffd640 1 -- 172.21.15.99:0/2187596795 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f3778056bb0 con 0x7f37840fcf80 2024-09-19T06:44:30.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.517+0000 7f3788859640 1 -- 172.21.15.99:0/2187596795 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3784065730 con 0x7f376c06e660 2024-09-19T06:44:30.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.519+0000 7f3772ffd640 1 -- 172.21.15.99:0/2187596795 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7f3784065730 con 0x7f376c06e660 2024-09-19T06:44:30.520 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:44:30.520 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T06:44:30.520 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": true, 2024-09-19T06:44:30.520 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T06:44:30.520 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [ 2024-09-19T06:44:30.520 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr", 2024-09-19T06:44:30.520 INFO:teuthology.orchestra.run.smithi099.stdout: "mon" 2024-09-19T06:44:30.521 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-19T06:44:30.521 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": "4/21 daemons upgraded", 2024-09-19T06:44:30.521 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "Currently upgrading crash daemons", 2024-09-19T06:44:30.521 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-09-19T06:44:30.521 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:44:30.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.521+0000 7f3788859640 1 -- 172.21.15.99:0/2187596795 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f376c06e660 msgr2=0x7f376c070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:30.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.521+0000 7f3788859640 1 --2- 172.21.15.99:0/2187596795 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f376c06e660 0x7f376c070b10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3774009ac0 tx=0x7f3774035040 comp rx=0 tx=0).stop 2024-09-19T06:44:30.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.521+0000 7f3788859640 1 -- 172.21.15.99:0/2187596795 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37840fcf80 msgr2=0x7f378410e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:30.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.521+0000 7f3788859640 1 --2- 172.21.15.99:0/2187596795 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37840fcf80 0x7f378410e700 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f377800b790 tx=0x7f37780091d0 comp rx=0 tx=0).stop 2024-09-19T06:44:30.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.521+0000 7f3788859640 1 -- 172.21.15.99:0/2187596795 shutdown_connections 2024-09-19T06:44:30.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.521+0000 7f3788859640 1 --2- 172.21.15.99:0/2187596795 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f376c06e660 0x7f376c070b10 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:30.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.521+0000 7f3788859640 1 --2- 172.21.15.99:0/2187596795 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37840fcf80 0x7f378410e700 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:30.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.521+0000 7f3788859640 1 --2- 172.21.15.99:0/2187596795 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f37840fb810 0x7f378410e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:30.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.521+0000 7f3788859640 1 -- 172.21.15.99:0/2187596795 >> 172.21.15.99:0/2187596795 conn(0x7f37840723b0 msgr2=0x7f37840fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:30.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.521+0000 7f3788859640 1 -- 172.21.15.99:0/2187596795 shutdown_connections 2024-09-19T06:44:30.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.521+0000 7f3788859640 1 -- 172.21.15.99:0/2187596795 wait complete. 2024-09-19T06:44:30.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.600+0000 7f8232039640 1 -- 172.21.15.99:0/1593418505 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f822c0fd570 msgr2=0x7f822c0fd940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:30.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.600+0000 7f8232039640 1 --2- 172.21.15.99:0/1593418505 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f822c0fd570 0x7f822c0fd940 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f821c0048d0 tx=0x7f821c009da0 comp rx=0 tx=0).stop 2024-09-19T06:44:30.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.600+0000 7f8232039640 1 -- 172.21.15.99:0/1593418505 shutdown_connections 2024-09-19T06:44:30.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.600+0000 7f8232039640 1 --2- 172.21.15.99:0/1593418505 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f822c0fdf10 0x7f822c106550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:30.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.600+0000 7f8232039640 1 --2- 172.21.15.99:0/1593418505 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f822c0fd570 0x7f822c0fd940 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:30.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.600+0000 7f8232039640 1 -- 172.21.15.99:0/1593418505 >> 172.21.15.99:0/1593418505 conn(0x7f822c0f7000 msgr2=0x7f822c0f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:30.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.600+0000 7f8232039640 1 -- 172.21.15.99:0/1593418505 shutdown_connections 2024-09-19T06:44:30.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.600+0000 7f8232039640 1 -- 172.21.15.99:0/1593418505 wait complete. 2024-09-19T06:44:30.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.601+0000 7f8232039640 1 Processor -- start 2024-09-19T06:44:30.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.601+0000 7f8232039640 1 -- start start 2024-09-19T06:44:30.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.601+0000 7f8232039640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f822c0fd570 0x7f822c1154a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:30.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.601+0000 7f8232039640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f822c0fdf10 0x7f822c1159e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:30.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.601+0000 7f8232039640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f822c116030 con 0x7f822c0fdf10 2024-09-19T06:44:30.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.601+0000 7f8232039640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f822c10f440 con 0x7f822c0fd570 2024-09-19T06:44:30.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.601+0000 7f822affd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f822c0fdf10 0x7f822c1159e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:30.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.601+0000 7f822affd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f822c0fdf10 0x7f822c1159e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40614/0 (socket says 172.21.15.99:40614) 2024-09-19T06:44:30.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.601+0000 7f822affd640 1 -- 172.21.15.99:0/608980520 learned_addr learned my addr 172.21.15.99:0/608980520 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:44:30.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.602+0000 7f822b7fe640 1 --2- 172.21.15.99:0/608980520 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f822c0fd570 0x7f822c1154a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:30.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.602+0000 7f822affd640 1 -- 172.21.15.99:0/608980520 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f822c0fd570 msgr2=0x7f822c1154a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:30.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.602+0000 7f822affd640 1 --2- 172.21.15.99:0/608980520 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f822c0fd570 0x7f822c1154a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:30.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.602+0000 7f822affd640 1 -- 172.21.15.99:0/608980520 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f821c005040 con 0x7f822c0fdf10 2024-09-19T06:44:30.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.602+0000 7f822affd640 1 --2- 172.21.15.99:0/608980520 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f822c0fdf10 0x7f822c1159e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f822000eb70 tx=0x7f822000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:30.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.602+0000 7f8213fff640 1 -- 172.21.15.99:0/608980520 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8220007c30 con 0x7f822c0fdf10 2024-09-19T06:44:30.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.602+0000 7f8213fff640 1 -- 172.21.15.99:0/608980520 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f822000f040 con 0x7f822c0fdf10 2024-09-19T06:44:30.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.602+0000 7f8213fff640 1 -- 172.21.15.99:0/608980520 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f822000ca60 con 0x7f822c0fdf10 2024-09-19T06:44:30.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.602+0000 7f8232039640 1 -- 172.21.15.99:0/608980520 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f822c10f6c0 con 0x7f822c0fdf10 2024-09-19T06:44:30.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.602+0000 7f8232039640 1 -- 172.21.15.99:0/608980520 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f822c10fb90 con 0x7f822c0fdf10 2024-09-19T06:44:30.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.603+0000 7f8232039640 1 -- 172.21.15.99:0/608980520 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f822c066330 con 0x7f822c0fdf10 2024-09-19T06:44:30.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.604+0000 7f8213fff640 1 -- 172.21.15.99:0/608980520 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 40) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f822000cbc0 con 0x7f822c0fdf10 2024-09-19T06:44:30.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.604+0000 7f8213fff640 1 --2- 172.21.15.99:0/608980520 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f821406e660 0x7f8214070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:44:30.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.604+0000 7f822b7fe640 1 --2- 172.21.15.99:0/608980520 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f821406e660 0x7f8214070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:44:30.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.604+0000 7f8213fff640 1 -- 172.21.15.99:0/608980520 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f822008dfa0 con 0x7f822c0fdf10 2024-09-19T06:44:30.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.605+0000 7f822b7fe640 1 --2- 172.21.15.99:0/608980520 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f821406e660 0x7f8214070b10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f821c004540 tx=0x7f821c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:44:30.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.609+0000 7f8213fff640 1 -- 172.21.15.99:0/608980520 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f8220056fc0 con 0x7f822c0fdf10 2024-09-19T06:44:30.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.840+0000 7f8232039640 1 -- 172.21.15.99:0/608980520 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f822c0fac40 con 0x7f822c0fdf10 2024-09-19T06:44:30.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.840+0000 7f8213fff640 1 -- 172.21.15.99:0/608980520 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f822005a680 con 0x7f822c0fdf10 2024-09-19T06:44:30.842 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:30 smithi099 ceph-mon[97031]: from='client.34158 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:44:30.842 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:30 smithi099 ceph-mon[97031]: from='client.34162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:44:30.842 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:30 smithi099 ceph-mon[97031]: from='client.34166 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:44:30.842 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:30 smithi099 ceph-mon[97031]: Upgrade: Updating crash.smithi117 (2/2) 2024-09-19T06:44:30.842 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:30 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:30.842 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:30 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi117", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-19T06:44:30.843 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:30 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:30.843 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:30 smithi099 ceph-mon[97031]: Deploying daemon crash.smithi117 on smithi117 2024-09-19T06:44:30.843 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:30 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/1537884045' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:44:30.843 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:30 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/758654565' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:44:30.843 INFO:teuthology.orchestra.run.smithi099.stdout:HEALTH_OK 2024-09-19T06:44:30.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.842+0000 7f8232039640 1 -- 172.21.15.99:0/608980520 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f821406e660 msgr2=0x7f8214070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:30.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.842+0000 7f8232039640 1 --2- 172.21.15.99:0/608980520 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f821406e660 0x7f8214070b10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f821c004540 tx=0x7f821c035040 comp rx=0 tx=0).stop 2024-09-19T06:44:30.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.842+0000 7f8232039640 1 -- 172.21.15.99:0/608980520 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f822c0fdf10 msgr2=0x7f822c1159e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:44:30.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.842+0000 7f8232039640 1 --2- 172.21.15.99:0/608980520 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f822c0fdf10 0x7f822c1159e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f822000eb70 tx=0x7f822000b040 comp rx=0 tx=0).stop 2024-09-19T06:44:30.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.842+0000 7f8232039640 1 -- 172.21.15.99:0/608980520 shutdown_connections 2024-09-19T06:44:30.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.843+0000 7f8232039640 1 --2- 172.21.15.99:0/608980520 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f821406e660 0x7f8214070b10 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:30.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.843+0000 7f8232039640 1 --2- 172.21.15.99:0/608980520 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f822c0fdf10 0x7f822c1159e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:30.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.843+0000 7f8232039640 1 --2- 172.21.15.99:0/608980520 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f822c0fd570 0x7f822c1154a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:44:30.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.843+0000 7f8232039640 1 -- 172.21.15.99:0/608980520 >> 172.21.15.99:0/608980520 conn(0x7f822c0f7000 msgr2=0x7f822c0f8540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:44:30.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.843+0000 7f8232039640 1 -- 172.21.15.99:0/608980520 shutdown_connections 2024-09-19T06:44:30.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:44:30.843+0000 7f8232039640 1 -- 172.21.15.99:0/608980520 wait complete. 2024-09-19T06:44:31.000 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:30 smithi117 ceph-mon[76771]: from='client.34158 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:44:31.000 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:30 smithi117 ceph-mon[76771]: from='client.34162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:44:31.000 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:30 smithi117 ceph-mon[76771]: from='client.34166 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:44:31.001 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:30 smithi117 ceph-mon[76771]: Upgrade: Updating crash.smithi117 (2/2) 2024-09-19T06:44:31.001 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:30 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:31.001 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:30 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi117", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-19T06:44:31.001 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:30 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:31.001 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:30 smithi117 ceph-mon[76771]: Deploying daemon crash.smithi117 on smithi117 2024-09-19T06:44:31.001 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:30 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/1537884045' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:44:31.001 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:30 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/758654565' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:44:31.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:31 smithi117 ceph-mon[76771]: from='client.34178 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:44:31.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:31 smithi117 ceph-mon[76771]: pgmap v30: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:44:31.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:31 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/608980520' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T06:44:31.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:31 smithi099 ceph-mon[97031]: from='client.34178 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:44:31.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:31 smithi099 ceph-mon[97031]: pgmap v30: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:44:31.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:31 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/608980520' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T06:44:34.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:33 smithi117 ceph-mon[76771]: pgmap v31: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:44:34.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:33 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:34.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:33 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:34.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:33 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:44:34.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:33 smithi099 ceph-mon[97031]: pgmap v31: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:44:34.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:33 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:34.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:33 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:34.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:33 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:44:36.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:35 smithi099 ceph-mon[97031]: pgmap v32: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:44:36.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:35 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:36.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:35 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:36.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:35 smithi117 ceph-mon[76771]: pgmap v32: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:44:36.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:35 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:36.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:35 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:37.560 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:37 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:37.560 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:37 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:37.560 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:37 smithi099 ceph-mon[97031]: pgmap v33: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:44:37.560 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:37 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:44:37.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:37 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:37.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:37 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:37.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:37 smithi117 ceph-mon[76771]: pgmap v33: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:44:37.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:37 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:44:39.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:38 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:39.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:38 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:39.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:38 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:39.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:38 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:39.197 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:38 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:39.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:38 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:39.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:38 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:39.198 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:38 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:40.180 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:39 smithi099 ceph-mon[97031]: pgmap v34: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:44:40.180 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:39 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:40.181 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:39 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:40.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:39 smithi117 ceph-mon[76771]: pgmap v34: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:44:40.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:39 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:40.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:39 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:42.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:41 smithi099 ceph-mon[97031]: pgmap v35: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:44:42.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:41 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:42.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:41 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:42.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:41 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:42.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:41 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:44:42.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:41 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:42.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:41 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:44:42.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:41 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:44:42.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:41 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:44:42.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:41 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:44:42.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:41 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:42.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:41 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi099"}]: dispatch 2024-09-19T06:44:42.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:41 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi099"}]': finished 2024-09-19T06:44:42.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:41 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi117"}]: dispatch 2024-09-19T06:44:42.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:41 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi117"}]': finished 2024-09-19T06:44:42.208 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:41 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-19T06:44:42.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:41 smithi117 ceph-mon[76771]: pgmap v35: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:44:42.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:41 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:42.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:41 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:42.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:41 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:42.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:41 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:44:42.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:41 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:42.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:41 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:44:42.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:41 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:44:42.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:41 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:44:42.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:41 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:44:42.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:41 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:42.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:41 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi099"}]: dispatch 2024-09-19T06:44:42.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:41 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi099"}]': finished 2024-09-19T06:44:42.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:41 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi117"}]: dispatch 2024-09-19T06:44:42.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:41 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi117"}]': finished 2024-09-19T06:44:42.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:41 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-19T06:44:43.168 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:42 smithi099 ceph-mon[97031]: Upgrade: Setting container_image for all crash 2024-09-19T06:44:43.168 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:42 smithi099 ceph-mon[97031]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-19T06:44:43.168 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:42 smithi099 ceph-mon[97031]: Upgrade: osd.0 is safe to restart 2024-09-19T06:44:43.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:42 smithi117 ceph-mon[76771]: Upgrade: Setting container_image for all crash 2024-09-19T06:44:43.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:42 smithi117 ceph-mon[76771]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-19T06:44:43.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:42 smithi117 ceph-mon[76771]: Upgrade: osd.0 is safe to restart 2024-09-19T06:44:44.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:43 smithi099 ceph-mon[97031]: pgmap v36: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:44:44.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:43 smithi099 ceph-mon[97031]: Upgrade: Updating osd.0 2024-09-19T06:44:44.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:43 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:44.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:43 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T06:44:44.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:43 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:44.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:43 smithi099 ceph-mon[97031]: Deploying daemon osd.0 on smithi099 2024-09-19T06:44:44.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:43 smithi117 ceph-mon[76771]: pgmap v36: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:44:44.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:43 smithi117 ceph-mon[76771]: Upgrade: Updating osd.0 2024-09-19T06:44:44.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:43 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:44.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:43 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T06:44:44.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:43 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:44:44.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:43 smithi117 ceph-mon[76771]: Deploying daemon osd.0 on smithi099 2024-09-19T06:44:46.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:45 smithi099 ceph-mon[97031]: pgmap v37: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:44:46.207 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 06:44:45 smithi099 systemd[1]: Stopping Ceph osd.0 for a73eb958-7650-11ef-bceb-c7b262605968... 2024-09-19T06:44:46.207 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 06:44:46 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-0[46051]: 2024-09-19T06:44:46.095+0000 7ff64dbbe640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:44:46.207 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 06:44:46 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-0[46051]: 2024-09-19T06:44:46.095+0000 7ff64dbbe640 -1 osd.0 48 *** Got signal Terminated *** 2024-09-19T06:44:46.207 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 06:44:46 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-0[46051]: 2024-09-19T06:44:46.095+0000 7ff64dbbe640 -1 osd.0 48 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:44:46.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:45 smithi117 ceph-mon[76771]: pgmap v37: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:44:47.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:46 smithi117 ceph-mon[76771]: osd.0 marked itself down and dead 2024-09-19T06:44:47.363 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:46 smithi099 ceph-mon[97031]: osd.0 marked itself down and dead 2024-09-19T06:44:47.639 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 06:44:47 smithi099 podman[107305]: 2024-09-19 06:44:47.363104497 +0000 UTC m=+1.368604307 container died cf8d3dd4a98717a962fc5a4ee4f2644bb5e02825367630c76708df3fb1a5ae96 (image=quay.ceph.io/ceph-ci/ceph@sha256:4d922a456af336b23156460d93b8143eb9c977eee7e72f2e9e44c816e5b46ac8, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=quincy-6e06d1e) 2024-09-19T06:44:47.956 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 06:44:47 smithi099 podman[107305]: 2024-09-19 06:44:47.712031669 +0000 UTC m=+1.717531481 container cleanup cf8d3dd4a98717a962fc5a4ee4f2644bb5e02825367630c76708df3fb1a5ae96 (image=quay.ceph.io/ceph-ci/ceph@sha256:4d922a456af336b23156460d93b8143eb9c977eee7e72f2e9e44c816e5b46ac8, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-0, RELEASE=quincy-6e06d1e, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-19T06:44:47.956 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 06:44:47 smithi099 bash[107305]: ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-0 2024-09-19T06:44:48.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:47 smithi117 ceph-mon[76771]: pgmap v38: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:44:48.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:47 smithi117 ceph-mon[76771]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-19T06:44:48.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:47 smithi117 ceph-mon[76771]: osdmap e49: 6 total, 5 up, 6 in 2024-09-19T06:44:48.373 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:47 smithi099 ceph-mon[97031]: pgmap v38: 65 pgs: 65 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:44:48.374 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:47 smithi099 ceph-mon[97031]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-19T06:44:48.374 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:47 smithi099 ceph-mon[97031]: osdmap e49: 6 total, 5 up, 6 in 2024-09-19T06:44:48.374 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 06:44:48 smithi099 podman[107322]: 2024-09-19 06:44:48.02117377 +0000 UTC m=+0.653278255 container remove cf8d3dd4a98717a962fc5a4ee4f2644bb5e02825367630c76708df3fb1a5ae96 (image=quay.ceph.io/ceph-ci/ceph@sha256:4d922a456af336b23156460d93b8143eb9c977eee7e72f2e9e44c816e5b46ac8, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=quincy-6e06d1e, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-19T06:44:48.659 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 06:44:48 smithi099 podman[107411]: 2024-09-19 06:44:48.373236954 +0000 UTC m=+0.107248244 container create 5aa4ed333331e9a98d1f744a44f5925c0610a3c416571c1d79be89838d442722 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-19T06:44:48.660 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 06:44:48 smithi099 podman[107411]: 2024-09-19 06:44:48.281911472 +0000 UTC m=+0.015922707 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:44:48.660 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 06:44:48 smithi099 podman[107411]: 2024-09-19 06:44:48.617660364 +0000 UTC m=+0.351671595 container init 5aa4ed333331e9a98d1f744a44f5925c0610a3c416571c1d79be89838d442722 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0) 2024-09-19T06:44:48.660 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 06:44:48 smithi099 podman[107411]: 2024-09-19 06:44:48.621323597 +0000 UTC m=+0.355334824 container start 5aa4ed333331e9a98d1f744a44f5925c0610a3c416571c1d79be89838d442722 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-19T06:44:48.956 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 06:44:48 smithi099 podman[107411]: 2024-09-19 06:44:48.69665249 +0000 UTC m=+0.430663726 container attach 5aa4ed333331e9a98d1f744a44f5925c0610a3c416571c1d79be89838d442722 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4) 2024-09-19T06:44:48.956 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 06:44:48 smithi099 podman[107411]: 2024-09-19 06:44:48.810142082 +0000 UTC m=+0.544153314 container died 5aa4ed333331e9a98d1f744a44f5925c0610a3c416571c1d79be89838d442722 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-19T06:44:49.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:48 smithi117 ceph-mon[76771]: osdmap e50: 6 total, 5 up, 6 in 2024-09-19T06:44:49.380 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:48 smithi099 ceph-mon[97031]: osdmap e50: 6 total, 5 up, 6 in 2024-09-19T06:44:49.706 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 06:44:49 smithi099 podman[107434]: 2024-09-19 06:44:49.379814311 +0000 UTC m=+0.557941898 container remove 5aa4ed333331e9a98d1f744a44f5925c0610a3c416571c1d79be89838d442722 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:44:49.707 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 06:44:49 smithi099 systemd[1]: ceph-a73eb958-7650-11ef-bceb-c7b262605968@osd.0.service: Deactivated successfully. 2024-09-19T06:44:49.707 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 06:44:49 smithi099 systemd[1]: Stopped Ceph osd.0 for a73eb958-7650-11ef-bceb-c7b262605968. 2024-09-19T06:44:49.707 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 06:44:49 smithi099 systemd[1]: ceph-a73eb958-7650-11ef-bceb-c7b262605968@osd.0.service: Consumed 58.157s CPU time. 2024-09-19T06:44:49.707 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 06:44:49 smithi099 systemd[1]: Starting Ceph osd.0 for a73eb958-7650-11ef-bceb-c7b262605968... 2024-09-19T06:44:50.126 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:49 smithi099 ceph-mon[97031]: pgmap v41: 65 pgs: 34 peering, 31 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:44:50.126 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:49 smithi099 ceph-mon[97031]: Health check failed: Reduced data availability: 34 pgs peering (PG_AVAILABILITY) 2024-09-19T06:44:50.127 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 06:44:49 smithi099 podman[107534]: 2024-09-19 06:44:49.814784627 +0000 UTC m=+0.104146794 container create 4c3d6c1767edf4ce3ffc45a5aa5f31d1ea38c65db200e2cc123246e79ad96cce (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-0-activate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-19T06:44:50.127 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 06:44:49 smithi099 podman[107534]: 2024-09-19 06:44:49.726766697 +0000 UTC m=+0.016128863 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:44:50.127 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 06:44:50 smithi099 podman[107534]: 2024-09-19 06:44:50.025472758 +0000 UTC m=+0.314834931 container init 4c3d6c1767edf4ce3ffc45a5aa5f31d1ea38c65db200e2cc123246e79ad96cce (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-0-activate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-19T06:44:50.127 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 06:44:50 smithi099 podman[107534]: 2024-09-19 06:44:50.029099532 +0000 UTC m=+0.318461712 container start 4c3d6c1767edf4ce3ffc45a5aa5f31d1ea38c65db200e2cc123246e79ad96cce (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-0-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-19T06:44:50.127 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 06:44:50 smithi099 podman[107534]: 2024-09-19 06:44:50.125837687 +0000 UTC m=+0.415201553 container attach 4c3d6c1767edf4ce3ffc45a5aa5f31d1ea38c65db200e2cc123246e79ad96cce (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-0-activate, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-19T06:44:50.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:49 smithi117 ceph-mon[76771]: pgmap v41: 65 pgs: 34 peering, 31 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:44:50.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:49 smithi117 ceph-mon[76771]: Health check failed: Reduced data availability: 34 pgs peering (PG_AVAILABILITY) 2024-09-19T06:44:50.456 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 06:44:50 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-0-activate[107549]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T06:44:50.456 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 06:44:50 smithi099 bash[107534]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T06:44:50.456 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 06:44:50 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-0-activate[107549]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T06:44:50.456 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 06:44:50 smithi099 bash[107534]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T06:44:51.180 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 06:44:50 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-0-activate[107549]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-19T06:44:51.181 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 06:44:50 smithi099 bash[107534]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-19T06:44:51.181 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 06:44:50 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-0-activate[107549]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-19T06:44:51.181 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 06:44:50 smithi099 bash[107534]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-19T06:44:51.456 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 06:44:51 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-0-activate[107549]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-19T06:44:51.457 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 06:44:51 smithi099 bash[107534]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-19T06:44:51.457 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 06:44:51 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-0-activate[107549]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-19T06:44:51.457 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 06:44:51 smithi099 bash[107534]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-19T06:44:51.457 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 06:44:51 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-0-activate[107549]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-19T06:44:51.457 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 06:44:51 smithi099 bash[107534]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-19T06:44:51.457 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 06:44:51 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-0-activate[107549]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-19T06:44:51.457 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 06:44:51 smithi099 bash[107534]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-19T06:44:51.457 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 06:44:51 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-0-activate[107549]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-19T06:44:51.457 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 06:44:51 smithi099 bash[107534]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-19T06:44:51.457 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 06:44:51 smithi099 podman[107534]: 2024-09-19 06:44:51.208409283 +0000 UTC m=+1.497771451 container died 4c3d6c1767edf4ce3ffc45a5aa5f31d1ea38c65db200e2cc123246e79ad96cce (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-0-activate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-19T06:44:52.094 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:51 smithi099 ceph-mon[97031]: pgmap v42: 65 pgs: 34 peering, 31 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:44:52.094 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:51 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:52.094 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:51 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:44:52.095 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 06:44:51 smithi099 podman[107683]: 2024-09-19 06:44:51.771187032 +0000 UTC m=+0.557192976 container remove 4c3d6c1767edf4ce3ffc45a5aa5f31d1ea38c65db200e2cc123246e79ad96cce (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-0-activate, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-19T06:44:52.095 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 06:44:51 smithi099 podman[107741]: 2024-09-19 06:44:51.881089451 +0000 UTC m=+0.016477129 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:44:52.095 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 06:44:51 smithi099 podman[107741]: 2024-09-19 06:44:51.980870113 +0000 UTC m=+0.116257826 container create 8e22543bf93312497d3d51ea5c56f9399f85cf8cf6b6f170156c5a047a2ff005 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-0, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-19T06:44:52.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:51 smithi117 ceph-mon[76771]: pgmap v42: 65 pgs: 34 peering, 31 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:44:52.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:51 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:52.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:51 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:44:52.706 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 06:44:52 smithi099 podman[107741]: 2024-09-19 06:44:52.208403546 +0000 UTC m=+0.343791232 container init 8e22543bf93312497d3d51ea5c56f9399f85cf8cf6b6f170156c5a047a2ff005 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True) 2024-09-19T06:44:52.706 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 06:44:52 smithi099 podman[107741]: 2024-09-19 06:44:52.211587426 +0000 UTC m=+0.346975095 container start 8e22543bf93312497d3d51ea5c56f9399f85cf8cf6b6f170156c5a047a2ff005 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, ceph=True, GIT_BRANCH=HEAD) 2024-09-19T06:44:52.706 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 06:44:52 smithi099 ceph-osd[107760]: -- 172.21.15.99:0/4251683104 <== mon.0 v2:172.21.15.99:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5648fcd941e0 con 0x5648fbfa9c00 2024-09-19T06:44:52.706 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 06:44:52 smithi099 bash[107741]: 8e22543bf93312497d3d51ea5c56f9399f85cf8cf6b6f170156c5a047a2ff005 2024-09-19T06:44:52.706 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 06:44:52 smithi099 systemd[1]: Started Ceph osd.0 for a73eb958-7650-11ef-bceb-c7b262605968. 2024-09-19T06:44:53.682 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:53 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:53.682 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:53 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:53.682 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:53 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:44:53.682 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:53 smithi099 ceph-mon[97031]: pgmap v43: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 63/321 objects degraded (19.626%) 2024-09-19T06:44:53.811 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:53 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:53.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:53 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:53.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:53 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:44:53.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:53 smithi117 ceph-mon[76771]: pgmap v43: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 63/321 objects degraded (19.626%) 2024-09-19T06:44:54.206 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 06:44:54 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-0[107756]: 2024-09-19T06:44:54.106+0000 7fd82fbfe640 -1 Falling back to public interface 2024-09-19T06:44:54.640 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:54 smithi099 ceph-mon[97031]: Health check failed: Degraded data redundancy: 63/321 objects degraded (19.626%), 19 pgs degraded (PG_DEGRADED) 2024-09-19T06:44:54.640 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:54 smithi099 ceph-mon[97031]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 34 pgs peering) 2024-09-19T06:44:54.811 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:54 smithi117 ceph-mon[76771]: Health check failed: Degraded data redundancy: 63/321 objects degraded (19.626%), 19 pgs degraded (PG_DEGRADED) 2024-09-19T06:44:54.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:54 smithi117 ceph-mon[76771]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 34 pgs peering) 2024-09-19T06:44:55.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:55 smithi099 ceph-mon[97031]: pgmap v44: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 63/321 objects degraded (19.626%) 2024-09-19T06:44:55.811 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:55 smithi117 ceph-mon[76771]: pgmap v44: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 63/321 objects degraded (19.626%) 2024-09-19T06:44:58.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:57 smithi099 ceph-mon[97031]: pgmap v45: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 63/321 objects degraded (19.626%) 2024-09-19T06:44:58.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:57 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:58.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:57 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:58.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:57 smithi117 ceph-mon[76771]: pgmap v45: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 63/321 objects degraded (19.626%) 2024-09-19T06:44:58.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:57 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:58.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:57 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:59.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:59 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:59.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:59 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:59.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:44:59 smithi117 ceph-mon[76771]: pgmap v46: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 63/321 objects degraded (19.626%) 2024-09-19T06:44:59.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:59 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:59.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:59 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:44:59.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:44:59 smithi099 ceph-mon[97031]: pgmap v46: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 254 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 63/321 objects degraded (19.626%) 2024-09-19T06:45:00.011 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 06:44:59 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-0[107756]: 2024-09-19T06:44:59.720+0000 7fd82fbfe640 -1 osd.0 48 log_to_monitors true 2024-09-19T06:45:00.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:00 smithi117 ceph-mon[76771]: from='osd.0 [v2:172.21.15.99:6802/3391765331,v1:172.21.15.99:6803/3391765331]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T06:45:00.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:00 smithi099 ceph-mon[97031]: from='osd.0 [v2:172.21.15.99:6802/3391765331,v1:172.21.15.99:6803/3391765331]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T06:45:00.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:00.941+0000 7fa5ce03f640 1 -- 172.21.15.99:0/606719791 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5c80fcf80 msgr2=0x7fa5c80fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:00.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:00.941+0000 7fa5ce03f640 1 --2- 172.21.15.99:0/606719791 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5c80fcf80 0x7fa5c80fd3d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa5b00048d0 tx=0x7fa5b0009da0 comp rx=0 tx=0).stop 2024-09-19T06:45:00.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:00.941+0000 7fa5ce03f640 1 -- 172.21.15.99:0/606719791 shutdown_connections 2024-09-19T06:45:00.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:00.941+0000 7fa5ce03f640 1 --2- 172.21.15.99:0/606719791 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5c80fcf80 0x7fa5c80fd3d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:00.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:00.941+0000 7fa5ce03f640 1 --2- 172.21.15.99:0/606719791 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5c80fb810 0x7fa5c80fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:00.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:00.941+0000 7fa5ce03f640 1 -- 172.21.15.99:0/606719791 >> 172.21.15.99:0/606719791 conn(0x7fa5c80723b0 msgr2=0x7fa5c80727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:00.944 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 06:45:00 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-0[107756]: 2024-09-19T06:45:00.909+0000 7fd823990640 -1 osd.0 48 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:45:00.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:00.942+0000 7fa5ce03f640 1 -- 172.21.15.99:0/606719791 shutdown_connections 2024-09-19T06:45:00.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:00.942+0000 7fa5ce03f640 1 -- 172.21.15.99:0/606719791 wait complete. 2024-09-19T06:45:00.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:00.942+0000 7fa5ce03f640 1 Processor -- start 2024-09-19T06:45:00.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:00.943+0000 7fa5ce03f640 1 -- start start 2024-09-19T06:45:00.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:00.943+0000 7fa5ce03f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5c80fb810 0x7fa5c8113260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:00.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:00.943+0000 7fa5ce03f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5c80fcf80 0x7fa5c81137a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:00.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:00.943+0000 7fa5ce03f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c8113e30 con 0x7fa5c80fb810 2024-09-19T06:45:00.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:00.943+0000 7fa5ce03f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c810d1e0 con 0x7fa5c80fcf80 2024-09-19T06:45:00.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:00.943+0000 7fa5c77fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5c80fb810 0x7fa5c8113260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:00.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:00.943+0000 7fa5c77fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5c80fb810 0x7fa5c8113260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60528/0 (socket says 172.21.15.99:60528) 2024-09-19T06:45:00.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:00.943+0000 7fa5c77fe640 1 -- 172.21.15.99:0/821695130 learned_addr learned my addr 172.21.15.99:0/821695130 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:45:00.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:00.943+0000 7fa5c6ffd640 1 --2- 172.21.15.99:0/821695130 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5c80fcf80 0x7fa5c81137a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:00.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:00.943+0000 7fa5c77fe640 1 -- 172.21.15.99:0/821695130 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5c80fcf80 msgr2=0x7fa5c81137a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:00.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:00.943+0000 7fa5c77fe640 1 --2- 172.21.15.99:0/821695130 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5c80fcf80 0x7fa5c81137a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:00.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:00.943+0000 7fa5c77fe640 1 -- 172.21.15.99:0/821695130 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b0005040 con 0x7fa5c80fb810 2024-09-19T06:45:00.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:00.944+0000 7fa5c77fe640 1 --2- 172.21.15.99:0/821695130 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5c80fb810 0x7fa5c8113260 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa5b800bbb0 tx=0x7fa5b8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:00.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:00.944+0000 7fa5bffff640 1 -- 172.21.15.99:0/821695130 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5b800c940 con 0x7fa5c80fb810 2024-09-19T06:45:00.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:00.944+0000 7fa5bffff640 1 -- 172.21.15.99:0/821695130 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa5b80092e0 con 0x7fa5c80fb810 2024-09-19T06:45:00.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:00.944+0000 7fa5ce03f640 1 -- 172.21.15.99:0/821695130 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5c810d4c0 con 0x7fa5c80fb810 2024-09-19T06:45:00.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:00.944+0000 7fa5bffff640 1 -- 172.21.15.99:0/821695130 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5b8007640 con 0x7fa5c80fb810 2024-09-19T06:45:00.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:00.944+0000 7fa5ce03f640 1 -- 172.21.15.99:0/821695130 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5c810d9b0 con 0x7fa5c80fb810 2024-09-19T06:45:00.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:00.945+0000 7fa5ce03f640 1 -- 172.21.15.99:0/821695130 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5c80fcbc0 con 0x7fa5c80fb810 2024-09-19T06:45:00.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:00.946+0000 7fa5bffff640 1 -- 172.21.15.99:0/821695130 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 40) v1 ==== 92653+0+0 (secure 0 0 0) 0x7fa5b8012070 con 0x7fa5c80fb810 2024-09-19T06:45:00.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:00.946+0000 7fa5bffff640 1 --2- 172.21.15.99:0/821695130 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa5b406e660 0x7fa5b4070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:00.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:00.946+0000 7fa5bffff640 1 -- 172.21.15.99:0/821695130 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fa5b808e0a0 con 0x7fa5c80fb810 2024-09-19T06:45:00.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:00.946+0000 7fa5c6ffd640 1 --2- 172.21.15.99:0/821695130 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa5b406e660 0x7fa5b4070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:00.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:00.947+0000 7fa5c6ffd640 1 --2- 172.21.15.99:0/821695130 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa5b406e660 0x7fa5b4070b10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa5b0009ac0 tx=0x7fa5b0035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:00.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:00.951+0000 7fa5bffff640 1 -- 172.21.15.99:0/821695130 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fa5b80571a0 con 0x7fa5c80fb810 2024-09-19T06:45:01.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.150+0000 7fa5ce03f640 1 -- 172.21.15.99:0/821695130 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa5c804b720 con 0x7fa5b406e660 2024-09-19T06:45:01.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.151+0000 7fa5bffff640 1 -- 172.21.15.99:0/821695130 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fa5c804b720 con 0x7fa5b406e660 2024-09-19T06:45:01.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.153+0000 7fa5ce03f640 1 -- 172.21.15.99:0/821695130 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa5b406e660 msgr2=0x7fa5b4070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:01.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.153+0000 7fa5ce03f640 1 --2- 172.21.15.99:0/821695130 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa5b406e660 0x7fa5b4070b10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa5b0009ac0 tx=0x7fa5b0035040 comp rx=0 tx=0).stop 2024-09-19T06:45:01.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.153+0000 7fa5ce03f640 1 -- 172.21.15.99:0/821695130 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5c80fb810 msgr2=0x7fa5c8113260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:01.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.153+0000 7fa5ce03f640 1 --2- 172.21.15.99:0/821695130 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5c80fb810 0x7fa5c8113260 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa5b800bbb0 tx=0x7fa5b8009840 comp rx=0 tx=0).stop 2024-09-19T06:45:01.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.153+0000 7fa5ce03f640 1 -- 172.21.15.99:0/821695130 shutdown_connections 2024-09-19T06:45:01.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.153+0000 7fa5ce03f640 1 --2- 172.21.15.99:0/821695130 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa5b406e660 0x7fa5b4070b10 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:01.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.153+0000 7fa5ce03f640 1 --2- 172.21.15.99:0/821695130 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa5c80fcf80 0x7fa5c81137a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:01.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.153+0000 7fa5ce03f640 1 --2- 172.21.15.99:0/821695130 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5c80fb810 0x7fa5c8113260 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:01.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.153+0000 7fa5ce03f640 1 -- 172.21.15.99:0/821695130 >> 172.21.15.99:0/821695130 conn(0x7fa5c80723b0 msgr2=0x7fa5c8064f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:01.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.153+0000 7fa5ce03f640 1 -- 172.21.15.99:0/821695130 shutdown_connections 2024-09-19T06:45:01.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.153+0000 7fa5ce03f640 1 -- 172.21.15.99:0/821695130 wait complete. 2024-09-19T06:45:01.164 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-09-19T06:45:01.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:01 smithi099 ceph-mon[97031]: from='osd.0 [v2:172.21.15.99:6802/3391765331,v1:172.21.15.99:6803/3391765331]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T06:45:01.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:01 smithi099 ceph-mon[97031]: osdmap e51: 6 total, 5 up, 6 in 2024-09-19T06:45:01.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:01 smithi099 ceph-mon[97031]: from='osd.0 [v2:172.21.15.99:6802/3391765331,v1:172.21.15.99:6803/3391765331]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-19T06:45:01.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:01 smithi099 ceph-mon[97031]: pgmap v48: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 63/321 objects degraded (19.626%) 2024-09-19T06:45:01.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:01 smithi099 ceph-mon[97031]: from='osd.0 [v2:172.21.15.99:6802/3391765331,v1:172.21.15.99:6803/3391765331]' entity='osd.0' 2024-09-19T06:45:01.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.237+0000 7f4282a50640 1 -- 172.21.15.99:0/2944789009 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f427c0703c0 msgr2=0x7f427c108890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:01.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.237+0000 7f4282a50640 1 --2- 172.21.15.99:0/2944789009 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f427c0703c0 0x7f427c108890 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f42700048d0 tx=0x7f4270009da0 comp rx=0 tx=0).stop 2024-09-19T06:45:01.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.237+0000 7f4282a50640 1 -- 172.21.15.99:0/2944789009 shutdown_connections 2024-09-19T06:45:01.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.237+0000 7f4282a50640 1 --2- 172.21.15.99:0/2944789009 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f427c0703c0 0x7f427c108890 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:01.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.237+0000 7f4282a50640 1 --2- 172.21.15.99:0/2944789009 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f427c06fab0 0x7f427c06fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:01.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.237+0000 7f4282a50640 1 -- 172.21.15.99:0/2944789009 >> 172.21.15.99:0/2944789009 conn(0x7f427c0f80d0 msgr2=0x7f427c0fa4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:01.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.237+0000 7f4282a50640 1 -- 172.21.15.99:0/2944789009 shutdown_connections 2024-09-19T06:45:01.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.237+0000 7f4282a50640 1 -- 172.21.15.99:0/2944789009 wait complete. 2024-09-19T06:45:01.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.237+0000 7f4282a50640 1 Processor -- start 2024-09-19T06:45:01.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.238+0000 7f4282a50640 1 -- start start 2024-09-19T06:45:01.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.238+0000 7f4282a50640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f427c06fab0 0x7f427c115400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:01.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.238+0000 7f4282a50640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f427c0703c0 0x7f427c115940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:01.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.238+0000 7f4282a50640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f427c115f40 con 0x7f427c06fab0 2024-09-19T06:45:01.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.238+0000 7f4282a50640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f427c1160b0 con 0x7f427c0703c0 2024-09-19T06:45:01.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.238+0000 7f427bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f427c06fab0 0x7f427c115400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:01.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.238+0000 7f427bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f427c06fab0 0x7f427c115400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60550/0 (socket says 172.21.15.99:60550) 2024-09-19T06:45:01.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.238+0000 7f427bfff640 1 -- 172.21.15.99:0/3452633531 learned_addr learned my addr 172.21.15.99:0/3452633531 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:45:01.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.238+0000 7f427b7fe640 1 --2- 172.21.15.99:0/3452633531 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f427c0703c0 0x7f427c115940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:01.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.238+0000 7f427bfff640 1 -- 172.21.15.99:0/3452633531 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f427c0703c0 msgr2=0x7f427c115940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:01.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.238+0000 7f427bfff640 1 --2- 172.21.15.99:0/3452633531 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f427c0703c0 0x7f427c115940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:01.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.238+0000 7f427bfff640 1 -- 172.21.15.99:0/3452633531 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4270005040 con 0x7f427c06fab0 2024-09-19T06:45:01.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.238+0000 7f427bfff640 1 --2- 172.21.15.99:0/3452633531 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f427c06fab0 0x7f427c115400 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f426c00c790 tx=0x7f426c0043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:01.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.239+0000 7f4278ff9640 1 -- 172.21.15.99:0/3452633531 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f426c00a7a0 con 0x7f427c06fab0 2024-09-19T06:45:01.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.239+0000 7f4282a50640 1 -- 172.21.15.99:0/3452633531 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f427c10f530 con 0x7f427c06fab0 2024-09-19T06:45:01.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.239+0000 7f4278ff9640 1 -- 172.21.15.99:0/3452633531 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f426c00ada0 con 0x7f427c06fab0 2024-09-19T06:45:01.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.239+0000 7f4278ff9640 1 -- 172.21.15.99:0/3452633531 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f426c0113a0 con 0x7f427c06fab0 2024-09-19T06:45:01.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.239+0000 7f4282a50640 1 -- 172.21.15.99:0/3452633531 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f427c10fa50 con 0x7f427c06fab0 2024-09-19T06:45:01.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.240+0000 7f4282a50640 1 -- 172.21.15.99:0/3452633531 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f427c0711f0 con 0x7f427c06fab0 2024-09-19T06:45:01.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.240+0000 7f4278ff9640 1 -- 172.21.15.99:0/3452633531 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 40) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f426c00a900 con 0x7f427c06fab0 2024-09-19T06:45:01.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.241+0000 7f4278ff9640 1 --2- 172.21.15.99:0/3452633531 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f426406e660 0x7f4264070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:01.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.241+0000 7f4278ff9640 1 -- 172.21.15.99:0/3452633531 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f426c08e400 con 0x7f427c06fab0 2024-09-19T06:45:01.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.241+0000 7f427b7fe640 1 --2- 172.21.15.99:0/3452633531 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f426406e660 0x7f4264070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:01.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.241+0000 7f427b7fe640 1 --2- 172.21.15.99:0/3452633531 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f426406e660 0x7f4264070b10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4270009ac0 tx=0x7f4270009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:01.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.245+0000 7f4278ff9640 1 -- 172.21.15.99:0/3452633531 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f426c05b030 con 0x7f427c06fab0 2024-09-19T06:45:01.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.465+0000 7f4282a50640 1 -- 172.21.15.99:0/3452633531 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f427c110ab0 con 0x7f426406e660 2024-09-19T06:45:01.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.466+0000 7f4278ff9640 1 -- 172.21.15.99:0/3452633531 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f427c110ab0 con 0x7f426406e660 2024-09-19T06:45:01.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.468+0000 7f4282a50640 1 -- 172.21.15.99:0/3452633531 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f426406e660 msgr2=0x7f4264070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:01.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.468+0000 7f4282a50640 1 --2- 172.21.15.99:0/3452633531 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f426406e660 0x7f4264070b10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4270009ac0 tx=0x7f4270009da0 comp rx=0 tx=0).stop 2024-09-19T06:45:01.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.468+0000 7f4282a50640 1 -- 172.21.15.99:0/3452633531 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f427c06fab0 msgr2=0x7f427c115400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:01.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.468+0000 7f4282a50640 1 --2- 172.21.15.99:0/3452633531 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f427c06fab0 0x7f427c115400 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f426c00c790 tx=0x7f426c0043c0 comp rx=0 tx=0).stop 2024-09-19T06:45:01.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.468+0000 7f4282a50640 1 -- 172.21.15.99:0/3452633531 shutdown_connections 2024-09-19T06:45:01.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.468+0000 7f4282a50640 1 --2- 172.21.15.99:0/3452633531 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f426406e660 0x7f4264070b10 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:01.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.468+0000 7f4282a50640 1 --2- 172.21.15.99:0/3452633531 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f427c0703c0 0x7f427c115940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:01.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.468+0000 7f4282a50640 1 --2- 172.21.15.99:0/3452633531 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f427c06fab0 0x7f427c115400 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:01.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.468+0000 7f4282a50640 1 -- 172.21.15.99:0/3452633531 >> 172.21.15.99:0/3452633531 conn(0x7f427c0f80d0 msgr2=0x7f427c0f96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:01.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.468+0000 7f4282a50640 1 -- 172.21.15.99:0/3452633531 shutdown_connections 2024-09-19T06:45:01.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.468+0000 7f4282a50640 1 -- 172.21.15.99:0/3452633531 wait complete. 2024-09-19T06:45:01.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.549+0000 7f81f5e8a640 1 -- 172.21.15.99:0/2383973578 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f81f0064fe0 msgr2=0x7f81f0065430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:01.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.549+0000 7f81f5e8a640 1 --2- 172.21.15.99:0/2383973578 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f81f0064fe0 0x7f81f0065430 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f81e00048d0 tx=0x7f81e0009da0 comp rx=0 tx=0).stop 2024-09-19T06:45:01.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.549+0000 7f81f5e8a640 1 -- 172.21.15.99:0/2383973578 shutdown_connections 2024-09-19T06:45:01.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.549+0000 7f81f5e8a640 1 --2- 172.21.15.99:0/2383973578 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f81f0064fe0 0x7f81f0065430 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:01.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.549+0000 7f81f5e8a640 1 --2- 172.21.15.99:0/2383973578 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81f00fe450 0x7f81f00fe820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:01.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.549+0000 7f81f5e8a640 1 -- 172.21.15.99:0/2383973578 >> 172.21.15.99:0/2383973578 conn(0x7f81f00723b0 msgr2=0x7f81f00727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:01.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.550+0000 7f81f5e8a640 1 -- 172.21.15.99:0/2383973578 shutdown_connections 2024-09-19T06:45:01.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.550+0000 7f81f5e8a640 1 -- 172.21.15.99:0/2383973578 wait complete. 2024-09-19T06:45:01.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.550+0000 7f81f5e8a640 1 Processor -- start 2024-09-19T06:45:01.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.550+0000 7f81f5e8a640 1 -- start start 2024-09-19T06:45:01.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.550+0000 7f81f5e8a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f81f0064fe0 0x7f81f01131b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:01.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.550+0000 7f81f5e8a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81f00fe450 0x7f81f01136f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:01.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.550+0000 7f81f5e8a640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f0113cf0 con 0x7f81f0064fe0 2024-09-19T06:45:01.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.550+0000 7f81f5e8a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f010d130 con 0x7f81f00fe450 2024-09-19T06:45:01.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.551+0000 7f81ef7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f81f0064fe0 0x7f81f01131b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:01.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.551+0000 7f81ef7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f81f0064fe0 0x7f81f01131b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60576/0 (socket says 172.21.15.99:60576) 2024-09-19T06:45:01.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.551+0000 7f81ef7fe640 1 -- 172.21.15.99:0/3189644280 learned_addr learned my addr 172.21.15.99:0/3189644280 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:45:01.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.551+0000 7f81eeffd640 1 --2- 172.21.15.99:0/3189644280 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81f00fe450 0x7f81f01136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:01.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.551+0000 7f81ef7fe640 1 -- 172.21.15.99:0/3189644280 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81f00fe450 msgr2=0x7f81f01136f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:01.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.551+0000 7f81ef7fe640 1 --2- 172.21.15.99:0/3189644280 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81f00fe450 0x7f81f01136f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:01.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.551+0000 7f81ef7fe640 1 -- 172.21.15.99:0/3189644280 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e0005040 con 0x7f81f0064fe0 2024-09-19T06:45:01.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.551+0000 7f81ef7fe640 1 --2- 172.21.15.99:0/3189644280 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f81f0064fe0 0x7f81f01131b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f81d800c830 tx=0x7f81d8004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:01.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.551+0000 7f81e7fff640 1 -- 172.21.15.99:0/3189644280 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81d800a7d0 con 0x7f81f0064fe0 2024-09-19T06:45:01.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.551+0000 7f81f5e8a640 1 -- 172.21.15.99:0/3189644280 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81f010d410 con 0x7f81f0064fe0 2024-09-19T06:45:01.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.551+0000 7f81e7fff640 1 -- 172.21.15.99:0/3189644280 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f81d800add0 con 0x7f81f0064fe0 2024-09-19T06:45:01.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.552+0000 7f81e7fff640 1 -- 172.21.15.99:0/3189644280 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81d80113a0 con 0x7f81f0064fe0 2024-09-19T06:45:01.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.552+0000 7f81f5e8a640 1 -- 172.21.15.99:0/3189644280 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81f010d980 con 0x7f81f0064fe0 2024-09-19T06:45:01.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.553+0000 7f81f5e8a640 1 -- 172.21.15.99:0/3189644280 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81f00fdce0 con 0x7f81f0064fe0 2024-09-19T06:45:01.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.553+0000 7f81e7fff640 1 -- 172.21.15.99:0/3189644280 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 40) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f81d8012400 con 0x7f81f0064fe0 2024-09-19T06:45:01.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.554+0000 7f81e7fff640 1 --2- 172.21.15.99:0/3189644280 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f81dc06e660 0x7f81dc070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:01.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.554+0000 7f81e7fff640 1 -- 172.21.15.99:0/3189644280 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f81d808e350 con 0x7f81f0064fe0 2024-09-19T06:45:01.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.554+0000 7f81eeffd640 1 --2- 172.21.15.99:0/3189644280 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f81dc06e660 0x7f81dc070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:01.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.554+0000 7f81eeffd640 1 --2- 172.21.15.99:0/3189644280 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f81dc06e660 0x7f81dc070b10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f81e0009ac0 tx=0x7f81e0035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:01.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.558+0000 7f81e7fff640 1 -- 172.21.15.99:0/3189644280 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f81d8057450 con 0x7f81f0064fe0 2024-09-19T06:45:01.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:01 smithi117 ceph-mon[76771]: from='osd.0 [v2:172.21.15.99:6802/3391765331,v1:172.21.15.99:6803/3391765331]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T06:45:01.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:01 smithi117 ceph-mon[76771]: osdmap e51: 6 total, 5 up, 6 in 2024-09-19T06:45:01.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:01 smithi117 ceph-mon[76771]: from='osd.0 [v2:172.21.15.99:6802/3391765331,v1:172.21.15.99:6803/3391765331]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-19T06:45:01.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:01 smithi117 ceph-mon[76771]: pgmap v48: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 63/321 objects degraded (19.626%) 2024-09-19T06:45:01.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:01 smithi117 ceph-mon[76771]: from='osd.0 [v2:172.21.15.99:6802/3391765331,v1:172.21.15.99:6803/3391765331]' entity='osd.0' 2024-09-19T06:45:01.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.738+0000 7f81f5e8a640 1 -- 172.21.15.99:0/3189644280 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f81f004b720 con 0x7f81dc06e660 2024-09-19T06:45:01.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.754+0000 7f81e7fff640 1 -- 172.21.15.99:0/3189644280 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f81f004b720 con 0x7f81dc06e660 2024-09-19T06:45:01.755 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T06:45:01.755 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.smithi099 smithi099 *:9093,9094 running (4m) 4s ago 12m 24.9M - 0.25.0 c8568f914cd2 e7c1774d56b0 2024-09-19T06:45:01.755 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi099 smithi099 running (33s) 4s ago 12m 6899k - 19.1.1-361-g2f599a46 d2baa855c067 b9775f416b10 2024-09-19T06:45:01.755 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi117 smithi117 running (29s) 26s ago 11m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 38cf60c0d548 2024-09-19T06:45:01.756 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.smithi099 smithi099 *:3000 running (2m) 4s ago 12m 75.1M - 9.4.12 2bacad6d85d8 cd53a18d5410 2024-09-19T06:45:01.756 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.obarqf smithi099 running (7m) 4s ago 7m 13.8M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 e36c9b74004b 2024-09-19T06:45:01.756 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.xehbxe smithi099 running (7m) 4s ago 7m 121M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 d09eb3d306ae 2024-09-19T06:45:01.756 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.bheqzh smithi117 running (7m) 26s ago 7m 15.4M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 21253e27fdd3 2024-09-19T06:45:01.756 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.nooexo smithi117 running (7m) 26s ago 7m 109M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 ad1faeb3343c 2024-09-19T06:45:01.756 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi099.pgvkqi smithi099 *:8443,9283,8765 running (3m) 4s ago 13m 494M - 19.1.1-361-g2f599a46 d2baa855c067 d5de99cb7e78 2024-09-19T06:45:01.756 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi117.ssmkcf smithi117 *:8443,9283,8765 running (2m) 26s ago 11m 441M - 19.1.1-361-g2f599a46 d2baa855c067 8b7ee0f871f5 2024-09-19T06:45:01.756 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi099 smithi099 running (91s) 4s ago 13m 44.9M 2048M 19.1.1-361-g2f599a46 d2baa855c067 ffe067438824 2024-09-19T06:45:01.756 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi117 smithi117 running (69s) 26s ago 11m 33.3M 2048M 19.1.1-361-g2f599a46 d2baa855c067 4cb7455e3ee7 2024-09-19T06:45:01.756 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi099 smithi099 *:9100 running (4m) 4s ago 12m 15.0M - 1.5.0 0da6a335fe13 dca7b4517dcc 2024-09-19T06:45:01.756 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi117 smithi117 *:9100 running (3m) 26s ago 11m 16.0M - 1.5.0 0da6a335fe13 8233ce3835d2 2024-09-19T06:45:01.756 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (9s) 4s ago 10m 14.2M 1557M 19.1.1-361-g2f599a46 d2baa855c067 8e22543bf933 2024-09-19T06:45:01.756 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (10m) 4s ago 10m 238M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 bc5b04b8bf9f 2024-09-19T06:45:01.757 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (9m) 4s ago 9m 201M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 cedc7e3698d8 2024-09-19T06:45:01.757 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi117 running (9m) 26s ago 9m 261M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 5984ed999c91 2024-09-19T06:45:01.757 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi117 running (9m) 26s ago 9m 232M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 6a2fc0c51c05 2024-09-19T06:45:01.757 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi117 running (8m) 26s ago 8m 226M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 39dcb7dbf0e3 2024-09-19T06:45:01.757 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.smithi099 smithi099 *:9095 running (2m) 4s ago 12m 63.0M - 2.43.0 a07b618ecd1d 15ad26ec6fb4 2024-09-19T06:45:01.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.756+0000 7f81f5e8a640 1 -- 172.21.15.99:0/3189644280 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f81dc06e660 msgr2=0x7f81dc070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:01.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.756+0000 7f81f5e8a640 1 --2- 172.21.15.99:0/3189644280 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f81dc06e660 0x7f81dc070b10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f81e0009ac0 tx=0x7f81e0035040 comp rx=0 tx=0).stop 2024-09-19T06:45:01.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.756+0000 7f81f5e8a640 1 -- 172.21.15.99:0/3189644280 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f81f0064fe0 msgr2=0x7f81f01131b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:01.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.756+0000 7f81f5e8a640 1 --2- 172.21.15.99:0/3189644280 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f81f0064fe0 0x7f81f01131b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f81d800c830 tx=0x7f81d8004430 comp rx=0 tx=0).stop 2024-09-19T06:45:01.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.756+0000 7f81f5e8a640 1 -- 172.21.15.99:0/3189644280 shutdown_connections 2024-09-19T06:45:01.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.756+0000 7f81f5e8a640 1 --2- 172.21.15.99:0/3189644280 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f81dc06e660 0x7f81dc070b10 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:01.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.756+0000 7f81f5e8a640 1 --2- 172.21.15.99:0/3189644280 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f81f00fe450 0x7f81f01136f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:01.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.756+0000 7f81f5e8a640 1 --2- 172.21.15.99:0/3189644280 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f81f0064fe0 0x7f81f01131b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:01.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.756+0000 7f81f5e8a640 1 -- 172.21.15.99:0/3189644280 >> 172.21.15.99:0/3189644280 conn(0x7f81f00723b0 msgr2=0x7f81f0105390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:01.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.756+0000 7f81f5e8a640 1 -- 172.21.15.99:0/3189644280 shutdown_connections 2024-09-19T06:45:01.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.756+0000 7f81f5e8a640 1 -- 172.21.15.99:0/3189644280 wait complete. 2024-09-19T06:45:01.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.835+0000 7fef3b276640 1 -- 172.21.15.99:0/912393022 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef340fe460 msgr2=0x7fef340fe830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:01.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.835+0000 7fef3b276640 1 --2- 172.21.15.99:0/912393022 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef340fe460 0x7fef340fe830 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fef300048d0 tx=0x7fef30009da0 comp rx=0 tx=0).stop 2024-09-19T06:45:01.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.835+0000 7fef3b276640 1 -- 172.21.15.99:0/912393022 shutdown_connections 2024-09-19T06:45:01.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.835+0000 7fef3b276640 1 --2- 172.21.15.99:0/912393022 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef34064fc0 0x7fef34065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:01.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.835+0000 7fef3b276640 1 --2- 172.21.15.99:0/912393022 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef340fe460 0x7fef340fe830 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:01.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.835+0000 7fef3b276640 1 -- 172.21.15.99:0/912393022 >> 172.21.15.99:0/912393022 conn(0x7fef340723b0 msgr2=0x7fef340727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:01.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.835+0000 7fef3b276640 1 -- 172.21.15.99:0/912393022 shutdown_connections 2024-09-19T06:45:01.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.835+0000 7fef3b276640 1 -- 172.21.15.99:0/912393022 wait complete. 2024-09-19T06:45:01.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.835+0000 7fef3b276640 1 Processor -- start 2024-09-19T06:45:01.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.835+0000 7fef3b276640 1 -- start start 2024-09-19T06:45:01.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.836+0000 7fef3b276640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef34064fc0 0x7fef341131b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:01.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.836+0000 7fef3b276640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef340fe460 0x7fef341136f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:01.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.836+0000 7fef3b276640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef34113cf0 con 0x7fef340fe460 2024-09-19T06:45:01.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.836+0000 7fef3b276640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef3410d130 con 0x7fef34064fc0 2024-09-19T06:45:01.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.836+0000 7fef38811640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef340fe460 0x7fef341136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:01.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.836+0000 7fef38811640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef340fe460 0x7fef341136f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60602/0 (socket says 172.21.15.99:60602) 2024-09-19T06:45:01.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.836+0000 7fef38811640 1 -- 172.21.15.99:0/1719612182 learned_addr learned my addr 172.21.15.99:0/1719612182 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:45:01.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.836+0000 7fef39012640 1 --2- 172.21.15.99:0/1719612182 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef34064fc0 0x7fef341131b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:01.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.836+0000 7fef38811640 1 -- 172.21.15.99:0/1719612182 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef34064fc0 msgr2=0x7fef341131b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:01.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.836+0000 7fef38811640 1 --2- 172.21.15.99:0/1719612182 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef34064fc0 0x7fef341131b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:01.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.836+0000 7fef38811640 1 -- 172.21.15.99:0/1719612182 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef30005040 con 0x7fef340fe460 2024-09-19T06:45:01.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.836+0000 7fef38811640 1 --2- 172.21.15.99:0/1719612182 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef340fe460 0x7fef341136f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fef24002a50 tx=0x7fef24004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:01.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.837+0000 7fef29ffb640 1 -- 172.21.15.99:0/1719612182 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef24007c30 con 0x7fef340fe460 2024-09-19T06:45:01.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.837+0000 7fef29ffb640 1 -- 172.21.15.99:0/1719612182 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fef2400f040 con 0x7fef340fe460 2024-09-19T06:45:01.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.837+0000 7fef3b276640 1 -- 172.21.15.99:0/1719612182 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef3410d410 con 0x7fef340fe460 2024-09-19T06:45:01.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.837+0000 7fef29ffb640 1 -- 172.21.15.99:0/1719612182 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef2400da10 con 0x7fef340fe460 2024-09-19T06:45:01.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.837+0000 7fef3b276640 1 -- 172.21.15.99:0/1719612182 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef3410d9b0 con 0x7fef340fe460 2024-09-19T06:45:01.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.838+0000 7fef3b276640 1 -- 172.21.15.99:0/1719612182 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef340fdcf0 con 0x7fef340fe460 2024-09-19T06:45:01.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.839+0000 7fef29ffb640 1 -- 172.21.15.99:0/1719612182 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 40) v1 ==== 92653+0+0 (secure 0 0 0) 0x7fef2400dc80 con 0x7fef340fe460 2024-09-19T06:45:01.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.839+0000 7fef29ffb640 1 --2- 172.21.15.99:0/1719612182 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fef2006e660 0x7fef20070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:01.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.839+0000 7fef29ffb640 1 -- 172.21.15.99:0/1719612182 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fef2408db10 con 0x7fef340fe460 2024-09-19T06:45:01.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.840+0000 7fef39012640 1 --2- 172.21.15.99:0/1719612182 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fef2006e660 0x7fef20070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:01.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.840+0000 7fef39012640 1 --2- 172.21.15.99:0/1719612182 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fef2006e660 0x7fef20070b10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fef30009ac0 tx=0x7fef30035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:01.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:01.846+0000 7fef29ffb640 1 -- 172.21.15.99:0/1719612182 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fef24056b30 con 0x7fef340fe460 2024-09-19T06:45:02.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.112+0000 7fef3b276640 1 -- 172.21.15.99:0/1719612182 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fef3410e850 con 0x7fef340fe460 2024-09-19T06:45:02.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.112+0000 7fef29ffb640 1 -- 172.21.15.99:0/1719612182 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+850 (secure 0 0 0) 0x7fef2405a1f0 con 0x7fef340fe460 2024-09-19T06:45:02.114 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:45:02.114 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-09-19T06:45:02.114 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T06:45:02.114 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:45:02.114 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-09-19T06:45:02.115 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T06:45:02.115 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:45:02.115 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-09-19T06:45:02.115 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 5, 2024-09-19T06:45:02.115 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 1 2024-09-19T06:45:02.115 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:45:02.115 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": { 2024-09-19T06:45:02.115 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 4 2024-09-19T06:45:02.115 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:45:02.115 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-09-19T06:45:02.115 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 9, 2024-09-19T06:45:02.115 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 5 2024-09-19T06:45:02.115 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T06:45:02.115 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:45:02.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.114+0000 7fef3b276640 1 -- 172.21.15.99:0/1719612182 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fef2006e660 msgr2=0x7fef20070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:02.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.114+0000 7fef3b276640 1 --2- 172.21.15.99:0/1719612182 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fef2006e660 0x7fef20070b10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fef30009ac0 tx=0x7fef30035040 comp rx=0 tx=0).stop 2024-09-19T06:45:02.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.114+0000 7fef3b276640 1 -- 172.21.15.99:0/1719612182 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef340fe460 msgr2=0x7fef341136f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:02.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.114+0000 7fef3b276640 1 --2- 172.21.15.99:0/1719612182 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef340fe460 0x7fef341136f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fef24002a50 tx=0x7fef24004600 comp rx=0 tx=0).stop 2024-09-19T06:45:02.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.114+0000 7fef3b276640 1 -- 172.21.15.99:0/1719612182 shutdown_connections 2024-09-19T06:45:02.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.114+0000 7fef3b276640 1 --2- 172.21.15.99:0/1719612182 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fef2006e660 0x7fef20070b10 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:02.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.114+0000 7fef3b276640 1 --2- 172.21.15.99:0/1719612182 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fef340fe460 0x7fef341136f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:02.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.114+0000 7fef3b276640 1 --2- 172.21.15.99:0/1719612182 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef34064fc0 0x7fef341131b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:02.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.114+0000 7fef3b276640 1 -- 172.21.15.99:0/1719612182 >> 172.21.15.99:0/1719612182 conn(0x7fef340723b0 msgr2=0x7fef34105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:02.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.114+0000 7fef3b276640 1 -- 172.21.15.99:0/1719612182 shutdown_connections 2024-09-19T06:45:02.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.114+0000 7fef3b276640 1 -- 172.21.15.99:0/1719612182 wait complete. 2024-09-19T06:45:02.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.193+0000 7f6553c40640 1 -- 172.21.15.99:0/1253132891 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f654c0fdee0 msgr2=0x7f654c1065b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:02.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.193+0000 7f6553c40640 1 --2- 172.21.15.99:0/1253132891 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f654c0fdee0 0x7f654c1065b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6540004900 tx=0x7f6540009da0 comp rx=0 tx=0).stop 2024-09-19T06:45:02.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.193+0000 7f6553c40640 1 -- 172.21.15.99:0/1253132891 shutdown_connections 2024-09-19T06:45:02.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.193+0000 7f6553c40640 1 --2- 172.21.15.99:0/1253132891 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f654c0fdee0 0x7f654c1065b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:02.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.193+0000 7f6553c40640 1 --2- 172.21.15.99:0/1253132891 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f654c0fd540 0x7f654c0fd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:02.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.193+0000 7f6553c40640 1 -- 172.21.15.99:0/1253132891 >> 172.21.15.99:0/1253132891 conn(0x7f654c0f7020 msgr2=0x7f654c0f9430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:02.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.193+0000 7f6553c40640 1 -- 172.21.15.99:0/1253132891 shutdown_connections 2024-09-19T06:45:02.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.193+0000 7f6553c40640 1 -- 172.21.15.99:0/1253132891 wait complete. 2024-09-19T06:45:02.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.194+0000 7f6553c40640 1 Processor -- start 2024-09-19T06:45:02.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.194+0000 7f6553c40640 1 -- start start 2024-09-19T06:45:02.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.194+0000 7f6553c40640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f654c0fd540 0x7f654c1132b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:02.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.194+0000 7f6553c40640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f654c0fdee0 0x7f654c1137f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:02.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.194+0000 7f6553c40640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f654c113df0 con 0x7f654c0fd540 2024-09-19T06:45:02.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.194+0000 7f6553c40640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f654c10d230 con 0x7f654c0fdee0 2024-09-19T06:45:02.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.194+0000 7f65519dc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f654c0fd540 0x7f654c1132b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:02.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.194+0000 7f65519dc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f654c0fd540 0x7f654c1132b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60626/0 (socket says 172.21.15.99:60626) 2024-09-19T06:45:02.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.194+0000 7f65519dc640 1 -- 172.21.15.99:0/3415427766 learned_addr learned my addr 172.21.15.99:0/3415427766 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:45:02.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.194+0000 7f65511db640 1 --2- 172.21.15.99:0/3415427766 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f654c0fdee0 0x7f654c1137f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:02.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.194+0000 7f65519dc640 1 -- 172.21.15.99:0/3415427766 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f654c0fdee0 msgr2=0x7f654c1137f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:02.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.194+0000 7f65519dc640 1 --2- 172.21.15.99:0/3415427766 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f654c0fdee0 0x7f654c1137f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:02.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.194+0000 7f65519dc640 1 -- 172.21.15.99:0/3415427766 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6540005040 con 0x7f654c0fd540 2024-09-19T06:45:02.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.194+0000 7f65519dc640 1 --2- 172.21.15.99:0/3415427766 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f654c0fd540 0x7f654c1132b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f654400c790 tx=0x7f65440043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:02.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.195+0000 7f654a7fc640 1 -- 172.21.15.99:0/3415427766 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f654400a820 con 0x7f654c0fd540 2024-09-19T06:45:02.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.195+0000 7f654a7fc640 1 -- 172.21.15.99:0/3415427766 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f654400ae20 con 0x7f654c0fd540 2024-09-19T06:45:02.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.195+0000 7f6553c40640 1 -- 172.21.15.99:0/3415427766 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f654c10d510 con 0x7f654c0fd540 2024-09-19T06:45:02.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.195+0000 7f654a7fc640 1 -- 172.21.15.99:0/3415427766 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65440113a0 con 0x7f654c0fd540 2024-09-19T06:45:02.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.195+0000 7f6553c40640 1 -- 172.21.15.99:0/3415427766 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f654c10da30 con 0x7f654c0fd540 2024-09-19T06:45:02.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.196+0000 7f6553c40640 1 -- 172.21.15.99:0/3415427766 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f654c066310 con 0x7f654c0fd540 2024-09-19T06:45:02.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.196+0000 7f654a7fc640 1 -- 172.21.15.99:0/3415427766 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 40) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f6544012400 con 0x7f654c0fd540 2024-09-19T06:45:02.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.196+0000 7f654a7fc640 1 --2- 172.21.15.99:0/3415427766 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f653406e660 0x7f6534070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:02.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.197+0000 7f654a7fc640 1 -- 172.21.15.99:0/3415427766 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f654408e3f0 con 0x7f654c0fd540 2024-09-19T06:45:02.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.197+0000 7f65511db640 1 --2- 172.21.15.99:0/3415427766 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f653406e660 0x7f6534070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:02.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.197+0000 7f65511db640 1 --2- 172.21.15.99:0/3415427766 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f653406e660 0x7f6534070b10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6540004540 tx=0x7f6540009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:02.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.201+0000 7f654a7fc640 1 -- 172.21.15.99:0/3415427766 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f65440574f0 con 0x7f654c0fd540 2024-09-19T06:45:02.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.400+0000 7f6553c40640 1 -- 172.21.15.99:0/3415427766 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f654c0fac40 con 0x7f654c0fd540 2024-09-19T06:45:02.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.401+0000 7f654a7fc640 1 -- 172.21.15.99:0/3415427766 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1941 (secure 0 0 0) 0x7f654400a980 con 0x7f654c0fd540 2024-09-19T06:45:02.402 INFO:teuthology.orchestra.run.smithi099.stdout:e19 2024-09-19T06:45:02.402 INFO:teuthology.orchestra.run.smithi099.stdout:btime 2024-09-19T06:44:03:270764+0000 2024-09-19T06:45:02.402 INFO:teuthology.orchestra.run.smithi099.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T06:45:02.402 INFO:teuthology.orchestra.run.smithi099.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T06:45:02.402 INFO:teuthology.orchestra.run.smithi099.stdout:legacy client fscid: 1 2024-09-19T06:45:02.402 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:45:02.403 INFO:teuthology.orchestra.run.smithi099.stdout:Filesystem 'cephfs' (1) 2024-09-19T06:45:02.403 INFO:teuthology.orchestra.run.smithi099.stdout:fs_name cephfs 2024-09-19T06:45:02.403 INFO:teuthology.orchestra.run.smithi099.stdout:epoch 19 2024-09-19T06:45:02.403 INFO:teuthology.orchestra.run.smithi099.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-19T06:45:02.403 INFO:teuthology.orchestra.run.smithi099.stdout:created 2024-09-19T06:37:40.838146+0000 2024-09-19T06:45:02.403 INFO:teuthology.orchestra.run.smithi099.stdout:modified 2024-09-19T06:44:02.356718+0000 2024-09-19T06:45:02.403 INFO:teuthology.orchestra.run.smithi099.stdout:tableserver 0 2024-09-19T06:45:02.403 INFO:teuthology.orchestra.run.smithi099.stdout:root 0 2024-09-19T06:45:02.403 INFO:teuthology.orchestra.run.smithi099.stdout:session_timeout 60 2024-09-19T06:45:02.403 INFO:teuthology.orchestra.run.smithi099.stdout:session_autoclose 300 2024-09-19T06:45:02.403 INFO:teuthology.orchestra.run.smithi099.stdout:max_file_size 1099511627776 2024-09-19T06:45:02.403 INFO:teuthology.orchestra.run.smithi099.stdout:max_xattr_size 65536 2024-09-19T06:45:02.403 INFO:teuthology.orchestra.run.smithi099.stdout:required_client_features {} 2024-09-19T06:45:02.404 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure 0 2024-09-19T06:45:02.404 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure_osd_epoch 45 2024-09-19T06:45:02.404 INFO:teuthology.orchestra.run.smithi099.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T06:45:02.404 INFO:teuthology.orchestra.run.smithi099.stdout:max_mds 2 2024-09-19T06:45:02.404 INFO:teuthology.orchestra.run.smithi099.stdout:in 0,1 2024-09-19T06:45:02.404 INFO:teuthology.orchestra.run.smithi099.stdout:up {0=14482,1=24269} 2024-09-19T06:45:02.404 INFO:teuthology.orchestra.run.smithi099.stdout:failed 2024-09-19T06:45:02.404 INFO:teuthology.orchestra.run.smithi099.stdout:damaged 2024-09-19T06:45:02.404 INFO:teuthology.orchestra.run.smithi099.stdout:stopped 2024-09-19T06:45:02.404 INFO:teuthology.orchestra.run.smithi099.stdout:data_pools [3] 2024-09-19T06:45:02.404 INFO:teuthology.orchestra.run.smithi099.stdout:metadata_pool 2 2024-09-19T06:45:02.404 INFO:teuthology.orchestra.run.smithi099.stdout:inline_data disabled 2024-09-19T06:45:02.404 INFO:teuthology.orchestra.run.smithi099.stdout:balancer 2024-09-19T06:45:02.405 INFO:teuthology.orchestra.run.smithi099.stdout:bal_rank_mask -1 2024-09-19T06:45:02.405 INFO:teuthology.orchestra.run.smithi099.stdout:standby_count_wanted 1 2024-09-19T06:45:02.405 INFO:teuthology.orchestra.run.smithi099.stdout:qdb_cluster leader: 14482 members: 24269,14482 2024-09-19T06:45:02.405 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.xehbxe{0:14482} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.99:6828/1508711176,v1:172.21.15.99:6829/1508711176] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T06:45:02.405 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.nooexo{1:24269} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.117:6824/2367330767,v1:172.21.15.117:6825/2367330767] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T06:45:02.405 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:45:02.405 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:45:02.405 INFO:teuthology.orchestra.run.smithi099.stdout:Standby daemons: 2024-09-19T06:45:02.405 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:45:02.405 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.obarqf{-1:14490} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6826/388324528,v1:172.21.15.99:6827/388324528] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T06:45:02.405 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.bheqzh{-1:24283} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.117:6826/4072877365,v1:172.21.15.117:6827/4072877365] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T06:45:02.406 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 19 2024-09-19T06:45:02.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.402+0000 7f6553c40640 1 -- 172.21.15.99:0/3415427766 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f653406e660 msgr2=0x7f6534070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:02.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.402+0000 7f6553c40640 1 --2- 172.21.15.99:0/3415427766 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f653406e660 0x7f6534070b10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6540004540 tx=0x7f6540009da0 comp rx=0 tx=0).stop 2024-09-19T06:45:02.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.402+0000 7f6553c40640 1 -- 172.21.15.99:0/3415427766 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f654c0fd540 msgr2=0x7f654c1132b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:02.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.402+0000 7f6553c40640 1 --2- 172.21.15.99:0/3415427766 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f654c0fd540 0x7f654c1132b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f654400c790 tx=0x7f65440043c0 comp rx=0 tx=0).stop 2024-09-19T06:45:02.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.403+0000 7f6553c40640 1 -- 172.21.15.99:0/3415427766 shutdown_connections 2024-09-19T06:45:02.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.403+0000 7f6553c40640 1 --2- 172.21.15.99:0/3415427766 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f653406e660 0x7f6534070b10 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:02.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.403+0000 7f6553c40640 1 --2- 172.21.15.99:0/3415427766 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f654c0fdee0 0x7f654c1137f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:02.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.403+0000 7f6553c40640 1 --2- 172.21.15.99:0/3415427766 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f654c0fd540 0x7f654c1132b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:02.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.403+0000 7f6553c40640 1 -- 172.21.15.99:0/3415427766 >> 172.21.15.99:0/3415427766 conn(0x7f654c0f7020 msgr2=0x7f654c100f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:02.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.403+0000 7f6553c40640 1 -- 172.21.15.99:0/3415427766 shutdown_connections 2024-09-19T06:45:02.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.403+0000 7f6553c40640 1 -- 172.21.15.99:0/3415427766 wait complete. 2024-09-19T06:45:02.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.481+0000 7f89d5a2e640 1 -- 172.21.15.99:0/136421939 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89d0102550 msgr2=0x7f89d0102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:02.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.481+0000 7f89d5a2e640 1 --2- 172.21.15.99:0/136421939 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89d0102550 0x7f89d0102920 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f89c00048d0 tx=0x7f89c0009da0 comp rx=0 tx=0).stop 2024-09-19T06:45:02.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.481+0000 7f89d5a2e640 1 -- 172.21.15.99:0/136421939 shutdown_connections 2024-09-19T06:45:02.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.481+0000 7f89d5a2e640 1 --2- 172.21.15.99:0/136421939 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89d0102ef0 0x7f89d00fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:02.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.481+0000 7f89d5a2e640 1 --2- 172.21.15.99:0/136421939 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89d0102550 0x7f89d0102920 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:02.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.481+0000 7f89d5a2e640 1 -- 172.21.15.99:0/136421939 >> 172.21.15.99:0/136421939 conn(0x7f89d00f80f0 msgr2=0x7f89d00fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:02.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.481+0000 7f89d5a2e640 1 -- 172.21.15.99:0/136421939 shutdown_connections 2024-09-19T06:45:02.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.481+0000 7f89d5a2e640 1 -- 172.21.15.99:0/136421939 wait complete. 2024-09-19T06:45:02.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.482+0000 7f89d5a2e640 1 Processor -- start 2024-09-19T06:45:02.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.482+0000 7f89d5a2e640 1 -- start start 2024-09-19T06:45:02.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.482+0000 7f89d5a2e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89d0102550 0x7f89d0113540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:02.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.482+0000 7f89d5a2e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89d0102ef0 0x7f89d0113a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:02.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.482+0000 7f89d5a2e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89d01140d0 con 0x7f89d0102550 2024-09-19T06:45:02.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.482+0000 7f89d5a2e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89d010d4e0 con 0x7f89d0102ef0 2024-09-19T06:45:02.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.482+0000 7f89ceffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89d0102550 0x7f89d0113540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:02.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.482+0000 7f89ceffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89d0102550 0x7f89d0113540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60634/0 (socket says 172.21.15.99:60634) 2024-09-19T06:45:02.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.482+0000 7f89ceffd640 1 -- 172.21.15.99:0/750968552 learned_addr learned my addr 172.21.15.99:0/750968552 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:45:02.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.482+0000 7f89ce7fc640 1 --2- 172.21.15.99:0/750968552 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89d0102ef0 0x7f89d0113a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:02.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.483+0000 7f89ceffd640 1 -- 172.21.15.99:0/750968552 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89d0102ef0 msgr2=0x7f89d0113a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:02.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.483+0000 7f89ceffd640 1 --2- 172.21.15.99:0/750968552 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89d0102ef0 0x7f89d0113a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:02.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.483+0000 7f89ceffd640 1 -- 172.21.15.99:0/750968552 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89c0005040 con 0x7f89d0102550 2024-09-19T06:45:02.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.483+0000 7f89ceffd640 1 --2- 172.21.15.99:0/750968552 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89d0102550 0x7f89d0113540 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f89c0003080 tx=0x7f89c0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:02.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.483+0000 7f89b77fe640 1 -- 172.21.15.99:0/750968552 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89c0038070 con 0x7f89d0102550 2024-09-19T06:45:02.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.483+0000 7f89d5a2e640 1 -- 172.21.15.99:0/750968552 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89d010d760 con 0x7f89d0102550 2024-09-19T06:45:02.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.483+0000 7f89b77fe640 1 -- 172.21.15.99:0/750968552 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f89c00097e0 con 0x7f89d0102550 2024-09-19T06:45:02.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.483+0000 7f89b77fe640 1 -- 172.21.15.99:0/750968552 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89c003d420 con 0x7f89d0102550 2024-09-19T06:45:02.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.483+0000 7f89d5a2e640 1 -- 172.21.15.99:0/750968552 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89d010dca0 con 0x7f89d0102550 2024-09-19T06:45:02.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.484+0000 7f89d5a2e640 1 -- 172.21.15.99:0/750968552 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89d00fdcd0 con 0x7f89d0102550 2024-09-19T06:45:02.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.484+0000 7f89b77fe640 1 -- 172.21.15.99:0/750968552 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 40) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f89c0030020 con 0x7f89d0102550 2024-09-19T06:45:02.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.485+0000 7f89b77fe640 1 --2- 172.21.15.99:0/750968552 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f89b806e660 0x7f89b8070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:02.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.485+0000 7f89b77fe640 1 -- 172.21.15.99:0/750968552 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f89c00ae7a0 con 0x7f89d0102550 2024-09-19T06:45:02.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.485+0000 7f89ce7fc640 1 --2- 172.21.15.99:0/750968552 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f89b806e660 0x7f89b8070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:02.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.485+0000 7f89ce7fc640 1 --2- 172.21.15.99:0/750968552 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f89b806e660 0x7f89b8070b10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f89d010e7c0 tx=0x7f89c4004330 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:02.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.489+0000 7f89b77fe640 1 -- 172.21.15.99:0/750968552 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f89c00777c0 con 0x7f89d0102550 2024-09-19T06:45:02.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.671+0000 7f89d5a2e640 1 -- 172.21.15.99:0/750968552 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f89d004b720 con 0x7f89b806e660 2024-09-19T06:45:02.672 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:02 smithi099 ceph-mon[97031]: from='client.34190 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:45:02.672 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:02 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:45:02.673 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:02 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:45:02.673 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:02 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:45:02.673 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:02 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:45:02.673 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:02 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:45:02.673 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:02 smithi099 ceph-mon[97031]: from='client.34194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:45:02.673 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:02 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:45:02.673 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:02 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:45:02.673 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:02 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:45:02.673 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:02 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:45:02.673 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:02 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-19T06:45:02.673 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:02 smithi099 ceph-mon[97031]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-19T06:45:02.673 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:02 smithi099 ceph-mon[97031]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-19T06:45:02.673 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:02 smithi099 ceph-mon[97031]: from='client.34198 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:45:02.674 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:02 smithi099 ceph-mon[97031]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-19T06:45:02.674 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:02 smithi099 ceph-mon[97031]: osd.0 [v2:172.21.15.99:6802/3391765331,v1:172.21.15.99:6803/3391765331] boot 2024-09-19T06:45:02.674 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:02 smithi099 ceph-mon[97031]: osdmap e52: 6 total, 6 up, 6 in 2024-09-19T06:45:02.674 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:02 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:45:02.674 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:02 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/1719612182' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:45:02.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.672+0000 7f89b77fe640 1 -- 172.21.15.99:0/750968552 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f89d004b720 con 0x7f89b806e660 2024-09-19T06:45:02.675 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:45:02.675 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T06:45:02.675 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": true, 2024-09-19T06:45:02.675 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T06:45:02.675 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [ 2024-09-19T06:45:02.675 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr", 2024-09-19T06:45:02.675 INFO:teuthology.orchestra.run.smithi099.stdout: "crash", 2024-09-19T06:45:02.675 INFO:teuthology.orchestra.run.smithi099.stdout: "mon" 2024-09-19T06:45:02.675 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-19T06:45:02.675 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": "7/21 daemons upgraded", 2024-09-19T06:45:02.675 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "Currently upgrading osd daemons", 2024-09-19T06:45:02.676 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-09-19T06:45:02.676 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:45:02.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.674+0000 7f89d5a2e640 1 -- 172.21.15.99:0/750968552 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f89b806e660 msgr2=0x7f89b8070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:02.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.674+0000 7f89d5a2e640 1 --2- 172.21.15.99:0/750968552 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f89b806e660 0x7f89b8070b10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f89d010e7c0 tx=0x7f89c4004330 comp rx=0 tx=0).stop 2024-09-19T06:45:02.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.674+0000 7f89d5a2e640 1 -- 172.21.15.99:0/750968552 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89d0102550 msgr2=0x7f89d0113540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:02.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.674+0000 7f89d5a2e640 1 --2- 172.21.15.99:0/750968552 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89d0102550 0x7f89d0113540 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f89c0003080 tx=0x7f89c0009da0 comp rx=0 tx=0).stop 2024-09-19T06:45:02.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.674+0000 7f89d5a2e640 1 -- 172.21.15.99:0/750968552 shutdown_connections 2024-09-19T06:45:02.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.674+0000 7f89d5a2e640 1 --2- 172.21.15.99:0/750968552 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f89b806e660 0x7f89b8070b10 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:02.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.674+0000 7f89d5a2e640 1 --2- 172.21.15.99:0/750968552 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89d0102ef0 0x7f89d0113a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:02.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.674+0000 7f89d5a2e640 1 --2- 172.21.15.99:0/750968552 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89d0102550 0x7f89d0113540 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:02.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.674+0000 7f89d5a2e640 1 -- 172.21.15.99:0/750968552 >> 172.21.15.99:0/750968552 conn(0x7f89d00f80f0 msgr2=0x7f89d00f9160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:02.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.675+0000 7f89d5a2e640 1 -- 172.21.15.99:0/750968552 shutdown_connections 2024-09-19T06:45:02.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.675+0000 7f89d5a2e640 1 -- 172.21.15.99:0/750968552 wait complete. 2024-09-19T06:45:02.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.752+0000 7fcf4e58c640 1 -- 172.21.15.99:0/2652872279 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf48102620 msgr2=0x7fcf481029f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:02.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.752+0000 7fcf4e58c640 1 --2- 172.21.15.99:0/2652872279 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf48102620 0x7fcf481029f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcf380048d0 tx=0x7fcf38009da0 comp rx=0 tx=0).stop 2024-09-19T06:45:02.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.752+0000 7fcf4e58c640 1 -- 172.21.15.99:0/2652872279 shutdown_connections 2024-09-19T06:45:02.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.752+0000 7fcf4e58c640 1 --2- 172.21.15.99:0/2652872279 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf480fac80 0x7fcf480fb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:02.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.752+0000 7fcf4e58c640 1 --2- 172.21.15.99:0/2652872279 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf48102620 0x7fcf481029f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:02.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.752+0000 7fcf4e58c640 1 -- 172.21.15.99:0/2652872279 >> 172.21.15.99:0/2652872279 conn(0x7fcf48070ce0 msgr2=0x7fcf480710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:02.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.752+0000 7fcf4e58c640 1 -- 172.21.15.99:0/2652872279 shutdown_connections 2024-09-19T06:45:02.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.752+0000 7fcf4e58c640 1 -- 172.21.15.99:0/2652872279 wait complete. 2024-09-19T06:45:02.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.753+0000 7fcf4e58c640 1 Processor -- start 2024-09-19T06:45:02.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.753+0000 7fcf4e58c640 1 -- start start 2024-09-19T06:45:02.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.753+0000 7fcf4e58c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf480fac80 0x7fcf481131c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:02.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.754+0000 7fcf4e58c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf48102620 0x7fcf48113700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:02.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.754+0000 7fcf4e58c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf48113d00 con 0x7fcf48102620 2024-09-19T06:45:02.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.754+0000 7fcf4e58c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4810d140 con 0x7fcf480fac80 2024-09-19T06:45:02.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.754+0000 7fcf477fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf48102620 0x7fcf48113700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:02.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.754+0000 7fcf477fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf48102620 0x7fcf48113700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60660/0 (socket says 172.21.15.99:60660) 2024-09-19T06:45:02.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.754+0000 7fcf477fe640 1 -- 172.21.15.99:0/2204138413 learned_addr learned my addr 172.21.15.99:0/2204138413 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:45:02.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.754+0000 7fcf47fff640 1 --2- 172.21.15.99:0/2204138413 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf480fac80 0x7fcf481131c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:02.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.754+0000 7fcf477fe640 1 -- 172.21.15.99:0/2204138413 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf480fac80 msgr2=0x7fcf481131c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:02.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.754+0000 7fcf477fe640 1 --2- 172.21.15.99:0/2204138413 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf480fac80 0x7fcf481131c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:02.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.754+0000 7fcf477fe640 1 -- 172.21.15.99:0/2204138413 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf38005040 con 0x7fcf48102620 2024-09-19T06:45:02.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.754+0000 7fcf477fe640 1 --2- 172.21.15.99:0/2204138413 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf48102620 0x7fcf48113700 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c002a50 tx=0x7fcf3c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:02.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.754+0000 7fcf44ff9640 1 -- 172.21.15.99:0/2204138413 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf3c007c30 con 0x7fcf48102620 2024-09-19T06:45:02.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.754+0000 7fcf44ff9640 1 -- 172.21.15.99:0/2204138413 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fcf3c00f040 con 0x7fcf48102620 2024-09-19T06:45:02.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.754+0000 7fcf4e58c640 1 -- 172.21.15.99:0/2204138413 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf4810d420 con 0x7fcf48102620 2024-09-19T06:45:02.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.754+0000 7fcf44ff9640 1 -- 172.21.15.99:0/2204138413 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf3c00da10 con 0x7fcf48102620 2024-09-19T06:45:02.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.754+0000 7fcf4e58c640 1 -- 172.21.15.99:0/2204138413 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf4810d9c0 con 0x7fcf48102620 2024-09-19T06:45:02.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.755+0000 7fcf4e58c640 1 -- 172.21.15.99:0/2204138413 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf480657b0 con 0x7fcf48102620 2024-09-19T06:45:02.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.756+0000 7fcf44ff9640 1 -- 172.21.15.99:0/2204138413 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 40) v1 ==== 92653+0+0 (secure 0 0 0) 0x7fcf3c00dbb0 con 0x7fcf48102620 2024-09-19T06:45:02.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.756+0000 7fcf44ff9640 1 --2- 172.21.15.99:0/2204138413 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fcf3006e660 0x7fcf30070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:02.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.756+0000 7fcf44ff9640 1 -- 172.21.15.99:0/2204138413 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fcf3c08dac0 con 0x7fcf48102620 2024-09-19T06:45:02.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.756+0000 7fcf47fff640 1 --2- 172.21.15.99:0/2204138413 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fcf3006e660 0x7fcf30070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:02.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.757+0000 7fcf47fff640 1 --2- 172.21.15.99:0/2204138413 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fcf3006e660 0x7fcf30070b10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fcf38009ac0 tx=0x7fcf38035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:02.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:02.760+0000 7fcf44ff9640 1 -- 172.21.15.99:0/2204138413 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fcf3c056bd0 con 0x7fcf48102620 2024-09-19T06:45:02.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:02 smithi117 ceph-mon[76771]: from='client.34190 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:45:02.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:02 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:45:02.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:02 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:45:02.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:02 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:45:02.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:02 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:45:02.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:02 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:45:02.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:02 smithi117 ceph-mon[76771]: from='client.34194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:45:02.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:02 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:45:02.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:02 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:45:02.813 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:02 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:45:02.813 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:02 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:45:02.813 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:02 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-19T06:45:02.813 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:02 smithi117 ceph-mon[76771]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-19T06:45:02.813 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:02 smithi117 ceph-mon[76771]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-19T06:45:02.813 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:02 smithi117 ceph-mon[76771]: from='client.34198 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:45:02.813 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:02 smithi117 ceph-mon[76771]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-19T06:45:02.813 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:02 smithi117 ceph-mon[76771]: osd.0 [v2:172.21.15.99:6802/3391765331,v1:172.21.15.99:6803/3391765331] boot 2024-09-19T06:45:02.813 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:02 smithi117 ceph-mon[76771]: osdmap e52: 6 total, 6 up, 6 in 2024-09-19T06:45:02.813 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:02 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T06:45:02.813 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:02 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/1719612182' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:45:03.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:03.017+0000 7fcf4e58c640 1 -- 172.21.15.99:0/2204138413 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fcf48074c00 con 0x7fcf48102620 2024-09-19T06:45:03.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:03.017+0000 7fcf44ff9640 1 -- 172.21.15.99:0/2204138413 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1239 (secure 0 0 0) 0x7fcf3c0174f0 con 0x7fcf48102620 2024-09-19T06:45:03.019 INFO:teuthology.orchestra.run.smithi099.stdout:HEALTH_WARN Degraded data redundancy: 63/321 objects degraded (19.626%), 19 pgs degraded 2024-09-19T06:45:03.019 INFO:teuthology.orchestra.run.smithi099.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 63/321 objects degraded (19.626%), 19 pgs degraded 2024-09-19T06:45:03.019 INFO:teuthology.orchestra.run.smithi099.stdout: pg 1.0 is active+undersized+degraded, acting [3,1] 2024-09-19T06:45:03.019 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.0 is active+undersized+degraded, acting [3,1] 2024-09-19T06:45:03.019 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.1 is active+undersized+degraded, acting [2,1] 2024-09-19T06:45:03.019 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.2 is active+undersized+degraded, acting [5,1] 2024-09-19T06:45:03.019 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.4 is active+undersized+degraded, acting [1,4] 2024-09-19T06:45:03.019 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.5 is active+undersized+degraded, acting [3,4] 2024-09-19T06:45:03.020 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.8 is active+undersized+degraded, acting [3,5] 2024-09-19T06:45:03.020 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.9 is active+undersized+degraded, acting [1,4] 2024-09-19T06:45:03.020 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.e is active+undersized+degraded, acting [2,3] 2024-09-19T06:45:03.020 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.f is active+undersized+degraded, acting [4,5] 2024-09-19T06:45:03.020 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.10 is active+undersized+degraded, acting [2,1] 2024-09-19T06:45:03.020 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.12 is active+undersized+degraded, acting [3,1] 2024-09-19T06:45:03.020 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.13 is active+undersized+degraded, acting [4,2] 2024-09-19T06:45:03.020 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.15 is active+undersized+degraded, acting [1,3] 2024-09-19T06:45:03.020 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.19 is active+undersized+degraded, acting [4,2] 2024-09-19T06:45:03.020 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.1b is active+undersized+degraded, acting [1,5] 2024-09-19T06:45:03.020 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.1d is active+undersized+degraded, acting [3,5] 2024-09-19T06:45:03.020 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.1e is active+undersized+degraded, acting [2,5] 2024-09-19T06:45:03.020 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.1f is active+undersized+degraded, acting [3,4] 2024-09-19T06:45:03.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:03.019+0000 7fcf4e58c640 1 -- 172.21.15.99:0/2204138413 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fcf3006e660 msgr2=0x7fcf30070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:03.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:03.019+0000 7fcf4e58c640 1 --2- 172.21.15.99:0/2204138413 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fcf3006e660 0x7fcf30070b10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fcf38009ac0 tx=0x7fcf38035040 comp rx=0 tx=0).stop 2024-09-19T06:45:03.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:03.019+0000 7fcf4e58c640 1 -- 172.21.15.99:0/2204138413 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf48102620 msgr2=0x7fcf48113700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:03.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:03.019+0000 7fcf4e58c640 1 --2- 172.21.15.99:0/2204138413 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf48102620 0x7fcf48113700 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c002a50 tx=0x7fcf3c004600 comp rx=0 tx=0).stop 2024-09-19T06:45:03.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:03.019+0000 7fcf4e58c640 1 -- 172.21.15.99:0/2204138413 shutdown_connections 2024-09-19T06:45:03.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:03.019+0000 7fcf4e58c640 1 --2- 172.21.15.99:0/2204138413 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fcf3006e660 0x7fcf30070b10 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:03.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:03.019+0000 7fcf4e58c640 1 --2- 172.21.15.99:0/2204138413 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf48102620 0x7fcf48113700 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:03.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:03.020+0000 7fcf4e58c640 1 --2- 172.21.15.99:0/2204138413 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf480fac80 0x7fcf481131c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:03.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:03.020+0000 7fcf4e58c640 1 -- 172.21.15.99:0/2204138413 >> 172.21.15.99:0/2204138413 conn(0x7fcf48070ce0 msgr2=0x7fcf48105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:03.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:03.020+0000 7fcf4e58c640 1 -- 172.21.15.99:0/2204138413 shutdown_connections 2024-09-19T06:45:03.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:03.020+0000 7fcf4e58c640 1 -- 172.21.15.99:0/2204138413 wait complete. 2024-09-19T06:45:03.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:03 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/3415427766' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:45:03.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:03 smithi099 ceph-mon[97031]: from='client.34210 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:45:03.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:03 smithi099 ceph-mon[97031]: pgmap v50: 65 pgs: 25 peering, 6 active+undersized, 3 active+undersized+degraded, 31 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 11/321 objects degraded (3.427%) 2024-09-19T06:45:03.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:03 smithi099 ceph-mon[97031]: osdmap e53: 6 total, 6 up, 6 in 2024-09-19T06:45:03.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:03 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/2204138413' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T06:45:03.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:03 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/3415427766' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:45:03.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:03 smithi117 ceph-mon[76771]: from='client.34210 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:45:03.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:03 smithi117 ceph-mon[76771]: pgmap v50: 65 pgs: 25 peering, 6 active+undersized, 3 active+undersized+degraded, 31 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 11/321 objects degraded (3.427%) 2024-09-19T06:45:03.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:03 smithi117 ceph-mon[76771]: osdmap e53: 6 total, 6 up, 6 in 2024-09-19T06:45:03.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:03 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/2204138413' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T06:45:04.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:04 smithi099 ceph-mon[97031]: Health check update: Degraded data redundancy: 11/321 objects degraded (3.427%), 3 pgs degraded (PG_DEGRADED) 2024-09-19T06:45:04.811 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:04 smithi117 ceph-mon[76771]: Health check update: Degraded data redundancy: 11/321 objects degraded (3.427%), 3 pgs degraded (PG_DEGRADED) 2024-09-19T06:45:05.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:05 smithi099 ceph-mon[97031]: pgmap v52: 65 pgs: 25 peering, 6 active+undersized, 3 active+undersized+degraded, 31 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 11/321 objects degraded (3.427%) 2024-09-19T06:45:05.811 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:05 smithi117 ceph-mon[76771]: pgmap v52: 65 pgs: 25 peering, 6 active+undersized, 3 active+undersized+degraded, 31 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 11/321 objects degraded (3.427%) 2024-09-19T06:45:08.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:07 smithi099 ceph-mon[97031]: pgmap v53: 65 pgs: 25 peering, 40 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:45:08.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:07 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:45:08.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:07 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:45:08.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:07 smithi099 ceph-mon[97031]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 11/321 objects degraded (3.427%), 3 pgs degraded) 2024-09-19T06:45:08.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:07 smithi099 ceph-mon[97031]: Cluster is now healthy 2024-09-19T06:45:08.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:07 smithi117 ceph-mon[76771]: pgmap v53: 65 pgs: 25 peering, 40 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:45:08.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:07 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:45:08.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:07 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:45:08.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:07 smithi117 ceph-mon[76771]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 11/321 objects degraded (3.427%), 3 pgs degraded) 2024-09-19T06:45:08.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:07 smithi117 ceph-mon[76771]: Cluster is now healthy 2024-09-19T06:45:10.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:09 smithi099 ceph-mon[97031]: pgmap v54: 65 pgs: 65 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-09-19T06:45:10.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:09 smithi099 ceph-mon[97031]: mgrmap e41: smithi099.pgvkqi(active, since 92s), standbys: smithi117.ssmkcf 2024-09-19T06:45:10.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:09 smithi117 ceph-mon[76771]: pgmap v54: 65 pgs: 65 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-09-19T06:45:10.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:09 smithi117 ceph-mon[76771]: mgrmap e41: smithi099.pgvkqi(active, since 92s), standbys: smithi117.ssmkcf 2024-09-19T06:45:12.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:11 smithi099 ceph-mon[97031]: pgmap v55: 65 pgs: 65 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 688 B/s wr, 0 op/s 2024-09-19T06:45:12.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:11 smithi117 ceph-mon[76771]: pgmap v55: 65 pgs: 65 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 688 B/s wr, 0 op/s 2024-09-19T06:45:14.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:13 smithi099 ceph-mon[97031]: pgmap v56: 65 pgs: 65 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 614 B/s wr, 0 op/s 2024-09-19T06:45:14.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:13 smithi117 ceph-mon[76771]: pgmap v56: 65 pgs: 65 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 614 B/s wr, 0 op/s 2024-09-19T06:45:16.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:15 smithi099 ceph-mon[97031]: pgmap v57: 65 pgs: 65 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 515 B/s wr, 0 op/s 2024-09-19T06:45:16.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:15 smithi117 ceph-mon[76771]: pgmap v57: 65 pgs: 65 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 515 B/s wr, 0 op/s 2024-09-19T06:45:17.152 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:16 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-19T06:45:17.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:16 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-19T06:45:18.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:17 smithi099 ceph-mon[97031]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-19T06:45:18.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:17 smithi099 ceph-mon[97031]: Upgrade: osd.1 is safe to restart 2024-09-19T06:45:18.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:17 smithi099 ceph-mon[97031]: pgmap v58: 65 pgs: 65 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-19T06:45:18.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:17 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:45:18.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:17 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:45:18.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:17 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T06:45:18.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:17 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:45:18.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:17 smithi117 ceph-mon[76771]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-19T06:45:18.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:17 smithi117 ceph-mon[76771]: Upgrade: osd.1 is safe to restart 2024-09-19T06:45:18.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:17 smithi117 ceph-mon[76771]: pgmap v58: 65 pgs: 65 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-19T06:45:18.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:17 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:45:18.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:17 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:45:18.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:17 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T06:45:18.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:17 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:45:19.205 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:18 smithi099 ceph-mon[97031]: Upgrade: Updating osd.1 2024-09-19T06:45:19.205 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:18 smithi099 ceph-mon[97031]: Deploying daemon osd.1 on smithi099 2024-09-19T06:45:19.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:18 smithi117 ceph-mon[76771]: Upgrade: Updating osd.1 2024-09-19T06:45:19.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:18 smithi117 ceph-mon[76771]: Deploying daemon osd.1 on smithi099 2024-09-19T06:45:20.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:19 smithi099 ceph-mon[97031]: pgmap v59: 65 pgs: 65 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-19T06:45:20.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:19 smithi117 ceph-mon[76771]: pgmap v59: 65 pgs: 65 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-19T06:45:20.956 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:45:20 smithi099 systemd[1]: Stopping Ceph osd.1 for a73eb958-7650-11ef-bceb-c7b262605968... 2024-09-19T06:45:21.456 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:45:21 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-1[53448]: 2024-09-19T06:45:21.032+0000 7fe827c06640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:45:21.456 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:45:21 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-1[53448]: 2024-09-19T06:45:21.032+0000 7fe827c06640 -1 osd.1 53 *** Got signal Terminated *** 2024-09-19T06:45:21.456 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:45:21 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-1[53448]: 2024-09-19T06:45:21.032+0000 7fe827c06640 -1 osd.1 53 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:45:22.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:21 smithi099 ceph-mon[97031]: pgmap v60: 65 pgs: 65 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:45:22.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:21 smithi099 ceph-mon[97031]: osd.1 marked itself down and dead 2024-09-19T06:45:22.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:21 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:45:22.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:21 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:45:22.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:21 smithi117 ceph-mon[76771]: pgmap v60: 65 pgs: 65 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:45:22.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:21 smithi117 ceph-mon[76771]: osd.1 marked itself down and dead 2024-09-19T06:45:22.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:21 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:45:22.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:21 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:45:22.601 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:45:22 smithi099 podman[112647]: 2024-09-19 06:45:22.28863783 +0000 UTC m=+1.377381605 container died bc5b04b8bf9f06a40de000d4100568d7a8b8f1de24581e09303cc7fbea3f568e (image=quay.ceph.io/ceph-ci/ceph@sha256:4d922a456af336b23156460d93b8143eb9c977eee7e72f2e9e44c816e5b46ac8, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-1, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=quincy-6e06d1e, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-19T06:45:22.920 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:45:22 smithi099 podman[112647]: 2024-09-19 06:45:22.69128723 +0000 UTC m=+1.780031008 container cleanup bc5b04b8bf9f06a40de000d4100568d7a8b8f1de24581e09303cc7fbea3f568e (image=quay.ceph.io/ceph-ci/ceph@sha256:4d922a456af336b23156460d93b8143eb9c977eee7e72f2e9e44c816e5b46ac8, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-1, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=quincy-6e06d1e, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-19T06:45:22.920 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:45:22 smithi099 bash[112647]: ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-1 2024-09-19T06:45:23.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:22 smithi099 ceph-mon[97031]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-19T06:45:23.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:22 smithi099 ceph-mon[97031]: osdmap e54: 6 total, 5 up, 6 in 2024-09-19T06:45:23.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:22 smithi099 ceph-mon[97031]: osdmap e55: 6 total, 5 up, 6 in 2024-09-19T06:45:23.206 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:45:22 smithi099 podman[112663]: 2024-09-19 06:45:22.976401326 +0000 UTC m=+0.690321229 container remove bc5b04b8bf9f06a40de000d4100568d7a8b8f1de24581e09303cc7fbea3f568e (image=quay.ceph.io/ceph-ci/ceph@sha256:4d922a456af336b23156460d93b8143eb9c977eee7e72f2e9e44c816e5b46ac8, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=quincy-6e06d1e, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:45:23.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:22 smithi117 ceph-mon[76771]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-19T06:45:23.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:22 smithi117 ceph-mon[76771]: osdmap e54: 6 total, 5 up, 6 in 2024-09-19T06:45:23.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:22 smithi117 ceph-mon[76771]: osdmap e55: 6 total, 5 up, 6 in 2024-09-19T06:45:23.614 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:45:23 smithi099 podman[112750]: 2024-09-19 06:45:23.194904643 +0000 UTC m=+0.016182387 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:45:23.614 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:45:23 smithi099 podman[112750]: 2024-09-19 06:45:23.319234353 +0000 UTC m=+0.140512087 container create 9167f89bb193451687d124526a3c15a7f8213dd763e5792d7382b025952a1258 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:45:23.614 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:45:23 smithi099 podman[112750]: 2024-09-19 06:45:23.538529968 +0000 UTC m=+0.359807707 container init 9167f89bb193451687d124526a3c15a7f8213dd763e5792d7382b025952a1258 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4) 2024-09-19T06:45:23.614 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:45:23 smithi099 podman[112750]: 2024-09-19 06:45:23.542020033 +0000 UTC m=+0.363297775 container start 9167f89bb193451687d124526a3c15a7f8213dd763e5792d7382b025952a1258 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:45:23.614 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:45:23 smithi099 podman[112750]: 2024-09-19 06:45:23.613480145 +0000 UTC m=+0.434757882 container attach 9167f89bb193451687d124526a3c15a7f8213dd763e5792d7382b025952a1258 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-1-deactivate, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-19T06:45:23.922 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:45:23 smithi099 podman[112750]: 2024-09-19 06:45:23.731135587 +0000 UTC m=+0.552413332 container died 9167f89bb193451687d124526a3c15a7f8213dd763e5792d7382b025952a1258 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-1-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-19T06:45:24.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:23 smithi099 ceph-mon[97031]: pgmap v62: 65 pgs: 29 peering, 3 stale+active+clean, 33 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:45:24.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:23 smithi099 ceph-mon[97031]: Health check failed: Reduced data availability: 8 pgs peering (PG_AVAILABILITY) 2024-09-19T06:45:24.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:23 smithi117 ceph-mon[76771]: pgmap v62: 65 pgs: 29 peering, 3 stale+active+clean, 33 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:45:24.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:23 smithi117 ceph-mon[76771]: Health check failed: Reduced data availability: 8 pgs peering (PG_AVAILABILITY) 2024-09-19T06:45:24.691 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:45:24 smithi099 podman[112773]: 2024-09-19 06:45:24.267550332 +0000 UTC m=+0.529973983 container remove 9167f89bb193451687d124526a3c15a7f8213dd763e5792d7382b025952a1258 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-19T06:45:24.691 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:45:24 smithi099 systemd[1]: ceph-a73eb958-7650-11ef-bceb-c7b262605968@osd.1.service: Deactivated successfully. 2024-09-19T06:45:24.691 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:45:24 smithi099 systemd[1]: Stopped Ceph osd.1 for a73eb958-7650-11ef-bceb-c7b262605968. 2024-09-19T06:45:24.692 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:45:24 smithi099 systemd[1]: ceph-a73eb958-7650-11ef-bceb-c7b262605968@osd.1.service: Consumed 1min 6.282s CPU time. 2024-09-19T06:45:24.692 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:45:24 smithi099 systemd[1]: Starting Ceph osd.1 for a73eb958-7650-11ef-bceb-c7b262605968... 2024-09-19T06:45:24.956 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:45:24 smithi099 podman[112873]: 2024-09-19 06:45:24.593133494 +0000 UTC m=+0.015721744 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:45:24.956 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:45:24 smithi099 podman[112873]: 2024-09-19 06:45:24.72816685 +0000 UTC m=+0.150755081 container create e17a475e1a1538b6671741a31435b09158cfae8e79fd7446718a2c2071eff8c8 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-1-activate, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD) 2024-09-19T06:45:25.456 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:45:24 smithi099 podman[112873]: 2024-09-19 06:45:24.988656383 +0000 UTC m=+0.411244617 container init e17a475e1a1538b6671741a31435b09158cfae8e79fd7446718a2c2071eff8c8 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-1-activate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-19T06:45:25.456 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:45:24 smithi099 podman[112873]: 2024-09-19 06:45:24.992288799 +0000 UTC m=+0.414877030 container start e17a475e1a1538b6671741a31435b09158cfae8e79fd7446718a2c2071eff8c8 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-1-activate, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:45:25.457 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:45:25 smithi099 podman[112873]: 2024-09-19 06:45:25.080325271 +0000 UTC m=+0.502913514 container attach e17a475e1a1538b6671741a31435b09158cfae8e79fd7446718a2c2071eff8c8 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-1-activate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD) 2024-09-19T06:45:25.457 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:45:25 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-1-activate[112888]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T06:45:25.457 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:45:25 smithi099 bash[112873]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T06:45:25.457 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:45:25 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-1-activate[112888]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T06:45:25.457 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:45:25 smithi099 bash[112873]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T06:45:26.142 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:25 smithi099 ceph-mon[97031]: pgmap v64: 65 pgs: 29 peering, 3 stale+active+clean, 33 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:45:26.142 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:45:25 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-1-activate[112888]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-19T06:45:26.142 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:45:25 smithi099 bash[112873]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-19T06:45:26.143 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:45:25 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-1-activate[112888]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-19T06:45:26.143 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:45:25 smithi099 bash[112873]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-19T06:45:26.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:25 smithi117 ceph-mon[76771]: pgmap v64: 65 pgs: 29 peering, 3 stale+active+clean, 33 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:45:26.456 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:45:26 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-1-activate[112888]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-19T06:45:26.457 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:45:26 smithi099 bash[112873]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-19T06:45:26.457 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:45:26 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-1-activate[112888]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-19T06:45:26.457 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:45:26 smithi099 bash[112873]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-19T06:45:26.457 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:45:26 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-1-activate[112888]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-19T06:45:26.457 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:45:26 smithi099 bash[112873]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-19T06:45:26.457 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:45:26 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-1-activate[112888]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-19T06:45:26.457 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:45:26 smithi099 bash[112873]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-19T06:45:26.457 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:45:26 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-1-activate[112888]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-19T06:45:26.457 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:45:26 smithi099 bash[112873]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-19T06:45:26.457 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:45:26 smithi099 podman[112873]: 2024-09-19 06:45:26.16981796 +0000 UTC m=+1.592406199 container died e17a475e1a1538b6671741a31435b09158cfae8e79fd7446718a2c2071eff8c8 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-1-activate, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731) 2024-09-19T06:45:27.138 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:26 smithi099 ceph-mon[97031]: Health check failed: Degraded data redundancy: 6/321 objects degraded (1.869%), 2 pgs degraded (PG_DEGRADED) 2024-09-19T06:45:27.138 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:45:26 smithi099 podman[113021]: 2024-09-19 06:45:26.801096617 +0000 UTC m=+0.625438734 container remove e17a475e1a1538b6671741a31435b09158cfae8e79fd7446718a2c2071eff8c8 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-1-activate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, RELEASE=squid-2f599a4) 2024-09-19T06:45:27.138 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:45:27 smithi099 podman[113080]: 2024-09-19 06:45:26.909158581 +0000 UTC m=+0.015738951 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:45:27.138 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:45:27 smithi099 podman[113080]: 2024-09-19 06:45:27.02728847 +0000 UTC m=+0.133868834 container create f54153d0ae09157af984e5942dc32ce9ec2fa724cdbd7e05b463f28921f5d588 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-1, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:45:27.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:26 smithi117 ceph-mon[76771]: Health check failed: Degraded data redundancy: 6/321 objects degraded (1.869%), 2 pgs degraded (PG_DEGRADED) 2024-09-19T06:45:27.456 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:45:27 smithi099 podman[113080]: 2024-09-19 06:45:27.246710886 +0000 UTC m=+0.353291264 container init f54153d0ae09157af984e5942dc32ce9ec2fa724cdbd7e05b463f28921f5d588 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-1, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2) 2024-09-19T06:45:27.457 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:45:27 smithi099 podman[113080]: 2024-09-19 06:45:27.250001314 +0000 UTC m=+0.356581679 container start f54153d0ae09157af984e5942dc32ce9ec2fa724cdbd7e05b463f28921f5d588 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:45:27.457 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:45:27 smithi099 ceph-osd[113100]: -- 172.21.15.99:0/466403278 <== mon.0 v2:172.21.15.99:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55faa42541e0 con 0x55faa3401c00 2024-09-19T06:45:27.457 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:45:27 smithi099 bash[113080]: f54153d0ae09157af984e5942dc32ce9ec2fa724cdbd7e05b463f28921f5d588 2024-09-19T06:45:27.457 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:45:27 smithi099 systemd[1]: Started Ceph osd.1 for a73eb958-7650-11ef-bceb-c7b262605968. 2024-09-19T06:45:28.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:27 smithi117 ceph-mon[76771]: pgmap v65: 65 pgs: 3 active+undersized, 29 peering, 2 active+undersized+degraded, 31 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 6/321 objects degraded (1.869%) 2024-09-19T06:45:28.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:27 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:45:28.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:27 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:45:28.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:27 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:45:28.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:27 smithi099 ceph-mon[97031]: pgmap v65: 65 pgs: 3 active+undersized, 29 peering, 2 active+undersized+degraded, 31 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 6/321 objects degraded (1.869%) 2024-09-19T06:45:28.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:27 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:45:28.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:27 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:45:28.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:27 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:45:29.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:29 smithi117 ceph-mon[76771]: pgmap v66: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 51/321 objects degraded (15.888%) 2024-09-19T06:45:29.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:29 smithi117 ceph-mon[76771]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 8 pgs peering) 2024-09-19T06:45:29.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:29 smithi099 ceph-mon[97031]: pgmap v66: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 51/321 objects degraded (15.888%) 2024-09-19T06:45:29.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:29 smithi099 ceph-mon[97031]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 8 pgs peering) 2024-09-19T06:45:29.457 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:45:29 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-1[113096]: 2024-09-19T06:45:29.113+0000 7f461405e640 -1 Falling back to public interface 2024-09-19T06:45:32.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:31 smithi099 ceph-mon[97031]: pgmap v67: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 51/321 objects degraded (15.888%) 2024-09-19T06:45:32.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:31 smithi117 ceph-mon[76771]: pgmap v67: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 51/321 objects degraded (15.888%) 2024-09-19T06:45:33.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.106+0000 7f220d5da640 1 -- 172.21.15.99:0/4187531668 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f22080fac60 msgr2=0x7f22080fb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:33.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.106+0000 7f220d5da640 1 --2- 172.21.15.99:0/4187531668 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f22080fac60 0x7f22080fb0b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f21fc0048d0 tx=0x7f21fc009da0 comp rx=0 tx=0).stop 2024-09-19T06:45:33.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.106+0000 7f220d5da640 1 -- 172.21.15.99:0/4187531668 shutdown_connections 2024-09-19T06:45:33.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.106+0000 7f220d5da640 1 --2- 172.21.15.99:0/4187531668 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f22080fac60 0x7f22080fb0b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:33.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.106+0000 7f220d5da640 1 --2- 172.21.15.99:0/4187531668 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22081025f0 0x7f22081029c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:33.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.106+0000 7f220d5da640 1 -- 172.21.15.99:0/4187531668 >> 172.21.15.99:0/4187531668 conn(0x7f2208070c80 msgr2=0x7f2208071080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:33.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.106+0000 7f220d5da640 1 -- 172.21.15.99:0/4187531668 shutdown_connections 2024-09-19T06:45:33.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.106+0000 7f220d5da640 1 -- 172.21.15.99:0/4187531668 wait complete. 2024-09-19T06:45:33.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.107+0000 7f220d5da640 1 Processor -- start 2024-09-19T06:45:33.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.107+0000 7f220d5da640 1 -- start start 2024-09-19T06:45:33.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.107+0000 7f220d5da640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22080fac60 0x7f22081131f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:33.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.107+0000 7f220d5da640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f22081025f0 0x7f2208113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:33.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.107+0000 7f220d5da640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2208113dc0 con 0x7f22081025f0 2024-09-19T06:45:33.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.107+0000 7f220d5da640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f220810d170 con 0x7f22080fac60 2024-09-19T06:45:33.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.107+0000 7f22067fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f22081025f0 0x7f2208113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:33.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.107+0000 7f22067fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f22081025f0 0x7f2208113730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40816/0 (socket says 172.21.15.99:40816) 2024-09-19T06:45:33.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.107+0000 7f22067fc640 1 -- 172.21.15.99:0/287292619 learned_addr learned my addr 172.21.15.99:0/287292619 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:45:33.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.107+0000 7f2206ffd640 1 --2- 172.21.15.99:0/287292619 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22080fac60 0x7f22081131f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:33.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.107+0000 7f22067fc640 1 -- 172.21.15.99:0/287292619 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22080fac60 msgr2=0x7f22081131f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:33.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.107+0000 7f22067fc640 1 --2- 172.21.15.99:0/287292619 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22080fac60 0x7f22081131f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:33.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.107+0000 7f22067fc640 1 -- 172.21.15.99:0/287292619 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21fc005040 con 0x7f22081025f0 2024-09-19T06:45:33.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.107+0000 7f2206ffd640 1 --2- 172.21.15.99:0/287292619 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22080fac60 0x7f22081131f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:45:33.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.108+0000 7f22067fc640 1 --2- 172.21.15.99:0/287292619 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f22081025f0 0x7f2208113730 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f21fc003080 tx=0x7f21fc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:33.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.108+0000 7f21ef7fe640 1 -- 172.21.15.99:0/287292619 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21fc038070 con 0x7f22081025f0 2024-09-19T06:45:33.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.108+0000 7f220d5da640 1 -- 172.21.15.99:0/287292619 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f220810d3f0 con 0x7f22081025f0 2024-09-19T06:45:33.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.108+0000 7f21ef7fe640 1 -- 172.21.15.99:0/287292619 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f21fc0097e0 con 0x7f22081025f0 2024-09-19T06:45:33.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.108+0000 7f220d5da640 1 -- 172.21.15.99:0/287292619 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f220810d8b0 con 0x7f22081025f0 2024-09-19T06:45:33.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.108+0000 7f21ef7fe640 1 -- 172.21.15.99:0/287292619 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21fc03d420 con 0x7f22081025f0 2024-09-19T06:45:33.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.109+0000 7f220d5da640 1 -- 172.21.15.99:0/287292619 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2208065810 con 0x7f22081025f0 2024-09-19T06:45:33.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.110+0000 7f21ef7fe640 1 -- 172.21.15.99:0/287292619 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f21fc030020 con 0x7f22081025f0 2024-09-19T06:45:33.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.111+0000 7f21ef7fe640 1 --2- 172.21.15.99:0/287292619 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f21f006e530 0x7f21f00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:33.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.111+0000 7f21ef7fe640 1 -- 172.21.15.99:0/287292619 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f21fc0ae5d0 con 0x7f22081025f0 2024-09-19T06:45:33.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.111+0000 7f2206ffd640 1 --2- 172.21.15.99:0/287292619 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f21f006e530 0x7f21f00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:33.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.111+0000 7f2206ffd640 1 --2- 172.21.15.99:0/287292619 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f21f006e530 0x7f21f00709e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f21f8009a80 tx=0x7f21f8008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:33.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.116+0000 7f21ef7fe640 1 -- 172.21.15.99:0/287292619 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f21fc0777e0 con 0x7f22081025f0 2024-09-19T06:45:33.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.319+0000 7f220d5da640 1 -- 172.21.15.99:0/287292619 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2208109680 con 0x7f21f006e530 2024-09-19T06:45:33.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.320+0000 7f21ef7fe640 1 -- 172.21.15.99:0/287292619 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f2208109680 con 0x7f21f006e530 2024-09-19T06:45:33.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.322+0000 7f220d5da640 1 -- 172.21.15.99:0/287292619 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f21f006e530 msgr2=0x7f21f00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:33.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.322+0000 7f220d5da640 1 --2- 172.21.15.99:0/287292619 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f21f006e530 0x7f21f00709e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f21f8009a80 tx=0x7f21f8008040 comp rx=0 tx=0).stop 2024-09-19T06:45:33.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.322+0000 7f220d5da640 1 -- 172.21.15.99:0/287292619 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f22081025f0 msgr2=0x7f2208113730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:33.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.322+0000 7f220d5da640 1 --2- 172.21.15.99:0/287292619 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f22081025f0 0x7f2208113730 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f21fc003080 tx=0x7f21fc009da0 comp rx=0 tx=0).stop 2024-09-19T06:45:33.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.322+0000 7f220d5da640 1 -- 172.21.15.99:0/287292619 shutdown_connections 2024-09-19T06:45:33.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.322+0000 7f220d5da640 1 --2- 172.21.15.99:0/287292619 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f21f006e530 0x7f21f00709e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:33.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.322+0000 7f220d5da640 1 --2- 172.21.15.99:0/287292619 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f22081025f0 0x7f2208113730 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:33.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.322+0000 7f220d5da640 1 --2- 172.21.15.99:0/287292619 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22080fac60 0x7f22081131f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:33.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.322+0000 7f220d5da640 1 -- 172.21.15.99:0/287292619 >> 172.21.15.99:0/287292619 conn(0x7f2208070c80 msgr2=0x7f22080f9f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:33.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.322+0000 7f220d5da640 1 -- 172.21.15.99:0/287292619 shutdown_connections 2024-09-19T06:45:33.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.323+0000 7f220d5da640 1 -- 172.21.15.99:0/287292619 wait complete. 2024-09-19T06:45:33.332 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-09-19T06:45:33.380 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:33 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:45:33.381 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:33 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:45:33.381 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:33 smithi099 ceph-mon[97031]: pgmap v68: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 51/321 objects degraded (15.888%) 2024-09-19T06:45:33.381 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:33 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:45:33.381 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:33 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:45:33.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.405+0000 7f320bb78640 1 -- 172.21.15.99:0/1752541115 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3204102550 msgr2=0x7f3204102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:33.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.405+0000 7f320bb78640 1 --2- 172.21.15.99:0/1752541115 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3204102550 0x7f3204102920 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f32000048d0 tx=0x7f3200009da0 comp rx=0 tx=0).stop 2024-09-19T06:45:33.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.405+0000 7f320bb78640 1 -- 172.21.15.99:0/1752541115 shutdown_connections 2024-09-19T06:45:33.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.405+0000 7f320bb78640 1 --2- 172.21.15.99:0/1752541115 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3204102ef0 0x7f32040fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:33.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.405+0000 7f320bb78640 1 --2- 172.21.15.99:0/1752541115 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3204102550 0x7f3204102920 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:33.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.405+0000 7f320bb78640 1 -- 172.21.15.99:0/1752541115 >> 172.21.15.99:0/1752541115 conn(0x7f32040f80f0 msgr2=0x7f32040fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:33.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.405+0000 7f320bb78640 1 -- 172.21.15.99:0/1752541115 shutdown_connections 2024-09-19T06:45:33.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.405+0000 7f320bb78640 1 -- 172.21.15.99:0/1752541115 wait complete. 2024-09-19T06:45:33.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.405+0000 7f320bb78640 1 Processor -- start 2024-09-19T06:45:33.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.406+0000 7f320bb78640 1 -- start start 2024-09-19T06:45:33.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.406+0000 7f320bb78640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3204102550 0x7f320406fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:33.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.406+0000 7f320bb78640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3204102ef0 0x7f320406ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:33.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.406+0000 7f320bb78640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3204070490 con 0x7f3204102ef0 2024-09-19T06:45:33.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.406+0000 7f320bb78640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3204070600 con 0x7f3204102550 2024-09-19T06:45:33.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.406+0000 7f3209113640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3204102ef0 0x7f320406ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:33.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.406+0000 7f3209113640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3204102ef0 0x7f320406ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40828/0 (socket says 172.21.15.99:40828) 2024-09-19T06:45:33.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.406+0000 7f3209113640 1 -- 172.21.15.99:0/603750573 learned_addr learned my addr 172.21.15.99:0/603750573 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:45:33.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.406+0000 7f3209914640 1 --2- 172.21.15.99:0/603750573 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3204102550 0x7f320406fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:33.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.406+0000 7f3209113640 1 -- 172.21.15.99:0/603750573 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3204102550 msgr2=0x7f320406fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:33.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.406+0000 7f3209113640 1 --2- 172.21.15.99:0/603750573 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3204102550 0x7f320406fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:33.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.406+0000 7f3209113640 1 -- 172.21.15.99:0/603750573 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3200005040 con 0x7f3204102ef0 2024-09-19T06:45:33.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.406+0000 7f3209113640 1 --2- 172.21.15.99:0/603750573 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3204102ef0 0x7f320406ff50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f31f400eb40 tx=0x7f31f400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:33.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.406+0000 7f31fa7fc640 1 -- 172.21.15.99:0/603750573 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31f4007c30 con 0x7f3204102ef0 2024-09-19T06:45:33.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.407+0000 7f320bb78640 1 -- 172.21.15.99:0/603750573 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3204070830 con 0x7f3204102ef0 2024-09-19T06:45:33.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.407+0000 7f31fa7fc640 1 -- 172.21.15.99:0/603750573 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f31f400f040 con 0x7f3204102ef0 2024-09-19T06:45:33.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.407+0000 7f31fa7fc640 1 -- 172.21.15.99:0/603750573 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31f4009600 con 0x7f3204102ef0 2024-09-19T06:45:33.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.407+0000 7f320bb78640 1 -- 172.21.15.99:0/603750573 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3204119c10 con 0x7f3204102ef0 2024-09-19T06:45:33.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.408+0000 7f320bb78640 1 -- 172.21.15.99:0/603750573 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32040fdcd0 con 0x7f3204102ef0 2024-09-19T06:45:33.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.408+0000 7f31fa7fc640 1 -- 172.21.15.99:0/603750573 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f31f4009760 con 0x7f3204102ef0 2024-09-19T06:45:33.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.409+0000 7f31fa7fc640 1 --2- 172.21.15.99:0/603750573 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f31f006e530 0x7f31f00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:33.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.409+0000 7f31fa7fc640 1 -- 172.21.15.99:0/603750573 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f31f408ddf0 con 0x7f3204102ef0 2024-09-19T06:45:33.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.409+0000 7f3209914640 1 --2- 172.21.15.99:0/603750573 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f31f006e530 0x7f31f00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:33.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.409+0000 7f3209914640 1 --2- 172.21.15.99:0/603750573 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f31f006e530 0x7f31f00709e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3200009ac0 tx=0x7f3200035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:33.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.413+0000 7f31fa7fc640 1 -- 172.21.15.99:0/603750573 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f31f4056f80 con 0x7f3204102ef0 2024-09-19T06:45:33.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:33 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:45:33.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:33 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:45:33.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:33 smithi117 ceph-mon[76771]: pgmap v68: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 51/321 objects degraded (15.888%) 2024-09-19T06:45:33.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:33 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:45:33.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:33 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:45:33.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.604+0000 7f320bb78640 1 -- 172.21.15.99:0/603750573 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f320404b720 con 0x7f31f006e530 2024-09-19T06:45:33.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.606+0000 7f31fa7fc640 1 -- 172.21.15.99:0/603750573 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f320404b720 con 0x7f31f006e530 2024-09-19T06:45:33.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.608+0000 7f320bb78640 1 -- 172.21.15.99:0/603750573 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f31f006e530 msgr2=0x7f31f00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:33.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.608+0000 7f320bb78640 1 --2- 172.21.15.99:0/603750573 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f31f006e530 0x7f31f00709e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3200009ac0 tx=0x7f3200035040 comp rx=0 tx=0).stop 2024-09-19T06:45:33.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.608+0000 7f320bb78640 1 -- 172.21.15.99:0/603750573 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3204102ef0 msgr2=0x7f320406ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:33.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.608+0000 7f320bb78640 1 --2- 172.21.15.99:0/603750573 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3204102ef0 0x7f320406ff50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f31f400eb40 tx=0x7f31f400b040 comp rx=0 tx=0).stop 2024-09-19T06:45:33.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.608+0000 7f320bb78640 1 -- 172.21.15.99:0/603750573 shutdown_connections 2024-09-19T06:45:33.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.608+0000 7f320bb78640 1 --2- 172.21.15.99:0/603750573 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f31f006e530 0x7f31f00709e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:33.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.608+0000 7f320bb78640 1 --2- 172.21.15.99:0/603750573 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3204102ef0 0x7f320406ff50 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:33.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.608+0000 7f320bb78640 1 --2- 172.21.15.99:0/603750573 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3204102550 0x7f320406fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:33.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.608+0000 7f320bb78640 1 -- 172.21.15.99:0/603750573 >> 172.21.15.99:0/603750573 conn(0x7f32040f80f0 msgr2=0x7f32040f9160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:33.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.608+0000 7f320bb78640 1 -- 172.21.15.99:0/603750573 shutdown_connections 2024-09-19T06:45:33.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.609+0000 7f320bb78640 1 -- 172.21.15.99:0/603750573 wait complete. 2024-09-19T06:45:33.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.692+0000 7f427c367640 1 -- 172.21.15.99:0/1102971818 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f42740fb480 msgr2=0x7f42740fb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:33.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.692+0000 7f427c367640 1 --2- 172.21.15.99:0/1102971818 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f42740fb480 0x7f42740fb8f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f42680048d0 tx=0x7f4268009da0 comp rx=0 tx=0).stop 2024-09-19T06:45:33.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.693+0000 7f427c367640 1 -- 172.21.15.99:0/1102971818 shutdown_connections 2024-09-19T06:45:33.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.693+0000 7f427c367640 1 --2- 172.21.15.99:0/1102971818 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f42740fb480 0x7f42740fb8f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:33.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.693+0000 7f427c367640 1 --2- 172.21.15.99:0/1102971818 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f42741014c0 0x7f4274101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:33.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.693+0000 7f427c367640 1 -- 172.21.15.99:0/1102971818 >> 172.21.15.99:0/1102971818 conn(0x7f42740f7000 msgr2=0x7f42740f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:33.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.693+0000 7f427c367640 1 -- 172.21.15.99:0/1102971818 shutdown_connections 2024-09-19T06:45:33.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.693+0000 7f427c367640 1 -- 172.21.15.99:0/1102971818 wait complete. 2024-09-19T06:45:33.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.693+0000 7f427c367640 1 Processor -- start 2024-09-19T06:45:33.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.693+0000 7f427c367640 1 -- start start 2024-09-19T06:45:33.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.693+0000 7f427c367640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f42740fb480 0x7f42741131c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:33.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.693+0000 7f427c367640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f42741014c0 0x7f4274113700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:33.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.693+0000 7f427c367640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4274113d00 con 0x7f42740fb480 2024-09-19T06:45:33.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.693+0000 7f427c367640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f427410d140 con 0x7f42741014c0 2024-09-19T06:45:33.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.693+0000 7f427a103640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f42740fb480 0x7f42741131c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:33.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.694+0000 7f427a103640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f42740fb480 0x7f42741131c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40846/0 (socket says 172.21.15.99:40846) 2024-09-19T06:45:33.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.694+0000 7f427a103640 1 -- 172.21.15.99:0/3008025244 learned_addr learned my addr 172.21.15.99:0/3008025244 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:45:33.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.694+0000 7f4279902640 1 --2- 172.21.15.99:0/3008025244 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f42741014c0 0x7f4274113700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:33.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.694+0000 7f427a103640 1 -- 172.21.15.99:0/3008025244 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f42741014c0 msgr2=0x7f4274113700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:33.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.694+0000 7f427a103640 1 --2- 172.21.15.99:0/3008025244 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f42741014c0 0x7f4274113700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:33.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.694+0000 7f427a103640 1 -- 172.21.15.99:0/3008025244 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4268005040 con 0x7f42740fb480 2024-09-19T06:45:33.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.694+0000 7f427a103640 1 --2- 172.21.15.99:0/3008025244 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f42740fb480 0x7f42741131c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f426c002a50 tx=0x7f426c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:33.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.694+0000 7f4272ffd640 1 -- 172.21.15.99:0/3008025244 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f426c007c30 con 0x7f42740fb480 2024-09-19T06:45:33.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.694+0000 7f4272ffd640 1 -- 172.21.15.99:0/3008025244 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f426c00f040 con 0x7f42740fb480 2024-09-19T06:45:33.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.694+0000 7f427c367640 1 -- 172.21.15.99:0/3008025244 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f427410d420 con 0x7f42740fb480 2024-09-19T06:45:33.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.694+0000 7f4272ffd640 1 -- 172.21.15.99:0/3008025244 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f426c00dad0 con 0x7f42740fb480 2024-09-19T06:45:33.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.694+0000 7f427c367640 1 -- 172.21.15.99:0/3008025244 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f427410d990 con 0x7f42740fb480 2024-09-19T06:45:33.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.696+0000 7f427c367640 1 -- 172.21.15.99:0/3008025244 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42740fcbc0 con 0x7f42740fb480 2024-09-19T06:45:33.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.696+0000 7f4272ffd640 1 -- 172.21.15.99:0/3008025244 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f426c00dc30 con 0x7f42740fb480 2024-09-19T06:45:33.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.696+0000 7f4272ffd640 1 --2- 172.21.15.99:0/3008025244 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f425c06e530 0x7f425c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:33.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.696+0000 7f4272ffd640 1 -- 172.21.15.99:0/3008025244 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f426c08de90 con 0x7f42740fb480 2024-09-19T06:45:33.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.696+0000 7f4279902640 1 --2- 172.21.15.99:0/3008025244 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f425c06e530 0x7f425c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:33.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.697+0000 7f4279902640 1 --2- 172.21.15.99:0/3008025244 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f425c06e530 0x7f425c0709e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4268009ac0 tx=0x7f4268035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:33.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.705+0000 7f4272ffd640 1 -- 172.21.15.99:0/3008025244 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f426c0570a0 con 0x7f42740fb480 2024-09-19T06:45:33.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.889+0000 7f427c367640 1 -- 172.21.15.99:0/3008025244 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f427404b720 con 0x7f425c06e530 2024-09-19T06:45:33.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.898+0000 7f4272ffd640 1 -- 172.21.15.99:0/3008025244 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f427404b720 con 0x7f425c06e530 2024-09-19T06:45:33.900 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T06:45:33.900 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.smithi099 smithi099 *:9093,9094 running (4m) 1s ago 12m 23.4M - 0.25.0 c8568f914cd2 e7c1774d56b0 2024-09-19T06:45:33.900 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi099 smithi099 running (66s) 1s ago 13m 6899k - 19.1.1-361-g2f599a46 d2baa855c067 b9775f416b10 2024-09-19T06:45:33.900 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi117 smithi117 running (61s) 58s ago 12m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 38cf60c0d548 2024-09-19T06:45:33.900 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.smithi099 smithi099 *:3000 running (3m) 1s ago 12m 77.6M - 9.4.12 2bacad6d85d8 cd53a18d5410 2024-09-19T06:45:33.900 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.obarqf smithi099 running (7m) 1s ago 7m 14.0M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 e36c9b74004b 2024-09-19T06:45:33.900 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.xehbxe smithi099 running (7m) 1s ago 7m 121M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 d09eb3d306ae 2024-09-19T06:45:33.900 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.bheqzh smithi117 running (7m) 58s ago 7m 15.4M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 21253e27fdd3 2024-09-19T06:45:33.900 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.nooexo smithi117 running (7m) 58s ago 7m 109M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 ad1faeb3343c 2024-09-19T06:45:33.900 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi099.pgvkqi smithi099 *:8443,9283,8765 running (4m) 1s ago 14m 498M - 19.1.1-361-g2f599a46 d2baa855c067 d5de99cb7e78 2024-09-19T06:45:33.900 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi117.ssmkcf smithi117 *:8443,9283,8765 running (3m) 58s ago 12m 441M - 19.1.1-361-g2f599a46 d2baa855c067 8b7ee0f871f5 2024-09-19T06:45:33.900 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi099 smithi099 running (2m) 1s ago 14m 46.7M 2048M 19.1.1-361-g2f599a46 d2baa855c067 ffe067438824 2024-09-19T06:45:33.900 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi117 smithi117 running (101s) 58s ago 12m 33.3M 2048M 19.1.1-361-g2f599a46 d2baa855c067 4cb7455e3ee7 2024-09-19T06:45:33.901 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi099 smithi099 *:9100 running (4m) 1s ago 13m 15.4M - 1.5.0 0da6a335fe13 dca7b4517dcc 2024-09-19T06:45:33.901 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi117 smithi117 *:9100 running (4m) 58s ago 12m 16.0M - 1.5.0 0da6a335fe13 8233ce3835d2 2024-09-19T06:45:33.901 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (42s) 1s ago 11m 95.5M 1557M 19.1.1-361-g2f599a46 d2baa855c067 8e22543bf933 2024-09-19T06:45:33.901 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (6s) 1s ago 10m 14.5M 1557M 19.1.1-361-g2f599a46 d2baa855c067 f54153d0ae09 2024-09-19T06:45:33.901 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (10m) 1s ago 10m 201M 1557M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 cedc7e3698d8 2024-09-19T06:45:33.901 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi117 running (10m) 58s ago 10m 261M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 5984ed999c91 2024-09-19T06:45:33.901 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi117 running (9m) 58s ago 9m 232M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 6a2fc0c51c05 2024-09-19T06:45:33.901 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi117 running (9m) 58s ago 9m 226M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 39dcb7dbf0e3 2024-09-19T06:45:33.901 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.smithi099 smithi099 *:9095 running (3m) 1s ago 12m 63.1M - 2.43.0 a07b618ecd1d 15ad26ec6fb4 2024-09-19T06:45:33.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.902+0000 7f427c367640 1 -- 172.21.15.99:0/3008025244 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f425c06e530 msgr2=0x7f425c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:33.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.902+0000 7f427c367640 1 --2- 172.21.15.99:0/3008025244 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f425c06e530 0x7f425c0709e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4268009ac0 tx=0x7f4268035040 comp rx=0 tx=0).stop 2024-09-19T06:45:33.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.902+0000 7f427c367640 1 -- 172.21.15.99:0/3008025244 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f42740fb480 msgr2=0x7f42741131c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:33.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.902+0000 7f427c367640 1 --2- 172.21.15.99:0/3008025244 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f42740fb480 0x7f42741131c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f426c002a50 tx=0x7f426c004600 comp rx=0 tx=0).stop 2024-09-19T06:45:33.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.902+0000 7f427c367640 1 -- 172.21.15.99:0/3008025244 shutdown_connections 2024-09-19T06:45:33.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.902+0000 7f427c367640 1 --2- 172.21.15.99:0/3008025244 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f425c06e530 0x7f425c0709e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:33.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.902+0000 7f427c367640 1 --2- 172.21.15.99:0/3008025244 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f42741014c0 0x7f4274113700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:33.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.902+0000 7f427c367640 1 --2- 172.21.15.99:0/3008025244 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f42740fb480 0x7f42741131c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:33.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.902+0000 7f427c367640 1 -- 172.21.15.99:0/3008025244 >> 172.21.15.99:0/3008025244 conn(0x7f42740f7000 msgr2=0x7f4274065a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:33.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.902+0000 7f427c367640 1 -- 172.21.15.99:0/3008025244 shutdown_connections 2024-09-19T06:45:33.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.902+0000 7f427c367640 1 -- 172.21.15.99:0/3008025244 wait complete. 2024-09-19T06:45:33.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.985+0000 7f8c52096640 1 -- 172.21.15.99:0/1440131790 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c4c064fe0 msgr2=0x7f8c4c065430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:33.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.985+0000 7f8c52096640 1 --2- 172.21.15.99:0/1440131790 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c4c064fe0 0x7f8c4c065430 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8c400048d0 tx=0x7f8c40009da0 comp rx=0 tx=0).stop 2024-09-19T06:45:33.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.985+0000 7f8c52096640 1 -- 172.21.15.99:0/1440131790 shutdown_connections 2024-09-19T06:45:33.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.985+0000 7f8c52096640 1 --2- 172.21.15.99:0/1440131790 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c4c064fe0 0x7f8c4c065430 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:33.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.985+0000 7f8c52096640 1 --2- 172.21.15.99:0/1440131790 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c4c0fe450 0x7f8c4c0fe820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:33.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.985+0000 7f8c52096640 1 -- 172.21.15.99:0/1440131790 >> 172.21.15.99:0/1440131790 conn(0x7f8c4c0723b0 msgr2=0x7f8c4c0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:33.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.985+0000 7f8c52096640 1 -- 172.21.15.99:0/1440131790 shutdown_connections 2024-09-19T06:45:33.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.985+0000 7f8c52096640 1 -- 172.21.15.99:0/1440131790 wait complete. 2024-09-19T06:45:33.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.985+0000 7f8c52096640 1 Processor -- start 2024-09-19T06:45:33.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.986+0000 7f8c52096640 1 -- start start 2024-09-19T06:45:33.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.986+0000 7f8c52096640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c4c064fe0 0x7f8c4c0fb560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:33.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.986+0000 7f8c52096640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c4c0fe450 0x7f8c4c0fbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:33.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.986+0000 7f8c52096640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c4c0fbfe0 con 0x7f8c4c0fe450 2024-09-19T06:45:33.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.986+0000 7f8c52096640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c4c0fc150 con 0x7f8c4c064fe0 2024-09-19T06:45:33.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.986+0000 7f8c4affd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c4c0fe450 0x7f8c4c0fbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:33.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.986+0000 7f8c4affd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c4c0fe450 0x7f8c4c0fbaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40868/0 (socket says 172.21.15.99:40868) 2024-09-19T06:45:33.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.986+0000 7f8c4affd640 1 -- 172.21.15.99:0/3597140965 learned_addr learned my addr 172.21.15.99:0/3597140965 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:45:33.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.986+0000 7f8c4b7fe640 1 --2- 172.21.15.99:0/3597140965 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c4c064fe0 0x7f8c4c0fb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:33.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.987+0000 7f8c4affd640 1 -- 172.21.15.99:0/3597140965 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c4c064fe0 msgr2=0x7f8c4c0fb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:33.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.987+0000 7f8c4affd640 1 --2- 172.21.15.99:0/3597140965 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c4c064fe0 0x7f8c4c0fb560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:33.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.987+0000 7f8c4affd640 1 -- 172.21.15.99:0/3597140965 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c40005040 con 0x7f8c4c0fe450 2024-09-19T06:45:33.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.987+0000 7f8c4affd640 1 --2- 172.21.15.99:0/3597140965 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c4c0fe450 0x7f8c4c0fbaa0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8c40003080 tx=0x7f8c40009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:33.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.987+0000 7f8c33fff640 1 -- 172.21.15.99:0/3597140965 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c40038070 con 0x7f8c4c0fe450 2024-09-19T06:45:33.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.987+0000 7f8c33fff640 1 -- 172.21.15.99:0/3597140965 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8c400097e0 con 0x7f8c4c0fe450 2024-09-19T06:45:33.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.987+0000 7f8c52096640 1 -- 172.21.15.99:0/3597140965 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c4c0fc380 con 0x7f8c4c0fe450 2024-09-19T06:45:33.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.987+0000 7f8c33fff640 1 -- 172.21.15.99:0/3597140965 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c4003d420 con 0x7f8c4c0fe450 2024-09-19T06:45:33.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.987+0000 7f8c52096640 1 -- 172.21.15.99:0/3597140965 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c4c119820 con 0x7f8c4c0fe450 2024-09-19T06:45:33.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.989+0000 7f8c52096640 1 -- 172.21.15.99:0/3597140965 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c4c0fdce0 con 0x7f8c4c0fe450 2024-09-19T06:45:33.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.990+0000 7f8c33fff640 1 -- 172.21.15.99:0/3597140965 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f8c40030020 con 0x7f8c4c0fe450 2024-09-19T06:45:33.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.990+0000 7f8c33fff640 1 --2- 172.21.15.99:0/3597140965 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f8c3406e530 0x7f8c340709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:33.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.991+0000 7f8c33fff640 1 -- 172.21.15.99:0/3597140965 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f8c400ae7f0 con 0x7f8c4c0fe450 2024-09-19T06:45:33.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.991+0000 7f8c4b7fe640 1 --2- 172.21.15.99:0/3597140965 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f8c3406e530 0x7f8c340709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:33.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.991+0000 7f8c4b7fe640 1 --2- 172.21.15.99:0/3597140965 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f8c3406e530 0x7f8c340709e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c0041d0 tx=0x7f8c3c004330 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:33.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:33.998+0000 7f8c33fff640 1 -- 172.21.15.99:0/3597140965 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f8c40077a00 con 0x7f8c4c0fe450 2024-09-19T06:45:34.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.247+0000 7f8c52096640 1 -- 172.21.15.99:0/3597140965 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8c4c0fcc80 con 0x7f8c4c0fe450 2024-09-19T06:45:34.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.248+0000 7f8c33fff640 1 -- 172.21.15.99:0/3597140965 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+850 (secure 0 0 0) 0x7f8c4007b0c0 con 0x7f8c4c0fe450 2024-09-19T06:45:34.249 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:45:34.249 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-09-19T06:45:34.249 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T06:45:34.249 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:45:34.250 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-09-19T06:45:34.250 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T06:45:34.250 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:45:34.250 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-09-19T06:45:34.250 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 4, 2024-09-19T06:45:34.250 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 1 2024-09-19T06:45:34.250 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:45:34.250 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": { 2024-09-19T06:45:34.250 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 4 2024-09-19T06:45:34.250 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:45:34.250 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-09-19T06:45:34.250 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 8, 2024-09-19T06:45:34.250 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 5 2024-09-19T06:45:34.250 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T06:45:34.251 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:45:34.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.250+0000 7f8c52096640 1 -- 172.21.15.99:0/3597140965 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f8c3406e530 msgr2=0x7f8c340709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:34.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.250+0000 7f8c52096640 1 --2- 172.21.15.99:0/3597140965 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f8c3406e530 0x7f8c340709e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c0041d0 tx=0x7f8c3c004330 comp rx=0 tx=0).stop 2024-09-19T06:45:34.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.250+0000 7f8c52096640 1 -- 172.21.15.99:0/3597140965 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c4c0fe450 msgr2=0x7f8c4c0fbaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:34.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.250+0000 7f8c52096640 1 --2- 172.21.15.99:0/3597140965 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c4c0fe450 0x7f8c4c0fbaa0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8c40003080 tx=0x7f8c40009da0 comp rx=0 tx=0).stop 2024-09-19T06:45:34.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.250+0000 7f8c52096640 1 -- 172.21.15.99:0/3597140965 shutdown_connections 2024-09-19T06:45:34.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.250+0000 7f8c52096640 1 --2- 172.21.15.99:0/3597140965 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f8c3406e530 0x7f8c340709e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:34.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.250+0000 7f8c52096640 1 --2- 172.21.15.99:0/3597140965 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8c4c0fe450 0x7f8c4c0fbaa0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:34.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.250+0000 7f8c52096640 1 --2- 172.21.15.99:0/3597140965 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c4c064fe0 0x7f8c4c0fb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:34.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.250+0000 7f8c52096640 1 -- 172.21.15.99:0/3597140965 >> 172.21.15.99:0/3597140965 conn(0x7f8c4c0723b0 msgr2=0x7f8c4c105390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:34.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.250+0000 7f8c52096640 1 -- 172.21.15.99:0/3597140965 shutdown_connections 2024-09-19T06:45:34.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.250+0000 7f8c52096640 1 -- 172.21.15.99:0/3597140965 wait complete. 2024-09-19T06:45:34.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.331+0000 7fc284f55640 1 -- 172.21.15.99:0/1241860335 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2800fb810 msgr2=0x7fc2800fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:34.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.331+0000 7fc284f55640 1 --2- 172.21.15.99:0/1241860335 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2800fb810 0x7fc2800fbbe0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc2700048d0 tx=0x7fc270009da0 comp rx=0 tx=0).stop 2024-09-19T06:45:34.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.331+0000 7fc284f55640 1 -- 172.21.15.99:0/1241860335 shutdown_connections 2024-09-19T06:45:34.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.331+0000 7fc284f55640 1 --2- 172.21.15.99:0/1241860335 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2800fcf80 0x7fc2800fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:34.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.332+0000 7fc284f55640 1 --2- 172.21.15.99:0/1241860335 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2800fb810 0x7fc2800fbbe0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:34.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.332+0000 7fc284f55640 1 -- 172.21.15.99:0/1241860335 >> 172.21.15.99:0/1241860335 conn(0x7fc2800723b0 msgr2=0x7fc2800727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:34.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.332+0000 7fc284f55640 1 -- 172.21.15.99:0/1241860335 shutdown_connections 2024-09-19T06:45:34.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.332+0000 7fc284f55640 1 -- 172.21.15.99:0/1241860335 wait complete. 2024-09-19T06:45:34.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.332+0000 7fc284f55640 1 Processor -- start 2024-09-19T06:45:34.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.332+0000 7fc284f55640 1 -- start start 2024-09-19T06:45:34.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.332+0000 7fc284f55640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2800fb810 0x7fc28010e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:34.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.332+0000 7fc284f55640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2800fcf80 0x7fc28010e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:34.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.332+0000 7fc284f55640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc28010ed00 con 0x7fc2800fcf80 2024-09-19T06:45:34.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.332+0000 7fc284f55640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc28010ee70 con 0x7fc2800fb810 2024-09-19T06:45:34.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.332+0000 7fc27dd9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2800fcf80 0x7fc28010e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:34.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.332+0000 7fc27dd9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2800fcf80 0x7fc28010e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40896/0 (socket says 172.21.15.99:40896) 2024-09-19T06:45:34.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.332+0000 7fc27dd9b640 1 -- 172.21.15.99:0/1855783490 learned_addr learned my addr 172.21.15.99:0/1855783490 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:45:34.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.332+0000 7fc27e59c640 1 --2- 172.21.15.99:0/1855783490 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2800fb810 0x7fc28010e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:34.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.333+0000 7fc27dd9b640 1 -- 172.21.15.99:0/1855783490 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2800fb810 msgr2=0x7fc28010e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:34.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.333+0000 7fc27dd9b640 1 --2- 172.21.15.99:0/1855783490 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2800fb810 0x7fc28010e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:34.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.333+0000 7fc27dd9b640 1 -- 172.21.15.99:0/1855783490 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc270005040 con 0x7fc2800fcf80 2024-09-19T06:45:34.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.333+0000 7fc27e59c640 1 --2- 172.21.15.99:0/1855783490 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2800fb810 0x7fc28010e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:45:34.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.333+0000 7fc27dd9b640 1 --2- 172.21.15.99:0/1855783490 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2800fcf80 0x7fc28010e6b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc268002a50 tx=0x7fc268004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:34.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.333+0000 7fc276ffd640 1 -- 172.21.15.99:0/1855783490 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc268007c30 con 0x7fc2800fcf80 2024-09-19T06:45:34.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.333+0000 7fc276ffd640 1 -- 172.21.15.99:0/1855783490 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc26800f040 con 0x7fc2800fcf80 2024-09-19T06:45:34.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.333+0000 7fc284f55640 1 -- 172.21.15.99:0/1855783490 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2801171e0 con 0x7fc2800fcf80 2024-09-19T06:45:34.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.333+0000 7fc276ffd640 1 -- 172.21.15.99:0/1855783490 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2680094b0 con 0x7fc2800fcf80 2024-09-19T06:45:34.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.333+0000 7fc284f55640 1 -- 172.21.15.99:0/1855783490 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2801176f0 con 0x7fc2800fcf80 2024-09-19T06:45:34.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.334+0000 7fc284f55640 1 -- 172.21.15.99:0/1855783490 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2800fcbc0 con 0x7fc2800fcf80 2024-09-19T06:45:34.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.335+0000 7fc276ffd640 1 -- 172.21.15.99:0/1855783490 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fc26800dc50 con 0x7fc2800fcf80 2024-09-19T06:45:34.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.335+0000 7fc276ffd640 1 --2- 172.21.15.99:0/1855783490 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fc26c06e530 0x7fc26c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:34.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.335+0000 7fc276ffd640 1 -- 172.21.15.99:0/1855783490 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fc26808de30 con 0x7fc2800fcf80 2024-09-19T06:45:34.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.335+0000 7fc27e59c640 1 --2- 172.21.15.99:0/1855783490 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fc26c06e530 0x7fc26c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:34.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.336+0000 7fc27e59c640 1 --2- 172.21.15.99:0/1855783490 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fc26c06e530 0x7fc26c0709e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc270009ac0 tx=0x7fc270035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:34.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.340+0000 7fc276ffd640 1 -- 172.21.15.99:0/1855783490 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fc26805aaf0 con 0x7fc2800fcf80 2024-09-19T06:45:34.555 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:34 smithi099 ceph-mon[97031]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:45:34.555 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:34 smithi099 ceph-mon[97031]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:45:34.555 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:34 smithi099 ceph-mon[97031]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:45:34.555 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:34 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/3597140965' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:45:34.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:34 smithi117 ceph-mon[76771]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:45:34.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:34 smithi117 ceph-mon[76771]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:45:34.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:34 smithi117 ceph-mon[76771]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:45:34.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:34 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/3597140965' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:45:34.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.579+0000 7fc284f55640 1 -- 172.21.15.99:0/1855783490 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc280072ec0 con 0x7fc2800fcf80 2024-09-19T06:45:34.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.580+0000 7fc276ffd640 1 -- 172.21.15.99:0/1855783490 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1941 (secure 0 0 0) 0x7fc26805a680 con 0x7fc2800fcf80 2024-09-19T06:45:34.581 INFO:teuthology.orchestra.run.smithi099.stdout:e19 2024-09-19T06:45:34.581 INFO:teuthology.orchestra.run.smithi099.stdout:btime 2024-09-19T06:44:03:270764+0000 2024-09-19T06:45:34.581 INFO:teuthology.orchestra.run.smithi099.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T06:45:34.581 INFO:teuthology.orchestra.run.smithi099.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T06:45:34.582 INFO:teuthology.orchestra.run.smithi099.stdout:legacy client fscid: 1 2024-09-19T06:45:34.582 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:45:34.582 INFO:teuthology.orchestra.run.smithi099.stdout:Filesystem 'cephfs' (1) 2024-09-19T06:45:34.582 INFO:teuthology.orchestra.run.smithi099.stdout:fs_name cephfs 2024-09-19T06:45:34.582 INFO:teuthology.orchestra.run.smithi099.stdout:epoch 19 2024-09-19T06:45:34.582 INFO:teuthology.orchestra.run.smithi099.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-19T06:45:34.582 INFO:teuthology.orchestra.run.smithi099.stdout:created 2024-09-19T06:37:40.838146+0000 2024-09-19T06:45:34.582 INFO:teuthology.orchestra.run.smithi099.stdout:modified 2024-09-19T06:44:02.356718+0000 2024-09-19T06:45:34.582 INFO:teuthology.orchestra.run.smithi099.stdout:tableserver 0 2024-09-19T06:45:34.582 INFO:teuthology.orchestra.run.smithi099.stdout:root 0 2024-09-19T06:45:34.582 INFO:teuthology.orchestra.run.smithi099.stdout:session_timeout 60 2024-09-19T06:45:34.582 INFO:teuthology.orchestra.run.smithi099.stdout:session_autoclose 300 2024-09-19T06:45:34.583 INFO:teuthology.orchestra.run.smithi099.stdout:max_file_size 1099511627776 2024-09-19T06:45:34.583 INFO:teuthology.orchestra.run.smithi099.stdout:max_xattr_size 65536 2024-09-19T06:45:34.583 INFO:teuthology.orchestra.run.smithi099.stdout:required_client_features {} 2024-09-19T06:45:34.583 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure 0 2024-09-19T06:45:34.583 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure_osd_epoch 45 2024-09-19T06:45:34.583 INFO:teuthology.orchestra.run.smithi099.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T06:45:34.583 INFO:teuthology.orchestra.run.smithi099.stdout:max_mds 2 2024-09-19T06:45:34.583 INFO:teuthology.orchestra.run.smithi099.stdout:in 0,1 2024-09-19T06:45:34.583 INFO:teuthology.orchestra.run.smithi099.stdout:up {0=14482,1=24269} 2024-09-19T06:45:34.583 INFO:teuthology.orchestra.run.smithi099.stdout:failed 2024-09-19T06:45:34.583 INFO:teuthology.orchestra.run.smithi099.stdout:damaged 2024-09-19T06:45:34.583 INFO:teuthology.orchestra.run.smithi099.stdout:stopped 2024-09-19T06:45:34.583 INFO:teuthology.orchestra.run.smithi099.stdout:data_pools [3] 2024-09-19T06:45:34.584 INFO:teuthology.orchestra.run.smithi099.stdout:metadata_pool 2 2024-09-19T06:45:34.584 INFO:teuthology.orchestra.run.smithi099.stdout:inline_data disabled 2024-09-19T06:45:34.584 INFO:teuthology.orchestra.run.smithi099.stdout:balancer 2024-09-19T06:45:34.584 INFO:teuthology.orchestra.run.smithi099.stdout:bal_rank_mask -1 2024-09-19T06:45:34.584 INFO:teuthology.orchestra.run.smithi099.stdout:standby_count_wanted 1 2024-09-19T06:45:34.584 INFO:teuthology.orchestra.run.smithi099.stdout:qdb_cluster leader: 14482 members: 24269,14482 2024-09-19T06:45:34.584 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.xehbxe{0:14482} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.99:6828/1508711176,v1:172.21.15.99:6829/1508711176] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T06:45:34.584 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.nooexo{1:24269} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.117:6824/2367330767,v1:172.21.15.117:6825/2367330767] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T06:45:34.584 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:45:34.584 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:45:34.584 INFO:teuthology.orchestra.run.smithi099.stdout:Standby daemons: 2024-09-19T06:45:34.584 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:45:34.585 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.obarqf{-1:14490} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6826/388324528,v1:172.21.15.99:6827/388324528] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T06:45:34.585 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.bheqzh{-1:24283} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.117:6826/4072877365,v1:172.21.15.117:6827/4072877365] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T06:45:34.585 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 19 2024-09-19T06:45:34.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.583+0000 7fc284f55640 1 -- 172.21.15.99:0/1855783490 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fc26c06e530 msgr2=0x7fc26c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:34.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.583+0000 7fc284f55640 1 --2- 172.21.15.99:0/1855783490 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fc26c06e530 0x7fc26c0709e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc270009ac0 tx=0x7fc270035040 comp rx=0 tx=0).stop 2024-09-19T06:45:34.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.583+0000 7fc284f55640 1 -- 172.21.15.99:0/1855783490 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2800fcf80 msgr2=0x7fc28010e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:34.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.583+0000 7fc284f55640 1 --2- 172.21.15.99:0/1855783490 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2800fcf80 0x7fc28010e6b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc268002a50 tx=0x7fc268004600 comp rx=0 tx=0).stop 2024-09-19T06:45:34.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.583+0000 7fc284f55640 1 -- 172.21.15.99:0/1855783490 shutdown_connections 2024-09-19T06:45:34.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.583+0000 7fc284f55640 1 --2- 172.21.15.99:0/1855783490 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fc26c06e530 0x7fc26c0709e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:34.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.583+0000 7fc284f55640 1 --2- 172.21.15.99:0/1855783490 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2800fcf80 0x7fc28010e6b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:34.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.583+0000 7fc284f55640 1 --2- 172.21.15.99:0/1855783490 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2800fb810 0x7fc28010e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:34.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.583+0000 7fc284f55640 1 -- 172.21.15.99:0/1855783490 >> 172.21.15.99:0/1855783490 conn(0x7fc2800723b0 msgr2=0x7fc2800fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:34.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.583+0000 7fc284f55640 1 -- 172.21.15.99:0/1855783490 shutdown_connections 2024-09-19T06:45:34.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.583+0000 7fc284f55640 1 -- 172.21.15.99:0/1855783490 wait complete. 2024-09-19T06:45:34.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.668+0000 7fe1afc61640 1 -- 172.21.15.99:0/3381310764 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe1a80fb470 msgr2=0x7fe1a80fb8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:34.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.668+0000 7fe1afc61640 1 --2- 172.21.15.99:0/3381310764 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe1a80fb470 0x7fe1a80fb8e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe1980048d0 tx=0x7fe198009da0 comp rx=0 tx=0).stop 2024-09-19T06:45:34.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.669+0000 7fe1afc61640 1 -- 172.21.15.99:0/3381310764 shutdown_connections 2024-09-19T06:45:34.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.669+0000 7fe1afc61640 1 --2- 172.21.15.99:0/3381310764 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe1a80fb470 0x7fe1a80fb8e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:34.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.669+0000 7fe1afc61640 1 --2- 172.21.15.99:0/3381310764 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1a81014b0 0x7fe1a8101880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:34.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.669+0000 7fe1afc61640 1 -- 172.21.15.99:0/3381310764 >> 172.21.15.99:0/3381310764 conn(0x7fe1a80f7030 msgr2=0x7fe1a80f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:34.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.669+0000 7fe1afc61640 1 -- 172.21.15.99:0/3381310764 shutdown_connections 2024-09-19T06:45:34.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.669+0000 7fe1afc61640 1 -- 172.21.15.99:0/3381310764 wait complete. 2024-09-19T06:45:34.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.669+0000 7fe1afc61640 1 Processor -- start 2024-09-19T06:45:34.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.669+0000 7fe1afc61640 1 -- start start 2024-09-19T06:45:34.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.669+0000 7fe1afc61640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1a80fb470 0x7fe1a810e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:34.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.669+0000 7fe1afc61640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe1a81014b0 0x7fe1a810e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:34.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.669+0000 7fe1afc61640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a810edd0 con 0x7fe1a81014b0 2024-09-19T06:45:34.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.669+0000 7fe1afc61640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a810ef40 con 0x7fe1a80fb470 2024-09-19T06:45:34.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.670+0000 7fe1ad1fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe1a81014b0 0x7fe1a810e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:34.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.670+0000 7fe1ad1fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe1a81014b0 0x7fe1a810e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40910/0 (socket says 172.21.15.99:40910) 2024-09-19T06:45:34.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.670+0000 7fe1ad1fc640 1 -- 172.21.15.99:0/2162382877 learned_addr learned my addr 172.21.15.99:0/2162382877 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:45:34.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.670+0000 7fe1ad9fd640 1 --2- 172.21.15.99:0/2162382877 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1a80fb470 0x7fe1a810e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:34.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.670+0000 7fe1ad1fc640 1 -- 172.21.15.99:0/2162382877 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1a80fb470 msgr2=0x7fe1a810e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:34.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.670+0000 7fe1ad1fc640 1 --2- 172.21.15.99:0/2162382877 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1a80fb470 0x7fe1a810e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:34.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.670+0000 7fe1ad1fc640 1 -- 172.21.15.99:0/2162382877 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe198005040 con 0x7fe1a81014b0 2024-09-19T06:45:34.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.670+0000 7fe1ad9fd640 1 --2- 172.21.15.99:0/2162382877 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1a80fb470 0x7fe1a810e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:45:34.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.670+0000 7fe1ad1fc640 1 --2- 172.21.15.99:0/2162382877 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe1a81014b0 0x7fe1a810e800 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe198003080 tx=0x7fe198009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:34.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.670+0000 7fe19e7fc640 1 -- 172.21.15.99:0/2162382877 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe198038070 con 0x7fe1a81014b0 2024-09-19T06:45:34.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.670+0000 7fe1afc61640 1 -- 172.21.15.99:0/2162382877 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1a8117250 con 0x7fe1a81014b0 2024-09-19T06:45:34.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.670+0000 7fe19e7fc640 1 -- 172.21.15.99:0/2162382877 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe1980097e0 con 0x7fe1a81014b0 2024-09-19T06:45:34.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.670+0000 7fe19e7fc640 1 -- 172.21.15.99:0/2162382877 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe19803d420 con 0x7fe1a81014b0 2024-09-19T06:45:34.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.670+0000 7fe1afc61640 1 -- 172.21.15.99:0/2162382877 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1a81176e0 con 0x7fe1a81014b0 2024-09-19T06:45:34.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.672+0000 7fe1afc61640 1 -- 172.21.15.99:0/2162382877 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1a80fcbb0 con 0x7fe1a81014b0 2024-09-19T06:45:34.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.672+0000 7fe19e7fc640 1 -- 172.21.15.99:0/2162382877 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fe198030020 con 0x7fe1a81014b0 2024-09-19T06:45:34.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.673+0000 7fe19e7fc640 1 --2- 172.21.15.99:0/2162382877 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe19406e530 0x7fe1940709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:34.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.673+0000 7fe19e7fc640 1 -- 172.21.15.99:0/2162382877 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fe1980ae610 con 0x7fe1a81014b0 2024-09-19T06:45:34.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.673+0000 7fe1ad9fd640 1 --2- 172.21.15.99:0/2162382877 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe19406e530 0x7fe1940709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:34.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.673+0000 7fe1ad9fd640 1 --2- 172.21.15.99:0/2162382877 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe19406e530 0x7fe1940709e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe1a4009a80 tx=0x7fe1a4008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:34.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.677+0000 7fe19e7fc640 1 -- 172.21.15.99:0/2162382877 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fe1980777a0 con 0x7fe1a81014b0 2024-09-19T06:45:34.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.909+0000 7fe1afc61640 1 -- 172.21.15.99:0/2162382877 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe1a8108520 con 0x7fe19406e530 2024-09-19T06:45:34.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.910+0000 7fe19e7fc640 1 -- 172.21.15.99:0/2162382877 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fe1a8108520 con 0x7fe19406e530 2024-09-19T06:45:34.912 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:45:34.912 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T06:45:34.912 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": true, 2024-09-19T06:45:34.912 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T06:45:34.912 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [ 2024-09-19T06:45:34.912 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr", 2024-09-19T06:45:34.912 INFO:teuthology.orchestra.run.smithi099.stdout: "crash", 2024-09-19T06:45:34.912 INFO:teuthology.orchestra.run.smithi099.stdout: "mon" 2024-09-19T06:45:34.913 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-19T06:45:34.913 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": "8/21 daemons upgraded", 2024-09-19T06:45:34.913 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "Currently upgrading osd daemons", 2024-09-19T06:45:34.913 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-09-19T06:45:34.913 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:45:34.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.912+0000 7fe1afc61640 1 -- 172.21.15.99:0/2162382877 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe19406e530 msgr2=0x7fe1940709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:34.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.912+0000 7fe1afc61640 1 --2- 172.21.15.99:0/2162382877 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe19406e530 0x7fe1940709e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe1a4009a80 tx=0x7fe1a4008040 comp rx=0 tx=0).stop 2024-09-19T06:45:34.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.912+0000 7fe1afc61640 1 -- 172.21.15.99:0/2162382877 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe1a81014b0 msgr2=0x7fe1a810e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:34.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.912+0000 7fe1afc61640 1 --2- 172.21.15.99:0/2162382877 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe1a81014b0 0x7fe1a810e800 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe198003080 tx=0x7fe198009da0 comp rx=0 tx=0).stop 2024-09-19T06:45:34.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.913+0000 7fe1afc61640 1 -- 172.21.15.99:0/2162382877 shutdown_connections 2024-09-19T06:45:34.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.913+0000 7fe1afc61640 1 --2- 172.21.15.99:0/2162382877 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe19406e530 0x7fe1940709e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:34.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.913+0000 7fe1afc61640 1 --2- 172.21.15.99:0/2162382877 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe1a81014b0 0x7fe1a810e800 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:34.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.913+0000 7fe1afc61640 1 --2- 172.21.15.99:0/2162382877 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1a80fb470 0x7fe1a810e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:34.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.913+0000 7fe1afc61640 1 -- 172.21.15.99:0/2162382877 >> 172.21.15.99:0/2162382877 conn(0x7fe1a80f7030 msgr2=0x7fe1a80f7400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:34.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.913+0000 7fe1afc61640 1 -- 172.21.15.99:0/2162382877 shutdown_connections 2024-09-19T06:45:34.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.913+0000 7fe1afc61640 1 -- 172.21.15.99:0/2162382877 wait complete. 2024-09-19T06:45:35.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.998+0000 7f6fbbbc5640 1 -- 172.21.15.99:0/3347658326 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6fb4102f10 msgr2=0x7f6fb40fc5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:35.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.998+0000 7f6fbbbc5640 1 --2- 172.21.15.99:0/3347658326 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6fb4102f10 0x7f6fb40fc5d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6fa40048d0 tx=0x7f6fa4009da0 comp rx=0 tx=0).stop 2024-09-19T06:45:35.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.998+0000 7f6fbbbc5640 1 -- 172.21.15.99:0/3347658326 shutdown_connections 2024-09-19T06:45:35.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.998+0000 7f6fbbbc5640 1 --2- 172.21.15.99:0/3347658326 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6fb4102f10 0x7f6fb40fc5d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:35.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.998+0000 7f6fbbbc5640 1 --2- 172.21.15.99:0/3347658326 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6fb4102570 0x7f6fb4102940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:35.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.998+0000 7f6fbbbc5640 1 -- 172.21.15.99:0/3347658326 >> 172.21.15.99:0/3347658326 conn(0x7f6fb40f8110 msgr2=0x7f6fb40fa520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:35.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.998+0000 7f6fbbbc5640 1 -- 172.21.15.99:0/3347658326 shutdown_connections 2024-09-19T06:45:35.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.998+0000 7f6fbbbc5640 1 -- 172.21.15.99:0/3347658326 wait complete. 2024-09-19T06:45:35.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.999+0000 7f6fbbbc5640 1 Processor -- start 2024-09-19T06:45:35.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.999+0000 7f6fbbbc5640 1 -- start start 2024-09-19T06:45:35.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.999+0000 7f6fbbbc5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6fb4102570 0x7f6fb41131b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:35.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.999+0000 7f6fbbbc5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6fb4102f10 0x7f6fb41136f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:35.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.999+0000 7f6fbbbc5640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb4113cf0 con 0x7f6fb4102570 2024-09-19T06:45:35.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.999+0000 7f6fbbbc5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb410d130 con 0x7f6fb4102f10 2024-09-19T06:45:35.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.999+0000 7f6fb9961640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6fb4102570 0x7f6fb41131b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:35.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.999+0000 7f6fb9961640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6fb4102570 0x7f6fb41131b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40938/0 (socket says 172.21.15.99:40938) 2024-09-19T06:45:35.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:34.999+0000 7f6fb9961640 1 -- 172.21.15.99:0/1560959319 learned_addr learned my addr 172.21.15.99:0/1560959319 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:45:35.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:35.000+0000 7f6fb9160640 1 --2- 172.21.15.99:0/1560959319 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6fb4102f10 0x7f6fb41136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:35.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:35.000+0000 7f6fb9961640 1 -- 172.21.15.99:0/1560959319 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6fb4102f10 msgr2=0x7f6fb41136f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:35.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:35.000+0000 7f6fb9961640 1 --2- 172.21.15.99:0/1560959319 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6fb4102f10 0x7f6fb41136f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:35.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:35.000+0000 7f6fb9961640 1 -- 172.21.15.99:0/1560959319 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa4005040 con 0x7f6fb4102570 2024-09-19T06:45:35.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:35.000+0000 7f6fb9961640 1 --2- 172.21.15.99:0/1560959319 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6fb4102570 0x7f6fb41131b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6fb000c810 tx=0x7f6fb00043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:35.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:35.000+0000 7f6faa7fc640 1 -- 172.21.15.99:0/1560959319 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6fb000a7a0 con 0x7f6fb4102570 2024-09-19T06:45:35.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:35.000+0000 7f6faa7fc640 1 -- 172.21.15.99:0/1560959319 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6fb000ada0 con 0x7f6fb4102570 2024-09-19T06:45:35.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:35.000+0000 7f6faa7fc640 1 -- 172.21.15.99:0/1560959319 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6fb0011380 con 0x7f6fb4102570 2024-09-19T06:45:35.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:35.000+0000 7f6fbbbc5640 1 -- 172.21.15.99:0/1560959319 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fb410d3b0 con 0x7f6fb4102570 2024-09-19T06:45:35.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:35.000+0000 7f6fbbbc5640 1 -- 172.21.15.99:0/1560959319 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fb410d8c0 con 0x7f6fb4102570 2024-09-19T06:45:35.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:35.002+0000 7f6fbbbc5640 1 -- 172.21.15.99:0/1560959319 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fb40fdcf0 con 0x7f6fb4102570 2024-09-19T06:45:35.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:35.002+0000 7f6faa7fc640 1 -- 172.21.15.99:0/1560959319 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f6fb00114e0 con 0x7f6fb4102570 2024-09-19T06:45:35.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:35.003+0000 7f6faa7fc640 1 --2- 172.21.15.99:0/1560959319 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f6fa0072940 0x7f6fa0074df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:45:35.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:35.003+0000 7f6faa7fc640 1 -- 172.21.15.99:0/1560959319 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f6fb008e530 con 0x7f6fb4102570 2024-09-19T06:45:35.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:35.003+0000 7f6fb9160640 1 --2- 172.21.15.99:0/1560959319 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f6fa0072940 0x7f6fa0074df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:45:35.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:35.004+0000 7f6fb9160640 1 --2- 172.21.15.99:0/1560959319 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f6fa0072940 0x7f6fa0074df0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6fa40048a0 tx=0x7f6fa4035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:45:35.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:35.008+0000 7f6faa7fc640 1 -- 172.21.15.99:0/1560959319 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f6fb005b2e0 con 0x7f6fb4102570 2024-09-19T06:45:35.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:35.352+0000 7f6fbbbc5640 1 -- 172.21.15.99:0/1560959319 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f6fb404b750 con 0x7f6fb4102570 2024-09-19T06:45:35.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:35.352+0000 7f6faa7fc640 1 -- 172.21.15.99:0/1560959319 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1160 (secure 0 0 0) 0x7f6fb005ae70 con 0x7f6fb4102570 2024-09-19T06:45:35.354 INFO:teuthology.orchestra.run.smithi099.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 51/321 objects degraded (15.888%), 16 pgs degraded 2024-09-19T06:45:35.354 INFO:teuthology.orchestra.run.smithi099.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-19T06:45:35.355 INFO:teuthology.orchestra.run.smithi099.stdout: osd.1 (root=default,host=smithi099) is down 2024-09-19T06:45:35.355 INFO:teuthology.orchestra.run.smithi099.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 51/321 objects degraded (15.888%), 16 pgs degraded 2024-09-19T06:45:35.355 INFO:teuthology.orchestra.run.smithi099.stdout: pg 1.0 is active+undersized+degraded, acting [3,0] 2024-09-19T06:45:35.355 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.0 is active+undersized+degraded, acting [3,0] 2024-09-19T06:45:35.355 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.1 is active+undersized+degraded, acting [2,0] 2024-09-19T06:45:35.355 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.2 is active+undersized+degraded, acting [5,0] 2024-09-19T06:45:35.355 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.3 is active+undersized+degraded, acting [5,2] 2024-09-19T06:45:35.355 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.4 is active+undersized+degraded, acting [0,4] 2024-09-19T06:45:35.355 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.6 is active+undersized+degraded, acting [3,4] 2024-09-19T06:45:35.355 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.9 is active+undersized+degraded, acting [4,0] 2024-09-19T06:45:35.355 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.a is active+undersized+degraded, acting [4,3] 2024-09-19T06:45:35.356 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.d is active+undersized+degraded, acting [3,2] 2024-09-19T06:45:35.356 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.10 is active+undersized+degraded, acting [2,0] 2024-09-19T06:45:35.356 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.11 is active+undersized+degraded, acting [4,3] 2024-09-19T06:45:35.356 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.12 is active+undersized+degraded, acting [3,0] 2024-09-19T06:45:35.356 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.15 is active+undersized+degraded, acting [3,0] 2024-09-19T06:45:35.356 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.17 is active+undersized+degraded, acting [5,2] 2024-09-19T06:45:35.356 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.1b is active+undersized+degraded, acting [0,5] 2024-09-19T06:45:35.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:35.355+0000 7f6fbbbc5640 1 -- 172.21.15.99:0/1560959319 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f6fa0072940 msgr2=0x7f6fa0074df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:35.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:35.355+0000 7f6fbbbc5640 1 --2- 172.21.15.99:0/1560959319 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f6fa0072940 0x7f6fa0074df0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6fa40048a0 tx=0x7f6fa4035040 comp rx=0 tx=0).stop 2024-09-19T06:45:35.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:35.355+0000 7f6fbbbc5640 1 -- 172.21.15.99:0/1560959319 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6fb4102570 msgr2=0x7f6fb41131b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:45:35.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:35.355+0000 7f6fbbbc5640 1 --2- 172.21.15.99:0/1560959319 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6fb4102570 0x7f6fb41131b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6fb000c810 tx=0x7f6fb00043c0 comp rx=0 tx=0).stop 2024-09-19T06:45:35.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:35.355+0000 7f6fbbbc5640 1 -- 172.21.15.99:0/1560959319 shutdown_connections 2024-09-19T06:45:35.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:35.355+0000 7f6fbbbc5640 1 --2- 172.21.15.99:0/1560959319 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f6fa0072940 0x7f6fa0074df0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:35.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:35.355+0000 7f6fbbbc5640 1 --2- 172.21.15.99:0/1560959319 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6fb4102f10 0x7f6fb41136f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:35.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:35.355+0000 7f6fbbbc5640 1 --2- 172.21.15.99:0/1560959319 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6fb4102570 0x7f6fb41131b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:45:35.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:35.355+0000 7f6fbbbc5640 1 -- 172.21.15.99:0/1560959319 >> 172.21.15.99:0/1560959319 conn(0x7f6fb40f8110 msgr2=0x7f6fb40f90a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:45:35.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:35.355+0000 7f6fbbbc5640 1 -- 172.21.15.99:0/1560959319 shutdown_connections 2024-09-19T06:45:35.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:45:35.355+0000 7f6fbbbc5640 1 -- 172.21.15.99:0/1560959319 wait complete. 2024-09-19T06:45:35.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:35 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/1855783490' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:45:35.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:35 smithi099 ceph-mon[97031]: pgmap v69: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 51/321 objects degraded (15.888%) 2024-09-19T06:45:35.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:35 smithi099 ceph-mon[97031]: from='client.34240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:45:35.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:35 smithi099 ceph-mon[97031]: from='osd.1 [v2:172.21.15.99:6810/593143090,v1:172.21.15.99:6811/593143090]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T06:45:35.457 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:45:35 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-1[113096]: 2024-09-19T06:45:35.197+0000 7f461405e640 -1 osd.1 53 log_to_monitors true 2024-09-19T06:45:35.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:35 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/1855783490' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:45:35.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:35 smithi117 ceph-mon[76771]: pgmap v69: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 254 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 51/321 objects degraded (15.888%) 2024-09-19T06:45:35.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:35 smithi117 ceph-mon[76771]: from='client.34240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:45:35.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:35 smithi117 ceph-mon[76771]: from='osd.1 [v2:172.21.15.99:6810/593143090,v1:172.21.15.99:6811/593143090]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T06:45:36.190 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 06:45:36 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-1[113096]: 2024-09-19T06:45:36.088+0000 7f4607df0640 -1 osd.1 53 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:45:36.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:36 smithi099 ceph-mon[97031]: from='osd.1 [v2:172.21.15.99:6810/593143090,v1:172.21.15.99:6811/593143090]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T06:45:36.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:36 smithi099 ceph-mon[97031]: osdmap e56: 6 total, 5 up, 6 in 2024-09-19T06:45:36.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:36 smithi099 ceph-mon[97031]: from='osd.1 [v2:172.21.15.99:6810/593143090,v1:172.21.15.99:6811/593143090]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-19T06:45:36.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:36 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/1560959319' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T06:45:36.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:36 smithi099 ceph-mon[97031]: Health check update: Degraded data redundancy: 51/321 objects degraded (15.888%), 16 pgs degraded (PG_DEGRADED) 2024-09-19T06:45:36.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:36 smithi099 ceph-mon[97031]: from='osd.1 [v2:172.21.15.99:6810/593143090,v1:172.21.15.99:6811/593143090]' entity='osd.1' 2024-09-19T06:45:36.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:36 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:45:36.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:36 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:45:36.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:36 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:45:36.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:36 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:45:36.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:36 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:45:36.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:36 smithi117 ceph-mon[76771]: from='osd.1 [v2:172.21.15.99:6810/593143090,v1:172.21.15.99:6811/593143090]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T06:45:36.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:36 smithi117 ceph-mon[76771]: osdmap e56: 6 total, 5 up, 6 in 2024-09-19T06:45:36.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:36 smithi117 ceph-mon[76771]: from='osd.1 [v2:172.21.15.99:6810/593143090,v1:172.21.15.99:6811/593143090]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-19T06:45:36.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:36 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/1560959319' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T06:45:36.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:36 smithi117 ceph-mon[76771]: Health check update: Degraded data redundancy: 51/321 objects degraded (15.888%), 16 pgs degraded (PG_DEGRADED) 2024-09-19T06:45:36.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:36 smithi117 ceph-mon[76771]: from='osd.1 [v2:172.21.15.99:6810/593143090,v1:172.21.15.99:6811/593143090]' entity='osd.1' 2024-09-19T06:45:36.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:36 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:45:36.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:36 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:45:36.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:36 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:45:36.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:36 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:45:36.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:36 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:45:37.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:37 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:45:37.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:37 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:45:37.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:37 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:45:37.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:37 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:45:37.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:37 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-19T06:45:37.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:37 smithi117 ceph-mon[76771]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-19T06:45:37.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:37 smithi117 ceph-mon[76771]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-19T06:45:37.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:37 smithi117 ceph-mon[76771]: pgmap v71: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 254 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 51/321 objects degraded (15.888%) 2024-09-19T06:45:37.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:37 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:45:37.563 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:37 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:45:37.563 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:37 smithi117 ceph-mon[76771]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-19T06:45:37.563 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:37 smithi117 ceph-mon[76771]: osd.1 [v2:172.21.15.99:6810/593143090,v1:172.21.15.99:6811/593143090] boot 2024-09-19T06:45:37.563 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:37 smithi117 ceph-mon[76771]: osdmap e57: 6 total, 6 up, 6 in 2024-09-19T06:45:37.563 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:37 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:45:37.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:37 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:45:37.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:37 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:45:37.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:37 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:45:37.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:37 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:45:37.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:37 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-19T06:45:37.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:37 smithi099 ceph-mon[97031]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-19T06:45:37.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:37 smithi099 ceph-mon[97031]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-19T06:45:37.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:37 smithi099 ceph-mon[97031]: pgmap v71: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 254 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 51/321 objects degraded (15.888%) 2024-09-19T06:45:37.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:37 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:45:37.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:37 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:45:37.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:37 smithi099 ceph-mon[97031]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-19T06:45:37.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:37 smithi099 ceph-mon[97031]: osd.1 [v2:172.21.15.99:6810/593143090,v1:172.21.15.99:6811/593143090] boot 2024-09-19T06:45:37.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:37 smithi099 ceph-mon[97031]: osdmap e57: 6 total, 6 up, 6 in 2024-09-19T06:45:37.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:37 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T06:45:39.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:39 smithi099 ceph-mon[97031]: osdmap e58: 6 total, 6 up, 6 in 2024-09-19T06:45:39.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:39 smithi099 ceph-mon[97031]: pgmap v74: 65 pgs: 20 peering, 7 active+undersized, 7 active+undersized+degraded, 31 active+clean; 254 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 22/321 objects degraded (6.854%) 2024-09-19T06:45:39.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:39 smithi117 ceph-mon[76771]: osdmap e58: 6 total, 6 up, 6 in 2024-09-19T06:45:39.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:39 smithi117 ceph-mon[76771]: pgmap v74: 65 pgs: 20 peering, 7 active+undersized, 7 active+undersized+degraded, 31 active+clean; 254 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 22/321 objects degraded (6.854%) 2024-09-19T06:45:40.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:40 smithi099 ceph-mon[97031]: Health check update: Degraded data redundancy: 22/321 objects degraded (6.854%), 7 pgs degraded (PG_DEGRADED) 2024-09-19T06:45:41.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:40 smithi117 ceph-mon[76771]: Health check update: Degraded data redundancy: 22/321 objects degraded (6.854%), 7 pgs degraded (PG_DEGRADED) 2024-09-19T06:45:41.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:41 smithi099 ceph-mon[97031]: pgmap v75: 65 pgs: 20 peering, 45 active+clean; 254 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:45:42.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:41 smithi117 ceph-mon[76771]: pgmap v75: 65 pgs: 20 peering, 45 active+clean; 254 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:45:42.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:42 smithi099 ceph-mon[97031]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 22/321 objects degraded (6.854%), 7 pgs degraded) 2024-09-19T06:45:42.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:42 smithi099 ceph-mon[97031]: Cluster is now healthy 2024-09-19T06:45:43.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:42 smithi117 ceph-mon[76771]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 22/321 objects degraded (6.854%), 7 pgs degraded) 2024-09-19T06:45:43.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:42 smithi117 ceph-mon[76771]: Cluster is now healthy 2024-09-19T06:45:43.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:43 smithi099 ceph-mon[97031]: pgmap v76: 65 pgs: 65 active+clean; 254 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:45:44.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:43 smithi117 ceph-mon[76771]: pgmap v76: 65 pgs: 65 active+clean; 254 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:45:45.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:45 smithi099 ceph-mon[97031]: pgmap v77: 65 pgs: 65 active+clean; 254 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:45:46.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:45 smithi117 ceph-mon[76771]: pgmap v77: 65 pgs: 65 active+clean; 254 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:45:48.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:47 smithi099 ceph-mon[97031]: pgmap v78: 65 pgs: 65 active+clean; 254 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:45:48.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:47 smithi117 ceph-mon[76771]: pgmap v78: 65 pgs: 65 active+clean; 254 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:45:50.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:49 smithi099 ceph-mon[97031]: pgmap v79: 65 pgs: 65 active+clean; 254 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:45:50.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:49 smithi117 ceph-mon[76771]: pgmap v79: 65 pgs: 65 active+clean; 254 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:45:52.008 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:51 smithi099 ceph-mon[97031]: pgmap v80: 65 pgs: 65 active+clean; 254 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:45:52.008 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:51 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-19T06:45:52.008 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:51 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:45:52.009 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:51 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:45:52.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:51 smithi117 ceph-mon[76771]: pgmap v80: 65 pgs: 65 active+clean; 254 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:45:52.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:51 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-19T06:45:52.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:51 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:45:52.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:51 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:45:53.149 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:52 smithi099 ceph-mon[97031]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-19T06:45:53.150 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:52 smithi099 ceph-mon[97031]: Upgrade: osd.2 is safe to restart 2024-09-19T06:45:53.150 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:52 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:45:53.150 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:52 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:45:53.150 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:52 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T06:45:53.150 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:52 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:45:53.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:52 smithi117 ceph-mon[76771]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-19T06:45:53.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:52 smithi117 ceph-mon[76771]: Upgrade: osd.2 is safe to restart 2024-09-19T06:45:53.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:52 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:45:53.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:52 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:45:53.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:52 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T06:45:53.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:52 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:45:54.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:53 smithi099 ceph-mon[97031]: pgmap v81: 65 pgs: 65 active+clean; 254 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:45:54.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:53 smithi099 ceph-mon[97031]: Upgrade: Updating osd.2 2024-09-19T06:45:54.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:53 smithi099 ceph-mon[97031]: Deploying daemon osd.2 on smithi099 2024-09-19T06:45:54.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:53 smithi117 ceph-mon[76771]: pgmap v81: 65 pgs: 65 active+clean; 254 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:45:54.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:53 smithi117 ceph-mon[76771]: Upgrade: Updating osd.2 2024-09-19T06:45:54.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:53 smithi117 ceph-mon[76771]: Deploying daemon osd.2 on smithi099 2024-09-19T06:45:56.201 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:55 smithi099 ceph-mon[97031]: pgmap v82: 65 pgs: 65 active+clean; 254 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:45:56.201 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 06:45:55 smithi099 systemd[1]: Stopping Ceph osd.2 for a73eb958-7650-11ef-bceb-c7b262605968... 2024-09-19T06:45:56.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:55 smithi117 ceph-mon[76771]: pgmap v82: 65 pgs: 65 active+clean; 254 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:45:56.456 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 06:45:56 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-2[60689]: 2024-09-19T06:45:56.198+0000 7f6f1856b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:45:56.456 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 06:45:56 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-2[60689]: 2024-09-19T06:45:56.198+0000 7f6f1856b640 -1 osd.2 58 *** Got signal Terminated *** 2024-09-19T06:45:56.456 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 06:45:56 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-2[60689]: 2024-09-19T06:45:56.198+0000 7f6f1856b640 -1 osd.2 58 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:45:57.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:56 smithi099 ceph-mon[97031]: osd.2 marked itself down and dead 2024-09-19T06:45:57.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:56 smithi117 ceph-mon[76771]: osd.2 marked itself down and dead 2024-09-19T06:45:57.752 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 06:45:57 smithi099 podman[118394]: 2024-09-19 06:45:57.466441351 +0000 UTC m=+1.388553402 container died cedc7e3698d81f6b3d9ea340c3b41894029c78822501b8e5d5e5d34548555725 (image=quay.ceph.io/ceph-ci/ceph@sha256:4d922a456af336b23156460d93b8143eb9c977eee7e72f2e9e44c816e5b46ac8, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=quincy-6e06d1e, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True) 2024-09-19T06:45:58.176 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:57 smithi099 ceph-mon[97031]: pgmap v83: 65 pgs: 65 active+clean; 254 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:45:58.176 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:57 smithi099 ceph-mon[97031]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-19T06:45:58.176 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:57 smithi099 ceph-mon[97031]: osdmap e59: 6 total, 5 up, 6 in 2024-09-19T06:45:58.177 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 06:45:57 smithi099 podman[118394]: 2024-09-19 06:45:57.899535278 +0000 UTC m=+1.821647318 container cleanup cedc7e3698d81f6b3d9ea340c3b41894029c78822501b8e5d5e5d34548555725 (image=quay.ceph.io/ceph-ci/ceph@sha256:4d922a456af336b23156460d93b8143eb9c977eee7e72f2e9e44c816e5b46ac8, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=quincy-6e06d1e, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-19T06:45:58.177 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 06:45:57 smithi099 bash[118394]: ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-2 2024-09-19T06:45:58.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:57 smithi117 ceph-mon[76771]: pgmap v83: 65 pgs: 65 active+clean; 254 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:45:58.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:57 smithi117 ceph-mon[76771]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-19T06:45:58.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:57 smithi117 ceph-mon[76771]: osdmap e59: 6 total, 5 up, 6 in 2024-09-19T06:45:58.456 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 06:45:58 smithi099 podman[118410]: 2024-09-19 06:45:58.175920519 +0000 UTC m=+0.707988217 container remove cedc7e3698d81f6b3d9ea340c3b41894029c78822501b8e5d5e5d34548555725 (image=quay.ceph.io/ceph-ci/ceph@sha256:4d922a456af336b23156460d93b8143eb9c977eee7e72f2e9e44c816e5b46ac8, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=quincy-6e06d1e, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-19T06:45:58.863 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 06:45:58 smithi099 podman[118500]: 2024-09-19 06:45:58.428630085 +0000 UTC m=+0.016524591 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:45:58.863 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 06:45:58 smithi099 podman[118500]: 2024-09-19 06:45:58.535306037 +0000 UTC m=+0.123200530 container create a3fef7d16ebe7c5ce7cd61d32103fc4cde5da7d3f6f66f0671c7eb74702ab455 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-2-deactivate, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-19T06:45:58.863 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 06:45:58 smithi099 podman[118500]: 2024-09-19 06:45:58.763568796 +0000 UTC m=+0.351463292 container init a3fef7d16ebe7c5ce7cd61d32103fc4cde5da7d3f6f66f0671c7eb74702ab455 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731) 2024-09-19T06:45:58.864 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 06:45:58 smithi099 podman[118500]: 2024-09-19 06:45:58.766928189 +0000 UTC m=+0.354822681 container start a3fef7d16ebe7c5ce7cd61d32103fc4cde5da7d3f6f66f0671c7eb74702ab455 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-19T06:45:58.864 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 06:45:58 smithi099 podman[118500]: 2024-09-19 06:45:58.862732405 +0000 UTC m=+0.450626905 container attach a3fef7d16ebe7c5ce7cd61d32103fc4cde5da7d3f6f66f0671c7eb74702ab455 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-19T06:45:59.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:58 smithi099 ceph-mon[97031]: osdmap e60: 6 total, 5 up, 6 in 2024-09-19T06:45:59.206 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 06:45:58 smithi099 podman[118500]: 2024-09-19 06:45:58.969921867 +0000 UTC m=+0.557816358 container died a3fef7d16ebe7c5ce7cd61d32103fc4cde5da7d3f6f66f0671c7eb74702ab455 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:45:59.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:58 smithi117 ceph-mon[76771]: osdmap e60: 6 total, 5 up, 6 in 2024-09-19T06:45:59.492 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 06:45:59 smithi099 podman[118524]: 2024-09-19 06:45:59.475073182 +0000 UTC m=+0.496637200 container remove a3fef7d16ebe7c5ce7cd61d32103fc4cde5da7d3f6f66f0671c7eb74702ab455 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:45:59.902 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 06:45:59 smithi099 systemd[1]: ceph-a73eb958-7650-11ef-bceb-c7b262605968@osd.2.service: Deactivated successfully. 2024-09-19T06:45:59.902 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 06:45:59 smithi099 systemd[1]: Stopped Ceph osd.2 for a73eb958-7650-11ef-bceb-c7b262605968. 2024-09-19T06:45:59.902 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 06:45:59 smithi099 systemd[1]: ceph-a73eb958-7650-11ef-bceb-c7b262605968@osd.2.service: Consumed 54.913s CPU time. 2024-09-19T06:45:59.902 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 06:45:59 smithi099 systemd[1]: Starting Ceph osd.2 for a73eb958-7650-11ef-bceb-c7b262605968... 2024-09-19T06:46:00.171 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:59 smithi099 ceph-mon[97031]: pgmap v86: 65 pgs: 12 peering, 7 stale+active+clean, 46 active+clean; 254 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:46:00.171 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:45:59 smithi099 ceph-mon[97031]: Health check failed: Reduced data availability: 1 pg inactive, 2 pgs peering (PG_AVAILABILITY) 2024-09-19T06:46:00.171 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 06:45:59 smithi099 podman[118622]: 2024-09-19 06:45:59.901470488 +0000 UTC m=+0.110115050 container create 7f2cf209c3d5d6fd8eca7121c70b302bd0b8d712c4299d554f71f2cfca141067 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-2-activate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-19T06:46:00.172 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 06:45:59 smithi099 podman[118622]: 2024-09-19 06:45:59.807503625 +0000 UTC m=+0.016148143 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:46:00.172 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 06:46:00 smithi099 podman[118622]: 2024-09-19 06:46:00.170761843 +0000 UTC m=+0.379406367 container init 7f2cf209c3d5d6fd8eca7121c70b302bd0b8d712c4299d554f71f2cfca141067 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-2-activate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-19T06:46:00.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:59 smithi117 ceph-mon[76771]: pgmap v86: 65 pgs: 12 peering, 7 stale+active+clean, 46 active+clean; 254 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-09-19T06:46:00.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:45:59 smithi117 ceph-mon[76771]: Health check failed: Reduced data availability: 1 pg inactive, 2 pgs peering (PG_AVAILABILITY) 2024-09-19T06:46:00.456 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 06:46:00 smithi099 podman[118622]: 2024-09-19 06:46:00.174189779 +0000 UTC m=+0.382834303 container start 7f2cf209c3d5d6fd8eca7121c70b302bd0b8d712c4299d554f71f2cfca141067 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-2-activate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-19T06:46:00.456 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 06:46:00 smithi099 podman[118622]: 2024-09-19 06:46:00.254014995 +0000 UTC m=+0.462659521 container attach 7f2cf209c3d5d6fd8eca7121c70b302bd0b8d712c4299d554f71f2cfca141067 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-2-activate, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-19T06:46:00.457 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 06:46:00 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-2-activate[118637]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T06:46:00.457 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 06:46:00 smithi099 bash[118622]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T06:46:00.457 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 06:46:00 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-2-activate[118637]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T06:46:00.457 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 06:46:00 smithi099 bash[118622]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T06:46:01.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:00 smithi117 ceph-mon[76771]: Health check failed: Degraded data redundancy: 24/321 objects degraded (7.477%), 7 pgs degraded (PG_DEGRADED) 2024-09-19T06:46:01.329 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:00 smithi099 ceph-mon[97031]: Health check failed: Degraded data redundancy: 24/321 objects degraded (7.477%), 7 pgs degraded (PG_DEGRADED) 2024-09-19T06:46:01.329 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 06:46:01 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-2-activate[118637]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-19T06:46:01.329 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 06:46:01 smithi099 bash[118622]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-19T06:46:01.329 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 06:46:01 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-2-activate[118637]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-19T06:46:01.329 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 06:46:01 smithi099 bash[118622]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-19T06:46:01.642 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 06:46:01 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-2-activate[118637]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-19T06:46:01.642 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 06:46:01 smithi099 bash[118622]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-19T06:46:01.643 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 06:46:01 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-2-activate[118637]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-19T06:46:01.643 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 06:46:01 smithi099 bash[118622]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-19T06:46:01.643 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 06:46:01 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-2-activate[118637]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-19T06:46:01.643 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 06:46:01 smithi099 bash[118622]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-19T06:46:01.643 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 06:46:01 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-2-activate[118637]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-19T06:46:01.643 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 06:46:01 smithi099 bash[118622]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-19T06:46:01.643 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 06:46:01 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-2-activate[118637]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-19T06:46:01.643 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 06:46:01 smithi099 bash[118622]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-19T06:46:01.643 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 06:46:01 smithi099 podman[118622]: 2024-09-19 06:46:01.356832216 +0000 UTC m=+1.565476733 container died 7f2cf209c3d5d6fd8eca7121c70b302bd0b8d712c4299d554f71f2cfca141067 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-2-activate, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS) 2024-09-19T06:46:02.243 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:01 smithi099 ceph-mon[97031]: pgmap v87: 65 pgs: 8 active+undersized, 12 peering, 7 active+undersized+degraded, 38 active+clean; 254 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 24/321 objects degraded (7.477%) 2024-09-19T06:46:02.243 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 06:46:02 smithi099 podman[118786]: 2024-09-19 06:46:02.037496359 +0000 UTC m=+0.670444663 container remove 7f2cf209c3d5d6fd8eca7121c70b302bd0b8d712c4299d554f71f2cfca141067 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-2-activate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:46:02.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:01 smithi117 ceph-mon[76771]: pgmap v87: 65 pgs: 8 active+undersized, 12 peering, 7 active+undersized+degraded, 38 active+clean; 254 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 24/321 objects degraded (7.477%) 2024-09-19T06:46:02.554 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 06:46:02 smithi099 podman[118846]: 2024-09-19 06:46:02.242752001 +0000 UTC m=+0.112042189 container create b1778ab8887074112f6bcdb2330d07ec6a171bf52d03cdbfe24724cfc8679127 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4) 2024-09-19T06:46:02.554 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 06:46:02 smithi099 podman[118846]: 2024-09-19 06:46:02.146774716 +0000 UTC m=+0.016064924 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:46:02.554 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 06:46:02 smithi099 podman[118846]: 2024-09-19 06:46:02.462023751 +0000 UTC m=+0.331313945 container init b1778ab8887074112f6bcdb2330d07ec6a171bf52d03cdbfe24724cfc8679127 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:46:02.554 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 06:46:02 smithi099 podman[118846]: 2024-09-19 06:46:02.46528086 +0000 UTC m=+0.334571049 container start b1778ab8887074112f6bcdb2330d07ec6a171bf52d03cdbfe24724cfc8679127 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:46:02.554 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 06:46:02 smithi099 ceph-osd[118864]: -- 172.21.15.99:0/951915284 <== mon.0 v2:172.21.15.99:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bf5d7201e0 con 0x55bf5c8cdc00 2024-09-19T06:46:02.555 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 06:46:02 smithi099 bash[118846]: b1778ab8887074112f6bcdb2330d07ec6a171bf52d03cdbfe24724cfc8679127 2024-09-19T06:46:02.956 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 06:46:02 smithi099 systemd[1]: Started Ceph osd.2 for a73eb958-7650-11ef-bceb-c7b262605968. 2024-09-19T06:46:03.741 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:03 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:46:03.741 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:03 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:46:03.741 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:03 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:46:03.741 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:03 smithi099 ceph-mon[97031]: pgmap v88: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 254 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 38/321 objects degraded (11.838%) 2024-09-19T06:46:03.995 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 06:46:03 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-2[118860]: 2024-09-19T06:46:03.882+0000 7f74a8c8e640 -1 Falling back to public interface 2024-09-19T06:46:04.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:03 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:46:04.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:03 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:46:04.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:03 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:46:04.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:03 smithi117 ceph-mon[76771]: pgmap v88: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 254 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 38/321 objects degraded (11.838%) 2024-09-19T06:46:04.855 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:04 smithi099 ceph-mon[97031]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 2 pgs peering) 2024-09-19T06:46:05.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:04 smithi117 ceph-mon[76771]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 2 pgs peering) 2024-09-19T06:46:05.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.439+0000 7f09108ec640 1 -- 172.21.15.99:0/367102735 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f090c0fcf80 msgr2=0x7f090c0fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:05.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.439+0000 7f09108ec640 1 --2- 172.21.15.99:0/367102735 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f090c0fcf80 0x7f090c0fd3d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f08f40048d0 tx=0x7f08f4009da0 comp rx=0 tx=0).stop 2024-09-19T06:46:05.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.439+0000 7f09108ec640 1 -- 172.21.15.99:0/367102735 shutdown_connections 2024-09-19T06:46:05.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.439+0000 7f09108ec640 1 --2- 172.21.15.99:0/367102735 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f090c0fcf80 0x7f090c0fd3d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:05.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.439+0000 7f09108ec640 1 --2- 172.21.15.99:0/367102735 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f090c0fb810 0x7f090c0fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:05.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.439+0000 7f09108ec640 1 -- 172.21.15.99:0/367102735 >> 172.21.15.99:0/367102735 conn(0x7f090c0723b0 msgr2=0x7f090c0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:05.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.440+0000 7f09108ec640 1 -- 172.21.15.99:0/367102735 shutdown_connections 2024-09-19T06:46:05.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.440+0000 7f09108ec640 1 -- 172.21.15.99:0/367102735 wait complete. 2024-09-19T06:46:05.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.440+0000 7f09108ec640 1 Processor -- start 2024-09-19T06:46:05.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.440+0000 7f09108ec640 1 -- start start 2024-09-19T06:46:05.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.441+0000 7f09108ec640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f090c0fb810 0x7f090c10e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:05.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.441+0000 7f09108ec640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f090c0fcf80 0x7f090c10e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:05.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.441+0000 7f09108ec640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090c10ed20 con 0x7f090c0fcf80 2024-09-19T06:46:05.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.441+0000 7f09108ec640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090c10ee90 con 0x7f090c0fb810 2024-09-19T06:46:05.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.441+0000 7f0903fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f090c0fcf80 0x7f090c10e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:05.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.441+0000 7f090a59c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f090c0fb810 0x7f090c10e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:05.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.441+0000 7f0903fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f090c0fcf80 0x7f090c10e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36814/0 (socket says 172.21.15.99:36814) 2024-09-19T06:46:05.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.441+0000 7f0903fff640 1 -- 172.21.15.99:0/3918558454 learned_addr learned my addr 172.21.15.99:0/3918558454 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:46:05.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.441+0000 7f090a59c640 1 --2- 172.21.15.99:0/3918558454 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f090c0fb810 0x7f090c10e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.99:48776/0 (socket says 172.21.15.99:48776) 2024-09-19T06:46:05.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.441+0000 7f0903fff640 1 -- 172.21.15.99:0/3918558454 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f090c0fb810 msgr2=0x7f090c10e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:05.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.441+0000 7f0903fff640 1 --2- 172.21.15.99:0/3918558454 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f090c0fb810 0x7f090c10e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:05.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.441+0000 7f0903fff640 1 -- 172.21.15.99:0/3918558454 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f4005040 con 0x7f090c0fcf80 2024-09-19T06:46:05.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.441+0000 7f090a59c640 1 --2- 172.21.15.99:0/3918558454 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f090c0fb810 0x7f090c10e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:46:05.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.442+0000 7f0903fff640 1 --2- 172.21.15.99:0/3918558454 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f090c0fcf80 0x7f090c10e6d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f08f4000c00 tx=0x7f08f4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:05.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.442+0000 7f0902ffd640 1 -- 172.21.15.99:0/3918558454 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08f4038070 con 0x7f090c0fcf80 2024-09-19T06:46:05.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.442+0000 7f0902ffd640 1 -- 172.21.15.99:0/3918558454 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f08f402ade0 con 0x7f090c0fcf80 2024-09-19T06:46:05.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.442+0000 7f09108ec640 1 -- 172.21.15.99:0/3918558454 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f090c10bf80 con 0x7f090c0fcf80 2024-09-19T06:46:05.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.442+0000 7f0902ffd640 1 -- 172.21.15.99:0/3918558454 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08f402c7e0 con 0x7f090c0fcf80 2024-09-19T06:46:05.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.442+0000 7f09108ec640 1 -- 172.21.15.99:0/3918558454 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f090c10c4c0 con 0x7f090c0fcf80 2024-09-19T06:46:05.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.443+0000 7f09108ec640 1 -- 172.21.15.99:0/3918558454 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f090c0fcbc0 con 0x7f090c0fcf80 2024-09-19T06:46:05.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.444+0000 7f0902ffd640 1 -- 172.21.15.99:0/3918558454 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f08f4030020 con 0x7f090c0fcf80 2024-09-19T06:46:05.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.444+0000 7f0902ffd640 1 --2- 172.21.15.99:0/3918558454 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f08f806e530 0x7f08f80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:05.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.444+0000 7f0902ffd640 1 -- 172.21.15.99:0/3918558454 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f08f40adcb0 con 0x7f090c0fcf80 2024-09-19T06:46:05.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.444+0000 7f090a59c640 1 --2- 172.21.15.99:0/3918558454 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f08f806e530 0x7f08f80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:05.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.445+0000 7f090a59c640 1 --2- 172.21.15.99:0/3918558454 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f08f806e530 0x7f08f80709e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f08fc004fd0 tx=0x7f08fc011040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:05.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.449+0000 7f0902ffd640 1 -- 172.21.15.99:0/3918558454 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f08f4076f70 con 0x7f090c0fcf80 2024-09-19T06:46:05.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.645+0000 7f09108ec640 1 -- 172.21.15.99:0/3918558454 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f090c065730 con 0x7f08f806e530 2024-09-19T06:46:05.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.646+0000 7f0902ffd640 1 -- 172.21.15.99:0/3918558454 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f090c065730 con 0x7f08f806e530 2024-09-19T06:46:05.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.648+0000 7f09108ec640 1 -- 172.21.15.99:0/3918558454 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f08f806e530 msgr2=0x7f08f80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:05.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.648+0000 7f09108ec640 1 --2- 172.21.15.99:0/3918558454 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f08f806e530 0x7f08f80709e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f08fc004fd0 tx=0x7f08fc011040 comp rx=0 tx=0).stop 2024-09-19T06:46:05.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.648+0000 7f09108ec640 1 -- 172.21.15.99:0/3918558454 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f090c0fcf80 msgr2=0x7f090c10e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:05.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.648+0000 7f09108ec640 1 --2- 172.21.15.99:0/3918558454 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f090c0fcf80 0x7f090c10e6d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f08f4000c00 tx=0x7f08f4009da0 comp rx=0 tx=0).stop 2024-09-19T06:46:05.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.648+0000 7f09108ec640 1 -- 172.21.15.99:0/3918558454 shutdown_connections 2024-09-19T06:46:05.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.648+0000 7f09108ec640 1 --2- 172.21.15.99:0/3918558454 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f08f806e530 0x7f08f80709e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:05.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.648+0000 7f09108ec640 1 --2- 172.21.15.99:0/3918558454 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f090c0fcf80 0x7f090c10e6d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:05.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.648+0000 7f09108ec640 1 --2- 172.21.15.99:0/3918558454 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f090c0fb810 0x7f090c10e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:05.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.648+0000 7f09108ec640 1 -- 172.21.15.99:0/3918558454 >> 172.21.15.99:0/3918558454 conn(0x7f090c0723b0 msgr2=0x7f090c0fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:05.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.649+0000 7f09108ec640 1 -- 172.21.15.99:0/3918558454 shutdown_connections 2024-09-19T06:46:05.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.649+0000 7f09108ec640 1 -- 172.21.15.99:0/3918558454 wait complete. 2024-09-19T06:46:05.658 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-09-19T06:46:05.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:05 smithi099 ceph-mon[97031]: pgmap v89: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 254 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 38/321 objects degraded (11.838%) 2024-09-19T06:46:05.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.729+0000 7f076d839640 1 -- 172.21.15.99:0/998080010 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0768100c90 msgr2=0x7f0768101060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:05.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.729+0000 7f076d839640 1 --2- 172.21.15.99:0/998080010 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0768100c90 0x7f0768101060 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f07580049c0 tx=0x7f075800aeb0 comp rx=0 tx=0).stop 2024-09-19T06:46:05.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.729+0000 7f076d839640 1 -- 172.21.15.99:0/998080010 shutdown_connections 2024-09-19T06:46:05.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.729+0000 7f076d839640 1 --2- 172.21.15.99:0/998080010 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07680fac60 0x7f07680fb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:05.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.729+0000 7f076d839640 1 --2- 172.21.15.99:0/998080010 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0768100c90 0x7f0768101060 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:05.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.729+0000 7f076d839640 1 -- 172.21.15.99:0/998080010 >> 172.21.15.99:0/998080010 conn(0x7f0768070c80 msgr2=0x7f0768071080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:05.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.729+0000 7f076d839640 1 -- 172.21.15.99:0/998080010 shutdown_connections 2024-09-19T06:46:05.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.729+0000 7f076d839640 1 -- 172.21.15.99:0/998080010 wait complete. 2024-09-19T06:46:05.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.730+0000 7f076d839640 1 Processor -- start 2024-09-19T06:46:05.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.730+0000 7f076d839640 1 -- start start 2024-09-19T06:46:05.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.730+0000 7f076d839640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07680fac60 0x7f0768111050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:05.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.730+0000 7f076d839640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0768100c90 0x7f0768111590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:05.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.730+0000 7f076d839640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0768111b90 con 0x7f0768100c90 2024-09-19T06:46:05.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.730+0000 7f076d839640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f076810afd0 con 0x7f07680fac60 2024-09-19T06:46:05.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.730+0000 7f075ffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0768100c90 0x7f0768111590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:05.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.730+0000 7f075ffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0768100c90 0x7f0768111590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36830/0 (socket says 172.21.15.99:36830) 2024-09-19T06:46:05.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.730+0000 7f075ffff640 1 -- 172.21.15.99:0/3389750874 learned_addr learned my addr 172.21.15.99:0/3389750874 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:46:05.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.730+0000 7f0766ffd640 1 --2- 172.21.15.99:0/3389750874 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07680fac60 0x7f0768111050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:05.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.730+0000 7f075ffff640 1 -- 172.21.15.99:0/3389750874 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07680fac60 msgr2=0x7f0768111050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:05.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.730+0000 7f075ffff640 1 --2- 172.21.15.99:0/3389750874 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07680fac60 0x7f0768111050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:05.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.730+0000 7f075ffff640 1 -- 172.21.15.99:0/3389750874 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0758005040 con 0x7f0768100c90 2024-09-19T06:46:05.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.731+0000 7f075ffff640 1 --2- 172.21.15.99:0/3389750874 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0768100c90 0x7f0768111590 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f075000eb70 tx=0x7f075000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:05.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.731+0000 7f075f7fe640 1 -- 172.21.15.99:0/3389750874 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0750007c30 con 0x7f0768100c90 2024-09-19T06:46:05.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.731+0000 7f076d839640 1 -- 172.21.15.99:0/3389750874 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f076810b250 con 0x7f0768100c90 2024-09-19T06:46:05.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.731+0000 7f075f7fe640 1 -- 172.21.15.99:0/3389750874 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f075000f040 con 0x7f0768100c90 2024-09-19T06:46:05.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.731+0000 7f076d839640 1 -- 172.21.15.99:0/3389750874 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f076810b7f0 con 0x7f0768100c90 2024-09-19T06:46:05.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.731+0000 7f075f7fe640 1 -- 172.21.15.99:0/3389750874 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07500094e0 con 0x7f0768100c90 2024-09-19T06:46:05.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.732+0000 7f076d839640 1 -- 172.21.15.99:0/3389750874 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07680fc350 con 0x7f0768100c90 2024-09-19T06:46:05.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.732+0000 7f075f7fe640 1 -- 172.21.15.99:0/3389750874 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f0750009720 con 0x7f0768100c90 2024-09-19T06:46:05.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.733+0000 7f075f7fe640 1 --2- 172.21.15.99:0/3389750874 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f075406e530 0x7f07540709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:05.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.733+0000 7f075f7fe640 1 -- 172.21.15.99:0/3389750874 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f075008de10 con 0x7f0768100c90 2024-09-19T06:46:05.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.733+0000 7f0766ffd640 1 --2- 172.21.15.99:0/3389750874 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f075406e530 0x7f07540709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:05.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.733+0000 7f0766ffd640 1 --2- 172.21.15.99:0/3389750874 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f075406e530 0x7f07540709e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0758004560 tx=0x7f075800aeb0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:05.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.737+0000 7f075f7fe640 1 -- 172.21.15.99:0/3389750874 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f0750056fa0 con 0x7f0768100c90 2024-09-19T06:46:05.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.929+0000 7f076d839640 1 -- 172.21.15.99:0/3389750874 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f076810c760 con 0x7f075406e530 2024-09-19T06:46:05.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.931+0000 7f075f7fe640 1 -- 172.21.15.99:0/3389750874 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f076810c760 con 0x7f075406e530 2024-09-19T06:46:05.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.933+0000 7f076d839640 1 -- 172.21.15.99:0/3389750874 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f075406e530 msgr2=0x7f07540709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:05.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.933+0000 7f076d839640 1 --2- 172.21.15.99:0/3389750874 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f075406e530 0x7f07540709e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0758004560 tx=0x7f075800aeb0 comp rx=0 tx=0).stop 2024-09-19T06:46:05.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.933+0000 7f076d839640 1 -- 172.21.15.99:0/3389750874 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0768100c90 msgr2=0x7f0768111590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:05.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.933+0000 7f076d839640 1 --2- 172.21.15.99:0/3389750874 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0768100c90 0x7f0768111590 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f075000eb70 tx=0x7f075000b040 comp rx=0 tx=0).stop 2024-09-19T06:46:05.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.933+0000 7f076d839640 1 -- 172.21.15.99:0/3389750874 shutdown_connections 2024-09-19T06:46:05.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.933+0000 7f076d839640 1 --2- 172.21.15.99:0/3389750874 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f075406e530 0x7f07540709e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:05.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.933+0000 7f076d839640 1 --2- 172.21.15.99:0/3389750874 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0768100c90 0x7f0768111590 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:05.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.933+0000 7f076d839640 1 --2- 172.21.15.99:0/3389750874 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07680fac60 0x7f0768111050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:05.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.933+0000 7f076d839640 1 -- 172.21.15.99:0/3389750874 >> 172.21.15.99:0/3389750874 conn(0x7f0768070c80 msgr2=0x7f0768103980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:05.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.933+0000 7f076d839640 1 -- 172.21.15.99:0/3389750874 shutdown_connections 2024-09-19T06:46:05.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:05.933+0000 7f076d839640 1 -- 172.21.15.99:0/3389750874 wait complete. 2024-09-19T06:46:06.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.019+0000 7f5133109640 1 -- 172.21.15.99:0/2112779509 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f512c102f00 msgr2=0x7f512c0fc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:06.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.019+0000 7f5133109640 1 --2- 172.21.15.99:0/2112779509 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f512c102f00 0x7f512c0fc5c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f511c0048d0 tx=0x7f511c009da0 comp rx=0 tx=0).stop 2024-09-19T06:46:06.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.019+0000 7f5133109640 1 -- 172.21.15.99:0/2112779509 shutdown_connections 2024-09-19T06:46:06.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.019+0000 7f5133109640 1 --2- 172.21.15.99:0/2112779509 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f512c102f00 0x7f512c0fc5c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:06.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.019+0000 7f5133109640 1 --2- 172.21.15.99:0/2112779509 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f512c102560 0x7f512c102930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:06.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.019+0000 7f5133109640 1 -- 172.21.15.99:0/2112779509 >> 172.21.15.99:0/2112779509 conn(0x7f512c0f8120 msgr2=0x7f512c0fa530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:06.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.019+0000 7f5133109640 1 -- 172.21.15.99:0/2112779509 shutdown_connections 2024-09-19T06:46:06.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.020+0000 7f5133109640 1 -- 172.21.15.99:0/2112779509 wait complete. 2024-09-19T06:46:06.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.020+0000 7f5133109640 1 Processor -- start 2024-09-19T06:46:06.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.020+0000 7f5133109640 1 -- start start 2024-09-19T06:46:06.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.020+0000 7f5133109640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f512c102560 0x7f512c113220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:06.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.020+0000 7f5133109640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f512c102f00 0x7f512c113760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:06.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.020+0000 7f5133109640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f512c113d60 con 0x7f512c102560 2024-09-19T06:46:06.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.020+0000 7f5133109640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f512c10d1a0 con 0x7f512c102f00 2024-09-19T06:46:06.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.021+0000 7f5130ea5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f512c102560 0x7f512c113220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:06.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.021+0000 7f5130ea5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f512c102560 0x7f512c113220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36856/0 (socket says 172.21.15.99:36856) 2024-09-19T06:46:06.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.021+0000 7f5130ea5640 1 -- 172.21.15.99:0/4173198416 learned_addr learned my addr 172.21.15.99:0/4173198416 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:46:06.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.021+0000 7f5123fff640 1 --2- 172.21.15.99:0/4173198416 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f512c102f00 0x7f512c113760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:06.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.021+0000 7f5130ea5640 1 -- 172.21.15.99:0/4173198416 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f512c102f00 msgr2=0x7f512c113760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:06.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.021+0000 7f5130ea5640 1 --2- 172.21.15.99:0/4173198416 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f512c102f00 0x7f512c113760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:06.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.021+0000 7f5130ea5640 1 -- 172.21.15.99:0/4173198416 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f511c005040 con 0x7f512c102560 2024-09-19T06:46:06.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.021+0000 7f5130ea5640 1 --2- 172.21.15.99:0/4173198416 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f512c102560 0x7f512c113220 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5128002a50 tx=0x7f5128004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:06.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.021+0000 7f51217fa640 1 -- 172.21.15.99:0/4173198416 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5128007c30 con 0x7f512c102560 2024-09-19T06:46:06.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.021+0000 7f51217fa640 1 -- 172.21.15.99:0/4173198416 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f512800f040 con 0x7f512c102560 2024-09-19T06:46:06.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.021+0000 7f5133109640 1 -- 172.21.15.99:0/4173198416 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f512c10d480 con 0x7f512c102560 2024-09-19T06:46:06.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.021+0000 7f51217fa640 1 -- 172.21.15.99:0/4173198416 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f512800da10 con 0x7f512c102560 2024-09-19T06:46:06.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.022+0000 7f5133109640 1 -- 172.21.15.99:0/4173198416 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f512c10d890 con 0x7f512c102560 2024-09-19T06:46:06.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.022+0000 7f5133109640 1 -- 172.21.15.99:0/4173198416 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f512c0fdce0 con 0x7f512c102560 2024-09-19T06:46:06.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.023+0000 7f51217fa640 1 -- 172.21.15.99:0/4173198416 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f512800dbb0 con 0x7f512c102560 2024-09-19T06:46:06.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.024+0000 7f51217fa640 1 --2- 172.21.15.99:0/4173198416 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f511406e530 0x7f51140709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:06.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.024+0000 7f51217fa640 1 -- 172.21.15.99:0/4173198416 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f512808d820 con 0x7f512c102560 2024-09-19T06:46:06.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.024+0000 7f5123fff640 1 --2- 172.21.15.99:0/4173198416 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f511406e530 0x7f51140709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:06.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.024+0000 7f5123fff640 1 --2- 172.21.15.99:0/4173198416 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f511406e530 0x7f51140709e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f511c0048a0 tx=0x7f511c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:06.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.028+0000 7f51217fa640 1 -- 172.21.15.99:0/4173198416 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f5128056ae0 con 0x7f512c102560 2024-09-19T06:46:06.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:05 smithi117 ceph-mon[76771]: pgmap v89: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 254 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 38/321 objects degraded (11.838%) 2024-09-19T06:46:06.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.213+0000 7f5133109640 1 -- 172.21.15.99:0/4173198416 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f512c04b720 con 0x7f511406e530 2024-09-19T06:46:06.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.222+0000 7f51217fa640 1 -- 172.21.15.99:0/4173198416 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f512c04b720 con 0x7f511406e530 2024-09-19T06:46:06.224 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T06:46:06.224 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.smithi099 smithi099 *:9093,9094 running (5m) 33s ago 13m 23.4M - 0.25.0 c8568f914cd2 e7c1774d56b0 2024-09-19T06:46:06.225 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi099 smithi099 running (98s) 33s ago 13m 6899k - 19.1.1-361-g2f599a46 d2baa855c067 b9775f416b10 2024-09-19T06:46:06.225 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi117 smithi117 running (93s) 90s ago 12m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 38cf60c0d548 2024-09-19T06:46:06.225 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.smithi099 smithi099 *:3000 running (3m) 33s ago 13m 77.6M - 9.4.12 2bacad6d85d8 cd53a18d5410 2024-09-19T06:46:06.225 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.obarqf smithi099 running (8m) 33s ago 8m 14.0M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 e36c9b74004b 2024-09-19T06:46:06.225 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.xehbxe smithi099 running (8m) 33s ago 8m 121M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 d09eb3d306ae 2024-09-19T06:46:06.225 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.bheqzh smithi117 running (8m) 90s ago 8m 15.4M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 21253e27fdd3 2024-09-19T06:46:06.225 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.nooexo smithi117 running (8m) 90s ago 8m 109M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 ad1faeb3343c 2024-09-19T06:46:06.225 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi099.pgvkqi smithi099 *:8443,9283,8765 running (4m) 33s ago 14m 498M - 19.1.1-361-g2f599a46 d2baa855c067 d5de99cb7e78 2024-09-19T06:46:06.225 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi117.ssmkcf smithi117 *:8443,9283,8765 running (3m) 90s ago 12m 441M - 19.1.1-361-g2f599a46 d2baa855c067 8b7ee0f871f5 2024-09-19T06:46:06.225 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi099 smithi099 running (2m) 33s ago 14m 46.7M 2048M 19.1.1-361-g2f599a46 d2baa855c067 ffe067438824 2024-09-19T06:46:06.225 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi117 smithi117 running (2m) 90s ago 12m 33.3M 2048M 19.1.1-361-g2f599a46 d2baa855c067 4cb7455e3ee7 2024-09-19T06:46:06.226 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi099 smithi099 *:9100 running (5m) 33s ago 13m 15.4M - 1.5.0 0da6a335fe13 dca7b4517dcc 2024-09-19T06:46:06.226 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi117 smithi117 *:9100 running (4m) 90s ago 12m 16.0M - 1.5.0 0da6a335fe13 8233ce3835d2 2024-09-19T06:46:06.226 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (74s) 33s ago 11m 95.5M 1557M 19.1.1-361-g2f599a46 d2baa855c067 8e22543bf933 2024-09-19T06:46:06.226 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (39s) 33s ago 11m 14.5M 1557M 19.1.1-361-g2f599a46 d2baa855c067 f54153d0ae09 2024-09-19T06:46:06.226 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 starting - - - 1557M 2024-09-19T06:46:06.226 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi117 running (10m) 90s ago 10m 261M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 5984ed999c91 2024-09-19T06:46:06.226 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi117 running (10m) 90s ago 10m 232M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 6a2fc0c51c05 2024-09-19T06:46:06.226 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi117 running (9m) 90s ago 9m 226M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 39dcb7dbf0e3 2024-09-19T06:46:06.226 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.smithi099 smithi099 *:9095 running (3m) 33s ago 13m 63.1M - 2.43.0 a07b618ecd1d 15ad26ec6fb4 2024-09-19T06:46:06.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.224+0000 7f5133109640 1 -- 172.21.15.99:0/4173198416 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f511406e530 msgr2=0x7f51140709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:06.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.224+0000 7f5133109640 1 --2- 172.21.15.99:0/4173198416 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f511406e530 0x7f51140709e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f511c0048a0 tx=0x7f511c035040 comp rx=0 tx=0).stop 2024-09-19T06:46:06.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.224+0000 7f5133109640 1 -- 172.21.15.99:0/4173198416 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f512c102560 msgr2=0x7f512c113220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:06.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.224+0000 7f5133109640 1 --2- 172.21.15.99:0/4173198416 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f512c102560 0x7f512c113220 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5128002a50 tx=0x7f5128004600 comp rx=0 tx=0).stop 2024-09-19T06:46:06.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.224+0000 7f5133109640 1 -- 172.21.15.99:0/4173198416 shutdown_connections 2024-09-19T06:46:06.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.224+0000 7f5133109640 1 --2- 172.21.15.99:0/4173198416 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f511406e530 0x7f51140709e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:06.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.224+0000 7f5133109640 1 --2- 172.21.15.99:0/4173198416 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f512c102f00 0x7f512c113760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:06.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.224+0000 7f5133109640 1 --2- 172.21.15.99:0/4173198416 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f512c102560 0x7f512c113220 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:06.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.224+0000 7f5133109640 1 -- 172.21.15.99:0/4173198416 >> 172.21.15.99:0/4173198416 conn(0x7f512c0f8120 msgr2=0x7f512c0f90a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:06.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.224+0000 7f5133109640 1 -- 172.21.15.99:0/4173198416 shutdown_connections 2024-09-19T06:46:06.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.224+0000 7f5133109640 1 -- 172.21.15.99:0/4173198416 wait complete. 2024-09-19T06:46:06.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.303+0000 7f0850b0c640 1 -- 172.21.15.99:0/356607256 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f084c1014d0 msgr2=0x7f084c1018a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:06.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.303+0000 7f0850b0c640 1 --2- 172.21.15.99:0/356607256 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f084c1014d0 0x7f084c1018a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f08440048d0 tx=0x7f0844009da0 comp rx=0 tx=0).stop 2024-09-19T06:46:06.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.303+0000 7f0850b0c640 1 -- 172.21.15.99:0/356607256 shutdown_connections 2024-09-19T06:46:06.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.303+0000 7f0850b0c640 1 --2- 172.21.15.99:0/356607256 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f084c0fb490 0x7f084c0fb900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:06.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.303+0000 7f0850b0c640 1 --2- 172.21.15.99:0/356607256 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f084c1014d0 0x7f084c1018a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:06.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.303+0000 7f0850b0c640 1 -- 172.21.15.99:0/356607256 >> 172.21.15.99:0/356607256 conn(0x7f084c0f7050 msgr2=0x7f084c0f9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:06.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.303+0000 7f0850b0c640 1 -- 172.21.15.99:0/356607256 shutdown_connections 2024-09-19T06:46:06.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.303+0000 7f0850b0c640 1 -- 172.21.15.99:0/356607256 wait complete. 2024-09-19T06:46:06.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.304+0000 7f0850b0c640 1 Processor -- start 2024-09-19T06:46:06.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.304+0000 7f0850b0c640 1 -- start start 2024-09-19T06:46:06.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.304+0000 7f0850b0c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f084c0fb490 0x7f084c10e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:06.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.304+0000 7f0850b0c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f084c1014d0 0x7f084c10e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:06.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.304+0000 7f0850b0c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f084c10ecc0 con 0x7f084c1014d0 2024-09-19T06:46:06.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.304+0000 7f0850b0c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f084c10ee30 con 0x7f084c0fb490 2024-09-19T06:46:06.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.304+0000 7f0849d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f084c1014d0 0x7f084c10e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:06.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.304+0000 7f0849d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f084c1014d0 0x7f084c10e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36872/0 (socket says 172.21.15.99:36872) 2024-09-19T06:46:06.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.304+0000 7f0849d9b640 1 -- 172.21.15.99:0/2122770805 learned_addr learned my addr 172.21.15.99:0/2122770805 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:46:06.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.304+0000 7f084a59c640 1 --2- 172.21.15.99:0/2122770805 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f084c0fb490 0x7f084c10e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:06.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.304+0000 7f0849d9b640 1 -- 172.21.15.99:0/2122770805 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f084c0fb490 msgr2=0x7f084c10e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:06.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.304+0000 7f0849d9b640 1 --2- 172.21.15.99:0/2122770805 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f084c0fb490 0x7f084c10e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:06.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.304+0000 7f0849d9b640 1 -- 172.21.15.99:0/2122770805 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0844005040 con 0x7f084c1014d0 2024-09-19T06:46:06.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.304+0000 7f084a59c640 1 --2- 172.21.15.99:0/2122770805 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f084c0fb490 0x7f084c10e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:46:06.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.305+0000 7f0849d9b640 1 --2- 172.21.15.99:0/2122770805 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f084c1014d0 0x7f084c10e6c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f083400cb10 tx=0x7f0834007f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:06.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.305+0000 7f0842ffd640 1 -- 172.21.15.99:0/2122770805 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0834004200 con 0x7f084c1014d0 2024-09-19T06:46:06.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.305+0000 7f0850b0c640 1 -- 172.21.15.99:0/2122770805 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f084c1171f0 con 0x7f084c1014d0 2024-09-19T06:46:06.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.305+0000 7f0842ffd640 1 -- 172.21.15.99:0/2122770805 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f083400acc0 con 0x7f084c1014d0 2024-09-19T06:46:06.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.305+0000 7f0842ffd640 1 -- 172.21.15.99:0/2122770805 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0834003cf0 con 0x7f084c1014d0 2024-09-19T06:46:06.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.305+0000 7f0850b0c640 1 -- 172.21.15.99:0/2122770805 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f084c117730 con 0x7f084c1014d0 2024-09-19T06:46:06.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.306+0000 7f0850b0c640 1 -- 172.21.15.99:0/2122770805 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f084c0fcbd0 con 0x7f084c1014d0 2024-09-19T06:46:06.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.306+0000 7f0842ffd640 1 -- 172.21.15.99:0/2122770805 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f0834003430 con 0x7f084c1014d0 2024-09-19T06:46:06.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.307+0000 7f0842ffd640 1 --2- 172.21.15.99:0/2122770805 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f083806e530 0x7f08380709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:06.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.307+0000 7f0842ffd640 1 -- 172.21.15.99:0/2122770805 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f083408e780 con 0x7f084c1014d0 2024-09-19T06:46:06.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.307+0000 7f084a59c640 1 --2- 172.21.15.99:0/2122770805 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f083806e530 0x7f08380709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:06.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.307+0000 7f084a59c640 1 --2- 172.21.15.99:0/2122770805 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f083806e530 0x7f08380709e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0844007ac0 tx=0x7f0844009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:06.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.311+0000 7f0842ffd640 1 -- 172.21.15.99:0/2122770805 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f0834057910 con 0x7f084c1014d0 2024-09-19T06:46:06.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.548+0000 7f0850b0c640 1 -- 172.21.15.99:0/2122770805 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f084c04b720 con 0x7f084c1014d0 2024-09-19T06:46:06.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.548+0000 7f0842ffd640 1 -- 172.21.15.99:0/2122770805 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+850 (secure 0 0 0) 0x7f083405afd0 con 0x7f084c1014d0 2024-09-19T06:46:06.551 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:46:06.551 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-09-19T06:46:06.551 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T06:46:06.551 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:46:06.551 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-09-19T06:46:06.551 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T06:46:06.551 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:46:06.551 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-09-19T06:46:06.551 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 3, 2024-09-19T06:46:06.551 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T06:46:06.551 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:46:06.552 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": { 2024-09-19T06:46:06.552 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 4 2024-09-19T06:46:06.552 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:46:06.552 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-09-19T06:46:06.552 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 7, 2024-09-19T06:46:06.552 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 6 2024-09-19T06:46:06.552 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T06:46:06.552 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:46:06.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.550+0000 7f0850b0c640 1 -- 172.21.15.99:0/2122770805 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f083806e530 msgr2=0x7f08380709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:06.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.550+0000 7f0850b0c640 1 --2- 172.21.15.99:0/2122770805 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f083806e530 0x7f08380709e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0844007ac0 tx=0x7f0844009da0 comp rx=0 tx=0).stop 2024-09-19T06:46:06.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.551+0000 7f0850b0c640 1 -- 172.21.15.99:0/2122770805 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f084c1014d0 msgr2=0x7f084c10e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:06.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.551+0000 7f0850b0c640 1 --2- 172.21.15.99:0/2122770805 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f084c1014d0 0x7f084c10e6c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f083400cb10 tx=0x7f0834007f00 comp rx=0 tx=0).stop 2024-09-19T06:46:06.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.551+0000 7f0850b0c640 1 -- 172.21.15.99:0/2122770805 shutdown_connections 2024-09-19T06:46:06.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.551+0000 7f0850b0c640 1 --2- 172.21.15.99:0/2122770805 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f083806e530 0x7f08380709e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:06.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.551+0000 7f0850b0c640 1 --2- 172.21.15.99:0/2122770805 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f084c1014d0 0x7f084c10e6c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:06.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.551+0000 7f0850b0c640 1 --2- 172.21.15.99:0/2122770805 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f084c0fb490 0x7f084c10e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:06.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.551+0000 7f0850b0c640 1 -- 172.21.15.99:0/2122770805 >> 172.21.15.99:0/2122770805 conn(0x7f084c0f7050 msgr2=0x7f084c0f8900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:06.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.551+0000 7f0850b0c640 1 -- 172.21.15.99:0/2122770805 shutdown_connections 2024-09-19T06:46:06.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.551+0000 7f0850b0c640 1 -- 172.21.15.99:0/2122770805 wait complete. 2024-09-19T06:46:06.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.631+0000 7f122cdf5640 1 -- 172.21.15.99:0/2232457114 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1228102530 msgr2=0x7f1228102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:06.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.631+0000 7f122cdf5640 1 --2- 172.21.15.99:0/2232457114 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1228102530 0x7f1228102900 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1220009c50 tx=0x7f1220004d10 comp rx=0 tx=0).stop 2024-09-19T06:46:06.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.632+0000 7f122cdf5640 1 -- 172.21.15.99:0/2232457114 shutdown_connections 2024-09-19T06:46:06.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.632+0000 7f122cdf5640 1 --2- 172.21.15.99:0/2232457114 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1228102ed0 0x7f12280fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:06.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.632+0000 7f122cdf5640 1 --2- 172.21.15.99:0/2232457114 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1228102530 0x7f1228102900 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:06.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.632+0000 7f122cdf5640 1 -- 172.21.15.99:0/2232457114 >> 172.21.15.99:0/2232457114 conn(0x7f12280f80f0 msgr2=0x7f12280fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:06.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.632+0000 7f122cdf5640 1 -- 172.21.15.99:0/2232457114 shutdown_connections 2024-09-19T06:46:06.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.632+0000 7f122cdf5640 1 -- 172.21.15.99:0/2232457114 wait complete. 2024-09-19T06:46:06.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.632+0000 7f122cdf5640 1 Processor -- start 2024-09-19T06:46:06.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.632+0000 7f122cdf5640 1 -- start start 2024-09-19T06:46:06.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.632+0000 7f122cdf5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1228102530 0x7f1228113210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:06.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.632+0000 7f122cdf5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1228102ed0 0x7f1228113750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:06.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.632+0000 7f122cdf5640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1228113d50 con 0x7f1228102530 2024-09-19T06:46:06.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.632+0000 7f122cdf5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f122810d190 con 0x7f1228102ed0 2024-09-19T06:46:06.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.632+0000 7f122659c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1228102530 0x7f1228113210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:06.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.632+0000 7f122659c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1228102530 0x7f1228113210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36884/0 (socket says 172.21.15.99:36884) 2024-09-19T06:46:06.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.632+0000 7f122659c640 1 -- 172.21.15.99:0/3433623384 learned_addr learned my addr 172.21.15.99:0/3433623384 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:46:06.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.633+0000 7f1225d9b640 1 --2- 172.21.15.99:0/3433623384 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1228102ed0 0x7f1228113750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:06.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.633+0000 7f122659c640 1 -- 172.21.15.99:0/3433623384 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1228102ed0 msgr2=0x7f1228113750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:06.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.633+0000 7f122659c640 1 --2- 172.21.15.99:0/3433623384 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1228102ed0 0x7f1228113750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:06.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.633+0000 7f122659c640 1 -- 172.21.15.99:0/3433623384 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12200098b0 con 0x7f1228102530 2024-09-19T06:46:06.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.633+0000 7f122659c640 1 --2- 172.21.15.99:0/3433623384 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1228102530 0x7f1228113210 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1220004a30 tx=0x7f1220004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:06.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.633+0000 7f1216ffd640 1 -- 172.21.15.99:0/3433623384 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1220009690 con 0x7f1228102530 2024-09-19T06:46:06.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.633+0000 7f1216ffd640 1 -- 172.21.15.99:0/3433623384 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1220032b10 con 0x7f1228102530 2024-09-19T06:46:06.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.633+0000 7f122cdf5640 1 -- 172.21.15.99:0/3433623384 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f122810d410 con 0x7f1228102530 2024-09-19T06:46:06.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.633+0000 7f1216ffd640 1 -- 172.21.15.99:0/3433623384 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f122003daa0 con 0x7f1228102530 2024-09-19T06:46:06.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.633+0000 7f122cdf5640 1 -- 172.21.15.99:0/3433623384 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f122810d9b0 con 0x7f1228102530 2024-09-19T06:46:06.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.634+0000 7f122cdf5640 1 -- 172.21.15.99:0/3433623384 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12280fdcb0 con 0x7f1228102530 2024-09-19T06:46:06.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.635+0000 7f1216ffd640 1 -- 172.21.15.99:0/3433623384 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f122002f030 con 0x7f1228102530 2024-09-19T06:46:06.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.635+0000 7f1216ffd640 1 --2- 172.21.15.99:0/3433623384 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f121006e530 0x7f12100709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:06.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.635+0000 7f1216ffd640 1 -- 172.21.15.99:0/3433623384 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f12200af1a0 con 0x7f1228102530 2024-09-19T06:46:06.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.635+0000 7f1225d9b640 1 --2- 172.21.15.99:0/3433623384 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f121006e530 0x7f12100709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:06.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.636+0000 7f1225d9b640 1 --2- 172.21.15.99:0/3433623384 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f121006e530 0x7f12100709e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f122810ead0 tx=0x7f121c009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:06.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.640+0000 7f1216ffd640 1 -- 172.21.15.99:0/3433623384 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f1220078330 con 0x7f1228102530 2024-09-19T06:46:06.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.877+0000 7f122cdf5640 1 -- 172.21.15.99:0/3433623384 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f122804b720 con 0x7f1228102530 2024-09-19T06:46:06.880 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:06 smithi099 ceph-mon[97031]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:46:06.881 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:06 smithi099 ceph-mon[97031]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:46:06.881 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:06 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/2122770805' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:46:06.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.878+0000 7f1216ffd640 1 -- 172.21.15.99:0/3433623384 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1941 (secure 0 0 0) 0x7f122007b9f0 con 0x7f1228102530 2024-09-19T06:46:06.881 INFO:teuthology.orchestra.run.smithi099.stdout:e19 2024-09-19T06:46:06.881 INFO:teuthology.orchestra.run.smithi099.stdout:btime 2024-09-19T06:44:03:270764+0000 2024-09-19T06:46:06.881 INFO:teuthology.orchestra.run.smithi099.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T06:46:06.881 INFO:teuthology.orchestra.run.smithi099.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T06:46:06.881 INFO:teuthology.orchestra.run.smithi099.stdout:legacy client fscid: 1 2024-09-19T06:46:06.882 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:46:06.882 INFO:teuthology.orchestra.run.smithi099.stdout:Filesystem 'cephfs' (1) 2024-09-19T06:46:06.882 INFO:teuthology.orchestra.run.smithi099.stdout:fs_name cephfs 2024-09-19T06:46:06.882 INFO:teuthology.orchestra.run.smithi099.stdout:epoch 19 2024-09-19T06:46:06.882 INFO:teuthology.orchestra.run.smithi099.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-19T06:46:06.882 INFO:teuthology.orchestra.run.smithi099.stdout:created 2024-09-19T06:37:40.838146+0000 2024-09-19T06:46:06.882 INFO:teuthology.orchestra.run.smithi099.stdout:modified 2024-09-19T06:44:02.356718+0000 2024-09-19T06:46:06.882 INFO:teuthology.orchestra.run.smithi099.stdout:tableserver 0 2024-09-19T06:46:06.882 INFO:teuthology.orchestra.run.smithi099.stdout:root 0 2024-09-19T06:46:06.882 INFO:teuthology.orchestra.run.smithi099.stdout:session_timeout 60 2024-09-19T06:46:06.882 INFO:teuthology.orchestra.run.smithi099.stdout:session_autoclose 300 2024-09-19T06:46:06.882 INFO:teuthology.orchestra.run.smithi099.stdout:max_file_size 1099511627776 2024-09-19T06:46:06.882 INFO:teuthology.orchestra.run.smithi099.stdout:max_xattr_size 65536 2024-09-19T06:46:06.882 INFO:teuthology.orchestra.run.smithi099.stdout:required_client_features {} 2024-09-19T06:46:06.883 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure 0 2024-09-19T06:46:06.883 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure_osd_epoch 45 2024-09-19T06:46:06.883 INFO:teuthology.orchestra.run.smithi099.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T06:46:06.883 INFO:teuthology.orchestra.run.smithi099.stdout:max_mds 2 2024-09-19T06:46:06.883 INFO:teuthology.orchestra.run.smithi099.stdout:in 0,1 2024-09-19T06:46:06.883 INFO:teuthology.orchestra.run.smithi099.stdout:up {0=14482,1=24269} 2024-09-19T06:46:06.883 INFO:teuthology.orchestra.run.smithi099.stdout:failed 2024-09-19T06:46:06.883 INFO:teuthology.orchestra.run.smithi099.stdout:damaged 2024-09-19T06:46:06.883 INFO:teuthology.orchestra.run.smithi099.stdout:stopped 2024-09-19T06:46:06.883 INFO:teuthology.orchestra.run.smithi099.stdout:data_pools [3] 2024-09-19T06:46:06.883 INFO:teuthology.orchestra.run.smithi099.stdout:metadata_pool 2 2024-09-19T06:46:06.884 INFO:teuthology.orchestra.run.smithi099.stdout:inline_data disabled 2024-09-19T06:46:06.884 INFO:teuthology.orchestra.run.smithi099.stdout:balancer 2024-09-19T06:46:06.884 INFO:teuthology.orchestra.run.smithi099.stdout:bal_rank_mask -1 2024-09-19T06:46:06.884 INFO:teuthology.orchestra.run.smithi099.stdout:standby_count_wanted 1 2024-09-19T06:46:06.884 INFO:teuthology.orchestra.run.smithi099.stdout:qdb_cluster leader: 14482 members: 24269,14482 2024-09-19T06:46:06.884 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.xehbxe{0:14482} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.99:6828/1508711176,v1:172.21.15.99:6829/1508711176] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T06:46:06.884 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.nooexo{1:24269} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.117:6824/2367330767,v1:172.21.15.117:6825/2367330767] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T06:46:06.884 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:46:06.884 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:46:06.884 INFO:teuthology.orchestra.run.smithi099.stdout:Standby daemons: 2024-09-19T06:46:06.884 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:46:06.884 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.obarqf{-1:14490} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6826/388324528,v1:172.21.15.99:6827/388324528] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T06:46:06.885 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.bheqzh{-1:24283} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.117:6826/4072877365,v1:172.21.15.117:6827/4072877365] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T06:46:06.885 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 19 2024-09-19T06:46:06.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.881+0000 7f122cdf5640 1 -- 172.21.15.99:0/3433623384 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f121006e530 msgr2=0x7f12100709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:06.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.881+0000 7f122cdf5640 1 --2- 172.21.15.99:0/3433623384 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f121006e530 0x7f12100709e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f122810ead0 tx=0x7f121c009040 comp rx=0 tx=0).stop 2024-09-19T06:46:06.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.881+0000 7f122cdf5640 1 -- 172.21.15.99:0/3433623384 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1228102530 msgr2=0x7f1228113210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:06.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.881+0000 7f122cdf5640 1 --2- 172.21.15.99:0/3433623384 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1228102530 0x7f1228113210 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1220004a30 tx=0x7f1220004d10 comp rx=0 tx=0).stop 2024-09-19T06:46:06.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.881+0000 7f122cdf5640 1 -- 172.21.15.99:0/3433623384 shutdown_connections 2024-09-19T06:46:06.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.881+0000 7f122cdf5640 1 --2- 172.21.15.99:0/3433623384 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f121006e530 0x7f12100709e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:06.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.881+0000 7f122cdf5640 1 --2- 172.21.15.99:0/3433623384 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1228102ed0 0x7f1228113750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:06.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.881+0000 7f122cdf5640 1 --2- 172.21.15.99:0/3433623384 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1228102530 0x7f1228113210 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:06.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.881+0000 7f122cdf5640 1 -- 172.21.15.99:0/3433623384 >> 172.21.15.99:0/3433623384 conn(0x7f12280f80f0 msgr2=0x7f12280f9100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:06.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.881+0000 7f122cdf5640 1 -- 172.21.15.99:0/3433623384 shutdown_connections 2024-09-19T06:46:06.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.881+0000 7f122cdf5640 1 -- 172.21.15.99:0/3433623384 wait complete. 2024-09-19T06:46:06.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.967+0000 7faf8f937640 1 -- 172.21.15.99:0/1601306450 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf88102ef0 msgr2=0x7faf880fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:06.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.967+0000 7faf8f937640 1 --2- 172.21.15.99:0/1601306450 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf88102ef0 0x7faf880fc5b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7faf7c0048d0 tx=0x7faf7c009da0 comp rx=0 tx=0).stop 2024-09-19T06:46:06.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.967+0000 7faf8f937640 1 -- 172.21.15.99:0/1601306450 shutdown_connections 2024-09-19T06:46:06.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.967+0000 7faf8f937640 1 --2- 172.21.15.99:0/1601306450 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf88102ef0 0x7faf880fc5b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:06.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.967+0000 7faf8f937640 1 --2- 172.21.15.99:0/1601306450 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf88102550 0x7faf88102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:06.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.967+0000 7faf8f937640 1 -- 172.21.15.99:0/1601306450 >> 172.21.15.99:0/1601306450 conn(0x7faf880f80f0 msgr2=0x7faf880fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:06.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.967+0000 7faf8f937640 1 -- 172.21.15.99:0/1601306450 shutdown_connections 2024-09-19T06:46:06.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.967+0000 7faf8f937640 1 -- 172.21.15.99:0/1601306450 wait complete. 2024-09-19T06:46:06.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.967+0000 7faf8f937640 1 Processor -- start 2024-09-19T06:46:06.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.967+0000 7faf8f937640 1 -- start start 2024-09-19T06:46:06.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.967+0000 7faf8f937640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf88102550 0x7faf88113520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:06.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.967+0000 7faf8f937640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf88102ef0 0x7faf88113a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:06.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.967+0000 7faf8f937640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf881140b0 con 0x7faf88102550 2024-09-19T06:46:06.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.968+0000 7faf8f937640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf8810d4c0 con 0x7faf88102ef0 2024-09-19T06:46:06.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.968+0000 7faf8d6d3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf88102550 0x7faf88113520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:06.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.968+0000 7faf8d6d3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf88102550 0x7faf88113520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36904/0 (socket says 172.21.15.99:36904) 2024-09-19T06:46:06.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.968+0000 7faf8d6d3640 1 -- 172.21.15.99:0/3332041934 learned_addr learned my addr 172.21.15.99:0/3332041934 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:46:06.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.968+0000 7faf8ced2640 1 --2- 172.21.15.99:0/3332041934 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf88102ef0 0x7faf88113a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:06.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.968+0000 7faf8d6d3640 1 -- 172.21.15.99:0/3332041934 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf88102ef0 msgr2=0x7faf88113a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:06.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.968+0000 7faf8d6d3640 1 --2- 172.21.15.99:0/3332041934 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf88102ef0 0x7faf88113a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:06.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.968+0000 7faf8d6d3640 1 -- 172.21.15.99:0/3332041934 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf7c005040 con 0x7faf88102550 2024-09-19T06:46:06.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.968+0000 7faf8ced2640 1 --2- 172.21.15.99:0/3332041934 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf88102ef0 0x7faf88113a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:46:06.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.968+0000 7faf8d6d3640 1 --2- 172.21.15.99:0/3332041934 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf88102550 0x7faf88113520 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7faf8000eb70 tx=0x7faf8000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:06.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.968+0000 7faf85ffb640 1 -- 172.21.15.99:0/3332041934 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf80007c30 con 0x7faf88102550 2024-09-19T06:46:06.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.968+0000 7faf85ffb640 1 -- 172.21.15.99:0/3332041934 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7faf8000f040 con 0x7faf88102550 2024-09-19T06:46:06.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.968+0000 7faf85ffb640 1 -- 172.21.15.99:0/3332041934 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf800094e0 con 0x7faf88102550 2024-09-19T06:46:06.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.968+0000 7faf8f937640 1 -- 172.21.15.99:0/3332041934 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf8810d740 con 0x7faf88102550 2024-09-19T06:46:06.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.968+0000 7faf8f937640 1 -- 172.21.15.99:0/3332041934 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf8810dcb0 con 0x7faf88102550 2024-09-19T06:46:06.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.969+0000 7faf8f937640 1 -- 172.21.15.99:0/3332041934 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf880fdcd0 con 0x7faf88102550 2024-09-19T06:46:06.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.970+0000 7faf85ffb640 1 -- 172.21.15.99:0/3332041934 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7faf80009640 con 0x7faf88102550 2024-09-19T06:46:06.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.970+0000 7faf85ffb640 1 --2- 172.21.15.99:0/3332041934 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7faf7006e530 0x7faf700709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:06.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.970+0000 7faf85ffb640 1 -- 172.21.15.99:0/3332041934 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6324+0+0 (secure 0 0 0) 0x7faf8008dd70 con 0x7faf88102550 2024-09-19T06:46:06.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.970+0000 7faf8ced2640 1 --2- 172.21.15.99:0/3332041934 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7faf7006e530 0x7faf700709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:06.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.971+0000 7faf8ced2640 1 --2- 172.21.15.99:0/3332041934 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7faf7006e530 0x7faf700709e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7faf7c000c00 tx=0x7faf7c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:06.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:06.976+0000 7faf85ffb640 1 -- 172.21.15.99:0/3332041934 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7faf80056f80 con 0x7faf88102550 2024-09-19T06:46:07.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:06 smithi117 ceph-mon[76771]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:46:07.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:06 smithi117 ceph-mon[76771]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:46:07.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:06 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/2122770805' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:46:07.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:07.168+0000 7faf8f937640 1 -- 172.21.15.99:0/3332041934 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7faf8804b750 con 0x7faf7006e530 2024-09-19T06:46:07.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:07.169+0000 7faf85ffb640 1 -- 172.21.15.99:0/3332041934 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7faf8804b750 con 0x7faf7006e530 2024-09-19T06:46:07.172 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:46:07.172 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T06:46:07.172 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": true, 2024-09-19T06:46:07.172 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T06:46:07.172 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [ 2024-09-19T06:46:07.172 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr", 2024-09-19T06:46:07.172 INFO:teuthology.orchestra.run.smithi099.stdout: "crash", 2024-09-19T06:46:07.172 INFO:teuthology.orchestra.run.smithi099.stdout: "mon" 2024-09-19T06:46:07.172 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-19T06:46:07.172 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": "8/21 daemons upgraded", 2024-09-19T06:46:07.173 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "Currently upgrading osd daemons", 2024-09-19T06:46:07.173 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-09-19T06:46:07.173 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:46:07.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:07.171+0000 7faf8f937640 1 -- 172.21.15.99:0/3332041934 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7faf7006e530 msgr2=0x7faf700709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:07.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:07.171+0000 7faf8f937640 1 --2- 172.21.15.99:0/3332041934 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7faf7006e530 0x7faf700709e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7faf7c000c00 tx=0x7faf7c035040 comp rx=0 tx=0).stop 2024-09-19T06:46:07.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:07.171+0000 7faf8f937640 1 -- 172.21.15.99:0/3332041934 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf88102550 msgr2=0x7faf88113520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:07.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:07.171+0000 7faf8f937640 1 --2- 172.21.15.99:0/3332041934 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf88102550 0x7faf88113520 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7faf8000eb70 tx=0x7faf8000b040 comp rx=0 tx=0).stop 2024-09-19T06:46:07.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:07.171+0000 7faf8f937640 1 -- 172.21.15.99:0/3332041934 shutdown_connections 2024-09-19T06:46:07.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:07.172+0000 7faf8f937640 1 --2- 172.21.15.99:0/3332041934 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7faf7006e530 0x7faf700709e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:07.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:07.172+0000 7faf8f937640 1 --2- 172.21.15.99:0/3332041934 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf88102ef0 0x7faf88113a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:07.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:07.172+0000 7faf8f937640 1 --2- 172.21.15.99:0/3332041934 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf88102550 0x7faf88113520 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:07.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:07.172+0000 7faf8f937640 1 -- 172.21.15.99:0/3332041934 >> 172.21.15.99:0/3332041934 conn(0x7faf880f80f0 msgr2=0x7faf880f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:07.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:07.172+0000 7faf8f937640 1 -- 172.21.15.99:0/3332041934 shutdown_connections 2024-09-19T06:46:07.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:07.172+0000 7faf8f937640 1 -- 172.21.15.99:0/3332041934 wait complete. 2024-09-19T06:46:07.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:07.258+0000 7f39f61b4640 1 -- 172.21.15.99:0/605763758 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f39f0102530 msgr2=0x7f39f0102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:07.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:07.258+0000 7f39f61b4640 1 --2- 172.21.15.99:0/605763758 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f39f0102530 0x7f39f0102900 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f39e00048d0 tx=0x7f39e0009da0 comp rx=0 tx=0).stop 2024-09-19T06:46:07.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:07.258+0000 7f39f61b4640 1 -- 172.21.15.99:0/605763758 shutdown_connections 2024-09-19T06:46:07.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:07.258+0000 7f39f61b4640 1 --2- 172.21.15.99:0/605763758 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39f0102ed0 0x7f39f00fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:07.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:07.258+0000 7f39f61b4640 1 --2- 172.21.15.99:0/605763758 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f39f0102530 0x7f39f0102900 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:07.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:07.258+0000 7f39f61b4640 1 -- 172.21.15.99:0/605763758 >> 172.21.15.99:0/605763758 conn(0x7f39f00f80f0 msgr2=0x7f39f00fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:07.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:07.258+0000 7f39f61b4640 1 -- 172.21.15.99:0/605763758 shutdown_connections 2024-09-19T06:46:07.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:07.258+0000 7f39f61b4640 1 -- 172.21.15.99:0/605763758 wait complete. 2024-09-19T06:46:07.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:07.258+0000 7f39f61b4640 1 Processor -- start 2024-09-19T06:46:07.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:07.259+0000 7f39f61b4640 1 -- start start 2024-09-19T06:46:07.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:07.259+0000 7f39f61b4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f39f0102530 0x7f39f006fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:07.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:07.259+0000 7f39f61b4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39f0102ed0 0x7f39f006ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:07.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:07.259+0000 7f39f61b4640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f0070490 con 0x7f39f0102530 2024-09-19T06:46:07.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:07.259+0000 7f39f61b4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f0070600 con 0x7f39f0102ed0 2024-09-19T06:46:07.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:07.259+0000 7f39ef7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f39f0102530 0x7f39f006fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:07.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:07.259+0000 7f39ef7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f39f0102530 0x7f39f006fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36914/0 (socket says 172.21.15.99:36914) 2024-09-19T06:46:07.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:07.259+0000 7f39ef7fe640 1 -- 172.21.15.99:0/2107993390 learned_addr learned my addr 172.21.15.99:0/2107993390 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:46:07.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:07.259+0000 7f39eeffd640 1 --2- 172.21.15.99:0/2107993390 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39f0102ed0 0x7f39f006ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:07.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:07.259+0000 7f39ef7fe640 1 -- 172.21.15.99:0/2107993390 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39f0102ed0 msgr2=0x7f39f006ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:07.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:07.259+0000 7f39ef7fe640 1 --2- 172.21.15.99:0/2107993390 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39f0102ed0 0x7f39f006ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:07.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:07.259+0000 7f39ef7fe640 1 -- 172.21.15.99:0/2107993390 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e0005040 con 0x7f39f0102530 2024-09-19T06:46:07.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:07.259+0000 7f39ef7fe640 1 --2- 172.21.15.99:0/2107993390 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f39f0102530 0x7f39f006fa10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f39e0000c00 tx=0x7f39e0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:07.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:07.259+0000 7f39d7fff640 1 -- 172.21.15.99:0/2107993390 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39e0038070 con 0x7f39f0102530 2024-09-19T06:46:07.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:07.259+0000 7f39d7fff640 1 -- 172.21.15.99:0/2107993390 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f39e002ade0 con 0x7f39f0102530 2024-09-19T06:46:07.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:07.259+0000 7f39f61b4640 1 -- 172.21.15.99:0/2107993390 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39f0070830 con 0x7f39f0102530 2024-09-19T06:46:07.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:07.259+0000 7f39d7fff640 1 -- 172.21.15.99:0/2107993390 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39e002c7e0 con 0x7f39f0102530 2024-09-19T06:46:07.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:07.259+0000 7f39f61b4640 1 -- 172.21.15.99:0/2107993390 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39f01198c0 con 0x7f39f0102530 2024-09-19T06:46:07.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:07.261+0000 7f39f61b4640 1 -- 172.21.15.99:0/2107993390 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39f00fdcb0 con 0x7f39f0102530 2024-09-19T06:46:07.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:07.261+0000 7f39d7fff640 1 -- 172.21.15.99:0/2107993390 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f39e0030020 con 0x7f39f0102530 2024-09-19T06:46:07.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:07.262+0000 7f39d7fff640 1 --2- 172.21.15.99:0/2107993390 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f39d806e530 0x7f39d80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:07.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:07.262+0000 7f39d7fff640 1 -- 172.21.15.99:0/2107993390 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f39e00adcb0 con 0x7f39f0102530 2024-09-19T06:46:07.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:07.262+0000 7f39eeffd640 1 --2- 172.21.15.99:0/2107993390 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f39d806e530 0x7f39d80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:07.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:07.263+0000 7f39eeffd640 1 --2- 172.21.15.99:0/2107993390 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f39d806e530 0x7f39d80709e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f39f0071350 tx=0x7f39e400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:07.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:07.266+0000 7f39d7fff640 1 -- 172.21.15.99:0/2107993390 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f39e0076f70 con 0x7f39f0102530 2024-09-19T06:46:07.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:07.509+0000 7f39f61b4640 1 -- 172.21.15.99:0/2107993390 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f39f00fbd30 con 0x7f39f0102530 2024-09-19T06:46:07.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:07.510+0000 7f39d7fff640 1 -- 172.21.15.99:0/2107993390 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+941 (secure 0 0 0) 0x7f39e007a630 con 0x7f39f0102530 2024-09-19T06:46:07.511 INFO:teuthology.orchestra.run.smithi099.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 38/321 objects degraded (11.838%), 12 pgs degraded 2024-09-19T06:46:07.511 INFO:teuthology.orchestra.run.smithi099.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-19T06:46:07.511 INFO:teuthology.orchestra.run.smithi099.stdout: osd.2 (root=default,host=smithi099) is down 2024-09-19T06:46:07.511 INFO:teuthology.orchestra.run.smithi099.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 38/321 objects degraded (11.838%), 12 pgs degraded 2024-09-19T06:46:07.512 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.1 is active+undersized+degraded, acting [1,0] 2024-09-19T06:46:07.512 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.3 is active+undersized+degraded, acting [5,1] 2024-09-19T06:46:07.512 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.7 is active+undersized+degraded, acting [3,4] 2024-09-19T06:46:07.512 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.d is active+undersized+degraded, acting [1,3] 2024-09-19T06:46:07.512 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.e is active+undersized+degraded, acting [0,3] 2024-09-19T06:46:07.512 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.10 is active+undersized+degraded, acting [1,0] 2024-09-19T06:46:07.512 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.13 is active+undersized+degraded, acting [0,4] 2024-09-19T06:46:07.512 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.16 is active+undersized+degraded, acting [5,3] 2024-09-19T06:46:07.512 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.17 is active+undersized+degraded, acting [5,1] 2024-09-19T06:46:07.512 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.19 is active+undersized+degraded, acting [0,4] 2024-09-19T06:46:07.512 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.1c is active+undersized+degraded, acting [4,5] 2024-09-19T06:46:07.512 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.1e is active+undersized+degraded, acting [0,5] 2024-09-19T06:46:07.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:07.513+0000 7f39f61b4640 1 -- 172.21.15.99:0/2107993390 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f39d806e530 msgr2=0x7f39d80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:07.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:07.513+0000 7f39f61b4640 1 --2- 172.21.15.99:0/2107993390 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f39d806e530 0x7f39d80709e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f39f0071350 tx=0x7f39e400b040 comp rx=0 tx=0).stop 2024-09-19T06:46:07.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:07.513+0000 7f39f61b4640 1 -- 172.21.15.99:0/2107993390 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f39f0102530 msgr2=0x7f39f006fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:07.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:07.513+0000 7f39f61b4640 1 --2- 172.21.15.99:0/2107993390 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f39f0102530 0x7f39f006fa10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f39e0000c00 tx=0x7f39e0009da0 comp rx=0 tx=0).stop 2024-09-19T06:46:07.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:07.513+0000 7f39f61b4640 1 -- 172.21.15.99:0/2107993390 shutdown_connections 2024-09-19T06:46:07.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:07.513+0000 7f39f61b4640 1 --2- 172.21.15.99:0/2107993390 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f39d806e530 0x7f39d80709e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:07.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:07.513+0000 7f39f61b4640 1 --2- 172.21.15.99:0/2107993390 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39f0102ed0 0x7f39f006ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:07.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:07.513+0000 7f39f61b4640 1 --2- 172.21.15.99:0/2107993390 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f39f0102530 0x7f39f006fa10 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:07.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:07.513+0000 7f39f61b4640 1 -- 172.21.15.99:0/2107993390 >> 172.21.15.99:0/2107993390 conn(0x7f39f00f80f0 msgr2=0x7f39f00f90f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:07.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:07.513+0000 7f39f61b4640 1 -- 172.21.15.99:0/2107993390 shutdown_connections 2024-09-19T06:46:07.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:07.513+0000 7f39f61b4640 1 -- 172.21.15.99:0/2107993390 wait complete. 2024-09-19T06:46:08.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:07 smithi099 ceph-mon[97031]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:46:08.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:07 smithi099 ceph-mon[97031]: pgmap v90: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 254 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 38/321 objects degraded (11.838%) 2024-09-19T06:46:08.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:07 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:46:08.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:07 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:46:08.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:07 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/3433623384' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:46:08.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:07 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/2107993390' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T06:46:08.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:07 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:46:08.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:07 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:46:08.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:07 smithi117 ceph-mon[76771]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:46:08.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:07 smithi117 ceph-mon[76771]: pgmap v90: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 254 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 38/321 objects degraded (11.838%) 2024-09-19T06:46:08.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:07 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:46:08.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:07 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:46:08.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:07 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/3433623384' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:46:08.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:07 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/2107993390' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T06:46:08.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:07 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:46:08.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:07 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:46:08.975 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:08 smithi099 ceph-mon[97031]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:46:08.975 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:08 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:46:08.975 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:08 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:46:09.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:08 smithi117 ceph-mon[76771]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:46:09.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:08 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:46:09.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:08 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:46:09.706 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 06:46:09 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-2[118860]: 2024-09-19T06:46:09.291+0000 7f74a8c8e640 -1 osd.2 58 log_to_monitors true 2024-09-19T06:46:10.074 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:09 smithi099 ceph-mon[97031]: pgmap v91: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 254 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 38/321 objects degraded (11.838%) 2024-09-19T06:46:10.075 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:09 smithi099 ceph-mon[97031]: from='osd.2 [v2:172.21.15.99:6818/672470203,v1:172.21.15.99:6819/672470203]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T06:46:10.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:09 smithi117 ceph-mon[76771]: pgmap v91: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 254 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 38/321 objects degraded (11.838%) 2024-09-19T06:46:10.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:09 smithi117 ceph-mon[76771]: from='osd.2 [v2:172.21.15.99:6818/672470203,v1:172.21.15.99:6819/672470203]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T06:46:10.456 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 06:46:10 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-2[118860]: 2024-09-19T06:46:10.298+0000 7f74a0a28640 -1 osd.2 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:46:11.363 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:11 smithi099 ceph-mon[97031]: from='osd.2 [v2:172.21.15.99:6818/672470203,v1:172.21.15.99:6819/672470203]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T06:46:11.363 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:11 smithi099 ceph-mon[97031]: osdmap e61: 6 total, 5 up, 6 in 2024-09-19T06:46:11.363 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:11 smithi099 ceph-mon[97031]: from='osd.2 [v2:172.21.15.99:6818/672470203,v1:172.21.15.99:6819/672470203]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-19T06:46:11.363 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:11 smithi099 ceph-mon[97031]: Health check update: Degraded data redundancy: 38/321 objects degraded (11.838%), 12 pgs degraded (PG_DEGRADED) 2024-09-19T06:46:11.363 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:11 smithi099 ceph-mon[97031]: pgmap v93: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 38/321 objects degraded (11.838%) 2024-09-19T06:46:11.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:11 smithi117 ceph-mon[76771]: from='osd.2 [v2:172.21.15.99:6818/672470203,v1:172.21.15.99:6819/672470203]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T06:46:11.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:11 smithi117 ceph-mon[76771]: osdmap e61: 6 total, 5 up, 6 in 2024-09-19T06:46:11.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:11 smithi117 ceph-mon[76771]: from='osd.2 [v2:172.21.15.99:6818/672470203,v1:172.21.15.99:6819/672470203]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi099", "root=default"]}]: dispatch 2024-09-19T06:46:11.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:11 smithi117 ceph-mon[76771]: Health check update: Degraded data redundancy: 38/321 objects degraded (11.838%), 12 pgs degraded (PG_DEGRADED) 2024-09-19T06:46:11.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:11 smithi117 ceph-mon[76771]: pgmap v93: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 38/321 objects degraded (11.838%) 2024-09-19T06:46:12.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:12 smithi117 ceph-mon[76771]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-19T06:46:12.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:12 smithi117 ceph-mon[76771]: osd.2 [v2:172.21.15.99:6818/672470203,v1:172.21.15.99:6819/672470203] boot 2024-09-19T06:46:12.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:12 smithi117 ceph-mon[76771]: osdmap e62: 6 total, 6 up, 6 in 2024-09-19T06:46:12.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:12 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:46:12.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:12 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:46:12.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:12 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:46:12.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:12 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:46:12.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:12 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:46:12.563 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:12 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:46:12.563 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:12 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:46:12.563 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:12 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:46:12.563 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:12 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:46:12.563 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:12 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:46:12.563 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:12 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-19T06:46:12.563 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:12 smithi117 ceph-mon[76771]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-19T06:46:12.563 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:12 smithi117 ceph-mon[76771]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-19T06:46:12.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:12 smithi099 ceph-mon[97031]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-19T06:46:12.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:12 smithi099 ceph-mon[97031]: osd.2 [v2:172.21.15.99:6818/672470203,v1:172.21.15.99:6819/672470203] boot 2024-09-19T06:46:12.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:12 smithi099 ceph-mon[97031]: osdmap e62: 6 total, 6 up, 6 in 2024-09-19T06:46:12.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:12 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T06:46:12.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:12 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:46:12.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:12 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:46:12.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:12 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:46:12.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:12 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:46:12.708 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:12 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:46:12.708 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:12 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:46:12.708 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:12 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:46:12.708 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:12 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:46:12.708 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:12 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:46:12.708 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:12 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-19T06:46:12.708 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:12 smithi099 ceph-mon[97031]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-19T06:46:12.708 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:12 smithi099 ceph-mon[97031]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-19T06:46:13.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:13 smithi099 ceph-mon[97031]: osdmap e63: 6 total, 6 up, 6 in 2024-09-19T06:46:13.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:13 smithi099 ceph-mon[97031]: pgmap v96: 65 pgs: 10 active+undersized, 7 active+undersized+degraded, 48 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 24/321 objects degraded (7.477%) 2024-09-19T06:46:13.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:13 smithi117 ceph-mon[76771]: osdmap e63: 6 total, 6 up, 6 in 2024-09-19T06:46:13.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:13 smithi117 ceph-mon[76771]: pgmap v96: 65 pgs: 10 active+undersized, 7 active+undersized+degraded, 48 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 24/321 objects degraded (7.477%) 2024-09-19T06:46:16.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:15 smithi099 ceph-mon[97031]: pgmap v97: 65 pgs: 10 active+undersized, 7 active+undersized+degraded, 48 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 24/321 objects degraded (7.477%) 2024-09-19T06:46:16.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:15 smithi099 ceph-mon[97031]: Health check update: Degraded data redundancy: 24/321 objects degraded (7.477%), 7 pgs degraded (PG_DEGRADED) 2024-09-19T06:46:16.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:15 smithi117 ceph-mon[76771]: pgmap v97: 65 pgs: 10 active+undersized, 7 active+undersized+degraded, 48 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 24/321 objects degraded (7.477%) 2024-09-19T06:46:16.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:15 smithi117 ceph-mon[76771]: Health check update: Degraded data redundancy: 24/321 objects degraded (7.477%), 7 pgs degraded (PG_DEGRADED) 2024-09-19T06:46:17.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:16 smithi099 ceph-mon[97031]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 24/321 objects degraded (7.477%), 7 pgs degraded) 2024-09-19T06:46:17.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:16 smithi099 ceph-mon[97031]: Cluster is now healthy 2024-09-19T06:46:17.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:16 smithi117 ceph-mon[76771]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 24/321 objects degraded (7.477%), 7 pgs degraded) 2024-09-19T06:46:17.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:16 smithi117 ceph-mon[76771]: Cluster is now healthy 2024-09-19T06:46:18.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:17 smithi099 ceph-mon[97031]: pgmap v98: 65 pgs: 65 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:46:18.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:17 smithi117 ceph-mon[76771]: pgmap v98: 65 pgs: 65 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:46:20.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:19 smithi099 ceph-mon[97031]: pgmap v99: 65 pgs: 65 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:46:20.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:19 smithi117 ceph-mon[76771]: pgmap v99: 65 pgs: 65 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:46:22.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:21 smithi117 ceph-mon[76771]: pgmap v100: 65 pgs: 65 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:46:22.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:21 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:46:22.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:21 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:46:22.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:21 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:46:22.315 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:21 smithi099 ceph-mon[97031]: pgmap v100: 65 pgs: 65 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:46:22.315 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:21 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:46:22.315 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:21 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:46:22.315 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:21 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:46:24.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:23 smithi117 ceph-mon[76771]: pgmap v101: 65 pgs: 65 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:46:24.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:23 smithi099 ceph-mon[97031]: pgmap v101: 65 pgs: 65 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:46:26.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:25 smithi117 ceph-mon[76771]: pgmap v102: 65 pgs: 65 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:46:26.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:25 smithi099 ceph-mon[97031]: pgmap v102: 65 pgs: 65 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:46:27.187 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:26 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-19T06:46:27.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:26 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-19T06:46:28.297 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:27 smithi117 ceph-mon[76771]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-19T06:46:28.297 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:27 smithi117 ceph-mon[76771]: Upgrade: osd.3 is safe to restart 2024-09-19T06:46:28.297 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:27 smithi117 ceph-mon[76771]: pgmap v103: 65 pgs: 65 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:46:28.297 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:27 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:46:28.298 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:27 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T06:46:28.298 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:27 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:46:28.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:27 smithi099 ceph-mon[97031]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-19T06:46:28.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:27 smithi099 ceph-mon[97031]: Upgrade: osd.3 is safe to restart 2024-09-19T06:46:28.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:27 smithi099 ceph-mon[97031]: pgmap v103: 65 pgs: 65 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:46:28.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:27 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:46:28.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:27 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T06:46:28.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:27 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:46:29.242 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:28 smithi117 ceph-mon[76771]: Upgrade: Updating osd.3 2024-09-19T06:46:29.242 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:28 smithi117 ceph-mon[76771]: Deploying daemon osd.3 on smithi117 2024-09-19T06:46:29.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:28 smithi099 ceph-mon[97031]: Upgrade: Updating osd.3 2024-09-19T06:46:29.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:28 smithi099 ceph-mon[97031]: Deploying daemon osd.3 on smithi117 2024-09-19T06:46:30.202 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:29 smithi117 ceph-mon[76771]: pgmap v104: 65 pgs: 65 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:46:30.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:29 smithi099 ceph-mon[97031]: pgmap v104: 65 pgs: 65 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:46:31.100 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 06:46:30 smithi117 systemd[1]: Stopping Ceph osd.3 for a73eb958-7650-11ef-bceb-c7b262605968... 2024-09-19T06:46:31.562 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 06:46:31 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-3[40034]: 2024-09-19T06:46:31.097+0000 7f5e5ece0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:46:31.562 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 06:46:31 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-3[40034]: 2024-09-19T06:46:31.097+0000 7f5e5ece0640 -1 osd.3 63 *** Got signal Terminated *** 2024-09-19T06:46:31.562 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 06:46:31 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-3[40034]: 2024-09-19T06:46:31.097+0000 7f5e5ece0640 -1 osd.3 63 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:46:32.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:31 smithi117 ceph-mon[76771]: pgmap v105: 65 pgs: 65 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:46:32.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:31 smithi117 ceph-mon[76771]: osd.3 marked itself down and dead 2024-09-19T06:46:32.315 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:31 smithi099 ceph-mon[97031]: pgmap v105: 65 pgs: 65 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:46:32.315 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:31 smithi099 ceph-mon[97031]: osd.3 marked itself down and dead 2024-09-19T06:46:32.673 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 06:46:32 smithi117 podman[85570]: 2024-09-19 06:46:32.340106066 +0000 UTC m=+1.331142220 container died 5984ed999c918fe3a451b5669ea9c439807c549ee295e8cf91ca285b14518300 (image=quay.ceph.io/ceph-ci/ceph@sha256:4d922a456af336b23156460d93b8143eb9c977eee7e72f2e9e44c816e5b46ac8, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-3, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=quincy-6e06d1e, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-19T06:46:32.982 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 06:46:32 smithi117 podman[85570]: 2024-09-19 06:46:32.773806706 +0000 UTC m=+1.764842860 container cleanup 5984ed999c918fe3a451b5669ea9c439807c549ee295e8cf91ca285b14518300 (image=quay.ceph.io/ceph-ci/ceph@sha256:4d922a456af336b23156460d93b8143eb9c977eee7e72f2e9e44c816e5b46ac8, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-3, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=quincy-6e06d1e, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-19T06:46:32.982 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 06:46:32 smithi117 bash[85570]: ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-3 2024-09-19T06:46:33.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:32 smithi117 ceph-mon[76771]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-19T06:46:33.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:32 smithi117 ceph-mon[76771]: osdmap e64: 6 total, 5 up, 6 in 2024-09-19T06:46:33.312 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 06:46:33 smithi117 podman[85599]: 2024-09-19 06:46:33.142337875 +0000 UTC m=+0.801327286 container remove 5984ed999c918fe3a451b5669ea9c439807c549ee295e8cf91ca285b14518300 (image=quay.ceph.io/ceph-ci/ceph@sha256:4d922a456af336b23156460d93b8143eb9c977eee7e72f2e9e44c816e5b46ac8, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=quincy-6e06d1e, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, ceph=True) 2024-09-19T06:46:33.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:32 smithi099 ceph-mon[97031]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-19T06:46:33.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:32 smithi099 ceph-mon[97031]: osdmap e64: 6 total, 5 up, 6 in 2024-09-19T06:46:33.913 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 06:46:33 smithi117 podman[85686]: 2024-09-19 06:46:33.626687877 +0000 UTC m=+0.109606225 container create 1acc07dbe174f06a09b959b3ef4903e88d06f45dc935e72589bfa67734d295b5 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-19T06:46:33.913 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 06:46:33 smithi117 podman[85686]: 2024-09-19 06:46:33.533296709 +0000 UTC m=+0.016215072 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:46:33.913 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 06:46:33 smithi117 podman[85686]: 2024-09-19 06:46:33.851600228 +0000 UTC m=+0.334518576 container init 1acc07dbe174f06a09b959b3ef4903e88d06f45dc935e72589bfa67734d295b5 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-3-deactivate, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-19T06:46:33.913 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 06:46:33 smithi117 podman[85686]: 2024-09-19 06:46:33.854950864 +0000 UTC m=+0.337869213 container start 1acc07dbe174f06a09b959b3ef4903e88d06f45dc935e72589bfa67734d295b5 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-3-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-19T06:46:33.913 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 06:46:33 smithi117 podman[85686]: 2024-09-19 06:46:33.912287858 +0000 UTC m=+0.395206227 container attach 1acc07dbe174f06a09b959b3ef4903e88d06f45dc935e72589bfa67734d295b5 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-3-deactivate, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=) 2024-09-19T06:46:34.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:33 smithi117 ceph-mon[76771]: pgmap v107: 65 pgs: 18 peering, 6 stale+active+clean, 41 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:46:34.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:33 smithi117 ceph-mon[76771]: Health check failed: Reduced data availability: 10 pgs peering (PG_AVAILABILITY) 2024-09-19T06:46:34.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:33 smithi117 ceph-mon[76771]: osdmap e65: 6 total, 5 up, 6 in 2024-09-19T06:46:34.312 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 06:46:34 smithi117 podman[85686]: 2024-09-19 06:46:34.042457499 +0000 UTC m=+0.525375865 container died 1acc07dbe174f06a09b959b3ef4903e88d06f45dc935e72589bfa67734d295b5 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-19T06:46:34.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:33 smithi099 ceph-mon[97031]: pgmap v107: 65 pgs: 18 peering, 6 stale+active+clean, 41 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:46:34.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:33 smithi099 ceph-mon[97031]: Health check failed: Reduced data availability: 10 pgs peering (PG_AVAILABILITY) 2024-09-19T06:46:34.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:33 smithi099 ceph-mon[97031]: osdmap e65: 6 total, 5 up, 6 in 2024-09-19T06:46:35.062 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 06:46:34 smithi117 podman[85709]: 2024-09-19 06:46:34.617388308 +0000 UTC m=+0.569360703 container remove 1acc07dbe174f06a09b959b3ef4903e88d06f45dc935e72589bfa67734d295b5 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-19T06:46:35.062 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 06:46:34 smithi117 systemd[1]: ceph-a73eb958-7650-11ef-bceb-c7b262605968@osd.3.service: Deactivated successfully. 2024-09-19T06:46:35.062 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 06:46:34 smithi117 systemd[1]: Stopped Ceph osd.3 for a73eb958-7650-11ef-bceb-c7b262605968. 2024-09-19T06:46:35.062 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 06:46:34 smithi117 systemd[1]: ceph-a73eb958-7650-11ef-bceb-c7b262605968@osd.3.service: Consumed 1min 11.384s CPU time. 2024-09-19T06:46:35.062 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 06:46:34 smithi117 systemd[1]: Starting Ceph osd.3 for a73eb958-7650-11ef-bceb-c7b262605968... 2024-09-19T06:46:35.346 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 06:46:35 smithi117 podman[85813]: 2024-09-19 06:46:34.970290486 +0000 UTC m=+0.015788264 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:46:35.346 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 06:46:35 smithi117 podman[85813]: 2024-09-19 06:46:35.08521128 +0000 UTC m=+0.130709093 container create 8c6e60560f2b5bf0fa4f0619a788eb33404168a4f075360788fc61abe715a948 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-3-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-19T06:46:35.346 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 06:46:35 smithi117 podman[85813]: 2024-09-19 06:46:35.27111943 +0000 UTC m=+0.316617209 container init 8c6e60560f2b5bf0fa4f0619a788eb33404168a4f075360788fc61abe715a948 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-3-activate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-19T06:46:35.347 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 06:46:35 smithi117 podman[85813]: 2024-09-19 06:46:35.274670473 +0000 UTC m=+0.320168240 container start 8c6e60560f2b5bf0fa4f0619a788eb33404168a4f075360788fc61abe715a948 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-3-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-19T06:46:35.347 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 06:46:35 smithi117 podman[85813]: 2024-09-19 06:46:35.345856046 +0000 UTC m=+0.391353826 container attach 8c6e60560f2b5bf0fa4f0619a788eb33404168a4f075360788fc61abe715a948 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-3-activate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:46:35.811 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 06:46:35 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-3-activate[85828]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T06:46:35.812 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 06:46:35 smithi117 bash[85813]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T06:46:35.812 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 06:46:35 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-3-activate[85828]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T06:46:35.812 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 06:46:35 smithi117 bash[85813]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T06:46:36.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:35 smithi117 ceph-mon[76771]: pgmap v109: 65 pgs: 18 peering, 6 stale+active+clean, 41 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:46:36.312 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 06:46:36 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-3-activate[85828]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-19T06:46:36.312 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 06:46:36 smithi117 bash[85813]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-19T06:46:36.312 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 06:46:36 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-3-activate[85828]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-19T06:46:36.313 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 06:46:36 smithi117 bash[85813]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-19T06:46:36.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:35 smithi099 ceph-mon[97031]: pgmap v109: 65 pgs: 18 peering, 6 stale+active+clean, 41 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:46:36.732 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 06:46:36 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-3-activate[85828]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-19T06:46:36.733 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 06:46:36 smithi117 bash[85813]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-19T06:46:36.733 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 06:46:36 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-3-activate[85828]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-19T06:46:36.733 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 06:46:36 smithi117 bash[85813]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-19T06:46:36.733 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 06:46:36 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-3-activate[85828]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-19T06:46:36.733 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 06:46:36 smithi117 bash[85813]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-19T06:46:36.733 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 06:46:36 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-3-activate[85828]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-19T06:46:36.733 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 06:46:36 smithi117 bash[85813]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-19T06:46:36.733 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 06:46:36 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-3-activate[85828]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-19T06:46:36.733 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 06:46:36 smithi117 bash[85813]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-19T06:46:36.733 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 06:46:36 smithi117 podman[85813]: 2024-09-19 06:46:36.452999568 +0000 UTC m=+1.498497349 container died 8c6e60560f2b5bf0fa4f0619a788eb33404168a4f075360788fc61abe715a948 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-3-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4) 2024-09-19T06:46:37.311 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 06:46:37 smithi117 podman[85973]: 2024-09-19 06:46:37.057783705 +0000 UTC m=+0.599076657 container remove 8c6e60560f2b5bf0fa4f0619a788eb33404168a4f075360788fc61abe715a948 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-3-activate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True) 2024-09-19T06:46:37.312 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 06:46:37 smithi117 podman[86033]: 2024-09-19 06:46:37.167014154 +0000 UTC m=+0.015599248 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:46:37.312 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 06:46:37 smithi117 podman[86033]: 2024-09-19 06:46:37.266908802 +0000 UTC m=+0.115493920 container create ea5236b193d3e56717db974d1262607e06e27cdcdce442ffae5f72f53348a118 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-3, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:46:37.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.608+0000 7f9357ade640 1 -- 172.21.15.99:0/1093757537 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9350102550 msgr2=0x7f9350102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:37.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.608+0000 7f9357ade640 1 --2- 172.21.15.99:0/1093757537 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9350102550 0x7f9350102920 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f93440048d0 tx=0x7f9344009da0 comp rx=0 tx=0).stop 2024-09-19T06:46:37.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.608+0000 7f9357ade640 1 -- 172.21.15.99:0/1093757537 shutdown_connections 2024-09-19T06:46:37.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.608+0000 7f9357ade640 1 --2- 172.21.15.99:0/1093757537 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9350102ef0 0x7f93500fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:37.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.608+0000 7f9357ade640 1 --2- 172.21.15.99:0/1093757537 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9350102550 0x7f9350102920 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:37.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.608+0000 7f9357ade640 1 -- 172.21.15.99:0/1093757537 >> 172.21.15.99:0/1093757537 conn(0x7f93500f80f0 msgr2=0x7f93500fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:37.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.608+0000 7f9357ade640 1 -- 172.21.15.99:0/1093757537 shutdown_connections 2024-09-19T06:46:37.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.608+0000 7f9357ade640 1 -- 172.21.15.99:0/1093757537 wait complete. 2024-09-19T06:46:37.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.609+0000 7f9357ade640 1 Processor -- start 2024-09-19T06:46:37.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.609+0000 7f9357ade640 1 -- start start 2024-09-19T06:46:37.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.609+0000 7f9357ade640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9350102550 0x7f935006fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:37.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.609+0000 7f9357ade640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9350102ef0 0x7f935006ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:37.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.609+0000 7f9357ade640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9350070490 con 0x7f9350102550 2024-09-19T06:46:37.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.609+0000 7f9357ade640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9350070600 con 0x7f9350102ef0 2024-09-19T06:46:37.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.609+0000 7f935587a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9350102550 0x7f935006fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:37.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.609+0000 7f935587a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9350102550 0x7f935006fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:43994/0 (socket says 172.21.15.99:43994) 2024-09-19T06:46:37.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.609+0000 7f935587a640 1 -- 172.21.15.99:0/3991943871 learned_addr learned my addr 172.21.15.99:0/3991943871 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:46:37.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.609+0000 7f9355079640 1 --2- 172.21.15.99:0/3991943871 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9350102ef0 0x7f935006ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:37.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.610+0000 7f935587a640 1 -- 172.21.15.99:0/3991943871 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9350102ef0 msgr2=0x7f935006ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:37.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.610+0000 7f935587a640 1 --2- 172.21.15.99:0/3991943871 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9350102ef0 0x7f935006ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:37.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.610+0000 7f935587a640 1 -- 172.21.15.99:0/3991943871 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9344005040 con 0x7f9350102550 2024-09-19T06:46:37.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.610+0000 7f9355079640 1 --2- 172.21.15.99:0/3991943871 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9350102ef0 0x7f935006ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:46:37.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.610+0000 7f935587a640 1 --2- 172.21.15.99:0/3991943871 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9350102550 0x7f935006fa10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9344000c00 tx=0x7f9344009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:37.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.610+0000 7f93427fc640 1 -- 172.21.15.99:0/3991943871 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9344038070 con 0x7f9350102550 2024-09-19T06:46:37.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.610+0000 7f93427fc640 1 -- 172.21.15.99:0/3991943871 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f934402ade0 con 0x7f9350102550 2024-09-19T06:46:37.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.610+0000 7f9357ade640 1 -- 172.21.15.99:0/3991943871 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9350070830 con 0x7f9350102550 2024-09-19T06:46:37.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.610+0000 7f93427fc640 1 -- 172.21.15.99:0/3991943871 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f934402c7b0 con 0x7f9350102550 2024-09-19T06:46:37.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.610+0000 7f9357ade640 1 -- 172.21.15.99:0/3991943871 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9350119bc0 con 0x7f9350102550 2024-09-19T06:46:37.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.611+0000 7f9357ade640 1 -- 172.21.15.99:0/3991943871 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93500fdcd0 con 0x7f9350102550 2024-09-19T06:46:37.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.612+0000 7f93427fc640 1 -- 172.21.15.99:0/3991943871 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f9344030020 con 0x7f9350102550 2024-09-19T06:46:37.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.612+0000 7f93427fc640 1 --2- 172.21.15.99:0/3991943871 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f933c06e530 0x7f933c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:37.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.612+0000 7f93427fc640 1 -- 172.21.15.99:0/3991943871 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f93440ae600 con 0x7f9350102550 2024-09-19T06:46:37.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.612+0000 7f9355079640 1 --2- 172.21.15.99:0/3991943871 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f933c06e530 0x7f933c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:37.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.613+0000 7f9355079640 1 --2- 172.21.15.99:0/3991943871 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f933c06e530 0x7f933c0709e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f934c007fd0 tx=0x7f934c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:37.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.617+0000 7f93427fc640 1 -- 172.21.15.99:0/3991943871 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f9344077790 con 0x7f9350102550 2024-09-19T06:46:37.811 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 06:46:37 smithi117 podman[86033]: 2024-09-19 06:46:37.50379839 +0000 UTC m=+0.352383472 container init ea5236b193d3e56717db974d1262607e06e27cdcdce442ffae5f72f53348a118 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-19T06:46:37.812 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 06:46:37 smithi117 podman[86033]: 2024-09-19 06:46:37.50682429 +0000 UTC m=+0.355409367 container start ea5236b193d3e56717db974d1262607e06e27cdcdce442ffae5f72f53348a118 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-3, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-19T06:46:37.812 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 06:46:37 smithi117 ceph-osd[86052]: -- 172.21.15.117:0/2679138485 <== mon.1 v2:172.21.15.117:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56378a3ca1e0 con 0x56378a3b2000 2024-09-19T06:46:37.812 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 06:46:37 smithi117 bash[86033]: ea5236b193d3e56717db974d1262607e06e27cdcdce442ffae5f72f53348a118 2024-09-19T06:46:37.812 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 06:46:37 smithi117 systemd[1]: Started Ceph osd.3 for a73eb958-7650-11ef-bceb-c7b262605968. 2024-09-19T06:46:37.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.817+0000 7f9357ade640 1 -- 172.21.15.99:0/3991943871 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9350071100 con 0x7f933c06e530 2024-09-19T06:46:37.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.818+0000 7f93427fc640 1 -- 172.21.15.99:0/3991943871 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f9350071100 con 0x7f933c06e530 2024-09-19T06:46:37.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.820+0000 7f9357ade640 1 -- 172.21.15.99:0/3991943871 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f933c06e530 msgr2=0x7f933c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:37.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.820+0000 7f9357ade640 1 --2- 172.21.15.99:0/3991943871 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f933c06e530 0x7f933c0709e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f934c007fd0 tx=0x7f934c00b040 comp rx=0 tx=0).stop 2024-09-19T06:46:37.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.820+0000 7f9357ade640 1 -- 172.21.15.99:0/3991943871 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9350102550 msgr2=0x7f935006fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:37.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.820+0000 7f9357ade640 1 --2- 172.21.15.99:0/3991943871 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9350102550 0x7f935006fa10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9344000c00 tx=0x7f9344009da0 comp rx=0 tx=0).stop 2024-09-19T06:46:37.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.820+0000 7f9357ade640 1 -- 172.21.15.99:0/3991943871 shutdown_connections 2024-09-19T06:46:37.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.820+0000 7f9357ade640 1 --2- 172.21.15.99:0/3991943871 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f933c06e530 0x7f933c0709e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:37.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.820+0000 7f9357ade640 1 --2- 172.21.15.99:0/3991943871 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9350102ef0 0x7f935006ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:37.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.820+0000 7f9357ade640 1 --2- 172.21.15.99:0/3991943871 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9350102550 0x7f935006fa10 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:37.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.820+0000 7f9357ade640 1 -- 172.21.15.99:0/3991943871 >> 172.21.15.99:0/3991943871 conn(0x7f93500f80f0 msgr2=0x7f93500f9160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:37.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.821+0000 7f9357ade640 1 -- 172.21.15.99:0/3991943871 shutdown_connections 2024-09-19T06:46:37.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.821+0000 7f9357ade640 1 -- 172.21.15.99:0/3991943871 wait complete. 2024-09-19T06:46:37.830 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-09-19T06:46:37.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.901+0000 7f99db89d640 1 -- 172.21.15.99:0/4179077111 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99d4102550 msgr2=0x7f99d4102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:37.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.901+0000 7f99db89d640 1 --2- 172.21.15.99:0/4179077111 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99d4102550 0x7f99d4102920 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f99d00048d0 tx=0x7f99d0009da0 comp rx=0 tx=0).stop 2024-09-19T06:46:37.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.901+0000 7f99db89d640 1 -- 172.21.15.99:0/4179077111 shutdown_connections 2024-09-19T06:46:37.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.901+0000 7f99db89d640 1 --2- 172.21.15.99:0/4179077111 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99d4102ef0 0x7f99d40fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:37.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.901+0000 7f99db89d640 1 --2- 172.21.15.99:0/4179077111 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99d4102550 0x7f99d4102920 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:37.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.901+0000 7f99db89d640 1 -- 172.21.15.99:0/4179077111 >> 172.21.15.99:0/4179077111 conn(0x7f99d40f80f0 msgr2=0x7f99d40fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:37.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.901+0000 7f99db89d640 1 -- 172.21.15.99:0/4179077111 shutdown_connections 2024-09-19T06:46:37.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.901+0000 7f99db89d640 1 -- 172.21.15.99:0/4179077111 wait complete. 2024-09-19T06:46:37.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.902+0000 7f99db89d640 1 Processor -- start 2024-09-19T06:46:37.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.902+0000 7f99db89d640 1 -- start start 2024-09-19T06:46:37.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.902+0000 7f99db89d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99d4102550 0x7f99d4113540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:37.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.902+0000 7f99db89d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99d4102ef0 0x7f99d4113a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:37.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.902+0000 7f99db89d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d41140d0 con 0x7f99d4102550 2024-09-19T06:46:37.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.902+0000 7f99db89d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d410d4e0 con 0x7f99d4102ef0 2024-09-19T06:46:37.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.902+0000 7f99d9639640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99d4102550 0x7f99d4113540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:37.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.902+0000 7f99d9639640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99d4102550 0x7f99d4113540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:44000/0 (socket says 172.21.15.99:44000) 2024-09-19T06:46:37.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.902+0000 7f99d9639640 1 -- 172.21.15.99:0/4011026518 learned_addr learned my addr 172.21.15.99:0/4011026518 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:46:37.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.902+0000 7f99d8e38640 1 --2- 172.21.15.99:0/4011026518 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99d4102ef0 0x7f99d4113a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:37.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.902+0000 7f99d9639640 1 -- 172.21.15.99:0/4011026518 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99d4102ef0 msgr2=0x7f99d4113a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:37.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.902+0000 7f99d9639640 1 --2- 172.21.15.99:0/4011026518 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99d4102ef0 0x7f99d4113a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:37.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.902+0000 7f99d9639640 1 -- 172.21.15.99:0/4011026518 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99d0005040 con 0x7f99d4102550 2024-09-19T06:46:37.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.902+0000 7f99d9639640 1 --2- 172.21.15.99:0/4011026518 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99d4102550 0x7f99d4113540 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f99d0000c00 tx=0x7f99d0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:37.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.903+0000 7f99c9ffb640 1 -- 172.21.15.99:0/4011026518 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99d0038070 con 0x7f99d4102550 2024-09-19T06:46:37.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.903+0000 7f99c9ffb640 1 -- 172.21.15.99:0/4011026518 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f99d002ade0 con 0x7f99d4102550 2024-09-19T06:46:37.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.903+0000 7f99db89d640 1 -- 172.21.15.99:0/4011026518 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99d410d760 con 0x7f99d4102550 2024-09-19T06:46:37.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.903+0000 7f99c9ffb640 1 -- 172.21.15.99:0/4011026518 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99d002c7e0 con 0x7f99d4102550 2024-09-19T06:46:37.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.903+0000 7f99db89d640 1 -- 172.21.15.99:0/4011026518 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99d410dca0 con 0x7f99d4102550 2024-09-19T06:46:37.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.904+0000 7f99db89d640 1 -- 172.21.15.99:0/4011026518 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99d40fdcd0 con 0x7f99d4102550 2024-09-19T06:46:37.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.904+0000 7f99c9ffb640 1 -- 172.21.15.99:0/4011026518 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f99d0030020 con 0x7f99d4102550 2024-09-19T06:46:37.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.905+0000 7f99c9ffb640 1 --2- 172.21.15.99:0/4011026518 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f99c006e530 0x7f99c00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:37.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.905+0000 7f99c9ffb640 1 -- 172.21.15.99:0/4011026518 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f99d00adca0 con 0x7f99d4102550 2024-09-19T06:46:37.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.905+0000 7f99d8e38640 1 --2- 172.21.15.99:0/4011026518 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f99c006e530 0x7f99c00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:37.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.905+0000 7f99d8e38640 1 --2- 172.21.15.99:0/4011026518 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f99c006e530 0x7f99c00709e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f99d410e7c0 tx=0x7f99c400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:37.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:37.909+0000 7f99c9ffb640 1 -- 172.21.15.99:0/4011026518 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f99d00b2070 con 0x7f99d4102550 2024-09-19T06:46:38.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.093+0000 7f99db89d640 1 -- 172.21.15.99:0/4011026518 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f99d404b750 con 0x7f99c006e530 2024-09-19T06:46:38.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.095+0000 7f99c9ffb640 1 -- 172.21.15.99:0/4011026518 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f99d404b750 con 0x7f99c006e530 2024-09-19T06:46:38.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.097+0000 7f99db89d640 1 -- 172.21.15.99:0/4011026518 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f99c006e530 msgr2=0x7f99c00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:38.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.097+0000 7f99db89d640 1 --2- 172.21.15.99:0/4011026518 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f99c006e530 0x7f99c00709e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f99d410e7c0 tx=0x7f99c400b040 comp rx=0 tx=0).stop 2024-09-19T06:46:38.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.097+0000 7f99db89d640 1 -- 172.21.15.99:0/4011026518 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99d4102550 msgr2=0x7f99d4113540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:38.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.097+0000 7f99db89d640 1 --2- 172.21.15.99:0/4011026518 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99d4102550 0x7f99d4113540 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f99d0000c00 tx=0x7f99d0009da0 comp rx=0 tx=0).stop 2024-09-19T06:46:38.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.097+0000 7f99db89d640 1 -- 172.21.15.99:0/4011026518 shutdown_connections 2024-09-19T06:46:38.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.097+0000 7f99db89d640 1 --2- 172.21.15.99:0/4011026518 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f99c006e530 0x7f99c00709e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:38.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.097+0000 7f99db89d640 1 --2- 172.21.15.99:0/4011026518 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99d4102ef0 0x7f99d4113a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:38.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.097+0000 7f99db89d640 1 --2- 172.21.15.99:0/4011026518 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99d4102550 0x7f99d4113540 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:38.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.097+0000 7f99db89d640 1 -- 172.21.15.99:0/4011026518 >> 172.21.15.99:0/4011026518 conn(0x7f99d40f80f0 msgr2=0x7f99d40f9160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:38.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.097+0000 7f99db89d640 1 -- 172.21.15.99:0/4011026518 shutdown_connections 2024-09-19T06:46:38.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.097+0000 7f99db89d640 1 -- 172.21.15.99:0/4011026518 wait complete. 2024-09-19T06:46:38.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.174+0000 7ffa65546640 1 -- 172.21.15.99:0/756803179 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa600703c0 msgr2=0x7ffa60108870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:38.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.174+0000 7ffa65546640 1 --2- 172.21.15.99:0/756803179 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa600703c0 0x7ffa60108870 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ffa540048d0 tx=0x7ffa54009da0 comp rx=0 tx=0).stop 2024-09-19T06:46:38.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.174+0000 7ffa65546640 1 -- 172.21.15.99:0/756803179 shutdown_connections 2024-09-19T06:46:38.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.174+0000 7ffa65546640 1 --2- 172.21.15.99:0/756803179 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa600703c0 0x7ffa60108870 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:38.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.174+0000 7ffa65546640 1 --2- 172.21.15.99:0/756803179 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa6006fab0 0x7ffa6006fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:38.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.174+0000 7ffa65546640 1 -- 172.21.15.99:0/756803179 >> 172.21.15.99:0/756803179 conn(0x7ffa600f80f0 msgr2=0x7ffa600fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:38.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.174+0000 7ffa65546640 1 -- 172.21.15.99:0/756803179 shutdown_connections 2024-09-19T06:46:38.177 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:37 smithi099 ceph-mon[97031]: pgmap v110: 65 pgs: 10 active+undersized, 18 peering, 10 active+undersized+degraded, 27 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 28/321 objects degraded (8.723%) 2024-09-19T06:46:38.177 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:37 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:46:38.177 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:37 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:46:38.177 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:37 smithi099 ceph-mon[97031]: Health check failed: Degraded data redundancy: 28/321 objects degraded (8.723%), 10 pgs degraded (PG_DEGRADED) 2024-09-19T06:46:38.177 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:37 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:46:38.177 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:37 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:46:38.177 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:37 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:46:38.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.174+0000 7ffa65546640 1 -- 172.21.15.99:0/756803179 wait complete. 2024-09-19T06:46:38.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.175+0000 7ffa65546640 1 Processor -- start 2024-09-19T06:46:38.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.175+0000 7ffa65546640 1 -- start start 2024-09-19T06:46:38.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.175+0000 7ffa65546640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa6006fab0 0x7ffa60115560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:38.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.175+0000 7ffa65546640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa600703c0 0x7ffa60115aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:38.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.175+0000 7ffa65546640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa60116180 con 0x7ffa600703c0 2024-09-19T06:46:38.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.175+0000 7ffa65546640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6010f500 con 0x7ffa6006fab0 2024-09-19T06:46:38.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.175+0000 7ffa5e7fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa600703c0 0x7ffa60115aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:38.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.175+0000 7ffa5e7fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa600703c0 0x7ffa60115aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:44008/0 (socket says 172.21.15.99:44008) 2024-09-19T06:46:38.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.175+0000 7ffa5e7fc640 1 -- 172.21.15.99:0/3739039278 learned_addr learned my addr 172.21.15.99:0/3739039278 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:46:38.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.176+0000 7ffa5effd640 1 --2- 172.21.15.99:0/3739039278 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa6006fab0 0x7ffa60115560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:38.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.176+0000 7ffa5e7fc640 1 -- 172.21.15.99:0/3739039278 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa6006fab0 msgr2=0x7ffa60115560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:38.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.176+0000 7ffa5e7fc640 1 --2- 172.21.15.99:0/3739039278 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa6006fab0 0x7ffa60115560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:38.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.176+0000 7ffa5e7fc640 1 -- 172.21.15.99:0/3739039278 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa54005040 con 0x7ffa600703c0 2024-09-19T06:46:38.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.176+0000 7ffa5effd640 1 --2- 172.21.15.99:0/3739039278 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa6006fab0 0x7ffa60115560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:46:38.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.176+0000 7ffa5e7fc640 1 --2- 172.21.15.99:0/3739039278 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa600703c0 0x7ffa60115aa0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ffa54003080 tx=0x7ffa54009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:38.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.176+0000 7ffa477fe640 1 -- 172.21.15.99:0/3739039278 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa54038070 con 0x7ffa600703c0 2024-09-19T06:46:38.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.176+0000 7ffa477fe640 1 -- 172.21.15.99:0/3739039278 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ffa540097e0 con 0x7ffa600703c0 2024-09-19T06:46:38.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.176+0000 7ffa65546640 1 -- 172.21.15.99:0/3739039278 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa6010f730 con 0x7ffa600703c0 2024-09-19T06:46:38.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.176+0000 7ffa477fe640 1 -- 172.21.15.99:0/3739039278 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa5403d420 con 0x7ffa600703c0 2024-09-19T06:46:38.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.176+0000 7ffa65546640 1 -- 172.21.15.99:0/3739039278 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa6010fbf0 con 0x7ffa600703c0 2024-09-19T06:46:38.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.177+0000 7ffa65546640 1 -- 172.21.15.99:0/3739039278 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa600711f0 con 0x7ffa600703c0 2024-09-19T06:46:38.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.178+0000 7ffa477fe640 1 -- 172.21.15.99:0/3739039278 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7ffa54030020 con 0x7ffa600703c0 2024-09-19T06:46:38.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.178+0000 7ffa477fe640 1 --2- 172.21.15.99:0/3739039278 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ffa4806e530 0x7ffa480709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:38.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.178+0000 7ffa477fe640 1 -- 172.21.15.99:0/3739039278 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6324+0+0 (secure 0 0 0) 0x7ffa540ae590 con 0x7ffa600703c0 2024-09-19T06:46:38.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.178+0000 7ffa5effd640 1 --2- 172.21.15.99:0/3739039278 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ffa4806e530 0x7ffa480709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:38.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.179+0000 7ffa5effd640 1 --2- 172.21.15.99:0/3739039278 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ffa4806e530 0x7ffa480709e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ffa50001370 tx=0x7ffa500096a0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:38.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.183+0000 7ffa477fe640 1 -- 172.21.15.99:0/3739039278 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7ffa540777a0 con 0x7ffa600703c0 2024-09-19T06:46:38.276 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:37 smithi117 ceph-mon[76771]: pgmap v110: 65 pgs: 10 active+undersized, 18 peering, 10 active+undersized+degraded, 27 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 28/321 objects degraded (8.723%) 2024-09-19T06:46:38.276 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:37 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:46:38.276 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:37 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:46:38.276 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:37 smithi117 ceph-mon[76771]: Health check failed: Degraded data redundancy: 28/321 objects degraded (8.723%), 10 pgs degraded (PG_DEGRADED) 2024-09-19T06:46:38.276 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:37 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:46:38.276 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:37 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:46:38.276 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:37 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:46:38.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.357+0000 7ffa65546640 1 -- 172.21.15.99:0/3739039278 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ffa6010b7d0 con 0x7ffa4806e530 2024-09-19T06:46:38.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.365+0000 7ffa477fe640 1 -- 172.21.15.99:0/3739039278 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7ffa6010b7d0 con 0x7ffa4806e530 2024-09-19T06:46:38.366 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T06:46:38.367 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.smithi099 smithi099 *:9093,9094 running (5m) 30s ago 14m 23.4M - 0.25.0 c8568f914cd2 e7c1774d56b0 2024-09-19T06:46:38.367 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi099 smithi099 running (2m) 30s ago 14m 6899k - 19.1.1-361-g2f599a46 d2baa855c067 b9775f416b10 2024-09-19T06:46:38.367 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi117 smithi117 running (2m) 2m ago 13m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 38cf60c0d548 2024-09-19T06:46:38.367 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.smithi099 smithi099 *:3000 running (4m) 30s ago 13m 80.4M - 9.4.12 2bacad6d85d8 cd53a18d5410 2024-09-19T06:46:38.367 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.obarqf smithi099 running (8m) 30s ago 8m 14.2M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 e36c9b74004b 2024-09-19T06:46:38.367 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.xehbxe smithi099 running (8m) 30s ago 8m 121M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 d09eb3d306ae 2024-09-19T06:46:38.367 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.bheqzh smithi117 running (8m) 2m ago 8m 15.4M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 21253e27fdd3 2024-09-19T06:46:38.367 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.nooexo smithi117 running (8m) 2m ago 8m 109M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 ad1faeb3343c 2024-09-19T06:46:38.367 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi099.pgvkqi smithi099 *:8443,9283,8765 running (5m) 30s ago 15m 500M - 19.1.1-361-g2f599a46 d2baa855c067 d5de99cb7e78 2024-09-19T06:46:38.367 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi117.ssmkcf smithi117 *:8443,9283,8765 running (4m) 2m ago 13m 441M - 19.1.1-361-g2f599a46 d2baa855c067 8b7ee0f871f5 2024-09-19T06:46:38.367 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi099 smithi099 running (3m) 30s ago 15m 48.7M 2048M 19.1.1-361-g2f599a46 d2baa855c067 ffe067438824 2024-09-19T06:46:38.367 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi117 smithi117 running (2m) 2m ago 13m 33.3M 2048M 19.1.1-361-g2f599a46 d2baa855c067 4cb7455e3ee7 2024-09-19T06:46:38.368 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi099 smithi099 *:9100 running (5m) 30s ago 14m 15.6M - 1.5.0 0da6a335fe13 dca7b4517dcc 2024-09-19T06:46:38.368 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi117 smithi117 *:9100 running (5m) 2m ago 13m 16.0M - 1.5.0 0da6a335fe13 8233ce3835d2 2024-09-19T06:46:38.368 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (106s) 30s ago 12m 96.9M 1557M 19.1.1-361-g2f599a46 d2baa855c067 8e22543bf933 2024-09-19T06:46:38.368 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (71s) 30s ago 11m 103M 1557M 19.1.1-361-g2f599a46 d2baa855c067 f54153d0ae09 2024-09-19T06:46:38.368 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (36s) 30s ago 11m 11.2M 1557M 19.1.1-361-g2f599a46 d2baa855c067 b1778ab88870 2024-09-19T06:46:38.368 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi117 starting - - - 2581M 2024-09-19T06:46:38.368 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi117 running (10m) 2m ago 10m 232M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 6a2fc0c51c05 2024-09-19T06:46:38.368 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi117 running (10m) 2m ago 10m 226M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 39dcb7dbf0e3 2024-09-19T06:46:38.368 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.smithi099 smithi099 *:9095 running (4m) 30s ago 13m 63.1M - 2.43.0 a07b618ecd1d 15ad26ec6fb4 2024-09-19T06:46:38.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.367+0000 7ffa65546640 1 -- 172.21.15.99:0/3739039278 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ffa4806e530 msgr2=0x7ffa480709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:38.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.367+0000 7ffa65546640 1 --2- 172.21.15.99:0/3739039278 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ffa4806e530 0x7ffa480709e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ffa50001370 tx=0x7ffa500096a0 comp rx=0 tx=0).stop 2024-09-19T06:46:38.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.367+0000 7ffa65546640 1 -- 172.21.15.99:0/3739039278 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa600703c0 msgr2=0x7ffa60115aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:38.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.367+0000 7ffa65546640 1 --2- 172.21.15.99:0/3739039278 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa600703c0 0x7ffa60115aa0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ffa54003080 tx=0x7ffa54009da0 comp rx=0 tx=0).stop 2024-09-19T06:46:38.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.367+0000 7ffa65546640 1 -- 172.21.15.99:0/3739039278 shutdown_connections 2024-09-19T06:46:38.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.367+0000 7ffa65546640 1 --2- 172.21.15.99:0/3739039278 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ffa4806e530 0x7ffa480709e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:38.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.367+0000 7ffa65546640 1 --2- 172.21.15.99:0/3739039278 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa600703c0 0x7ffa60115aa0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:38.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.367+0000 7ffa65546640 1 --2- 172.21.15.99:0/3739039278 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa6006fab0 0x7ffa60115560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:38.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.367+0000 7ffa65546640 1 -- 172.21.15.99:0/3739039278 >> 172.21.15.99:0/3739039278 conn(0x7ffa600f80f0 msgr2=0x7ffa600f9610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:38.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.367+0000 7ffa65546640 1 -- 172.21.15.99:0/3739039278 shutdown_connections 2024-09-19T06:46:38.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.367+0000 7ffa65546640 1 -- 172.21.15.99:0/3739039278 wait complete. 2024-09-19T06:46:38.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.444+0000 7f61f991b640 1 -- 172.21.15.99:0/2574603527 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f61f40703c0 msgr2=0x7f61f41088a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:38.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.444+0000 7f61f991b640 1 --2- 172.21.15.99:0/2574603527 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f61f40703c0 0x7f61f41088a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f61e80048d0 tx=0x7f61e8009da0 comp rx=0 tx=0).stop 2024-09-19T06:46:38.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.444+0000 7f61f991b640 1 -- 172.21.15.99:0/2574603527 shutdown_connections 2024-09-19T06:46:38.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.444+0000 7f61f991b640 1 --2- 172.21.15.99:0/2574603527 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f61f40703c0 0x7f61f41088a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:38.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.444+0000 7f61f991b640 1 --2- 172.21.15.99:0/2574603527 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61f406fab0 0x7f61f406fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:38.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.444+0000 7f61f991b640 1 -- 172.21.15.99:0/2574603527 >> 172.21.15.99:0/2574603527 conn(0x7f61f40f8120 msgr2=0x7f61f40fa530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:38.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.445+0000 7f61f991b640 1 -- 172.21.15.99:0/2574603527 shutdown_connections 2024-09-19T06:46:38.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.445+0000 7f61f991b640 1 -- 172.21.15.99:0/2574603527 wait complete. 2024-09-19T06:46:38.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.445+0000 7f61f991b640 1 Processor -- start 2024-09-19T06:46:38.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.445+0000 7f61f991b640 1 -- start start 2024-09-19T06:46:38.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.446+0000 7f61f991b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f61f406fab0 0x7f61f4115430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:38.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.446+0000 7f61f991b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61f40703c0 0x7f61f4115970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:38.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.446+0000 7f61f991b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f4115f70 con 0x7f61f406fab0 2024-09-19T06:46:38.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.446+0000 7f61f991b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f41160e0 con 0x7f61f40703c0 2024-09-19T06:46:38.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.446+0000 7f61f2ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f61f406fab0 0x7f61f4115430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:38.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.446+0000 7f61f2ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f61f406fab0 0x7f61f4115430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:44026/0 (socket says 172.21.15.99:44026) 2024-09-19T06:46:38.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.446+0000 7f61f2ffd640 1 -- 172.21.15.99:0/4219439052 learned_addr learned my addr 172.21.15.99:0/4219439052 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:46:38.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.446+0000 7f61f27fc640 1 --2- 172.21.15.99:0/4219439052 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61f40703c0 0x7f61f4115970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:38.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.446+0000 7f61f2ffd640 1 -- 172.21.15.99:0/4219439052 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61f40703c0 msgr2=0x7f61f4115970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:38.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.446+0000 7f61f2ffd640 1 --2- 172.21.15.99:0/4219439052 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61f40703c0 0x7f61f4115970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:38.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.446+0000 7f61f2ffd640 1 -- 172.21.15.99:0/4219439052 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e8005040 con 0x7f61f406fab0 2024-09-19T06:46:38.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.446+0000 7f61f2ffd640 1 --2- 172.21.15.99:0/4219439052 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f61f406fab0 0x7f61f4115430 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f61ec00eb70 tx=0x7f61ec00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:38.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.447+0000 7f61db7fe640 1 -- 172.21.15.99:0/4219439052 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61ec007c30 con 0x7f61f406fab0 2024-09-19T06:46:38.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.447+0000 7f61db7fe640 1 -- 172.21.15.99:0/4219439052 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f61ec00f040 con 0x7f61f406fab0 2024-09-19T06:46:38.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.447+0000 7f61f991b640 1 -- 172.21.15.99:0/4219439052 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61f410f500 con 0x7f61f406fab0 2024-09-19T06:46:38.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.447+0000 7f61db7fe640 1 -- 172.21.15.99:0/4219439052 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61ec00ca60 con 0x7f61f406fab0 2024-09-19T06:46:38.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.447+0000 7f61f991b640 1 -- 172.21.15.99:0/4219439052 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61f410fa20 con 0x7f61f406fab0 2024-09-19T06:46:38.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.448+0000 7f61f991b640 1 -- 172.21.15.99:0/4219439052 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61f40711f0 con 0x7f61f406fab0 2024-09-19T06:46:38.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.448+0000 7f61db7fe640 1 -- 172.21.15.99:0/4219439052 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f61ec00cbc0 con 0x7f61f406fab0 2024-09-19T06:46:38.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.449+0000 7f61db7fe640 1 --2- 172.21.15.99:0/4219439052 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f61dc06e530 0x7f61dc0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:38.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.449+0000 7f61db7fe640 1 -- 172.21.15.99:0/4219439052 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f61ec08dce0 con 0x7f61f406fab0 2024-09-19T06:46:38.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.449+0000 7f61f27fc640 1 --2- 172.21.15.99:0/4219439052 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f61dc06e530 0x7f61dc0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:38.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.449+0000 7f61f27fc640 1 --2- 172.21.15.99:0/4219439052 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f61dc06e530 0x7f61dc0709e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f61f4110d30 tx=0x7f61e8035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:38.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.453+0000 7f61db7fe640 1 -- 172.21.15.99:0/4219439052 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f61ec056f20 con 0x7f61f406fab0 2024-09-19T06:46:38.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.684+0000 7f61f991b640 1 -- 172.21.15.99:0/4219439052 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f61f40fbd60 con 0x7f61f406fab0 2024-09-19T06:46:38.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.685+0000 7f61db7fe640 1 -- 172.21.15.99:0/4219439052 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+850 (secure 0 0 0) 0x7f61ec05a5e0 con 0x7f61f406fab0 2024-09-19T06:46:38.686 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:46:38.686 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-09-19T06:46:38.686 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T06:46:38.686 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:46:38.686 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-09-19T06:46:38.686 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T06:46:38.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:46:38.687 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-09-19T06:46:38.687 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 2, 2024-09-19T06:46:38.687 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 3 2024-09-19T06:46:38.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:46:38.687 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": { 2024-09-19T06:46:38.687 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 4 2024-09-19T06:46:38.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:46:38.687 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-09-19T06:46:38.687 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 6, 2024-09-19T06:46:38.687 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 7 2024-09-19T06:46:38.687 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T06:46:38.687 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:46:38.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.687+0000 7f61f991b640 1 -- 172.21.15.99:0/4219439052 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f61dc06e530 msgr2=0x7f61dc0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:38.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.687+0000 7f61f991b640 1 --2- 172.21.15.99:0/4219439052 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f61dc06e530 0x7f61dc0709e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f61f4110d30 tx=0x7f61e8035040 comp rx=0 tx=0).stop 2024-09-19T06:46:38.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.687+0000 7f61f991b640 1 -- 172.21.15.99:0/4219439052 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f61f406fab0 msgr2=0x7f61f4115430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:38.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.687+0000 7f61f991b640 1 --2- 172.21.15.99:0/4219439052 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f61f406fab0 0x7f61f4115430 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f61ec00eb70 tx=0x7f61ec00b040 comp rx=0 tx=0).stop 2024-09-19T06:46:38.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.687+0000 7f61f991b640 1 -- 172.21.15.99:0/4219439052 shutdown_connections 2024-09-19T06:46:38.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.687+0000 7f61f991b640 1 --2- 172.21.15.99:0/4219439052 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f61dc06e530 0x7f61dc0709e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:38.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.687+0000 7f61f991b640 1 --2- 172.21.15.99:0/4219439052 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61f40703c0 0x7f61f4115970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:38.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.687+0000 7f61f991b640 1 --2- 172.21.15.99:0/4219439052 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f61f406fab0 0x7f61f4115430 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:38.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.687+0000 7f61f991b640 1 -- 172.21.15.99:0/4219439052 >> 172.21.15.99:0/4219439052 conn(0x7f61f40f8120 msgr2=0x7f61f41031d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:38.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.687+0000 7f61f991b640 1 -- 172.21.15.99:0/4219439052 shutdown_connections 2024-09-19T06:46:38.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.687+0000 7f61f991b640 1 -- 172.21.15.99:0/4219439052 wait complete. 2024-09-19T06:46:38.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.765+0000 7f323f3d0640 1 -- 172.21.15.99:0/701747792 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32380fd560 msgr2=0x7f32380fd930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:38.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.765+0000 7f323f3d0640 1 --2- 172.21.15.99:0/701747792 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32380fd560 0x7f32380fd930 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3234004900 tx=0x7f3234009da0 comp rx=0 tx=0).stop 2024-09-19T06:46:38.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.765+0000 7f323f3d0640 1 -- 172.21.15.99:0/701747792 shutdown_connections 2024-09-19T06:46:38.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.765+0000 7f323f3d0640 1 --2- 172.21.15.99:0/701747792 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32380fdf00 0x7f32381065d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:38.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.765+0000 7f323f3d0640 1 --2- 172.21.15.99:0/701747792 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32380fd560 0x7f32380fd930 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:38.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.765+0000 7f323f3d0640 1 -- 172.21.15.99:0/701747792 >> 172.21.15.99:0/701747792 conn(0x7f32380f7060 msgr2=0x7f32380f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:38.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.765+0000 7f323f3d0640 1 -- 172.21.15.99:0/701747792 shutdown_connections 2024-09-19T06:46:38.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.765+0000 7f323f3d0640 1 -- 172.21.15.99:0/701747792 wait complete. 2024-09-19T06:46:38.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.766+0000 7f323f3d0640 1 Processor -- start 2024-09-19T06:46:38.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.766+0000 7f323f3d0640 1 -- start start 2024-09-19T06:46:38.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.766+0000 7f323f3d0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32380fd560 0x7f3238113310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:38.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.766+0000 7f323f3d0640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32380fdf00 0x7f3238113850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:38.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.766+0000 7f323f3d0640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3238113e50 con 0x7f32380fdf00 2024-09-19T06:46:38.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.766+0000 7f323f3d0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323810d290 con 0x7f32380fd560 2024-09-19T06:46:38.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.766+0000 7f323c96b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32380fdf00 0x7f3238113850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:38.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.766+0000 7f323c96b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32380fdf00 0x7f3238113850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:44034/0 (socket says 172.21.15.99:44034) 2024-09-19T06:46:38.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.766+0000 7f323c96b640 1 -- 172.21.15.99:0/2592006743 learned_addr learned my addr 172.21.15.99:0/2592006743 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:46:38.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.766+0000 7f323d16c640 1 --2- 172.21.15.99:0/2592006743 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32380fd560 0x7f3238113310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:38.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.766+0000 7f323c96b640 1 -- 172.21.15.99:0/2592006743 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32380fd560 msgr2=0x7f3238113310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:38.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.766+0000 7f323c96b640 1 --2- 172.21.15.99:0/2592006743 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32380fd560 0x7f3238113310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:38.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.766+0000 7f323c96b640 1 -- 172.21.15.99:0/2592006743 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3234005040 con 0x7f32380fdf00 2024-09-19T06:46:38.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.767+0000 7f323c96b640 1 --2- 172.21.15.99:0/2592006743 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32380fdf00 0x7f3238113850 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f322800eb70 tx=0x7f322800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:38.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.767+0000 7f322dffb640 1 -- 172.21.15.99:0/2592006743 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3228007c30 con 0x7f32380fdf00 2024-09-19T06:46:38.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.767+0000 7f322dffb640 1 -- 172.21.15.99:0/2592006743 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f322800f040 con 0x7f32380fdf00 2024-09-19T06:46:38.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.767+0000 7f323f3d0640 1 -- 172.21.15.99:0/2592006743 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f323810d510 con 0x7f32380fdf00 2024-09-19T06:46:38.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.767+0000 7f322dffb640 1 -- 172.21.15.99:0/2592006743 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32280094e0 con 0x7f32380fdf00 2024-09-19T06:46:38.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.767+0000 7f323f3d0640 1 -- 172.21.15.99:0/2592006743 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f323810da30 con 0x7f32380fdf00 2024-09-19T06:46:38.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.768+0000 7f323f3d0640 1 -- 172.21.15.99:0/2592006743 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32380662f0 con 0x7f32380fdf00 2024-09-19T06:46:38.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.768+0000 7f322dffb640 1 -- 172.21.15.99:0/2592006743 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f3228009790 con 0x7f32380fdf00 2024-09-19T06:46:38.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.769+0000 7f322dffb640 1 --2- 172.21.15.99:0/2592006743 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f322406e530 0x7f32240709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:38.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.769+0000 7f323d16c640 1 --2- 172.21.15.99:0/2592006743 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f322406e530 0x7f32240709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:38.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.769+0000 7f322dffb640 1 -- 172.21.15.99:0/2592006743 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f322808ddc0 con 0x7f32380fdf00 2024-09-19T06:46:38.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.769+0000 7f323d16c640 1 --2- 172.21.15.99:0/2592006743 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f322406e530 0x7f32240709e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3234000c00 tx=0x7f3234035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:38.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.773+0000 7f322dffb640 1 -- 172.21.15.99:0/2592006743 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f3228056fa0 con 0x7f32380fdf00 2024-09-19T06:46:38.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.976+0000 7f323f3d0640 1 -- 172.21.15.99:0/2592006743 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f32380fac60 con 0x7f32380fdf00 2024-09-19T06:46:38.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.976+0000 7f322dffb640 1 -- 172.21.15.99:0/2592006743 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1941 (secure 0 0 0) 0x7f322805a660 con 0x7f32380fdf00 2024-09-19T06:46:38.978 INFO:teuthology.orchestra.run.smithi099.stdout:e19 2024-09-19T06:46:38.978 INFO:teuthology.orchestra.run.smithi099.stdout:btime 2024-09-19T06:44:03:270764+0000 2024-09-19T06:46:38.978 INFO:teuthology.orchestra.run.smithi099.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T06:46:38.978 INFO:teuthology.orchestra.run.smithi099.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T06:46:38.978 INFO:teuthology.orchestra.run.smithi099.stdout:legacy client fscid: 1 2024-09-19T06:46:38.978 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:46:38.978 INFO:teuthology.orchestra.run.smithi099.stdout:Filesystem 'cephfs' (1) 2024-09-19T06:46:38.978 INFO:teuthology.orchestra.run.smithi099.stdout:fs_name cephfs 2024-09-19T06:46:38.978 INFO:teuthology.orchestra.run.smithi099.stdout:epoch 19 2024-09-19T06:46:38.978 INFO:teuthology.orchestra.run.smithi099.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-19T06:46:38.978 INFO:teuthology.orchestra.run.smithi099.stdout:created 2024-09-19T06:37:40.838146+0000 2024-09-19T06:46:38.978 INFO:teuthology.orchestra.run.smithi099.stdout:modified 2024-09-19T06:44:02.356718+0000 2024-09-19T06:46:38.979 INFO:teuthology.orchestra.run.smithi099.stdout:tableserver 0 2024-09-19T06:46:38.979 INFO:teuthology.orchestra.run.smithi099.stdout:root 0 2024-09-19T06:46:38.979 INFO:teuthology.orchestra.run.smithi099.stdout:session_timeout 60 2024-09-19T06:46:38.979 INFO:teuthology.orchestra.run.smithi099.stdout:session_autoclose 300 2024-09-19T06:46:38.979 INFO:teuthology.orchestra.run.smithi099.stdout:max_file_size 1099511627776 2024-09-19T06:46:38.979 INFO:teuthology.orchestra.run.smithi099.stdout:max_xattr_size 65536 2024-09-19T06:46:38.979 INFO:teuthology.orchestra.run.smithi099.stdout:required_client_features {} 2024-09-19T06:46:38.979 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure 0 2024-09-19T06:46:38.979 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure_osd_epoch 45 2024-09-19T06:46:38.979 INFO:teuthology.orchestra.run.smithi099.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T06:46:38.979 INFO:teuthology.orchestra.run.smithi099.stdout:max_mds 2 2024-09-19T06:46:38.979 INFO:teuthology.orchestra.run.smithi099.stdout:in 0,1 2024-09-19T06:46:38.979 INFO:teuthology.orchestra.run.smithi099.stdout:up {0=14482,1=24269} 2024-09-19T06:46:38.980 INFO:teuthology.orchestra.run.smithi099.stdout:failed 2024-09-19T06:46:38.980 INFO:teuthology.orchestra.run.smithi099.stdout:damaged 2024-09-19T06:46:38.980 INFO:teuthology.orchestra.run.smithi099.stdout:stopped 2024-09-19T06:46:38.980 INFO:teuthology.orchestra.run.smithi099.stdout:data_pools [3] 2024-09-19T06:46:38.980 INFO:teuthology.orchestra.run.smithi099.stdout:metadata_pool 2 2024-09-19T06:46:38.980 INFO:teuthology.orchestra.run.smithi099.stdout:inline_data disabled 2024-09-19T06:46:38.980 INFO:teuthology.orchestra.run.smithi099.stdout:balancer 2024-09-19T06:46:38.980 INFO:teuthology.orchestra.run.smithi099.stdout:bal_rank_mask -1 2024-09-19T06:46:38.980 INFO:teuthology.orchestra.run.smithi099.stdout:standby_count_wanted 1 2024-09-19T06:46:38.980 INFO:teuthology.orchestra.run.smithi099.stdout:qdb_cluster leader: 14482 members: 24269,14482 2024-09-19T06:46:38.980 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.xehbxe{0:14482} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.99:6828/1508711176,v1:172.21.15.99:6829/1508711176] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T06:46:38.980 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.nooexo{1:24269} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.117:6824/2367330767,v1:172.21.15.117:6825/2367330767] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T06:46:38.980 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:46:38.981 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:46:38.981 INFO:teuthology.orchestra.run.smithi099.stdout:Standby daemons: 2024-09-19T06:46:38.981 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:46:38.981 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.obarqf{-1:14490} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6826/388324528,v1:172.21.15.99:6827/388324528] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T06:46:38.981 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.bheqzh{-1:24283} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.117:6826/4072877365,v1:172.21.15.117:6827/4072877365] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T06:46:38.982 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 19 2024-09-19T06:46:38.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.978+0000 7f323f3d0640 1 -- 172.21.15.99:0/2592006743 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f322406e530 msgr2=0x7f32240709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:38.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.978+0000 7f323f3d0640 1 --2- 172.21.15.99:0/2592006743 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f322406e530 0x7f32240709e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3234000c00 tx=0x7f3234035040 comp rx=0 tx=0).stop 2024-09-19T06:46:38.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.978+0000 7f323f3d0640 1 -- 172.21.15.99:0/2592006743 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32380fdf00 msgr2=0x7f3238113850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:38.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.978+0000 7f323f3d0640 1 --2- 172.21.15.99:0/2592006743 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32380fdf00 0x7f3238113850 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f322800eb70 tx=0x7f322800b040 comp rx=0 tx=0).stop 2024-09-19T06:46:38.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.979+0000 7f323f3d0640 1 -- 172.21.15.99:0/2592006743 shutdown_connections 2024-09-19T06:46:38.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.979+0000 7f323f3d0640 1 --2- 172.21.15.99:0/2592006743 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f322406e530 0x7f32240709e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:38.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.979+0000 7f323f3d0640 1 --2- 172.21.15.99:0/2592006743 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32380fdf00 0x7f3238113850 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:38.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.979+0000 7f323f3d0640 1 --2- 172.21.15.99:0/2592006743 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32380fd560 0x7f3238113310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:38.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.979+0000 7f323f3d0640 1 -- 172.21.15.99:0/2592006743 >> 172.21.15.99:0/2592006743 conn(0x7f32380f7060 msgr2=0x7f32380f85f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:38.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.979+0000 7f323f3d0640 1 -- 172.21.15.99:0/2592006743 shutdown_connections 2024-09-19T06:46:38.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:38.979+0000 7f323f3d0640 1 -- 172.21.15.99:0/2592006743 wait complete. 2024-09-19T06:46:39.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.057+0000 7fee03314640 1 -- 172.21.15.99:0/863912370 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fedfc0fb370 msgr2=0x7fedfc0fb740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:39.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.057+0000 7fee03314640 1 --2- 172.21.15.99:0/863912370 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fedfc0fb370 0x7fedfc0fb740 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fedf80048d0 tx=0x7fedf8009da0 comp rx=0 tx=0).stop 2024-09-19T06:46:39.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.057+0000 7fee03314640 1 -- 172.21.15.99:0/863912370 shutdown_connections 2024-09-19T06:46:39.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.057+0000 7fee03314640 1 --2- 172.21.15.99:0/863912370 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fedfc0fbd10 0x7fedfc100330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:39.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.057+0000 7fee03314640 1 --2- 172.21.15.99:0/863912370 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fedfc0fb370 0x7fedfc0fb740 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:39.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.057+0000 7fee03314640 1 -- 172.21.15.99:0/863912370 >> 172.21.15.99:0/863912370 conn(0x7fedfc0f7010 msgr2=0x7fedfc0f9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:39.060 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:38 smithi099 ceph-mon[97031]: from='client.34282 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:46:39.060 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:38 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/4219439052' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:46:39.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.058+0000 7fee03314640 1 -- 172.21.15.99:0/863912370 shutdown_connections 2024-09-19T06:46:39.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.058+0000 7fee03314640 1 -- 172.21.15.99:0/863912370 wait complete. 2024-09-19T06:46:39.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.058+0000 7fee03314640 1 Processor -- start 2024-09-19T06:46:39.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.058+0000 7fee03314640 1 -- start start 2024-09-19T06:46:39.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.058+0000 7fee03314640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fedfc0fb370 0x7fedfc1198c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:39.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.058+0000 7fee03314640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fedfc0fbd10 0x7fedfc119e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:39.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.058+0000 7fee03314640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedfc11a450 con 0x7fedfc0fb370 2024-09-19T06:46:39.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.058+0000 7fee03314640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedfc113860 con 0x7fedfc0fbd10 2024-09-19T06:46:39.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.058+0000 7fee010b0640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fedfc0fb370 0x7fedfc1198c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:39.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.058+0000 7fee010b0640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fedfc0fb370 0x7fedfc1198c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:44052/0 (socket says 172.21.15.99:44052) 2024-09-19T06:46:39.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.058+0000 7fee010b0640 1 -- 172.21.15.99:0/2466369569 learned_addr learned my addr 172.21.15.99:0/2466369569 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:46:39.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.058+0000 7fee008af640 1 --2- 172.21.15.99:0/2466369569 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fedfc0fbd10 0x7fedfc119e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:39.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.059+0000 7fee010b0640 1 -- 172.21.15.99:0/2466369569 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fedfc0fbd10 msgr2=0x7fedfc119e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:39.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.059+0000 7fee010b0640 1 --2- 172.21.15.99:0/2466369569 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fedfc0fbd10 0x7fedfc119e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:39.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.059+0000 7fee010b0640 1 -- 172.21.15.99:0/2466369569 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf8005040 con 0x7fedfc0fb370 2024-09-19T06:46:39.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.059+0000 7fee010b0640 1 --2- 172.21.15.99:0/2466369569 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fedfc0fb370 0x7fedfc1198c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fedf8000c00 tx=0x7fedf8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:39.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.059+0000 7fedf1ffb640 1 -- 172.21.15.99:0/2466369569 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fedf8038070 con 0x7fedfc0fb370 2024-09-19T06:46:39.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.059+0000 7fee03314640 1 -- 172.21.15.99:0/2466369569 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedfc113ae0 con 0x7fedfc0fb370 2024-09-19T06:46:39.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.059+0000 7fedf1ffb640 1 -- 172.21.15.99:0/2466369569 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fedf802ade0 con 0x7fedfc0fb370 2024-09-19T06:46:39.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.059+0000 7fedf1ffb640 1 -- 172.21.15.99:0/2466369569 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fedf802c7e0 con 0x7fedfc0fb370 2024-09-19T06:46:39.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.059+0000 7fee03314640 1 -- 172.21.15.99:0/2466369569 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedfc113fa0 con 0x7fedfc0fb370 2024-09-19T06:46:39.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.060+0000 7fee03314640 1 -- 172.21.15.99:0/2466369569 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedfc0663b0 con 0x7fedfc0fb370 2024-09-19T06:46:39.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.061+0000 7fedf1ffb640 1 -- 172.21.15.99:0/2466369569 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fedf8030020 con 0x7fedfc0fb370 2024-09-19T06:46:39.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.062+0000 7fedf1ffb640 1 --2- 172.21.15.99:0/2466369569 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fede806e530 0x7fede80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:39.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.062+0000 7fedf1ffb640 1 -- 172.21.15.99:0/2466369569 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fedf80add50 con 0x7fedfc0fb370 2024-09-19T06:46:39.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.062+0000 7fee008af640 1 --2- 172.21.15.99:0/2466369569 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fede806e530 0x7fede80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:39.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.062+0000 7fee008af640 1 --2- 172.21.15.99:0/2466369569 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fede806e530 0x7fede80709e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fedfc114b40 tx=0x7fedec00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:39.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.066+0000 7fedf1ffb640 1 -- 172.21.15.99:0/2466369569 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fedf8076f90 con 0x7fedfc0fb370 2024-09-19T06:46:39.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.248+0000 7fee03314640 1 -- 172.21.15.99:0/2466369569 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fedfc10fb90 con 0x7fede806e530 2024-09-19T06:46:39.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.249+0000 7fedf1ffb640 1 -- 172.21.15.99:0/2466369569 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fedfc10fb90 con 0x7fede806e530 2024-09-19T06:46:39.250 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:46:39.251 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T06:46:39.251 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": true, 2024-09-19T06:46:39.251 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T06:46:39.251 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [ 2024-09-19T06:46:39.251 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr", 2024-09-19T06:46:39.251 INFO:teuthology.orchestra.run.smithi099.stdout: "crash", 2024-09-19T06:46:39.251 INFO:teuthology.orchestra.run.smithi099.stdout: "mon" 2024-09-19T06:46:39.251 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-19T06:46:39.251 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": "9/21 daemons upgraded", 2024-09-19T06:46:39.251 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "Currently upgrading osd daemons", 2024-09-19T06:46:39.251 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-09-19T06:46:39.251 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:46:39.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.251+0000 7fee03314640 1 -- 172.21.15.99:0/2466369569 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fede806e530 msgr2=0x7fede80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:39.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.251+0000 7fee03314640 1 --2- 172.21.15.99:0/2466369569 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fede806e530 0x7fede80709e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fedfc114b40 tx=0x7fedec00b040 comp rx=0 tx=0).stop 2024-09-19T06:46:39.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.251+0000 7fee03314640 1 -- 172.21.15.99:0/2466369569 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fedfc0fb370 msgr2=0x7fedfc1198c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:39.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.251+0000 7fee03314640 1 --2- 172.21.15.99:0/2466369569 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fedfc0fb370 0x7fedfc1198c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fedf8000c00 tx=0x7fedf8009da0 comp rx=0 tx=0).stop 2024-09-19T06:46:39.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.251+0000 7fee03314640 1 -- 172.21.15.99:0/2466369569 shutdown_connections 2024-09-19T06:46:39.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.251+0000 7fee03314640 1 --2- 172.21.15.99:0/2466369569 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fede806e530 0x7fede80709e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:39.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.251+0000 7fee03314640 1 --2- 172.21.15.99:0/2466369569 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fedfc0fbd10 0x7fedfc119e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:39.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.251+0000 7fee03314640 1 --2- 172.21.15.99:0/2466369569 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fedfc0fb370 0x7fedfc1198c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:39.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.251+0000 7fee03314640 1 -- 172.21.15.99:0/2466369569 >> 172.21.15.99:0/2466369569 conn(0x7fedfc0f7010 msgr2=0x7fedfc0f8700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:39.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.251+0000 7fee03314640 1 -- 172.21.15.99:0/2466369569 shutdown_connections 2024-09-19T06:46:39.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.252+0000 7fee03314640 1 -- 172.21.15.99:0/2466369569 wait complete. 2024-09-19T06:46:39.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:38 smithi117 ceph-mon[76771]: from='client.34282 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:46:39.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:38 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/4219439052' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:46:39.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.329+0000 7f46dce39640 1 -- 172.21.15.99:0/1690784222 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46d80fb480 msgr2=0x7f46d80fb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:39.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.329+0000 7f46dce39640 1 --2- 172.21.15.99:0/1690784222 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46d80fb480 0x7f46d80fb8f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f46c00048d0 tx=0x7f46c0009da0 comp rx=0 tx=0).stop 2024-09-19T06:46:39.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.329+0000 7f46dce39640 1 -- 172.21.15.99:0/1690784222 shutdown_connections 2024-09-19T06:46:39.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.329+0000 7f46dce39640 1 --2- 172.21.15.99:0/1690784222 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46d80fb480 0x7f46d80fb8f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:39.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.329+0000 7f46dce39640 1 --2- 172.21.15.99:0/1690784222 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46d81014c0 0x7f46d8101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:39.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.329+0000 7f46dce39640 1 -- 172.21.15.99:0/1690784222 >> 172.21.15.99:0/1690784222 conn(0x7f46d80f7000 msgr2=0x7f46d80f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:39.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.329+0000 7f46dce39640 1 -- 172.21.15.99:0/1690784222 shutdown_connections 2024-09-19T06:46:39.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.329+0000 7f46dce39640 1 -- 172.21.15.99:0/1690784222 wait complete. 2024-09-19T06:46:39.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.330+0000 7f46dce39640 1 Processor -- start 2024-09-19T06:46:39.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.330+0000 7f46dce39640 1 -- start start 2024-09-19T06:46:39.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.330+0000 7f46dce39640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46d80fb480 0x7f46d810e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:39.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.330+0000 7f46dce39640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46d81014c0 0x7f46d810e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:39.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.330+0000 7f46dce39640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46d810ecd0 con 0x7f46d80fb480 2024-09-19T06:46:39.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.330+0000 7f46dce39640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46d810ee40 con 0x7f46d81014c0 2024-09-19T06:46:39.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.330+0000 7f46d659c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46d80fb480 0x7f46d810e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:39.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.331+0000 7f46d659c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46d80fb480 0x7f46d810e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:44072/0 (socket says 172.21.15.99:44072) 2024-09-19T06:46:39.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.331+0000 7f46d659c640 1 -- 172.21.15.99:0/2197982306 learned_addr learned my addr 172.21.15.99:0/2197982306 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:46:39.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.331+0000 7f46cdd9b640 1 --2- 172.21.15.99:0/2197982306 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46d81014c0 0x7f46d810e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:39.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.331+0000 7f46d659c640 1 -- 172.21.15.99:0/2197982306 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46d81014c0 msgr2=0x7f46d810e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:39.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.331+0000 7f46d659c640 1 --2- 172.21.15.99:0/2197982306 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46d81014c0 0x7f46d810e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:39.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.331+0000 7f46d659c640 1 -- 172.21.15.99:0/2197982306 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c0005040 con 0x7f46d80fb480 2024-09-19T06:46:39.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.331+0000 7f46d659c640 1 --2- 172.21.15.99:0/2197982306 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46d80fb480 0x7f46d810e190 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f46c8002a50 tx=0x7f46c8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:39.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.331+0000 7f46cf7fe640 1 -- 172.21.15.99:0/2197982306 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46c8007c30 con 0x7f46d80fb480 2024-09-19T06:46:39.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.331+0000 7f46cf7fe640 1 -- 172.21.15.99:0/2197982306 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f46c800f040 con 0x7f46d80fb480 2024-09-19T06:46:39.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.331+0000 7f46dce39640 1 -- 172.21.15.99:0/2197982306 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46d8117200 con 0x7f46d80fb480 2024-09-19T06:46:39.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.332+0000 7f46cf7fe640 1 -- 172.21.15.99:0/2197982306 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46c800da10 con 0x7f46d80fb480 2024-09-19T06:46:39.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.332+0000 7f46dce39640 1 -- 172.21.15.99:0/2197982306 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46d8117710 con 0x7f46d80fb480 2024-09-19T06:46:39.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.333+0000 7f46cf7fe640 1 -- 172.21.15.99:0/2197982306 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f46c800dc50 con 0x7f46d80fb480 2024-09-19T06:46:39.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.333+0000 7f46dce39640 1 -- 172.21.15.99:0/2197982306 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46d80fcbc0 con 0x7f46d80fb480 2024-09-19T06:46:39.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.333+0000 7f46cf7fe640 1 --2- 172.21.15.99:0/2197982306 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f46c406e530 0x7f46c40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:46:39.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.333+0000 7f46cf7fe640 1 -- 172.21.15.99:0/2197982306 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f46c808d7e0 con 0x7f46d80fb480 2024-09-19T06:46:39.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.333+0000 7f46cdd9b640 1 --2- 172.21.15.99:0/2197982306 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f46c406e530 0x7f46c40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:46:39.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.334+0000 7f46cdd9b640 1 --2- 172.21.15.99:0/2197982306 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f46c406e530 0x7f46c40709e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f46c0009ac0 tx=0x7f46c0035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:46:39.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.338+0000 7f46cf7fe640 1 -- 172.21.15.99:0/2197982306 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f46c8056aa0 con 0x7f46d80fb480 2024-09-19T06:46:39.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.569+0000 7f46dce39640 1 -- 172.21.15.99:0/2197982306 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f46d80fac40 con 0x7f46d80fb480 2024-09-19T06:46:39.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.569+0000 7f46cf7fe640 1 -- 172.21.15.99:0/2197982306 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1328 (secure 0 0 0) 0x7f46c805a160 con 0x7f46d80fb480 2024-09-19T06:46:39.570 INFO:teuthology.orchestra.run.smithi099.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 66/321 objects degraded (20.561%), 19 pgs degraded 2024-09-19T06:46:39.571 INFO:teuthology.orchestra.run.smithi099.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-19T06:46:39.571 INFO:teuthology.orchestra.run.smithi099.stdout: osd.3 (root=default,host=smithi117) is down 2024-09-19T06:46:39.571 INFO:teuthology.orchestra.run.smithi099.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 66/321 objects degraded (20.561%), 19 pgs degraded 2024-09-19T06:46:39.571 INFO:teuthology.orchestra.run.smithi099.stdout: pg 1.0 is active+undersized+degraded, acting [0,1] 2024-09-19T06:46:39.571 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.0 is active+undersized+degraded, acting [1,0] 2024-09-19T06:46:39.571 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.5 is active+undersized+degraded, acting [0,4] 2024-09-19T06:46:39.571 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.6 is active+undersized+degraded, acting [1,4] 2024-09-19T06:46:39.571 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.7 is active+undersized+degraded, acting [4,2] 2024-09-19T06:46:39.571 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.8 is active+undersized+degraded, acting [5,0] 2024-09-19T06:46:39.572 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.a is active+undersized+degraded, acting [1,4] 2024-09-19T06:46:39.572 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.b is active+undersized+degraded, acting [4,5] 2024-09-19T06:46:39.572 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.d is active+undersized+degraded, acting [1,2] 2024-09-19T06:46:39.572 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.e is active+undersized+degraded, acting [2,0] 2024-09-19T06:46:39.572 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.11 is active+undersized+degraded, acting [4,1] 2024-09-19T06:46:39.572 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.12 is active+undersized+degraded, acting [1,0] 2024-09-19T06:46:39.572 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.14 is active+undersized+degraded, acting [4,5] 2024-09-19T06:46:39.572 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.15 is active+undersized+degraded, acting [1,0] 2024-09-19T06:46:39.572 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.16 is active+undersized+degraded, acting [5,2] 2024-09-19T06:46:39.572 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.18 is active+undersized+degraded, acting [5,4] 2024-09-19T06:46:39.572 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.1a is active+undersized+degraded, acting [4,5] 2024-09-19T06:46:39.573 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.1d is active+undersized+degraded, acting [5,0] 2024-09-19T06:46:39.573 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.1f is active+undersized+degraded, acting [0,4] 2024-09-19T06:46:39.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.571+0000 7f46dce39640 1 -- 172.21.15.99:0/2197982306 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f46c406e530 msgr2=0x7f46c40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:39.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.571+0000 7f46dce39640 1 --2- 172.21.15.99:0/2197982306 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f46c406e530 0x7f46c40709e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f46c0009ac0 tx=0x7f46c0035040 comp rx=0 tx=0).stop 2024-09-19T06:46:39.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.571+0000 7f46dce39640 1 -- 172.21.15.99:0/2197982306 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46d80fb480 msgr2=0x7f46d810e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:46:39.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.571+0000 7f46dce39640 1 --2- 172.21.15.99:0/2197982306 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46d80fb480 0x7f46d810e190 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f46c8002a50 tx=0x7f46c8004600 comp rx=0 tx=0).stop 2024-09-19T06:46:39.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.571+0000 7f46dce39640 1 -- 172.21.15.99:0/2197982306 shutdown_connections 2024-09-19T06:46:39.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.571+0000 7f46dce39640 1 --2- 172.21.15.99:0/2197982306 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f46c406e530 0x7f46c40709e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:39.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.571+0000 7f46dce39640 1 --2- 172.21.15.99:0/2197982306 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46d81014c0 0x7f46d810e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:39.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.571+0000 7f46dce39640 1 --2- 172.21.15.99:0/2197982306 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46d80fb480 0x7f46d810e190 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:46:39.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.571+0000 7f46dce39640 1 -- 172.21.15.99:0/2197982306 >> 172.21.15.99:0/2197982306 conn(0x7f46d80f7000 msgr2=0x7f46d80f8900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:46:39.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.572+0000 7f46dce39640 1 -- 172.21.15.99:0/2197982306 shutdown_connections 2024-09-19T06:46:39.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:46:39.572+0000 7f46dce39640 1 -- 172.21.15.99:0/2197982306 wait complete. 2024-09-19T06:46:39.766 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 06:46:39 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-3[86048]: 2024-09-19T06:46:39.396+0000 7ff1464d1640 -1 Falling back to public interface 2024-09-19T06:46:40.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:39 smithi117 ceph-mon[76771]: from='client.34286 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:46:40.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:39 smithi117 ceph-mon[76771]: from='client.34290 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:46:40.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:39 smithi117 ceph-mon[76771]: pgmap v111: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 66/321 objects degraded (20.561%) 2024-09-19T06:46:40.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:39 smithi117 ceph-mon[76771]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 10 pgs peering) 2024-09-19T06:46:40.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:39 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/2592006743' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:46:40.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:39 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/2197982306' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T06:46:40.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:39 smithi099 ceph-mon[97031]: from='client.34286 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:46:40.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:39 smithi099 ceph-mon[97031]: from='client.34290 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:46:40.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:39 smithi099 ceph-mon[97031]: pgmap v111: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 66/321 objects degraded (20.561%) 2024-09-19T06:46:40.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:39 smithi099 ceph-mon[97031]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 10 pgs peering) 2024-09-19T06:46:40.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:39 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/2592006743' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:46:40.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:39 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/2197982306' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T06:46:41.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:40 smithi099 ceph-mon[97031]: from='client.34302 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:46:41.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:40 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:46:41.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:40 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:46:41.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:40 smithi117 ceph-mon[76771]: from='client.34302 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:46:41.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:40 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:46:41.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:40 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:46:42.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:41 smithi099 ceph-mon[97031]: pgmap v112: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 66/321 objects degraded (20.561%) 2024-09-19T06:46:42.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:41 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:46:42.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:41 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:46:42.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:41 smithi117 ceph-mon[76771]: pgmap v112: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 66/321 objects degraded (20.561%) 2024-09-19T06:46:42.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:41 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:46:42.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:41 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:46:44.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:43 smithi117 ceph-mon[76771]: pgmap v113: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 66/321 objects degraded (20.561%) 2024-09-19T06:46:44.243 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:43 smithi099 ceph-mon[97031]: pgmap v113: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 66/321 objects degraded (20.561%) 2024-09-19T06:46:45.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:45 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:46:45.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:45 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:46:45.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:45 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:46:45.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:45 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:46:45.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:45 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:46:45.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:45 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:46:45.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:45 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:46:45.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:45 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:46:45.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:45 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:46:45.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:45 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-19T06:46:45.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:45 smithi099 ceph-mon[97031]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-19T06:46:45.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:45 smithi099 ceph-mon[97031]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-19T06:46:45.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:45 smithi099 ceph-mon[97031]: pgmap v114: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 66/321 objects degraded (20.561%) 2024-09-19T06:46:45.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:45 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:46:45.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:45 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:46:45.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:45 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:46:45.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:45 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:46:45.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:45 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:46:45.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:45 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:46:45.564 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:45 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:46:45.564 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:45 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:46:45.564 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:45 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:46:45.564 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:45 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-19T06:46:45.564 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:45 smithi117 ceph-mon[76771]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-19T06:46:45.564 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:45 smithi117 ceph-mon[76771]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-19T06:46:45.564 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:45 smithi117 ceph-mon[76771]: pgmap v114: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 254 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 66/321 objects degraded (20.561%) 2024-09-19T06:46:46.061 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 06:46:45 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-3[86048]: 2024-09-19T06:46:45.764+0000 7ff1464d1640 -1 osd.3 63 log_to_monitors true 2024-09-19T06:46:46.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:46 smithi099 ceph-mon[97031]: Health check update: Degraded data redundancy: 66/321 objects degraded (20.561%), 19 pgs degraded (PG_DEGRADED) 2024-09-19T06:46:46.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:46 smithi099 ceph-mon[97031]: from='osd.3 [v2:172.21.15.117:6800/1829397626,v1:172.21.15.117:6801/1829397626]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T06:46:46.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:46 smithi099 ceph-mon[97031]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T06:46:46.562 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 06:46:46 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-3[86048]: 2024-09-19T06:46:46.140+0000 7ff13e26b640 -1 osd.3 63 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:46:46.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:46 smithi117 ceph-mon[76771]: Health check update: Degraded data redundancy: 66/321 objects degraded (20.561%), 19 pgs degraded (PG_DEGRADED) 2024-09-19T06:46:46.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:46 smithi117 ceph-mon[76771]: from='osd.3 [v2:172.21.15.117:6800/1829397626,v1:172.21.15.117:6801/1829397626]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T06:46:46.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:46 smithi117 ceph-mon[76771]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T06:46:47.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:47 smithi099 ceph-mon[97031]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T06:46:47.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:47 smithi099 ceph-mon[97031]: from='osd.3 [v2:172.21.15.117:6800/1829397626,v1:172.21.15.117:6801/1829397626]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-19T06:46:47.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:47 smithi099 ceph-mon[97031]: osdmap e66: 6 total, 5 up, 6 in 2024-09-19T06:46:47.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:47 smithi099 ceph-mon[97031]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-19T06:46:47.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:47 smithi099 ceph-mon[97031]: pgmap v116: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 254 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 66/321 objects degraded (20.561%) 2024-09-19T06:46:47.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:47 smithi117 ceph-mon[76771]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T06:46:47.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:47 smithi117 ceph-mon[76771]: from='osd.3 [v2:172.21.15.117:6800/1829397626,v1:172.21.15.117:6801/1829397626]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-19T06:46:47.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:47 smithi117 ceph-mon[76771]: osdmap e66: 6 total, 5 up, 6 in 2024-09-19T06:46:47.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:47 smithi117 ceph-mon[76771]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-19T06:46:47.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:47 smithi117 ceph-mon[76771]: pgmap v116: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 254 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 66/321 objects degraded (20.561%) 2024-09-19T06:46:48.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:48 smithi099 ceph-mon[97031]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-19T06:46:48.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:48 smithi099 ceph-mon[97031]: osd.3 [v2:172.21.15.117:6800/1829397626,v1:172.21.15.117:6801/1829397626] boot 2024-09-19T06:46:48.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:48 smithi099 ceph-mon[97031]: osdmap e67: 6 total, 6 up, 6 in 2024-09-19T06:46:48.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:48 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:46:48.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:48 smithi117 ceph-mon[76771]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-19T06:46:48.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:48 smithi117 ceph-mon[76771]: osd.3 [v2:172.21.15.117:6800/1829397626,v1:172.21.15.117:6801/1829397626] boot 2024-09-19T06:46:48.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:48 smithi117 ceph-mon[76771]: osdmap e67: 6 total, 6 up, 6 in 2024-09-19T06:46:48.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:48 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T06:46:49.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:49 smithi099 ceph-mon[97031]: osdmap e68: 6 total, 6 up, 6 in 2024-09-19T06:46:49.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:49 smithi099 ceph-mon[97031]: pgmap v119: 65 pgs: 8 peering, 14 active+undersized, 16 active+undersized+degraded, 27 active+clean; 254 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 57/321 objects degraded (17.757%) 2024-09-19T06:46:49.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:49 smithi117 ceph-mon[76771]: osdmap e68: 6 total, 6 up, 6 in 2024-09-19T06:46:49.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:49 smithi117 ceph-mon[76771]: pgmap v119: 65 pgs: 8 peering, 14 active+undersized, 16 active+undersized+degraded, 27 active+clean; 254 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 57/321 objects degraded (17.757%) 2024-09-19T06:46:50.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:50 smithi099 ceph-mon[97031]: Health check update: Degraded data redundancy: 57/321 objects degraded (17.757%), 16 pgs degraded (PG_DEGRADED) 2024-09-19T06:46:51.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:50 smithi117 ceph-mon[76771]: Health check update: Degraded data redundancy: 57/321 objects degraded (17.757%), 16 pgs degraded (PG_DEGRADED) 2024-09-19T06:46:51.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:51 smithi099 ceph-mon[97031]: pgmap v120: 65 pgs: 8 peering, 6 active+undersized, 10 active+undersized+degraded, 41 active+clean; 254 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 40/321 objects degraded (12.461%) 2024-09-19T06:46:52.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:51 smithi117 ceph-mon[76771]: pgmap v120: 65 pgs: 8 peering, 6 active+undersized, 10 active+undersized+degraded, 41 active+clean; 254 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 40/321 objects degraded (12.461%) 2024-09-19T06:46:53.149 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:52 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:46:53.149 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:52 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:46:53.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:52 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:46:53.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:52 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:46:54.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:53 smithi099 ceph-mon[97031]: pgmap v121: 65 pgs: 65 active+clean; 254 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:46:54.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:53 smithi099 ceph-mon[97031]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 40/321 objects degraded (12.461%), 10 pgs degraded) 2024-09-19T06:46:54.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:53 smithi099 ceph-mon[97031]: Cluster is now healthy 2024-09-19T06:46:54.226 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:53 smithi117 ceph-mon[76771]: pgmap v121: 65 pgs: 65 active+clean; 254 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:46:54.227 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:53 smithi117 ceph-mon[76771]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 40/321 objects degraded (12.461%), 10 pgs degraded) 2024-09-19T06:46:54.227 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:53 smithi117 ceph-mon[76771]: Cluster is now healthy 2024-09-19T06:46:56.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:55 smithi099 ceph-mon[97031]: pgmap v122: 65 pgs: 65 active+clean; 254 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:46:56.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:55 smithi117 ceph-mon[76771]: pgmap v122: 65 pgs: 65 active+clean; 254 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:46:58.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:57 smithi099 ceph-mon[97031]: pgmap v123: 65 pgs: 65 active+clean; 254 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:46:58.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:57 smithi117 ceph-mon[76771]: pgmap v123: 65 pgs: 65 active+clean; 254 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:46:59.932 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:59 smithi117 ceph-mon[76771]: pgmap v124: 65 pgs: 65 active+clean; 254 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:46:59.932 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:46:59 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-19T06:47:00.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:59 smithi099 ceph-mon[97031]: pgmap v124: 65 pgs: 65 active+clean; 254 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:47:00.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:46:59 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-19T06:47:01.040 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:00 smithi117 ceph-mon[76771]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-19T06:47:01.040 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:00 smithi117 ceph-mon[76771]: Upgrade: osd.4 is safe to restart 2024-09-19T06:47:01.040 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:00 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:47:01.041 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:00 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T06:47:01.041 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:00 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:47:01.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:00 smithi099 ceph-mon[97031]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-19T06:47:01.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:00 smithi099 ceph-mon[97031]: Upgrade: osd.4 is safe to restart 2024-09-19T06:47:01.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:00 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:47:01.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:00 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T06:47:01.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:00 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:47:02.046 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:01 smithi117 ceph-mon[76771]: Upgrade: Updating osd.4 2024-09-19T06:47:02.046 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:01 smithi117 ceph-mon[76771]: Deploying daemon osd.4 on smithi117 2024-09-19T06:47:02.046 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:01 smithi117 ceph-mon[76771]: pgmap v125: 65 pgs: 65 active+clean; 254 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:47:02.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:01 smithi099 ceph-mon[97031]: Upgrade: Updating osd.4 2024-09-19T06:47:02.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:01 smithi099 ceph-mon[97031]: Deploying daemon osd.4 on smithi117 2024-09-19T06:47:02.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:01 smithi099 ceph-mon[97031]: pgmap v125: 65 pgs: 65 active+clean; 254 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:47:03.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:02 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:47:03.212 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:02 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:47:03.811 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 06:47:03 smithi117 systemd[1]: Stopping Ceph osd.4 for a73eb958-7650-11ef-bceb-c7b262605968... 2024-09-19T06:47:04.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:03 smithi099 ceph-mon[97031]: pgmap v126: 65 pgs: 65 active+clean; 254 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:47:04.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:03 smithi099 ceph-mon[97031]: osd.4 marked itself down and dead 2024-09-19T06:47:04.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:03 smithi117 ceph-mon[76771]: pgmap v126: 65 pgs: 65 active+clean; 254 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:47:04.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:03 smithi117 ceph-mon[76771]: osd.4 marked itself down and dead 2024-09-19T06:47:04.312 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 06:47:03 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-4[46532]: 2024-09-19T06:47:03.841+0000 7f9fb2c46640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:47:04.312 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 06:47:03 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-4[46532]: 2024-09-19T06:47:03.841+0000 7f9fb2c46640 -1 osd.4 68 *** Got signal Terminated *** 2024-09-19T06:47:04.312 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 06:47:03 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-4[46532]: 2024-09-19T06:47:03.841+0000 7f9fb2c46640 -1 osd.4 68 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:47:04.792 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 06:47:04 smithi117 podman[90591]: 2024-09-19 06:47:04.476094425 +0000 UTC m=+0.762362814 container died 6a2fc0c51c052d4617ec9e94758f7e85acf8cbdf5052b388fcdb33feda80bd0d (image=quay.ceph.io/ceph-ci/ceph@sha256:4d922a456af336b23156460d93b8143eb9c977eee7e72f2e9e44c816e5b46ac8, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-4, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=quincy-6e06d1e, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True) 2024-09-19T06:47:05.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:04 smithi117 ceph-mon[76771]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-19T06:47:05.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:04 smithi117 ceph-mon[76771]: osdmap e69: 6 total, 5 up, 6 in 2024-09-19T06:47:05.062 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 06:47:04 smithi117 podman[90591]: 2024-09-19 06:47:04.891052046 +0000 UTC m=+1.177320423 container cleanup 6a2fc0c51c052d4617ec9e94758f7e85acf8cbdf5052b388fcdb33feda80bd0d (image=quay.ceph.io/ceph-ci/ceph@sha256:4d922a456af336b23156460d93b8143eb9c977eee7e72f2e9e44c816e5b46ac8, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-4, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-6e06d1e, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:47:05.062 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 06:47:04 smithi117 bash[90591]: ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-4 2024-09-19T06:47:05.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:04 smithi099 ceph-mon[97031]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-19T06:47:05.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:04 smithi099 ceph-mon[97031]: osdmap e69: 6 total, 5 up, 6 in 2024-09-19T06:47:05.452 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 06:47:05 smithi117 podman[90607]: 2024-09-19 06:47:05.117911896 +0000 UTC m=+0.636463292 container remove 6a2fc0c51c052d4617ec9e94758f7e85acf8cbdf5052b388fcdb33feda80bd0d (image=quay.ceph.io/ceph-ci/ceph@sha256:4d922a456af336b23156460d93b8143eb9c977eee7e72f2e9e44c816e5b46ac8, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-4, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=quincy-6e06d1e, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-19T06:47:05.763 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 06:47:05 smithi117 podman[90695]: 2024-09-19 06:47:05.354627888 +0000 UTC m=+0.015950955 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:47:05.763 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 06:47:05 smithi117 podman[90695]: 2024-09-19 06:47:05.46866487 +0000 UTC m=+0.129987924 container create d39edd401fb95c1db4fbfcdd0ce384f3dfa3cbd3a1bc84f940ee9bfff47b8bbf (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-19T06:47:05.763 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 06:47:05 smithi117 podman[90695]: 2024-09-19 06:47:05.679575405 +0000 UTC m=+0.340898459 container init d39edd401fb95c1db4fbfcdd0ce384f3dfa3cbd3a1bc84f940ee9bfff47b8bbf (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-2f599a4, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:47:05.763 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 06:47:05 smithi117 podman[90695]: 2024-09-19 06:47:05.683179691 +0000 UTC m=+0.344502746 container start d39edd401fb95c1db4fbfcdd0ce384f3dfa3cbd3a1bc84f940ee9bfff47b8bbf (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-19T06:47:05.763 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 06:47:05 smithi117 podman[90695]: 2024-09-19 06:47:05.762561408 +0000 UTC m=+0.423884479 container attach d39edd401fb95c1db4fbfcdd0ce384f3dfa3cbd3a1bc84f940ee9bfff47b8bbf (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-19T06:47:06.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:05 smithi117 ceph-mon[76771]: pgmap v128: 65 pgs: 6 stale+active+clean, 59 active+clean; 254 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:47:06.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:05 smithi117 ceph-mon[76771]: osdmap e70: 6 total, 5 up, 6 in 2024-09-19T06:47:06.062 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 06:47:05 smithi117 podman[90695]: 2024-09-19 06:47:05.875619826 +0000 UTC m=+0.536942892 container died d39edd401fb95c1db4fbfcdd0ce384f3dfa3cbd3a1bc84f940ee9bfff47b8bbf (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-19T06:47:06.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:05 smithi099 ceph-mon[97031]: pgmap v128: 65 pgs: 6 stale+active+clean, 59 active+clean; 254 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:47:06.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:05 smithi099 ceph-mon[97031]: osdmap e70: 6 total, 5 up, 6 in 2024-09-19T06:47:06.812 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 06:47:06 smithi117 podman[90719]: 2024-09-19 06:47:06.434970384 +0000 UTC m=+0.549203647 container remove d39edd401fb95c1db4fbfcdd0ce384f3dfa3cbd3a1bc84f940ee9bfff47b8bbf (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731) 2024-09-19T06:47:06.812 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 06:47:06 smithi117 systemd[1]: ceph-a73eb958-7650-11ef-bceb-c7b262605968@osd.4.service: Deactivated successfully. 2024-09-19T06:47:06.812 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 06:47:06 smithi117 systemd[1]: Stopped Ceph osd.4 for a73eb958-7650-11ef-bceb-c7b262605968. 2024-09-19T06:47:06.812 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 06:47:06 smithi117 systemd[1]: ceph-a73eb958-7650-11ef-bceb-c7b262605968@osd.4.service: Consumed 1min 1.265s CPU time. 2024-09-19T06:47:06.812 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 06:47:06 smithi117 systemd[1]: Starting Ceph osd.4 for a73eb958-7650-11ef-bceb-c7b262605968... 2024-09-19T06:47:07.164 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 06:47:06 smithi117 podman[90816]: 2024-09-19 06:47:06.777455256 +0000 UTC m=+0.016044047 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:47:07.164 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 06:47:06 smithi117 podman[90816]: 2024-09-19 06:47:06.911006983 +0000 UTC m=+0.149595766 container create db9f114d58dae89c1fcd787dc5f7da3e87ed2adf71b2e5d238fd4b9e5192b806 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-4-activate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:47:07.164 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 06:47:07 smithi117 podman[90816]: 2024-09-19 06:47:07.163659625 +0000 UTC m=+0.402248421 container init db9f114d58dae89c1fcd787dc5f7da3e87ed2adf71b2e5d238fd4b9e5192b806 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-4-activate, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-19T06:47:07.562 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 06:47:07 smithi117 podman[90816]: 2024-09-19 06:47:07.167120442 +0000 UTC m=+0.405709226 container start db9f114d58dae89c1fcd787dc5f7da3e87ed2adf71b2e5d238fd4b9e5192b806 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-4-activate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-19T06:47:07.562 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 06:47:07 smithi117 podman[90816]: 2024-09-19 06:47:07.246836529 +0000 UTC m=+0.485425314 container attach db9f114d58dae89c1fcd787dc5f7da3e87ed2adf71b2e5d238fd4b9e5192b806 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-4-activate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:47:07.563 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 06:47:07 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-4-activate[90831]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T06:47:07.563 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 06:47:07 smithi117 bash[90816]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T06:47:07.563 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 06:47:07 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-4-activate[90831]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T06:47:07.563 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 06:47:07 smithi117 bash[90816]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T06:47:08.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:07 smithi099 ceph-mon[97031]: pgmap v130: 65 pgs: 15 active+undersized, 1 stale+active+clean, 14 active+undersized+degraded, 35 active+clean; 254 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 48/321 objects degraded (14.953%) 2024-09-19T06:47:08.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:07 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:47:08.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:07 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:47:08.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:07 smithi099 ceph-mon[97031]: Health check failed: Degraded data redundancy: 48/321 objects degraded (14.953%), 14 pgs degraded (PG_DEGRADED) 2024-09-19T06:47:08.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:07 smithi117 ceph-mon[76771]: pgmap v130: 65 pgs: 15 active+undersized, 1 stale+active+clean, 14 active+undersized+degraded, 35 active+clean; 254 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 48/321 objects degraded (14.953%) 2024-09-19T06:47:08.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:07 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:47:08.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:07 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:47:08.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:07 smithi117 ceph-mon[76771]: Health check failed: Degraded data redundancy: 48/321 objects degraded (14.953%), 14 pgs degraded (PG_DEGRADED) 2024-09-19T06:47:08.312 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 06:47:08 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-4-activate[90831]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-19T06:47:08.312 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 06:47:08 smithi117 bash[90816]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-19T06:47:08.312 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 06:47:08 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-4-activate[90831]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-19T06:47:08.312 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 06:47:08 smithi117 bash[90816]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-19T06:47:08.642 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 06:47:08 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-4-activate[90831]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-19T06:47:08.642 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 06:47:08 smithi117 bash[90816]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-19T06:47:08.642 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 06:47:08 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-4-activate[90831]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-19T06:47:08.642 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 06:47:08 smithi117 bash[90816]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-19T06:47:08.642 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 06:47:08 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-4-activate[90831]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-19T06:47:08.642 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 06:47:08 smithi117 bash[90816]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-19T06:47:08.643 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 06:47:08 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-4-activate[90831]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-19T06:47:08.643 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 06:47:08 smithi117 bash[90816]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-19T06:47:08.643 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 06:47:08 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-4-activate[90831]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-19T06:47:08.643 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 06:47:08 smithi117 bash[90816]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-19T06:47:08.643 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 06:47:08 smithi117 podman[90816]: 2024-09-19 06:47:08.339647875 +0000 UTC m=+1.578236666 container died db9f114d58dae89c1fcd787dc5f7da3e87ed2adf71b2e5d238fd4b9e5192b806 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-4-activate, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-19T06:47:09.404 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 06:47:09 smithi117 podman[90960]: 2024-09-19 06:47:09.076131607 +0000 UTC m=+0.725388594 container remove db9f114d58dae89c1fcd787dc5f7da3e87ed2adf71b2e5d238fd4b9e5192b806 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-4-activate, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T06:47:09.404 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 06:47:09 smithi117 podman[91020]: 2024-09-19 06:47:09.276994314 +0000 UTC m=+0.110295903 container create 27ac2c859a688e9db983302f0d4def550fff0d1198a1163e58eba2cb0c112534 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-4, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4) 2024-09-19T06:47:09.404 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 06:47:09 smithi117 podman[91020]: 2024-09-19 06:47:09.182587893 +0000 UTC m=+0.015889485 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:47:09.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.663+0000 7fe9323c1640 1 -- 172.21.15.99:0/603973005 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe92c102ef0 msgr2=0x7fe92c0fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:09.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.663+0000 7fe9323c1640 1 --2- 172.21.15.99:0/603973005 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe92c102ef0 0x7fe92c0fc5b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe9200048d0 tx=0x7fe920009da0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.664+0000 7fe9323c1640 1 -- 172.21.15.99:0/603973005 shutdown_connections 2024-09-19T06:47:09.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.664+0000 7fe9323c1640 1 --2- 172.21.15.99:0/603973005 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe92c102ef0 0x7fe92c0fc5b0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.664+0000 7fe9323c1640 1 --2- 172.21.15.99:0/603973005 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe92c102550 0x7fe92c102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.664+0000 7fe9323c1640 1 -- 172.21.15.99:0/603973005 >> 172.21.15.99:0/603973005 conn(0x7fe92c0f80f0 msgr2=0x7fe92c0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:09.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.664+0000 7fe9323c1640 1 -- 172.21.15.99:0/603973005 shutdown_connections 2024-09-19T06:47:09.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.664+0000 7fe9323c1640 1 -- 172.21.15.99:0/603973005 wait complete. 2024-09-19T06:47:09.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.664+0000 7fe9323c1640 1 Processor -- start 2024-09-19T06:47:09.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.664+0000 7fe9323c1640 1 -- start start 2024-09-19T06:47:09.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.665+0000 7fe9323c1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe92c102550 0x7fe92c06fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:09.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.665+0000 7fe9323c1640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe92c102ef0 0x7fe92c06ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:09.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.665+0000 7fe9323c1640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe92c070490 con 0x7fe92c102ef0 2024-09-19T06:47:09.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.665+0000 7fe9323c1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe92c070600 con 0x7fe92c102550 2024-09-19T06:47:09.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.665+0000 7fe92b7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe92c102ef0 0x7fe92c06ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:09.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.665+0000 7fe92b7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe92c102ef0 0x7fe92c06ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45952/0 (socket says 172.21.15.99:45952) 2024-09-19T06:47:09.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.665+0000 7fe92b7fe640 1 -- 172.21.15.99:0/1564374989 learned_addr learned my addr 172.21.15.99:0/1564374989 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:47:09.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.665+0000 7fe92bfff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe92c102550 0x7fe92c06fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:09.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.665+0000 7fe92b7fe640 1 -- 172.21.15.99:0/1564374989 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe92c102550 msgr2=0x7fe92c06fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:09.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.665+0000 7fe92b7fe640 1 --2- 172.21.15.99:0/1564374989 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe92c102550 0x7fe92c06fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.665+0000 7fe92b7fe640 1 -- 172.21.15.99:0/1564374989 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe920005040 con 0x7fe92c102ef0 2024-09-19T06:47:09.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.665+0000 7fe92bfff640 1 --2- 172.21.15.99:0/1564374989 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe92c102550 0x7fe92c06fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:47:09.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.665+0000 7fe92b7fe640 1 --2- 172.21.15.99:0/1564374989 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe92c102ef0 0x7fe92c06ff50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe92002a530 tx=0x7fe920009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:09.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.666+0000 7fe928ff9640 1 -- 172.21.15.99:0/1564374989 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe920038070 con 0x7fe92c102ef0 2024-09-19T06:47:09.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.666+0000 7fe928ff9640 1 -- 172.21.15.99:0/1564374989 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe92002ade0 con 0x7fe92c102ef0 2024-09-19T06:47:09.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.666+0000 7fe9323c1640 1 -- 172.21.15.99:0/1564374989 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe92c070830 con 0x7fe92c102ef0 2024-09-19T06:47:09.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.666+0000 7fe928ff9640 1 -- 172.21.15.99:0/1564374989 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe92002c7a0 con 0x7fe92c102ef0 2024-09-19T06:47:09.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.666+0000 7fe9323c1640 1 -- 172.21.15.99:0/1564374989 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe92c119bb0 con 0x7fe92c102ef0 2024-09-19T06:47:09.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.668+0000 7fe9323c1640 1 -- 172.21.15.99:0/1564374989 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe92c0fdcd0 con 0x7fe92c102ef0 2024-09-19T06:47:09.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.668+0000 7fe928ff9640 1 -- 172.21.15.99:0/1564374989 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fe920030020 con 0x7fe92c102ef0 2024-09-19T06:47:09.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.669+0000 7fe928ff9640 1 --2- 172.21.15.99:0/1564374989 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe91406e530 0x7fe9140709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:09.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.669+0000 7fe92bfff640 1 --2- 172.21.15.99:0/1564374989 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe91406e530 0x7fe9140709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:09.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.669+0000 7fe928ff9640 1 -- 172.21.15.99:0/1564374989 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fe9200ae6a0 con 0x7fe92c102ef0 2024-09-19T06:47:09.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.669+0000 7fe92bfff640 1 --2- 172.21.15.99:0/1564374989 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe91406e530 0x7fe9140709e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe91c004fd0 tx=0x7fe91c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:09.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.673+0000 7fe928ff9640 1 -- 172.21.15.99:0/1564374989 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fe920078500 con 0x7fe92c102ef0 2024-09-19T06:47:09.811 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 06:47:09 smithi117 podman[91020]: 2024-09-19 06:47:09.512472699 +0000 UTC m=+0.345774293 container init 27ac2c859a688e9db983302f0d4def550fff0d1198a1163e58eba2cb0c112534 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-4, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True) 2024-09-19T06:47:09.812 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 06:47:09 smithi117 podman[91020]: 2024-09-19 06:47:09.515655615 +0000 UTC m=+0.348957207 container start 27ac2c859a688e9db983302f0d4def550fff0d1198a1163e58eba2cb0c112534 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-4, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_CLEAN=True) 2024-09-19T06:47:09.812 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 06:47:09 smithi117 ceph-osd[91039]: -- 172.21.15.117:0/804306937 <== mon.1 v2:172.21.15.117:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56366989e1e0 con 0x563668a4bc00 2024-09-19T06:47:09.812 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 06:47:09 smithi117 bash[91020]: 27ac2c859a688e9db983302f0d4def550fff0d1198a1163e58eba2cb0c112534 2024-09-19T06:47:09.812 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 06:47:09 smithi117 systemd[1]: Started Ceph osd.4 for a73eb958-7650-11ef-bceb-c7b262605968. 2024-09-19T06:47:09.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.878+0000 7fe9323c1640 1 -- 172.21.15.99:0/1564374989 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe92c1095d0 con 0x7fe91406e530 2024-09-19T06:47:09.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.880+0000 7fe928ff9640 1 -- 172.21.15.99:0/1564374989 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fe92c1095d0 con 0x7fe91406e530 2024-09-19T06:47:09.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.882+0000 7fe9323c1640 1 -- 172.21.15.99:0/1564374989 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe91406e530 msgr2=0x7fe9140709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:09.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.882+0000 7fe9323c1640 1 --2- 172.21.15.99:0/1564374989 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe91406e530 0x7fe9140709e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe91c004fd0 tx=0x7fe91c00b040 comp rx=0 tx=0).stop 2024-09-19T06:47:09.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.882+0000 7fe9323c1640 1 -- 172.21.15.99:0/1564374989 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe92c102ef0 msgr2=0x7fe92c06ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:09.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.882+0000 7fe9323c1640 1 --2- 172.21.15.99:0/1564374989 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe92c102ef0 0x7fe92c06ff50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe92002a530 tx=0x7fe920009da0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.882+0000 7fe9323c1640 1 -- 172.21.15.99:0/1564374989 shutdown_connections 2024-09-19T06:47:09.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.882+0000 7fe9323c1640 1 --2- 172.21.15.99:0/1564374989 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe91406e530 0x7fe9140709e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.882+0000 7fe9323c1640 1 --2- 172.21.15.99:0/1564374989 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe92c102ef0 0x7fe92c06ff50 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.882+0000 7fe9323c1640 1 --2- 172.21.15.99:0/1564374989 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe92c102550 0x7fe92c06fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.882+0000 7fe9323c1640 1 -- 172.21.15.99:0/1564374989 >> 172.21.15.99:0/1564374989 conn(0x7fe92c0f80f0 msgr2=0x7fe92c0f9100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:09.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.882+0000 7fe9323c1640 1 -- 172.21.15.99:0/1564374989 shutdown_connections 2024-09-19T06:47:09.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.882+0000 7fe9323c1640 1 -- 172.21.15.99:0/1564374989 wait complete. 2024-09-19T06:47:09.892 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-09-19T06:47:09.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:09 smithi099 ceph-mon[97031]: pgmap v131: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 254 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 53/321 objects degraded (16.511%) 2024-09-19T06:47:09.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:09 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:47:09.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:09 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:47:09.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:09 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:47:09.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.965+0000 7ff5355e7640 1 -- 172.21.15.99:0/2558353012 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5300fe450 msgr2=0x7ff5300fe820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:09.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.965+0000 7ff5355e7640 1 --2- 172.21.15.99:0/2558353012 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5300fe450 0x7ff5300fe820 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff5200048d0 tx=0x7ff520009da0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.965+0000 7ff5355e7640 1 -- 172.21.15.99:0/2558353012 shutdown_connections 2024-09-19T06:47:09.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.965+0000 7ff5355e7640 1 --2- 172.21.15.99:0/2558353012 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff530064fe0 0x7ff530065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.965+0000 7ff5355e7640 1 --2- 172.21.15.99:0/2558353012 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5300fe450 0x7ff5300fe820 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.965+0000 7ff5355e7640 1 -- 172.21.15.99:0/2558353012 >> 172.21.15.99:0/2558353012 conn(0x7ff5300723b0 msgr2=0x7ff5300727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:09.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.965+0000 7ff5355e7640 1 -- 172.21.15.99:0/2558353012 shutdown_connections 2024-09-19T06:47:09.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.965+0000 7ff5355e7640 1 -- 172.21.15.99:0/2558353012 wait complete. 2024-09-19T06:47:09.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.966+0000 7ff5355e7640 1 Processor -- start 2024-09-19T06:47:09.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.966+0000 7ff5355e7640 1 -- start start 2024-09-19T06:47:09.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.966+0000 7ff5355e7640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff530064fe0 0x7ff5301131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:09.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.966+0000 7ff5355e7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5300fe450 0x7ff530113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:09.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.966+0000 7ff5355e7640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff530113d10 con 0x7ff530064fe0 2024-09-19T06:47:09.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.966+0000 7ff5355e7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff53010d150 con 0x7ff5300fe450 2024-09-19T06:47:09.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.966+0000 7ff52effd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff530064fe0 0x7ff5301131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:09.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.966+0000 7ff52effd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff530064fe0 0x7ff5301131d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45976/0 (socket says 172.21.15.99:45976) 2024-09-19T06:47:09.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.966+0000 7ff52effd640 1 -- 172.21.15.99:0/1308322558 learned_addr learned my addr 172.21.15.99:0/1308322558 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:47:09.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.966+0000 7ff52e7fc640 1 --2- 172.21.15.99:0/1308322558 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5300fe450 0x7ff530113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:09.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.967+0000 7ff52effd640 1 -- 172.21.15.99:0/1308322558 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5300fe450 msgr2=0x7ff530113710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:09.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.967+0000 7ff52effd640 1 --2- 172.21.15.99:0/1308322558 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5300fe450 0x7ff530113710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:09.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.967+0000 7ff52effd640 1 -- 172.21.15.99:0/1308322558 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff520005040 con 0x7ff530064fe0 2024-09-19T06:47:09.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.967+0000 7ff52e7fc640 1 --2- 172.21.15.99:0/1308322558 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5300fe450 0x7ff530113710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:47:09.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.967+0000 7ff52effd640 1 --2- 172.21.15.99:0/1308322558 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff530064fe0 0x7ff5301131d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff520000c00 tx=0x7ff520009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:09.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.967+0000 7ff5177fe640 1 -- 172.21.15.99:0/1308322558 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff520038070 con 0x7ff530064fe0 2024-09-19T06:47:09.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.967+0000 7ff5177fe640 1 -- 172.21.15.99:0/1308322558 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff52002ade0 con 0x7ff530064fe0 2024-09-19T06:47:09.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.967+0000 7ff5355e7640 1 -- 172.21.15.99:0/1308322558 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff53010d3d0 con 0x7ff530064fe0 2024-09-19T06:47:09.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.967+0000 7ff5177fe640 1 -- 172.21.15.99:0/1308322558 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff52002c7e0 con 0x7ff530064fe0 2024-09-19T06:47:09.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.967+0000 7ff5355e7640 1 -- 172.21.15.99:0/1308322558 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff53010d910 con 0x7ff530064fe0 2024-09-19T06:47:09.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.968+0000 7ff5355e7640 1 -- 172.21.15.99:0/1308322558 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5300fdce0 con 0x7ff530064fe0 2024-09-19T06:47:09.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.969+0000 7ff5177fe640 1 -- 172.21.15.99:0/1308322558 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7ff520030020 con 0x7ff530064fe0 2024-09-19T06:47:09.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.969+0000 7ff5177fe640 1 --2- 172.21.15.99:0/1308322558 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ff51806e530 0x7ff5180709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:09.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.969+0000 7ff5177fe640 1 -- 172.21.15.99:0/1308322558 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6324+0+0 (secure 0 0 0) 0x7ff5200add50 con 0x7ff530064fe0 2024-09-19T06:47:09.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.969+0000 7ff52e7fc640 1 --2- 172.21.15.99:0/1308322558 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ff51806e530 0x7ff5180709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:09.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.970+0000 7ff52e7fc640 1 --2- 172.21.15.99:0/1308322558 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ff51806e530 0x7ff5180709e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff524004fd0 tx=0x7ff52400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:09.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:09.974+0000 7ff5177fe640 1 -- 172.21.15.99:0/1308322558 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7ff520076f90 con 0x7ff530064fe0 2024-09-19T06:47:10.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.162+0000 7ff5355e7640 1 -- 172.21.15.99:0/1308322558 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff53004b750 con 0x7ff51806e530 2024-09-19T06:47:10.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.163+0000 7ff5177fe640 1 -- 172.21.15.99:0/1308322558 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7ff53004b750 con 0x7ff51806e530 2024-09-19T06:47:10.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.165+0000 7ff5355e7640 1 -- 172.21.15.99:0/1308322558 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ff51806e530 msgr2=0x7ff5180709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:10.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.165+0000 7ff5355e7640 1 --2- 172.21.15.99:0/1308322558 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ff51806e530 0x7ff5180709e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff524004fd0 tx=0x7ff52400b040 comp rx=0 tx=0).stop 2024-09-19T06:47:10.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.165+0000 7ff5355e7640 1 -- 172.21.15.99:0/1308322558 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff530064fe0 msgr2=0x7ff5301131d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:10.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.165+0000 7ff5355e7640 1 --2- 172.21.15.99:0/1308322558 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff530064fe0 0x7ff5301131d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff520000c00 tx=0x7ff520009da0 comp rx=0 tx=0).stop 2024-09-19T06:47:10.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.165+0000 7ff5355e7640 1 -- 172.21.15.99:0/1308322558 shutdown_connections 2024-09-19T06:47:10.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.165+0000 7ff5355e7640 1 --2- 172.21.15.99:0/1308322558 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ff51806e530 0x7ff5180709e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:10.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.165+0000 7ff5355e7640 1 --2- 172.21.15.99:0/1308322558 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5300fe450 0x7ff530113710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:10.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.165+0000 7ff5355e7640 1 --2- 172.21.15.99:0/1308322558 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff530064fe0 0x7ff5301131d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:10.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.165+0000 7ff5355e7640 1 -- 172.21.15.99:0/1308322558 >> 172.21.15.99:0/1308322558 conn(0x7ff5300723b0 msgr2=0x7ff5300fa290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:10.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.165+0000 7ff5355e7640 1 -- 172.21.15.99:0/1308322558 shutdown_connections 2024-09-19T06:47:10.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.165+0000 7ff5355e7640 1 -- 172.21.15.99:0/1308322558 wait complete. 2024-09-19T06:47:10.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.243+0000 7f4ae0695640 1 -- 172.21.15.99:0/538008833 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ad8102530 msgr2=0x7f4ad8102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:10.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.243+0000 7f4ae0695640 1 --2- 172.21.15.99:0/538008833 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ad8102530 0x7f4ad8102900 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4ad40048d0 tx=0x7f4ad4009da0 comp rx=0 tx=0).stop 2024-09-19T06:47:10.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.243+0000 7f4ae0695640 1 -- 172.21.15.99:0/538008833 shutdown_connections 2024-09-19T06:47:10.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.243+0000 7f4ae0695640 1 --2- 172.21.15.99:0/538008833 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ad8102ed0 0x7f4ad80fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:10.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.243+0000 7f4ae0695640 1 --2- 172.21.15.99:0/538008833 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ad8102530 0x7f4ad8102900 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:10.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.243+0000 7f4ae0695640 1 -- 172.21.15.99:0/538008833 >> 172.21.15.99:0/538008833 conn(0x7f4ad80f80f0 msgr2=0x7f4ad80fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:10.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.243+0000 7f4ae0695640 1 -- 172.21.15.99:0/538008833 shutdown_connections 2024-09-19T06:47:10.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.243+0000 7f4ae0695640 1 -- 172.21.15.99:0/538008833 wait complete. 2024-09-19T06:47:10.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.243+0000 7f4ae0695640 1 Processor -- start 2024-09-19T06:47:10.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.243+0000 7f4ae0695640 1 -- start start 2024-09-19T06:47:10.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.244+0000 7f4ae0695640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ad8102530 0x7f4ad81154e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:10.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.244+0000 7f4ae0695640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ad8102ed0 0x7f4ad8115a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:10.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.244+0000 7f4ae0695640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad8116100 con 0x7f4ad8102530 2024-09-19T06:47:10.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.244+0000 7f4ae0695640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad810f480 con 0x7f4ad8102ed0 2024-09-19T06:47:10.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.244+0000 7f4ade431640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ad8102530 0x7f4ad81154e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:10.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.244+0000 7f4ade431640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ad8102530 0x7f4ad81154e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45982/0 (socket says 172.21.15.99:45982) 2024-09-19T06:47:10.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.244+0000 7f4ade431640 1 -- 172.21.15.99:0/3822240950 learned_addr learned my addr 172.21.15.99:0/3822240950 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:47:10.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.244+0000 7f4addc30640 1 --2- 172.21.15.99:0/3822240950 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ad8102ed0 0x7f4ad8115a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:10.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.244+0000 7f4ade431640 1 -- 172.21.15.99:0/3822240950 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ad8102ed0 msgr2=0x7f4ad8115a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:10.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.244+0000 7f4ade431640 1 --2- 172.21.15.99:0/3822240950 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ad8102ed0 0x7f4ad8115a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:10.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.244+0000 7f4ade431640 1 -- 172.21.15.99:0/3822240950 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad4005040 con 0x7f4ad8102530 2024-09-19T06:47:10.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.244+0000 7f4ade431640 1 --2- 172.21.15.99:0/3822240950 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ad8102530 0x7f4ad81154e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4ad4000c00 tx=0x7f4ad4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:10.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.244+0000 7f4acaffd640 1 -- 172.21.15.99:0/3822240950 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ad4038070 con 0x7f4ad8102530 2024-09-19T06:47:10.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.245+0000 7f4acaffd640 1 -- 172.21.15.99:0/3822240950 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4ad403daf0 con 0x7f4ad8102530 2024-09-19T06:47:10.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.245+0000 7f4acaffd640 1 -- 172.21.15.99:0/3822240950 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ad4033b20 con 0x7f4ad8102530 2024-09-19T06:47:10.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.245+0000 7f4ae0695640 1 -- 172.21.15.99:0/3822240950 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ad810f6b0 con 0x7f4ad8102530 2024-09-19T06:47:10.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.245+0000 7f4ae0695640 1 -- 172.21.15.99:0/3822240950 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ad810fbd0 con 0x7f4ad8102530 2024-09-19T06:47:10.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.246+0000 7f4ae0695640 1 -- 172.21.15.99:0/3822240950 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ad80fdcb0 con 0x7f4ad8102530 2024-09-19T06:47:10.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.246+0000 7f4acaffd640 1 -- 172.21.15.99:0/3822240950 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f4ad4030020 con 0x7f4ad8102530 2024-09-19T06:47:10.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.247+0000 7f4acaffd640 1 --2- 172.21.15.99:0/3822240950 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f4ac406e530 0x7f4ac40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:10.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.247+0000 7f4acaffd640 1 -- 172.21.15.99:0/3822240950 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f4ad40ae140 con 0x7f4ad8102530 2024-09-19T06:47:10.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.247+0000 7f4addc30640 1 --2- 172.21.15.99:0/3822240950 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f4ac406e530 0x7f4ac40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:10.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.247+0000 7f4addc30640 1 --2- 172.21.15.99:0/3822240950 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f4ac406e530 0x7f4ac40709e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4ad8110760 tx=0x7f4acc009120 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:10.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.251+0000 7f4acaffd640 1 -- 172.21.15.99:0/3822240950 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f4ad40772d0 con 0x7f4ad8102530 2024-09-19T06:47:10.268 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:09 smithi117 ceph-mon[76771]: pgmap v131: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 254 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 53/321 objects degraded (16.511%) 2024-09-19T06:47:10.268 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:09 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:47:10.268 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:09 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:47:10.268 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:09 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:47:10.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.425+0000 7f4ae0695640 1 -- 172.21.15.99:0/3822240950 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4ad804b750 con 0x7f4ac406e530 2024-09-19T06:47:10.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.433+0000 7f4acaffd640 1 -- 172.21.15.99:0/3822240950 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f4ad804b750 con 0x7f4ac406e530 2024-09-19T06:47:10.435 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T06:47:10.435 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.smithi099 smithi099 *:9093,9094 running (6m) 62s ago 14m 23.4M - 0.25.0 c8568f914cd2 e7c1774d56b0 2024-09-19T06:47:10.435 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi099 smithi099 running (2m) 62s ago 14m 6899k - 19.1.1-361-g2f599a46 d2baa855c067 b9775f416b10 2024-09-19T06:47:10.435 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi117 smithi117 running (2m) 30s ago 13m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 38cf60c0d548 2024-09-19T06:47:10.435 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.smithi099 smithi099 *:3000 running (4m) 62s ago 14m 80.4M - 9.4.12 2bacad6d85d8 cd53a18d5410 2024-09-19T06:47:10.435 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.obarqf smithi099 running (9m) 62s ago 9m 14.2M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 e36c9b74004b 2024-09-19T06:47:10.435 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.xehbxe smithi099 running (9m) 62s ago 9m 121M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 d09eb3d306ae 2024-09-19T06:47:10.435 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.bheqzh smithi117 running (9m) 30s ago 9m 15.9M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 21253e27fdd3 2024-09-19T06:47:10.435 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.nooexo smithi117 running (9m) 30s ago 9m 109M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 ad1faeb3343c 2024-09-19T06:47:10.435 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi099.pgvkqi smithi099 *:8443,9283,8765 running (5m) 62s ago 15m 500M - 19.1.1-361-g2f599a46 d2baa855c067 d5de99cb7e78 2024-09-19T06:47:10.435 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi117.ssmkcf smithi117 *:8443,9283,8765 running (4m) 30s ago 13m 443M - 19.1.1-361-g2f599a46 d2baa855c067 8b7ee0f871f5 2024-09-19T06:47:10.435 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi099 smithi099 running (3m) 62s ago 16m 48.7M 2048M 19.1.1-361-g2f599a46 d2baa855c067 ffe067438824 2024-09-19T06:47:10.436 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi117 smithi117 running (3m) 30s ago 13m 37.7M 2048M 19.1.1-361-g2f599a46 d2baa855c067 4cb7455e3ee7 2024-09-19T06:47:10.436 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi099 smithi099 *:9100 running (6m) 62s ago 14m 15.6M - 1.5.0 0da6a335fe13 dca7b4517dcc 2024-09-19T06:47:10.436 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi117 smithi117 *:9100 running (5m) 30s ago 13m 15.8M - 1.5.0 0da6a335fe13 8233ce3835d2 2024-09-19T06:47:10.436 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (2m) 62s ago 12m 96.9M 1557M 19.1.1-361-g2f599a46 d2baa855c067 8e22543bf933 2024-09-19T06:47:10.436 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (103s) 62s ago 12m 103M 1557M 19.1.1-361-g2f599a46 d2baa855c067 f54153d0ae09 2024-09-19T06:47:10.436 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (68s) 62s ago 12m 11.2M 1557M 19.1.1-361-g2f599a46 d2baa855c067 b1778ab88870 2024-09-19T06:47:10.436 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi117 running (33s) 30s ago 11m 14.4M 2581M 19.1.1-361-g2f599a46 d2baa855c067 ea5236b193d3 2024-09-19T06:47:10.436 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi117 starting - - - 2581M 2024-09-19T06:47:10.436 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi117 running (10m) 30s ago 10m 225M 2581M 17.2.7-1637-g6e06d1e0 f63ad14e4e43 39dcb7dbf0e3 2024-09-19T06:47:10.436 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.smithi099 smithi099 *:9095 running (5m) 62s ago 14m 63.1M - 2.43.0 a07b618ecd1d 15ad26ec6fb4 2024-09-19T06:47:10.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.435+0000 7f4ae0695640 1 -- 172.21.15.99:0/3822240950 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f4ac406e530 msgr2=0x7f4ac40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:10.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.435+0000 7f4ae0695640 1 --2- 172.21.15.99:0/3822240950 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f4ac406e530 0x7f4ac40709e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4ad8110760 tx=0x7f4acc009120 comp rx=0 tx=0).stop 2024-09-19T06:47:10.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.435+0000 7f4ae0695640 1 -- 172.21.15.99:0/3822240950 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ad8102530 msgr2=0x7f4ad81154e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:10.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.435+0000 7f4ae0695640 1 --2- 172.21.15.99:0/3822240950 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ad8102530 0x7f4ad81154e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4ad4000c00 tx=0x7f4ad4009da0 comp rx=0 tx=0).stop 2024-09-19T06:47:10.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.435+0000 7f4ae0695640 1 -- 172.21.15.99:0/3822240950 shutdown_connections 2024-09-19T06:47:10.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.435+0000 7f4ae0695640 1 --2- 172.21.15.99:0/3822240950 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f4ac406e530 0x7f4ac40709e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:10.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.435+0000 7f4ae0695640 1 --2- 172.21.15.99:0/3822240950 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ad8102ed0 0x7f4ad8115a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:10.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.435+0000 7f4ae0695640 1 --2- 172.21.15.99:0/3822240950 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ad8102530 0x7f4ad81154e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:10.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.435+0000 7f4ae0695640 1 -- 172.21.15.99:0/3822240950 >> 172.21.15.99:0/3822240950 conn(0x7f4ad80f80f0 msgr2=0x7f4ad80f90b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:10.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.436+0000 7f4ae0695640 1 -- 172.21.15.99:0/3822240950 shutdown_connections 2024-09-19T06:47:10.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.436+0000 7f4ae0695640 1 -- 172.21.15.99:0/3822240950 wait complete. 2024-09-19T06:47:10.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.513+0000 7f0cff7ea640 1 -- 172.21.15.99:0/1903985942 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0cf80faeb0 msgr2=0x7f0cf80fb280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:10.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.513+0000 7f0cff7ea640 1 --2- 172.21.15.99:0/1903985942 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0cf80faeb0 0x7f0cf80fb280 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0cf40048d0 tx=0x7f0cf4009da0 comp rx=0 tx=0).stop 2024-09-19T06:47:10.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.513+0000 7f0cff7ea640 1 -- 172.21.15.99:0/1903985942 shutdown_connections 2024-09-19T06:47:10.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.513+0000 7f0cff7ea640 1 --2- 172.21.15.99:0/1903985942 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cf80fb7c0 0x7f0cf810cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:10.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.513+0000 7f0cff7ea640 1 --2- 172.21.15.99:0/1903985942 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0cf80faeb0 0x7f0cf80fb280 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:10.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.513+0000 7f0cff7ea640 1 -- 172.21.15.99:0/1903985942 >> 172.21.15.99:0/1903985942 conn(0x7f0cf8070ce0 msgr2=0x7f0cf80710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:10.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.514+0000 7f0cff7ea640 1 -- 172.21.15.99:0/1903985942 shutdown_connections 2024-09-19T06:47:10.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.514+0000 7f0cff7ea640 1 -- 172.21.15.99:0/1903985942 wait complete. 2024-09-19T06:47:10.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.514+0000 7f0cff7ea640 1 Processor -- start 2024-09-19T06:47:10.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.514+0000 7f0cff7ea640 1 -- start start 2024-09-19T06:47:10.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.514+0000 7f0cff7ea640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cf80faeb0 0x7f0cf81197e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:10.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.514+0000 7f0cff7ea640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0cf80fb7c0 0x7f0cf8119d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:10.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.514+0000 7f0cff7ea640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf811a370 con 0x7f0cf80fb7c0 2024-09-19T06:47:10.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.514+0000 7f0cff7ea640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf8113780 con 0x7f0cf80faeb0 2024-09-19T06:47:10.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.514+0000 7f0cfcd85640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0cf80fb7c0 0x7f0cf8119d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:10.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.514+0000 7f0cfcd85640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0cf80fb7c0 0x7f0cf8119d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46006/0 (socket says 172.21.15.99:46006) 2024-09-19T06:47:10.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.515+0000 7f0cfcd85640 1 -- 172.21.15.99:0/3492005804 learned_addr learned my addr 172.21.15.99:0/3492005804 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:47:10.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.515+0000 7f0cfd586640 1 --2- 172.21.15.99:0/3492005804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cf80faeb0 0x7f0cf81197e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:10.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.515+0000 7f0cfcd85640 1 -- 172.21.15.99:0/3492005804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cf80faeb0 msgr2=0x7f0cf81197e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:10.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.515+0000 7f0cfcd85640 1 --2- 172.21.15.99:0/3492005804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cf80faeb0 0x7f0cf81197e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:10.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.515+0000 7f0cfcd85640 1 -- 172.21.15.99:0/3492005804 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf4005040 con 0x7f0cf80fb7c0 2024-09-19T06:47:10.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.515+0000 7f0cfcd85640 1 --2- 172.21.15.99:0/3492005804 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0cf80fb7c0 0x7f0cf8119d20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0ce800c830 tx=0x7f0ce8004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:10.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.515+0000 7f0cedffb640 1 -- 172.21.15.99:0/3492005804 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ce800a7d0 con 0x7f0cf80fb7c0 2024-09-19T06:47:10.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.515+0000 7f0cedffb640 1 -- 172.21.15.99:0/3492005804 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0ce800add0 con 0x7f0cf80fb7c0 2024-09-19T06:47:10.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.515+0000 7f0cff7ea640 1 -- 172.21.15.99:0/3492005804 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cf8113a60 con 0x7f0cf80fb7c0 2024-09-19T06:47:10.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.515+0000 7f0cedffb640 1 -- 172.21.15.99:0/3492005804 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ce80113a0 con 0x7f0cf80fb7c0 2024-09-19T06:47:10.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.516+0000 7f0cff7ea640 1 -- 172.21.15.99:0/3492005804 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cf8113f80 con 0x7f0cf80fb7c0 2024-09-19T06:47:10.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.517+0000 7f0cff7ea640 1 -- 172.21.15.99:0/3492005804 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cf80fbc90 con 0x7f0cf80fb7c0 2024-09-19T06:47:10.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.517+0000 7f0cedffb640 1 -- 172.21.15.99:0/3492005804 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f0ce8012400 con 0x7f0cf80fb7c0 2024-09-19T06:47:10.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.517+0000 7f0cedffb640 1 --2- 172.21.15.99:0/3492005804 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f0ce406e530 0x7f0ce40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:10.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.518+0000 7f0cedffb640 1 -- 172.21.15.99:0/3492005804 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f0ce808e0f0 con 0x7f0cf80fb7c0 2024-09-19T06:47:10.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.518+0000 7f0cfd586640 1 --2- 172.21.15.99:0/3492005804 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f0ce406e530 0x7f0ce40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:10.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.518+0000 7f0cfd586640 1 --2- 172.21.15.99:0/3492005804 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f0ce406e530 0x7f0ce40709e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0cf4009ac0 tx=0x7f0cf4035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:10.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.522+0000 7f0cedffb640 1 -- 172.21.15.99:0/3492005804 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f0ce80573a0 con 0x7f0cf80fb7c0 2024-09-19T06:47:10.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.753+0000 7f0cff7ea640 1 -- 172.21.15.99:0/3492005804 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0cf810fb30 con 0x7f0cf80fb7c0 2024-09-19T06:47:10.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.753+0000 7f0cedffb640 1 -- 172.21.15.99:0/3492005804 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+850 (secure 0 0 0) 0x7f0ce805aa60 con 0x7f0cf80fb7c0 2024-09-19T06:47:10.755 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:47:10.755 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-09-19T06:47:10.755 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T06:47:10.755 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:47:10.755 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-09-19T06:47:10.755 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T06:47:10.755 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:47:10.756 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-09-19T06:47:10.756 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 1, 2024-09-19T06:47:10.756 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 4 2024-09-19T06:47:10.756 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:47:10.756 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": { 2024-09-19T06:47:10.756 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 4 2024-09-19T06:47:10.756 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:47:10.756 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-09-19T06:47:10.756 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 5, 2024-09-19T06:47:10.756 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 8 2024-09-19T06:47:10.756 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T06:47:10.756 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:47:10.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.756+0000 7f0cff7ea640 1 -- 172.21.15.99:0/3492005804 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f0ce406e530 msgr2=0x7f0ce40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:10.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.756+0000 7f0cff7ea640 1 --2- 172.21.15.99:0/3492005804 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f0ce406e530 0x7f0ce40709e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0cf4009ac0 tx=0x7f0cf4035040 comp rx=0 tx=0).stop 2024-09-19T06:47:10.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.756+0000 7f0cff7ea640 1 -- 172.21.15.99:0/3492005804 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0cf80fb7c0 msgr2=0x7f0cf8119d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:10.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.756+0000 7f0cff7ea640 1 --2- 172.21.15.99:0/3492005804 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0cf80fb7c0 0x7f0cf8119d20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0ce800c830 tx=0x7f0ce8004430 comp rx=0 tx=0).stop 2024-09-19T06:47:10.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.756+0000 7f0cff7ea640 1 -- 172.21.15.99:0/3492005804 shutdown_connections 2024-09-19T06:47:10.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.756+0000 7f0cff7ea640 1 --2- 172.21.15.99:0/3492005804 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f0ce406e530 0x7f0ce40709e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:10.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.756+0000 7f0cff7ea640 1 --2- 172.21.15.99:0/3492005804 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0cf80fb7c0 0x7f0cf8119d20 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:10.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.756+0000 7f0cff7ea640 1 --2- 172.21.15.99:0/3492005804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0cf80faeb0 0x7f0cf81197e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:10.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.756+0000 7f0cff7ea640 1 -- 172.21.15.99:0/3492005804 >> 172.21.15.99:0/3492005804 conn(0x7f0cf8070ce0 msgr2=0x7f0cf80f96d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:10.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.756+0000 7f0cff7ea640 1 -- 172.21.15.99:0/3492005804 shutdown_connections 2024-09-19T06:47:10.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.756+0000 7f0cff7ea640 1 -- 172.21.15.99:0/3492005804 wait complete. 2024-09-19T06:47:10.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.834+0000 7f802ce8b640 1 -- 172.21.15.99:0/1973384314 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8028102fc0 msgr2=0x7f80280facf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:10.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.834+0000 7f802ce8b640 1 --2- 172.21.15.99:0/1973384314 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8028102fc0 0x7f80280facf0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f80100048d0 tx=0x7f8010009da0 comp rx=0 tx=0).stop 2024-09-19T06:47:10.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.834+0000 7f802ce8b640 1 -- 172.21.15.99:0/1973384314 shutdown_connections 2024-09-19T06:47:10.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.834+0000 7f802ce8b640 1 --2- 172.21.15.99:0/1973384314 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8028102fc0 0x7f80280facf0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:10.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.834+0000 7f802ce8b640 1 --2- 172.21.15.99:0/1973384314 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8028102620 0x7f80281029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:10.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.834+0000 7f802ce8b640 1 -- 172.21.15.99:0/1973384314 >> 172.21.15.99:0/1973384314 conn(0x7f8028070d50 msgr2=0x7f8028071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:10.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.834+0000 7f802ce8b640 1 -- 172.21.15.99:0/1973384314 shutdown_connections 2024-09-19T06:47:10.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.834+0000 7f802ce8b640 1 -- 172.21.15.99:0/1973384314 wait complete. 2024-09-19T06:47:10.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.835+0000 7f802ce8b640 1 Processor -- start 2024-09-19T06:47:10.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.835+0000 7f802ce8b640 1 -- start start 2024-09-19T06:47:10.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.835+0000 7f802ce8b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8028102620 0x7f80281132c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:10.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.835+0000 7f802ce8b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8028102fc0 0x7f8028113800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:10.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.835+0000 7f802ce8b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8028113e90 con 0x7f8028102620 2024-09-19T06:47:10.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.835+0000 7f802ce8b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f802810d240 con 0x7f8028102fc0 2024-09-19T06:47:10.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.835+0000 7f802659c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8028102620 0x7f80281132c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:10.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.835+0000 7f802659c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8028102620 0x7f80281132c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46014/0 (socket says 172.21.15.99:46014) 2024-09-19T06:47:10.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.835+0000 7f802659c640 1 -- 172.21.15.99:0/2325587522 learned_addr learned my addr 172.21.15.99:0/2325587522 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:47:10.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.835+0000 7f8025d9b640 1 --2- 172.21.15.99:0/2325587522 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8028102fc0 0x7f8028113800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:10.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.835+0000 7f802659c640 1 -- 172.21.15.99:0/2325587522 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8028102fc0 msgr2=0x7f8028113800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:10.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.835+0000 7f802659c640 1 --2- 172.21.15.99:0/2325587522 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8028102fc0 0x7f8028113800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:10.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.835+0000 7f802659c640 1 -- 172.21.15.99:0/2325587522 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8010005040 con 0x7f8028102620 2024-09-19T06:47:10.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.836+0000 7f802659c640 1 --2- 172.21.15.99:0/2325587522 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8028102620 0x7f80281132c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f801800b790 tx=0x7f80180091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:10.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.836+0000 7f801effd640 1 -- 172.21.15.99:0/2325587522 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f801800c700 con 0x7f8028102620 2024-09-19T06:47:10.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.836+0000 7f801effd640 1 -- 172.21.15.99:0/2325587522 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f801800cd00 con 0x7f8028102620 2024-09-19T06:47:10.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.836+0000 7f801effd640 1 -- 172.21.15.99:0/2325587522 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8018015e80 con 0x7f8028102620 2024-09-19T06:47:10.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.836+0000 7f802ce8b640 1 -- 172.21.15.99:0/2325587522 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f802810d520 con 0x7f8028102620 2024-09-19T06:47:10.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.836+0000 7f802ce8b640 1 -- 172.21.15.99:0/2325587522 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f802810d9c0 con 0x7f8028102620 2024-09-19T06:47:10.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.837+0000 7f802ce8b640 1 -- 172.21.15.99:0/2325587522 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80280657c0 con 0x7f8028102620 2024-09-19T06:47:10.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.838+0000 7f801effd640 1 -- 172.21.15.99:0/2325587522 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f8018012070 con 0x7f8028102620 2024-09-19T06:47:10.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.838+0000 7f801effd640 1 --2- 172.21.15.99:0/2325587522 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f801406e530 0x7f80140709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:10.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.838+0000 7f8025d9b640 1 --2- 172.21.15.99:0/2325587522 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f801406e530 0x7f80140709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:10.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.838+0000 7f801effd640 1 -- 172.21.15.99:0/2325587522 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f801808d9a0 con 0x7f8028102620 2024-09-19T06:47:10.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.839+0000 7f8025d9b640 1 --2- 172.21.15.99:0/2325587522 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f801406e530 0x7f80140709e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f80100048a0 tx=0x7f8010035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:10.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:10.843+0000 7f801effd640 1 -- 172.21.15.99:0/2325587522 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f8018056b30 con 0x7f8028102620 2024-09-19T06:47:11.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.049+0000 7f802ce8b640 1 -- 172.21.15.99:0/2325587522 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f802804b720 con 0x7f8028102620 2024-09-19T06:47:11.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.049+0000 7f801effd640 1 -- 172.21.15.99:0/2325587522 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1941 (secure 0 0 0) 0x7f801805a1f0 con 0x7f8028102620 2024-09-19T06:47:11.051 INFO:teuthology.orchestra.run.smithi099.stdout:e19 2024-09-19T06:47:11.051 INFO:teuthology.orchestra.run.smithi099.stdout:btime 2024-09-19T06:44:03:270764+0000 2024-09-19T06:47:11.051 INFO:teuthology.orchestra.run.smithi099.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T06:47:11.051 INFO:teuthology.orchestra.run.smithi099.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T06:47:11.051 INFO:teuthology.orchestra.run.smithi099.stdout:legacy client fscid: 1 2024-09-19T06:47:11.051 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:47:11.051 INFO:teuthology.orchestra.run.smithi099.stdout:Filesystem 'cephfs' (1) 2024-09-19T06:47:11.051 INFO:teuthology.orchestra.run.smithi099.stdout:fs_name cephfs 2024-09-19T06:47:11.051 INFO:teuthology.orchestra.run.smithi099.stdout:epoch 19 2024-09-19T06:47:11.051 INFO:teuthology.orchestra.run.smithi099.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-19T06:47:11.051 INFO:teuthology.orchestra.run.smithi099.stdout:created 2024-09-19T06:37:40.838146+0000 2024-09-19T06:47:11.052 INFO:teuthology.orchestra.run.smithi099.stdout:modified 2024-09-19T06:44:02.356718+0000 2024-09-19T06:47:11.052 INFO:teuthology.orchestra.run.smithi099.stdout:tableserver 0 2024-09-19T06:47:11.052 INFO:teuthology.orchestra.run.smithi099.stdout:root 0 2024-09-19T06:47:11.052 INFO:teuthology.orchestra.run.smithi099.stdout:session_timeout 60 2024-09-19T06:47:11.052 INFO:teuthology.orchestra.run.smithi099.stdout:session_autoclose 300 2024-09-19T06:47:11.052 INFO:teuthology.orchestra.run.smithi099.stdout:max_file_size 1099511627776 2024-09-19T06:47:11.052 INFO:teuthology.orchestra.run.smithi099.stdout:max_xattr_size 65536 2024-09-19T06:47:11.052 INFO:teuthology.orchestra.run.smithi099.stdout:required_client_features {} 2024-09-19T06:47:11.052 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure 0 2024-09-19T06:47:11.052 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure_osd_epoch 45 2024-09-19T06:47:11.052 INFO:teuthology.orchestra.run.smithi099.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T06:47:11.052 INFO:teuthology.orchestra.run.smithi099.stdout:max_mds 2 2024-09-19T06:47:11.053 INFO:teuthology.orchestra.run.smithi099.stdout:in 0,1 2024-09-19T06:47:11.053 INFO:teuthology.orchestra.run.smithi099.stdout:up {0=14482,1=24269} 2024-09-19T06:47:11.053 INFO:teuthology.orchestra.run.smithi099.stdout:failed 2024-09-19T06:47:11.053 INFO:teuthology.orchestra.run.smithi099.stdout:damaged 2024-09-19T06:47:11.053 INFO:teuthology.orchestra.run.smithi099.stdout:stopped 2024-09-19T06:47:11.053 INFO:teuthology.orchestra.run.smithi099.stdout:data_pools [3] 2024-09-19T06:47:11.053 INFO:teuthology.orchestra.run.smithi099.stdout:metadata_pool 2 2024-09-19T06:47:11.053 INFO:teuthology.orchestra.run.smithi099.stdout:inline_data disabled 2024-09-19T06:47:11.053 INFO:teuthology.orchestra.run.smithi099.stdout:balancer 2024-09-19T06:47:11.053 INFO:teuthology.orchestra.run.smithi099.stdout:bal_rank_mask -1 2024-09-19T06:47:11.053 INFO:teuthology.orchestra.run.smithi099.stdout:standby_count_wanted 1 2024-09-19T06:47:11.053 INFO:teuthology.orchestra.run.smithi099.stdout:qdb_cluster leader: 14482 members: 24269,14482 2024-09-19T06:47:11.054 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.xehbxe{0:14482} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.99:6828/1508711176,v1:172.21.15.99:6829/1508711176] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T06:47:11.054 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.nooexo{1:24269} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.117:6824/2367330767,v1:172.21.15.117:6825/2367330767] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T06:47:11.054 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:47:11.054 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:47:11.054 INFO:teuthology.orchestra.run.smithi099.stdout:Standby daemons: 2024-09-19T06:47:11.054 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:47:11.054 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.obarqf{-1:14490} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6826/388324528,v1:172.21.15.99:6827/388324528] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T06:47:11.054 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.bheqzh{-1:24283} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.117:6826/4072877365,v1:172.21.15.117:6827/4072877365] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T06:47:11.055 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 19 2024-09-19T06:47:11.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.051+0000 7f802ce8b640 1 -- 172.21.15.99:0/2325587522 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f801406e530 msgr2=0x7f80140709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:11.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.051+0000 7f802ce8b640 1 --2- 172.21.15.99:0/2325587522 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f801406e530 0x7f80140709e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f80100048a0 tx=0x7f8010035040 comp rx=0 tx=0).stop 2024-09-19T06:47:11.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.051+0000 7f802ce8b640 1 -- 172.21.15.99:0/2325587522 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8028102620 msgr2=0x7f80281132c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:11.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.051+0000 7f802ce8b640 1 --2- 172.21.15.99:0/2325587522 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8028102620 0x7f80281132c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f801800b790 tx=0x7f80180091d0 comp rx=0 tx=0).stop 2024-09-19T06:47:11.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.051+0000 7f802ce8b640 1 -- 172.21.15.99:0/2325587522 shutdown_connections 2024-09-19T06:47:11.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.051+0000 7f802ce8b640 1 --2- 172.21.15.99:0/2325587522 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f801406e530 0x7f80140709e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:11.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.051+0000 7f802ce8b640 1 --2- 172.21.15.99:0/2325587522 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8028102fc0 0x7f8028113800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:11.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.051+0000 7f802ce8b640 1 --2- 172.21.15.99:0/2325587522 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8028102620 0x7f80281132c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:11.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.051+0000 7f802ce8b640 1 -- 172.21.15.99:0/2325587522 >> 172.21.15.99:0/2325587522 conn(0x7f8028070d50 msgr2=0x7f80280fa180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:11.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.052+0000 7f802ce8b640 1 -- 172.21.15.99:0/2325587522 shutdown_connections 2024-09-19T06:47:11.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.052+0000 7f802ce8b640 1 -- 172.21.15.99:0/2325587522 wait complete. 2024-09-19T06:47:11.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.132+0000 7fe03234e640 1 -- 172.21.15.99:0/2459653359 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe02c0fb480 msgr2=0x7fe02c0fb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:11.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.132+0000 7fe03234e640 1 --2- 172.21.15.99:0/2459653359 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe02c0fb480 0x7fe02c0fb8f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe0140048d0 tx=0x7fe014009da0 comp rx=0 tx=0).stop 2024-09-19T06:47:11.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.132+0000 7fe03234e640 1 -- 172.21.15.99:0/2459653359 shutdown_connections 2024-09-19T06:47:11.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.132+0000 7fe03234e640 1 --2- 172.21.15.99:0/2459653359 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe02c0fb480 0x7fe02c0fb8f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:11.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.132+0000 7fe03234e640 1 --2- 172.21.15.99:0/2459653359 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe02c1014c0 0x7fe02c101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:11.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.132+0000 7fe03234e640 1 -- 172.21.15.99:0/2459653359 >> 172.21.15.99:0/2459653359 conn(0x7fe02c0f7000 msgr2=0x7fe02c0f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:11.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.132+0000 7fe03234e640 1 -- 172.21.15.99:0/2459653359 shutdown_connections 2024-09-19T06:47:11.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.132+0000 7fe03234e640 1 -- 172.21.15.99:0/2459653359 wait complete. 2024-09-19T06:47:11.134 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:10 smithi099 ceph-mon[97031]: from='client.34310 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:47:11.134 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:10 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/3492005804' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:47:11.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.132+0000 7fe03234e640 1 Processor -- start 2024-09-19T06:47:11.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.133+0000 7fe03234e640 1 -- start start 2024-09-19T06:47:11.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.133+0000 7fe03234e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe02c0fb480 0x7fe02c1131e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:11.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.133+0000 7fe03234e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe02c1014c0 0x7fe02c113720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:11.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.133+0000 7fe03234e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe02c113d20 con 0x7fe02c1014c0 2024-09-19T06:47:11.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.133+0000 7fe03234e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe02c10d160 con 0x7fe02c0fb480 2024-09-19T06:47:11.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.133+0000 7fe02b7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe02c1014c0 0x7fe02c113720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:11.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.133+0000 7fe02b7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe02c1014c0 0x7fe02c113720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46022/0 (socket says 172.21.15.99:46022) 2024-09-19T06:47:11.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.133+0000 7fe02b7fe640 1 -- 172.21.15.99:0/1585530391 learned_addr learned my addr 172.21.15.99:0/1585530391 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:47:11.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.133+0000 7fe02bfff640 1 --2- 172.21.15.99:0/1585530391 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe02c0fb480 0x7fe02c1131e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:11.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.133+0000 7fe02bfff640 1 -- 172.21.15.99:0/1585530391 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe02c1014c0 msgr2=0x7fe02c113720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:11.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.133+0000 7fe02bfff640 1 --2- 172.21.15.99:0/1585530391 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe02c1014c0 0x7fe02c113720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:11.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.133+0000 7fe02bfff640 1 -- 172.21.15.99:0/1585530391 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe014005040 con 0x7fe02c0fb480 2024-09-19T06:47:11.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.133+0000 7fe02b7fe640 1 --2- 172.21.15.99:0/1585530391 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe02c1014c0 0x7fe02c113720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:47:11.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.134+0000 7fe02bfff640 1 --2- 172.21.15.99:0/1585530391 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe02c0fb480 0x7fe02c1131e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe01c0027d0 tx=0x7fe01c009f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:11.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.134+0000 7fe028ff9640 1 -- 172.21.15.99:0/1585530391 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe01c007a20 con 0x7fe02c0fb480 2024-09-19T06:47:11.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.134+0000 7fe028ff9640 1 -- 172.21.15.99:0/1585530391 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe01c00f040 con 0x7fe02c0fb480 2024-09-19T06:47:11.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.134+0000 7fe03234e640 1 -- 172.21.15.99:0/1585530391 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe02c10d440 con 0x7fe02c0fb480 2024-09-19T06:47:11.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.134+0000 7fe028ff9640 1 -- 172.21.15.99:0/1585530391 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe01c009470 con 0x7fe02c0fb480 2024-09-19T06:47:11.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.134+0000 7fe03234e640 1 -- 172.21.15.99:0/1585530391 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe02c10d9e0 con 0x7fe02c0fb480 2024-09-19T06:47:11.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.135+0000 7fe03234e640 1 -- 172.21.15.99:0/1585530391 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe02c0fcbc0 con 0x7fe02c0fb480 2024-09-19T06:47:11.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.135+0000 7fe028ff9640 1 -- 172.21.15.99:0/1585530391 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fe01c0096e0 con 0x7fe02c0fb480 2024-09-19T06:47:11.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.136+0000 7fe028ff9640 1 --2- 172.21.15.99:0/1585530391 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe01806e530 0x7fe0180709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:11.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.136+0000 7fe028ff9640 1 -- 172.21.15.99:0/1585530391 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fe01c08d8a0 con 0x7fe02c0fb480 2024-09-19T06:47:11.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.136+0000 7fe02b7fe640 1 --2- 172.21.15.99:0/1585530391 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe01806e530 0x7fe0180709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:11.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.136+0000 7fe02b7fe640 1 --2- 172.21.15.99:0/1585530391 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe01806e530 0x7fe0180709e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe02c10eaa0 tx=0x7fe014035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:11.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.140+0000 7fe028ff9640 1 -- 172.21.15.99:0/1585530391 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fe01c056a40 con 0x7fe02c0fb480 2024-09-19T06:47:11.143 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:10 smithi117 ceph-mon[76771]: from='client.34310 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:47:11.143 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:10 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/3492005804' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:47:11.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.323+0000 7fe03234e640 1 -- 172.21.15.99:0/1585530391 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe02c04b720 con 0x7fe01806e530 2024-09-19T06:47:11.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.324+0000 7fe028ff9640 1 -- 172.21.15.99:0/1585530391 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fe02c04b720 con 0x7fe01806e530 2024-09-19T06:47:11.326 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:47:11.326 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T06:47:11.326 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": true, 2024-09-19T06:47:11.326 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T06:47:11.326 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [ 2024-09-19T06:47:11.326 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr", 2024-09-19T06:47:11.326 INFO:teuthology.orchestra.run.smithi099.stdout: "crash", 2024-09-19T06:47:11.326 INFO:teuthology.orchestra.run.smithi099.stdout: "mon" 2024-09-19T06:47:11.326 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-19T06:47:11.326 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": "10/21 daemons upgraded", 2024-09-19T06:47:11.326 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "Currently upgrading osd daemons", 2024-09-19T06:47:11.326 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-09-19T06:47:11.326 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:47:11.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.326+0000 7fe03234e640 1 -- 172.21.15.99:0/1585530391 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe01806e530 msgr2=0x7fe0180709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:11.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.326+0000 7fe03234e640 1 --2- 172.21.15.99:0/1585530391 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe01806e530 0x7fe0180709e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe02c10eaa0 tx=0x7fe014035040 comp rx=0 tx=0).stop 2024-09-19T06:47:11.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.326+0000 7fe03234e640 1 -- 172.21.15.99:0/1585530391 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe02c0fb480 msgr2=0x7fe02c1131e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:11.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.326+0000 7fe03234e640 1 --2- 172.21.15.99:0/1585530391 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe02c0fb480 0x7fe02c1131e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe01c0027d0 tx=0x7fe01c009f70 comp rx=0 tx=0).stop 2024-09-19T06:47:11.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.326+0000 7fe03234e640 1 -- 172.21.15.99:0/1585530391 shutdown_connections 2024-09-19T06:47:11.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.326+0000 7fe03234e640 1 --2- 172.21.15.99:0/1585530391 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe01806e530 0x7fe0180709e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:11.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.326+0000 7fe03234e640 1 --2- 172.21.15.99:0/1585530391 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe02c1014c0 0x7fe02c113720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:11.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.326+0000 7fe03234e640 1 --2- 172.21.15.99:0/1585530391 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe02c0fb480 0x7fe02c1131e0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:11.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.326+0000 7fe03234e640 1 -- 172.21.15.99:0/1585530391 >> 172.21.15.99:0/1585530391 conn(0x7fe02c0f7000 msgr2=0x7fe02c065a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:11.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.326+0000 7fe03234e640 1 -- 172.21.15.99:0/1585530391 shutdown_connections 2024-09-19T06:47:11.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.326+0000 7fe03234e640 1 -- 172.21.15.99:0/1585530391 wait complete. 2024-09-19T06:47:11.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.404+0000 7f9d48d76640 1 -- 172.21.15.99:0/341198250 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9d44102580 msgr2=0x7f9d44102950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:11.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.404+0000 7f9d48d76640 1 --2- 172.21.15.99:0/341198250 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9d44102580 0x7f9d44102950 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9d340048d0 tx=0x7f9d34009da0 comp rx=0 tx=0).stop 2024-09-19T06:47:11.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.404+0000 7f9d48d76640 1 -- 172.21.15.99:0/341198250 shutdown_connections 2024-09-19T06:47:11.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.404+0000 7f9d48d76640 1 --2- 172.21.15.99:0/341198250 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d44102f20 0x7f9d440fc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:11.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.404+0000 7f9d48d76640 1 --2- 172.21.15.99:0/341198250 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9d44102580 0x7f9d44102950 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:11.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.404+0000 7f9d48d76640 1 -- 172.21.15.99:0/341198250 >> 172.21.15.99:0/341198250 conn(0x7f9d440f81a0 msgr2=0x7f9d440fa5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:11.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.404+0000 7f9d48d76640 1 -- 172.21.15.99:0/341198250 shutdown_connections 2024-09-19T06:47:11.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.404+0000 7f9d48d76640 1 -- 172.21.15.99:0/341198250 wait complete. 2024-09-19T06:47:11.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.405+0000 7f9d48d76640 1 Processor -- start 2024-09-19T06:47:11.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.405+0000 7f9d48d76640 1 -- start start 2024-09-19T06:47:11.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.405+0000 7f9d48d76640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d44102580 0x7f9d44113220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:11.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.405+0000 7f9d48d76640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9d44102f20 0x7f9d44113760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:11.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.405+0000 7f9d48d76640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d44113d60 con 0x7f9d44102f20 2024-09-19T06:47:11.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.405+0000 7f9d48d76640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4410d1a0 con 0x7f9d44102580 2024-09-19T06:47:11.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.405+0000 7f9d41d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9d44102f20 0x7f9d44113760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:11.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.405+0000 7f9d41d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9d44102f20 0x7f9d44113760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46038/0 (socket says 172.21.15.99:46038) 2024-09-19T06:47:11.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.406+0000 7f9d41d9b640 1 -- 172.21.15.99:0/1719623965 learned_addr learned my addr 172.21.15.99:0/1719623965 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:47:11.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.406+0000 7f9d4259c640 1 --2- 172.21.15.99:0/1719623965 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d44102580 0x7f9d44113220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:11.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.406+0000 7f9d41d9b640 1 -- 172.21.15.99:0/1719623965 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d44102580 msgr2=0x7f9d44113220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:11.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.406+0000 7f9d41d9b640 1 --2- 172.21.15.99:0/1719623965 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d44102580 0x7f9d44113220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:11.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.406+0000 7f9d41d9b640 1 -- 172.21.15.99:0/1719623965 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d34005040 con 0x7f9d44102f20 2024-09-19T06:47:11.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.406+0000 7f9d41d9b640 1 --2- 172.21.15.99:0/1719623965 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9d44102f20 0x7f9d44113760 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c00eb40 tx=0x7f9d2c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:11.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.406+0000 7f9d3affd640 1 -- 172.21.15.99:0/1719623965 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d2c007c30 con 0x7f9d44102f20 2024-09-19T06:47:11.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.406+0000 7f9d3affd640 1 -- 172.21.15.99:0/1719623965 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9d2c00f040 con 0x7f9d44102f20 2024-09-19T06:47:11.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.406+0000 7f9d48d76640 1 -- 172.21.15.99:0/1719623965 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d4410d420 con 0x7f9d44102f20 2024-09-19T06:47:11.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.406+0000 7f9d3affd640 1 -- 172.21.15.99:0/1719623965 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d2c00ca90 con 0x7f9d44102f20 2024-09-19T06:47:11.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.406+0000 7f9d48d76640 1 -- 172.21.15.99:0/1719623965 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d4410d9c0 con 0x7f9d44102f20 2024-09-19T06:47:11.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.407+0000 7f9d48d76640 1 -- 172.21.15.99:0/1719623965 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d440fdd00 con 0x7f9d44102f20 2024-09-19T06:47:11.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.408+0000 7f9d3affd640 1 -- 172.21.15.99:0/1719623965 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f9d2c00cc10 con 0x7f9d44102f20 2024-09-19T06:47:11.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.408+0000 7f9d3affd640 1 --2- 172.21.15.99:0/1719623965 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f9d3006e530 0x7f9d300709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:11.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.408+0000 7f9d3affd640 1 -- 172.21.15.99:0/1719623965 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f9d2c08dca0 con 0x7f9d44102f20 2024-09-19T06:47:11.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.409+0000 7f9d4259c640 1 --2- 172.21.15.99:0/1719623965 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f9d3006e530 0x7f9d300709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:11.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.409+0000 7f9d4259c640 1 --2- 172.21.15.99:0/1719623965 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f9d3006e530 0x7f9d300709e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9d34004540 tx=0x7f9d34035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:11.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.413+0000 7f9d3affd640 1 -- 172.21.15.99:0/1719623965 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f9d2c092070 con 0x7f9d44102f20 2024-09-19T06:47:11.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.644+0000 7f9d48d76640 1 -- 172.21.15.99:0/1719623965 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f9d44109680 con 0x7f9d44102f20 2024-09-19T06:47:11.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.645+0000 7f9d3affd640 1 -- 172.21.15.99:0/1719623965 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1162 (secure 0 0 0) 0x7f9d2c056ee0 con 0x7f9d44102f20 2024-09-19T06:47:11.646 INFO:teuthology.orchestra.run.smithi099.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 53/321 objects degraded (16.511%), 16 pgs degraded 2024-09-19T06:47:11.646 INFO:teuthology.orchestra.run.smithi099.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-19T06:47:11.647 INFO:teuthology.orchestra.run.smithi099.stdout: osd.4 (root=default,host=smithi117) is down 2024-09-19T06:47:11.647 INFO:teuthology.orchestra.run.smithi099.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 53/321 objects degraded (16.511%), 16 pgs degraded 2024-09-19T06:47:11.647 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.4 is active+undersized+degraded, acting [1,0] 2024-09-19T06:47:11.647 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.5 is active+undersized+degraded, acting [3,0] 2024-09-19T06:47:11.647 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.6 is active+undersized+degraded, acting [1,3] 2024-09-19T06:47:11.648 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.7 is active+undersized+degraded, acting [3,2] 2024-09-19T06:47:11.648 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.9 is active+undersized+degraded, acting [1,0] 2024-09-19T06:47:11.648 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.a is active+undersized+degraded, acting [1,3] 2024-09-19T06:47:11.648 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.b is active+undersized+degraded, acting [3,5] 2024-09-19T06:47:11.648 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.f is active+undersized+degraded, acting [0,5] 2024-09-19T06:47:11.648 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.11 is active+undersized+degraded, acting [3,1] 2024-09-19T06:47:11.648 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.13 is active+undersized+degraded, acting [0,2] 2024-09-19T06:47:11.648 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.14 is active+undersized+degraded, acting [3,5] 2024-09-19T06:47:11.648 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.18 is active+undersized+degraded, acting [5,3] 2024-09-19T06:47:11.649 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.19 is active+undersized+degraded, acting [0,2] 2024-09-19T06:47:11.649 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.1a is active+undersized+degraded, acting [3,5] 2024-09-19T06:47:11.649 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.1c is active+undersized+degraded, acting [5,2] 2024-09-19T06:47:11.649 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.1f is active+undersized+degraded, acting [0,3] 2024-09-19T06:47:11.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.647+0000 7f9d48d76640 1 -- 172.21.15.99:0/1719623965 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f9d3006e530 msgr2=0x7f9d300709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:11.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.647+0000 7f9d48d76640 1 --2- 172.21.15.99:0/1719623965 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f9d3006e530 0x7f9d300709e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9d34004540 tx=0x7f9d34035040 comp rx=0 tx=0).stop 2024-09-19T06:47:11.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.647+0000 7f9d48d76640 1 -- 172.21.15.99:0/1719623965 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9d44102f20 msgr2=0x7f9d44113760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:11.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.647+0000 7f9d48d76640 1 --2- 172.21.15.99:0/1719623965 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9d44102f20 0x7f9d44113760 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c00eb40 tx=0x7f9d2c00b040 comp rx=0 tx=0).stop 2024-09-19T06:47:11.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.647+0000 7f9d48d76640 1 -- 172.21.15.99:0/1719623965 shutdown_connections 2024-09-19T06:47:11.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.647+0000 7f9d48d76640 1 --2- 172.21.15.99:0/1719623965 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f9d3006e530 0x7f9d300709e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:11.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.647+0000 7f9d48d76640 1 --2- 172.21.15.99:0/1719623965 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9d44102f20 0x7f9d44113760 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:11.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.647+0000 7f9d48d76640 1 --2- 172.21.15.99:0/1719623965 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d44102580 0x7f9d44113220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:11.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.647+0000 7f9d48d76640 1 -- 172.21.15.99:0/1719623965 >> 172.21.15.99:0/1719623965 conn(0x7f9d440f81a0 msgr2=0x7f9d440f91c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:11.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.647+0000 7f9d48d76640 1 -- 172.21.15.99:0/1719623965 shutdown_connections 2024-09-19T06:47:11.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:11.647+0000 7f9d48d76640 1 -- 172.21.15.99:0/1719623965 wait complete. 2024-09-19T06:47:11.811 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 06:47:11 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-4[91035]: 2024-09-19T06:47:11.399+0000 7f69461f3640 -1 Falling back to public interface 2024-09-19T06:47:12.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:11 smithi099 ceph-mon[97031]: from='client.34314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:47:12.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:11 smithi099 ceph-mon[97031]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:47:12.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:11 smithi099 ceph-mon[97031]: pgmap v132: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 254 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 53/321 objects degraded (16.511%) 2024-09-19T06:47:12.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:11 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/2325587522' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:47:12.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:11 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/1719623965' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T06:47:12.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:11 smithi117 ceph-mon[76771]: from='client.34314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:47:12.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:11 smithi117 ceph-mon[76771]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:47:12.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:11 smithi117 ceph-mon[76771]: pgmap v132: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 254 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 53/321 objects degraded (16.511%) 2024-09-19T06:47:12.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:11 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/2325587522' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:47:12.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:11 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/1719623965' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T06:47:13.149 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:12 smithi099 ceph-mon[97031]: from='client.44245 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:47:13.150 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:12 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:47:13.150 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:12 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:47:13.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:12 smithi117 ceph-mon[76771]: from='client.44245 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:47:13.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:12 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:47:13.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:12 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:47:14.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:13 smithi117 ceph-mon[76771]: pgmap v133: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 254 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 53/321 objects degraded (16.511%) 2024-09-19T06:47:14.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:13 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:47:14.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:13 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:47:14.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:13 smithi099 ceph-mon[97031]: pgmap v133: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 254 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 53/321 objects degraded (16.511%) 2024-09-19T06:47:14.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:13 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:47:14.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:13 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:47:16.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:15 smithi117 ceph-mon[76771]: pgmap v134: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 254 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 53/321 objects degraded (16.511%) 2024-09-19T06:47:16.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:15 smithi117 ceph-mon[76771]: Health check update: Degraded data redundancy: 53/321 objects degraded (16.511%), 16 pgs degraded (PG_DEGRADED) 2024-09-19T06:47:16.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:15 smithi099 ceph-mon[97031]: pgmap v134: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 254 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 53/321 objects degraded (16.511%) 2024-09-19T06:47:16.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:15 smithi099 ceph-mon[97031]: Health check update: Degraded data redundancy: 53/321 objects degraded (16.511%), 16 pgs degraded (PG_DEGRADED) 2024-09-19T06:47:17.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:17 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:47:17.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:17 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:47:17.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:17 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:47:17.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:17 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:47:17.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:17 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:47:17.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:17 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:47:17.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:17 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:47:17.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:17 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:47:17.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:17 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:47:17.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:17 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-19T06:47:17.458 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:17 smithi099 ceph-mon[97031]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-19T06:47:17.458 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:17 smithi099 ceph-mon[97031]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-19T06:47:17.458 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:17 smithi099 ceph-mon[97031]: pgmap v135: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 254 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 53/321 objects degraded (16.511%) 2024-09-19T06:47:17.500 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:17 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:47:17.500 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:17 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:47:17.501 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:17 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:47:17.501 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:17 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:47:17.501 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:17 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:47:17.501 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:17 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:47:17.501 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:17 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:47:17.501 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:17 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:47:17.501 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:17 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:47:17.501 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:17 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-19T06:47:17.501 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:17 smithi117 ceph-mon[76771]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-19T06:47:17.501 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:17 smithi117 ceph-mon[76771]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-19T06:47:17.502 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:17 smithi117 ceph-mon[76771]: pgmap v135: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 254 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 53/321 objects degraded (16.511%) 2024-09-19T06:47:17.811 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 06:47:17 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-4[91035]: 2024-09-19T06:47:17.497+0000 7f69461f3640 -1 osd.4 68 log_to_monitors true 2024-09-19T06:47:18.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:18 smithi099 ceph-mon[97031]: from='osd.4 [v2:172.21.15.117:6808/3788965717,v1:172.21.15.117:6809/3788965717]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T06:47:18.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:18 smithi099 ceph-mon[97031]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T06:47:18.562 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 06:47:18 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-4[91035]: 2024-09-19T06:47:18.183+0000 7f693df8d640 -1 osd.4 68 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:47:18.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:18 smithi117 ceph-mon[76771]: from='osd.4 [v2:172.21.15.117:6808/3788965717,v1:172.21.15.117:6809/3788965717]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T06:47:18.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:18 smithi117 ceph-mon[76771]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T06:47:19.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:19 smithi099 ceph-mon[97031]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T06:47:19.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:19 smithi099 ceph-mon[97031]: osdmap e71: 6 total, 5 up, 6 in 2024-09-19T06:47:19.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:19 smithi099 ceph-mon[97031]: from='osd.4 [v2:172.21.15.117:6808/3788965717,v1:172.21.15.117:6809/3788965717]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-19T06:47:19.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:19 smithi099 ceph-mon[97031]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-19T06:47:19.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:19 smithi099 ceph-mon[97031]: pgmap v137: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 53/321 objects degraded (16.511%) 2024-09-19T06:47:19.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:19 smithi117 ceph-mon[76771]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T06:47:19.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:19 smithi117 ceph-mon[76771]: osdmap e71: 6 total, 5 up, 6 in 2024-09-19T06:47:19.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:19 smithi117 ceph-mon[76771]: from='osd.4 [v2:172.21.15.117:6808/3788965717,v1:172.21.15.117:6809/3788965717]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-19T06:47:19.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:19 smithi117 ceph-mon[76771]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-19T06:47:19.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:19 smithi117 ceph-mon[76771]: pgmap v137: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 53/321 objects degraded (16.511%) 2024-09-19T06:47:20.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:20 smithi099 ceph-mon[97031]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-19T06:47:20.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:20 smithi099 ceph-mon[97031]: osd.4 [v2:172.21.15.117:6808/3788965717,v1:172.21.15.117:6809/3788965717] boot 2024-09-19T06:47:20.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:20 smithi099 ceph-mon[97031]: osdmap e72: 6 total, 6 up, 6 in 2024-09-19T06:47:20.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:20 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:47:20.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:20 smithi099 ceph-mon[97031]: osdmap e73: 6 total, 6 up, 6 in 2024-09-19T06:47:20.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:20 smithi117 ceph-mon[76771]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-19T06:47:20.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:20 smithi117 ceph-mon[76771]: osd.4 [v2:172.21.15.117:6808/3788965717,v1:172.21.15.117:6809/3788965717] boot 2024-09-19T06:47:20.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:20 smithi117 ceph-mon[76771]: osdmap e72: 6 total, 6 up, 6 in 2024-09-19T06:47:20.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:20 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T06:47:20.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:20 smithi117 ceph-mon[76771]: osdmap e73: 6 total, 6 up, 6 in 2024-09-19T06:47:21.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:21 smithi099 ceph-mon[97031]: pgmap v140: 65 pgs: 6 peering, 11 active+undersized, 9 active+undersized+degraded, 39 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 31/321 objects degraded (9.657%) 2024-09-19T06:47:21.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:21 smithi117 ceph-mon[76771]: pgmap v140: 65 pgs: 6 peering, 11 active+undersized, 9 active+undersized+degraded, 39 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 31/321 objects degraded (9.657%) 2024-09-19T06:47:22.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:22 smithi099 ceph-mon[97031]: Health check update: Degraded data redundancy: 31/321 objects degraded (9.657%), 9 pgs degraded (PG_DEGRADED) 2024-09-19T06:47:22.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:22 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:47:22.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:22 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:47:22.463 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:22 smithi117 ceph-mon[76771]: Health check update: Degraded data redundancy: 31/321 objects degraded (9.657%), 9 pgs degraded (PG_DEGRADED) 2024-09-19T06:47:22.463 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:22 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:47:22.463 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:22 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:47:23.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:23 smithi099 ceph-mon[97031]: pgmap v141: 65 pgs: 6 peering, 3 active+undersized, 3 active+undersized+degraded, 53 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 6/321 objects degraded (1.869%) 2024-09-19T06:47:23.479 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:23 smithi117 ceph-mon[76771]: pgmap v141: 65 pgs: 6 peering, 3 active+undersized, 3 active+undersized+degraded, 53 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 6/321 objects degraded (1.869%) 2024-09-19T06:47:25.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:24 smithi117 ceph-mon[76771]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/321 objects degraded (1.869%), 3 pgs degraded) 2024-09-19T06:47:25.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:24 smithi117 ceph-mon[76771]: Cluster is now healthy 2024-09-19T06:47:25.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:24 smithi099 ceph-mon[97031]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/321 objects degraded (1.869%), 3 pgs degraded) 2024-09-19T06:47:25.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:24 smithi099 ceph-mon[97031]: Cluster is now healthy 2024-09-19T06:47:26.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:25 smithi117 ceph-mon[76771]: pgmap v142: 65 pgs: 6 peering, 59 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:47:26.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:25 smithi099 ceph-mon[97031]: pgmap v142: 65 pgs: 6 peering, 59 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:47:28.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:27 smithi117 ceph-mon[76771]: pgmap v143: 65 pgs: 65 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:47:28.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:27 smithi099 ceph-mon[97031]: pgmap v143: 65 pgs: 65 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:47:30.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:29 smithi117 ceph-mon[76771]: pgmap v144: 65 pgs: 65 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:47:30.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:29 smithi099 ceph-mon[97031]: pgmap v144: 65 pgs: 65 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:47:32.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:31 smithi117 ceph-mon[76771]: pgmap v145: 65 pgs: 65 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:47:32.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:31 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-19T06:47:32.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:31 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:47:32.315 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:31 smithi099 ceph-mon[97031]: pgmap v145: 65 pgs: 65 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:47:32.315 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:31 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-19T06:47:32.315 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:31 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:47:33.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:32 smithi117 ceph-mon[76771]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-19T06:47:33.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:32 smithi117 ceph-mon[76771]: Upgrade: osd.5 is safe to restart 2024-09-19T06:47:33.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:32 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:47:33.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:32 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T06:47:33.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:32 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:47:33.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:32 smithi099 ceph-mon[97031]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-19T06:47:33.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:32 smithi099 ceph-mon[97031]: Upgrade: osd.5 is safe to restart 2024-09-19T06:47:33.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:32 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:47:33.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:32 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T06:47:33.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:32 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:47:34.166 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:33 smithi117 ceph-mon[76771]: Upgrade: Updating osd.5 2024-09-19T06:47:34.166 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:33 smithi117 ceph-mon[76771]: Deploying daemon osd.5 on smithi117 2024-09-19T06:47:34.167 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:33 smithi117 ceph-mon[76771]: pgmap v146: 65 pgs: 65 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:47:34.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:33 smithi099 ceph-mon[97031]: Upgrade: Updating osd.5 2024-09-19T06:47:34.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:33 smithi099 ceph-mon[97031]: Deploying daemon osd.5 on smithi117 2024-09-19T06:47:34.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:33 smithi099 ceph-mon[97031]: pgmap v146: 65 pgs: 65 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:47:36.141 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:35 smithi117 ceph-mon[76771]: pgmap v147: 65 pgs: 65 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:47:36.141 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:47:35 smithi117 systemd[1]: Stopping Ceph osd.5 for a73eb958-7650-11ef-bceb-c7b262605968... 2024-09-19T06:47:36.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:35 smithi099 ceph-mon[97031]: pgmap v147: 65 pgs: 65 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:47:36.561 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:47:36 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5[52951]: 2024-09-19T06:47:36.161+0000 7fd52eee2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T06:47:36.562 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:47:36 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5[52951]: 2024-09-19T06:47:36.161+0000 7fd52eee2640 -1 osd.5 73 *** Got signal Terminated *** 2024-09-19T06:47:36.562 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:47:36 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5[52951]: 2024-09-19T06:47:36.161+0000 7fd52eee2640 -1 osd.5 73 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T06:47:37.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:36 smithi117 ceph-mon[76771]: osd.5 marked itself down and dead 2024-09-19T06:47:37.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:36 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:47:37.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:36 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:47:37.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:36 smithi099 ceph-mon[97031]: osd.5 marked itself down and dead 2024-09-19T06:47:37.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:36 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:47:37.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:36 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:47:37.712 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:47:37 smithi117 podman[95433]: 2024-09-19 06:47:37.434212637 +0000 UTC m=+1.389326805 container died 39dcb7dbf0e30e96b1f8c2db5afac5da980edd0290139e6f1ea398bd40ccc4dc (image=quay.ceph.io/ceph-ci/ceph@sha256:4d922a456af336b23156460d93b8143eb9c977eee7e72f2e9e44c816e5b46ac8, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-6e06d1e, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD) 2024-09-19T06:47:37.986 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:47:37 smithi117 podman[95433]: 2024-09-19 06:47:37.819004287 +0000 UTC m=+1.774118456 container cleanup 39dcb7dbf0e30e96b1f8c2db5afac5da980edd0290139e6f1ea398bd40ccc4dc (image=quay.ceph.io/ceph-ci/ceph@sha256:4d922a456af336b23156460d93b8143eb9c977eee7e72f2e9e44c816e5b46ac8, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, RELEASE=quincy-6e06d1e, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T06:47:37.986 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:47:37 smithi117 bash[95433]: ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5 2024-09-19T06:47:38.311 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:47:38 smithi117 podman[95460]: 2024-09-19 06:47:38.078882266 +0000 UTC m=+0.638912770 container remove 39dcb7dbf0e30e96b1f8c2db5afac5da980edd0290139e6f1ea398bd40ccc4dc (image=quay.ceph.io/ceph-ci/ceph@sha256:4d922a456af336b23156460d93b8143eb9c977eee7e72f2e9e44c816e5b46ac8, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=quincy-6e06d1e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-19T06:47:38.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:37 smithi117 ceph-mon[76771]: pgmap v148: 65 pgs: 65 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:47:38.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:37 smithi117 ceph-mon[76771]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-19T06:47:38.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:37 smithi117 ceph-mon[76771]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-09-19T06:47:38.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:37 smithi117 ceph-mon[76771]: osdmap e74: 6 total, 5 up, 6 in 2024-09-19T06:47:38.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:37 smithi099 ceph-mon[97031]: pgmap v148: 65 pgs: 65 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-19T06:47:38.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:37 smithi099 ceph-mon[97031]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-19T06:47:38.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:37 smithi099 ceph-mon[97031]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-09-19T06:47:38.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:37 smithi099 ceph-mon[97031]: osdmap e74: 6 total, 5 up, 6 in 2024-09-19T06:47:38.741 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:47:38 smithi117 podman[95548]: 2024-09-19 06:47:38.429639548 +0000 UTC m=+0.112203284 container create edcf6d67f7d40a1d091b6d79dee5371f168bd41a19c7aa4679bd1c886004dc21 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-19T06:47:38.741 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:47:38 smithi117 podman[95548]: 2024-09-19 06:47:38.333067042 +0000 UTC m=+0.015630735 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:47:38.741 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:47:38 smithi117 podman[95548]: 2024-09-19 06:47:38.640372301 +0000 UTC m=+0.322936001 container init edcf6d67f7d40a1d091b6d79dee5371f168bd41a19c7aa4679bd1c886004dc21 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-19T06:47:38.741 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:47:38 smithi117 podman[95548]: 2024-09-19 06:47:38.64371249 +0000 UTC m=+0.326276192 container start edcf6d67f7d40a1d091b6d79dee5371f168bd41a19c7aa4679bd1c886004dc21 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5-deactivate, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=) 2024-09-19T06:47:38.741 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:47:38 smithi117 podman[95548]: 2024-09-19 06:47:38.740167664 +0000 UTC m=+0.422731367 container attach edcf6d67f7d40a1d091b6d79dee5371f168bd41a19c7aa4679bd1c886004dc21 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-19T06:47:38.996 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:47:38 smithi117 podman[95548]: 2024-09-19 06:47:38.829751863 +0000 UTC m=+0.512315556 container died edcf6d67f7d40a1d091b6d79dee5371f168bd41a19c7aa4679bd1c886004dc21 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2) 2024-09-19T06:47:39.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:38 smithi117 ceph-mon[76771]: osdmap e75: 6 total, 5 up, 6 in 2024-09-19T06:47:39.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:38 smithi099 ceph-mon[97031]: osdmap e75: 6 total, 5 up, 6 in 2024-09-19T06:47:39.812 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:47:39 smithi117 podman[95571]: 2024-09-19 06:47:39.390639315 +0000 UTC m=+0.555181454 container remove edcf6d67f7d40a1d091b6d79dee5371f168bd41a19c7aa4679bd1c886004dc21 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True) 2024-09-19T06:47:39.812 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:47:39 smithi117 systemd[1]: ceph-a73eb958-7650-11ef-bceb-c7b262605968@osd.5.service: Deactivated successfully. 2024-09-19T06:47:39.812 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:47:39 smithi117 systemd[1]: Stopped Ceph osd.5 for a73eb958-7650-11ef-bceb-c7b262605968. 2024-09-19T06:47:39.812 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:47:39 smithi117 systemd[1]: ceph-a73eb958-7650-11ef-bceb-c7b262605968@osd.5.service: Consumed 1min 2.548s CPU time. 2024-09-19T06:47:39.812 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:47:39 smithi117 systemd[1]: Starting Ceph osd.5 for a73eb958-7650-11ef-bceb-c7b262605968... 2024-09-19T06:47:40.147 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:39 smithi117 ceph-mon[76771]: pgmap v151: 65 pgs: 4 active+undersized, 9 stale+active+clean, 3 active+undersized+degraded, 49 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 7/321 objects degraded (2.181%) 2024-09-19T06:47:40.148 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:39 smithi117 ceph-mon[76771]: Health check failed: Degraded data redundancy: 7/321 objects degraded (2.181%), 3 pgs degraded (PG_DEGRADED) 2024-09-19T06:47:40.148 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:47:39 smithi117 podman[95669]: 2024-09-19 06:47:39.811575537 +0000 UTC m=+0.106443629 container create 070ad318c1ad1796f8158d4952d657e22dad2f4105c02a358d154a772f544419 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5-activate, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2) 2024-09-19T06:47:40.148 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:47:39 smithi117 podman[95669]: 2024-09-19 06:47:39.720659868 +0000 UTC m=+0.015527971 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:47:40.148 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:47:40 smithi117 podman[95669]: 2024-09-19 06:47:40.04759041 +0000 UTC m=+0.342458504 container init 070ad318c1ad1796f8158d4952d657e22dad2f4105c02a358d154a772f544419 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5-activate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-19T06:47:40.148 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:47:40 smithi117 podman[95669]: 2024-09-19 06:47:40.05134549 +0000 UTC m=+0.346213580 container start 070ad318c1ad1796f8158d4952d657e22dad2f4105c02a358d154a772f544419 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5-activate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T06:47:40.148 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:47:40 smithi117 podman[95669]: 2024-09-19 06:47:40.147416948 +0000 UTC m=+0.442285066 container attach 070ad318c1ad1796f8158d4952d657e22dad2f4105c02a358d154a772f544419 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5-activate, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4) 2024-09-19T06:47:40.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:39 smithi099 ceph-mon[97031]: pgmap v151: 65 pgs: 4 active+undersized, 9 stale+active+clean, 3 active+undersized+degraded, 49 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 7/321 objects degraded (2.181%) 2024-09-19T06:47:40.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:39 smithi099 ceph-mon[97031]: Health check failed: Degraded data redundancy: 7/321 objects degraded (2.181%), 3 pgs degraded (PG_DEGRADED) 2024-09-19T06:47:40.561 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:47:40 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5-activate[95685]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T06:47:40.562 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:47:40 smithi117 bash[95669]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T06:47:40.562 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:47:40 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5-activate[95685]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T06:47:40.562 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:47:40 smithi117 bash[95669]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-19T06:47:41.195 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:47:40 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5-activate[95685]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-19T06:47:41.195 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:47:40 smithi117 bash[95669]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-19T06:47:41.195 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:47:40 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5-activate[95685]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-19T06:47:41.196 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:47:40 smithi117 bash[95669]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-19T06:47:41.518 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:47:41 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5-activate[95685]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-19T06:47:41.518 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:47:41 smithi117 bash[95669]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-19T06:47:41.518 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:47:41 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5-activate[95685]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-19T06:47:41.518 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:47:41 smithi117 bash[95669]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-19T06:47:41.518 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:47:41 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5-activate[95685]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-19T06:47:41.518 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:47:41 smithi117 bash[95669]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-19T06:47:41.518 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:47:41 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5-activate[95685]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-19T06:47:41.519 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:47:41 smithi117 bash[95669]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-19T06:47:41.519 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:47:41 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5-activate[95685]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-19T06:47:41.519 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:47:41 smithi117 bash[95669]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-19T06:47:41.519 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:47:41 smithi117 podman[95669]: 2024-09-19 06:47:41.223053914 +0000 UTC m=+1.517922016 container died 070ad318c1ad1796f8158d4952d657e22dad2f4105c02a358d154a772f544419 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5-activate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-19T06:47:41.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:41.738+0000 7f4d1629f640 1 -- 172.21.15.99:0/3673979521 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d101014c0 msgr2=0x7f4d10101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:41.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:41.738+0000 7f4d1629f640 1 --2- 172.21.15.99:0/3673979521 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d101014c0 0x7f4d10101890 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4d000048d0 tx=0x7f4d00009da0 comp rx=0 tx=0).stop 2024-09-19T06:47:41.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:41.738+0000 7f4d1629f640 1 -- 172.21.15.99:0/3673979521 shutdown_connections 2024-09-19T06:47:41.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:41.738+0000 7f4d1629f640 1 --2- 172.21.15.99:0/3673979521 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d100fb480 0x7f4d100fb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:41.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:41.738+0000 7f4d1629f640 1 --2- 172.21.15.99:0/3673979521 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d101014c0 0x7f4d10101890 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:41.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:41.738+0000 7f4d1629f640 1 -- 172.21.15.99:0/3673979521 >> 172.21.15.99:0/3673979521 conn(0x7f4d100f7000 msgr2=0x7f4d100f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:41.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:41.738+0000 7f4d1629f640 1 -- 172.21.15.99:0/3673979521 shutdown_connections 2024-09-19T06:47:41.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:41.738+0000 7f4d1629f640 1 -- 172.21.15.99:0/3673979521 wait complete. 2024-09-19T06:47:41.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:41.739+0000 7f4d1629f640 1 Processor -- start 2024-09-19T06:47:41.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:41.739+0000 7f4d1629f640 1 -- start start 2024-09-19T06:47:41.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:41.739+0000 7f4d1629f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d100fb480 0x7f4d1010e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:41.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:41.739+0000 7f4d1629f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d101014c0 0x7f4d1010e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:41.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:41.739+0000 7f4d1629f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1010ec90 con 0x7f4d101014c0 2024-09-19T06:47:41.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:41.739+0000 7f4d1629f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1010ee00 con 0x7f4d100fb480 2024-09-19T06:47:41.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:41.739+0000 7f4d0f7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d101014c0 0x7f4d1010e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:41.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:41.739+0000 7f4d0f7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d101014c0 0x7f4d1010e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38248/0 (socket says 172.21.15.99:38248) 2024-09-19T06:47:41.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:41.739+0000 7f4d0f7fe640 1 -- 172.21.15.99:0/2832204314 learned_addr learned my addr 172.21.15.99:0/2832204314 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:47:41.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:41.739+0000 7f4d0ffff640 1 --2- 172.21.15.99:0/2832204314 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d100fb480 0x7f4d1010e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:41.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:41.740+0000 7f4d0f7fe640 1 -- 172.21.15.99:0/2832204314 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d100fb480 msgr2=0x7f4d1010e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:41.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:41.740+0000 7f4d0f7fe640 1 --2- 172.21.15.99:0/2832204314 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d100fb480 0x7f4d1010e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:41.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:41.740+0000 7f4d0f7fe640 1 -- 172.21.15.99:0/2832204314 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d00005040 con 0x7f4d101014c0 2024-09-19T06:47:41.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:41.740+0000 7f4d0ffff640 1 --2- 172.21.15.99:0/2832204314 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d100fb480 0x7f4d1010e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:47:41.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:41.740+0000 7f4d0f7fe640 1 --2- 172.21.15.99:0/2832204314 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d101014c0 0x7f4d1010e690 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4d0400c810 tx=0x7f4d040043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:41.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:41.740+0000 7f4d0cff9640 1 -- 172.21.15.99:0/2832204314 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d0400a820 con 0x7f4d101014c0 2024-09-19T06:47:41.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:41.740+0000 7f4d0cff9640 1 -- 172.21.15.99:0/2832204314 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4d0400ae20 con 0x7f4d101014c0 2024-09-19T06:47:41.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:41.740+0000 7f4d1629f640 1 -- 172.21.15.99:0/2832204314 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d101171c0 con 0x7f4d101014c0 2024-09-19T06:47:41.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:41.740+0000 7f4d0cff9640 1 -- 172.21.15.99:0/2832204314 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d040115c0 con 0x7f4d101014c0 2024-09-19T06:47:41.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:41.740+0000 7f4d1629f640 1 -- 172.21.15.99:0/2832204314 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d10117700 con 0x7f4d101014c0 2024-09-19T06:47:41.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:41.741+0000 7f4d1629f640 1 -- 172.21.15.99:0/2832204314 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d100fcbc0 con 0x7f4d101014c0 2024-09-19T06:47:41.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:41.742+0000 7f4d0cff9640 1 -- 172.21.15.99:0/2832204314 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f4d04012840 con 0x7f4d101014c0 2024-09-19T06:47:41.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:41.742+0000 7f4d0cff9640 1 --2- 172.21.15.99:0/2832204314 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f4cf806e530 0x7f4cf80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:41.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:41.742+0000 7f4d0cff9640 1 -- 172.21.15.99:0/2832204314 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f4d0408e6a0 con 0x7f4d101014c0 2024-09-19T06:47:41.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:41.742+0000 7f4d0ffff640 1 --2- 172.21.15.99:0/2832204314 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f4cf806e530 0x7f4cf80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:41.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:41.743+0000 7f4d0ffff640 1 --2- 172.21.15.99:0/2832204314 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f4cf806e530 0x7f4cf80709e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4d00007ac0 tx=0x7f4d00035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:41.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:41.747+0000 7f4d0cff9640 1 -- 172.21.15.99:0/2832204314 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f4d0405b360 con 0x7f4d101014c0 2024-09-19T06:47:41.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:41.930+0000 7f4d1629f640 1 -- 172.21.15.99:0/2832204314 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4d1004b720 con 0x7f4cf806e530 2024-09-19T06:47:41.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:41.932+0000 7f4d0cff9640 1 -- 172.21.15.99:0/2832204314 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f4d1004b720 con 0x7f4cf806e530 2024-09-19T06:47:41.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:41.934+0000 7f4d1629f640 1 -- 172.21.15.99:0/2832204314 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f4cf806e530 msgr2=0x7f4cf80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:41.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:41.934+0000 7f4d1629f640 1 --2- 172.21.15.99:0/2832204314 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f4cf806e530 0x7f4cf80709e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4d00007ac0 tx=0x7f4d00035040 comp rx=0 tx=0).stop 2024-09-19T06:47:41.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:41.934+0000 7f4d1629f640 1 -- 172.21.15.99:0/2832204314 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d101014c0 msgr2=0x7f4d1010e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:41.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:41.934+0000 7f4d1629f640 1 --2- 172.21.15.99:0/2832204314 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d101014c0 0x7f4d1010e690 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4d0400c810 tx=0x7f4d040043c0 comp rx=0 tx=0).stop 2024-09-19T06:47:41.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:41.934+0000 7f4d1629f640 1 -- 172.21.15.99:0/2832204314 shutdown_connections 2024-09-19T06:47:41.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:41.934+0000 7f4d1629f640 1 --2- 172.21.15.99:0/2832204314 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f4cf806e530 0x7f4cf80709e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:41.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:41.934+0000 7f4d1629f640 1 --2- 172.21.15.99:0/2832204314 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d101014c0 0x7f4d1010e690 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:41.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:41.934+0000 7f4d1629f640 1 --2- 172.21.15.99:0/2832204314 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4d100fb480 0x7f4d1010e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:41.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:41.934+0000 7f4d1629f640 1 -- 172.21.15.99:0/2832204314 >> 172.21.15.99:0/2832204314 conn(0x7f4d100f7000 msgr2=0x7f4d100f88b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:41.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:41.934+0000 7f4d1629f640 1 -- 172.21.15.99:0/2832204314 shutdown_connections 2024-09-19T06:47:41.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:41.934+0000 7f4d1629f640 1 -- 172.21.15.99:0/2832204314 wait complete. 2024-09-19T06:47:41.944 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-09-19T06:47:42.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.014+0000 7fdd3a127640 1 -- 172.21.15.99:0/3267362447 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdd34064fe0 msgr2=0x7fdd34065430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:42.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.014+0000 7fdd3a127640 1 --2- 172.21.15.99:0/3267362447 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdd34064fe0 0x7fdd34065430 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c0048d0 tx=0x7fdd1c009da0 comp rx=0 tx=0).stop 2024-09-19T06:47:42.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.014+0000 7fdd3a127640 1 -- 172.21.15.99:0/3267362447 shutdown_connections 2024-09-19T06:47:42.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.014+0000 7fdd3a127640 1 --2- 172.21.15.99:0/3267362447 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdd34064fe0 0x7fdd34065430 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:42.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.014+0000 7fdd3a127640 1 --2- 172.21.15.99:0/3267362447 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd340fe450 0x7fdd340fe820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:42.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.014+0000 7fdd3a127640 1 -- 172.21.15.99:0/3267362447 >> 172.21.15.99:0/3267362447 conn(0x7fdd340723b0 msgr2=0x7fdd340727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:42.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.014+0000 7fdd3a127640 1 -- 172.21.15.99:0/3267362447 shutdown_connections 2024-09-19T06:47:42.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.014+0000 7fdd3a127640 1 -- 172.21.15.99:0/3267362447 wait complete. 2024-09-19T06:47:42.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.014+0000 7fdd3a127640 1 Processor -- start 2024-09-19T06:47:42.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.014+0000 7fdd3a127640 1 -- start start 2024-09-19T06:47:42.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.014+0000 7fdd3a127640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdd34064fe0 0x7fdd341131b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:42.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.014+0000 7fdd3a127640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd340fe450 0x7fdd341136f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:42.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.014+0000 7fdd3a127640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd34113cf0 con 0x7fdd34064fe0 2024-09-19T06:47:42.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.014+0000 7fdd3a127640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd3410d130 con 0x7fdd340fe450 2024-09-19T06:47:42.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.015+0000 7fdd337fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdd34064fe0 0x7fdd341131b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:42.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.015+0000 7fdd337fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdd34064fe0 0x7fdd341131b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38274/0 (socket says 172.21.15.99:38274) 2024-09-19T06:47:42.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.015+0000 7fdd337fe640 1 -- 172.21.15.99:0/342109922 learned_addr learned my addr 172.21.15.99:0/342109922 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:47:42.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.015+0000 7fdd2bfff640 1 --2- 172.21.15.99:0/342109922 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd340fe450 0x7fdd341136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:42.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.015+0000 7fdd337fe640 1 -- 172.21.15.99:0/342109922 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd340fe450 msgr2=0x7fdd341136f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:42.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.015+0000 7fdd337fe640 1 --2- 172.21.15.99:0/342109922 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd340fe450 0x7fdd341136f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:42.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.015+0000 7fdd337fe640 1 -- 172.21.15.99:0/342109922 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd1c005040 con 0x7fdd34064fe0 2024-09-19T06:47:42.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.015+0000 7fdd337fe640 1 --2- 172.21.15.99:0/342109922 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdd34064fe0 0x7fdd341131b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fdd2400c830 tx=0x7fdd24004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:42.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.015+0000 7fdd30ff9640 1 -- 172.21.15.99:0/342109922 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd2400a7d0 con 0x7fdd34064fe0 2024-09-19T06:47:42.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.015+0000 7fdd30ff9640 1 -- 172.21.15.99:0/342109922 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fdd2400add0 con 0x7fdd34064fe0 2024-09-19T06:47:42.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.015+0000 7fdd30ff9640 1 -- 172.21.15.99:0/342109922 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd240113a0 con 0x7fdd34064fe0 2024-09-19T06:47:42.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.015+0000 7fdd3a127640 1 -- 172.21.15.99:0/342109922 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd3410d410 con 0x7fdd34064fe0 2024-09-19T06:47:42.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.015+0000 7fdd3a127640 1 -- 172.21.15.99:0/342109922 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd3410d980 con 0x7fdd34064fe0 2024-09-19T06:47:42.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.016+0000 7fdd3a127640 1 -- 172.21.15.99:0/342109922 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd340fdce0 con 0x7fdd34064fe0 2024-09-19T06:47:42.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.017+0000 7fdd30ff9640 1 -- 172.21.15.99:0/342109922 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fdd24012400 con 0x7fdd34064fe0 2024-09-19T06:47:42.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.017+0000 7fdd30ff9640 1 --2- 172.21.15.99:0/342109922 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fdd2006e530 0x7fdd200709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:42.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.017+0000 7fdd30ff9640 1 -- 172.21.15.99:0/342109922 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fdd2408e1d0 con 0x7fdd34064fe0 2024-09-19T06:47:42.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.017+0000 7fdd2bfff640 1 --2- 172.21.15.99:0/342109922 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fdd2006e530 0x7fdd200709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:42.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.018+0000 7fdd2bfff640 1 --2- 172.21.15.99:0/342109922 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fdd2006e530 0x7fdd200709e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdd34072d20 tx=0x7fdd1c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:42.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.022+0000 7fdd30ff9640 1 -- 172.21.15.99:0/342109922 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fdd24057480 con 0x7fdd34064fe0 2024-09-19T06:47:42.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:41 smithi117 ceph-mon[76771]: pgmap v152: 65 pgs: 10 active+undersized, 3 stale+active+clean, 8 active+undersized+degraded, 44 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 20/321 objects degraded (6.231%) 2024-09-19T06:47:42.062 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:47:41 smithi117 podman[95820]: 2024-09-19 06:47:41.80090119 +0000 UTC m=+0.567008878 container remove 070ad318c1ad1796f8158d4952d657e22dad2f4105c02a358d154a772f544419 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5-activate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731) 2024-09-19T06:47:42.062 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:47:42 smithi117 podman[95879]: 2024-09-19 06:47:41.907935503 +0000 UTC m=+0.015926882 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T06:47:42.062 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:47:42 smithi117 podman[95879]: 2024-09-19 06:47:42.027071014 +0000 UTC m=+0.135062387 container create de6aeb8544ce3ac3d6d374382463f0c7c9778cbd81b9c5c38917185b17cc736c (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-19T06:47:42.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.202+0000 7fdd3a127640 1 -- 172.21.15.99:0/342109922 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdd3404b720 con 0x7fdd2006e530 2024-09-19T06:47:42.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.203+0000 7fdd30ff9640 1 -- 172.21.15.99:0/342109922 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fdd3404b720 con 0x7fdd2006e530 2024-09-19T06:47:42.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.205+0000 7fdd3a127640 1 -- 172.21.15.99:0/342109922 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fdd2006e530 msgr2=0x7fdd200709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:42.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.205+0000 7fdd3a127640 1 --2- 172.21.15.99:0/342109922 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fdd2006e530 0x7fdd200709e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdd34072d20 tx=0x7fdd1c035040 comp rx=0 tx=0).stop 2024-09-19T06:47:42.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.205+0000 7fdd3a127640 1 -- 172.21.15.99:0/342109922 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdd34064fe0 msgr2=0x7fdd341131b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:42.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.205+0000 7fdd3a127640 1 --2- 172.21.15.99:0/342109922 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdd34064fe0 0x7fdd341131b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fdd2400c830 tx=0x7fdd24004430 comp rx=0 tx=0).stop 2024-09-19T06:47:42.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.205+0000 7fdd3a127640 1 -- 172.21.15.99:0/342109922 shutdown_connections 2024-09-19T06:47:42.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.205+0000 7fdd3a127640 1 --2- 172.21.15.99:0/342109922 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fdd2006e530 0x7fdd200709e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:42.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.205+0000 7fdd3a127640 1 --2- 172.21.15.99:0/342109922 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdd340fe450 0x7fdd341136f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:42.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.205+0000 7fdd3a127640 1 --2- 172.21.15.99:0/342109922 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdd34064fe0 0x7fdd341131b0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:42.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.205+0000 7fdd3a127640 1 -- 172.21.15.99:0/342109922 >> 172.21.15.99:0/342109922 conn(0x7fdd340723b0 msgr2=0x7fdd34105390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:42.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.205+0000 7fdd3a127640 1 -- 172.21.15.99:0/342109922 shutdown_connections 2024-09-19T06:47:42.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.205+0000 7fdd3a127640 1 -- 172.21.15.99:0/342109922 wait complete. 2024-09-19T06:47:42.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.283+0000 7f2ce2c2a640 1 -- 172.21.15.99:0/3102492844 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cdc0fb810 msgr2=0x7f2cdc0fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:42.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.283+0000 7f2ce2c2a640 1 --2- 172.21.15.99:0/3102492844 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cdc0fb810 0x7f2cdc0fbbe0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2cd00048d0 tx=0x7f2cd0009da0 comp rx=0 tx=0).stop 2024-09-19T06:47:42.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.284+0000 7f2ce2c2a640 1 -- 172.21.15.99:0/3102492844 shutdown_connections 2024-09-19T06:47:42.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.284+0000 7f2ce2c2a640 1 --2- 172.21.15.99:0/3102492844 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2cdc0fcf80 0x7f2cdc0fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:42.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.284+0000 7f2ce2c2a640 1 --2- 172.21.15.99:0/3102492844 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cdc0fb810 0x7f2cdc0fbbe0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:42.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.284+0000 7f2ce2c2a640 1 -- 172.21.15.99:0/3102492844 >> 172.21.15.99:0/3102492844 conn(0x7f2cdc0723b0 msgr2=0x7f2cdc0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:42.286 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:41 smithi099 ceph-mon[97031]: pgmap v152: 65 pgs: 10 active+undersized, 3 stale+active+clean, 8 active+undersized+degraded, 44 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 20/321 objects degraded (6.231%) 2024-09-19T06:47:42.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.284+0000 7f2ce2c2a640 1 -- 172.21.15.99:0/3102492844 shutdown_connections 2024-09-19T06:47:42.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.284+0000 7f2ce2c2a640 1 -- 172.21.15.99:0/3102492844 wait complete. 2024-09-19T06:47:42.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.284+0000 7f2ce2c2a640 1 Processor -- start 2024-09-19T06:47:42.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.284+0000 7f2ce2c2a640 1 -- start start 2024-09-19T06:47:42.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.285+0000 7f2ce2c2a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2cdc0fb810 0x7f2cdc10e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:42.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.285+0000 7f2ce2c2a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cdc0fcf80 0x7f2cdc10e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:42.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.285+0000 7f2ce2c2a640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cdc10ed70 con 0x7f2cdc0fcf80 2024-09-19T06:47:42.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.285+0000 7f2ce2c2a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cdc10eee0 con 0x7f2cdc0fb810 2024-09-19T06:47:42.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.285+0000 7f2cdbfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cdc0fcf80 0x7f2cdc10e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:42.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.285+0000 7f2cdbfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cdc0fcf80 0x7f2cdc10e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38302/0 (socket says 172.21.15.99:38302) 2024-09-19T06:47:42.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.285+0000 7f2cdbfff640 1 -- 172.21.15.99:0/2427006055 learned_addr learned my addr 172.21.15.99:0/2427006055 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:47:42.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.285+0000 7f2ce09c6640 1 --2- 172.21.15.99:0/2427006055 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2cdc0fb810 0x7f2cdc10e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:42.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.285+0000 7f2cdbfff640 1 -- 172.21.15.99:0/2427006055 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2cdc0fb810 msgr2=0x7f2cdc10e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:42.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.285+0000 7f2cdbfff640 1 --2- 172.21.15.99:0/2427006055 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2cdc0fb810 0x7f2cdc10e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:42.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.285+0000 7f2cdbfff640 1 -- 172.21.15.99:0/2427006055 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cd0005040 con 0x7f2cdc0fcf80 2024-09-19T06:47:42.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.285+0000 7f2ce09c6640 1 --2- 172.21.15.99:0/2427006055 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2cdc0fb810 0x7f2cdc10e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:47:42.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.285+0000 7f2cdbfff640 1 --2- 172.21.15.99:0/2427006055 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cdc0fcf80 0x7f2cdc10e830 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8010e80 tx=0x7f2cc800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:42.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.286+0000 7f2cd97fa640 1 -- 172.21.15.99:0/2427006055 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2cc8015070 con 0x7f2cdc0fcf80 2024-09-19T06:47:42.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.286+0000 7f2cd97fa640 1 -- 172.21.15.99:0/2427006055 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2cc8004e50 con 0x7f2cdc0fcf80 2024-09-19T06:47:42.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.286+0000 7f2ce2c2a640 1 -- 172.21.15.99:0/2427006055 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cdc10bf40 con 0x7f2cdc0fcf80 2024-09-19T06:47:42.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.286+0000 7f2cd97fa640 1 -- 172.21.15.99:0/2427006055 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2cc801b470 con 0x7f2cdc0fcf80 2024-09-19T06:47:42.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.286+0000 7f2ce2c2a640 1 -- 172.21.15.99:0/2427006055 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cdc10c490 con 0x7f2cdc0fcf80 2024-09-19T06:47:42.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.287+0000 7f2ce2c2a640 1 -- 172.21.15.99:0/2427006055 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cdc0fcbc0 con 0x7f2cdc0fcf80 2024-09-19T06:47:42.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.288+0000 7f2cd97fa640 1 -- 172.21.15.99:0/2427006055 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f2cc8007a20 con 0x7f2cdc0fcf80 2024-09-19T06:47:42.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.288+0000 7f2cd97fa640 1 --2- 172.21.15.99:0/2427006055 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f2ccc06e530 0x7f2ccc0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:42.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.288+0000 7f2cd97fa640 1 -- 172.21.15.99:0/2427006055 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f2cc8092a10 con 0x7f2cdc0fcf80 2024-09-19T06:47:42.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.288+0000 7f2ce09c6640 1 --2- 172.21.15.99:0/2427006055 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f2ccc06e530 0x7f2ccc0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:42.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.289+0000 7f2ce09c6640 1 --2- 172.21.15.99:0/2427006055 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f2ccc06e530 0x7f2ccc0709e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2cd0007ac0 tx=0x7f2cd0035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:42.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.293+0000 7f2cd97fa640 1 -- 172.21.15.99:0/2427006055 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f2cc805bc20 con 0x7f2cdc0fcf80 2024-09-19T06:47:42.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.469+0000 7f2ce2c2a640 1 -- 172.21.15.99:0/2427006055 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2cdc065800 con 0x7f2ccc06e530 2024-09-19T06:47:42.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.478+0000 7f2cd97fa640 1 -- 172.21.15.99:0/2427006055 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f2cdc065800 con 0x7f2ccc06e530 2024-09-19T06:47:42.480 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T06:47:42.480 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.smithi099 smithi099 *:9093,9094 running (6m) 94s ago 15m 23.4M - 0.25.0 c8568f914cd2 e7c1774d56b0 2024-09-19T06:47:42.480 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi099 smithi099 running (3m) 94s ago 15m 6899k - 19.1.1-361-g2f599a46 d2baa855c067 b9775f416b10 2024-09-19T06:47:42.480 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi117 smithi117 running (3m) 30s ago 14m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 38cf60c0d548 2024-09-19T06:47:42.480 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.smithi099 smithi099 *:3000 running (5m) 94s ago 14m 80.4M - 9.4.12 2bacad6d85d8 cd53a18d5410 2024-09-19T06:47:42.480 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.obarqf smithi099 running (9m) 94s ago 9m 14.2M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 e36c9b74004b 2024-09-19T06:47:42.480 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.xehbxe smithi099 running (9m) 94s ago 9m 121M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 d09eb3d306ae 2024-09-19T06:47:42.480 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.bheqzh smithi117 running (9m) 30s ago 9m 16.0M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 21253e27fdd3 2024-09-19T06:47:42.481 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.nooexo smithi117 running (9m) 30s ago 9m 109M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 ad1faeb3343c 2024-09-19T06:47:42.481 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi099.pgvkqi smithi099 *:8443,9283,8765 running (6m) 94s ago 16m 500M - 19.1.1-361-g2f599a46 d2baa855c067 d5de99cb7e78 2024-09-19T06:47:42.481 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi117.ssmkcf smithi117 *:8443,9283,8765 running (5m) 30s ago 14m 444M - 19.1.1-361-g2f599a46 d2baa855c067 8b7ee0f871f5 2024-09-19T06:47:42.481 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi099 smithi099 running (4m) 94s ago 16m 48.7M 2048M 19.1.1-361-g2f599a46 d2baa855c067 ffe067438824 2024-09-19T06:47:42.481 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi117 smithi117 running (3m) 30s ago 14m 38.7M 2048M 19.1.1-361-g2f599a46 d2baa855c067 4cb7455e3ee7 2024-09-19T06:47:42.481 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi099 smithi099 *:9100 running (6m) 94s ago 15m 15.6M - 1.5.0 0da6a335fe13 dca7b4517dcc 2024-09-19T06:47:42.481 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi117 smithi117 *:9100 running (6m) 30s ago 14m 15.7M - 1.5.0 0da6a335fe13 8233ce3835d2 2024-09-19T06:47:42.481 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (2m) 94s ago 13m 96.9M 1557M 19.1.1-361-g2f599a46 d2baa855c067 8e22543bf933 2024-09-19T06:47:42.481 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (2m) 94s ago 13m 103M 1557M 19.1.1-361-g2f599a46 d2baa855c067 f54153d0ae09 2024-09-19T06:47:42.481 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (100s) 94s ago 12m 11.2M 1557M 19.1.1-361-g2f599a46 d2baa855c067 b1778ab88870 2024-09-19T06:47:42.481 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi117 running (65s) 30s ago 12m 99.3M 2581M 19.1.1-361-g2f599a46 d2baa855c067 ea5236b193d3 2024-09-19T06:47:42.481 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi117 running (33s) 30s ago 11m 11.7M 2581M 19.1.1-361-g2f599a46 d2baa855c067 27ac2c859a68 2024-09-19T06:47:42.481 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi117 starting - - - 2581M 2024-09-19T06:47:42.482 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.smithi099 smithi099 *:9095 running (5m) 94s ago 14m 63.1M - 2.43.0 a07b618ecd1d 15ad26ec6fb4 2024-09-19T06:47:42.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.480+0000 7f2ce2c2a640 1 -- 172.21.15.99:0/2427006055 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f2ccc06e530 msgr2=0x7f2ccc0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:42.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.480+0000 7f2ce2c2a640 1 --2- 172.21.15.99:0/2427006055 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f2ccc06e530 0x7f2ccc0709e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2cd0007ac0 tx=0x7f2cd0035040 comp rx=0 tx=0).stop 2024-09-19T06:47:42.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.480+0000 7f2ce2c2a640 1 -- 172.21.15.99:0/2427006055 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cdc0fcf80 msgr2=0x7f2cdc10e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:42.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.480+0000 7f2ce2c2a640 1 --2- 172.21.15.99:0/2427006055 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cdc0fcf80 0x7f2cdc10e830 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8010e80 tx=0x7f2cc800b040 comp rx=0 tx=0).stop 2024-09-19T06:47:42.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.480+0000 7f2ce2c2a640 1 -- 172.21.15.99:0/2427006055 shutdown_connections 2024-09-19T06:47:42.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.480+0000 7f2ce2c2a640 1 --2- 172.21.15.99:0/2427006055 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f2ccc06e530 0x7f2ccc0709e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:42.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.480+0000 7f2ce2c2a640 1 --2- 172.21.15.99:0/2427006055 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2cdc0fcf80 0x7f2cdc10e830 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:42.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.480+0000 7f2ce2c2a640 1 --2- 172.21.15.99:0/2427006055 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2cdc0fb810 0x7f2cdc10e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:42.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.480+0000 7f2ce2c2a640 1 -- 172.21.15.99:0/2427006055 >> 172.21.15.99:0/2427006055 conn(0x7f2cdc0723b0 msgr2=0x7f2cdc0fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:42.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.480+0000 7f2ce2c2a640 1 -- 172.21.15.99:0/2427006055 shutdown_connections 2024-09-19T06:47:42.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.480+0000 7f2ce2c2a640 1 -- 172.21.15.99:0/2427006055 wait complete. 2024-09-19T06:47:42.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.557+0000 7f8bbded1640 1 -- 172.21.15.99:0/70387024 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8bb80fb4a0 msgr2=0x7f8bb80fb910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:42.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.557+0000 7f8bbded1640 1 --2- 172.21.15.99:0/70387024 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8bb80fb4a0 0x7f8bb80fb910 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8bac0048d0 tx=0x7f8bac009da0 comp rx=0 tx=0).stop 2024-09-19T06:47:42.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.557+0000 7f8bbded1640 1 -- 172.21.15.99:0/70387024 shutdown_connections 2024-09-19T06:47:42.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.557+0000 7f8bbded1640 1 --2- 172.21.15.99:0/70387024 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8bb80fb4a0 0x7f8bb80fb910 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:42.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.557+0000 7f8bbded1640 1 --2- 172.21.15.99:0/70387024 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8bb81014e0 0x7f8bb81018b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:42.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.557+0000 7f8bbded1640 1 -- 172.21.15.99:0/70387024 >> 172.21.15.99:0/70387024 conn(0x7f8bb80f7060 msgr2=0x7f8bb80f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:42.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.557+0000 7f8bbded1640 1 -- 172.21.15.99:0/70387024 shutdown_connections 2024-09-19T06:47:42.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.557+0000 7f8bbded1640 1 -- 172.21.15.99:0/70387024 wait complete. 2024-09-19T06:47:42.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.558+0000 7f8bbded1640 1 Processor -- start 2024-09-19T06:47:42.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.558+0000 7f8bbded1640 1 -- start start 2024-09-19T06:47:42.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.558+0000 7f8bbded1640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8bb80fb4a0 0x7f8bb810e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:42.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.558+0000 7f8bbded1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8bb81014e0 0x7f8bb810e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:42.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.558+0000 7f8bbded1640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb810ed00 con 0x7f8bb80fb4a0 2024-09-19T06:47:42.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.558+0000 7f8bbded1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb810ee70 con 0x7f8bb81014e0 2024-09-19T06:47:42.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.558+0000 7f8bb77fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8bb80fb4a0 0x7f8bb810e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:42.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.558+0000 7f8bb77fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8bb80fb4a0 0x7f8bb810e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38324/0 (socket says 172.21.15.99:38324) 2024-09-19T06:47:42.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.558+0000 7f8bb77fe640 1 -- 172.21.15.99:0/2940753430 learned_addr learned my addr 172.21.15.99:0/2940753430 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:47:42.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.558+0000 7f8bb6ffd640 1 --2- 172.21.15.99:0/2940753430 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8bb81014e0 0x7f8bb810e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:42.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.559+0000 7f8bb77fe640 1 -- 172.21.15.99:0/2940753430 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8bb81014e0 msgr2=0x7f8bb810e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:42.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.559+0000 7f8bb77fe640 1 --2- 172.21.15.99:0/2940753430 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8bb81014e0 0x7f8bb810e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:42.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.559+0000 7f8bb77fe640 1 -- 172.21.15.99:0/2940753430 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bac005040 con 0x7f8bb80fb4a0 2024-09-19T06:47:42.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.559+0000 7f8bb77fe640 1 --2- 172.21.15.99:0/2940753430 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8bb80fb4a0 0x7f8bb810e170 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8ba8002a50 tx=0x7f8ba8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:42.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.559+0000 7f8b9ffff640 1 -- 172.21.15.99:0/2940753430 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ba8007c30 con 0x7f8bb80fb4a0 2024-09-19T06:47:42.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.559+0000 7f8bbded1640 1 -- 172.21.15.99:0/2940753430 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bb81171e0 con 0x7f8bb80fb4a0 2024-09-19T06:47:42.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.559+0000 7f8b9ffff640 1 -- 172.21.15.99:0/2940753430 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8ba800f040 con 0x7f8bb80fb4a0 2024-09-19T06:47:42.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.560+0000 7f8b9ffff640 1 -- 172.21.15.99:0/2940753430 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ba800dad0 con 0x7f8bb80fb4a0 2024-09-19T06:47:42.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.560+0000 7f8bbded1640 1 -- 172.21.15.99:0/2940753430 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bb81176f0 con 0x7f8bb80fb4a0 2024-09-19T06:47:42.562 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:47:42 smithi117 podman[95879]: 2024-09-19 06:47:42.245959936 +0000 UTC m=+0.353951306 container init de6aeb8544ce3ac3d6d374382463f0c7c9778cbd81b9c5c38917185b17cc736c (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD) 2024-09-19T06:47:42.563 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:47:42 smithi117 podman[95879]: 2024-09-19 06:47:42.249344696 +0000 UTC m=+0.357336061 container start de6aeb8544ce3ac3d6d374382463f0c7c9778cbd81b9c5c38917185b17cc736c (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-19T06:47:42.563 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:47:42 smithi117 ceph-osd[95898]: -- 172.21.15.117:0/3373990095 <== mon.1 v2:172.21.15.117:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5590735081e0 con 0x55907349a000 2024-09-19T06:47:42.563 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:47:42 smithi117 bash[95879]: de6aeb8544ce3ac3d6d374382463f0c7c9778cbd81b9c5c38917185b17cc736c 2024-09-19T06:47:42.563 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:47:42 smithi117 systemd[1]: Started Ceph osd.5 for a73eb958-7650-11ef-bceb-c7b262605968. 2024-09-19T06:47:42.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.561+0000 7f8bbded1640 1 -- 172.21.15.99:0/2940753430 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bb80fcbe0 con 0x7f8bb80fb4a0 2024-09-19T06:47:42.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.561+0000 7f8b9ffff640 1 -- 172.21.15.99:0/2940753430 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f8ba800dc30 con 0x7f8bb80fb4a0 2024-09-19T06:47:42.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.561+0000 7f8b9ffff640 1 --2- 172.21.15.99:0/2940753430 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f8ba006e530 0x7f8ba00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:42.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.562+0000 7f8b9ffff640 1 -- 172.21.15.99:0/2940753430 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f8ba808dc50 con 0x7f8bb80fb4a0 2024-09-19T06:47:42.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.562+0000 7f8bb6ffd640 1 --2- 172.21.15.99:0/2940753430 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f8ba006e530 0x7f8ba00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:42.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.562+0000 7f8bb6ffd640 1 --2- 172.21.15.99:0/2940753430 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f8ba006e530 0x7f8ba00709e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8bac009ac0 tx=0x7f8bac035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:42.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.566+0000 7f8b9ffff640 1 -- 172.21.15.99:0/2940753430 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f8ba8056de0 con 0x7f8bb80fb4a0 2024-09-19T06:47:42.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.798+0000 7f8bbded1640 1 -- 172.21.15.99:0/2940753430 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8bb8066220 con 0x7f8bb80fb4a0 2024-09-19T06:47:42.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.798+0000 7f8b9ffff640 1 -- 172.21.15.99:0/2940753430 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+742 (secure 0 0 0) 0x7f8ba805a4a0 con 0x7f8bb80fb4a0 2024-09-19T06:47:42.799 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:47:42.800 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-09-19T06:47:42.800 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T06:47:42.800 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:47:42.800 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-09-19T06:47:42.800 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T06:47:42.800 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:47:42.800 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-09-19T06:47:42.800 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 5 2024-09-19T06:47:42.800 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:47:42.800 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": { 2024-09-19T06:47:42.800 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 4 2024-09-19T06:47:42.800 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:47:42.800 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-09-19T06:47:42.800 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 4, 2024-09-19T06:47:42.801 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 9 2024-09-19T06:47:42.801 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T06:47:42.801 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:47:42.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.800+0000 7f8bbded1640 1 -- 172.21.15.99:0/2940753430 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f8ba006e530 msgr2=0x7f8ba00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:42.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.800+0000 7f8bbded1640 1 --2- 172.21.15.99:0/2940753430 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f8ba006e530 0x7f8ba00709e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8bac009ac0 tx=0x7f8bac035040 comp rx=0 tx=0).stop 2024-09-19T06:47:42.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.800+0000 7f8bbded1640 1 -- 172.21.15.99:0/2940753430 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8bb80fb4a0 msgr2=0x7f8bb810e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:42.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.800+0000 7f8bbded1640 1 --2- 172.21.15.99:0/2940753430 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8bb80fb4a0 0x7f8bb810e170 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8ba8002a50 tx=0x7f8ba8004600 comp rx=0 tx=0).stop 2024-09-19T06:47:42.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.800+0000 7f8bbded1640 1 -- 172.21.15.99:0/2940753430 shutdown_connections 2024-09-19T06:47:42.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.800+0000 7f8bbded1640 1 --2- 172.21.15.99:0/2940753430 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f8ba006e530 0x7f8ba00709e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:42.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.800+0000 7f8bbded1640 1 --2- 172.21.15.99:0/2940753430 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8bb81014e0 0x7f8bb810e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:42.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.800+0000 7f8bbded1640 1 --2- 172.21.15.99:0/2940753430 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8bb80fb4a0 0x7f8bb810e170 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:42.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.800+0000 7f8bbded1640 1 -- 172.21.15.99:0/2940753430 >> 172.21.15.99:0/2940753430 conn(0x7f8bb80f7060 msgr2=0x7f8bb80f8910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:42.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.800+0000 7f8bbded1640 1 -- 172.21.15.99:0/2940753430 shutdown_connections 2024-09-19T06:47:42.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.800+0000 7f8bbded1640 1 -- 172.21.15.99:0/2940753430 wait complete. 2024-09-19T06:47:42.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.879+0000 7f0434ebb640 1 -- 172.21.15.99:0/796385359 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f04300fe460 msgr2=0x7f04300fe830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:42.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.879+0000 7f0434ebb640 1 --2- 172.21.15.99:0/796385359 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f04300fe460 0x7f04300fe830 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0420009c50 tx=0x7f0420004d10 comp rx=0 tx=0).stop 2024-09-19T06:47:42.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.879+0000 7f0434ebb640 1 -- 172.21.15.99:0/796385359 shutdown_connections 2024-09-19T06:47:42.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.879+0000 7f0434ebb640 1 --2- 172.21.15.99:0/796385359 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0430064fc0 0x7f0430065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:42.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.879+0000 7f0434ebb640 1 --2- 172.21.15.99:0/796385359 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f04300fe460 0x7f04300fe830 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:42.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.879+0000 7f0434ebb640 1 -- 172.21.15.99:0/796385359 >> 172.21.15.99:0/796385359 conn(0x7f04300723b0 msgr2=0x7f04300727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:42.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.879+0000 7f0434ebb640 1 -- 172.21.15.99:0/796385359 shutdown_connections 2024-09-19T06:47:42.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.879+0000 7f0434ebb640 1 -- 172.21.15.99:0/796385359 wait complete. 2024-09-19T06:47:42.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.879+0000 7f0434ebb640 1 Processor -- start 2024-09-19T06:47:42.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.879+0000 7f0434ebb640 1 -- start start 2024-09-19T06:47:42.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.880+0000 7f0434ebb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0430064fc0 0x7f0430113190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:42.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.880+0000 7f0434ebb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04300fe460 0x7f04301136d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:42.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.880+0000 7f0434ebb640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0430113cd0 con 0x7f0430064fc0 2024-09-19T06:47:42.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.880+0000 7f0434ebb640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f043010d110 con 0x7f04300fe460 2024-09-19T06:47:42.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.880+0000 7f042e59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0430064fc0 0x7f0430113190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:42.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.880+0000 7f042e59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0430064fc0 0x7f0430113190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38348/0 (socket says 172.21.15.99:38348) 2024-09-19T06:47:42.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.880+0000 7f042e59c640 1 -- 172.21.15.99:0/2721702656 learned_addr learned my addr 172.21.15.99:0/2721702656 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:47:42.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.880+0000 7f042dd9b640 1 --2- 172.21.15.99:0/2721702656 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04300fe460 0x7f04301136d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:42.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.880+0000 7f042e59c640 1 -- 172.21.15.99:0/2721702656 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04300fe460 msgr2=0x7f04301136d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:42.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.880+0000 7f042e59c640 1 --2- 172.21.15.99:0/2721702656 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04300fe460 0x7f04301136d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:42.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.880+0000 7f042e59c640 1 -- 172.21.15.99:0/2721702656 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04200098b0 con 0x7f0430064fc0 2024-09-19T06:47:42.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.880+0000 7f042e59c640 1 --2- 172.21.15.99:0/2721702656 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0430064fc0 0x7f0430113190 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0420004a30 tx=0x7f0420004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:42.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.881+0000 7f041effd640 1 -- 172.21.15.99:0/2721702656 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0420009690 con 0x7f0430064fc0 2024-09-19T06:47:42.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.881+0000 7f041effd640 1 -- 172.21.15.99:0/2721702656 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0420032b10 con 0x7f0430064fc0 2024-09-19T06:47:42.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.881+0000 7f0434ebb640 1 -- 172.21.15.99:0/2721702656 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f043010d390 con 0x7f0430064fc0 2024-09-19T06:47:42.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.881+0000 7f041effd640 1 -- 172.21.15.99:0/2721702656 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f042003daa0 con 0x7f0430064fc0 2024-09-19T06:47:42.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.881+0000 7f0434ebb640 1 -- 172.21.15.99:0/2721702656 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f043010d930 con 0x7f0430064fc0 2024-09-19T06:47:42.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.882+0000 7f0434ebb640 1 -- 172.21.15.99:0/2721702656 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04300fdcf0 con 0x7f0430064fc0 2024-09-19T06:47:42.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.882+0000 7f041effd640 1 -- 172.21.15.99:0/2721702656 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f042002f030 con 0x7f0430064fc0 2024-09-19T06:47:42.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.883+0000 7f041effd640 1 --2- 172.21.15.99:0/2721702656 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f041806e530 0x7f04180709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:42.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.883+0000 7f041effd640 1 -- 172.21.15.99:0/2721702656 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f04200af490 con 0x7f0430064fc0 2024-09-19T06:47:42.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.883+0000 7f042dd9b640 1 --2- 172.21.15.99:0/2721702656 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f041806e530 0x7f04180709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:42.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.883+0000 7f042dd9b640 1 --2- 172.21.15.99:0/2721702656 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f041806e530 0x7f04180709e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f043010ea50 tx=0x7f0424009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:42.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:42.887+0000 7f041effd640 1 -- 172.21.15.99:0/2721702656 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f0420078620 con 0x7f0430064fc0 2024-09-19T06:47:43.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.089+0000 7f0434ebb640 1 -- 172.21.15.99:0/2721702656 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f043004b720 con 0x7f0430064fc0 2024-09-19T06:47:43.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.089+0000 7f041effd640 1 -- 172.21.15.99:0/2721702656 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1941 (secure 0 0 0) 0x7f042007bce0 con 0x7f0430064fc0 2024-09-19T06:47:43.091 INFO:teuthology.orchestra.run.smithi099.stdout:e19 2024-09-19T06:47:43.091 INFO:teuthology.orchestra.run.smithi099.stdout:btime 2024-09-19T06:44:03:270764+0000 2024-09-19T06:47:43.091 INFO:teuthology.orchestra.run.smithi099.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T06:47:43.091 INFO:teuthology.orchestra.run.smithi099.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T06:47:43.091 INFO:teuthology.orchestra.run.smithi099.stdout:legacy client fscid: 1 2024-09-19T06:47:43.091 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:47:43.091 INFO:teuthology.orchestra.run.smithi099.stdout:Filesystem 'cephfs' (1) 2024-09-19T06:47:43.091 INFO:teuthology.orchestra.run.smithi099.stdout:fs_name cephfs 2024-09-19T06:47:43.091 INFO:teuthology.orchestra.run.smithi099.stdout:epoch 19 2024-09-19T06:47:43.091 INFO:teuthology.orchestra.run.smithi099.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-19T06:47:43.092 INFO:teuthology.orchestra.run.smithi099.stdout:created 2024-09-19T06:37:40.838146+0000 2024-09-19T06:47:43.092 INFO:teuthology.orchestra.run.smithi099.stdout:modified 2024-09-19T06:44:02.356718+0000 2024-09-19T06:47:43.092 INFO:teuthology.orchestra.run.smithi099.stdout:tableserver 0 2024-09-19T06:47:43.092 INFO:teuthology.orchestra.run.smithi099.stdout:root 0 2024-09-19T06:47:43.092 INFO:teuthology.orchestra.run.smithi099.stdout:session_timeout 60 2024-09-19T06:47:43.092 INFO:teuthology.orchestra.run.smithi099.stdout:session_autoclose 300 2024-09-19T06:47:43.092 INFO:teuthology.orchestra.run.smithi099.stdout:max_file_size 1099511627776 2024-09-19T06:47:43.092 INFO:teuthology.orchestra.run.smithi099.stdout:max_xattr_size 65536 2024-09-19T06:47:43.092 INFO:teuthology.orchestra.run.smithi099.stdout:required_client_features {} 2024-09-19T06:47:43.092 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure 0 2024-09-19T06:47:43.092 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure_osd_epoch 45 2024-09-19T06:47:43.092 INFO:teuthology.orchestra.run.smithi099.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T06:47:43.093 INFO:teuthology.orchestra.run.smithi099.stdout:max_mds 2 2024-09-19T06:47:43.093 INFO:teuthology.orchestra.run.smithi099.stdout:in 0,1 2024-09-19T06:47:43.093 INFO:teuthology.orchestra.run.smithi099.stdout:up {0=14482,1=24269} 2024-09-19T06:47:43.093 INFO:teuthology.orchestra.run.smithi099.stdout:failed 2024-09-19T06:47:43.093 INFO:teuthology.orchestra.run.smithi099.stdout:damaged 2024-09-19T06:47:43.093 INFO:teuthology.orchestra.run.smithi099.stdout:stopped 2024-09-19T06:47:43.093 INFO:teuthology.orchestra.run.smithi099.stdout:data_pools [3] 2024-09-19T06:47:43.093 INFO:teuthology.orchestra.run.smithi099.stdout:metadata_pool 2 2024-09-19T06:47:43.093 INFO:teuthology.orchestra.run.smithi099.stdout:inline_data disabled 2024-09-19T06:47:43.093 INFO:teuthology.orchestra.run.smithi099.stdout:balancer 2024-09-19T06:47:43.093 INFO:teuthology.orchestra.run.smithi099.stdout:bal_rank_mask -1 2024-09-19T06:47:43.093 INFO:teuthology.orchestra.run.smithi099.stdout:standby_count_wanted 1 2024-09-19T06:47:43.093 INFO:teuthology.orchestra.run.smithi099.stdout:qdb_cluster leader: 14482 members: 24269,14482 2024-09-19T06:47:43.094 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.xehbxe{0:14482} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.99:6828/1508711176,v1:172.21.15.99:6829/1508711176] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T06:47:43.094 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.nooexo{1:24269} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.117:6824/2367330767,v1:172.21.15.117:6825/2367330767] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T06:47:43.094 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:47:43.094 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:47:43.094 INFO:teuthology.orchestra.run.smithi099.stdout:Standby daemons: 2024-09-19T06:47:43.094 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:47:43.094 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.obarqf{-1:14490} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6826/388324528,v1:172.21.15.99:6827/388324528] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T06:47:43.094 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.bheqzh{-1:24283} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.117:6826/4072877365,v1:172.21.15.117:6827/4072877365] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T06:47:43.095 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 19 2024-09-19T06:47:43.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.091+0000 7f0434ebb640 1 -- 172.21.15.99:0/2721702656 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f041806e530 msgr2=0x7f04180709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:43.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.091+0000 7f0434ebb640 1 --2- 172.21.15.99:0/2721702656 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f041806e530 0x7f04180709e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f043010ea50 tx=0x7f0424009040 comp rx=0 tx=0).stop 2024-09-19T06:47:43.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.091+0000 7f0434ebb640 1 -- 172.21.15.99:0/2721702656 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0430064fc0 msgr2=0x7f0430113190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:43.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.091+0000 7f0434ebb640 1 --2- 172.21.15.99:0/2721702656 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0430064fc0 0x7f0430113190 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0420004a30 tx=0x7f0420004d10 comp rx=0 tx=0).stop 2024-09-19T06:47:43.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.091+0000 7f0434ebb640 1 -- 172.21.15.99:0/2721702656 shutdown_connections 2024-09-19T06:47:43.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.091+0000 7f0434ebb640 1 --2- 172.21.15.99:0/2721702656 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f041806e530 0x7f04180709e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:43.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.091+0000 7f0434ebb640 1 --2- 172.21.15.99:0/2721702656 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f04300fe460 0x7f04301136d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:43.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.091+0000 7f0434ebb640 1 --2- 172.21.15.99:0/2721702656 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0430064fc0 0x7f0430113190 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:43.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.091+0000 7f0434ebb640 1 -- 172.21.15.99:0/2721702656 >> 172.21.15.99:0/2721702656 conn(0x7f04300723b0 msgr2=0x7f0430105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:43.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.091+0000 7f0434ebb640 1 -- 172.21.15.99:0/2721702656 shutdown_connections 2024-09-19T06:47:43.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.091+0000 7f0434ebb640 1 -- 172.21.15.99:0/2721702656 wait complete. 2024-09-19T06:47:43.149 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:42 smithi099 ceph-mon[97031]: from='client.34340 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:47:43.149 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:42 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:47:43.149 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:42 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:47:43.149 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:42 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:47:43.149 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:42 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/2940753430' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:47:43.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.171+0000 7f2801089640 1 -- 172.21.15.99:0/4253498336 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f27fc0658f0 msgr2=0x7f27fc108b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:43.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.171+0000 7f2801089640 1 --2- 172.21.15.99:0/4253498336 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f27fc0658f0 0x7f27fc108b00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f27f00048d0 tx=0x7f27f0009da0 comp rx=0 tx=0).stop 2024-09-19T06:47:43.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.171+0000 7f2801089640 1 -- 172.21.15.99:0/4253498336 shutdown_connections 2024-09-19T06:47:43.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.171+0000 7f2801089640 1 --2- 172.21.15.99:0/4253498336 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f27fc0658f0 0x7f27fc108b00 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:43.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.171+0000 7f2801089640 1 --2- 172.21.15.99:0/4253498336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27fc064fe0 0x7f27fc0653b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:43.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.171+0000 7f2801089640 1 -- 172.21.15.99:0/4253498336 >> 172.21.15.99:0/4253498336 conn(0x7f27fc0723b0 msgr2=0x7f27fc0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:43.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.171+0000 7f2801089640 1 -- 172.21.15.99:0/4253498336 shutdown_connections 2024-09-19T06:47:43.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.171+0000 7f2801089640 1 -- 172.21.15.99:0/4253498336 wait complete. 2024-09-19T06:47:43.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.172+0000 7f2801089640 1 Processor -- start 2024-09-19T06:47:43.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.172+0000 7f2801089640 1 -- start start 2024-09-19T06:47:43.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.172+0000 7f2801089640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f27fc064fe0 0x7f27fc1153a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:43.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.172+0000 7f2801089640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27fc0658f0 0x7f27fc1158e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:43.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.172+0000 7f2801089640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27fc115ee0 con 0x7f27fc064fe0 2024-09-19T06:47:43.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.172+0000 7f2801089640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27fc10f320 con 0x7f27fc0658f0 2024-09-19T06:47:43.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.172+0000 7f27fad9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f27fc064fe0 0x7f27fc1153a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:43.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.172+0000 7f27fad9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f27fc064fe0 0x7f27fc1153a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38368/0 (socket says 172.21.15.99:38368) 2024-09-19T06:47:43.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.172+0000 7f27fad9d640 1 -- 172.21.15.99:0/2781502152 learned_addr learned my addr 172.21.15.99:0/2781502152 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:47:43.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.172+0000 7f27fa59c640 1 --2- 172.21.15.99:0/2781502152 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27fc0658f0 0x7f27fc1158e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:43.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.173+0000 7f27fad9d640 1 -- 172.21.15.99:0/2781502152 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27fc0658f0 msgr2=0x7f27fc1158e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:43.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.173+0000 7f27fad9d640 1 --2- 172.21.15.99:0/2781502152 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27fc0658f0 0x7f27fc1158e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:43.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.173+0000 7f27fad9d640 1 -- 172.21.15.99:0/2781502152 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f0005040 con 0x7f27fc064fe0 2024-09-19T06:47:43.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.173+0000 7f27fa59c640 1 --2- 172.21.15.99:0/2781502152 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27fc0658f0 0x7f27fc1158e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:47:43.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.173+0000 7f27fad9d640 1 --2- 172.21.15.99:0/2781502152 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f27fc064fe0 0x7f27fc1153a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f27ec002a80 tx=0x7f27ec004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:43.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.173+0000 7f27e37fe640 1 -- 172.21.15.99:0/2781502152 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27ec007c30 con 0x7f27fc064fe0 2024-09-19T06:47:43.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.173+0000 7f2801089640 1 -- 172.21.15.99:0/2781502152 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27fc10f600 con 0x7f27fc064fe0 2024-09-19T06:47:43.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.173+0000 7f27e37fe640 1 -- 172.21.15.99:0/2781502152 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f27ec00f040 con 0x7f27fc064fe0 2024-09-19T06:47:43.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.173+0000 7f27e37fe640 1 -- 172.21.15.99:0/2781502152 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27ec0095b0 con 0x7f27fc064fe0 2024-09-19T06:47:43.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.173+0000 7f2801089640 1 -- 172.21.15.99:0/2781502152 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27fc10fb20 con 0x7f27fc064fe0 2024-09-19T06:47:43.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.175+0000 7f2801089640 1 -- 172.21.15.99:0/2781502152 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27fc0fbae0 con 0x7f27fc064fe0 2024-09-19T06:47:43.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.175+0000 7f27e37fe640 1 -- 172.21.15.99:0/2781502152 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f27ec009710 con 0x7f27fc064fe0 2024-09-19T06:47:43.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.175+0000 7f27e37fe640 1 --2- 172.21.15.99:0/2781502152 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f27e406e530 0x7f27e40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:43.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.175+0000 7f27e37fe640 1 -- 172.21.15.99:0/2781502152 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f27ec08d9e0 con 0x7f27fc064fe0 2024-09-19T06:47:43.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.175+0000 7f27fa59c640 1 --2- 172.21.15.99:0/2781502152 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f27e406e530 0x7f27e40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:43.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.176+0000 7f27fa59c640 1 --2- 172.21.15.99:0/2781502152 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f27e406e530 0x7f27e40709e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f27fc110c60 tx=0x7f27f0035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:43.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.180+0000 7f27e37fe640 1 -- 172.21.15.99:0/2781502152 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f27ec056c20 con 0x7f27fc064fe0 2024-09-19T06:47:43.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:42 smithi117 ceph-mon[76771]: from='client.34340 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:47:43.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:42 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:47:43.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:42 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:47:43.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:42 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:47:43.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:42 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/2940753430' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:47:43.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.361+0000 7f2801089640 1 -- 172.21.15.99:0/2781502152 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f27fc04b750 con 0x7f27e406e530 2024-09-19T06:47:43.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.363+0000 7f27e37fe640 1 -- 172.21.15.99:0/2781502152 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f27fc04b750 con 0x7f27e406e530 2024-09-19T06:47:43.364 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:47:43.364 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T06:47:43.364 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": true, 2024-09-19T06:47:43.364 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T06:47:43.364 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [ 2024-09-19T06:47:43.364 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr", 2024-09-19T06:47:43.364 INFO:teuthology.orchestra.run.smithi099.stdout: "crash", 2024-09-19T06:47:43.364 INFO:teuthology.orchestra.run.smithi099.stdout: "mon" 2024-09-19T06:47:43.365 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-19T06:47:43.365 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": "11/21 daemons upgraded", 2024-09-19T06:47:43.365 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "Currently upgrading osd daemons", 2024-09-19T06:47:43.365 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-09-19T06:47:43.365 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:47:43.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.365+0000 7f2801089640 1 -- 172.21.15.99:0/2781502152 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f27e406e530 msgr2=0x7f27e40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:43.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.365+0000 7f2801089640 1 --2- 172.21.15.99:0/2781502152 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f27e406e530 0x7f27e40709e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f27fc110c60 tx=0x7f27f0035040 comp rx=0 tx=0).stop 2024-09-19T06:47:43.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.365+0000 7f2801089640 1 -- 172.21.15.99:0/2781502152 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f27fc064fe0 msgr2=0x7f27fc1153a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:43.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.365+0000 7f2801089640 1 --2- 172.21.15.99:0/2781502152 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f27fc064fe0 0x7f27fc1153a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f27ec002a80 tx=0x7f27ec004600 comp rx=0 tx=0).stop 2024-09-19T06:47:43.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.365+0000 7f2801089640 1 -- 172.21.15.99:0/2781502152 shutdown_connections 2024-09-19T06:47:43.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.365+0000 7f2801089640 1 --2- 172.21.15.99:0/2781502152 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f27e406e530 0x7f27e40709e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:43.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.365+0000 7f2801089640 1 --2- 172.21.15.99:0/2781502152 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27fc0658f0 0x7f27fc1158e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:43.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.365+0000 7f2801089640 1 --2- 172.21.15.99:0/2781502152 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f27fc064fe0 0x7f27fc1153a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:43.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.365+0000 7f2801089640 1 -- 172.21.15.99:0/2781502152 >> 172.21.15.99:0/2781502152 conn(0x7f27fc0723b0 msgr2=0x7f27fc0f9080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:43.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.365+0000 7f2801089640 1 -- 172.21.15.99:0/2781502152 shutdown_connections 2024-09-19T06:47:43.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.365+0000 7f2801089640 1 -- 172.21.15.99:0/2781502152 wait complete. 2024-09-19T06:47:43.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.443+0000 7fe85cd62640 1 -- 172.21.15.99:0/2955452847 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe8580fdf00 msgr2=0x7fe858106540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:43.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.443+0000 7fe85cd62640 1 --2- 172.21.15.99:0/2955452847 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe8580fdf00 0x7fe858106540 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe84c0048d0 tx=0x7fe84c009da0 comp rx=0 tx=0).stop 2024-09-19T06:47:43.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.443+0000 7fe85cd62640 1 -- 172.21.15.99:0/2955452847 shutdown_connections 2024-09-19T06:47:43.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.443+0000 7fe85cd62640 1 --2- 172.21.15.99:0/2955452847 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe8580fdf00 0x7fe858106540 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:43.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.443+0000 7fe85cd62640 1 --2- 172.21.15.99:0/2955452847 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8580fd560 0x7fe8580fd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:43.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.443+0000 7fe85cd62640 1 -- 172.21.15.99:0/2955452847 >> 172.21.15.99:0/2955452847 conn(0x7fe8580f7030 msgr2=0x7fe8580f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:43.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.443+0000 7fe85cd62640 1 -- 172.21.15.99:0/2955452847 shutdown_connections 2024-09-19T06:47:43.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.443+0000 7fe85cd62640 1 -- 172.21.15.99:0/2955452847 wait complete. 2024-09-19T06:47:43.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.444+0000 7fe85cd62640 1 Processor -- start 2024-09-19T06:47:43.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.444+0000 7fe85cd62640 1 -- start start 2024-09-19T06:47:43.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.444+0000 7fe85cd62640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe8580fd560 0x7fe8580fb390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:43.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.444+0000 7fe85cd62640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8580fdf00 0x7fe8580fb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:43.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.444+0000 7fe85cd62640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8580fbe10 con 0x7fe8580fd560 2024-09-19T06:47:43.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.444+0000 7fe85cd62640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8580fbf80 con 0x7fe8580fdf00 2024-09-19T06:47:43.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.444+0000 7fe85659c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe8580fd560 0x7fe8580fb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:43.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.444+0000 7fe85659c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe8580fd560 0x7fe8580fb390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38380/0 (socket says 172.21.15.99:38380) 2024-09-19T06:47:43.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.444+0000 7fe85659c640 1 -- 172.21.15.99:0/4294578009 learned_addr learned my addr 172.21.15.99:0/4294578009 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:47:43.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.444+0000 7fe855d9b640 1 --2- 172.21.15.99:0/4294578009 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8580fdf00 0x7fe8580fb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:43.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.444+0000 7fe85659c640 1 -- 172.21.15.99:0/4294578009 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8580fdf00 msgr2=0x7fe8580fb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:43.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.444+0000 7fe85659c640 1 --2- 172.21.15.99:0/4294578009 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8580fdf00 0x7fe8580fb8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:43.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.444+0000 7fe85659c640 1 -- 172.21.15.99:0/4294578009 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe84c005040 con 0x7fe8580fd560 2024-09-19T06:47:43.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.445+0000 7fe85659c640 1 --2- 172.21.15.99:0/4294578009 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe8580fd560 0x7fe8580fb390 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe848002a50 tx=0x7fe848004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:43.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.445+0000 7fe846ffd640 1 -- 172.21.15.99:0/4294578009 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe848007c30 con 0x7fe8580fd560 2024-09-19T06:47:43.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.445+0000 7fe846ffd640 1 -- 172.21.15.99:0/4294578009 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe84800f040 con 0x7fe8580fd560 2024-09-19T06:47:43.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.445+0000 7fe85cd62640 1 -- 172.21.15.99:0/4294578009 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8580fc210 con 0x7fe8580fd560 2024-09-19T06:47:43.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.445+0000 7fe846ffd640 1 -- 172.21.15.99:0/4294578009 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe84800da10 con 0x7fe8580fd560 2024-09-19T06:47:43.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.445+0000 7fe85cd62640 1 -- 172.21.15.99:0/4294578009 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8581198b0 con 0x7fe8580fd560 2024-09-19T06:47:43.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.446+0000 7fe85cd62640 1 -- 172.21.15.99:0/4294578009 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe858066390 con 0x7fe8580fd560 2024-09-19T06:47:43.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.447+0000 7fe846ffd640 1 -- 172.21.15.99:0/4294578009 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fe84800dbb0 con 0x7fe8580fd560 2024-09-19T06:47:43.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.447+0000 7fe846ffd640 1 --2- 172.21.15.99:0/4294578009 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe84006e530 0x7fe8400709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:47:43.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.447+0000 7fe846ffd640 1 -- 172.21.15.99:0/4294578009 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fe84808d7d0 con 0x7fe8580fd560 2024-09-19T06:47:43.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.447+0000 7fe855d9b640 1 --2- 172.21.15.99:0/4294578009 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe84006e530 0x7fe8400709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:47:43.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.448+0000 7fe855d9b640 1 --2- 172.21.15.99:0/4294578009 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe84006e530 0x7fe8400709e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe84c009ac0 tx=0x7fe84c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:47:43.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.451+0000 7fe846ffd640 1 -- 172.21.15.99:0/4294578009 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fe848056a90 con 0x7fe8580fd560 2024-09-19T06:47:43.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.686+0000 7fe85cd62640 1 -- 172.21.15.99:0/4294578009 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fe85804b780 con 0x7fe8580fd560 2024-09-19T06:47:43.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.686+0000 7fe846ffd640 1 -- 172.21.15.99:0/4294578009 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1290 (secure 0 0 0) 0x7fe84800de60 con 0x7fe8580fd560 2024-09-19T06:47:43.687 INFO:teuthology.orchestra.run.smithi099.stdout:HEALTH_WARN 1 osds down; all OSDs are running squid or later but require_osd_release < squid; Degraded data redundancy: 50/321 objects degraded (15.576%), 14 pgs degraded 2024-09-19T06:47:43.687 INFO:teuthology.orchestra.run.smithi099.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-19T06:47:43.688 INFO:teuthology.orchestra.run.smithi099.stdout: osd.5 (root=default,host=smithi117) is down 2024-09-19T06:47:43.688 INFO:teuthology.orchestra.run.smithi099.stdout:[WRN] OSD_UPGRADE_FINISHED: all OSDs are running squid or later but require_osd_release < squid 2024-09-19T06:47:43.688 INFO:teuthology.orchestra.run.smithi099.stdout: all OSDs are running squid or later but require_osd_release < squid 2024-09-19T06:47:43.688 INFO:teuthology.orchestra.run.smithi099.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 50/321 objects degraded (15.576%), 14 pgs degraded 2024-09-19T06:47:43.688 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.2 is active+undersized+degraded, acting [1,0] 2024-09-19T06:47:43.688 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.3 is active+undersized+degraded, acting [2,1] 2024-09-19T06:47:43.688 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.8 is active+undersized+degraded, acting [3,0] 2024-09-19T06:47:43.688 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.b is active+undersized+degraded, acting [3,4] 2024-09-19T06:47:43.688 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.f is active+undersized+degraded, acting [4,0] 2024-09-19T06:47:43.688 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.14 is active+undersized+degraded, acting [3,4] 2024-09-19T06:47:43.688 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.16 is active+undersized+degraded, acting [3,2] 2024-09-19T06:47:43.688 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.17 is active+undersized+degraded, acting [2,1] 2024-09-19T06:47:43.688 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.18 is active+undersized+degraded, acting [4,3] 2024-09-19T06:47:43.689 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.1a is active+undersized+degraded, acting [3,4] 2024-09-19T06:47:43.689 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.1b is active+undersized+degraded, acting [1,0] 2024-09-19T06:47:43.689 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.1c is active+undersized+degraded, acting [4,2] 2024-09-19T06:47:43.689 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.1d is active+undersized+degraded, acting [3,0] 2024-09-19T06:47:43.689 INFO:teuthology.orchestra.run.smithi099.stdout: pg 2.1e is active+undersized+degraded, acting [2,0] 2024-09-19T06:47:43.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.688+0000 7fe85cd62640 1 -- 172.21.15.99:0/4294578009 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe84006e530 msgr2=0x7fe8400709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:43.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.688+0000 7fe85cd62640 1 --2- 172.21.15.99:0/4294578009 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe84006e530 0x7fe8400709e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe84c009ac0 tx=0x7fe84c035040 comp rx=0 tx=0).stop 2024-09-19T06:47:43.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.688+0000 7fe85cd62640 1 -- 172.21.15.99:0/4294578009 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe8580fd560 msgr2=0x7fe8580fb390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:47:43.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.688+0000 7fe85cd62640 1 --2- 172.21.15.99:0/4294578009 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe8580fd560 0x7fe8580fb390 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe848002a50 tx=0x7fe848004600 comp rx=0 tx=0).stop 2024-09-19T06:47:43.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.688+0000 7fe85cd62640 1 -- 172.21.15.99:0/4294578009 shutdown_connections 2024-09-19T06:47:43.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.688+0000 7fe85cd62640 1 --2- 172.21.15.99:0/4294578009 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe84006e530 0x7fe8400709e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:43.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.688+0000 7fe85cd62640 1 --2- 172.21.15.99:0/4294578009 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8580fdf00 0x7fe8580fb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:43.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.688+0000 7fe85cd62640 1 --2- 172.21.15.99:0/4294578009 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe8580fd560 0x7fe8580fb390 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:47:43.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.688+0000 7fe85cd62640 1 -- 172.21.15.99:0/4294578009 >> 172.21.15.99:0/4294578009 conn(0x7fe8580f7030 msgr2=0x7fe8580f8560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:47:43.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.688+0000 7fe85cd62640 1 -- 172.21.15.99:0/4294578009 shutdown_connections 2024-09-19T06:47:43.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:47:43.688+0000 7fe85cd62640 1 -- 172.21.15.99:0/4294578009 wait complete. 2024-09-19T06:47:44.311 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:47:44 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5[95894]: 2024-09-19T06:47:44.139+0000 7efd9cbf7640 -1 Falling back to public interface 2024-09-19T06:47:44.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:44 smithi117 ceph-mon[76771]: from='client.34344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:47:44.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:44 smithi117 ceph-mon[76771]: from='client.34350 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:47:44.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:44 smithi117 ceph-mon[76771]: pgmap v153: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 50/321 objects degraded (15.576%) 2024-09-19T06:47:44.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:44 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/2721702656' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:47:44.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:44 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/4294578009' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T06:47:44.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:44 smithi099 ceph-mon[97031]: from='client.34344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:47:44.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:44 smithi099 ceph-mon[97031]: from='client.34350 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:47:44.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:44 smithi099 ceph-mon[97031]: pgmap v153: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 50/321 objects degraded (15.576%) 2024-09-19T06:47:44.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:44 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/2721702656' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:47:44.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:44 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/4294578009' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T06:47:45.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:45 smithi117 ceph-mon[76771]: from='client.34362 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:47:45.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:45 smithi099 ceph-mon[97031]: from='client.34362 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:47:46.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:46 smithi117 ceph-mon[76771]: pgmap v154: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 50/321 objects degraded (15.576%) 2024-09-19T06:47:46.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:46 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:47:46.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:46 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:47:46.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:46 smithi117 ceph-mon[76771]: Health check update: Degraded data redundancy: 50/321 objects degraded (15.576%), 14 pgs degraded (PG_DEGRADED) 2024-09-19T06:47:46.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:46 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:47:46.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:46 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:47:46.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:46 smithi099 ceph-mon[97031]: pgmap v154: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 50/321 objects degraded (15.576%) 2024-09-19T06:47:46.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:46 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:47:46.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:46 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:47:46.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:46 smithi099 ceph-mon[97031]: Health check update: Degraded data redundancy: 50/321 objects degraded (15.576%), 14 pgs degraded (PG_DEGRADED) 2024-09-19T06:47:46.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:46 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:47:46.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:46 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:47:48.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:48 smithi117 ceph-mon[76771]: pgmap v155: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 50/321 objects degraded (15.576%) 2024-09-19T06:47:48.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:48 smithi099 ceph-mon[97031]: pgmap v155: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 50/321 objects degraded (15.576%) 2024-09-19T06:47:50.117 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:47:49 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5[95894]: 2024-09-19T06:47:49.810+0000 7efd9cbf7640 -1 osd.5 73 log_to_monitors true 2024-09-19T06:47:50.118 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:49 smithi117 ceph-mon[76771]: pgmap v156: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 50/321 objects degraded (15.576%) 2024-09-19T06:47:50.118 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:49 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:47:50.118 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:49 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:47:50.118 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:49 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:47:50.118 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:49 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:47:50.118 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:49 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:47:50.118 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:49 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:47:50.119 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:49 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:47:50.119 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:49 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:47:50.119 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:49 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:47:50.119 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:49 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:47:50.119 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:49 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:47:50.119 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:49 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-09-19T06:47:50.119 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:49 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-19T06:47:50.119 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:49 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-09-19T06:47:50.119 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:49 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-19T06:47:50.119 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:49 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-09-19T06:47:50.119 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:49 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-19T06:47:50.119 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:49 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-09-19T06:47:50.119 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:49 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-19T06:47:50.120 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:49 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-09-19T06:47:50.120 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:49 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-19T06:47:50.120 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:49 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-09-19T06:47:50.120 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:49 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-19T06:47:50.120 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:49 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-09-19T06:47:50.120 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:49 smithi117 ceph-mon[76771]: from='osd.5 [v2:172.21.15.117:6816/3277250125,v1:172.21.15.117:6817/3277250125]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T06:47:50.120 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:49 smithi117 ceph-mon[76771]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T06:47:50.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:49 smithi099 ceph-mon[97031]: pgmap v156: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 254 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 50/321 objects degraded (15.576%) 2024-09-19T06:47:50.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:49 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:47:50.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:49 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:47:50.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:49 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:47:50.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:49 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:47:50.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:49 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:47:50.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:49 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:47:50.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:49 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:47:50.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:49 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:47:50.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:49 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:47:50.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:49 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:47:50.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:49 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:47:50.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:49 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-09-19T06:47:50.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:49 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-19T06:47:50.208 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:49 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-09-19T06:47:50.208 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:49 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-19T06:47:50.208 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:49 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-09-19T06:47:50.208 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:49 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-19T06:47:50.208 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:49 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-09-19T06:47:50.208 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:49 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-19T06:47:50.208 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:49 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-09-19T06:47:50.208 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:49 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-19T06:47:50.208 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:49 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-09-19T06:47:50.208 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:49 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-19T06:47:50.208 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:49 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-09-19T06:47:50.208 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:49 smithi099 ceph-mon[97031]: from='osd.5 [v2:172.21.15.117:6816/3277250125,v1:172.21.15.117:6817/3277250125]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T06:47:50.209 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:49 smithi099 ceph-mon[97031]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T06:47:50.209 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:50 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-mon-smithi099[97027]: 2024-09-19T06:47:50.075+0000 7f687a806640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T06:47:51.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:50 smithi099 ceph-mon[97031]: Upgrade: Setting container_image for all osd 2024-09-19T06:47:51.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:50 smithi099 ceph-mon[97031]: Upgrade: Setting require_osd_release to 19 squid 2024-09-19T06:47:51.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:50 smithi099 ceph-mon[97031]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-09-19T06:47:51.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:50 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-09-19T06:47:51.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:50 smithi099 ceph-mon[97031]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T06:47:51.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:50 smithi099 ceph-mon[97031]: osdmap e76: 6 total, 5 up, 6 in 2024-09-19T06:47:51.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:50 smithi099 ceph-mon[97031]: from='osd.5 [v2:172.21.15.117:6816/3277250125,v1:172.21.15.117:6817/3277250125]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-19T06:47:51.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:50 smithi099 ceph-mon[97031]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-19T06:47:51.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:50 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T06:47:51.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:50 smithi099 ceph-mon[97031]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T06:47:51.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:50 smithi099 ceph-mon[97031]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T06:47:51.208 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:50 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T06:47:51.208 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:50 smithi099 ceph-mon[97031]: osdmap e77: 6 total, 5 up, 6 in 2024-09-19T06:47:51.208 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:50 smithi099 ceph-mon[97031]: fsmap cephfs:0/2 2 up:standby, 2 failed 2024-09-19T06:47:51.312 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 06:47:50 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5[95894]: 2024-09-19T06:47:50.912+0000 7efd90989640 -1 osd.5 73 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T06:47:51.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:50 smithi117 ceph-mon[76771]: Upgrade: Setting container_image for all osd 2024-09-19T06:47:51.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:50 smithi117 ceph-mon[76771]: Upgrade: Setting require_osd_release to 19 squid 2024-09-19T06:47:51.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:50 smithi117 ceph-mon[76771]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-09-19T06:47:51.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:50 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-09-19T06:47:51.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:50 smithi117 ceph-mon[76771]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T06:47:51.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:50 smithi117 ceph-mon[76771]: osdmap e76: 6 total, 5 up, 6 in 2024-09-19T06:47:51.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:50 smithi117 ceph-mon[76771]: from='osd.5 [v2:172.21.15.117:6816/3277250125,v1:172.21.15.117:6817/3277250125]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-19T06:47:51.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:50 smithi117 ceph-mon[76771]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]: dispatch 2024-09-19T06:47:51.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:50 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T06:47:51.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:50 smithi117 ceph-mon[76771]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T06:47:51.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:50 smithi117 ceph-mon[76771]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T06:47:51.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:50 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T06:47:51.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:50 smithi117 ceph-mon[76771]: osdmap e77: 6 total, 5 up, 6 in 2024-09-19T06:47:51.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:50 smithi117 ceph-mon[76771]: fsmap cephfs:0/2 2 up:standby, 2 failed 2024-09-19T06:47:52.115 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:51 smithi099 ceph-mon[97031]: Upgrade: failing fs cephfs for rapid multi-rank mds upgrade 2024-09-19T06:47:52.115 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:51 smithi099 ceph-mon[97031]: pgmap v159: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 254 MiB data, 973 MiB used, 535 GiB / 536 GiB avail; 50/321 objects degraded (15.576%) 2024-09-19T06:47:52.115 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:51 smithi099 ceph-mon[97031]: from='osd.5 ' entity='osd.5' 2024-09-19T06:47:52.115 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:51 smithi099 ceph-mon[97031]: mds.? [v2:172.21.15.117:6824/3050129703,v1:172.21.15.117:6825/3050129703] up:boot 2024-09-19T06:47:52.115 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:51 smithi099 ceph-mon[97031]: mds.? [v2:172.21.15.99:6828/1319728944,v1:172.21.15.99:6829/1319728944] up:boot 2024-09-19T06:47:52.115 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:51 smithi099 ceph-mon[97031]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-19T06:47:52.115 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:51 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi099.xehbxe"}]: dispatch 2024-09-19T06:47:52.115 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:51 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi117.nooexo"}]: dispatch 2024-09-19T06:47:52.115 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:51 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:47:52.115 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:51 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi099.obarqf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:47:52.116 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:51 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:47:52.116 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:51 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:47:52.116 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:51 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:47:52.116 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:51 smithi099 ceph-mon[97031]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-19T06:47:52.116 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:51 smithi099 ceph-mon[97031]: osd.5 [v2:172.21.15.117:6816/3277250125,v1:172.21.15.117:6817/3277250125] boot 2024-09-19T06:47:52.116 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:51 smithi099 ceph-mon[97031]: osdmap e78: 6 total, 6 up, 6 in 2024-09-19T06:47:52.116 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:51 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:47:52.214 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:51 smithi117 ceph-mon[76771]: Upgrade: failing fs cephfs for rapid multi-rank mds upgrade 2024-09-19T06:47:52.215 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:51 smithi117 ceph-mon[76771]: pgmap v159: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 254 MiB data, 973 MiB used, 535 GiB / 536 GiB avail; 50/321 objects degraded (15.576%) 2024-09-19T06:47:52.215 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:51 smithi117 ceph-mon[76771]: from='osd.5 ' entity='osd.5' 2024-09-19T06:47:52.215 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:51 smithi117 ceph-mon[76771]: mds.? [v2:172.21.15.117:6824/3050129703,v1:172.21.15.117:6825/3050129703] up:boot 2024-09-19T06:47:52.215 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:51 smithi117 ceph-mon[76771]: mds.? [v2:172.21.15.99:6828/1319728944,v1:172.21.15.99:6829/1319728944] up:boot 2024-09-19T06:47:52.215 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:51 smithi117 ceph-mon[76771]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-19T06:47:52.215 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:51 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi099.xehbxe"}]: dispatch 2024-09-19T06:47:52.215 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:51 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi117.nooexo"}]: dispatch 2024-09-19T06:47:52.215 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:51 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:47:52.216 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:51 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi099.obarqf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:47:52.216 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:51 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:47:52.216 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:51 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:47:52.216 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:51 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:47:52.216 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:51 smithi117 ceph-mon[76771]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-19T06:47:52.216 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:51 smithi117 ceph-mon[76771]: osd.5 [v2:172.21.15.117:6816/3277250125,v1:172.21.15.117:6817/3277250125] boot 2024-09-19T06:47:52.216 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:51 smithi117 ceph-mon[76771]: osdmap e78: 6 total, 6 up, 6 in 2024-09-19T06:47:52.216 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:51 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T06:47:53.093 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:52 smithi099 ceph-mon[97031]: Upgrade: Updating mds.cephfs.smithi099.obarqf 2024-09-19T06:47:53.094 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:52 smithi099 ceph-mon[97031]: Deploying daemon mds.cephfs.smithi099.obarqf on smithi099 2024-09-19T06:47:53.094 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:52 smithi099 ceph-mon[97031]: osdmap e79: 6 total, 6 up, 6 in 2024-09-19T06:47:53.230 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:52 smithi117 ceph-mon[76771]: Upgrade: Updating mds.cephfs.smithi099.obarqf 2024-09-19T06:47:53.230 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:52 smithi117 ceph-mon[76771]: Deploying daemon mds.cephfs.smithi099.obarqf on smithi099 2024-09-19T06:47:53.230 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:52 smithi117 ceph-mon[76771]: osdmap e79: 6 total, 6 up, 6 in 2024-09-19T06:47:54.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:53 smithi117 ceph-mon[76771]: pgmap v161: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 254 MiB data, 973 MiB used, 535 GiB / 536 GiB avail; 50/321 objects degraded (15.576%) 2024-09-19T06:47:54.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:53 smithi099 ceph-mon[97031]: pgmap v161: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 254 MiB data, 973 MiB used, 535 GiB / 536 GiB avail; 50/321 objects degraded (15.576%) 2024-09-19T06:47:55.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:54 smithi099 ceph-mon[97031]: osdmap e80: 6 total, 6 up, 6 in 2024-09-19T06:47:55.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:54 smithi099 ceph-mon[97031]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-19T06:47:55.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:54 smithi117 ceph-mon[76771]: osdmap e80: 6 total, 6 up, 6 in 2024-09-19T06:47:55.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:54 smithi117 ceph-mon[76771]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-19T06:47:56.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:55 smithi099 ceph-mon[97031]: pgmap v164: 65 pgs: 13 active+undersized, 12 active+undersized+degraded, 40 active+clean; 254 MiB data, 973 MiB used, 535 GiB / 536 GiB avail; 46/321 objects degraded (14.330%) 2024-09-19T06:47:56.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:55 smithi099 ceph-mon[97031]: Health check update: Degraded data redundancy: 46/321 objects degraded (14.330%), 12 pgs degraded (PG_DEGRADED) 2024-09-19T06:47:56.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:55 smithi117 ceph-mon[76771]: pgmap v164: 65 pgs: 13 active+undersized, 12 active+undersized+degraded, 40 active+clean; 254 MiB data, 973 MiB used, 535 GiB / 536 GiB avail; 46/321 objects degraded (14.330%) 2024-09-19T06:47:56.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:55 smithi117 ceph-mon[76771]: Health check update: Degraded data redundancy: 46/321 objects degraded (14.330%), 12 pgs degraded (PG_DEGRADED) 2024-09-19T06:47:57.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:56 smithi099 ceph-mon[97031]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 46/321 objects degraded (14.330%), 12 pgs degraded) 2024-09-19T06:47:57.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:56 smithi117 ceph-mon[76771]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 46/321 objects degraded (14.330%), 12 pgs degraded) 2024-09-19T06:47:58.288 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:57 smithi099 ceph-mon[97031]: pgmap v165: 65 pgs: 65 active+clean; 254 MiB data, 977 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:47:58.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:57 smithi117 ceph-mon[76771]: pgmap v165: 65 pgs: 65 active+clean; 254 MiB data, 977 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:47:59.670 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:59 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:47:59.670 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:59 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:47:59.670 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:59 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:47:59.670 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:59 smithi099 ceph-mon[97031]: pgmap v166: 65 pgs: 65 active+clean; 254 MiB data, 977 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:47:59.670 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:59 smithi099 ceph-mon[97031]: mds.? [v2:172.21.15.99:6826/1859154203,v1:172.21.15.99:6827/1859154203] up:boot 2024-09-19T06:47:59.670 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:59 smithi099 ceph-mon[97031]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-19T06:47:59.670 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:47:59 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi099.obarqf"}]: dispatch 2024-09-19T06:47:59.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:59 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:47:59.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:59 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:47:59.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:59 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:47:59.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:59 smithi117 ceph-mon[76771]: pgmap v166: 65 pgs: 65 active+clean; 254 MiB data, 977 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:47:59.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:59 smithi117 ceph-mon[76771]: mds.? [v2:172.21.15.99:6826/1859154203,v1:172.21.15.99:6827/1859154203] up:boot 2024-09-19T06:47:59.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:59 smithi117 ceph-mon[76771]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-19T06:47:59.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:47:59 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi099.obarqf"}]: dispatch 2024-09-19T06:48:02.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:01 smithi099 ceph-mon[97031]: pgmap v167: 65 pgs: 65 active+clean; 254 MiB data, 977 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:48:02.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:01 smithi117 ceph-mon[76771]: pgmap v167: 65 pgs: 65 active+clean; 254 MiB data, 977 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:48:03.201 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:02 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:03.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:02 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:04.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:03 smithi099 ceph-mon[97031]: pgmap v168: 65 pgs: 65 active+clean; 254 MiB data, 977 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:48:04.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:03 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:04.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:03 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:04.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:03 smithi117 ceph-mon[76771]: pgmap v168: 65 pgs: 65 active+clean; 254 MiB data, 977 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:48:04.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:03 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:04.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:03 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:05.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:05 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:05.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:05 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:05.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:05 smithi099 ceph-mon[97031]: pgmap v169: 65 pgs: 65 active+clean; 254 MiB data, 977 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:48:05.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:05 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:05.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:05 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:05.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:05 smithi117 ceph-mon[76771]: pgmap v169: 65 pgs: 65 active+clean; 254 MiB data, 977 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:48:08.084 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:07 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:08.084 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:07 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:48:08.084 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:07 smithi099 ceph-mon[97031]: pgmap v170: 65 pgs: 65 active+clean; 254 MiB data, 977 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:48:08.084 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:07 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:08.084 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:07 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:08.084 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:07 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:48:08.084 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:07 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:48:08.084 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:07 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:08.085 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:07 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:48:08.085 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:07 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:48:08.085 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:07 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:48:08.085 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:07 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:48:08.085 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:07 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:48:08.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:07 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:08.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:07 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:48:08.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:07 smithi117 ceph-mon[76771]: pgmap v170: 65 pgs: 65 active+clean; 254 MiB data, 977 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:48:08.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:07 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:08.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:07 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:08.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:07 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:48:08.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:07 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:48:08.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:07 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:08.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:07 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:48:08.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:07 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:48:08.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:07 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:48:08.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:07 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:48:08.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:07 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:48:10.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:09 smithi099 ceph-mon[97031]: Upgrade: Updating mds.cephfs.smithi099.xehbxe 2024-09-19T06:48:10.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:09 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:10.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:09 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi099.xehbxe", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:48:10.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:09 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:48:10.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:09 smithi099 ceph-mon[97031]: Deploying daemon mds.cephfs.smithi099.xehbxe on smithi099 2024-09-19T06:48:10.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:09 smithi099 ceph-mon[97031]: pgmap v171: 65 pgs: 65 active+clean; 254 MiB data, 977 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:48:10.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:09 smithi117 ceph-mon[76771]: Upgrade: Updating mds.cephfs.smithi099.xehbxe 2024-09-19T06:48:10.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:09 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:10.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:09 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi099.xehbxe", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:48:10.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:09 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:48:10.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:09 smithi117 ceph-mon[76771]: Deploying daemon mds.cephfs.smithi099.xehbxe on smithi099 2024-09-19T06:48:10.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:09 smithi117 ceph-mon[76771]: pgmap v171: 65 pgs: 65 active+clean; 254 MiB data, 977 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:48:12.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:11 smithi099 ceph-mon[97031]: osdmap e81: 6 total, 6 up, 6 in 2024-09-19T06:48:12.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:11 smithi099 ceph-mon[97031]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-19T06:48:12.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:11 smithi099 ceph-mon[97031]: pgmap v173: 65 pgs: 65 active+clean; 254 MiB data, 977 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:48:12.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:11 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi099.xehbxe"}]: dispatch 2024-09-19T06:48:12.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:11 smithi117 ceph-mon[76771]: osdmap e81: 6 total, 6 up, 6 in 2024-09-19T06:48:12.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:11 smithi117 ceph-mon[76771]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-19T06:48:12.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:11 smithi117 ceph-mon[76771]: pgmap v173: 65 pgs: 65 active+clean; 254 MiB data, 977 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:48:12.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:11 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi099.xehbxe"}]: dispatch 2024-09-19T06:48:13.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:13.770+0000 7f17ea1da640 1 -- 172.21.15.99:0/3744254775 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17e41014c0 msgr2=0x7f17e4101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:13.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:13.770+0000 7f17ea1da640 1 --2- 172.21.15.99:0/3744254775 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17e41014c0 0x7f17e4101890 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f17d40048d0 tx=0x7f17d4009da0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:13.770+0000 7f17ea1da640 1 -- 172.21.15.99:0/3744254775 shutdown_connections 2024-09-19T06:48:13.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:13.770+0000 7f17ea1da640 1 --2- 172.21.15.99:0/3744254775 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17e40fb480 0x7f17e40fb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:13.770+0000 7f17ea1da640 1 --2- 172.21.15.99:0/3744254775 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17e41014c0 0x7f17e4101890 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:13.770+0000 7f17ea1da640 1 -- 172.21.15.99:0/3744254775 >> 172.21.15.99:0/3744254775 conn(0x7f17e40f7000 msgr2=0x7f17e40f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:13.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:13.770+0000 7f17ea1da640 1 -- 172.21.15.99:0/3744254775 shutdown_connections 2024-09-19T06:48:13.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:13.770+0000 7f17ea1da640 1 -- 172.21.15.99:0/3744254775 wait complete. 2024-09-19T06:48:13.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:13.771+0000 7f17ea1da640 1 Processor -- start 2024-09-19T06:48:13.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:13.771+0000 7f17ea1da640 1 -- start start 2024-09-19T06:48:13.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:13.771+0000 7f17ea1da640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17e40fb480 0x7f17e4113230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:13.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:13.771+0000 7f17ea1da640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17e41014c0 0x7f17e4113770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:13.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:13.771+0000 7f17ea1da640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17e4113e00 con 0x7f17e41014c0 2024-09-19T06:48:13.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:13.771+0000 7f17ea1da640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17e410d1b0 con 0x7f17e40fb480 2024-09-19T06:48:13.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:13.771+0000 7f17e2ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17e41014c0 0x7f17e4113770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:13.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:13.771+0000 7f17e2ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17e41014c0 0x7f17e4113770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:39586/0 (socket says 172.21.15.99:39586) 2024-09-19T06:48:13.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:13.771+0000 7f17e2ffd640 1 -- 172.21.15.99:0/285520840 learned_addr learned my addr 172.21.15.99:0/285520840 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:48:13.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:13.771+0000 7f17e37fe640 1 --2- 172.21.15.99:0/285520840 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17e40fb480 0x7f17e4113230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:13.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:13.772+0000 7f17e2ffd640 1 -- 172.21.15.99:0/285520840 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17e40fb480 msgr2=0x7f17e4113230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:13.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:13.772+0000 7f17e2ffd640 1 --2- 172.21.15.99:0/285520840 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17e40fb480 0x7f17e4113230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:13.772+0000 7f17e2ffd640 1 -- 172.21.15.99:0/285520840 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17d4005040 con 0x7f17e41014c0 2024-09-19T06:48:13.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:13.772+0000 7f17e2ffd640 1 --2- 172.21.15.99:0/285520840 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17e41014c0 0x7f17e4113770 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f17d800b790 tx=0x7f17d80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:13.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:13.772+0000 7f17cbfff640 1 -- 172.21.15.99:0/285520840 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17d800c700 con 0x7f17e41014c0 2024-09-19T06:48:13.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:13.772+0000 7f17cbfff640 1 -- 172.21.15.99:0/285520840 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f17d800cd00 con 0x7f17e41014c0 2024-09-19T06:48:13.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:13.772+0000 7f17ea1da640 1 -- 172.21.15.99:0/285520840 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17e410d490 con 0x7f17e41014c0 2024-09-19T06:48:13.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:13.772+0000 7f17cbfff640 1 -- 172.21.15.99:0/285520840 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17d8015e70 con 0x7f17e41014c0 2024-09-19T06:48:13.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:13.772+0000 7f17ea1da640 1 -- 172.21.15.99:0/285520840 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17e410d9b0 con 0x7f17e41014c0 2024-09-19T06:48:13.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:13.773+0000 7f17ea1da640 1 -- 172.21.15.99:0/285520840 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17e40fcbc0 con 0x7f17e41014c0 2024-09-19T06:48:13.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:13.774+0000 7f17cbfff640 1 -- 172.21.15.99:0/285520840 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f17d8012070 con 0x7f17e41014c0 2024-09-19T06:48:13.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:13.774+0000 7f17cbfff640 1 --2- 172.21.15.99:0/285520840 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f17cc06e530 0x7f17cc0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:13.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:13.774+0000 7f17cbfff640 1 -- 172.21.15.99:0/285520840 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f17d808dc80 con 0x7f17e41014c0 2024-09-19T06:48:13.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:13.774+0000 7f17e37fe640 1 --2- 172.21.15.99:0/285520840 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f17cc06e530 0x7f17cc0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:13.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:13.775+0000 7f17e37fe640 1 --2- 172.21.15.99:0/285520840 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f17cc06e530 0x7f17cc0709e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f17d4009ac0 tx=0x7f17d4035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:13.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:13.778+0000 7f17cbfff640 1 -- 172.21.15.99:0/285520840 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f17d8056df0 con 0x7f17e41014c0 2024-09-19T06:48:13.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:13.961+0000 7f17ea1da640 1 -- 172.21.15.99:0/285520840 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f17e40fac10 con 0x7f17cc06e530 2024-09-19T06:48:13.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:13.962+0000 7f17cbfff640 1 -- 172.21.15.99:0/285520840 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f17e40fac10 con 0x7f17cc06e530 2024-09-19T06:48:13.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:13.965+0000 7f17ea1da640 1 -- 172.21.15.99:0/285520840 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f17cc06e530 msgr2=0x7f17cc0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:13.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:13.965+0000 7f17ea1da640 1 --2- 172.21.15.99:0/285520840 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f17cc06e530 0x7f17cc0709e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f17d4009ac0 tx=0x7f17d4035040 comp rx=0 tx=0).stop 2024-09-19T06:48:13.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:13.965+0000 7f17ea1da640 1 -- 172.21.15.99:0/285520840 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17e41014c0 msgr2=0x7f17e4113770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:13.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:13.965+0000 7f17ea1da640 1 --2- 172.21.15.99:0/285520840 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17e41014c0 0x7f17e4113770 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f17d800b790 tx=0x7f17d80091d0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:13.965+0000 7f17ea1da640 1 -- 172.21.15.99:0/285520840 shutdown_connections 2024-09-19T06:48:13.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:13.965+0000 7f17ea1da640 1 --2- 172.21.15.99:0/285520840 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f17cc06e530 0x7f17cc0709e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:13.965+0000 7f17ea1da640 1 --2- 172.21.15.99:0/285520840 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17e41014c0 0x7f17e4113770 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:13.965+0000 7f17ea1da640 1 --2- 172.21.15.99:0/285520840 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17e40fb480 0x7f17e4113230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:13.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:13.965+0000 7f17ea1da640 1 -- 172.21.15.99:0/285520840 >> 172.21.15.99:0/285520840 conn(0x7f17e40f7000 msgr2=0x7f17e40f73d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:13.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:13.965+0000 7f17ea1da640 1 -- 172.21.15.99:0/285520840 shutdown_connections 2024-09-19T06:48:13.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:13.965+0000 7f17ea1da640 1 -- 172.21.15.99:0/285520840 wait complete. 2024-09-19T06:48:13.975 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-09-19T06:48:14.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.044+0000 7f9db4faf640 1 -- 172.21.15.99:0/2777173802 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9db01025f0 msgr2=0x7f9db01029c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:14.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.044+0000 7f9db4faf640 1 --2- 172.21.15.99:0/2777173802 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9db01025f0 0x7f9db01029c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9da00048d0 tx=0x7f9da0009da0 comp rx=0 tx=0).stop 2024-09-19T06:48:14.047 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:13 smithi099 ceph-mon[97031]: pgmap v174: 65 pgs: 65 active+clean; 254 MiB data, 977 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:48:14.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.044+0000 7f9db4faf640 1 -- 172.21.15.99:0/2777173802 shutdown_connections 2024-09-19T06:48:14.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.044+0000 7f9db4faf640 1 --2- 172.21.15.99:0/2777173802 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9db00fac60 0x7f9db00fb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:14.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.044+0000 7f9db4faf640 1 --2- 172.21.15.99:0/2777173802 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9db01025f0 0x7f9db01029c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:14.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.044+0000 7f9db4faf640 1 -- 172.21.15.99:0/2777173802 >> 172.21.15.99:0/2777173802 conn(0x7f9db0070c80 msgr2=0x7f9db0071080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:14.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.044+0000 7f9db4faf640 1 -- 172.21.15.99:0/2777173802 shutdown_connections 2024-09-19T06:48:14.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.044+0000 7f9db4faf640 1 -- 172.21.15.99:0/2777173802 wait complete. 2024-09-19T06:48:14.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.045+0000 7f9db4faf640 1 Processor -- start 2024-09-19T06:48:14.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.045+0000 7f9db4faf640 1 -- start start 2024-09-19T06:48:14.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.045+0000 7f9db4faf640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9db00fac60 0x7f9db0113250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:14.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.045+0000 7f9db4faf640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9db01025f0 0x7f9db0113790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:14.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.045+0000 7f9db4faf640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db0113e20 con 0x7f9db00fac60 2024-09-19T06:48:14.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.045+0000 7f9db4faf640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db010d1d0 con 0x7f9db01025f0 2024-09-19T06:48:14.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.045+0000 7f9dae59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9db00fac60 0x7f9db0113250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:14.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.045+0000 7f9dae59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9db00fac60 0x7f9db0113250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:39608/0 (socket says 172.21.15.99:39608) 2024-09-19T06:48:14.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.045+0000 7f9dae59c640 1 -- 172.21.15.99:0/873967515 learned_addr learned my addr 172.21.15.99:0/873967515 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:48:14.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.045+0000 7f9dadd9b640 1 --2- 172.21.15.99:0/873967515 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9db01025f0 0x7f9db0113790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:14.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.046+0000 7f9dae59c640 1 -- 172.21.15.99:0/873967515 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9db01025f0 msgr2=0x7f9db0113790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:14.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.046+0000 7f9dae59c640 1 --2- 172.21.15.99:0/873967515 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9db01025f0 0x7f9db0113790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:14.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.046+0000 7f9dae59c640 1 -- 172.21.15.99:0/873967515 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da0005040 con 0x7f9db00fac60 2024-09-19T06:48:14.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.046+0000 7f9dae59c640 1 --2- 172.21.15.99:0/873967515 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9db00fac60 0x7f9db0113250 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9da0003080 tx=0x7f9da0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:14.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.046+0000 7f9d9effd640 1 -- 172.21.15.99:0/873967515 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9da0038070 con 0x7f9db00fac60 2024-09-19T06:48:14.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.046+0000 7f9d9effd640 1 -- 172.21.15.99:0/873967515 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9da00097e0 con 0x7f9db00fac60 2024-09-19T06:48:14.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.046+0000 7f9db4faf640 1 -- 172.21.15.99:0/873967515 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9db010d450 con 0x7f9db00fac60 2024-09-19T06:48:14.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.046+0000 7f9d9effd640 1 -- 172.21.15.99:0/873967515 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9da003d420 con 0x7f9db00fac60 2024-09-19T06:48:14.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.046+0000 7f9db4faf640 1 -- 172.21.15.99:0/873967515 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9db010d910 con 0x7f9db00fac60 2024-09-19T06:48:14.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.047+0000 7f9db4faf640 1 -- 172.21.15.99:0/873967515 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9db0065810 con 0x7f9db00fac60 2024-09-19T06:48:14.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.048+0000 7f9d9effd640 1 -- 172.21.15.99:0/873967515 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f9da0030020 con 0x7f9db00fac60 2024-09-19T06:48:14.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.048+0000 7f9d9effd640 1 --2- 172.21.15.99:0/873967515 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f9d9806e530 0x7f9d980709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:14.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.049+0000 7f9d9effd640 1 -- 172.21.15.99:0/873967515 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f9da00ae720 con 0x7f9db00fac60 2024-09-19T06:48:14.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.049+0000 7f9dadd9b640 1 --2- 172.21.15.99:0/873967515 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f9d9806e530 0x7f9d980709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:14.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.049+0000 7f9dadd9b640 1 --2- 172.21.15.99:0/873967515 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f9d9806e530 0x7f9d980709e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9da4006fd0 tx=0x7f9da4008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:14.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.053+0000 7f9d9effd640 1 -- 172.21.15.99:0/873967515 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f9da0077810 con 0x7f9db00fac60 2024-09-19T06:48:14.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.242+0000 7f9db4faf640 1 -- 172.21.15.99:0/873967515 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9db010e8c0 con 0x7f9d9806e530 2024-09-19T06:48:14.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.243+0000 7f9d9effd640 1 -- 172.21.15.99:0/873967515 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f9db010e8c0 con 0x7f9d9806e530 2024-09-19T06:48:14.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.245+0000 7f9db4faf640 1 -- 172.21.15.99:0/873967515 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f9d9806e530 msgr2=0x7f9d980709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:14.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.245+0000 7f9db4faf640 1 --2- 172.21.15.99:0/873967515 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f9d9806e530 0x7f9d980709e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9da4006fd0 tx=0x7f9da4008040 comp rx=0 tx=0).stop 2024-09-19T06:48:14.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.245+0000 7f9db4faf640 1 -- 172.21.15.99:0/873967515 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9db00fac60 msgr2=0x7f9db0113250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:14.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.245+0000 7f9db4faf640 1 --2- 172.21.15.99:0/873967515 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9db00fac60 0x7f9db0113250 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9da0003080 tx=0x7f9da0009da0 comp rx=0 tx=0).stop 2024-09-19T06:48:14.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.245+0000 7f9db4faf640 1 -- 172.21.15.99:0/873967515 shutdown_connections 2024-09-19T06:48:14.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.246+0000 7f9db4faf640 1 --2- 172.21.15.99:0/873967515 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f9d9806e530 0x7f9d980709e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:14.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.246+0000 7f9db4faf640 1 --2- 172.21.15.99:0/873967515 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9db01025f0 0x7f9db0113790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:14.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.246+0000 7f9db4faf640 1 --2- 172.21.15.99:0/873967515 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9db00fac60 0x7f9db0113250 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:14.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.246+0000 7f9db4faf640 1 -- 172.21.15.99:0/873967515 >> 172.21.15.99:0/873967515 conn(0x7f9db0070c80 msgr2=0x7f9db00f9f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:14.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.246+0000 7f9db4faf640 1 -- 172.21.15.99:0/873967515 shutdown_connections 2024-09-19T06:48:14.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.246+0000 7f9db4faf640 1 -- 172.21.15.99:0/873967515 wait complete. 2024-09-19T06:48:14.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:13 smithi117 ceph-mon[76771]: pgmap v174: 65 pgs: 65 active+clean; 254 MiB data, 977 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:48:14.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.324+0000 7ff1c07f4640 1 -- 172.21.15.99:0/1080505935 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1b80fdf30 msgr2=0x7ff1b8106600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:14.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.324+0000 7ff1c07f4640 1 --2- 172.21.15.99:0/1080505935 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1b80fdf30 0x7ff1b8106600 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff1a80048d0 tx=0x7ff1a8009da0 comp rx=0 tx=0).stop 2024-09-19T06:48:14.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.324+0000 7ff1c07f4640 1 -- 172.21.15.99:0/1080505935 shutdown_connections 2024-09-19T06:48:14.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.324+0000 7ff1c07f4640 1 --2- 172.21.15.99:0/1080505935 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1b80fdf30 0x7ff1b8106600 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:14.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.324+0000 7ff1c07f4640 1 --2- 172.21.15.99:0/1080505935 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1b80fd590 0x7ff1b80fd960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:14.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.324+0000 7ff1c07f4640 1 -- 172.21.15.99:0/1080505935 >> 172.21.15.99:0/1080505935 conn(0x7ff1b80f6ff0 msgr2=0x7ff1b80f9400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:14.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.324+0000 7ff1c07f4640 1 -- 172.21.15.99:0/1080505935 shutdown_connections 2024-09-19T06:48:14.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.324+0000 7ff1c07f4640 1 -- 172.21.15.99:0/1080505935 wait complete. 2024-09-19T06:48:14.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.325+0000 7ff1c07f4640 1 Processor -- start 2024-09-19T06:48:14.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.325+0000 7ff1c07f4640 1 -- start start 2024-09-19T06:48:14.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.325+0000 7ff1c07f4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1b80fd590 0x7ff1b8113290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:14.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.325+0000 7ff1c07f4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1b80fdf30 0x7ff1b81137d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:14.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.325+0000 7ff1c07f4640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b8113dd0 con 0x7ff1b80fdf30 2024-09-19T06:48:14.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.325+0000 7ff1c07f4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b810d210 con 0x7ff1b80fd590 2024-09-19T06:48:14.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.325+0000 7ff1bdd8f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1b80fdf30 0x7ff1b81137d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:14.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.326+0000 7ff1bdd8f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1b80fdf30 0x7ff1b81137d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:39620/0 (socket says 172.21.15.99:39620) 2024-09-19T06:48:14.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.326+0000 7ff1bdd8f640 1 -- 172.21.15.99:0/2944831488 learned_addr learned my addr 172.21.15.99:0/2944831488 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:48:14.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.326+0000 7ff1be590640 1 --2- 172.21.15.99:0/2944831488 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1b80fd590 0x7ff1b8113290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:14.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.326+0000 7ff1bdd8f640 1 -- 172.21.15.99:0/2944831488 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1b80fd590 msgr2=0x7ff1b8113290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:14.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.326+0000 7ff1bdd8f640 1 --2- 172.21.15.99:0/2944831488 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1b80fd590 0x7ff1b8113290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:14.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.326+0000 7ff1bdd8f640 1 -- 172.21.15.99:0/2944831488 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a8005040 con 0x7ff1b80fdf30 2024-09-19T06:48:14.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.326+0000 7ff1bdd8f640 1 --2- 172.21.15.99:0/2944831488 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1b80fdf30 0x7ff1b81137d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff1a8009ac0 tx=0x7ff1a8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:14.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.326+0000 7ff1aeffd640 1 -- 172.21.15.99:0/2944831488 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1a8038070 con 0x7ff1b80fdf30 2024-09-19T06:48:14.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.326+0000 7ff1aeffd640 1 -- 172.21.15.99:0/2944831488 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff1a8008ed0 con 0x7ff1b80fdf30 2024-09-19T06:48:14.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.326+0000 7ff1c07f4640 1 -- 172.21.15.99:0/2944831488 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1b810d490 con 0x7ff1b80fdf30 2024-09-19T06:48:14.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.326+0000 7ff1c07f4640 1 -- 172.21.15.99:0/2944831488 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1b810d950 con 0x7ff1b80fdf30 2024-09-19T06:48:14.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.326+0000 7ff1aeffd640 1 -- 172.21.15.99:0/2944831488 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1a8009620 con 0x7ff1b80fdf30 2024-09-19T06:48:14.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.327+0000 7ff1c07f4640 1 -- 172.21.15.99:0/2944831488 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff19c005210 con 0x7ff1b80fdf30 2024-09-19T06:48:14.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.328+0000 7ff1aeffd640 1 -- 172.21.15.99:0/2944831488 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7ff1a8030020 con 0x7ff1b80fdf30 2024-09-19T06:48:14.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.328+0000 7ff1aeffd640 1 --2- 172.21.15.99:0/2944831488 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ff1a406e530 0x7ff1a40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:14.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.328+0000 7ff1aeffd640 1 -- 172.21.15.99:0/2944831488 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6496+0+0 (secure 0 0 0) 0x7ff1a80ae4a0 con 0x7ff1b80fdf30 2024-09-19T06:48:14.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.328+0000 7ff1be590640 1 --2- 172.21.15.99:0/2944831488 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ff1a406e530 0x7ff1a40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:14.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.329+0000 7ff1be590640 1 --2- 172.21.15.99:0/2944831488 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ff1a406e530 0x7ff1a40709e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4004ed0 tx=0x7ff1b400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:14.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.333+0000 7ff1aeffd640 1 -- 172.21.15.99:0/2944831488 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7ff1a8077510 con 0x7ff1b80fdf30 2024-09-19T06:48:14.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.513+0000 7ff1c07f4640 1 -- 172.21.15.99:0/2944831488 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff19c000bc0 con 0x7ff1a406e530 2024-09-19T06:48:14.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.521+0000 7ff1aeffd640 1 -- 172.21.15.99:0/2944831488 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7ff19c000bc0 con 0x7ff1a406e530 2024-09-19T06:48:14.524 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T06:48:14.524 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.smithi099 smithi099 *:9093,9094 running (7m) 11s ago 15m 23.4M - 0.25.0 c8568f914cd2 e7c1774d56b0 2024-09-19T06:48:14.524 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi099 smithi099 running (3m) 11s ago 15m 6899k - 19.1.1-361-g2f599a46 d2baa855c067 b9775f416b10 2024-09-19T06:48:14.524 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi117 smithi117 running (3m) 29s ago 14m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 38cf60c0d548 2024-09-19T06:48:14.524 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.smithi099 smithi099 *:3000 running (5m) 11s ago 15m 80.7M - 9.4.12 2bacad6d85d8 cd53a18d5410 2024-09-19T06:48:14.524 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.obarqf smithi099 running (16s) 11s ago 10m 10.9M - 19.1.1-361-g2f599a46 d2baa855c067 314a73082521 2024-09-19T06:48:14.524 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.xehbxe smithi099 running (10m) 11s ago 10m 10.8M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 d09eb3d306ae 2024-09-19T06:48:14.524 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.bheqzh smithi117 running (10m) 29s ago 10m 16.2M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 21253e27fdd3 2024-09-19T06:48:14.524 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.nooexo smithi117 running (10m) 29s ago 10m 109M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 ad1faeb3343c 2024-09-19T06:48:14.524 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi099.pgvkqi smithi099 *:8443,9283,8765 running (6m) 11s ago 16m 504M - 19.1.1-361-g2f599a46 d2baa855c067 d5de99cb7e78 2024-09-19T06:48:14.524 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi117.ssmkcf smithi117 *:8443,9283,8765 running (6m) 29s ago 14m 444M - 19.1.1-361-g2f599a46 d2baa855c067 8b7ee0f871f5 2024-09-19T06:48:14.525 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi099 smithi099 running (4m) 11s ago 17m 53.5M 2048M 19.1.1-361-g2f599a46 d2baa855c067 ffe067438824 2024-09-19T06:48:14.525 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi117 smithi117 running (4m) 29s ago 14m 36.6M 2048M 19.1.1-361-g2f599a46 d2baa855c067 4cb7455e3ee7 2024-09-19T06:48:14.525 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi099 smithi099 *:9100 running (7m) 11s ago 15m 14.9M - 1.5.0 0da6a335fe13 dca7b4517dcc 2024-09-19T06:48:14.525 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi117 smithi117 *:9100 running (6m) 29s ago 14m 15.7M - 1.5.0 0da6a335fe13 8233ce3835d2 2024-09-19T06:48:14.525 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (3m) 11s ago 14m 100M 1557M 19.1.1-361-g2f599a46 d2baa855c067 8e22543bf933 2024-09-19T06:48:14.525 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (2m) 11s ago 13m 106M 1557M 19.1.1-361-g2f599a46 d2baa855c067 f54153d0ae09 2024-09-19T06:48:14.525 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (2m) 11s ago 13m 83.5M 1557M 19.1.1-361-g2f599a46 d2baa855c067 b1778ab88870 2024-09-19T06:48:14.525 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi117 running (97s) 29s ago 12m 101M 2581M 19.1.1-361-g2f599a46 d2baa855c067 ea5236b193d3 2024-09-19T06:48:14.525 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi117 running (65s) 29s ago 12m 93.3M 2581M 19.1.1-361-g2f599a46 d2baa855c067 27ac2c859a68 2024-09-19T06:48:14.525 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi117 running (32s) 29s ago 11m 11.3M 2581M 19.1.1-361-g2f599a46 d2baa855c067 de6aeb8544ce 2024-09-19T06:48:14.525 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.smithi099 smithi099 *:9095 running (6m) 11s ago 15m 64.4M - 2.43.0 a07b618ecd1d 15ad26ec6fb4 2024-09-19T06:48:14.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.523+0000 7ff1c07f4640 1 -- 172.21.15.99:0/2944831488 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ff1a406e530 msgr2=0x7ff1a40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:14.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.523+0000 7ff1c07f4640 1 --2- 172.21.15.99:0/2944831488 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ff1a406e530 0x7ff1a40709e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4004ed0 tx=0x7ff1b400b040 comp rx=0 tx=0).stop 2024-09-19T06:48:14.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.523+0000 7ff1c07f4640 1 -- 172.21.15.99:0/2944831488 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1b80fdf30 msgr2=0x7ff1b81137d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:14.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.523+0000 7ff1c07f4640 1 --2- 172.21.15.99:0/2944831488 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1b80fdf30 0x7ff1b81137d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff1a8009ac0 tx=0x7ff1a8009da0 comp rx=0 tx=0).stop 2024-09-19T06:48:14.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.523+0000 7ff1c07f4640 1 -- 172.21.15.99:0/2944831488 shutdown_connections 2024-09-19T06:48:14.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.523+0000 7ff1c07f4640 1 --2- 172.21.15.99:0/2944831488 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ff1a406e530 0x7ff1a40709e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:14.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.523+0000 7ff1c07f4640 1 --2- 172.21.15.99:0/2944831488 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1b80fdf30 0x7ff1b81137d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:14.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.523+0000 7ff1c07f4640 1 --2- 172.21.15.99:0/2944831488 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1b80fd590 0x7ff1b8113290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:14.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.523+0000 7ff1c07f4640 1 -- 172.21.15.99:0/2944831488 >> 172.21.15.99:0/2944831488 conn(0x7ff1b80f6ff0 msgr2=0x7ff1b80f85a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:14.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.524+0000 7ff1c07f4640 1 -- 172.21.15.99:0/2944831488 shutdown_connections 2024-09-19T06:48:14.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.524+0000 7ff1c07f4640 1 -- 172.21.15.99:0/2944831488 wait complete. 2024-09-19T06:48:14.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.602+0000 7f9bf3125640 1 -- 172.21.15.99:0/2813021197 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9bec1014d0 msgr2=0x7f9bec1018a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:14.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.602+0000 7f9bf3125640 1 --2- 172.21.15.99:0/2813021197 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9bec1014d0 0x7f9bec1018a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9be40048d0 tx=0x7f9be4009da0 comp rx=0 tx=0).stop 2024-09-19T06:48:14.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.602+0000 7f9bf3125640 1 -- 172.21.15.99:0/2813021197 shutdown_connections 2024-09-19T06:48:14.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.602+0000 7f9bf3125640 1 --2- 172.21.15.99:0/2813021197 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9bec0fb490 0x7f9bec0fb900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:14.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.602+0000 7f9bf3125640 1 --2- 172.21.15.99:0/2813021197 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9bec1014d0 0x7f9bec1018a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:14.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.602+0000 7f9bf3125640 1 -- 172.21.15.99:0/2813021197 >> 172.21.15.99:0/2813021197 conn(0x7f9bec0f7010 msgr2=0x7f9bec0f9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:14.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.602+0000 7f9bf3125640 1 -- 172.21.15.99:0/2813021197 shutdown_connections 2024-09-19T06:48:14.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.602+0000 7f9bf3125640 1 -- 172.21.15.99:0/2813021197 wait complete. 2024-09-19T06:48:14.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.603+0000 7f9bf3125640 1 Processor -- start 2024-09-19T06:48:14.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.603+0000 7f9bf3125640 1 -- start start 2024-09-19T06:48:14.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.603+0000 7f9bf3125640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9bec0fb490 0x7f9bec0f74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:14.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.603+0000 7f9bf3125640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9bec1014d0 0x7f9bec0f79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:14.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.603+0000 7f9bf3125640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bec0f7fc0 con 0x7f9bec1014d0 2024-09-19T06:48:14.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.603+0000 7f9bf3125640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bec0f8130 con 0x7f9bec0fb490 2024-09-19T06:48:14.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.603+0000 7f9bebfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9bec1014d0 0x7f9bec0f79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:14.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.603+0000 7f9bebfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9bec1014d0 0x7f9bec0f79f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:39630/0 (socket says 172.21.15.99:39630) 2024-09-19T06:48:14.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.603+0000 7f9bebfff640 1 -- 172.21.15.99:0/1837817492 learned_addr learned my addr 172.21.15.99:0/1837817492 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:48:14.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.603+0000 7f9bf0ec1640 1 --2- 172.21.15.99:0/1837817492 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9bec0fb490 0x7f9bec0f74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:14.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.604+0000 7f9bebfff640 1 -- 172.21.15.99:0/1837817492 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9bec0fb490 msgr2=0x7f9bec0f74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:14.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.604+0000 7f9bebfff640 1 --2- 172.21.15.99:0/1837817492 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9bec0fb490 0x7f9bec0f74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:14.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.604+0000 7f9bebfff640 1 -- 172.21.15.99:0/1837817492 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9be4005040 con 0x7f9bec1014d0 2024-09-19T06:48:14.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.604+0000 7f9bebfff640 1 --2- 172.21.15.99:0/1837817492 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9bec1014d0 0x7f9bec0f79f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc00bbb0 tx=0x7f9bdc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:14.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.604+0000 7f9be97fa640 1 -- 172.21.15.99:0/1837817492 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9bdc00c9c0 con 0x7f9bec1014d0 2024-09-19T06:48:14.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.604+0000 7f9be97fa640 1 -- 172.21.15.99:0/1837817492 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9bdc0092e0 con 0x7f9bec1014d0 2024-09-19T06:48:14.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.604+0000 7f9bf3125640 1 -- 172.21.15.99:0/1837817492 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bec1195c0 con 0x7f9bec1014d0 2024-09-19T06:48:14.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.604+0000 7f9be97fa640 1 -- 172.21.15.99:0/1837817492 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9bdc007640 con 0x7f9bec1014d0 2024-09-19T06:48:14.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.604+0000 7f9bf3125640 1 -- 172.21.15.99:0/1837817492 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bec119a00 con 0x7f9bec1014d0 2024-09-19T06:48:14.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.605+0000 7f9bf3125640 1 -- 172.21.15.99:0/1837817492 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bec0fcbd0 con 0x7f9bec1014d0 2024-09-19T06:48:14.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.605+0000 7f9be97fa640 1 -- 172.21.15.99:0/1837817492 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f9bdc012070 con 0x7f9bec1014d0 2024-09-19T06:48:14.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.606+0000 7f9be97fa640 1 --2- 172.21.15.99:0/1837817492 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f9bd806e530 0x7f9bd80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:14.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.606+0000 7f9be97fa640 1 -- 172.21.15.99:0/1837817492 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f9bdc08e130 con 0x7f9bec1014d0 2024-09-19T06:48:14.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.606+0000 7f9bf0ec1640 1 --2- 172.21.15.99:0/1837817492 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f9bd806e530 0x7f9bd80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:14.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.607+0000 7f9bf0ec1640 1 --2- 172.21.15.99:0/1837817492 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f9bd806e530 0x7f9bd80709e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9be4009ac0 tx=0x7f9be4035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:14.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.610+0000 7f9be97fa640 1 -- 172.21.15.99:0/1837817492 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f9bdc0572a0 con 0x7f9bec1014d0 2024-09-19T06:48:14.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.862+0000 7f9bf3125640 1 -- 172.21.15.99:0/1837817492 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9bec108500 con 0x7f9bec1014d0 2024-09-19T06:48:14.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.862+0000 7f9be97fa640 1 -- 172.21.15.99:0/1837817492 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+849 (secure 0 0 0) 0x7f9bdc05a960 con 0x7f9bec1014d0 2024-09-19T06:48:14.864 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:48:14.864 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-09-19T06:48:14.864 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T06:48:14.864 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:48:14.864 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-09-19T06:48:14.864 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T06:48:14.864 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:48:14.864 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-09-19T06:48:14.864 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 6 2024-09-19T06:48:14.864 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:48:14.865 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": { 2024-09-19T06:48:14.865 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 2, 2024-09-19T06:48:14.865 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 1 2024-09-19T06:48:14.865 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:48:14.865 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-09-19T06:48:14.865 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 17.2.7-1637-g6e06d1e0 (6e06d1e002b6603c076b9260a58131a040dabe75) quincy (stable)": 2, 2024-09-19T06:48:14.865 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 11 2024-09-19T06:48:14.865 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T06:48:14.865 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:48:14.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.865+0000 7f9bf3125640 1 -- 172.21.15.99:0/1837817492 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f9bd806e530 msgr2=0x7f9bd80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:14.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.865+0000 7f9bf3125640 1 --2- 172.21.15.99:0/1837817492 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f9bd806e530 0x7f9bd80709e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9be4009ac0 tx=0x7f9be4035040 comp rx=0 tx=0).stop 2024-09-19T06:48:14.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.865+0000 7f9bf3125640 1 -- 172.21.15.99:0/1837817492 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9bec1014d0 msgr2=0x7f9bec0f79f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:14.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.865+0000 7f9bf3125640 1 --2- 172.21.15.99:0/1837817492 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9bec1014d0 0x7f9bec0f79f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc00bbb0 tx=0x7f9bdc009840 comp rx=0 tx=0).stop 2024-09-19T06:48:14.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.865+0000 7f9bf3125640 1 -- 172.21.15.99:0/1837817492 shutdown_connections 2024-09-19T06:48:14.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.865+0000 7f9bf3125640 1 --2- 172.21.15.99:0/1837817492 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f9bd806e530 0x7f9bd80709e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:14.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.865+0000 7f9bf3125640 1 --2- 172.21.15.99:0/1837817492 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9bec1014d0 0x7f9bec0f79f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:14.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.865+0000 7f9bf3125640 1 --2- 172.21.15.99:0/1837817492 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9bec0fb490 0x7f9bec0f74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:14.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.865+0000 7f9bf3125640 1 -- 172.21.15.99:0/1837817492 >> 172.21.15.99:0/1837817492 conn(0x7f9bec0f7010 msgr2=0x7f9bec1052c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:14.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.865+0000 7f9bf3125640 1 -- 172.21.15.99:0/1837817492 shutdown_connections 2024-09-19T06:48:14.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.865+0000 7f9bf3125640 1 -- 172.21.15.99:0/1837817492 wait complete. 2024-09-19T06:48:14.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.947+0000 7f714151a640 1 -- 172.21.15.99:0/634404303 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f713c0fb470 msgr2=0x7f713c0fb8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:14.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.947+0000 7f714151a640 1 --2- 172.21.15.99:0/634404303 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f713c0fb470 0x7f713c0fb8e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f71240048d0 tx=0x7f7124009da0 comp rx=0 tx=0).stop 2024-09-19T06:48:14.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.947+0000 7f714151a640 1 -- 172.21.15.99:0/634404303 shutdown_connections 2024-09-19T06:48:14.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.947+0000 7f714151a640 1 --2- 172.21.15.99:0/634404303 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f713c0fb470 0x7f713c0fb8e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:14.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.947+0000 7f714151a640 1 --2- 172.21.15.99:0/634404303 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f713c1014b0 0x7f713c101880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:14.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.947+0000 7f714151a640 1 -- 172.21.15.99:0/634404303 >> 172.21.15.99:0/634404303 conn(0x7f713c0f7030 msgr2=0x7f713c0f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:14.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.947+0000 7f714151a640 1 -- 172.21.15.99:0/634404303 shutdown_connections 2024-09-19T06:48:14.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.947+0000 7f714151a640 1 -- 172.21.15.99:0/634404303 wait complete. 2024-09-19T06:48:14.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.947+0000 7f714151a640 1 Processor -- start 2024-09-19T06:48:14.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.947+0000 7f714151a640 1 -- start start 2024-09-19T06:48:14.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.948+0000 7f714151a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f713c0fb470 0x7f713c112080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:14.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.948+0000 7f714151a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f713c1014b0 0x7f713c1125c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:14.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.948+0000 7f714151a640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f713c112c50 con 0x7f713c1014b0 2024-09-19T06:48:14.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.948+0000 7f714151a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f713c10c040 con 0x7f713c0fb470 2024-09-19T06:48:14.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.948+0000 7f7133fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f713c1014b0 0x7f713c1125c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:14.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.948+0000 7f7133fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f713c1014b0 0x7f713c1125c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:39644/0 (socket says 172.21.15.99:39644) 2024-09-19T06:48:14.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.948+0000 7f7133fff640 1 -- 172.21.15.99:0/783898965 learned_addr learned my addr 172.21.15.99:0/783898965 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:48:14.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.948+0000 7f713affd640 1 --2- 172.21.15.99:0/783898965 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f713c0fb470 0x7f713c112080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:14.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.948+0000 7f7133fff640 1 -- 172.21.15.99:0/783898965 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f713c0fb470 msgr2=0x7f713c112080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:14.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.948+0000 7f7133fff640 1 --2- 172.21.15.99:0/783898965 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f713c0fb470 0x7f713c112080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:14.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.948+0000 7f7133fff640 1 -- 172.21.15.99:0/783898965 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7124005040 con 0x7f713c1014b0 2024-09-19T06:48:14.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.948+0000 7f7133fff640 1 --2- 172.21.15.99:0/783898965 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f713c1014b0 0x7f713c1125c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7124003080 tx=0x7f7124009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:14.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.948+0000 7f71337fe640 1 -- 172.21.15.99:0/783898965 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7124038070 con 0x7f713c1014b0 2024-09-19T06:48:14.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.949+0000 7f71337fe640 1 -- 172.21.15.99:0/783898965 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f71240097e0 con 0x7f713c1014b0 2024-09-19T06:48:14.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.949+0000 7f714151a640 1 -- 172.21.15.99:0/783898965 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f713c10c2c0 con 0x7f713c1014b0 2024-09-19T06:48:14.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.949+0000 7f71337fe640 1 -- 172.21.15.99:0/783898965 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f712403d420 con 0x7f713c1014b0 2024-09-19T06:48:14.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.949+0000 7f714151a640 1 -- 172.21.15.99:0/783898965 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f713c10c780 con 0x7f713c1014b0 2024-09-19T06:48:14.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.950+0000 7f714151a640 1 -- 172.21.15.99:0/783898965 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f713c0fcbb0 con 0x7f713c1014b0 2024-09-19T06:48:14.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.950+0000 7f71337fe640 1 -- 172.21.15.99:0/783898965 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f7124030020 con 0x7f713c1014b0 2024-09-19T06:48:14.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.950+0000 7f71337fe640 1 --2- 172.21.15.99:0/783898965 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f712806e530 0x7f71280709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:14.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.951+0000 7f71337fe640 1 -- 172.21.15.99:0/783898965 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f71240ae720 con 0x7f713c1014b0 2024-09-19T06:48:14.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.951+0000 7f713affd640 1 --2- 172.21.15.99:0/783898965 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f712806e530 0x7f71280709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:14.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.951+0000 7f713affd640 1 --2- 172.21.15.99:0/783898965 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f712806e530 0x7f71280709e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f712c006fd0 tx=0x7f712c008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:14.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:14.955+0000 7f71337fe640 1 -- 172.21.15.99:0/783898965 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f7124077810 con 0x7f713c1014b0 2024-09-19T06:48:15.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.180+0000 7f714151a640 1 -- 172.21.15.99:0/783898965 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f713c0fac30 con 0x7f713c1014b0 2024-09-19T06:48:15.182 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:14 smithi099 ceph-mon[97031]: from='client.34382 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:48:15.182 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:14 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/1837817492' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:48:15.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.180+0000 7f71337fe640 1 -- 172.21.15.99:0/783898965 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) v1 ==== 76+0+1736 (secure 0 0 0) 0x7f712407aed0 con 0x7f713c1014b0 2024-09-19T06:48:15.182 INFO:teuthology.orchestra.run.smithi099.stdout:e24 2024-09-19T06:48:15.182 INFO:teuthology.orchestra.run.smithi099.stdout:btime 2024-09-19T06:48:10:851648+0000 2024-09-19T06:48:15.183 INFO:teuthology.orchestra.run.smithi099.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T06:48:15.183 INFO:teuthology.orchestra.run.smithi099.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T06:48:15.183 INFO:teuthology.orchestra.run.smithi099.stdout:legacy client fscid: 1 2024-09-19T06:48:15.183 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:48:15.183 INFO:teuthology.orchestra.run.smithi099.stdout:Filesystem 'cephfs' (1) 2024-09-19T06:48:15.183 INFO:teuthology.orchestra.run.smithi099.stdout:fs_name cephfs 2024-09-19T06:48:15.183 INFO:teuthology.orchestra.run.smithi099.stdout:epoch 20 2024-09-19T06:48:15.183 INFO:teuthology.orchestra.run.smithi099.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-19T06:48:15.183 INFO:teuthology.orchestra.run.smithi099.stdout:created 2024-09-19T06:37:40.838146+0000 2024-09-19T06:48:15.183 INFO:teuthology.orchestra.run.smithi099.stdout:modified 2024-09-19T06:47:50.076553+0000 2024-09-19T06:48:15.183 INFO:teuthology.orchestra.run.smithi099.stdout:tableserver 0 2024-09-19T06:48:15.183 INFO:teuthology.orchestra.run.smithi099.stdout:root 0 2024-09-19T06:48:15.183 INFO:teuthology.orchestra.run.smithi099.stdout:session_timeout 60 2024-09-19T06:48:15.183 INFO:teuthology.orchestra.run.smithi099.stdout:session_autoclose 300 2024-09-19T06:48:15.184 INFO:teuthology.orchestra.run.smithi099.stdout:max_file_size 1099511627776 2024-09-19T06:48:15.184 INFO:teuthology.orchestra.run.smithi099.stdout:max_xattr_size 65536 2024-09-19T06:48:15.184 INFO:teuthology.orchestra.run.smithi099.stdout:required_client_features {} 2024-09-19T06:48:15.184 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure 0 2024-09-19T06:48:15.184 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure_osd_epoch 77 2024-09-19T06:48:15.184 INFO:teuthology.orchestra.run.smithi099.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T06:48:15.184 INFO:teuthology.orchestra.run.smithi099.stdout:max_mds 2 2024-09-19T06:48:15.184 INFO:teuthology.orchestra.run.smithi099.stdout:in 0,1 2024-09-19T06:48:15.184 INFO:teuthology.orchestra.run.smithi099.stdout:up {} 2024-09-19T06:48:15.184 INFO:teuthology.orchestra.run.smithi099.stdout:failed 0,1 2024-09-19T06:48:15.184 INFO:teuthology.orchestra.run.smithi099.stdout:damaged 2024-09-19T06:48:15.184 INFO:teuthology.orchestra.run.smithi099.stdout:stopped 2024-09-19T06:48:15.184 INFO:teuthology.orchestra.run.smithi099.stdout:data_pools [3] 2024-09-19T06:48:15.184 INFO:teuthology.orchestra.run.smithi099.stdout:metadata_pool 2 2024-09-19T06:48:15.185 INFO:teuthology.orchestra.run.smithi099.stdout:inline_data disabled 2024-09-19T06:48:15.185 INFO:teuthology.orchestra.run.smithi099.stdout:balancer 2024-09-19T06:48:15.185 INFO:teuthology.orchestra.run.smithi099.stdout:bal_rank_mask -1 2024-09-19T06:48:15.185 INFO:teuthology.orchestra.run.smithi099.stdout:standby_count_wanted 1 2024-09-19T06:48:15.185 INFO:teuthology.orchestra.run.smithi099.stdout:qdb_cluster leader: 0 members: 2024-09-19T06:48:15.185 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:48:15.185 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:48:15.185 INFO:teuthology.orchestra.run.smithi099.stdout:Standby daemons: 2024-09-19T06:48:15.185 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:48:15.185 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.bheqzh{-1:24283} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.117:6826/4072877365,v1:172.21.15.117:6827/4072877365] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T06:48:15.185 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.obarqf{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6826/1859154203,v1:172.21.15.99:6827/1859154203] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:48:15.185 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.nooexo{-1:44283} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6824/3050129703,v1:172.21.15.117:6825/3050129703] compat {c=[1],r=[1],i=[7ff]}] 2024-09-19T06:48:15.186 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 24 2024-09-19T06:48:15.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.183+0000 7f714151a640 1 -- 172.21.15.99:0/783898965 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f712806e530 msgr2=0x7f71280709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:15.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.183+0000 7f714151a640 1 --2- 172.21.15.99:0/783898965 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f712806e530 0x7f71280709e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f712c006fd0 tx=0x7f712c008040 comp rx=0 tx=0).stop 2024-09-19T06:48:15.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.183+0000 7f714151a640 1 -- 172.21.15.99:0/783898965 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f713c1014b0 msgr2=0x7f713c1125c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:15.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.183+0000 7f714151a640 1 --2- 172.21.15.99:0/783898965 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f713c1014b0 0x7f713c1125c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7124003080 tx=0x7f7124009da0 comp rx=0 tx=0).stop 2024-09-19T06:48:15.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.183+0000 7f714151a640 1 -- 172.21.15.99:0/783898965 shutdown_connections 2024-09-19T06:48:15.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.183+0000 7f714151a640 1 --2- 172.21.15.99:0/783898965 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f712806e530 0x7f71280709e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:15.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.183+0000 7f714151a640 1 --2- 172.21.15.99:0/783898965 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f713c1014b0 0x7f713c1125c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:15.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.183+0000 7f714151a640 1 --2- 172.21.15.99:0/783898965 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f713c0fb470 0x7f713c112080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:15.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.183+0000 7f714151a640 1 -- 172.21.15.99:0/783898965 >> 172.21.15.99:0/783898965 conn(0x7f713c0f7030 msgr2=0x7f713c0f7400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:15.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.183+0000 7f714151a640 1 -- 172.21.15.99:0/783898965 shutdown_connections 2024-09-19T06:48:15.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.184+0000 7f714151a640 1 -- 172.21.15.99:0/783898965 wait complete. 2024-09-19T06:48:15.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.268+0000 7fd147ecb640 1 -- 172.21.15.99:0/3177526044 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd140064fc0 msgr2=0x7fd140065430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:15.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.268+0000 7fd147ecb640 1 --2- 172.21.15.99:0/3177526044 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd140064fc0 0x7fd140065430 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd1300048d0 tx=0x7fd130009da0 comp rx=0 tx=0).stop 2024-09-19T06:48:15.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.268+0000 7fd147ecb640 1 -- 172.21.15.99:0/3177526044 shutdown_connections 2024-09-19T06:48:15.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.268+0000 7fd147ecb640 1 --2- 172.21.15.99:0/3177526044 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd140064fc0 0x7fd140065430 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:15.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.268+0000 7fd147ecb640 1 --2- 172.21.15.99:0/3177526044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd1400fe460 0x7fd1400fe830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:15.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.268+0000 7fd147ecb640 1 -- 172.21.15.99:0/3177526044 >> 172.21.15.99:0/3177526044 conn(0x7fd1400723b0 msgr2=0x7fd1400727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:15.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.268+0000 7fd147ecb640 1 -- 172.21.15.99:0/3177526044 shutdown_connections 2024-09-19T06:48:15.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.268+0000 7fd147ecb640 1 -- 172.21.15.99:0/3177526044 wait complete. 2024-09-19T06:48:15.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.268+0000 7fd147ecb640 1 Processor -- start 2024-09-19T06:48:15.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.268+0000 7fd147ecb640 1 -- start start 2024-09-19T06:48:15.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.269+0000 7fd147ecb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd140064fc0 0x7fd1401131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:15.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.269+0000 7fd147ecb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd1400fe460 0x7fd140113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:15.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.269+0000 7fd147ecb640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd140113d10 con 0x7fd1400fe460 2024-09-19T06:48:15.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.269+0000 7fd147ecb640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd14010d1a0 con 0x7fd140064fc0 2024-09-19T06:48:15.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.269+0000 7fd145466640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd1400fe460 0x7fd140113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:15.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.269+0000 7fd145466640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd1400fe460 0x7fd140113710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:39660/0 (socket says 172.21.15.99:39660) 2024-09-19T06:48:15.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.269+0000 7fd145466640 1 -- 172.21.15.99:0/2512650735 learned_addr learned my addr 172.21.15.99:0/2512650735 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:48:15.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.269+0000 7fd145c67640 1 --2- 172.21.15.99:0/2512650735 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd140064fc0 0x7fd1401131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:15.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.269+0000 7fd145466640 1 -- 172.21.15.99:0/2512650735 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd140064fc0 msgr2=0x7fd1401131d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:15.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.269+0000 7fd145466640 1 --2- 172.21.15.99:0/2512650735 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd140064fc0 0x7fd1401131d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:15.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.269+0000 7fd145466640 1 -- 172.21.15.99:0/2512650735 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd130005040 con 0x7fd1400fe460 2024-09-19T06:48:15.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.269+0000 7fd145466640 1 --2- 172.21.15.99:0/2512650735 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd1400fe460 0x7fd140113710 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd1300043d0 tx=0x7fd130009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:15.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.270+0000 7fd1367fc640 1 -- 172.21.15.99:0/2512650735 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd130038070 con 0x7fd1400fe460 2024-09-19T06:48:15.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.270+0000 7fd1367fc640 1 -- 172.21.15.99:0/2512650735 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd1300096e0 con 0x7fd1400fe460 2024-09-19T06:48:15.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.270+0000 7fd147ecb640 1 -- 172.21.15.99:0/2512650735 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd14010d420 con 0x7fd1400fe460 2024-09-19T06:48:15.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.270+0000 7fd1367fc640 1 -- 172.21.15.99:0/2512650735 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd13003d420 con 0x7fd1400fe460 2024-09-19T06:48:15.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.270+0000 7fd147ecb640 1 -- 172.21.15.99:0/2512650735 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd14010d9c0 con 0x7fd1400fe460 2024-09-19T06:48:15.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.271+0000 7fd147ecb640 1 -- 172.21.15.99:0/2512650735 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1400fdcf0 con 0x7fd1400fe460 2024-09-19T06:48:15.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.271+0000 7fd1367fc640 1 -- 172.21.15.99:0/2512650735 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fd130030020 con 0x7fd1400fe460 2024-09-19T06:48:15.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.272+0000 7fd1367fc640 1 --2- 172.21.15.99:0/2512650735 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd12c06e530 0x7fd12c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:15.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.272+0000 7fd1367fc640 1 -- 172.21.15.99:0/2512650735 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fd1300ae5f0 con 0x7fd1400fe460 2024-09-19T06:48:15.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.272+0000 7fd145c67640 1 --2- 172.21.15.99:0/2512650735 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd12c06e530 0x7fd12c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:15.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.272+0000 7fd145c67640 1 --2- 172.21.15.99:0/2512650735 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd12c06e530 0x7fd12c0709e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd13c007fd0 tx=0x7fd13c009e90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:15.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.276+0000 7fd1367fc640 1 -- 172.21.15.99:0/2512650735 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fd130077760 con 0x7fd1400fe460 2024-09-19T06:48:15.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:14 smithi117 ceph-mon[76771]: from='client.34382 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:48:15.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:14 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/1837817492' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:48:15.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.473+0000 7fd147ecb640 1 -- 172.21.15.99:0/2512650735 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd14010e840 con 0x7fd12c06e530 2024-09-19T06:48:15.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.475+0000 7fd1367fc640 1 -- 172.21.15.99:0/2512650735 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fd14010e840 con 0x7fd12c06e530 2024-09-19T06:48:15.476 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:48:15.477 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T06:48:15.477 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": true, 2024-09-19T06:48:15.477 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T06:48:15.477 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [ 2024-09-19T06:48:15.477 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr", 2024-09-19T06:48:15.477 INFO:teuthology.orchestra.run.smithi099.stdout: "osd", 2024-09-19T06:48:15.477 INFO:teuthology.orchestra.run.smithi099.stdout: "crash", 2024-09-19T06:48:15.477 INFO:teuthology.orchestra.run.smithi099.stdout: "mon" 2024-09-19T06:48:15.477 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-19T06:48:15.477 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": "13/21 daemons upgraded", 2024-09-19T06:48:15.477 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "Currently upgrading mds daemons", 2024-09-19T06:48:15.477 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-09-19T06:48:15.477 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:48:15.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.477+0000 7fd147ecb640 1 -- 172.21.15.99:0/2512650735 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd12c06e530 msgr2=0x7fd12c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:15.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.477+0000 7fd147ecb640 1 --2- 172.21.15.99:0/2512650735 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd12c06e530 0x7fd12c0709e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd13c007fd0 tx=0x7fd13c009e90 comp rx=0 tx=0).stop 2024-09-19T06:48:15.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.477+0000 7fd147ecb640 1 -- 172.21.15.99:0/2512650735 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd1400fe460 msgr2=0x7fd140113710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:15.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.477+0000 7fd147ecb640 1 --2- 172.21.15.99:0/2512650735 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd1400fe460 0x7fd140113710 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd1300043d0 tx=0x7fd130009da0 comp rx=0 tx=0).stop 2024-09-19T06:48:15.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.477+0000 7fd147ecb640 1 -- 172.21.15.99:0/2512650735 shutdown_connections 2024-09-19T06:48:15.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.477+0000 7fd147ecb640 1 --2- 172.21.15.99:0/2512650735 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd12c06e530 0x7fd12c0709e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:15.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.477+0000 7fd147ecb640 1 --2- 172.21.15.99:0/2512650735 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd1400fe460 0x7fd140113710 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:15.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.477+0000 7fd147ecb640 1 --2- 172.21.15.99:0/2512650735 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd140064fc0 0x7fd1401131d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:15.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.477+0000 7fd147ecb640 1 -- 172.21.15.99:0/2512650735 >> 172.21.15.99:0/2512650735 conn(0x7fd1400723b0 msgr2=0x7fd1401053f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:15.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.477+0000 7fd147ecb640 1 -- 172.21.15.99:0/2512650735 shutdown_connections 2024-09-19T06:48:15.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.477+0000 7fd147ecb640 1 -- 172.21.15.99:0/2512650735 wait complete. 2024-09-19T06:48:15.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.558+0000 7f12af596640 1 -- 172.21.15.99:0/2446449852 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12a8102550 msgr2=0x7f12a8102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:15.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.558+0000 7f12af596640 1 --2- 172.21.15.99:0/2446449852 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12a8102550 0x7f12a8102920 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f12a40048d0 tx=0x7f12a4009da0 comp rx=0 tx=0).stop 2024-09-19T06:48:15.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.558+0000 7f12af596640 1 -- 172.21.15.99:0/2446449852 shutdown_connections 2024-09-19T06:48:15.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.558+0000 7f12af596640 1 --2- 172.21.15.99:0/2446449852 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f12a8102ef0 0x7f12a80fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:15.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.558+0000 7f12af596640 1 --2- 172.21.15.99:0/2446449852 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12a8102550 0x7f12a8102920 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:15.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.558+0000 7f12af596640 1 -- 172.21.15.99:0/2446449852 >> 172.21.15.99:0/2446449852 conn(0x7f12a80f80f0 msgr2=0x7f12a80fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:15.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.559+0000 7f12af596640 1 -- 172.21.15.99:0/2446449852 shutdown_connections 2024-09-19T06:48:15.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.559+0000 7f12af596640 1 -- 172.21.15.99:0/2446449852 wait complete. 2024-09-19T06:48:15.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.559+0000 7f12af596640 1 Processor -- start 2024-09-19T06:48:15.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.559+0000 7f12af596640 1 -- start start 2024-09-19T06:48:15.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.559+0000 7f12af596640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f12a8102550 0x7f12a8113570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:15.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.559+0000 7f12af596640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12a8102ef0 0x7f12a8113ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:15.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.559+0000 7f12af596640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a8114100 con 0x7f12a8102ef0 2024-09-19T06:48:15.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.559+0000 7f12af596640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a810d510 con 0x7f12a8102550 2024-09-19T06:48:15.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.560+0000 7f12acb31640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12a8102ef0 0x7f12a8113ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:15.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.560+0000 7f12acb31640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12a8102ef0 0x7f12a8113ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54276/0 (socket says 172.21.15.99:54276) 2024-09-19T06:48:15.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.560+0000 7f12acb31640 1 -- 172.21.15.99:0/2699409811 learned_addr learned my addr 172.21.15.99:0/2699409811 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:48:15.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.560+0000 7f12ad332640 1 --2- 172.21.15.99:0/2699409811 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f12a8102550 0x7f12a8113570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:15.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.560+0000 7f12acb31640 1 -- 172.21.15.99:0/2699409811 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f12a8102550 msgr2=0x7f12a8113570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:15.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.560+0000 7f12acb31640 1 --2- 172.21.15.99:0/2699409811 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f12a8102550 0x7f12a8113570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:15.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.560+0000 7f12acb31640 1 -- 172.21.15.99:0/2699409811 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a4005040 con 0x7f12a8102ef0 2024-09-19T06:48:15.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.560+0000 7f12acb31640 1 --2- 172.21.15.99:0/2699409811 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12a8102ef0 0x7f12a8113ab0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f129800c760 tx=0x7f129800cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:15.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.560+0000 7f129dffb640 1 -- 172.21.15.99:0/2699409811 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f129800a7a0 con 0x7f12a8102ef0 2024-09-19T06:48:15.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.560+0000 7f12af596640 1 -- 172.21.15.99:0/2699409811 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12a810d7f0 con 0x7f12a8102ef0 2024-09-19T06:48:15.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.560+0000 7f129dffb640 1 -- 172.21.15.99:0/2699409811 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f129800ada0 con 0x7f12a8102ef0 2024-09-19T06:48:15.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.560+0000 7f129dffb640 1 -- 172.21.15.99:0/2699409811 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12980113a0 con 0x7f12a8102ef0 2024-09-19T06:48:15.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.560+0000 7f12af596640 1 -- 172.21.15.99:0/2699409811 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12a810dd90 con 0x7f12a8102ef0 2024-09-19T06:48:15.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.562+0000 7f12af596640 1 -- 172.21.15.99:0/2699409811 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12a80fdcd0 con 0x7f12a8102ef0 2024-09-19T06:48:15.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.562+0000 7f129dffb640 1 -- 172.21.15.99:0/2699409811 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f1298012400 con 0x7f12a8102ef0 2024-09-19T06:48:15.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.562+0000 7f129dffb640 1 --2- 172.21.15.99:0/2699409811 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f129406e530 0x7f12940709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:15.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.562+0000 7f129dffb640 1 -- 172.21.15.99:0/2699409811 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f129808e2a0 con 0x7f12a8102ef0 2024-09-19T06:48:15.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.562+0000 7f12ad332640 1 --2- 172.21.15.99:0/2699409811 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f129406e530 0x7f12940709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:15.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.563+0000 7f12ad332640 1 --2- 172.21.15.99:0/2699409811 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f129406e530 0x7f12940709e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f12a4009ac0 tx=0x7f12a4035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:15.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.567+0000 7f129dffb640 1 -- 172.21.15.99:0/2699409811 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f1298057410 con 0x7f12a8102ef0 2024-09-19T06:48:15.815 INFO:teuthology.orchestra.run.smithi099.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-09-19T06:48:15.815 INFO:teuthology.orchestra.run.smithi099.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-19T06:48:15.815 INFO:teuthology.orchestra.run.smithi099.stdout: fs cephfs is degraded 2024-09-19T06:48:15.815 INFO:teuthology.orchestra.run.smithi099.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-19T06:48:15.815 INFO:teuthology.orchestra.run.smithi099.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-19T06:48:15.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.813+0000 7f12af596640 1 -- 172.21.15.99:0/2699409811 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f12a81095a0 con 0x7f12a8102ef0 2024-09-19T06:48:15.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.813+0000 7f129dffb640 1 -- 172.21.15.99:0/2699409811 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7f129805aad0 con 0x7f12a8102ef0 2024-09-19T06:48:15.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.815+0000 7f12af596640 1 -- 172.21.15.99:0/2699409811 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f129406e530 msgr2=0x7f12940709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:15.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.815+0000 7f12af596640 1 --2- 172.21.15.99:0/2699409811 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f129406e530 0x7f12940709e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f12a4009ac0 tx=0x7f12a4035040 comp rx=0 tx=0).stop 2024-09-19T06:48:15.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.815+0000 7f12af596640 1 -- 172.21.15.99:0/2699409811 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12a8102ef0 msgr2=0x7f12a8113ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:15.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.815+0000 7f12af596640 1 --2- 172.21.15.99:0/2699409811 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12a8102ef0 0x7f12a8113ab0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f129800c760 tx=0x7f129800cb60 comp rx=0 tx=0).stop 2024-09-19T06:48:15.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.816+0000 7f12af596640 1 -- 172.21.15.99:0/2699409811 shutdown_connections 2024-09-19T06:48:15.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.816+0000 7f12af596640 1 --2- 172.21.15.99:0/2699409811 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f129406e530 0x7f12940709e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:15.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.816+0000 7f12af596640 1 --2- 172.21.15.99:0/2699409811 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12a8102ef0 0x7f12a8113ab0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:15.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.816+0000 7f12af596640 1 --2- 172.21.15.99:0/2699409811 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f12a8102550 0x7f12a8113570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:15.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.816+0000 7f12af596640 1 -- 172.21.15.99:0/2699409811 >> 172.21.15.99:0/2699409811 conn(0x7f12a80f80f0 msgr2=0x7f12a80f90b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:15.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.816+0000 7f12af596640 1 -- 172.21.15.99:0/2699409811 shutdown_connections 2024-09-19T06:48:15.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:15.816+0000 7f12af596640 1 -- 172.21.15.99:0/2699409811 wait complete. 2024-09-19T06:48:16.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:15 smithi099 ceph-mon[97031]: from='client.34386 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:48:16.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:15 smithi099 ceph-mon[97031]: from='client.34390 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:48:16.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:15 smithi099 ceph-mon[97031]: pgmap v175: 65 pgs: 65 active+clean; 254 MiB data, 977 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:48:16.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:15 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/783898965' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:48:16.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:15 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/2699409811' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T06:48:16.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:15 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:16.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:15 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:16.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:15 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:48:16.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:15 smithi117 ceph-mon[76771]: from='client.34386 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:48:16.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:15 smithi117 ceph-mon[76771]: from='client.34390 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:48:16.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:15 smithi117 ceph-mon[76771]: pgmap v175: 65 pgs: 65 active+clean; 254 MiB data, 977 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:48:16.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:15 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/783898965' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:48:16.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:15 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/2699409811' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T06:48:16.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:15 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:16.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:15 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:16.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:15 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:48:17.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:16 smithi099 ceph-mon[97031]: from='client.34402 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:48:17.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:16 smithi099 ceph-mon[97031]: mds.? [v2:172.21.15.99:6828/1939453719,v1:172.21.15.99:6829/1939453719] up:boot 2024-09-19T06:48:17.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:16 smithi099 ceph-mon[97031]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-19T06:48:17.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:16 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi099.xehbxe"}]: dispatch 2024-09-19T06:48:17.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:16 smithi117 ceph-mon[76771]: from='client.34402 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:48:17.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:16 smithi117 ceph-mon[76771]: mds.? [v2:172.21.15.99:6828/1939453719,v1:172.21.15.99:6829/1939453719] up:boot 2024-09-19T06:48:17.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:16 smithi117 ceph-mon[76771]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-19T06:48:17.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:16 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi099.xehbxe"}]: dispatch 2024-09-19T06:48:18.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:17 smithi099 ceph-mon[97031]: pgmap v176: 65 pgs: 65 active+clean; 254 MiB data, 977 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:48:18.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:17 smithi117 ceph-mon[76771]: pgmap v176: 65 pgs: 65 active+clean; 254 MiB data, 977 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:48:20.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:19 smithi099 ceph-mon[97031]: pgmap v177: 65 pgs: 65 active+clean; 254 MiB data, 977 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:48:20.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:19 smithi117 ceph-mon[76771]: pgmap v177: 65 pgs: 65 active+clean; 254 MiB data, 977 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:48:21.383 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:21 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:21.383 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:21 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:21.384 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:21 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:21.384 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:21 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:21.384 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:21 smithi099 ceph-mon[97031]: pgmap v178: 65 pgs: 65 active+clean; 254 MiB data, 977 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:48:21.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:21 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:21.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:21 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:21.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:21 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:21.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:21 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:21.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:21 smithi117 ceph-mon[76771]: pgmap v178: 65 pgs: 65 active+clean; 254 MiB data, 977 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:48:22.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:22 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:48:23.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:22 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:48:23.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:23 smithi099 ceph-mon[97031]: pgmap v179: 65 pgs: 65 active+clean; 254 MiB data, 977 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:48:24.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:23 smithi117 ceph-mon[76771]: pgmap v179: 65 pgs: 65 active+clean; 254 MiB data, 977 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:48:25.207 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:25 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:25.207 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:25 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:25.208 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:25 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:48:25.208 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:25 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:48:25.208 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:25 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:25.208 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:25 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:48:25.208 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:25 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:48:25.208 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:25 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:48:25.208 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:25 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:48:25.208 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:25 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:48:25.208 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:25 smithi117 ceph-mon[76771]: pgmap v180: 65 pgs: 65 active+clean; 254 MiB data, 977 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:48:25.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:25 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:25.461 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:25 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:25.461 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:25 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:48:25.461 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:25 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:48:25.461 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:25 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:25.461 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:25 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:48:25.461 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:25 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:48:25.461 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:25 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:48:25.461 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:25 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:48:25.461 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:25 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:48:25.461 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:25 smithi099 ceph-mon[97031]: pgmap v180: 65 pgs: 65 active+clean; 254 MiB data, 977 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:48:26.811 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:26 smithi117 ceph-mon[76771]: Upgrade: Updating mds.cephfs.smithi117.nooexo 2024-09-19T06:48:26.811 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:26 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:26.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:26 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi117.nooexo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:48:26.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:26 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:48:26.812 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:26 smithi117 ceph-mon[76771]: Deploying daemon mds.cephfs.smithi117.nooexo on smithi117 2024-09-19T06:48:26.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:26 smithi099 ceph-mon[97031]: Upgrade: Updating mds.cephfs.smithi117.nooexo 2024-09-19T06:48:26.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:26 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:26.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:26 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi117.nooexo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:48:26.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:26 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:48:26.957 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:26 smithi099 ceph-mon[97031]: Deploying daemon mds.cephfs.smithi117.nooexo on smithi117 2024-09-19T06:48:27.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:27 smithi099 ceph-mon[97031]: pgmap v181: 65 pgs: 65 active+clean; 254 MiB data, 977 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:48:28.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:27 smithi117 ceph-mon[76771]: pgmap v181: 65 pgs: 65 active+clean; 254 MiB data, 977 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:48:28.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:28 smithi099 ceph-mon[97031]: osdmap e82: 6 total, 6 up, 6 in 2024-09-19T06:48:28.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:28 smithi099 ceph-mon[97031]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-19T06:48:29.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:28 smithi117 ceph-mon[76771]: osdmap e82: 6 total, 6 up, 6 in 2024-09-19T06:48:29.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:28 smithi117 ceph-mon[76771]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-19T06:48:29.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:29 smithi099 ceph-mon[97031]: pgmap v183: 65 pgs: 65 active+clean; 254 MiB data, 977 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:48:30.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:29 smithi117 ceph-mon[76771]: pgmap v183: 65 pgs: 65 active+clean; 254 MiB data, 977 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:48:32.208 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:31 smithi099 ceph-mon[97031]: pgmap v184: 65 pgs: 65 active+clean; 254 MiB data, 977 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:48:32.208 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:31 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:32.209 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:31 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:32.209 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:31 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:48:32.286 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:31 smithi117 ceph-mon[76771]: pgmap v184: 65 pgs: 65 active+clean; 254 MiB data, 977 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:48:32.286 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:31 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:32.286 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:31 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:32.286 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:31 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:48:33.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:32 smithi099 ceph-mon[97031]: mds.? [v2:172.21.15.117:6824/1398895079,v1:172.21.15.117:6825/1398895079] up:boot 2024-09-19T06:48:33.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:32 smithi099 ceph-mon[97031]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-19T06:48:33.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:32 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi117.nooexo"}]: dispatch 2024-09-19T06:48:33.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:32 smithi117 ceph-mon[76771]: mds.? [v2:172.21.15.117:6824/1398895079,v1:172.21.15.117:6825/1398895079] up:boot 2024-09-19T06:48:33.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:32 smithi117 ceph-mon[76771]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-19T06:48:33.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:32 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi117.nooexo"}]: dispatch 2024-09-19T06:48:34.042 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:33 smithi117 ceph-mon[76771]: pgmap v185: 65 pgs: 65 active+clean; 254 MiB data, 977 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:48:34.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:33 smithi099 ceph-mon[97031]: pgmap v185: 65 pgs: 65 active+clean; 254 MiB data, 977 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:48:35.861 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:35 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:35.861 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:35 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:35.861 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:35 smithi117 ceph-mon[76771]: pgmap v186: 65 pgs: 65 active+clean; 254 MiB data, 977 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:48:35.862 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:35 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:35.862 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:35 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:35.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:35 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:35.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:35 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:35.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:35 smithi099 ceph-mon[97031]: pgmap v186: 65 pgs: 65 active+clean; 254 MiB data, 977 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:48:35.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:35 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:35.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:35 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:37.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:36 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:48:37.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:36 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:48:38.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:37 smithi099 ceph-mon[97031]: pgmap v187: 65 pgs: 65 active+clean; 254 MiB data, 977 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:48:38.212 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:37 smithi117 ceph-mon[76771]: pgmap v187: 65 pgs: 65 active+clean; 254 MiB data, 977 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:48:39.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:39 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:39.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:39 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:39.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:39 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:48:39.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:39 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:48:39.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:39 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:39.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:39 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:48:39.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:39 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:48:39.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:39 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:48:39.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:39 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:48:39.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:39 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:48:39.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:39 smithi117 ceph-mon[76771]: pgmap v188: 65 pgs: 65 active+clean; 254 MiB data, 977 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:48:39.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:39 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:39.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:39 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:39.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:39 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:48:39.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:39 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T06:48:39.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:39 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:39.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:39 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:48:39.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:39 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:48:39.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:39 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:48:39.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:39 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:48:39.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:39 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:48:39.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:39 smithi099 ceph-mon[97031]: pgmap v188: 65 pgs: 65 active+clean; 254 MiB data, 977 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:48:40.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:40 smithi099 ceph-mon[97031]: Upgrade: Updating mds.cephfs.smithi117.bheqzh 2024-09-19T06:48:40.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:40 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:40.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:40 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi117.bheqzh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:48:40.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:40 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:48:40.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:40 smithi099 ceph-mon[97031]: Deploying daemon mds.cephfs.smithi117.bheqzh on smithi117 2024-09-19T06:48:41.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:40 smithi117 ceph-mon[76771]: Upgrade: Updating mds.cephfs.smithi117.bheqzh 2024-09-19T06:48:41.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:40 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:41.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:40 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi117.bheqzh", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T06:48:41.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:40 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T06:48:41.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:40 smithi117 ceph-mon[76771]: Deploying daemon mds.cephfs.smithi117.bheqzh on smithi117 2024-09-19T06:48:42.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:41 smithi117 ceph-mon[76771]: pgmap v189: 65 pgs: 65 active+clean; 254 MiB data, 977 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:48:42.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:41 smithi099 ceph-mon[97031]: pgmap v189: 65 pgs: 65 active+clean; 254 MiB data, 977 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:48:43.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:42 smithi117 ceph-mon[76771]: osdmap e83: 6 total, 6 up, 6 in 2024-09-19T06:48:43.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:42 smithi117 ceph-mon[76771]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-19T06:48:43.149 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:42 smithi099 ceph-mon[97031]: osdmap e83: 6 total, 6 up, 6 in 2024-09-19T06:48:43.149 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:42 smithi099 ceph-mon[97031]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-19T06:48:44.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:43 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi117.bheqzh"}]: dispatch 2024-09-19T06:48:44.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:43 smithi117 ceph-mon[76771]: pgmap v191: 65 pgs: 65 active+clean; 254 MiB data, 977 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:48:44.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:43 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi117.bheqzh"}]: dispatch 2024-09-19T06:48:44.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:43 smithi099 ceph-mon[97031]: pgmap v191: 65 pgs: 65 active+clean; 254 MiB data, 977 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:48:45.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:45.907+0000 7f928d29f640 1 -- 172.21.15.99:0/3377097732 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92880fcf80 msgr2=0x7f92880fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:45.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:45.907+0000 7f928d29f640 1 --2- 172.21.15.99:0/3377097732 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92880fcf80 0x7f92880fd3d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f92700048d0 tx=0x7f9270009da0 comp rx=0 tx=0).stop 2024-09-19T06:48:45.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:45.907+0000 7f928d29f640 1 -- 172.21.15.99:0/3377097732 shutdown_connections 2024-09-19T06:48:45.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:45.907+0000 7f928d29f640 1 --2- 172.21.15.99:0/3377097732 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92880fcf80 0x7f92880fd3d0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:45.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:45.907+0000 7f928d29f640 1 --2- 172.21.15.99:0/3377097732 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92880fb810 0x7f92880fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:45.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:45.907+0000 7f928d29f640 1 -- 172.21.15.99:0/3377097732 >> 172.21.15.99:0/3377097732 conn(0x7f92880723b0 msgr2=0x7f92880727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:45.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:45.907+0000 7f928d29f640 1 -- 172.21.15.99:0/3377097732 shutdown_connections 2024-09-19T06:48:45.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:45.907+0000 7f928d29f640 1 -- 172.21.15.99:0/3377097732 wait complete. 2024-09-19T06:48:45.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:45.907+0000 7f928d29f640 1 Processor -- start 2024-09-19T06:48:45.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:45.908+0000 7f928d29f640 1 -- start start 2024-09-19T06:48:45.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:45.908+0000 7f928d29f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92880fb810 0x7f928810e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:45.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:45.908+0000 7f928d29f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92880fcf80 0x7f928810e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:45.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:45.908+0000 7f928d29f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f928810ecb0 con 0x7f92880fcf80 2024-09-19T06:48:45.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:45.908+0000 7f928d29f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f928810ee20 con 0x7f92880fb810 2024-09-19T06:48:45.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:45.908+0000 7f92867fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92880fcf80 0x7f928810e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:45.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:45.908+0000 7f92867fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92880fcf80 0x7f928810e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56468/0 (socket says 172.21.15.99:56468) 2024-09-19T06:48:45.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:45.908+0000 7f92867fc640 1 -- 172.21.15.99:0/1155123172 learned_addr learned my addr 172.21.15.99:0/1155123172 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:48:45.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:45.908+0000 7f9286ffd640 1 --2- 172.21.15.99:0/1155123172 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92880fb810 0x7f928810e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:45.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:45.908+0000 7f92867fc640 1 -- 172.21.15.99:0/1155123172 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92880fb810 msgr2=0x7f928810e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:45.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:45.908+0000 7f92867fc640 1 --2- 172.21.15.99:0/1155123172 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92880fb810 0x7f928810e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:45.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:45.908+0000 7f92867fc640 1 -- 172.21.15.99:0/1155123172 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9270005040 con 0x7f92880fcf80 2024-09-19T06:48:45.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:45.909+0000 7f92867fc640 1 --2- 172.21.15.99:0/1155123172 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92880fcf80 0x7f928810e6b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9270000c00 tx=0x7f9270009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:45.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:45.909+0000 7f927f7fe640 1 -- 172.21.15.99:0/1155123172 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9270038070 con 0x7f92880fcf80 2024-09-19T06:48:45.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:45.909+0000 7f927f7fe640 1 -- 172.21.15.99:0/1155123172 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f927002ade0 con 0x7f92880fcf80 2024-09-19T06:48:45.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:45.909+0000 7f928d29f640 1 -- 172.21.15.99:0/1155123172 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92881171e0 con 0x7f92880fcf80 2024-09-19T06:48:45.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:45.909+0000 7f927f7fe640 1 -- 172.21.15.99:0/1155123172 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f927002c7e0 con 0x7f92880fcf80 2024-09-19T06:48:45.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:45.909+0000 7f928d29f640 1 -- 172.21.15.99:0/1155123172 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9288117640 con 0x7f92880fcf80 2024-09-19T06:48:45.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:45.910+0000 7f928d29f640 1 -- 172.21.15.99:0/1155123172 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92880fcbc0 con 0x7f92880fcf80 2024-09-19T06:48:45.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:45.910+0000 7f927f7fe640 1 -- 172.21.15.99:0/1155123172 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f9270030020 con 0x7f92880fcf80 2024-09-19T06:48:45.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:45.911+0000 7f927f7fe640 1 --2- 172.21.15.99:0/1155123172 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f927406e530 0x7f92740709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:45.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:45.911+0000 7f927f7fe640 1 -- 172.21.15.99:0/1155123172 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f92700add50 con 0x7f92880fcf80 2024-09-19T06:48:45.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:45.911+0000 7f9286ffd640 1 --2- 172.21.15.99:0/1155123172 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f927406e530 0x7f92740709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:45.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:45.911+0000 7f9286ffd640 1 --2- 172.21.15.99:0/1155123172 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f927406e530 0x7f92740709e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9278004ed0 tx=0x7f927800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:45.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:45.915+0000 7f927f7fe640 1 -- 172.21.15.99:0/1155123172 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f9270076f70 con 0x7f92880fcf80 2024-09-19T06:48:46.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.108+0000 7f928d29f640 1 -- 172.21.15.99:0/1155123172 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f928804b720 con 0x7f927406e530 2024-09-19T06:48:46.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.109+0000 7f927f7fe640 1 -- 172.21.15.99:0/1155123172 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f928804b720 con 0x7f927406e530 2024-09-19T06:48:46.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.111+0000 7f928d29f640 1 -- 172.21.15.99:0/1155123172 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f927406e530 msgr2=0x7f92740709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:46.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.111+0000 7f928d29f640 1 --2- 172.21.15.99:0/1155123172 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f927406e530 0x7f92740709e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9278004ed0 tx=0x7f927800b040 comp rx=0 tx=0).stop 2024-09-19T06:48:46.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.111+0000 7f928d29f640 1 -- 172.21.15.99:0/1155123172 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92880fcf80 msgr2=0x7f928810e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:46.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.111+0000 7f928d29f640 1 --2- 172.21.15.99:0/1155123172 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92880fcf80 0x7f928810e6b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9270000c00 tx=0x7f9270009da0 comp rx=0 tx=0).stop 2024-09-19T06:48:46.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.112+0000 7f928d29f640 1 -- 172.21.15.99:0/1155123172 shutdown_connections 2024-09-19T06:48:46.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.112+0000 7f928d29f640 1 --2- 172.21.15.99:0/1155123172 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f927406e530 0x7f92740709e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:46.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.112+0000 7f928d29f640 1 --2- 172.21.15.99:0/1155123172 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f92880fcf80 0x7f928810e6b0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:46.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.112+0000 7f928d29f640 1 --2- 172.21.15.99:0/1155123172 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92880fb810 0x7f928810e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:46.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.112+0000 7f928d29f640 1 -- 172.21.15.99:0/1155123172 >> 172.21.15.99:0/1155123172 conn(0x7f92880723b0 msgr2=0x7f92880fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:46.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.112+0000 7f928d29f640 1 -- 172.21.15.99:0/1155123172 shutdown_connections 2024-09-19T06:48:46.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.112+0000 7f928d29f640 1 -- 172.21.15.99:0/1155123172 wait complete. 2024-09-19T06:48:46.122 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-09-19T06:48:46.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.191+0000 7f161c64e640 1 -- 172.21.15.99:0/2807796 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f16141014c0 msgr2=0x7f1614101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:46.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.191+0000 7f161c64e640 1 --2- 172.21.15.99:0/2807796 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f16141014c0 0x7f1614101890 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f16100048d0 tx=0x7f1610009da0 comp rx=0 tx=0).stop 2024-09-19T06:48:46.193 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:45 smithi099 ceph-mon[97031]: pgmap v192: 65 pgs: 65 active+clean; 254 MiB data, 977 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:48:46.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.191+0000 7f161c64e640 1 -- 172.21.15.99:0/2807796 shutdown_connections 2024-09-19T06:48:46.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.191+0000 7f161c64e640 1 --2- 172.21.15.99:0/2807796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16140fb480 0x7f16140fb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:46.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.191+0000 7f161c64e640 1 --2- 172.21.15.99:0/2807796 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f16141014c0 0x7f1614101890 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:46.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.191+0000 7f161c64e640 1 -- 172.21.15.99:0/2807796 >> 172.21.15.99:0/2807796 conn(0x7f16140f7020 msgr2=0x7f16140f9430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:46.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.191+0000 7f161c64e640 1 -- 172.21.15.99:0/2807796 shutdown_connections 2024-09-19T06:48:46.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.191+0000 7f161c64e640 1 -- 172.21.15.99:0/2807796 wait complete. 2024-09-19T06:48:46.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.192+0000 7f161c64e640 1 Processor -- start 2024-09-19T06:48:46.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.192+0000 7f161c64e640 1 -- start start 2024-09-19T06:48:46.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.192+0000 7f161c64e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16140fb480 0x7f16141131b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:46.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.192+0000 7f161c64e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f16141014c0 0x7f16141136f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:46.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.192+0000 7f161c64e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1614113cf0 con 0x7f16141014c0 2024-09-19T06:48:46.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.192+0000 7f161c64e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f161410d130 con 0x7f16140fb480 2024-09-19T06:48:46.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.192+0000 7f1619be9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f16141014c0 0x7f16141136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:46.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.192+0000 7f161a3ea640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16140fb480 0x7f16141131b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:46.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.192+0000 7f1619be9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f16141014c0 0x7f16141136f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56486/0 (socket says 172.21.15.99:56486) 2024-09-19T06:48:46.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.192+0000 7f1619be9640 1 -- 172.21.15.99:0/1719683499 learned_addr learned my addr 172.21.15.99:0/1719683499 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:48:46.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.193+0000 7f1619be9640 1 -- 172.21.15.99:0/1719683499 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16140fb480 msgr2=0x7f16141131b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:46.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.193+0000 7f1619be9640 1 --2- 172.21.15.99:0/1719683499 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16140fb480 0x7f16141131b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:46.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.193+0000 7f1619be9640 1 -- 172.21.15.99:0/1719683499 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1610005040 con 0x7f16141014c0 2024-09-19T06:48:46.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.193+0000 7f1619be9640 1 --2- 172.21.15.99:0/1719683499 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f16141014c0 0x7f16141136f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f160400c830 tx=0x7f1604004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:46.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.193+0000 7f160affd640 1 -- 172.21.15.99:0/1719683499 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f160400a7d0 con 0x7f16141014c0 2024-09-19T06:48:46.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.193+0000 7f161c64e640 1 -- 172.21.15.99:0/1719683499 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f161410d410 con 0x7f16141014c0 2024-09-19T06:48:46.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.193+0000 7f160affd640 1 -- 172.21.15.99:0/1719683499 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f160400add0 con 0x7f16141014c0 2024-09-19T06:48:46.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.193+0000 7f160affd640 1 -- 172.21.15.99:0/1719683499 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16040113a0 con 0x7f16141014c0 2024-09-19T06:48:46.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.193+0000 7f161c64e640 1 -- 172.21.15.99:0/1719683499 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f161410d9b0 con 0x7f16141014c0 2024-09-19T06:48:46.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.194+0000 7f161c64e640 1 -- 172.21.15.99:0/1719683499 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16140fcbc0 con 0x7f16141014c0 2024-09-19T06:48:46.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.195+0000 7f160affd640 1 -- 172.21.15.99:0/1719683499 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f1604012400 con 0x7f16141014c0 2024-09-19T06:48:46.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.195+0000 7f160affd640 1 --2- 172.21.15.99:0/1719683499 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f160006e530 0x7f16000709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:46.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.195+0000 7f160affd640 1 -- 172.21.15.99:0/1719683499 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f160408e260 con 0x7f16141014c0 2024-09-19T06:48:46.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.195+0000 7f161a3ea640 1 --2- 172.21.15.99:0/1719683499 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f160006e530 0x7f16000709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:46.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.196+0000 7f161a3ea640 1 --2- 172.21.15.99:0/1719683499 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f160006e530 0x7f16000709e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1610009ac0 tx=0x7f1610035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:46.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.200+0000 7f160affd640 1 -- 172.21.15.99:0/1719683499 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f16040573d0 con 0x7f16141014c0 2024-09-19T06:48:46.214 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:45 smithi117 ceph-mon[76771]: pgmap v192: 65 pgs: 65 active+clean; 254 MiB data, 977 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:48:46.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.382+0000 7f161c64e640 1 -- 172.21.15.99:0/1719683499 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1614108440 con 0x7f160006e530 2024-09-19T06:48:46.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.383+0000 7f160affd640 1 -- 172.21.15.99:0/1719683499 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f1614108440 con 0x7f160006e530 2024-09-19T06:48:46.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.385+0000 7f161c64e640 1 -- 172.21.15.99:0/1719683499 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f160006e530 msgr2=0x7f16000709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:46.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.385+0000 7f161c64e640 1 --2- 172.21.15.99:0/1719683499 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f160006e530 0x7f16000709e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1610009ac0 tx=0x7f1610035040 comp rx=0 tx=0).stop 2024-09-19T06:48:46.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.385+0000 7f161c64e640 1 -- 172.21.15.99:0/1719683499 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f16141014c0 msgr2=0x7f16141136f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:46.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.385+0000 7f161c64e640 1 --2- 172.21.15.99:0/1719683499 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f16141014c0 0x7f16141136f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f160400c830 tx=0x7f1604004430 comp rx=0 tx=0).stop 2024-09-19T06:48:46.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.385+0000 7f161c64e640 1 -- 172.21.15.99:0/1719683499 shutdown_connections 2024-09-19T06:48:46.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.385+0000 7f161c64e640 1 --2- 172.21.15.99:0/1719683499 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f160006e530 0x7f16000709e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:46.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.385+0000 7f161c64e640 1 --2- 172.21.15.99:0/1719683499 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f16141014c0 0x7f16141136f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:46.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.385+0000 7f161c64e640 1 --2- 172.21.15.99:0/1719683499 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16140fb480 0x7f16141131b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:46.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.385+0000 7f161c64e640 1 -- 172.21.15.99:0/1719683499 >> 172.21.15.99:0/1719683499 conn(0x7f16140f7020 msgr2=0x7f1614065a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:46.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.385+0000 7f161c64e640 1 -- 172.21.15.99:0/1719683499 shutdown_connections 2024-09-19T06:48:46.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.385+0000 7f161c64e640 1 -- 172.21.15.99:0/1719683499 wait complete. 2024-09-19T06:48:46.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.463+0000 7fd17cdc5640 1 -- 172.21.15.99:0/2615455418 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd178102550 msgr2=0x7fd178102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:46.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.463+0000 7fd17cdc5640 1 --2- 172.21.15.99:0/2615455418 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd178102550 0x7fd178102920 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd1680048d0 tx=0x7fd168009da0 comp rx=0 tx=0).stop 2024-09-19T06:48:46.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.463+0000 7fd17cdc5640 1 -- 172.21.15.99:0/2615455418 shutdown_connections 2024-09-19T06:48:46.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.463+0000 7fd17cdc5640 1 --2- 172.21.15.99:0/2615455418 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd178102ef0 0x7fd1780fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:46.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.463+0000 7fd17cdc5640 1 --2- 172.21.15.99:0/2615455418 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd178102550 0x7fd178102920 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:46.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.463+0000 7fd17cdc5640 1 -- 172.21.15.99:0/2615455418 >> 172.21.15.99:0/2615455418 conn(0x7fd1780f80f0 msgr2=0x7fd1780fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:46.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.463+0000 7fd17cdc5640 1 -- 172.21.15.99:0/2615455418 shutdown_connections 2024-09-19T06:48:46.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.463+0000 7fd17cdc5640 1 -- 172.21.15.99:0/2615455418 wait complete. 2024-09-19T06:48:46.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.464+0000 7fd17cdc5640 1 Processor -- start 2024-09-19T06:48:46.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.464+0000 7fd17cdc5640 1 -- start start 2024-09-19T06:48:46.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.464+0000 7fd17cdc5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd178102550 0x7fd178113540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:46.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.464+0000 7fd17cdc5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd178102ef0 0x7fd178113a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:46.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.464+0000 7fd17cdc5640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1781140d0 con 0x7fd178102ef0 2024-09-19T06:48:46.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.464+0000 7fd17cdc5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd17810d4e0 con 0x7fd178102550 2024-09-19T06:48:46.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.464+0000 7fd175d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd178102ef0 0x7fd178113a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:46.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.464+0000 7fd175d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd178102ef0 0x7fd178113a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56504/0 (socket says 172.21.15.99:56504) 2024-09-19T06:48:46.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.464+0000 7fd175d9b640 1 -- 172.21.15.99:0/3157993838 learned_addr learned my addr 172.21.15.99:0/3157993838 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:48:46.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.464+0000 7fd17659c640 1 --2- 172.21.15.99:0/3157993838 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd178102550 0x7fd178113540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:46.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.465+0000 7fd175d9b640 1 -- 172.21.15.99:0/3157993838 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd178102550 msgr2=0x7fd178113540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:46.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.465+0000 7fd175d9b640 1 --2- 172.21.15.99:0/3157993838 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd178102550 0x7fd178113540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:46.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.465+0000 7fd175d9b640 1 -- 172.21.15.99:0/3157993838 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd168005040 con 0x7fd178102ef0 2024-09-19T06:48:46.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.465+0000 7fd175d9b640 1 --2- 172.21.15.99:0/3157993838 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd178102ef0 0x7fd178113a80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd16c00eb40 tx=0x7fd16c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:46.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.465+0000 7fd166ffd640 1 -- 172.21.15.99:0/3157993838 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd16c007c30 con 0x7fd178102ef0 2024-09-19T06:48:46.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.465+0000 7fd166ffd640 1 -- 172.21.15.99:0/3157993838 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd16c00f040 con 0x7fd178102ef0 2024-09-19T06:48:46.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.465+0000 7fd17cdc5640 1 -- 172.21.15.99:0/3157993838 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd17810d760 con 0x7fd178102ef0 2024-09-19T06:48:46.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.465+0000 7fd166ffd640 1 -- 172.21.15.99:0/3157993838 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd16c00ca90 con 0x7fd178102ef0 2024-09-19T06:48:46.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.465+0000 7fd17cdc5640 1 -- 172.21.15.99:0/3157993838 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd17810dd00 con 0x7fd178102ef0 2024-09-19T06:48:46.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.466+0000 7fd17cdc5640 1 -- 172.21.15.99:0/3157993838 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1780fdcd0 con 0x7fd178102ef0 2024-09-19T06:48:46.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.467+0000 7fd166ffd640 1 -- 172.21.15.99:0/3157993838 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fd16c00cc10 con 0x7fd178102ef0 2024-09-19T06:48:46.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.467+0000 7fd166ffd640 1 --2- 172.21.15.99:0/3157993838 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd16006e530 0x7fd1600709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:46.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.467+0000 7fd166ffd640 1 -- 172.21.15.99:0/3157993838 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fd16c08dd40 con 0x7fd178102ef0 2024-09-19T06:48:46.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.467+0000 7fd17659c640 1 --2- 172.21.15.99:0/3157993838 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd16006e530 0x7fd1600709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:46.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.467+0000 7fd17659c640 1 --2- 172.21.15.99:0/3157993838 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd16006e530 0x7fd1600709e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd168003080 tx=0x7fd168035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:46.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.471+0000 7fd166ffd640 1 -- 172.21.15.99:0/3157993838 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fd16c091030 con 0x7fd178102ef0 2024-09-19T06:48:46.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.644+0000 7fd17cdc5640 1 -- 172.21.15.99:0/3157993838 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd1781095c0 con 0x7fd16006e530 2024-09-19T06:48:46.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.653+0000 7fd166ffd640 1 -- 172.21.15.99:0/3157993838 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fd1781095c0 con 0x7fd16006e530 2024-09-19T06:48:46.654 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T06:48:46.654 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.smithi099 smithi099 *:9093,9094 running (7m) 26s ago 16m 23.4M - 0.25.0 c8568f914cd2 e7c1774d56b0 2024-09-19T06:48:46.655 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi099 smithi099 running (4m) 26s ago 16m 6899k - 19.1.1-361-g2f599a46 d2baa855c067 b9775f416b10 2024-09-19T06:48:46.655 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi117 smithi117 running (4m) 12s ago 15m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 38cf60c0d548 2024-09-19T06:48:46.655 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.smithi099 smithi099 *:3000 running (6m) 26s ago 15m 80.7M - 9.4.12 2bacad6d85d8 cd53a18d5410 2024-09-19T06:48:46.655 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.obarqf smithi099 running (48s) 26s ago 11m 12.2M - 19.1.1-361-g2f599a46 d2baa855c067 314a73082521 2024-09-19T06:48:46.655 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.xehbxe smithi099 running (31s) 26s ago 10m 14.4M - 19.1.1-361-g2f599a46 d2baa855c067 a2955a9d06e6 2024-09-19T06:48:46.655 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.bheqzh smithi117 running (10m) 12s ago 10m 16.4M - 17.2.7-1637-g6e06d1e0 f63ad14e4e43 21253e27fdd3 2024-09-19T06:48:46.655 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.nooexo smithi117 running (15s) 12s ago 10m 13.0M - 19.1.1-361-g2f599a46 d2baa855c067 35bd7725855c 2024-09-19T06:48:46.655 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi099.pgvkqi smithi099 *:8443,9283,8765 running (7m) 26s ago 17m 505M - 19.1.1-361-g2f599a46 d2baa855c067 d5de99cb7e78 2024-09-19T06:48:46.655 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi117.ssmkcf smithi117 *:8443,9283,8765 running (6m) 12s ago 15m 444M - 19.1.1-361-g2f599a46 d2baa855c067 8b7ee0f871f5 2024-09-19T06:48:46.655 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi099 smithi099 running (5m) 26s ago 17m 52.4M 2048M 19.1.1-361-g2f599a46 d2baa855c067 ffe067438824 2024-09-19T06:48:46.655 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi117 smithi117 running (4m) 12s ago 15m 38.6M 2048M 19.1.1-361-g2f599a46 d2baa855c067 4cb7455e3ee7 2024-09-19T06:48:46.655 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi099 smithi099 *:9100 running (7m) 26s ago 16m 15.0M - 1.5.0 0da6a335fe13 dca7b4517dcc 2024-09-19T06:48:46.655 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi117 smithi117 *:9100 running (7m) 12s ago 15m 16.1M - 1.5.0 0da6a335fe13 8233ce3835d2 2024-09-19T06:48:46.656 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (3m) 26s ago 14m 100M 1557M 19.1.1-361-g2f599a46 d2baa855c067 8e22543bf933 2024-09-19T06:48:46.656 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (3m) 26s ago 14m 106M 1557M 19.1.1-361-g2f599a46 d2baa855c067 f54153d0ae09 2024-09-19T06:48:46.656 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (2m) 26s ago 13m 83.7M 1557M 19.1.1-361-g2f599a46 d2baa855c067 b1778ab88870 2024-09-19T06:48:46.656 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi117 running (2m) 12s ago 13m 102M 2581M 19.1.1-361-g2f599a46 d2baa855c067 ea5236b193d3 2024-09-19T06:48:46.656 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi117 running (97s) 12s ago 12m 93.4M 2581M 19.1.1-361-g2f599a46 d2baa855c067 27ac2c859a68 2024-09-19T06:48:46.656 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi117 running (64s) 12s ago 12m 100M 2581M 19.1.1-361-g2f599a46 d2baa855c067 de6aeb8544ce 2024-09-19T06:48:46.656 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.smithi099 smithi099 *:9095 running (6m) 26s ago 15m 64.4M - 2.43.0 a07b618ecd1d 15ad26ec6fb4 2024-09-19T06:48:46.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.655+0000 7fd17cdc5640 1 -- 172.21.15.99:0/3157993838 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd16006e530 msgr2=0x7fd1600709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:46.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.655+0000 7fd17cdc5640 1 --2- 172.21.15.99:0/3157993838 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd16006e530 0x7fd1600709e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd168003080 tx=0x7fd168035040 comp rx=0 tx=0).stop 2024-09-19T06:48:46.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.655+0000 7fd17cdc5640 1 -- 172.21.15.99:0/3157993838 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd178102ef0 msgr2=0x7fd178113a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:46.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.655+0000 7fd17cdc5640 1 --2- 172.21.15.99:0/3157993838 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd178102ef0 0x7fd178113a80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd16c00eb40 tx=0x7fd16c00b040 comp rx=0 tx=0).stop 2024-09-19T06:48:46.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.655+0000 7fd17cdc5640 1 -- 172.21.15.99:0/3157993838 shutdown_connections 2024-09-19T06:48:46.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.655+0000 7fd17cdc5640 1 --2- 172.21.15.99:0/3157993838 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd16006e530 0x7fd1600709e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:46.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.655+0000 7fd17cdc5640 1 --2- 172.21.15.99:0/3157993838 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd178102ef0 0x7fd178113a80 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:46.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.655+0000 7fd17cdc5640 1 --2- 172.21.15.99:0/3157993838 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd178102550 0x7fd178113540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:46.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.655+0000 7fd17cdc5640 1 -- 172.21.15.99:0/3157993838 >> 172.21.15.99:0/3157993838 conn(0x7fd1780f80f0 msgr2=0x7fd1780f9160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:46.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.655+0000 7fd17cdc5640 1 -- 172.21.15.99:0/3157993838 shutdown_connections 2024-09-19T06:48:46.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.655+0000 7fd17cdc5640 1 -- 172.21.15.99:0/3157993838 wait complete. 2024-09-19T06:48:46.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.732+0000 7feaa3e1e640 1 -- 172.21.15.99:0/3673837839 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea9c102530 msgr2=0x7fea9c102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:46.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.732+0000 7feaa3e1e640 1 --2- 172.21.15.99:0/3673837839 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea9c102530 0x7fea9c102900 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fea940048d0 tx=0x7fea94009da0 comp rx=0 tx=0).stop 2024-09-19T06:48:46.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.733+0000 7feaa3e1e640 1 -- 172.21.15.99:0/3673837839 shutdown_connections 2024-09-19T06:48:46.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.733+0000 7feaa3e1e640 1 --2- 172.21.15.99:0/3673837839 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea9c102ed0 0x7fea9c0fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:46.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.733+0000 7feaa3e1e640 1 --2- 172.21.15.99:0/3673837839 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea9c102530 0x7fea9c102900 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:46.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.733+0000 7feaa3e1e640 1 -- 172.21.15.99:0/3673837839 >> 172.21.15.99:0/3673837839 conn(0x7fea9c0f80f0 msgr2=0x7fea9c0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:46.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.733+0000 7feaa3e1e640 1 -- 172.21.15.99:0/3673837839 shutdown_connections 2024-09-19T06:48:46.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.733+0000 7feaa3e1e640 1 -- 172.21.15.99:0/3673837839 wait complete. 2024-09-19T06:48:46.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.733+0000 7feaa3e1e640 1 Processor -- start 2024-09-19T06:48:46.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.733+0000 7feaa3e1e640 1 -- start start 2024-09-19T06:48:46.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.733+0000 7feaa3e1e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea9c102530 0x7fea9c06fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:46.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.733+0000 7feaa3e1e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea9c102ed0 0x7fea9c06ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:46.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.733+0000 7feaa3e1e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea9c070520 con 0x7fea9c102ed0 2024-09-19T06:48:46.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.734+0000 7feaa3e1e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea9c070690 con 0x7fea9c102530 2024-09-19T06:48:46.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.734+0000 7feaa13b9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea9c102ed0 0x7fea9c06ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:46.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.734+0000 7feaa13b9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea9c102ed0 0x7fea9c06ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56508/0 (socket says 172.21.15.99:56508) 2024-09-19T06:48:46.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.734+0000 7feaa13b9640 1 -- 172.21.15.99:0/1113876073 learned_addr learned my addr 172.21.15.99:0/1113876073 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:48:46.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.734+0000 7feaa1bba640 1 --2- 172.21.15.99:0/1113876073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea9c102530 0x7fea9c06fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:46.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.734+0000 7feaa13b9640 1 -- 172.21.15.99:0/1113876073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea9c102530 msgr2=0x7fea9c06fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:46.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.734+0000 7feaa13b9640 1 --2- 172.21.15.99:0/1113876073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea9c102530 0x7fea9c06fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:46.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.734+0000 7feaa13b9640 1 -- 172.21.15.99:0/1113876073 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea94005040 con 0x7fea9c102ed0 2024-09-19T06:48:46.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.734+0000 7feaa13b9640 1 --2- 172.21.15.99:0/1113876073 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea9c102ed0 0x7fea9c06ff50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fea9000b540 tx=0x7fea900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:46.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.734+0000 7fea9a7fc640 1 -- 172.21.15.99:0/1113876073 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea9000f6f0 con 0x7fea9c102ed0 2024-09-19T06:48:46.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.734+0000 7fea9a7fc640 1 -- 172.21.15.99:0/1113876073 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fea9000fcf0 con 0x7fea9c102ed0 2024-09-19T06:48:46.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.734+0000 7feaa3e1e640 1 -- 172.21.15.99:0/1113876073 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea9c119570 con 0x7fea9c102ed0 2024-09-19T06:48:46.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.734+0000 7fea9a7fc640 1 -- 172.21.15.99:0/1113876073 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea90011e80 con 0x7fea9c102ed0 2024-09-19T06:48:46.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.734+0000 7feaa3e1e640 1 -- 172.21.15.99:0/1113876073 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea9c1199b0 con 0x7fea9c102ed0 2024-09-19T06:48:46.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.736+0000 7feaa3e1e640 1 -- 172.21.15.99:0/1113876073 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea9c0fdcb0 con 0x7fea9c102ed0 2024-09-19T06:48:46.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.736+0000 7fea9a7fc640 1 -- 172.21.15.99:0/1113876073 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fea900116b0 con 0x7fea9c102ed0 2024-09-19T06:48:46.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.737+0000 7fea9a7fc640 1 --2- 172.21.15.99:0/1113876073 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fea8406e530 0x7fea840709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:46.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.737+0000 7fea9a7fc640 1 -- 172.21.15.99:0/1113876073 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fea9008df10 con 0x7fea9c102ed0 2024-09-19T06:48:46.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.737+0000 7feaa1bba640 1 --2- 172.21.15.99:0/1113876073 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fea8406e530 0x7fea840709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:46.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.737+0000 7feaa1bba640 1 --2- 172.21.15.99:0/1113876073 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fea8406e530 0x7fea840709e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fea940048a0 tx=0x7fea94035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:46.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.741+0000 7fea9a7fc640 1 -- 172.21.15.99:0/1113876073 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fea90057140 con 0x7fea9c102ed0 2024-09-19T06:48:46.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.976+0000 7feaa3e1e640 1 -- 172.21.15.99:0/1113876073 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fea9c0fbd30 con 0x7fea9c102ed0 2024-09-19T06:48:46.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.977+0000 7fea9a7fc640 1 -- 172.21.15.99:0/1113876073 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7fea9005a800 con 0x7fea9c102ed0 2024-09-19T06:48:46.978 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:48:46.978 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-09-19T06:48:46.978 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T06:48:46.978 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:48:46.978 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-09-19T06:48:46.978 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T06:48:46.979 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:48:46.979 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-09-19T06:48:46.979 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 6 2024-09-19T06:48:46.979 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:48:46.979 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": { 2024-09-19T06:48:46.979 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 3 2024-09-19T06:48:46.979 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:48:46.979 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-09-19T06:48:46.979 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 13 2024-09-19T06:48:46.979 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T06:48:46.979 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:48:46.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.979+0000 7feaa3e1e640 1 -- 172.21.15.99:0/1113876073 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fea8406e530 msgr2=0x7fea840709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:46.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.979+0000 7feaa3e1e640 1 --2- 172.21.15.99:0/1113876073 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fea8406e530 0x7fea840709e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fea940048a0 tx=0x7fea94035040 comp rx=0 tx=0).stop 2024-09-19T06:48:46.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.979+0000 7feaa3e1e640 1 -- 172.21.15.99:0/1113876073 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea9c102ed0 msgr2=0x7fea9c06ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:46.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.979+0000 7feaa3e1e640 1 --2- 172.21.15.99:0/1113876073 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea9c102ed0 0x7fea9c06ff50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fea9000b540 tx=0x7fea900091a0 comp rx=0 tx=0).stop 2024-09-19T06:48:46.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.979+0000 7feaa3e1e640 1 -- 172.21.15.99:0/1113876073 shutdown_connections 2024-09-19T06:48:46.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.979+0000 7feaa3e1e640 1 --2- 172.21.15.99:0/1113876073 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fea8406e530 0x7fea840709e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:46.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.979+0000 7feaa3e1e640 1 --2- 172.21.15.99:0/1113876073 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fea9c102ed0 0x7fea9c06ff50 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:46.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.979+0000 7feaa3e1e640 1 --2- 172.21.15.99:0/1113876073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fea9c102530 0x7fea9c06fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:46.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.979+0000 7feaa3e1e640 1 -- 172.21.15.99:0/1113876073 >> 172.21.15.99:0/1113876073 conn(0x7fea9c0f80f0 msgr2=0x7fea9c0f9140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:46.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.979+0000 7feaa3e1e640 1 -- 172.21.15.99:0/1113876073 shutdown_connections 2024-09-19T06:48:46.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:46.979+0000 7feaa3e1e640 1 -- 172.21.15.99:0/1113876073 wait complete. 2024-09-19T06:48:47.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.056+0000 7f170da22640 1 -- 172.21.15.99:0/1005174655 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1708102550 msgr2=0x7f1708102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:47.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.056+0000 7f170da22640 1 --2- 172.21.15.99:0/1005174655 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1708102550 0x7f1708102920 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f16f80048d0 tx=0x7f16f8009da0 comp rx=0 tx=0).stop 2024-09-19T06:48:47.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.056+0000 7f170da22640 1 -- 172.21.15.99:0/1005174655 shutdown_connections 2024-09-19T06:48:47.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.056+0000 7f170da22640 1 --2- 172.21.15.99:0/1005174655 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1708102ef0 0x7f17080fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:47.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.056+0000 7f170da22640 1 --2- 172.21.15.99:0/1005174655 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1708102550 0x7f1708102920 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:47.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.056+0000 7f170da22640 1 -- 172.21.15.99:0/1005174655 >> 172.21.15.99:0/1005174655 conn(0x7f17080f80f0 msgr2=0x7f17080fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:47.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.057+0000 7f170da22640 1 -- 172.21.15.99:0/1005174655 shutdown_connections 2024-09-19T06:48:47.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.057+0000 7f170da22640 1 -- 172.21.15.99:0/1005174655 wait complete. 2024-09-19T06:48:47.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.057+0000 7f170da22640 1 Processor -- start 2024-09-19T06:48:47.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.057+0000 7f170da22640 1 -- start start 2024-09-19T06:48:47.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.057+0000 7f170da22640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1708102550 0x7f1708113530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:47.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.057+0000 7f170da22640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1708102ef0 0x7f1708113a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:47.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.057+0000 7f170da22640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17081140c0 con 0x7f1708102ef0 2024-09-19T06:48:47.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.057+0000 7f170da22640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f170810d4d0 con 0x7f1708102550 2024-09-19T06:48:47.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.057+0000 7f16fffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1708102ef0 0x7f1708113a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:47.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.057+0000 7f16fffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1708102ef0 0x7f1708113a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56518/0 (socket says 172.21.15.99:56518) 2024-09-19T06:48:47.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.057+0000 7f16fffff640 1 -- 172.21.15.99:0/3740697092 learned_addr learned my addr 172.21.15.99:0/3740697092 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:48:47.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.057+0000 7f1706ffd640 1 --2- 172.21.15.99:0/3740697092 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1708102550 0x7f1708113530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:47.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.058+0000 7f16fffff640 1 -- 172.21.15.99:0/3740697092 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1708102550 msgr2=0x7f1708113530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:47.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.058+0000 7f16fffff640 1 --2- 172.21.15.99:0/3740697092 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1708102550 0x7f1708113530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:47.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.058+0000 7f16fffff640 1 -- 172.21.15.99:0/3740697092 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16f8005040 con 0x7f1708102ef0 2024-09-19T06:48:47.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.058+0000 7f16fffff640 1 --2- 172.21.15.99:0/3740697092 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1708102ef0 0x7f1708113a70 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f16f000eb40 tx=0x7f16f000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:47.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.058+0000 7f16ff7fe640 1 -- 172.21.15.99:0/3740697092 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16f0007c30 con 0x7f1708102ef0 2024-09-19T06:48:47.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.058+0000 7f16ff7fe640 1 -- 172.21.15.99:0/3740697092 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f16f000f040 con 0x7f1708102ef0 2024-09-19T06:48:47.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.058+0000 7f16ff7fe640 1 -- 172.21.15.99:0/3740697092 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16f000ca90 con 0x7f1708102ef0 2024-09-19T06:48:47.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.058+0000 7f170da22640 1 -- 172.21.15.99:0/3740697092 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f170810d750 con 0x7f1708102ef0 2024-09-19T06:48:47.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.058+0000 7f170da22640 1 -- 172.21.15.99:0/3740697092 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f170810dcf0 con 0x7f1708102ef0 2024-09-19T06:48:47.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.059+0000 7f170da22640 1 -- 172.21.15.99:0/3740697092 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17080fdcd0 con 0x7f1708102ef0 2024-09-19T06:48:47.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.060+0000 7f16ff7fe640 1 -- 172.21.15.99:0/3740697092 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f16f000cc10 con 0x7f1708102ef0 2024-09-19T06:48:47.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.060+0000 7f16ff7fe640 1 --2- 172.21.15.99:0/3740697092 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f16f406e530 0x7f16f40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:47.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.061+0000 7f16ff7fe640 1 -- 172.21.15.99:0/3740697092 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f16f008dd80 con 0x7f1708102ef0 2024-09-19T06:48:47.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.061+0000 7f1706ffd640 1 --2- 172.21.15.99:0/3740697092 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f16f406e530 0x7f16f40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:47.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.061+0000 7f1706ffd640 1 --2- 172.21.15.99:0/3740697092 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f16f406e530 0x7f16f40709e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f16f8003080 tx=0x7f16f8035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:47.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.065+0000 7f16ff7fe640 1 -- 172.21.15.99:0/3740697092 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f16f0056f20 con 0x7f1708102ef0 2024-09-19T06:48:47.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.266+0000 7f170da22640 1 -- 172.21.15.99:0/3740697092 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f170810d8e0 con 0x7f1708102ef0 2024-09-19T06:48:47.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.266+0000 7f16ff7fe640 1 -- 172.21.15.99:0/3740697092 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 28 v28) v1 ==== 76+0+1736 (secure 0 0 0) 0x7f170810d8e0 con 0x7f1708102ef0 2024-09-19T06:48:47.268 INFO:teuthology.orchestra.run.smithi099.stdout:e28 2024-09-19T06:48:47.268 INFO:teuthology.orchestra.run.smithi099.stdout:btime 2024-09-19T06:48:41:704374+0000 2024-09-19T06:48:47.268 INFO:teuthology.orchestra.run.smithi099.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T06:48:47.268 INFO:teuthology.orchestra.run.smithi099.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T06:48:47.268 INFO:teuthology.orchestra.run.smithi099.stdout:legacy client fscid: 1 2024-09-19T06:48:47.268 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:48:47.268 INFO:teuthology.orchestra.run.smithi099.stdout:Filesystem 'cephfs' (1) 2024-09-19T06:48:47.268 INFO:teuthology.orchestra.run.smithi099.stdout:fs_name cephfs 2024-09-19T06:48:47.269 INFO:teuthology.orchestra.run.smithi099.stdout:epoch 20 2024-09-19T06:48:47.269 INFO:teuthology.orchestra.run.smithi099.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-19T06:48:47.269 INFO:teuthology.orchestra.run.smithi099.stdout:created 2024-09-19T06:37:40.838146+0000 2024-09-19T06:48:47.269 INFO:teuthology.orchestra.run.smithi099.stdout:modified 2024-09-19T06:47:50.076553+0000 2024-09-19T06:48:47.269 INFO:teuthology.orchestra.run.smithi099.stdout:tableserver 0 2024-09-19T06:48:47.269 INFO:teuthology.orchestra.run.smithi099.stdout:root 0 2024-09-19T06:48:47.269 INFO:teuthology.orchestra.run.smithi099.stdout:session_timeout 60 2024-09-19T06:48:47.269 INFO:teuthology.orchestra.run.smithi099.stdout:session_autoclose 300 2024-09-19T06:48:47.269 INFO:teuthology.orchestra.run.smithi099.stdout:max_file_size 1099511627776 2024-09-19T06:48:47.269 INFO:teuthology.orchestra.run.smithi099.stdout:max_xattr_size 65536 2024-09-19T06:48:47.269 INFO:teuthology.orchestra.run.smithi099.stdout:required_client_features {} 2024-09-19T06:48:47.269 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure 0 2024-09-19T06:48:47.270 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure_osd_epoch 77 2024-09-19T06:48:47.270 INFO:teuthology.orchestra.run.smithi099.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T06:48:47.270 INFO:teuthology.orchestra.run.smithi099.stdout:max_mds 2 2024-09-19T06:48:47.270 INFO:teuthology.orchestra.run.smithi099.stdout:in 0,1 2024-09-19T06:48:47.270 INFO:teuthology.orchestra.run.smithi099.stdout:up {} 2024-09-19T06:48:47.270 INFO:teuthology.orchestra.run.smithi099.stdout:failed 0,1 2024-09-19T06:48:47.270 INFO:teuthology.orchestra.run.smithi099.stdout:damaged 2024-09-19T06:48:47.270 INFO:teuthology.orchestra.run.smithi099.stdout:stopped 2024-09-19T06:48:47.270 INFO:teuthology.orchestra.run.smithi099.stdout:data_pools [3] 2024-09-19T06:48:47.270 INFO:teuthology.orchestra.run.smithi099.stdout:metadata_pool 2 2024-09-19T06:48:47.270 INFO:teuthology.orchestra.run.smithi099.stdout:inline_data disabled 2024-09-19T06:48:47.270 INFO:teuthology.orchestra.run.smithi099.stdout:balancer 2024-09-19T06:48:47.270 INFO:teuthology.orchestra.run.smithi099.stdout:bal_rank_mask -1 2024-09-19T06:48:47.270 INFO:teuthology.orchestra.run.smithi099.stdout:standby_count_wanted 1 2024-09-19T06:48:47.270 INFO:teuthology.orchestra.run.smithi099.stdout:qdb_cluster leader: 0 members: 2024-09-19T06:48:47.271 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:48:47.271 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:48:47.271 INFO:teuthology.orchestra.run.smithi099.stdout:Standby daemons: 2024-09-19T06:48:47.271 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:48:47.271 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.obarqf{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6826/1859154203,v1:172.21.15.99:6827/1859154203] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:48:47.271 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.xehbxe{-1:34410} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6828/1939453719,v1:172.21.15.99:6829/1939453719] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:48:47.271 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.nooexo{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6824/1398895079,v1:172.21.15.117:6825/1398895079] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:48:47.272 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 28 2024-09-19T06:48:47.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.268+0000 7f170da22640 1 -- 172.21.15.99:0/3740697092 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f16f406e530 msgr2=0x7f16f40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:47.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.268+0000 7f170da22640 1 --2- 172.21.15.99:0/3740697092 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f16f406e530 0x7f16f40709e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f16f8003080 tx=0x7f16f8035040 comp rx=0 tx=0).stop 2024-09-19T06:48:47.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.268+0000 7f170da22640 1 -- 172.21.15.99:0/3740697092 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1708102ef0 msgr2=0x7f1708113a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:47.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.268+0000 7f170da22640 1 --2- 172.21.15.99:0/3740697092 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1708102ef0 0x7f1708113a70 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f16f000eb40 tx=0x7f16f000b040 comp rx=0 tx=0).stop 2024-09-19T06:48:47.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.268+0000 7f170da22640 1 -- 172.21.15.99:0/3740697092 shutdown_connections 2024-09-19T06:48:47.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.268+0000 7f170da22640 1 --2- 172.21.15.99:0/3740697092 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f16f406e530 0x7f16f40709e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:47.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.268+0000 7f170da22640 1 --2- 172.21.15.99:0/3740697092 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1708102ef0 0x7f1708113a70 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:47.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.268+0000 7f170da22640 1 --2- 172.21.15.99:0/3740697092 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1708102550 0x7f1708113530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:47.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.269+0000 7f170da22640 1 -- 172.21.15.99:0/3740697092 >> 172.21.15.99:0/3740697092 conn(0x7f17080f80f0 msgr2=0x7f17080f90a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:47.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.269+0000 7f170da22640 1 -- 172.21.15.99:0/3740697092 shutdown_connections 2024-09-19T06:48:47.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.269+0000 7f170da22640 1 -- 172.21.15.99:0/3740697092 wait complete. 2024-09-19T06:48:47.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.348+0000 7f884e6ab640 1 -- 172.21.15.99:0/3164206725 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8848102ed0 msgr2=0x7f88480fc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:47.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.348+0000 7f884e6ab640 1 --2- 172.21.15.99:0/3164206725 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8848102ed0 0x7f88480fc590 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f88300048d0 tx=0x7f8830009da0 comp rx=0 tx=0).stop 2024-09-19T06:48:47.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.348+0000 7f884e6ab640 1 -- 172.21.15.99:0/3164206725 shutdown_connections 2024-09-19T06:48:47.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.348+0000 7f884e6ab640 1 --2- 172.21.15.99:0/3164206725 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8848102ed0 0x7f88480fc590 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:47.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.348+0000 7f884e6ab640 1 --2- 172.21.15.99:0/3164206725 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8848102530 0x7f8848102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:47.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.348+0000 7f884e6ab640 1 -- 172.21.15.99:0/3164206725 >> 172.21.15.99:0/3164206725 conn(0x7f88480f8110 msgr2=0x7f88480fa520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:47.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.348+0000 7f884e6ab640 1 -- 172.21.15.99:0/3164206725 shutdown_connections 2024-09-19T06:48:47.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.348+0000 7f884e6ab640 1 -- 172.21.15.99:0/3164206725 wait complete. 2024-09-19T06:48:47.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.349+0000 7f884e6ab640 1 Processor -- start 2024-09-19T06:48:47.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.349+0000 7f884e6ab640 1 -- start start 2024-09-19T06:48:47.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.349+0000 7f884e6ab640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8848102530 0x7f884806fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:47.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.349+0000 7f884e6ab640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8848102ed0 0x7f884806ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:47.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.349+0000 7f884e6ab640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8848070490 con 0x7f8848102530 2024-09-19T06:48:47.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.349+0000 7f884e6ab640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8848070600 con 0x7f8848102ed0 2024-09-19T06:48:47.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.349+0000 7f8847fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8848102530 0x7f884806fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:47.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.349+0000 7f8847fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8848102530 0x7f884806fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56530/0 (socket says 172.21.15.99:56530) 2024-09-19T06:48:47.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.349+0000 7f8847fff640 1 -- 172.21.15.99:0/606994900 learned_addr learned my addr 172.21.15.99:0/606994900 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:48:47.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.349+0000 7f883ffff640 1 --2- 172.21.15.99:0/606994900 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8848102ed0 0x7f884806ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:47.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.350+0000 7f8847fff640 1 -- 172.21.15.99:0/606994900 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8848102ed0 msgr2=0x7f884806ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:47.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.350+0000 7f8847fff640 1 --2- 172.21.15.99:0/606994900 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8848102ed0 0x7f884806ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:47.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.350+0000 7f8847fff640 1 -- 172.21.15.99:0/606994900 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8830005040 con 0x7f8848102530 2024-09-19T06:48:47.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.350+0000 7f883ffff640 1 --2- 172.21.15.99:0/606994900 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8848102ed0 0x7f884806ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:48:47.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.350+0000 7f8847fff640 1 --2- 172.21.15.99:0/606994900 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8848102530 0x7f884806fa10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f883800eb70 tx=0x7f883800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:47.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.350+0000 7f88457fa640 1 -- 172.21.15.99:0/606994900 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8838007c30 con 0x7f8848102530 2024-09-19T06:48:47.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.350+0000 7f88457fa640 1 -- 172.21.15.99:0/606994900 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f883800f040 con 0x7f8848102530 2024-09-19T06:48:47.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.350+0000 7f884e6ab640 1 -- 172.21.15.99:0/606994900 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8848070830 con 0x7f8848102530 2024-09-19T06:48:47.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.350+0000 7f88457fa640 1 -- 172.21.15.99:0/606994900 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8838009420 con 0x7f8848102530 2024-09-19T06:48:47.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.350+0000 7f884e6ab640 1 -- 172.21.15.99:0/606994900 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88481198b0 con 0x7f8848102530 2024-09-19T06:48:47.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.351+0000 7f884e6ab640 1 -- 172.21.15.99:0/606994900 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88480fdcb0 con 0x7f8848102530 2024-09-19T06:48:47.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.352+0000 7f88457fa640 1 -- 172.21.15.99:0/606994900 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f8838009580 con 0x7f8848102530 2024-09-19T06:48:47.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.353+0000 7f88457fa640 1 --2- 172.21.15.99:0/606994900 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f883406e530 0x7f88340709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:47.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.353+0000 7f88457fa640 1 -- 172.21.15.99:0/606994900 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f883808e0e0 con 0x7f8848102530 2024-09-19T06:48:47.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.353+0000 7f883ffff640 1 --2- 172.21.15.99:0/606994900 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f883406e530 0x7f88340709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:47.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.353+0000 7f883ffff640 1 --2- 172.21.15.99:0/606994900 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f883406e530 0x7f88340709e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8830000c00 tx=0x7f8830035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:47.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.357+0000 7f88457fa640 1 -- 172.21.15.99:0/606994900 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f88380573c0 con 0x7f8848102530 2024-09-19T06:48:47.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.541+0000 7f884e6ab640 1 -- 172.21.15.99:0/606994900 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8848071100 con 0x7f883406e530 2024-09-19T06:48:47.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.542+0000 7f88457fa640 1 -- 172.21.15.99:0/606994900 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f8848071100 con 0x7f883406e530 2024-09-19T06:48:47.544 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:48:47.544 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T06:48:47.544 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": true, 2024-09-19T06:48:47.544 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T06:48:47.544 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [ 2024-09-19T06:48:47.544 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr", 2024-09-19T06:48:47.544 INFO:teuthology.orchestra.run.smithi099.stdout: "osd", 2024-09-19T06:48:47.544 INFO:teuthology.orchestra.run.smithi099.stdout: "crash", 2024-09-19T06:48:47.544 INFO:teuthology.orchestra.run.smithi099.stdout: "mon" 2024-09-19T06:48:47.544 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-19T06:48:47.544 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": "15/21 daemons upgraded", 2024-09-19T06:48:47.544 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "Currently upgrading mds daemons", 2024-09-19T06:48:47.545 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-09-19T06:48:47.545 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:48:47.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.545+0000 7f884e6ab640 1 -- 172.21.15.99:0/606994900 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f883406e530 msgr2=0x7f88340709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:47.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.545+0000 7f884e6ab640 1 --2- 172.21.15.99:0/606994900 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f883406e530 0x7f88340709e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8830000c00 tx=0x7f8830035040 comp rx=0 tx=0).stop 2024-09-19T06:48:47.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.545+0000 7f884e6ab640 1 -- 172.21.15.99:0/606994900 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8848102530 msgr2=0x7f884806fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:47.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.545+0000 7f884e6ab640 1 --2- 172.21.15.99:0/606994900 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8848102530 0x7f884806fa10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f883800eb70 tx=0x7f883800b040 comp rx=0 tx=0).stop 2024-09-19T06:48:47.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.545+0000 7f884e6ab640 1 -- 172.21.15.99:0/606994900 shutdown_connections 2024-09-19T06:48:47.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.545+0000 7f884e6ab640 1 --2- 172.21.15.99:0/606994900 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f883406e530 0x7f88340709e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:47.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.545+0000 7f884e6ab640 1 --2- 172.21.15.99:0/606994900 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8848102ed0 0x7f884806ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:47.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.545+0000 7f884e6ab640 1 --2- 172.21.15.99:0/606994900 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8848102530 0x7f884806fa10 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:47.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.545+0000 7f884e6ab640 1 -- 172.21.15.99:0/606994900 >> 172.21.15.99:0/606994900 conn(0x7f88480f8110 msgr2=0x7f88480f91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:47.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.545+0000 7f884e6ab640 1 -- 172.21.15.99:0/606994900 shutdown_connections 2024-09-19T06:48:47.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.545+0000 7f884e6ab640 1 -- 172.21.15.99:0/606994900 wait complete. 2024-09-19T06:48:47.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.623+0000 7f5f29f92640 1 -- 172.21.15.99:0/1086642094 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5f241014e0 msgr2=0x7f5f241018b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:47.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.623+0000 7f5f29f92640 1 --2- 172.21.15.99:0/1086642094 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5f241014e0 0x7f5f241018b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5f140048d0 tx=0x7f5f14009da0 comp rx=0 tx=0).stop 2024-09-19T06:48:47.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.623+0000 7f5f29f92640 1 -- 172.21.15.99:0/1086642094 shutdown_connections 2024-09-19T06:48:47.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.623+0000 7f5f29f92640 1 --2- 172.21.15.99:0/1086642094 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f240fb4a0 0x7f5f240fb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:47.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.623+0000 7f5f29f92640 1 --2- 172.21.15.99:0/1086642094 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5f241014e0 0x7f5f241018b0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:47.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.623+0000 7f5f29f92640 1 -- 172.21.15.99:0/1086642094 >> 172.21.15.99:0/1086642094 conn(0x7f5f240f7060 msgr2=0x7f5f240f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:47.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.623+0000 7f5f29f92640 1 -- 172.21.15.99:0/1086642094 shutdown_connections 2024-09-19T06:48:47.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.623+0000 7f5f29f92640 1 -- 172.21.15.99:0/1086642094 wait complete. 2024-09-19T06:48:47.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.624+0000 7f5f29f92640 1 Processor -- start 2024-09-19T06:48:47.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.624+0000 7f5f29f92640 1 -- start start 2024-09-19T06:48:47.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.624+0000 7f5f29f92640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5f240fb4a0 0x7f5f2410e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:47.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.624+0000 7f5f29f92640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f241014e0 0x7f5f2410e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:47.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.624+0000 7f5f29f92640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2410ed10 con 0x7f5f240fb4a0 2024-09-19T06:48:47.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.624+0000 7f5f29f92640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2410ee80 con 0x7f5f241014e0 2024-09-19T06:48:47.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.624+0000 7f5f237fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5f240fb4a0 0x7f5f2410e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:47.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.625+0000 7f5f237fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5f240fb4a0 0x7f5f2410e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56550/0 (socket says 172.21.15.99:56550) 2024-09-19T06:48:47.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.625+0000 7f5f237fe640 1 -- 172.21.15.99:0/3703735841 learned_addr learned my addr 172.21.15.99:0/3703735841 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:48:47.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.625+0000 7f5f22ffd640 1 --2- 172.21.15.99:0/3703735841 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f241014e0 0x7f5f2410e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:47.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.625+0000 7f5f237fe640 1 -- 172.21.15.99:0/3703735841 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f241014e0 msgr2=0x7f5f2410e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:47.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.625+0000 7f5f237fe640 1 --2- 172.21.15.99:0/3703735841 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f241014e0 0x7f5f2410e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:47.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.625+0000 7f5f237fe640 1 -- 172.21.15.99:0/3703735841 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f14005040 con 0x7f5f240fb4a0 2024-09-19T06:48:47.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.625+0000 7f5f22ffd640 1 --2- 172.21.15.99:0/3703735841 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f241014e0 0x7f5f2410e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:48:47.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.625+0000 7f5f237fe640 1 --2- 172.21.15.99:0/3703735841 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5f240fb4a0 0x7f5f2410e180 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5f14000c00 tx=0x7f5f14009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:47.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.625+0000 7f5f0bfff640 1 -- 172.21.15.99:0/3703735841 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f14038070 con 0x7f5f240fb4a0 2024-09-19T06:48:47.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.625+0000 7f5f29f92640 1 -- 172.21.15.99:0/3703735841 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f241171f0 con 0x7f5f240fb4a0 2024-09-19T06:48:47.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.625+0000 7f5f0bfff640 1 -- 172.21.15.99:0/3703735841 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5f1402ade0 con 0x7f5f240fb4a0 2024-09-19T06:48:47.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.625+0000 7f5f0bfff640 1 -- 172.21.15.99:0/3703735841 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f1402c7e0 con 0x7f5f240fb4a0 2024-09-19T06:48:47.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.625+0000 7f5f29f92640 1 -- 172.21.15.99:0/3703735841 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f24117650 con 0x7f5f240fb4a0 2024-09-19T06:48:47.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.626+0000 7f5f29f92640 1 -- 172.21.15.99:0/3703735841 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f240fcbe0 con 0x7f5f240fb4a0 2024-09-19T06:48:47.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.627+0000 7f5f0bfff640 1 -- 172.21.15.99:0/3703735841 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f5f14030020 con 0x7f5f240fb4a0 2024-09-19T06:48:47.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.628+0000 7f5f0bfff640 1 --2- 172.21.15.99:0/3703735841 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f5f0c06e530 0x7f5f0c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:48:47.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.628+0000 7f5f0bfff640 1 -- 172.21.15.99:0/3703735841 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f5f140addf0 con 0x7f5f240fb4a0 2024-09-19T06:48:47.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.628+0000 7f5f22ffd640 1 --2- 172.21.15.99:0/3703735841 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f5f0c06e530 0x7f5f0c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:48:47.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.628+0000 7f5f22ffd640 1 --2- 172.21.15.99:0/3703735841 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f5f0c06e530 0x7f5f0c0709e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5f24066470 tx=0x7f5f18004d00 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:48:47.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.632+0000 7f5f0bfff640 1 -- 172.21.15.99:0/3703735841 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f5f14076f90 con 0x7f5f240fb4a0 2024-09-19T06:48:47.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.860+0000 7f5f29f92640 1 -- 172.21.15.99:0/3703735841 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f5f240fac60 con 0x7f5f240fb4a0 2024-09-19T06:48:47.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.860+0000 7f5f0bfff640 1 -- 172.21.15.99:0/3703735841 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7f5f1407a650 con 0x7f5f240fb4a0 2024-09-19T06:48:47.862 INFO:teuthology.orchestra.run.smithi099.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-09-19T06:48:47.862 INFO:teuthology.orchestra.run.smithi099.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-19T06:48:47.862 INFO:teuthology.orchestra.run.smithi099.stdout: fs cephfs is degraded 2024-09-19T06:48:47.862 INFO:teuthology.orchestra.run.smithi099.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-19T06:48:47.862 INFO:teuthology.orchestra.run.smithi099.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-19T06:48:47.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.862+0000 7f5f29f92640 1 -- 172.21.15.99:0/3703735841 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f5f0c06e530 msgr2=0x7f5f0c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:47.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.862+0000 7f5f29f92640 1 --2- 172.21.15.99:0/3703735841 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f5f0c06e530 0x7f5f0c0709e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5f24066470 tx=0x7f5f18004d00 comp rx=0 tx=0).stop 2024-09-19T06:48:47.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.862+0000 7f5f29f92640 1 -- 172.21.15.99:0/3703735841 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5f240fb4a0 msgr2=0x7f5f2410e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:48:47.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.862+0000 7f5f29f92640 1 --2- 172.21.15.99:0/3703735841 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5f240fb4a0 0x7f5f2410e180 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5f14000c00 tx=0x7f5f14009da0 comp rx=0 tx=0).stop 2024-09-19T06:48:47.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.862+0000 7f5f29f92640 1 -- 172.21.15.99:0/3703735841 shutdown_connections 2024-09-19T06:48:47.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.862+0000 7f5f29f92640 1 --2- 172.21.15.99:0/3703735841 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f5f0c06e530 0x7f5f0c0709e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:47.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.862+0000 7f5f29f92640 1 --2- 172.21.15.99:0/3703735841 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f241014e0 0x7f5f2410e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:47.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.862+0000 7f5f29f92640 1 --2- 172.21.15.99:0/3703735841 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5f240fb4a0 0x7f5f2410e180 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:48:47.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.862+0000 7f5f29f92640 1 -- 172.21.15.99:0/3703735841 >> 172.21.15.99:0/3703735841 conn(0x7f5f240f7060 msgr2=0x7f5f240f7430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:48:47.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.862+0000 7f5f29f92640 1 -- 172.21.15.99:0/3703735841 shutdown_connections 2024-09-19T06:48:47.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:48:47.862+0000 7f5f29f92640 1 -- 172.21.15.99:0/3703735841 wait complete. 2024-09-19T06:48:48.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:47 smithi117 ceph-mon[76771]: from='client.34414 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:48:48.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:47 smithi117 ceph-mon[76771]: from='client.34418 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:48:48.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:47 smithi117 ceph-mon[76771]: from='client.34422 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:48:48.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:47 smithi117 ceph-mon[76771]: pgmap v193: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:48:48.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:47 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/1113876073' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:48:48.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:47 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:48.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:47 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:48.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:47 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:48:48.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:47 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/3740697092' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:48:48.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:47 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/3703735841' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T06:48:48.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:47 smithi099 ceph-mon[97031]: from='client.34414 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:48:48.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:47 smithi099 ceph-mon[97031]: from='client.34418 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:48:48.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:47 smithi099 ceph-mon[97031]: from='client.34422 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:48:48.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:47 smithi099 ceph-mon[97031]: pgmap v193: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:48:48.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:47 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/1113876073' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:48:48.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:47 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:48.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:47 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:48.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:47 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T06:48:48.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:47 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/3740697092' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:48:48.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:47 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/3703735841' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T06:48:49.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:48 smithi099 ceph-mon[97031]: from='client.34438 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:48:49.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:48 smithi099 ceph-mon[97031]: mds.? [v2:172.21.15.117:6826/3233337308,v1:172.21.15.117:6827/3233337308] up:boot 2024-09-19T06:48:49.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:48 smithi099 ceph-mon[97031]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-19T06:48:49.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:48 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi117.bheqzh"}]: dispatch 2024-09-19T06:48:49.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:48 smithi117 ceph-mon[76771]: from='client.34438 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:48:49.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:48 smithi117 ceph-mon[76771]: mds.? [v2:172.21.15.117:6826/3233337308,v1:172.21.15.117:6827/3233337308] up:boot 2024-09-19T06:48:49.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:48 smithi117 ceph-mon[76771]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-19T06:48:49.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:48 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi117.bheqzh"}]: dispatch 2024-09-19T06:48:50.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:49 smithi099 ceph-mon[97031]: pgmap v194: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:48:50.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:49 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:50.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:49 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:50.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:49 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:50.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:49 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:50.274 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:49 smithi117 ceph-mon[76771]: pgmap v194: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:48:50.274 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:49 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:50.274 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:49 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:50.274 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:49 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:50.274 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:49 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T06:48:52.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:51 smithi099 ceph-mon[97031]: pgmap v195: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:48:52.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:51 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:48:52.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:51 smithi117 ceph-mon[76771]: pgmap v195: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:48:52.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:51 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:48:54.263 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:53 smithi117 ceph-mon[76771]: pgmap v196: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:48:54.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:53 smithi099 ceph-mon[97031]: pgmap v196: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:48:56.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:55 smithi117 ceph-mon[76771]: pgmap v197: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:48:56.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:55 smithi099 ceph-mon[97031]: pgmap v197: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:48:58.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:57 smithi117 ceph-mon[76771]: pgmap v198: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:48:58.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:57 smithi099 ceph-mon[97031]: pgmap v198: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:49:00.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:48:59 smithi117 ceph-mon[76771]: pgmap v199: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:49:00.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:48:59 smithi099 ceph-mon[97031]: pgmap v199: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:49:02.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:49:01 smithi117 ceph-mon[76771]: pgmap v200: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:49:02.314 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:49:01 smithi099 ceph-mon[97031]: pgmap v200: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:49:04.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:49:03 smithi117 ceph-mon[76771]: pgmap v201: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:49:04.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:49:03 smithi099 ceph-mon[97031]: pgmap v201: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:49:06.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:49:05 smithi117 ceph-mon[76771]: pgmap v202: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:49:06.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:49:05 smithi099 ceph-mon[97031]: pgmap v202: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:49:07.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:49:06 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:49:07.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:49:06 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:49:08.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:49:07 smithi117 ceph-mon[76771]: pgmap v203: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:49:08.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:49:07 smithi099 ceph-mon[97031]: pgmap v203: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:49:10.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:49:09 smithi117 ceph-mon[76771]: pgmap v204: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:49:10.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:49:09 smithi099 ceph-mon[97031]: pgmap v204: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:49:11.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:49:11 smithi099 ceph-mon[97031]: pgmap v205: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:49:12.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:49:11 smithi117 ceph-mon[76771]: pgmap v205: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:49:14.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:49:13 smithi099 ceph-mon[97031]: pgmap v206: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:49:14.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:49:13 smithi117 ceph-mon[76771]: pgmap v206: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:49:16.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:49:15 smithi099 ceph-mon[97031]: pgmap v207: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:49:16.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:49:15 smithi117 ceph-mon[76771]: pgmap v207: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:49:17.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:17.954+0000 7f0871c72640 1 -- 172.21.15.99:0/1502771196 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f086c0fdf30 msgr2=0x7f086c106600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:17.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:17.954+0000 7f0871c72640 1 --2- 172.21.15.99:0/1502771196 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f086c0fdf30 0x7f086c106600 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f08600048d0 tx=0x7f0860009da0 comp rx=0 tx=0).stop 2024-09-19T06:49:17.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:17.954+0000 7f0871c72640 1 -- 172.21.15.99:0/1502771196 shutdown_connections 2024-09-19T06:49:17.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:17.954+0000 7f0871c72640 1 --2- 172.21.15.99:0/1502771196 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f086c0fdf30 0x7f086c106600 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:17.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:17.954+0000 7f0871c72640 1 --2- 172.21.15.99:0/1502771196 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f086c0fd590 0x7f086c0fd960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:17.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:17.954+0000 7f0871c72640 1 -- 172.21.15.99:0/1502771196 >> 172.21.15.99:0/1502771196 conn(0x7f086c0f7030 msgr2=0x7f086c0f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:17.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:17.954+0000 7f0871c72640 1 -- 172.21.15.99:0/1502771196 shutdown_connections 2024-09-19T06:49:17.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:17.954+0000 7f0871c72640 1 -- 172.21.15.99:0/1502771196 wait complete. 2024-09-19T06:49:17.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:17.954+0000 7f0871c72640 1 Processor -- start 2024-09-19T06:49:17.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:17.955+0000 7f0871c72640 1 -- start start 2024-09-19T06:49:17.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:17.955+0000 7f0871c72640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f086c0fd590 0x7f086c1131f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:17.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:17.955+0000 7f0871c72640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f086c0fdf30 0x7f086c113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:17.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:17.955+0000 7f0871c72640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f086c113d30 con 0x7f086c0fd590 2024-09-19T06:49:17.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:17.955+0000 7f0871c72640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f086c10d170 con 0x7f086c0fdf30 2024-09-19T06:49:17.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:17.955+0000 7f086b7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f086c0fd590 0x7f086c1131f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:17.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:17.955+0000 7f086b7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f086c0fd590 0x7f086c1131f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35468/0 (socket says 172.21.15.99:35468) 2024-09-19T06:49:17.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:17.955+0000 7f086b7fe640 1 -- 172.21.15.99:0/489164112 learned_addr learned my addr 172.21.15.99:0/489164112 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:49:17.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:17.955+0000 7f086affd640 1 --2- 172.21.15.99:0/489164112 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f086c0fdf30 0x7f086c113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:17.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:17.955+0000 7f086b7fe640 1 -- 172.21.15.99:0/489164112 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f086c0fdf30 msgr2=0x7f086c113730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:17.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:17.955+0000 7f086b7fe640 1 --2- 172.21.15.99:0/489164112 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f086c0fdf30 0x7f086c113730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:17.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:17.955+0000 7f086b7fe640 1 -- 172.21.15.99:0/489164112 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0860005040 con 0x7f086c0fd590 2024-09-19T06:49:17.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:17.955+0000 7f086b7fe640 1 --2- 172.21.15.99:0/489164112 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f086c0fd590 0x7f086c1131f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f085c00eb70 tx=0x7f085c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:17.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:17.956+0000 7f0853fff640 1 -- 172.21.15.99:0/489164112 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f085c007c30 con 0x7f086c0fd590 2024-09-19T06:49:17.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:17.956+0000 7f0853fff640 1 -- 172.21.15.99:0/489164112 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f085c00f040 con 0x7f086c0fd590 2024-09-19T06:49:17.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:17.956+0000 7f0871c72640 1 -- 172.21.15.99:0/489164112 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f086c10d3f0 con 0x7f086c0fd590 2024-09-19T06:49:17.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:17.956+0000 7f0853fff640 1 -- 172.21.15.99:0/489164112 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f085c0094e0 con 0x7f086c0fd590 2024-09-19T06:49:17.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:17.956+0000 7f0871c72640 1 -- 172.21.15.99:0/489164112 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f086c10d910 con 0x7f086c0fd590 2024-09-19T06:49:17.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:17.957+0000 7f0871c72640 1 -- 172.21.15.99:0/489164112 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f086c066030 con 0x7f086c0fd590 2024-09-19T06:49:17.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:17.957+0000 7f0853fff640 1 -- 172.21.15.99:0/489164112 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f085c0096a0 con 0x7f086c0fd590 2024-09-19T06:49:17.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:17.958+0000 7f0853fff640 1 --2- 172.21.15.99:0/489164112 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f085406e530 0x7f08540709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:17.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:17.958+0000 7f0853fff640 1 -- 172.21.15.99:0/489164112 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f085c08dd60 con 0x7f086c0fd590 2024-09-19T06:49:17.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:17.958+0000 7f086affd640 1 --2- 172.21.15.99:0/489164112 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f085406e530 0x7f08540709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:17.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:17.958+0000 7f086affd640 1 --2- 172.21.15.99:0/489164112 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f085406e530 0x7f08540709e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0860004540 tx=0x7f0860035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:17.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:17.962+0000 7f0853fff640 1 -- 172.21.15.99:0/489164112 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f085c056f80 con 0x7f086c0fd590 2024-09-19T06:49:18.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.144+0000 7f0871c72640 1 -- 172.21.15.99:0/489164112 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f086c04b770 con 0x7f085406e530 2024-09-19T06:49:18.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.146+0000 7f0853fff640 1 -- 172.21.15.99:0/489164112 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f086c04b770 con 0x7f085406e530 2024-09-19T06:49:18.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.148+0000 7f0871c72640 1 -- 172.21.15.99:0/489164112 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f085406e530 msgr2=0x7f08540709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:18.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.148+0000 7f0871c72640 1 --2- 172.21.15.99:0/489164112 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f085406e530 0x7f08540709e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0860004540 tx=0x7f0860035040 comp rx=0 tx=0).stop 2024-09-19T06:49:18.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.148+0000 7f0871c72640 1 -- 172.21.15.99:0/489164112 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f086c0fd590 msgr2=0x7f086c1131f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:18.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.148+0000 7f0871c72640 1 --2- 172.21.15.99:0/489164112 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f086c0fd590 0x7f086c1131f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f085c00eb70 tx=0x7f085c00b040 comp rx=0 tx=0).stop 2024-09-19T06:49:18.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.148+0000 7f0871c72640 1 -- 172.21.15.99:0/489164112 shutdown_connections 2024-09-19T06:49:18.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.148+0000 7f0871c72640 1 --2- 172.21.15.99:0/489164112 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f085406e530 0x7f08540709e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:18.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.148+0000 7f0871c72640 1 --2- 172.21.15.99:0/489164112 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f086c0fdf30 0x7f086c113730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:18.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.148+0000 7f0871c72640 1 --2- 172.21.15.99:0/489164112 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f086c0fd590 0x7f086c1131f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:18.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.148+0000 7f0871c72640 1 -- 172.21.15.99:0/489164112 >> 172.21.15.99:0/489164112 conn(0x7f086c0f7030 msgr2=0x7f086c0f85d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:18.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.148+0000 7f0871c72640 1 -- 172.21.15.99:0/489164112 shutdown_connections 2024-09-19T06:49:18.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.148+0000 7f0871c72640 1 -- 172.21.15.99:0/489164112 wait complete. 2024-09-19T06:49:18.158 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-09-19T06:49:18.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:49:17 smithi099 ceph-mon[97031]: pgmap v208: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:49:18.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.228+0000 7f924dad8640 1 -- 172.21.15.99:0/4202468180 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9248102680 msgr2=0x7f9248102a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:18.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.228+0000 7f924dad8640 1 --2- 172.21.15.99:0/4202468180 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9248102680 0x7f9248102a50 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f92380048d0 tx=0x7f9238009da0 comp rx=0 tx=0).stop 2024-09-19T06:49:18.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.228+0000 7f924dad8640 1 -- 172.21.15.99:0/4202468180 shutdown_connections 2024-09-19T06:49:18.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.228+0000 7f924dad8640 1 --2- 172.21.15.99:0/4202468180 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92480facf0 0x7f92480fb160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:18.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.228+0000 7f924dad8640 1 --2- 172.21.15.99:0/4202468180 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9248102680 0x7f9248102a50 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:18.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.228+0000 7f924dad8640 1 -- 172.21.15.99:0/4202468180 >> 172.21.15.99:0/4202468180 conn(0x7f9248070d50 msgr2=0x7f9248071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:18.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.228+0000 7f924dad8640 1 -- 172.21.15.99:0/4202468180 shutdown_connections 2024-09-19T06:49:18.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.228+0000 7f924dad8640 1 -- 172.21.15.99:0/4202468180 wait complete. 2024-09-19T06:49:18.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.228+0000 7f924dad8640 1 Processor -- start 2024-09-19T06:49:18.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.229+0000 7f924dad8640 1 -- start start 2024-09-19T06:49:18.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.229+0000 7f924dad8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92480facf0 0x7f92481154c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:18.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.229+0000 7f924dad8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9248102680 0x7f9248115a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:18.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.229+0000 7f924dad8640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9248116050 con 0x7f9248102680 2024-09-19T06:49:18.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.229+0000 7f924dad8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f924810f460 con 0x7f92480facf0 2024-09-19T06:49:18.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.229+0000 7f9246ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9248102680 0x7f9248115a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:18.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.229+0000 7f9246ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9248102680 0x7f9248115a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35496/0 (socket says 172.21.15.99:35496) 2024-09-19T06:49:18.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.229+0000 7f9246ffd640 1 -- 172.21.15.99:0/2449964466 learned_addr learned my addr 172.21.15.99:0/2449964466 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:49:18.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.229+0000 7f92477fe640 1 --2- 172.21.15.99:0/2449964466 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92480facf0 0x7f92481154c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:18.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.229+0000 7f9246ffd640 1 -- 172.21.15.99:0/2449964466 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92480facf0 msgr2=0x7f92481154c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:18.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.229+0000 7f9246ffd640 1 --2- 172.21.15.99:0/2449964466 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92480facf0 0x7f92481154c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:18.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.229+0000 7f9246ffd640 1 -- 172.21.15.99:0/2449964466 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9238005040 con 0x7f9248102680 2024-09-19T06:49:18.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.229+0000 7f9246ffd640 1 --2- 172.21.15.99:0/2449964466 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9248102680 0x7f9248115a00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f923c002a50 tx=0x7f923c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:18.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.230+0000 7f922ffff640 1 -- 172.21.15.99:0/2449964466 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f923c007c30 con 0x7f9248102680 2024-09-19T06:49:18.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.230+0000 7f922ffff640 1 -- 172.21.15.99:0/2449964466 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f923c00f040 con 0x7f9248102680 2024-09-19T06:49:18.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.230+0000 7f924dad8640 1 -- 172.21.15.99:0/2449964466 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f924810f740 con 0x7f9248102680 2024-09-19T06:49:18.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.230+0000 7f922ffff640 1 -- 172.21.15.99:0/2449964466 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f923c00da10 con 0x7f9248102680 2024-09-19T06:49:18.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.230+0000 7f924dad8640 1 -- 172.21.15.99:0/2449964466 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f924810fc60 con 0x7f9248102680 2024-09-19T06:49:18.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.231+0000 7f924dad8640 1 -- 172.21.15.99:0/2449964466 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92480657f0 con 0x7f9248102680 2024-09-19T06:49:18.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.231+0000 7f922ffff640 1 -- 172.21.15.99:0/2449964466 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f923c00dbb0 con 0x7f9248102680 2024-09-19T06:49:18.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.232+0000 7f922ffff640 1 --2- 172.21.15.99:0/2449964466 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f923006e530 0x7f92300709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:18.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.232+0000 7f922ffff640 1 -- 172.21.15.99:0/2449964466 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f923c08d870 con 0x7f9248102680 2024-09-19T06:49:18.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.232+0000 7f92477fe640 1 --2- 172.21.15.99:0/2449964466 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f923006e530 0x7f92300709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:18.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.232+0000 7f92477fe640 1 --2- 172.21.15.99:0/2449964466 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f923006e530 0x7f92300709e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9238009ac0 tx=0x7f9238035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:18.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.236+0000 7f922ffff640 1 -- 172.21.15.99:0/2449964466 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f923c056a90 con 0x7f9248102680 2024-09-19T06:49:18.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:49:17 smithi117 ceph-mon[76771]: pgmap v208: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:49:18.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.417+0000 7f924dad8640 1 -- 172.21.15.99:0/2449964466 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9248110bd0 con 0x7f923006e530 2024-09-19T06:49:18.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.419+0000 7f922ffff640 1 -- 172.21.15.99:0/2449964466 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f9248110bd0 con 0x7f923006e530 2024-09-19T06:49:18.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.420+0000 7f924dad8640 1 -- 172.21.15.99:0/2449964466 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f923006e530 msgr2=0x7f92300709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:18.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.420+0000 7f924dad8640 1 --2- 172.21.15.99:0/2449964466 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f923006e530 0x7f92300709e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9238009ac0 tx=0x7f9238035040 comp rx=0 tx=0).stop 2024-09-19T06:49:18.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.420+0000 7f924dad8640 1 -- 172.21.15.99:0/2449964466 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9248102680 msgr2=0x7f9248115a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:18.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.420+0000 7f924dad8640 1 --2- 172.21.15.99:0/2449964466 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9248102680 0x7f9248115a00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f923c002a50 tx=0x7f923c004600 comp rx=0 tx=0).stop 2024-09-19T06:49:18.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.421+0000 7f924dad8640 1 -- 172.21.15.99:0/2449964466 shutdown_connections 2024-09-19T06:49:18.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.421+0000 7f924dad8640 1 --2- 172.21.15.99:0/2449964466 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f923006e530 0x7f92300709e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:18.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.421+0000 7f924dad8640 1 --2- 172.21.15.99:0/2449964466 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9248102680 0x7f9248115a00 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:18.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.421+0000 7f924dad8640 1 --2- 172.21.15.99:0/2449964466 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f92480facf0 0x7f92481154c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:18.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.421+0000 7f924dad8640 1 -- 172.21.15.99:0/2449964466 >> 172.21.15.99:0/2449964466 conn(0x7f9248070d50 msgr2=0x7f92480fc7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:18.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.421+0000 7f924dad8640 1 -- 172.21.15.99:0/2449964466 shutdown_connections 2024-09-19T06:49:18.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.421+0000 7f924dad8640 1 -- 172.21.15.99:0/2449964466 wait complete. 2024-09-19T06:49:18.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.499+0000 7f2753134640 1 -- 172.21.15.99:0/1499274462 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f274c0fe460 msgr2=0x7f274c0fe830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:18.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.499+0000 7f2753134640 1 --2- 172.21.15.99:0/1499274462 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f274c0fe460 0x7f274c0fe830 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f273c0048d0 tx=0x7f273c009da0 comp rx=0 tx=0).stop 2024-09-19T06:49:18.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.500+0000 7f2753134640 1 -- 172.21.15.99:0/1499274462 shutdown_connections 2024-09-19T06:49:18.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.500+0000 7f2753134640 1 --2- 172.21.15.99:0/1499274462 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f274c064fc0 0x7f274c065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:18.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.500+0000 7f2753134640 1 --2- 172.21.15.99:0/1499274462 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f274c0fe460 0x7f274c0fe830 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:18.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.500+0000 7f2753134640 1 -- 172.21.15.99:0/1499274462 >> 172.21.15.99:0/1499274462 conn(0x7f274c0723b0 msgr2=0x7f274c0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:18.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.500+0000 7f2753134640 1 -- 172.21.15.99:0/1499274462 shutdown_connections 2024-09-19T06:49:18.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.500+0000 7f2753134640 1 -- 172.21.15.99:0/1499274462 wait complete. 2024-09-19T06:49:18.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.500+0000 7f2753134640 1 Processor -- start 2024-09-19T06:49:18.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.500+0000 7f2753134640 1 -- start start 2024-09-19T06:49:18.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.501+0000 7f2753134640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f274c064fc0 0x7f274c113190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:18.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.501+0000 7f2753134640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f274c0fe460 0x7f274c1136d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:18.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.501+0000 7f2753134640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f274c113cd0 con 0x7f274c0fe460 2024-09-19T06:49:18.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.501+0000 7f2753134640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f274c10d110 con 0x7f274c064fc0 2024-09-19T06:49:18.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.501+0000 7f274bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f274c0fe460 0x7f274c1136d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:18.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.501+0000 7f274bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f274c0fe460 0x7f274c1136d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35516/0 (socket says 172.21.15.99:35516) 2024-09-19T06:49:18.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.501+0000 7f274bfff640 1 -- 172.21.15.99:0/2527205590 learned_addr learned my addr 172.21.15.99:0/2527205590 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:49:18.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.501+0000 7f2750ed0640 1 --2- 172.21.15.99:0/2527205590 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f274c064fc0 0x7f274c113190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:18.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.501+0000 7f274bfff640 1 -- 172.21.15.99:0/2527205590 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f274c064fc0 msgr2=0x7f274c113190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:18.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.501+0000 7f274bfff640 1 --2- 172.21.15.99:0/2527205590 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f274c064fc0 0x7f274c113190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:18.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.501+0000 7f274bfff640 1 -- 172.21.15.99:0/2527205590 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f273c005040 con 0x7f274c0fe460 2024-09-19T06:49:18.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.501+0000 7f274bfff640 1 --2- 172.21.15.99:0/2527205590 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f274c0fe460 0x7f274c1136d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2740002a50 tx=0x7f2740004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:18.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.502+0000 7f27497fa640 1 -- 172.21.15.99:0/2527205590 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2740007c30 con 0x7f274c0fe460 2024-09-19T06:49:18.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.502+0000 7f2753134640 1 -- 172.21.15.99:0/2527205590 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f274c10d3f0 con 0x7f274c0fe460 2024-09-19T06:49:18.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.502+0000 7f27497fa640 1 -- 172.21.15.99:0/2527205590 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f274000f040 con 0x7f274c0fe460 2024-09-19T06:49:18.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.502+0000 7f27497fa640 1 -- 172.21.15.99:0/2527205590 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f274000dad0 con 0x7f274c0fe460 2024-09-19T06:49:18.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.502+0000 7f2753134640 1 -- 172.21.15.99:0/2527205590 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f274c10d990 con 0x7f274c0fe460 2024-09-19T06:49:18.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.503+0000 7f2753134640 1 -- 172.21.15.99:0/2527205590 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f274c0fdcf0 con 0x7f274c0fe460 2024-09-19T06:49:18.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.503+0000 7f27497fa640 1 -- 172.21.15.99:0/2527205590 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f274000dc30 con 0x7f274c0fe460 2024-09-19T06:49:18.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.504+0000 7f27497fa640 1 --2- 172.21.15.99:0/2527205590 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f273406e530 0x7f27340709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:18.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.504+0000 7f27497fa640 1 -- 172.21.15.99:0/2527205590 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f274008e040 con 0x7f274c0fe460 2024-09-19T06:49:18.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.504+0000 7f2750ed0640 1 --2- 172.21.15.99:0/2527205590 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f273406e530 0x7f27340709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:18.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.505+0000 7f2750ed0640 1 --2- 172.21.15.99:0/2527205590 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f273406e530 0x7f27340709e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f273c009ac0 tx=0x7f273c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:18.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.508+0000 7f27497fa640 1 -- 172.21.15.99:0/2527205590 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f2740057130 con 0x7f274c0fe460 2024-09-19T06:49:18.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.683+0000 7f2753134640 1 -- 172.21.15.99:0/2527205590 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f274c10e800 con 0x7f273406e530 2024-09-19T06:49:18.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.691+0000 7f27497fa640 1 -- 172.21.15.99:0/2527205590 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f274c10e800 con 0x7f273406e530 2024-09-19T06:49:18.693 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T06:49:18.693 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.smithi099 smithi099 *:9093,9094 running (8m) 58s ago 16m 23.4M - 0.25.0 c8568f914cd2 e7c1774d56b0 2024-09-19T06:49:18.693 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi099 smithi099 running (4m) 58s ago 16m 6899k - 19.1.1-361-g2f599a46 d2baa855c067 b9775f416b10 2024-09-19T06:49:18.693 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi117 smithi117 running (4m) 29s ago 16m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 38cf60c0d548 2024-09-19T06:49:18.693 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.smithi099 smithi099 *:3000 running (6m) 58s ago 16m 80.7M - 9.4.12 2bacad6d85d8 cd53a18d5410 2024-09-19T06:49:18.693 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.obarqf smithi099 running (80s) 58s ago 11m 12.2M - 19.1.1-361-g2f599a46 d2baa855c067 314a73082521 2024-09-19T06:49:18.694 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.xehbxe smithi099 running (63s) 58s ago 11m 14.4M - 19.1.1-361-g2f599a46 d2baa855c067 a2955a9d06e6 2024-09-19T06:49:18.694 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.bheqzh smithi117 running (32s) 29s ago 11m 11.8M - 19.1.1-361-g2f599a46 d2baa855c067 b1505937c0b7 2024-09-19T06:49:18.694 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.nooexo smithi117 running (47s) 29s ago 11m 13.1M - 19.1.1-361-g2f599a46 d2baa855c067 35bd7725855c 2024-09-19T06:49:18.694 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi099.pgvkqi smithi099 *:8443,9283,8765 running (7m) 58s ago 18m 505M - 19.1.1-361-g2f599a46 d2baa855c067 d5de99cb7e78 2024-09-19T06:49:18.694 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi117.ssmkcf smithi117 *:8443,9283,8765 running (7m) 29s ago 15m 444M - 19.1.1-361-g2f599a46 d2baa855c067 8b7ee0f871f5 2024-09-19T06:49:18.694 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi099 smithi099 running (5m) 58s ago 18m 52.4M 2048M 19.1.1-361-g2f599a46 d2baa855c067 ffe067438824 2024-09-19T06:49:18.694 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi117 smithi117 running (5m) 29s ago 15m 38.9M 2048M 19.1.1-361-g2f599a46 d2baa855c067 4cb7455e3ee7 2024-09-19T06:49:18.694 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi099 smithi099 *:9100 running (8m) 58s ago 16m 15.0M - 1.5.0 0da6a335fe13 dca7b4517dcc 2024-09-19T06:49:18.694 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi117 smithi117 *:9100 running (7m) 29s ago 15m 15.9M - 1.5.0 0da6a335fe13 8233ce3835d2 2024-09-19T06:49:18.694 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (4m) 58s ago 15m 100M 1557M 19.1.1-361-g2f599a46 d2baa855c067 8e22543bf933 2024-09-19T06:49:18.694 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (3m) 58s ago 14m 106M 1557M 19.1.1-361-g2f599a46 d2baa855c067 f54153d0ae09 2024-09-19T06:49:18.694 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (3m) 58s ago 14m 83.7M 1557M 19.1.1-361-g2f599a46 d2baa855c067 b1778ab88870 2024-09-19T06:49:18.694 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi117 running (2m) 29s ago 13m 102M 2581M 19.1.1-361-g2f599a46 d2baa855c067 ea5236b193d3 2024-09-19T06:49:18.694 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi117 running (2m) 29s ago 13m 93.5M 2581M 19.1.1-361-g2f599a46 d2baa855c067 27ac2c859a68 2024-09-19T06:49:18.695 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi117 running (96s) 29s ago 12m 100M 2581M 19.1.1-361-g2f599a46 d2baa855c067 de6aeb8544ce 2024-09-19T06:49:18.695 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.smithi099 smithi099 *:9095 running (7m) 58s ago 16m 64.4M - 2.43.0 a07b618ecd1d 15ad26ec6fb4 2024-09-19T06:49:18.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.694+0000 7f2753134640 1 -- 172.21.15.99:0/2527205590 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f273406e530 msgr2=0x7f27340709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:18.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.694+0000 7f2753134640 1 --2- 172.21.15.99:0/2527205590 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f273406e530 0x7f27340709e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f273c009ac0 tx=0x7f273c035040 comp rx=0 tx=0).stop 2024-09-19T06:49:18.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.694+0000 7f2753134640 1 -- 172.21.15.99:0/2527205590 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f274c0fe460 msgr2=0x7f274c1136d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:18.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.694+0000 7f2753134640 1 --2- 172.21.15.99:0/2527205590 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f274c0fe460 0x7f274c1136d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2740002a50 tx=0x7f2740004600 comp rx=0 tx=0).stop 2024-09-19T06:49:18.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.694+0000 7f2753134640 1 -- 172.21.15.99:0/2527205590 shutdown_connections 2024-09-19T06:49:18.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.694+0000 7f2753134640 1 --2- 172.21.15.99:0/2527205590 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f273406e530 0x7f27340709e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:18.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.694+0000 7f2753134640 1 --2- 172.21.15.99:0/2527205590 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f274c0fe460 0x7f274c1136d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:18.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.694+0000 7f2753134640 1 --2- 172.21.15.99:0/2527205590 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f274c064fc0 0x7f274c113190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:18.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.694+0000 7f2753134640 1 -- 172.21.15.99:0/2527205590 >> 172.21.15.99:0/2527205590 conn(0x7f274c0723b0 msgr2=0x7f274c105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:18.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.694+0000 7f2753134640 1 -- 172.21.15.99:0/2527205590 shutdown_connections 2024-09-19T06:49:18.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.694+0000 7f2753134640 1 -- 172.21.15.99:0/2527205590 wait complete. 2024-09-19T06:49:18.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.772+0000 7f40037d9640 1 -- 172.21.15.99:0/2596307062 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ffc0fcf80 msgr2=0x7f3ffc0fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:18.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.772+0000 7f40037d9640 1 --2- 172.21.15.99:0/2596307062 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ffc0fcf80 0x7f3ffc0fd3d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3ff00048d0 tx=0x7f3ff0009da0 comp rx=0 tx=0).stop 2024-09-19T06:49:18.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.772+0000 7f40037d9640 1 -- 172.21.15.99:0/2596307062 shutdown_connections 2024-09-19T06:49:18.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.772+0000 7f40037d9640 1 --2- 172.21.15.99:0/2596307062 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ffc0fcf80 0x7f3ffc0fd3d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:18.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.772+0000 7f40037d9640 1 --2- 172.21.15.99:0/2596307062 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ffc0fb810 0x7f3ffc0fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:18.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.772+0000 7f40037d9640 1 -- 172.21.15.99:0/2596307062 >> 172.21.15.99:0/2596307062 conn(0x7f3ffc0723b0 msgr2=0x7f3ffc0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:18.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.772+0000 7f40037d9640 1 -- 172.21.15.99:0/2596307062 shutdown_connections 2024-09-19T06:49:18.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.772+0000 7f40037d9640 1 -- 172.21.15.99:0/2596307062 wait complete. 2024-09-19T06:49:18.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.772+0000 7f40037d9640 1 Processor -- start 2024-09-19T06:49:18.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.773+0000 7f40037d9640 1 -- start start 2024-09-19T06:49:18.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.773+0000 7f40037d9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ffc0fb810 0x7f3ffc10e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:18.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.773+0000 7f40037d9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ffc0fcf80 0x7f3ffc10e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:18.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.773+0000 7f40037d9640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ffc10ed20 con 0x7f3ffc0fcf80 2024-09-19T06:49:18.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.773+0000 7f40037d9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ffc10ee90 con 0x7f3ffc0fb810 2024-09-19T06:49:18.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.773+0000 7f4000d74640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ffc0fcf80 0x7f3ffc10e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:18.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.773+0000 7f4000d74640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ffc0fcf80 0x7f3ffc10e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35530/0 (socket says 172.21.15.99:35530) 2024-09-19T06:49:18.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.773+0000 7f4000d74640 1 -- 172.21.15.99:0/2504126765 learned_addr learned my addr 172.21.15.99:0/2504126765 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:49:18.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.773+0000 7f4001575640 1 --2- 172.21.15.99:0/2504126765 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ffc0fb810 0x7f3ffc10e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:18.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.773+0000 7f4000d74640 1 -- 172.21.15.99:0/2504126765 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ffc0fb810 msgr2=0x7f3ffc10e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:18.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.773+0000 7f4000d74640 1 --2- 172.21.15.99:0/2504126765 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ffc0fb810 0x7f3ffc10e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:18.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.773+0000 7f4000d74640 1 -- 172.21.15.99:0/2504126765 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ff0005040 con 0x7f3ffc0fcf80 2024-09-19T06:49:18.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.773+0000 7f4001575640 1 --2- 172.21.15.99:0/2504126765 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ffc0fb810 0x7f3ffc10e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:49:18.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.774+0000 7f4000d74640 1 --2- 172.21.15.99:0/2504126765 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ffc0fcf80 0x7f3ffc10e6d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3ff00043d0 tx=0x7f3ff0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:18.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.774+0000 7f3ff9ffb640 1 -- 172.21.15.99:0/2504126765 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ff0038070 con 0x7f3ffc0fcf80 2024-09-19T06:49:18.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.774+0000 7f3ff9ffb640 1 -- 172.21.15.99:0/2504126765 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3ff00096e0 con 0x7f3ffc0fcf80 2024-09-19T06:49:18.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.774+0000 7f40037d9640 1 -- 172.21.15.99:0/2504126765 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ffc117200 con 0x7f3ffc0fcf80 2024-09-19T06:49:18.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.774+0000 7f3ff9ffb640 1 -- 172.21.15.99:0/2504126765 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ff003d420 con 0x7f3ffc0fcf80 2024-09-19T06:49:18.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.774+0000 7f40037d9640 1 -- 172.21.15.99:0/2504126765 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ffc1176c0 con 0x7f3ffc0fcf80 2024-09-19T06:49:18.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.775+0000 7f40037d9640 1 -- 172.21.15.99:0/2504126765 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ffc0fcbc0 con 0x7f3ffc0fcf80 2024-09-19T06:49:18.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.776+0000 7f3ff9ffb640 1 -- 172.21.15.99:0/2504126765 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f3ff0030020 con 0x7f3ffc0fcf80 2024-09-19T06:49:18.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.776+0000 7f3ff9ffb640 1 --2- 172.21.15.99:0/2504126765 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f3fe406e530 0x7f3fe40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:18.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.776+0000 7f3ff9ffb640 1 -- 172.21.15.99:0/2504126765 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f3ff00ae5e0 con 0x7f3ffc0fcf80 2024-09-19T06:49:18.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.776+0000 7f4001575640 1 --2- 172.21.15.99:0/2504126765 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f3fe406e530 0x7f3fe40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:18.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.777+0000 7f4001575640 1 --2- 172.21.15.99:0/2504126765 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f3fe406e530 0x7f3fe40709e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3fec004fd0 tx=0x7f3fec009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:18.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:18.780+0000 7f3ff9ffb640 1 -- 172.21.15.99:0/2504126765 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f3ff00776d0 con 0x7f3ffc0fcf80 2024-09-19T06:49:19.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.012+0000 7f40037d9640 1 -- 172.21.15.99:0/2504126765 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3ffc065760 con 0x7f3ffc0fcf80 2024-09-19T06:49:19.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.013+0000 7f3ff9ffb640 1 -- 172.21.15.99:0/2504126765 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f3ff007ad90 con 0x7f3ffc0fcf80 2024-09-19T06:49:19.014 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:49:19.015 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-09-19T06:49:19.015 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T06:49:19.015 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:49:19.015 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-09-19T06:49:19.015 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T06:49:19.015 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:49:19.015 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-09-19T06:49:19.015 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 6 2024-09-19T06:49:19.015 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:49:19.015 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": { 2024-09-19T06:49:19.015 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 4 2024-09-19T06:49:19.015 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:49:19.016 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-09-19T06:49:19.016 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 14 2024-09-19T06:49:19.016 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T06:49:19.016 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:49:19.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.015+0000 7f40037d9640 1 -- 172.21.15.99:0/2504126765 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f3fe406e530 msgr2=0x7f3fe40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:19.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.015+0000 7f40037d9640 1 --2- 172.21.15.99:0/2504126765 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f3fe406e530 0x7f3fe40709e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3fec004fd0 tx=0x7f3fec009040 comp rx=0 tx=0).stop 2024-09-19T06:49:19.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.015+0000 7f40037d9640 1 -- 172.21.15.99:0/2504126765 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ffc0fcf80 msgr2=0x7f3ffc10e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:19.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.015+0000 7f40037d9640 1 --2- 172.21.15.99:0/2504126765 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ffc0fcf80 0x7f3ffc10e6d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3ff00043d0 tx=0x7f3ff0009da0 comp rx=0 tx=0).stop 2024-09-19T06:49:19.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.015+0000 7f40037d9640 1 -- 172.21.15.99:0/2504126765 shutdown_connections 2024-09-19T06:49:19.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.015+0000 7f40037d9640 1 --2- 172.21.15.99:0/2504126765 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f3fe406e530 0x7f3fe40709e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:19.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.015+0000 7f40037d9640 1 --2- 172.21.15.99:0/2504126765 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ffc0fcf80 0x7f3ffc10e6d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:19.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.015+0000 7f40037d9640 1 --2- 172.21.15.99:0/2504126765 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ffc0fb810 0x7f3ffc10e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:19.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.015+0000 7f40037d9640 1 -- 172.21.15.99:0/2504126765 >> 172.21.15.99:0/2504126765 conn(0x7f3ffc0723b0 msgr2=0x7f3ffc0fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:19.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.016+0000 7f40037d9640 1 -- 172.21.15.99:0/2504126765 shutdown_connections 2024-09-19T06:49:19.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.016+0000 7f40037d9640 1 -- 172.21.15.99:0/2504126765 wait complete. 2024-09-19T06:49:19.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.094+0000 7f9a838e5640 1 -- 172.21.15.99:0/3311014794 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a7c102530 msgr2=0x7f9a7c102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:19.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.094+0000 7f9a838e5640 1 --2- 172.21.15.99:0/3311014794 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a7c102530 0x7f9a7c102900 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9a780048d0 tx=0x7f9a78009da0 comp rx=0 tx=0).stop 2024-09-19T06:49:19.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.094+0000 7f9a838e5640 1 -- 172.21.15.99:0/3311014794 shutdown_connections 2024-09-19T06:49:19.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.094+0000 7f9a838e5640 1 --2- 172.21.15.99:0/3311014794 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a7c102ed0 0x7f9a7c0fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:19.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.094+0000 7f9a838e5640 1 --2- 172.21.15.99:0/3311014794 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a7c102530 0x7f9a7c102900 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:19.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.095+0000 7f9a838e5640 1 -- 172.21.15.99:0/3311014794 >> 172.21.15.99:0/3311014794 conn(0x7f9a7c0f80f0 msgr2=0x7f9a7c0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:19.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.095+0000 7f9a838e5640 1 -- 172.21.15.99:0/3311014794 shutdown_connections 2024-09-19T06:49:19.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.095+0000 7f9a838e5640 1 -- 172.21.15.99:0/3311014794 wait complete. 2024-09-19T06:49:19.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.095+0000 7f9a838e5640 1 Processor -- start 2024-09-19T06:49:19.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.095+0000 7f9a838e5640 1 -- start start 2024-09-19T06:49:19.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.096+0000 7f9a838e5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a7c102530 0x7f9a7c113240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:19.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.096+0000 7f9a838e5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a7c102ed0 0x7f9a7c113780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:19.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.096+0000 7f9a838e5640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7c113d80 con 0x7f9a7c102ed0 2024-09-19T06:49:19.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.096+0000 7f9a838e5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7c10d1c0 con 0x7f9a7c102530 2024-09-19T06:49:19.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.096+0000 7f9a80e80640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a7c102ed0 0x7f9a7c113780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:19.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.096+0000 7f9a80e80640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a7c102ed0 0x7f9a7c113780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35558/0 (socket says 172.21.15.99:35558) 2024-09-19T06:49:19.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.096+0000 7f9a80e80640 1 -- 172.21.15.99:0/2031681895 learned_addr learned my addr 172.21.15.99:0/2031681895 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:49:19.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.096+0000 7f9a81681640 1 --2- 172.21.15.99:0/2031681895 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a7c102530 0x7f9a7c113240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:19.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.096+0000 7f9a80e80640 1 -- 172.21.15.99:0/2031681895 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a7c102530 msgr2=0x7f9a7c113240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:19.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.096+0000 7f9a80e80640 1 --2- 172.21.15.99:0/2031681895 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a7c102530 0x7f9a7c113240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:19.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.096+0000 7f9a80e80640 1 -- 172.21.15.99:0/2031681895 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a78005040 con 0x7f9a7c102ed0 2024-09-19T06:49:19.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.096+0000 7f9a80e80640 1 --2- 172.21.15.99:0/2031681895 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a7c102ed0 0x7f9a7c113780 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c002840 tx=0x7f9a6c004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:19.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.096+0000 7f9a71ffb640 1 -- 172.21.15.99:0/2031681895 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a6c007c30 con 0x7f9a7c102ed0 2024-09-19T06:49:19.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.096+0000 7f9a71ffb640 1 -- 172.21.15.99:0/2031681895 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9a6c00f040 con 0x7f9a7c102ed0 2024-09-19T06:49:19.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.097+0000 7f9a838e5640 1 -- 172.21.15.99:0/2031681895 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a7c10d4a0 con 0x7f9a7c102ed0 2024-09-19T06:49:19.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.097+0000 7f9a71ffb640 1 -- 172.21.15.99:0/2031681895 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a6c00d990 con 0x7f9a7c102ed0 2024-09-19T06:49:19.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.097+0000 7f9a838e5640 1 -- 172.21.15.99:0/2031681895 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a7c10da40 con 0x7f9a7c102ed0 2024-09-19T06:49:19.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.098+0000 7f9a838e5640 1 -- 172.21.15.99:0/2031681895 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a7c0fdcb0 con 0x7f9a7c102ed0 2024-09-19T06:49:19.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.098+0000 7f9a71ffb640 1 -- 172.21.15.99:0/2031681895 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f9a6c009600 con 0x7f9a7c102ed0 2024-09-19T06:49:19.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.099+0000 7f9a71ffb640 1 --2- 172.21.15.99:0/2031681895 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f9a6806e530 0x7f9a680709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:19.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.099+0000 7f9a71ffb640 1 -- 172.21.15.99:0/2031681895 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f9a6c08d8d0 con 0x7f9a7c102ed0 2024-09-19T06:49:19.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.099+0000 7f9a81681640 1 --2- 172.21.15.99:0/2031681895 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f9a6806e530 0x7f9a680709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:19.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.099+0000 7f9a81681640 1 --2- 172.21.15.99:0/2031681895 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f9a6806e530 0x7f9a680709e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9a78009ac0 tx=0x7f9a78035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:19.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.103+0000 7f9a71ffb640 1 -- 172.21.15.99:0/2031681895 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f9a6c056a70 con 0x7f9a7c102ed0 2024-09-19T06:49:19.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.305+0000 7f9a838e5640 1 -- 172.21.15.99:0/2031681895 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9a7c1095a0 con 0x7f9a7c102ed0 2024-09-19T06:49:19.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.305+0000 7f9a71ffb640 1 -- 172.21.15.99:0/2031681895 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 29 v29) v1 ==== 76+0+1915 (secure 0 0 0) 0x7f9a6c05a130 con 0x7f9a7c102ed0 2024-09-19T06:49:19.307 INFO:teuthology.orchestra.run.smithi099.stdout:e29 2024-09-19T06:49:19.307 INFO:teuthology.orchestra.run.smithi099.stdout:btime 2024-09-19T06:48:47:938420+0000 2024-09-19T06:49:19.307 INFO:teuthology.orchestra.run.smithi099.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T06:49:19.307 INFO:teuthology.orchestra.run.smithi099.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T06:49:19.307 INFO:teuthology.orchestra.run.smithi099.stdout:legacy client fscid: 1 2024-09-19T06:49:19.307 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:49:19.307 INFO:teuthology.orchestra.run.smithi099.stdout:Filesystem 'cephfs' (1) 2024-09-19T06:49:19.307 INFO:teuthology.orchestra.run.smithi099.stdout:fs_name cephfs 2024-09-19T06:49:19.308 INFO:teuthology.orchestra.run.smithi099.stdout:epoch 20 2024-09-19T06:49:19.308 INFO:teuthology.orchestra.run.smithi099.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-19T06:49:19.308 INFO:teuthology.orchestra.run.smithi099.stdout:created 2024-09-19T06:37:40.838146+0000 2024-09-19T06:49:19.308 INFO:teuthology.orchestra.run.smithi099.stdout:modified 2024-09-19T06:47:50.076553+0000 2024-09-19T06:49:19.308 INFO:teuthology.orchestra.run.smithi099.stdout:tableserver 0 2024-09-19T06:49:19.308 INFO:teuthology.orchestra.run.smithi099.stdout:root 0 2024-09-19T06:49:19.308 INFO:teuthology.orchestra.run.smithi099.stdout:session_timeout 60 2024-09-19T06:49:19.308 INFO:teuthology.orchestra.run.smithi099.stdout:session_autoclose 300 2024-09-19T06:49:19.308 INFO:teuthology.orchestra.run.smithi099.stdout:max_file_size 1099511627776 2024-09-19T06:49:19.308 INFO:teuthology.orchestra.run.smithi099.stdout:max_xattr_size 65536 2024-09-19T06:49:19.308 INFO:teuthology.orchestra.run.smithi099.stdout:required_client_features {} 2024-09-19T06:49:19.309 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure 0 2024-09-19T06:49:19.309 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure_osd_epoch 77 2024-09-19T06:49:19.309 INFO:teuthology.orchestra.run.smithi099.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T06:49:19.309 INFO:teuthology.orchestra.run.smithi099.stdout:max_mds 2 2024-09-19T06:49:19.309 INFO:teuthology.orchestra.run.smithi099.stdout:in 0,1 2024-09-19T06:49:19.309 INFO:teuthology.orchestra.run.smithi099.stdout:up {} 2024-09-19T06:49:19.309 INFO:teuthology.orchestra.run.smithi099.stdout:failed 0,1 2024-09-19T06:49:19.309 INFO:teuthology.orchestra.run.smithi099.stdout:damaged 2024-09-19T06:49:19.309 INFO:teuthology.orchestra.run.smithi099.stdout:stopped 2024-09-19T06:49:19.309 INFO:teuthology.orchestra.run.smithi099.stdout:data_pools [3] 2024-09-19T06:49:19.309 INFO:teuthology.orchestra.run.smithi099.stdout:metadata_pool 2 2024-09-19T06:49:19.309 INFO:teuthology.orchestra.run.smithi099.stdout:inline_data disabled 2024-09-19T06:49:19.309 INFO:teuthology.orchestra.run.smithi099.stdout:balancer 2024-09-19T06:49:19.309 INFO:teuthology.orchestra.run.smithi099.stdout:bal_rank_mask -1 2024-09-19T06:49:19.310 INFO:teuthology.orchestra.run.smithi099.stdout:standby_count_wanted 1 2024-09-19T06:49:19.310 INFO:teuthology.orchestra.run.smithi099.stdout:qdb_cluster leader: 0 members: 2024-09-19T06:49:19.310 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:49:19.310 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:49:19.310 INFO:teuthology.orchestra.run.smithi099.stdout:Standby daemons: 2024-09-19T06:49:19.310 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:49:19.310 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.obarqf{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6826/1859154203,v1:172.21.15.99:6827/1859154203] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:49:19.310 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.xehbxe{-1:34410} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6828/1939453719,v1:172.21.15.99:6829/1939453719] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:49:19.310 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.nooexo{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6824/1398895079,v1:172.21.15.117:6825/1398895079] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:49:19.310 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.bheqzh{-1:44329} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6826/3233337308,v1:172.21.15.117:6827/3233337308] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:49:19.311 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 29 2024-09-19T06:49:19.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.307+0000 7f9a838e5640 1 -- 172.21.15.99:0/2031681895 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f9a6806e530 msgr2=0x7f9a680709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:19.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.308+0000 7f9a838e5640 1 --2- 172.21.15.99:0/2031681895 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f9a6806e530 0x7f9a680709e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9a78009ac0 tx=0x7f9a78035040 comp rx=0 tx=0).stop 2024-09-19T06:49:19.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.308+0000 7f9a838e5640 1 -- 172.21.15.99:0/2031681895 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a7c102ed0 msgr2=0x7f9a7c113780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:19.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.308+0000 7f9a838e5640 1 --2- 172.21.15.99:0/2031681895 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a7c102ed0 0x7f9a7c113780 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c002840 tx=0x7f9a6c004570 comp rx=0 tx=0).stop 2024-09-19T06:49:19.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.308+0000 7f9a838e5640 1 -- 172.21.15.99:0/2031681895 shutdown_connections 2024-09-19T06:49:19.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.308+0000 7f9a838e5640 1 --2- 172.21.15.99:0/2031681895 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f9a6806e530 0x7f9a680709e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:19.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.308+0000 7f9a838e5640 1 --2- 172.21.15.99:0/2031681895 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a7c102ed0 0x7f9a7c113780 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:19.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.308+0000 7f9a838e5640 1 --2- 172.21.15.99:0/2031681895 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a7c102530 0x7f9a7c113240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:19.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.308+0000 7f9a838e5640 1 -- 172.21.15.99:0/2031681895 >> 172.21.15.99:0/2031681895 conn(0x7f9a7c0f80f0 msgr2=0x7f9a7c0f90f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:19.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.308+0000 7f9a838e5640 1 -- 172.21.15.99:0/2031681895 shutdown_connections 2024-09-19T06:49:19.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.308+0000 7f9a838e5640 1 -- 172.21.15.99:0/2031681895 wait complete. 2024-09-19T06:49:19.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.387+0000 7fccc2082640 1 -- 172.21.15.99:0/1896747842 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fccbc0fdf00 msgr2=0x7fccbc1065d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:19.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.387+0000 7fccc2082640 1 --2- 172.21.15.99:0/1896747842 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fccbc0fdf00 0x7fccbc1065d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fccb0004900 tx=0x7fccb0009da0 comp rx=0 tx=0).stop 2024-09-19T06:49:19.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.387+0000 7fccc2082640 1 -- 172.21.15.99:0/1896747842 shutdown_connections 2024-09-19T06:49:19.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.387+0000 7fccc2082640 1 --2- 172.21.15.99:0/1896747842 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fccbc0fdf00 0x7fccbc1065d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:19.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.387+0000 7fccc2082640 1 --2- 172.21.15.99:0/1896747842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fccbc0fd560 0x7fccbc0fd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:19.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.387+0000 7fccc2082640 1 -- 172.21.15.99:0/1896747842 >> 172.21.15.99:0/1896747842 conn(0x7fccbc0f7000 msgr2=0x7fccbc0f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:19.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.387+0000 7fccc2082640 1 -- 172.21.15.99:0/1896747842 shutdown_connections 2024-09-19T06:49:19.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.387+0000 7fccc2082640 1 -- 172.21.15.99:0/1896747842 wait complete. 2024-09-19T06:49:19.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.388+0000 7fccc2082640 1 Processor -- start 2024-09-19T06:49:19.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.388+0000 7fccc2082640 1 -- start start 2024-09-19T06:49:19.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.388+0000 7fccc2082640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fccbc0fd560 0x7fccbc1132d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:19.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.388+0000 7fccc2082640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fccbc0fdf00 0x7fccbc113810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:19.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.388+0000 7fccc2082640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccbc113e10 con 0x7fccbc0fdf00 2024-09-19T06:49:19.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.388+0000 7fccc2082640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccbc113f80 con 0x7fccbc0fd560 2024-09-19T06:49:19.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.388+0000 7fccbaffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fccbc0fdf00 0x7fccbc113810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:19.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.388+0000 7fccbaffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fccbc0fdf00 0x7fccbc113810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35564/0 (socket says 172.21.15.99:35564) 2024-09-19T06:49:19.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.388+0000 7fccbaffd640 1 -- 172.21.15.99:0/3647864915 learned_addr learned my addr 172.21.15.99:0/3647864915 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:49:19.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.388+0000 7fccbb7fe640 1 --2- 172.21.15.99:0/3647864915 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fccbc0fd560 0x7fccbc1132d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:19.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.389+0000 7fccbaffd640 1 -- 172.21.15.99:0/3647864915 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fccbc0fd560 msgr2=0x7fccbc1132d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:19.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.389+0000 7fccbaffd640 1 --2- 172.21.15.99:0/3647864915 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fccbc0fd560 0x7fccbc1132d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:19.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.389+0000 7fccbaffd640 1 -- 172.21.15.99:0/3647864915 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccb0005040 con 0x7fccbc0fdf00 2024-09-19T06:49:19.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.389+0000 7fccbaffd640 1 --2- 172.21.15.99:0/3647864915 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fccbc0fdf00 0x7fccbc113810 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fccb0009ac0 tx=0x7fccb0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:19.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.389+0000 7fcca3fff640 1 -- 172.21.15.99:0/3647864915 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fccb0038070 con 0x7fccbc0fdf00 2024-09-19T06:49:19.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.389+0000 7fccc2082640 1 -- 172.21.15.99:0/3647864915 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccbc10d3a0 con 0x7fccbc0fdf00 2024-09-19T06:49:19.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.389+0000 7fcca3fff640 1 -- 172.21.15.99:0/3647864915 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fccb002ae80 con 0x7fccbc0fdf00 2024-09-19T06:49:19.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.389+0000 7fcca3fff640 1 -- 172.21.15.99:0/3647864915 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fccb0009680 con 0x7fccbc0fdf00 2024-09-19T06:49:19.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.389+0000 7fccc2082640 1 -- 172.21.15.99:0/3647864915 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccbc10d860 con 0x7fccbc0fdf00 2024-09-19T06:49:19.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.390+0000 7fccc2082640 1 -- 172.21.15.99:0/3647864915 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcca8005210 con 0x7fccbc0fdf00 2024-09-19T06:49:19.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.391+0000 7fcca3fff640 1 -- 172.21.15.99:0/3647864915 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fccb0030020 con 0x7fccbc0fdf00 2024-09-19T06:49:19.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.391+0000 7fcca3fff640 1 --2- 172.21.15.99:0/3647864915 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fcca406e530 0x7fcca40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:19.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.391+0000 7fcca3fff640 1 -- 172.21.15.99:0/3647864915 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fccb00ae570 con 0x7fccbc0fdf00 2024-09-19T06:49:19.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.391+0000 7fccbb7fe640 1 --2- 172.21.15.99:0/3647864915 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fcca406e530 0x7fcca40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:19.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.392+0000 7fccbb7fe640 1 --2- 172.21.15.99:0/3647864915 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fcca406e530 0x7fcca40709e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fccac004ed0 tx=0x7fccac00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:19.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.396+0000 7fcca3fff640 1 -- 172.21.15.99:0/3647864915 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fccb0077660 con 0x7fccbc0fdf00 2024-09-19T06:49:19.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.577+0000 7fccc2082640 1 -- 172.21.15.99:0/3647864915 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcca8000bc0 con 0x7fcca406e530 2024-09-19T06:49:19.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.578+0000 7fcca3fff640 1 -- 172.21.15.99:0/3647864915 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fcca8000bc0 con 0x7fcca406e530 2024-09-19T06:49:19.579 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:49:19.579 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T06:49:19.579 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": true, 2024-09-19T06:49:19.580 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T06:49:19.580 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [ 2024-09-19T06:49:19.580 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr", 2024-09-19T06:49:19.580 INFO:teuthology.orchestra.run.smithi099.stdout: "crash", 2024-09-19T06:49:19.580 INFO:teuthology.orchestra.run.smithi099.stdout: "mds", 2024-09-19T06:49:19.580 INFO:teuthology.orchestra.run.smithi099.stdout: "mon", 2024-09-19T06:49:19.580 INFO:teuthology.orchestra.run.smithi099.stdout: "osd" 2024-09-19T06:49:19.580 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-19T06:49:19.580 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": "16/21 daemons upgraded", 2024-09-19T06:49:19.580 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "Currently upgrading mds daemons", 2024-09-19T06:49:19.580 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-09-19T06:49:19.580 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:49:19.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.580+0000 7fccc2082640 1 -- 172.21.15.99:0/3647864915 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fcca406e530 msgr2=0x7fcca40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:19.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.580+0000 7fccc2082640 1 --2- 172.21.15.99:0/3647864915 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fcca406e530 0x7fcca40709e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fccac004ed0 tx=0x7fccac00b040 comp rx=0 tx=0).stop 2024-09-19T06:49:19.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.580+0000 7fccc2082640 1 -- 172.21.15.99:0/3647864915 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fccbc0fdf00 msgr2=0x7fccbc113810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:19.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.580+0000 7fccc2082640 1 --2- 172.21.15.99:0/3647864915 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fccbc0fdf00 0x7fccbc113810 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fccb0009ac0 tx=0x7fccb0009da0 comp rx=0 tx=0).stop 2024-09-19T06:49:19.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.580+0000 7fccc2082640 1 -- 172.21.15.99:0/3647864915 shutdown_connections 2024-09-19T06:49:19.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.580+0000 7fccc2082640 1 --2- 172.21.15.99:0/3647864915 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fcca406e530 0x7fcca40709e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:19.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.580+0000 7fccc2082640 1 --2- 172.21.15.99:0/3647864915 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fccbc0fdf00 0x7fccbc113810 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:19.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.580+0000 7fccc2082640 1 --2- 172.21.15.99:0/3647864915 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fccbc0fd560 0x7fccbc1132d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:19.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.580+0000 7fccc2082640 1 -- 172.21.15.99:0/3647864915 >> 172.21.15.99:0/3647864915 conn(0x7fccbc0f7000 msgr2=0x7fccbc0f8510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:19.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.581+0000 7fccc2082640 1 -- 172.21.15.99:0/3647864915 shutdown_connections 2024-09-19T06:49:19.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.581+0000 7fccc2082640 1 -- 172.21.15.99:0/3647864915 wait complete. 2024-09-19T06:49:19.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.658+0000 7fc48a7bf640 1 -- 172.21.15.99:0/528878707 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc484065520 msgr2=0x7fc484065970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:19.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.658+0000 7fc48a7bf640 1 --2- 172.21.15.99:0/528878707 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc484065520 0x7fc484065970 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc4780048d0 tx=0x7fc478009da0 comp rx=0 tx=0).stop 2024-09-19T06:49:19.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.658+0000 7fc48a7bf640 1 -- 172.21.15.99:0/528878707 shutdown_connections 2024-09-19T06:49:19.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.658+0000 7fc48a7bf640 1 --2- 172.21.15.99:0/528878707 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc484065520 0x7fc484065970 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:19.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.658+0000 7fc48a7bf640 1 --2- 172.21.15.99:0/528878707 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc484101540 0x7fc484064fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:19.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.658+0000 7fc48a7bf640 1 -- 172.21.15.99:0/528878707 >> 172.21.15.99:0/528878707 conn(0x7fc4840723b0 msgr2=0x7fc4840727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:19.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.658+0000 7fc48a7bf640 1 -- 172.21.15.99:0/528878707 shutdown_connections 2024-09-19T06:49:19.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.658+0000 7fc48a7bf640 1 -- 172.21.15.99:0/528878707 wait complete. 2024-09-19T06:49:19.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.659+0000 7fc48a7bf640 1 Processor -- start 2024-09-19T06:49:19.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.659+0000 7fc48a7bf640 1 -- start start 2024-09-19T06:49:19.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.659+0000 7fc48a7bf640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc484065520 0x7fc484119820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:19.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.659+0000 7fc48a7bf640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc484101540 0x7fc484119d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:19.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.659+0000 7fc48a7bf640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc48411a3b0 con 0x7fc484101540 2024-09-19T06:49:19.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.659+0000 7fc48a7bf640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4841137c0 con 0x7fc484065520 2024-09-19T06:49:19.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.659+0000 7fc4837fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc484101540 0x7fc484119d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:19.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.659+0000 7fc4837fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc484101540 0x7fc484119d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35574/0 (socket says 172.21.15.99:35574) 2024-09-19T06:49:19.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.659+0000 7fc483fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc484065520 0x7fc484119820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:19.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.659+0000 7fc4837fe640 1 -- 172.21.15.99:0/3993471217 learned_addr learned my addr 172.21.15.99:0/3993471217 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:49:19.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.660+0000 7fc4837fe640 1 -- 172.21.15.99:0/3993471217 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc484065520 msgr2=0x7fc484119820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:19.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.660+0000 7fc4837fe640 1 --2- 172.21.15.99:0/3993471217 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc484065520 0x7fc484119820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:19.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.660+0000 7fc4837fe640 1 -- 172.21.15.99:0/3993471217 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc478005040 con 0x7fc484101540 2024-09-19T06:49:19.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.660+0000 7fc4837fe640 1 --2- 172.21.15.99:0/3993471217 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc484101540 0x7fc484119d60 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc478000c00 tx=0x7fc478009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:19.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.660+0000 7fc480ff9640 1 -- 172.21.15.99:0/3993471217 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc478038070 con 0x7fc484101540 2024-09-19T06:49:19.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.660+0000 7fc480ff9640 1 -- 172.21.15.99:0/3993471217 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc47802ade0 con 0x7fc484101540 2024-09-19T06:49:19.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.660+0000 7fc48a7bf640 1 -- 172.21.15.99:0/3993471217 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc484113a40 con 0x7fc484101540 2024-09-19T06:49:19.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.660+0000 7fc480ff9640 1 -- 172.21.15.99:0/3993471217 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc47802c7e0 con 0x7fc484101540 2024-09-19T06:49:19.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.660+0000 7fc48a7bf640 1 -- 172.21.15.99:0/3993471217 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc484113f00 con 0x7fc484101540 2024-09-19T06:49:19.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.661+0000 7fc48a7bf640 1 -- 172.21.15.99:0/3993471217 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4840fbae0 con 0x7fc484101540 2024-09-19T06:49:19.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.662+0000 7fc480ff9640 1 -- 172.21.15.99:0/3993471217 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fc478030020 con 0x7fc484101540 2024-09-19T06:49:19.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.662+0000 7fc480ff9640 1 --2- 172.21.15.99:0/3993471217 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fc46c06e530 0x7fc46c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:19.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.663+0000 7fc480ff9640 1 -- 172.21.15.99:0/3993471217 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fc4780adce0 con 0x7fc484101540 2024-09-19T06:49:19.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.663+0000 7fc483fff640 1 --2- 172.21.15.99:0/3993471217 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fc46c06e530 0x7fc46c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:19.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.663+0000 7fc483fff640 1 --2- 172.21.15.99:0/3993471217 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fc46c06e530 0x7fc46c0709e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc474009fd0 tx=0x7fc47400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:19.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.667+0000 7fc480ff9640 1 -- 172.21.15.99:0/3993471217 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fc4780b2070 con 0x7fc484101540 2024-09-19T06:49:19.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.898+0000 7fc48a7bf640 1 -- 172.21.15.99:0/3993471217 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fc484114e90 con 0x7fc484101540 2024-09-19T06:49:19.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.898+0000 7fc480ff9640 1 -- 172.21.15.99:0/3993471217 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7fc478076f00 con 0x7fc484101540 2024-09-19T06:49:19.900 INFO:teuthology.orchestra.run.smithi099.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-09-19T06:49:19.900 INFO:teuthology.orchestra.run.smithi099.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-19T06:49:19.900 INFO:teuthology.orchestra.run.smithi099.stdout: fs cephfs is degraded 2024-09-19T06:49:19.900 INFO:teuthology.orchestra.run.smithi099.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-19T06:49:19.900 INFO:teuthology.orchestra.run.smithi099.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-19T06:49:19.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.901+0000 7fc48a7bf640 1 -- 172.21.15.99:0/3993471217 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fc46c06e530 msgr2=0x7fc46c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:19.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.901+0000 7fc48a7bf640 1 --2- 172.21.15.99:0/3993471217 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fc46c06e530 0x7fc46c0709e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc474009fd0 tx=0x7fc47400b040 comp rx=0 tx=0).stop 2024-09-19T06:49:19.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.901+0000 7fc48a7bf640 1 -- 172.21.15.99:0/3993471217 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc484101540 msgr2=0x7fc484119d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:19.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.901+0000 7fc48a7bf640 1 --2- 172.21.15.99:0/3993471217 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc484101540 0x7fc484119d60 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc478000c00 tx=0x7fc478009da0 comp rx=0 tx=0).stop 2024-09-19T06:49:19.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.901+0000 7fc48a7bf640 1 -- 172.21.15.99:0/3993471217 shutdown_connections 2024-09-19T06:49:19.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.901+0000 7fc48a7bf640 1 --2- 172.21.15.99:0/3993471217 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fc46c06e530 0x7fc46c0709e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:19.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.901+0000 7fc48a7bf640 1 --2- 172.21.15.99:0/3993471217 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc484101540 0x7fc484119d60 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:19.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.901+0000 7fc48a7bf640 1 --2- 172.21.15.99:0/3993471217 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc484065520 0x7fc484119820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:19.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.901+0000 7fc48a7bf640 1 -- 172.21.15.99:0/3993471217 >> 172.21.15.99:0/3993471217 conn(0x7fc4840723b0 msgr2=0x7fc4840fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:19.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.901+0000 7fc48a7bf640 1 -- 172.21.15.99:0/3993471217 shutdown_connections 2024-09-19T06:49:19.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:19.901+0000 7fc48a7bf640 1 -- 172.21.15.99:0/3993471217 wait complete. 2024-09-19T06:49:20.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:49:19 smithi099 ceph-mon[97031]: from='client.34446 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:49:20.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:49:19 smithi099 ceph-mon[97031]: from='client.34450 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:49:20.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:49:19 smithi099 ceph-mon[97031]: from='client.34454 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:49:20.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:49:19 smithi099 ceph-mon[97031]: pgmap v209: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:49:20.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:49:19 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/2504126765' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:49:20.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:49:19 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/2031681895' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:49:20.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:49:19 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/3993471217' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T06:49:20.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:49:19 smithi117 ceph-mon[76771]: from='client.34446 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:49:20.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:49:19 smithi117 ceph-mon[76771]: from='client.34450 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:49:20.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:49:19 smithi117 ceph-mon[76771]: from='client.34454 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:49:20.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:49:19 smithi117 ceph-mon[76771]: pgmap v209: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:49:20.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:49:19 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/2504126765' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:49:20.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:49:19 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/2031681895' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:49:20.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:49:19 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/3993471217' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T06:49:21.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:49:20 smithi117 ceph-mon[76771]: from='client.34466 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:49:21.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:49:20 smithi099 ceph-mon[97031]: from='client.34466 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:49:22.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:49:21 smithi117 ceph-mon[76771]: pgmap v210: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:49:22.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:49:21 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:49:22.314 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:49:21 smithi099 ceph-mon[97031]: pgmap v210: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:49:22.314 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:49:21 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:49:24.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:49:23 smithi117 ceph-mon[76771]: pgmap v211: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:49:24.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:49:23 smithi099 ceph-mon[97031]: pgmap v211: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:49:26.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:49:25 smithi117 ceph-mon[76771]: pgmap v212: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:49:26.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:49:25 smithi099 ceph-mon[97031]: pgmap v212: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:49:28.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:49:27 smithi117 ceph-mon[76771]: pgmap v213: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:49:28.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:49:27 smithi099 ceph-mon[97031]: pgmap v213: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:49:30.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:49:29 smithi117 ceph-mon[76771]: pgmap v214: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:49:30.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:49:29 smithi099 ceph-mon[97031]: pgmap v214: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:49:32.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:49:31 smithi117 ceph-mon[76771]: pgmap v215: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:49:32.314 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:49:31 smithi099 ceph-mon[97031]: pgmap v215: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:49:34.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:49:33 smithi117 ceph-mon[76771]: pgmap v216: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:49:34.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:49:33 smithi099 ceph-mon[97031]: pgmap v216: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:49:36.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:49:35 smithi117 ceph-mon[76771]: pgmap v217: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:49:36.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:49:35 smithi099 ceph-mon[97031]: pgmap v217: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:49:37.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:49:36 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:49:37.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:49:36 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:49:38.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:49:37 smithi117 ceph-mon[76771]: pgmap v218: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:49:38.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:49:37 smithi099 ceph-mon[97031]: pgmap v218: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:49:40.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:49:39 smithi117 ceph-mon[76771]: pgmap v219: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:49:40.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:49:39 smithi099 ceph-mon[97031]: pgmap v219: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:49:42.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:49:42 smithi117 ceph-mon[76771]: pgmap v220: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:49:42.314 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:49:42 smithi099 ceph-mon[97031]: pgmap v220: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:49:44.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:49:44 smithi117 ceph-mon[76771]: pgmap v221: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:49:44.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:49:44 smithi099 ceph-mon[97031]: pgmap v221: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:49:46.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:49:46 smithi117 ceph-mon[76771]: pgmap v222: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:49:46.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:49:46 smithi099 ceph-mon[97031]: pgmap v222: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:49:48.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:49:48 smithi117 ceph-mon[76771]: pgmap v223: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:49:48.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:49:48 smithi099 ceph-mon[97031]: pgmap v223: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:49:49.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:49.992+0000 7f45a8c89640 1 -- 172.21.15.99:0/548857978 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45a4102660 msgr2=0x7f45a4102a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:49.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:49.992+0000 7f45a8c89640 1 --2- 172.21.15.99:0/548857978 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45a4102660 0x7f45a4102a30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f45940048d0 tx=0x7f4594009da0 comp rx=0 tx=0).stop 2024-09-19T06:49:49.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:49.992+0000 7f45a8c89640 1 -- 172.21.15.99:0/548857978 shutdown_connections 2024-09-19T06:49:49.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:49.992+0000 7f45a8c89640 1 --2- 172.21.15.99:0/548857978 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45a40fac80 0x7f45a40fb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:49.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:49.992+0000 7f45a8c89640 1 --2- 172.21.15.99:0/548857978 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45a4102660 0x7f45a4102a30 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:49.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:49.992+0000 7f45a8c89640 1 -- 172.21.15.99:0/548857978 >> 172.21.15.99:0/548857978 conn(0x7f45a4070ce0 msgr2=0x7f45a40710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:49.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:49.992+0000 7f45a8c89640 1 -- 172.21.15.99:0/548857978 shutdown_connections 2024-09-19T06:49:49.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:49.992+0000 7f45a8c89640 1 -- 172.21.15.99:0/548857978 wait complete. 2024-09-19T06:49:49.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:49.993+0000 7f45a8c89640 1 Processor -- start 2024-09-19T06:49:49.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:49.993+0000 7f45a8c89640 1 -- start start 2024-09-19T06:49:49.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:49.993+0000 7f45a8c89640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45a40fac80 0x7f45a41131f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:49.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:49.993+0000 7f45a8c89640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45a4102660 0x7f45a4113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:49.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:49.993+0000 7f45a8c89640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a4113dc0 con 0x7f45a40fac80 2024-09-19T06:49:49.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:49.993+0000 7f45a8c89640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a410d170 con 0x7f45a4102660 2024-09-19T06:49:49.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:49.993+0000 7f45a259c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45a40fac80 0x7f45a41131f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:49.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:49.993+0000 7f45a259c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45a40fac80 0x7f45a41131f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:51416/0 (socket says 172.21.15.99:51416) 2024-09-19T06:49:49.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:49.993+0000 7f45a259c640 1 -- 172.21.15.99:0/1658657371 learned_addr learned my addr 172.21.15.99:0/1658657371 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:49:49.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:49.993+0000 7f459bfff640 1 --2- 172.21.15.99:0/1658657371 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45a4102660 0x7f45a4113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:49.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:49.994+0000 7f45a259c640 1 -- 172.21.15.99:0/1658657371 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45a4102660 msgr2=0x7f45a4113730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:49.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:49.994+0000 7f45a259c640 1 --2- 172.21.15.99:0/1658657371 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45a4102660 0x7f45a4113730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:49.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:49.994+0000 7f45a259c640 1 -- 172.21.15.99:0/1658657371 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4594005040 con 0x7f45a40fac80 2024-09-19T06:49:49.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:49.994+0000 7f45a259c640 1 --2- 172.21.15.99:0/1658657371 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45a40fac80 0x7f45a41131f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4594003080 tx=0x7f4594009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:49.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:49.994+0000 7f459affd640 1 -- 172.21.15.99:0/1658657371 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4594038070 con 0x7f45a40fac80 2024-09-19T06:49:49.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:49.994+0000 7f459affd640 1 -- 172.21.15.99:0/1658657371 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f45940097e0 con 0x7f45a40fac80 2024-09-19T06:49:49.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:49.994+0000 7f45a8c89640 1 -- 172.21.15.99:0/1658657371 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45a410d3f0 con 0x7f45a40fac80 2024-09-19T06:49:49.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:49.994+0000 7f459affd640 1 -- 172.21.15.99:0/1658657371 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f459403d420 con 0x7f45a40fac80 2024-09-19T06:49:49.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:49.994+0000 7f45a8c89640 1 -- 172.21.15.99:0/1658657371 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45a410d8b0 con 0x7f45a40fac80 2024-09-19T06:49:49.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:49.995+0000 7f45a8c89640 1 -- 172.21.15.99:0/1658657371 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45a40657d0 con 0x7f45a40fac80 2024-09-19T06:49:50.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:49.996+0000 7f459affd640 1 -- 172.21.15.99:0/1658657371 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f4594030020 con 0x7f45a40fac80 2024-09-19T06:49:50.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:49.996+0000 7f459affd640 1 --2- 172.21.15.99:0/1658657371 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f459006e530 0x7f45900709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:50.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:49.996+0000 7f459affd640 1 -- 172.21.15.99:0/1658657371 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f45940ae670 con 0x7f45a40fac80 2024-09-19T06:49:50.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:49.996+0000 7f459bfff640 1 --2- 172.21.15.99:0/1658657371 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f459006e530 0x7f45900709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:50.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:49.997+0000 7f459bfff640 1 --2- 172.21.15.99:0/1658657371 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f459006e530 0x7f45900709e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f45a410eab0 tx=0x7f458c009120 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:50.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.001+0000 7f459affd640 1 -- 172.21.15.99:0/1658657371 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f4594077760 con 0x7f45a40fac80 2024-09-19T06:49:50.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.186+0000 7f45a8c89640 1 -- 172.21.15.99:0/1658657371 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f45a404b750 con 0x7f459006e530 2024-09-19T06:49:50.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.187+0000 7f459affd640 1 -- 172.21.15.99:0/1658657371 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f45a404b750 con 0x7f459006e530 2024-09-19T06:49:50.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.189+0000 7f45a8c89640 1 -- 172.21.15.99:0/1658657371 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f459006e530 msgr2=0x7f45900709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:50.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.189+0000 7f45a8c89640 1 --2- 172.21.15.99:0/1658657371 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f459006e530 0x7f45900709e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f45a410eab0 tx=0x7f458c009120 comp rx=0 tx=0).stop 2024-09-19T06:49:50.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.189+0000 7f45a8c89640 1 -- 172.21.15.99:0/1658657371 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45a40fac80 msgr2=0x7f45a41131f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:50.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.189+0000 7f45a8c89640 1 --2- 172.21.15.99:0/1658657371 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45a40fac80 0x7f45a41131f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4594003080 tx=0x7f4594009da0 comp rx=0 tx=0).stop 2024-09-19T06:49:50.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.189+0000 7f45a8c89640 1 -- 172.21.15.99:0/1658657371 shutdown_connections 2024-09-19T06:49:50.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.189+0000 7f45a8c89640 1 --2- 172.21.15.99:0/1658657371 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f459006e530 0x7f45900709e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:50.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.189+0000 7f45a8c89640 1 --2- 172.21.15.99:0/1658657371 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45a4102660 0x7f45a4113730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:50.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.189+0000 7f45a8c89640 1 --2- 172.21.15.99:0/1658657371 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45a40fac80 0x7f45a41131f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:50.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.189+0000 7f45a8c89640 1 -- 172.21.15.99:0/1658657371 >> 172.21.15.99:0/1658657371 conn(0x7f45a4070ce0 msgr2=0x7f45a40f9b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:50.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.189+0000 7f45a8c89640 1 -- 172.21.15.99:0/1658657371 shutdown_connections 2024-09-19T06:49:50.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.189+0000 7f45a8c89640 1 -- 172.21.15.99:0/1658657371 wait complete. 2024-09-19T06:49:50.199 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-09-19T06:49:50.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.270+0000 7f9b6f9a1640 1 -- 172.21.15.99:0/800009133 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b68102ef0 msgr2=0x7f9b680fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:50.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.270+0000 7f9b6f9a1640 1 --2- 172.21.15.99:0/800009133 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b68102ef0 0x7f9b680fc5b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c0048d0 tx=0x7f9b5c009da0 comp rx=0 tx=0).stop 2024-09-19T06:49:50.272 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:49:50 smithi099 ceph-mon[97031]: pgmap v224: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:49:50.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.270+0000 7f9b6f9a1640 1 -- 172.21.15.99:0/800009133 shutdown_connections 2024-09-19T06:49:50.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.270+0000 7f9b6f9a1640 1 --2- 172.21.15.99:0/800009133 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b68102ef0 0x7f9b680fc5b0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:50.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.270+0000 7f9b6f9a1640 1 --2- 172.21.15.99:0/800009133 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b68102550 0x7f9b68102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:50.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.270+0000 7f9b6f9a1640 1 -- 172.21.15.99:0/800009133 >> 172.21.15.99:0/800009133 conn(0x7f9b680f80f0 msgr2=0x7f9b680fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:50.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.270+0000 7f9b6f9a1640 1 -- 172.21.15.99:0/800009133 shutdown_connections 2024-09-19T06:49:50.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.270+0000 7f9b6f9a1640 1 -- 172.21.15.99:0/800009133 wait complete. 2024-09-19T06:49:50.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.271+0000 7f9b6f9a1640 1 Processor -- start 2024-09-19T06:49:50.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.271+0000 7f9b6f9a1640 1 -- start start 2024-09-19T06:49:50.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.271+0000 7f9b6f9a1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b68102550 0x7f9b68113520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:50.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.271+0000 7f9b6f9a1640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b68102ef0 0x7f9b68113a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:50.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.271+0000 7f9b6f9a1640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b681140b0 con 0x7f9b68102ef0 2024-09-19T06:49:50.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.271+0000 7f9b6f9a1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6810d4c0 con 0x7f9b68102550 2024-09-19T06:49:50.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.271+0000 7f9b6cf3c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b68102ef0 0x7f9b68113a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:50.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.271+0000 7f9b6cf3c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b68102ef0 0x7f9b68113a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:51444/0 (socket says 172.21.15.99:51444) 2024-09-19T06:49:50.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.271+0000 7f9b6cf3c640 1 -- 172.21.15.99:0/4078042006 learned_addr learned my addr 172.21.15.99:0/4078042006 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:49:50.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.271+0000 7f9b6d73d640 1 --2- 172.21.15.99:0/4078042006 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b68102550 0x7f9b68113520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:50.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.271+0000 7f9b6cf3c640 1 -- 172.21.15.99:0/4078042006 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b68102550 msgr2=0x7f9b68113520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:50.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.271+0000 7f9b6cf3c640 1 --2- 172.21.15.99:0/4078042006 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b68102550 0x7f9b68113520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:50.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.271+0000 7f9b6cf3c640 1 -- 172.21.15.99:0/4078042006 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b5c005040 con 0x7f9b68102ef0 2024-09-19T06:49:50.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.272+0000 7f9b6cf3c640 1 --2- 172.21.15.99:0/4078042006 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b68102ef0 0x7f9b68113a60 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c0043d0 tx=0x7f9b5c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:50.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.272+0000 7f9b65ffb640 1 -- 172.21.15.99:0/4078042006 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b5c038070 con 0x7f9b68102ef0 2024-09-19T06:49:50.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.272+0000 7f9b65ffb640 1 -- 172.21.15.99:0/4078042006 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9b5c0096e0 con 0x7f9b68102ef0 2024-09-19T06:49:50.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.272+0000 7f9b6f9a1640 1 -- 172.21.15.99:0/4078042006 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b6810d740 con 0x7f9b68102ef0 2024-09-19T06:49:50.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.272+0000 7f9b65ffb640 1 -- 172.21.15.99:0/4078042006 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b5c02c8a0 con 0x7f9b68102ef0 2024-09-19T06:49:50.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.272+0000 7f9b6f9a1640 1 -- 172.21.15.99:0/4078042006 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b6810dc80 con 0x7f9b68102ef0 2024-09-19T06:49:50.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.273+0000 7f9b6f9a1640 1 -- 172.21.15.99:0/4078042006 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b680fdcd0 con 0x7f9b68102ef0 2024-09-19T06:49:50.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.274+0000 7f9b65ffb640 1 -- 172.21.15.99:0/4078042006 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f9b5c030020 con 0x7f9b68102ef0 2024-09-19T06:49:50.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.274+0000 7f9b65ffb640 1 --2- 172.21.15.99:0/4078042006 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f9b5006e530 0x7f9b500709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:50.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.274+0000 7f9b65ffb640 1 -- 172.21.15.99:0/4078042006 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f9b5c0adde0 con 0x7f9b68102ef0 2024-09-19T06:49:50.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.274+0000 7f9b6d73d640 1 --2- 172.21.15.99:0/4078042006 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f9b5006e530 0x7f9b500709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:50.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.275+0000 7f9b6d73d640 1 --2- 172.21.15.99:0/4078042006 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f9b5006e530 0x7f9b500709e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9b60004ed0 tx=0x7f9b6000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:50.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.279+0000 7f9b65ffb640 1 -- 172.21.15.99:0/4078042006 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f9b5c077000 con 0x7f9b68102ef0 2024-09-19T06:49:50.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:49:50 smithi117 ceph-mon[76771]: pgmap v224: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:49:50.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.460+0000 7f9b6f9a1640 1 -- 172.21.15.99:0/4078042006 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9b68109580 con 0x7f9b5006e530 2024-09-19T06:49:50.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.461+0000 7f9b65ffb640 1 -- 172.21.15.99:0/4078042006 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f9b68109580 con 0x7f9b5006e530 2024-09-19T06:49:50.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.463+0000 7f9b6f9a1640 1 -- 172.21.15.99:0/4078042006 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f9b5006e530 msgr2=0x7f9b500709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:50.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.463+0000 7f9b6f9a1640 1 --2- 172.21.15.99:0/4078042006 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f9b5006e530 0x7f9b500709e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9b60004ed0 tx=0x7f9b6000b040 comp rx=0 tx=0).stop 2024-09-19T06:49:50.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.463+0000 7f9b6f9a1640 1 -- 172.21.15.99:0/4078042006 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b68102ef0 msgr2=0x7f9b68113a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:50.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.463+0000 7f9b6f9a1640 1 --2- 172.21.15.99:0/4078042006 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b68102ef0 0x7f9b68113a60 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c0043d0 tx=0x7f9b5c009da0 comp rx=0 tx=0).stop 2024-09-19T06:49:50.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.463+0000 7f9b6f9a1640 1 -- 172.21.15.99:0/4078042006 shutdown_connections 2024-09-19T06:49:50.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.463+0000 7f9b6f9a1640 1 --2- 172.21.15.99:0/4078042006 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f9b5006e530 0x7f9b500709e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:50.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.463+0000 7f9b6f9a1640 1 --2- 172.21.15.99:0/4078042006 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b68102ef0 0x7f9b68113a60 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:50.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.463+0000 7f9b6f9a1640 1 --2- 172.21.15.99:0/4078042006 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b68102550 0x7f9b68113520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:50.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.463+0000 7f9b6f9a1640 1 -- 172.21.15.99:0/4078042006 >> 172.21.15.99:0/4078042006 conn(0x7f9b680f80f0 msgr2=0x7f9b680f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:50.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.463+0000 7f9b6f9a1640 1 -- 172.21.15.99:0/4078042006 shutdown_connections 2024-09-19T06:49:50.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.463+0000 7f9b6f9a1640 1 -- 172.21.15.99:0/4078042006 wait complete. 2024-09-19T06:49:50.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.541+0000 7fc6478dd640 1 -- 172.21.15.99:0/2129230711 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc640102ef0 msgr2=0x7fc6400fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:50.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.541+0000 7fc6478dd640 1 --2- 172.21.15.99:0/2129230711 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc640102ef0 0x7fc6400fc5b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc63c0048d0 tx=0x7fc63c009da0 comp rx=0 tx=0).stop 2024-09-19T06:49:50.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.541+0000 7fc6478dd640 1 -- 172.21.15.99:0/2129230711 shutdown_connections 2024-09-19T06:49:50.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.541+0000 7fc6478dd640 1 --2- 172.21.15.99:0/2129230711 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc640102ef0 0x7fc6400fc5b0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:50.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.541+0000 7fc6478dd640 1 --2- 172.21.15.99:0/2129230711 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc640102550 0x7fc640102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:50.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.541+0000 7fc6478dd640 1 -- 172.21.15.99:0/2129230711 >> 172.21.15.99:0/2129230711 conn(0x7fc6400f80f0 msgr2=0x7fc6400fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:50.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.541+0000 7fc6478dd640 1 -- 172.21.15.99:0/2129230711 shutdown_connections 2024-09-19T06:49:50.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.541+0000 7fc6478dd640 1 -- 172.21.15.99:0/2129230711 wait complete. 2024-09-19T06:49:50.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.542+0000 7fc6478dd640 1 Processor -- start 2024-09-19T06:49:50.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.542+0000 7fc6478dd640 1 -- start start 2024-09-19T06:49:50.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.542+0000 7fc6478dd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc640102550 0x7fc640113520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:50.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.542+0000 7fc6478dd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc640102ef0 0x7fc640113a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:50.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.542+0000 7fc6478dd640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6401140b0 con 0x7fc640102ef0 2024-09-19T06:49:50.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.542+0000 7fc6478dd640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc64010d4c0 con 0x7fc640102550 2024-09-19T06:49:50.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.542+0000 7fc644e78640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc640102ef0 0x7fc640113a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:50.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.542+0000 7fc644e78640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc640102ef0 0x7fc640113a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:51470/0 (socket says 172.21.15.99:51470) 2024-09-19T06:49:50.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.542+0000 7fc644e78640 1 -- 172.21.15.99:0/2364500055 learned_addr learned my addr 172.21.15.99:0/2364500055 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:49:50.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.542+0000 7fc645679640 1 --2- 172.21.15.99:0/2364500055 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc640102550 0x7fc640113520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:50.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.543+0000 7fc644e78640 1 -- 172.21.15.99:0/2364500055 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc640102550 msgr2=0x7fc640113520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:50.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.543+0000 7fc644e78640 1 --2- 172.21.15.99:0/2364500055 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc640102550 0x7fc640113520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:50.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.543+0000 7fc644e78640 1 -- 172.21.15.99:0/2364500055 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc63c005040 con 0x7fc640102ef0 2024-09-19T06:49:50.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.543+0000 7fc644e78640 1 --2- 172.21.15.99:0/2364500055 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc640102ef0 0x7fc640113a60 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc63c0043d0 tx=0x7fc63c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:50.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.543+0000 7fc631ffb640 1 -- 172.21.15.99:0/2364500055 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc63c038070 con 0x7fc640102ef0 2024-09-19T06:49:50.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.543+0000 7fc631ffb640 1 -- 172.21.15.99:0/2364500055 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc63c0096e0 con 0x7fc640102ef0 2024-09-19T06:49:50.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.543+0000 7fc631ffb640 1 -- 172.21.15.99:0/2364500055 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc63c02c8a0 con 0x7fc640102ef0 2024-09-19T06:49:50.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.543+0000 7fc6478dd640 1 -- 172.21.15.99:0/2364500055 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc64010d740 con 0x7fc640102ef0 2024-09-19T06:49:50.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.543+0000 7fc6478dd640 1 -- 172.21.15.99:0/2364500055 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc64010dc30 con 0x7fc640102ef0 2024-09-19T06:49:50.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.545+0000 7fc6478dd640 1 -- 172.21.15.99:0/2364500055 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6400fdcd0 con 0x7fc640102ef0 2024-09-19T06:49:50.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.545+0000 7fc631ffb640 1 -- 172.21.15.99:0/2364500055 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fc63c030020 con 0x7fc640102ef0 2024-09-19T06:49:50.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.545+0000 7fc631ffb640 1 --2- 172.21.15.99:0/2364500055 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fc62c06e530 0x7fc62c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:50.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.546+0000 7fc631ffb640 1 -- 172.21.15.99:0/2364500055 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fc63c0adee0 con 0x7fc640102ef0 2024-09-19T06:49:50.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.546+0000 7fc645679640 1 --2- 172.21.15.99:0/2364500055 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fc62c06e530 0x7fc62c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:50.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.546+0000 7fc645679640 1 --2- 172.21.15.99:0/2364500055 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fc62c06e530 0x7fc62c0709e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc634004ed0 tx=0x7fc63400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:50.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.550+0000 7fc631ffb640 1 -- 172.21.15.99:0/2364500055 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fc63c077000 con 0x7fc640102ef0 2024-09-19T06:49:50.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.723+0000 7fc6478dd640 1 -- 172.21.15.99:0/2364500055 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc640109580 con 0x7fc62c06e530 2024-09-19T06:49:50.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.732+0000 7fc631ffb640 1 -- 172.21.15.99:0/2364500055 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fc640109580 con 0x7fc62c06e530 2024-09-19T06:49:50.733 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T06:49:50.733 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.smithi099 smithi099 *:9093,9094 running (8m) 90s ago 17m 23.4M - 0.25.0 c8568f914cd2 e7c1774d56b0 2024-09-19T06:49:50.733 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi099 smithi099 running (5m) 90s ago 17m 6899k - 19.1.1-361-g2f599a46 d2baa855c067 b9775f416b10 2024-09-19T06:49:50.733 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi117 smithi117 running (5m) 61s ago 16m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 38cf60c0d548 2024-09-19T06:49:50.733 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.smithi099 smithi099 *:3000 running (7m) 90s ago 17m 80.7M - 9.4.12 2bacad6d85d8 cd53a18d5410 2024-09-19T06:49:50.733 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.obarqf smithi099 running (112s) 90s ago 12m 12.2M - 19.1.1-361-g2f599a46 d2baa855c067 314a73082521 2024-09-19T06:49:50.733 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.xehbxe smithi099 running (95s) 90s ago 11m 14.4M - 19.1.1-361-g2f599a46 d2baa855c067 a2955a9d06e6 2024-09-19T06:49:50.734 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.bheqzh smithi117 running (64s) 61s ago 11m 11.8M - 19.1.1-361-g2f599a46 d2baa855c067 b1505937c0b7 2024-09-19T06:49:50.734 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.nooexo smithi117 running (79s) 61s ago 12m 13.1M - 19.1.1-361-g2f599a46 d2baa855c067 35bd7725855c 2024-09-19T06:49:50.734 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi099.pgvkqi smithi099 *:8443,9283,8765 running (8m) 90s ago 18m 505M - 19.1.1-361-g2f599a46 d2baa855c067 d5de99cb7e78 2024-09-19T06:49:50.734 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi117.ssmkcf smithi117 *:8443,9283,8765 running (7m) 61s ago 16m 444M - 19.1.1-361-g2f599a46 d2baa855c067 8b7ee0f871f5 2024-09-19T06:49:50.734 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi099 smithi099 running (6m) 90s ago 18m 52.4M 2048M 19.1.1-361-g2f599a46 d2baa855c067 ffe067438824 2024-09-19T06:49:50.734 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi117 smithi117 running (5m) 61s ago 16m 38.9M 2048M 19.1.1-361-g2f599a46 d2baa855c067 4cb7455e3ee7 2024-09-19T06:49:50.734 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi099 smithi099 *:9100 running (9m) 90s ago 17m 15.0M - 1.5.0 0da6a335fe13 dca7b4517dcc 2024-09-19T06:49:50.734 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi117 smithi117 *:9100 running (8m) 61s ago 16m 15.9M - 1.5.0 0da6a335fe13 8233ce3835d2 2024-09-19T06:49:50.734 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (4m) 90s ago 15m 100M 1557M 19.1.1-361-g2f599a46 d2baa855c067 8e22543bf933 2024-09-19T06:49:50.734 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (4m) 90s ago 15m 106M 1557M 19.1.1-361-g2f599a46 d2baa855c067 f54153d0ae09 2024-09-19T06:49:50.734 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (3m) 90s ago 14m 83.7M 1557M 19.1.1-361-g2f599a46 d2baa855c067 b1778ab88870 2024-09-19T06:49:50.734 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi117 running (3m) 61s ago 14m 102M 2581M 19.1.1-361-g2f599a46 d2baa855c067 ea5236b193d3 2024-09-19T06:49:50.734 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi117 running (2m) 61s ago 13m 93.5M 2581M 19.1.1-361-g2f599a46 d2baa855c067 27ac2c859a68 2024-09-19T06:49:50.734 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi117 running (2m) 61s ago 13m 100M 2581M 19.1.1-361-g2f599a46 d2baa855c067 de6aeb8544ce 2024-09-19T06:49:50.734 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.smithi099 smithi099 *:9095 running (7m) 90s ago 16m 64.4M - 2.43.0 a07b618ecd1d 15ad26ec6fb4 2024-09-19T06:49:50.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.734+0000 7fc6478dd640 1 -- 172.21.15.99:0/2364500055 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fc62c06e530 msgr2=0x7fc62c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:50.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.734+0000 7fc6478dd640 1 --2- 172.21.15.99:0/2364500055 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fc62c06e530 0x7fc62c0709e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc634004ed0 tx=0x7fc63400b040 comp rx=0 tx=0).stop 2024-09-19T06:49:50.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.734+0000 7fc6478dd640 1 -- 172.21.15.99:0/2364500055 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc640102ef0 msgr2=0x7fc640113a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:50.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.734+0000 7fc6478dd640 1 --2- 172.21.15.99:0/2364500055 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc640102ef0 0x7fc640113a60 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc63c0043d0 tx=0x7fc63c009da0 comp rx=0 tx=0).stop 2024-09-19T06:49:50.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.734+0000 7fc6478dd640 1 -- 172.21.15.99:0/2364500055 shutdown_connections 2024-09-19T06:49:50.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.734+0000 7fc6478dd640 1 --2- 172.21.15.99:0/2364500055 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fc62c06e530 0x7fc62c0709e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:50.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.734+0000 7fc6478dd640 1 --2- 172.21.15.99:0/2364500055 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc640102ef0 0x7fc640113a60 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:50.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.734+0000 7fc6478dd640 1 --2- 172.21.15.99:0/2364500055 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc640102550 0x7fc640113520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:50.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.734+0000 7fc6478dd640 1 -- 172.21.15.99:0/2364500055 >> 172.21.15.99:0/2364500055 conn(0x7fc6400f80f0 msgr2=0x7fc6400f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:50.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.734+0000 7fc6478dd640 1 -- 172.21.15.99:0/2364500055 shutdown_connections 2024-09-19T06:49:50.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.734+0000 7fc6478dd640 1 -- 172.21.15.99:0/2364500055 wait complete. 2024-09-19T06:49:50.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.811+0000 7f8cfc2ff640 1 -- 172.21.15.99:0/385720925 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8cf4102ed0 msgr2=0x7f8cf40fc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:50.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.811+0000 7f8cfc2ff640 1 --2- 172.21.15.99:0/385720925 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8cf4102ed0 0x7f8cf40fc590 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8ce40048d0 tx=0x7f8ce4009da0 comp rx=0 tx=0).stop 2024-09-19T06:49:50.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.812+0000 7f8cfc2ff640 1 -- 172.21.15.99:0/385720925 shutdown_connections 2024-09-19T06:49:50.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.812+0000 7f8cfc2ff640 1 --2- 172.21.15.99:0/385720925 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8cf4102ed0 0x7f8cf40fc590 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:50.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.812+0000 7f8cfc2ff640 1 --2- 172.21.15.99:0/385720925 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8cf4102530 0x7f8cf4102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:50.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.812+0000 7f8cfc2ff640 1 -- 172.21.15.99:0/385720925 >> 172.21.15.99:0/385720925 conn(0x7f8cf40f80f0 msgr2=0x7f8cf40fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:50.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.812+0000 7f8cfc2ff640 1 -- 172.21.15.99:0/385720925 shutdown_connections 2024-09-19T06:49:50.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.812+0000 7f8cfc2ff640 1 -- 172.21.15.99:0/385720925 wait complete. 2024-09-19T06:49:50.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.812+0000 7f8cfc2ff640 1 Processor -- start 2024-09-19T06:49:50.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.812+0000 7f8cfc2ff640 1 -- start start 2024-09-19T06:49:50.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.812+0000 7f8cfc2ff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8cf4102530 0x7f8cf406fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:50.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.812+0000 7f8cfc2ff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8cf4102ed0 0x7f8cf406ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:50.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.812+0000 7f8cfc2ff640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf4070490 con 0x7f8cf4102530 2024-09-19T06:49:50.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.812+0000 7f8cfc2ff640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf4070600 con 0x7f8cf4102ed0 2024-09-19T06:49:50.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.813+0000 7f8cfa09b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8cf4102530 0x7f8cf406fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:50.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.813+0000 7f8cfa09b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8cf4102530 0x7f8cf406fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:51490/0 (socket says 172.21.15.99:51490) 2024-09-19T06:49:50.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.813+0000 7f8cfa09b640 1 -- 172.21.15.99:0/2124123448 learned_addr learned my addr 172.21.15.99:0/2124123448 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:49:50.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.813+0000 7f8cf989a640 1 --2- 172.21.15.99:0/2124123448 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8cf4102ed0 0x7f8cf406ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:50.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.813+0000 7f8cfa09b640 1 -- 172.21.15.99:0/2124123448 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8cf4102ed0 msgr2=0x7f8cf406ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:50.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.813+0000 7f8cfa09b640 1 --2- 172.21.15.99:0/2124123448 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8cf4102ed0 0x7f8cf406ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:50.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.813+0000 7f8cfa09b640 1 -- 172.21.15.99:0/2124123448 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce4005040 con 0x7f8cf4102530 2024-09-19T06:49:50.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.813+0000 7f8cfa09b640 1 --2- 172.21.15.99:0/2124123448 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8cf4102530 0x7f8cf406fa10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0002a50 tx=0x7f8cf0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:50.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.813+0000 7f8ceaffd640 1 -- 172.21.15.99:0/2124123448 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8cf0007c30 con 0x7f8cf4102530 2024-09-19T06:49:50.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.813+0000 7f8ceaffd640 1 -- 172.21.15.99:0/2124123448 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8cf000f040 con 0x7f8cf4102530 2024-09-19T06:49:50.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.813+0000 7f8cfc2ff640 1 -- 172.21.15.99:0/2124123448 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cf4070890 con 0x7f8cf4102530 2024-09-19T06:49:50.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.813+0000 7f8ceaffd640 1 -- 172.21.15.99:0/2124123448 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8cf000da10 con 0x7f8cf4102530 2024-09-19T06:49:50.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.813+0000 7f8cfc2ff640 1 -- 172.21.15.99:0/2124123448 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cf41198f0 con 0x7f8cf4102530 2024-09-19T06:49:50.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.814+0000 7f8cfc2ff640 1 -- 172.21.15.99:0/2124123448 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cf40fdcb0 con 0x7f8cf4102530 2024-09-19T06:49:50.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.815+0000 7f8ceaffd640 1 -- 172.21.15.99:0/2124123448 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f8cf000dc50 con 0x7f8cf4102530 2024-09-19T06:49:50.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.815+0000 7f8ceaffd640 1 --2- 172.21.15.99:0/2124123448 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f8ce006e530 0x7f8ce00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:50.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.816+0000 7f8ceaffd640 1 -- 172.21.15.99:0/2124123448 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f8cf008d8b0 con 0x7f8cf4102530 2024-09-19T06:49:50.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.816+0000 7f8cf989a640 1 --2- 172.21.15.99:0/2124123448 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f8ce006e530 0x7f8ce00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:50.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.816+0000 7f8cf989a640 1 --2- 172.21.15.99:0/2124123448 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f8ce006e530 0x7f8ce00709e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8ce40048a0 tx=0x7f8ce4035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:50.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:50.820+0000 7f8ceaffd640 1 -- 172.21.15.99:0/2124123448 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f8cf0056ad0 con 0x7f8cf4102530 2024-09-19T06:49:51.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.052+0000 7f8cfc2ff640 1 -- 172.21.15.99:0/2124123448 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8cf4071100 con 0x7f8cf4102530 2024-09-19T06:49:51.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.053+0000 7f8ceaffd640 1 -- 172.21.15.99:0/2124123448 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f8cf005a190 con 0x7f8cf4102530 2024-09-19T06:49:51.054 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:49:51.054 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-09-19T06:49:51.054 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T06:49:51.054 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:49:51.054 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-09-19T06:49:51.054 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T06:49:51.055 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:49:51.055 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-09-19T06:49:51.055 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 6 2024-09-19T06:49:51.055 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:49:51.055 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": { 2024-09-19T06:49:51.055 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 4 2024-09-19T06:49:51.055 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:49:51.055 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-09-19T06:49:51.055 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 14 2024-09-19T06:49:51.055 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T06:49:51.055 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:49:51.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.055+0000 7f8cfc2ff640 1 -- 172.21.15.99:0/2124123448 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f8ce006e530 msgr2=0x7f8ce00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:51.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.055+0000 7f8cfc2ff640 1 --2- 172.21.15.99:0/2124123448 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f8ce006e530 0x7f8ce00709e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8ce40048a0 tx=0x7f8ce4035040 comp rx=0 tx=0).stop 2024-09-19T06:49:51.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.055+0000 7f8cfc2ff640 1 -- 172.21.15.99:0/2124123448 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8cf4102530 msgr2=0x7f8cf406fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:51.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.055+0000 7f8cfc2ff640 1 --2- 172.21.15.99:0/2124123448 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8cf4102530 0x7f8cf406fa10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0002a50 tx=0x7f8cf0004600 comp rx=0 tx=0).stop 2024-09-19T06:49:51.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.055+0000 7f8cfc2ff640 1 -- 172.21.15.99:0/2124123448 shutdown_connections 2024-09-19T06:49:51.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.055+0000 7f8cfc2ff640 1 --2- 172.21.15.99:0/2124123448 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f8ce006e530 0x7f8ce00709e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:51.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.055+0000 7f8cfc2ff640 1 --2- 172.21.15.99:0/2124123448 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8cf4102ed0 0x7f8cf406ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:51.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.055+0000 7f8cfc2ff640 1 --2- 172.21.15.99:0/2124123448 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8cf4102530 0x7f8cf406fa10 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:51.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.055+0000 7f8cfc2ff640 1 -- 172.21.15.99:0/2124123448 >> 172.21.15.99:0/2124123448 conn(0x7f8cf40f80f0 msgr2=0x7f8cf40f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:51.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.055+0000 7f8cfc2ff640 1 -- 172.21.15.99:0/2124123448 shutdown_connections 2024-09-19T06:49:51.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.055+0000 7f8cfc2ff640 1 -- 172.21.15.99:0/2124123448 wait complete. 2024-09-19T06:49:51.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.133+0000 7f0f9796e640 1 -- 172.21.15.99:0/2484600903 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0f90102680 msgr2=0x7f0f90102a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:51.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.133+0000 7f0f9796e640 1 --2- 172.21.15.99:0/2484600903 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0f90102680 0x7f0f90102a50 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0f840048d0 tx=0x7f0f84009da0 comp rx=0 tx=0).stop 2024-09-19T06:49:51.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.133+0000 7f0f9796e640 1 -- 172.21.15.99:0/2484600903 shutdown_connections 2024-09-19T06:49:51.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.133+0000 7f0f9796e640 1 --2- 172.21.15.99:0/2484600903 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f900facf0 0x7f0f900fb160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:51.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.133+0000 7f0f9796e640 1 --2- 172.21.15.99:0/2484600903 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0f90102680 0x7f0f90102a50 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:51.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.133+0000 7f0f9796e640 1 -- 172.21.15.99:0/2484600903 >> 172.21.15.99:0/2484600903 conn(0x7f0f90070d50 msgr2=0x7f0f90071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:51.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.133+0000 7f0f9796e640 1 -- 172.21.15.99:0/2484600903 shutdown_connections 2024-09-19T06:49:51.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.133+0000 7f0f9796e640 1 -- 172.21.15.99:0/2484600903 wait complete. 2024-09-19T06:49:51.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.133+0000 7f0f9796e640 1 Processor -- start 2024-09-19T06:49:51.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.134+0000 7f0f9796e640 1 -- start start 2024-09-19T06:49:51.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.134+0000 7f0f9796e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0f900facf0 0x7f0f90113310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:51.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.134+0000 7f0f9796e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f90102680 0x7f0f90113850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:51.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.134+0000 7f0f9796e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f90113e50 con 0x7f0f900facf0 2024-09-19T06:49:51.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.134+0000 7f0f9796e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9010d290 con 0x7f0f90102680 2024-09-19T06:49:51.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.134+0000 7f0f9570a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0f900facf0 0x7f0f90113310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:51.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.134+0000 7f0f9570a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0f900facf0 0x7f0f90113310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:51512/0 (socket says 172.21.15.99:51512) 2024-09-19T06:49:51.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.134+0000 7f0f9570a640 1 -- 172.21.15.99:0/3228324336 learned_addr learned my addr 172.21.15.99:0/3228324336 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:49:51.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.134+0000 7f0f94f09640 1 --2- 172.21.15.99:0/3228324336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f90102680 0x7f0f90113850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:51.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.134+0000 7f0f9570a640 1 -- 172.21.15.99:0/3228324336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f90102680 msgr2=0x7f0f90113850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:51.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.134+0000 7f0f9570a640 1 --2- 172.21.15.99:0/3228324336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f90102680 0x7f0f90113850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:51.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.134+0000 7f0f9570a640 1 -- 172.21.15.99:0/3228324336 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f84005040 con 0x7f0f900facf0 2024-09-19T06:49:51.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.134+0000 7f0f94f09640 1 --2- 172.21.15.99:0/3228324336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f90102680 0x7f0f90113850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:49:51.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.134+0000 7f0f9570a640 1 --2- 172.21.15.99:0/3228324336 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0f900facf0 0x7f0f90113310 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0f84000c00 tx=0x7f0f84009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:51.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.135+0000 7f0f81ffb640 1 -- 172.21.15.99:0/3228324336 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f84038070 con 0x7f0f900facf0 2024-09-19T06:49:51.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.135+0000 7f0f81ffb640 1 -- 172.21.15.99:0/3228324336 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0f8402ade0 con 0x7f0f900facf0 2024-09-19T06:49:51.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.135+0000 7f0f81ffb640 1 -- 172.21.15.99:0/3228324336 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f8402c7e0 con 0x7f0f900facf0 2024-09-19T06:49:51.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.135+0000 7f0f9796e640 1 -- 172.21.15.99:0/3228324336 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f9010d510 con 0x7f0f900facf0 2024-09-19T06:49:51.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.135+0000 7f0f9796e640 1 -- 172.21.15.99:0/3228324336 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f9010d980 con 0x7f0f900facf0 2024-09-19T06:49:51.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.136+0000 7f0f9796e640 1 -- 172.21.15.99:0/3228324336 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f900657f0 con 0x7f0f900facf0 2024-09-19T06:49:51.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.136+0000 7f0f81ffb640 1 -- 172.21.15.99:0/3228324336 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f0f84030020 con 0x7f0f900facf0 2024-09-19T06:49:51.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.137+0000 7f0f81ffb640 1 --2- 172.21.15.99:0/3228324336 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f0f7c06e530 0x7f0f7c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:51.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.137+0000 7f0f81ffb640 1 -- 172.21.15.99:0/3228324336 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f0f840addf0 con 0x7f0f900facf0 2024-09-19T06:49:51.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.137+0000 7f0f94f09640 1 --2- 172.21.15.99:0/3228324336 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f0f7c06e530 0x7f0f7c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:51.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.137+0000 7f0f94f09640 1 --2- 172.21.15.99:0/3228324336 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f0f7c06e530 0x7f0f7c0709e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c007fd0 tx=0x7f0f8c009e90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:51.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.141+0000 7f0f81ffb640 1 -- 172.21.15.99:0/3228324336 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f0f84076f90 con 0x7f0f900facf0 2024-09-19T06:49:51.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.339+0000 7f0f9796e640 1 -- 172.21.15.99:0/3228324336 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0f9004b720 con 0x7f0f900facf0 2024-09-19T06:49:51.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.339+0000 7f0f81ffb640 1 -- 172.21.15.99:0/3228324336 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 29 v29) v1 ==== 76+0+1915 (secure 0 0 0) 0x7f0f8407a650 con 0x7f0f900facf0 2024-09-19T06:49:51.341 INFO:teuthology.orchestra.run.smithi099.stdout:e29 2024-09-19T06:49:51.341 INFO:teuthology.orchestra.run.smithi099.stdout:btime 2024-09-19T06:48:47:938420+0000 2024-09-19T06:49:51.341 INFO:teuthology.orchestra.run.smithi099.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T06:49:51.341 INFO:teuthology.orchestra.run.smithi099.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T06:49:51.341 INFO:teuthology.orchestra.run.smithi099.stdout:legacy client fscid: 1 2024-09-19T06:49:51.341 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:49:51.341 INFO:teuthology.orchestra.run.smithi099.stdout:Filesystem 'cephfs' (1) 2024-09-19T06:49:51.341 INFO:teuthology.orchestra.run.smithi099.stdout:fs_name cephfs 2024-09-19T06:49:51.341 INFO:teuthology.orchestra.run.smithi099.stdout:epoch 20 2024-09-19T06:49:51.341 INFO:teuthology.orchestra.run.smithi099.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-19T06:49:51.342 INFO:teuthology.orchestra.run.smithi099.stdout:created 2024-09-19T06:37:40.838146+0000 2024-09-19T06:49:51.342 INFO:teuthology.orchestra.run.smithi099.stdout:modified 2024-09-19T06:47:50.076553+0000 2024-09-19T06:49:51.342 INFO:teuthology.orchestra.run.smithi099.stdout:tableserver 0 2024-09-19T06:49:51.342 INFO:teuthology.orchestra.run.smithi099.stdout:root 0 2024-09-19T06:49:51.342 INFO:teuthology.orchestra.run.smithi099.stdout:session_timeout 60 2024-09-19T06:49:51.342 INFO:teuthology.orchestra.run.smithi099.stdout:session_autoclose 300 2024-09-19T06:49:51.342 INFO:teuthology.orchestra.run.smithi099.stdout:max_file_size 1099511627776 2024-09-19T06:49:51.342 INFO:teuthology.orchestra.run.smithi099.stdout:max_xattr_size 65536 2024-09-19T06:49:51.342 INFO:teuthology.orchestra.run.smithi099.stdout:required_client_features {} 2024-09-19T06:49:51.342 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure 0 2024-09-19T06:49:51.342 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure_osd_epoch 77 2024-09-19T06:49:51.342 INFO:teuthology.orchestra.run.smithi099.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T06:49:51.342 INFO:teuthology.orchestra.run.smithi099.stdout:max_mds 2 2024-09-19T06:49:51.342 INFO:teuthology.orchestra.run.smithi099.stdout:in 0,1 2024-09-19T06:49:51.343 INFO:teuthology.orchestra.run.smithi099.stdout:up {} 2024-09-19T06:49:51.343 INFO:teuthology.orchestra.run.smithi099.stdout:failed 0,1 2024-09-19T06:49:51.343 INFO:teuthology.orchestra.run.smithi099.stdout:damaged 2024-09-19T06:49:51.343 INFO:teuthology.orchestra.run.smithi099.stdout:stopped 2024-09-19T06:49:51.343 INFO:teuthology.orchestra.run.smithi099.stdout:data_pools [3] 2024-09-19T06:49:51.343 INFO:teuthology.orchestra.run.smithi099.stdout:metadata_pool 2 2024-09-19T06:49:51.343 INFO:teuthology.orchestra.run.smithi099.stdout:inline_data disabled 2024-09-19T06:49:51.343 INFO:teuthology.orchestra.run.smithi099.stdout:balancer 2024-09-19T06:49:51.343 INFO:teuthology.orchestra.run.smithi099.stdout:bal_rank_mask -1 2024-09-19T06:49:51.343 INFO:teuthology.orchestra.run.smithi099.stdout:standby_count_wanted 1 2024-09-19T06:49:51.343 INFO:teuthology.orchestra.run.smithi099.stdout:qdb_cluster leader: 0 members: 2024-09-19T06:49:51.343 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:49:51.343 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:49:51.344 INFO:teuthology.orchestra.run.smithi099.stdout:Standby daemons: 2024-09-19T06:49:51.344 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:49:51.344 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.obarqf{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6826/1859154203,v1:172.21.15.99:6827/1859154203] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:49:51.344 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.xehbxe{-1:34410} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6828/1939453719,v1:172.21.15.99:6829/1939453719] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:49:51.344 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.nooexo{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6824/1398895079,v1:172.21.15.117:6825/1398895079] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:49:51.344 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.bheqzh{-1:44329} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6826/3233337308,v1:172.21.15.117:6827/3233337308] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:49:51.345 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 29 2024-09-19T06:49:51.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.341+0000 7f0f9796e640 1 -- 172.21.15.99:0/3228324336 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f0f7c06e530 msgr2=0x7f0f7c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:51.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.341+0000 7f0f9796e640 1 --2- 172.21.15.99:0/3228324336 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f0f7c06e530 0x7f0f7c0709e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c007fd0 tx=0x7f0f8c009e90 comp rx=0 tx=0).stop 2024-09-19T06:49:51.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.341+0000 7f0f9796e640 1 -- 172.21.15.99:0/3228324336 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0f900facf0 msgr2=0x7f0f90113310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:51.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.341+0000 7f0f9796e640 1 --2- 172.21.15.99:0/3228324336 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0f900facf0 0x7f0f90113310 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0f84000c00 tx=0x7f0f84009da0 comp rx=0 tx=0).stop 2024-09-19T06:49:51.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.341+0000 7f0f9796e640 1 -- 172.21.15.99:0/3228324336 shutdown_connections 2024-09-19T06:49:51.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.341+0000 7f0f9796e640 1 --2- 172.21.15.99:0/3228324336 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f0f7c06e530 0x7f0f7c0709e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:51.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.341+0000 7f0f9796e640 1 --2- 172.21.15.99:0/3228324336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0f90102680 0x7f0f90113850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:51.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.341+0000 7f0f9796e640 1 --2- 172.21.15.99:0/3228324336 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0f900facf0 0x7f0f90113310 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:51.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.341+0000 7f0f9796e640 1 -- 172.21.15.99:0/3228324336 >> 172.21.15.99:0/3228324336 conn(0x7f0f90070d50 msgr2=0x7f0f900fa0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:51.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.341+0000 7f0f9796e640 1 -- 172.21.15.99:0/3228324336 shutdown_connections 2024-09-19T06:49:51.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.341+0000 7f0f9796e640 1 -- 172.21.15.99:0/3228324336 wait complete. 2024-09-19T06:49:51.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.421+0000 7f8d57f7f640 1 -- 172.21.15.99:0/2660506354 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8d500fcf80 msgr2=0x7f8d500fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:51.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.421+0000 7f8d57f7f640 1 --2- 172.21.15.99:0/2660506354 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8d500fcf80 0x7f8d500fd3d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8d440048d0 tx=0x7f8d44009da0 comp rx=0 tx=0).stop 2024-09-19T06:49:51.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.421+0000 7f8d57f7f640 1 -- 172.21.15.99:0/2660506354 shutdown_connections 2024-09-19T06:49:51.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.421+0000 7f8d57f7f640 1 --2- 172.21.15.99:0/2660506354 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8d500fcf80 0x7f8d500fd3d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:51.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.421+0000 7f8d57f7f640 1 --2- 172.21.15.99:0/2660506354 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d500fb810 0x7f8d500fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:51.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.421+0000 7f8d57f7f640 1 -- 172.21.15.99:0/2660506354 >> 172.21.15.99:0/2660506354 conn(0x7f8d500723b0 msgr2=0x7f8d500727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:51.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.421+0000 7f8d57f7f640 1 -- 172.21.15.99:0/2660506354 shutdown_connections 2024-09-19T06:49:51.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.421+0000 7f8d57f7f640 1 -- 172.21.15.99:0/2660506354 wait complete. 2024-09-19T06:49:51.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.421+0000 7f8d57f7f640 1 Processor -- start 2024-09-19T06:49:51.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.421+0000 7f8d57f7f640 1 -- start start 2024-09-19T06:49:51.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.422+0000 7f8d57f7f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d500fb810 0x7f8d50115440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:51.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.422+0000 7f8d57f7f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8d500fcf80 0x7f8d50115980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:51.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.422+0000 7f8d57f7f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d50115f80 con 0x7f8d500fcf80 2024-09-19T06:49:51.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.422+0000 7f8d57f7f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5010f390 con 0x7f8d500fb810 2024-09-19T06:49:51.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.422+0000 7f8d5551a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8d500fcf80 0x7f8d50115980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:51.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.422+0000 7f8d5551a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8d500fcf80 0x7f8d50115980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:51530/0 (socket says 172.21.15.99:51530) 2024-09-19T06:49:51.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.422+0000 7f8d5551a640 1 -- 172.21.15.99:0/1179585210 learned_addr learned my addr 172.21.15.99:0/1179585210 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:49:51.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.422+0000 7f8d55d1b640 1 --2- 172.21.15.99:0/1179585210 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d500fb810 0x7f8d50115440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:51.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.422+0000 7f8d5551a640 1 -- 172.21.15.99:0/1179585210 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d500fb810 msgr2=0x7f8d50115440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:51.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.422+0000 7f8d5551a640 1 --2- 172.21.15.99:0/1179585210 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d500fb810 0x7f8d50115440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:51.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.422+0000 7f8d5551a640 1 -- 172.21.15.99:0/1179585210 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d44005040 con 0x7f8d500fcf80 2024-09-19T06:49:51.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.422+0000 7f8d5551a640 1 --2- 172.21.15.99:0/1179585210 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8d500fcf80 0x7f8d50115980 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8d44003080 tx=0x7f8d44009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:51.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.422+0000 7f8d4e7fc640 1 -- 172.21.15.99:0/1179585210 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d44038070 con 0x7f8d500fcf80 2024-09-19T06:49:51.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.422+0000 7f8d4e7fc640 1 -- 172.21.15.99:0/1179585210 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8d440097e0 con 0x7f8d500fcf80 2024-09-19T06:49:51.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.422+0000 7f8d57f7f640 1 -- 172.21.15.99:0/1179585210 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d5010f610 con 0x7f8d500fcf80 2024-09-19T06:49:51.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.423+0000 7f8d4e7fc640 1 -- 172.21.15.99:0/1179585210 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d4403d420 con 0x7f8d500fcf80 2024-09-19T06:49:51.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.423+0000 7f8d57f7f640 1 -- 172.21.15.99:0/1179585210 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d5010fad0 con 0x7f8d500fcf80 2024-09-19T06:49:51.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.424+0000 7f8d4e7fc640 1 -- 172.21.15.99:0/1179585210 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f8d44030020 con 0x7f8d500fcf80 2024-09-19T06:49:51.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.424+0000 7f8d57f7f640 1 -- 172.21.15.99:0/1179585210 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d500fcbc0 con 0x7f8d500fcf80 2024-09-19T06:49:51.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.425+0000 7f8d4e7fc640 1 --2- 172.21.15.99:0/1179585210 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f8d3806e530 0x7f8d380709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:51.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.425+0000 7f8d4e7fc640 1 -- 172.21.15.99:0/1179585210 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f8d440ae750 con 0x7f8d500fcf80 2024-09-19T06:49:51.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.425+0000 7f8d55d1b640 1 --2- 172.21.15.99:0/1179585210 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f8d3806e530 0x7f8d380709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:51.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.425+0000 7f8d55d1b640 1 --2- 172.21.15.99:0/1179585210 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f8d3806e530 0x7f8d380709e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8d40004550 tx=0x7f8d40009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:51.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.429+0000 7f8d4e7fc640 1 -- 172.21.15.99:0/1179585210 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f8d44077840 con 0x7f8d500fcf80 2024-09-19T06:49:51.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.612+0000 7f8d57f7f640 1 -- 172.21.15.99:0/1179585210 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8d50110a80 con 0x7f8d3806e530 2024-09-19T06:49:51.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.613+0000 7f8d4e7fc640 1 -- 172.21.15.99:0/1179585210 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f8d50110a80 con 0x7f8d3806e530 2024-09-19T06:49:51.614 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:49:51.614 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T06:49:51.614 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": true, 2024-09-19T06:49:51.614 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T06:49:51.614 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [ 2024-09-19T06:49:51.614 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr", 2024-09-19T06:49:51.615 INFO:teuthology.orchestra.run.smithi099.stdout: "crash", 2024-09-19T06:49:51.615 INFO:teuthology.orchestra.run.smithi099.stdout: "mds", 2024-09-19T06:49:51.615 INFO:teuthology.orchestra.run.smithi099.stdout: "mon", 2024-09-19T06:49:51.615 INFO:teuthology.orchestra.run.smithi099.stdout: "osd" 2024-09-19T06:49:51.615 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-19T06:49:51.615 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": "16/21 daemons upgraded", 2024-09-19T06:49:51.615 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "Currently upgrading mds daemons", 2024-09-19T06:49:51.615 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-09-19T06:49:51.615 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:49:51.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.615+0000 7f8d57f7f640 1 -- 172.21.15.99:0/1179585210 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f8d3806e530 msgr2=0x7f8d380709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:51.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.615+0000 7f8d57f7f640 1 --2- 172.21.15.99:0/1179585210 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f8d3806e530 0x7f8d380709e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8d40004550 tx=0x7f8d40009040 comp rx=0 tx=0).stop 2024-09-19T06:49:51.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.615+0000 7f8d57f7f640 1 -- 172.21.15.99:0/1179585210 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8d500fcf80 msgr2=0x7f8d50115980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:51.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.615+0000 7f8d57f7f640 1 --2- 172.21.15.99:0/1179585210 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8d500fcf80 0x7f8d50115980 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8d44003080 tx=0x7f8d44009da0 comp rx=0 tx=0).stop 2024-09-19T06:49:51.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.615+0000 7f8d57f7f640 1 -- 172.21.15.99:0/1179585210 shutdown_connections 2024-09-19T06:49:51.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.615+0000 7f8d57f7f640 1 --2- 172.21.15.99:0/1179585210 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f8d3806e530 0x7f8d380709e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:51.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.615+0000 7f8d57f7f640 1 --2- 172.21.15.99:0/1179585210 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8d500fcf80 0x7f8d50115980 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:51.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.615+0000 7f8d57f7f640 1 --2- 172.21.15.99:0/1179585210 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d500fb810 0x7f8d50115440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:51.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.615+0000 7f8d57f7f640 1 -- 172.21.15.99:0/1179585210 >> 172.21.15.99:0/1179585210 conn(0x7f8d500723b0 msgr2=0x7f8d50065810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:51.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.615+0000 7f8d57f7f640 1 -- 172.21.15.99:0/1179585210 shutdown_connections 2024-09-19T06:49:51.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.615+0000 7f8d57f7f640 1 -- 172.21.15.99:0/1179585210 wait complete. 2024-09-19T06:49:51.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.693+0000 7f7a33430640 1 -- 172.21.15.99:0/1645594401 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7a2c0fe460 msgr2=0x7f7a2c0fe830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:51.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.693+0000 7f7a33430640 1 --2- 172.21.15.99:0/1645594401 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7a2c0fe460 0x7f7a2c0fe830 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7a28009c50 tx=0x7f7a28004d10 comp rx=0 tx=0).stop 2024-09-19T06:49:51.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.694+0000 7f7a33430640 1 -- 172.21.15.99:0/1645594401 shutdown_connections 2024-09-19T06:49:51.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.694+0000 7f7a33430640 1 --2- 172.21.15.99:0/1645594401 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a2c064fc0 0x7f7a2c065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:51.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.694+0000 7f7a33430640 1 --2- 172.21.15.99:0/1645594401 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7a2c0fe460 0x7f7a2c0fe830 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:51.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.694+0000 7f7a33430640 1 -- 172.21.15.99:0/1645594401 >> 172.21.15.99:0/1645594401 conn(0x7f7a2c0723b0 msgr2=0x7f7a2c0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:51.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.694+0000 7f7a33430640 1 -- 172.21.15.99:0/1645594401 shutdown_connections 2024-09-19T06:49:51.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.694+0000 7f7a33430640 1 -- 172.21.15.99:0/1645594401 wait complete. 2024-09-19T06:49:51.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.694+0000 7f7a33430640 1 Processor -- start 2024-09-19T06:49:51.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.694+0000 7f7a33430640 1 -- start start 2024-09-19T06:49:51.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.695+0000 7f7a33430640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7a2c064fc0 0x7f7a2c1131b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:51.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.695+0000 7f7a33430640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a2c0fe460 0x7f7a2c1136f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:51.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.695+0000 7f7a33430640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2c113cf0 con 0x7f7a2c064fc0 2024-09-19T06:49:51.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.695+0000 7f7a33430640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2c10d130 con 0x7f7a2c0fe460 2024-09-19T06:49:51.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.695+0000 7f7a311cc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7a2c064fc0 0x7f7a2c1131b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:51.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.695+0000 7f7a311cc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7a2c064fc0 0x7f7a2c1131b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:51548/0 (socket says 172.21.15.99:51548) 2024-09-19T06:49:51.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.695+0000 7f7a311cc640 1 -- 172.21.15.99:0/602821113 learned_addr learned my addr 172.21.15.99:0/602821113 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:49:51.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.695+0000 7f7a309cb640 1 --2- 172.21.15.99:0/602821113 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a2c0fe460 0x7f7a2c1136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:51.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.695+0000 7f7a311cc640 1 -- 172.21.15.99:0/602821113 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a2c0fe460 msgr2=0x7f7a2c1136f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:51.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.695+0000 7f7a311cc640 1 --2- 172.21.15.99:0/602821113 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a2c0fe460 0x7f7a2c1136f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:51.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.695+0000 7f7a311cc640 1 -- 172.21.15.99:0/602821113 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a280098b0 con 0x7f7a2c064fc0 2024-09-19T06:49:51.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.695+0000 7f7a311cc640 1 --2- 172.21.15.99:0/602821113 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7a2c064fc0 0x7f7a2c1131b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7a28004750 tx=0x7f7a28004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:51.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.696+0000 7f7a21ffb640 1 -- 172.21.15.99:0/602821113 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a28009540 con 0x7f7a2c064fc0 2024-09-19T06:49:51.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.696+0000 7f7a21ffb640 1 -- 172.21.15.99:0/602821113 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7a280096a0 con 0x7f7a2c064fc0 2024-09-19T06:49:51.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.696+0000 7f7a33430640 1 -- 172.21.15.99:0/602821113 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a2c10d3b0 con 0x7f7a2c064fc0 2024-09-19T06:49:51.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.696+0000 7f7a21ffb640 1 -- 172.21.15.99:0/602821113 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a2803d960 con 0x7f7a2c064fc0 2024-09-19T06:49:51.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.696+0000 7f7a33430640 1 -- 172.21.15.99:0/602821113 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a2c10d900 con 0x7f7a2c064fc0 2024-09-19T06:49:51.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.697+0000 7f7a21ffb640 1 -- 172.21.15.99:0/602821113 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f7a2802f030 con 0x7f7a2c064fc0 2024-09-19T06:49:51.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.698+0000 7f7a33430640 1 -- 172.21.15.99:0/602821113 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a2c0fdcf0 con 0x7f7a2c064fc0 2024-09-19T06:49:51.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.698+0000 7f7a21ffb640 1 --2- 172.21.15.99:0/602821113 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f7a1806e530 0x7f7a180709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:49:51.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.698+0000 7f7a21ffb640 1 -- 172.21.15.99:0/602821113 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f7a280af060 con 0x7f7a2c064fc0 2024-09-19T06:49:51.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.698+0000 7f7a309cb640 1 --2- 172.21.15.99:0/602821113 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f7a1806e530 0x7f7a180709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:49:51.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.698+0000 7f7a309cb640 1 --2- 172.21.15.99:0/602821113 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f7a1806e530 0x7f7a180709e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c10ea70 tx=0x7f7a1c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:49:51.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.702+0000 7f7a21ffb640 1 -- 172.21.15.99:0/602821113 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f7a28078150 con 0x7f7a2c064fc0 2024-09-19T06:49:51.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.946+0000 7f7a33430640 1 -- 172.21.15.99:0/602821113 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f7a2c04b720 con 0x7f7a2c064fc0 2024-09-19T06:49:51.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.946+0000 7f7a21ffb640 1 -- 172.21.15.99:0/602821113 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7f7a2807b810 con 0x7f7a2c064fc0 2024-09-19T06:49:51.947 INFO:teuthology.orchestra.run.smithi099.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-09-19T06:49:51.948 INFO:teuthology.orchestra.run.smithi099.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-19T06:49:51.948 INFO:teuthology.orchestra.run.smithi099.stdout: fs cephfs is degraded 2024-09-19T06:49:51.948 INFO:teuthology.orchestra.run.smithi099.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-19T06:49:51.948 INFO:teuthology.orchestra.run.smithi099.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-19T06:49:51.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.948+0000 7f7a33430640 1 -- 172.21.15.99:0/602821113 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f7a1806e530 msgr2=0x7f7a180709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:51.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.948+0000 7f7a33430640 1 --2- 172.21.15.99:0/602821113 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f7a1806e530 0x7f7a180709e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c10ea70 tx=0x7f7a1c00b040 comp rx=0 tx=0).stop 2024-09-19T06:49:51.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.948+0000 7f7a33430640 1 -- 172.21.15.99:0/602821113 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7a2c064fc0 msgr2=0x7f7a2c1131b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:49:51.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.948+0000 7f7a33430640 1 --2- 172.21.15.99:0/602821113 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7a2c064fc0 0x7f7a2c1131b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7a28004750 tx=0x7f7a28004d10 comp rx=0 tx=0).stop 2024-09-19T06:49:51.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.948+0000 7f7a33430640 1 -- 172.21.15.99:0/602821113 shutdown_connections 2024-09-19T06:49:51.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.948+0000 7f7a33430640 1 --2- 172.21.15.99:0/602821113 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f7a1806e530 0x7f7a180709e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:51.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.948+0000 7f7a33430640 1 --2- 172.21.15.99:0/602821113 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a2c0fe460 0x7f7a2c1136f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:51.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.948+0000 7f7a33430640 1 --2- 172.21.15.99:0/602821113 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7a2c064fc0 0x7f7a2c1131b0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:49:51.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.948+0000 7f7a33430640 1 -- 172.21.15.99:0/602821113 >> 172.21.15.99:0/602821113 conn(0x7f7a2c0723b0 msgr2=0x7f7a2c105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:49:51.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.948+0000 7f7a33430640 1 -- 172.21.15.99:0/602821113 shutdown_connections 2024-09-19T06:49:51.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:49:51.949+0000 7f7a33430640 1 -- 172.21.15.99:0/602821113 wait complete. 2024-09-19T06:49:52.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:49:52 smithi099 ceph-mon[97031]: from='client.34474 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:49:52.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:49:52 smithi099 ceph-mon[97031]: from='client.34478 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:49:52.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:49:52 smithi099 ceph-mon[97031]: from='client.34482 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:49:52.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:49:52 smithi099 ceph-mon[97031]: pgmap v225: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:49:52.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:49:52 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/2124123448' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:49:52.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:49:52 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/3228324336' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:49:52.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:49:52 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:49:52.207 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:49:52 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/602821113' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T06:49:52.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:49:52 smithi117 ceph-mon[76771]: from='client.34474 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:49:52.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:49:52 smithi117 ceph-mon[76771]: from='client.34478 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:49:52.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:49:52 smithi117 ceph-mon[76771]: from='client.34482 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:49:52.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:49:52 smithi117 ceph-mon[76771]: pgmap v225: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:49:52.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:49:52 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/2124123448' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:49:52.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:49:52 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/3228324336' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:49:52.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:49:52 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:49:52.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:49:52 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/602821113' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T06:49:53.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:49:53 smithi117 ceph-mon[76771]: from='client.34494 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:49:53.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:49:53 smithi099 ceph-mon[97031]: from='client.34494 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:49:54.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:49:54 smithi117 ceph-mon[76771]: pgmap v226: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:49:54.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:49:54 smithi099 ceph-mon[97031]: pgmap v226: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:49:56.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:49:56 smithi117 ceph-mon[76771]: pgmap v227: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:49:56.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:49:56 smithi099 ceph-mon[97031]: pgmap v227: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:49:58.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:49:58 smithi117 ceph-mon[76771]: pgmap v228: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:49:58.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:49:58 smithi099 ceph-mon[97031]: pgmap v228: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:50:00.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:50:00 smithi117 ceph-mon[76771]: pgmap v229: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:50:00.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:50:00 smithi117 ceph-mon[76771]: Health detail: HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-09-19T06:50:00.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:50:00 smithi117 ceph-mon[76771]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-19T06:50:00.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:50:00 smithi117 ceph-mon[76771]: fs cephfs is degraded 2024-09-19T06:50:00.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:50:00 smithi117 ceph-mon[76771]: [ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-19T06:50:00.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:50:00 smithi117 ceph-mon[76771]: fs cephfs is offline because no MDS is active for it. 2024-09-19T06:50:00.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:50:00 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-mon-smithi099[97027]: 2024-09-19T06:49:59.999+0000 7f687d00b640 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-09-19T06:50:00.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:50:00 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-mon-smithi099[97027]: 2024-09-19T06:49:59.999+0000 7f687d00b640 -1 log_channel(cluster) log [ERR] : [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-19T06:50:00.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:50:00 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-mon-smithi099[97027]: 2024-09-19T06:49:59.999+0000 7f687d00b640 -1 log_channel(cluster) log [ERR] : fs cephfs is degraded 2024-09-19T06:50:00.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:50:00 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-mon-smithi099[97027]: 2024-09-19T06:49:59.999+0000 7f687d00b640 -1 log_channel(cluster) log [ERR] : [ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-19T06:50:00.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:50:00 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-mon-smithi099[97027]: 2024-09-19T06:49:59.999+0000 7f687d00b640 -1 log_channel(cluster) log [ERR] : fs cephfs is offline because no MDS is active for it. 2024-09-19T06:50:00.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:50:00 smithi099 ceph-mon[97031]: pgmap v229: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:50:00.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:50:00 smithi099 ceph-mon[97031]: Health detail: HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-09-19T06:50:00.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:50:00 smithi099 ceph-mon[97031]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-19T06:50:00.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:50:00 smithi099 ceph-mon[97031]: fs cephfs is degraded 2024-09-19T06:50:00.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:50:00 smithi099 ceph-mon[97031]: [ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-19T06:50:00.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:50:00 smithi099 ceph-mon[97031]: fs cephfs is offline because no MDS is active for it. 2024-09-19T06:50:02.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:50:02 smithi117 ceph-mon[76771]: pgmap v230: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:50:02.314 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:50:02 smithi099 ceph-mon[97031]: pgmap v230: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:50:04.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:50:04 smithi117 ceph-mon[76771]: pgmap v231: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:50:04.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:50:04 smithi099 ceph-mon[97031]: pgmap v231: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:50:06.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:50:06 smithi117 ceph-mon[76771]: pgmap v232: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:50:06.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:50:06 smithi099 ceph-mon[97031]: pgmap v232: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:50:07.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:50:07 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:50:07.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:50:07 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:50:08.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:50:08 smithi117 ceph-mon[76771]: pgmap v233: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:50:08.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:50:08 smithi099 ceph-mon[97031]: pgmap v233: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:50:09.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:50:09 smithi099 ceph-mon[97031]: pgmap v234: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:50:09.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:50:09 smithi117 ceph-mon[76771]: pgmap v234: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:50:12.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:50:11 smithi117 ceph-mon[76771]: pgmap v235: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:50:12.314 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:50:11 smithi099 ceph-mon[97031]: pgmap v235: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:50:14.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:50:13 smithi117 ceph-mon[76771]: pgmap v236: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:50:14.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:50:13 smithi099 ceph-mon[97031]: pgmap v236: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:50:16.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:50:15 smithi117 ceph-mon[76771]: pgmap v237: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:50:16.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:50:15 smithi099 ceph-mon[97031]: pgmap v237: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:50:18.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:50:17 smithi117 ceph-mon[76771]: pgmap v238: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:50:18.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:50:17 smithi099 ceph-mon[97031]: pgmap v238: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:50:20.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:50:19 smithi117 ceph-mon[76771]: pgmap v239: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:50:20.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:50:19 smithi099 ceph-mon[97031]: pgmap v239: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:50:22.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.040+0000 7efcc17a2640 1 -- 172.21.15.99:0/1624866127 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efcbc0fb480 msgr2=0x7efcbc0fb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:22.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.040+0000 7efcc17a2640 1 --2- 172.21.15.99:0/1624866127 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efcbc0fb480 0x7efcbc0fb8f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7efca40048d0 tx=0x7efca4009da0 comp rx=0 tx=0).stop 2024-09-19T06:50:22.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.041+0000 7efcc17a2640 1 -- 172.21.15.99:0/1624866127 shutdown_connections 2024-09-19T06:50:22.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.041+0000 7efcc17a2640 1 --2- 172.21.15.99:0/1624866127 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efcbc0fb480 0x7efcbc0fb8f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:22.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.041+0000 7efcc17a2640 1 --2- 172.21.15.99:0/1624866127 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcbc1014c0 0x7efcbc101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:22.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.041+0000 7efcc17a2640 1 -- 172.21.15.99:0/1624866127 >> 172.21.15.99:0/1624866127 conn(0x7efcbc0f7000 msgr2=0x7efcbc0f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:22.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.041+0000 7efcc17a2640 1 -- 172.21.15.99:0/1624866127 shutdown_connections 2024-09-19T06:50:22.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.041+0000 7efcc17a2640 1 -- 172.21.15.99:0/1624866127 wait complete. 2024-09-19T06:50:22.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.041+0000 7efcc17a2640 1 Processor -- start 2024-09-19T06:50:22.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.041+0000 7efcc17a2640 1 -- start start 2024-09-19T06:50:22.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.041+0000 7efcc17a2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcbc0fb480 0x7efcbc10e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:22.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.041+0000 7efcc17a2640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efcbc1014c0 0x7efcbc10e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:22.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.041+0000 7efcc17a2640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcbc10ecf0 con 0x7efcbc1014c0 2024-09-19T06:50:22.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.041+0000 7efcc17a2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcbc10ee60 con 0x7efcbc0fb480 2024-09-19T06:50:22.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.042+0000 7efcb3fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efcbc1014c0 0x7efcbc10e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:22.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.042+0000 7efcb3fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efcbc1014c0 0x7efcbc10e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40620/0 (socket says 172.21.15.99:40620) 2024-09-19T06:50:22.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.042+0000 7efcb3fff640 1 -- 172.21.15.99:0/223278674 learned_addr learned my addr 172.21.15.99:0/223278674 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:50:22.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.042+0000 7efcbaffd640 1 --2- 172.21.15.99:0/223278674 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcbc0fb480 0x7efcbc10e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:22.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.042+0000 7efcb3fff640 1 -- 172.21.15.99:0/223278674 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcbc0fb480 msgr2=0x7efcbc10e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:22.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.042+0000 7efcb3fff640 1 --2- 172.21.15.99:0/223278674 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcbc0fb480 0x7efcbc10e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:22.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.042+0000 7efcb3fff640 1 -- 172.21.15.99:0/223278674 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca4005040 con 0x7efcbc1014c0 2024-09-19T06:50:22.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.042+0000 7efcb3fff640 1 --2- 172.21.15.99:0/223278674 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efcbc1014c0 0x7efcbc10e6a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7efca4000c00 tx=0x7efca4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:22.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.042+0000 7efcb37fe640 1 -- 172.21.15.99:0/223278674 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efca4038070 con 0x7efcbc1014c0 2024-09-19T06:50:22.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.042+0000 7efcb37fe640 1 -- 172.21.15.99:0/223278674 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7efca402ade0 con 0x7efcbc1014c0 2024-09-19T06:50:22.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.042+0000 7efcc17a2640 1 -- 172.21.15.99:0/223278674 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcbc1171d0 con 0x7efcbc1014c0 2024-09-19T06:50:22.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.042+0000 7efcb37fe640 1 -- 172.21.15.99:0/223278674 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efca402c7e0 con 0x7efcbc1014c0 2024-09-19T06:50:22.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.043+0000 7efcc17a2640 1 -- 172.21.15.99:0/223278674 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcbc1175b0 con 0x7efcbc1014c0 2024-09-19T06:50:22.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.043+0000 7efcc17a2640 1 -- 172.21.15.99:0/223278674 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcbc0fcbc0 con 0x7efcbc1014c0 2024-09-19T06:50:22.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.044+0000 7efcb37fe640 1 -- 172.21.15.99:0/223278674 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7efca4030020 con 0x7efcbc1014c0 2024-09-19T06:50:22.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.044+0000 7efcb37fe640 1 --2- 172.21.15.99:0/223278674 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7efca806e530 0x7efca80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:22.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.045+0000 7efcb37fe640 1 -- 172.21.15.99:0/223278674 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7efca40add40 con 0x7efcbc1014c0 2024-09-19T06:50:22.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.045+0000 7efcbaffd640 1 --2- 172.21.15.99:0/223278674 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7efca806e530 0x7efca80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:22.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.045+0000 7efcbaffd640 1 --2- 172.21.15.99:0/223278674 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7efca806e530 0x7efca80709e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7efcac009fd0 tx=0x7efcac00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:22.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.049+0000 7efcb37fe640 1 -- 172.21.15.99:0/223278674 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7efca40b1030 con 0x7efcbc1014c0 2024-09-19T06:50:22.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.235+0000 7efcc17a2640 1 -- 172.21.15.99:0/223278674 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efcbc04b720 con 0x7efca806e530 2024-09-19T06:50:22.236 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:50:21 smithi099 ceph-mon[97031]: pgmap v240: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:50:22.236 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:50:21 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:50:22.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.236+0000 7efcb37fe640 1 -- 172.21.15.99:0/223278674 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7efcbc04b720 con 0x7efca806e530 2024-09-19T06:50:22.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.238+0000 7efcc17a2640 1 -- 172.21.15.99:0/223278674 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7efca806e530 msgr2=0x7efca80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:22.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.238+0000 7efcc17a2640 1 --2- 172.21.15.99:0/223278674 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7efca806e530 0x7efca80709e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7efcac009fd0 tx=0x7efcac00b040 comp rx=0 tx=0).stop 2024-09-19T06:50:22.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.238+0000 7efcc17a2640 1 -- 172.21.15.99:0/223278674 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efcbc1014c0 msgr2=0x7efcbc10e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:22.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.238+0000 7efcc17a2640 1 --2- 172.21.15.99:0/223278674 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efcbc1014c0 0x7efcbc10e6a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7efca4000c00 tx=0x7efca4009da0 comp rx=0 tx=0).stop 2024-09-19T06:50:22.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.238+0000 7efcc17a2640 1 -- 172.21.15.99:0/223278674 shutdown_connections 2024-09-19T06:50:22.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.238+0000 7efcc17a2640 1 --2- 172.21.15.99:0/223278674 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7efca806e530 0x7efca80709e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:22.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.238+0000 7efcc17a2640 1 --2- 172.21.15.99:0/223278674 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efcbc1014c0 0x7efcbc10e6a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:22.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.238+0000 7efcc17a2640 1 --2- 172.21.15.99:0/223278674 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcbc0fb480 0x7efcbc10e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:22.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.238+0000 7efcc17a2640 1 -- 172.21.15.99:0/223278674 >> 172.21.15.99:0/223278674 conn(0x7efcbc0f7000 msgr2=0x7efcbc0f88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:22.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.238+0000 7efcc17a2640 1 -- 172.21.15.99:0/223278674 shutdown_connections 2024-09-19T06:50:22.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.238+0000 7efcc17a2640 1 -- 172.21.15.99:0/223278674 wait complete. 2024-09-19T06:50:22.248 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-09-19T06:50:22.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:50:21 smithi117 ceph-mon[76771]: pgmap v240: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:50:22.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:50:21 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:50:22.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.318+0000 7f3ee4d7c640 1 -- 172.21.15.99:0/1570412875 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ee01003c0 msgr2=0x7f3ee0100790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:22.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.318+0000 7f3ee4d7c640 1 --2- 172.21.15.99:0/1570412875 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ee01003c0 0x7f3ee0100790 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3ed00048d0 tx=0x7f3ed0009da0 comp rx=0 tx=0).stop 2024-09-19T06:50:22.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.318+0000 7f3ee4d7c640 1 -- 172.21.15.99:0/1570412875 shutdown_connections 2024-09-19T06:50:22.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.318+0000 7f3ee4d7c640 1 --2- 172.21.15.99:0/1570412875 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ee00fbd70 0x7f3ee00fc1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:22.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.318+0000 7f3ee4d7c640 1 --2- 172.21.15.99:0/1570412875 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ee01003c0 0x7f3ee0100790 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:22.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.318+0000 7f3ee4d7c640 1 -- 172.21.15.99:0/1570412875 >> 172.21.15.99:0/1570412875 conn(0x7f3ee0070c80 msgr2=0x7f3ee0071080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:22.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.318+0000 7f3ee4d7c640 1 -- 172.21.15.99:0/1570412875 shutdown_connections 2024-09-19T06:50:22.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.318+0000 7f3ee4d7c640 1 -- 172.21.15.99:0/1570412875 wait complete. 2024-09-19T06:50:22.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.319+0000 7f3ee4d7c640 1 Processor -- start 2024-09-19T06:50:22.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.319+0000 7f3ee4d7c640 1 -- start start 2024-09-19T06:50:22.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.319+0000 7f3ee4d7c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ee00fbd70 0x7f3ee01153b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:22.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.319+0000 7f3ee4d7c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ee01003c0 0x7f3ee01158f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:22.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.319+0000 7f3ee4d7c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee0115ef0 con 0x7f3ee00fbd70 2024-09-19T06:50:22.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.319+0000 7f3ee4d7c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee010f330 con 0x7f3ee01003c0 2024-09-19T06:50:22.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.319+0000 7f3ede59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ee00fbd70 0x7f3ee01153b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:22.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.319+0000 7f3ede59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ee00fbd70 0x7f3ee01153b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40638/0 (socket says 172.21.15.99:40638) 2024-09-19T06:50:22.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.319+0000 7f3ede59c640 1 -- 172.21.15.99:0/1273791836 learned_addr learned my addr 172.21.15.99:0/1273791836 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:50:22.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.319+0000 7f3ed7fff640 1 --2- 172.21.15.99:0/1273791836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ee01003c0 0x7f3ee01158f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:22.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.319+0000 7f3ede59c640 1 -- 172.21.15.99:0/1273791836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ee01003c0 msgr2=0x7f3ee01158f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:22.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.319+0000 7f3ede59c640 1 --2- 172.21.15.99:0/1273791836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ee01003c0 0x7f3ee01158f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:22.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.319+0000 7f3ede59c640 1 -- 172.21.15.99:0/1273791836 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed0005040 con 0x7f3ee00fbd70 2024-09-19T06:50:22.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.320+0000 7f3ede59c640 1 --2- 172.21.15.99:0/1273791836 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ee00fbd70 0x7f3ee01153b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3ed0000c00 tx=0x7f3ed0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:22.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.320+0000 7f3ed6ffd640 1 -- 172.21.15.99:0/1273791836 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ed0038070 con 0x7f3ee00fbd70 2024-09-19T06:50:22.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.320+0000 7f3ed6ffd640 1 -- 172.21.15.99:0/1273791836 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3ed002ade0 con 0x7f3ee00fbd70 2024-09-19T06:50:22.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.320+0000 7f3ee4d7c640 1 -- 172.21.15.99:0/1273791836 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ee010f5b0 con 0x7f3ee00fbd70 2024-09-19T06:50:22.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.320+0000 7f3ed6ffd640 1 -- 172.21.15.99:0/1273791836 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ed002c7e0 con 0x7f3ee00fbd70 2024-09-19T06:50:22.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.320+0000 7f3ee4d7c640 1 -- 172.21.15.99:0/1273791836 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ee010faf0 con 0x7f3ee00fbd70 2024-09-19T06:50:22.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.321+0000 7f3ee4d7c640 1 -- 172.21.15.99:0/1273791836 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ee00fcd80 con 0x7f3ee00fbd70 2024-09-19T06:50:22.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.321+0000 7f3ed6ffd640 1 -- 172.21.15.99:0/1273791836 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f3ed0030020 con 0x7f3ee00fbd70 2024-09-19T06:50:22.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.322+0000 7f3ed6ffd640 1 --2- 172.21.15.99:0/1273791836 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f3ecc06e530 0x7f3ecc0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:22.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.322+0000 7f3ed6ffd640 1 -- 172.21.15.99:0/1273791836 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f3ed00add00 con 0x7f3ee00fbd70 2024-09-19T06:50:22.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.322+0000 7f3ed7fff640 1 --2- 172.21.15.99:0/1273791836 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f3ecc06e530 0x7f3ecc0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:22.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.322+0000 7f3ed7fff640 1 --2- 172.21.15.99:0/1273791836 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f3ecc06e530 0x7f3ecc0709e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3ee0110c70 tx=0x7f3ec800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:22.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.326+0000 7f3ed6ffd640 1 -- 172.21.15.99:0/1273791836 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f3ed0076f20 con 0x7f3ee00fbd70 2024-09-19T06:50:22.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.508+0000 7f3ee4d7c640 1 -- 172.21.15.99:0/1273791836 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3ee004b720 con 0x7f3ecc06e530 2024-09-19T06:50:22.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.509+0000 7f3ed6ffd640 1 -- 172.21.15.99:0/1273791836 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f3ee004b720 con 0x7f3ecc06e530 2024-09-19T06:50:22.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.511+0000 7f3ee4d7c640 1 -- 172.21.15.99:0/1273791836 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f3ecc06e530 msgr2=0x7f3ecc0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:22.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.511+0000 7f3ee4d7c640 1 --2- 172.21.15.99:0/1273791836 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f3ecc06e530 0x7f3ecc0709e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3ee0110c70 tx=0x7f3ec800b040 comp rx=0 tx=0).stop 2024-09-19T06:50:22.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.511+0000 7f3ee4d7c640 1 -- 172.21.15.99:0/1273791836 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ee00fbd70 msgr2=0x7f3ee01153b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:22.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.511+0000 7f3ee4d7c640 1 --2- 172.21.15.99:0/1273791836 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ee00fbd70 0x7f3ee01153b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3ed0000c00 tx=0x7f3ed0009da0 comp rx=0 tx=0).stop 2024-09-19T06:50:22.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.511+0000 7f3ee4d7c640 1 -- 172.21.15.99:0/1273791836 shutdown_connections 2024-09-19T06:50:22.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.511+0000 7f3ee4d7c640 1 --2- 172.21.15.99:0/1273791836 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f3ecc06e530 0x7f3ecc0709e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:22.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.511+0000 7f3ee4d7c640 1 --2- 172.21.15.99:0/1273791836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3ee01003c0 0x7f3ee01158f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:22.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.511+0000 7f3ee4d7c640 1 --2- 172.21.15.99:0/1273791836 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ee00fbd70 0x7f3ee01153b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:22.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.511+0000 7f3ee4d7c640 1 -- 172.21.15.99:0/1273791836 >> 172.21.15.99:0/1273791836 conn(0x7f3ee0070c80 msgr2=0x7f3ee00fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:22.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.512+0000 7f3ee4d7c640 1 -- 172.21.15.99:0/1273791836 shutdown_connections 2024-09-19T06:50:22.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.512+0000 7f3ee4d7c640 1 -- 172.21.15.99:0/1273791836 wait complete. 2024-09-19T06:50:22.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.589+0000 7fa222215640 1 -- 172.21.15.99:0/3168497784 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa21c102550 msgr2=0x7fa21c102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:22.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.589+0000 7fa222215640 1 --2- 172.21.15.99:0/3168497784 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa21c102550 0x7fa21c102920 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa20c0048d0 tx=0x7fa20c009da0 comp rx=0 tx=0).stop 2024-09-19T06:50:22.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.589+0000 7fa222215640 1 -- 172.21.15.99:0/3168497784 shutdown_connections 2024-09-19T06:50:22.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.589+0000 7fa222215640 1 --2- 172.21.15.99:0/3168497784 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa21c102ef0 0x7fa21c0fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:22.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.589+0000 7fa222215640 1 --2- 172.21.15.99:0/3168497784 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa21c102550 0x7fa21c102920 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:22.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.589+0000 7fa222215640 1 -- 172.21.15.99:0/3168497784 >> 172.21.15.99:0/3168497784 conn(0x7fa21c0f80f0 msgr2=0x7fa21c0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:22.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.589+0000 7fa222215640 1 -- 172.21.15.99:0/3168497784 shutdown_connections 2024-09-19T06:50:22.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.589+0000 7fa222215640 1 -- 172.21.15.99:0/3168497784 wait complete. 2024-09-19T06:50:22.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.590+0000 7fa222215640 1 Processor -- start 2024-09-19T06:50:22.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.590+0000 7fa222215640 1 -- start start 2024-09-19T06:50:22.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.590+0000 7fa222215640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa21c102550 0x7fa21c113540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:22.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.590+0000 7fa222215640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa21c102ef0 0x7fa21c113a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:22.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.590+0000 7fa222215640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa21c1140d0 con 0x7fa21c102550 2024-09-19T06:50:22.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.590+0000 7fa222215640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa21c10d4e0 con 0x7fa21c102ef0 2024-09-19T06:50:22.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.590+0000 7fa21b7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa21c102550 0x7fa21c113540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:22.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.590+0000 7fa21b7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa21c102550 0x7fa21c113540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40646/0 (socket says 172.21.15.99:40646) 2024-09-19T06:50:22.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.590+0000 7fa21b7fe640 1 -- 172.21.15.99:0/1999624051 learned_addr learned my addr 172.21.15.99:0/1999624051 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:50:22.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.590+0000 7fa21affd640 1 --2- 172.21.15.99:0/1999624051 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa21c102ef0 0x7fa21c113a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:22.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.590+0000 7fa21b7fe640 1 -- 172.21.15.99:0/1999624051 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa21c102ef0 msgr2=0x7fa21c113a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:22.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.590+0000 7fa21b7fe640 1 --2- 172.21.15.99:0/1999624051 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa21c102ef0 0x7fa21c113a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:22.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.591+0000 7fa21b7fe640 1 -- 172.21.15.99:0/1999624051 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa20c005040 con 0x7fa21c102550 2024-09-19T06:50:22.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.591+0000 7fa21b7fe640 1 --2- 172.21.15.99:0/1999624051 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa21c102550 0x7fa21c113540 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa20c0043d0 tx=0x7fa20c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:22.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.591+0000 7fa203fff640 1 -- 172.21.15.99:0/1999624051 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa20c038070 con 0x7fa21c102550 2024-09-19T06:50:22.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.591+0000 7fa203fff640 1 -- 172.21.15.99:0/1999624051 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa20c0096e0 con 0x7fa21c102550 2024-09-19T06:50:22.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.591+0000 7fa222215640 1 -- 172.21.15.99:0/1999624051 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa21c10d760 con 0x7fa21c102550 2024-09-19T06:50:22.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.591+0000 7fa203fff640 1 -- 172.21.15.99:0/1999624051 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa20c03d420 con 0x7fa21c102550 2024-09-19T06:50:22.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.591+0000 7fa222215640 1 -- 172.21.15.99:0/1999624051 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa21c10dd00 con 0x7fa21c102550 2024-09-19T06:50:22.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.592+0000 7fa222215640 1 -- 172.21.15.99:0/1999624051 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa21c0fdcd0 con 0x7fa21c102550 2024-09-19T06:50:22.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.593+0000 7fa203fff640 1 -- 172.21.15.99:0/1999624051 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fa20c030020 con 0x7fa21c102550 2024-09-19T06:50:22.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.593+0000 7fa203fff640 1 --2- 172.21.15.99:0/1999624051 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa20406e530 0x7fa2040709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:22.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.593+0000 7fa203fff640 1 -- 172.21.15.99:0/1999624051 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fa20c0ae560 con 0x7fa21c102550 2024-09-19T06:50:22.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.593+0000 7fa21affd640 1 --2- 172.21.15.99:0/1999624051 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa20406e530 0x7fa2040709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:22.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.593+0000 7fa21affd640 1 --2- 172.21.15.99:0/1999624051 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa20406e530 0x7fa2040709e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa21c10e7c0 tx=0x7fa21000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:22.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.597+0000 7fa203fff640 1 -- 172.21.15.99:0/1999624051 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fa20c0776d0 con 0x7fa21c102550 2024-09-19T06:50:22.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.774+0000 7fa222215640 1 -- 172.21.15.99:0/1999624051 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa21c04b720 con 0x7fa20406e530 2024-09-19T06:50:22.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.783+0000 7fa203fff640 1 -- 172.21.15.99:0/1999624051 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fa21c04b720 con 0x7fa20406e530 2024-09-19T06:50:22.785 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T06:50:22.785 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.smithi099 smithi099 *:9093,9094 running (9m) 2m ago 17m 23.4M - 0.25.0 c8568f914cd2 e7c1774d56b0 2024-09-19T06:50:22.785 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi099 smithi099 running (5m) 2m ago 17m 6899k - 19.1.1-361-g2f599a46 d2baa855c067 b9775f416b10 2024-09-19T06:50:22.785 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi117 smithi117 running (5m) 93s ago 17m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 38cf60c0d548 2024-09-19T06:50:22.785 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.smithi099 smithi099 *:3000 running (7m) 2m ago 17m 80.7M - 9.4.12 2bacad6d85d8 cd53a18d5410 2024-09-19T06:50:22.785 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.obarqf smithi099 running (2m) 2m ago 12m 12.2M - 19.1.1-361-g2f599a46 d2baa855c067 314a73082521 2024-09-19T06:50:22.785 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.xehbxe smithi099 running (2m) 2m ago 12m 14.4M - 19.1.1-361-g2f599a46 d2baa855c067 a2955a9d06e6 2024-09-19T06:50:22.785 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.bheqzh smithi117 running (96s) 93s ago 12m 11.8M - 19.1.1-361-g2f599a46 d2baa855c067 b1505937c0b7 2024-09-19T06:50:22.785 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.nooexo smithi117 running (111s) 93s ago 12m 13.1M - 19.1.1-361-g2f599a46 d2baa855c067 35bd7725855c 2024-09-19T06:50:22.785 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi099.pgvkqi smithi099 *:8443,9283,8765 running (8m) 2m ago 19m 505M - 19.1.1-361-g2f599a46 d2baa855c067 d5de99cb7e78 2024-09-19T06:50:22.785 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi117.ssmkcf smithi117 *:8443,9283,8765 running (8m) 93s ago 17m 444M - 19.1.1-361-g2f599a46 d2baa855c067 8b7ee0f871f5 2024-09-19T06:50:22.785 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi099 smithi099 running (6m) 2m ago 19m 52.4M 2048M 19.1.1-361-g2f599a46 d2baa855c067 ffe067438824 2024-09-19T06:50:22.785 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi117 smithi117 running (6m) 93s ago 16m 38.9M 2048M 19.1.1-361-g2f599a46 d2baa855c067 4cb7455e3ee7 2024-09-19T06:50:22.786 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi099 smithi099 *:9100 running (9m) 2m ago 17m 15.0M - 1.5.0 0da6a335fe13 dca7b4517dcc 2024-09-19T06:50:22.786 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi117 smithi117 *:9100 running (8m) 93s ago 17m 15.9M - 1.5.0 0da6a335fe13 8233ce3835d2 2024-09-19T06:50:22.786 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (5m) 2m ago 16m 100M 1557M 19.1.1-361-g2f599a46 d2baa855c067 8e22543bf933 2024-09-19T06:50:22.786 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (4m) 2m ago 15m 106M 1557M 19.1.1-361-g2f599a46 d2baa855c067 f54153d0ae09 2024-09-19T06:50:22.786 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (4m) 2m ago 15m 83.7M 1557M 19.1.1-361-g2f599a46 d2baa855c067 b1778ab88870 2024-09-19T06:50:22.786 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi117 running (3m) 93s ago 14m 102M 2581M 19.1.1-361-g2f599a46 d2baa855c067 ea5236b193d3 2024-09-19T06:50:22.786 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi117 running (3m) 93s ago 14m 93.5M 2581M 19.1.1-361-g2f599a46 d2baa855c067 27ac2c859a68 2024-09-19T06:50:22.786 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi117 running (2m) 93s ago 14m 100M 2581M 19.1.1-361-g2f599a46 d2baa855c067 de6aeb8544ce 2024-09-19T06:50:22.786 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.smithi099 smithi099 *:9095 running (8m) 2m ago 17m 64.4M - 2.43.0 a07b618ecd1d 15ad26ec6fb4 2024-09-19T06:50:22.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.785+0000 7fa222215640 1 -- 172.21.15.99:0/1999624051 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa20406e530 msgr2=0x7fa2040709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:22.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.785+0000 7fa222215640 1 --2- 172.21.15.99:0/1999624051 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa20406e530 0x7fa2040709e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa21c10e7c0 tx=0x7fa21000b040 comp rx=0 tx=0).stop 2024-09-19T06:50:22.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.785+0000 7fa222215640 1 -- 172.21.15.99:0/1999624051 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa21c102550 msgr2=0x7fa21c113540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:22.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.785+0000 7fa222215640 1 --2- 172.21.15.99:0/1999624051 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa21c102550 0x7fa21c113540 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa20c0043d0 tx=0x7fa20c009da0 comp rx=0 tx=0).stop 2024-09-19T06:50:22.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.786+0000 7fa222215640 1 -- 172.21.15.99:0/1999624051 shutdown_connections 2024-09-19T06:50:22.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.786+0000 7fa222215640 1 --2- 172.21.15.99:0/1999624051 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa20406e530 0x7fa2040709e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:22.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.786+0000 7fa222215640 1 --2- 172.21.15.99:0/1999624051 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa21c102ef0 0x7fa21c113a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:22.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.786+0000 7fa222215640 1 --2- 172.21.15.99:0/1999624051 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa21c102550 0x7fa21c113540 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:22.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.786+0000 7fa222215640 1 -- 172.21.15.99:0/1999624051 >> 172.21.15.99:0/1999624051 conn(0x7fa21c0f80f0 msgr2=0x7fa21c0f9160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:22.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.786+0000 7fa222215640 1 -- 172.21.15.99:0/1999624051 shutdown_connections 2024-09-19T06:50:22.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.786+0000 7fa222215640 1 -- 172.21.15.99:0/1999624051 wait complete. 2024-09-19T06:50:22.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.864+0000 7faf2a9e2640 1 -- 172.21.15.99:0/1771358190 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf24102ef0 msgr2=0x7faf240fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:22.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.864+0000 7faf2a9e2640 1 --2- 172.21.15.99:0/1771358190 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf24102ef0 0x7faf240fc5b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7faf180048d0 tx=0x7faf18009da0 comp rx=0 tx=0).stop 2024-09-19T06:50:22.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.864+0000 7faf2a9e2640 1 -- 172.21.15.99:0/1771358190 shutdown_connections 2024-09-19T06:50:22.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.864+0000 7faf2a9e2640 1 --2- 172.21.15.99:0/1771358190 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf24102ef0 0x7faf240fc5b0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:22.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.864+0000 7faf2a9e2640 1 --2- 172.21.15.99:0/1771358190 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf24102550 0x7faf24102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:22.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.864+0000 7faf2a9e2640 1 -- 172.21.15.99:0/1771358190 >> 172.21.15.99:0/1771358190 conn(0x7faf240f80f0 msgr2=0x7faf240fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:22.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.864+0000 7faf2a9e2640 1 -- 172.21.15.99:0/1771358190 shutdown_connections 2024-09-19T06:50:22.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.864+0000 7faf2a9e2640 1 -- 172.21.15.99:0/1771358190 wait complete. 2024-09-19T06:50:22.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.865+0000 7faf2a9e2640 1 Processor -- start 2024-09-19T06:50:22.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.865+0000 7faf2a9e2640 1 -- start start 2024-09-19T06:50:22.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.865+0000 7faf2a9e2640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf24102550 0x7faf24113520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:22.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.865+0000 7faf2a9e2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf24102ef0 0x7faf24113a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:22.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.865+0000 7faf2a9e2640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf241140b0 con 0x7faf24102550 2024-09-19T06:50:22.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.865+0000 7faf2a9e2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf2410d4c0 con 0x7faf24102ef0 2024-09-19T06:50:22.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.865+0000 7faf23fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf24102550 0x7faf24113520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:22.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.865+0000 7faf23fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf24102550 0x7faf24113520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40652/0 (socket says 172.21.15.99:40652) 2024-09-19T06:50:22.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.865+0000 7faf23fff640 1 -- 172.21.15.99:0/262327073 learned_addr learned my addr 172.21.15.99:0/262327073 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:50:22.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.865+0000 7faf237fe640 1 --2- 172.21.15.99:0/262327073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf24102ef0 0x7faf24113a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:22.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.865+0000 7faf23fff640 1 -- 172.21.15.99:0/262327073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf24102ef0 msgr2=0x7faf24113a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:22.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.865+0000 7faf23fff640 1 --2- 172.21.15.99:0/262327073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf24102ef0 0x7faf24113a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:22.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.865+0000 7faf23fff640 1 -- 172.21.15.99:0/262327073 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf18005040 con 0x7faf24102550 2024-09-19T06:50:22.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.866+0000 7faf23fff640 1 --2- 172.21.15.99:0/262327073 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf24102550 0x7faf24113520 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7faf14002a50 tx=0x7faf14004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:22.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.866+0000 7faf20ff9640 1 -- 172.21.15.99:0/262327073 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf14007c30 con 0x7faf24102550 2024-09-19T06:50:22.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.866+0000 7faf20ff9640 1 -- 172.21.15.99:0/262327073 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7faf1400f040 con 0x7faf24102550 2024-09-19T06:50:22.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.866+0000 7faf2a9e2640 1 -- 172.21.15.99:0/262327073 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf2410d7a0 con 0x7faf24102550 2024-09-19T06:50:22.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.866+0000 7faf20ff9640 1 -- 172.21.15.99:0/262327073 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf1400da10 con 0x7faf24102550 2024-09-19T06:50:22.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.866+0000 7faf2a9e2640 1 -- 172.21.15.99:0/262327073 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf2410dd10 con 0x7faf24102550 2024-09-19T06:50:22.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.867+0000 7faf2a9e2640 1 -- 172.21.15.99:0/262327073 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf240fdcd0 con 0x7faf24102550 2024-09-19T06:50:22.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.867+0000 7faf20ff9640 1 -- 172.21.15.99:0/262327073 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7faf1400dc80 con 0x7faf24102550 2024-09-19T06:50:22.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.868+0000 7faf20ff9640 1 --2- 172.21.15.99:0/262327073 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7faf0c06e530 0x7faf0c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:22.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.868+0000 7faf20ff9640 1 -- 172.21.15.99:0/262327073 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7faf1408d970 con 0x7faf24102550 2024-09-19T06:50:22.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.868+0000 7faf237fe640 1 --2- 172.21.15.99:0/262327073 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7faf0c06e530 0x7faf0c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:22.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.868+0000 7faf237fe640 1 --2- 172.21.15.99:0/262327073 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7faf0c06e530 0x7faf0c0709e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7faf180048a0 tx=0x7faf18035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:22.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:22.872+0000 7faf20ff9640 1 -- 172.21.15.99:0/262327073 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7faf14056b10 con 0x7faf24102550 2024-09-19T06:50:23.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.105+0000 7faf2a9e2640 1 -- 172.21.15.99:0/262327073 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7faf2404b720 con 0x7faf24102550 2024-09-19T06:50:23.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.105+0000 7faf20ff9640 1 -- 172.21.15.99:0/262327073 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7faf1405a1d0 con 0x7faf24102550 2024-09-19T06:50:23.107 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:50:23.107 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-09-19T06:50:23.107 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T06:50:23.107 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:50:23.107 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-09-19T06:50:23.107 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T06:50:23.107 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:50:23.107 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-09-19T06:50:23.108 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 6 2024-09-19T06:50:23.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:50:23.108 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": { 2024-09-19T06:50:23.108 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 4 2024-09-19T06:50:23.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:50:23.108 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-09-19T06:50:23.108 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 14 2024-09-19T06:50:23.108 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T06:50:23.108 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:50:23.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.108+0000 7faf2a9e2640 1 -- 172.21.15.99:0/262327073 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7faf0c06e530 msgr2=0x7faf0c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:23.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.108+0000 7faf2a9e2640 1 --2- 172.21.15.99:0/262327073 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7faf0c06e530 0x7faf0c0709e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7faf180048a0 tx=0x7faf18035040 comp rx=0 tx=0).stop 2024-09-19T06:50:23.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.108+0000 7faf2a9e2640 1 -- 172.21.15.99:0/262327073 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf24102550 msgr2=0x7faf24113520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:23.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.108+0000 7faf2a9e2640 1 --2- 172.21.15.99:0/262327073 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf24102550 0x7faf24113520 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7faf14002a50 tx=0x7faf14004600 comp rx=0 tx=0).stop 2024-09-19T06:50:23.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.108+0000 7faf2a9e2640 1 -- 172.21.15.99:0/262327073 shutdown_connections 2024-09-19T06:50:23.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.108+0000 7faf2a9e2640 1 --2- 172.21.15.99:0/262327073 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7faf0c06e530 0x7faf0c0709e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:23.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.108+0000 7faf2a9e2640 1 --2- 172.21.15.99:0/262327073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf24102ef0 0x7faf24113a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:23.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.108+0000 7faf2a9e2640 1 --2- 172.21.15.99:0/262327073 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faf24102550 0x7faf24113520 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:23.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.108+0000 7faf2a9e2640 1 -- 172.21.15.99:0/262327073 >> 172.21.15.99:0/262327073 conn(0x7faf240f80f0 msgr2=0x7faf240f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:23.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.108+0000 7faf2a9e2640 1 -- 172.21.15.99:0/262327073 shutdown_connections 2024-09-19T06:50:23.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.108+0000 7faf2a9e2640 1 -- 172.21.15.99:0/262327073 wait complete. 2024-09-19T06:50:23.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.187+0000 7fd7d24dd640 1 -- 172.21.15.99:0/3854828320 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd7cc0fac80 msgr2=0x7fd7cc0fb0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:23.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.187+0000 7fd7d24dd640 1 --2- 172.21.15.99:0/3854828320 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd7cc0fac80 0x7fd7cc0fb0d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd7c00048d0 tx=0x7fd7c0009da0 comp rx=0 tx=0).stop 2024-09-19T06:50:23.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.187+0000 7fd7d24dd640 1 -- 172.21.15.99:0/3854828320 shutdown_connections 2024-09-19T06:50:23.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.187+0000 7fd7d24dd640 1 --2- 172.21.15.99:0/3854828320 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd7cc0fac80 0x7fd7cc0fb0d0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:23.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.187+0000 7fd7d24dd640 1 --2- 172.21.15.99:0/3854828320 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7cc102660 0x7fd7cc102a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:23.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.187+0000 7fd7d24dd640 1 -- 172.21.15.99:0/3854828320 >> 172.21.15.99:0/3854828320 conn(0x7fd7cc070ce0 msgr2=0x7fd7cc0710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:23.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.187+0000 7fd7d24dd640 1 -- 172.21.15.99:0/3854828320 shutdown_connections 2024-09-19T06:50:23.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.187+0000 7fd7d24dd640 1 -- 172.21.15.99:0/3854828320 wait complete. 2024-09-19T06:50:23.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.188+0000 7fd7d24dd640 1 Processor -- start 2024-09-19T06:50:23.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.188+0000 7fd7d24dd640 1 -- start start 2024-09-19T06:50:23.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.188+0000 7fd7d24dd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd7cc0fac80 0x7fd7cc0fbe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:23.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.188+0000 7fd7d24dd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7cc102660 0x7fd7cc0fc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:23.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.188+0000 7fd7d24dd640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7cc0fc930 con 0x7fd7cc0fac80 2024-09-19T06:50:23.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.188+0000 7fd7d24dd640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7cc0fcaa0 con 0x7fd7cc102660 2024-09-19T06:50:23.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.188+0000 7fd7cbfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd7cc0fac80 0x7fd7cc0fbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:23.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.188+0000 7fd7cbfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd7cc0fac80 0x7fd7cc0fbe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40666/0 (socket says 172.21.15.99:40666) 2024-09-19T06:50:23.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.188+0000 7fd7cbfff640 1 -- 172.21.15.99:0/1016452731 learned_addr learned my addr 172.21.15.99:0/1016452731 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:50:23.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.189+0000 7fd7cbfff640 1 -- 172.21.15.99:0/1016452731 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7cc102660 msgr2=0x7fd7cc0fc3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:23.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.189+0000 7fd7cb7fe640 1 --2- 172.21.15.99:0/1016452731 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7cc102660 0x7fd7cc0fc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:23.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.189+0000 7fd7cbfff640 1 --2- 172.21.15.99:0/1016452731 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7cc102660 0x7fd7cc0fc3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:23.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.189+0000 7fd7cbfff640 1 -- 172.21.15.99:0/1016452731 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7c0005040 con 0x7fd7cc0fac80 2024-09-19T06:50:23.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.189+0000 7fd7cbfff640 1 --2- 172.21.15.99:0/1016452731 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd7cc0fac80 0x7fd7cc0fbe60 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc00c790 tx=0x7fd7bc0043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:23.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.189+0000 7fd7c8ff9640 1 -- 172.21.15.99:0/1016452731 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7bc00a820 con 0x7fd7cc0fac80 2024-09-19T06:50:23.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.189+0000 7fd7d24dd640 1 -- 172.21.15.99:0/1016452731 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7cc119510 con 0x7fd7cc0fac80 2024-09-19T06:50:23.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.189+0000 7fd7c8ff9640 1 -- 172.21.15.99:0/1016452731 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd7bc00ae20 con 0x7fd7cc0fac80 2024-09-19T06:50:23.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.189+0000 7fd7c8ff9640 1 -- 172.21.15.99:0/1016452731 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7bc0113a0 con 0x7fd7cc0fac80 2024-09-19T06:50:23.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.189+0000 7fd7d24dd640 1 -- 172.21.15.99:0/1016452731 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7cc119950 con 0x7fd7cc0fac80 2024-09-19T06:50:23.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.190+0000 7fd7b27fc640 1 -- 172.21.15.99:0/1016452731 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7ac005210 con 0x7fd7cc0fac80 2024-09-19T06:50:23.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.191+0000 7fd7c8ff9640 1 -- 172.21.15.99:0/1016452731 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fd7bc00a980 con 0x7fd7cc0fac80 2024-09-19T06:50:23.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.191+0000 7fd7c8ff9640 1 --2- 172.21.15.99:0/1016452731 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd7b406e530 0x7fd7b40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:23.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.191+0000 7fd7c8ff9640 1 -- 172.21.15.99:0/1016452731 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fd7bc08e310 con 0x7fd7cc0fac80 2024-09-19T06:50:23.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.191+0000 7fd7cb7fe640 1 --2- 172.21.15.99:0/1016452731 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd7b406e530 0x7fd7b40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:23.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.191+0000 7fd7cb7fe640 1 --2- 172.21.15.99:0/1016452731 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd7b406e530 0x7fd7b40709e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd7c0004540 tx=0x7fd7c0009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:23.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.195+0000 7fd7c8ff9640 1 -- 172.21.15.99:0/1016452731 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fd7bc057480 con 0x7fd7cc0fac80 2024-09-19T06:50:23.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.398+0000 7fd7b27fc640 1 -- 172.21.15.99:0/1016452731 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd7ac005cd0 con 0x7fd7cc0fac80 2024-09-19T06:50:23.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.398+0000 7fd7c8ff9640 1 -- 172.21.15.99:0/1016452731 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 29 v29) v1 ==== 76+0+1915 (secure 0 0 0) 0x7fd7bc05ab40 con 0x7fd7cc0fac80 2024-09-19T06:50:23.401 INFO:teuthology.orchestra.run.smithi099.stdout:e29 2024-09-19T06:50:23.401 INFO:teuthology.orchestra.run.smithi099.stdout:btime 2024-09-19T06:48:47:938420+0000 2024-09-19T06:50:23.401 INFO:teuthology.orchestra.run.smithi099.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T06:50:23.401 INFO:teuthology.orchestra.run.smithi099.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T06:50:23.401 INFO:teuthology.orchestra.run.smithi099.stdout:legacy client fscid: 1 2024-09-19T06:50:23.401 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:50:23.401 INFO:teuthology.orchestra.run.smithi099.stdout:Filesystem 'cephfs' (1) 2024-09-19T06:50:23.401 INFO:teuthology.orchestra.run.smithi099.stdout:fs_name cephfs 2024-09-19T06:50:23.401 INFO:teuthology.orchestra.run.smithi099.stdout:epoch 20 2024-09-19T06:50:23.401 INFO:teuthology.orchestra.run.smithi099.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-19T06:50:23.401 INFO:teuthology.orchestra.run.smithi099.stdout:created 2024-09-19T06:37:40.838146+0000 2024-09-19T06:50:23.402 INFO:teuthology.orchestra.run.smithi099.stdout:modified 2024-09-19T06:47:50.076553+0000 2024-09-19T06:50:23.402 INFO:teuthology.orchestra.run.smithi099.stdout:tableserver 0 2024-09-19T06:50:23.402 INFO:teuthology.orchestra.run.smithi099.stdout:root 0 2024-09-19T06:50:23.402 INFO:teuthology.orchestra.run.smithi099.stdout:session_timeout 60 2024-09-19T06:50:23.402 INFO:teuthology.orchestra.run.smithi099.stdout:session_autoclose 300 2024-09-19T06:50:23.402 INFO:teuthology.orchestra.run.smithi099.stdout:max_file_size 1099511627776 2024-09-19T06:50:23.402 INFO:teuthology.orchestra.run.smithi099.stdout:max_xattr_size 65536 2024-09-19T06:50:23.402 INFO:teuthology.orchestra.run.smithi099.stdout:required_client_features {} 2024-09-19T06:50:23.402 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure 0 2024-09-19T06:50:23.402 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure_osd_epoch 77 2024-09-19T06:50:23.402 INFO:teuthology.orchestra.run.smithi099.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T06:50:23.402 INFO:teuthology.orchestra.run.smithi099.stdout:max_mds 2 2024-09-19T06:50:23.402 INFO:teuthology.orchestra.run.smithi099.stdout:in 0,1 2024-09-19T06:50:23.403 INFO:teuthology.orchestra.run.smithi099.stdout:up {} 2024-09-19T06:50:23.403 INFO:teuthology.orchestra.run.smithi099.stdout:failed 0,1 2024-09-19T06:50:23.403 INFO:teuthology.orchestra.run.smithi099.stdout:damaged 2024-09-19T06:50:23.403 INFO:teuthology.orchestra.run.smithi099.stdout:stopped 2024-09-19T06:50:23.403 INFO:teuthology.orchestra.run.smithi099.stdout:data_pools [3] 2024-09-19T06:50:23.403 INFO:teuthology.orchestra.run.smithi099.stdout:metadata_pool 2 2024-09-19T06:50:23.403 INFO:teuthology.orchestra.run.smithi099.stdout:inline_data disabled 2024-09-19T06:50:23.403 INFO:teuthology.orchestra.run.smithi099.stdout:balancer 2024-09-19T06:50:23.403 INFO:teuthology.orchestra.run.smithi099.stdout:bal_rank_mask -1 2024-09-19T06:50:23.403 INFO:teuthology.orchestra.run.smithi099.stdout:standby_count_wanted 1 2024-09-19T06:50:23.403 INFO:teuthology.orchestra.run.smithi099.stdout:qdb_cluster leader: 0 members: 2024-09-19T06:50:23.404 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:50:23.404 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:50:23.404 INFO:teuthology.orchestra.run.smithi099.stdout:Standby daemons: 2024-09-19T06:50:23.404 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:50:23.404 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.obarqf{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6826/1859154203,v1:172.21.15.99:6827/1859154203] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:50:23.404 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.xehbxe{-1:34410} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6828/1939453719,v1:172.21.15.99:6829/1939453719] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:50:23.404 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.nooexo{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6824/1398895079,v1:172.21.15.117:6825/1398895079] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:50:23.404 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.bheqzh{-1:44329} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6826/3233337308,v1:172.21.15.117:6827/3233337308] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:50:23.405 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 29 2024-09-19T06:50:23.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.400+0000 7fd7b27fc640 1 -- 172.21.15.99:0/1016452731 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd7b406e530 msgr2=0x7fd7b40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:23.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.400+0000 7fd7b27fc640 1 --2- 172.21.15.99:0/1016452731 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd7b406e530 0x7fd7b40709e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd7c0004540 tx=0x7fd7c0009da0 comp rx=0 tx=0).stop 2024-09-19T06:50:23.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.400+0000 7fd7b27fc640 1 -- 172.21.15.99:0/1016452731 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd7cc0fac80 msgr2=0x7fd7cc0fbe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:23.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.400+0000 7fd7b27fc640 1 --2- 172.21.15.99:0/1016452731 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd7cc0fac80 0x7fd7cc0fbe60 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc00c790 tx=0x7fd7bc0043c0 comp rx=0 tx=0).stop 2024-09-19T06:50:23.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.400+0000 7fd7b27fc640 1 -- 172.21.15.99:0/1016452731 shutdown_connections 2024-09-19T06:50:23.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.400+0000 7fd7b27fc640 1 --2- 172.21.15.99:0/1016452731 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd7b406e530 0x7fd7b40709e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:23.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.400+0000 7fd7b27fc640 1 --2- 172.21.15.99:0/1016452731 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7cc102660 0x7fd7cc0fc3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:23.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.400+0000 7fd7b27fc640 1 --2- 172.21.15.99:0/1016452731 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd7cc0fac80 0x7fd7cc0fbe60 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:23.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.400+0000 7fd7b27fc640 1 -- 172.21.15.99:0/1016452731 >> 172.21.15.99:0/1016452731 conn(0x7fd7cc070ce0 msgr2=0x7fd7cc0fa0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:23.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.401+0000 7fd7b27fc640 1 -- 172.21.15.99:0/1016452731 shutdown_connections 2024-09-19T06:50:23.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.401+0000 7fd7b27fc640 1 -- 172.21.15.99:0/1016452731 wait complete. 2024-09-19T06:50:23.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.479+0000 7fe8bfb4b640 1 -- 172.21.15.99:0/2644951054 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe8b8102620 msgr2=0x7fe8b81029f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:23.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.479+0000 7fe8bfb4b640 1 --2- 172.21.15.99:0/2644951054 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe8b8102620 0x7fe8b81029f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe8b40048d0 tx=0x7fe8b4009da0 comp rx=0 tx=0).stop 2024-09-19T06:50:23.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.479+0000 7fe8bfb4b640 1 -- 172.21.15.99:0/2644951054 shutdown_connections 2024-09-19T06:50:23.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.479+0000 7fe8bfb4b640 1 --2- 172.21.15.99:0/2644951054 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8b80fac80 0x7fe8b80fb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:23.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.479+0000 7fe8bfb4b640 1 --2- 172.21.15.99:0/2644951054 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe8b8102620 0x7fe8b81029f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:23.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.479+0000 7fe8bfb4b640 1 -- 172.21.15.99:0/2644951054 >> 172.21.15.99:0/2644951054 conn(0x7fe8b8070ce0 msgr2=0x7fe8b80710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:23.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.479+0000 7fe8bfb4b640 1 -- 172.21.15.99:0/2644951054 shutdown_connections 2024-09-19T06:50:23.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.479+0000 7fe8bfb4b640 1 -- 172.21.15.99:0/2644951054 wait complete. 2024-09-19T06:50:23.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.480+0000 7fe8bfb4b640 1 Processor -- start 2024-09-19T06:50:23.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.480+0000 7fe8bfb4b640 1 -- start start 2024-09-19T06:50:23.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.480+0000 7fe8bfb4b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8b80fac80 0x7fe8b80fbe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:23.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.480+0000 7fe8bfb4b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe8b8102620 0x7fe8b80fc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:23.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.480+0000 7fe8bfb4b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b80fc8e0 con 0x7fe8b8102620 2024-09-19T06:50:23.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.480+0000 7fe8bfb4b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b80fca50 con 0x7fe8b80fac80 2024-09-19T06:50:23.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.480+0000 7fe8bd0e6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe8b8102620 0x7fe8b80fc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:23.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.480+0000 7fe8bd0e6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe8b8102620 0x7fe8b80fc3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40680/0 (socket says 172.21.15.99:40680) 2024-09-19T06:50:23.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.480+0000 7fe8bd0e6640 1 -- 172.21.15.99:0/1700183219 learned_addr learned my addr 172.21.15.99:0/1700183219 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:50:23.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.480+0000 7fe8bd8e7640 1 --2- 172.21.15.99:0/1700183219 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8b80fac80 0x7fe8b80fbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:23.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.480+0000 7fe8bd0e6640 1 -- 172.21.15.99:0/1700183219 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8b80fac80 msgr2=0x7fe8b80fbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:23.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.480+0000 7fe8bd0e6640 1 --2- 172.21.15.99:0/1700183219 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8b80fac80 0x7fe8b80fbe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:23.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.480+0000 7fe8bd0e6640 1 -- 172.21.15.99:0/1700183219 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b4005040 con 0x7fe8b8102620 2024-09-19T06:50:23.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.481+0000 7fe8bd0e6640 1 --2- 172.21.15.99:0/1700183219 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe8b8102620 0x7fe8b80fc3a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac002a50 tx=0x7fe8ac004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:23.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.481+0000 7fe8aa7fc640 1 -- 172.21.15.99:0/1700183219 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8ac007c30 con 0x7fe8b8102620 2024-09-19T06:50:23.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.481+0000 7fe8aa7fc640 1 -- 172.21.15.99:0/1700183219 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe8ac00f040 con 0x7fe8b8102620 2024-09-19T06:50:23.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.481+0000 7fe8bfb4b640 1 -- 172.21.15.99:0/1700183219 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8b80fcce0 con 0x7fe8b8102620 2024-09-19T06:50:23.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.481+0000 7fe8aa7fc640 1 -- 172.21.15.99:0/1700183219 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8ac00da10 con 0x7fe8b8102620 2024-09-19T06:50:23.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.481+0000 7fe8bfb4b640 1 -- 172.21.15.99:0/1700183219 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8b8119920 con 0x7fe8b8102620 2024-09-19T06:50:23.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.482+0000 7fe8bfb4b640 1 -- 172.21.15.99:0/1700183219 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8b80657b0 con 0x7fe8b8102620 2024-09-19T06:50:23.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.482+0000 7fe8aa7fc640 1 -- 172.21.15.99:0/1700183219 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fe8ac00dbb0 con 0x7fe8b8102620 2024-09-19T06:50:23.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.483+0000 7fe8aa7fc640 1 --2- 172.21.15.99:0/1700183219 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe8a406e530 0x7fe8a40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:23.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.483+0000 7fe8aa7fc640 1 -- 172.21.15.99:0/1700183219 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fe8ac08d8c0 con 0x7fe8b8102620 2024-09-19T06:50:23.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.483+0000 7fe8bd8e7640 1 --2- 172.21.15.99:0/1700183219 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe8a406e530 0x7fe8a40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:23.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.483+0000 7fe8bd8e7640 1 --2- 172.21.15.99:0/1700183219 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe8a406e530 0x7fe8a40709e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe8b4009ac0 tx=0x7fe8b4035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:23.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.487+0000 7fe8aa7fc640 1 -- 172.21.15.99:0/1700183219 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fe8ac056ae0 con 0x7fe8b8102620 2024-09-19T06:50:23.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.669+0000 7fe8bfb4b640 1 -- 172.21.15.99:0/1700183219 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe8b804b720 con 0x7fe8a406e530 2024-09-19T06:50:23.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.671+0000 7fe8aa7fc640 1 -- 172.21.15.99:0/1700183219 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fe8b804b720 con 0x7fe8a406e530 2024-09-19T06:50:23.672 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:50:23.672 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T06:50:23.672 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": true, 2024-09-19T06:50:23.673 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T06:50:23.673 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [ 2024-09-19T06:50:23.673 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr", 2024-09-19T06:50:23.673 INFO:teuthology.orchestra.run.smithi099.stdout: "crash", 2024-09-19T06:50:23.673 INFO:teuthology.orchestra.run.smithi099.stdout: "mds", 2024-09-19T06:50:23.673 INFO:teuthology.orchestra.run.smithi099.stdout: "mon", 2024-09-19T06:50:23.673 INFO:teuthology.orchestra.run.smithi099.stdout: "osd" 2024-09-19T06:50:23.673 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-19T06:50:23.673 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": "16/21 daemons upgraded", 2024-09-19T06:50:23.673 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "Currently upgrading mds daemons", 2024-09-19T06:50:23.673 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-09-19T06:50:23.673 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:50:23.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.673+0000 7fe8bfb4b640 1 -- 172.21.15.99:0/1700183219 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe8a406e530 msgr2=0x7fe8a40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:23.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.673+0000 7fe8bfb4b640 1 --2- 172.21.15.99:0/1700183219 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe8a406e530 0x7fe8a40709e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe8b4009ac0 tx=0x7fe8b4035040 comp rx=0 tx=0).stop 2024-09-19T06:50:23.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.673+0000 7fe8bfb4b640 1 -- 172.21.15.99:0/1700183219 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe8b8102620 msgr2=0x7fe8b80fc3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:23.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.673+0000 7fe8bfb4b640 1 --2- 172.21.15.99:0/1700183219 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe8b8102620 0x7fe8b80fc3a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac002a50 tx=0x7fe8ac004600 comp rx=0 tx=0).stop 2024-09-19T06:50:23.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.673+0000 7fe8bfb4b640 1 -- 172.21.15.99:0/1700183219 shutdown_connections 2024-09-19T06:50:23.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.673+0000 7fe8bfb4b640 1 --2- 172.21.15.99:0/1700183219 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe8a406e530 0x7fe8a40709e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:23.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.673+0000 7fe8bfb4b640 1 --2- 172.21.15.99:0/1700183219 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe8b8102620 0x7fe8b80fc3a0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:23.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.673+0000 7fe8bfb4b640 1 --2- 172.21.15.99:0/1700183219 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe8b80fac80 0x7fe8b80fbe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:23.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.673+0000 7fe8bfb4b640 1 -- 172.21.15.99:0/1700183219 >> 172.21.15.99:0/1700183219 conn(0x7fe8b8070ce0 msgr2=0x7fe8b8105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:23.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.673+0000 7fe8bfb4b640 1 -- 172.21.15.99:0/1700183219 shutdown_connections 2024-09-19T06:50:23.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.673+0000 7fe8bfb4b640 1 -- 172.21.15.99:0/1700183219 wait complete. 2024-09-19T06:50:23.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.752+0000 7f7e684fd640 1 -- 172.21.15.99:0/3654041948 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e600fb4a0 msgr2=0x7f7e600fb910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:23.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.752+0000 7f7e684fd640 1 --2- 172.21.15.99:0/3654041948 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e600fb4a0 0x7f7e600fb910 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7e500048d0 tx=0x7f7e50009da0 comp rx=0 tx=0).stop 2024-09-19T06:50:23.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.752+0000 7f7e684fd640 1 -- 172.21.15.99:0/3654041948 shutdown_connections 2024-09-19T06:50:23.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.752+0000 7f7e684fd640 1 --2- 172.21.15.99:0/3654041948 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e600fb4a0 0x7f7e600fb910 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:23.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.752+0000 7f7e684fd640 1 --2- 172.21.15.99:0/3654041948 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e601014e0 0x7f7e601018b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:23.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.752+0000 7f7e684fd640 1 -- 172.21.15.99:0/3654041948 >> 172.21.15.99:0/3654041948 conn(0x7f7e600f7020 msgr2=0x7f7e600f9430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:23.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.753+0000 7f7e684fd640 1 -- 172.21.15.99:0/3654041948 shutdown_connections 2024-09-19T06:50:23.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.753+0000 7f7e684fd640 1 -- 172.21.15.99:0/3654041948 wait complete. 2024-09-19T06:50:23.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.753+0000 7f7e684fd640 1 Processor -- start 2024-09-19T06:50:23.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.753+0000 7f7e684fd640 1 -- start start 2024-09-19T06:50:23.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.753+0000 7f7e684fd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e600fb4a0 0x7f7e601131b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:23.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.753+0000 7f7e684fd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e601014e0 0x7f7e601136f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:23.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.753+0000 7f7e684fd640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e60113cf0 con 0x7f7e601014e0 2024-09-19T06:50:23.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.753+0000 7f7e684fd640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6010d130 con 0x7f7e600fb4a0 2024-09-19T06:50:23.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.753+0000 7f7e65a98640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e601014e0 0x7f7e601136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:23.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.753+0000 7f7e65a98640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e601014e0 0x7f7e601136f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40704/0 (socket says 172.21.15.99:40704) 2024-09-19T06:50:23.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.753+0000 7f7e65a98640 1 -- 172.21.15.99:0/3028565182 learned_addr learned my addr 172.21.15.99:0/3028565182 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:50:23.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.753+0000 7f7e66299640 1 --2- 172.21.15.99:0/3028565182 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e600fb4a0 0x7f7e601131b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:23.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.754+0000 7f7e65a98640 1 -- 172.21.15.99:0/3028565182 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e600fb4a0 msgr2=0x7f7e601131b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:23.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.754+0000 7f7e65a98640 1 --2- 172.21.15.99:0/3028565182 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e600fb4a0 0x7f7e601131b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:23.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.754+0000 7f7e65a98640 1 -- 172.21.15.99:0/3028565182 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e50005040 con 0x7f7e601014e0 2024-09-19T06:50:23.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.754+0000 7f7e65a98640 1 --2- 172.21.15.99:0/3028565182 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e601014e0 0x7f7e601136f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7e50000c00 tx=0x7f7e50009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:23.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.754+0000 7f7e56ffd640 1 -- 172.21.15.99:0/3028565182 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e50038070 con 0x7f7e601014e0 2024-09-19T06:50:23.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.754+0000 7f7e56ffd640 1 -- 172.21.15.99:0/3028565182 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7e5002ade0 con 0x7f7e601014e0 2024-09-19T06:50:23.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.754+0000 7f7e684fd640 1 -- 172.21.15.99:0/3028565182 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e6010d3b0 con 0x7f7e601014e0 2024-09-19T06:50:23.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.754+0000 7f7e56ffd640 1 -- 172.21.15.99:0/3028565182 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e5002c7e0 con 0x7f7e601014e0 2024-09-19T06:50:23.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.754+0000 7f7e684fd640 1 -- 172.21.15.99:0/3028565182 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e6010d8f0 con 0x7f7e601014e0 2024-09-19T06:50:23.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.755+0000 7f7e684fd640 1 -- 172.21.15.99:0/3028565182 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e600fcbe0 con 0x7f7e601014e0 2024-09-19T06:50:23.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.756+0000 7f7e56ffd640 1 -- 172.21.15.99:0/3028565182 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f7e50030020 con 0x7f7e601014e0 2024-09-19T06:50:23.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.756+0000 7f7e56ffd640 1 --2- 172.21.15.99:0/3028565182 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f7e4c06e530 0x7f7e4c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:23.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.756+0000 7f7e56ffd640 1 -- 172.21.15.99:0/3028565182 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f7e500add50 con 0x7f7e601014e0 2024-09-19T06:50:23.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.756+0000 7f7e66299640 1 --2- 172.21.15.99:0/3028565182 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f7e4c06e530 0x7f7e4c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:23.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.757+0000 7f7e66299640 1 --2- 172.21.15.99:0/3028565182 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f7e4c06e530 0x7f7e4c0709e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c004ed0 tx=0x7f7e5c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:23.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.761+0000 7f7e56ffd640 1 -- 172.21.15.99:0/3028565182 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f7e50076f70 con 0x7f7e601014e0 2024-09-19T06:50:23.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.994+0000 7f7e684fd640 1 -- 172.21.15.99:0/3028565182 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f7e60109610 con 0x7f7e601014e0 2024-09-19T06:50:23.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.994+0000 7f7e56ffd640 1 -- 172.21.15.99:0/3028565182 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7f7e5007a630 con 0x7f7e601014e0 2024-09-19T06:50:23.995 INFO:teuthology.orchestra.run.smithi099.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-09-19T06:50:23.996 INFO:teuthology.orchestra.run.smithi099.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-19T06:50:23.996 INFO:teuthology.orchestra.run.smithi099.stdout: fs cephfs is degraded 2024-09-19T06:50:23.996 INFO:teuthology.orchestra.run.smithi099.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-19T06:50:23.996 INFO:teuthology.orchestra.run.smithi099.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-19T06:50:23.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.996+0000 7f7e684fd640 1 -- 172.21.15.99:0/3028565182 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f7e4c06e530 msgr2=0x7f7e4c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:23.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.996+0000 7f7e684fd640 1 --2- 172.21.15.99:0/3028565182 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f7e4c06e530 0x7f7e4c0709e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c004ed0 tx=0x7f7e5c00b040 comp rx=0 tx=0).stop 2024-09-19T06:50:23.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.996+0000 7f7e684fd640 1 -- 172.21.15.99:0/3028565182 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e601014e0 msgr2=0x7f7e601136f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:23.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.996+0000 7f7e684fd640 1 --2- 172.21.15.99:0/3028565182 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e601014e0 0x7f7e601136f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7e50000c00 tx=0x7f7e50009da0 comp rx=0 tx=0).stop 2024-09-19T06:50:23.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.996+0000 7f7e684fd640 1 -- 172.21.15.99:0/3028565182 shutdown_connections 2024-09-19T06:50:23.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.996+0000 7f7e684fd640 1 --2- 172.21.15.99:0/3028565182 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f7e4c06e530 0x7f7e4c0709e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:23.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.996+0000 7f7e684fd640 1 --2- 172.21.15.99:0/3028565182 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e601014e0 0x7f7e601136f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:23.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.996+0000 7f7e684fd640 1 --2- 172.21.15.99:0/3028565182 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7e600fb4a0 0x7f7e601131b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:23.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.996+0000 7f7e684fd640 1 -- 172.21.15.99:0/3028565182 >> 172.21.15.99:0/3028565182 conn(0x7f7e600f7020 msgr2=0x7f7e600f8920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:23.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.996+0000 7f7e684fd640 1 -- 172.21.15.99:0/3028565182 shutdown_connections 2024-09-19T06:50:23.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:23.996+0000 7f7e684fd640 1 -- 172.21.15.99:0/3028565182 wait complete. 2024-09-19T06:50:24.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:50:23 smithi117 ceph-mon[76771]: from='client.34502 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:50:24.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:50:23 smithi117 ceph-mon[76771]: from='client.34506 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:50:24.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:50:23 smithi117 ceph-mon[76771]: from='client.34510 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:50:24.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:50:23 smithi117 ceph-mon[76771]: pgmap v241: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:50:24.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:50:23 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/262327073' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:50:24.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:50:23 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/1016452731' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:50:24.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:50:23 smithi099 ceph-mon[97031]: from='client.34502 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:50:24.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:50:23 smithi099 ceph-mon[97031]: from='client.34506 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:50:24.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:50:23 smithi099 ceph-mon[97031]: from='client.34510 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:50:24.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:50:23 smithi099 ceph-mon[97031]: pgmap v241: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:50:24.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:50:23 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/262327073' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:50:24.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:50:23 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/1016452731' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:50:25.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:50:24 smithi117 ceph-mon[76771]: from='client.34522 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:50:25.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:50:24 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/3028565182' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T06:50:25.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:50:24 smithi099 ceph-mon[97031]: from='client.34522 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:50:25.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:50:24 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/3028565182' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T06:50:26.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:50:25 smithi117 ceph-mon[76771]: pgmap v242: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:50:26.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:50:25 smithi099 ceph-mon[97031]: pgmap v242: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:50:28.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:50:27 smithi117 ceph-mon[76771]: pgmap v243: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:50:28.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:50:27 smithi099 ceph-mon[97031]: pgmap v243: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:50:30.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:50:29 smithi117 ceph-mon[76771]: pgmap v244: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:50:30.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:50:29 smithi099 ceph-mon[97031]: pgmap v244: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:50:32.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:50:31 smithi117 ceph-mon[76771]: pgmap v245: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:50:32.314 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:50:31 smithi099 ceph-mon[97031]: pgmap v245: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:50:34.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:50:33 smithi117 ceph-mon[76771]: pgmap v246: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:50:34.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:50:33 smithi099 ceph-mon[97031]: pgmap v246: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:50:36.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:50:35 smithi117 ceph-mon[76771]: pgmap v247: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:50:36.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:50:35 smithi099 ceph-mon[97031]: pgmap v247: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:50:37.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:50:37 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:50:37.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:50:37 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:50:38.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:50:38 smithi117 ceph-mon[76771]: pgmap v248: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:50:38.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:50:38 smithi099 ceph-mon[97031]: pgmap v248: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:50:40.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:50:40 smithi117 ceph-mon[76771]: pgmap v249: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:50:40.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:50:40 smithi099 ceph-mon[97031]: pgmap v249: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:50:42.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:50:42 smithi117 ceph-mon[76771]: pgmap v250: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:50:42.314 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:50:42 smithi099 ceph-mon[97031]: pgmap v250: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:50:44.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:50:44 smithi117 ceph-mon[76771]: pgmap v251: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:50:44.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:50:44 smithi099 ceph-mon[97031]: pgmap v251: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:50:46.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:50:46 smithi117 ceph-mon[76771]: pgmap v252: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:50:46.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:50:46 smithi099 ceph-mon[97031]: pgmap v252: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:50:48.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:50:48 smithi117 ceph-mon[76771]: pgmap v253: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:50:48.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:50:48 smithi099 ceph-mon[97031]: pgmap v253: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:50:50.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:50:50 smithi117 ceph-mon[76771]: pgmap v254: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:50:50.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:50:50 smithi099 ceph-mon[97031]: pgmap v254: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:50:52.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:50:52 smithi117 ceph-mon[76771]: pgmap v255: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:50:52.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:50:52 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:50:52.314 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:50:52 smithi099 ceph-mon[97031]: pgmap v255: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:50:52.314 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:50:52 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:50:54.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.087+0000 7f5c0b080640 1 -- 172.21.15.99:0/2690990899 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5c041014c0 msgr2=0x7f5c04101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:54.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.087+0000 7f5c0b080640 1 --2- 172.21.15.99:0/2690990899 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5c041014c0 0x7f5c04101890 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5bec0048d0 tx=0x7f5bec009da0 comp rx=0 tx=0).stop 2024-09-19T06:50:54.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.087+0000 7f5c0b080640 1 -- 172.21.15.99:0/2690990899 shutdown_connections 2024-09-19T06:50:54.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.087+0000 7f5c0b080640 1 --2- 172.21.15.99:0/2690990899 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5c040fb480 0x7f5c040fb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:54.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.087+0000 7f5c0b080640 1 --2- 172.21.15.99:0/2690990899 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5c041014c0 0x7f5c04101890 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:54.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.087+0000 7f5c0b080640 1 -- 172.21.15.99:0/2690990899 >> 172.21.15.99:0/2690990899 conn(0x7f5c040f7000 msgr2=0x7f5c040f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:54.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.087+0000 7f5c0b080640 1 -- 172.21.15.99:0/2690990899 shutdown_connections 2024-09-19T06:50:54.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.087+0000 7f5c0b080640 1 -- 172.21.15.99:0/2690990899 wait complete. 2024-09-19T06:50:54.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.088+0000 7f5c0b080640 1 Processor -- start 2024-09-19T06:50:54.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.088+0000 7f5c0b080640 1 -- start start 2024-09-19T06:50:54.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.088+0000 7f5c0b080640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5c040fb480 0x7f5c041131c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:54.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.088+0000 7f5c0b080640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5c041014c0 0x7f5c04113700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:54.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.088+0000 7f5c0b080640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c04113d00 con 0x7f5c041014c0 2024-09-19T06:50:54.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.088+0000 7f5c0b080640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0410d140 con 0x7f5c040fb480 2024-09-19T06:50:54.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.089+0000 7f5c03fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5c041014c0 0x7f5c04113700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:54.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.089+0000 7f5c08e1c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5c040fb480 0x7f5c041131c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:54.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.089+0000 7f5c03fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5c041014c0 0x7f5c04113700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40918/0 (socket says 172.21.15.99:40918) 2024-09-19T06:50:54.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.089+0000 7f5c08e1c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5c040fb480 0x7f5c041131c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.99:52404/0 (socket says 172.21.15.99:52404) 2024-09-19T06:50:54.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.089+0000 7f5c03fff640 1 -- 172.21.15.99:0/3761503319 learned_addr learned my addr 172.21.15.99:0/3761503319 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:50:54.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.089+0000 7f5c08e1c640 1 -- 172.21.15.99:0/3761503319 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5c041014c0 msgr2=0x7f5c04113700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:54.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.089+0000 7f5c08e1c640 1 --2- 172.21.15.99:0/3761503319 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5c041014c0 0x7f5c04113700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:54.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.089+0000 7f5c08e1c640 1 -- 172.21.15.99:0/3761503319 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bec005040 con 0x7f5c040fb480 2024-09-19T06:50:54.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.089+0000 7f5c03fff640 1 --2- 172.21.15.99:0/3761503319 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5c041014c0 0x7f5c04113700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:50:54.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.089+0000 7f5c08e1c640 1 --2- 172.21.15.99:0/3761503319 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5c040fb480 0x7f5c041131c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5bec003080 tx=0x7f5bec009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:54.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.089+0000 7f5c017fa640 1 -- 172.21.15.99:0/3761503319 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5bec038070 con 0x7f5c040fb480 2024-09-19T06:50:54.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.089+0000 7f5c017fa640 1 -- 172.21.15.99:0/3761503319 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5bec009760 con 0x7f5c040fb480 2024-09-19T06:50:54.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.089+0000 7f5c017fa640 1 -- 172.21.15.99:0/3761503319 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5bec033420 con 0x7f5c040fb480 2024-09-19T06:50:54.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.090+0000 7f5c0b080640 1 -- 172.21.15.99:0/3761503319 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c0410d3c0 con 0x7f5c040fb480 2024-09-19T06:50:54.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.090+0000 7f5c0b080640 1 -- 172.21.15.99:0/3761503319 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c0410d8a0 con 0x7f5c040fb480 2024-09-19T06:50:54.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.091+0000 7f5c0b080640 1 -- 172.21.15.99:0/3761503319 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c040fcbc0 con 0x7f5c040fb480 2024-09-19T06:50:54.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.091+0000 7f5c017fa640 1 -- 172.21.15.99:0/3761503319 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f5bec030020 con 0x7f5c040fb480 2024-09-19T06:50:54.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.091+0000 7f5c017fa640 1 --2- 172.21.15.99:0/3761503319 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f5bf006e530 0x7f5bf00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:54.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.092+0000 7f5c017fa640 1 -- 172.21.15.99:0/3761503319 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f5bec0ade10 con 0x7f5c040fb480 2024-09-19T06:50:54.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.092+0000 7f5c03fff640 1 --2- 172.21.15.99:0/3761503319 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f5bf006e530 0x7f5bf00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:54.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.092+0000 7f5c03fff640 1 --2- 172.21.15.99:0/3761503319 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f5bf006e530 0x7f5bf00709e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5c0410ea80 tx=0x7f5bf4009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:54.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.097+0000 7f5c017fa640 1 -- 172.21.15.99:0/3761503319 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f5bec076e80 con 0x7f5c040fb480 2024-09-19T06:50:54.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.279+0000 7f5c0b080640 1 -- 172.21.15.99:0/3761503319 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5c0410e830 con 0x7f5bf006e530 2024-09-19T06:50:54.281 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:50:54 smithi099 ceph-mon[97031]: pgmap v256: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:50:54.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.281+0000 7f5c017fa640 1 -- 172.21.15.99:0/3761503319 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f5c0410e830 con 0x7f5bf006e530 2024-09-19T06:50:54.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.282+0000 7f5c0b080640 1 -- 172.21.15.99:0/3761503319 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f5bf006e530 msgr2=0x7f5bf00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:54.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.283+0000 7f5c0b080640 1 --2- 172.21.15.99:0/3761503319 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f5bf006e530 0x7f5bf00709e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5c0410ea80 tx=0x7f5bf4009040 comp rx=0 tx=0).stop 2024-09-19T06:50:54.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.283+0000 7f5c0b080640 1 -- 172.21.15.99:0/3761503319 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5c040fb480 msgr2=0x7f5c041131c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:54.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.283+0000 7f5c0b080640 1 --2- 172.21.15.99:0/3761503319 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5c040fb480 0x7f5c041131c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5bec003080 tx=0x7f5bec009da0 comp rx=0 tx=0).stop 2024-09-19T06:50:54.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.283+0000 7f5c0b080640 1 -- 172.21.15.99:0/3761503319 shutdown_connections 2024-09-19T06:50:54.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.283+0000 7f5c0b080640 1 --2- 172.21.15.99:0/3761503319 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f5bf006e530 0x7f5bf00709e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:54.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.283+0000 7f5c0b080640 1 --2- 172.21.15.99:0/3761503319 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5c041014c0 0x7f5c04113700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:54.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.283+0000 7f5c0b080640 1 --2- 172.21.15.99:0/3761503319 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5c040fb480 0x7f5c041131c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:54.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.283+0000 7f5c0b080640 1 -- 172.21.15.99:0/3761503319 >> 172.21.15.99:0/3761503319 conn(0x7f5c040f7000 msgr2=0x7f5c04065a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:54.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.283+0000 7f5c0b080640 1 -- 172.21.15.99:0/3761503319 shutdown_connections 2024-09-19T06:50:54.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.283+0000 7f5c0b080640 1 -- 172.21.15.99:0/3761503319 wait complete. 2024-09-19T06:50:54.292 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-09-19T06:50:54.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:50:54 smithi117 ceph-mon[76771]: pgmap v256: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:50:54.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.363+0000 7fe154156640 1 -- 172.21.15.99:0/4218353588 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe14c0fe450 msgr2=0x7fe14c0fe820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:54.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.363+0000 7fe154156640 1 --2- 172.21.15.99:0/4218353588 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe14c0fe450 0x7fe14c0fe820 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe13c009c50 tx=0x7fe13c004d10 comp rx=0 tx=0).stop 2024-09-19T06:50:54.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.363+0000 7fe154156640 1 -- 172.21.15.99:0/4218353588 shutdown_connections 2024-09-19T06:50:54.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.363+0000 7fe154156640 1 --2- 172.21.15.99:0/4218353588 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe14c064fe0 0x7fe14c065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:54.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.363+0000 7fe154156640 1 --2- 172.21.15.99:0/4218353588 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe14c0fe450 0x7fe14c0fe820 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:54.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.363+0000 7fe154156640 1 -- 172.21.15.99:0/4218353588 >> 172.21.15.99:0/4218353588 conn(0x7fe14c0723b0 msgr2=0x7fe14c0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:54.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.363+0000 7fe154156640 1 -- 172.21.15.99:0/4218353588 shutdown_connections 2024-09-19T06:50:54.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.363+0000 7fe154156640 1 -- 172.21.15.99:0/4218353588 wait complete. 2024-09-19T06:50:54.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.363+0000 7fe154156640 1 Processor -- start 2024-09-19T06:50:54.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.363+0000 7fe154156640 1 -- start start 2024-09-19T06:50:54.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.363+0000 7fe154156640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe14c064fe0 0x7fe14c113250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:54.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.364+0000 7fe154156640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe14c0fe450 0x7fe14c113790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:54.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.364+0000 7fe154156640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe14c113e20 con 0x7fe14c0fe450 2024-09-19T06:50:54.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.364+0000 7fe154156640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe14c10d1d0 con 0x7fe14c064fe0 2024-09-19T06:50:54.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.364+0000 7fe1516f1640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe14c0fe450 0x7fe14c113790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:54.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.364+0000 7fe1516f1640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe14c0fe450 0x7fe14c113790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40940/0 (socket says 172.21.15.99:40940) 2024-09-19T06:50:54.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.364+0000 7fe1516f1640 1 -- 172.21.15.99:0/524703205 learned_addr learned my addr 172.21.15.99:0/524703205 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:50:54.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.364+0000 7fe151ef2640 1 --2- 172.21.15.99:0/524703205 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe14c064fe0 0x7fe14c113250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:54.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.364+0000 7fe1516f1640 1 -- 172.21.15.99:0/524703205 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe14c064fe0 msgr2=0x7fe14c113250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:54.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.364+0000 7fe1516f1640 1 --2- 172.21.15.99:0/524703205 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe14c064fe0 0x7fe14c113250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:54.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.364+0000 7fe1516f1640 1 -- 172.21.15.99:0/524703205 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe13c0098b0 con 0x7fe14c0fe450 2024-09-19T06:50:54.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.364+0000 7fe151ef2640 1 --2- 172.21.15.99:0/524703205 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe14c064fe0 0x7fe14c113250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:50:54.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.364+0000 7fe1516f1640 1 --2- 172.21.15.99:0/524703205 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe14c0fe450 0x7fe14c113790 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe14000b790 tx=0x7fe1400091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:54.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.364+0000 7fe14a7fc640 1 -- 172.21.15.99:0/524703205 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe14000c700 con 0x7fe14c0fe450 2024-09-19T06:50:54.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.364+0000 7fe14a7fc640 1 -- 172.21.15.99:0/524703205 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe14000cd00 con 0x7fe14c0fe450 2024-09-19T06:50:54.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.364+0000 7fe154156640 1 -- 172.21.15.99:0/524703205 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe14c10d4b0 con 0x7fe14c0fe450 2024-09-19T06:50:54.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.365+0000 7fe14a7fc640 1 -- 172.21.15.99:0/524703205 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe140015e70 con 0x7fe14c0fe450 2024-09-19T06:50:54.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.365+0000 7fe154156640 1 -- 172.21.15.99:0/524703205 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe14c10d9d0 con 0x7fe14c0fe450 2024-09-19T06:50:54.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.365+0000 7fe154156640 1 -- 172.21.15.99:0/524703205 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe14c0fdce0 con 0x7fe14c0fe450 2024-09-19T06:50:54.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.366+0000 7fe14a7fc640 1 -- 172.21.15.99:0/524703205 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fe140012070 con 0x7fe14c0fe450 2024-09-19T06:50:54.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.366+0000 7fe14a7fc640 1 --2- 172.21.15.99:0/524703205 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe13406e530 0x7fe1340709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:54.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.366+0000 7fe14a7fc640 1 -- 172.21.15.99:0/524703205 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fe14008dc60 con 0x7fe14c0fe450 2024-09-19T06:50:54.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.366+0000 7fe151ef2640 1 --2- 172.21.15.99:0/524703205 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe13406e530 0x7fe1340709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:54.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.367+0000 7fe151ef2640 1 --2- 172.21.15.99:0/524703205 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe13406e530 0x7fe1340709e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe13c0048c0 tx=0x7fe13c004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:54.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.371+0000 7fe14a7fc640 1 -- 172.21.15.99:0/524703205 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fe140056dd0 con 0x7fe14c0fe450 2024-09-19T06:50:54.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.553+0000 7fe154156640 1 -- 172.21.15.99:0/524703205 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe14c10e8f0 con 0x7fe13406e530 2024-09-19T06:50:54.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.554+0000 7fe14a7fc640 1 -- 172.21.15.99:0/524703205 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fe14c10e8f0 con 0x7fe13406e530 2024-09-19T06:50:54.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.556+0000 7fe154156640 1 -- 172.21.15.99:0/524703205 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe13406e530 msgr2=0x7fe1340709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:54.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.556+0000 7fe154156640 1 --2- 172.21.15.99:0/524703205 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe13406e530 0x7fe1340709e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe13c0048c0 tx=0x7fe13c004d10 comp rx=0 tx=0).stop 2024-09-19T06:50:54.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.556+0000 7fe154156640 1 -- 172.21.15.99:0/524703205 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe14c0fe450 msgr2=0x7fe14c113790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:54.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.556+0000 7fe154156640 1 --2- 172.21.15.99:0/524703205 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe14c0fe450 0x7fe14c113790 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe14000b790 tx=0x7fe1400091d0 comp rx=0 tx=0).stop 2024-09-19T06:50:54.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.556+0000 7fe154156640 1 -- 172.21.15.99:0/524703205 shutdown_connections 2024-09-19T06:50:54.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.556+0000 7fe154156640 1 --2- 172.21.15.99:0/524703205 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe13406e530 0x7fe1340709e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:54.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.556+0000 7fe154156640 1 --2- 172.21.15.99:0/524703205 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe14c0fe450 0x7fe14c113790 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:54.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.556+0000 7fe154156640 1 --2- 172.21.15.99:0/524703205 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe14c064fe0 0x7fe14c113250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:54.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.556+0000 7fe154156640 1 -- 172.21.15.99:0/524703205 >> 172.21.15.99:0/524703205 conn(0x7fe14c0723b0 msgr2=0x7fe14c0fa290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:54.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.556+0000 7fe154156640 1 -- 172.21.15.99:0/524703205 shutdown_connections 2024-09-19T06:50:54.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.556+0000 7fe154156640 1 -- 172.21.15.99:0/524703205 wait complete. 2024-09-19T06:50:54.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.634+0000 7fda69144640 1 -- 172.21.15.99:0/2431981372 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda640fcf80 msgr2=0x7fda640fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:54.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.634+0000 7fda69144640 1 --2- 172.21.15.99:0/2431981372 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda640fcf80 0x7fda640fd3d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fda4c0048d0 tx=0x7fda4c009da0 comp rx=0 tx=0).stop 2024-09-19T06:50:54.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.634+0000 7fda69144640 1 -- 172.21.15.99:0/2431981372 shutdown_connections 2024-09-19T06:50:54.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.634+0000 7fda69144640 1 --2- 172.21.15.99:0/2431981372 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda640fcf80 0x7fda640fd3d0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:54.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.634+0000 7fda69144640 1 --2- 172.21.15.99:0/2431981372 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda640fb810 0x7fda640fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:54.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.634+0000 7fda69144640 1 -- 172.21.15.99:0/2431981372 >> 172.21.15.99:0/2431981372 conn(0x7fda640723b0 msgr2=0x7fda640727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:54.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.634+0000 7fda69144640 1 -- 172.21.15.99:0/2431981372 shutdown_connections 2024-09-19T06:50:54.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.634+0000 7fda69144640 1 -- 172.21.15.99:0/2431981372 wait complete. 2024-09-19T06:50:54.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.635+0000 7fda69144640 1 Processor -- start 2024-09-19T06:50:54.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.635+0000 7fda69144640 1 -- start start 2024-09-19T06:50:54.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.635+0000 7fda69144640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda640fb810 0x7fda6410bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:54.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.635+0000 7fda69144640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda640fcf80 0x7fda6410c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:54.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.635+0000 7fda69144640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda6410c9e0 con 0x7fda640fcf80 2024-09-19T06:50:54.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.635+0000 7fda69144640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda6410cb20 con 0x7fda640fb810 2024-09-19T06:50:54.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.635+0000 7fda5a59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda640fcf80 0x7fda6410c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:54.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.636+0000 7fda5a59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda640fcf80 0x7fda6410c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40956/0 (socket says 172.21.15.99:40956) 2024-09-19T06:50:54.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.636+0000 7fda5a59c640 1 -- 172.21.15.99:0/4022541182 learned_addr learned my addr 172.21.15.99:0/4022541182 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:50:54.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.636+0000 7fda62d9d640 1 --2- 172.21.15.99:0/4022541182 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda640fb810 0x7fda6410bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:54.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.636+0000 7fda5a59c640 1 -- 172.21.15.99:0/4022541182 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda640fb810 msgr2=0x7fda6410bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:54.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.636+0000 7fda5a59c640 1 --2- 172.21.15.99:0/4022541182 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda640fb810 0x7fda6410bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:54.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.636+0000 7fda5a59c640 1 -- 172.21.15.99:0/4022541182 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda4c005040 con 0x7fda640fcf80 2024-09-19T06:50:54.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.636+0000 7fda5a59c640 1 --2- 172.21.15.99:0/4022541182 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda640fcf80 0x7fda6410c4a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fda4c003080 tx=0x7fda4c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:54.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.636+0000 7fda5bfff640 1 -- 172.21.15.99:0/4022541182 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda4c038070 con 0x7fda640fcf80 2024-09-19T06:50:54.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.636+0000 7fda69144640 1 -- 172.21.15.99:0/4022541182 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda6410cda0 con 0x7fda640fcf80 2024-09-19T06:50:54.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.636+0000 7fda5bfff640 1 -- 172.21.15.99:0/4022541182 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fda4c0097e0 con 0x7fda640fcf80 2024-09-19T06:50:54.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.636+0000 7fda5bfff640 1 -- 172.21.15.99:0/4022541182 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda4c03d420 con 0x7fda640fcf80 2024-09-19T06:50:54.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.636+0000 7fda69144640 1 -- 172.21.15.99:0/4022541182 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda641198a0 con 0x7fda640fcf80 2024-09-19T06:50:54.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.637+0000 7fda69144640 1 -- 172.21.15.99:0/4022541182 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda640fcbc0 con 0x7fda640fcf80 2024-09-19T06:50:54.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.638+0000 7fda5bfff640 1 -- 172.21.15.99:0/4022541182 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fda4c030020 con 0x7fda640fcf80 2024-09-19T06:50:54.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.639+0000 7fda5bfff640 1 --2- 172.21.15.99:0/4022541182 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fda5006e530 0x7fda500709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:54.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.639+0000 7fda62d9d640 1 --2- 172.21.15.99:0/4022541182 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fda5006e530 0x7fda500709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:54.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.639+0000 7fda5bfff640 1 -- 172.21.15.99:0/4022541182 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fda4c0ae6f0 con 0x7fda640fcf80 2024-09-19T06:50:54.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.639+0000 7fda62d9d640 1 --2- 172.21.15.99:0/4022541182 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fda5006e530 0x7fda500709e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fda540041d0 tx=0x7fda54009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:54.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.643+0000 7fda5bfff640 1 -- 172.21.15.99:0/4022541182 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fda4c0777e0 con 0x7fda640fcf80 2024-09-19T06:50:54.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.815+0000 7fda69144640 1 -- 172.21.15.99:0/4022541182 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fda6404b720 con 0x7fda5006e530 2024-09-19T06:50:54.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.824+0000 7fda5bfff640 1 -- 172.21.15.99:0/4022541182 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7fda6404b720 con 0x7fda5006e530 2024-09-19T06:50:54.825 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T06:50:54.826 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.smithi099 smithi099 *:9093,9094 running (9m) 2m ago 18m 23.4M - 0.25.0 c8568f914cd2 e7c1774d56b0 2024-09-19T06:50:54.826 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi099 smithi099 running (6m) 2m ago 18m 6899k - 19.1.1-361-g2f599a46 d2baa855c067 b9775f416b10 2024-09-19T06:50:54.826 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi117 smithi117 running (6m) 2m ago 17m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 38cf60c0d548 2024-09-19T06:50:54.826 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.smithi099 smithi099 *:3000 running (8m) 2m ago 18m 80.7M - 9.4.12 2bacad6d85d8 cd53a18d5410 2024-09-19T06:50:54.826 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.obarqf smithi099 running (2m) 2m ago 13m 12.2M - 19.1.1-361-g2f599a46 d2baa855c067 314a73082521 2024-09-19T06:50:54.826 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.xehbxe smithi099 running (2m) 2m ago 13m 14.4M - 19.1.1-361-g2f599a46 d2baa855c067 a2955a9d06e6 2024-09-19T06:50:54.826 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.bheqzh smithi117 running (2m) 2m ago 13m 11.8M - 19.1.1-361-g2f599a46 d2baa855c067 b1505937c0b7 2024-09-19T06:50:54.826 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.nooexo smithi117 running (2m) 2m ago 13m 13.1M - 19.1.1-361-g2f599a46 d2baa855c067 35bd7725855c 2024-09-19T06:50:54.826 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi099.pgvkqi smithi099 *:8443,9283,8765 running (9m) 2m ago 19m 505M - 19.1.1-361-g2f599a46 d2baa855c067 d5de99cb7e78 2024-09-19T06:50:54.826 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi117.ssmkcf smithi117 *:8443,9283,8765 running (8m) 2m ago 17m 444M - 19.1.1-361-g2f599a46 d2baa855c067 8b7ee0f871f5 2024-09-19T06:50:54.826 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi099 smithi099 running (7m) 2m ago 19m 52.4M 2048M 19.1.1-361-g2f599a46 d2baa855c067 ffe067438824 2024-09-19T06:50:54.826 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi117 smithi117 running (7m) 2m ago 17m 38.9M 2048M 19.1.1-361-g2f599a46 d2baa855c067 4cb7455e3ee7 2024-09-19T06:50:54.826 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi099 smithi099 *:9100 running (10m) 2m ago 18m 15.0M - 1.5.0 0da6a335fe13 dca7b4517dcc 2024-09-19T06:50:54.827 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi117 smithi117 *:9100 running (9m) 2m ago 17m 15.9M - 1.5.0 0da6a335fe13 8233ce3835d2 2024-09-19T06:50:54.827 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (6m) 2m ago 16m 100M 1557M 19.1.1-361-g2f599a46 d2baa855c067 8e22543bf933 2024-09-19T06:50:54.827 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (5m) 2m ago 16m 106M 1557M 19.1.1-361-g2f599a46 d2baa855c067 f54153d0ae09 2024-09-19T06:50:54.827 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (4m) 2m ago 15m 83.7M 1557M 19.1.1-361-g2f599a46 d2baa855c067 b1778ab88870 2024-09-19T06:50:54.827 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi117 running (4m) 2m ago 15m 102M 2581M 19.1.1-361-g2f599a46 d2baa855c067 ea5236b193d3 2024-09-19T06:50:54.827 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi117 running (3m) 2m ago 15m 93.5M 2581M 19.1.1-361-g2f599a46 d2baa855c067 27ac2c859a68 2024-09-19T06:50:54.827 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi117 running (3m) 2m ago 14m 100M 2581M 19.1.1-361-g2f599a46 d2baa855c067 de6aeb8544ce 2024-09-19T06:50:54.827 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.smithi099 smithi099 *:9095 running (8m) 2m ago 17m 64.4M - 2.43.0 a07b618ecd1d 15ad26ec6fb4 2024-09-19T06:50:54.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.826+0000 7fda69144640 1 -- 172.21.15.99:0/4022541182 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fda5006e530 msgr2=0x7fda500709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:54.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.826+0000 7fda69144640 1 --2- 172.21.15.99:0/4022541182 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fda5006e530 0x7fda500709e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fda540041d0 tx=0x7fda54009040 comp rx=0 tx=0).stop 2024-09-19T06:50:54.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.826+0000 7fda69144640 1 -- 172.21.15.99:0/4022541182 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda640fcf80 msgr2=0x7fda6410c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:54.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.826+0000 7fda69144640 1 --2- 172.21.15.99:0/4022541182 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda640fcf80 0x7fda6410c4a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fda4c003080 tx=0x7fda4c009da0 comp rx=0 tx=0).stop 2024-09-19T06:50:54.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.826+0000 7fda69144640 1 -- 172.21.15.99:0/4022541182 shutdown_connections 2024-09-19T06:50:54.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.826+0000 7fda69144640 1 --2- 172.21.15.99:0/4022541182 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fda5006e530 0x7fda500709e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:54.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.826+0000 7fda69144640 1 --2- 172.21.15.99:0/4022541182 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fda640fcf80 0x7fda6410c4a0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:54.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.826+0000 7fda69144640 1 --2- 172.21.15.99:0/4022541182 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda640fb810 0x7fda6410bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:54.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.826+0000 7fda69144640 1 -- 172.21.15.99:0/4022541182 >> 172.21.15.99:0/4022541182 conn(0x7fda640723b0 msgr2=0x7fda640fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:54.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.826+0000 7fda69144640 1 -- 172.21.15.99:0/4022541182 shutdown_connections 2024-09-19T06:50:54.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.826+0000 7fda69144640 1 -- 172.21.15.99:0/4022541182 wait complete. 2024-09-19T06:50:54.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.903+0000 7ff1b8bac640 1 -- 172.21.15.99:0/1150998106 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1b4102550 msgr2=0x7ff1b4102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:54.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.903+0000 7ff1b8bac640 1 --2- 172.21.15.99:0/1150998106 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1b4102550 0x7ff1b4102920 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff1a40048d0 tx=0x7ff1a4009da0 comp rx=0 tx=0).stop 2024-09-19T06:50:54.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.903+0000 7ff1b8bac640 1 -- 172.21.15.99:0/1150998106 shutdown_connections 2024-09-19T06:50:54.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.903+0000 7ff1b8bac640 1 --2- 172.21.15.99:0/1150998106 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1b4102ef0 0x7ff1b40fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:54.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.903+0000 7ff1b8bac640 1 --2- 172.21.15.99:0/1150998106 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1b4102550 0x7ff1b4102920 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:54.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.903+0000 7ff1b8bac640 1 -- 172.21.15.99:0/1150998106 >> 172.21.15.99:0/1150998106 conn(0x7ff1b40f80f0 msgr2=0x7ff1b40fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:54.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.903+0000 7ff1b8bac640 1 -- 172.21.15.99:0/1150998106 shutdown_connections 2024-09-19T06:50:54.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.903+0000 7ff1b8bac640 1 -- 172.21.15.99:0/1150998106 wait complete. 2024-09-19T06:50:54.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.904+0000 7ff1b8bac640 1 Processor -- start 2024-09-19T06:50:54.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.904+0000 7ff1b8bac640 1 -- start start 2024-09-19T06:50:54.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.904+0000 7ff1b8bac640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1b4102550 0x7ff1b4113540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:54.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.904+0000 7ff1b8bac640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1b4102ef0 0x7ff1b4113a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:54.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.904+0000 7ff1b8bac640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b41140d0 con 0x7ff1b4102ef0 2024-09-19T06:50:54.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.904+0000 7ff1b8bac640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b410d4e0 con 0x7ff1b4102550 2024-09-19T06:50:54.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.904+0000 7ff1b1d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1b4102ef0 0x7ff1b4113a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:54.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.904+0000 7ff1b1d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1b4102ef0 0x7ff1b4113a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40970/0 (socket says 172.21.15.99:40970) 2024-09-19T06:50:54.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.904+0000 7ff1b1d9b640 1 -- 172.21.15.99:0/3045871544 learned_addr learned my addr 172.21.15.99:0/3045871544 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:50:54.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.904+0000 7ff1b259c640 1 --2- 172.21.15.99:0/3045871544 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1b4102550 0x7ff1b4113540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:54.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.905+0000 7ff1b1d9b640 1 -- 172.21.15.99:0/3045871544 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1b4102550 msgr2=0x7ff1b4113540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:54.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.905+0000 7ff1b1d9b640 1 --2- 172.21.15.99:0/3045871544 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1b4102550 0x7ff1b4113540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:54.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.905+0000 7ff1b1d9b640 1 -- 172.21.15.99:0/3045871544 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a4005040 con 0x7ff1b4102ef0 2024-09-19T06:50:54.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.905+0000 7ff1b1d9b640 1 --2- 172.21.15.99:0/3045871544 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1b4102ef0 0x7ff1b4113a80 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff1a8002840 tx=0x7ff1a8004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:54.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.905+0000 7ff1a2ffd640 1 -- 172.21.15.99:0/3045871544 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1a8007c30 con 0x7ff1b4102ef0 2024-09-19T06:50:54.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.905+0000 7ff1a2ffd640 1 -- 172.21.15.99:0/3045871544 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff1a800f040 con 0x7ff1b4102ef0 2024-09-19T06:50:54.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.905+0000 7ff1b8bac640 1 -- 172.21.15.99:0/3045871544 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1b410d7c0 con 0x7ff1b4102ef0 2024-09-19T06:50:54.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.905+0000 7ff1a2ffd640 1 -- 172.21.15.99:0/3045871544 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1a800d990 con 0x7ff1b4102ef0 2024-09-19T06:50:54.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.905+0000 7ff1b8bac640 1 -- 172.21.15.99:0/3045871544 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1b410dd60 con 0x7ff1b4102ef0 2024-09-19T06:50:54.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.906+0000 7ff1b8bac640 1 -- 172.21.15.99:0/3045871544 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1b40fdcd0 con 0x7ff1b4102ef0 2024-09-19T06:50:54.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.907+0000 7ff1a2ffd640 1 -- 172.21.15.99:0/3045871544 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7ff1a8009600 con 0x7ff1b4102ef0 2024-09-19T06:50:54.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.907+0000 7ff1a2ffd640 1 --2- 172.21.15.99:0/3045871544 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ff19c06e530 0x7ff19c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:54.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.907+0000 7ff1a2ffd640 1 -- 172.21.15.99:0/3045871544 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7ff1a808d810 con 0x7ff1b4102ef0 2024-09-19T06:50:54.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.907+0000 7ff1b259c640 1 --2- 172.21.15.99:0/3045871544 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ff19c06e530 0x7ff19c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:54.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.908+0000 7ff1b259c640 1 --2- 172.21.15.99:0/3045871544 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ff19c06e530 0x7ff19c0709e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4009ac0 tx=0x7ff1a4035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:54.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:54.911+0000 7ff1a2ffd640 1 -- 172.21.15.99:0/3045871544 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7ff1a8056a30 con 0x7ff1b4102ef0 2024-09-19T06:50:55.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.146+0000 7ff1b8bac640 1 -- 172.21.15.99:0/3045871544 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff1b40fbd50 con 0x7ff1b4102ef0 2024-09-19T06:50:55.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.147+0000 7ff1a2ffd640 1 -- 172.21.15.99:0/3045871544 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7ff1a805a0f0 con 0x7ff1b4102ef0 2024-09-19T06:50:55.148 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:50:55.148 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-09-19T06:50:55.148 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T06:50:55.148 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:50:55.149 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-09-19T06:50:55.149 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T06:50:55.149 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:50:55.149 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-09-19T06:50:55.149 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 6 2024-09-19T06:50:55.149 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:50:55.149 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": { 2024-09-19T06:50:55.149 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 4 2024-09-19T06:50:55.149 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:50:55.149 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-09-19T06:50:55.149 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 14 2024-09-19T06:50:55.149 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T06:50:55.149 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:50:55.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.149+0000 7ff1b8bac640 1 -- 172.21.15.99:0/3045871544 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ff19c06e530 msgr2=0x7ff19c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:55.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.149+0000 7ff1b8bac640 1 --2- 172.21.15.99:0/3045871544 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ff19c06e530 0x7ff19c0709e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4009ac0 tx=0x7ff1a4035040 comp rx=0 tx=0).stop 2024-09-19T06:50:55.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.149+0000 7ff1b8bac640 1 -- 172.21.15.99:0/3045871544 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1b4102ef0 msgr2=0x7ff1b4113a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:55.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.149+0000 7ff1b8bac640 1 --2- 172.21.15.99:0/3045871544 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1b4102ef0 0x7ff1b4113a80 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff1a8002840 tx=0x7ff1a8004570 comp rx=0 tx=0).stop 2024-09-19T06:50:55.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.149+0000 7ff1b8bac640 1 -- 172.21.15.99:0/3045871544 shutdown_connections 2024-09-19T06:50:55.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.149+0000 7ff1b8bac640 1 --2- 172.21.15.99:0/3045871544 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ff19c06e530 0x7ff19c0709e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:55.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.149+0000 7ff1b8bac640 1 --2- 172.21.15.99:0/3045871544 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1b4102ef0 0x7ff1b4113a80 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:55.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.149+0000 7ff1b8bac640 1 --2- 172.21.15.99:0/3045871544 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff1b4102550 0x7ff1b4113540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:55.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.149+0000 7ff1b8bac640 1 -- 172.21.15.99:0/3045871544 >> 172.21.15.99:0/3045871544 conn(0x7ff1b40f80f0 msgr2=0x7ff1b40f9160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:55.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.149+0000 7ff1b8bac640 1 -- 172.21.15.99:0/3045871544 shutdown_connections 2024-09-19T06:50:55.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.149+0000 7ff1b8bac640 1 -- 172.21.15.99:0/3045871544 wait complete. 2024-09-19T06:50:55.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.228+0000 7f49a02df640 1 -- 172.21.15.99:0/3212990287 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49980fb810 msgr2=0x7f49980fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:55.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.228+0000 7f49a02df640 1 --2- 172.21.15.99:0/3212990287 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49980fb810 0x7f49980fbbe0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f498c0048d0 tx=0x7f498c009da0 comp rx=0 tx=0).stop 2024-09-19T06:50:55.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.228+0000 7f49a02df640 1 -- 172.21.15.99:0/3212990287 shutdown_connections 2024-09-19T06:50:55.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.228+0000 7f49a02df640 1 --2- 172.21.15.99:0/3212990287 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49980fcf80 0x7f49980fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:55.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.228+0000 7f49a02df640 1 --2- 172.21.15.99:0/3212990287 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49980fb810 0x7f49980fbbe0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:55.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.228+0000 7f49a02df640 1 -- 172.21.15.99:0/3212990287 >> 172.21.15.99:0/3212990287 conn(0x7f49980723b0 msgr2=0x7f49980727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:55.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.228+0000 7f49a02df640 1 -- 172.21.15.99:0/3212990287 shutdown_connections 2024-09-19T06:50:55.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.228+0000 7f49a02df640 1 -- 172.21.15.99:0/3212990287 wait complete. 2024-09-19T06:50:55.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.228+0000 7f49a02df640 1 Processor -- start 2024-09-19T06:50:55.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.228+0000 7f49a02df640 1 -- start start 2024-09-19T06:50:55.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.229+0000 7f49a02df640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49980fb810 0x7f49981120f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:55.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.229+0000 7f49a02df640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49980fcf80 0x7f4998112630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:55.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.229+0000 7f49a02df640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4998112c30 con 0x7f49980fcf80 2024-09-19T06:50:55.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.229+0000 7f49a02df640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f499810c070 con 0x7f49980fb810 2024-09-19T06:50:55.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.229+0000 7f499d87a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49980fcf80 0x7f4998112630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:55.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.229+0000 7f499d87a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49980fcf80 0x7f4998112630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40986/0 (socket says 172.21.15.99:40986) 2024-09-19T06:50:55.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.229+0000 7f499d87a640 1 -- 172.21.15.99:0/3664656662 learned_addr learned my addr 172.21.15.99:0/3664656662 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:50:55.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.229+0000 7f499e07b640 1 --2- 172.21.15.99:0/3664656662 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49980fb810 0x7f49981120f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:55.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.229+0000 7f499d87a640 1 -- 172.21.15.99:0/3664656662 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49980fb810 msgr2=0x7f49981120f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:55.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.229+0000 7f499d87a640 1 --2- 172.21.15.99:0/3664656662 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49980fb810 0x7f49981120f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:55.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.229+0000 7f499d87a640 1 -- 172.21.15.99:0/3664656662 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f498c005040 con 0x7f49980fcf80 2024-09-19T06:50:55.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.229+0000 7f499e07b640 1 --2- 172.21.15.99:0/3664656662 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49980fb810 0x7f49981120f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:50:55.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.229+0000 7f499d87a640 1 --2- 172.21.15.99:0/3664656662 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49980fcf80 0x7f4998112630 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4994002a50 tx=0x7f4994004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:55.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.229+0000 7f498affd640 1 -- 172.21.15.99:0/3664656662 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4994007c30 con 0x7f49980fcf80 2024-09-19T06:50:55.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.229+0000 7f498affd640 1 -- 172.21.15.99:0/3664656662 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f499400f040 con 0x7f49980fcf80 2024-09-19T06:50:55.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.229+0000 7f49a02df640 1 -- 172.21.15.99:0/3664656662 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f499810c350 con 0x7f49980fcf80 2024-09-19T06:50:55.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.229+0000 7f498affd640 1 -- 172.21.15.99:0/3664656662 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f499400da90 con 0x7f49980fcf80 2024-09-19T06:50:55.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.229+0000 7f49a02df640 1 -- 172.21.15.99:0/3664656662 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f499810c8f0 con 0x7f49980fcf80 2024-09-19T06:50:55.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.231+0000 7f49a02df640 1 -- 172.21.15.99:0/3664656662 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49980fcbc0 con 0x7f49980fcf80 2024-09-19T06:50:55.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.231+0000 7f498affd640 1 -- 172.21.15.99:0/3664656662 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f499400dd00 con 0x7f49980fcf80 2024-09-19T06:50:55.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.231+0000 7f498affd640 1 --2- 172.21.15.99:0/3664656662 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f498406e530 0x7f49840709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:55.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.232+0000 7f498affd640 1 -- 172.21.15.99:0/3664656662 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f499408da70 con 0x7f49980fcf80 2024-09-19T06:50:55.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.232+0000 7f499e07b640 1 --2- 172.21.15.99:0/3664656662 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f498406e530 0x7f49840709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:55.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.232+0000 7f499e07b640 1 --2- 172.21.15.99:0/3664656662 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f498406e530 0x7f49840709e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f498c00b020 tx=0x7f498c009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:55.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.236+0000 7f498affd640 1 -- 172.21.15.99:0/3664656662 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f4994056b60 con 0x7f49980fcf80 2024-09-19T06:50:55.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.435+0000 7f49a02df640 1 -- 172.21.15.99:0/3664656662 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f499810d7c0 con 0x7f49980fcf80 2024-09-19T06:50:55.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.436+0000 7f498affd640 1 -- 172.21.15.99:0/3664656662 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 29 v29) v1 ==== 76+0+1915 (secure 0 0 0) 0x7f499405a220 con 0x7f49980fcf80 2024-09-19T06:50:55.437 INFO:teuthology.orchestra.run.smithi099.stdout:e29 2024-09-19T06:50:55.437 INFO:teuthology.orchestra.run.smithi099.stdout:btime 2024-09-19T06:48:47:938420+0000 2024-09-19T06:50:55.437 INFO:teuthology.orchestra.run.smithi099.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T06:50:55.438 INFO:teuthology.orchestra.run.smithi099.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T06:50:55.438 INFO:teuthology.orchestra.run.smithi099.stdout:legacy client fscid: 1 2024-09-19T06:50:55.438 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:50:55.438 INFO:teuthology.orchestra.run.smithi099.stdout:Filesystem 'cephfs' (1) 2024-09-19T06:50:55.438 INFO:teuthology.orchestra.run.smithi099.stdout:fs_name cephfs 2024-09-19T06:50:55.438 INFO:teuthology.orchestra.run.smithi099.stdout:epoch 20 2024-09-19T06:50:55.438 INFO:teuthology.orchestra.run.smithi099.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-19T06:50:55.438 INFO:teuthology.orchestra.run.smithi099.stdout:created 2024-09-19T06:37:40.838146+0000 2024-09-19T06:50:55.438 INFO:teuthology.orchestra.run.smithi099.stdout:modified 2024-09-19T06:47:50.076553+0000 2024-09-19T06:50:55.438 INFO:teuthology.orchestra.run.smithi099.stdout:tableserver 0 2024-09-19T06:50:55.438 INFO:teuthology.orchestra.run.smithi099.stdout:root 0 2024-09-19T06:50:55.438 INFO:teuthology.orchestra.run.smithi099.stdout:session_timeout 60 2024-09-19T06:50:55.438 INFO:teuthology.orchestra.run.smithi099.stdout:session_autoclose 300 2024-09-19T06:50:55.439 INFO:teuthology.orchestra.run.smithi099.stdout:max_file_size 1099511627776 2024-09-19T06:50:55.439 INFO:teuthology.orchestra.run.smithi099.stdout:max_xattr_size 65536 2024-09-19T06:50:55.439 INFO:teuthology.orchestra.run.smithi099.stdout:required_client_features {} 2024-09-19T06:50:55.439 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure 0 2024-09-19T06:50:55.439 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure_osd_epoch 77 2024-09-19T06:50:55.439 INFO:teuthology.orchestra.run.smithi099.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T06:50:55.439 INFO:teuthology.orchestra.run.smithi099.stdout:max_mds 2 2024-09-19T06:50:55.439 INFO:teuthology.orchestra.run.smithi099.stdout:in 0,1 2024-09-19T06:50:55.439 INFO:teuthology.orchestra.run.smithi099.stdout:up {} 2024-09-19T06:50:55.439 INFO:teuthology.orchestra.run.smithi099.stdout:failed 0,1 2024-09-19T06:50:55.439 INFO:teuthology.orchestra.run.smithi099.stdout:damaged 2024-09-19T06:50:55.439 INFO:teuthology.orchestra.run.smithi099.stdout:stopped 2024-09-19T06:50:55.439 INFO:teuthology.orchestra.run.smithi099.stdout:data_pools [3] 2024-09-19T06:50:55.439 INFO:teuthology.orchestra.run.smithi099.stdout:metadata_pool 2 2024-09-19T06:50:55.440 INFO:teuthology.orchestra.run.smithi099.stdout:inline_data disabled 2024-09-19T06:50:55.440 INFO:teuthology.orchestra.run.smithi099.stdout:balancer 2024-09-19T06:50:55.440 INFO:teuthology.orchestra.run.smithi099.stdout:bal_rank_mask -1 2024-09-19T06:50:55.440 INFO:teuthology.orchestra.run.smithi099.stdout:standby_count_wanted 1 2024-09-19T06:50:55.440 INFO:teuthology.orchestra.run.smithi099.stdout:qdb_cluster leader: 0 members: 2024-09-19T06:50:55.440 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:50:55.440 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:50:55.440 INFO:teuthology.orchestra.run.smithi099.stdout:Standby daemons: 2024-09-19T06:50:55.440 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:50:55.440 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.obarqf{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6826/1859154203,v1:172.21.15.99:6827/1859154203] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:50:55.440 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.xehbxe{-1:34410} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6828/1939453719,v1:172.21.15.99:6829/1939453719] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:50:55.440 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.nooexo{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6824/1398895079,v1:172.21.15.117:6825/1398895079] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:50:55.440 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.bheqzh{-1:44329} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6826/3233337308,v1:172.21.15.117:6827/3233337308] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:50:55.441 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 29 2024-09-19T06:50:55.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.438+0000 7f49a02df640 1 -- 172.21.15.99:0/3664656662 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f498406e530 msgr2=0x7f49840709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:55.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.438+0000 7f49a02df640 1 --2- 172.21.15.99:0/3664656662 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f498406e530 0x7f49840709e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f498c00b020 tx=0x7f498c009da0 comp rx=0 tx=0).stop 2024-09-19T06:50:55.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.438+0000 7f49a02df640 1 -- 172.21.15.99:0/3664656662 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49980fcf80 msgr2=0x7f4998112630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:55.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.438+0000 7f49a02df640 1 --2- 172.21.15.99:0/3664656662 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49980fcf80 0x7f4998112630 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4994002a50 tx=0x7f4994004600 comp rx=0 tx=0).stop 2024-09-19T06:50:55.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.438+0000 7f49a02df640 1 -- 172.21.15.99:0/3664656662 shutdown_connections 2024-09-19T06:50:55.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.438+0000 7f49a02df640 1 --2- 172.21.15.99:0/3664656662 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f498406e530 0x7f49840709e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:55.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.438+0000 7f49a02df640 1 --2- 172.21.15.99:0/3664656662 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49980fcf80 0x7f4998112630 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:55.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.438+0000 7f49a02df640 1 --2- 172.21.15.99:0/3664656662 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49980fb810 0x7f49981120f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:55.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.438+0000 7f49a02df640 1 -- 172.21.15.99:0/3664656662 >> 172.21.15.99:0/3664656662 conn(0x7f49980723b0 msgr2=0x7f49980fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:55.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.438+0000 7f49a02df640 1 -- 172.21.15.99:0/3664656662 shutdown_connections 2024-09-19T06:50:55.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.438+0000 7f49a02df640 1 -- 172.21.15.99:0/3664656662 wait complete. 2024-09-19T06:50:55.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.517+0000 7fbf50bef640 1 -- 172.21.15.99:0/534726744 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbf4c0fb480 msgr2=0x7fbf4c0fb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:55.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.517+0000 7fbf50bef640 1 --2- 172.21.15.99:0/534726744 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbf4c0fb480 0x7fbf4c0fb8f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fbf400048d0 tx=0x7fbf40009da0 comp rx=0 tx=0).stop 2024-09-19T06:50:55.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.517+0000 7fbf50bef640 1 -- 172.21.15.99:0/534726744 shutdown_connections 2024-09-19T06:50:55.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.517+0000 7fbf50bef640 1 --2- 172.21.15.99:0/534726744 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbf4c0fb480 0x7fbf4c0fb8f0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:55.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.517+0000 7fbf50bef640 1 --2- 172.21.15.99:0/534726744 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf4c1014c0 0x7fbf4c101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:55.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.517+0000 7fbf50bef640 1 -- 172.21.15.99:0/534726744 >> 172.21.15.99:0/534726744 conn(0x7fbf4c0f7000 msgr2=0x7fbf4c0f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:55.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.517+0000 7fbf50bef640 1 -- 172.21.15.99:0/534726744 shutdown_connections 2024-09-19T06:50:55.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.517+0000 7fbf50bef640 1 -- 172.21.15.99:0/534726744 wait complete. 2024-09-19T06:50:55.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.518+0000 7fbf50bef640 1 Processor -- start 2024-09-19T06:50:55.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.518+0000 7fbf50bef640 1 -- start start 2024-09-19T06:50:55.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.518+0000 7fbf50bef640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf4c0fb480 0x7fbf4c10e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:55.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.518+0000 7fbf50bef640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbf4c1014c0 0x7fbf4c10e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:55.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.518+0000 7fbf50bef640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4c10edc0 con 0x7fbf4c1014c0 2024-09-19T06:50:55.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.518+0000 7fbf50bef640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4c10ef30 con 0x7fbf4c0fb480 2024-09-19T06:50:55.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.518+0000 7fbf49d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbf4c1014c0 0x7fbf4c10e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:55.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.518+0000 7fbf49d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbf4c1014c0 0x7fbf4c10e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52652/0 (socket says 172.21.15.99:52652) 2024-09-19T06:50:55.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.518+0000 7fbf49d9b640 1 -- 172.21.15.99:0/2379297082 learned_addr learned my addr 172.21.15.99:0/2379297082 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:50:55.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.518+0000 7fbf4a59c640 1 --2- 172.21.15.99:0/2379297082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf4c0fb480 0x7fbf4c10e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:55.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.518+0000 7fbf49d9b640 1 -- 172.21.15.99:0/2379297082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf4c0fb480 msgr2=0x7fbf4c10e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:55.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.518+0000 7fbf49d9b640 1 --2- 172.21.15.99:0/2379297082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf4c0fb480 0x7fbf4c10e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:55.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.518+0000 7fbf49d9b640 1 -- 172.21.15.99:0/2379297082 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf40005040 con 0x7fbf4c1014c0 2024-09-19T06:50:55.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.518+0000 7fbf4a59c640 1 --2- 172.21.15.99:0/2379297082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf4c0fb480 0x7fbf4c10e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:50:55.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.518+0000 7fbf49d9b640 1 --2- 172.21.15.99:0/2379297082 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbf4c1014c0 0x7fbf4c10e730 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fbf40003080 tx=0x7fbf40009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:55.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.519+0000 7fbf3affd640 1 -- 172.21.15.99:0/2379297082 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf40038070 con 0x7fbf4c1014c0 2024-09-19T06:50:55.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.519+0000 7fbf3affd640 1 -- 172.21.15.99:0/2379297082 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fbf400097e0 con 0x7fbf4c1014c0 2024-09-19T06:50:55.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.519+0000 7fbf50bef640 1 -- 172.21.15.99:0/2379297082 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf4c117260 con 0x7fbf4c1014c0 2024-09-19T06:50:55.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.519+0000 7fbf3affd640 1 -- 172.21.15.99:0/2379297082 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf4003d420 con 0x7fbf4c1014c0 2024-09-19T06:50:55.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.519+0000 7fbf50bef640 1 -- 172.21.15.99:0/2379297082 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf4c1176d0 con 0x7fbf4c1014c0 2024-09-19T06:50:55.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.520+0000 7fbf50bef640 1 -- 172.21.15.99:0/2379297082 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf4c0fcbc0 con 0x7fbf4c1014c0 2024-09-19T06:50:55.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.520+0000 7fbf3affd640 1 -- 172.21.15.99:0/2379297082 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fbf40030020 con 0x7fbf4c1014c0 2024-09-19T06:50:55.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.521+0000 7fbf3affd640 1 --2- 172.21.15.99:0/2379297082 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fbf3406e530 0x7fbf340709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:55.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.521+0000 7fbf3affd640 1 -- 172.21.15.99:0/2379297082 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fbf400ae720 con 0x7fbf4c1014c0 2024-09-19T06:50:55.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.521+0000 7fbf4a59c640 1 --2- 172.21.15.99:0/2379297082 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fbf3406e530 0x7fbf340709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:55.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.521+0000 7fbf4a59c640 1 --2- 172.21.15.99:0/2379297082 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fbf3406e530 0x7fbf340709e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c009a80 tx=0x7fbf3c008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:55.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.525+0000 7fbf3affd640 1 -- 172.21.15.99:0/2379297082 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fbf40077810 con 0x7fbf4c1014c0 2024-09-19T06:50:55.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.706+0000 7fbf50bef640 1 -- 172.21.15.99:0/2379297082 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbf4c108560 con 0x7fbf3406e530 2024-09-19T06:50:55.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.707+0000 7fbf3affd640 1 -- 172.21.15.99:0/2379297082 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fbf3c009710 con 0x7fbf3406e530 2024-09-19T06:50:55.708 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:50:55.709 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T06:50:55.709 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": true, 2024-09-19T06:50:55.709 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T06:50:55.709 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [ 2024-09-19T06:50:55.709 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr", 2024-09-19T06:50:55.709 INFO:teuthology.orchestra.run.smithi099.stdout: "crash", 2024-09-19T06:50:55.709 INFO:teuthology.orchestra.run.smithi099.stdout: "mds", 2024-09-19T06:50:55.709 INFO:teuthology.orchestra.run.smithi099.stdout: "mon", 2024-09-19T06:50:55.709 INFO:teuthology.orchestra.run.smithi099.stdout: "osd" 2024-09-19T06:50:55.709 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-19T06:50:55.709 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": "16/21 daemons upgraded", 2024-09-19T06:50:55.709 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "Currently upgrading mds daemons", 2024-09-19T06:50:55.709 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-09-19T06:50:55.710 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:50:55.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.710+0000 7fbf50bef640 1 -- 172.21.15.99:0/2379297082 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fbf3406e530 msgr2=0x7fbf340709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:55.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.710+0000 7fbf50bef640 1 --2- 172.21.15.99:0/2379297082 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fbf3406e530 0x7fbf340709e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c009a80 tx=0x7fbf3c008040 comp rx=0 tx=0).stop 2024-09-19T06:50:55.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.710+0000 7fbf50bef640 1 -- 172.21.15.99:0/2379297082 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbf4c1014c0 msgr2=0x7fbf4c10e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:55.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.710+0000 7fbf50bef640 1 --2- 172.21.15.99:0/2379297082 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbf4c1014c0 0x7fbf4c10e730 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fbf40003080 tx=0x7fbf40009da0 comp rx=0 tx=0).stop 2024-09-19T06:50:55.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.710+0000 7fbf50bef640 1 -- 172.21.15.99:0/2379297082 shutdown_connections 2024-09-19T06:50:55.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.710+0000 7fbf50bef640 1 --2- 172.21.15.99:0/2379297082 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fbf3406e530 0x7fbf340709e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:55.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.710+0000 7fbf50bef640 1 --2- 172.21.15.99:0/2379297082 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbf4c1014c0 0x7fbf4c10e730 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:55.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.710+0000 7fbf50bef640 1 --2- 172.21.15.99:0/2379297082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf4c0fb480 0x7fbf4c10e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:55.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.710+0000 7fbf50bef640 1 -- 172.21.15.99:0/2379297082 >> 172.21.15.99:0/2379297082 conn(0x7fbf4c0f7000 msgr2=0x7fbf4c0f8950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:55.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.710+0000 7fbf50bef640 1 -- 172.21.15.99:0/2379297082 shutdown_connections 2024-09-19T06:50:55.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.710+0000 7fbf50bef640 1 -- 172.21.15.99:0/2379297082 wait complete. 2024-09-19T06:50:55.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.787+0000 7fe7e39bc640 1 -- 172.21.15.99:0/1987462743 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7dc102550 msgr2=0x7fe7dc102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:55.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.787+0000 7fe7e39bc640 1 --2- 172.21.15.99:0/1987462743 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7dc102550 0x7fe7dc102920 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe7d80048d0 tx=0x7fe7d8009da0 comp rx=0 tx=0).stop 2024-09-19T06:50:55.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.787+0000 7fe7e39bc640 1 -- 172.21.15.99:0/1987462743 shutdown_connections 2024-09-19T06:50:55.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.787+0000 7fe7e39bc640 1 --2- 172.21.15.99:0/1987462743 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe7dc102ef0 0x7fe7dc0fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:55.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.787+0000 7fe7e39bc640 1 --2- 172.21.15.99:0/1987462743 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7dc102550 0x7fe7dc102920 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:55.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.787+0000 7fe7e39bc640 1 -- 172.21.15.99:0/1987462743 >> 172.21.15.99:0/1987462743 conn(0x7fe7dc0f80f0 msgr2=0x7fe7dc0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:55.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.787+0000 7fe7e39bc640 1 -- 172.21.15.99:0/1987462743 shutdown_connections 2024-09-19T06:50:55.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.788+0000 7fe7e39bc640 1 -- 172.21.15.99:0/1987462743 wait complete. 2024-09-19T06:50:55.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.788+0000 7fe7e39bc640 1 Processor -- start 2024-09-19T06:50:55.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.788+0000 7fe7e39bc640 1 -- start start 2024-09-19T06:50:55.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.788+0000 7fe7e39bc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7dc102550 0x7fe7dc06fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:55.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.788+0000 7fe7e39bc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe7dc102ef0 0x7fe7dc06ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:55.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.788+0000 7fe7e39bc640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7dc070490 con 0x7fe7dc102550 2024-09-19T06:50:55.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.788+0000 7fe7e39bc640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7dc070600 con 0x7fe7dc102ef0 2024-09-19T06:50:55.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.788+0000 7fe7e1758640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7dc102550 0x7fe7dc06fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:55.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.788+0000 7fe7e1758640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7dc102550 0x7fe7dc06fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52666/0 (socket says 172.21.15.99:52666) 2024-09-19T06:50:55.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.788+0000 7fe7e1758640 1 -- 172.21.15.99:0/1592375421 learned_addr learned my addr 172.21.15.99:0/1592375421 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:50:55.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.788+0000 7fe7e0f57640 1 --2- 172.21.15.99:0/1592375421 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe7dc102ef0 0x7fe7dc06ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:55.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.789+0000 7fe7e1758640 1 -- 172.21.15.99:0/1592375421 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe7dc102ef0 msgr2=0x7fe7dc06ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:55.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.789+0000 7fe7e1758640 1 --2- 172.21.15.99:0/1592375421 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe7dc102ef0 0x7fe7dc06ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:55.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.789+0000 7fe7e1758640 1 -- 172.21.15.99:0/1592375421 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d8005040 con 0x7fe7dc102550 2024-09-19T06:50:55.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.789+0000 7fe7e1758640 1 --2- 172.21.15.99:0/1592375421 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7dc102550 0x7fe7dc06fa10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe7d8000c00 tx=0x7fe7d8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:55.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.789+0000 7fe7d1ffb640 1 -- 172.21.15.99:0/1592375421 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7d8038070 con 0x7fe7dc102550 2024-09-19T06:50:55.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.789+0000 7fe7e39bc640 1 -- 172.21.15.99:0/1592375421 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7dc070830 con 0x7fe7dc102550 2024-09-19T06:50:55.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.789+0000 7fe7d1ffb640 1 -- 172.21.15.99:0/1592375421 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe7d802ade0 con 0x7fe7dc102550 2024-09-19T06:50:55.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.789+0000 7fe7d1ffb640 1 -- 172.21.15.99:0/1592375421 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7d802c7b0 con 0x7fe7dc102550 2024-09-19T06:50:55.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.789+0000 7fe7e39bc640 1 -- 172.21.15.99:0/1592375421 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7dc119bf0 con 0x7fe7dc102550 2024-09-19T06:50:55.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.790+0000 7fe7e39bc640 1 -- 172.21.15.99:0/1592375421 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7dc0fdcd0 con 0x7fe7dc102550 2024-09-19T06:50:55.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.791+0000 7fe7d1ffb640 1 -- 172.21.15.99:0/1592375421 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fe7d8030020 con 0x7fe7dc102550 2024-09-19T06:50:55.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.791+0000 7fe7d1ffb640 1 --2- 172.21.15.99:0/1592375421 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe7c806e530 0x7fe7c80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:50:55.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.792+0000 7fe7e0f57640 1 --2- 172.21.15.99:0/1592375421 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe7c806e530 0x7fe7c80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:50:55.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.792+0000 7fe7d1ffb640 1 -- 172.21.15.99:0/1592375421 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fe7d80ae5b0 con 0x7fe7dc102550 2024-09-19T06:50:55.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.792+0000 7fe7e0f57640 1 --2- 172.21.15.99:0/1592375421 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe7c806e530 0x7fe7c80709e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc071350 tx=0x7fe7cc00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:50:55.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:55.796+0000 7fe7d1ffb640 1 -- 172.21.15.99:0/1592375421 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fe7d80776a0 con 0x7fe7dc102550 2024-09-19T06:50:56.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:56.023+0000 7fe7e39bc640 1 -- 172.21.15.99:0/1592375421 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fe7dc0fbd50 con 0x7fe7dc102550 2024-09-19T06:50:56.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:56.023+0000 7fe7d1ffb640 1 -- 172.21.15.99:0/1592375421 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7fe7d807ad60 con 0x7fe7dc102550 2024-09-19T06:50:56.024 INFO:teuthology.orchestra.run.smithi099.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-09-19T06:50:56.025 INFO:teuthology.orchestra.run.smithi099.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-19T06:50:56.025 INFO:teuthology.orchestra.run.smithi099.stdout: fs cephfs is degraded 2024-09-19T06:50:56.025 INFO:teuthology.orchestra.run.smithi099.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-19T06:50:56.025 INFO:teuthology.orchestra.run.smithi099.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-19T06:50:56.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:56.025+0000 7fe7e39bc640 1 -- 172.21.15.99:0/1592375421 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe7c806e530 msgr2=0x7fe7c80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:56.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:56.025+0000 7fe7e39bc640 1 --2- 172.21.15.99:0/1592375421 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe7c806e530 0x7fe7c80709e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc071350 tx=0x7fe7cc00b040 comp rx=0 tx=0).stop 2024-09-19T06:50:56.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:56.025+0000 7fe7e39bc640 1 -- 172.21.15.99:0/1592375421 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7dc102550 msgr2=0x7fe7dc06fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:50:56.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:56.025+0000 7fe7e39bc640 1 --2- 172.21.15.99:0/1592375421 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7dc102550 0x7fe7dc06fa10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe7d8000c00 tx=0x7fe7d8009da0 comp rx=0 tx=0).stop 2024-09-19T06:50:56.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:56.025+0000 7fe7e39bc640 1 -- 172.21.15.99:0/1592375421 shutdown_connections 2024-09-19T06:50:56.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:56.025+0000 7fe7e39bc640 1 --2- 172.21.15.99:0/1592375421 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe7c806e530 0x7fe7c80709e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:56.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:56.025+0000 7fe7e39bc640 1 --2- 172.21.15.99:0/1592375421 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe7dc102ef0 0x7fe7dc06ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:56.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:56.025+0000 7fe7e39bc640 1 --2- 172.21.15.99:0/1592375421 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7dc102550 0x7fe7dc06fa10 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:50:56.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:56.025+0000 7fe7e39bc640 1 -- 172.21.15.99:0/1592375421 >> 172.21.15.99:0/1592375421 conn(0x7fe7dc0f80f0 msgr2=0x7fe7dc0f90b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:50:56.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:56.025+0000 7fe7e39bc640 1 -- 172.21.15.99:0/1592375421 shutdown_connections 2024-09-19T06:50:56.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:50:56.025+0000 7fe7e39bc640 1 -- 172.21.15.99:0/1592375421 wait complete. 2024-09-19T06:50:56.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:50:56 smithi117 ceph-mon[76771]: from='client.44415 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:50:56.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:50:56 smithi117 ceph-mon[76771]: from='client.34534 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:50:56.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:50:56 smithi117 ceph-mon[76771]: from='client.34538 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:50:56.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:50:56 smithi117 ceph-mon[76771]: pgmap v257: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:50:56.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:50:56 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/3045871544' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:50:56.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:50:56 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/3664656662' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:50:56.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:50:56 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/1592375421' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T06:50:56.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:50:56 smithi099 ceph-mon[97031]: from='client.44415 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:50:56.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:50:56 smithi099 ceph-mon[97031]: from='client.34534 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:50:56.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:50:56 smithi099 ceph-mon[97031]: from='client.34538 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:50:56.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:50:56 smithi099 ceph-mon[97031]: pgmap v257: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:50:56.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:50:56 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/3045871544' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:50:56.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:50:56 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/3664656662' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:50:56.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:50:56 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/1592375421' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T06:50:57.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:50:57 smithi117 ceph-mon[76771]: from='client.34550 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:50:57.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:50:57 smithi099 ceph-mon[97031]: from='client.34550 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:50:58.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:50:58 smithi117 ceph-mon[76771]: pgmap v258: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:50:58.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:50:58 smithi099 ceph-mon[97031]: pgmap v258: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:51:00.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:51:00 smithi117 ceph-mon[76771]: pgmap v259: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:51:00.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:51:00 smithi099 ceph-mon[97031]: pgmap v259: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:51:02.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:51:02 smithi117 ceph-mon[76771]: pgmap v260: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:51:02.315 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:51:02 smithi099 ceph-mon[97031]: pgmap v260: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:51:04.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:51:04 smithi117 ceph-mon[76771]: pgmap v261: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:51:04.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:51:04 smithi099 ceph-mon[97031]: pgmap v261: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:51:06.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:51:06 smithi117 ceph-mon[76771]: pgmap v262: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:51:06.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:51:06 smithi099 ceph-mon[97031]: pgmap v262: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:51:07.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:51:07 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:51:07.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:51:07 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:51:08.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:51:08 smithi117 ceph-mon[76771]: pgmap v263: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:51:08.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:51:08 smithi099 ceph-mon[97031]: pgmap v263: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:51:10.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:51:10 smithi117 ceph-mon[76771]: pgmap v264: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:51:10.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:51:10 smithi099 ceph-mon[97031]: pgmap v264: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:51:12.314 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:51:12 smithi099 ceph-mon[97031]: pgmap v265: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:51:12.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:51:12 smithi117 ceph-mon[76771]: pgmap v265: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:51:13.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:51:13 smithi099 ceph-mon[97031]: pgmap v266: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:51:13.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:51:13 smithi117 ceph-mon[76771]: pgmap v266: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:51:16.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:51:15 smithi117 ceph-mon[76771]: pgmap v267: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:51:16.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:51:15 smithi099 ceph-mon[97031]: pgmap v267: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:51:18.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:51:17 smithi117 ceph-mon[76771]: pgmap v268: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:51:18.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:51:17 smithi099 ceph-mon[97031]: pgmap v268: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:51:20.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:51:19 smithi117 ceph-mon[76771]: pgmap v269: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:51:20.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:51:19 smithi099 ceph-mon[97031]: pgmap v269: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:51:22.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:51:21 smithi117 ceph-mon[76771]: pgmap v270: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:51:22.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:51:21 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:51:22.314 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:51:21 smithi099 ceph-mon[97031]: pgmap v270: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:51:22.314 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:51:21 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:51:24.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:51:23 smithi117 ceph-mon[76771]: pgmap v271: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:51:24.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:51:23 smithi099 ceph-mon[97031]: pgmap v271: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:51:26.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.116+0000 7f4c24a49640 1 -- 172.21.15.99:0/3207112463 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4c20102550 msgr2=0x7f4c20102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:26.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.116+0000 7f4c24a49640 1 --2- 172.21.15.99:0/3207112463 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4c20102550 0x7f4c20102920 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4c080048d0 tx=0x7f4c08009da0 comp rx=0 tx=0).stop 2024-09-19T06:51:26.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.116+0000 7f4c24a49640 1 -- 172.21.15.99:0/3207112463 shutdown_connections 2024-09-19T06:51:26.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.116+0000 7f4c24a49640 1 --2- 172.21.15.99:0/3207112463 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c20102ef0 0x7f4c200fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:26.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.116+0000 7f4c24a49640 1 --2- 172.21.15.99:0/3207112463 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4c20102550 0x7f4c20102920 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:26.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.116+0000 7f4c24a49640 1 -- 172.21.15.99:0/3207112463 >> 172.21.15.99:0/3207112463 conn(0x7f4c200f80f0 msgr2=0x7f4c200fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:26.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.116+0000 7f4c24a49640 1 -- 172.21.15.99:0/3207112463 shutdown_connections 2024-09-19T06:51:26.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.116+0000 7f4c24a49640 1 -- 172.21.15.99:0/3207112463 wait complete. 2024-09-19T06:51:26.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.117+0000 7f4c24a49640 1 Processor -- start 2024-09-19T06:51:26.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.117+0000 7f4c24a49640 1 -- start start 2024-09-19T06:51:26.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.117+0000 7f4c24a49640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c20102550 0x7f4c20113570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:26.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.117+0000 7f4c24a49640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4c20102ef0 0x7f4c20113ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:26.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.117+0000 7f4c24a49640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c20114100 con 0x7f4c20102ef0 2024-09-19T06:51:26.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.117+0000 7f4c24a49640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2010d510 con 0x7f4c20102550 2024-09-19T06:51:26.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.118+0000 7f4c1dd9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4c20102ef0 0x7f4c20113ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:26.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.118+0000 7f4c1dd9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4c20102ef0 0x7f4c20113ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42156/0 (socket says 172.21.15.99:42156) 2024-09-19T06:51:26.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.118+0000 7f4c1dd9b640 1 -- 172.21.15.99:0/1784851895 learned_addr learned my addr 172.21.15.99:0/1784851895 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:51:26.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.118+0000 7f4c1e59c640 1 --2- 172.21.15.99:0/1784851895 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c20102550 0x7f4c20113570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:26.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.118+0000 7f4c1dd9b640 1 -- 172.21.15.99:0/1784851895 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c20102550 msgr2=0x7f4c20113570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:26.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.118+0000 7f4c1dd9b640 1 --2- 172.21.15.99:0/1784851895 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c20102550 0x7f4c20113570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:26.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.118+0000 7f4c1dd9b640 1 -- 172.21.15.99:0/1784851895 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c08005040 con 0x7f4c20102ef0 2024-09-19T06:51:26.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.118+0000 7f4c1dd9b640 1 --2- 172.21.15.99:0/1784851895 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4c20102ef0 0x7f4c20113ab0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4c1000c760 tx=0x7f4c1000cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:26.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.118+0000 7f4c16ffd640 1 -- 172.21.15.99:0/1784851895 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c1000a7a0 con 0x7f4c20102ef0 2024-09-19T06:51:26.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.118+0000 7f4c16ffd640 1 -- 172.21.15.99:0/1784851895 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4c1000ada0 con 0x7f4c20102ef0 2024-09-19T06:51:26.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.118+0000 7f4c16ffd640 1 -- 172.21.15.99:0/1784851895 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c100113a0 con 0x7f4c20102ef0 2024-09-19T06:51:26.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.118+0000 7f4c24a49640 1 -- 172.21.15.99:0/1784851895 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c2010d7f0 con 0x7f4c20102ef0 2024-09-19T06:51:26.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.118+0000 7f4c24a49640 1 -- 172.21.15.99:0/1784851895 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c2010dd90 con 0x7f4c20102ef0 2024-09-19T06:51:26.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.120+0000 7f4c24a49640 1 -- 172.21.15.99:0/1784851895 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c200fdcd0 con 0x7f4c20102ef0 2024-09-19T06:51:26.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.120+0000 7f4c16ffd640 1 -- 172.21.15.99:0/1784851895 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f4c10012400 con 0x7f4c20102ef0 2024-09-19T06:51:26.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.121+0000 7f4c16ffd640 1 --2- 172.21.15.99:0/1784851895 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f4c0c06e530 0x7f4c0c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:26.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.121+0000 7f4c16ffd640 1 -- 172.21.15.99:0/1784851895 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f4c1008e2a0 con 0x7f4c20102ef0 2024-09-19T06:51:26.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.121+0000 7f4c1e59c640 1 --2- 172.21.15.99:0/1784851895 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f4c0c06e530 0x7f4c0c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:26.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.121+0000 7f4c1e59c640 1 --2- 172.21.15.99:0/1784851895 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f4c0c06e530 0x7f4c0c0709e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4c08009ac0 tx=0x7f4c08035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:26.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.125+0000 7f4c16ffd640 1 -- 172.21.15.99:0/1784851895 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f4c10057410 con 0x7f4c20102ef0 2024-09-19T06:51:26.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.309+0000 7f4c24a49640 1 -- 172.21.15.99:0/1784851895 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4c201095a0 con 0x7f4c0c06e530 2024-09-19T06:51:26.310 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:51:25 smithi099 ceph-mon[97031]: pgmap v272: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:51:26.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.310+0000 7f4c16ffd640 1 -- 172.21.15.99:0/1784851895 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f4c201095a0 con 0x7f4c0c06e530 2024-09-19T06:51:26.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:51:25 smithi117 ceph-mon[76771]: pgmap v272: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:51:26.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.312+0000 7f4c24a49640 1 -- 172.21.15.99:0/1784851895 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f4c0c06e530 msgr2=0x7f4c0c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:26.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.312+0000 7f4c24a49640 1 --2- 172.21.15.99:0/1784851895 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f4c0c06e530 0x7f4c0c0709e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4c08009ac0 tx=0x7f4c08035040 comp rx=0 tx=0).stop 2024-09-19T06:51:26.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.312+0000 7f4c24a49640 1 -- 172.21.15.99:0/1784851895 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4c20102ef0 msgr2=0x7f4c20113ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:26.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.312+0000 7f4c24a49640 1 --2- 172.21.15.99:0/1784851895 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4c20102ef0 0x7f4c20113ab0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4c1000c760 tx=0x7f4c1000cb60 comp rx=0 tx=0).stop 2024-09-19T06:51:26.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.312+0000 7f4c24a49640 1 -- 172.21.15.99:0/1784851895 shutdown_connections 2024-09-19T06:51:26.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.312+0000 7f4c24a49640 1 --2- 172.21.15.99:0/1784851895 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f4c0c06e530 0x7f4c0c0709e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:26.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.312+0000 7f4c24a49640 1 --2- 172.21.15.99:0/1784851895 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4c20102ef0 0x7f4c20113ab0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:26.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.312+0000 7f4c24a49640 1 --2- 172.21.15.99:0/1784851895 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4c20102550 0x7f4c20113570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:26.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.312+0000 7f4c24a49640 1 -- 172.21.15.99:0/1784851895 >> 172.21.15.99:0/1784851895 conn(0x7f4c200f80f0 msgr2=0x7f4c200f90b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:26.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.312+0000 7f4c24a49640 1 -- 172.21.15.99:0/1784851895 shutdown_connections 2024-09-19T06:51:26.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.312+0000 7f4c24a49640 1 -- 172.21.15.99:0/1784851895 wait complete. 2024-09-19T06:51:26.322 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-09-19T06:51:26.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.392+0000 7fd9f15e5640 1 -- 172.21.15.99:0/2977847072 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9ec102550 msgr2=0x7fd9ec102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:26.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.392+0000 7fd9f15e5640 1 --2- 172.21.15.99:0/2977847072 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9ec102550 0x7fd9ec102920 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd9e4009c50 tx=0x7fd9e4004d10 comp rx=0 tx=0).stop 2024-09-19T06:51:26.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.392+0000 7fd9f15e5640 1 -- 172.21.15.99:0/2977847072 shutdown_connections 2024-09-19T06:51:26.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.392+0000 7fd9f15e5640 1 --2- 172.21.15.99:0/2977847072 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd9ec102ef0 0x7fd9ec0fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:26.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.392+0000 7fd9f15e5640 1 --2- 172.21.15.99:0/2977847072 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9ec102550 0x7fd9ec102920 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:26.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.392+0000 7fd9f15e5640 1 -- 172.21.15.99:0/2977847072 >> 172.21.15.99:0/2977847072 conn(0x7fd9ec0f80f0 msgr2=0x7fd9ec0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:26.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.392+0000 7fd9f15e5640 1 -- 172.21.15.99:0/2977847072 shutdown_connections 2024-09-19T06:51:26.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.392+0000 7fd9f15e5640 1 -- 172.21.15.99:0/2977847072 wait complete. 2024-09-19T06:51:26.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.392+0000 7fd9f15e5640 1 Processor -- start 2024-09-19T06:51:26.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.393+0000 7fd9f15e5640 1 -- start start 2024-09-19T06:51:26.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.393+0000 7fd9f15e5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9ec102550 0x7fd9ec113540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:26.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.393+0000 7fd9f15e5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd9ec102ef0 0x7fd9ec113a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:26.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.393+0000 7fd9f15e5640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ec1140d0 con 0x7fd9ec102550 2024-09-19T06:51:26.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.393+0000 7fd9f15e5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ec10d4e0 con 0x7fd9ec102ef0 2024-09-19T06:51:26.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.393+0000 7fd9eaffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9ec102550 0x7fd9ec113540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:26.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.393+0000 7fd9eaffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9ec102550 0x7fd9ec113540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42166/0 (socket says 172.21.15.99:42166) 2024-09-19T06:51:26.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.393+0000 7fd9eaffd640 1 -- 172.21.15.99:0/2188887868 learned_addr learned my addr 172.21.15.99:0/2188887868 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:51:26.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.393+0000 7fd9e27fc640 1 --2- 172.21.15.99:0/2188887868 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd9ec102ef0 0x7fd9ec113a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:26.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.393+0000 7fd9eaffd640 1 -- 172.21.15.99:0/2188887868 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd9ec102ef0 msgr2=0x7fd9ec113a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:26.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.393+0000 7fd9eaffd640 1 --2- 172.21.15.99:0/2188887868 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd9ec102ef0 0x7fd9ec113a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:26.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.393+0000 7fd9eaffd640 1 -- 172.21.15.99:0/2188887868 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9e40098b0 con 0x7fd9ec102550 2024-09-19T06:51:26.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.394+0000 7fd9eaffd640 1 --2- 172.21.15.99:0/2188887868 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9ec102550 0x7fd9ec113540 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd9e4004750 tx=0x7fd9e4004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:26.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.394+0000 7fd9e3fff640 1 -- 172.21.15.99:0/2188887868 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9e4009610 con 0x7fd9ec102550 2024-09-19T06:51:26.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.394+0000 7fd9e3fff640 1 -- 172.21.15.99:0/2188887868 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd9e4032b10 con 0x7fd9ec102550 2024-09-19T06:51:26.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.394+0000 7fd9f15e5640 1 -- 172.21.15.99:0/2188887868 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9ec10d760 con 0x7fd9ec102550 2024-09-19T06:51:26.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.394+0000 7fd9e3fff640 1 -- 172.21.15.99:0/2188887868 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9e403d990 con 0x7fd9ec102550 2024-09-19T06:51:26.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.394+0000 7fd9f15e5640 1 -- 172.21.15.99:0/2188887868 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9ec10dd00 con 0x7fd9ec102550 2024-09-19T06:51:26.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.395+0000 7fd9f15e5640 1 -- 172.21.15.99:0/2188887868 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9ec0fdcd0 con 0x7fd9ec102550 2024-09-19T06:51:26.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.395+0000 7fd9e3fff640 1 -- 172.21.15.99:0/2188887868 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fd9e402f030 con 0x7fd9ec102550 2024-09-19T06:51:26.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.396+0000 7fd9e3fff640 1 --2- 172.21.15.99:0/2188887868 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd9d806e530 0x7fd9d80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:26.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.396+0000 7fd9e27fc640 1 --2- 172.21.15.99:0/2188887868 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd9d806e530 0x7fd9d80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:26.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.396+0000 7fd9e3fff640 1 -- 172.21.15.99:0/2188887868 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fd9e40af2e0 con 0x7fd9ec102550 2024-09-19T06:51:26.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.396+0000 7fd9e27fc640 1 --2- 172.21.15.99:0/2188887868 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd9d806e530 0x7fd9d80709e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd9d4007fd0 tx=0x7fd9d4009e90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:26.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.400+0000 7fd9e3fff640 1 -- 172.21.15.99:0/2188887868 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fd9e40783d0 con 0x7fd9ec102550 2024-09-19T06:51:26.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.583+0000 7fd9f15e5640 1 -- 172.21.15.99:0/2188887868 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd9ec04b720 con 0x7fd9d806e530 2024-09-19T06:51:26.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.584+0000 7fd9e3fff640 1 -- 172.21.15.99:0/2188887868 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fd9ec04b720 con 0x7fd9d806e530 2024-09-19T06:51:26.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.586+0000 7fd9f15e5640 1 -- 172.21.15.99:0/2188887868 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd9d806e530 msgr2=0x7fd9d80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:26.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.586+0000 7fd9f15e5640 1 --2- 172.21.15.99:0/2188887868 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd9d806e530 0x7fd9d80709e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd9d4007fd0 tx=0x7fd9d4009e90 comp rx=0 tx=0).stop 2024-09-19T06:51:26.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.586+0000 7fd9f15e5640 1 -- 172.21.15.99:0/2188887868 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9ec102550 msgr2=0x7fd9ec113540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:26.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.586+0000 7fd9f15e5640 1 --2- 172.21.15.99:0/2188887868 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9ec102550 0x7fd9ec113540 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd9e4004750 tx=0x7fd9e4004d10 comp rx=0 tx=0).stop 2024-09-19T06:51:26.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.586+0000 7fd9f15e5640 1 -- 172.21.15.99:0/2188887868 shutdown_connections 2024-09-19T06:51:26.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.586+0000 7fd9f15e5640 1 --2- 172.21.15.99:0/2188887868 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd9d806e530 0x7fd9d80709e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:26.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.586+0000 7fd9f15e5640 1 --2- 172.21.15.99:0/2188887868 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd9ec102ef0 0x7fd9ec113a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:26.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.586+0000 7fd9f15e5640 1 --2- 172.21.15.99:0/2188887868 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9ec102550 0x7fd9ec113540 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:26.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.586+0000 7fd9f15e5640 1 -- 172.21.15.99:0/2188887868 >> 172.21.15.99:0/2188887868 conn(0x7fd9ec0f80f0 msgr2=0x7fd9ec0f9160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:26.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.587+0000 7fd9f15e5640 1 -- 172.21.15.99:0/2188887868 shutdown_connections 2024-09-19T06:51:26.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.587+0000 7fd9f15e5640 1 -- 172.21.15.99:0/2188887868 wait complete. 2024-09-19T06:51:26.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.664+0000 7f858f38f640 1 -- 172.21.15.99:0/2238287763 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8588102530 msgr2=0x7f8588102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:26.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.664+0000 7f858f38f640 1 --2- 172.21.15.99:0/2238287763 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8588102530 0x7f8588102900 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f857c0048d0 tx=0x7f857c009da0 comp rx=0 tx=0).stop 2024-09-19T06:51:26.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.665+0000 7f858f38f640 1 -- 172.21.15.99:0/2238287763 shutdown_connections 2024-09-19T06:51:26.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.665+0000 7f858f38f640 1 --2- 172.21.15.99:0/2238287763 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8588102ed0 0x7f85880fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:26.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.665+0000 7f858f38f640 1 --2- 172.21.15.99:0/2238287763 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8588102530 0x7f8588102900 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:26.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.665+0000 7f858f38f640 1 -- 172.21.15.99:0/2238287763 >> 172.21.15.99:0/2238287763 conn(0x7f85880f80f0 msgr2=0x7f85880fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:26.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.665+0000 7f858f38f640 1 -- 172.21.15.99:0/2238287763 shutdown_connections 2024-09-19T06:51:26.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.665+0000 7f858f38f640 1 -- 172.21.15.99:0/2238287763 wait complete. 2024-09-19T06:51:26.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.665+0000 7f858f38f640 1 Processor -- start 2024-09-19T06:51:26.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.665+0000 7f858f38f640 1 -- start start 2024-09-19T06:51:26.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.665+0000 7f858f38f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8588102530 0x7f8588113250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:26.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.665+0000 7f858f38f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8588102ed0 0x7f8588113790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:26.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.665+0000 7f858f38f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8588113e20 con 0x7f8588102ed0 2024-09-19T06:51:26.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.665+0000 7f858f38f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f858810d1d0 con 0x7f8588102530 2024-09-19T06:51:26.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.666+0000 7f858c92a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8588102ed0 0x7f8588113790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:26.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.666+0000 7f858c92a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8588102ed0 0x7f8588113790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42182/0 (socket says 172.21.15.99:42182) 2024-09-19T06:51:26.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.666+0000 7f858c92a640 1 -- 172.21.15.99:0/2180032259 learned_addr learned my addr 172.21.15.99:0/2180032259 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:51:26.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.666+0000 7f858d12b640 1 --2- 172.21.15.99:0/2180032259 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8588102530 0x7f8588113250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:26.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.666+0000 7f858c92a640 1 -- 172.21.15.99:0/2180032259 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8588102530 msgr2=0x7f8588113250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:26.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.666+0000 7f858c92a640 1 --2- 172.21.15.99:0/2180032259 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8588102530 0x7f8588113250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:26.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.666+0000 7f858c92a640 1 -- 172.21.15.99:0/2180032259 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f857c005040 con 0x7f8588102ed0 2024-09-19T06:51:26.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.666+0000 7f858c92a640 1 --2- 172.21.15.99:0/2180032259 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8588102ed0 0x7f8588113790 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f858400b540 tx=0x7f85840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:26.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.666+0000 7f8579ffb640 1 -- 172.21.15.99:0/2180032259 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f858400f6f0 con 0x7f8588102ed0 2024-09-19T06:51:26.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.666+0000 7f8579ffb640 1 -- 172.21.15.99:0/2180032259 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f858400fcf0 con 0x7f8588102ed0 2024-09-19T06:51:26.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.666+0000 7f858f38f640 1 -- 172.21.15.99:0/2180032259 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f858810d4b0 con 0x7f8588102ed0 2024-09-19T06:51:26.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.666+0000 7f8579ffb640 1 -- 172.21.15.99:0/2180032259 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8584011e80 con 0x7f8588102ed0 2024-09-19T06:51:26.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.666+0000 7f858f38f640 1 -- 172.21.15.99:0/2180032259 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f858810d9d0 con 0x7f8588102ed0 2024-09-19T06:51:26.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.667+0000 7f858f38f640 1 -- 172.21.15.99:0/2180032259 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85880fdcb0 con 0x7f8588102ed0 2024-09-19T06:51:26.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.668+0000 7f8579ffb640 1 -- 172.21.15.99:0/2180032259 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f85840116b0 con 0x7f8588102ed0 2024-09-19T06:51:26.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.668+0000 7f8579ffb640 1 --2- 172.21.15.99:0/2180032259 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f857406e530 0x7f85740709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:26.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.668+0000 7f8579ffb640 1 -- 172.21.15.99:0/2180032259 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f858408dfb0 con 0x7f8588102ed0 2024-09-19T06:51:26.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.668+0000 7f858d12b640 1 --2- 172.21.15.99:0/2180032259 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f857406e530 0x7f85740709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:26.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.669+0000 7f858d12b640 1 --2- 172.21.15.99:0/2180032259 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f857406e530 0x7f85740709e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f857c0048a0 tx=0x7f857c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:26.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.673+0000 7f8579ffb640 1 -- 172.21.15.99:0/2180032259 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f85840c3210 con 0x7f8588102ed0 2024-09-19T06:51:26.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.844+0000 7f858f38f640 1 -- 172.21.15.99:0/2180032259 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8588109640 con 0x7f857406e530 2024-09-19T06:51:26.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.852+0000 7f8579ffb640 1 -- 172.21.15.99:0/2180032259 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f8588109640 con 0x7f857406e530 2024-09-19T06:51:26.854 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T06:51:26.854 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.smithi099 smithi099 *:9093,9094 running (10m) 3m ago 18m 23.4M - 0.25.0 c8568f914cd2 e7c1774d56b0 2024-09-19T06:51:26.854 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi099 smithi099 running (6m) 3m ago 19m 6899k - 19.1.1-361-g2f599a46 d2baa855c067 b9775f416b10 2024-09-19T06:51:26.854 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi117 smithi117 running (6m) 2m ago 18m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 38cf60c0d548 2024-09-19T06:51:26.854 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.smithi099 smithi099 *:3000 running (8m) 3m ago 18m 80.7M - 9.4.12 2bacad6d85d8 cd53a18d5410 2024-09-19T06:51:26.854 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.obarqf smithi099 running (3m) 3m ago 13m 12.2M - 19.1.1-361-g2f599a46 d2baa855c067 314a73082521 2024-09-19T06:51:26.855 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.xehbxe smithi099 running (3m) 3m ago 13m 14.4M - 19.1.1-361-g2f599a46 d2baa855c067 a2955a9d06e6 2024-09-19T06:51:26.855 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.bheqzh smithi117 running (2m) 2m ago 13m 11.8M - 19.1.1-361-g2f599a46 d2baa855c067 b1505937c0b7 2024-09-19T06:51:26.855 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.nooexo smithi117 running (2m) 2m ago 13m 13.1M - 19.1.1-361-g2f599a46 d2baa855c067 35bd7725855c 2024-09-19T06:51:26.855 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi099.pgvkqi smithi099 *:8443,9283,8765 running (9m) 3m ago 20m 505M - 19.1.1-361-g2f599a46 d2baa855c067 d5de99cb7e78 2024-09-19T06:51:26.855 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi117.ssmkcf smithi117 *:8443,9283,8765 running (9m) 2m ago 18m 444M - 19.1.1-361-g2f599a46 d2baa855c067 8b7ee0f871f5 2024-09-19T06:51:26.855 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi099 smithi099 running (7m) 3m ago 20m 52.4M 2048M 19.1.1-361-g2f599a46 d2baa855c067 ffe067438824 2024-09-19T06:51:26.855 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi117 smithi117 running (7m) 2m ago 17m 38.9M 2048M 19.1.1-361-g2f599a46 d2baa855c067 4cb7455e3ee7 2024-09-19T06:51:26.855 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi099 smithi099 *:9100 running (10m) 3m ago 18m 15.0M - 1.5.0 0da6a335fe13 dca7b4517dcc 2024-09-19T06:51:26.855 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi117 smithi117 *:9100 running (10m) 2m ago 18m 15.9M - 1.5.0 0da6a335fe13 8233ce3835d2 2024-09-19T06:51:26.856 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (6m) 3m ago 17m 100M 1557M 19.1.1-361-g2f599a46 d2baa855c067 8e22543bf933 2024-09-19T06:51:26.856 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (5m) 3m ago 16m 106M 1557M 19.1.1-361-g2f599a46 d2baa855c067 f54153d0ae09 2024-09-19T06:51:26.856 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (5m) 3m ago 16m 83.7M 1557M 19.1.1-361-g2f599a46 d2baa855c067 b1778ab88870 2024-09-19T06:51:26.856 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi117 running (4m) 2m ago 15m 102M 2581M 19.1.1-361-g2f599a46 d2baa855c067 ea5236b193d3 2024-09-19T06:51:26.856 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi117 running (4m) 2m ago 15m 93.5M 2581M 19.1.1-361-g2f599a46 d2baa855c067 27ac2c859a68 2024-09-19T06:51:26.856 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi117 running (3m) 2m ago 15m 100M 2581M 19.1.1-361-g2f599a46 d2baa855c067 de6aeb8544ce 2024-09-19T06:51:26.856 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.smithi099 smithi099 *:9095 running (9m) 3m ago 18m 64.4M - 2.43.0 a07b618ecd1d 15ad26ec6fb4 2024-09-19T06:51:26.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.855+0000 7f858f38f640 1 -- 172.21.15.99:0/2180032259 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f857406e530 msgr2=0x7f85740709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:26.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.855+0000 7f858f38f640 1 --2- 172.21.15.99:0/2180032259 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f857406e530 0x7f85740709e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f857c0048a0 tx=0x7f857c035040 comp rx=0 tx=0).stop 2024-09-19T06:51:26.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.855+0000 7f858f38f640 1 -- 172.21.15.99:0/2180032259 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8588102ed0 msgr2=0x7f8588113790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:26.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.855+0000 7f858f38f640 1 --2- 172.21.15.99:0/2180032259 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8588102ed0 0x7f8588113790 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f858400b540 tx=0x7f85840091a0 comp rx=0 tx=0).stop 2024-09-19T06:51:26.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.855+0000 7f858f38f640 1 -- 172.21.15.99:0/2180032259 shutdown_connections 2024-09-19T06:51:26.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.855+0000 7f858f38f640 1 --2- 172.21.15.99:0/2180032259 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f857406e530 0x7f85740709e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:26.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.855+0000 7f858f38f640 1 --2- 172.21.15.99:0/2180032259 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8588102ed0 0x7f8588113790 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:26.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.855+0000 7f858f38f640 1 --2- 172.21.15.99:0/2180032259 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8588102530 0x7f8588113250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:26.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.855+0000 7f858f38f640 1 -- 172.21.15.99:0/2180032259 >> 172.21.15.99:0/2180032259 conn(0x7f85880f80f0 msgr2=0x7f85880f9140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:26.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.855+0000 7f858f38f640 1 -- 172.21.15.99:0/2180032259 shutdown_connections 2024-09-19T06:51:26.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.855+0000 7f858f38f640 1 -- 172.21.15.99:0/2180032259 wait complete. 2024-09-19T06:51:26.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.932+0000 7f231e5c8640 1 -- 172.21.15.99:0/221936171 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2318102530 msgr2=0x7f2318102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:26.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.932+0000 7f231e5c8640 1 --2- 172.21.15.99:0/221936171 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2318102530 0x7f2318102900 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f23080048d0 tx=0x7f2308009da0 comp rx=0 tx=0).stop 2024-09-19T06:51:26.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.932+0000 7f231e5c8640 1 -- 172.21.15.99:0/221936171 shutdown_connections 2024-09-19T06:51:26.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.932+0000 7f231e5c8640 1 --2- 172.21.15.99:0/221936171 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2318102ed0 0x7f23180fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:26.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.932+0000 7f231e5c8640 1 --2- 172.21.15.99:0/221936171 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2318102530 0x7f2318102900 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:26.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.932+0000 7f231e5c8640 1 -- 172.21.15.99:0/221936171 >> 172.21.15.99:0/221936171 conn(0x7f23180f80f0 msgr2=0x7f23180fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:26.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.932+0000 7f231e5c8640 1 -- 172.21.15.99:0/221936171 shutdown_connections 2024-09-19T06:51:26.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.932+0000 7f231e5c8640 1 -- 172.21.15.99:0/221936171 wait complete. 2024-09-19T06:51:26.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.932+0000 7f231e5c8640 1 Processor -- start 2024-09-19T06:51:26.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.933+0000 7f231e5c8640 1 -- start start 2024-09-19T06:51:26.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.933+0000 7f231e5c8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2318102530 0x7f2318113250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:26.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.933+0000 7f231e5c8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2318102ed0 0x7f2318113790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:26.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.933+0000 7f231e5c8640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2318113e20 con 0x7f2318102530 2024-09-19T06:51:26.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.933+0000 7f231e5c8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f231810d1d0 con 0x7f2318102ed0 2024-09-19T06:51:26.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.933+0000 7f2317fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2318102530 0x7f2318113250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:26.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.933+0000 7f2317fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2318102530 0x7f2318113250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42208/0 (socket says 172.21.15.99:42208) 2024-09-19T06:51:26.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.933+0000 7f2317fff640 1 -- 172.21.15.99:0/3186814946 learned_addr learned my addr 172.21.15.99:0/3186814946 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:51:26.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.933+0000 7f23177fe640 1 --2- 172.21.15.99:0/3186814946 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2318102ed0 0x7f2318113790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:26.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.933+0000 7f2317fff640 1 -- 172.21.15.99:0/3186814946 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2318102ed0 msgr2=0x7f2318113790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:26.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.933+0000 7f2317fff640 1 --2- 172.21.15.99:0/3186814946 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2318102ed0 0x7f2318113790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:26.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.933+0000 7f2317fff640 1 -- 172.21.15.99:0/3186814946 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2308005040 con 0x7f2318102530 2024-09-19T06:51:26.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.934+0000 7f2317fff640 1 --2- 172.21.15.99:0/3186814946 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2318102530 0x7f2318113250 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2308000c00 tx=0x7f2308009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:26.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.934+0000 7f2314ff9640 1 -- 172.21.15.99:0/3186814946 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2308038070 con 0x7f2318102530 2024-09-19T06:51:26.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.934+0000 7f231e5c8640 1 -- 172.21.15.99:0/3186814946 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f231810d450 con 0x7f2318102530 2024-09-19T06:51:26.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.934+0000 7f2314ff9640 1 -- 172.21.15.99:0/3186814946 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2308033ad0 con 0x7f2318102530 2024-09-19T06:51:26.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.934+0000 7f2314ff9640 1 -- 172.21.15.99:0/3186814946 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f230803db70 con 0x7f2318102530 2024-09-19T06:51:26.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.934+0000 7f231e5c8640 1 -- 172.21.15.99:0/3186814946 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f231810d970 con 0x7f2318102530 2024-09-19T06:51:26.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.935+0000 7f231e5c8640 1 -- 172.21.15.99:0/3186814946 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23180fdcb0 con 0x7f2318102530 2024-09-19T06:51:26.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.935+0000 7f2314ff9640 1 -- 172.21.15.99:0/3186814946 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f2308030020 con 0x7f2318102530 2024-09-19T06:51:26.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.936+0000 7f2314ff9640 1 --2- 172.21.15.99:0/3186814946 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f230006e530 0x7f23000709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:26.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.936+0000 7f2314ff9640 1 -- 172.21.15.99:0/3186814946 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f23080ae360 con 0x7f2318102530 2024-09-19T06:51:26.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.936+0000 7f23177fe640 1 --2- 172.21.15.99:0/3186814946 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f230006e530 0x7f23000709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:26.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.936+0000 7f23177fe640 1 --2- 172.21.15.99:0/3186814946 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f230006e530 0x7f23000709e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f231810eb10 tx=0x7f230c009120 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:26.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:26.940+0000 7f2314ff9640 1 -- 172.21.15.99:0/3186814946 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f2308077450 con 0x7f2318102530 2024-09-19T06:51:27.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.173+0000 7f231e5c8640 1 -- 172.21.15.99:0/3186814946 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f231804b780 con 0x7f2318102530 2024-09-19T06:51:27.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.174+0000 7f2314ff9640 1 -- 172.21.15.99:0/3186814946 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f230807ab10 con 0x7f2318102530 2024-09-19T06:51:27.175 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:51:27.175 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-09-19T06:51:27.175 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T06:51:27.176 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:51:27.176 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-09-19T06:51:27.176 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T06:51:27.176 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:51:27.176 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-09-19T06:51:27.176 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 6 2024-09-19T06:51:27.176 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:51:27.176 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": { 2024-09-19T06:51:27.176 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 4 2024-09-19T06:51:27.176 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:51:27.176 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-09-19T06:51:27.176 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 14 2024-09-19T06:51:27.177 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T06:51:27.177 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:51:27.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.176+0000 7f231e5c8640 1 -- 172.21.15.99:0/3186814946 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f230006e530 msgr2=0x7f23000709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:27.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.176+0000 7f231e5c8640 1 --2- 172.21.15.99:0/3186814946 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f230006e530 0x7f23000709e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f231810eb10 tx=0x7f230c009120 comp rx=0 tx=0).stop 2024-09-19T06:51:27.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.176+0000 7f231e5c8640 1 -- 172.21.15.99:0/3186814946 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2318102530 msgr2=0x7f2318113250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:27.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.176+0000 7f231e5c8640 1 --2- 172.21.15.99:0/3186814946 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2318102530 0x7f2318113250 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2308000c00 tx=0x7f2308009da0 comp rx=0 tx=0).stop 2024-09-19T06:51:27.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.176+0000 7f231e5c8640 1 -- 172.21.15.99:0/3186814946 shutdown_connections 2024-09-19T06:51:27.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.176+0000 7f231e5c8640 1 --2- 172.21.15.99:0/3186814946 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f230006e530 0x7f23000709e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:27.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.176+0000 7f231e5c8640 1 --2- 172.21.15.99:0/3186814946 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2318102ed0 0x7f2318113790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:27.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.176+0000 7f231e5c8640 1 --2- 172.21.15.99:0/3186814946 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2318102530 0x7f2318113250 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:27.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.176+0000 7f231e5c8640 1 -- 172.21.15.99:0/3186814946 >> 172.21.15.99:0/3186814946 conn(0x7f23180f80f0 msgr2=0x7f23180f9140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:27.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.177+0000 7f231e5c8640 1 -- 172.21.15.99:0/3186814946 shutdown_connections 2024-09-19T06:51:27.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.177+0000 7f231e5c8640 1 -- 172.21.15.99:0/3186814946 wait complete. 2024-09-19T06:51:27.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.255+0000 7ff9a93c5640 1 -- 172.21.15.99:0/595936889 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff9a40fb810 msgr2=0x7ff9a40fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:27.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.255+0000 7ff9a93c5640 1 --2- 172.21.15.99:0/595936889 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff9a40fb810 0x7ff9a40fbbe0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff9940048d0 tx=0x7ff994009da0 comp rx=0 tx=0).stop 2024-09-19T06:51:27.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.255+0000 7ff9a93c5640 1 -- 172.21.15.99:0/595936889 shutdown_connections 2024-09-19T06:51:27.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.255+0000 7ff9a93c5640 1 --2- 172.21.15.99:0/595936889 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9a40fcf80 0x7ff9a40fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:27.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.255+0000 7ff9a93c5640 1 --2- 172.21.15.99:0/595936889 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff9a40fb810 0x7ff9a40fbbe0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:27.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.255+0000 7ff9a93c5640 1 -- 172.21.15.99:0/595936889 >> 172.21.15.99:0/595936889 conn(0x7ff9a40723b0 msgr2=0x7ff9a40727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:27.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.255+0000 7ff9a93c5640 1 -- 172.21.15.99:0/595936889 shutdown_connections 2024-09-19T06:51:27.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.255+0000 7ff9a93c5640 1 -- 172.21.15.99:0/595936889 wait complete. 2024-09-19T06:51:27.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.256+0000 7ff9a93c5640 1 Processor -- start 2024-09-19T06:51:27.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.256+0000 7ff9a93c5640 1 -- start start 2024-09-19T06:51:27.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.256+0000 7ff9a93c5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9a40fb810 0x7ff9a4113200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:27.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.256+0000 7ff9a93c5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff9a40fcf80 0x7ff9a4113740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:27.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.256+0000 7ff9a93c5640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a4113d40 con 0x7ff9a40fcf80 2024-09-19T06:51:27.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.256+0000 7ff9a93c5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a410d180 con 0x7ff9a40fb810 2024-09-19T06:51:27.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.256+0000 7ff99bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff9a40fcf80 0x7ff9a4113740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:27.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.256+0000 7ff99bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff9a40fcf80 0x7ff9a4113740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42218/0 (socket says 172.21.15.99:42218) 2024-09-19T06:51:27.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.256+0000 7ff99bfff640 1 -- 172.21.15.99:0/1474614573 learned_addr learned my addr 172.21.15.99:0/1474614573 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:51:27.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.256+0000 7ff9a2ffd640 1 --2- 172.21.15.99:0/1474614573 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9a40fb810 0x7ff9a4113200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:27.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.257+0000 7ff99bfff640 1 -- 172.21.15.99:0/1474614573 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9a40fb810 msgr2=0x7ff9a4113200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:27.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.257+0000 7ff99bfff640 1 --2- 172.21.15.99:0/1474614573 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9a40fb810 0x7ff9a4113200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:27.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.257+0000 7ff99bfff640 1 -- 172.21.15.99:0/1474614573 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff994005040 con 0x7ff9a40fcf80 2024-09-19T06:51:27.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.257+0000 7ff9a2ffd640 1 --2- 172.21.15.99:0/1474614573 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9a40fb810 0x7ff9a4113200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:51:27.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.257+0000 7ff99bfff640 1 --2- 172.21.15.99:0/1474614573 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff9a40fcf80 0x7ff9a4113740 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff98c002a50 tx=0x7ff98c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:27.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.257+0000 7ff99b7fe640 1 -- 172.21.15.99:0/1474614573 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff98c007c30 con 0x7ff9a40fcf80 2024-09-19T06:51:27.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.257+0000 7ff9a93c5640 1 -- 172.21.15.99:0/1474614573 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9a410d460 con 0x7ff9a40fcf80 2024-09-19T06:51:27.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.257+0000 7ff99b7fe640 1 -- 172.21.15.99:0/1474614573 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff98c00f040 con 0x7ff9a40fcf80 2024-09-19T06:51:27.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.257+0000 7ff99b7fe640 1 -- 172.21.15.99:0/1474614573 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff98c00da90 con 0x7ff9a40fcf80 2024-09-19T06:51:27.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.257+0000 7ff9a93c5640 1 -- 172.21.15.99:0/1474614573 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9a410da00 con 0x7ff9a40fcf80 2024-09-19T06:51:27.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.258+0000 7ff9a93c5640 1 -- 172.21.15.99:0/1474614573 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9a40fcbc0 con 0x7ff9a40fcf80 2024-09-19T06:51:27.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.258+0000 7ff99b7fe640 1 -- 172.21.15.99:0/1474614573 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7ff98c00dd00 con 0x7ff9a40fcf80 2024-09-19T06:51:27.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.259+0000 7ff99b7fe640 1 --2- 172.21.15.99:0/1474614573 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ff99006e530 0x7ff9900709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:27.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.259+0000 7ff99b7fe640 1 -- 172.21.15.99:0/1474614573 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7ff98c08da90 con 0x7ff9a40fcf80 2024-09-19T06:51:27.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.259+0000 7ff9a2ffd640 1 --2- 172.21.15.99:0/1474614573 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ff99006e530 0x7ff9900709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:27.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.259+0000 7ff9a2ffd640 1 --2- 172.21.15.99:0/1474614573 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ff99006e530 0x7ff9900709e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff994007ac0 tx=0x7ff994035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:27.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.263+0000 7ff99b7fe640 1 -- 172.21.15.99:0/1474614573 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7ff98c056b80 con 0x7ff9a40fcf80 2024-09-19T06:51:27.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.463+0000 7ff9a93c5640 1 -- 172.21.15.99:0/1474614573 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff9a410e870 con 0x7ff9a40fcf80 2024-09-19T06:51:27.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.463+0000 7ff99b7fe640 1 -- 172.21.15.99:0/1474614573 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 29 v29) v1 ==== 76+0+1915 (secure 0 0 0) 0x7ff98c05a240 con 0x7ff9a40fcf80 2024-09-19T06:51:27.465 INFO:teuthology.orchestra.run.smithi099.stdout:e29 2024-09-19T06:51:27.465 INFO:teuthology.orchestra.run.smithi099.stdout:btime 2024-09-19T06:48:47:938420+0000 2024-09-19T06:51:27.465 INFO:teuthology.orchestra.run.smithi099.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T06:51:27.465 INFO:teuthology.orchestra.run.smithi099.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T06:51:27.465 INFO:teuthology.orchestra.run.smithi099.stdout:legacy client fscid: 1 2024-09-19T06:51:27.465 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:51:27.465 INFO:teuthology.orchestra.run.smithi099.stdout:Filesystem 'cephfs' (1) 2024-09-19T06:51:27.465 INFO:teuthology.orchestra.run.smithi099.stdout:fs_name cephfs 2024-09-19T06:51:27.465 INFO:teuthology.orchestra.run.smithi099.stdout:epoch 20 2024-09-19T06:51:27.465 INFO:teuthology.orchestra.run.smithi099.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-19T06:51:27.465 INFO:teuthology.orchestra.run.smithi099.stdout:created 2024-09-19T06:37:40.838146+0000 2024-09-19T06:51:27.466 INFO:teuthology.orchestra.run.smithi099.stdout:modified 2024-09-19T06:47:50.076553+0000 2024-09-19T06:51:27.466 INFO:teuthology.orchestra.run.smithi099.stdout:tableserver 0 2024-09-19T06:51:27.466 INFO:teuthology.orchestra.run.smithi099.stdout:root 0 2024-09-19T06:51:27.466 INFO:teuthology.orchestra.run.smithi099.stdout:session_timeout 60 2024-09-19T06:51:27.466 INFO:teuthology.orchestra.run.smithi099.stdout:session_autoclose 300 2024-09-19T06:51:27.466 INFO:teuthology.orchestra.run.smithi099.stdout:max_file_size 1099511627776 2024-09-19T06:51:27.466 INFO:teuthology.orchestra.run.smithi099.stdout:max_xattr_size 65536 2024-09-19T06:51:27.466 INFO:teuthology.orchestra.run.smithi099.stdout:required_client_features {} 2024-09-19T06:51:27.466 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure 0 2024-09-19T06:51:27.466 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure_osd_epoch 77 2024-09-19T06:51:27.466 INFO:teuthology.orchestra.run.smithi099.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T06:51:27.466 INFO:teuthology.orchestra.run.smithi099.stdout:max_mds 2 2024-09-19T06:51:27.466 INFO:teuthology.orchestra.run.smithi099.stdout:in 0,1 2024-09-19T06:51:27.467 INFO:teuthology.orchestra.run.smithi099.stdout:up {} 2024-09-19T06:51:27.467 INFO:teuthology.orchestra.run.smithi099.stdout:failed 0,1 2024-09-19T06:51:27.467 INFO:teuthology.orchestra.run.smithi099.stdout:damaged 2024-09-19T06:51:27.467 INFO:teuthology.orchestra.run.smithi099.stdout:stopped 2024-09-19T06:51:27.467 INFO:teuthology.orchestra.run.smithi099.stdout:data_pools [3] 2024-09-19T06:51:27.467 INFO:teuthology.orchestra.run.smithi099.stdout:metadata_pool 2 2024-09-19T06:51:27.467 INFO:teuthology.orchestra.run.smithi099.stdout:inline_data disabled 2024-09-19T06:51:27.467 INFO:teuthology.orchestra.run.smithi099.stdout:balancer 2024-09-19T06:51:27.467 INFO:teuthology.orchestra.run.smithi099.stdout:bal_rank_mask -1 2024-09-19T06:51:27.467 INFO:teuthology.orchestra.run.smithi099.stdout:standby_count_wanted 1 2024-09-19T06:51:27.467 INFO:teuthology.orchestra.run.smithi099.stdout:qdb_cluster leader: 0 members: 2024-09-19T06:51:27.467 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:51:27.467 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:51:27.467 INFO:teuthology.orchestra.run.smithi099.stdout:Standby daemons: 2024-09-19T06:51:27.468 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:51:27.468 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.obarqf{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6826/1859154203,v1:172.21.15.99:6827/1859154203] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:51:27.468 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.xehbxe{-1:34410} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6828/1939453719,v1:172.21.15.99:6829/1939453719] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:51:27.468 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.nooexo{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6824/1398895079,v1:172.21.15.117:6825/1398895079] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:51:27.468 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.bheqzh{-1:44329} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6826/3233337308,v1:172.21.15.117:6827/3233337308] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:51:27.469 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 29 2024-09-19T06:51:27.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.465+0000 7ff9a93c5640 1 -- 172.21.15.99:0/1474614573 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ff99006e530 msgr2=0x7ff9900709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:27.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.465+0000 7ff9a93c5640 1 --2- 172.21.15.99:0/1474614573 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ff99006e530 0x7ff9900709e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff994007ac0 tx=0x7ff994035040 comp rx=0 tx=0).stop 2024-09-19T06:51:27.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.465+0000 7ff9a93c5640 1 -- 172.21.15.99:0/1474614573 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff9a40fcf80 msgr2=0x7ff9a4113740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:27.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.465+0000 7ff9a93c5640 1 --2- 172.21.15.99:0/1474614573 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff9a40fcf80 0x7ff9a4113740 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff98c002a50 tx=0x7ff98c004600 comp rx=0 tx=0).stop 2024-09-19T06:51:27.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.465+0000 7ff9a93c5640 1 -- 172.21.15.99:0/1474614573 shutdown_connections 2024-09-19T06:51:27.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.465+0000 7ff9a93c5640 1 --2- 172.21.15.99:0/1474614573 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ff99006e530 0x7ff9900709e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:27.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.465+0000 7ff9a93c5640 1 --2- 172.21.15.99:0/1474614573 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff9a40fcf80 0x7ff9a4113740 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:27.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.465+0000 7ff9a93c5640 1 --2- 172.21.15.99:0/1474614573 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff9a40fb810 0x7ff9a4113200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:27.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.465+0000 7ff9a93c5640 1 -- 172.21.15.99:0/1474614573 >> 172.21.15.99:0/1474614573 conn(0x7ff9a40723b0 msgr2=0x7ff9a4064f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:27.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.466+0000 7ff9a93c5640 1 -- 172.21.15.99:0/1474614573 shutdown_connections 2024-09-19T06:51:27.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.466+0000 7ff9a93c5640 1 -- 172.21.15.99:0/1474614573 wait complete. 2024-09-19T06:51:27.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.545+0000 7fae9394e640 1 -- 172.21.15.99:0/3320257577 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fae8c102680 msgr2=0x7fae8c102a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:27.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.545+0000 7fae9394e640 1 --2- 172.21.15.99:0/3320257577 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fae8c102680 0x7fae8c102a50 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fae800048d0 tx=0x7fae80009da0 comp rx=0 tx=0).stop 2024-09-19T06:51:27.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.545+0000 7fae9394e640 1 -- 172.21.15.99:0/3320257577 shutdown_connections 2024-09-19T06:51:27.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.545+0000 7fae9394e640 1 --2- 172.21.15.99:0/3320257577 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae8c0facf0 0x7fae8c0fb160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:27.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.545+0000 7fae9394e640 1 --2- 172.21.15.99:0/3320257577 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fae8c102680 0x7fae8c102a50 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:27.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.545+0000 7fae9394e640 1 -- 172.21.15.99:0/3320257577 >> 172.21.15.99:0/3320257577 conn(0x7fae8c070d50 msgr2=0x7fae8c071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:27.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.545+0000 7fae9394e640 1 -- 172.21.15.99:0/3320257577 shutdown_connections 2024-09-19T06:51:27.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.545+0000 7fae9394e640 1 -- 172.21.15.99:0/3320257577 wait complete. 2024-09-19T06:51:27.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.545+0000 7fae9394e640 1 Processor -- start 2024-09-19T06:51:27.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.545+0000 7fae9394e640 1 -- start start 2024-09-19T06:51:27.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.546+0000 7fae9394e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fae8c0facf0 0x7fae8c1132b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:27.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.546+0000 7fae9394e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae8c102680 0x7fae8c1137f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:27.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.546+0000 7fae9394e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae8c113df0 con 0x7fae8c0facf0 2024-09-19T06:51:27.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.546+0000 7fae9394e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae8c10d230 con 0x7fae8c102680 2024-09-19T06:51:27.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.546+0000 7fae916ea640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fae8c0facf0 0x7fae8c1132b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:27.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.546+0000 7fae916ea640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fae8c0facf0 0x7fae8c1132b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42238/0 (socket says 172.21.15.99:42238) 2024-09-19T06:51:27.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.546+0000 7fae916ea640 1 -- 172.21.15.99:0/2517541217 learned_addr learned my addr 172.21.15.99:0/2517541217 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:51:27.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.546+0000 7fae90ee9640 1 --2- 172.21.15.99:0/2517541217 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae8c102680 0x7fae8c1137f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:27.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.546+0000 7fae916ea640 1 -- 172.21.15.99:0/2517541217 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae8c102680 msgr2=0x7fae8c1137f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:27.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.546+0000 7fae916ea640 1 --2- 172.21.15.99:0/2517541217 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae8c102680 0x7fae8c1137f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:27.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.546+0000 7fae916ea640 1 -- 172.21.15.99:0/2517541217 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae80005040 con 0x7fae8c0facf0 2024-09-19T06:51:27.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.546+0000 7fae90ee9640 1 --2- 172.21.15.99:0/2517541217 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae8c102680 0x7fae8c1137f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:51:27.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.546+0000 7fae916ea640 1 --2- 172.21.15.99:0/2517541217 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fae8c0facf0 0x7fae8c1132b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fae80003080 tx=0x7fae80009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:27.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.546+0000 7fae7dffb640 1 -- 172.21.15.99:0/2517541217 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae80038070 con 0x7fae8c0facf0 2024-09-19T06:51:27.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.546+0000 7fae7dffb640 1 -- 172.21.15.99:0/2517541217 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fae800097e0 con 0x7fae8c0facf0 2024-09-19T06:51:27.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.546+0000 7fae9394e640 1 -- 172.21.15.99:0/2517541217 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae8c10d4b0 con 0x7fae8c0facf0 2024-09-19T06:51:27.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.546+0000 7fae7dffb640 1 -- 172.21.15.99:0/2517541217 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae8003d420 con 0x7fae8c0facf0 2024-09-19T06:51:27.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.547+0000 7fae9394e640 1 -- 172.21.15.99:0/2517541217 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae8c10d970 con 0x7fae8c0facf0 2024-09-19T06:51:27.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.548+0000 7fae9394e640 1 -- 172.21.15.99:0/2517541217 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae8c0657f0 con 0x7fae8c0facf0 2024-09-19T06:51:27.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.548+0000 7fae7dffb640 1 -- 172.21.15.99:0/2517541217 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fae80030020 con 0x7fae8c0facf0 2024-09-19T06:51:27.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.548+0000 7fae7dffb640 1 --2- 172.21.15.99:0/2517541217 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fae7806e530 0x7fae780709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:27.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.549+0000 7fae7dffb640 1 -- 172.21.15.99:0/2517541217 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fae800ae720 con 0x7fae8c0facf0 2024-09-19T06:51:27.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.549+0000 7fae90ee9640 1 --2- 172.21.15.99:0/2517541217 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fae7806e530 0x7fae780709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:27.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.549+0000 7fae90ee9640 1 --2- 172.21.15.99:0/2517541217 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fae7806e530 0x7fae780709e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fae8c10eb70 tx=0x7fae88009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:27.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.553+0000 7fae7dffb640 1 -- 172.21.15.99:0/2517541217 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fae80077810 con 0x7fae8c0facf0 2024-09-19T06:51:27.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.733+0000 7fae9394e640 1 -- 172.21.15.99:0/2517541217 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fae8c04b720 con 0x7fae7806e530 2024-09-19T06:51:27.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.734+0000 7fae7dffb640 1 -- 172.21.15.99:0/2517541217 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fae8c04b720 con 0x7fae7806e530 2024-09-19T06:51:27.736 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:51:27.736 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T06:51:27.736 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": true, 2024-09-19T06:51:27.736 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T06:51:27.736 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [ 2024-09-19T06:51:27.736 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr", 2024-09-19T06:51:27.736 INFO:teuthology.orchestra.run.smithi099.stdout: "crash", 2024-09-19T06:51:27.736 INFO:teuthology.orchestra.run.smithi099.stdout: "mds", 2024-09-19T06:51:27.736 INFO:teuthology.orchestra.run.smithi099.stdout: "mon", 2024-09-19T06:51:27.736 INFO:teuthology.orchestra.run.smithi099.stdout: "osd" 2024-09-19T06:51:27.736 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-19T06:51:27.736 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": "16/21 daemons upgraded", 2024-09-19T06:51:27.737 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "Currently upgrading mds daemons", 2024-09-19T06:51:27.737 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-09-19T06:51:27.737 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:51:27.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.736+0000 7fae9394e640 1 -- 172.21.15.99:0/2517541217 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fae7806e530 msgr2=0x7fae780709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:27.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.736+0000 7fae9394e640 1 --2- 172.21.15.99:0/2517541217 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fae7806e530 0x7fae780709e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fae8c10eb70 tx=0x7fae88009040 comp rx=0 tx=0).stop 2024-09-19T06:51:27.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.736+0000 7fae9394e640 1 -- 172.21.15.99:0/2517541217 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fae8c0facf0 msgr2=0x7fae8c1132b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:27.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.736+0000 7fae9394e640 1 --2- 172.21.15.99:0/2517541217 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fae8c0facf0 0x7fae8c1132b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fae80003080 tx=0x7fae80009da0 comp rx=0 tx=0).stop 2024-09-19T06:51:27.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.737+0000 7fae9394e640 1 -- 172.21.15.99:0/2517541217 shutdown_connections 2024-09-19T06:51:27.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.737+0000 7fae9394e640 1 --2- 172.21.15.99:0/2517541217 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fae7806e530 0x7fae780709e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:27.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.737+0000 7fae9394e640 1 --2- 172.21.15.99:0/2517541217 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fae8c102680 0x7fae8c1137f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:27.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.737+0000 7fae9394e640 1 --2- 172.21.15.99:0/2517541217 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fae8c0facf0 0x7fae8c1132b0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:27.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.737+0000 7fae9394e640 1 -- 172.21.15.99:0/2517541217 >> 172.21.15.99:0/2517541217 conn(0x7fae8c070d50 msgr2=0x7fae8c0fa030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:27.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.737+0000 7fae9394e640 1 -- 172.21.15.99:0/2517541217 shutdown_connections 2024-09-19T06:51:27.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.737+0000 7fae9394e640 1 -- 172.21.15.99:0/2517541217 wait complete. 2024-09-19T06:51:27.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.815+0000 7f9873927640 1 -- 172.21.15.99:0/1563375838 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f986c0fac80 msgr2=0x7f986c0fb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:27.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.815+0000 7f9873927640 1 --2- 172.21.15.99:0/1563375838 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f986c0fac80 0x7f986c0fb0f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f98680048d0 tx=0x7f9868009da0 comp rx=0 tx=0).stop 2024-09-19T06:51:27.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.815+0000 7f9873927640 1 -- 172.21.15.99:0/1563375838 shutdown_connections 2024-09-19T06:51:27.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.815+0000 7f9873927640 1 --2- 172.21.15.99:0/1563375838 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f986c0fac80 0x7f986c0fb0f0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:27.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.815+0000 7f9873927640 1 --2- 172.21.15.99:0/1563375838 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f986c102620 0x7f986c1029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:27.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.815+0000 7f9873927640 1 -- 172.21.15.99:0/1563375838 >> 172.21.15.99:0/1563375838 conn(0x7f986c070ce0 msgr2=0x7f986c0710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:27.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.815+0000 7f9873927640 1 -- 172.21.15.99:0/1563375838 shutdown_connections 2024-09-19T06:51:27.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.815+0000 7f9873927640 1 -- 172.21.15.99:0/1563375838 wait complete. 2024-09-19T06:51:27.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.815+0000 7f9873927640 1 Processor -- start 2024-09-19T06:51:27.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.815+0000 7f9873927640 1 -- start start 2024-09-19T06:51:27.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.816+0000 7f9873927640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f986c0fac80 0x7f986c1131e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:27.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.816+0000 7f9873927640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f986c102620 0x7f986c113720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:27.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.816+0000 7f9873927640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986c113d20 con 0x7f986c0fac80 2024-09-19T06:51:27.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.816+0000 7f9873927640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986c10d160 con 0x7f986c102620 2024-09-19T06:51:27.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.816+0000 7f98716c3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f986c0fac80 0x7f986c1131e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:27.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.816+0000 7f98716c3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f986c0fac80 0x7f986c1131e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42254/0 (socket says 172.21.15.99:42254) 2024-09-19T06:51:27.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.816+0000 7f98716c3640 1 -- 172.21.15.99:0/585639044 learned_addr learned my addr 172.21.15.99:0/585639044 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:51:27.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.816+0000 7f9870ec2640 1 --2- 172.21.15.99:0/585639044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f986c102620 0x7f986c113720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:27.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.816+0000 7f98716c3640 1 -- 172.21.15.99:0/585639044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f986c102620 msgr2=0x7f986c113720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:27.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.816+0000 7f98716c3640 1 --2- 172.21.15.99:0/585639044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f986c102620 0x7f986c113720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:27.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.816+0000 7f98716c3640 1 -- 172.21.15.99:0/585639044 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9868005040 con 0x7f986c0fac80 2024-09-19T06:51:27.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.816+0000 7f9870ec2640 1 --2- 172.21.15.99:0/585639044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f986c102620 0x7f986c113720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:51:27.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.816+0000 7f98716c3640 1 --2- 172.21.15.99:0/585639044 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f986c0fac80 0x7f986c1131e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f985c00eb70 tx=0x7f985c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:27.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.816+0000 7f9861ffb640 1 -- 172.21.15.99:0/585639044 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f985c007c30 con 0x7f986c0fac80 2024-09-19T06:51:27.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.816+0000 7f9861ffb640 1 -- 172.21.15.99:0/585639044 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f985c00f040 con 0x7f986c0fac80 2024-09-19T06:51:27.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.816+0000 7f9873927640 1 -- 172.21.15.99:0/585639044 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f986c10d3e0 con 0x7f986c0fac80 2024-09-19T06:51:27.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.816+0000 7f9861ffb640 1 -- 172.21.15.99:0/585639044 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f985c0094e0 con 0x7f986c0fac80 2024-09-19T06:51:27.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.817+0000 7f9873927640 1 -- 172.21.15.99:0/585639044 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f986c10d950 con 0x7f986c0fac80 2024-09-19T06:51:27.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.818+0000 7f9873927640 1 -- 172.21.15.99:0/585639044 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f986c0657b0 con 0x7f986c0fac80 2024-09-19T06:51:27.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.818+0000 7f9861ffb640 1 -- 172.21.15.99:0/585639044 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f985c009640 con 0x7f986c0fac80 2024-09-19T06:51:27.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.818+0000 7f9861ffb640 1 --2- 172.21.15.99:0/585639044 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f985806e530 0x7f98580709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:27.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.819+0000 7f9870ec2640 1 --2- 172.21.15.99:0/585639044 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f985806e530 0x7f98580709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:27.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.819+0000 7f9861ffb640 1 -- 172.21.15.99:0/585639044 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f985c08de10 con 0x7f986c0fac80 2024-09-19T06:51:27.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.819+0000 7f9870ec2640 1 --2- 172.21.15.99:0/585639044 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f985806e530 0x7f98580709e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f986c0f8f90 tx=0x7f9868035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:27.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:27.823+0000 7f9861ffb640 1 -- 172.21.15.99:0/585639044 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f985c056f80 con 0x7f986c0fac80 2024-09-19T06:51:28.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:28.058+0000 7f9873927640 1 -- 172.21.15.99:0/585639044 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f986c04b720 con 0x7f986c0fac80 2024-09-19T06:51:28.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:28.059+0000 7f9861ffb640 1 -- 172.21.15.99:0/585639044 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7f985c05a640 con 0x7f986c0fac80 2024-09-19T06:51:28.060 INFO:teuthology.orchestra.run.smithi099.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-09-19T06:51:28.060 INFO:teuthology.orchestra.run.smithi099.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-19T06:51:28.060 INFO:teuthology.orchestra.run.smithi099.stdout: fs cephfs is degraded 2024-09-19T06:51:28.060 INFO:teuthology.orchestra.run.smithi099.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-19T06:51:28.060 INFO:teuthology.orchestra.run.smithi099.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-19T06:51:28.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:28.061+0000 7f9873927640 1 -- 172.21.15.99:0/585639044 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f985806e530 msgr2=0x7f98580709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:28.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:28.061+0000 7f9873927640 1 --2- 172.21.15.99:0/585639044 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f985806e530 0x7f98580709e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f986c0f8f90 tx=0x7f9868035040 comp rx=0 tx=0).stop 2024-09-19T06:51:28.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:28.061+0000 7f9873927640 1 -- 172.21.15.99:0/585639044 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f986c0fac80 msgr2=0x7f986c1131e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:28.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:28.061+0000 7f9873927640 1 --2- 172.21.15.99:0/585639044 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f986c0fac80 0x7f986c1131e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f985c00eb70 tx=0x7f985c00b040 comp rx=0 tx=0).stop 2024-09-19T06:51:28.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:28.061+0000 7f9873927640 1 -- 172.21.15.99:0/585639044 shutdown_connections 2024-09-19T06:51:28.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:28.061+0000 7f9873927640 1 --2- 172.21.15.99:0/585639044 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f985806e530 0x7f98580709e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:28.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:28.061+0000 7f9873927640 1 --2- 172.21.15.99:0/585639044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f986c102620 0x7f986c113720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:28.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:28.061+0000 7f9873927640 1 --2- 172.21.15.99:0/585639044 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f986c0fac80 0x7f986c1131e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:28.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:28.061+0000 7f9873927640 1 -- 172.21.15.99:0/585639044 >> 172.21.15.99:0/585639044 conn(0x7f986c070ce0 msgr2=0x7f986c105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:28.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:28.061+0000 7f9873927640 1 -- 172.21.15.99:0/585639044 shutdown_connections 2024-09-19T06:51:28.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:28.061+0000 7f9873927640 1 -- 172.21.15.99:0/585639044 wait complete. 2024-09-19T06:51:28.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:51:27 smithi117 ceph-mon[76771]: from='client.34558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:51:28.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:51:27 smithi117 ceph-mon[76771]: from='client.34562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:51:28.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:51:27 smithi117 ceph-mon[76771]: from='client.34566 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:51:28.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:51:27 smithi117 ceph-mon[76771]: pgmap v273: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:51:28.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:51:27 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/3186814946' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:51:28.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:51:27 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/1474614573' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:51:28.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:51:27 smithi099 ceph-mon[97031]: from='client.34558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:51:28.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:51:27 smithi099 ceph-mon[97031]: from='client.34562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:51:28.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:51:27 smithi099 ceph-mon[97031]: from='client.34566 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:51:28.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:51:27 smithi099 ceph-mon[97031]: pgmap v273: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:51:28.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:51:27 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/3186814946' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:51:28.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:51:27 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/1474614573' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:51:29.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:51:28 smithi117 ceph-mon[76771]: from='client.34578 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:51:29.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:51:28 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/585639044' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T06:51:29.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:51:28 smithi099 ceph-mon[97031]: from='client.34578 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:51:29.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:51:28 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/585639044' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T06:51:30.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:51:30 smithi117 ceph-mon[76771]: pgmap v274: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:51:30.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:51:29 smithi099 ceph-mon[97031]: pgmap v274: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:51:32.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:51:32 smithi117 ceph-mon[76771]: pgmap v275: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:51:32.314 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:51:32 smithi099 ceph-mon[97031]: pgmap v275: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:51:34.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:51:34 smithi117 ceph-mon[76771]: pgmap v276: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:51:34.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:51:34 smithi099 ceph-mon[97031]: pgmap v276: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:51:36.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:51:36 smithi117 ceph-mon[76771]: pgmap v277: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:51:36.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:51:36 smithi099 ceph-mon[97031]: pgmap v277: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:51:37.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:51:37 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:51:37.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:51:37 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:51:38.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:51:38 smithi117 ceph-mon[76771]: pgmap v278: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:51:38.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:51:38 smithi099 ceph-mon[97031]: pgmap v278: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:51:40.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:51:40 smithi117 ceph-mon[76771]: pgmap v279: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:51:40.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:51:40 smithi099 ceph-mon[97031]: pgmap v279: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:51:42.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:51:42 smithi117 ceph-mon[76771]: pgmap v280: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:51:42.315 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:51:42 smithi099 ceph-mon[97031]: pgmap v280: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:51:44.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:51:44 smithi117 ceph-mon[76771]: pgmap v281: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:51:44.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:51:44 smithi099 ceph-mon[97031]: pgmap v281: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:51:46.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:51:46 smithi117 ceph-mon[76771]: pgmap v282: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:51:46.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:51:46 smithi099 ceph-mon[97031]: pgmap v282: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:51:48.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:51:48 smithi117 ceph-mon[76771]: pgmap v283: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:51:48.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:51:48 smithi099 ceph-mon[97031]: pgmap v283: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:51:50.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:51:50 smithi117 ceph-mon[76771]: pgmap v284: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:51:50.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:51:50 smithi099 ceph-mon[97031]: pgmap v284: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:51:52.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:51:52 smithi117 ceph-mon[76771]: pgmap v285: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:51:52.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:51:52 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:51:52.314 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:51:52 smithi099 ceph-mon[97031]: pgmap v285: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:51:52.314 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:51:52 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:51:54.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:51:54 smithi117 ceph-mon[76771]: pgmap v286: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:51:54.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:51:54 smithi099 ceph-mon[97031]: pgmap v286: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:51:56.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:51:56 smithi117 ceph-mon[76771]: pgmap v287: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:51:56.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:51:56 smithi099 ceph-mon[97031]: pgmap v287: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:51:58.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.147+0000 7f383495f640 1 -- 172.21.15.99:0/3361700133 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f38300fb480 msgr2=0x7f38300fb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:58.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.147+0000 7f383495f640 1 --2- 172.21.15.99:0/3361700133 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f38300fb480 0x7f38300fb8f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f38240048d0 tx=0x7f3824009da0 comp rx=0 tx=0).stop 2024-09-19T06:51:58.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.147+0000 7f383495f640 1 -- 172.21.15.99:0/3361700133 shutdown_connections 2024-09-19T06:51:58.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.147+0000 7f383495f640 1 --2- 172.21.15.99:0/3361700133 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f38300fb480 0x7f38300fb8f0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:58.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.147+0000 7f383495f640 1 --2- 172.21.15.99:0/3361700133 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38301014c0 0x7f3830101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:58.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.147+0000 7f383495f640 1 -- 172.21.15.99:0/3361700133 >> 172.21.15.99:0/3361700133 conn(0x7f38300f7000 msgr2=0x7f38300f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:58.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.147+0000 7f383495f640 1 -- 172.21.15.99:0/3361700133 shutdown_connections 2024-09-19T06:51:58.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.147+0000 7f383495f640 1 -- 172.21.15.99:0/3361700133 wait complete. 2024-09-19T06:51:58.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.148+0000 7f383495f640 1 Processor -- start 2024-09-19T06:51:58.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.148+0000 7f383495f640 1 -- start start 2024-09-19T06:51:58.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.148+0000 7f383495f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38300fb480 0x7f38301120d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:58.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.148+0000 7f383495f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f38301014c0 0x7f3830112610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:58.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.148+0000 7f383495f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3830112c10 con 0x7f38301014c0 2024-09-19T06:51:58.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.148+0000 7f383495f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f383010c050 con 0x7f38300fb480 2024-09-19T06:51:58.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.148+0000 7f382dd9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f38301014c0 0x7f3830112610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:58.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.148+0000 7f382dd9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f38301014c0 0x7f3830112610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42376/0 (socket says 172.21.15.99:42376) 2024-09-19T06:51:58.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.148+0000 7f382dd9b640 1 -- 172.21.15.99:0/158287756 learned_addr learned my addr 172.21.15.99:0/158287756 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:51:58.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.148+0000 7f382e59c640 1 --2- 172.21.15.99:0/158287756 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38300fb480 0x7f38301120d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:58.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.148+0000 7f382dd9b640 1 -- 172.21.15.99:0/158287756 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38300fb480 msgr2=0x7f38301120d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:58.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.148+0000 7f382dd9b640 1 --2- 172.21.15.99:0/158287756 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38300fb480 0x7f38301120d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:58.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.148+0000 7f382dd9b640 1 -- 172.21.15.99:0/158287756 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3824005040 con 0x7f38301014c0 2024-09-19T06:51:58.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.148+0000 7f382e59c640 1 --2- 172.21.15.99:0/158287756 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38300fb480 0x7f38301120d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:51:58.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.149+0000 7f382dd9b640 1 --2- 172.21.15.99:0/158287756 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f38301014c0 0x7f3830112610 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3824000c00 tx=0x7f3824009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:58.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.149+0000 7f381effd640 1 -- 172.21.15.99:0/158287756 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3824038070 con 0x7f38301014c0 2024-09-19T06:51:58.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.149+0000 7f381effd640 1 -- 172.21.15.99:0/158287756 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f382402ade0 con 0x7f38301014c0 2024-09-19T06:51:58.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.149+0000 7f383495f640 1 -- 172.21.15.99:0/158287756 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f383010c2d0 con 0x7f38301014c0 2024-09-19T06:51:58.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.149+0000 7f381effd640 1 -- 172.21.15.99:0/158287756 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f382402c7e0 con 0x7f38301014c0 2024-09-19T06:51:58.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.149+0000 7f383495f640 1 -- 172.21.15.99:0/158287756 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f383010c810 con 0x7f38301014c0 2024-09-19T06:51:58.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.150+0000 7f383495f640 1 -- 172.21.15.99:0/158287756 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38300fcbc0 con 0x7f38301014c0 2024-09-19T06:51:58.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.151+0000 7f381effd640 1 -- 172.21.15.99:0/158287756 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f3824030020 con 0x7f38301014c0 2024-09-19T06:51:58.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.151+0000 7f381effd640 1 --2- 172.21.15.99:0/158287756 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f381806e530 0x7f38180709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:58.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.151+0000 7f382e59c640 1 --2- 172.21.15.99:0/158287756 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f381806e530 0x7f38180709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:58.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.151+0000 7f381effd640 1 -- 172.21.15.99:0/158287756 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f38240addf0 con 0x7f38301014c0 2024-09-19T06:51:58.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.152+0000 7f382e59c640 1 --2- 172.21.15.99:0/158287756 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f381806e530 0x7f38180709e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3820004d60 tx=0x7f382000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:58.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.156+0000 7f381effd640 1 -- 172.21.15.99:0/158287756 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f3824076f90 con 0x7f38301014c0 2024-09-19T06:51:58.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:51:58 smithi117 ceph-mon[76771]: pgmap v288: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:51:58.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.338+0000 7f383495f640 1 -- 172.21.15.99:0/158287756 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f38301084a0 con 0x7f381806e530 2024-09-19T06:51:58.339 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:51:58 smithi099 ceph-mon[97031]: pgmap v288: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:51:58.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.339+0000 7f381effd640 1 -- 172.21.15.99:0/158287756 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f38301084a0 con 0x7f381806e530 2024-09-19T06:51:58.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.341+0000 7f383495f640 1 -- 172.21.15.99:0/158287756 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f381806e530 msgr2=0x7f38180709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:58.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.341+0000 7f383495f640 1 --2- 172.21.15.99:0/158287756 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f381806e530 0x7f38180709e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3820004d60 tx=0x7f382000b040 comp rx=0 tx=0).stop 2024-09-19T06:51:58.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.341+0000 7f383495f640 1 -- 172.21.15.99:0/158287756 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f38301014c0 msgr2=0x7f3830112610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:58.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.341+0000 7f383495f640 1 --2- 172.21.15.99:0/158287756 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f38301014c0 0x7f3830112610 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3824000c00 tx=0x7f3824009da0 comp rx=0 tx=0).stop 2024-09-19T06:51:58.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.341+0000 7f383495f640 1 -- 172.21.15.99:0/158287756 shutdown_connections 2024-09-19T06:51:58.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.341+0000 7f383495f640 1 --2- 172.21.15.99:0/158287756 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f381806e530 0x7f38180709e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:58.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.341+0000 7f383495f640 1 --2- 172.21.15.99:0/158287756 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f38301014c0 0x7f3830112610 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:58.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.341+0000 7f383495f640 1 --2- 172.21.15.99:0/158287756 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38300fb480 0x7f38301120d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:58.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.341+0000 7f383495f640 1 -- 172.21.15.99:0/158287756 >> 172.21.15.99:0/158287756 conn(0x7f38300f7000 msgr2=0x7f38300f73d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:58.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.341+0000 7f383495f640 1 -- 172.21.15.99:0/158287756 shutdown_connections 2024-09-19T06:51:58.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.341+0000 7f383495f640 1 -- 172.21.15.99:0/158287756 wait complete. 2024-09-19T06:51:58.351 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-09-19T06:51:58.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.421+0000 7fa08fc6c640 1 -- 172.21.15.99:0/228717177 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa0880fb810 msgr2=0x7fa0880fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:58.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.421+0000 7fa08fc6c640 1 --2- 172.21.15.99:0/228717177 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa0880fb810 0x7fa0880fbbe0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa0840048d0 tx=0x7fa084009da0 comp rx=0 tx=0).stop 2024-09-19T06:51:58.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.421+0000 7fa08fc6c640 1 -- 172.21.15.99:0/228717177 shutdown_connections 2024-09-19T06:51:58.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.421+0000 7fa08fc6c640 1 --2- 172.21.15.99:0/228717177 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0880fcf80 0x7fa0880fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:58.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.421+0000 7fa08fc6c640 1 --2- 172.21.15.99:0/228717177 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa0880fb810 0x7fa0880fbbe0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:58.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.421+0000 7fa08fc6c640 1 -- 172.21.15.99:0/228717177 >> 172.21.15.99:0/228717177 conn(0x7fa0880723b0 msgr2=0x7fa0880727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:58.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.421+0000 7fa08fc6c640 1 -- 172.21.15.99:0/228717177 shutdown_connections 2024-09-19T06:51:58.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.421+0000 7fa08fc6c640 1 -- 172.21.15.99:0/228717177 wait complete. 2024-09-19T06:51:58.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.421+0000 7fa08fc6c640 1 Processor -- start 2024-09-19T06:51:58.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.421+0000 7fa08fc6c640 1 -- start start 2024-09-19T06:51:58.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.421+0000 7fa08fc6c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa0880fb810 0x7fa0881131a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:58.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.421+0000 7fa08fc6c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0880fcf80 0x7fa0881136e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:58.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.421+0000 7fa08fc6c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa088113ce0 con 0x7fa0880fb810 2024-09-19T06:51:58.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.421+0000 7fa08fc6c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa08810d120 con 0x7fa0880fcf80 2024-09-19T06:51:58.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.422+0000 7fa08da08640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa0880fb810 0x7fa0881131a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:58.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.422+0000 7fa08da08640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa0880fb810 0x7fa0881131a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42394/0 (socket says 172.21.15.99:42394) 2024-09-19T06:51:58.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.422+0000 7fa08da08640 1 -- 172.21.15.99:0/1879400269 learned_addr learned my addr 172.21.15.99:0/1879400269 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:51:58.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.422+0000 7fa08d207640 1 --2- 172.21.15.99:0/1879400269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0880fcf80 0x7fa0881136e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:58.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.422+0000 7fa08da08640 1 -- 172.21.15.99:0/1879400269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0880fcf80 msgr2=0x7fa0881136e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:58.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.422+0000 7fa08da08640 1 --2- 172.21.15.99:0/1879400269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0880fcf80 0x7fa0881136e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:58.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.422+0000 7fa08da08640 1 -- 172.21.15.99:0/1879400269 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa084005040 con 0x7fa0880fb810 2024-09-19T06:51:58.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.422+0000 7fa08da08640 1 --2- 172.21.15.99:0/1879400269 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa0880fb810 0x7fa0881131a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa0840043d0 tx=0x7fa084009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:58.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.422+0000 7fa07a7fc640 1 -- 172.21.15.99:0/1879400269 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa084038070 con 0x7fa0880fb810 2024-09-19T06:51:58.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.422+0000 7fa08fc6c640 1 -- 172.21.15.99:0/1879400269 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa08810d3a0 con 0x7fa0880fb810 2024-09-19T06:51:58.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.422+0000 7fa07a7fc640 1 -- 172.21.15.99:0/1879400269 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa0840096e0 con 0x7fa0880fb810 2024-09-19T06:51:58.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.422+0000 7fa07a7fc640 1 -- 172.21.15.99:0/1879400269 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa08403d420 con 0x7fa0880fb810 2024-09-19T06:51:58.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.422+0000 7fa08fc6c640 1 -- 172.21.15.99:0/1879400269 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa08810d8c0 con 0x7fa0880fb810 2024-09-19T06:51:58.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.423+0000 7fa08fc6c640 1 -- 172.21.15.99:0/1879400269 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0880fcbc0 con 0x7fa0880fb810 2024-09-19T06:51:58.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.424+0000 7fa07a7fc640 1 -- 172.21.15.99:0/1879400269 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fa084030020 con 0x7fa0880fb810 2024-09-19T06:51:58.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.424+0000 7fa07a7fc640 1 --2- 172.21.15.99:0/1879400269 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa07406e530 0x7fa0740709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:58.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.424+0000 7fa07a7fc640 1 -- 172.21.15.99:0/1879400269 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fa0840ae730 con 0x7fa0880fb810 2024-09-19T06:51:58.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.424+0000 7fa08d207640 1 --2- 172.21.15.99:0/1879400269 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa07406e530 0x7fa0740709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:58.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.425+0000 7fa08d207640 1 --2- 172.21.15.99:0/1879400269 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa07406e530 0x7fa0740709e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa08810ea60 tx=0x7fa07c009ed0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:58.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.429+0000 7fa07a7fc640 1 -- 172.21.15.99:0/1879400269 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fa084077820 con 0x7fa0880fb810 2024-09-19T06:51:58.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.609+0000 7fa08fc6c640 1 -- 172.21.15.99:0/1879400269 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa08804b750 con 0x7fa07406e530 2024-09-19T06:51:58.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.610+0000 7fa07a7fc640 1 -- 172.21.15.99:0/1879400269 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fa08804b750 con 0x7fa07406e530 2024-09-19T06:51:58.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.612+0000 7fa08fc6c640 1 -- 172.21.15.99:0/1879400269 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa07406e530 msgr2=0x7fa0740709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:58.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.612+0000 7fa08fc6c640 1 --2- 172.21.15.99:0/1879400269 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa07406e530 0x7fa0740709e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa08810ea60 tx=0x7fa07c009ed0 comp rx=0 tx=0).stop 2024-09-19T06:51:58.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.612+0000 7fa08fc6c640 1 -- 172.21.15.99:0/1879400269 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa0880fb810 msgr2=0x7fa0881131a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:58.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.612+0000 7fa08fc6c640 1 --2- 172.21.15.99:0/1879400269 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa0880fb810 0x7fa0881131a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa0840043d0 tx=0x7fa084009da0 comp rx=0 tx=0).stop 2024-09-19T06:51:58.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.612+0000 7fa08fc6c640 1 -- 172.21.15.99:0/1879400269 shutdown_connections 2024-09-19T06:51:58.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.612+0000 7fa08fc6c640 1 --2- 172.21.15.99:0/1879400269 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa07406e530 0x7fa0740709e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:58.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.612+0000 7fa08fc6c640 1 --2- 172.21.15.99:0/1879400269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa0880fcf80 0x7fa0881136e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:58.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.612+0000 7fa08fc6c640 1 --2- 172.21.15.99:0/1879400269 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa0880fb810 0x7fa0881131a0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:58.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.612+0000 7fa08fc6c640 1 -- 172.21.15.99:0/1879400269 >> 172.21.15.99:0/1879400269 conn(0x7fa0880723b0 msgr2=0x7fa088064f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:58.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.612+0000 7fa08fc6c640 1 -- 172.21.15.99:0/1879400269 shutdown_connections 2024-09-19T06:51:58.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.612+0000 7fa08fc6c640 1 -- 172.21.15.99:0/1879400269 wait complete. 2024-09-19T06:51:58.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.691+0000 7fe3bf6e2640 1 -- 172.21.15.99:0/850917037 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3b8102ef0 msgr2=0x7fe3b80fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:58.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.691+0000 7fe3bf6e2640 1 --2- 172.21.15.99:0/850917037 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3b8102ef0 0x7fe3b80fc5b0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac0048d0 tx=0x7fe3ac009da0 comp rx=0 tx=0).stop 2024-09-19T06:51:58.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.691+0000 7fe3bf6e2640 1 -- 172.21.15.99:0/850917037 shutdown_connections 2024-09-19T06:51:58.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.691+0000 7fe3bf6e2640 1 --2- 172.21.15.99:0/850917037 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3b8102ef0 0x7fe3b80fc5b0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:58.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.691+0000 7fe3bf6e2640 1 --2- 172.21.15.99:0/850917037 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3b8102550 0x7fe3b8102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:58.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.691+0000 7fe3bf6e2640 1 -- 172.21.15.99:0/850917037 >> 172.21.15.99:0/850917037 conn(0x7fe3b80f80f0 msgr2=0x7fe3b80fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:58.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.692+0000 7fe3bf6e2640 1 -- 172.21.15.99:0/850917037 shutdown_connections 2024-09-19T06:51:58.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.692+0000 7fe3bf6e2640 1 -- 172.21.15.99:0/850917037 wait complete. 2024-09-19T06:51:58.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.692+0000 7fe3bf6e2640 1 Processor -- start 2024-09-19T06:51:58.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.692+0000 7fe3bf6e2640 1 -- start start 2024-09-19T06:51:58.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.692+0000 7fe3bf6e2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3b8102550 0x7fe3b8113500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:58.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.692+0000 7fe3bf6e2640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3b8102ef0 0x7fe3b8113a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:58.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.692+0000 7fe3bf6e2640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b8114090 con 0x7fe3b8102ef0 2024-09-19T06:51:58.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.692+0000 7fe3bf6e2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b810d4a0 con 0x7fe3b8102550 2024-09-19T06:51:58.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.692+0000 7fe3bcc7d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3b8102ef0 0x7fe3b8113a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:58.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.692+0000 7fe3bcc7d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3b8102ef0 0x7fe3b8113a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42412/0 (socket says 172.21.15.99:42412) 2024-09-19T06:51:58.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.692+0000 7fe3bcc7d640 1 -- 172.21.15.99:0/3466877760 learned_addr learned my addr 172.21.15.99:0/3466877760 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:51:58.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.693+0000 7fe3bd47e640 1 --2- 172.21.15.99:0/3466877760 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3b8102550 0x7fe3b8113500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:58.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.693+0000 7fe3bcc7d640 1 -- 172.21.15.99:0/3466877760 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3b8102550 msgr2=0x7fe3b8113500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:58.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.693+0000 7fe3bcc7d640 1 --2- 172.21.15.99:0/3466877760 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3b8102550 0x7fe3b8113500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:58.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.693+0000 7fe3bcc7d640 1 -- 172.21.15.99:0/3466877760 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3ac005040 con 0x7fe3b8102ef0 2024-09-19T06:51:58.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.693+0000 7fe3bcc7d640 1 --2- 172.21.15.99:0/3466877760 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3b8102ef0 0x7fe3b8113a40 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac003080 tx=0x7fe3ac009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:58.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.693+0000 7fe3b5ffb640 1 -- 172.21.15.99:0/3466877760 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe3ac038070 con 0x7fe3b8102ef0 2024-09-19T06:51:58.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.693+0000 7fe3b5ffb640 1 -- 172.21.15.99:0/3466877760 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe3ac009760 con 0x7fe3b8102ef0 2024-09-19T06:51:58.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.693+0000 7fe3b5ffb640 1 -- 172.21.15.99:0/3466877760 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe3ac033420 con 0x7fe3b8102ef0 2024-09-19T06:51:58.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.693+0000 7fe3bf6e2640 1 -- 172.21.15.99:0/3466877760 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3b810d720 con 0x7fe3b8102ef0 2024-09-19T06:51:58.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.693+0000 7fe3bf6e2640 1 -- 172.21.15.99:0/3466877760 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3b810dc00 con 0x7fe3b8102ef0 2024-09-19T06:51:58.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.694+0000 7fe3bf6e2640 1 -- 172.21.15.99:0/3466877760 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3b80fdcd0 con 0x7fe3b8102ef0 2024-09-19T06:51:58.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.695+0000 7fe3b5ffb640 1 -- 172.21.15.99:0/3466877760 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fe3ac030020 con 0x7fe3b8102ef0 2024-09-19T06:51:58.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.695+0000 7fe3b5ffb640 1 --2- 172.21.15.99:0/3466877760 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe3a006e530 0x7fe3a00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:58.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.696+0000 7fe3b5ffb640 1 -- 172.21.15.99:0/3466877760 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fe3ac0add20 con 0x7fe3b8102ef0 2024-09-19T06:51:58.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.696+0000 7fe3bd47e640 1 --2- 172.21.15.99:0/3466877760 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe3a006e530 0x7fe3a00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:58.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.696+0000 7fe3bd47e640 1 --2- 172.21.15.99:0/3466877760 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe3a006e530 0x7fe3a00709e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe3a8007fd0 tx=0x7fe3a8009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:58.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.700+0000 7fe3b5ffb640 1 -- 172.21.15.99:0/3466877760 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fe3ac076e90 con 0x7fe3b8102ef0 2024-09-19T06:51:58.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.873+0000 7fe3bf6e2640 1 -- 172.21.15.99:0/3466877760 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe3b8109560 con 0x7fe3a006e530 2024-09-19T06:51:58.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.882+0000 7fe3b5ffb640 1 -- 172.21.15.99:0/3466877760 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7fe3b8109560 con 0x7fe3a006e530 2024-09-19T06:51:58.883 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T06:51:58.884 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.smithi099 smithi099 *:9093,9094 running (11m) 3m ago 19m 23.4M - 0.25.0 c8568f914cd2 e7c1774d56b0 2024-09-19T06:51:58.884 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi099 smithi099 running (7m) 3m ago 19m 6899k - 19.1.1-361-g2f599a46 d2baa855c067 b9775f416b10 2024-09-19T06:51:58.884 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi117 smithi117 running (7m) 3m ago 18m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 38cf60c0d548 2024-09-19T06:51:58.884 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.smithi099 smithi099 *:3000 running (9m) 3m ago 19m 80.7M - 9.4.12 2bacad6d85d8 cd53a18d5410 2024-09-19T06:51:58.884 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.obarqf smithi099 running (4m) 3m ago 14m 12.2M - 19.1.1-361-g2f599a46 d2baa855c067 314a73082521 2024-09-19T06:51:58.884 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.xehbxe smithi099 running (3m) 3m ago 14m 14.4M - 19.1.1-361-g2f599a46 d2baa855c067 a2955a9d06e6 2024-09-19T06:51:58.884 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.bheqzh smithi117 running (3m) 3m ago 14m 11.8M - 19.1.1-361-g2f599a46 d2baa855c067 b1505937c0b7 2024-09-19T06:51:58.884 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.nooexo smithi117 running (3m) 3m ago 14m 13.1M - 19.1.1-361-g2f599a46 d2baa855c067 35bd7725855c 2024-09-19T06:51:58.884 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi099.pgvkqi smithi099 *:8443,9283,8765 running (10m) 3m ago 20m 505M - 19.1.1-361-g2f599a46 d2baa855c067 d5de99cb7e78 2024-09-19T06:51:58.884 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi117.ssmkcf smithi117 *:8443,9283,8765 running (9m) 3m ago 18m 444M - 19.1.1-361-g2f599a46 d2baa855c067 8b7ee0f871f5 2024-09-19T06:51:58.884 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi099 smithi099 running (8m) 3m ago 20m 52.4M 2048M 19.1.1-361-g2f599a46 d2baa855c067 ffe067438824 2024-09-19T06:51:58.884 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi117 smithi117 running (8m) 3m ago 18m 38.9M 2048M 19.1.1-361-g2f599a46 d2baa855c067 4cb7455e3ee7 2024-09-19T06:51:58.884 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi099 smithi099 *:9100 running (11m) 3m ago 19m 15.0M - 1.5.0 0da6a335fe13 dca7b4517dcc 2024-09-19T06:51:58.885 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi117 smithi117 *:9100 running (10m) 3m ago 18m 15.9M - 1.5.0 0da6a335fe13 8233ce3835d2 2024-09-19T06:51:58.885 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (7m) 3m ago 17m 100M 1557M 19.1.1-361-g2f599a46 d2baa855c067 8e22543bf933 2024-09-19T06:51:58.885 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (6m) 3m ago 17m 106M 1557M 19.1.1-361-g2f599a46 d2baa855c067 f54153d0ae09 2024-09-19T06:51:58.885 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (5m) 3m ago 16m 83.7M 1557M 19.1.1-361-g2f599a46 d2baa855c067 b1778ab88870 2024-09-19T06:51:58.885 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi117 running (5m) 3m ago 16m 102M 2581M 19.1.1-361-g2f599a46 d2baa855c067 ea5236b193d3 2024-09-19T06:51:58.885 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi117 running (4m) 3m ago 16m 93.5M 2581M 19.1.1-361-g2f599a46 d2baa855c067 27ac2c859a68 2024-09-19T06:51:58.885 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi117 running (4m) 3m ago 15m 100M 2581M 19.1.1-361-g2f599a46 d2baa855c067 de6aeb8544ce 2024-09-19T06:51:58.885 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.smithi099 smithi099 *:9095 running (9m) 3m ago 18m 64.4M - 2.43.0 a07b618ecd1d 15ad26ec6fb4 2024-09-19T06:51:58.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.884+0000 7fe3bf6e2640 1 -- 172.21.15.99:0/3466877760 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe3a006e530 msgr2=0x7fe3a00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:58.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.884+0000 7fe3bf6e2640 1 --2- 172.21.15.99:0/3466877760 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe3a006e530 0x7fe3a00709e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe3a8007fd0 tx=0x7fe3a8009040 comp rx=0 tx=0).stop 2024-09-19T06:51:58.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.884+0000 7fe3bf6e2640 1 -- 172.21.15.99:0/3466877760 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3b8102ef0 msgr2=0x7fe3b8113a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:58.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.884+0000 7fe3bf6e2640 1 --2- 172.21.15.99:0/3466877760 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3b8102ef0 0x7fe3b8113a40 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac003080 tx=0x7fe3ac009da0 comp rx=0 tx=0).stop 2024-09-19T06:51:58.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.884+0000 7fe3bf6e2640 1 -- 172.21.15.99:0/3466877760 shutdown_connections 2024-09-19T06:51:58.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.884+0000 7fe3bf6e2640 1 --2- 172.21.15.99:0/3466877760 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe3a006e530 0x7fe3a00709e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:58.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.884+0000 7fe3bf6e2640 1 --2- 172.21.15.99:0/3466877760 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3b8102ef0 0x7fe3b8113a40 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:58.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.884+0000 7fe3bf6e2640 1 --2- 172.21.15.99:0/3466877760 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3b8102550 0x7fe3b8113500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:58.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.884+0000 7fe3bf6e2640 1 -- 172.21.15.99:0/3466877760 >> 172.21.15.99:0/3466877760 conn(0x7fe3b80f80f0 msgr2=0x7fe3b80f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:58.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.885+0000 7fe3bf6e2640 1 -- 172.21.15.99:0/3466877760 shutdown_connections 2024-09-19T06:51:58.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.885+0000 7fe3bf6e2640 1 -- 172.21.15.99:0/3466877760 wait complete. 2024-09-19T06:51:58.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.962+0000 7fc74612b640 1 -- 172.21.15.99:0/32527499 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc7401014e0 msgr2=0x7fc7401018b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:58.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.962+0000 7fc74612b640 1 --2- 172.21.15.99:0/32527499 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc7401014e0 0x7fc7401018b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc7300048d0 tx=0x7fc730009da0 comp rx=0 tx=0).stop 2024-09-19T06:51:58.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.962+0000 7fc74612b640 1 -- 172.21.15.99:0/32527499 shutdown_connections 2024-09-19T06:51:58.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.962+0000 7fc74612b640 1 --2- 172.21.15.99:0/32527499 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7400fb4a0 0x7fc7400fb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:58.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.962+0000 7fc74612b640 1 --2- 172.21.15.99:0/32527499 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc7401014e0 0x7fc7401018b0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:58.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.962+0000 7fc74612b640 1 -- 172.21.15.99:0/32527499 >> 172.21.15.99:0/32527499 conn(0x7fc7400f70a0 msgr2=0x7fc7400f94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:58.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.962+0000 7fc74612b640 1 -- 172.21.15.99:0/32527499 shutdown_connections 2024-09-19T06:51:58.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.962+0000 7fc74612b640 1 -- 172.21.15.99:0/32527499 wait complete. 2024-09-19T06:51:58.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.963+0000 7fc74612b640 1 Processor -- start 2024-09-19T06:51:58.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.963+0000 7fc74612b640 1 -- start start 2024-09-19T06:51:58.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.963+0000 7fc74612b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc7400fb4a0 0x7fc740113230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:58.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.963+0000 7fc74612b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7401014e0 0x7fc740113770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:58.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.963+0000 7fc74612b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc740113d70 con 0x7fc7400fb4a0 2024-09-19T06:51:58.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.963+0000 7fc74612b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc74010d1b0 con 0x7fc7401014e0 2024-09-19T06:51:58.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.963+0000 7fc73f7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc7400fb4a0 0x7fc740113230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:58.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.963+0000 7fc73f7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc7400fb4a0 0x7fc740113230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42424/0 (socket says 172.21.15.99:42424) 2024-09-19T06:51:58.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.963+0000 7fc73f7fe640 1 -- 172.21.15.99:0/1416968696 learned_addr learned my addr 172.21.15.99:0/1416968696 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:51:58.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.964+0000 7fc73effd640 1 --2- 172.21.15.99:0/1416968696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7401014e0 0x7fc740113770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:58.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.964+0000 7fc73f7fe640 1 -- 172.21.15.99:0/1416968696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7401014e0 msgr2=0x7fc740113770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:58.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.964+0000 7fc73f7fe640 1 --2- 172.21.15.99:0/1416968696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7401014e0 0x7fc740113770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:58.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.964+0000 7fc73f7fe640 1 -- 172.21.15.99:0/1416968696 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc730005040 con 0x7fc7400fb4a0 2024-09-19T06:51:58.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.964+0000 7fc73effd640 1 --2- 172.21.15.99:0/1416968696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7401014e0 0x7fc740113770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:51:58.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.964+0000 7fc73f7fe640 1 --2- 172.21.15.99:0/1416968696 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc7400fb4a0 0x7fc740113230 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc730000c00 tx=0x7fc730009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:58.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.964+0000 7fc727fff640 1 -- 172.21.15.99:0/1416968696 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc730038070 con 0x7fc7400fb4a0 2024-09-19T06:51:58.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.964+0000 7fc727fff640 1 -- 172.21.15.99:0/1416968696 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc73002ade0 con 0x7fc7400fb4a0 2024-09-19T06:51:58.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.964+0000 7fc74612b640 1 -- 172.21.15.99:0/1416968696 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc74010d430 con 0x7fc7400fb4a0 2024-09-19T06:51:58.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.964+0000 7fc727fff640 1 -- 172.21.15.99:0/1416968696 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc73002c7e0 con 0x7fc7400fb4a0 2024-09-19T06:51:58.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.964+0000 7fc74612b640 1 -- 172.21.15.99:0/1416968696 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc74010d8f0 con 0x7fc7400fb4a0 2024-09-19T06:51:58.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.965+0000 7fc74612b640 1 -- 172.21.15.99:0/1416968696 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7400fcbe0 con 0x7fc7400fb4a0 2024-09-19T06:51:58.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.965+0000 7fc727fff640 1 -- 172.21.15.99:0/1416968696 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fc730030020 con 0x7fc7400fb4a0 2024-09-19T06:51:58.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.966+0000 7fc727fff640 1 --2- 172.21.15.99:0/1416968696 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fc72806e530 0x7fc7280709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:58.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.966+0000 7fc727fff640 1 -- 172.21.15.99:0/1416968696 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fc7300adce0 con 0x7fc7400fb4a0 2024-09-19T06:51:58.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.966+0000 7fc73effd640 1 --2- 172.21.15.99:0/1416968696 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fc72806e530 0x7fc7280709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:58.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.966+0000 7fc73effd640 1 --2- 172.21.15.99:0/1416968696 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fc72806e530 0x7fc7280709e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc734009af0 tx=0x7fc73400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:58.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:58.970+0000 7fc727fff640 1 -- 172.21.15.99:0/1416968696 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fc7300b2070 con 0x7fc7400fb4a0 2024-09-19T06:51:59.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.202+0000 7fc74612b640 1 -- 172.21.15.99:0/1416968696 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc74004b720 con 0x7fc7400fb4a0 2024-09-19T06:51:59.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.203+0000 7fc727fff640 1 -- 172.21.15.99:0/1416968696 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7fc730076f00 con 0x7fc7400fb4a0 2024-09-19T06:51:59.204 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:51:59.204 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-09-19T06:51:59.205 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T06:51:59.205 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:51:59.205 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-09-19T06:51:59.205 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T06:51:59.205 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:51:59.205 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-09-19T06:51:59.205 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 6 2024-09-19T06:51:59.205 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:51:59.205 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": { 2024-09-19T06:51:59.205 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 4 2024-09-19T06:51:59.205 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:51:59.205 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-09-19T06:51:59.205 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 14 2024-09-19T06:51:59.206 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T06:51:59.206 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:51:59.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.205+0000 7fc74612b640 1 -- 172.21.15.99:0/1416968696 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fc72806e530 msgr2=0x7fc7280709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:59.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.205+0000 7fc74612b640 1 --2- 172.21.15.99:0/1416968696 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fc72806e530 0x7fc7280709e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc734009af0 tx=0x7fc73400b040 comp rx=0 tx=0).stop 2024-09-19T06:51:59.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.205+0000 7fc74612b640 1 -- 172.21.15.99:0/1416968696 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc7400fb4a0 msgr2=0x7fc740113230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:59.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.205+0000 7fc74612b640 1 --2- 172.21.15.99:0/1416968696 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc7400fb4a0 0x7fc740113230 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc730000c00 tx=0x7fc730009da0 comp rx=0 tx=0).stop 2024-09-19T06:51:59.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.205+0000 7fc74612b640 1 -- 172.21.15.99:0/1416968696 shutdown_connections 2024-09-19T06:51:59.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.205+0000 7fc74612b640 1 --2- 172.21.15.99:0/1416968696 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fc72806e530 0x7fc7280709e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:59.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.205+0000 7fc74612b640 1 --2- 172.21.15.99:0/1416968696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7401014e0 0x7fc740113770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:59.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.205+0000 7fc74612b640 1 --2- 172.21.15.99:0/1416968696 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc7400fb4a0 0x7fc740113230 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:59.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.205+0000 7fc74612b640 1 -- 172.21.15.99:0/1416968696 >> 172.21.15.99:0/1416968696 conn(0x7fc7400f70a0 msgr2=0x7fc7401052d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:59.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.206+0000 7fc74612b640 1 -- 172.21.15.99:0/1416968696 shutdown_connections 2024-09-19T06:51:59.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.206+0000 7fc74612b640 1 -- 172.21.15.99:0/1416968696 wait complete. 2024-09-19T06:51:59.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.283+0000 7fe2ea27b640 1 -- 172.21.15.99:0/602255277 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe2e4102ef0 msgr2=0x7fe2e40fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:59.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.283+0000 7fe2ea27b640 1 --2- 172.21.15.99:0/602255277 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe2e4102ef0 0x7fe2e40fc5b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe2d80048d0 tx=0x7fe2d8009da0 comp rx=0 tx=0).stop 2024-09-19T06:51:59.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.283+0000 7fe2ea27b640 1 -- 172.21.15.99:0/602255277 shutdown_connections 2024-09-19T06:51:59.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.283+0000 7fe2ea27b640 1 --2- 172.21.15.99:0/602255277 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe2e4102ef0 0x7fe2e40fc5b0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:59.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.283+0000 7fe2ea27b640 1 --2- 172.21.15.99:0/602255277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2e4102550 0x7fe2e4102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:59.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.283+0000 7fe2ea27b640 1 -- 172.21.15.99:0/602255277 >> 172.21.15.99:0/602255277 conn(0x7fe2e40f80f0 msgr2=0x7fe2e40fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:59.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.283+0000 7fe2ea27b640 1 -- 172.21.15.99:0/602255277 shutdown_connections 2024-09-19T06:51:59.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.283+0000 7fe2ea27b640 1 -- 172.21.15.99:0/602255277 wait complete. 2024-09-19T06:51:59.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.283+0000 7fe2ea27b640 1 Processor -- start 2024-09-19T06:51:59.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.284+0000 7fe2ea27b640 1 -- start start 2024-09-19T06:51:59.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.284+0000 7fe2ea27b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe2e4102550 0x7fe2e4113520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:59.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.284+0000 7fe2ea27b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2e4102ef0 0x7fe2e4113a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:59.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.284+0000 7fe2ea27b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e41140b0 con 0x7fe2e4102550 2024-09-19T06:51:59.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.284+0000 7fe2ea27b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e410d4c0 con 0x7fe2e4102ef0 2024-09-19T06:51:59.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.284+0000 7fe2e3fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe2e4102550 0x7fe2e4113520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:59.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.284+0000 7fe2e3fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe2e4102550 0x7fe2e4113520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42430/0 (socket says 172.21.15.99:42430) 2024-09-19T06:51:59.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.284+0000 7fe2e3fff640 1 -- 172.21.15.99:0/2616100351 learned_addr learned my addr 172.21.15.99:0/2616100351 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:51:59.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.284+0000 7fe2e37fe640 1 --2- 172.21.15.99:0/2616100351 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2e4102ef0 0x7fe2e4113a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:59.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.284+0000 7fe2e3fff640 1 -- 172.21.15.99:0/2616100351 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2e4102ef0 msgr2=0x7fe2e4113a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:59.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.284+0000 7fe2e3fff640 1 --2- 172.21.15.99:0/2616100351 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2e4102ef0 0x7fe2e4113a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:59.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.284+0000 7fe2e3fff640 1 -- 172.21.15.99:0/2616100351 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d8005040 con 0x7fe2e4102550 2024-09-19T06:51:59.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.285+0000 7fe2e3fff640 1 --2- 172.21.15.99:0/2616100351 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe2e4102550 0x7fe2e4113520 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe2d4002a50 tx=0x7fe2d4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:59.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.285+0000 7fe2e0ff9640 1 -- 172.21.15.99:0/2616100351 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2d4007c30 con 0x7fe2e4102550 2024-09-19T06:51:59.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.285+0000 7fe2e0ff9640 1 -- 172.21.15.99:0/2616100351 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe2d400f040 con 0x7fe2e4102550 2024-09-19T06:51:59.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.285+0000 7fe2ea27b640 1 -- 172.21.15.99:0/2616100351 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2e410d7a0 con 0x7fe2e4102550 2024-09-19T06:51:59.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.285+0000 7fe2e0ff9640 1 -- 172.21.15.99:0/2616100351 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2d400da10 con 0x7fe2e4102550 2024-09-19T06:51:59.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.285+0000 7fe2ea27b640 1 -- 172.21.15.99:0/2616100351 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2e410dd10 con 0x7fe2e4102550 2024-09-19T06:51:59.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.286+0000 7fe2ea27b640 1 -- 172.21.15.99:0/2616100351 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2e40fdcd0 con 0x7fe2e4102550 2024-09-19T06:51:59.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.286+0000 7fe2e0ff9640 1 -- 172.21.15.99:0/2616100351 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fe2d400dc80 con 0x7fe2e4102550 2024-09-19T06:51:59.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.287+0000 7fe2e0ff9640 1 --2- 172.21.15.99:0/2616100351 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe2cc06e530 0x7fe2cc0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:59.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.287+0000 7fe2e0ff9640 1 -- 172.21.15.99:0/2616100351 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fe2d408d970 con 0x7fe2e4102550 2024-09-19T06:51:59.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.287+0000 7fe2e37fe640 1 --2- 172.21.15.99:0/2616100351 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe2cc06e530 0x7fe2cc0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:59.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.287+0000 7fe2e37fe640 1 --2- 172.21.15.99:0/2616100351 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe2cc06e530 0x7fe2cc0709e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe2d80048a0 tx=0x7fe2d8035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:59.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.291+0000 7fe2e0ff9640 1 -- 172.21.15.99:0/2616100351 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fe2d4056b10 con 0x7fe2e4102550 2024-09-19T06:51:59.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.490+0000 7fe2ea27b640 1 -- 172.21.15.99:0/2616100351 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe2e404b720 con 0x7fe2e4102550 2024-09-19T06:51:59.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.490+0000 7fe2e0ff9640 1 -- 172.21.15.99:0/2616100351 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 29 v29) v1 ==== 76+0+1915 (secure 0 0 0) 0x7fe2d405a1d0 con 0x7fe2e4102550 2024-09-19T06:51:59.492 INFO:teuthology.orchestra.run.smithi099.stdout:e29 2024-09-19T06:51:59.492 INFO:teuthology.orchestra.run.smithi099.stdout:btime 2024-09-19T06:48:47:938420+0000 2024-09-19T06:51:59.492 INFO:teuthology.orchestra.run.smithi099.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T06:51:59.492 INFO:teuthology.orchestra.run.smithi099.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T06:51:59.492 INFO:teuthology.orchestra.run.smithi099.stdout:legacy client fscid: 1 2024-09-19T06:51:59.492 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:51:59.492 INFO:teuthology.orchestra.run.smithi099.stdout:Filesystem 'cephfs' (1) 2024-09-19T06:51:59.492 INFO:teuthology.orchestra.run.smithi099.stdout:fs_name cephfs 2024-09-19T06:51:59.492 INFO:teuthology.orchestra.run.smithi099.stdout:epoch 20 2024-09-19T06:51:59.492 INFO:teuthology.orchestra.run.smithi099.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-19T06:51:59.492 INFO:teuthology.orchestra.run.smithi099.stdout:created 2024-09-19T06:37:40.838146+0000 2024-09-19T06:51:59.492 INFO:teuthology.orchestra.run.smithi099.stdout:modified 2024-09-19T06:47:50.076553+0000 2024-09-19T06:51:59.493 INFO:teuthology.orchestra.run.smithi099.stdout:tableserver 0 2024-09-19T06:51:59.493 INFO:teuthology.orchestra.run.smithi099.stdout:root 0 2024-09-19T06:51:59.493 INFO:teuthology.orchestra.run.smithi099.stdout:session_timeout 60 2024-09-19T06:51:59.493 INFO:teuthology.orchestra.run.smithi099.stdout:session_autoclose 300 2024-09-19T06:51:59.493 INFO:teuthology.orchestra.run.smithi099.stdout:max_file_size 1099511627776 2024-09-19T06:51:59.493 INFO:teuthology.orchestra.run.smithi099.stdout:max_xattr_size 65536 2024-09-19T06:51:59.493 INFO:teuthology.orchestra.run.smithi099.stdout:required_client_features {} 2024-09-19T06:51:59.493 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure 0 2024-09-19T06:51:59.493 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure_osd_epoch 77 2024-09-19T06:51:59.493 INFO:teuthology.orchestra.run.smithi099.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T06:51:59.493 INFO:teuthology.orchestra.run.smithi099.stdout:max_mds 2 2024-09-19T06:51:59.493 INFO:teuthology.orchestra.run.smithi099.stdout:in 0,1 2024-09-19T06:51:59.493 INFO:teuthology.orchestra.run.smithi099.stdout:up {} 2024-09-19T06:51:59.494 INFO:teuthology.orchestra.run.smithi099.stdout:failed 0,1 2024-09-19T06:51:59.494 INFO:teuthology.orchestra.run.smithi099.stdout:damaged 2024-09-19T06:51:59.494 INFO:teuthology.orchestra.run.smithi099.stdout:stopped 2024-09-19T06:51:59.494 INFO:teuthology.orchestra.run.smithi099.stdout:data_pools [3] 2024-09-19T06:51:59.494 INFO:teuthology.orchestra.run.smithi099.stdout:metadata_pool 2 2024-09-19T06:51:59.494 INFO:teuthology.orchestra.run.smithi099.stdout:inline_data disabled 2024-09-19T06:51:59.494 INFO:teuthology.orchestra.run.smithi099.stdout:balancer 2024-09-19T06:51:59.494 INFO:teuthology.orchestra.run.smithi099.stdout:bal_rank_mask -1 2024-09-19T06:51:59.494 INFO:teuthology.orchestra.run.smithi099.stdout:standby_count_wanted 1 2024-09-19T06:51:59.494 INFO:teuthology.orchestra.run.smithi099.stdout:qdb_cluster leader: 0 members: 2024-09-19T06:51:59.494 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:51:59.494 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:51:59.495 INFO:teuthology.orchestra.run.smithi099.stdout:Standby daemons: 2024-09-19T06:51:59.495 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:51:59.495 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.obarqf{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6826/1859154203,v1:172.21.15.99:6827/1859154203] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:51:59.495 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.xehbxe{-1:34410} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6828/1939453719,v1:172.21.15.99:6829/1939453719] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:51:59.495 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.nooexo{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6824/1398895079,v1:172.21.15.117:6825/1398895079] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:51:59.495 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.bheqzh{-1:44329} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6826/3233337308,v1:172.21.15.117:6827/3233337308] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:51:59.496 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 29 2024-09-19T06:51:59.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.493+0000 7fe2ea27b640 1 -- 172.21.15.99:0/2616100351 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe2cc06e530 msgr2=0x7fe2cc0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:59.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.493+0000 7fe2ea27b640 1 --2- 172.21.15.99:0/2616100351 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe2cc06e530 0x7fe2cc0709e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe2d80048a0 tx=0x7fe2d8035040 comp rx=0 tx=0).stop 2024-09-19T06:51:59.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.493+0000 7fe2ea27b640 1 -- 172.21.15.99:0/2616100351 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe2e4102550 msgr2=0x7fe2e4113520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:59.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.493+0000 7fe2ea27b640 1 --2- 172.21.15.99:0/2616100351 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe2e4102550 0x7fe2e4113520 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe2d4002a50 tx=0x7fe2d4004600 comp rx=0 tx=0).stop 2024-09-19T06:51:59.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.493+0000 7fe2ea27b640 1 -- 172.21.15.99:0/2616100351 shutdown_connections 2024-09-19T06:51:59.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.493+0000 7fe2ea27b640 1 --2- 172.21.15.99:0/2616100351 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe2cc06e530 0x7fe2cc0709e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:59.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.493+0000 7fe2ea27b640 1 --2- 172.21.15.99:0/2616100351 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2e4102ef0 0x7fe2e4113a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:59.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.493+0000 7fe2ea27b640 1 --2- 172.21.15.99:0/2616100351 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe2e4102550 0x7fe2e4113520 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:59.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.493+0000 7fe2ea27b640 1 -- 172.21.15.99:0/2616100351 >> 172.21.15.99:0/2616100351 conn(0x7fe2e40f80f0 msgr2=0x7fe2e40f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:59.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.493+0000 7fe2ea27b640 1 -- 172.21.15.99:0/2616100351 shutdown_connections 2024-09-19T06:51:59.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.493+0000 7fe2ea27b640 1 -- 172.21.15.99:0/2616100351 wait complete. 2024-09-19T06:51:59.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.572+0000 7f759110b640 1 -- 172.21.15.99:0/2399004693 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f758c102620 msgr2=0x7f758c1029f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:59.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.572+0000 7f759110b640 1 --2- 172.21.15.99:0/2399004693 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f758c102620 0x7f758c1029f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f757c0048d0 tx=0x7f757c009da0 comp rx=0 tx=0).stop 2024-09-19T06:51:59.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.572+0000 7f759110b640 1 -- 172.21.15.99:0/2399004693 shutdown_connections 2024-09-19T06:51:59.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.572+0000 7f759110b640 1 --2- 172.21.15.99:0/2399004693 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f758c0fac80 0x7f758c0fb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:59.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.572+0000 7f759110b640 1 --2- 172.21.15.99:0/2399004693 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f758c102620 0x7f758c1029f0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:59.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.572+0000 7f759110b640 1 -- 172.21.15.99:0/2399004693 >> 172.21.15.99:0/2399004693 conn(0x7f758c070ce0 msgr2=0x7f758c0710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:59.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.572+0000 7f759110b640 1 -- 172.21.15.99:0/2399004693 shutdown_connections 2024-09-19T06:51:59.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.572+0000 7f759110b640 1 -- 172.21.15.99:0/2399004693 wait complete. 2024-09-19T06:51:59.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.572+0000 7f759110b640 1 Processor -- start 2024-09-19T06:51:59.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.573+0000 7f759110b640 1 -- start start 2024-09-19T06:51:59.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.573+0000 7f759110b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f758c0fac80 0x7f758c1131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:59.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.573+0000 7f759110b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f758c102620 0x7f758c113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:59.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.573+0000 7f759110b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f758c113da0 con 0x7f758c0fac80 2024-09-19T06:51:59.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.573+0000 7f759110b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f758c10d150 con 0x7f758c102620 2024-09-19T06:51:59.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.573+0000 7f758ad9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f758c0fac80 0x7f758c1131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:59.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.573+0000 7f758ad9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f758c0fac80 0x7f758c1131d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42444/0 (socket says 172.21.15.99:42444) 2024-09-19T06:51:59.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.573+0000 7f758ad9d640 1 -- 172.21.15.99:0/1005086435 learned_addr learned my addr 172.21.15.99:0/1005086435 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:51:59.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.573+0000 7f758a59c640 1 --2- 172.21.15.99:0/1005086435 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f758c102620 0x7f758c113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:59.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.573+0000 7f758ad9d640 1 -- 172.21.15.99:0/1005086435 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f758c102620 msgr2=0x7f758c113710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:59.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.573+0000 7f758ad9d640 1 --2- 172.21.15.99:0/1005086435 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f758c102620 0x7f758c113710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:59.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.573+0000 7f758ad9d640 1 -- 172.21.15.99:0/1005086435 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f757c005040 con 0x7f758c0fac80 2024-09-19T06:51:59.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.573+0000 7f758ad9d640 1 --2- 172.21.15.99:0/1005086435 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f758c0fac80 0x7f758c1131d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f757c003080 tx=0x7f757c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:59.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.573+0000 7f75737fe640 1 -- 172.21.15.99:0/1005086435 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f757c038070 con 0x7f758c0fac80 2024-09-19T06:51:59.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.573+0000 7f759110b640 1 -- 172.21.15.99:0/1005086435 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f758c10d3d0 con 0x7f758c0fac80 2024-09-19T06:51:59.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.573+0000 7f75737fe640 1 -- 172.21.15.99:0/1005086435 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f757c0097e0 con 0x7f758c0fac80 2024-09-19T06:51:59.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.574+0000 7f75737fe640 1 -- 172.21.15.99:0/1005086435 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f757c03d420 con 0x7f758c0fac80 2024-09-19T06:51:59.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.574+0000 7f759110b640 1 -- 172.21.15.99:0/1005086435 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f758c10d890 con 0x7f758c0fac80 2024-09-19T06:51:59.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.575+0000 7f759110b640 1 -- 172.21.15.99:0/1005086435 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f758c0657b0 con 0x7f758c0fac80 2024-09-19T06:51:59.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.575+0000 7f75737fe640 1 -- 172.21.15.99:0/1005086435 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f757c030020 con 0x7f758c0fac80 2024-09-19T06:51:59.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.576+0000 7f75737fe640 1 --2- 172.21.15.99:0/1005086435 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f757406e530 0x7f75740709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:59.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.576+0000 7f75737fe640 1 -- 172.21.15.99:0/1005086435 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f757c0ae720 con 0x7f758c0fac80 2024-09-19T06:51:59.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.576+0000 7f758a59c640 1 --2- 172.21.15.99:0/1005086435 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f757406e530 0x7f75740709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:59.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.576+0000 7f758a59c640 1 --2- 172.21.15.99:0/1005086435 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f757406e530 0x7f75740709e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f758c10ea90 tx=0x7f7580008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:59.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.580+0000 7f75737fe640 1 -- 172.21.15.99:0/1005086435 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f757c077810 con 0x7f758c0fac80 2024-09-19T06:51:59.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.760+0000 7f759110b640 1 -- 172.21.15.99:0/1005086435 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f758c04b7b0 con 0x7f757406e530 2024-09-19T06:51:59.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.762+0000 7f75737fe640 1 -- 172.21.15.99:0/1005086435 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f758c04b7b0 con 0x7f757406e530 2024-09-19T06:51:59.763 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:51:59.763 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T06:51:59.763 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": true, 2024-09-19T06:51:59.763 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T06:51:59.763 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [ 2024-09-19T06:51:59.763 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr", 2024-09-19T06:51:59.763 INFO:teuthology.orchestra.run.smithi099.stdout: "crash", 2024-09-19T06:51:59.763 INFO:teuthology.orchestra.run.smithi099.stdout: "mds", 2024-09-19T06:51:59.763 INFO:teuthology.orchestra.run.smithi099.stdout: "mon", 2024-09-19T06:51:59.763 INFO:teuthology.orchestra.run.smithi099.stdout: "osd" 2024-09-19T06:51:59.764 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-19T06:51:59.764 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": "16/21 daemons upgraded", 2024-09-19T06:51:59.764 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "Currently upgrading mds daemons", 2024-09-19T06:51:59.764 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-09-19T06:51:59.764 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:51:59.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.764+0000 7f759110b640 1 -- 172.21.15.99:0/1005086435 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f757406e530 msgr2=0x7f75740709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:59.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.764+0000 7f759110b640 1 --2- 172.21.15.99:0/1005086435 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f757406e530 0x7f75740709e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f758c10ea90 tx=0x7f7580008040 comp rx=0 tx=0).stop 2024-09-19T06:51:59.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.764+0000 7f759110b640 1 -- 172.21.15.99:0/1005086435 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f758c0fac80 msgr2=0x7f758c1131d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:59.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.764+0000 7f759110b640 1 --2- 172.21.15.99:0/1005086435 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f758c0fac80 0x7f758c1131d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f757c003080 tx=0x7f757c009da0 comp rx=0 tx=0).stop 2024-09-19T06:51:59.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.764+0000 7f759110b640 1 -- 172.21.15.99:0/1005086435 shutdown_connections 2024-09-19T06:51:59.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.764+0000 7f759110b640 1 --2- 172.21.15.99:0/1005086435 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f757406e530 0x7f75740709e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:59.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.764+0000 7f759110b640 1 --2- 172.21.15.99:0/1005086435 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f758c102620 0x7f758c113710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:59.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.764+0000 7f759110b640 1 --2- 172.21.15.99:0/1005086435 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f758c0fac80 0x7f758c1131d0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:59.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.764+0000 7f759110b640 1 -- 172.21.15.99:0/1005086435 >> 172.21.15.99:0/1005086435 conn(0x7f758c070ce0 msgr2=0x7f758c105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:59.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.764+0000 7f759110b640 1 -- 172.21.15.99:0/1005086435 shutdown_connections 2024-09-19T06:51:59.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.764+0000 7f759110b640 1 -- 172.21.15.99:0/1005086435 wait complete. 2024-09-19T06:51:59.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.843+0000 7f5594de2640 1 -- 172.21.15.99:0/2380931201 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5590102550 msgr2=0x7f5590102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:59.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.843+0000 7f5594de2640 1 --2- 172.21.15.99:0/2380931201 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5590102550 0x7f5590102920 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f55800048d0 tx=0x7f5580009da0 comp rx=0 tx=0).stop 2024-09-19T06:51:59.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.843+0000 7f5594de2640 1 -- 172.21.15.99:0/2380931201 shutdown_connections 2024-09-19T06:51:59.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.843+0000 7f5594de2640 1 --2- 172.21.15.99:0/2380931201 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5590102ef0 0x7f55900fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:59.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.843+0000 7f5594de2640 1 --2- 172.21.15.99:0/2380931201 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5590102550 0x7f5590102920 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:59.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.843+0000 7f5594de2640 1 -- 172.21.15.99:0/2380931201 >> 172.21.15.99:0/2380931201 conn(0x7f55900f80f0 msgr2=0x7f55900fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:51:59.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.843+0000 7f5594de2640 1 -- 172.21.15.99:0/2380931201 shutdown_connections 2024-09-19T06:51:59.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.843+0000 7f5594de2640 1 -- 172.21.15.99:0/2380931201 wait complete. 2024-09-19T06:51:59.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.843+0000 7f5594de2640 1 Processor -- start 2024-09-19T06:51:59.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.843+0000 7f5594de2640 1 -- start start 2024-09-19T06:51:59.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.843+0000 7f5594de2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5590102550 0x7f5590113540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:59.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.843+0000 7f5594de2640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5590102ef0 0x7f5590113a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:59.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.843+0000 7f5594de2640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55901140d0 con 0x7f5590102ef0 2024-09-19T06:51:59.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.843+0000 7f5594de2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f559010d4e0 con 0x7f5590102550 2024-09-19T06:51:59.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.844+0000 7f558dd9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5590102ef0 0x7f5590113a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:59.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.844+0000 7f558e59c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5590102550 0x7f5590113540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:59.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.844+0000 7f558dd9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5590102ef0 0x7f5590113a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42462/0 (socket says 172.21.15.99:42462) 2024-09-19T06:51:59.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.844+0000 7f558dd9b640 1 -- 172.21.15.99:0/4223188005 learned_addr learned my addr 172.21.15.99:0/4223188005 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:51:59.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.844+0000 7f558dd9b640 1 -- 172.21.15.99:0/4223188005 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5590102550 msgr2=0x7f5590113540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:51:59.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.844+0000 7f558dd9b640 1 --2- 172.21.15.99:0/4223188005 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5590102550 0x7f5590113540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:51:59.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.844+0000 7f558dd9b640 1 -- 172.21.15.99:0/4223188005 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5580005040 con 0x7f5590102ef0 2024-09-19T06:51:59.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.844+0000 7f558e59c640 1 --2- 172.21.15.99:0/4223188005 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5590102550 0x7f5590113540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:51:59.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.844+0000 7f558dd9b640 1 --2- 172.21.15.99:0/4223188005 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5590102ef0 0x7f5590113a80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f558400eb40 tx=0x7f558400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:59.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.844+0000 7f557effd640 1 -- 172.21.15.99:0/4223188005 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5584007c30 con 0x7f5590102ef0 2024-09-19T06:51:59.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.844+0000 7f557effd640 1 -- 172.21.15.99:0/4223188005 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f558400f040 con 0x7f5590102ef0 2024-09-19T06:51:59.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.844+0000 7f5594de2640 1 -- 172.21.15.99:0/4223188005 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f559010d760 con 0x7f5590102ef0 2024-09-19T06:51:59.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.844+0000 7f557effd640 1 -- 172.21.15.99:0/4223188005 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5584009570 con 0x7f5590102ef0 2024-09-19T06:51:59.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.844+0000 7f5594de2640 1 -- 172.21.15.99:0/4223188005 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f559010dd00 con 0x7f5590102ef0 2024-09-19T06:51:59.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.845+0000 7f5594de2640 1 -- 172.21.15.99:0/4223188005 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55900fdcd0 con 0x7f5590102ef0 2024-09-19T06:51:59.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.846+0000 7f557effd640 1 -- 172.21.15.99:0/4223188005 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f55840096d0 con 0x7f5590102ef0 2024-09-19T06:51:59.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.846+0000 7f557effd640 1 --2- 172.21.15.99:0/4223188005 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f557806e530 0x7f55780709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:51:59.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.846+0000 7f557effd640 1 -- 172.21.15.99:0/4223188005 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f558408dc80 con 0x7f5590102ef0 2024-09-19T06:51:59.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.846+0000 7f558e59c640 1 --2- 172.21.15.99:0/4223188005 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f557806e530 0x7f55780709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:51:59.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.847+0000 7f558e59c640 1 --2- 172.21.15.99:0/4223188005 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f557806e530 0x7f55780709e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5580009ac0 tx=0x7f5580035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:51:59.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:51:59.851+0000 7f557effd640 1 -- 172.21.15.99:0/4223188005 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f5584056ea0 con 0x7f5590102ef0 2024-09-19T06:52:00.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:00.081+0000 7f5594de2640 1 -- 172.21.15.99:0/4223188005 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f55900fbd50 con 0x7f5590102ef0 2024-09-19T06:52:00.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:00.081+0000 7f557effd640 1 -- 172.21.15.99:0/4223188005 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7f558405a560 con 0x7f5590102ef0 2024-09-19T06:52:00.083 INFO:teuthology.orchestra.run.smithi099.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-09-19T06:52:00.083 INFO:teuthology.orchestra.run.smithi099.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-19T06:52:00.083 INFO:teuthology.orchestra.run.smithi099.stdout: fs cephfs is degraded 2024-09-19T06:52:00.083 INFO:teuthology.orchestra.run.smithi099.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-19T06:52:00.083 INFO:teuthology.orchestra.run.smithi099.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-19T06:52:00.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:00.083+0000 7f5594de2640 1 -- 172.21.15.99:0/4223188005 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f557806e530 msgr2=0x7f55780709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:00.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:00.083+0000 7f5594de2640 1 --2- 172.21.15.99:0/4223188005 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f557806e530 0x7f55780709e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5580009ac0 tx=0x7f5580035040 comp rx=0 tx=0).stop 2024-09-19T06:52:00.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:00.083+0000 7f5594de2640 1 -- 172.21.15.99:0/4223188005 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5590102ef0 msgr2=0x7f5590113a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:00.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:00.083+0000 7f5594de2640 1 --2- 172.21.15.99:0/4223188005 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5590102ef0 0x7f5590113a80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f558400eb40 tx=0x7f558400b040 comp rx=0 tx=0).stop 2024-09-19T06:52:00.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:00.083+0000 7f5594de2640 1 -- 172.21.15.99:0/4223188005 shutdown_connections 2024-09-19T06:52:00.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:00.083+0000 7f5594de2640 1 --2- 172.21.15.99:0/4223188005 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f557806e530 0x7f55780709e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:00.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:00.083+0000 7f5594de2640 1 --2- 172.21.15.99:0/4223188005 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5590102ef0 0x7f5590113a80 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:00.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:00.083+0000 7f5594de2640 1 --2- 172.21.15.99:0/4223188005 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5590102550 0x7f5590113540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:00.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:00.083+0000 7f5594de2640 1 -- 172.21.15.99:0/4223188005 >> 172.21.15.99:0/4223188005 conn(0x7f55900f80f0 msgr2=0x7f55900f9160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:00.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:00.084+0000 7f5594de2640 1 -- 172.21.15.99:0/4223188005 shutdown_connections 2024-09-19T06:52:00.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:00.084+0000 7f5594de2640 1 -- 172.21.15.99:0/4223188005 wait complete. 2024-09-19T06:52:00.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:52:00 smithi117 ceph-mon[76771]: from='client.34586 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:52:00.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:52:00 smithi117 ceph-mon[76771]: from='client.34590 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:52:00.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:52:00 smithi117 ceph-mon[76771]: from='client.34594 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:52:00.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:52:00 smithi117 ceph-mon[76771]: pgmap v289: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:52:00.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:52:00 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/1416968696' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:52:00.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:52:00 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/2616100351' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:52:00.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:52:00 smithi099 ceph-mon[97031]: from='client.34586 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:52:00.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:52:00 smithi099 ceph-mon[97031]: from='client.34590 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:52:00.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:52:00 smithi099 ceph-mon[97031]: from='client.34594 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:52:00.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:52:00 smithi099 ceph-mon[97031]: pgmap v289: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:52:00.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:52:00 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/1416968696' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:52:00.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:52:00 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/2616100351' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:52:01.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:52:01 smithi117 ceph-mon[76771]: from='client.34606 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:52:01.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:52:01 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/4223188005' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T06:52:01.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:52:01 smithi099 ceph-mon[97031]: from='client.34606 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:52:01.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:52:01 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/4223188005' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T06:52:02.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:52:02 smithi117 ceph-mon[76771]: pgmap v290: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:52:02.314 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:52:02 smithi099 ceph-mon[97031]: pgmap v290: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:52:04.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:52:04 smithi117 ceph-mon[76771]: pgmap v291: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:52:04.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:52:04 smithi099 ceph-mon[97031]: pgmap v291: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:52:06.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:52:06 smithi117 ceph-mon[76771]: pgmap v292: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:52:06.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:52:06 smithi099 ceph-mon[97031]: pgmap v292: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:52:07.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:52:07 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:52:07.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:52:07 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:52:08.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:52:08 smithi099 ceph-mon[97031]: pgmap v293: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:52:08.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:52:08 smithi117 ceph-mon[76771]: pgmap v293: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:52:10.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:52:10 smithi099 ceph-mon[97031]: pgmap v294: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:52:10.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:52:10 smithi117 ceph-mon[76771]: pgmap v294: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:52:11.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:52:11 smithi099 ceph-mon[97031]: pgmap v295: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:52:11.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:52:11 smithi117 ceph-mon[76771]: pgmap v295: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:52:14.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:52:13 smithi117 ceph-mon[76771]: pgmap v296: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:52:14.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:52:13 smithi099 ceph-mon[97031]: pgmap v296: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:52:16.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:52:15 smithi117 ceph-mon[76771]: pgmap v297: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:52:16.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:52:15 smithi099 ceph-mon[97031]: pgmap v297: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:52:18.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:52:17 smithi117 ceph-mon[76771]: pgmap v298: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:52:18.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:52:17 smithi099 ceph-mon[97031]: pgmap v298: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:52:20.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:52:20 smithi117 ceph-mon[76771]: pgmap v299: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:52:20.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:52:20 smithi099 ceph-mon[97031]: pgmap v299: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:52:22.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:52:22 smithi117 ceph-mon[76771]: pgmap v300: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:52:22.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:52:22 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:52:22.314 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:52:22 smithi099 ceph-mon[97031]: pgmap v300: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:52:22.315 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:52:22 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:52:24.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:52:24 smithi117 ceph-mon[76771]: pgmap v301: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:52:24.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:52:24 smithi099 ceph-mon[97031]: pgmap v301: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:52:26.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:52:26 smithi117 ceph-mon[76771]: pgmap v302: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:52:26.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:52:26 smithi099 ceph-mon[97031]: pgmap v302: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:52:28.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:52:28 smithi117 ceph-mon[76771]: pgmap v303: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:52:28.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:52:28 smithi099 ceph-mon[97031]: pgmap v303: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:52:30.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.175+0000 7f9456b74640 1 -- 172.21.15.99:0/1583020044 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9450102500 msgr2=0x7f94501028d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:30.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.175+0000 7f9456b74640 1 --2- 172.21.15.99:0/1583020044 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9450102500 0x7f94501028d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f94380048d0 tx=0x7f9438009da0 comp rx=0 tx=0).stop 2024-09-19T06:52:30.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.175+0000 7f9456b74640 1 -- 172.21.15.99:0/1583020044 shutdown_connections 2024-09-19T06:52:30.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.175+0000 7f9456b74640 1 --2- 172.21.15.99:0/1583020044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9450102ea0 0x7f94500fabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:30.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.175+0000 7f9456b74640 1 --2- 172.21.15.99:0/1583020044 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9450102500 0x7f94501028d0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:30.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.175+0000 7f9456b74640 1 -- 172.21.15.99:0/1583020044 >> 172.21.15.99:0/1583020044 conn(0x7f9450070c10 msgr2=0x7f9450071010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:30.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.175+0000 7f9456b74640 1 -- 172.21.15.99:0/1583020044 shutdown_connections 2024-09-19T06:52:30.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.175+0000 7f9456b74640 1 -- 172.21.15.99:0/1583020044 wait complete. 2024-09-19T06:52:30.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.176+0000 7f9456b74640 1 Processor -- start 2024-09-19T06:52:30.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.176+0000 7f9456b74640 1 -- start start 2024-09-19T06:52:30.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.177+0000 7f9456b74640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9450102500 0x7f9450113170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:30.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.177+0000 7f9456b74640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9450102ea0 0x7f94501136b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:30.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.177+0000 7f9456b74640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9450113cb0 con 0x7f9450102ea0 2024-09-19T06:52:30.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.177+0000 7f9456b74640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f945010d0f0 con 0x7f9450102500 2024-09-19T06:52:30.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.177+0000 7f944ffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9450102ea0 0x7f94501136b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:30.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.177+0000 7f944ffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9450102ea0 0x7f94501136b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48316/0 (socket says 172.21.15.99:48316) 2024-09-19T06:52:30.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.177+0000 7f944ffff640 1 -- 172.21.15.99:0/1750339682 learned_addr learned my addr 172.21.15.99:0/1750339682 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:52:30.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.177+0000 7f9454910640 1 --2- 172.21.15.99:0/1750339682 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9450102500 0x7f9450113170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:30.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.177+0000 7f944ffff640 1 -- 172.21.15.99:0/1750339682 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9450102500 msgr2=0x7f9450113170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:30.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.177+0000 7f944ffff640 1 --2- 172.21.15.99:0/1750339682 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9450102500 0x7f9450113170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:30.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.177+0000 7f944ffff640 1 -- 172.21.15.99:0/1750339682 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9438005040 con 0x7f9450102ea0 2024-09-19T06:52:30.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.177+0000 7f944ffff640 1 --2- 172.21.15.99:0/1750339682 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9450102ea0 0x7f94501136b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f944000c790 tx=0x7f94400043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:30.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.177+0000 7f944d7fa640 1 -- 172.21.15.99:0/1750339682 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f944000a7a0 con 0x7f9450102ea0 2024-09-19T06:52:30.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.178+0000 7f944d7fa640 1 -- 172.21.15.99:0/1750339682 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f944000ada0 con 0x7f9450102ea0 2024-09-19T06:52:30.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.178+0000 7f9456b74640 1 -- 172.21.15.99:0/1750339682 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f945010d3d0 con 0x7f9450102ea0 2024-09-19T06:52:30.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.178+0000 7f944d7fa640 1 -- 172.21.15.99:0/1750339682 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9440011380 con 0x7f9450102ea0 2024-09-19T06:52:30.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.178+0000 7f9456b74640 1 -- 172.21.15.99:0/1750339682 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f945010d970 con 0x7f9450102ea0 2024-09-19T06:52:30.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.179+0000 7f9456b74640 1 -- 172.21.15.99:0/1750339682 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94500656c0 con 0x7f9450102ea0 2024-09-19T06:52:30.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.179+0000 7f944d7fa640 1 -- 172.21.15.99:0/1750339682 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f9440012420 con 0x7f9450102ea0 2024-09-19T06:52:30.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.180+0000 7f944d7fa640 1 --2- 172.21.15.99:0/1750339682 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f943c06e530 0x7f943c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:30.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.180+0000 7f944d7fa640 1 -- 172.21.15.99:0/1750339682 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f944008e580 con 0x7f9450102ea0 2024-09-19T06:52:30.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.180+0000 7f9454910640 1 --2- 172.21.15.99:0/1750339682 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f943c06e530 0x7f943c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:30.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.180+0000 7f9454910640 1 --2- 172.21.15.99:0/1750339682 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f943c06e530 0x7f943c0709e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9438009ac0 tx=0x7f9438035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:30.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.184+0000 7f944d7fa640 1 -- 172.21.15.99:0/1750339682 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f94400576f0 con 0x7f9450102ea0 2024-09-19T06:52:30.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:52:30 smithi117 ceph-mon[76771]: pgmap v304: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:52:30.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.370+0000 7f9456b74640 1 -- 172.21.15.99:0/1750339682 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9450109570 con 0x7f943c06e530 2024-09-19T06:52:30.371 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:52:30 smithi099 ceph-mon[97031]: pgmap v304: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:52:30.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.371+0000 7f944d7fa640 1 -- 172.21.15.99:0/1750339682 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f9450109570 con 0x7f943c06e530 2024-09-19T06:52:30.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.373+0000 7f9456b74640 1 -- 172.21.15.99:0/1750339682 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f943c06e530 msgr2=0x7f943c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:30.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.373+0000 7f9456b74640 1 --2- 172.21.15.99:0/1750339682 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f943c06e530 0x7f943c0709e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9438009ac0 tx=0x7f9438035040 comp rx=0 tx=0).stop 2024-09-19T06:52:30.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.373+0000 7f9456b74640 1 -- 172.21.15.99:0/1750339682 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9450102ea0 msgr2=0x7f94501136b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:30.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.373+0000 7f9456b74640 1 --2- 172.21.15.99:0/1750339682 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9450102ea0 0x7f94501136b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f944000c790 tx=0x7f94400043c0 comp rx=0 tx=0).stop 2024-09-19T06:52:30.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.374+0000 7f9456b74640 1 -- 172.21.15.99:0/1750339682 shutdown_connections 2024-09-19T06:52:30.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.374+0000 7f9456b74640 1 --2- 172.21.15.99:0/1750339682 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f943c06e530 0x7f943c0709e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:30.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.374+0000 7f9456b74640 1 --2- 172.21.15.99:0/1750339682 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9450102ea0 0x7f94501136b0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:30.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.374+0000 7f9456b74640 1 --2- 172.21.15.99:0/1750339682 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9450102500 0x7f9450113170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:30.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.374+0000 7f9456b74640 1 -- 172.21.15.99:0/1750339682 >> 172.21.15.99:0/1750339682 conn(0x7f9450070c10 msgr2=0x7f94500f9570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:30.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.374+0000 7f9456b74640 1 -- 172.21.15.99:0/1750339682 shutdown_connections 2024-09-19T06:52:30.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.374+0000 7f9456b74640 1 -- 172.21.15.99:0/1750339682 wait complete. 2024-09-19T06:52:30.383 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-09-19T06:52:30.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.453+0000 7fb238dc0640 1 -- 172.21.15.99:0/3693863610 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb234102540 msgr2=0x7fb234102910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:30.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.453+0000 7fb238dc0640 1 --2- 172.21.15.99:0/3693863610 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb234102540 0x7fb234102910 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb2240048d0 tx=0x7fb224009da0 comp rx=0 tx=0).stop 2024-09-19T06:52:30.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.453+0000 7fb238dc0640 1 -- 172.21.15.99:0/3693863610 shutdown_connections 2024-09-19T06:52:30.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.453+0000 7fb238dc0640 1 --2- 172.21.15.99:0/3693863610 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb234102ee0 0x7fb2340fc5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:30.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.453+0000 7fb238dc0640 1 --2- 172.21.15.99:0/3693863610 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb234102540 0x7fb234102910 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:30.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.453+0000 7fb238dc0640 1 -- 172.21.15.99:0/3693863610 >> 172.21.15.99:0/3693863610 conn(0x7fb2340f8120 msgr2=0x7fb2340fa530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:30.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.453+0000 7fb238dc0640 1 -- 172.21.15.99:0/3693863610 shutdown_connections 2024-09-19T06:52:30.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.453+0000 7fb238dc0640 1 -- 172.21.15.99:0/3693863610 wait complete. 2024-09-19T06:52:30.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.453+0000 7fb238dc0640 1 Processor -- start 2024-09-19T06:52:30.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.453+0000 7fb238dc0640 1 -- start start 2024-09-19T06:52:30.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.453+0000 7fb238dc0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb234102540 0x7fb234113200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:30.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.453+0000 7fb238dc0640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb234102ee0 0x7fb234113740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:30.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.453+0000 7fb238dc0640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb234113d40 con 0x7fb234102ee0 2024-09-19T06:52:30.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.453+0000 7fb238dc0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb23410d180 con 0x7fb234102540 2024-09-19T06:52:30.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.453+0000 7fb22bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb234102ee0 0x7fb234113740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:30.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.454+0000 7fb22bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb234102ee0 0x7fb234113740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48348/0 (socket says 172.21.15.99:48348) 2024-09-19T06:52:30.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.454+0000 7fb22bfff640 1 -- 172.21.15.99:0/2905044287 learned_addr learned my addr 172.21.15.99:0/2905044287 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:52:30.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.454+0000 7fb23259c640 1 --2- 172.21.15.99:0/2905044287 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb234102540 0x7fb234113200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:30.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.454+0000 7fb22bfff640 1 -- 172.21.15.99:0/2905044287 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb234102540 msgr2=0x7fb234113200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:30.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.454+0000 7fb22bfff640 1 --2- 172.21.15.99:0/2905044287 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb234102540 0x7fb234113200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:30.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.454+0000 7fb22bfff640 1 -- 172.21.15.99:0/2905044287 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb224005040 con 0x7fb234102ee0 2024-09-19T06:52:30.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.454+0000 7fb22bfff640 1 --2- 172.21.15.99:0/2905044287 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb234102ee0 0x7fb234113740 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb21c00eb40 tx=0x7fb21c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:30.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.454+0000 7fb22affd640 1 -- 172.21.15.99:0/2905044287 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb21c007c30 con 0x7fb234102ee0 2024-09-19T06:52:30.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.454+0000 7fb22affd640 1 -- 172.21.15.99:0/2905044287 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb21c00f040 con 0x7fb234102ee0 2024-09-19T06:52:30.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.454+0000 7fb238dc0640 1 -- 172.21.15.99:0/2905044287 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb23410d400 con 0x7fb234102ee0 2024-09-19T06:52:30.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.454+0000 7fb22affd640 1 -- 172.21.15.99:0/2905044287 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb21c00ca90 con 0x7fb234102ee0 2024-09-19T06:52:30.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.454+0000 7fb238dc0640 1 -- 172.21.15.99:0/2905044287 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb23410d9a0 con 0x7fb234102ee0 2024-09-19T06:52:30.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.455+0000 7fb238dc0640 1 -- 172.21.15.99:0/2905044287 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2340fdcc0 con 0x7fb234102ee0 2024-09-19T06:52:30.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.456+0000 7fb22affd640 1 -- 172.21.15.99:0/2905044287 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fb21c00cbf0 con 0x7fb234102ee0 2024-09-19T06:52:30.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.456+0000 7fb22affd640 1 --2- 172.21.15.99:0/2905044287 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fb22006e530 0x7fb2200709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:30.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.456+0000 7fb22affd640 1 -- 172.21.15.99:0/2905044287 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fb21c08dcb0 con 0x7fb234102ee0 2024-09-19T06:52:30.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.456+0000 7fb23259c640 1 --2- 172.21.15.99:0/2905044287 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fb22006e530 0x7fb2200709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:30.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.457+0000 7fb23259c640 1 --2- 172.21.15.99:0/2905044287 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fb22006e530 0x7fb2200709e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb224004540 tx=0x7fb224035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:30.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.460+0000 7fb22affd640 1 -- 172.21.15.99:0/2905044287 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fb21c056ed0 con 0x7fb234102ee0 2024-09-19T06:52:30.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.642+0000 7fb238dc0640 1 -- 172.21.15.99:0/2905044287 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb2341095b0 con 0x7fb22006e530 2024-09-19T06:52:30.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.643+0000 7fb22affd640 1 -- 172.21.15.99:0/2905044287 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fb2341095b0 con 0x7fb22006e530 2024-09-19T06:52:30.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.645+0000 7fb238dc0640 1 -- 172.21.15.99:0/2905044287 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fb22006e530 msgr2=0x7fb2200709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:30.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.645+0000 7fb238dc0640 1 --2- 172.21.15.99:0/2905044287 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fb22006e530 0x7fb2200709e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb224004540 tx=0x7fb224035040 comp rx=0 tx=0).stop 2024-09-19T06:52:30.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.645+0000 7fb238dc0640 1 -- 172.21.15.99:0/2905044287 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb234102ee0 msgr2=0x7fb234113740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:30.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.645+0000 7fb238dc0640 1 --2- 172.21.15.99:0/2905044287 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb234102ee0 0x7fb234113740 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb21c00eb40 tx=0x7fb21c00b040 comp rx=0 tx=0).stop 2024-09-19T06:52:30.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.645+0000 7fb238dc0640 1 -- 172.21.15.99:0/2905044287 shutdown_connections 2024-09-19T06:52:30.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.645+0000 7fb238dc0640 1 --2- 172.21.15.99:0/2905044287 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fb22006e530 0x7fb2200709e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:30.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.645+0000 7fb238dc0640 1 --2- 172.21.15.99:0/2905044287 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb234102ee0 0x7fb234113740 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:30.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.645+0000 7fb238dc0640 1 --2- 172.21.15.99:0/2905044287 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb234102540 0x7fb234113200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:30.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.645+0000 7fb238dc0640 1 -- 172.21.15.99:0/2905044287 >> 172.21.15.99:0/2905044287 conn(0x7fb2340f8120 msgr2=0x7fb2340f9110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:30.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.645+0000 7fb238dc0640 1 -- 172.21.15.99:0/2905044287 shutdown_connections 2024-09-19T06:52:30.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.645+0000 7fb238dc0640 1 -- 172.21.15.99:0/2905044287 wait complete. 2024-09-19T06:52:30.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.723+0000 7f6357609640 1 -- 172.21.15.99:0/4046123983 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63500fdf90 msgr2=0x7f6350106660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:30.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.723+0000 7f6357609640 1 --2- 172.21.15.99:0/4046123983 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63500fdf90 0x7f6350106660 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f63400048d0 tx=0x7f6340009da0 comp rx=0 tx=0).stop 2024-09-19T06:52:30.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.723+0000 7f6357609640 1 -- 172.21.15.99:0/4046123983 shutdown_connections 2024-09-19T06:52:30.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.723+0000 7f6357609640 1 --2- 172.21.15.99:0/4046123983 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63500fdf90 0x7f6350106660 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:30.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.723+0000 7f6357609640 1 --2- 172.21.15.99:0/4046123983 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63500fd5f0 0x7f63500fd9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:30.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.723+0000 7f6357609640 1 -- 172.21.15.99:0/4046123983 >> 172.21.15.99:0/4046123983 conn(0x7f63500f7090 msgr2=0x7f63500f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:30.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.723+0000 7f6357609640 1 -- 172.21.15.99:0/4046123983 shutdown_connections 2024-09-19T06:52:30.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.723+0000 7f6357609640 1 -- 172.21.15.99:0/4046123983 wait complete. 2024-09-19T06:52:30.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.724+0000 7f6357609640 1 Processor -- start 2024-09-19T06:52:30.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.724+0000 7f6357609640 1 -- start start 2024-09-19T06:52:30.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.724+0000 7f6357609640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63500fd5f0 0x7f6350113280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:30.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.724+0000 7f6357609640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63500fdf90 0x7f63501137c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:30.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.724+0000 7f6357609640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6350113dc0 con 0x7f63500fd5f0 2024-09-19T06:52:30.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.724+0000 7f6357609640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f635010d200 con 0x7f63500fdf90 2024-09-19T06:52:30.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.724+0000 7f63553a5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63500fd5f0 0x7f6350113280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:30.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.724+0000 7f63553a5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63500fd5f0 0x7f6350113280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48366/0 (socket says 172.21.15.99:48366) 2024-09-19T06:52:30.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.724+0000 7f63553a5640 1 -- 172.21.15.99:0/3278195833 learned_addr learned my addr 172.21.15.99:0/3278195833 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:52:30.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.724+0000 7f6354ba4640 1 --2- 172.21.15.99:0/3278195833 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63500fdf90 0x7f63501137c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:30.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.724+0000 7f63553a5640 1 -- 172.21.15.99:0/3278195833 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63500fdf90 msgr2=0x7f63501137c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:30.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.724+0000 7f63553a5640 1 --2- 172.21.15.99:0/3278195833 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63500fdf90 0x7f63501137c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:30.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.724+0000 7f63553a5640 1 -- 172.21.15.99:0/3278195833 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6340005040 con 0x7f63500fd5f0 2024-09-19T06:52:30.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.724+0000 7f63553a5640 1 --2- 172.21.15.99:0/3278195833 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63500fd5f0 0x7f6350113280 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f634c00eb70 tx=0x7f634c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:30.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.725+0000 7f6345ffb640 1 -- 172.21.15.99:0/3278195833 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f634c007c30 con 0x7f63500fd5f0 2024-09-19T06:52:30.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.725+0000 7f6345ffb640 1 -- 172.21.15.99:0/3278195833 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f634c00f040 con 0x7f63500fd5f0 2024-09-19T06:52:30.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.725+0000 7f6357609640 1 -- 172.21.15.99:0/3278195833 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f635010d480 con 0x7f63500fd5f0 2024-09-19T06:52:30.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.725+0000 7f6345ffb640 1 -- 172.21.15.99:0/3278195833 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f634c00ca60 con 0x7f63500fd5f0 2024-09-19T06:52:30.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.725+0000 7f6357609640 1 -- 172.21.15.99:0/3278195833 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f635010d9a0 con 0x7f63500fd5f0 2024-09-19T06:52:30.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.726+0000 7f6357609640 1 -- 172.21.15.99:0/3278195833 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6350066270 con 0x7f63500fd5f0 2024-09-19T06:52:30.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.726+0000 7f6345ffb640 1 -- 172.21.15.99:0/3278195833 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f634c00cbc0 con 0x7f63500fd5f0 2024-09-19T06:52:30.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.727+0000 7f6345ffb640 1 --2- 172.21.15.99:0/3278195833 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f633c06e530 0x7f633c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:30.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.727+0000 7f6354ba4640 1 --2- 172.21.15.99:0/3278195833 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f633c06e530 0x7f633c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:30.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.727+0000 7f6345ffb640 1 -- 172.21.15.99:0/3278195833 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f634c08dd80 con 0x7f63500fd5f0 2024-09-19T06:52:30.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.727+0000 7f6354ba4640 1 --2- 172.21.15.99:0/3278195833 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f633c06e530 0x7f633c0709e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6340004540 tx=0x7f6340035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:30.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.731+0000 7f6345ffb640 1 -- 172.21.15.99:0/3278195833 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f634c056f20 con 0x7f63500fd5f0 2024-09-19T06:52:30.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.905+0000 7f6357609640 1 -- 172.21.15.99:0/3278195833 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f635004b720 con 0x7f633c06e530 2024-09-19T06:52:30.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.913+0000 7f6345ffb640 1 -- 172.21.15.99:0/3278195833 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f635004b720 con 0x7f633c06e530 2024-09-19T06:52:30.915 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T06:52:30.915 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.smithi099 smithi099 *:9093,9094 running (11m) 4m ago 19m 23.4M - 0.25.0 c8568f914cd2 e7c1774d56b0 2024-09-19T06:52:30.915 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi099 smithi099 running (8m) 4m ago 20m 6899k - 19.1.1-361-g2f599a46 d2baa855c067 b9775f416b10 2024-09-19T06:52:30.915 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi117 smithi117 running (7m) 3m ago 19m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 38cf60c0d548 2024-09-19T06:52:30.915 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.smithi099 smithi099 *:3000 running (9m) 4m ago 19m 80.7M - 9.4.12 2bacad6d85d8 cd53a18d5410 2024-09-19T06:52:30.915 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.obarqf smithi099 running (4m) 4m ago 14m 12.2M - 19.1.1-361-g2f599a46 d2baa855c067 314a73082521 2024-09-19T06:52:30.915 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.xehbxe smithi099 running (4m) 4m ago 14m 14.4M - 19.1.1-361-g2f599a46 d2baa855c067 a2955a9d06e6 2024-09-19T06:52:30.915 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.bheqzh smithi117 running (3m) 3m ago 14m 11.8M - 19.1.1-361-g2f599a46 d2baa855c067 b1505937c0b7 2024-09-19T06:52:30.915 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.nooexo smithi117 running (3m) 3m ago 14m 13.1M - 19.1.1-361-g2f599a46 d2baa855c067 35bd7725855c 2024-09-19T06:52:30.915 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi099.pgvkqi smithi099 *:8443,9283,8765 running (10m) 4m ago 21m 505M - 19.1.1-361-g2f599a46 d2baa855c067 d5de99cb7e78 2024-09-19T06:52:30.915 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi117.ssmkcf smithi117 *:8443,9283,8765 running (10m) 3m ago 19m 444M - 19.1.1-361-g2f599a46 d2baa855c067 8b7ee0f871f5 2024-09-19T06:52:30.915 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi099 smithi099 running (9m) 4m ago 21m 52.4M 2048M 19.1.1-361-g2f599a46 d2baa855c067 ffe067438824 2024-09-19T06:52:30.915 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi117 smithi117 running (8m) 3m ago 19m 38.9M 2048M 19.1.1-361-g2f599a46 d2baa855c067 4cb7455e3ee7 2024-09-19T06:52:30.916 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi099 smithi099 *:9100 running (11m) 4m ago 20m 15.0M - 1.5.0 0da6a335fe13 dca7b4517dcc 2024-09-19T06:52:30.916 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi117 smithi117 *:9100 running (11m) 3m ago 19m 15.9M - 1.5.0 0da6a335fe13 8233ce3835d2 2024-09-19T06:52:30.916 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (7m) 4m ago 18m 100M 1557M 19.1.1-361-g2f599a46 d2baa855c067 8e22543bf933 2024-09-19T06:52:30.916 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (7m) 4m ago 17m 106M 1557M 19.1.1-361-g2f599a46 d2baa855c067 f54153d0ae09 2024-09-19T06:52:30.916 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (6m) 4m ago 17m 83.7M 1557M 19.1.1-361-g2f599a46 d2baa855c067 b1778ab88870 2024-09-19T06:52:30.916 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi117 running (5m) 3m ago 17m 102M 2581M 19.1.1-361-g2f599a46 d2baa855c067 ea5236b193d3 2024-09-19T06:52:30.916 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi117 running (5m) 3m ago 16m 93.5M 2581M 19.1.1-361-g2f599a46 d2baa855c067 27ac2c859a68 2024-09-19T06:52:30.916 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi117 running (4m) 3m ago 16m 100M 2581M 19.1.1-361-g2f599a46 d2baa855c067 de6aeb8544ce 2024-09-19T06:52:30.916 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.smithi099 smithi099 *:9095 running (10m) 4m ago 19m 64.4M - 2.43.0 a07b618ecd1d 15ad26ec6fb4 2024-09-19T06:52:30.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.916+0000 7f6357609640 1 -- 172.21.15.99:0/3278195833 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f633c06e530 msgr2=0x7f633c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:30.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.916+0000 7f6357609640 1 --2- 172.21.15.99:0/3278195833 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f633c06e530 0x7f633c0709e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6340004540 tx=0x7f6340035040 comp rx=0 tx=0).stop 2024-09-19T06:52:30.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.916+0000 7f6357609640 1 -- 172.21.15.99:0/3278195833 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63500fd5f0 msgr2=0x7f6350113280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:30.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.916+0000 7f6357609640 1 --2- 172.21.15.99:0/3278195833 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63500fd5f0 0x7f6350113280 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f634c00eb70 tx=0x7f634c00b040 comp rx=0 tx=0).stop 2024-09-19T06:52:30.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.916+0000 7f6357609640 1 -- 172.21.15.99:0/3278195833 shutdown_connections 2024-09-19T06:52:30.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.916+0000 7f6357609640 1 --2- 172.21.15.99:0/3278195833 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f633c06e530 0x7f633c0709e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:30.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.916+0000 7f6357609640 1 --2- 172.21.15.99:0/3278195833 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63500fdf90 0x7f63501137c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:30.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.916+0000 7f6357609640 1 --2- 172.21.15.99:0/3278195833 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63500fd5f0 0x7f6350113280 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:30.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.916+0000 7f6357609640 1 -- 172.21.15.99:0/3278195833 >> 172.21.15.99:0/3278195833 conn(0x7f63500f7090 msgr2=0x7f6350105b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:30.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.916+0000 7f6357609640 1 -- 172.21.15.99:0/3278195833 shutdown_connections 2024-09-19T06:52:30.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.916+0000 7f6357609640 1 -- 172.21.15.99:0/3278195833 wait complete. 2024-09-19T06:52:30.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.995+0000 7f9a45c2d640 1 -- 172.21.15.99:0/778483737 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a40102550 msgr2=0x7f9a40102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:30.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.995+0000 7f9a45c2d640 1 --2- 172.21.15.99:0/778483737 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a40102550 0x7f9a40102920 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9a300048d0 tx=0x7f9a30009da0 comp rx=0 tx=0).stop 2024-09-19T06:52:30.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.995+0000 7f9a45c2d640 1 -- 172.21.15.99:0/778483737 shutdown_connections 2024-09-19T06:52:30.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.995+0000 7f9a45c2d640 1 --2- 172.21.15.99:0/778483737 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a40102ef0 0x7f9a400fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:30.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.995+0000 7f9a45c2d640 1 --2- 172.21.15.99:0/778483737 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a40102550 0x7f9a40102920 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:30.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.995+0000 7f9a45c2d640 1 -- 172.21.15.99:0/778483737 >> 172.21.15.99:0/778483737 conn(0x7f9a400f80f0 msgr2=0x7f9a400fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:30.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.995+0000 7f9a45c2d640 1 -- 172.21.15.99:0/778483737 shutdown_connections 2024-09-19T06:52:30.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.995+0000 7f9a45c2d640 1 -- 172.21.15.99:0/778483737 wait complete. 2024-09-19T06:52:30.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.995+0000 7f9a45c2d640 1 Processor -- start 2024-09-19T06:52:30.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.995+0000 7f9a45c2d640 1 -- start start 2024-09-19T06:52:30.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.995+0000 7f9a45c2d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a40102550 0x7f9a4006fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:30.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.996+0000 7f9a45c2d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a40102ef0 0x7f9a4006ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:30.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.996+0000 7f9a45c2d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a40070490 con 0x7f9a40102ef0 2024-09-19T06:52:30.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.996+0000 7f9a45c2d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a40070600 con 0x7f9a40102550 2024-09-19T06:52:30.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.996+0000 7f9a3f7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a40102550 0x7f9a4006fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:30.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.996+0000 7f9a3f7fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a40102550 0x7f9a4006fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.99:42340/0 (socket says 172.21.15.99:42340) 2024-09-19T06:52:30.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.996+0000 7f9a3f7fe640 1 -- 172.21.15.99:0/1305283443 learned_addr learned my addr 172.21.15.99:0/1305283443 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:52:31.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.996+0000 7f9a37fff640 1 --2- 172.21.15.99:0/1305283443 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a40102ef0 0x7f9a4006ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:31.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.996+0000 7f9a3f7fe640 1 -- 172.21.15.99:0/1305283443 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a40102ef0 msgr2=0x7f9a4006ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:31.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.996+0000 7f9a3f7fe640 1 --2- 172.21.15.99:0/1305283443 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a40102ef0 0x7f9a4006ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:31.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.996+0000 7f9a3f7fe640 1 -- 172.21.15.99:0/1305283443 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a30005040 con 0x7f9a40102550 2024-09-19T06:52:31.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.996+0000 7f9a3f7fe640 1 --2- 172.21.15.99:0/1305283443 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a40102550 0x7f9a4006fa10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9a30003080 tx=0x7f9a30009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:31.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.996+0000 7f9a3cff9640 1 -- 172.21.15.99:0/1305283443 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a30038070 con 0x7f9a40102550 2024-09-19T06:52:31.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.997+0000 7f9a45c2d640 1 -- 172.21.15.99:0/1305283443 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a40070830 con 0x7f9a40102550 2024-09-19T06:52:31.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.997+0000 7f9a3cff9640 1 -- 172.21.15.99:0/1305283443 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9a3002ade0 con 0x7f9a40102550 2024-09-19T06:52:31.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.997+0000 7f9a3cff9640 1 -- 172.21.15.99:0/1305283443 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a3002c880 con 0x7f9a40102550 2024-09-19T06:52:31.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.997+0000 7f9a45c2d640 1 -- 172.21.15.99:0/1305283443 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a40119b60 con 0x7f9a40102550 2024-09-19T06:52:31.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.997+0000 7f9a45c2d640 1 -- 172.21.15.99:0/1305283443 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a400fdcd0 con 0x7f9a40102550 2024-09-19T06:52:31.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.998+0000 7f9a3cff9640 1 -- 172.21.15.99:0/1305283443 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f9a30030020 con 0x7f9a40102550 2024-09-19T06:52:31.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.999+0000 7f9a3cff9640 1 --2- 172.21.15.99:0/1305283443 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f9a2c06e530 0x7f9a2c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:31.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.999+0000 7f9a3cff9640 1 -- 172.21.15.99:0/1305283443 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f9a300ae110 con 0x7f9a40102550 2024-09-19T06:52:31.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.999+0000 7f9a37fff640 1 --2- 172.21.15.99:0/1305283443 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f9a2c06e530 0x7f9a2c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:31.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:30.999+0000 7f9a37fff640 1 --2- 172.21.15.99:0/1305283443 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f9a2c06e530 0x7f9a2c0709e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9a40071350 tx=0x7f9a28004330 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:31.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.003+0000 7f9a3cff9640 1 -- 172.21.15.99:0/1305283443 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f9a30077280 con 0x7f9a40102550 2024-09-19T06:52:31.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.242+0000 7f9a45c2d640 1 -- 172.21.15.99:0/1305283443 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9a400fbd50 con 0x7f9a40102550 2024-09-19T06:52:31.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.243+0000 7f9a3cff9640 1 -- 172.21.15.99:0/1305283443 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f9a3007a940 con 0x7f9a40102550 2024-09-19T06:52:31.244 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:52:31.245 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-09-19T06:52:31.245 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T06:52:31.245 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:52:31.245 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-09-19T06:52:31.245 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T06:52:31.245 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:52:31.245 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-09-19T06:52:31.246 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 6 2024-09-19T06:52:31.246 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:52:31.246 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": { 2024-09-19T06:52:31.246 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 4 2024-09-19T06:52:31.246 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:52:31.246 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-09-19T06:52:31.246 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 14 2024-09-19T06:52:31.246 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T06:52:31.246 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:52:31.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.246+0000 7f9a45c2d640 1 -- 172.21.15.99:0/1305283443 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f9a2c06e530 msgr2=0x7f9a2c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:31.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.246+0000 7f9a45c2d640 1 --2- 172.21.15.99:0/1305283443 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f9a2c06e530 0x7f9a2c0709e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9a40071350 tx=0x7f9a28004330 comp rx=0 tx=0).stop 2024-09-19T06:52:31.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.246+0000 7f9a45c2d640 1 -- 172.21.15.99:0/1305283443 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a40102550 msgr2=0x7f9a4006fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:31.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.246+0000 7f9a45c2d640 1 --2- 172.21.15.99:0/1305283443 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a40102550 0x7f9a4006fa10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9a30003080 tx=0x7f9a30009da0 comp rx=0 tx=0).stop 2024-09-19T06:52:31.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.246+0000 7f9a45c2d640 1 -- 172.21.15.99:0/1305283443 shutdown_connections 2024-09-19T06:52:31.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.246+0000 7f9a45c2d640 1 --2- 172.21.15.99:0/1305283443 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f9a2c06e530 0x7f9a2c0709e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:31.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.246+0000 7f9a45c2d640 1 --2- 172.21.15.99:0/1305283443 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a40102ef0 0x7f9a4006ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:31.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.246+0000 7f9a45c2d640 1 --2- 172.21.15.99:0/1305283443 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a40102550 0x7f9a4006fa10 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:31.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.246+0000 7f9a45c2d640 1 -- 172.21.15.99:0/1305283443 >> 172.21.15.99:0/1305283443 conn(0x7f9a400f80f0 msgr2=0x7f9a400f9160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:31.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.246+0000 7f9a45c2d640 1 -- 172.21.15.99:0/1305283443 shutdown_connections 2024-09-19T06:52:31.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.246+0000 7f9a45c2d640 1 -- 172.21.15.99:0/1305283443 wait complete. 2024-09-19T06:52:31.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.325+0000 7fe5c0264640 1 -- 172.21.15.99:0/3196260929 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe5b80fb480 msgr2=0x7fe5b80fb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:31.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.325+0000 7fe5c0264640 1 --2- 172.21.15.99:0/3196260929 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe5b80fb480 0x7fe5b80fb8f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe5a80048d0 tx=0x7fe5a8009da0 comp rx=0 tx=0).stop 2024-09-19T06:52:31.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.325+0000 7fe5c0264640 1 -- 172.21.15.99:0/3196260929 shutdown_connections 2024-09-19T06:52:31.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.325+0000 7fe5c0264640 1 --2- 172.21.15.99:0/3196260929 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe5b80fb480 0x7fe5b80fb8f0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:31.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.325+0000 7fe5c0264640 1 --2- 172.21.15.99:0/3196260929 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5b81014c0 0x7fe5b8101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:31.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.325+0000 7fe5c0264640 1 -- 172.21.15.99:0/3196260929 >> 172.21.15.99:0/3196260929 conn(0x7fe5b80f7000 msgr2=0x7fe5b80f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:31.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.325+0000 7fe5c0264640 1 -- 172.21.15.99:0/3196260929 shutdown_connections 2024-09-19T06:52:31.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.325+0000 7fe5c0264640 1 -- 172.21.15.99:0/3196260929 wait complete. 2024-09-19T06:52:31.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.325+0000 7fe5c0264640 1 Processor -- start 2024-09-19T06:52:31.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.325+0000 7fe5c0264640 1 -- start start 2024-09-19T06:52:31.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.326+0000 7fe5c0264640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe5b80fb480 0x7fe5b810e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:31.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.326+0000 7fe5c0264640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5b81014c0 0x7fe5b810e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:31.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.326+0000 7fe5c0264640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b810ecb0 con 0x7fe5b80fb480 2024-09-19T06:52:31.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.326+0000 7fe5c0264640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b810ee20 con 0x7fe5b81014c0 2024-09-19T06:52:31.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.326+0000 7fe5be000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe5b80fb480 0x7fe5b810e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:31.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.326+0000 7fe5be000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe5b80fb480 0x7fe5b810e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48402/0 (socket says 172.21.15.99:48402) 2024-09-19T06:52:31.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.326+0000 7fe5be000640 1 -- 172.21.15.99:0/2119042520 learned_addr learned my addr 172.21.15.99:0/2119042520 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:52:31.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.326+0000 7fe5be000640 1 -- 172.21.15.99:0/2119042520 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5b81014c0 msgr2=0x7fe5b810e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:31.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.326+0000 7fe5be000640 1 --2- 172.21.15.99:0/2119042520 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5b81014c0 0x7fe5b810e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:31.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.326+0000 7fe5be000640 1 -- 172.21.15.99:0/2119042520 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a8005040 con 0x7fe5b80fb480 2024-09-19T06:52:31.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.326+0000 7fe5be000640 1 --2- 172.21.15.99:0/2119042520 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe5b80fb480 0x7fe5b810e170 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4002a50 tx=0x7fe5b4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:31.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.326+0000 7fe5ae7fc640 1 -- 172.21.15.99:0/2119042520 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5b4007c30 con 0x7fe5b80fb480 2024-09-19T06:52:31.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.326+0000 7fe5ae7fc640 1 -- 172.21.15.99:0/2119042520 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe5b400f040 con 0x7fe5b80fb480 2024-09-19T06:52:31.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.326+0000 7fe5c0264640 1 -- 172.21.15.99:0/2119042520 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5b81171e0 con 0x7fe5b80fb480 2024-09-19T06:52:31.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.326+0000 7fe5ae7fc640 1 -- 172.21.15.99:0/2119042520 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5b400db50 con 0x7fe5b80fb480 2024-09-19T06:52:31.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.327+0000 7fe5c0264640 1 -- 172.21.15.99:0/2119042520 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5b8117720 con 0x7fe5b80fb480 2024-09-19T06:52:31.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.328+0000 7fe5c0264640 1 -- 172.21.15.99:0/2119042520 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5b80fcbc0 con 0x7fe5b80fb480 2024-09-19T06:52:31.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.328+0000 7fe5ae7fc640 1 -- 172.21.15.99:0/2119042520 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fe5b400dcb0 con 0x7fe5b80fb480 2024-09-19T06:52:31.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.328+0000 7fe5ae7fc640 1 --2- 172.21.15.99:0/2119042520 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe5a406e530 0x7fe5a40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:31.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.328+0000 7fe5ae7fc640 1 -- 172.21.15.99:0/2119042520 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fe5b408e050 con 0x7fe5b80fb480 2024-09-19T06:52:31.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.328+0000 7fe5bd7ff640 1 --2- 172.21.15.99:0/2119042520 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe5a406e530 0x7fe5a40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:31.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.329+0000 7fe5bd7ff640 1 --2- 172.21.15.99:0/2119042520 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe5a406e530 0x7fe5a40709e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe5a80043d0 tx=0x7fe5a8009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:31.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.333+0000 7fe5ae7fc640 1 -- 172.21.15.99:0/2119042520 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fe5b40571c0 con 0x7fe5b80fb480 2024-09-19T06:52:31.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.532+0000 7fe5c0264640 1 -- 172.21.15.99:0/2119042520 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe5b804b720 con 0x7fe5b80fb480 2024-09-19T06:52:31.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.532+0000 7fe5ae7fc640 1 -- 172.21.15.99:0/2119042520 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 29 v29) v1 ==== 76+0+1915 (secure 0 0 0) 0x7fe5b405a880 con 0x7fe5b80fb480 2024-09-19T06:52:31.533 INFO:teuthology.orchestra.run.smithi099.stdout:e29 2024-09-19T06:52:31.534 INFO:teuthology.orchestra.run.smithi099.stdout:btime 2024-09-19T06:48:47:938420+0000 2024-09-19T06:52:31.534 INFO:teuthology.orchestra.run.smithi099.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T06:52:31.534 INFO:teuthology.orchestra.run.smithi099.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T06:52:31.534 INFO:teuthology.orchestra.run.smithi099.stdout:legacy client fscid: 1 2024-09-19T06:52:31.534 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:52:31.534 INFO:teuthology.orchestra.run.smithi099.stdout:Filesystem 'cephfs' (1) 2024-09-19T06:52:31.534 INFO:teuthology.orchestra.run.smithi099.stdout:fs_name cephfs 2024-09-19T06:52:31.534 INFO:teuthology.orchestra.run.smithi099.stdout:epoch 20 2024-09-19T06:52:31.534 INFO:teuthology.orchestra.run.smithi099.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-19T06:52:31.534 INFO:teuthology.orchestra.run.smithi099.stdout:created 2024-09-19T06:37:40.838146+0000 2024-09-19T06:52:31.534 INFO:teuthology.orchestra.run.smithi099.stdout:modified 2024-09-19T06:47:50.076553+0000 2024-09-19T06:52:31.535 INFO:teuthology.orchestra.run.smithi099.stdout:tableserver 0 2024-09-19T06:52:31.535 INFO:teuthology.orchestra.run.smithi099.stdout:root 0 2024-09-19T06:52:31.535 INFO:teuthology.orchestra.run.smithi099.stdout:session_timeout 60 2024-09-19T06:52:31.535 INFO:teuthology.orchestra.run.smithi099.stdout:session_autoclose 300 2024-09-19T06:52:31.535 INFO:teuthology.orchestra.run.smithi099.stdout:max_file_size 1099511627776 2024-09-19T06:52:31.535 INFO:teuthology.orchestra.run.smithi099.stdout:max_xattr_size 65536 2024-09-19T06:52:31.535 INFO:teuthology.orchestra.run.smithi099.stdout:required_client_features {} 2024-09-19T06:52:31.535 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure 0 2024-09-19T06:52:31.535 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure_osd_epoch 77 2024-09-19T06:52:31.535 INFO:teuthology.orchestra.run.smithi099.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T06:52:31.536 INFO:teuthology.orchestra.run.smithi099.stdout:max_mds 2 2024-09-19T06:52:31.536 INFO:teuthology.orchestra.run.smithi099.stdout:in 0,1 2024-09-19T06:52:31.536 INFO:teuthology.orchestra.run.smithi099.stdout:up {} 2024-09-19T06:52:31.536 INFO:teuthology.orchestra.run.smithi099.stdout:failed 0,1 2024-09-19T06:52:31.536 INFO:teuthology.orchestra.run.smithi099.stdout:damaged 2024-09-19T06:52:31.536 INFO:teuthology.orchestra.run.smithi099.stdout:stopped 2024-09-19T06:52:31.536 INFO:teuthology.orchestra.run.smithi099.stdout:data_pools [3] 2024-09-19T06:52:31.536 INFO:teuthology.orchestra.run.smithi099.stdout:metadata_pool 2 2024-09-19T06:52:31.536 INFO:teuthology.orchestra.run.smithi099.stdout:inline_data disabled 2024-09-19T06:52:31.536 INFO:teuthology.orchestra.run.smithi099.stdout:balancer 2024-09-19T06:52:31.536 INFO:teuthology.orchestra.run.smithi099.stdout:bal_rank_mask -1 2024-09-19T06:52:31.536 INFO:teuthology.orchestra.run.smithi099.stdout:standby_count_wanted 1 2024-09-19T06:52:31.537 INFO:teuthology.orchestra.run.smithi099.stdout:qdb_cluster leader: 0 members: 2024-09-19T06:52:31.537 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:52:31.537 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:52:31.537 INFO:teuthology.orchestra.run.smithi099.stdout:Standby daemons: 2024-09-19T06:52:31.537 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:52:31.537 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.obarqf{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6826/1859154203,v1:172.21.15.99:6827/1859154203] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:52:31.537 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.xehbxe{-1:34410} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6828/1939453719,v1:172.21.15.99:6829/1939453719] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:52:31.537 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.nooexo{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6824/1398895079,v1:172.21.15.117:6825/1398895079] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:52:31.537 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.bheqzh{-1:44329} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6826/3233337308,v1:172.21.15.117:6827/3233337308] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:52:31.538 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 29 2024-09-19T06:52:31.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.535+0000 7fe5c0264640 1 -- 172.21.15.99:0/2119042520 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe5a406e530 msgr2=0x7fe5a40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:31.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.535+0000 7fe5c0264640 1 --2- 172.21.15.99:0/2119042520 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe5a406e530 0x7fe5a40709e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe5a80043d0 tx=0x7fe5a8009da0 comp rx=0 tx=0).stop 2024-09-19T06:52:31.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.535+0000 7fe5c0264640 1 -- 172.21.15.99:0/2119042520 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe5b80fb480 msgr2=0x7fe5b810e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:31.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.535+0000 7fe5c0264640 1 --2- 172.21.15.99:0/2119042520 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe5b80fb480 0x7fe5b810e170 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4002a50 tx=0x7fe5b4004600 comp rx=0 tx=0).stop 2024-09-19T06:52:31.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.535+0000 7fe5c0264640 1 -- 172.21.15.99:0/2119042520 shutdown_connections 2024-09-19T06:52:31.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.535+0000 7fe5c0264640 1 --2- 172.21.15.99:0/2119042520 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe5a406e530 0x7fe5a40709e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:31.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.535+0000 7fe5c0264640 1 --2- 172.21.15.99:0/2119042520 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5b81014c0 0x7fe5b810e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:31.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.535+0000 7fe5c0264640 1 --2- 172.21.15.99:0/2119042520 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe5b80fb480 0x7fe5b810e170 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:31.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.535+0000 7fe5c0264640 1 -- 172.21.15.99:0/2119042520 >> 172.21.15.99:0/2119042520 conn(0x7fe5b80f7000 msgr2=0x7fe5b80f73d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:31.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.535+0000 7fe5c0264640 1 -- 172.21.15.99:0/2119042520 shutdown_connections 2024-09-19T06:52:31.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.535+0000 7fe5c0264640 1 -- 172.21.15.99:0/2119042520 wait complete. 2024-09-19T06:52:31.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.615+0000 7f7532c2c640 1 -- 172.21.15.99:0/1587902806 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f752c102560 msgr2=0x7f752c102930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:31.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.615+0000 7f7532c2c640 1 --2- 172.21.15.99:0/1587902806 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f752c102560 0x7f752c102930 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f75200048d0 tx=0x7f7520009da0 comp rx=0 tx=0).stop 2024-09-19T06:52:31.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.615+0000 7f7532c2c640 1 -- 172.21.15.99:0/1587902806 shutdown_connections 2024-09-19T06:52:31.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.615+0000 7f7532c2c640 1 --2- 172.21.15.99:0/1587902806 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f752c102f00 0x7f752c0fc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:31.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.615+0000 7f7532c2c640 1 --2- 172.21.15.99:0/1587902806 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f752c102560 0x7f752c102930 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:31.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.615+0000 7f7532c2c640 1 -- 172.21.15.99:0/1587902806 >> 172.21.15.99:0/1587902806 conn(0x7f752c0f8120 msgr2=0x7f752c0fa530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:31.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.615+0000 7f7532c2c640 1 -- 172.21.15.99:0/1587902806 shutdown_connections 2024-09-19T06:52:31.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.615+0000 7f7532c2c640 1 -- 172.21.15.99:0/1587902806 wait complete. 2024-09-19T06:52:31.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.616+0000 7f7532c2c640 1 Processor -- start 2024-09-19T06:52:31.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.616+0000 7f7532c2c640 1 -- start start 2024-09-19T06:52:31.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.616+0000 7f7532c2c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f752c102560 0x7f752c113230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:31.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.616+0000 7f7532c2c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f752c102f00 0x7f752c113770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:31.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.616+0000 7f7532c2c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f752c113d70 con 0x7f752c102560 2024-09-19T06:52:31.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.616+0000 7f7532c2c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f752c10d1b0 con 0x7f752c102f00 2024-09-19T06:52:31.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.616+0000 7f75309c8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f752c102560 0x7f752c113230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:31.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.616+0000 7f75309c8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f752c102560 0x7f752c113230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48420/0 (socket says 172.21.15.99:48420) 2024-09-19T06:52:31.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.616+0000 7f75309c8640 1 -- 172.21.15.99:0/2260849499 learned_addr learned my addr 172.21.15.99:0/2260849499 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:52:31.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.617+0000 7f752bfff640 1 --2- 172.21.15.99:0/2260849499 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f752c102f00 0x7f752c113770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:31.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.617+0000 7f75309c8640 1 -- 172.21.15.99:0/2260849499 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f752c102f00 msgr2=0x7f752c113770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:31.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.617+0000 7f75309c8640 1 --2- 172.21.15.99:0/2260849499 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f752c102f00 0x7f752c113770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:31.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.617+0000 7f75309c8640 1 -- 172.21.15.99:0/2260849499 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7520005040 con 0x7f752c102560 2024-09-19T06:52:31.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.617+0000 7f75309c8640 1 --2- 172.21.15.99:0/2260849499 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f752c102560 0x7f752c113230 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7520003080 tx=0x7f7520009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:31.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.617+0000 7f75297fa640 1 -- 172.21.15.99:0/2260849499 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f752003c070 con 0x7f752c102560 2024-09-19T06:52:31.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.617+0000 7f75297fa640 1 -- 172.21.15.99:0/2260849499 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f752002ade0 con 0x7f752c102560 2024-09-19T06:52:31.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.617+0000 7f7532c2c640 1 -- 172.21.15.99:0/2260849499 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f752c10d430 con 0x7f752c102560 2024-09-19T06:52:31.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.617+0000 7f75297fa640 1 -- 172.21.15.99:0/2260849499 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f752002c0b0 con 0x7f752c102560 2024-09-19T06:52:31.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.617+0000 7f7532c2c640 1 -- 172.21.15.99:0/2260849499 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f752c10d910 con 0x7f752c102560 2024-09-19T06:52:31.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.618+0000 7f7532c2c640 1 -- 172.21.15.99:0/2260849499 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f752c0fdce0 con 0x7f752c102560 2024-09-19T06:52:31.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.619+0000 7f75297fa640 1 -- 172.21.15.99:0/2260849499 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f7520030020 con 0x7f752c102560 2024-09-19T06:52:31.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.619+0000 7f75297fa640 1 --2- 172.21.15.99:0/2260849499 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f751c06e530 0x7f751c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:31.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.619+0000 7f752bfff640 1 --2- 172.21.15.99:0/2260849499 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f751c06e530 0x7f751c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:31.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.619+0000 7f75297fa640 1 -- 172.21.15.99:0/2260849499 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f75200b2640 con 0x7f752c102560 2024-09-19T06:52:31.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.620+0000 7f752bfff640 1 --2- 172.21.15.99:0/2260849499 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f751c06e530 0x7f751c0709e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f752c10eaf0 tx=0x7f7518009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:31.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.624+0000 7f75297fa640 1 -- 172.21.15.99:0/2260849499 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f752007b730 con 0x7f752c102560 2024-09-19T06:52:31.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.805+0000 7f7532c2c640 1 -- 172.21.15.99:0/2260849499 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f752c04b7b0 con 0x7f751c06e530 2024-09-19T06:52:31.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.806+0000 7f75297fa640 1 -- 172.21.15.99:0/2260849499 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f752c04b7b0 con 0x7f751c06e530 2024-09-19T06:52:31.807 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:52:31.807 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T06:52:31.808 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": true, 2024-09-19T06:52:31.808 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T06:52:31.808 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [ 2024-09-19T06:52:31.808 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr", 2024-09-19T06:52:31.808 INFO:teuthology.orchestra.run.smithi099.stdout: "crash", 2024-09-19T06:52:31.808 INFO:teuthology.orchestra.run.smithi099.stdout: "mds", 2024-09-19T06:52:31.808 INFO:teuthology.orchestra.run.smithi099.stdout: "mon", 2024-09-19T06:52:31.808 INFO:teuthology.orchestra.run.smithi099.stdout: "osd" 2024-09-19T06:52:31.808 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-19T06:52:31.808 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": "16/21 daemons upgraded", 2024-09-19T06:52:31.808 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "Currently upgrading mds daemons", 2024-09-19T06:52:31.808 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-09-19T06:52:31.808 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:52:31.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.809+0000 7f7532c2c640 1 -- 172.21.15.99:0/2260849499 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f751c06e530 msgr2=0x7f751c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:31.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.809+0000 7f7532c2c640 1 --2- 172.21.15.99:0/2260849499 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f751c06e530 0x7f751c0709e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f752c10eaf0 tx=0x7f7518009040 comp rx=0 tx=0).stop 2024-09-19T06:52:31.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.809+0000 7f7532c2c640 1 -- 172.21.15.99:0/2260849499 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f752c102560 msgr2=0x7f752c113230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:31.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.809+0000 7f7532c2c640 1 --2- 172.21.15.99:0/2260849499 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f752c102560 0x7f752c113230 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7520003080 tx=0x7f7520009da0 comp rx=0 tx=0).stop 2024-09-19T06:52:31.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.809+0000 7f7532c2c640 1 -- 172.21.15.99:0/2260849499 shutdown_connections 2024-09-19T06:52:31.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.809+0000 7f7532c2c640 1 --2- 172.21.15.99:0/2260849499 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f751c06e530 0x7f751c0709e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:31.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.809+0000 7f7532c2c640 1 --2- 172.21.15.99:0/2260849499 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f752c102f00 0x7f752c113770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:31.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.809+0000 7f7532c2c640 1 --2- 172.21.15.99:0/2260849499 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f752c102560 0x7f752c113230 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:31.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.809+0000 7f7532c2c640 1 -- 172.21.15.99:0/2260849499 >> 172.21.15.99:0/2260849499 conn(0x7f752c0f8120 msgr2=0x7f752c0f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:31.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.809+0000 7f7532c2c640 1 -- 172.21.15.99:0/2260849499 shutdown_connections 2024-09-19T06:52:31.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.809+0000 7f7532c2c640 1 -- 172.21.15.99:0/2260849499 wait complete. 2024-09-19T06:52:31.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.888+0000 7efccf689640 1 -- 172.21.15.99:0/4122896465 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efcc8102680 msgr2=0x7efcc8102a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:31.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.888+0000 7efccf689640 1 --2- 172.21.15.99:0/4122896465 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efcc8102680 0x7efcc8102a50 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7efcc40048d0 tx=0x7efcc4009da0 comp rx=0 tx=0).stop 2024-09-19T06:52:31.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.888+0000 7efccf689640 1 -- 172.21.15.99:0/4122896465 shutdown_connections 2024-09-19T06:52:31.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.888+0000 7efccf689640 1 --2- 172.21.15.99:0/4122896465 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcc80fabd0 0x7efcc80fb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:31.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.888+0000 7efccf689640 1 --2- 172.21.15.99:0/4122896465 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efcc8102680 0x7efcc8102a50 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:31.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.888+0000 7efccf689640 1 -- 172.21.15.99:0/4122896465 >> 172.21.15.99:0/4122896465 conn(0x7efcc8071ac0 msgr2=0x7efcc8071ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:31.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.888+0000 7efccf689640 1 -- 172.21.15.99:0/4122896465 shutdown_connections 2024-09-19T06:52:31.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.888+0000 7efccf689640 1 -- 172.21.15.99:0/4122896465 wait complete. 2024-09-19T06:52:31.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.889+0000 7efccf689640 1 Processor -- start 2024-09-19T06:52:31.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.889+0000 7efccf689640 1 -- start start 2024-09-19T06:52:31.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.889+0000 7efccf689640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efcc80fabd0 0x7efcc81132b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:31.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.889+0000 7efccf689640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcc8102680 0x7efcc81137f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:31.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.889+0000 7efccf689640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcc8113df0 con 0x7efcc80fabd0 2024-09-19T06:52:31.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.889+0000 7efccf689640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcc810d230 con 0x7efcc8102680 2024-09-19T06:52:31.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.889+0000 7efccd425640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efcc80fabd0 0x7efcc81132b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:31.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.889+0000 7efccd425640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efcc80fabd0 0x7efcc81132b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48444/0 (socket says 172.21.15.99:48444) 2024-09-19T06:52:31.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.889+0000 7efccd425640 1 -- 172.21.15.99:0/2842089679 learned_addr learned my addr 172.21.15.99:0/2842089679 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:52:31.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.889+0000 7efcccc24640 1 --2- 172.21.15.99:0/2842089679 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcc8102680 0x7efcc81137f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:31.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.890+0000 7efccd425640 1 -- 172.21.15.99:0/2842089679 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcc8102680 msgr2=0x7efcc81137f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:31.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.890+0000 7efccd425640 1 --2- 172.21.15.99:0/2842089679 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcc8102680 0x7efcc81137f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:31.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.890+0000 7efccd425640 1 -- 172.21.15.99:0/2842089679 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcc4005040 con 0x7efcc80fabd0 2024-09-19T06:52:31.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.890+0000 7efccd425640 1 --2- 172.21.15.99:0/2842089679 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efcc80fabd0 0x7efcc81132b0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7efcc4000c00 tx=0x7efcc4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:31.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.890+0000 7efcbdffb640 1 -- 172.21.15.99:0/2842089679 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efcc4038070 con 0x7efcc80fabd0 2024-09-19T06:52:31.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.890+0000 7efccf689640 1 -- 172.21.15.99:0/2842089679 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcc810d4b0 con 0x7efcc80fabd0 2024-09-19T06:52:31.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.890+0000 7efcbdffb640 1 -- 172.21.15.99:0/2842089679 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7efcc402ade0 con 0x7efcc80fabd0 2024-09-19T06:52:31.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.890+0000 7efcbdffb640 1 -- 172.21.15.99:0/2842089679 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efcc402c7e0 con 0x7efcc80fabd0 2024-09-19T06:52:31.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.890+0000 7efccf689640 1 -- 172.21.15.99:0/2842089679 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcc810d9f0 con 0x7efcc80fabd0 2024-09-19T06:52:31.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.891+0000 7efccf689640 1 -- 172.21.15.99:0/2842089679 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcc80725d0 con 0x7efcc80fabd0 2024-09-19T06:52:31.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.892+0000 7efcbdffb640 1 -- 172.21.15.99:0/2842089679 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7efcc4030020 con 0x7efcc80fabd0 2024-09-19T06:52:31.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.892+0000 7efcbdffb640 1 --2- 172.21.15.99:0/2842089679 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7efcb406e530 0x7efcb40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:52:31.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.892+0000 7efcbdffb640 1 -- 172.21.15.99:0/2842089679 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7efcc40add50 con 0x7efcc80fabd0 2024-09-19T06:52:31.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.892+0000 7efcccc24640 1 --2- 172.21.15.99:0/2842089679 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7efcb406e530 0x7efcb40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:52:31.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.893+0000 7efcccc24640 1 --2- 172.21.15.99:0/2842089679 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7efcb406e530 0x7efcb40709e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7efcc810eb70 tx=0x7efcb800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:52:31.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:31.896+0000 7efcbdffb640 1 -- 172.21.15.99:0/2842089679 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7efcc4076f70 con 0x7efcc80fabd0 2024-09-19T06:52:32.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:32.130+0000 7efccf689640 1 -- 172.21.15.99:0/2842089679 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7efcc804b720 con 0x7efcc80fabd0 2024-09-19T06:52:32.131 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:52:32 smithi099 ceph-mon[97031]: from='client.34614 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:52:32.131 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:52:32 smithi099 ceph-mon[97031]: from='client.34618 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:52:32.131 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:52:32 smithi099 ceph-mon[97031]: from='client.34622 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:52:32.131 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:52:32 smithi099 ceph-mon[97031]: pgmap v305: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:52:32.132 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:52:32 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/1305283443' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:52:32.132 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:52:32 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/2119042520' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:52:32.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:32.130+0000 7efcbdffb640 1 -- 172.21.15.99:0/2842089679 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7efcc407a630 con 0x7efcc80fabd0 2024-09-19T06:52:32.132 INFO:teuthology.orchestra.run.smithi099.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-09-19T06:52:32.132 INFO:teuthology.orchestra.run.smithi099.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-19T06:52:32.132 INFO:teuthology.orchestra.run.smithi099.stdout: fs cephfs is degraded 2024-09-19T06:52:32.132 INFO:teuthology.orchestra.run.smithi099.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-19T06:52:32.132 INFO:teuthology.orchestra.run.smithi099.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-19T06:52:32.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:32.132+0000 7efccf689640 1 -- 172.21.15.99:0/2842089679 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7efcb406e530 msgr2=0x7efcb40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:32.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:32.132+0000 7efccf689640 1 --2- 172.21.15.99:0/2842089679 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7efcb406e530 0x7efcb40709e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7efcc810eb70 tx=0x7efcb800b040 comp rx=0 tx=0).stop 2024-09-19T06:52:32.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:32.132+0000 7efccf689640 1 -- 172.21.15.99:0/2842089679 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efcc80fabd0 msgr2=0x7efcc81132b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:52:32.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:32.132+0000 7efccf689640 1 --2- 172.21.15.99:0/2842089679 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efcc80fabd0 0x7efcc81132b0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7efcc4000c00 tx=0x7efcc4009da0 comp rx=0 tx=0).stop 2024-09-19T06:52:32.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:32.132+0000 7efccf689640 1 -- 172.21.15.99:0/2842089679 shutdown_connections 2024-09-19T06:52:32.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:32.132+0000 7efccf689640 1 --2- 172.21.15.99:0/2842089679 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7efcb406e530 0x7efcb40709e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:32.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:32.132+0000 7efccf689640 1 --2- 172.21.15.99:0/2842089679 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcc8102680 0x7efcc81137f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:32.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:32.132+0000 7efccf689640 1 --2- 172.21.15.99:0/2842089679 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efcc80fabd0 0x7efcc81132b0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:52:32.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:32.132+0000 7efccf689640 1 -- 172.21.15.99:0/2842089679 >> 172.21.15.99:0/2842089679 conn(0x7efcc8071ac0 msgr2=0x7efcc8105350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:52:32.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:32.132+0000 7efccf689640 1 -- 172.21.15.99:0/2842089679 shutdown_connections 2024-09-19T06:52:32.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:52:32.132+0000 7efccf689640 1 -- 172.21.15.99:0/2842089679 wait complete. 2024-09-19T06:52:32.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:52:32 smithi117 ceph-mon[76771]: from='client.34614 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:52:32.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:52:32 smithi117 ceph-mon[76771]: from='client.34618 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:52:32.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:52:32 smithi117 ceph-mon[76771]: from='client.34622 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:52:32.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:52:32 smithi117 ceph-mon[76771]: pgmap v305: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:52:32.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:52:32 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/1305283443' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:52:32.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:52:32 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/2119042520' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:52:33.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:52:33 smithi117 ceph-mon[76771]: from='client.34634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:52:33.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:52:33 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/2842089679' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T06:52:33.357 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:52:33 smithi099 ceph-mon[97031]: from='client.34634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:52:33.358 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:52:33 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/2842089679' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T06:52:34.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:52:34 smithi099 ceph-mon[97031]: pgmap v306: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:52:34.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:52:34 smithi117 ceph-mon[76771]: pgmap v306: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:52:36.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:52:36 smithi117 ceph-mon[76771]: pgmap v307: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:52:36.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:52:36 smithi099 ceph-mon[97031]: pgmap v307: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:52:37.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:52:37 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:52:37.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:52:37 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:52:38.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:52:38 smithi117 ceph-mon[76771]: pgmap v308: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:52:38.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:52:38 smithi099 ceph-mon[97031]: pgmap v308: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:52:40.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:52:40 smithi117 ceph-mon[76771]: pgmap v309: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:52:40.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:52:40 smithi099 ceph-mon[97031]: pgmap v309: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:52:42.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:52:42 smithi117 ceph-mon[76771]: pgmap v310: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:52:42.314 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:52:42 smithi099 ceph-mon[97031]: pgmap v310: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:52:44.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:52:44 smithi117 ceph-mon[76771]: pgmap v311: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:52:44.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:52:44 smithi099 ceph-mon[97031]: pgmap v311: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:52:46.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:52:46 smithi117 ceph-mon[76771]: pgmap v312: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:52:46.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:52:46 smithi099 ceph-mon[97031]: pgmap v312: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:52:48.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:52:48 smithi117 ceph-mon[76771]: pgmap v313: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:52:48.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:52:48 smithi099 ceph-mon[97031]: pgmap v313: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:52:50.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:52:50 smithi117 ceph-mon[76771]: pgmap v314: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:52:50.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:52:50 smithi099 ceph-mon[97031]: pgmap v314: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:52:52.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:52:52 smithi117 ceph-mon[76771]: pgmap v315: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:52:52.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:52:52 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:52:52.314 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:52:52 smithi099 ceph-mon[97031]: pgmap v315: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:52:52.314 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:52:52 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:52:54.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:52:54 smithi117 ceph-mon[76771]: pgmap v316: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:52:54.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:52:54 smithi099 ceph-mon[97031]: pgmap v316: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:52:56.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:52:56 smithi099 ceph-mon[97031]: pgmap v317: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:52:56.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:52:56 smithi117 ceph-mon[76771]: pgmap v317: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:52:58.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:52:58 smithi099 ceph-mon[97031]: pgmap v318: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:52:58.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:52:58 smithi117 ceph-mon[76771]: pgmap v318: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:53:00.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:53:00 smithi099 ceph-mon[97031]: pgmap v319: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:53:00.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:53:00 smithi117 ceph-mon[76771]: pgmap v319: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:53:02.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.224+0000 7effa6be0640 1 -- 172.21.15.99:0/2622764158 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7effa0102530 msgr2=0x7effa0102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:02.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.224+0000 7effa6be0640 1 --2- 172.21.15.99:0/2622764158 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7effa0102530 0x7effa0102900 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7eff900048d0 tx=0x7eff90009da0 comp rx=0 tx=0).stop 2024-09-19T06:53:02.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.224+0000 7effa6be0640 1 -- 172.21.15.99:0/2622764158 shutdown_connections 2024-09-19T06:53:02.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.224+0000 7effa6be0640 1 --2- 172.21.15.99:0/2622764158 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effa0102ed0 0x7effa00fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:02.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.224+0000 7effa6be0640 1 --2- 172.21.15.99:0/2622764158 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7effa0102530 0x7effa0102900 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:02.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.224+0000 7effa6be0640 1 -- 172.21.15.99:0/2622764158 >> 172.21.15.99:0/2622764158 conn(0x7effa00f80f0 msgr2=0x7effa00fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:02.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.224+0000 7effa6be0640 1 -- 172.21.15.99:0/2622764158 shutdown_connections 2024-09-19T06:53:02.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.224+0000 7effa6be0640 1 -- 172.21.15.99:0/2622764158 wait complete. 2024-09-19T06:53:02.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.225+0000 7effa6be0640 1 Processor -- start 2024-09-19T06:53:02.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.225+0000 7effa6be0640 1 -- start start 2024-09-19T06:53:02.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.225+0000 7effa6be0640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7effa0102530 0x7effa0113210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:02.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.225+0000 7effa6be0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effa0102ed0 0x7effa0113750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:02.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.225+0000 7effa6be0640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa0113d50 con 0x7effa0102530 2024-09-19T06:53:02.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.225+0000 7effa6be0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa010d190 con 0x7effa0102ed0 2024-09-19T06:53:02.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.225+0000 7effa497c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7effa0102530 0x7effa0113210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:02.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.225+0000 7effa497c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7effa0102530 0x7effa0113210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60604/0 (socket says 172.21.15.99:60604) 2024-09-19T06:53:02.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.225+0000 7effa497c640 1 -- 172.21.15.99:0/720516185 learned_addr learned my addr 172.21.15.99:0/720516185 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:53:02.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.226+0000 7eff9ffff640 1 --2- 172.21.15.99:0/720516185 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effa0102ed0 0x7effa0113750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:02.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.226+0000 7effa497c640 1 -- 172.21.15.99:0/720516185 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effa0102ed0 msgr2=0x7effa0113750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:02.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.226+0000 7effa497c640 1 --2- 172.21.15.99:0/720516185 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effa0102ed0 0x7effa0113750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:02.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.226+0000 7effa497c640 1 -- 172.21.15.99:0/720516185 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff90005040 con 0x7effa0102530 2024-09-19T06:53:02.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.226+0000 7effa497c640 1 --2- 172.21.15.99:0/720516185 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7effa0102530 0x7effa0113210 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7eff90003080 tx=0x7eff90009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:02.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.226+0000 7eff9d7fa640 1 -- 172.21.15.99:0/720516185 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff90038070 con 0x7effa0102530 2024-09-19T06:53:02.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.226+0000 7eff9d7fa640 1 -- 172.21.15.99:0/720516185 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7eff900097e0 con 0x7effa0102530 2024-09-19T06:53:02.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.226+0000 7effa6be0640 1 -- 172.21.15.99:0/720516185 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effa010d410 con 0x7effa0102530 2024-09-19T06:53:02.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.226+0000 7eff9d7fa640 1 -- 172.21.15.99:0/720516185 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff9003d420 con 0x7effa0102530 2024-09-19T06:53:02.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.226+0000 7effa6be0640 1 -- 172.21.15.99:0/720516185 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effa010d950 con 0x7effa0102530 2024-09-19T06:53:02.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.227+0000 7effa6be0640 1 -- 172.21.15.99:0/720516185 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effa00fdcb0 con 0x7effa0102530 2024-09-19T06:53:02.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.228+0000 7eff9d7fa640 1 -- 172.21.15.99:0/720516185 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7eff90030020 con 0x7effa0102530 2024-09-19T06:53:02.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.228+0000 7eff9d7fa640 1 --2- 172.21.15.99:0/720516185 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7eff8c06e530 0x7eff8c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:02.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.228+0000 7eff9d7fa640 1 -- 172.21.15.99:0/720516185 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7eff900ae5e0 con 0x7effa0102530 2024-09-19T06:53:02.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.229+0000 7eff9ffff640 1 --2- 172.21.15.99:0/720516185 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7eff8c06e530 0x7eff8c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:02.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.229+0000 7eff9ffff640 1 --2- 172.21.15.99:0/720516185 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7eff8c06e530 0x7eff8c0709e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7effa010ead0 tx=0x7eff88004330 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:02.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.233+0000 7eff9d7fa640 1 -- 172.21.15.99:0/720516185 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7eff90077750 con 0x7effa0102530 2024-09-19T06:53:02.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.419+0000 7effa6be0640 1 -- 172.21.15.99:0/720516185 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7effa004b720 con 0x7eff8c06e530 2024-09-19T06:53:02.420 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:53:02 smithi099 ceph-mon[97031]: pgmap v320: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:53:02.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.420+0000 7eff9d7fa640 1 -- 172.21.15.99:0/720516185 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7effa004b720 con 0x7eff8c06e530 2024-09-19T06:53:02.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.422+0000 7effa6be0640 1 -- 172.21.15.99:0/720516185 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7eff8c06e530 msgr2=0x7eff8c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:02.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.422+0000 7effa6be0640 1 --2- 172.21.15.99:0/720516185 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7eff8c06e530 0x7eff8c0709e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7effa010ead0 tx=0x7eff88004330 comp rx=0 tx=0).stop 2024-09-19T06:53:02.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.422+0000 7effa6be0640 1 -- 172.21.15.99:0/720516185 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7effa0102530 msgr2=0x7effa0113210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:02.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.422+0000 7effa6be0640 1 --2- 172.21.15.99:0/720516185 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7effa0102530 0x7effa0113210 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7eff90003080 tx=0x7eff90009da0 comp rx=0 tx=0).stop 2024-09-19T06:53:02.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.422+0000 7effa6be0640 1 -- 172.21.15.99:0/720516185 shutdown_connections 2024-09-19T06:53:02.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.422+0000 7effa6be0640 1 --2- 172.21.15.99:0/720516185 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7eff8c06e530 0x7eff8c0709e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:02.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.422+0000 7effa6be0640 1 --2- 172.21.15.99:0/720516185 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effa0102ed0 0x7effa0113750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:02.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.422+0000 7effa6be0640 1 --2- 172.21.15.99:0/720516185 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7effa0102530 0x7effa0113210 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:02.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.422+0000 7effa6be0640 1 -- 172.21.15.99:0/720516185 >> 172.21.15.99:0/720516185 conn(0x7effa00f80f0 msgr2=0x7effa00f9100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:02.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.422+0000 7effa6be0640 1 -- 172.21.15.99:0/720516185 shutdown_connections 2024-09-19T06:53:02.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.422+0000 7effa6be0640 1 -- 172.21.15.99:0/720516185 wait complete. 2024-09-19T06:53:02.432 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-09-19T06:53:02.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.501+0000 7f1ebe397640 1 -- 172.21.15.99:0/3871031044 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1eb80fd570 msgr2=0x7f1eb80fd940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:02.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.501+0000 7f1ebe397640 1 --2- 172.21.15.99:0/3871031044 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1eb80fd570 0x7f1eb80fd940 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1ea8004900 tx=0x7f1ea8009da0 comp rx=0 tx=0).stop 2024-09-19T06:53:02.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.501+0000 7f1ebe397640 1 -- 172.21.15.99:0/3871031044 shutdown_connections 2024-09-19T06:53:02.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.501+0000 7f1ebe397640 1 --2- 172.21.15.99:0/3871031044 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1eb80fdf10 0x7f1eb81065e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:02.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.501+0000 7f1ebe397640 1 --2- 172.21.15.99:0/3871031044 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1eb80fd570 0x7f1eb80fd940 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:02.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.501+0000 7f1ebe397640 1 -- 172.21.15.99:0/3871031044 >> 172.21.15.99:0/3871031044 conn(0x7f1eb80f7010 msgr2=0x7f1eb80f9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:02.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.501+0000 7f1ebe397640 1 -- 172.21.15.99:0/3871031044 shutdown_connections 2024-09-19T06:53:02.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.501+0000 7f1ebe397640 1 -- 172.21.15.99:0/3871031044 wait complete. 2024-09-19T06:53:02.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.501+0000 7f1ebe397640 1 Processor -- start 2024-09-19T06:53:02.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.501+0000 7f1ebe397640 1 -- start start 2024-09-19T06:53:02.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.502+0000 7f1ebe397640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1eb80fd570 0x7f1eb8113270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:02.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.502+0000 7f1ebe397640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1eb80fdf10 0x7f1eb81137b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:02.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.502+0000 7f1ebe397640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb8113db0 con 0x7f1eb80fdf10 2024-09-19T06:53:02.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.502+0000 7f1ebe397640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb810d1f0 con 0x7f1eb80fd570 2024-09-19T06:53:02.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.502+0000 7f1eb77fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1eb80fdf10 0x7f1eb81137b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:02.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.502+0000 7f1eb77fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1eb80fdf10 0x7f1eb81137b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60628/0 (socket says 172.21.15.99:60628) 2024-09-19T06:53:02.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.502+0000 7f1eb77fe640 1 -- 172.21.15.99:0/552153947 learned_addr learned my addr 172.21.15.99:0/552153947 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:53:02.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.502+0000 7f1eb7fff640 1 --2- 172.21.15.99:0/552153947 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1eb80fd570 0x7f1eb8113270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:02.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.502+0000 7f1eb77fe640 1 -- 172.21.15.99:0/552153947 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1eb80fd570 msgr2=0x7f1eb8113270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:02.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.502+0000 7f1eb77fe640 1 --2- 172.21.15.99:0/552153947 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1eb80fd570 0x7f1eb8113270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:02.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.502+0000 7f1eb77fe640 1 -- 172.21.15.99:0/552153947 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ea8005040 con 0x7f1eb80fdf10 2024-09-19T06:53:02.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.502+0000 7f1eb77fe640 1 --2- 172.21.15.99:0/552153947 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1eb80fdf10 0x7f1eb81137b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1eac00c790 tx=0x7f1eac0043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:02.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.502+0000 7f1eb4ff9640 1 -- 172.21.15.99:0/552153947 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1eac00a820 con 0x7f1eb80fdf10 2024-09-19T06:53:02.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.502+0000 7f1eb4ff9640 1 -- 172.21.15.99:0/552153947 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1eac00ae20 con 0x7f1eb80fdf10 2024-09-19T06:53:02.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.502+0000 7f1ebe397640 1 -- 172.21.15.99:0/552153947 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1eb810d4d0 con 0x7f1eb80fdf10 2024-09-19T06:53:02.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.502+0000 7f1eb4ff9640 1 -- 172.21.15.99:0/552153947 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1eac0113a0 con 0x7f1eb80fdf10 2024-09-19T06:53:02.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.503+0000 7f1ebe397640 1 -- 172.21.15.99:0/552153947 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1eb810d9f0 con 0x7f1eb80fdf10 2024-09-19T06:53:02.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.503+0000 7f1ebe397640 1 -- 172.21.15.99:0/552153947 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1eb8066330 con 0x7f1eb80fdf10 2024-09-19T06:53:02.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.504+0000 7f1eb4ff9640 1 -- 172.21.15.99:0/552153947 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f1eac012400 con 0x7f1eb80fdf10 2024-09-19T06:53:02.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.504+0000 7f1eb4ff9640 1 --2- 172.21.15.99:0/552153947 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f1ea006e530 0x7f1ea00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:02.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.505+0000 7f1eb4ff9640 1 -- 172.21.15.99:0/552153947 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f1eac08e3a0 con 0x7f1eb80fdf10 2024-09-19T06:53:02.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.505+0000 7f1eb7fff640 1 --2- 172.21.15.99:0/552153947 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f1ea006e530 0x7f1ea00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:02.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.505+0000 7f1eb7fff640 1 --2- 172.21.15.99:0/552153947 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f1ea006e530 0x7f1ea00709e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1ea8007ac0 tx=0x7f1ea8035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:02.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.509+0000 7f1eb4ff9640 1 -- 172.21.15.99:0/552153947 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f1eac057490 con 0x7f1eb80fdf10 2024-09-19T06:53:02.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:53:02 smithi117 ceph-mon[76771]: pgmap v320: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:53:02.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.691+0000 7f1ebe397640 1 -- 172.21.15.99:0/552153947 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1eb81095a0 con 0x7f1ea006e530 2024-09-19T06:53:02.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.692+0000 7f1eb4ff9640 1 -- 172.21.15.99:0/552153947 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f1eb81095a0 con 0x7f1ea006e530 2024-09-19T06:53:02.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.695+0000 7f1ebe397640 1 -- 172.21.15.99:0/552153947 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f1ea006e530 msgr2=0x7f1ea00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:02.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.695+0000 7f1ebe397640 1 --2- 172.21.15.99:0/552153947 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f1ea006e530 0x7f1ea00709e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1ea8007ac0 tx=0x7f1ea8035040 comp rx=0 tx=0).stop 2024-09-19T06:53:02.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.695+0000 7f1ebe397640 1 -- 172.21.15.99:0/552153947 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1eb80fdf10 msgr2=0x7f1eb81137b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:02.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.695+0000 7f1ebe397640 1 --2- 172.21.15.99:0/552153947 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1eb80fdf10 0x7f1eb81137b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1eac00c790 tx=0x7f1eac0043c0 comp rx=0 tx=0).stop 2024-09-19T06:53:02.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.695+0000 7f1ebe397640 1 -- 172.21.15.99:0/552153947 shutdown_connections 2024-09-19T06:53:02.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.695+0000 7f1ebe397640 1 --2- 172.21.15.99:0/552153947 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f1ea006e530 0x7f1ea00709e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:02.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.695+0000 7f1ebe397640 1 --2- 172.21.15.99:0/552153947 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1eb80fdf10 0x7f1eb81137b0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:02.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.695+0000 7f1ebe397640 1 --2- 172.21.15.99:0/552153947 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1eb80fd570 0x7f1eb8113270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:02.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.695+0000 7f1ebe397640 1 -- 172.21.15.99:0/552153947 >> 172.21.15.99:0/552153947 conn(0x7f1eb80f7010 msgr2=0x7f1eb80f85b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:02.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.695+0000 7f1ebe397640 1 -- 172.21.15.99:0/552153947 shutdown_connections 2024-09-19T06:53:02.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.695+0000 7f1ebe397640 1 -- 172.21.15.99:0/552153947 wait complete. 2024-09-19T06:53:02.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.774+0000 7fa199a65640 1 -- 172.21.15.99:0/2346931130 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa1940fe450 msgr2=0x7fa1940fe820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:02.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.774+0000 7fa199a65640 1 --2- 172.21.15.99:0/2346931130 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa1940fe450 0x7fa1940fe820 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa1840048d0 tx=0x7fa184009da0 comp rx=0 tx=0).stop 2024-09-19T06:53:02.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.774+0000 7fa199a65640 1 -- 172.21.15.99:0/2346931130 shutdown_connections 2024-09-19T06:53:02.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.774+0000 7fa199a65640 1 --2- 172.21.15.99:0/2346931130 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa194064fe0 0x7fa194065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:02.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.774+0000 7fa199a65640 1 --2- 172.21.15.99:0/2346931130 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa1940fe450 0x7fa1940fe820 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:02.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.774+0000 7fa199a65640 1 -- 172.21.15.99:0/2346931130 >> 172.21.15.99:0/2346931130 conn(0x7fa1940723b0 msgr2=0x7fa1940727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:02.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.774+0000 7fa199a65640 1 -- 172.21.15.99:0/2346931130 shutdown_connections 2024-09-19T06:53:02.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.774+0000 7fa199a65640 1 -- 172.21.15.99:0/2346931130 wait complete. 2024-09-19T06:53:02.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.775+0000 7fa199a65640 1 Processor -- start 2024-09-19T06:53:02.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.775+0000 7fa199a65640 1 -- start start 2024-09-19T06:53:02.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.775+0000 7fa199a65640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa194064fe0 0x7fa1940fb560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:02.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.775+0000 7fa199a65640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1940fe450 0x7fa1940fbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:02.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.775+0000 7fa199a65640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1940fbfe0 con 0x7fa194064fe0 2024-09-19T06:53:02.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.775+0000 7fa199a65640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1940fc150 con 0x7fa1940fe450 2024-09-19T06:53:02.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.775+0000 7fa1937fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa194064fe0 0x7fa1940fb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:02.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.775+0000 7fa1937fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa194064fe0 0x7fa1940fb560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60652/0 (socket says 172.21.15.99:60652) 2024-09-19T06:53:02.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.775+0000 7fa1937fe640 1 -- 172.21.15.99:0/256777797 learned_addr learned my addr 172.21.15.99:0/256777797 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:53:02.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.775+0000 7fa18bfff640 1 --2- 172.21.15.99:0/256777797 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1940fe450 0x7fa1940fbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:02.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.775+0000 7fa1937fe640 1 -- 172.21.15.99:0/256777797 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1940fe450 msgr2=0x7fa1940fbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:02.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.775+0000 7fa1937fe640 1 --2- 172.21.15.99:0/256777797 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1940fe450 0x7fa1940fbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:02.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.775+0000 7fa1937fe640 1 -- 172.21.15.99:0/256777797 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa184005040 con 0x7fa194064fe0 2024-09-19T06:53:02.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.775+0000 7fa1937fe640 1 --2- 172.21.15.99:0/256777797 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa194064fe0 0x7fa1940fb560 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa184000c00 tx=0x7fa184009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:02.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.776+0000 7fa190ff9640 1 -- 172.21.15.99:0/256777797 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa184038070 con 0x7fa194064fe0 2024-09-19T06:53:02.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.776+0000 7fa190ff9640 1 -- 172.21.15.99:0/256777797 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa18402ade0 con 0x7fa194064fe0 2024-09-19T06:53:02.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.776+0000 7fa199a65640 1 -- 172.21.15.99:0/256777797 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1940fc380 con 0x7fa194064fe0 2024-09-19T06:53:02.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.776+0000 7fa190ff9640 1 -- 172.21.15.99:0/256777797 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa18402c7e0 con 0x7fa194064fe0 2024-09-19T06:53:02.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.776+0000 7fa199a65640 1 -- 172.21.15.99:0/256777797 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa194119810 con 0x7fa194064fe0 2024-09-19T06:53:02.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.777+0000 7fa199a65640 1 -- 172.21.15.99:0/256777797 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1940fdce0 con 0x7fa194064fe0 2024-09-19T06:53:02.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.777+0000 7fa190ff9640 1 -- 172.21.15.99:0/256777797 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fa184030020 con 0x7fa194064fe0 2024-09-19T06:53:02.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.778+0000 7fa190ff9640 1 --2- 172.21.15.99:0/256777797 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa18006e530 0x7fa1800709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:02.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.778+0000 7fa190ff9640 1 -- 172.21.15.99:0/256777797 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fa1840addf0 con 0x7fa194064fe0 2024-09-19T06:53:02.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.778+0000 7fa18bfff640 1 --2- 172.21.15.99:0/256777797 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa18006e530 0x7fa1800709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:02.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.778+0000 7fa18bfff640 1 --2- 172.21.15.99:0/256777797 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa18006e530 0x7fa1800709e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa17c007fd0 tx=0x7fa17c009e90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:02.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.782+0000 7fa190ff9640 1 -- 172.21.15.99:0/256777797 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fa184076f90 con 0x7fa194064fe0 2024-09-19T06:53:02.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.958+0000 7fa199a65640 1 -- 172.21.15.99:0/256777797 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa1940fcc50 con 0x7fa18006e530 2024-09-19T06:53:02.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.966+0000 7fa190ff9640 1 -- 172.21.15.99:0/256777797 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7fa1940fcc50 con 0x7fa18006e530 2024-09-19T06:53:02.967 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T06:53:02.967 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.smithi099 smithi099 *:9093,9094 running (12m) 4m ago 20m 23.4M - 0.25.0 c8568f914cd2 e7c1774d56b0 2024-09-19T06:53:02.968 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi099 smithi099 running (8m) 4m ago 20m 6899k - 19.1.1-361-g2f599a46 d2baa855c067 b9775f416b10 2024-09-19T06:53:02.968 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi117 smithi117 running (8m) 4m ago 19m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 38cf60c0d548 2024-09-19T06:53:02.968 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.smithi099 smithi099 *:3000 running (10m) 4m ago 20m 80.7M - 9.4.12 2bacad6d85d8 cd53a18d5410 2024-09-19T06:53:02.968 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.obarqf smithi099 running (5m) 4m ago 15m 12.2M - 19.1.1-361-g2f599a46 d2baa855c067 314a73082521 2024-09-19T06:53:02.968 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.xehbxe smithi099 running (4m) 4m ago 15m 14.4M - 19.1.1-361-g2f599a46 d2baa855c067 a2955a9d06e6 2024-09-19T06:53:02.968 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.bheqzh smithi117 running (4m) 4m ago 15m 11.8M - 19.1.1-361-g2f599a46 d2baa855c067 b1505937c0b7 2024-09-19T06:53:02.968 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.nooexo smithi117 running (4m) 4m ago 15m 13.1M - 19.1.1-361-g2f599a46 d2baa855c067 35bd7725855c 2024-09-19T06:53:02.968 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi099.pgvkqi smithi099 *:8443,9283,8765 running (11m) 4m ago 21m 505M - 19.1.1-361-g2f599a46 d2baa855c067 d5de99cb7e78 2024-09-19T06:53:02.968 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi117.ssmkcf smithi117 *:8443,9283,8765 running (10m) 4m ago 19m 444M - 19.1.1-361-g2f599a46 d2baa855c067 8b7ee0f871f5 2024-09-19T06:53:02.968 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi099 smithi099 running (9m) 4m ago 21m 52.4M 2048M 19.1.1-361-g2f599a46 d2baa855c067 ffe067438824 2024-09-19T06:53:02.968 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi117 smithi117 running (9m) 4m ago 19m 38.9M 2048M 19.1.1-361-g2f599a46 d2baa855c067 4cb7455e3ee7 2024-09-19T06:53:02.968 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi099 smithi099 *:9100 running (12m) 4m ago 20m 15.0M - 1.5.0 0da6a335fe13 dca7b4517dcc 2024-09-19T06:53:02.969 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi117 smithi117 *:9100 running (11m) 4m ago 19m 15.9M - 1.5.0 0da6a335fe13 8233ce3835d2 2024-09-19T06:53:02.969 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (8m) 4m ago 18m 100M 1557M 19.1.1-361-g2f599a46 d2baa855c067 8e22543bf933 2024-09-19T06:53:02.969 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (7m) 4m ago 18m 106M 1557M 19.1.1-361-g2f599a46 d2baa855c067 f54153d0ae09 2024-09-19T06:53:02.969 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (7m) 4m ago 17m 83.7M 1557M 19.1.1-361-g2f599a46 d2baa855c067 b1778ab88870 2024-09-19T06:53:02.969 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi117 running (6m) 4m ago 17m 102M 2581M 19.1.1-361-g2f599a46 d2baa855c067 ea5236b193d3 2024-09-19T06:53:02.969 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi117 running (5m) 4m ago 17m 93.5M 2581M 19.1.1-361-g2f599a46 d2baa855c067 27ac2c859a68 2024-09-19T06:53:02.969 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi117 running (5m) 4m ago 16m 100M 2581M 19.1.1-361-g2f599a46 d2baa855c067 de6aeb8544ce 2024-09-19T06:53:02.969 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.smithi099 smithi099 *:9095 running (10m) 4m ago 20m 64.4M - 2.43.0 a07b618ecd1d 15ad26ec6fb4 2024-09-19T06:53:02.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.969+0000 7fa199a65640 1 -- 172.21.15.99:0/256777797 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa18006e530 msgr2=0x7fa1800709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:02.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.969+0000 7fa199a65640 1 --2- 172.21.15.99:0/256777797 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa18006e530 0x7fa1800709e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa17c007fd0 tx=0x7fa17c009e90 comp rx=0 tx=0).stop 2024-09-19T06:53:02.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.969+0000 7fa199a65640 1 -- 172.21.15.99:0/256777797 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa194064fe0 msgr2=0x7fa1940fb560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:02.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.969+0000 7fa199a65640 1 --2- 172.21.15.99:0/256777797 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa194064fe0 0x7fa1940fb560 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa184000c00 tx=0x7fa184009da0 comp rx=0 tx=0).stop 2024-09-19T06:53:02.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.969+0000 7fa199a65640 1 -- 172.21.15.99:0/256777797 shutdown_connections 2024-09-19T06:53:02.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.969+0000 7fa199a65640 1 --2- 172.21.15.99:0/256777797 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa18006e530 0x7fa1800709e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:02.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.969+0000 7fa199a65640 1 --2- 172.21.15.99:0/256777797 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa1940fe450 0x7fa1940fbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:02.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.969+0000 7fa199a65640 1 --2- 172.21.15.99:0/256777797 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa194064fe0 0x7fa1940fb560 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:02.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.969+0000 7fa199a65640 1 -- 172.21.15.99:0/256777797 >> 172.21.15.99:0/256777797 conn(0x7fa1940723b0 msgr2=0x7fa1940fa2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:02.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.969+0000 7fa199a65640 1 -- 172.21.15.99:0/256777797 shutdown_connections 2024-09-19T06:53:02.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:02.969+0000 7fa199a65640 1 -- 172.21.15.99:0/256777797 wait complete. 2024-09-19T06:53:03.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.047+0000 7fc18fe67640 1 -- 172.21.15.99:0/425810571 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc1880fb810 msgr2=0x7fc1880fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:03.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.047+0000 7fc18fe67640 1 --2- 172.21.15.99:0/425810571 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc1880fb810 0x7fc1880fbbe0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc1780048d0 tx=0x7fc178009da0 comp rx=0 tx=0).stop 2024-09-19T06:53:03.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.047+0000 7fc18fe67640 1 -- 172.21.15.99:0/425810571 shutdown_connections 2024-09-19T06:53:03.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.047+0000 7fc18fe67640 1 --2- 172.21.15.99:0/425810571 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1880fcf80 0x7fc1880fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:03.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.047+0000 7fc18fe67640 1 --2- 172.21.15.99:0/425810571 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc1880fb810 0x7fc1880fbbe0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:03.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.047+0000 7fc18fe67640 1 -- 172.21.15.99:0/425810571 >> 172.21.15.99:0/425810571 conn(0x7fc1880723b0 msgr2=0x7fc1880727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:03.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.047+0000 7fc18fe67640 1 -- 172.21.15.99:0/425810571 shutdown_connections 2024-09-19T06:53:03.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.047+0000 7fc18fe67640 1 -- 172.21.15.99:0/425810571 wait complete. 2024-09-19T06:53:03.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.048+0000 7fc18fe67640 1 Processor -- start 2024-09-19T06:53:03.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.048+0000 7fc18fe67640 1 -- start start 2024-09-19T06:53:03.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.048+0000 7fc18fe67640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc1880fb810 0x7fc18810e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:03.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.048+0000 7fc18fe67640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1880fcf80 0x7fc18810e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:03.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.048+0000 7fc18fe67640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc18810ed70 con 0x7fc1880fb810 2024-09-19T06:53:03.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.048+0000 7fc18fe67640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc18810eee0 con 0x7fc1880fcf80 2024-09-19T06:53:03.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.048+0000 7fc18dc03640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc1880fb810 0x7fc18810e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:03.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.048+0000 7fc18dc03640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc1880fb810 0x7fc18810e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60680/0 (socket says 172.21.15.99:60680) 2024-09-19T06:53:03.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.048+0000 7fc18dc03640 1 -- 172.21.15.99:0/2396659529 learned_addr learned my addr 172.21.15.99:0/2396659529 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:53:03.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.048+0000 7fc18d402640 1 --2- 172.21.15.99:0/2396659529 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1880fcf80 0x7fc18810e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:03.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.048+0000 7fc18dc03640 1 -- 172.21.15.99:0/2396659529 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1880fcf80 msgr2=0x7fc18810e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:03.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.048+0000 7fc18dc03640 1 --2- 172.21.15.99:0/2396659529 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1880fcf80 0x7fc18810e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:03.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.048+0000 7fc18dc03640 1 -- 172.21.15.99:0/2396659529 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc178005040 con 0x7fc1880fb810 2024-09-19T06:53:03.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.048+0000 7fc18dc03640 1 --2- 172.21.15.99:0/2396659529 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc1880fb810 0x7fc18810e2f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc1780043d0 tx=0x7fc178009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:03.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.049+0000 7fc17e7fc640 1 -- 172.21.15.99:0/2396659529 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc178038070 con 0x7fc1880fb810 2024-09-19T06:53:03.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.049+0000 7fc18fe67640 1 -- 172.21.15.99:0/2396659529 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1881171c0 con 0x7fc1880fb810 2024-09-19T06:53:03.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.049+0000 7fc17e7fc640 1 -- 172.21.15.99:0/2396659529 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc1780096e0 con 0x7fc1880fb810 2024-09-19T06:53:03.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.049+0000 7fc17e7fc640 1 -- 172.21.15.99:0/2396659529 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc17803d420 con 0x7fc1880fb810 2024-09-19T06:53:03.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.049+0000 7fc18fe67640 1 -- 172.21.15.99:0/2396659529 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1881176d0 con 0x7fc1880fb810 2024-09-19T06:53:03.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.050+0000 7fc18fe67640 1 -- 172.21.15.99:0/2396659529 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1880fcbc0 con 0x7fc1880fb810 2024-09-19T06:53:03.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.050+0000 7fc17e7fc640 1 -- 172.21.15.99:0/2396659529 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fc178030020 con 0x7fc1880fb810 2024-09-19T06:53:03.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.051+0000 7fc17e7fc640 1 --2- 172.21.15.99:0/2396659529 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fc17406e530 0x7fc1740709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:03.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.051+0000 7fc18d402640 1 --2- 172.21.15.99:0/2396659529 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fc17406e530 0x7fc1740709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:03.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.051+0000 7fc17e7fc640 1 -- 172.21.15.99:0/2396659529 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fc1780ae730 con 0x7fc1880fb810 2024-09-19T06:53:03.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.051+0000 7fc18d402640 1 --2- 172.21.15.99:0/2396659529 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fc17406e530 0x7fc1740709e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc184007fd0 tx=0x7fc184009e90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:03.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.055+0000 7fc17e7fc640 1 -- 172.21.15.99:0/2396659529 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fc178077820 con 0x7fc1880fb810 2024-09-19T06:53:03.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.290+0000 7fc18fe67640 1 -- 172.21.15.99:0/2396659529 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc188072ec0 con 0x7fc1880fb810 2024-09-19T06:53:03.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.291+0000 7fc17e7fc640 1 -- 172.21.15.99:0/2396659529 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7fc17807aee0 con 0x7fc1880fb810 2024-09-19T06:53:03.292 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:53:03.292 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-09-19T06:53:03.293 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T06:53:03.293 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:53:03.293 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-09-19T06:53:03.293 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T06:53:03.293 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:53:03.293 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-09-19T06:53:03.293 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 6 2024-09-19T06:53:03.293 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:53:03.293 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": { 2024-09-19T06:53:03.293 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 4 2024-09-19T06:53:03.293 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:53:03.294 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-09-19T06:53:03.294 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 14 2024-09-19T06:53:03.295 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T06:53:03.296 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:53:03.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.293+0000 7fc18fe67640 1 -- 172.21.15.99:0/2396659529 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fc17406e530 msgr2=0x7fc1740709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:03.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.293+0000 7fc18fe67640 1 --2- 172.21.15.99:0/2396659529 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fc17406e530 0x7fc1740709e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc184007fd0 tx=0x7fc184009e90 comp rx=0 tx=0).stop 2024-09-19T06:53:03.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.293+0000 7fc18fe67640 1 -- 172.21.15.99:0/2396659529 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc1880fb810 msgr2=0x7fc18810e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:03.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.293+0000 7fc18fe67640 1 --2- 172.21.15.99:0/2396659529 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc1880fb810 0x7fc18810e2f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc1780043d0 tx=0x7fc178009da0 comp rx=0 tx=0).stop 2024-09-19T06:53:03.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.294+0000 7fc18fe67640 1 -- 172.21.15.99:0/2396659529 shutdown_connections 2024-09-19T06:53:03.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.294+0000 7fc18fe67640 1 --2- 172.21.15.99:0/2396659529 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fc17406e530 0x7fc1740709e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:03.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.294+0000 7fc18fe67640 1 --2- 172.21.15.99:0/2396659529 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc1880fcf80 0x7fc18810e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:03.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.294+0000 7fc18fe67640 1 --2- 172.21.15.99:0/2396659529 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc1880fb810 0x7fc18810e2f0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:03.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.294+0000 7fc18fe67640 1 -- 172.21.15.99:0/2396659529 >> 172.21.15.99:0/2396659529 conn(0x7fc1880723b0 msgr2=0x7fc1880fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:03.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.294+0000 7fc18fe67640 1 -- 172.21.15.99:0/2396659529 shutdown_connections 2024-09-19T06:53:03.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.294+0000 7fc18fe67640 1 -- 172.21.15.99:0/2396659529 wait complete. 2024-09-19T06:53:03.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.372+0000 7faad5db5640 1 -- 172.21.15.99:0/1010156572 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faad00fdf00 msgr2=0x7faad01065d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:03.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.372+0000 7faad5db5640 1 --2- 172.21.15.99:0/1010156572 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faad00fdf00 0x7faad01065d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7faac4004900 tx=0x7faac4009da0 comp rx=0 tx=0).stop 2024-09-19T06:53:03.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.372+0000 7faad5db5640 1 -- 172.21.15.99:0/1010156572 shutdown_connections 2024-09-19T06:53:03.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.372+0000 7faad5db5640 1 --2- 172.21.15.99:0/1010156572 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faad00fdf00 0x7faad01065d0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:03.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.372+0000 7faad5db5640 1 --2- 172.21.15.99:0/1010156572 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faad00fd560 0x7faad00fd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:03.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.372+0000 7faad5db5640 1 -- 172.21.15.99:0/1010156572 >> 172.21.15.99:0/1010156572 conn(0x7faad00f7000 msgr2=0x7faad00f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:03.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.372+0000 7faad5db5640 1 -- 172.21.15.99:0/1010156572 shutdown_connections 2024-09-19T06:53:03.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.372+0000 7faad5db5640 1 -- 172.21.15.99:0/1010156572 wait complete. 2024-09-19T06:53:03.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.373+0000 7faad5db5640 1 Processor -- start 2024-09-19T06:53:03.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.373+0000 7faad5db5640 1 -- start start 2024-09-19T06:53:03.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.373+0000 7faad5db5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faad00fd560 0x7faad00fb420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:03.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.373+0000 7faad5db5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faad00fdf00 0x7faad00fb960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:03.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.373+0000 7faad5db5640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad00fbef0 con 0x7faad00fdf00 2024-09-19T06:53:03.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.373+0000 7faad5db5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad00fc060 con 0x7faad00fd560 2024-09-19T06:53:03.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.373+0000 7faaceffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faad00fdf00 0x7faad00fb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:03.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.373+0000 7faaceffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faad00fdf00 0x7faad00fb960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60706/0 (socket says 172.21.15.99:60706) 2024-09-19T06:53:03.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.373+0000 7faaceffd640 1 -- 172.21.15.99:0/3263870957 learned_addr learned my addr 172.21.15.99:0/3263870957 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:53:03.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.374+0000 7faacf7fe640 1 --2- 172.21.15.99:0/3263870957 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faad00fd560 0x7faad00fb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:03.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.374+0000 7faaceffd640 1 -- 172.21.15.99:0/3263870957 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faad00fd560 msgr2=0x7faad00fb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:03.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.374+0000 7faaceffd640 1 --2- 172.21.15.99:0/3263870957 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faad00fd560 0x7faad00fb420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:03.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.374+0000 7faaceffd640 1 -- 172.21.15.99:0/3263870957 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac4005040 con 0x7faad00fdf00 2024-09-19T06:53:03.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.374+0000 7faacf7fe640 1 --2- 172.21.15.99:0/3263870957 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faad00fd560 0x7faad00fb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:53:03.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.374+0000 7faaceffd640 1 --2- 172.21.15.99:0/3263870957 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faad00fdf00 0x7faad00fb960 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7faac4009ac0 tx=0x7faac4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:03.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.374+0000 7faab7fff640 1 -- 172.21.15.99:0/3263870957 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faac4038070 con 0x7faad00fdf00 2024-09-19T06:53:03.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.374+0000 7faad5db5640 1 -- 172.21.15.99:0/3263870957 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faad0119610 con 0x7faad00fdf00 2024-09-19T06:53:03.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.374+0000 7faab7fff640 1 -- 172.21.15.99:0/3263870957 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7faac402ae80 con 0x7faad00fdf00 2024-09-19T06:53:03.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.374+0000 7faab7fff640 1 -- 172.21.15.99:0/3263870957 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faac4009680 con 0x7faad00fdf00 2024-09-19T06:53:03.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.374+0000 7faad5db5640 1 -- 172.21.15.99:0/3263870957 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faad0119990 con 0x7faad00fdf00 2024-09-19T06:53:03.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.375+0000 7faad5db5640 1 -- 172.21.15.99:0/3263870957 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faad00662b0 con 0x7faad00fdf00 2024-09-19T06:53:03.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.376+0000 7faab7fff640 1 -- 172.21.15.99:0/3263870957 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7faac4030020 con 0x7faad00fdf00 2024-09-19T06:53:03.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.376+0000 7faab7fff640 1 --2- 172.21.15.99:0/3263870957 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7faab806e530 0x7faab80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:03.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.376+0000 7faab7fff640 1 -- 172.21.15.99:0/3263870957 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7faac40ae3e0 con 0x7faad00fdf00 2024-09-19T06:53:03.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.376+0000 7faacf7fe640 1 --2- 172.21.15.99:0/3263870957 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7faab806e530 0x7faab80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:03.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.377+0000 7faacf7fe640 1 --2- 172.21.15.99:0/3263870957 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7faab806e530 0x7faab80709e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7faac00093f0 tx=0x7faac0009ed0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:03.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.381+0000 7faab7fff640 1 -- 172.21.15.99:0/3263870957 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7faac4077550 con 0x7faad00fdf00 2024-09-19T06:53:03.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.584+0000 7faad5db5640 1 -- 172.21.15.99:0/3263870957 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7faad00fac40 con 0x7faad00fdf00 2024-09-19T06:53:03.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.585+0000 7faab7fff640 1 -- 172.21.15.99:0/3263870957 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 29 v29) v1 ==== 76+0+1915 (secure 0 0 0) 0x7faac407ac10 con 0x7faad00fdf00 2024-09-19T06:53:03.586 INFO:teuthology.orchestra.run.smithi099.stdout:e29 2024-09-19T06:53:03.586 INFO:teuthology.orchestra.run.smithi099.stdout:btime 2024-09-19T06:48:47:938420+0000 2024-09-19T06:53:03.586 INFO:teuthology.orchestra.run.smithi099.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T06:53:03.586 INFO:teuthology.orchestra.run.smithi099.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T06:53:03.586 INFO:teuthology.orchestra.run.smithi099.stdout:legacy client fscid: 1 2024-09-19T06:53:03.586 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:53:03.586 INFO:teuthology.orchestra.run.smithi099.stdout:Filesystem 'cephfs' (1) 2024-09-19T06:53:03.586 INFO:teuthology.orchestra.run.smithi099.stdout:fs_name cephfs 2024-09-19T06:53:03.587 INFO:teuthology.orchestra.run.smithi099.stdout:epoch 20 2024-09-19T06:53:03.587 INFO:teuthology.orchestra.run.smithi099.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-19T06:53:03.587 INFO:teuthology.orchestra.run.smithi099.stdout:created 2024-09-19T06:37:40.838146+0000 2024-09-19T06:53:03.587 INFO:teuthology.orchestra.run.smithi099.stdout:modified 2024-09-19T06:47:50.076553+0000 2024-09-19T06:53:03.587 INFO:teuthology.orchestra.run.smithi099.stdout:tableserver 0 2024-09-19T06:53:03.587 INFO:teuthology.orchestra.run.smithi099.stdout:root 0 2024-09-19T06:53:03.587 INFO:teuthology.orchestra.run.smithi099.stdout:session_timeout 60 2024-09-19T06:53:03.587 INFO:teuthology.orchestra.run.smithi099.stdout:session_autoclose 300 2024-09-19T06:53:03.587 INFO:teuthology.orchestra.run.smithi099.stdout:max_file_size 1099511627776 2024-09-19T06:53:03.587 INFO:teuthology.orchestra.run.smithi099.stdout:max_xattr_size 65536 2024-09-19T06:53:03.587 INFO:teuthology.orchestra.run.smithi099.stdout:required_client_features {} 2024-09-19T06:53:03.587 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure 0 2024-09-19T06:53:03.587 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure_osd_epoch 77 2024-09-19T06:53:03.587 INFO:teuthology.orchestra.run.smithi099.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T06:53:03.588 INFO:teuthology.orchestra.run.smithi099.stdout:max_mds 2 2024-09-19T06:53:03.588 INFO:teuthology.orchestra.run.smithi099.stdout:in 0,1 2024-09-19T06:53:03.588 INFO:teuthology.orchestra.run.smithi099.stdout:up {} 2024-09-19T06:53:03.588 INFO:teuthology.orchestra.run.smithi099.stdout:failed 0,1 2024-09-19T06:53:03.588 INFO:teuthology.orchestra.run.smithi099.stdout:damaged 2024-09-19T06:53:03.588 INFO:teuthology.orchestra.run.smithi099.stdout:stopped 2024-09-19T06:53:03.588 INFO:teuthology.orchestra.run.smithi099.stdout:data_pools [3] 2024-09-19T06:53:03.588 INFO:teuthology.orchestra.run.smithi099.stdout:metadata_pool 2 2024-09-19T06:53:03.588 INFO:teuthology.orchestra.run.smithi099.stdout:inline_data disabled 2024-09-19T06:53:03.588 INFO:teuthology.orchestra.run.smithi099.stdout:balancer 2024-09-19T06:53:03.588 INFO:teuthology.orchestra.run.smithi099.stdout:bal_rank_mask -1 2024-09-19T06:53:03.588 INFO:teuthology.orchestra.run.smithi099.stdout:standby_count_wanted 1 2024-09-19T06:53:03.588 INFO:teuthology.orchestra.run.smithi099.stdout:qdb_cluster leader: 0 members: 2024-09-19T06:53:03.589 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:53:03.589 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:53:03.589 INFO:teuthology.orchestra.run.smithi099.stdout:Standby daemons: 2024-09-19T06:53:03.589 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:53:03.589 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.obarqf{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6826/1859154203,v1:172.21.15.99:6827/1859154203] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:53:03.589 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.xehbxe{-1:34410} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6828/1939453719,v1:172.21.15.99:6829/1939453719] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:53:03.589 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.nooexo{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6824/1398895079,v1:172.21.15.117:6825/1398895079] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:53:03.589 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.bheqzh{-1:44329} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6826/3233337308,v1:172.21.15.117:6827/3233337308] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:53:03.590 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 29 2024-09-19T06:53:03.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.587+0000 7faad5db5640 1 -- 172.21.15.99:0/3263870957 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7faab806e530 msgr2=0x7faab80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:03.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.587+0000 7faad5db5640 1 --2- 172.21.15.99:0/3263870957 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7faab806e530 0x7faab80709e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7faac00093f0 tx=0x7faac0009ed0 comp rx=0 tx=0).stop 2024-09-19T06:53:03.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.587+0000 7faad5db5640 1 -- 172.21.15.99:0/3263870957 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faad00fdf00 msgr2=0x7faad00fb960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:03.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.587+0000 7faad5db5640 1 --2- 172.21.15.99:0/3263870957 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faad00fdf00 0x7faad00fb960 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7faac4009ac0 tx=0x7faac4009da0 comp rx=0 tx=0).stop 2024-09-19T06:53:03.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.587+0000 7faad5db5640 1 -- 172.21.15.99:0/3263870957 shutdown_connections 2024-09-19T06:53:03.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.587+0000 7faad5db5640 1 --2- 172.21.15.99:0/3263870957 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7faab806e530 0x7faab80709e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:03.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.587+0000 7faad5db5640 1 --2- 172.21.15.99:0/3263870957 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faad00fdf00 0x7faad00fb960 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:03.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.587+0000 7faad5db5640 1 --2- 172.21.15.99:0/3263870957 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faad00fd560 0x7faad00fb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:03.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.587+0000 7faad5db5640 1 -- 172.21.15.99:0/3263870957 >> 172.21.15.99:0/3263870957 conn(0x7faad00f7000 msgr2=0x7faad00f8510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:03.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.587+0000 7faad5db5640 1 -- 172.21.15.99:0/3263870957 shutdown_connections 2024-09-19T06:53:03.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.587+0000 7faad5db5640 1 -- 172.21.15.99:0/3263870957 wait complete. 2024-09-19T06:53:03.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.666+0000 7f43f0b3a640 1 -- 172.21.15.99:0/781693369 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f43ec102530 msgr2=0x7f43ec102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:03.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.666+0000 7f43f0b3a640 1 --2- 172.21.15.99:0/781693369 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f43ec102530 0x7f43ec102900 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f43dc0048d0 tx=0x7f43dc009da0 comp rx=0 tx=0).stop 2024-09-19T06:53:03.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.666+0000 7f43f0b3a640 1 -- 172.21.15.99:0/781693369 shutdown_connections 2024-09-19T06:53:03.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.667+0000 7f43f0b3a640 1 --2- 172.21.15.99:0/781693369 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f43ec102ed0 0x7f43ec0fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:03.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.667+0000 7f43f0b3a640 1 --2- 172.21.15.99:0/781693369 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f43ec102530 0x7f43ec102900 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:03.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.667+0000 7f43f0b3a640 1 -- 172.21.15.99:0/781693369 >> 172.21.15.99:0/781693369 conn(0x7f43ec0f8110 msgr2=0x7f43ec0fa520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:03.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.667+0000 7f43f0b3a640 1 -- 172.21.15.99:0/781693369 shutdown_connections 2024-09-19T06:53:03.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.667+0000 7f43f0b3a640 1 -- 172.21.15.99:0/781693369 wait complete. 2024-09-19T06:53:03.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.667+0000 7f43f0b3a640 1 Processor -- start 2024-09-19T06:53:03.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.667+0000 7f43f0b3a640 1 -- start start 2024-09-19T06:53:03.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.667+0000 7f43f0b3a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f43ec102530 0x7f43ec113270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:03.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.667+0000 7f43f0b3a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f43ec102ed0 0x7f43ec1137b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:03.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.667+0000 7f43f0b3a640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43ec113e40 con 0x7f43ec102ed0 2024-09-19T06:53:03.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.667+0000 7f43f0b3a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43ec10d1f0 con 0x7f43ec102530 2024-09-19T06:53:03.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.668+0000 7f43e9d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f43ec102ed0 0x7f43ec1137b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:03.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.668+0000 7f43e9d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f43ec102ed0 0x7f43ec1137b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60724/0 (socket says 172.21.15.99:60724) 2024-09-19T06:53:03.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.668+0000 7f43e9d9b640 1 -- 172.21.15.99:0/1351427474 learned_addr learned my addr 172.21.15.99:0/1351427474 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:53:03.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.668+0000 7f43ea59c640 1 --2- 172.21.15.99:0/1351427474 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f43ec102530 0x7f43ec113270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:03.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.668+0000 7f43e9d9b640 1 -- 172.21.15.99:0/1351427474 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f43ec102530 msgr2=0x7f43ec113270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:03.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.668+0000 7f43e9d9b640 1 --2- 172.21.15.99:0/1351427474 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f43ec102530 0x7f43ec113270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:03.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.668+0000 7f43e9d9b640 1 -- 172.21.15.99:0/1351427474 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43dc005040 con 0x7f43ec102ed0 2024-09-19T06:53:03.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.668+0000 7f43e9d9b640 1 --2- 172.21.15.99:0/1351427474 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f43ec102ed0 0x7f43ec1137b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f43e000b540 tx=0x7f43e00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:03.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.668+0000 7f43daffd640 1 -- 172.21.15.99:0/1351427474 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43e000f6f0 con 0x7f43ec102ed0 2024-09-19T06:53:03.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.668+0000 7f43daffd640 1 -- 172.21.15.99:0/1351427474 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f43e000fcf0 con 0x7f43ec102ed0 2024-09-19T06:53:03.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.668+0000 7f43f0b3a640 1 -- 172.21.15.99:0/1351427474 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43ec10d4d0 con 0x7f43ec102ed0 2024-09-19T06:53:03.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.668+0000 7f43daffd640 1 -- 172.21.15.99:0/1351427474 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43e0011e80 con 0x7f43ec102ed0 2024-09-19T06:53:03.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.668+0000 7f43f0b3a640 1 -- 172.21.15.99:0/1351427474 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43ec10d9f0 con 0x7f43ec102ed0 2024-09-19T06:53:03.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.669+0000 7f43f0b3a640 1 -- 172.21.15.99:0/1351427474 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43ec0fdcb0 con 0x7f43ec102ed0 2024-09-19T06:53:03.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.670+0000 7f43daffd640 1 -- 172.21.15.99:0/1351427474 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f43e00116b0 con 0x7f43ec102ed0 2024-09-19T06:53:03.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.670+0000 7f43daffd640 1 --2- 172.21.15.99:0/1351427474 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f43d406e530 0x7f43d40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:03.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.670+0000 7f43daffd640 1 -- 172.21.15.99:0/1351427474 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f43e008df10 con 0x7f43ec102ed0 2024-09-19T06:53:03.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.670+0000 7f43ea59c640 1 --2- 172.21.15.99:0/1351427474 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f43d406e530 0x7f43d40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:03.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.671+0000 7f43ea59c640 1 --2- 172.21.15.99:0/1351427474 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f43d406e530 0x7f43d40709e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f43dc0048a0 tx=0x7f43dc035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:03.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.675+0000 7f43daffd640 1 -- 172.21.15.99:0/1351427474 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f43e0057140 con 0x7f43ec102ed0 2024-09-19T06:53:03.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.858+0000 7f43f0b3a640 1 -- 172.21.15.99:0/1351427474 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f43ec109640 con 0x7f43d406e530 2024-09-19T06:53:03.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.859+0000 7f43daffd640 1 -- 172.21.15.99:0/1351427474 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f43ec109640 con 0x7f43d406e530 2024-09-19T06:53:03.860 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:53:03.860 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T06:53:03.860 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": true, 2024-09-19T06:53:03.861 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T06:53:03.861 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [ 2024-09-19T06:53:03.861 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr", 2024-09-19T06:53:03.861 INFO:teuthology.orchestra.run.smithi099.stdout: "crash", 2024-09-19T06:53:03.861 INFO:teuthology.orchestra.run.smithi099.stdout: "mds", 2024-09-19T06:53:03.861 INFO:teuthology.orchestra.run.smithi099.stdout: "mon", 2024-09-19T06:53:03.861 INFO:teuthology.orchestra.run.smithi099.stdout: "osd" 2024-09-19T06:53:03.861 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-19T06:53:03.861 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": "16/21 daemons upgraded", 2024-09-19T06:53:03.861 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "Currently upgrading mds daemons", 2024-09-19T06:53:03.861 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-09-19T06:53:03.861 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:53:03.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.861+0000 7f43f0b3a640 1 -- 172.21.15.99:0/1351427474 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f43d406e530 msgr2=0x7f43d40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:03.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.861+0000 7f43f0b3a640 1 --2- 172.21.15.99:0/1351427474 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f43d406e530 0x7f43d40709e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f43dc0048a0 tx=0x7f43dc035040 comp rx=0 tx=0).stop 2024-09-19T06:53:03.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.861+0000 7f43f0b3a640 1 -- 172.21.15.99:0/1351427474 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f43ec102ed0 msgr2=0x7f43ec1137b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:03.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.861+0000 7f43f0b3a640 1 --2- 172.21.15.99:0/1351427474 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f43ec102ed0 0x7f43ec1137b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f43e000b540 tx=0x7f43e00091a0 comp rx=0 tx=0).stop 2024-09-19T06:53:03.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.861+0000 7f43f0b3a640 1 -- 172.21.15.99:0/1351427474 shutdown_connections 2024-09-19T06:53:03.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.861+0000 7f43f0b3a640 1 --2- 172.21.15.99:0/1351427474 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f43d406e530 0x7f43d40709e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:03.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.861+0000 7f43f0b3a640 1 --2- 172.21.15.99:0/1351427474 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f43ec102ed0 0x7f43ec1137b0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:03.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.861+0000 7f43f0b3a640 1 --2- 172.21.15.99:0/1351427474 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f43ec102530 0x7f43ec113270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:03.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.861+0000 7f43f0b3a640 1 -- 172.21.15.99:0/1351427474 >> 172.21.15.99:0/1351427474 conn(0x7f43ec0f8110 msgr2=0x7f43ec0f91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:03.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.861+0000 7f43f0b3a640 1 -- 172.21.15.99:0/1351427474 shutdown_connections 2024-09-19T06:53:03.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.861+0000 7f43f0b3a640 1 -- 172.21.15.99:0/1351427474 wait complete. 2024-09-19T06:53:03.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.940+0000 7f7689511640 1 -- 172.21.15.99:0/1712905050 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f76840fb480 msgr2=0x7f76840fb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:03.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.940+0000 7f7689511640 1 --2- 172.21.15.99:0/1712905050 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f76840fb480 0x7f76840fb8f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f766c0048d0 tx=0x7f766c009da0 comp rx=0 tx=0).stop 2024-09-19T06:53:03.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.940+0000 7f7689511640 1 -- 172.21.15.99:0/1712905050 shutdown_connections 2024-09-19T06:53:03.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.940+0000 7f7689511640 1 --2- 172.21.15.99:0/1712905050 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f76840fb480 0x7f76840fb8f0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:03.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.940+0000 7f7689511640 1 --2- 172.21.15.99:0/1712905050 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76841014c0 0x7f7684101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:03.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.940+0000 7f7689511640 1 -- 172.21.15.99:0/1712905050 >> 172.21.15.99:0/1712905050 conn(0x7f76840f7000 msgr2=0x7f76840f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:03.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.940+0000 7f7689511640 1 -- 172.21.15.99:0/1712905050 shutdown_connections 2024-09-19T06:53:03.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.940+0000 7f7689511640 1 -- 172.21.15.99:0/1712905050 wait complete. 2024-09-19T06:53:03.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.940+0000 7f7689511640 1 Processor -- start 2024-09-19T06:53:03.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.940+0000 7f7689511640 1 -- start start 2024-09-19T06:53:03.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.941+0000 7f7689511640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f76840fb480 0x7f7684113190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:03.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.941+0000 7f7689511640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76841014c0 0x7f76841136d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:03.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.941+0000 7f7689511640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7684113cd0 con 0x7f76840fb480 2024-09-19T06:53:03.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.941+0000 7f7689511640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f768410d110 con 0x7f76841014c0 2024-09-19T06:53:03.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.941+0000 7f7682ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f76840fb480 0x7f7684113190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:03.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.941+0000 7f7682ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f76840fb480 0x7f7684113190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60736/0 (socket says 172.21.15.99:60736) 2024-09-19T06:53:03.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.941+0000 7f7682ffd640 1 -- 172.21.15.99:0/1323440474 learned_addr learned my addr 172.21.15.99:0/1323440474 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:53:03.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.941+0000 7f7682ffd640 1 -- 172.21.15.99:0/1323440474 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76841014c0 msgr2=0x7f76841136d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:03.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.941+0000 7f76827fc640 1 --2- 172.21.15.99:0/1323440474 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76841014c0 0x7f76841136d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:03.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.941+0000 7f7682ffd640 1 --2- 172.21.15.99:0/1323440474 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76841014c0 0x7f76841136d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:03.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.941+0000 7f7682ffd640 1 -- 172.21.15.99:0/1323440474 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f766c005040 con 0x7f76840fb480 2024-09-19T06:53:03.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.941+0000 7f76827fc640 1 --2- 172.21.15.99:0/1323440474 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76841014c0 0x7f76841136d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:53:03.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.941+0000 7f7682ffd640 1 --2- 172.21.15.99:0/1323440474 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f76840fb480 0x7f7684113190 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f767400eb70 tx=0x7f767400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:03.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.941+0000 7f767b7fe640 1 -- 172.21.15.99:0/1323440474 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7674007c30 con 0x7f76840fb480 2024-09-19T06:53:03.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.941+0000 7f7689511640 1 -- 172.21.15.99:0/1323440474 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f768410d390 con 0x7f76840fb480 2024-09-19T06:53:03.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.941+0000 7f767b7fe640 1 -- 172.21.15.99:0/1323440474 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f767400f040 con 0x7f76840fb480 2024-09-19T06:53:03.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.941+0000 7f767b7fe640 1 -- 172.21.15.99:0/1323440474 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7674009550 con 0x7f76840fb480 2024-09-19T06:53:03.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.942+0000 7f7689511640 1 -- 172.21.15.99:0/1323440474 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f768410d930 con 0x7f76840fb480 2024-09-19T06:53:03.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.942+0000 7f7689511640 1 -- 172.21.15.99:0/1323440474 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76840fcbc0 con 0x7f76840fb480 2024-09-19T06:53:03.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.943+0000 7f767b7fe640 1 -- 172.21.15.99:0/1323440474 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f767400cca0 con 0x7f76840fb480 2024-09-19T06:53:03.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.943+0000 7f767b7fe640 1 --2- 172.21.15.99:0/1323440474 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f767006e530 0x7f76700709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:03.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.943+0000 7f767b7fe640 1 -- 172.21.15.99:0/1323440474 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f767408de10 con 0x7f76840fb480 2024-09-19T06:53:03.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.943+0000 7f76827fc640 1 --2- 172.21.15.99:0/1323440474 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f767006e530 0x7f76700709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:03.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.944+0000 7f76827fc640 1 --2- 172.21.15.99:0/1323440474 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f767006e530 0x7f76700709e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f766c00b020 tx=0x7f766c009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:03.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:03.948+0000 7f767b7fe640 1 -- 172.21.15.99:0/1323440474 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f7674056fb0 con 0x7f76840fb480 2024-09-19T06:53:04.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:04.189+0000 7f7689511640 1 -- 172.21.15.99:0/1323440474 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f76840fac40 con 0x7f76840fb480 2024-09-19T06:53:04.191 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:53:04 smithi099 ceph-mon[97031]: from='client.34642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:53:04.191 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:53:04 smithi099 ceph-mon[97031]: from='client.34646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:53:04.191 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:53:04 smithi099 ceph-mon[97031]: pgmap v321: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:53:04.191 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:53:04 smithi099 ceph-mon[97031]: from='client.34650 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:53:04.191 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:53:04 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/2396659529' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:53:04.191 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:53:04 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/3263870957' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:53:04.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:04.189+0000 7f767b7fe640 1 -- 172.21.15.99:0/1323440474 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7f76840fac40 con 0x7f76840fb480 2024-09-19T06:53:04.191 INFO:teuthology.orchestra.run.smithi099.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-09-19T06:53:04.192 INFO:teuthology.orchestra.run.smithi099.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-19T06:53:04.192 INFO:teuthology.orchestra.run.smithi099.stdout: fs cephfs is degraded 2024-09-19T06:53:04.192 INFO:teuthology.orchestra.run.smithi099.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-19T06:53:04.192 INFO:teuthology.orchestra.run.smithi099.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-19T06:53:04.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:04.192+0000 7f7689511640 1 -- 172.21.15.99:0/1323440474 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f767006e530 msgr2=0x7f76700709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:04.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:04.192+0000 7f7689511640 1 --2- 172.21.15.99:0/1323440474 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f767006e530 0x7f76700709e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f766c00b020 tx=0x7f766c009da0 comp rx=0 tx=0).stop 2024-09-19T06:53:04.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:04.192+0000 7f7689511640 1 -- 172.21.15.99:0/1323440474 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f76840fb480 msgr2=0x7f7684113190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:04.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:04.192+0000 7f7689511640 1 --2- 172.21.15.99:0/1323440474 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f76840fb480 0x7f7684113190 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f767400eb70 tx=0x7f767400b040 comp rx=0 tx=0).stop 2024-09-19T06:53:04.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:04.192+0000 7f7689511640 1 -- 172.21.15.99:0/1323440474 shutdown_connections 2024-09-19T06:53:04.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:04.192+0000 7f7689511640 1 --2- 172.21.15.99:0/1323440474 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f767006e530 0x7f76700709e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:04.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:04.192+0000 7f7689511640 1 --2- 172.21.15.99:0/1323440474 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76841014c0 0x7f76841136d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:04.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:04.192+0000 7f7689511640 1 --2- 172.21.15.99:0/1323440474 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f76840fb480 0x7f7684113190 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:04.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:04.192+0000 7f7689511640 1 -- 172.21.15.99:0/1323440474 >> 172.21.15.99:0/1323440474 conn(0x7f76840f7000 msgr2=0x7f76840659f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:04.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:04.193+0000 7f7689511640 1 -- 172.21.15.99:0/1323440474 shutdown_connections 2024-09-19T06:53:04.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:04.193+0000 7f7689511640 1 -- 172.21.15.99:0/1323440474 wait complete. 2024-09-19T06:53:04.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:53:04 smithi117 ceph-mon[76771]: from='client.34642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:53:04.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:53:04 smithi117 ceph-mon[76771]: from='client.34646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:53:04.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:53:04 smithi117 ceph-mon[76771]: pgmap v321: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:53:04.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:53:04 smithi117 ceph-mon[76771]: from='client.34650 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:53:04.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:53:04 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/2396659529' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:53:04.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:53:04 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/3263870957' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:53:05.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:53:05 smithi099 ceph-mon[97031]: from='client.34662 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:53:05.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:53:05 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/1323440474' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T06:53:05.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:53:05 smithi117 ceph-mon[76771]: from='client.34662 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:53:05.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:53:05 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/1323440474' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T06:53:06.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:53:06 smithi099 ceph-mon[97031]: pgmap v322: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:53:06.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:53:06 smithi117 ceph-mon[76771]: pgmap v322: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:53:07.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:53:07 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:53:07.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:53:07 smithi099 ceph-mon[97031]: pgmap v323: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:53:07.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:53:07 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:53:07.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:53:07 smithi117 ceph-mon[76771]: pgmap v323: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:53:10.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:53:10 smithi117 ceph-mon[76771]: pgmap v324: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:53:10.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:53:10 smithi099 ceph-mon[97031]: pgmap v324: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:53:11.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:53:11 smithi099 ceph-mon[97031]: pgmap v325: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:53:12.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:53:11 smithi117 ceph-mon[76771]: pgmap v325: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:53:14.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:53:14 smithi117 ceph-mon[76771]: pgmap v326: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:53:14.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:53:14 smithi099 ceph-mon[97031]: pgmap v326: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:53:16.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:53:16 smithi117 ceph-mon[76771]: pgmap v327: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:53:16.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:53:16 smithi099 ceph-mon[97031]: pgmap v327: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:53:18.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:53:18 smithi117 ceph-mon[76771]: pgmap v328: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:53:18.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:53:18 smithi099 ceph-mon[97031]: pgmap v328: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:53:20.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:53:20 smithi117 ceph-mon[76771]: pgmap v329: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:53:20.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:53:20 smithi099 ceph-mon[97031]: pgmap v329: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:53:22.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:53:22 smithi117 ceph-mon[76771]: pgmap v330: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:53:22.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:53:22 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:53:22.314 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:53:22 smithi099 ceph-mon[97031]: pgmap v330: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:53:22.314 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:53:22 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:53:24.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:53:24 smithi117 ceph-mon[76771]: pgmap v331: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:53:24.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:53:24 smithi099 ceph-mon[97031]: pgmap v331: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:53:26.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:53:26 smithi117 ceph-mon[76771]: pgmap v332: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:53:26.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:53:26 smithi099 ceph-mon[97031]: pgmap v332: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:53:28.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:53:28 smithi117 ceph-mon[76771]: pgmap v333: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:53:28.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:53:28 smithi099 ceph-mon[97031]: pgmap v333: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:53:30.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:53:30 smithi117 ceph-mon[76771]: pgmap v334: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:53:30.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:53:30 smithi099 ceph-mon[97031]: pgmap v334: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:53:32.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:53:32 smithi117 ceph-mon[76771]: pgmap v335: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:53:32.314 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:53:32 smithi099 ceph-mon[97031]: pgmap v335: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:53:34.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.284+0000 7f7eecab7640 1 -- 172.21.15.99:0/3539759118 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ee8102550 msgr2=0x7f7ee8102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:34.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.284+0000 7f7eecab7640 1 --2- 172.21.15.99:0/3539759118 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ee8102550 0x7f7ee8102920 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7ed80048d0 tx=0x7f7ed8009da0 comp rx=0 tx=0).stop 2024-09-19T06:53:34.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.284+0000 7f7eecab7640 1 -- 172.21.15.99:0/3539759118 shutdown_connections 2024-09-19T06:53:34.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.284+0000 7f7eecab7640 1 --2- 172.21.15.99:0/3539759118 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ee8102ef0 0x7f7ee80fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:34.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.284+0000 7f7eecab7640 1 --2- 172.21.15.99:0/3539759118 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ee8102550 0x7f7ee8102920 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:34.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.284+0000 7f7eecab7640 1 -- 172.21.15.99:0/3539759118 >> 172.21.15.99:0/3539759118 conn(0x7f7ee80f80f0 msgr2=0x7f7ee80fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:34.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.284+0000 7f7eecab7640 1 -- 172.21.15.99:0/3539759118 shutdown_connections 2024-09-19T06:53:34.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.284+0000 7f7eecab7640 1 -- 172.21.15.99:0/3539759118 wait complete. 2024-09-19T06:53:34.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.285+0000 7f7eecab7640 1 Processor -- start 2024-09-19T06:53:34.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.285+0000 7f7eecab7640 1 -- start start 2024-09-19T06:53:34.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.285+0000 7f7eecab7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ee8102550 0x7f7ee806fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:34.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.285+0000 7f7eecab7640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ee8102ef0 0x7f7ee806ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:34.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.285+0000 7f7eecab7640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee8070490 con 0x7f7ee8102ef0 2024-09-19T06:53:34.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.285+0000 7f7eecab7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee8070600 con 0x7f7ee8102550 2024-09-19T06:53:34.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.285+0000 7f7ee5d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ee8102ef0 0x7f7ee806ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:34.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.285+0000 7f7ee5d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ee8102ef0 0x7f7ee806ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36296/0 (socket says 172.21.15.99:36296) 2024-09-19T06:53:34.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.286+0000 7f7ee5d9b640 1 -- 172.21.15.99:0/1154354286 learned_addr learned my addr 172.21.15.99:0/1154354286 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:53:34.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.286+0000 7f7ee659c640 1 --2- 172.21.15.99:0/1154354286 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ee8102550 0x7f7ee806fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:34.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.286+0000 7f7ee5d9b640 1 -- 172.21.15.99:0/1154354286 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ee8102550 msgr2=0x7f7ee806fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:34.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.286+0000 7f7ee5d9b640 1 --2- 172.21.15.99:0/1154354286 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ee8102550 0x7f7ee806fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:34.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.286+0000 7f7ee5d9b640 1 -- 172.21.15.99:0/1154354286 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed8005040 con 0x7f7ee8102ef0 2024-09-19T06:53:34.290 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:53:34 smithi099 ceph-mon[97031]: pgmap v336: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:53:34.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.286+0000 7f7ee5d9b640 1 --2- 172.21.15.99:0/1154354286 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ee8102ef0 0x7f7ee806ff50 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7edc002870 tx=0x7f7edc004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:34.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.286+0000 7f7ed6ffd640 1 -- 172.21.15.99:0/1154354286 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7edc007c30 con 0x7f7ee8102ef0 2024-09-19T06:53:34.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.286+0000 7f7ed6ffd640 1 -- 172.21.15.99:0/1154354286 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7edc00f040 con 0x7f7ee8102ef0 2024-09-19T06:53:34.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.286+0000 7f7eecab7640 1 -- 172.21.15.99:0/1154354286 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ee8070890 con 0x7f7ee8102ef0 2024-09-19T06:53:34.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.286+0000 7f7ed6ffd640 1 -- 172.21.15.99:0/1154354286 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7edc00daf0 con 0x7f7ee8102ef0 2024-09-19T06:53:34.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.287+0000 7f7eecab7640 1 -- 172.21.15.99:0/1154354286 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ee8119c20 con 0x7f7ee8102ef0 2024-09-19T06:53:34.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.288+0000 7f7eecab7640 1 -- 172.21.15.99:0/1154354286 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ee80fdcd0 con 0x7f7ee8102ef0 2024-09-19T06:53:34.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.288+0000 7f7ed6ffd640 1 -- 172.21.15.99:0/1154354286 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f7edc00dc50 con 0x7f7ee8102ef0 2024-09-19T06:53:34.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.289+0000 7f7ed6ffd640 1 --2- 172.21.15.99:0/1154354286 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f7ed006e530 0x7f7ed00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:34.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.289+0000 7f7ed6ffd640 1 -- 172.21.15.99:0/1154354286 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f7edc08df00 con 0x7f7ee8102ef0 2024-09-19T06:53:34.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.289+0000 7f7ee659c640 1 --2- 172.21.15.99:0/1154354286 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f7ed006e530 0x7f7ed00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:34.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.289+0000 7f7ee659c640 1 --2- 172.21.15.99:0/1154354286 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f7ed006e530 0x7f7ed00709e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7ed8009ac0 tx=0x7f7ed8035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:34.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.293+0000 7f7ed6ffd640 1 -- 172.21.15.99:0/1154354286 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f7edc057070 con 0x7f7ee8102ef0 2024-09-19T06:53:34.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:53:34 smithi117 ceph-mon[76771]: pgmap v336: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:53:34.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.478+0000 7f7eecab7640 1 -- 172.21.15.99:0/1154354286 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7ee804b720 con 0x7f7ed006e530 2024-09-19T06:53:34.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.479+0000 7f7ed6ffd640 1 -- 172.21.15.99:0/1154354286 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f7ee804b720 con 0x7f7ed006e530 2024-09-19T06:53:34.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.481+0000 7f7eecab7640 1 -- 172.21.15.99:0/1154354286 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f7ed006e530 msgr2=0x7f7ed00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:34.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.481+0000 7f7eecab7640 1 --2- 172.21.15.99:0/1154354286 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f7ed006e530 0x7f7ed00709e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7ed8009ac0 tx=0x7f7ed8035040 comp rx=0 tx=0).stop 2024-09-19T06:53:34.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.481+0000 7f7eecab7640 1 -- 172.21.15.99:0/1154354286 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ee8102ef0 msgr2=0x7f7ee806ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:34.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.481+0000 7f7eecab7640 1 --2- 172.21.15.99:0/1154354286 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ee8102ef0 0x7f7ee806ff50 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7edc002870 tx=0x7f7edc004600 comp rx=0 tx=0).stop 2024-09-19T06:53:34.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.481+0000 7f7eecab7640 1 -- 172.21.15.99:0/1154354286 shutdown_connections 2024-09-19T06:53:34.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.481+0000 7f7eecab7640 1 --2- 172.21.15.99:0/1154354286 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f7ed006e530 0x7f7ed00709e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:34.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.481+0000 7f7eecab7640 1 --2- 172.21.15.99:0/1154354286 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ee8102ef0 0x7f7ee806ff50 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:34.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.481+0000 7f7eecab7640 1 --2- 172.21.15.99:0/1154354286 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7ee8102550 0x7f7ee806fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:34.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.481+0000 7f7eecab7640 1 -- 172.21.15.99:0/1154354286 >> 172.21.15.99:0/1154354286 conn(0x7f7ee80f80f0 msgr2=0x7f7ee80f90b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:34.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.481+0000 7f7eecab7640 1 -- 172.21.15.99:0/1154354286 shutdown_connections 2024-09-19T06:53:34.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.481+0000 7f7eecab7640 1 -- 172.21.15.99:0/1154354286 wait complete. 2024-09-19T06:53:34.491 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-09-19T06:53:34.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.561+0000 7f740a410640 1 -- 172.21.15.99:0/4231055259 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7404102ed0 msgr2=0x7f74040fc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:34.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.561+0000 7f740a410640 1 --2- 172.21.15.99:0/4231055259 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7404102ed0 0x7f74040fc590 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f73f80048d0 tx=0x7f73f8009da0 comp rx=0 tx=0).stop 2024-09-19T06:53:34.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.561+0000 7f740a410640 1 -- 172.21.15.99:0/4231055259 shutdown_connections 2024-09-19T06:53:34.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.561+0000 7f740a410640 1 --2- 172.21.15.99:0/4231055259 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7404102ed0 0x7f74040fc590 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:34.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.561+0000 7f740a410640 1 --2- 172.21.15.99:0/4231055259 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7404102530 0x7f7404102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:34.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.561+0000 7f740a410640 1 -- 172.21.15.99:0/4231055259 >> 172.21.15.99:0/4231055259 conn(0x7f74040f80f0 msgr2=0x7f74040fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:34.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.561+0000 7f740a410640 1 -- 172.21.15.99:0/4231055259 shutdown_connections 2024-09-19T06:53:34.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.561+0000 7f740a410640 1 -- 172.21.15.99:0/4231055259 wait complete. 2024-09-19T06:53:34.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.562+0000 7f740a410640 1 Processor -- start 2024-09-19T06:53:34.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.562+0000 7f740a410640 1 -- start start 2024-09-19T06:53:34.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.562+0000 7f740a410640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7404102530 0x7f74041131f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:34.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.562+0000 7f740a410640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7404102ed0 0x7f7404113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:34.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.562+0000 7f740a410640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7404113d30 con 0x7f7404102ed0 2024-09-19T06:53:34.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.562+0000 7f740a410640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f740410d170 con 0x7f7404102530 2024-09-19T06:53:34.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.562+0000 7f74037fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7404102ed0 0x7f7404113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:34.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.562+0000 7f74037fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7404102ed0 0x7f7404113730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36324/0 (socket says 172.21.15.99:36324) 2024-09-19T06:53:34.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.562+0000 7f74037fe640 1 -- 172.21.15.99:0/4058800393 learned_addr learned my addr 172.21.15.99:0/4058800393 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:53:34.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.562+0000 7f7403fff640 1 --2- 172.21.15.99:0/4058800393 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7404102530 0x7f74041131f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:34.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.563+0000 7f74037fe640 1 -- 172.21.15.99:0/4058800393 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7404102530 msgr2=0x7f74041131f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:34.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.563+0000 7f74037fe640 1 --2- 172.21.15.99:0/4058800393 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7404102530 0x7f74041131f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:34.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.563+0000 7f74037fe640 1 -- 172.21.15.99:0/4058800393 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f8005040 con 0x7f7404102ed0 2024-09-19T06:53:34.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.563+0000 7f74037fe640 1 --2- 172.21.15.99:0/4058800393 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7404102ed0 0x7f7404113730 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f73f80043d0 tx=0x7f73f8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:34.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.563+0000 7f7400ff9640 1 -- 172.21.15.99:0/4058800393 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73f8038070 con 0x7f7404102ed0 2024-09-19T06:53:34.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.563+0000 7f7400ff9640 1 -- 172.21.15.99:0/4058800393 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f73f80096e0 con 0x7f7404102ed0 2024-09-19T06:53:34.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.563+0000 7f740a410640 1 -- 172.21.15.99:0/4058800393 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f740410d3f0 con 0x7f7404102ed0 2024-09-19T06:53:34.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.563+0000 7f7400ff9640 1 -- 172.21.15.99:0/4058800393 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73f802c8a0 con 0x7f7404102ed0 2024-09-19T06:53:34.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.563+0000 7f740a410640 1 -- 172.21.15.99:0/4058800393 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f740410d930 con 0x7f7404102ed0 2024-09-19T06:53:34.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.564+0000 7f740a410640 1 -- 172.21.15.99:0/4058800393 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74040fdcb0 con 0x7f7404102ed0 2024-09-19T06:53:34.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.565+0000 7f7400ff9640 1 -- 172.21.15.99:0/4058800393 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f73f8030020 con 0x7f7404102ed0 2024-09-19T06:53:34.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.565+0000 7f7400ff9640 1 --2- 172.21.15.99:0/4058800393 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f73ec06e530 0x7f73ec0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:34.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.565+0000 7f7400ff9640 1 -- 172.21.15.99:0/4058800393 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f73f80adde0 con 0x7f7404102ed0 2024-09-19T06:53:34.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.565+0000 7f7403fff640 1 --2- 172.21.15.99:0/4058800393 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f73ec06e530 0x7f73ec0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:34.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.565+0000 7f7403fff640 1 --2- 172.21.15.99:0/4058800393 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f73ec06e530 0x7f73ec0709e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f73f4004ed0 tx=0x7f73f400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:34.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.569+0000 7f7400ff9640 1 -- 172.21.15.99:0/4058800393 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f73f8077000 con 0x7f7404102ed0 2024-09-19T06:53:34.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.751+0000 7f740a410640 1 -- 172.21.15.99:0/4058800393 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7404109560 con 0x7f73ec06e530 2024-09-19T06:53:34.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.752+0000 7f7400ff9640 1 -- 172.21.15.99:0/4058800393 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f7404109560 con 0x7f73ec06e530 2024-09-19T06:53:34.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.754+0000 7f740a410640 1 -- 172.21.15.99:0/4058800393 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f73ec06e530 msgr2=0x7f73ec0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:34.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.754+0000 7f740a410640 1 --2- 172.21.15.99:0/4058800393 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f73ec06e530 0x7f73ec0709e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f73f4004ed0 tx=0x7f73f400b040 comp rx=0 tx=0).stop 2024-09-19T06:53:34.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.754+0000 7f740a410640 1 -- 172.21.15.99:0/4058800393 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7404102ed0 msgr2=0x7f7404113730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:34.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.754+0000 7f740a410640 1 --2- 172.21.15.99:0/4058800393 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7404102ed0 0x7f7404113730 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f73f80043d0 tx=0x7f73f8009da0 comp rx=0 tx=0).stop 2024-09-19T06:53:34.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.754+0000 7f740a410640 1 -- 172.21.15.99:0/4058800393 shutdown_connections 2024-09-19T06:53:34.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.754+0000 7f740a410640 1 --2- 172.21.15.99:0/4058800393 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f73ec06e530 0x7f73ec0709e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:34.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.754+0000 7f740a410640 1 --2- 172.21.15.99:0/4058800393 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7404102ed0 0x7f7404113730 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:34.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.754+0000 7f740a410640 1 --2- 172.21.15.99:0/4058800393 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7404102530 0x7f74041131f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:34.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.754+0000 7f740a410640 1 -- 172.21.15.99:0/4058800393 >> 172.21.15.99:0/4058800393 conn(0x7f74040f80f0 msgr2=0x7f74040f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:34.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.754+0000 7f740a410640 1 -- 172.21.15.99:0/4058800393 shutdown_connections 2024-09-19T06:53:34.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.754+0000 7f740a410640 1 -- 172.21.15.99:0/4058800393 wait complete. 2024-09-19T06:53:34.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.833+0000 7f7fe34b3640 1 -- 172.21.15.99:0/2231799657 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7fdc102550 msgr2=0x7f7fdc102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:34.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.833+0000 7f7fe34b3640 1 --2- 172.21.15.99:0/2231799657 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7fdc102550 0x7f7fdc102920 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc0048d0 tx=0x7f7fcc009da0 comp rx=0 tx=0).stop 2024-09-19T06:53:34.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.833+0000 7f7fe34b3640 1 -- 172.21.15.99:0/2231799657 shutdown_connections 2024-09-19T06:53:34.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.833+0000 7f7fe34b3640 1 --2- 172.21.15.99:0/2231799657 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7fdc102ef0 0x7f7fdc0fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:34.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.833+0000 7f7fe34b3640 1 --2- 172.21.15.99:0/2231799657 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7fdc102550 0x7f7fdc102920 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:34.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.833+0000 7f7fe34b3640 1 -- 172.21.15.99:0/2231799657 >> 172.21.15.99:0/2231799657 conn(0x7f7fdc0f80f0 msgr2=0x7f7fdc0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:34.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.833+0000 7f7fe34b3640 1 -- 172.21.15.99:0/2231799657 shutdown_connections 2024-09-19T06:53:34.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.833+0000 7f7fe34b3640 1 -- 172.21.15.99:0/2231799657 wait complete. 2024-09-19T06:53:34.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.833+0000 7f7fe34b3640 1 Processor -- start 2024-09-19T06:53:34.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.834+0000 7f7fe34b3640 1 -- start start 2024-09-19T06:53:34.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.834+0000 7f7fe34b3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7fdc102550 0x7f7fdc113540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:34.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.834+0000 7f7fe34b3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7fdc102ef0 0x7f7fdc113a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:34.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.834+0000 7f7fe34b3640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fdc1140d0 con 0x7f7fdc102550 2024-09-19T06:53:34.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.834+0000 7f7fe34b3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fdc10d4e0 con 0x7f7fdc102ef0 2024-09-19T06:53:34.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.834+0000 7f7fe124f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7fdc102550 0x7f7fdc113540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:34.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.834+0000 7f7fe124f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7fdc102550 0x7f7fdc113540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36330/0 (socket says 172.21.15.99:36330) 2024-09-19T06:53:34.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.834+0000 7f7fe124f640 1 -- 172.21.15.99:0/768880247 learned_addr learned my addr 172.21.15.99:0/768880247 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:53:34.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.834+0000 7f7fe0a4e640 1 --2- 172.21.15.99:0/768880247 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7fdc102ef0 0x7f7fdc113a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:34.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.834+0000 7f7fe124f640 1 -- 172.21.15.99:0/768880247 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7fdc102ef0 msgr2=0x7f7fdc113a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:34.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.834+0000 7f7fe124f640 1 --2- 172.21.15.99:0/768880247 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7fdc102ef0 0x7f7fdc113a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:34.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.834+0000 7f7fe124f640 1 -- 172.21.15.99:0/768880247 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fcc005040 con 0x7f7fdc102550 2024-09-19T06:53:34.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.834+0000 7f7fe124f640 1 --2- 172.21.15.99:0/768880247 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7fdc102550 0x7f7fdc113540 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc000c00 tx=0x7f7fcc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:34.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.835+0000 7f7fd1ffb640 1 -- 172.21.15.99:0/768880247 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fcc038070 con 0x7f7fdc102550 2024-09-19T06:53:34.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.835+0000 7f7fe34b3640 1 -- 172.21.15.99:0/768880247 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fdc10d760 con 0x7f7fdc102550 2024-09-19T06:53:34.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.835+0000 7f7fd1ffb640 1 -- 172.21.15.99:0/768880247 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7fcc02ade0 con 0x7f7fdc102550 2024-09-19T06:53:34.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.835+0000 7f7fd1ffb640 1 -- 172.21.15.99:0/768880247 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fcc02c7b0 con 0x7f7fdc102550 2024-09-19T06:53:34.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.835+0000 7f7fe34b3640 1 -- 172.21.15.99:0/768880247 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fdc10dca0 con 0x7f7fdc102550 2024-09-19T06:53:34.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.836+0000 7f7fe34b3640 1 -- 172.21.15.99:0/768880247 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fdc0fdcd0 con 0x7f7fdc102550 2024-09-19T06:53:34.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.836+0000 7f7fd1ffb640 1 -- 172.21.15.99:0/768880247 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f7fcc030020 con 0x7f7fdc102550 2024-09-19T06:53:34.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.837+0000 7f7fd1ffb640 1 --2- 172.21.15.99:0/768880247 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f7fc806e530 0x7f7fc80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:34.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.837+0000 7f7fd1ffb640 1 -- 172.21.15.99:0/768880247 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f7fcc0ae4e0 con 0x7f7fdc102550 2024-09-19T06:53:34.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.837+0000 7f7fe0a4e640 1 --2- 172.21.15.99:0/768880247 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f7fc806e530 0x7f7fc80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:34.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.838+0000 7f7fe0a4e640 1 --2- 172.21.15.99:0/768880247 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f7fc806e530 0x7f7fc80709e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc10e7c0 tx=0x7f7fd800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:34.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:34.841+0000 7f7fd1ffb640 1 -- 172.21.15.99:0/768880247 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f7fcc077650 con 0x7f7fdc102550 2024-09-19T06:53:35.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.015+0000 7f7fe34b3640 1 -- 172.21.15.99:0/768880247 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7fdc04b720 con 0x7f7fc806e530 2024-09-19T06:53:35.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.024+0000 7f7fd1ffb640 1 -- 172.21.15.99:0/768880247 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f7fdc04b720 con 0x7f7fc806e530 2024-09-19T06:53:35.025 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T06:53:35.025 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.smithi099 smithi099 *:9093,9094 running (12m) 5m ago 20m 23.4M - 0.25.0 c8568f914cd2 e7c1774d56b0 2024-09-19T06:53:35.025 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi099 smithi099 running (9m) 5m ago 21m 6899k - 19.1.1-361-g2f599a46 d2baa855c067 b9775f416b10 2024-09-19T06:53:35.026 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi117 smithi117 running (9m) 4m ago 20m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 38cf60c0d548 2024-09-19T06:53:35.026 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.smithi099 smithi099 *:3000 running (11m) 5m ago 20m 80.7M - 9.4.12 2bacad6d85d8 cd53a18d5410 2024-09-19T06:53:35.026 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.obarqf smithi099 running (5m) 5m ago 15m 12.2M - 19.1.1-361-g2f599a46 d2baa855c067 314a73082521 2024-09-19T06:53:35.026 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.xehbxe smithi099 running (5m) 5m ago 15m 14.4M - 19.1.1-361-g2f599a46 d2baa855c067 a2955a9d06e6 2024-09-19T06:53:35.026 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.bheqzh smithi117 running (4m) 4m ago 15m 11.8M - 19.1.1-361-g2f599a46 d2baa855c067 b1505937c0b7 2024-09-19T06:53:35.026 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.nooexo smithi117 running (5m) 4m ago 15m 13.1M - 19.1.1-361-g2f599a46 d2baa855c067 35bd7725855c 2024-09-19T06:53:35.026 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi099.pgvkqi smithi099 *:8443,9283,8765 running (12m) 5m ago 22m 505M - 19.1.1-361-g2f599a46 d2baa855c067 d5de99cb7e78 2024-09-19T06:53:35.026 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi117.ssmkcf smithi117 *:8443,9283,8765 running (11m) 4m ago 20m 444M - 19.1.1-361-g2f599a46 d2baa855c067 8b7ee0f871f5 2024-09-19T06:53:35.026 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi099 smithi099 running (10m) 5m ago 22m 52.4M 2048M 19.1.1-361-g2f599a46 d2baa855c067 ffe067438824 2024-09-19T06:53:35.026 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi117 smithi117 running (9m) 4m ago 20m 38.9M 2048M 19.1.1-361-g2f599a46 d2baa855c067 4cb7455e3ee7 2024-09-19T06:53:35.027 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi099 smithi099 *:9100 running (12m) 5m ago 21m 15.0M - 1.5.0 0da6a335fe13 dca7b4517dcc 2024-09-19T06:53:35.027 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi117 smithi117 *:9100 running (12m) 4m ago 20m 15.9M - 1.5.0 0da6a335fe13 8233ce3835d2 2024-09-19T06:53:35.027 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (8m) 5m ago 19m 100M 1557M 19.1.1-361-g2f599a46 d2baa855c067 8e22543bf933 2024-09-19T06:53:35.027 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (8m) 5m ago 18m 106M 1557M 19.1.1-361-g2f599a46 d2baa855c067 f54153d0ae09 2024-09-19T06:53:35.027 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (7m) 5m ago 18m 83.7M 1557M 19.1.1-361-g2f599a46 d2baa855c067 b1778ab88870 2024-09-19T06:53:35.027 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi117 running (6m) 4m ago 18m 102M 2581M 19.1.1-361-g2f599a46 d2baa855c067 ea5236b193d3 2024-09-19T06:53:35.027 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi117 running (6m) 4m ago 17m 93.5M 2581M 19.1.1-361-g2f599a46 d2baa855c067 27ac2c859a68 2024-09-19T06:53:35.027 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi117 running (5m) 4m ago 17m 100M 2581M 19.1.1-361-g2f599a46 d2baa855c067 de6aeb8544ce 2024-09-19T06:53:35.028 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.smithi099 smithi099 *:9095 running (11m) 5m ago 20m 64.4M - 2.43.0 a07b618ecd1d 15ad26ec6fb4 2024-09-19T06:53:35.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.026+0000 7f7fe34b3640 1 -- 172.21.15.99:0/768880247 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f7fc806e530 msgr2=0x7f7fc80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:35.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.026+0000 7f7fe34b3640 1 --2- 172.21.15.99:0/768880247 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f7fc806e530 0x7f7fc80709e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc10e7c0 tx=0x7f7fd800b040 comp rx=0 tx=0).stop 2024-09-19T06:53:35.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.026+0000 7f7fe34b3640 1 -- 172.21.15.99:0/768880247 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7fdc102550 msgr2=0x7f7fdc113540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:35.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.026+0000 7f7fe34b3640 1 --2- 172.21.15.99:0/768880247 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7fdc102550 0x7f7fdc113540 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc000c00 tx=0x7f7fcc009da0 comp rx=0 tx=0).stop 2024-09-19T06:53:35.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.026+0000 7f7fe34b3640 1 -- 172.21.15.99:0/768880247 shutdown_connections 2024-09-19T06:53:35.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.026+0000 7f7fe34b3640 1 --2- 172.21.15.99:0/768880247 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f7fc806e530 0x7f7fc80709e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:35.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.026+0000 7f7fe34b3640 1 --2- 172.21.15.99:0/768880247 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7fdc102ef0 0x7f7fdc113a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:35.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.026+0000 7f7fe34b3640 1 --2- 172.21.15.99:0/768880247 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7fdc102550 0x7f7fdc113540 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:35.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.026+0000 7f7fe34b3640 1 -- 172.21.15.99:0/768880247 >> 172.21.15.99:0/768880247 conn(0x7f7fdc0f80f0 msgr2=0x7f7fdc0f9160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:35.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.026+0000 7f7fe34b3640 1 -- 172.21.15.99:0/768880247 shutdown_connections 2024-09-19T06:53:35.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.026+0000 7f7fe34b3640 1 -- 172.21.15.99:0/768880247 wait complete. 2024-09-19T06:53:35.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.112+0000 7fd5f96b1640 1 -- 172.21.15.99:0/2611054015 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5f40fd590 msgr2=0x7fd5f40fd960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:35.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.112+0000 7fd5f96b1640 1 --2- 172.21.15.99:0/2611054015 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5f40fd590 0x7fd5f40fd960 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fd5e4009c50 tx=0x7fd5e4004d10 comp rx=0 tx=0).stop 2024-09-19T06:53:35.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.112+0000 7fd5f96b1640 1 -- 172.21.15.99:0/2611054015 shutdown_connections 2024-09-19T06:53:35.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.112+0000 7fd5f96b1640 1 --2- 172.21.15.99:0/2611054015 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5f40fdf30 0x7fd5f4106600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:35.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.112+0000 7fd5f96b1640 1 --2- 172.21.15.99:0/2611054015 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5f40fd590 0x7fd5f40fd960 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:35.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.112+0000 7fd5f96b1640 1 -- 172.21.15.99:0/2611054015 >> 172.21.15.99:0/2611054015 conn(0x7fd5f40f7030 msgr2=0x7fd5f40f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:35.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.113+0000 7fd5f96b1640 1 -- 172.21.15.99:0/2611054015 shutdown_connections 2024-09-19T06:53:35.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.113+0000 7fd5f96b1640 1 -- 172.21.15.99:0/2611054015 wait complete. 2024-09-19T06:53:35.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.113+0000 7fd5f96b1640 1 Processor -- start 2024-09-19T06:53:35.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.113+0000 7fd5f96b1640 1 -- start start 2024-09-19T06:53:35.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.114+0000 7fd5f96b1640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5f40fd590 0x7fd5f40fb450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:35.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.114+0000 7fd5f96b1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5f40fdf30 0x7fd5f40fb990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:35.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.114+0000 7fd5f96b1640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f40fbed0 con 0x7fd5f40fd590 2024-09-19T06:53:35.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.114+0000 7fd5f96b1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f40fc040 con 0x7fd5f40fdf30 2024-09-19T06:53:35.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.114+0000 7fd5f2ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5f40fd590 0x7fd5f40fb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:35.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.114+0000 7fd5f2ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5f40fd590 0x7fd5f40fb450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36344/0 (socket says 172.21.15.99:36344) 2024-09-19T06:53:35.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.114+0000 7fd5f2ffd640 1 -- 172.21.15.99:0/3782791331 learned_addr learned my addr 172.21.15.99:0/3782791331 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:53:35.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.114+0000 7fd5f27fc640 1 --2- 172.21.15.99:0/3782791331 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5f40fdf30 0x7fd5f40fb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:35.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.114+0000 7fd5f2ffd640 1 -- 172.21.15.99:0/3782791331 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5f40fdf30 msgr2=0x7fd5f40fb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:35.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.114+0000 7fd5f2ffd640 1 --2- 172.21.15.99:0/3782791331 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5f40fdf30 0x7fd5f40fb990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:35.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.114+0000 7fd5f2ffd640 1 -- 172.21.15.99:0/3782791331 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5e40098b0 con 0x7fd5f40fd590 2024-09-19T06:53:35.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.114+0000 7fd5f2ffd640 1 --2- 172.21.15.99:0/3782791331 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5f40fd590 0x7fd5f40fb450 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd5e4004a30 tx=0x7fd5e4004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:35.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.114+0000 7fd5db7fe640 1 -- 172.21.15.99:0/3782791331 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5e4009590 con 0x7fd5f40fd590 2024-09-19T06:53:35.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.114+0000 7fd5f96b1640 1 -- 172.21.15.99:0/3782791331 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5f40fc270 con 0x7fd5f40fd590 2024-09-19T06:53:35.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.115+0000 7fd5db7fe640 1 -- 172.21.15.99:0/3782791331 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd5e40096f0 con 0x7fd5f40fd590 2024-09-19T06:53:35.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.115+0000 7fd5db7fe640 1 -- 172.21.15.99:0/3782791331 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5e403d9d0 con 0x7fd5f40fd590 2024-09-19T06:53:35.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.115+0000 7fd5f96b1640 1 -- 172.21.15.99:0/3782791331 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5f4119860 con 0x7fd5f40fd590 2024-09-19T06:53:35.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.116+0000 7fd5f96b1640 1 -- 172.21.15.99:0/3782791331 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5f4066030 con 0x7fd5f40fd590 2024-09-19T06:53:35.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.117+0000 7fd5db7fe640 1 -- 172.21.15.99:0/3782791331 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fd5e402f030 con 0x7fd5f40fd590 2024-09-19T06:53:35.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.117+0000 7fd5db7fe640 1 --2- 172.21.15.99:0/3782791331 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd5dc06e530 0x7fd5dc0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:35.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.117+0000 7fd5db7fe640 1 -- 172.21.15.99:0/3782791331 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fd5e40af610 con 0x7fd5f40fd590 2024-09-19T06:53:35.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.117+0000 7fd5f27fc640 1 --2- 172.21.15.99:0/3782791331 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd5dc06e530 0x7fd5dc0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:35.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.118+0000 7fd5f27fc640 1 --2- 172.21.15.99:0/3782791331 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd5dc06e530 0x7fd5dc0709e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd5f40fcd90 tx=0x7fd5e800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:35.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.122+0000 7fd5db7fe640 1 -- 172.21.15.99:0/3782791331 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fd5e4078700 con 0x7fd5f40fd590 2024-09-19T06:53:35.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.352+0000 7fd5f96b1640 1 -- 172.21.15.99:0/3782791331 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd5f404b7b0 con 0x7fd5f40fd590 2024-09-19T06:53:35.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.352+0000 7fd5db7fe640 1 -- 172.21.15.99:0/3782791331 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7fd5e407bdc0 con 0x7fd5f40fd590 2024-09-19T06:53:35.354 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:53:35.354 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-09-19T06:53:35.354 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T06:53:35.355 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:53:35.355 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-09-19T06:53:35.355 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T06:53:35.355 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:53:35.355 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-09-19T06:53:35.355 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 6 2024-09-19T06:53:35.356 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:53:35.356 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": { 2024-09-19T06:53:35.356 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 4 2024-09-19T06:53:35.356 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:53:35.356 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-09-19T06:53:35.356 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 14 2024-09-19T06:53:35.356 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T06:53:35.357 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:53:35.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.354+0000 7fd5f96b1640 1 -- 172.21.15.99:0/3782791331 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd5dc06e530 msgr2=0x7fd5dc0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:35.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.354+0000 7fd5f96b1640 1 --2- 172.21.15.99:0/3782791331 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd5dc06e530 0x7fd5dc0709e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd5f40fcd90 tx=0x7fd5e800b040 comp rx=0 tx=0).stop 2024-09-19T06:53:35.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.354+0000 7fd5f96b1640 1 -- 172.21.15.99:0/3782791331 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5f40fd590 msgr2=0x7fd5f40fb450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:35.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.354+0000 7fd5f96b1640 1 --2- 172.21.15.99:0/3782791331 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5f40fd590 0x7fd5f40fb450 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd5e4004a30 tx=0x7fd5e4004d10 comp rx=0 tx=0).stop 2024-09-19T06:53:35.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.354+0000 7fd5f96b1640 1 -- 172.21.15.99:0/3782791331 shutdown_connections 2024-09-19T06:53:35.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.354+0000 7fd5f96b1640 1 --2- 172.21.15.99:0/3782791331 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd5dc06e530 0x7fd5dc0709e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:35.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.354+0000 7fd5f96b1640 1 --2- 172.21.15.99:0/3782791331 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd5f40fdf30 0x7fd5f40fb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:35.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.354+0000 7fd5f96b1640 1 --2- 172.21.15.99:0/3782791331 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd5f40fd590 0x7fd5f40fb450 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:35.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.354+0000 7fd5f96b1640 1 -- 172.21.15.99:0/3782791331 >> 172.21.15.99:0/3782791331 conn(0x7fd5f40f7030 msgr2=0x7fd5f40f8720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:35.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.355+0000 7fd5f96b1640 1 -- 172.21.15.99:0/3782791331 shutdown_connections 2024-09-19T06:53:35.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.355+0000 7fd5f96b1640 1 -- 172.21.15.99:0/3782791331 wait complete. 2024-09-19T06:53:35.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.432+0000 7fd844d3b640 1 -- 172.21.15.99:0/3313664708 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8400fac60 msgr2=0x7fd8400fb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:35.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.432+0000 7fd844d3b640 1 --2- 172.21.15.99:0/3313664708 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8400fac60 0x7fd8400fb0b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd8280048d0 tx=0x7fd828009da0 comp rx=0 tx=0).stop 2024-09-19T06:53:35.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.432+0000 7fd844d3b640 1 -- 172.21.15.99:0/3313664708 shutdown_connections 2024-09-19T06:53:35.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.432+0000 7fd844d3b640 1 --2- 172.21.15.99:0/3313664708 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8400fac60 0x7fd8400fb0b0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:35.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.432+0000 7fd844d3b640 1 --2- 172.21.15.99:0/3313664708 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8400fd460 0x7fd8400fd830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:35.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.432+0000 7fd844d3b640 1 -- 172.21.15.99:0/3313664708 >> 172.21.15.99:0/3313664708 conn(0x7fd840070c80 msgr2=0x7fd840071080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:35.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.432+0000 7fd844d3b640 1 -- 172.21.15.99:0/3313664708 shutdown_connections 2024-09-19T06:53:35.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.432+0000 7fd844d3b640 1 -- 172.21.15.99:0/3313664708 wait complete. 2024-09-19T06:53:35.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.433+0000 7fd844d3b640 1 Processor -- start 2024-09-19T06:53:35.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.433+0000 7fd844d3b640 1 -- start start 2024-09-19T06:53:35.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.433+0000 7fd844d3b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8400fac60 0x7fd8401153d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:35.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.433+0000 7fd844d3b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8400fd460 0x7fd840115910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:35.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.433+0000 7fd844d3b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd840115f10 con 0x7fd8400fac60 2024-09-19T06:53:35.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.433+0000 7fd844d3b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd84010f350 con 0x7fd8400fd460 2024-09-19T06:53:35.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.433+0000 7fd83e59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8400fac60 0x7fd8401153d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:35.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.433+0000 7fd83e59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8400fac60 0x7fd8401153d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33066/0 (socket says 172.21.15.99:33066) 2024-09-19T06:53:35.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.433+0000 7fd83e59c640 1 -- 172.21.15.99:0/2769841852 learned_addr learned my addr 172.21.15.99:0/2769841852 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:53:35.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.433+0000 7fd837fff640 1 --2- 172.21.15.99:0/2769841852 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8400fd460 0x7fd840115910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:35.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.433+0000 7fd83e59c640 1 -- 172.21.15.99:0/2769841852 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8400fd460 msgr2=0x7fd840115910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:35.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.433+0000 7fd83e59c640 1 --2- 172.21.15.99:0/2769841852 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8400fd460 0x7fd840115910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:35.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.433+0000 7fd83e59c640 1 -- 172.21.15.99:0/2769841852 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd828005040 con 0x7fd8400fac60 2024-09-19T06:53:35.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.433+0000 7fd837fff640 1 --2- 172.21.15.99:0/2769841852 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8400fd460 0x7fd840115910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:53:35.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.434+0000 7fd83e59c640 1 --2- 172.21.15.99:0/2769841852 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8400fac60 0x7fd8401153d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd83000c790 tx=0x7fd8300043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:35.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.434+0000 7fd836ffd640 1 -- 172.21.15.99:0/2769841852 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd83000a820 con 0x7fd8400fac60 2024-09-19T06:53:35.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.434+0000 7fd844d3b640 1 -- 172.21.15.99:0/2769841852 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd84010f630 con 0x7fd8400fac60 2024-09-19T06:53:35.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.434+0000 7fd836ffd640 1 -- 172.21.15.99:0/2769841852 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd83000ae20 con 0x7fd8400fac60 2024-09-19T06:53:35.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.434+0000 7fd836ffd640 1 -- 172.21.15.99:0/2769841852 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8300113a0 con 0x7fd8400fac60 2024-09-19T06:53:35.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.434+0000 7fd844d3b640 1 -- 172.21.15.99:0/2769841852 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd84010fba0 con 0x7fd8400fac60 2024-09-19T06:53:35.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.435+0000 7fd844d3b640 1 -- 172.21.15.99:0/2769841852 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8400fbc70 con 0x7fd8400fac60 2024-09-19T06:53:35.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.435+0000 7fd836ffd640 1 -- 172.21.15.99:0/2769841852 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fd830012400 con 0x7fd8400fac60 2024-09-19T06:53:35.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.436+0000 7fd836ffd640 1 --2- 172.21.15.99:0/2769841852 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd82c06e530 0x7fd82c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:35.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.436+0000 7fd836ffd640 1 -- 172.21.15.99:0/2769841852 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fd83008e230 con 0x7fd8400fac60 2024-09-19T06:53:35.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.436+0000 7fd837fff640 1 --2- 172.21.15.99:0/2769841852 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd82c06e530 0x7fd82c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:35.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.437+0000 7fd837fff640 1 --2- 172.21.15.99:0/2769841852 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd82c06e530 0x7fd82c0709e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd828000c00 tx=0x7fd828009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:35.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.440+0000 7fd836ffd640 1 -- 172.21.15.99:0/2769841852 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fd830057460 con 0x7fd8400fac60 2024-09-19T06:53:35.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.639+0000 7fd844d3b640 1 -- 172.21.15.99:0/2769841852 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd84004b720 con 0x7fd8400fac60 2024-09-19T06:53:35.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.640+0000 7fd836ffd640 1 -- 172.21.15.99:0/2769841852 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 29 v29) v1 ==== 76+0+1915 (secure 0 0 0) 0x7fd83005ab20 con 0x7fd8400fac60 2024-09-19T06:53:35.642 INFO:teuthology.orchestra.run.smithi099.stdout:e29 2024-09-19T06:53:35.642 INFO:teuthology.orchestra.run.smithi099.stdout:btime 2024-09-19T06:48:47:938420+0000 2024-09-19T06:53:35.642 INFO:teuthology.orchestra.run.smithi099.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T06:53:35.642 INFO:teuthology.orchestra.run.smithi099.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T06:53:35.643 INFO:teuthology.orchestra.run.smithi099.stdout:legacy client fscid: 1 2024-09-19T06:53:35.643 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:53:35.643 INFO:teuthology.orchestra.run.smithi099.stdout:Filesystem 'cephfs' (1) 2024-09-19T06:53:35.643 INFO:teuthology.orchestra.run.smithi099.stdout:fs_name cephfs 2024-09-19T06:53:35.643 INFO:teuthology.orchestra.run.smithi099.stdout:epoch 20 2024-09-19T06:53:35.644 INFO:teuthology.orchestra.run.smithi099.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-19T06:53:35.644 INFO:teuthology.orchestra.run.smithi099.stdout:created 2024-09-19T06:37:40.838146+0000 2024-09-19T06:53:35.644 INFO:teuthology.orchestra.run.smithi099.stdout:modified 2024-09-19T06:47:50.076553+0000 2024-09-19T06:53:35.644 INFO:teuthology.orchestra.run.smithi099.stdout:tableserver 0 2024-09-19T06:53:35.644 INFO:teuthology.orchestra.run.smithi099.stdout:root 0 2024-09-19T06:53:35.644 INFO:teuthology.orchestra.run.smithi099.stdout:session_timeout 60 2024-09-19T06:53:35.645 INFO:teuthology.orchestra.run.smithi099.stdout:session_autoclose 300 2024-09-19T06:53:35.645 INFO:teuthology.orchestra.run.smithi099.stdout:max_file_size 1099511627776 2024-09-19T06:53:35.645 INFO:teuthology.orchestra.run.smithi099.stdout:max_xattr_size 65536 2024-09-19T06:53:35.645 INFO:teuthology.orchestra.run.smithi099.stdout:required_client_features {} 2024-09-19T06:53:35.645 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure 0 2024-09-19T06:53:35.645 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure_osd_epoch 77 2024-09-19T06:53:35.646 INFO:teuthology.orchestra.run.smithi099.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T06:53:35.646 INFO:teuthology.orchestra.run.smithi099.stdout:max_mds 2 2024-09-19T06:53:35.646 INFO:teuthology.orchestra.run.smithi099.stdout:in 0,1 2024-09-19T06:53:35.646 INFO:teuthology.orchestra.run.smithi099.stdout:up {} 2024-09-19T06:53:35.646 INFO:teuthology.orchestra.run.smithi099.stdout:failed 0,1 2024-09-19T06:53:35.647 INFO:teuthology.orchestra.run.smithi099.stdout:damaged 2024-09-19T06:53:35.647 INFO:teuthology.orchestra.run.smithi099.stdout:stopped 2024-09-19T06:53:35.647 INFO:teuthology.orchestra.run.smithi099.stdout:data_pools [3] 2024-09-19T06:53:35.647 INFO:teuthology.orchestra.run.smithi099.stdout:metadata_pool 2 2024-09-19T06:53:35.647 INFO:teuthology.orchestra.run.smithi099.stdout:inline_data disabled 2024-09-19T06:53:35.647 INFO:teuthology.orchestra.run.smithi099.stdout:balancer 2024-09-19T06:53:35.648 INFO:teuthology.orchestra.run.smithi099.stdout:bal_rank_mask -1 2024-09-19T06:53:35.648 INFO:teuthology.orchestra.run.smithi099.stdout:standby_count_wanted 1 2024-09-19T06:53:35.648 INFO:teuthology.orchestra.run.smithi099.stdout:qdb_cluster leader: 0 members: 2024-09-19T06:53:35.648 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:53:35.649 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:53:35.649 INFO:teuthology.orchestra.run.smithi099.stdout:Standby daemons: 2024-09-19T06:53:35.649 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:53:35.649 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.obarqf{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6826/1859154203,v1:172.21.15.99:6827/1859154203] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:53:35.649 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.xehbxe{-1:34410} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6828/1939453719,v1:172.21.15.99:6829/1939453719] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:53:35.650 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.nooexo{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6824/1398895079,v1:172.21.15.117:6825/1398895079] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:53:35.650 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.bheqzh{-1:44329} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6826/3233337308,v1:172.21.15.117:6827/3233337308] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:53:35.651 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 29 2024-09-19T06:53:35.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.641+0000 7fd844d3b640 1 -- 172.21.15.99:0/2769841852 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd82c06e530 msgr2=0x7fd82c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:35.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.641+0000 7fd844d3b640 1 --2- 172.21.15.99:0/2769841852 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd82c06e530 0x7fd82c0709e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd828000c00 tx=0x7fd828009da0 comp rx=0 tx=0).stop 2024-09-19T06:53:35.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.641+0000 7fd844d3b640 1 -- 172.21.15.99:0/2769841852 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8400fac60 msgr2=0x7fd8401153d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:35.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.641+0000 7fd844d3b640 1 --2- 172.21.15.99:0/2769841852 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8400fac60 0x7fd8401153d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd83000c790 tx=0x7fd8300043c0 comp rx=0 tx=0).stop 2024-09-19T06:53:35.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.642+0000 7fd844d3b640 1 -- 172.21.15.99:0/2769841852 shutdown_connections 2024-09-19T06:53:35.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.642+0000 7fd844d3b640 1 --2- 172.21.15.99:0/2769841852 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd82c06e530 0x7fd82c0709e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:35.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.642+0000 7fd844d3b640 1 --2- 172.21.15.99:0/2769841852 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd8400fd460 0x7fd840115910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:35.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.642+0000 7fd844d3b640 1 --2- 172.21.15.99:0/2769841852 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd8400fac60 0x7fd8401153d0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:35.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.642+0000 7fd844d3b640 1 -- 172.21.15.99:0/2769841852 >> 172.21.15.99:0/2769841852 conn(0x7fd840070c80 msgr2=0x7fd8400f8c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:35.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.642+0000 7fd844d3b640 1 -- 172.21.15.99:0/2769841852 shutdown_connections 2024-09-19T06:53:35.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.642+0000 7fd844d3b640 1 -- 172.21.15.99:0/2769841852 wait complete. 2024-09-19T06:53:35.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.721+0000 7f8515506640 1 -- 172.21.15.99:0/289098838 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85100fb480 msgr2=0x7f85100fb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:35.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.721+0000 7f8515506640 1 --2- 172.21.15.99:0/289098838 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85100fb480 0x7f85100fb8f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f84f80048d0 tx=0x7f84f8009da0 comp rx=0 tx=0).stop 2024-09-19T06:53:35.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.721+0000 7f8515506640 1 -- 172.21.15.99:0/289098838 shutdown_connections 2024-09-19T06:53:35.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.721+0000 7f8515506640 1 --2- 172.21.15.99:0/289098838 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85100fb480 0x7f85100fb8f0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:35.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.721+0000 7f8515506640 1 --2- 172.21.15.99:0/289098838 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85101014c0 0x7f8510101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:35.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.721+0000 7f8515506640 1 -- 172.21.15.99:0/289098838 >> 172.21.15.99:0/289098838 conn(0x7f85100f7000 msgr2=0x7f85100f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:35.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.721+0000 7f8515506640 1 -- 172.21.15.99:0/289098838 shutdown_connections 2024-09-19T06:53:35.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.721+0000 7f8515506640 1 -- 172.21.15.99:0/289098838 wait complete. 2024-09-19T06:53:35.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.721+0000 7f8515506640 1 Processor -- start 2024-09-19T06:53:35.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.722+0000 7f8515506640 1 -- start start 2024-09-19T06:53:35.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.722+0000 7f8515506640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85100fb480 0x7f851010e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:35.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.722+0000 7f8515506640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85101014c0 0x7f851010e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:35.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.722+0000 7f8515506640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f851010ed20 con 0x7f85101014c0 2024-09-19T06:53:35.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.722+0000 7f8515506640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f851010ee90 con 0x7f85100fb480 2024-09-19T06:53:35.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.722+0000 7f850e7fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85101014c0 0x7f851010e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:35.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.722+0000 7f850e7fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85101014c0 0x7f851010e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33084/0 (socket says 172.21.15.99:33084) 2024-09-19T06:53:35.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.722+0000 7f850e7fc640 1 -- 172.21.15.99:0/3935804565 learned_addr learned my addr 172.21.15.99:0/3935804565 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:53:35.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.722+0000 7f850effd640 1 --2- 172.21.15.99:0/3935804565 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85100fb480 0x7f851010e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:35.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.722+0000 7f850e7fc640 1 -- 172.21.15.99:0/3935804565 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85100fb480 msgr2=0x7f851010e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:35.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.722+0000 7f850e7fc640 1 --2- 172.21.15.99:0/3935804565 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85100fb480 0x7f851010e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:35.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.722+0000 7f850e7fc640 1 -- 172.21.15.99:0/3935804565 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f8005040 con 0x7f85101014c0 2024-09-19T06:53:35.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.722+0000 7f850e7fc640 1 --2- 172.21.15.99:0/3935804565 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85101014c0 0x7f851010e6d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f84f8000c00 tx=0x7f84f8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:35.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.723+0000 7f85077fe640 1 -- 172.21.15.99:0/3935804565 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84f8038070 con 0x7f85101014c0 2024-09-19T06:53:35.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.723+0000 7f85077fe640 1 -- 172.21.15.99:0/3935804565 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f84f802ade0 con 0x7f85101014c0 2024-09-19T06:53:35.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.723+0000 7f8515506640 1 -- 172.21.15.99:0/3935804565 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8510117200 con 0x7f85101014c0 2024-09-19T06:53:35.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.723+0000 7f85077fe640 1 -- 172.21.15.99:0/3935804565 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84f802c7e0 con 0x7f85101014c0 2024-09-19T06:53:35.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.723+0000 7f8515506640 1 -- 172.21.15.99:0/3935804565 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85101175e0 con 0x7f85101014c0 2024-09-19T06:53:35.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.724+0000 7f8515506640 1 -- 172.21.15.99:0/3935804565 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85100fcbc0 con 0x7f85101014c0 2024-09-19T06:53:35.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.724+0000 7f85077fe640 1 -- 172.21.15.99:0/3935804565 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f84f8030020 con 0x7f85101014c0 2024-09-19T06:53:35.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.725+0000 7f85077fe640 1 --2- 172.21.15.99:0/3935804565 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f84fc06e530 0x7f84fc0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:35.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.725+0000 7f85077fe640 1 -- 172.21.15.99:0/3935804565 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f84f80add50 con 0x7f85101014c0 2024-09-19T06:53:35.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.725+0000 7f850effd640 1 --2- 172.21.15.99:0/3935804565 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f84fc06e530 0x7f84fc0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:35.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.725+0000 7f850effd640 1 --2- 172.21.15.99:0/3935804565 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f84fc06e530 0x7f84fc0709e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f85080102e0 tx=0x7f8508009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:35.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.729+0000 7f85077fe640 1 -- 172.21.15.99:0/3935804565 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f84f8076f70 con 0x7f85101014c0 2024-09-19T06:53:35.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.910+0000 7f8515506640 1 -- 172.21.15.99:0/3935804565 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f851004b720 con 0x7f84fc06e530 2024-09-19T06:53:35.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.911+0000 7f85077fe640 1 -- 172.21.15.99:0/3935804565 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f851004b720 con 0x7f84fc06e530 2024-09-19T06:53:35.912 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:53:35.912 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T06:53:35.913 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": true, 2024-09-19T06:53:35.913 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T06:53:35.913 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [ 2024-09-19T06:53:35.913 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr", 2024-09-19T06:53:35.913 INFO:teuthology.orchestra.run.smithi099.stdout: "crash", 2024-09-19T06:53:35.913 INFO:teuthology.orchestra.run.smithi099.stdout: "mds", 2024-09-19T06:53:35.913 INFO:teuthology.orchestra.run.smithi099.stdout: "mon", 2024-09-19T06:53:35.913 INFO:teuthology.orchestra.run.smithi099.stdout: "osd" 2024-09-19T06:53:35.913 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-19T06:53:35.913 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": "16/21 daemons upgraded", 2024-09-19T06:53:35.914 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "Currently upgrading mds daemons", 2024-09-19T06:53:35.914 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-09-19T06:53:35.914 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:53:35.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.913+0000 7f8515506640 1 -- 172.21.15.99:0/3935804565 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f84fc06e530 msgr2=0x7f84fc0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:35.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.913+0000 7f8515506640 1 --2- 172.21.15.99:0/3935804565 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f84fc06e530 0x7f84fc0709e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f85080102e0 tx=0x7f8508009040 comp rx=0 tx=0).stop 2024-09-19T06:53:35.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.913+0000 7f8515506640 1 -- 172.21.15.99:0/3935804565 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85101014c0 msgr2=0x7f851010e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:35.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.913+0000 7f8515506640 1 --2- 172.21.15.99:0/3935804565 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85101014c0 0x7f851010e6d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f84f8000c00 tx=0x7f84f8009da0 comp rx=0 tx=0).stop 2024-09-19T06:53:35.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.913+0000 7f8515506640 1 -- 172.21.15.99:0/3935804565 shutdown_connections 2024-09-19T06:53:35.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.913+0000 7f8515506640 1 --2- 172.21.15.99:0/3935804565 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f84fc06e530 0x7f84fc0709e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:35.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.913+0000 7f8515506640 1 --2- 172.21.15.99:0/3935804565 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85101014c0 0x7f851010e6d0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:35.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.913+0000 7f8515506640 1 --2- 172.21.15.99:0/3935804565 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85100fb480 0x7f851010e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:35.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.913+0000 7f8515506640 1 -- 172.21.15.99:0/3935804565 >> 172.21.15.99:0/3935804565 conn(0x7f85100f7000 msgr2=0x7f85100f73d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:35.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.914+0000 7f8515506640 1 -- 172.21.15.99:0/3935804565 shutdown_connections 2024-09-19T06:53:35.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.914+0000 7f8515506640 1 -- 172.21.15.99:0/3935804565 wait complete. 2024-09-19T06:53:35.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.992+0000 7f16dfd46640 1 -- 172.21.15.99:0/2706509424 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f16d8064fe0 msgr2=0x7f16d8065430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:35.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.992+0000 7f16dfd46640 1 --2- 172.21.15.99:0/2706509424 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f16d8064fe0 0x7f16d8065430 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f16d40048d0 tx=0x7f16d4009da0 comp rx=0 tx=0).stop 2024-09-19T06:53:35.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.992+0000 7f16dfd46640 1 -- 172.21.15.99:0/2706509424 shutdown_connections 2024-09-19T06:53:35.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.992+0000 7f16dfd46640 1 --2- 172.21.15.99:0/2706509424 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f16d8064fe0 0x7f16d8065430 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:35.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.992+0000 7f16dfd46640 1 --2- 172.21.15.99:0/2706509424 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16d80fe450 0x7f16d80fe820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:35.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.992+0000 7f16dfd46640 1 -- 172.21.15.99:0/2706509424 >> 172.21.15.99:0/2706509424 conn(0x7f16d80723b0 msgr2=0x7f16d80727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:35.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.992+0000 7f16dfd46640 1 -- 172.21.15.99:0/2706509424 shutdown_connections 2024-09-19T06:53:35.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.992+0000 7f16dfd46640 1 -- 172.21.15.99:0/2706509424 wait complete. 2024-09-19T06:53:35.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.992+0000 7f16dfd46640 1 Processor -- start 2024-09-19T06:53:35.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.992+0000 7f16dfd46640 1 -- start start 2024-09-19T06:53:35.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.992+0000 7f16dfd46640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f16d8064fe0 0x7f16d8113220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:35.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.992+0000 7f16dfd46640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16d80fe450 0x7f16d8113760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:35.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.992+0000 7f16dfd46640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16d8113d60 con 0x7f16d8064fe0 2024-09-19T06:53:35.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.992+0000 7f16dfd46640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16d810d1a0 con 0x7f16d80fe450 2024-09-19T06:53:35.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.993+0000 7f16ddae2640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f16d8064fe0 0x7f16d8113220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:35.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.993+0000 7f16ddae2640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f16d8064fe0 0x7f16d8113220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33090/0 (socket says 172.21.15.99:33090) 2024-09-19T06:53:35.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.993+0000 7f16ddae2640 1 -- 172.21.15.99:0/1791437632 learned_addr learned my addr 172.21.15.99:0/1791437632 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:53:35.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.993+0000 7f16dd2e1640 1 --2- 172.21.15.99:0/1791437632 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16d80fe450 0x7f16d8113760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:35.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.993+0000 7f16ddae2640 1 -- 172.21.15.99:0/1791437632 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16d80fe450 msgr2=0x7f16d8113760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:35.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.993+0000 7f16ddae2640 1 --2- 172.21.15.99:0/1791437632 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16d80fe450 0x7f16d8113760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:35.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.993+0000 7f16ddae2640 1 -- 172.21.15.99:0/1791437632 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16d4005040 con 0x7f16d8064fe0 2024-09-19T06:53:35.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.993+0000 7f16dd2e1640 1 --2- 172.21.15.99:0/1791437632 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16d80fe450 0x7f16d8113760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:53:35.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.993+0000 7f16ddae2640 1 --2- 172.21.15.99:0/1791437632 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f16d8064fe0 0x7f16d8113220 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f16c8002a50 tx=0x7f16c8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:35.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.993+0000 7f16ce7fc640 1 -- 172.21.15.99:0/1791437632 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16c8007c30 con 0x7f16d8064fe0 2024-09-19T06:53:35.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.993+0000 7f16dfd46640 1 -- 172.21.15.99:0/1791437632 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16d810d480 con 0x7f16d8064fe0 2024-09-19T06:53:35.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.993+0000 7f16ce7fc640 1 -- 172.21.15.99:0/1791437632 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f16c800f040 con 0x7f16d8064fe0 2024-09-19T06:53:35.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.993+0000 7f16ce7fc640 1 -- 172.21.15.99:0/1791437632 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16c800da90 con 0x7f16d8064fe0 2024-09-19T06:53:35.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.993+0000 7f16dfd46640 1 -- 172.21.15.99:0/1791437632 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16d810d970 con 0x7f16d8064fe0 2024-09-19T06:53:35.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.995+0000 7f16dfd46640 1 -- 172.21.15.99:0/1791437632 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16d80fdce0 con 0x7f16d8064fe0 2024-09-19T06:53:35.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.995+0000 7f16ce7fc640 1 -- 172.21.15.99:0/1791437632 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f16c800dc30 con 0x7f16d8064fe0 2024-09-19T06:53:35.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.996+0000 7f16ce7fc640 1 --2- 172.21.15.99:0/1791437632 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f16c406e530 0x7f16c40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:53:35.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.996+0000 7f16ce7fc640 1 -- 172.21.15.99:0/1791437632 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f16c808d9c0 con 0x7f16d8064fe0 2024-09-19T06:53:35.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.996+0000 7f16dd2e1640 1 --2- 172.21.15.99:0/1791437632 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f16c406e530 0x7f16c40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:53:35.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:35.996+0000 7f16dd2e1640 1 --2- 172.21.15.99:0/1791437632 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f16c406e530 0x7f16c40709e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f16d8072dd0 tx=0x7f16d4035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:53:36.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:36.000+0000 7f16ce7fc640 1 -- 172.21.15.99:0/1791437632 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f16c8056b30 con 0x7f16d8064fe0 2024-09-19T06:53:36.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:36.238+0000 7f16dfd46640 1 -- 172.21.15.99:0/1791437632 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f16d804b750 con 0x7f16d8064fe0 2024-09-19T06:53:36.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:36.239+0000 7f16ce7fc640 1 -- 172.21.15.99:0/1791437632 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7f16c805a1f0 con 0x7f16d8064fe0 2024-09-19T06:53:36.240 INFO:teuthology.orchestra.run.smithi099.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-09-19T06:53:36.240 INFO:teuthology.orchestra.run.smithi099.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-19T06:53:36.240 INFO:teuthology.orchestra.run.smithi099.stdout: fs cephfs is degraded 2024-09-19T06:53:36.240 INFO:teuthology.orchestra.run.smithi099.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-19T06:53:36.240 INFO:teuthology.orchestra.run.smithi099.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-19T06:53:36.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:36.241+0000 7f16dfd46640 1 -- 172.21.15.99:0/1791437632 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f16c406e530 msgr2=0x7f16c40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:36.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:36.241+0000 7f16dfd46640 1 --2- 172.21.15.99:0/1791437632 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f16c406e530 0x7f16c40709e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f16d8072dd0 tx=0x7f16d4035040 comp rx=0 tx=0).stop 2024-09-19T06:53:36.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:36.241+0000 7f16dfd46640 1 -- 172.21.15.99:0/1791437632 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f16d8064fe0 msgr2=0x7f16d8113220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:53:36.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:36.241+0000 7f16dfd46640 1 --2- 172.21.15.99:0/1791437632 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f16d8064fe0 0x7f16d8113220 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f16c8002a50 tx=0x7f16c8004600 comp rx=0 tx=0).stop 2024-09-19T06:53:36.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:36.241+0000 7f16dfd46640 1 -- 172.21.15.99:0/1791437632 shutdown_connections 2024-09-19T06:53:36.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:36.241+0000 7f16dfd46640 1 --2- 172.21.15.99:0/1791437632 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f16c406e530 0x7f16c40709e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:36.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:36.241+0000 7f16dfd46640 1 --2- 172.21.15.99:0/1791437632 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16d80fe450 0x7f16d8113760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:36.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:36.241+0000 7f16dfd46640 1 --2- 172.21.15.99:0/1791437632 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f16d8064fe0 0x7f16d8113220 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:53:36.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:36.241+0000 7f16dfd46640 1 -- 172.21.15.99:0/1791437632 >> 172.21.15.99:0/1791437632 conn(0x7f16d80723b0 msgr2=0x7f16d8105390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:53:36.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:36.241+0000 7f16dfd46640 1 -- 172.21.15.99:0/1791437632 shutdown_connections 2024-09-19T06:53:36.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:53:36.241+0000 7f16dfd46640 1 -- 172.21.15.99:0/1791437632 wait complete. 2024-09-19T06:53:36.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:53:36 smithi117 ceph-mon[76771]: from='client.34670 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:53:36.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:53:36 smithi117 ceph-mon[76771]: from='client.34674 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:53:36.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:53:36 smithi117 ceph-mon[76771]: pgmap v337: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:53:36.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:53:36 smithi117 ceph-mon[76771]: from='client.34678 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:53:36.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:53:36 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/3782791331' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:53:36.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:53:36 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/2769841852' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:53:36.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:53:36 smithi099 ceph-mon[97031]: from='client.34670 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:53:36.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:53:36 smithi099 ceph-mon[97031]: from='client.34674 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:53:36.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:53:36 smithi099 ceph-mon[97031]: pgmap v337: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:53:36.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:53:36 smithi099 ceph-mon[97031]: from='client.34678 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:53:36.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:53:36 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/3782791331' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:53:36.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:53:36 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/2769841852' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:53:37.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:53:37 smithi117 ceph-mon[76771]: from='client.34690 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:53:37.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:53:37 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/1791437632' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T06:53:37.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:53:37 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:53:37.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:53:37 smithi099 ceph-mon[97031]: from='client.34690 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:53:37.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:53:37 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/1791437632' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T06:53:37.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:53:37 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:53:38.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:53:38 smithi117 ceph-mon[76771]: pgmap v338: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:53:38.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:53:38 smithi099 ceph-mon[97031]: pgmap v338: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:53:40.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:53:40 smithi117 ceph-mon[76771]: pgmap v339: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:53:40.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:53:40 smithi099 ceph-mon[97031]: pgmap v339: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:53:42.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:53:42 smithi117 ceph-mon[76771]: pgmap v340: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:53:42.315 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:53:42 smithi099 ceph-mon[97031]: pgmap v340: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:53:44.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:53:44 smithi099 ceph-mon[97031]: pgmap v341: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:53:44.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:53:44 smithi117 ceph-mon[76771]: pgmap v341: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:53:46.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:53:46 smithi099 ceph-mon[97031]: pgmap v342: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:53:46.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:53:46 smithi117 ceph-mon[76771]: pgmap v342: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:53:48.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:53:48 smithi099 ceph-mon[97031]: pgmap v343: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:53:48.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:53:48 smithi117 ceph-mon[76771]: pgmap v343: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:53:50.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:53:50 smithi099 ceph-mon[97031]: pgmap v344: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:53:50.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:53:50 smithi117 ceph-mon[76771]: pgmap v344: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:53:52.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:53:52 smithi099 ceph-mon[97031]: pgmap v345: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:53:52.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:53:52 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:53:52.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:53:52 smithi117 ceph-mon[76771]: pgmap v345: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:53:52.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:53:52 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:53:54.364 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:53:54 smithi117 ceph-mon[76771]: pgmap v346: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:53:54.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:53:54 smithi099 ceph-mon[97031]: pgmap v346: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:53:56.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:53:56 smithi099 ceph-mon[97031]: pgmap v347: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:53:56.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:53:56 smithi117 ceph-mon[76771]: pgmap v347: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:53:58.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:53:58 smithi099 ceph-mon[97031]: pgmap v348: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:53:58.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:53:58 smithi117 ceph-mon[76771]: pgmap v348: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:54:00.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:54:00 smithi099 ceph-mon[97031]: pgmap v349: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:54:00.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:54:00 smithi117 ceph-mon[76771]: pgmap v349: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:54:02.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:54:02 smithi099 ceph-mon[97031]: pgmap v350: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:54:02.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:54:02 smithi117 ceph-mon[76771]: pgmap v350: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:54:03.357 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:54:03 smithi099 ceph-mon[97031]: pgmap v351: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:54:03.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:54:03 smithi117 ceph-mon[76771]: pgmap v351: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:54:06.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:54:06 smithi117 ceph-mon[76771]: pgmap v352: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:54:06.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.332+0000 7f68965e9640 1 -- 172.21.15.99:0/3234862917 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f68900fe450 msgr2=0x7f68900fe820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:06.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.332+0000 7f68965e9640 1 --2- 172.21.15.99:0/3234862917 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f68900fe450 0x7f68900fe820 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f68800048d0 tx=0x7f6880009da0 comp rx=0 tx=0).stop 2024-09-19T06:54:06.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.332+0000 7f68965e9640 1 -- 172.21.15.99:0/3234862917 shutdown_connections 2024-09-19T06:54:06.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.332+0000 7f68965e9640 1 --2- 172.21.15.99:0/3234862917 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6890064fe0 0x7f6890065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:06.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.332+0000 7f68965e9640 1 --2- 172.21.15.99:0/3234862917 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f68900fe450 0x7f68900fe820 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:06.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.332+0000 7f68965e9640 1 -- 172.21.15.99:0/3234862917 >> 172.21.15.99:0/3234862917 conn(0x7f68900723b0 msgr2=0x7f68900727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:06.335 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:54:06 smithi099 ceph-mon[97031]: pgmap v352: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:54:06.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.332+0000 7f68965e9640 1 -- 172.21.15.99:0/3234862917 shutdown_connections 2024-09-19T06:54:06.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.332+0000 7f68965e9640 1 -- 172.21.15.99:0/3234862917 wait complete. 2024-09-19T06:54:06.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.333+0000 7f68965e9640 1 Processor -- start 2024-09-19T06:54:06.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.333+0000 7f68965e9640 1 -- start start 2024-09-19T06:54:06.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.333+0000 7f68965e9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6890064fe0 0x7f6890113210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:06.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.333+0000 7f68965e9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f68900fe450 0x7f6890113750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:06.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.333+0000 7f68965e9640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6890113d50 con 0x7f68900fe450 2024-09-19T06:54:06.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.333+0000 7f68965e9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f689010d190 con 0x7f6890064fe0 2024-09-19T06:54:06.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.333+0000 7f688f7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f68900fe450 0x7f6890113750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:06.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.333+0000 7f688f7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f68900fe450 0x7f6890113750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40192/0 (socket says 172.21.15.99:40192) 2024-09-19T06:54:06.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.333+0000 7f688f7fe640 1 -- 172.21.15.99:0/1074939759 learned_addr learned my addr 172.21.15.99:0/1074939759 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:54:06.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.334+0000 7f688ffff640 1 --2- 172.21.15.99:0/1074939759 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6890064fe0 0x7f6890113210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:06.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.334+0000 7f688f7fe640 1 -- 172.21.15.99:0/1074939759 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6890064fe0 msgr2=0x7f6890113210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:06.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.334+0000 7f688f7fe640 1 --2- 172.21.15.99:0/1074939759 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6890064fe0 0x7f6890113210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:06.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.334+0000 7f688f7fe640 1 -- 172.21.15.99:0/1074939759 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6880005040 con 0x7f68900fe450 2024-09-19T06:54:06.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.334+0000 7f688ffff640 1 --2- 172.21.15.99:0/1074939759 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6890064fe0 0x7f6890113210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:54:06.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.334+0000 7f688f7fe640 1 --2- 172.21.15.99:0/1074939759 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f68900fe450 0x7f6890113750 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f687800eb70 tx=0x7f687800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:06.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.334+0000 7f688cff9640 1 -- 172.21.15.99:0/1074939759 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6878007c30 con 0x7f68900fe450 2024-09-19T06:54:06.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.334+0000 7f688cff9640 1 -- 172.21.15.99:0/1074939759 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f687800f040 con 0x7f68900fe450 2024-09-19T06:54:06.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.334+0000 7f68965e9640 1 -- 172.21.15.99:0/1074939759 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f689010d410 con 0x7f68900fe450 2024-09-19T06:54:06.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.334+0000 7f688cff9640 1 -- 172.21.15.99:0/1074939759 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68780094e0 con 0x7f68900fe450 2024-09-19T06:54:06.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.334+0000 7f68965e9640 1 -- 172.21.15.99:0/1074939759 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f689010d930 con 0x7f68900fe450 2024-09-19T06:54:06.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.335+0000 7f68965e9640 1 -- 172.21.15.99:0/1074939759 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68900fdce0 con 0x7f68900fe450 2024-09-19T06:54:06.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.336+0000 7f688cff9640 1 -- 172.21.15.99:0/1074939759 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f6878009660 con 0x7f68900fe450 2024-09-19T06:54:06.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.336+0000 7f688cff9640 1 --2- 172.21.15.99:0/1074939759 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f687c06e530 0x7f687c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:06.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.336+0000 7f688cff9640 1 -- 172.21.15.99:0/1074939759 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f687808deb0 con 0x7f68900fe450 2024-09-19T06:54:06.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.336+0000 7f688ffff640 1 --2- 172.21.15.99:0/1074939759 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f687c06e530 0x7f687c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:06.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.337+0000 7f688ffff640 1 --2- 172.21.15.99:0/1074939759 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f687c06e530 0x7f687c0709e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6880007ac0 tx=0x7f6880035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:06.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.341+0000 7f688cff9640 1 -- 172.21.15.99:0/1074939759 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f6878056fa0 con 0x7f68900fe450 2024-09-19T06:54:06.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.528+0000 7f68965e9640 1 -- 172.21.15.99:0/1074939759 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f689010e880 con 0x7f687c06e530 2024-09-19T06:54:06.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.530+0000 7f688cff9640 1 -- 172.21.15.99:0/1074939759 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f689010e880 con 0x7f687c06e530 2024-09-19T06:54:06.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.532+0000 7f68965e9640 1 -- 172.21.15.99:0/1074939759 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f687c06e530 msgr2=0x7f687c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:06.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.532+0000 7f68965e9640 1 --2- 172.21.15.99:0/1074939759 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f687c06e530 0x7f687c0709e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6880007ac0 tx=0x7f6880035040 comp rx=0 tx=0).stop 2024-09-19T06:54:06.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.532+0000 7f68965e9640 1 -- 172.21.15.99:0/1074939759 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f68900fe450 msgr2=0x7f6890113750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:06.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.532+0000 7f68965e9640 1 --2- 172.21.15.99:0/1074939759 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f68900fe450 0x7f6890113750 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f687800eb70 tx=0x7f687800b040 comp rx=0 tx=0).stop 2024-09-19T06:54:06.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.532+0000 7f68965e9640 1 -- 172.21.15.99:0/1074939759 shutdown_connections 2024-09-19T06:54:06.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.532+0000 7f68965e9640 1 --2- 172.21.15.99:0/1074939759 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f687c06e530 0x7f687c0709e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:06.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.532+0000 7f68965e9640 1 --2- 172.21.15.99:0/1074939759 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f68900fe450 0x7f6890113750 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:06.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.532+0000 7f68965e9640 1 --2- 172.21.15.99:0/1074939759 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6890064fe0 0x7f6890113210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:06.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.532+0000 7f68965e9640 1 -- 172.21.15.99:0/1074939759 >> 172.21.15.99:0/1074939759 conn(0x7f68900723b0 msgr2=0x7f68900fa2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:06.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.532+0000 7f68965e9640 1 -- 172.21.15.99:0/1074939759 shutdown_connections 2024-09-19T06:54:06.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.532+0000 7f68965e9640 1 -- 172.21.15.99:0/1074939759 wait complete. 2024-09-19T06:54:06.542 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-09-19T06:54:06.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.611+0000 7f10c0fae640 1 -- 172.21.15.99:0/2875965949 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f10bc102550 msgr2=0x7f10bc102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:06.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.611+0000 7f10c0fae640 1 --2- 172.21.15.99:0/2875965949 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f10bc102550 0x7f10bc102920 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f10ac0048d0 tx=0x7f10ac009da0 comp rx=0 tx=0).stop 2024-09-19T06:54:06.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.611+0000 7f10c0fae640 1 -- 172.21.15.99:0/2875965949 shutdown_connections 2024-09-19T06:54:06.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.611+0000 7f10c0fae640 1 --2- 172.21.15.99:0/2875965949 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10bc102ef0 0x7f10bc0fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:06.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.611+0000 7f10c0fae640 1 --2- 172.21.15.99:0/2875965949 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f10bc102550 0x7f10bc102920 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:06.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.611+0000 7f10c0fae640 1 -- 172.21.15.99:0/2875965949 >> 172.21.15.99:0/2875965949 conn(0x7f10bc0f80f0 msgr2=0x7f10bc0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:06.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.611+0000 7f10c0fae640 1 -- 172.21.15.99:0/2875965949 shutdown_connections 2024-09-19T06:54:06.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.611+0000 7f10c0fae640 1 -- 172.21.15.99:0/2875965949 wait complete. 2024-09-19T06:54:06.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.612+0000 7f10c0fae640 1 Processor -- start 2024-09-19T06:54:06.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.612+0000 7f10c0fae640 1 -- start start 2024-09-19T06:54:06.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.612+0000 7f10c0fae640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10bc102550 0x7f10bc113540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:06.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.612+0000 7f10c0fae640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f10bc102ef0 0x7f10bc113a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:06.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.612+0000 7f10c0fae640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10bc1140d0 con 0x7f10bc102ef0 2024-09-19T06:54:06.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.612+0000 7f10c0fae640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10bc10d4e0 con 0x7f10bc102550 2024-09-19T06:54:06.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.612+0000 7f10b9d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f10bc102ef0 0x7f10bc113a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:06.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.612+0000 7f10b9d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f10bc102ef0 0x7f10bc113a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40222/0 (socket says 172.21.15.99:40222) 2024-09-19T06:54:06.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.612+0000 7f10b9d9b640 1 -- 172.21.15.99:0/2682794483 learned_addr learned my addr 172.21.15.99:0/2682794483 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:54:06.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.612+0000 7f10ba59c640 1 --2- 172.21.15.99:0/2682794483 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10bc102550 0x7f10bc113540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:06.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.613+0000 7f10b9d9b640 1 -- 172.21.15.99:0/2682794483 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10bc102550 msgr2=0x7f10bc113540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:06.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.613+0000 7f10b9d9b640 1 --2- 172.21.15.99:0/2682794483 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10bc102550 0x7f10bc113540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:06.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.613+0000 7f10b9d9b640 1 -- 172.21.15.99:0/2682794483 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10ac005040 con 0x7f10bc102ef0 2024-09-19T06:54:06.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.613+0000 7f10b9d9b640 1 --2- 172.21.15.99:0/2682794483 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f10bc102ef0 0x7f10bc113a80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f10b000eb40 tx=0x7f10b000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:06.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.613+0000 7f10aaffd640 1 -- 172.21.15.99:0/2682794483 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10b0007c30 con 0x7f10bc102ef0 2024-09-19T06:54:06.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.613+0000 7f10c0fae640 1 -- 172.21.15.99:0/2682794483 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10bc10d760 con 0x7f10bc102ef0 2024-09-19T06:54:06.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.613+0000 7f10aaffd640 1 -- 172.21.15.99:0/2682794483 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f10b000f040 con 0x7f10bc102ef0 2024-09-19T06:54:06.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.613+0000 7f10aaffd640 1 -- 172.21.15.99:0/2682794483 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10b000ca90 con 0x7f10bc102ef0 2024-09-19T06:54:06.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.613+0000 7f10c0fae640 1 -- 172.21.15.99:0/2682794483 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10bc10dd00 con 0x7f10bc102ef0 2024-09-19T06:54:06.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.614+0000 7f10c0fae640 1 -- 172.21.15.99:0/2682794483 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10bc0fdcd0 con 0x7f10bc102ef0 2024-09-19T06:54:06.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.615+0000 7f10aaffd640 1 -- 172.21.15.99:0/2682794483 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f10b000ccd0 con 0x7f10bc102ef0 2024-09-19T06:54:06.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.615+0000 7f10aaffd640 1 --2- 172.21.15.99:0/2682794483 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f10a406e530 0x7f10a40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:06.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.615+0000 7f10aaffd640 1 -- 172.21.15.99:0/2682794483 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f10b008de20 con 0x7f10bc102ef0 2024-09-19T06:54:06.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.615+0000 7f10ba59c640 1 --2- 172.21.15.99:0/2682794483 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f10a406e530 0x7f10a40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:06.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.616+0000 7f10ba59c640 1 --2- 172.21.15.99:0/2682794483 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f10a406e530 0x7f10a40709e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f10ac007ac0 tx=0x7f10ac035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:06.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.619+0000 7f10aaffd640 1 -- 172.21.15.99:0/2682794483 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f10b0056f10 con 0x7f10bc102ef0 2024-09-19T06:54:06.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.799+0000 7f10c0fae640 1 -- 172.21.15.99:0/2682794483 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f10bc1095c0 con 0x7f10a406e530 2024-09-19T06:54:06.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.800+0000 7f10aaffd640 1 -- 172.21.15.99:0/2682794483 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f10bc1095c0 con 0x7f10a406e530 2024-09-19T06:54:06.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.802+0000 7f10c0fae640 1 -- 172.21.15.99:0/2682794483 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f10a406e530 msgr2=0x7f10a40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:06.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.802+0000 7f10c0fae640 1 --2- 172.21.15.99:0/2682794483 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f10a406e530 0x7f10a40709e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f10ac007ac0 tx=0x7f10ac035040 comp rx=0 tx=0).stop 2024-09-19T06:54:06.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.802+0000 7f10c0fae640 1 -- 172.21.15.99:0/2682794483 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f10bc102ef0 msgr2=0x7f10bc113a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:06.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.802+0000 7f10c0fae640 1 --2- 172.21.15.99:0/2682794483 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f10bc102ef0 0x7f10bc113a80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f10b000eb40 tx=0x7f10b000b040 comp rx=0 tx=0).stop 2024-09-19T06:54:06.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.802+0000 7f10c0fae640 1 -- 172.21.15.99:0/2682794483 shutdown_connections 2024-09-19T06:54:06.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.802+0000 7f10c0fae640 1 --2- 172.21.15.99:0/2682794483 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f10a406e530 0x7f10a40709e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:06.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.802+0000 7f10c0fae640 1 --2- 172.21.15.99:0/2682794483 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f10bc102ef0 0x7f10bc113a80 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:06.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.802+0000 7f10c0fae640 1 --2- 172.21.15.99:0/2682794483 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10bc102550 0x7f10bc113540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:06.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.802+0000 7f10c0fae640 1 -- 172.21.15.99:0/2682794483 >> 172.21.15.99:0/2682794483 conn(0x7f10bc0f80f0 msgr2=0x7f10bc0f9160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:06.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.802+0000 7f10c0fae640 1 -- 172.21.15.99:0/2682794483 shutdown_connections 2024-09-19T06:54:06.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.802+0000 7f10c0fae640 1 -- 172.21.15.99:0/2682794483 wait complete. 2024-09-19T06:54:06.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.881+0000 7febd2e26640 1 -- 172.21.15.99:0/2860528363 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7febcc0fcf80 msgr2=0x7febcc0fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:06.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.881+0000 7febd2e26640 1 --2- 172.21.15.99:0/2860528363 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7febcc0fcf80 0x7febcc0fd3d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7febc00048d0 tx=0x7febc0009da0 comp rx=0 tx=0).stop 2024-09-19T06:54:06.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.881+0000 7febd2e26640 1 -- 172.21.15.99:0/2860528363 shutdown_connections 2024-09-19T06:54:06.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.881+0000 7febd2e26640 1 --2- 172.21.15.99:0/2860528363 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7febcc0fcf80 0x7febcc0fd3d0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:06.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.881+0000 7febd2e26640 1 --2- 172.21.15.99:0/2860528363 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7febcc0fb810 0x7febcc0fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:06.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.881+0000 7febd2e26640 1 -- 172.21.15.99:0/2860528363 >> 172.21.15.99:0/2860528363 conn(0x7febcc0723b0 msgr2=0x7febcc0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:06.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.882+0000 7febd2e26640 1 -- 172.21.15.99:0/2860528363 shutdown_connections 2024-09-19T06:54:06.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.882+0000 7febd2e26640 1 -- 172.21.15.99:0/2860528363 wait complete. 2024-09-19T06:54:06.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.882+0000 7febd2e26640 1 Processor -- start 2024-09-19T06:54:06.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.882+0000 7febd2e26640 1 -- start start 2024-09-19T06:54:06.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.883+0000 7febd2e26640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7febcc0fb810 0x7febcc10e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:06.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.883+0000 7febd2e26640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7febcc0fcf80 0x7febcc10e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:06.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.883+0000 7febd2e26640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febcc10ecb0 con 0x7febcc0fcf80 2024-09-19T06:54:06.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.883+0000 7febd2e26640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febcc10ee20 con 0x7febcc0fb810 2024-09-19T06:54:06.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.883+0000 7febcbfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7febcc0fcf80 0x7febcc10e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:06.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.883+0000 7febcbfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7febcc0fcf80 0x7febcc10e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40242/0 (socket says 172.21.15.99:40242) 2024-09-19T06:54:06.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.883+0000 7febcbfff640 1 -- 172.21.15.99:0/2374751842 learned_addr learned my addr 172.21.15.99:0/2374751842 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:54:06.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.883+0000 7febd0bc2640 1 --2- 172.21.15.99:0/2374751842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7febcc0fb810 0x7febcc10e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:06.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.883+0000 7febd0bc2640 1 -- 172.21.15.99:0/2374751842 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7febcc0fcf80 msgr2=0x7febcc10e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:06.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.883+0000 7febd0bc2640 1 --2- 172.21.15.99:0/2374751842 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7febcc0fcf80 0x7febcc10e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:06.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.883+0000 7febd0bc2640 1 -- 172.21.15.99:0/2374751842 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc0005040 con 0x7febcc0fb810 2024-09-19T06:54:06.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.884+0000 7febd0bc2640 1 --2- 172.21.15.99:0/2374751842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7febcc0fb810 0x7febcc10e170 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7febbc0027d0 tx=0x7febbc009f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:06.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.884+0000 7febc97fa640 1 -- 172.21.15.99:0/2374751842 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7febbc002dc0 con 0x7febcc0fb810 2024-09-19T06:54:06.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.884+0000 7febd2e26640 1 -- 172.21.15.99:0/2374751842 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febcc1171e0 con 0x7febcc0fb810 2024-09-19T06:54:06.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.884+0000 7febc97fa640 1 -- 172.21.15.99:0/2374751842 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7febbc00f040 con 0x7febcc0fb810 2024-09-19T06:54:06.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.884+0000 7febc97fa640 1 -- 172.21.15.99:0/2374751842 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7febbc00d9f0 con 0x7febcc0fb810 2024-09-19T06:54:06.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.884+0000 7febd2e26640 1 -- 172.21.15.99:0/2374751842 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febcc117720 con 0x7febcc0fb810 2024-09-19T06:54:06.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.885+0000 7febd2e26640 1 -- 172.21.15.99:0/2374751842 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febcc0fcbc0 con 0x7febcc0fb810 2024-09-19T06:54:06.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.886+0000 7febc97fa640 1 -- 172.21.15.99:0/2374751842 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7febbc00dc60 con 0x7febcc0fb810 2024-09-19T06:54:06.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.886+0000 7febc97fa640 1 --2- 172.21.15.99:0/2374751842 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7febb406e530 0x7febb40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:06.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.886+0000 7febc97fa640 1 -- 172.21.15.99:0/2374751842 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7febbc08d8f0 con 0x7febcc0fb810 2024-09-19T06:54:06.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.886+0000 7febcbfff640 1 --2- 172.21.15.99:0/2374751842 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7febb406e530 0x7febb40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:06.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.887+0000 7febcbfff640 1 --2- 172.21.15.99:0/2374751842 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7febb406e530 0x7febb40709e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7febcc0659a0 tx=0x7febc0035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:06.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:06.890+0000 7febc97fa640 1 -- 172.21.15.99:0/2374751842 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7febbc056b10 con 0x7febcc0fb810 2024-09-19T06:54:07.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.066+0000 7febd2e26640 1 -- 172.21.15.99:0/2374751842 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7febcc065750 con 0x7febb406e530 2024-09-19T06:54:07.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.075+0000 7febc97fa640 1 -- 172.21.15.99:0/2374751842 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7febcc065750 con 0x7febb406e530 2024-09-19T06:54:07.076 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T06:54:07.076 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.smithi099 smithi099 *:9093,9094 running (13m) 5m ago 21m 23.4M - 0.25.0 c8568f914cd2 e7c1774d56b0 2024-09-19T06:54:07.076 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi099 smithi099 running (9m) 5m ago 21m 6899k - 19.1.1-361-g2f599a46 d2baa855c067 b9775f416b10 2024-09-19T06:54:07.076 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi117 smithi117 running (9m) 5m ago 20m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 38cf60c0d548 2024-09-19T06:54:07.076 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.smithi099 smithi099 *:3000 running (11m) 5m ago 21m 80.7M - 9.4.12 2bacad6d85d8 cd53a18d5410 2024-09-19T06:54:07.077 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.obarqf smithi099 running (6m) 5m ago 16m 12.2M - 19.1.1-361-g2f599a46 d2baa855c067 314a73082521 2024-09-19T06:54:07.077 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.xehbxe smithi099 running (5m) 5m ago 16m 14.4M - 19.1.1-361-g2f599a46 d2baa855c067 a2955a9d06e6 2024-09-19T06:54:07.077 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.bheqzh smithi117 running (5m) 5m ago 16m 11.8M - 19.1.1-361-g2f599a46 d2baa855c067 b1505937c0b7 2024-09-19T06:54:07.077 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.nooexo smithi117 running (5m) 5m ago 16m 13.1M - 19.1.1-361-g2f599a46 d2baa855c067 35bd7725855c 2024-09-19T06:54:07.077 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi099.pgvkqi smithi099 *:8443,9283,8765 running (12m) 5m ago 22m 505M - 19.1.1-361-g2f599a46 d2baa855c067 d5de99cb7e78 2024-09-19T06:54:07.077 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi117.ssmkcf smithi117 *:8443,9283,8765 running (11m) 5m ago 20m 444M - 19.1.1-361-g2f599a46 d2baa855c067 8b7ee0f871f5 2024-09-19T06:54:07.077 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi099 smithi099 running (10m) 5m ago 22m 52.4M 2048M 19.1.1-361-g2f599a46 d2baa855c067 ffe067438824 2024-09-19T06:54:07.077 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi117 smithi117 running (10m) 5m ago 20m 38.9M 2048M 19.1.1-361-g2f599a46 d2baa855c067 4cb7455e3ee7 2024-09-19T06:54:07.077 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi099 smithi099 *:9100 running (13m) 5m ago 21m 15.0M - 1.5.0 0da6a335fe13 dca7b4517dcc 2024-09-19T06:54:07.077 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi117 smithi117 *:9100 running (12m) 5m ago 20m 15.9M - 1.5.0 0da6a335fe13 8233ce3835d2 2024-09-19T06:54:07.077 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (9m) 5m ago 19m 100M 1557M 19.1.1-361-g2f599a46 d2baa855c067 8e22543bf933 2024-09-19T06:54:07.077 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (8m) 5m ago 19m 106M 1557M 19.1.1-361-g2f599a46 d2baa855c067 f54153d0ae09 2024-09-19T06:54:07.077 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (8m) 5m ago 18m 83.7M 1557M 19.1.1-361-g2f599a46 d2baa855c067 b1778ab88870 2024-09-19T06:54:07.078 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi117 running (7m) 5m ago 18m 102M 2581M 19.1.1-361-g2f599a46 d2baa855c067 ea5236b193d3 2024-09-19T06:54:07.078 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi117 running (6m) 5m ago 18m 93.5M 2581M 19.1.1-361-g2f599a46 d2baa855c067 27ac2c859a68 2024-09-19T06:54:07.078 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi117 running (6m) 5m ago 17m 100M 2581M 19.1.1-361-g2f599a46 d2baa855c067 de6aeb8544ce 2024-09-19T06:54:07.078 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.smithi099 smithi099 *:9095 running (11m) 5m ago 21m 64.4M - 2.43.0 a07b618ecd1d 15ad26ec6fb4 2024-09-19T06:54:07.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.077+0000 7febd2e26640 1 -- 172.21.15.99:0/2374751842 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7febb406e530 msgr2=0x7febb40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:07.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.077+0000 7febd2e26640 1 --2- 172.21.15.99:0/2374751842 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7febb406e530 0x7febb40709e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7febcc0659a0 tx=0x7febc0035040 comp rx=0 tx=0).stop 2024-09-19T06:54:07.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.077+0000 7febd2e26640 1 -- 172.21.15.99:0/2374751842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7febcc0fb810 msgr2=0x7febcc10e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:07.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.077+0000 7febd2e26640 1 --2- 172.21.15.99:0/2374751842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7febcc0fb810 0x7febcc10e170 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7febbc0027d0 tx=0x7febbc009f70 comp rx=0 tx=0).stop 2024-09-19T06:54:07.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.077+0000 7febd2e26640 1 -- 172.21.15.99:0/2374751842 shutdown_connections 2024-09-19T06:54:07.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.077+0000 7febd2e26640 1 --2- 172.21.15.99:0/2374751842 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7febb406e530 0x7febb40709e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:07.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.077+0000 7febd2e26640 1 --2- 172.21.15.99:0/2374751842 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7febcc0fcf80 0x7febcc10e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:07.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.077+0000 7febd2e26640 1 --2- 172.21.15.99:0/2374751842 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7febcc0fb810 0x7febcc10e170 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:07.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.077+0000 7febd2e26640 1 -- 172.21.15.99:0/2374751842 >> 172.21.15.99:0/2374751842 conn(0x7febcc0723b0 msgr2=0x7febcc0fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:07.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.077+0000 7febd2e26640 1 -- 172.21.15.99:0/2374751842 shutdown_connections 2024-09-19T06:54:07.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.077+0000 7febd2e26640 1 -- 172.21.15.99:0/2374751842 wait complete. 2024-09-19T06:54:07.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.155+0000 7faa8f430640 1 -- 172.21.15.99:0/309176608 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa880fac60 msgr2=0x7faa880fb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:07.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.155+0000 7faa8f430640 1 --2- 172.21.15.99:0/309176608 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa880fac60 0x7faa880fb0b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7faa780048d0 tx=0x7faa78009da0 comp rx=0 tx=0).stop 2024-09-19T06:54:07.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.155+0000 7faa8f430640 1 -- 172.21.15.99:0/309176608 shutdown_connections 2024-09-19T06:54:07.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.155+0000 7faa8f430640 1 --2- 172.21.15.99:0/309176608 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa880fac60 0x7faa880fb0b0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:07.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.155+0000 7faa8f430640 1 --2- 172.21.15.99:0/309176608 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa881025f0 0x7faa881029c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:07.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.155+0000 7faa8f430640 1 -- 172.21.15.99:0/309176608 >> 172.21.15.99:0/309176608 conn(0x7faa88070c80 msgr2=0x7faa88071080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:07.157 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:54:07 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:54:07.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.155+0000 7faa8f430640 1 -- 172.21.15.99:0/309176608 shutdown_connections 2024-09-19T06:54:07.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.155+0000 7faa8f430640 1 -- 172.21.15.99:0/309176608 wait complete. 2024-09-19T06:54:07.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.156+0000 7faa8f430640 1 Processor -- start 2024-09-19T06:54:07.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.156+0000 7faa8f430640 1 -- start start 2024-09-19T06:54:07.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.156+0000 7faa8f430640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa880fac60 0x7faa881131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:07.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.156+0000 7faa8f430640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa881025f0 0x7faa88113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:07.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.156+0000 7faa8f430640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa88113d10 con 0x7faa881025f0 2024-09-19T06:54:07.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.156+0000 7faa8f430640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa8810d150 con 0x7faa880fac60 2024-09-19T06:54:07.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.156+0000 7faa8c9cb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa881025f0 0x7faa88113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:07.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.156+0000 7faa8c9cb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa881025f0 0x7faa88113710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40268/0 (socket says 172.21.15.99:40268) 2024-09-19T06:54:07.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.156+0000 7faa8c9cb640 1 -- 172.21.15.99:0/3656218880 learned_addr learned my addr 172.21.15.99:0/3656218880 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:54:07.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.156+0000 7faa8d1cc640 1 --2- 172.21.15.99:0/3656218880 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa880fac60 0x7faa881131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:07.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.157+0000 7faa8c9cb640 1 -- 172.21.15.99:0/3656218880 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa880fac60 msgr2=0x7faa881131d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:07.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.157+0000 7faa8c9cb640 1 --2- 172.21.15.99:0/3656218880 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa880fac60 0x7faa881131d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:07.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.157+0000 7faa8c9cb640 1 -- 172.21.15.99:0/3656218880 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa78005040 con 0x7faa881025f0 2024-09-19T06:54:07.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.157+0000 7faa8c9cb640 1 --2- 172.21.15.99:0/3656218880 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa881025f0 0x7faa88113710 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7faa78000c00 tx=0x7faa78009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:07.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.157+0000 7faa7dffb640 1 -- 172.21.15.99:0/3656218880 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa78038070 con 0x7faa881025f0 2024-09-19T06:54:07.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.157+0000 7faa7dffb640 1 -- 172.21.15.99:0/3656218880 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7faa7802ade0 con 0x7faa881025f0 2024-09-19T06:54:07.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.157+0000 7faa8f430640 1 -- 172.21.15.99:0/3656218880 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa8810d3d0 con 0x7faa881025f0 2024-09-19T06:54:07.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.157+0000 7faa7dffb640 1 -- 172.21.15.99:0/3656218880 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa7802c7e0 con 0x7faa881025f0 2024-09-19T06:54:07.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.157+0000 7faa8f430640 1 -- 172.21.15.99:0/3656218880 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa8810d910 con 0x7faa881025f0 2024-09-19T06:54:07.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.159+0000 7faa8f430640 1 -- 172.21.15.99:0/3656218880 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa88065810 con 0x7faa881025f0 2024-09-19T06:54:07.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.159+0000 7faa7dffb640 1 -- 172.21.15.99:0/3656218880 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7faa78030020 con 0x7faa881025f0 2024-09-19T06:54:07.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.160+0000 7faa7dffb640 1 --2- 172.21.15.99:0/3656218880 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7faa7406e530 0x7faa740709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:07.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.160+0000 7faa7dffb640 1 -- 172.21.15.99:0/3656218880 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7faa780ade70 con 0x7faa881025f0 2024-09-19T06:54:07.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.160+0000 7faa8d1cc640 1 --2- 172.21.15.99:0/3656218880 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7faa7406e530 0x7faa740709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:07.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.160+0000 7faa8d1cc640 1 --2- 172.21.15.99:0/3656218880 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7faa7406e530 0x7faa740709e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7faa84004ed0 tx=0x7faa8400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:07.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.164+0000 7faa7dffb640 1 -- 172.21.15.99:0/3656218880 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7faa78076f90 con 0x7faa881025f0 2024-09-19T06:54:07.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:54:07 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:54:07.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.392+0000 7faa8f430640 1 -- 172.21.15.99:0/3656218880 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7faa88109620 con 0x7faa881025f0 2024-09-19T06:54:07.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.392+0000 7faa7dffb640 1 -- 172.21.15.99:0/3656218880 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7faa7807a650 con 0x7faa881025f0 2024-09-19T06:54:07.394 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:54:07.394 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-09-19T06:54:07.394 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T06:54:07.394 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:54:07.394 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-09-19T06:54:07.394 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T06:54:07.394 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:54:07.394 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-09-19T06:54:07.394 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 6 2024-09-19T06:54:07.394 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:54:07.394 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": { 2024-09-19T06:54:07.395 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 4 2024-09-19T06:54:07.395 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:54:07.395 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-09-19T06:54:07.395 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 14 2024-09-19T06:54:07.395 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T06:54:07.395 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:54:07.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.394+0000 7faa8f430640 1 -- 172.21.15.99:0/3656218880 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7faa7406e530 msgr2=0x7faa740709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:07.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.394+0000 7faa8f430640 1 --2- 172.21.15.99:0/3656218880 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7faa7406e530 0x7faa740709e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7faa84004ed0 tx=0x7faa8400b040 comp rx=0 tx=0).stop 2024-09-19T06:54:07.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.394+0000 7faa8f430640 1 -- 172.21.15.99:0/3656218880 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa881025f0 msgr2=0x7faa88113710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:07.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.394+0000 7faa8f430640 1 --2- 172.21.15.99:0/3656218880 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa881025f0 0x7faa88113710 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7faa78000c00 tx=0x7faa78009da0 comp rx=0 tx=0).stop 2024-09-19T06:54:07.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.394+0000 7faa8f430640 1 -- 172.21.15.99:0/3656218880 shutdown_connections 2024-09-19T06:54:07.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.394+0000 7faa8f430640 1 --2- 172.21.15.99:0/3656218880 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7faa7406e530 0x7faa740709e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:07.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.394+0000 7faa8f430640 1 --2- 172.21.15.99:0/3656218880 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa881025f0 0x7faa88113710 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:07.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.394+0000 7faa8f430640 1 --2- 172.21.15.99:0/3656218880 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa880fac60 0x7faa881131d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:07.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.395+0000 7faa8f430640 1 -- 172.21.15.99:0/3656218880 >> 172.21.15.99:0/3656218880 conn(0x7faa88070c80 msgr2=0x7faa880f9f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:07.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.395+0000 7faa8f430640 1 -- 172.21.15.99:0/3656218880 shutdown_connections 2024-09-19T06:54:07.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.395+0000 7faa8f430640 1 -- 172.21.15.99:0/3656218880 wait complete. 2024-09-19T06:54:07.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.472+0000 7fa3b5ff8640 1 -- 172.21.15.99:0/3768804444 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3b00fe460 msgr2=0x7fa3b00fe830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:07.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.472+0000 7fa3b5ff8640 1 --2- 172.21.15.99:0/3768804444 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3b00fe460 0x7fa3b00fe830 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fa3a00048d0 tx=0x7fa3a0009da0 comp rx=0 tx=0).stop 2024-09-19T06:54:07.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.473+0000 7fa3b5ff8640 1 -- 172.21.15.99:0/3768804444 shutdown_connections 2024-09-19T06:54:07.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.473+0000 7fa3b5ff8640 1 --2- 172.21.15.99:0/3768804444 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3b0064fc0 0x7fa3b0065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:07.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.473+0000 7fa3b5ff8640 1 --2- 172.21.15.99:0/3768804444 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3b00fe460 0x7fa3b00fe830 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:07.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.473+0000 7fa3b5ff8640 1 -- 172.21.15.99:0/3768804444 >> 172.21.15.99:0/3768804444 conn(0x7fa3b00723b0 msgr2=0x7fa3b00727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:07.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.473+0000 7fa3b5ff8640 1 -- 172.21.15.99:0/3768804444 shutdown_connections 2024-09-19T06:54:07.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.473+0000 7fa3b5ff8640 1 -- 172.21.15.99:0/3768804444 wait complete. 2024-09-19T06:54:07.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.473+0000 7fa3b5ff8640 1 Processor -- start 2024-09-19T06:54:07.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.473+0000 7fa3b5ff8640 1 -- start start 2024-09-19T06:54:07.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.473+0000 7fa3b5ff8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3b0064fc0 0x7fa3b01153a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:07.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.473+0000 7fa3b5ff8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3b00fe460 0x7fa3b01158e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:07.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.473+0000 7fa3b5ff8640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b0115ee0 con 0x7fa3b00fe460 2024-09-19T06:54:07.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.473+0000 7fa3b5ff8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b0116050 con 0x7fa3b0064fc0 2024-09-19T06:54:07.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.474+0000 7fa3a6ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3b00fe460 0x7fa3b01158e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:07.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.474+0000 7fa3a6ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3b00fe460 0x7fa3b01158e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40286/0 (socket says 172.21.15.99:40286) 2024-09-19T06:54:07.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.474+0000 7fa3a6ffd640 1 -- 172.21.15.99:0/1856742779 learned_addr learned my addr 172.21.15.99:0/1856742779 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:54:07.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.474+0000 7fa3af7fe640 1 --2- 172.21.15.99:0/1856742779 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3b0064fc0 0x7fa3b01153a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:07.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.474+0000 7fa3a6ffd640 1 -- 172.21.15.99:0/1856742779 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3b0064fc0 msgr2=0x7fa3b01153a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:07.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.474+0000 7fa3a6ffd640 1 --2- 172.21.15.99:0/1856742779 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3b0064fc0 0x7fa3b01153a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:07.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.474+0000 7fa3a6ffd640 1 -- 172.21.15.99:0/1856742779 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a0005040 con 0x7fa3b00fe460 2024-09-19T06:54:07.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.474+0000 7fa3a6ffd640 1 --2- 172.21.15.99:0/1856742779 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3b00fe460 0x7fa3b01158e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa39800c790 tx=0x7fa3980043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:07.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.474+0000 7fa3acff9640 1 -- 172.21.15.99:0/1856742779 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa39800a7a0 con 0x7fa3b00fe460 2024-09-19T06:54:07.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.474+0000 7fa3acff9640 1 -- 172.21.15.99:0/1856742779 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa39800ada0 con 0x7fa3b00fe460 2024-09-19T06:54:07.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.474+0000 7fa3acff9640 1 -- 172.21.15.99:0/1856742779 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3980113a0 con 0x7fa3b00fe460 2024-09-19T06:54:07.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.474+0000 7fa3b5ff8640 1 -- 172.21.15.99:0/1856742779 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3b010f4d0 con 0x7fa3b00fe460 2024-09-19T06:54:07.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.474+0000 7fa3b5ff8640 1 -- 172.21.15.99:0/1856742779 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3b010fa20 con 0x7fa3b00fe460 2024-09-19T06:54:07.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.476+0000 7fa3b5ff8640 1 -- 172.21.15.99:0/1856742779 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3b00fdcf0 con 0x7fa3b00fe460 2024-09-19T06:54:07.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.476+0000 7fa3acff9640 1 -- 172.21.15.99:0/1856742779 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fa39800a900 con 0x7fa3b00fe460 2024-09-19T06:54:07.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.476+0000 7fa3acff9640 1 --2- 172.21.15.99:0/1856742779 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa39c06e530 0x7fa39c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:07.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.477+0000 7fa3acff9640 1 -- 172.21.15.99:0/1856742779 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fa39808e280 con 0x7fa3b00fe460 2024-09-19T06:54:07.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.477+0000 7fa3af7fe640 1 --2- 172.21.15.99:0/1856742779 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa39c06e530 0x7fa39c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:07.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.477+0000 7fa3af7fe640 1 --2- 172.21.15.99:0/1856742779 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa39c06e530 0x7fa39c0709e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa3a0009ac0 tx=0x7fa3a0035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:07.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.481+0000 7fa3acff9640 1 -- 172.21.15.99:0/1856742779 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fa3980573f0 con 0x7fa3b00fe460 2024-09-19T06:54:07.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.683+0000 7fa3b5ff8640 1 -- 172.21.15.99:0/1856742779 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa3b0072ec0 con 0x7fa3b00fe460 2024-09-19T06:54:07.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.683+0000 7fa3acff9640 1 -- 172.21.15.99:0/1856742779 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 29 v29) v1 ==== 76+0+1915 (secure 0 0 0) 0x7fa39805aab0 con 0x7fa3b00fe460 2024-09-19T06:54:07.685 INFO:teuthology.orchestra.run.smithi099.stdout:e29 2024-09-19T06:54:07.685 INFO:teuthology.orchestra.run.smithi099.stdout:btime 2024-09-19T06:48:47:938420+0000 2024-09-19T06:54:07.685 INFO:teuthology.orchestra.run.smithi099.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T06:54:07.685 INFO:teuthology.orchestra.run.smithi099.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T06:54:07.685 INFO:teuthology.orchestra.run.smithi099.stdout:legacy client fscid: 1 2024-09-19T06:54:07.685 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:54:07.685 INFO:teuthology.orchestra.run.smithi099.stdout:Filesystem 'cephfs' (1) 2024-09-19T06:54:07.685 INFO:teuthology.orchestra.run.smithi099.stdout:fs_name cephfs 2024-09-19T06:54:07.685 INFO:teuthology.orchestra.run.smithi099.stdout:epoch 20 2024-09-19T06:54:07.685 INFO:teuthology.orchestra.run.smithi099.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-19T06:54:07.685 INFO:teuthology.orchestra.run.smithi099.stdout:created 2024-09-19T06:37:40.838146+0000 2024-09-19T06:54:07.685 INFO:teuthology.orchestra.run.smithi099.stdout:modified 2024-09-19T06:47:50.076553+0000 2024-09-19T06:54:07.685 INFO:teuthology.orchestra.run.smithi099.stdout:tableserver 0 2024-09-19T06:54:07.686 INFO:teuthology.orchestra.run.smithi099.stdout:root 0 2024-09-19T06:54:07.686 INFO:teuthology.orchestra.run.smithi099.stdout:session_timeout 60 2024-09-19T06:54:07.686 INFO:teuthology.orchestra.run.smithi099.stdout:session_autoclose 300 2024-09-19T06:54:07.686 INFO:teuthology.orchestra.run.smithi099.stdout:max_file_size 1099511627776 2024-09-19T06:54:07.686 INFO:teuthology.orchestra.run.smithi099.stdout:max_xattr_size 65536 2024-09-19T06:54:07.686 INFO:teuthology.orchestra.run.smithi099.stdout:required_client_features {} 2024-09-19T06:54:07.686 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure 0 2024-09-19T06:54:07.686 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure_osd_epoch 77 2024-09-19T06:54:07.686 INFO:teuthology.orchestra.run.smithi099.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T06:54:07.686 INFO:teuthology.orchestra.run.smithi099.stdout:max_mds 2 2024-09-19T06:54:07.686 INFO:teuthology.orchestra.run.smithi099.stdout:in 0,1 2024-09-19T06:54:07.686 INFO:teuthology.orchestra.run.smithi099.stdout:up {} 2024-09-19T06:54:07.686 INFO:teuthology.orchestra.run.smithi099.stdout:failed 0,1 2024-09-19T06:54:07.687 INFO:teuthology.orchestra.run.smithi099.stdout:damaged 2024-09-19T06:54:07.687 INFO:teuthology.orchestra.run.smithi099.stdout:stopped 2024-09-19T06:54:07.687 INFO:teuthology.orchestra.run.smithi099.stdout:data_pools [3] 2024-09-19T06:54:07.687 INFO:teuthology.orchestra.run.smithi099.stdout:metadata_pool 2 2024-09-19T06:54:07.687 INFO:teuthology.orchestra.run.smithi099.stdout:inline_data disabled 2024-09-19T06:54:07.687 INFO:teuthology.orchestra.run.smithi099.stdout:balancer 2024-09-19T06:54:07.687 INFO:teuthology.orchestra.run.smithi099.stdout:bal_rank_mask -1 2024-09-19T06:54:07.687 INFO:teuthology.orchestra.run.smithi099.stdout:standby_count_wanted 1 2024-09-19T06:54:07.687 INFO:teuthology.orchestra.run.smithi099.stdout:qdb_cluster leader: 0 members: 2024-09-19T06:54:07.687 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:54:07.687 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:54:07.687 INFO:teuthology.orchestra.run.smithi099.stdout:Standby daemons: 2024-09-19T06:54:07.687 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:54:07.687 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.obarqf{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6826/1859154203,v1:172.21.15.99:6827/1859154203] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:54:07.688 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.xehbxe{-1:34410} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6828/1939453719,v1:172.21.15.99:6829/1939453719] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:54:07.688 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.nooexo{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6824/1398895079,v1:172.21.15.117:6825/1398895079] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:54:07.688 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.bheqzh{-1:44329} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6826/3233337308,v1:172.21.15.117:6827/3233337308] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:54:07.688 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 29 2024-09-19T06:54:07.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.685+0000 7fa3b5ff8640 1 -- 172.21.15.99:0/1856742779 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa39c06e530 msgr2=0x7fa39c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:07.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.685+0000 7fa3b5ff8640 1 --2- 172.21.15.99:0/1856742779 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa39c06e530 0x7fa39c0709e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa3a0009ac0 tx=0x7fa3a0035040 comp rx=0 tx=0).stop 2024-09-19T06:54:07.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.685+0000 7fa3b5ff8640 1 -- 172.21.15.99:0/1856742779 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3b00fe460 msgr2=0x7fa3b01158e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:07.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.685+0000 7fa3b5ff8640 1 --2- 172.21.15.99:0/1856742779 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3b00fe460 0x7fa3b01158e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa39800c790 tx=0x7fa3980043c0 comp rx=0 tx=0).stop 2024-09-19T06:54:07.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.686+0000 7fa3b5ff8640 1 -- 172.21.15.99:0/1856742779 shutdown_connections 2024-09-19T06:54:07.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.686+0000 7fa3b5ff8640 1 --2- 172.21.15.99:0/1856742779 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa39c06e530 0x7fa39c0709e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:07.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.686+0000 7fa3b5ff8640 1 --2- 172.21.15.99:0/1856742779 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3b00fe460 0x7fa3b01158e0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:07.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.686+0000 7fa3b5ff8640 1 --2- 172.21.15.99:0/1856742779 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3b0064fc0 0x7fa3b01153a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:07.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.686+0000 7fa3b5ff8640 1 -- 172.21.15.99:0/1856742779 >> 172.21.15.99:0/1856742779 conn(0x7fa3b00723b0 msgr2=0x7fa3b0103400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:07.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.686+0000 7fa3b5ff8640 1 -- 172.21.15.99:0/1856742779 shutdown_connections 2024-09-19T06:54:07.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.686+0000 7fa3b5ff8640 1 -- 172.21.15.99:0/1856742779 wait complete. 2024-09-19T06:54:07.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.764+0000 7f35b33de640 1 -- 172.21.15.99:0/2177253276 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35ac101e20 msgr2=0x7f35ac0fbd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:07.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.765+0000 7f35b33de640 1 --2- 172.21.15.99:0/2177253276 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35ac101e20 0x7f35ac0fbd70 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f359c0048d0 tx=0x7f359c009da0 comp rx=0 tx=0).stop 2024-09-19T06:54:07.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.765+0000 7f35b33de640 1 -- 172.21.15.99:0/2177253276 shutdown_connections 2024-09-19T06:54:07.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.765+0000 7f35b33de640 1 --2- 172.21.15.99:0/2177253276 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35ac101e20 0x7f35ac0fbd70 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:07.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.765+0000 7f35b33de640 1 --2- 172.21.15.99:0/2177253276 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35ac101480 0x7f35ac101850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:07.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.765+0000 7f35b33de640 1 -- 172.21.15.99:0/2177253276 >> 172.21.15.99:0/2177253276 conn(0x7f35ac070c80 msgr2=0x7f35ac071080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:07.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.765+0000 7f35b33de640 1 -- 172.21.15.99:0/2177253276 shutdown_connections 2024-09-19T06:54:07.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.765+0000 7f35b33de640 1 -- 172.21.15.99:0/2177253276 wait complete. 2024-09-19T06:54:07.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.765+0000 7f35b33de640 1 Processor -- start 2024-09-19T06:54:07.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.765+0000 7f35b33de640 1 -- start start 2024-09-19T06:54:07.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.765+0000 7f35b33de640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35ac101480 0x7f35ac1022e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:07.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.765+0000 7f35b33de640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35ac101e20 0x7f35ac102820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:07.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.765+0000 7f35b33de640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35ac102d60 con 0x7f35ac101e20 2024-09-19T06:54:07.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.765+0000 7f35b33de640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35ac102ed0 con 0x7f35ac101480 2024-09-19T06:54:07.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.766+0000 7f35b0979640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35ac101e20 0x7f35ac102820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:07.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.766+0000 7f35b117a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35ac101480 0x7f35ac1022e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:07.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.766+0000 7f35b0979640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35ac101e20 0x7f35ac102820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40296/0 (socket says 172.21.15.99:40296) 2024-09-19T06:54:07.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.766+0000 7f35b0979640 1 -- 172.21.15.99:0/1146105784 learned_addr learned my addr 172.21.15.99:0/1146105784 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:54:07.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.766+0000 7f35b0979640 1 -- 172.21.15.99:0/1146105784 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35ac101480 msgr2=0x7f35ac1022e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:07.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.766+0000 7f35b0979640 1 --2- 172.21.15.99:0/1146105784 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35ac101480 0x7f35ac1022e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:07.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.766+0000 7f35b0979640 1 -- 172.21.15.99:0/1146105784 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f359c005040 con 0x7f35ac101e20 2024-09-19T06:54:07.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.766+0000 7f35b117a640 1 --2- 172.21.15.99:0/1146105784 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35ac101480 0x7f35ac1022e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:54:07.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.766+0000 7f35b0979640 1 --2- 172.21.15.99:0/1146105784 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35ac101e20 0x7f35ac102820 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f359c003080 tx=0x7f359c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:07.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.766+0000 7f35a1ffb640 1 -- 172.21.15.99:0/1146105784 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f359c038070 con 0x7f35ac101e20 2024-09-19T06:54:07.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.766+0000 7f35a1ffb640 1 -- 172.21.15.99:0/1146105784 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f359c009760 con 0x7f35ac101e20 2024-09-19T06:54:07.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.766+0000 7f35b33de640 1 -- 172.21.15.99:0/1146105784 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35ac103150 con 0x7f35ac101e20 2024-09-19T06:54:07.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.766+0000 7f35a1ffb640 1 -- 172.21.15.99:0/1146105784 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f359c033420 con 0x7f35ac101e20 2024-09-19T06:54:07.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.767+0000 7f35b33de640 1 -- 172.21.15.99:0/1146105784 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35ac1197b0 con 0x7f35ac101e20 2024-09-19T06:54:07.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.768+0000 7f35b33de640 1 -- 172.21.15.99:0/1146105784 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35ac0fcd80 con 0x7f35ac101e20 2024-09-19T06:54:07.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.768+0000 7f35a1ffb640 1 -- 172.21.15.99:0/1146105784 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f359c030020 con 0x7f35ac101e20 2024-09-19T06:54:07.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.769+0000 7f35a1ffb640 1 --2- 172.21.15.99:0/1146105784 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f359806e530 0x7f35980709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:07.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.769+0000 7f35a1ffb640 1 -- 172.21.15.99:0/1146105784 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f359c0adb90 con 0x7f35ac101e20 2024-09-19T06:54:07.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.769+0000 7f35b117a640 1 --2- 172.21.15.99:0/1146105784 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f359806e530 0x7f35980709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:07.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.770+0000 7f35b117a640 1 --2- 172.21.15.99:0/1146105784 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f359806e530 0x7f35980709e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f35a8007fd0 tx=0x7f35a8009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:07.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.773+0000 7f35a1ffb640 1 -- 172.21.15.99:0/1146105784 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f359c076d00 con 0x7f35ac101e20 2024-09-19T06:54:07.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.956+0000 7f35b33de640 1 -- 172.21.15.99:0/1146105784 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f35ac103150 con 0x7f359806e530 2024-09-19T06:54:07.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.957+0000 7f35a1ffb640 1 -- 172.21.15.99:0/1146105784 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f35ac103150 con 0x7f359806e530 2024-09-19T06:54:07.958 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:54:07.959 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T06:54:07.959 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": true, 2024-09-19T06:54:07.959 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T06:54:07.959 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [ 2024-09-19T06:54:07.959 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr", 2024-09-19T06:54:07.959 INFO:teuthology.orchestra.run.smithi099.stdout: "crash", 2024-09-19T06:54:07.959 INFO:teuthology.orchestra.run.smithi099.stdout: "mds", 2024-09-19T06:54:07.959 INFO:teuthology.orchestra.run.smithi099.stdout: "mon", 2024-09-19T06:54:07.959 INFO:teuthology.orchestra.run.smithi099.stdout: "osd" 2024-09-19T06:54:07.959 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-19T06:54:07.959 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": "16/21 daemons upgraded", 2024-09-19T06:54:07.959 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "Currently upgrading mds daemons", 2024-09-19T06:54:07.959 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-09-19T06:54:07.960 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:54:07.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.959+0000 7f35b33de640 1 -- 172.21.15.99:0/1146105784 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f359806e530 msgr2=0x7f35980709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:07.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.959+0000 7f35b33de640 1 --2- 172.21.15.99:0/1146105784 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f359806e530 0x7f35980709e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f35a8007fd0 tx=0x7f35a8009040 comp rx=0 tx=0).stop 2024-09-19T06:54:07.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.959+0000 7f35b33de640 1 -- 172.21.15.99:0/1146105784 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35ac101e20 msgr2=0x7f35ac102820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:07.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.959+0000 7f35b33de640 1 --2- 172.21.15.99:0/1146105784 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35ac101e20 0x7f35ac102820 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f359c003080 tx=0x7f359c009da0 comp rx=0 tx=0).stop 2024-09-19T06:54:07.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.960+0000 7f35b33de640 1 -- 172.21.15.99:0/1146105784 shutdown_connections 2024-09-19T06:54:07.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.960+0000 7f35b33de640 1 --2- 172.21.15.99:0/1146105784 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f359806e530 0x7f35980709e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:07.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.960+0000 7f35b33de640 1 --2- 172.21.15.99:0/1146105784 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35ac101e20 0x7f35ac102820 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:07.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.960+0000 7f35b33de640 1 --2- 172.21.15.99:0/1146105784 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35ac101480 0x7f35ac1022e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:07.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.960+0000 7f35b33de640 1 -- 172.21.15.99:0/1146105784 >> 172.21.15.99:0/1146105784 conn(0x7f35ac070c80 msgr2=0x7f35ac0f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:07.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.960+0000 7f35b33de640 1 -- 172.21.15.99:0/1146105784 shutdown_connections 2024-09-19T06:54:07.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:07.960+0000 7f35b33de640 1 -- 172.21.15.99:0/1146105784 wait complete. 2024-09-19T06:54:08.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:08.039+0000 7f7f5909a640 1 -- 172.21.15.99:0/3030000901 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f54102ef0 msgr2=0x7f7f540fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:08.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:08.039+0000 7f7f5909a640 1 --2- 172.21.15.99:0/3030000901 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f54102ef0 0x7f7f540fc5b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f7f480048d0 tx=0x7f7f48009da0 comp rx=0 tx=0).stop 2024-09-19T06:54:08.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:08.039+0000 7f7f5909a640 1 -- 172.21.15.99:0/3030000901 shutdown_connections 2024-09-19T06:54:08.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:08.039+0000 7f7f5909a640 1 --2- 172.21.15.99:0/3030000901 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f54102ef0 0x7f7f540fc5b0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:08.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:08.039+0000 7f7f5909a640 1 --2- 172.21.15.99:0/3030000901 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f54102550 0x7f7f54102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:08.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:08.039+0000 7f7f5909a640 1 -- 172.21.15.99:0/3030000901 >> 172.21.15.99:0/3030000901 conn(0x7f7f540f80f0 msgr2=0x7f7f540fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:08.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:08.039+0000 7f7f5909a640 1 -- 172.21.15.99:0/3030000901 shutdown_connections 2024-09-19T06:54:08.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:08.039+0000 7f7f5909a640 1 -- 172.21.15.99:0/3030000901 wait complete. 2024-09-19T06:54:08.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:08.040+0000 7f7f5909a640 1 Processor -- start 2024-09-19T06:54:08.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:08.040+0000 7f7f5909a640 1 -- start start 2024-09-19T06:54:08.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:08.040+0000 7f7f5909a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f54102550 0x7f7f54113520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:08.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:08.040+0000 7f7f5909a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f54102ef0 0x7f7f54113a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:08.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:08.040+0000 7f7f5909a640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f541140b0 con 0x7f7f54102ef0 2024-09-19T06:54:08.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:08.040+0000 7f7f5909a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5410d4c0 con 0x7f7f54102550 2024-09-19T06:54:08.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:08.040+0000 7f7f5259c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f54102ef0 0x7f7f54113a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:08.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:08.040+0000 7f7f5259c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f54102ef0 0x7f7f54113a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40314/0 (socket says 172.21.15.99:40314) 2024-09-19T06:54:08.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:08.040+0000 7f7f5259c640 1 -- 172.21.15.99:0/3211116748 learned_addr learned my addr 172.21.15.99:0/3211116748 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:54:08.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:08.040+0000 7f7f52d9d640 1 --2- 172.21.15.99:0/3211116748 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f54102550 0x7f7f54113520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:08.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:08.041+0000 7f7f5259c640 1 -- 172.21.15.99:0/3211116748 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f54102550 msgr2=0x7f7f54113520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:08.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:08.041+0000 7f7f5259c640 1 --2- 172.21.15.99:0/3211116748 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f54102550 0x7f7f54113520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:08.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:08.041+0000 7f7f5259c640 1 -- 172.21.15.99:0/3211116748 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f48005040 con 0x7f7f54102ef0 2024-09-19T06:54:08.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:08.041+0000 7f7f52d9d640 1 --2- 172.21.15.99:0/3211116748 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f54102550 0x7f7f54113520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:54:08.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:08.041+0000 7f7f5259c640 1 --2- 172.21.15.99:0/3211116748 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f54102ef0 0x7f7f54113a60 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7f480043d0 tx=0x7f7f48009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:08.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:08.041+0000 7f7f3b7fe640 1 -- 172.21.15.99:0/3211116748 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f48038070 con 0x7f7f54102ef0 2024-09-19T06:54:08.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:08.041+0000 7f7f5909a640 1 -- 172.21.15.99:0/3211116748 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f5410d740 con 0x7f7f54102ef0 2024-09-19T06:54:08.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:08.041+0000 7f7f3b7fe640 1 -- 172.21.15.99:0/3211116748 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7f480096e0 con 0x7f7f54102ef0 2024-09-19T06:54:08.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:08.041+0000 7f7f3b7fe640 1 -- 172.21.15.99:0/3211116748 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f4802c8a0 con 0x7f7f54102ef0 2024-09-19T06:54:08.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:08.041+0000 7f7f5909a640 1 -- 172.21.15.99:0/3211116748 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f5410dc80 con 0x7f7f54102ef0 2024-09-19T06:54:08.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:08.042+0000 7f7f5909a640 1 -- 172.21.15.99:0/3211116748 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f540fdcd0 con 0x7f7f54102ef0 2024-09-19T06:54:08.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:08.043+0000 7f7f3b7fe640 1 -- 172.21.15.99:0/3211116748 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f7f48030020 con 0x7f7f54102ef0 2024-09-19T06:54:08.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:08.043+0000 7f7f3b7fe640 1 --2- 172.21.15.99:0/3211116748 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f7f3c06e530 0x7f7f3c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:08.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:08.043+0000 7f7f52d9d640 1 --2- 172.21.15.99:0/3211116748 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f7f3c06e530 0x7f7f3c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:08.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:08.043+0000 7f7f3b7fe640 1 -- 172.21.15.99:0/3211116748 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f7f480ade00 con 0x7f7f54102ef0 2024-09-19T06:54:08.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:08.044+0000 7f7f52d9d640 1 --2- 172.21.15.99:0/3211116748 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f7f3c06e530 0x7f7f3c0709e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7f44004fd0 tx=0x7f7f4400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:08.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:08.048+0000 7f7f3b7fe640 1 -- 172.21.15.99:0/3211116748 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f7f48076fa0 con 0x7f7f54102ef0 2024-09-19T06:54:08.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:08.280+0000 7f7f5909a640 1 -- 172.21.15.99:0/3211116748 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f7f540fbd50 con 0x7f7f54102ef0 2024-09-19T06:54:08.282 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:54:08 smithi099 ceph-mon[97031]: from='client.34698 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:54:08.282 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:54:08 smithi099 ceph-mon[97031]: from='client.34702 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:54:08.282 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:54:08 smithi099 ceph-mon[97031]: pgmap v353: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:54:08.282 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:54:08 smithi099 ceph-mon[97031]: from='client.44543 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:54:08.282 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:54:08 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/3656218880' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:54:08.282 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:54:08 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/1856742779' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:54:08.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:08.281+0000 7f7f3b7fe640 1 -- 172.21.15.99:0/3211116748 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7f7f4807a660 con 0x7f7f54102ef0 2024-09-19T06:54:08.282 INFO:teuthology.orchestra.run.smithi099.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-09-19T06:54:08.283 INFO:teuthology.orchestra.run.smithi099.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-19T06:54:08.283 INFO:teuthology.orchestra.run.smithi099.stdout: fs cephfs is degraded 2024-09-19T06:54:08.283 INFO:teuthology.orchestra.run.smithi099.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-19T06:54:08.283 INFO:teuthology.orchestra.run.smithi099.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-19T06:54:08.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:08.283+0000 7f7f5909a640 1 -- 172.21.15.99:0/3211116748 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f7f3c06e530 msgr2=0x7f7f3c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:08.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:08.283+0000 7f7f5909a640 1 --2- 172.21.15.99:0/3211116748 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f7f3c06e530 0x7f7f3c0709e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7f44004fd0 tx=0x7f7f4400b040 comp rx=0 tx=0).stop 2024-09-19T06:54:08.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:08.283+0000 7f7f5909a640 1 -- 172.21.15.99:0/3211116748 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f54102ef0 msgr2=0x7f7f54113a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:08.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:08.283+0000 7f7f5909a640 1 --2- 172.21.15.99:0/3211116748 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f54102ef0 0x7f7f54113a60 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7f480043d0 tx=0x7f7f48009da0 comp rx=0 tx=0).stop 2024-09-19T06:54:08.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:08.283+0000 7f7f5909a640 1 -- 172.21.15.99:0/3211116748 shutdown_connections 2024-09-19T06:54:08.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:08.283+0000 7f7f5909a640 1 --2- 172.21.15.99:0/3211116748 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f7f3c06e530 0x7f7f3c0709e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:08.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:08.284+0000 7f7f5909a640 1 --2- 172.21.15.99:0/3211116748 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f54102ef0 0x7f7f54113a60 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:08.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:08.284+0000 7f7f5909a640 1 --2- 172.21.15.99:0/3211116748 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f54102550 0x7f7f54113520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:08.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:08.284+0000 7f7f5909a640 1 -- 172.21.15.99:0/3211116748 >> 172.21.15.99:0/3211116748 conn(0x7f7f540f80f0 msgr2=0x7f7f540f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:08.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:08.284+0000 7f7f5909a640 1 -- 172.21.15.99:0/3211116748 shutdown_connections 2024-09-19T06:54:08.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:08.284+0000 7f7f5909a640 1 -- 172.21.15.99:0/3211116748 wait complete. 2024-09-19T06:54:08.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:54:08 smithi117 ceph-mon[76771]: from='client.34698 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:54:08.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:54:08 smithi117 ceph-mon[76771]: from='client.34702 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:54:08.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:54:08 smithi117 ceph-mon[76771]: pgmap v353: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:54:08.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:54:08 smithi117 ceph-mon[76771]: from='client.44543 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:54:08.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:54:08 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/3656218880' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:54:08.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:54:08 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/1856742779' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:54:09.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:54:09 smithi117 ceph-mon[76771]: from='client.34718 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:54:09.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:54:09 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/3211116748' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T06:54:09.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:54:09 smithi099 ceph-mon[97031]: from='client.34718 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:54:09.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:54:09 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/3211116748' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T06:54:10.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:54:10 smithi117 ceph-mon[76771]: pgmap v354: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:54:10.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:54:10 smithi099 ceph-mon[97031]: pgmap v354: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:54:12.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:54:12 smithi117 ceph-mon[76771]: pgmap v355: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:54:12.314 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:54:12 smithi099 ceph-mon[97031]: pgmap v355: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:54:14.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:54:14 smithi117 ceph-mon[76771]: pgmap v356: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:54:14.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:54:14 smithi099 ceph-mon[97031]: pgmap v356: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:54:16.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:54:16 smithi117 ceph-mon[76771]: pgmap v357: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:54:16.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:54:16 smithi099 ceph-mon[97031]: pgmap v357: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:54:18.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:54:18 smithi117 ceph-mon[76771]: pgmap v358: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:54:18.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:54:18 smithi099 ceph-mon[97031]: pgmap v358: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:54:20.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:54:20 smithi117 ceph-mon[76771]: pgmap v359: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:54:20.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:54:20 smithi099 ceph-mon[97031]: pgmap v359: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:54:22.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:54:22 smithi117 ceph-mon[76771]: pgmap v360: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:54:22.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:54:22 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:54:22.314 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:54:22 smithi099 ceph-mon[97031]: pgmap v360: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:54:22.314 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:54:22 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:54:24.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:54:24 smithi117 ceph-mon[76771]: pgmap v361: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:54:24.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:54:24 smithi099 ceph-mon[97031]: pgmap v361: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:54:26.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:54:26 smithi117 ceph-mon[76771]: pgmap v362: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:54:26.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:54:26 smithi099 ceph-mon[97031]: pgmap v362: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:54:28.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:54:28 smithi117 ceph-mon[76771]: pgmap v363: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:54:28.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:54:28 smithi099 ceph-mon[97031]: pgmap v363: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:54:30.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:54:30 smithi099 ceph-mon[97031]: pgmap v364: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:54:30.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:54:30 smithi117 ceph-mon[76771]: pgmap v364: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:54:32.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:54:32 smithi099 ceph-mon[97031]: pgmap v365: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:54:32.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:54:32 smithi117 ceph-mon[76771]: pgmap v365: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:54:34.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:54:34 smithi099 ceph-mon[97031]: pgmap v366: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:54:34.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:54:34 smithi117 ceph-mon[76771]: pgmap v366: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:54:36.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:54:36 smithi099 ceph-mon[97031]: pgmap v367: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:54:36.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:54:36 smithi117 ceph-mon[76771]: pgmap v367: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:54:37.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:54:37 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:54:37.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:54:37 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:54:38.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.374+0000 7f22525da640 1 -- 172.21.15.99:0/1426236022 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f224c0fdf20 msgr2=0x7f224c1065f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:38.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.374+0000 7f22525da640 1 --2- 172.21.15.99:0/1426236022 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f224c0fdf20 0x7f224c1065f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f22400048d0 tx=0x7f2240009da0 comp rx=0 tx=0).stop 2024-09-19T06:54:38.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.374+0000 7f22525da640 1 -- 172.21.15.99:0/1426236022 shutdown_connections 2024-09-19T06:54:38.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.374+0000 7f22525da640 1 --2- 172.21.15.99:0/1426236022 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f224c0fdf20 0x7f224c1065f0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:38.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.374+0000 7f22525da640 1 --2- 172.21.15.99:0/1426236022 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f224c0fd580 0x7f224c0fd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:38.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.374+0000 7f22525da640 1 -- 172.21.15.99:0/1426236022 >> 172.21.15.99:0/1426236022 conn(0x7f224c0f7000 msgr2=0x7f224c0f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:38.376 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:54:38 smithi099 ceph-mon[97031]: pgmap v368: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:54:38.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.374+0000 7f22525da640 1 -- 172.21.15.99:0/1426236022 shutdown_connections 2024-09-19T06:54:38.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.374+0000 7f22525da640 1 -- 172.21.15.99:0/1426236022 wait complete. 2024-09-19T06:54:38.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.375+0000 7f22525da640 1 Processor -- start 2024-09-19T06:54:38.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.375+0000 7f22525da640 1 -- start start 2024-09-19T06:54:38.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.375+0000 7f22525da640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f224c0fd580 0x7f224c0fb440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:38.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.375+0000 7f22525da640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f224c0fdf20 0x7f224c0fb980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:38.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.375+0000 7f22525da640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f224c0fbec0 con 0x7f224c0fdf20 2024-09-19T06:54:38.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.375+0000 7f22525da640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f224c0fc030 con 0x7f224c0fd580 2024-09-19T06:54:38.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.376+0000 7f224b7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f224c0fdf20 0x7f224c0fb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:38.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.376+0000 7f224b7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f224c0fdf20 0x7f224c0fb980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47226/0 (socket says 172.21.15.99:47226) 2024-09-19T06:54:38.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.376+0000 7f224b7fe640 1 -- 172.21.15.99:0/1278596023 learned_addr learned my addr 172.21.15.99:0/1278596023 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:54:38.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.376+0000 7f224bfff640 1 --2- 172.21.15.99:0/1278596023 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f224c0fd580 0x7f224c0fb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:38.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.376+0000 7f224b7fe640 1 -- 172.21.15.99:0/1278596023 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f224c0fd580 msgr2=0x7f224c0fb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:38.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.376+0000 7f224b7fe640 1 --2- 172.21.15.99:0/1278596023 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f224c0fd580 0x7f224c0fb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:38.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.376+0000 7f224b7fe640 1 -- 172.21.15.99:0/1278596023 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2240005040 con 0x7f224c0fdf20 2024-09-19T06:54:38.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.376+0000 7f224b7fe640 1 --2- 172.21.15.99:0/1278596023 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f224c0fdf20 0x7f224c0fb980 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f2240000c00 tx=0x7f2240009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:38.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.376+0000 7f2248ff9640 1 -- 172.21.15.99:0/1278596023 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2240038070 con 0x7f224c0fdf20 2024-09-19T06:54:38.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.376+0000 7f2248ff9640 1 -- 172.21.15.99:0/1278596023 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f224002ade0 con 0x7f224c0fdf20 2024-09-19T06:54:38.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.376+0000 7f2248ff9640 1 -- 172.21.15.99:0/1278596023 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f224002c770 con 0x7f224c0fdf20 2024-09-19T06:54:38.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.376+0000 7f22525da640 1 -- 172.21.15.99:0/1278596023 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f224c0fc260 con 0x7f224c0fdf20 2024-09-19T06:54:38.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.376+0000 7f22525da640 1 -- 172.21.15.99:0/1278596023 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f224c119890 con 0x7f224c0fdf20 2024-09-19T06:54:38.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.378+0000 7f22525da640 1 -- 172.21.15.99:0/1278596023 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f224c066290 con 0x7f224c0fdf20 2024-09-19T06:54:38.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.378+0000 7f2248ff9640 1 -- 172.21.15.99:0/1278596023 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f2240030020 con 0x7f224c0fdf20 2024-09-19T06:54:38.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.379+0000 7f2248ff9640 1 --2- 172.21.15.99:0/1278596023 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f223406e530 0x7f22340709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:38.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.379+0000 7f2248ff9640 1 -- 172.21.15.99:0/1278596023 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f22400add90 con 0x7f224c0fdf20 2024-09-19T06:54:38.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.379+0000 7f224bfff640 1 --2- 172.21.15.99:0/1278596023 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f223406e530 0x7f22340709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:38.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.379+0000 7f224bfff640 1 --2- 172.21.15.99:0/1278596023 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f223406e530 0x7f22340709e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f223c004ed0 tx=0x7f223c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:38.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.383+0000 7f2248ff9640 1 -- 172.21.15.99:0/1278596023 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f2240076fb0 con 0x7f224c0fdf20 2024-09-19T06:54:38.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:54:38 smithi117 ceph-mon[76771]: pgmap v368: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:54:38.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.566+0000 7f22525da640 1 -- 172.21.15.99:0/1278596023 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f224c04b720 con 0x7f223406e530 2024-09-19T06:54:38.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.567+0000 7f2248ff9640 1 -- 172.21.15.99:0/1278596023 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f224c04b720 con 0x7f223406e530 2024-09-19T06:54:38.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.570+0000 7f22525da640 1 -- 172.21.15.99:0/1278596023 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f223406e530 msgr2=0x7f22340709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:38.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.570+0000 7f22525da640 1 --2- 172.21.15.99:0/1278596023 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f223406e530 0x7f22340709e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f223c004ed0 tx=0x7f223c00b040 comp rx=0 tx=0).stop 2024-09-19T06:54:38.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.570+0000 7f22525da640 1 -- 172.21.15.99:0/1278596023 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f224c0fdf20 msgr2=0x7f224c0fb980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:38.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.570+0000 7f22525da640 1 --2- 172.21.15.99:0/1278596023 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f224c0fdf20 0x7f224c0fb980 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f2240000c00 tx=0x7f2240009da0 comp rx=0 tx=0).stop 2024-09-19T06:54:38.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.570+0000 7f22525da640 1 -- 172.21.15.99:0/1278596023 shutdown_connections 2024-09-19T06:54:38.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.570+0000 7f22525da640 1 --2- 172.21.15.99:0/1278596023 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f223406e530 0x7f22340709e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:38.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.570+0000 7f22525da640 1 --2- 172.21.15.99:0/1278596023 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f224c0fdf20 0x7f224c0fb980 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:38.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.570+0000 7f22525da640 1 --2- 172.21.15.99:0/1278596023 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f224c0fd580 0x7f224c0fb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:38.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.570+0000 7f22525da640 1 -- 172.21.15.99:0/1278596023 >> 172.21.15.99:0/1278596023 conn(0x7f224c0f7000 msgr2=0x7f224c0f8550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:38.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.570+0000 7f22525da640 1 -- 172.21.15.99:0/1278596023 shutdown_connections 2024-09-19T06:54:38.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.570+0000 7f22525da640 1 -- 172.21.15.99:0/1278596023 wait complete. 2024-09-19T06:54:38.580 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-09-19T06:54:38.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.649+0000 7f2e2c4be640 1 -- 172.21.15.99:0/1918172627 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2e240fb3a0 msgr2=0x7f2e241063e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:38.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.649+0000 7f2e2c4be640 1 --2- 172.21.15.99:0/1918172627 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2e240fb3a0 0x7f2e241063e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2e18004900 tx=0x7f2e18009da0 comp rx=0 tx=0).stop 2024-09-19T06:54:38.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.649+0000 7f2e2c4be640 1 -- 172.21.15.99:0/1918172627 shutdown_connections 2024-09-19T06:54:38.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.649+0000 7f2e2c4be640 1 --2- 172.21.15.99:0/1918172627 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2e240fb3a0 0x7f2e241063e0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:38.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.649+0000 7f2e2c4be640 1 --2- 172.21.15.99:0/1918172627 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e240faa00 0x7f2e240fadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:38.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.649+0000 7f2e2c4be640 1 -- 172.21.15.99:0/1918172627 >> 172.21.15.99:0/1918172627 conn(0x7f2e24072740 msgr2=0x7f2e24072b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:38.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.649+0000 7f2e2c4be640 1 -- 172.21.15.99:0/1918172627 shutdown_connections 2024-09-19T06:54:38.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.649+0000 7f2e2c4be640 1 -- 172.21.15.99:0/1918172627 wait complete. 2024-09-19T06:54:38.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.650+0000 7f2e2c4be640 1 Processor -- start 2024-09-19T06:54:38.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.650+0000 7f2e2c4be640 1 -- start start 2024-09-19T06:54:38.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.650+0000 7f2e2c4be640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e240faa00 0x7f2e24113280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:38.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.650+0000 7f2e2c4be640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2e240fb3a0 0x7f2e241137c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:38.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.650+0000 7f2e2c4be640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e24113dc0 con 0x7f2e240fb3a0 2024-09-19T06:54:38.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.650+0000 7f2e2c4be640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2410d200 con 0x7f2e240faa00 2024-09-19T06:54:38.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.650+0000 7f2e29a59640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2e240fb3a0 0x7f2e241137c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:38.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.650+0000 7f2e29a59640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2e240fb3a0 0x7f2e241137c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47246/0 (socket says 172.21.15.99:47246) 2024-09-19T06:54:38.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.650+0000 7f2e29a59640 1 -- 172.21.15.99:0/3399922586 learned_addr learned my addr 172.21.15.99:0/3399922586 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:54:38.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.650+0000 7f2e2a25a640 1 --2- 172.21.15.99:0/3399922586 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e240faa00 0x7f2e24113280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:38.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.650+0000 7f2e29a59640 1 -- 172.21.15.99:0/3399922586 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e240faa00 msgr2=0x7f2e24113280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:38.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.651+0000 7f2e29a59640 1 --2- 172.21.15.99:0/3399922586 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e240faa00 0x7f2e24113280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:38.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.651+0000 7f2e29a59640 1 -- 172.21.15.99:0/3399922586 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e18005040 con 0x7f2e240fb3a0 2024-09-19T06:54:38.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.651+0000 7f2e29a59640 1 --2- 172.21.15.99:0/3399922586 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2e240fb3a0 0x7f2e241137c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2e1802a560 tx=0x7f2e18009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:38.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.651+0000 7f2e16ffd640 1 -- 172.21.15.99:0/3399922586 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e18038070 con 0x7f2e240fb3a0 2024-09-19T06:54:38.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.651+0000 7f2e16ffd640 1 -- 172.21.15.99:0/3399922586 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2e18008ed0 con 0x7f2e240fb3a0 2024-09-19T06:54:38.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.651+0000 7f2e2c4be640 1 -- 172.21.15.99:0/3399922586 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e2410d480 con 0x7f2e240fb3a0 2024-09-19T06:54:38.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.651+0000 7f2e16ffd640 1 -- 172.21.15.99:0/3399922586 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e180095a0 con 0x7f2e240fb3a0 2024-09-19T06:54:38.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.651+0000 7f2e2c4be640 1 -- 172.21.15.99:0/3399922586 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e2410d940 con 0x7f2e240fb3a0 2024-09-19T06:54:38.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.652+0000 7f2e2c4be640 1 -- 172.21.15.99:0/3399922586 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e240fbab0 con 0x7f2e240fb3a0 2024-09-19T06:54:38.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.652+0000 7f2e16ffd640 1 -- 172.21.15.99:0/3399922586 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f2e18030020 con 0x7f2e240fb3a0 2024-09-19T06:54:38.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.653+0000 7f2e16ffd640 1 --2- 172.21.15.99:0/3399922586 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f2e1006e530 0x7f2e100709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:38.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.653+0000 7f2e16ffd640 1 -- 172.21.15.99:0/3399922586 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f2e180addd0 con 0x7f2e240fb3a0 2024-09-19T06:54:38.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.653+0000 7f2e2a25a640 1 --2- 172.21.15.99:0/3399922586 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f2e1006e530 0x7f2e100709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:38.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.654+0000 7f2e2a25a640 1 --2- 172.21.15.99:0/3399922586 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f2e1006e530 0x7f2e100709e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2e20009fd0 tx=0x7f2e20009e50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:38.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.657+0000 7f2e16ffd640 1 -- 172.21.15.99:0/3399922586 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f2e18076f70 con 0x7f2e240fb3a0 2024-09-19T06:54:38.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.839+0000 7f2e2c4be640 1 -- 172.21.15.99:0/3399922586 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2e2404b720 con 0x7f2e1006e530 2024-09-19T06:54:38.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.840+0000 7f2e16ffd640 1 -- 172.21.15.99:0/3399922586 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f2e2404b720 con 0x7f2e1006e530 2024-09-19T06:54:38.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.842+0000 7f2e2c4be640 1 -- 172.21.15.99:0/3399922586 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f2e1006e530 msgr2=0x7f2e100709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:38.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.842+0000 7f2e2c4be640 1 --2- 172.21.15.99:0/3399922586 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f2e1006e530 0x7f2e100709e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2e20009fd0 tx=0x7f2e20009e50 comp rx=0 tx=0).stop 2024-09-19T06:54:38.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.842+0000 7f2e2c4be640 1 -- 172.21.15.99:0/3399922586 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2e240fb3a0 msgr2=0x7f2e241137c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:38.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.842+0000 7f2e2c4be640 1 --2- 172.21.15.99:0/3399922586 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2e240fb3a0 0x7f2e241137c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2e1802a560 tx=0x7f2e18009da0 comp rx=0 tx=0).stop 2024-09-19T06:54:38.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.842+0000 7f2e2c4be640 1 -- 172.21.15.99:0/3399922586 shutdown_connections 2024-09-19T06:54:38.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.842+0000 7f2e2c4be640 1 --2- 172.21.15.99:0/3399922586 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f2e1006e530 0x7f2e100709e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:38.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.842+0000 7f2e2c4be640 1 --2- 172.21.15.99:0/3399922586 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2e240fb3a0 0x7f2e241137c0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:38.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.842+0000 7f2e2c4be640 1 --2- 172.21.15.99:0/3399922586 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e240faa00 0x7f2e24113280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:38.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.842+0000 7f2e2c4be640 1 -- 172.21.15.99:0/3399922586 >> 172.21.15.99:0/3399922586 conn(0x7f2e24072740 msgr2=0x7f2e240f9310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:38.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.842+0000 7f2e2c4be640 1 -- 172.21.15.99:0/3399922586 shutdown_connections 2024-09-19T06:54:38.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.842+0000 7f2e2c4be640 1 -- 172.21.15.99:0/3399922586 wait complete. 2024-09-19T06:54:38.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.921+0000 7fa87534f640 1 -- 172.21.15.99:0/1908562346 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa870102ef0 msgr2=0x7fa8700fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:38.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.921+0000 7fa87534f640 1 --2- 172.21.15.99:0/1908562346 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa870102ef0 0x7fa8700fc5b0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa8640048d0 tx=0x7fa864009da0 comp rx=0 tx=0).stop 2024-09-19T06:54:38.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.921+0000 7fa87534f640 1 -- 172.21.15.99:0/1908562346 shutdown_connections 2024-09-19T06:54:38.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.921+0000 7fa87534f640 1 --2- 172.21.15.99:0/1908562346 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa870102ef0 0x7fa8700fc5b0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:38.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.921+0000 7fa87534f640 1 --2- 172.21.15.99:0/1908562346 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa870102550 0x7fa870102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:38.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.921+0000 7fa87534f640 1 -- 172.21.15.99:0/1908562346 >> 172.21.15.99:0/1908562346 conn(0x7fa8700f80f0 msgr2=0x7fa8700fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:38.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.921+0000 7fa87534f640 1 -- 172.21.15.99:0/1908562346 shutdown_connections 2024-09-19T06:54:38.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.921+0000 7fa87534f640 1 -- 172.21.15.99:0/1908562346 wait complete. 2024-09-19T06:54:38.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.922+0000 7fa87534f640 1 Processor -- start 2024-09-19T06:54:38.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.922+0000 7fa87534f640 1 -- start start 2024-09-19T06:54:38.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.922+0000 7fa87534f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa870102550 0x7fa870113500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:38.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.922+0000 7fa87534f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa870102ef0 0x7fa870113a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:38.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.922+0000 7fa87534f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa870114090 con 0x7fa870102550 2024-09-19T06:54:38.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.922+0000 7fa87534f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa87010d4a0 con 0x7fa870102ef0 2024-09-19T06:54:38.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.922+0000 7fa86effd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa870102550 0x7fa870113500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:38.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.922+0000 7fa86effd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa870102550 0x7fa870113500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47272/0 (socket says 172.21.15.99:47272) 2024-09-19T06:54:38.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.922+0000 7fa86effd640 1 -- 172.21.15.99:0/240137040 learned_addr learned my addr 172.21.15.99:0/240137040 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:54:38.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.922+0000 7fa86e7fc640 1 --2- 172.21.15.99:0/240137040 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa870102ef0 0x7fa870113a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:38.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.922+0000 7fa86effd640 1 -- 172.21.15.99:0/240137040 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa870102ef0 msgr2=0x7fa870113a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:38.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.922+0000 7fa86effd640 1 --2- 172.21.15.99:0/240137040 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa870102ef0 0x7fa870113a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:38.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.922+0000 7fa86effd640 1 -- 172.21.15.99:0/240137040 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa864005040 con 0x7fa870102550 2024-09-19T06:54:38.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.923+0000 7fa86effd640 1 --2- 172.21.15.99:0/240137040 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa870102550 0x7fa870113500 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa86000c830 tx=0x7fa860004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:38.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.923+0000 7fa8577fe640 1 -- 172.21.15.99:0/240137040 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa86000a7d0 con 0x7fa870102550 2024-09-19T06:54:38.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.923+0000 7fa8577fe640 1 -- 172.21.15.99:0/240137040 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa86000add0 con 0x7fa870102550 2024-09-19T06:54:38.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.923+0000 7fa87534f640 1 -- 172.21.15.99:0/240137040 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa87010d780 con 0x7fa870102550 2024-09-19T06:54:38.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.923+0000 7fa8577fe640 1 -- 172.21.15.99:0/240137040 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8600113a0 con 0x7fa870102550 2024-09-19T06:54:38.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.923+0000 7fa87534f640 1 -- 172.21.15.99:0/240137040 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa87010dcf0 con 0x7fa870102550 2024-09-19T06:54:38.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.924+0000 7fa87534f640 1 -- 172.21.15.99:0/240137040 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8700fdcd0 con 0x7fa870102550 2024-09-19T06:54:38.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.924+0000 7fa8577fe640 1 -- 172.21.15.99:0/240137040 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fa860012400 con 0x7fa870102550 2024-09-19T06:54:38.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.925+0000 7fa8577fe640 1 --2- 172.21.15.99:0/240137040 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa85806e530 0x7fa8580709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:38.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.925+0000 7fa8577fe640 1 -- 172.21.15.99:0/240137040 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fa86008e270 con 0x7fa870102550 2024-09-19T06:54:38.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.925+0000 7fa86e7fc640 1 --2- 172.21.15.99:0/240137040 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa85806e530 0x7fa8580709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:38.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.925+0000 7fa86e7fc640 1 --2- 172.21.15.99:0/240137040 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa85806e530 0x7fa8580709e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa8640048a0 tx=0x7fa864035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:38.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:38.929+0000 7fa8577fe640 1 -- 172.21.15.99:0/240137040 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fa8600573e0 con 0x7fa870102550 2024-09-19T06:54:39.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.103+0000 7fa87534f640 1 -- 172.21.15.99:0/240137040 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa87004b720 con 0x7fa85806e530 2024-09-19T06:54:39.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.112+0000 7fa8577fe640 1 -- 172.21.15.99:0/240137040 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7fa87004b720 con 0x7fa85806e530 2024-09-19T06:54:39.113 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T06:54:39.113 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.smithi099 smithi099 *:9093,9094 running (13m) 6m ago 22m 23.4M - 0.25.0 c8568f914cd2 e7c1774d56b0 2024-09-19T06:54:39.114 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi099 smithi099 running (10m) 6m ago 22m 6899k - 19.1.1-361-g2f599a46 d2baa855c067 b9775f416b10 2024-09-19T06:54:39.114 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi117 smithi117 running (10m) 5m ago 21m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 38cf60c0d548 2024-09-19T06:54:39.114 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.smithi099 smithi099 *:3000 running (12m) 6m ago 21m 80.7M - 9.4.12 2bacad6d85d8 cd53a18d5410 2024-09-19T06:54:39.114 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.obarqf smithi099 running (6m) 6m ago 16m 12.2M - 19.1.1-361-g2f599a46 d2baa855c067 314a73082521 2024-09-19T06:54:39.114 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.xehbxe smithi099 running (6m) 6m ago 16m 14.4M - 19.1.1-361-g2f599a46 d2baa855c067 a2955a9d06e6 2024-09-19T06:54:39.114 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.bheqzh smithi117 running (5m) 5m ago 16m 11.8M - 19.1.1-361-g2f599a46 d2baa855c067 b1505937c0b7 2024-09-19T06:54:39.114 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.nooexo smithi117 running (6m) 5m ago 16m 13.1M - 19.1.1-361-g2f599a46 d2baa855c067 35bd7725855c 2024-09-19T06:54:39.114 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi099.pgvkqi smithi099 *:8443,9283,8765 running (13m) 6m ago 23m 505M - 19.1.1-361-g2f599a46 d2baa855c067 d5de99cb7e78 2024-09-19T06:54:39.114 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi117.ssmkcf smithi117 *:8443,9283,8765 running (12m) 5m ago 21m 444M - 19.1.1-361-g2f599a46 d2baa855c067 8b7ee0f871f5 2024-09-19T06:54:39.114 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi099 smithi099 running (11m) 6m ago 23m 52.4M 2048M 19.1.1-361-g2f599a46 d2baa855c067 ffe067438824 2024-09-19T06:54:39.114 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi117 smithi117 running (10m) 5m ago 21m 38.9M 2048M 19.1.1-361-g2f599a46 d2baa855c067 4cb7455e3ee7 2024-09-19T06:54:39.114 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi099 smithi099 *:9100 running (13m) 6m ago 22m 15.0M - 1.5.0 0da6a335fe13 dca7b4517dcc 2024-09-19T06:54:39.114 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi117 smithi117 *:9100 running (13m) 5m ago 21m 15.9M - 1.5.0 0da6a335fe13 8233ce3835d2 2024-09-19T06:54:39.115 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (9m) 6m ago 20m 100M 1557M 19.1.1-361-g2f599a46 d2baa855c067 8e22543bf933 2024-09-19T06:54:39.115 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (9m) 6m ago 19m 106M 1557M 19.1.1-361-g2f599a46 d2baa855c067 f54153d0ae09 2024-09-19T06:54:39.115 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (8m) 6m ago 19m 83.7M 1557M 19.1.1-361-g2f599a46 d2baa855c067 b1778ab88870 2024-09-19T06:54:39.115 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi117 running (8m) 5m ago 19m 102M 2581M 19.1.1-361-g2f599a46 d2baa855c067 ea5236b193d3 2024-09-19T06:54:39.115 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi117 running (7m) 5m ago 18m 93.5M 2581M 19.1.1-361-g2f599a46 d2baa855c067 27ac2c859a68 2024-09-19T06:54:39.115 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi117 running (6m) 5m ago 18m 100M 2581M 19.1.1-361-g2f599a46 d2baa855c067 de6aeb8544ce 2024-09-19T06:54:39.115 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.smithi099 smithi099 *:9095 running (12m) 6m ago 21m 64.4M - 2.43.0 a07b618ecd1d 15ad26ec6fb4 2024-09-19T06:54:39.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.114+0000 7fa87534f640 1 -- 172.21.15.99:0/240137040 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa85806e530 msgr2=0x7fa8580709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:39.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.114+0000 7fa87534f640 1 --2- 172.21.15.99:0/240137040 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa85806e530 0x7fa8580709e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa8640048a0 tx=0x7fa864035040 comp rx=0 tx=0).stop 2024-09-19T06:54:39.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.114+0000 7fa87534f640 1 -- 172.21.15.99:0/240137040 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa870102550 msgr2=0x7fa870113500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:39.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.114+0000 7fa87534f640 1 --2- 172.21.15.99:0/240137040 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa870102550 0x7fa870113500 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa86000c830 tx=0x7fa860004430 comp rx=0 tx=0).stop 2024-09-19T06:54:39.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.114+0000 7fa87534f640 1 -- 172.21.15.99:0/240137040 shutdown_connections 2024-09-19T06:54:39.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.114+0000 7fa87534f640 1 --2- 172.21.15.99:0/240137040 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa85806e530 0x7fa8580709e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:39.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.114+0000 7fa87534f640 1 --2- 172.21.15.99:0/240137040 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa870102ef0 0x7fa870113a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:39.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.114+0000 7fa87534f640 1 --2- 172.21.15.99:0/240137040 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa870102550 0x7fa870113500 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:39.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.114+0000 7fa87534f640 1 -- 172.21.15.99:0/240137040 >> 172.21.15.99:0/240137040 conn(0x7fa8700f80f0 msgr2=0x7fa8700f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:39.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.115+0000 7fa87534f640 1 -- 172.21.15.99:0/240137040 shutdown_connections 2024-09-19T06:54:39.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.115+0000 7fa87534f640 1 -- 172.21.15.99:0/240137040 wait complete. 2024-09-19T06:54:39.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.191+0000 7fece772d640 1 -- 172.21.15.99:0/1348254778 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fece00fb810 msgr2=0x7fece00fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:39.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.191+0000 7fece772d640 1 --2- 172.21.15.99:0/1348254778 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fece00fb810 0x7fece00fbbe0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fecd00048d0 tx=0x7fecd0009da0 comp rx=0 tx=0).stop 2024-09-19T06:54:39.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.191+0000 7fece772d640 1 -- 172.21.15.99:0/1348254778 shutdown_connections 2024-09-19T06:54:39.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.191+0000 7fece772d640 1 --2- 172.21.15.99:0/1348254778 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fece00fcf80 0x7fece00fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:39.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.191+0000 7fece772d640 1 --2- 172.21.15.99:0/1348254778 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fece00fb810 0x7fece00fbbe0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:39.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.191+0000 7fece772d640 1 -- 172.21.15.99:0/1348254778 >> 172.21.15.99:0/1348254778 conn(0x7fece00723b0 msgr2=0x7fece00727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:39.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.191+0000 7fece772d640 1 -- 172.21.15.99:0/1348254778 shutdown_connections 2024-09-19T06:54:39.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.191+0000 7fece772d640 1 -- 172.21.15.99:0/1348254778 wait complete. 2024-09-19T06:54:39.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.192+0000 7fece772d640 1 Processor -- start 2024-09-19T06:54:39.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.192+0000 7fece772d640 1 -- start start 2024-09-19T06:54:39.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.192+0000 7fece772d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fece00fb810 0x7fece010e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:39.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.192+0000 7fece772d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fece00fcf80 0x7fece010e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:39.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.192+0000 7fece772d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece010ed40 con 0x7fece00fb810 2024-09-19T06:54:39.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.192+0000 7fece772d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece010eeb0 con 0x7fece00fcf80 2024-09-19T06:54:39.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.192+0000 7fece54c9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fece00fb810 0x7fece010e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:39.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.192+0000 7fece54c9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fece00fb810 0x7fece010e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47286/0 (socket says 172.21.15.99:47286) 2024-09-19T06:54:39.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.192+0000 7fece54c9640 1 -- 172.21.15.99:0/3002291807 learned_addr learned my addr 172.21.15.99:0/3002291807 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:54:39.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.192+0000 7fece4cc8640 1 --2- 172.21.15.99:0/3002291807 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fece00fcf80 0x7fece010e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:39.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.192+0000 7fece54c9640 1 -- 172.21.15.99:0/3002291807 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fece00fcf80 msgr2=0x7fece010e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:39.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.192+0000 7fece54c9640 1 --2- 172.21.15.99:0/3002291807 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fece00fcf80 0x7fece010e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:39.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.192+0000 7fece54c9640 1 -- 172.21.15.99:0/3002291807 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd0005040 con 0x7fece00fb810 2024-09-19T06:54:39.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.192+0000 7fece4cc8640 1 --2- 172.21.15.99:0/3002291807 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fece00fcf80 0x7fece010e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:54:39.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.193+0000 7fece54c9640 1 --2- 172.21.15.99:0/3002291807 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fece00fb810 0x7fece010e1b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fecd0003080 tx=0x7fecd0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:39.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.193+0000 7fecd5ffb640 1 -- 172.21.15.99:0/3002291807 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fecd0038070 con 0x7fece00fb810 2024-09-19T06:54:39.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.193+0000 7fece772d640 1 -- 172.21.15.99:0/3002291807 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fece0117220 con 0x7fece00fb810 2024-09-19T06:54:39.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.193+0000 7fecd5ffb640 1 -- 172.21.15.99:0/3002291807 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fecd00097e0 con 0x7fece00fb810 2024-09-19T06:54:39.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.193+0000 7fecd5ffb640 1 -- 172.21.15.99:0/3002291807 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fecd003d420 con 0x7fece00fb810 2024-09-19T06:54:39.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.193+0000 7fece772d640 1 -- 172.21.15.99:0/3002291807 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fece0117680 con 0x7fece00fb810 2024-09-19T06:54:39.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.194+0000 7fece772d640 1 -- 172.21.15.99:0/3002291807 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fece00fcbc0 con 0x7fece00fb810 2024-09-19T06:54:39.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.195+0000 7fecd5ffb640 1 -- 172.21.15.99:0/3002291807 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fecd0030020 con 0x7fece00fb810 2024-09-19T06:54:39.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.195+0000 7fecd5ffb640 1 --2- 172.21.15.99:0/3002291807 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7feccc06e530 0x7feccc0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:39.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.195+0000 7fecd5ffb640 1 -- 172.21.15.99:0/3002291807 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fecd00ae640 con 0x7fece00fb810 2024-09-19T06:54:39.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.195+0000 7fece4cc8640 1 --2- 172.21.15.99:0/3002291807 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7feccc06e530 0x7feccc0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:39.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.196+0000 7fece4cc8640 1 --2- 172.21.15.99:0/3002291807 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7feccc06e530 0x7feccc0709e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fece0065980 tx=0x7fecdc009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:39.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.200+0000 7fecd5ffb640 1 -- 172.21.15.99:0/3002291807 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fecd00777b0 con 0x7fece00fb810 2024-09-19T06:54:39.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.430+0000 7fece772d640 1 -- 172.21.15.99:0/3002291807 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fece0065730 con 0x7fece00fb810 2024-09-19T06:54:39.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.431+0000 7fecd5ffb640 1 -- 172.21.15.99:0/3002291807 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7fecd007ae70 con 0x7fece00fb810 2024-09-19T06:54:39.432 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:54:39.432 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-09-19T06:54:39.432 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T06:54:39.432 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:54:39.432 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-09-19T06:54:39.433 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T06:54:39.433 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:54:39.433 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-09-19T06:54:39.433 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 6 2024-09-19T06:54:39.433 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:54:39.433 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": { 2024-09-19T06:54:39.433 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 4 2024-09-19T06:54:39.433 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:54:39.433 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-09-19T06:54:39.433 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 14 2024-09-19T06:54:39.433 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T06:54:39.433 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:54:39.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.433+0000 7fece772d640 1 -- 172.21.15.99:0/3002291807 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7feccc06e530 msgr2=0x7feccc0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:39.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.433+0000 7fece772d640 1 --2- 172.21.15.99:0/3002291807 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7feccc06e530 0x7feccc0709e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fece0065980 tx=0x7fecdc009040 comp rx=0 tx=0).stop 2024-09-19T06:54:39.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.433+0000 7fece772d640 1 -- 172.21.15.99:0/3002291807 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fece00fb810 msgr2=0x7fece010e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:39.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.433+0000 7fece772d640 1 --2- 172.21.15.99:0/3002291807 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fece00fb810 0x7fece010e1b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fecd0003080 tx=0x7fecd0009da0 comp rx=0 tx=0).stop 2024-09-19T06:54:39.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.433+0000 7fece772d640 1 -- 172.21.15.99:0/3002291807 shutdown_connections 2024-09-19T06:54:39.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.433+0000 7fece772d640 1 --2- 172.21.15.99:0/3002291807 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7feccc06e530 0x7feccc0709e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:39.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.433+0000 7fece772d640 1 --2- 172.21.15.99:0/3002291807 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fece00fcf80 0x7fece010e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:39.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.433+0000 7fece772d640 1 --2- 172.21.15.99:0/3002291807 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fece00fb810 0x7fece010e1b0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:39.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.433+0000 7fece772d640 1 -- 172.21.15.99:0/3002291807 >> 172.21.15.99:0/3002291807 conn(0x7fece00723b0 msgr2=0x7fece00fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:39.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.433+0000 7fece772d640 1 -- 172.21.15.99:0/3002291807 shutdown_connections 2024-09-19T06:54:39.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.433+0000 7fece772d640 1 -- 172.21.15.99:0/3002291807 wait complete. 2024-09-19T06:54:39.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.511+0000 7f0d9d072640 1 -- 172.21.15.99:0/286142673 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d980fb810 msgr2=0x7f0d980fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:39.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.511+0000 7f0d9d072640 1 --2- 172.21.15.99:0/286142673 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d980fb810 0x7f0d980fbbe0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f0d880048d0 tx=0x7f0d88009da0 comp rx=0 tx=0).stop 2024-09-19T06:54:39.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.512+0000 7f0d9d072640 1 -- 172.21.15.99:0/286142673 shutdown_connections 2024-09-19T06:54:39.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.512+0000 7f0d9d072640 1 --2- 172.21.15.99:0/286142673 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d980fcf80 0x7f0d980fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:39.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.512+0000 7f0d9d072640 1 --2- 172.21.15.99:0/286142673 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d980fb810 0x7f0d980fbbe0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:39.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.512+0000 7f0d9d072640 1 -- 172.21.15.99:0/286142673 >> 172.21.15.99:0/286142673 conn(0x7f0d980723b0 msgr2=0x7f0d980727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:39.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.512+0000 7f0d9d072640 1 -- 172.21.15.99:0/286142673 shutdown_connections 2024-09-19T06:54:39.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.512+0000 7f0d9d072640 1 -- 172.21.15.99:0/286142673 wait complete. 2024-09-19T06:54:39.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.512+0000 7f0d9d072640 1 Processor -- start 2024-09-19T06:54:39.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.512+0000 7f0d9d072640 1 -- start start 2024-09-19T06:54:39.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.512+0000 7f0d9d072640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d980fb810 0x7f0d9810e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:39.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.512+0000 7f0d9d072640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d980fcf80 0x7f0d9810e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:39.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.512+0000 7f0d9d072640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d9810ed40 con 0x7f0d980fcf80 2024-09-19T06:54:39.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.512+0000 7f0d9d072640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d9810eeb0 con 0x7f0d980fb810 2024-09-19T06:54:39.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.512+0000 7f0d8ffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d980fcf80 0x7f0d9810e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:39.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.513+0000 7f0d8ffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d980fcf80 0x7f0d9810e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47312/0 (socket says 172.21.15.99:47312) 2024-09-19T06:54:39.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.513+0000 7f0d8ffff640 1 -- 172.21.15.99:0/150022815 learned_addr learned my addr 172.21.15.99:0/150022815 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:54:39.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.513+0000 7f0d96d9d640 1 --2- 172.21.15.99:0/150022815 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d980fb810 0x7f0d9810e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:39.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.513+0000 7f0d8ffff640 1 -- 172.21.15.99:0/150022815 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d980fb810 msgr2=0x7f0d9810e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:39.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.513+0000 7f0d8ffff640 1 --2- 172.21.15.99:0/150022815 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d980fb810 0x7f0d9810e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:39.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.513+0000 7f0d8ffff640 1 -- 172.21.15.99:0/150022815 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d88005040 con 0x7f0d980fcf80 2024-09-19T06:54:39.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.513+0000 7f0d8ffff640 1 --2- 172.21.15.99:0/150022815 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d980fcf80 0x7f0d9810e6f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f0d80002a50 tx=0x7f0d80004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:39.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.513+0000 7f0d8f7fe640 1 -- 172.21.15.99:0/150022815 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d80007c30 con 0x7f0d980fcf80 2024-09-19T06:54:39.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.513+0000 7f0d8f7fe640 1 -- 172.21.15.99:0/150022815 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0d8000f040 con 0x7f0d980fcf80 2024-09-19T06:54:39.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.513+0000 7f0d9d072640 1 -- 172.21.15.99:0/150022815 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d98117220 con 0x7f0d980fcf80 2024-09-19T06:54:39.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.513+0000 7f0d8f7fe640 1 -- 172.21.15.99:0/150022815 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d8000da10 con 0x7f0d980fcf80 2024-09-19T06:54:39.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.513+0000 7f0d9d072640 1 -- 172.21.15.99:0/150022815 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d98117730 con 0x7f0d980fcf80 2024-09-19T06:54:39.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.514+0000 7f0d9d072640 1 -- 172.21.15.99:0/150022815 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d980fcbc0 con 0x7f0d980fcf80 2024-09-19T06:54:39.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.515+0000 7f0d8f7fe640 1 -- 172.21.15.99:0/150022815 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f0d8000dbb0 con 0x7f0d980fcf80 2024-09-19T06:54:39.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.515+0000 7f0d8f7fe640 1 --2- 172.21.15.99:0/150022815 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f0d8406e530 0x7f0d840709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:39.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.515+0000 7f0d8f7fe640 1 -- 172.21.15.99:0/150022815 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f0d8008d810 con 0x7f0d980fcf80 2024-09-19T06:54:39.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.515+0000 7f0d96d9d640 1 --2- 172.21.15.99:0/150022815 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f0d8406e530 0x7f0d840709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:39.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.516+0000 7f0d96d9d640 1 --2- 172.21.15.99:0/150022815 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f0d8406e530 0x7f0d840709e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0d88009ac0 tx=0x7f0d88035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:39.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.520+0000 7f0d8f7fe640 1 -- 172.21.15.99:0/150022815 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f0d80056a30 con 0x7f0d980fcf80 2024-09-19T06:54:39.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.718+0000 7f0d9d072640 1 -- 172.21.15.99:0/150022815 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0d9804b720 con 0x7f0d980fcf80 2024-09-19T06:54:39.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.718+0000 7f0d8f7fe640 1 -- 172.21.15.99:0/150022815 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 29 v29) v1 ==== 76+0+1915 (secure 0 0 0) 0x7f0d8005a0f0 con 0x7f0d980fcf80 2024-09-19T06:54:39.720 INFO:teuthology.orchestra.run.smithi099.stdout:e29 2024-09-19T06:54:39.720 INFO:teuthology.orchestra.run.smithi099.stdout:btime 2024-09-19T06:48:47:938420+0000 2024-09-19T06:54:39.720 INFO:teuthology.orchestra.run.smithi099.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T06:54:39.720 INFO:teuthology.orchestra.run.smithi099.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T06:54:39.720 INFO:teuthology.orchestra.run.smithi099.stdout:legacy client fscid: 1 2024-09-19T06:54:39.720 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:54:39.720 INFO:teuthology.orchestra.run.smithi099.stdout:Filesystem 'cephfs' (1) 2024-09-19T06:54:39.721 INFO:teuthology.orchestra.run.smithi099.stdout:fs_name cephfs 2024-09-19T06:54:39.721 INFO:teuthology.orchestra.run.smithi099.stdout:epoch 20 2024-09-19T06:54:39.721 INFO:teuthology.orchestra.run.smithi099.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-19T06:54:39.721 INFO:teuthology.orchestra.run.smithi099.stdout:created 2024-09-19T06:37:40.838146+0000 2024-09-19T06:54:39.721 INFO:teuthology.orchestra.run.smithi099.stdout:modified 2024-09-19T06:47:50.076553+0000 2024-09-19T06:54:39.721 INFO:teuthology.orchestra.run.smithi099.stdout:tableserver 0 2024-09-19T06:54:39.721 INFO:teuthology.orchestra.run.smithi099.stdout:root 0 2024-09-19T06:54:39.721 INFO:teuthology.orchestra.run.smithi099.stdout:session_timeout 60 2024-09-19T06:54:39.721 INFO:teuthology.orchestra.run.smithi099.stdout:session_autoclose 300 2024-09-19T06:54:39.721 INFO:teuthology.orchestra.run.smithi099.stdout:max_file_size 1099511627776 2024-09-19T06:54:39.721 INFO:teuthology.orchestra.run.smithi099.stdout:max_xattr_size 65536 2024-09-19T06:54:39.721 INFO:teuthology.orchestra.run.smithi099.stdout:required_client_features {} 2024-09-19T06:54:39.722 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure 0 2024-09-19T06:54:39.722 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure_osd_epoch 77 2024-09-19T06:54:39.722 INFO:teuthology.orchestra.run.smithi099.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T06:54:39.722 INFO:teuthology.orchestra.run.smithi099.stdout:max_mds 2 2024-09-19T06:54:39.722 INFO:teuthology.orchestra.run.smithi099.stdout:in 0,1 2024-09-19T06:54:39.722 INFO:teuthology.orchestra.run.smithi099.stdout:up {} 2024-09-19T06:54:39.722 INFO:teuthology.orchestra.run.smithi099.stdout:failed 0,1 2024-09-19T06:54:39.722 INFO:teuthology.orchestra.run.smithi099.stdout:damaged 2024-09-19T06:54:39.722 INFO:teuthology.orchestra.run.smithi099.stdout:stopped 2024-09-19T06:54:39.722 INFO:teuthology.orchestra.run.smithi099.stdout:data_pools [3] 2024-09-19T06:54:39.722 INFO:teuthology.orchestra.run.smithi099.stdout:metadata_pool 2 2024-09-19T06:54:39.722 INFO:teuthology.orchestra.run.smithi099.stdout:inline_data disabled 2024-09-19T06:54:39.722 INFO:teuthology.orchestra.run.smithi099.stdout:balancer 2024-09-19T06:54:39.723 INFO:teuthology.orchestra.run.smithi099.stdout:bal_rank_mask -1 2024-09-19T06:54:39.723 INFO:teuthology.orchestra.run.smithi099.stdout:standby_count_wanted 1 2024-09-19T06:54:39.723 INFO:teuthology.orchestra.run.smithi099.stdout:qdb_cluster leader: 0 members: 2024-09-19T06:54:39.723 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:54:39.723 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:54:39.723 INFO:teuthology.orchestra.run.smithi099.stdout:Standby daemons: 2024-09-19T06:54:39.723 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:54:39.723 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.obarqf{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6826/1859154203,v1:172.21.15.99:6827/1859154203] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:54:39.723 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.xehbxe{-1:34410} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6828/1939453719,v1:172.21.15.99:6829/1939453719] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:54:39.723 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.nooexo{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6824/1398895079,v1:172.21.15.117:6825/1398895079] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:54:39.723 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.bheqzh{-1:44329} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6826/3233337308,v1:172.21.15.117:6827/3233337308] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:54:39.724 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 29 2024-09-19T06:54:39.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.720+0000 7f0d9d072640 1 -- 172.21.15.99:0/150022815 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f0d8406e530 msgr2=0x7f0d840709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:39.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.720+0000 7f0d9d072640 1 --2- 172.21.15.99:0/150022815 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f0d8406e530 0x7f0d840709e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0d88009ac0 tx=0x7f0d88035040 comp rx=0 tx=0).stop 2024-09-19T06:54:39.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.720+0000 7f0d9d072640 1 -- 172.21.15.99:0/150022815 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d980fcf80 msgr2=0x7f0d9810e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:39.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.720+0000 7f0d9d072640 1 --2- 172.21.15.99:0/150022815 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d980fcf80 0x7f0d9810e6f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f0d80002a50 tx=0x7f0d80004600 comp rx=0 tx=0).stop 2024-09-19T06:54:39.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.720+0000 7f0d9d072640 1 -- 172.21.15.99:0/150022815 shutdown_connections 2024-09-19T06:54:39.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.721+0000 7f0d9d072640 1 --2- 172.21.15.99:0/150022815 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f0d8406e530 0x7f0d840709e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:39.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.721+0000 7f0d9d072640 1 --2- 172.21.15.99:0/150022815 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d980fcf80 0x7f0d9810e6f0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:39.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.721+0000 7f0d9d072640 1 --2- 172.21.15.99:0/150022815 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0d980fb810 0x7f0d9810e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:39.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.721+0000 7f0d9d072640 1 -- 172.21.15.99:0/150022815 >> 172.21.15.99:0/150022815 conn(0x7f0d980723b0 msgr2=0x7f0d980fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:39.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.721+0000 7f0d9d072640 1 -- 172.21.15.99:0/150022815 shutdown_connections 2024-09-19T06:54:39.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.721+0000 7f0d9d072640 1 -- 172.21.15.99:0/150022815 wait complete. 2024-09-19T06:54:39.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.798+0000 7fc6695d6640 1 -- 172.21.15.99:0/3371776709 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc664102680 msgr2=0x7fc664102a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:39.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.798+0000 7fc6695d6640 1 --2- 172.21.15.99:0/3371776709 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc664102680 0x7fc664102a50 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc6540048d0 tx=0x7fc654009da0 comp rx=0 tx=0).stop 2024-09-19T06:54:39.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.799+0000 7fc6695d6640 1 -- 172.21.15.99:0/3371776709 shutdown_connections 2024-09-19T06:54:39.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.799+0000 7fc6695d6640 1 --2- 172.21.15.99:0/3371776709 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6640fabd0 0x7fc6640fb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:39.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.799+0000 7fc6695d6640 1 --2- 172.21.15.99:0/3371776709 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc664102680 0x7fc664102a50 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:39.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.799+0000 7fc6695d6640 1 -- 172.21.15.99:0/3371776709 >> 172.21.15.99:0/3371776709 conn(0x7fc664071ac0 msgr2=0x7fc664071ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:39.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.799+0000 7fc6695d6640 1 -- 172.21.15.99:0/3371776709 shutdown_connections 2024-09-19T06:54:39.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.799+0000 7fc6695d6640 1 -- 172.21.15.99:0/3371776709 wait complete. 2024-09-19T06:54:39.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.799+0000 7fc6695d6640 1 Processor -- start 2024-09-19T06:54:39.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.799+0000 7fc6695d6640 1 -- start start 2024-09-19T06:54:39.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.799+0000 7fc6695d6640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6640fabd0 0x7fc664113290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:39.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.800+0000 7fc6695d6640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc664102680 0x7fc6641137d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:39.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.800+0000 7fc6695d6640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc664113dd0 con 0x7fc664102680 2024-09-19T06:54:39.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.800+0000 7fc6695d6640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc66410d210 con 0x7fc6640fabd0 2024-09-19T06:54:39.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.800+0000 7fc65a7fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc664102680 0x7fc6641137d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:39.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.800+0000 7fc65a7fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc664102680 0x7fc6641137d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47324/0 (socket says 172.21.15.99:47324) 2024-09-19T06:54:39.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.800+0000 7fc65a7fc640 1 -- 172.21.15.99:0/37796943 learned_addr learned my addr 172.21.15.99:0/37796943 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:54:39.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.800+0000 7fc662ffd640 1 --2- 172.21.15.99:0/37796943 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6640fabd0 0x7fc664113290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:39.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.800+0000 7fc65a7fc640 1 -- 172.21.15.99:0/37796943 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6640fabd0 msgr2=0x7fc664113290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:39.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.800+0000 7fc65a7fc640 1 --2- 172.21.15.99:0/37796943 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6640fabd0 0x7fc664113290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:39.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.800+0000 7fc65a7fc640 1 -- 172.21.15.99:0/37796943 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc654005040 con 0x7fc664102680 2024-09-19T06:54:39.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.800+0000 7fc65a7fc640 1 --2- 172.21.15.99:0/37796943 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc664102680 0x7fc6641137d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc64c002a50 tx=0x7fc64c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:39.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.800+0000 7fc65bfff640 1 -- 172.21.15.99:0/37796943 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc64c007c30 con 0x7fc664102680 2024-09-19T06:54:39.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.800+0000 7fc65bfff640 1 -- 172.21.15.99:0/37796943 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc64c00f040 con 0x7fc664102680 2024-09-19T06:54:39.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.800+0000 7fc65bfff640 1 -- 172.21.15.99:0/37796943 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc64c00dad0 con 0x7fc664102680 2024-09-19T06:54:39.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.800+0000 7fc6695d6640 1 -- 172.21.15.99:0/37796943 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc66410d490 con 0x7fc664102680 2024-09-19T06:54:39.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.800+0000 7fc6695d6640 1 -- 172.21.15.99:0/37796943 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc66410d9e0 con 0x7fc664102680 2024-09-19T06:54:39.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.801+0000 7fc6695d6640 1 -- 172.21.15.99:0/37796943 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6640725d0 con 0x7fc664102680 2024-09-19T06:54:39.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.802+0000 7fc65bfff640 1 -- 172.21.15.99:0/37796943 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fc64c00dc30 con 0x7fc664102680 2024-09-19T06:54:39.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.803+0000 7fc65bfff640 1 --2- 172.21.15.99:0/37796943 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fc65006e530 0x7fc6500709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:39.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.803+0000 7fc65bfff640 1 -- 172.21.15.99:0/37796943 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fc64c08e030 con 0x7fc664102680 2024-09-19T06:54:39.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.803+0000 7fc662ffd640 1 --2- 172.21.15.99:0/37796943 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fc65006e530 0x7fc6500709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:39.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.803+0000 7fc662ffd640 1 --2- 172.21.15.99:0/37796943 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fc65006e530 0x7fc6500709e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc654009ac0 tx=0x7fc654035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:39.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.807+0000 7fc65bfff640 1 -- 172.21.15.99:0/37796943 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fc64c057120 con 0x7fc664102680 2024-09-19T06:54:39.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.989+0000 7fc6695d6640 1 -- 172.21.15.99:0/37796943 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc66404b720 con 0x7fc65006e530 2024-09-19T06:54:39.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.990+0000 7fc65bfff640 1 -- 172.21.15.99:0/37796943 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fc66404b720 con 0x7fc65006e530 2024-09-19T06:54:39.991 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:54:39.992 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T06:54:39.992 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": true, 2024-09-19T06:54:39.992 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T06:54:39.992 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [ 2024-09-19T06:54:39.992 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr", 2024-09-19T06:54:39.992 INFO:teuthology.orchestra.run.smithi099.stdout: "crash", 2024-09-19T06:54:39.992 INFO:teuthology.orchestra.run.smithi099.stdout: "mds", 2024-09-19T06:54:39.992 INFO:teuthology.orchestra.run.smithi099.stdout: "mon", 2024-09-19T06:54:39.992 INFO:teuthology.orchestra.run.smithi099.stdout: "osd" 2024-09-19T06:54:39.992 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-19T06:54:39.992 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": "16/21 daemons upgraded", 2024-09-19T06:54:39.993 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "Currently upgrading mds daemons", 2024-09-19T06:54:39.993 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-09-19T06:54:39.993 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:54:39.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.993+0000 7fc6695d6640 1 -- 172.21.15.99:0/37796943 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fc65006e530 msgr2=0x7fc6500709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:39.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.993+0000 7fc6695d6640 1 --2- 172.21.15.99:0/37796943 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fc65006e530 0x7fc6500709e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc654009ac0 tx=0x7fc654035040 comp rx=0 tx=0).stop 2024-09-19T06:54:39.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.993+0000 7fc6695d6640 1 -- 172.21.15.99:0/37796943 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc664102680 msgr2=0x7fc6641137d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:39.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.993+0000 7fc6695d6640 1 --2- 172.21.15.99:0/37796943 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc664102680 0x7fc6641137d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc64c002a50 tx=0x7fc64c004600 comp rx=0 tx=0).stop 2024-09-19T06:54:39.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.993+0000 7fc6695d6640 1 -- 172.21.15.99:0/37796943 shutdown_connections 2024-09-19T06:54:39.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.993+0000 7fc6695d6640 1 --2- 172.21.15.99:0/37796943 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fc65006e530 0x7fc6500709e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:39.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.993+0000 7fc6695d6640 1 --2- 172.21.15.99:0/37796943 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc664102680 0x7fc6641137d0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:39.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.993+0000 7fc6695d6640 1 --2- 172.21.15.99:0/37796943 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc6640fabd0 0x7fc664113290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:39.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.993+0000 7fc6695d6640 1 -- 172.21.15.99:0/37796943 >> 172.21.15.99:0/37796943 conn(0x7fc664071ac0 msgr2=0x7fc664105350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:39.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.993+0000 7fc6695d6640 1 -- 172.21.15.99:0/37796943 shutdown_connections 2024-09-19T06:54:39.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:39.993+0000 7fc6695d6640 1 -- 172.21.15.99:0/37796943 wait complete. 2024-09-19T06:54:40.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:40.077+0000 7fd1af8d7640 1 -- 172.21.15.99:0/3336083879 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd1a81014b0 msgr2=0x7fd1a8101880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:40.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:40.077+0000 7fd1af8d7640 1 --2- 172.21.15.99:0/3336083879 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd1a81014b0 0x7fd1a8101880 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd1980048d0 tx=0x7fd198009da0 comp rx=0 tx=0).stop 2024-09-19T06:54:40.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:40.077+0000 7fd1af8d7640 1 -- 172.21.15.99:0/3336083879 shutdown_connections 2024-09-19T06:54:40.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:40.077+0000 7fd1af8d7640 1 --2- 172.21.15.99:0/3336083879 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd1a80fb470 0x7fd1a80fb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:40.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:40.077+0000 7fd1af8d7640 1 --2- 172.21.15.99:0/3336083879 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd1a81014b0 0x7fd1a8101880 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:40.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:40.077+0000 7fd1af8d7640 1 -- 172.21.15.99:0/3336083879 >> 172.21.15.99:0/3336083879 conn(0x7fd1a80f6ff0 msgr2=0x7fd1a80f9400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:40.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:40.077+0000 7fd1af8d7640 1 -- 172.21.15.99:0/3336083879 shutdown_connections 2024-09-19T06:54:40.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:40.077+0000 7fd1af8d7640 1 -- 172.21.15.99:0/3336083879 wait complete. 2024-09-19T06:54:40.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:40.078+0000 7fd1af8d7640 1 Processor -- start 2024-09-19T06:54:40.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:40.078+0000 7fd1af8d7640 1 -- start start 2024-09-19T06:54:40.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:40.078+0000 7fd1af8d7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd1a80fb470 0x7fd1a81131c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:40.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:40.078+0000 7fd1af8d7640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd1a81014b0 0x7fd1a8113700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:40.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:40.078+0000 7fd1af8d7640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a8113d00 con 0x7fd1a81014b0 2024-09-19T06:54:40.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:40.078+0000 7fd1af8d7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a810d140 con 0x7fd1a80fb470 2024-09-19T06:54:40.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:40.078+0000 7fd1ace72640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd1a81014b0 0x7fd1a8113700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:40.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:40.078+0000 7fd1ace72640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd1a81014b0 0x7fd1a8113700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47336/0 (socket says 172.21.15.99:47336) 2024-09-19T06:54:40.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:40.078+0000 7fd1ace72640 1 -- 172.21.15.99:0/4283446646 learned_addr learned my addr 172.21.15.99:0/4283446646 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:54:40.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:40.078+0000 7fd1ad673640 1 --2- 172.21.15.99:0/4283446646 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd1a80fb470 0x7fd1a81131c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:40.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:40.078+0000 7fd1ace72640 1 -- 172.21.15.99:0/4283446646 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd1a80fb470 msgr2=0x7fd1a81131c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:40.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:40.078+0000 7fd1ace72640 1 --2- 172.21.15.99:0/4283446646 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd1a80fb470 0x7fd1a81131c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:40.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:40.078+0000 7fd1ace72640 1 -- 172.21.15.99:0/4283446646 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd198005040 con 0x7fd1a81014b0 2024-09-19T06:54:40.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:40.079+0000 7fd1ace72640 1 --2- 172.21.15.99:0/4283446646 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd1a81014b0 0x7fd1a8113700 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd1a4002a50 tx=0x7fd1a4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:40.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:40.079+0000 7fd19dffb640 1 -- 172.21.15.99:0/4283446646 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1a4007c30 con 0x7fd1a81014b0 2024-09-19T06:54:40.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:40.079+0000 7fd19dffb640 1 -- 172.21.15.99:0/4283446646 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd1a400f040 con 0x7fd1a81014b0 2024-09-19T06:54:40.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:40.079+0000 7fd1af8d7640 1 -- 172.21.15.99:0/4283446646 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1a810d420 con 0x7fd1a81014b0 2024-09-19T06:54:40.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:40.079+0000 7fd19dffb640 1 -- 172.21.15.99:0/4283446646 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1a400da90 con 0x7fd1a81014b0 2024-09-19T06:54:40.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:40.079+0000 7fd1af8d7640 1 -- 172.21.15.99:0/4283446646 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1a810d9c0 con 0x7fd1a81014b0 2024-09-19T06:54:40.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:40.080+0000 7fd1af8d7640 1 -- 172.21.15.99:0/4283446646 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1a80fcbb0 con 0x7fd1a81014b0 2024-09-19T06:54:40.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:40.081+0000 7fd19dffb640 1 -- 172.21.15.99:0/4283446646 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fd1a400dc30 con 0x7fd1a81014b0 2024-09-19T06:54:40.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:40.081+0000 7fd19dffb640 1 --2- 172.21.15.99:0/4283446646 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd19406e530 0x7fd1940709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:54:40.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:40.081+0000 7fd19dffb640 1 -- 172.21.15.99:0/4283446646 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fd1a408d9c0 con 0x7fd1a81014b0 2024-09-19T06:54:40.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:40.081+0000 7fd1ad673640 1 --2- 172.21.15.99:0/4283446646 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd19406e530 0x7fd1940709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:54:40.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:40.082+0000 7fd1ad673640 1 --2- 172.21.15.99:0/4283446646 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd19406e530 0x7fd1940709e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd198009ac0 tx=0x7fd198035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:54:40.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:40.086+0000 7fd19dffb640 1 -- 172.21.15.99:0/4283446646 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fd1a4056b30 con 0x7fd1a81014b0 2024-09-19T06:54:40.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:40.319+0000 7fd1af8d7640 1 -- 172.21.15.99:0/4283446646 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fd1a80fac30 con 0x7fd1a81014b0 2024-09-19T06:54:40.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:40.319+0000 7fd19dffb640 1 -- 172.21.15.99:0/4283446646 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7fd1a405a1f0 con 0x7fd1a81014b0 2024-09-19T06:54:40.321 INFO:teuthology.orchestra.run.smithi099.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-09-19T06:54:40.321 INFO:teuthology.orchestra.run.smithi099.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-19T06:54:40.321 INFO:teuthology.orchestra.run.smithi099.stdout: fs cephfs is degraded 2024-09-19T06:54:40.321 INFO:teuthology.orchestra.run.smithi099.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-19T06:54:40.321 INFO:teuthology.orchestra.run.smithi099.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-19T06:54:40.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:40.322+0000 7fd1af8d7640 1 -- 172.21.15.99:0/4283446646 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd19406e530 msgr2=0x7fd1940709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:40.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:40.322+0000 7fd1af8d7640 1 --2- 172.21.15.99:0/4283446646 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd19406e530 0x7fd1940709e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd198009ac0 tx=0x7fd198035040 comp rx=0 tx=0).stop 2024-09-19T06:54:40.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:40.322+0000 7fd1af8d7640 1 -- 172.21.15.99:0/4283446646 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd1a81014b0 msgr2=0x7fd1a8113700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:54:40.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:40.322+0000 7fd1af8d7640 1 --2- 172.21.15.99:0/4283446646 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd1a81014b0 0x7fd1a8113700 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd1a4002a50 tx=0x7fd1a4004600 comp rx=0 tx=0).stop 2024-09-19T06:54:40.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:40.322+0000 7fd1af8d7640 1 -- 172.21.15.99:0/4283446646 shutdown_connections 2024-09-19T06:54:40.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:40.322+0000 7fd1af8d7640 1 --2- 172.21.15.99:0/4283446646 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd19406e530 0x7fd1940709e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:40.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:40.322+0000 7fd1af8d7640 1 --2- 172.21.15.99:0/4283446646 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd1a81014b0 0x7fd1a8113700 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:40.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:40.322+0000 7fd1af8d7640 1 --2- 172.21.15.99:0/4283446646 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd1a80fb470 0x7fd1a81131c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:54:40.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:40.322+0000 7fd1af8d7640 1 -- 172.21.15.99:0/4283446646 >> 172.21.15.99:0/4283446646 conn(0x7fd1a80f6ff0 msgr2=0x7fd1a8065ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:54:40.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:40.322+0000 7fd1af8d7640 1 -- 172.21.15.99:0/4283446646 shutdown_connections 2024-09-19T06:54:40.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:54:40.322+0000 7fd1af8d7640 1 -- 172.21.15.99:0/4283446646 wait complete. 2024-09-19T06:54:40.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:54:40 smithi099 ceph-mon[97031]: from='client.34726 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:54:40.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:54:40 smithi099 ceph-mon[97031]: from='client.34730 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:54:40.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:54:40 smithi099 ceph-mon[97031]: pgmap v369: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:54:40.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:54:40 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/3002291807' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:54:40.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:54:40 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/150022815' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:54:40.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:54:40 smithi117 ceph-mon[76771]: from='client.34726 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:54:40.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:54:40 smithi117 ceph-mon[76771]: from='client.34730 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:54:40.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:54:40 smithi117 ceph-mon[76771]: pgmap v369: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:54:40.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:54:40 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/3002291807' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:54:40.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:54:40 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/150022815' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:54:41.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:54:41 smithi099 ceph-mon[97031]: from='client.34734 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:54:41.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:54:41 smithi099 ceph-mon[97031]: from='client.34746 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:54:41.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:54:41 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/4283446646' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T06:54:41.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:54:41 smithi117 ceph-mon[76771]: from='client.34734 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:54:41.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:54:41 smithi117 ceph-mon[76771]: from='client.34746 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:54:41.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:54:41 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/4283446646' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T06:54:42.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:54:42 smithi099 ceph-mon[97031]: pgmap v370: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:54:42.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:54:42 smithi117 ceph-mon[76771]: pgmap v370: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:54:43.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:54:43 smithi099 ceph-mon[97031]: pgmap v371: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:54:43.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:54:43 smithi117 ceph-mon[76771]: pgmap v371: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:54:46.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:54:46 smithi117 ceph-mon[76771]: pgmap v372: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:54:46.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:54:46 smithi099 ceph-mon[97031]: pgmap v372: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:54:48.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:54:48 smithi117 ceph-mon[76771]: pgmap v373: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:54:48.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:54:48 smithi099 ceph-mon[97031]: pgmap v373: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:54:50.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:54:50 smithi117 ceph-mon[76771]: pgmap v374: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:54:50.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:54:50 smithi099 ceph-mon[97031]: pgmap v374: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:54:52.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:54:52 smithi117 ceph-mon[76771]: pgmap v375: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:54:52.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:54:52 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:54:52.314 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:54:52 smithi099 ceph-mon[97031]: pgmap v375: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:54:52.315 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:54:52 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:54:54.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:54:54 smithi117 ceph-mon[76771]: pgmap v376: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:54:54.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:54:54 smithi099 ceph-mon[97031]: pgmap v376: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:54:56.313 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:54:56 smithi117 ceph-mon[76771]: pgmap v377: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:54:56.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:54:56 smithi099 ceph-mon[97031]: pgmap v377: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:54:58.314 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:54:58 smithi117 ceph-mon[76771]: pgmap v378: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:54:58.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:54:58 smithi099 ceph-mon[97031]: pgmap v378: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:55:00.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:55:00 smithi117 ceph-mon[76771]: pgmap v379: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:55:00.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:55:00 smithi099 ceph-mon[97031]: pgmap v379: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:55:02.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:55:02 smithi117 ceph-mon[76771]: pgmap v380: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:55:02.314 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:55:02 smithi099 ceph-mon[97031]: pgmap v380: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:55:04.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:55:04 smithi117 ceph-mon[76771]: pgmap v381: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:55:04.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:55:04 smithi099 ceph-mon[97031]: pgmap v381: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:55:06.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:55:06 smithi117 ceph-mon[76771]: pgmap v382: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:55:06.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:55:06 smithi099 ceph-mon[97031]: pgmap v382: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:55:07.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:55:07 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:55:07.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:55:07 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:55:08.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:55:08 smithi099 ceph-mon[97031]: pgmap v383: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:55:08.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:55:08 smithi117 ceph-mon[76771]: pgmap v383: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:55:10.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.412+0000 7fa49b927640 1 -- 172.21.15.99:0/3907633024 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa4940716e0 msgr2=0x7fa49406fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:10.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.412+0000 7fa49b927640 1 --2- 172.21.15.99:0/3907633024 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa4940716e0 0x7fa49406fab0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa48c009c50 tx=0x7fa48c004d10 comp rx=0 tx=0).stop 2024-09-19T06:55:10.414 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:55:10 smithi099 ceph-mon[97031]: pgmap v384: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:55:10.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.412+0000 7fa49b927640 1 -- 172.21.15.99:0/3907633024 shutdown_connections 2024-09-19T06:55:10.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.412+0000 7fa49b927640 1 --2- 172.21.15.99:0/3907633024 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa49406fff0 0x7fa494070460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:10.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.412+0000 7fa49b927640 1 --2- 172.21.15.99:0/3907633024 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa4940716e0 0x7fa49406fab0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:10.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.412+0000 7fa49b927640 1 -- 172.21.15.99:0/3907633024 >> 172.21.15.99:0/3907633024 conn(0x7fa4940f8120 msgr2=0x7fa4940fa530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:10.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.412+0000 7fa49b927640 1 -- 172.21.15.99:0/3907633024 shutdown_connections 2024-09-19T06:55:10.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.412+0000 7fa49b927640 1 -- 172.21.15.99:0/3907633024 wait complete. 2024-09-19T06:55:10.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.413+0000 7fa49b927640 1 Processor -- start 2024-09-19T06:55:10.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.413+0000 7fa49b927640 1 -- start start 2024-09-19T06:55:10.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.413+0000 7fa49b927640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa49406fff0 0x7fa494119860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:10.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.413+0000 7fa49b927640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4940716e0 0x7fa494119da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:10.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.413+0000 7fa49b927640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa49411a3f0 con 0x7fa49406fff0 2024-09-19T06:55:10.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.413+0000 7fa49b927640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa494113800 con 0x7fa4940716e0 2024-09-19T06:55:10.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.413+0000 7fa4996c3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa49406fff0 0x7fa494119860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:10.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.413+0000 7fa4996c3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa49406fff0 0x7fa494119860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59972/0 (socket says 172.21.15.99:59972) 2024-09-19T06:55:10.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.413+0000 7fa4996c3640 1 -- 172.21.15.99:0/3978548563 learned_addr learned my addr 172.21.15.99:0/3978548563 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:55:10.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.413+0000 7fa498ec2640 1 --2- 172.21.15.99:0/3978548563 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4940716e0 0x7fa494119da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:10.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.414+0000 7fa4996c3640 1 -- 172.21.15.99:0/3978548563 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4940716e0 msgr2=0x7fa494119da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:10.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.414+0000 7fa4996c3640 1 --2- 172.21.15.99:0/3978548563 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4940716e0 0x7fa494119da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:10.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.414+0000 7fa4996c3640 1 -- 172.21.15.99:0/3978548563 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa48c0098b0 con 0x7fa49406fff0 2024-09-19T06:55:10.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.414+0000 7fa498ec2640 1 --2- 172.21.15.99:0/3978548563 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4940716e0 0x7fa494119da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:55:10.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.414+0000 7fa4996c3640 1 --2- 172.21.15.99:0/3978548563 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa49406fff0 0x7fa494119860 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fa48c004a30 tx=0x7fa48c004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:10.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.414+0000 7fa491ffb640 1 -- 172.21.15.99:0/3978548563 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa48c008f00 con 0x7fa49406fff0 2024-09-19T06:55:10.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.414+0000 7fa491ffb640 1 -- 172.21.15.99:0/3978548563 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa48c032d20 con 0x7fa49406fff0 2024-09-19T06:55:10.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.414+0000 7fa49b927640 1 -- 172.21.15.99:0/3978548563 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa494113a80 con 0x7fa49406fff0 2024-09-19T06:55:10.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.414+0000 7fa491ffb640 1 -- 172.21.15.99:0/3978548563 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa48c03dd20 con 0x7fa49406fff0 2024-09-19T06:55:10.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.415+0000 7fa49b927640 1 -- 172.21.15.99:0/3978548563 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa494113fa0 con 0x7fa49406fff0 2024-09-19T06:55:10.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.416+0000 7fa49b927640 1 -- 172.21.15.99:0/3978548563 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4940711f0 con 0x7fa49406fff0 2024-09-19T06:55:10.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.416+0000 7fa491ffb640 1 -- 172.21.15.99:0/3978548563 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fa48c02f030 con 0x7fa49406fff0 2024-09-19T06:55:10.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.417+0000 7fa491ffb640 1 --2- 172.21.15.99:0/3978548563 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa47c06e530 0x7fa47c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:10.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.417+0000 7fa491ffb640 1 -- 172.21.15.99:0/3978548563 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fa48c0af8f0 con 0x7fa49406fff0 2024-09-19T06:55:10.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.417+0000 7fa498ec2640 1 --2- 172.21.15.99:0/3978548563 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa47c06e530 0x7fa47c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:10.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.417+0000 7fa498ec2640 1 --2- 172.21.15.99:0/3978548563 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa47c06e530 0x7fa47c0709e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa488004fd0 tx=0x7fa48800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:10.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.421+0000 7fa491ffb640 1 -- 172.21.15.99:0/3978548563 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fa48c078a60 con 0x7fa49406fff0 2024-09-19T06:55:10.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:55:10 smithi117 ceph-mon[76771]: pgmap v384: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:55:10.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.605+0000 7fa49b927640 1 -- 172.21.15.99:0/3978548563 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa49410fb30 con 0x7fa47c06e530 2024-09-19T06:55:10.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.606+0000 7fa491ffb640 1 -- 172.21.15.99:0/3978548563 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fa49410fb30 con 0x7fa47c06e530 2024-09-19T06:55:10.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.608+0000 7fa49b927640 1 -- 172.21.15.99:0/3978548563 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa47c06e530 msgr2=0x7fa47c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:10.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.608+0000 7fa49b927640 1 --2- 172.21.15.99:0/3978548563 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa47c06e530 0x7fa47c0709e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa488004fd0 tx=0x7fa48800b040 comp rx=0 tx=0).stop 2024-09-19T06:55:10.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.608+0000 7fa49b927640 1 -- 172.21.15.99:0/3978548563 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa49406fff0 msgr2=0x7fa494119860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:10.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.608+0000 7fa49b927640 1 --2- 172.21.15.99:0/3978548563 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa49406fff0 0x7fa494119860 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fa48c004a30 tx=0x7fa48c004d10 comp rx=0 tx=0).stop 2024-09-19T06:55:10.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.609+0000 7fa49b927640 1 -- 172.21.15.99:0/3978548563 shutdown_connections 2024-09-19T06:55:10.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.609+0000 7fa49b927640 1 --2- 172.21.15.99:0/3978548563 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa47c06e530 0x7fa47c0709e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:10.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.609+0000 7fa49b927640 1 --2- 172.21.15.99:0/3978548563 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4940716e0 0x7fa494119da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:10.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.609+0000 7fa49b927640 1 --2- 172.21.15.99:0/3978548563 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa49406fff0 0x7fa494119860 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:10.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.609+0000 7fa49b927640 1 -- 172.21.15.99:0/3978548563 >> 172.21.15.99:0/3978548563 conn(0x7fa4940f8120 msgr2=0x7fa4940f93d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:10.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.609+0000 7fa49b927640 1 -- 172.21.15.99:0/3978548563 shutdown_connections 2024-09-19T06:55:10.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.609+0000 7fa49b927640 1 -- 172.21.15.99:0/3978548563 wait complete. 2024-09-19T06:55:10.618 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-09-19T06:55:10.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.688+0000 7fcbb8d74640 1 -- 172.21.15.99:0/465293065 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcbb40fb4a0 msgr2=0x7fcbb40fb910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:10.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.688+0000 7fcbb8d74640 1 --2- 172.21.15.99:0/465293065 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcbb40fb4a0 0x7fcbb40fb910 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c0048d0 tx=0x7fcb9c009da0 comp rx=0 tx=0).stop 2024-09-19T06:55:10.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.688+0000 7fcbb8d74640 1 -- 172.21.15.99:0/465293065 shutdown_connections 2024-09-19T06:55:10.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.688+0000 7fcbb8d74640 1 --2- 172.21.15.99:0/465293065 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcbb40fb4a0 0x7fcbb40fb910 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:10.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.688+0000 7fcbb8d74640 1 --2- 172.21.15.99:0/465293065 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcbb41014e0 0x7fcbb41018b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:10.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.688+0000 7fcbb8d74640 1 -- 172.21.15.99:0/465293065 >> 172.21.15.99:0/465293065 conn(0x7fcbb40f7060 msgr2=0x7fcbb40f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:10.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.688+0000 7fcbb8d74640 1 -- 172.21.15.99:0/465293065 shutdown_connections 2024-09-19T06:55:10.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.688+0000 7fcbb8d74640 1 -- 172.21.15.99:0/465293065 wait complete. 2024-09-19T06:55:10.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.689+0000 7fcbb8d74640 1 Processor -- start 2024-09-19T06:55:10.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.689+0000 7fcbb8d74640 1 -- start start 2024-09-19T06:55:10.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.689+0000 7fcbb8d74640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcbb40fb4a0 0x7fcbb410e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:10.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.689+0000 7fcbb8d74640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcbb41014e0 0x7fcbb410e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:10.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.689+0000 7fcbb8d74640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb410ed50 con 0x7fcbb41014e0 2024-09-19T06:55:10.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.689+0000 7fcbb8d74640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb410eec0 con 0x7fcbb40fb4a0 2024-09-19T06:55:10.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.689+0000 7fcbabfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcbb41014e0 0x7fcbb410e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:10.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.689+0000 7fcbabfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcbb41014e0 0x7fcbb410e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59996/0 (socket says 172.21.15.99:59996) 2024-09-19T06:55:10.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.689+0000 7fcbabfff640 1 -- 172.21.15.99:0/2062356776 learned_addr learned my addr 172.21.15.99:0/2062356776 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:55:10.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.689+0000 7fcbb259c640 1 --2- 172.21.15.99:0/2062356776 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcbb40fb4a0 0x7fcbb410e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:10.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.690+0000 7fcbabfff640 1 -- 172.21.15.99:0/2062356776 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcbb40fb4a0 msgr2=0x7fcbb410e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:10.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.690+0000 7fcbabfff640 1 --2- 172.21.15.99:0/2062356776 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcbb40fb4a0 0x7fcbb410e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:10.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.690+0000 7fcbabfff640 1 -- 172.21.15.99:0/2062356776 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb9c005040 con 0x7fcbb41014e0 2024-09-19T06:55:10.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.690+0000 7fcbabfff640 1 --2- 172.21.15.99:0/2062356776 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcbb41014e0 0x7fcbb410e810 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c000c00 tx=0x7fcb9c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:10.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.690+0000 7fcbaaffd640 1 -- 172.21.15.99:0/2062356776 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb9c038070 con 0x7fcbb41014e0 2024-09-19T06:55:10.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.690+0000 7fcbaaffd640 1 -- 172.21.15.99:0/2062356776 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fcb9c02ade0 con 0x7fcbb41014e0 2024-09-19T06:55:10.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.690+0000 7fcbb8d74640 1 -- 172.21.15.99:0/2062356776 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbb41171a0 con 0x7fcbb41014e0 2024-09-19T06:55:10.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.690+0000 7fcbaaffd640 1 -- 172.21.15.99:0/2062356776 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb9c02c7b0 con 0x7fcbb41014e0 2024-09-19T06:55:10.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.690+0000 7fcbb8d74640 1 -- 172.21.15.99:0/2062356776 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbb4117660 con 0x7fcbb41014e0 2024-09-19T06:55:10.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.691+0000 7fcbb8d74640 1 -- 172.21.15.99:0/2062356776 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbb40fcbe0 con 0x7fcbb41014e0 2024-09-19T06:55:10.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.692+0000 7fcbaaffd640 1 -- 172.21.15.99:0/2062356776 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fcb9c030020 con 0x7fcbb41014e0 2024-09-19T06:55:10.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.693+0000 7fcbaaffd640 1 --2- 172.21.15.99:0/2062356776 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fcba006e530 0x7fcba00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:10.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.693+0000 7fcbaaffd640 1 -- 172.21.15.99:0/2062356776 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fcb9c0ae4e0 con 0x7fcbb41014e0 2024-09-19T06:55:10.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.693+0000 7fcbb259c640 1 --2- 172.21.15.99:0/2062356776 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fcba006e530 0x7fcba00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:10.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.693+0000 7fcbb259c640 1 --2- 172.21.15.99:0/2062356776 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fcba006e530 0x7fcba00709e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fcba4009af0 tx=0x7fcba400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:10.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.698+0000 7fcbaaffd640 1 -- 172.21.15.99:0/2062356776 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fcb9c077650 con 0x7fcbb41014e0 2024-09-19T06:55:10.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.883+0000 7fcbb8d74640 1 -- 172.21.15.99:0/2062356776 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcbb41084f0 con 0x7fcba006e530 2024-09-19T06:55:10.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.884+0000 7fcbaaffd640 1 -- 172.21.15.99:0/2062356776 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fcbb41084f0 con 0x7fcba006e530 2024-09-19T06:55:10.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.886+0000 7fcbb8d74640 1 -- 172.21.15.99:0/2062356776 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fcba006e530 msgr2=0x7fcba00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:10.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.886+0000 7fcbb8d74640 1 --2- 172.21.15.99:0/2062356776 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fcba006e530 0x7fcba00709e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fcba4009af0 tx=0x7fcba400b040 comp rx=0 tx=0).stop 2024-09-19T06:55:10.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.886+0000 7fcbb8d74640 1 -- 172.21.15.99:0/2062356776 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcbb41014e0 msgr2=0x7fcbb410e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:10.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.886+0000 7fcbb8d74640 1 --2- 172.21.15.99:0/2062356776 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcbb41014e0 0x7fcbb410e810 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c000c00 tx=0x7fcb9c009da0 comp rx=0 tx=0).stop 2024-09-19T06:55:10.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.886+0000 7fcbb8d74640 1 -- 172.21.15.99:0/2062356776 shutdown_connections 2024-09-19T06:55:10.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.886+0000 7fcbb8d74640 1 --2- 172.21.15.99:0/2062356776 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fcba006e530 0x7fcba00709e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:10.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.886+0000 7fcbb8d74640 1 --2- 172.21.15.99:0/2062356776 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcbb41014e0 0x7fcbb410e810 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:10.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.886+0000 7fcbb8d74640 1 --2- 172.21.15.99:0/2062356776 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcbb40fb4a0 0x7fcbb410e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:10.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.886+0000 7fcbb8d74640 1 -- 172.21.15.99:0/2062356776 >> 172.21.15.99:0/2062356776 conn(0x7fcbb40f7060 msgr2=0x7fcbb40f8910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:10.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.886+0000 7fcbb8d74640 1 -- 172.21.15.99:0/2062356776 shutdown_connections 2024-09-19T06:55:10.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.886+0000 7fcbb8d74640 1 -- 172.21.15.99:0/2062356776 wait complete. 2024-09-19T06:55:10.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.965+0000 7f15a6156640 1 -- 172.21.15.99:0/109281830 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15a0102550 msgr2=0x7f15a0102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:10.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.965+0000 7f15a6156640 1 --2- 172.21.15.99:0/109281830 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15a0102550 0x7f15a0102920 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f15900048d0 tx=0x7f1590009da0 comp rx=0 tx=0).stop 2024-09-19T06:55:10.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.965+0000 7f15a6156640 1 -- 172.21.15.99:0/109281830 shutdown_connections 2024-09-19T06:55:10.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.965+0000 7f15a6156640 1 --2- 172.21.15.99:0/109281830 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15a0102ef0 0x7f15a00fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:10.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.965+0000 7f15a6156640 1 --2- 172.21.15.99:0/109281830 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15a0102550 0x7f15a0102920 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:10.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.965+0000 7f15a6156640 1 -- 172.21.15.99:0/109281830 >> 172.21.15.99:0/109281830 conn(0x7f15a00f80f0 msgr2=0x7f15a00fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:10.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.965+0000 7f15a6156640 1 -- 172.21.15.99:0/109281830 shutdown_connections 2024-09-19T06:55:10.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.965+0000 7f15a6156640 1 -- 172.21.15.99:0/109281830 wait complete. 2024-09-19T06:55:10.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.966+0000 7f15a6156640 1 Processor -- start 2024-09-19T06:55:10.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.966+0000 7f15a6156640 1 -- start start 2024-09-19T06:55:10.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.966+0000 7f15a6156640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15a0102550 0x7f15a0113570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:10.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.966+0000 7f15a6156640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15a0102ef0 0x7f15a0113ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:10.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.966+0000 7f15a6156640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a0114100 con 0x7f15a0102ef0 2024-09-19T06:55:10.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.966+0000 7f15a6156640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a010d510 con 0x7f15a0102550 2024-09-19T06:55:10.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.966+0000 7f159effd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15a0102ef0 0x7f15a0113ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:10.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.966+0000 7f159effd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15a0102ef0 0x7f15a0113ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60012/0 (socket says 172.21.15.99:60012) 2024-09-19T06:55:10.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.966+0000 7f159effd640 1 -- 172.21.15.99:0/3316452770 learned_addr learned my addr 172.21.15.99:0/3316452770 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:55:10.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.966+0000 7f159f7fe640 1 --2- 172.21.15.99:0/3316452770 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15a0102550 0x7f15a0113570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:10.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.967+0000 7f159effd640 1 -- 172.21.15.99:0/3316452770 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15a0102550 msgr2=0x7f15a0113570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:10.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.967+0000 7f159effd640 1 --2- 172.21.15.99:0/3316452770 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15a0102550 0x7f15a0113570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:10.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.967+0000 7f159effd640 1 -- 172.21.15.99:0/3316452770 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1590005040 con 0x7f15a0102ef0 2024-09-19T06:55:10.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.967+0000 7f159effd640 1 --2- 172.21.15.99:0/3316452770 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15a0102ef0 0x7f15a0113ab0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f1594002870 tx=0x7f1594004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:10.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.967+0000 7f1587fff640 1 -- 172.21.15.99:0/3316452770 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1594007c30 con 0x7f15a0102ef0 2024-09-19T06:55:10.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.967+0000 7f1587fff640 1 -- 172.21.15.99:0/3316452770 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f159400f040 con 0x7f15a0102ef0 2024-09-19T06:55:10.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.967+0000 7f15a6156640 1 -- 172.21.15.99:0/3316452770 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15a010d7f0 con 0x7f15a0102ef0 2024-09-19T06:55:10.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.967+0000 7f1587fff640 1 -- 172.21.15.99:0/3316452770 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f159400daf0 con 0x7f15a0102ef0 2024-09-19T06:55:10.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.967+0000 7f15a6156640 1 -- 172.21.15.99:0/3316452770 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15a010dd10 con 0x7f15a0102ef0 2024-09-19T06:55:10.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.968+0000 7f15a6156640 1 -- 172.21.15.99:0/3316452770 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15a00fdcd0 con 0x7f15a0102ef0 2024-09-19T06:55:10.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.968+0000 7f1587fff640 1 -- 172.21.15.99:0/3316452770 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f159400dc50 con 0x7f15a0102ef0 2024-09-19T06:55:10.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.969+0000 7f1587fff640 1 --2- 172.21.15.99:0/3316452770 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f158806e530 0x7f15880709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:10.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.969+0000 7f1587fff640 1 -- 172.21.15.99:0/3316452770 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f159408dfe0 con 0x7f15a0102ef0 2024-09-19T06:55:10.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.969+0000 7f159f7fe640 1 --2- 172.21.15.99:0/3316452770 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f158806e530 0x7f15880709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:10.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.969+0000 7f159f7fe640 1 --2- 172.21.15.99:0/3316452770 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f158806e530 0x7f15880709e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1590009ac0 tx=0x7f1590035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:10.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:10.973+0000 7f1587fff640 1 -- 172.21.15.99:0/3316452770 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f15940570d0 con 0x7f15a0102ef0 2024-09-19T06:55:11.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.148+0000 7f15a6156640 1 -- 172.21.15.99:0/3316452770 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f15a010ec80 con 0x7f158806e530 2024-09-19T06:55:11.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.156+0000 7f1587fff640 1 -- 172.21.15.99:0/3316452770 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f15a010ec80 con 0x7f158806e530 2024-09-19T06:55:11.157 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T06:55:11.157 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.smithi099 smithi099 *:9093,9094 running (14m) 6m ago 22m 23.4M - 0.25.0 c8568f914cd2 e7c1774d56b0 2024-09-19T06:55:11.157 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi099 smithi099 running (10m) 6m ago 22m 6899k - 19.1.1-361-g2f599a46 d2baa855c067 b9775f416b10 2024-09-19T06:55:11.158 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi117 smithi117 running (10m) 6m ago 21m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 38cf60c0d548 2024-09-19T06:55:11.158 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.smithi099 smithi099 *:3000 running (12m) 6m ago 22m 80.7M - 9.4.12 2bacad6d85d8 cd53a18d5410 2024-09-19T06:55:11.158 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.obarqf smithi099 running (7m) 6m ago 17m 12.2M - 19.1.1-361-g2f599a46 d2baa855c067 314a73082521 2024-09-19T06:55:11.158 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.xehbxe smithi099 running (6m) 6m ago 17m 14.4M - 19.1.1-361-g2f599a46 d2baa855c067 a2955a9d06e6 2024-09-19T06:55:11.158 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.bheqzh smithi117 running (6m) 6m ago 17m 11.8M - 19.1.1-361-g2f599a46 d2baa855c067 b1505937c0b7 2024-09-19T06:55:11.158 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.nooexo smithi117 running (6m) 6m ago 17m 13.1M - 19.1.1-361-g2f599a46 d2baa855c067 35bd7725855c 2024-09-19T06:55:11.158 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi099.pgvkqi smithi099 *:8443,9283,8765 running (13m) 6m ago 23m 505M - 19.1.1-361-g2f599a46 d2baa855c067 d5de99cb7e78 2024-09-19T06:55:11.158 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi117.ssmkcf smithi117 *:8443,9283,8765 running (12m) 6m ago 21m 444M - 19.1.1-361-g2f599a46 d2baa855c067 8b7ee0f871f5 2024-09-19T06:55:11.158 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi099 smithi099 running (11m) 6m ago 24m 52.4M 2048M 19.1.1-361-g2f599a46 d2baa855c067 ffe067438824 2024-09-19T06:55:11.158 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi117 smithi117 running (11m) 6m ago 21m 38.9M 2048M 19.1.1-361-g2f599a46 d2baa855c067 4cb7455e3ee7 2024-09-19T06:55:11.158 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi099 smithi099 *:9100 running (14m) 6m ago 22m 15.0M - 1.5.0 0da6a335fe13 dca7b4517dcc 2024-09-19T06:55:11.158 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi117 smithi117 *:9100 running (13m) 6m ago 21m 15.9M - 1.5.0 0da6a335fe13 8233ce3835d2 2024-09-19T06:55:11.158 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (10m) 6m ago 20m 100M 1557M 19.1.1-361-g2f599a46 d2baa855c067 8e22543bf933 2024-09-19T06:55:11.159 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (9m) 6m ago 20m 106M 1557M 19.1.1-361-g2f599a46 d2baa855c067 f54153d0ae09 2024-09-19T06:55:11.159 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (9m) 6m ago 20m 83.7M 1557M 19.1.1-361-g2f599a46 d2baa855c067 b1778ab88870 2024-09-19T06:55:11.159 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi117 running (8m) 6m ago 19m 102M 2581M 19.1.1-361-g2f599a46 d2baa855c067 ea5236b193d3 2024-09-19T06:55:11.159 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi117 running (8m) 6m ago 19m 93.5M 2581M 19.1.1-361-g2f599a46 d2baa855c067 27ac2c859a68 2024-09-19T06:55:11.159 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi117 running (7m) 6m ago 18m 100M 2581M 19.1.1-361-g2f599a46 d2baa855c067 de6aeb8544ce 2024-09-19T06:55:11.159 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.smithi099 smithi099 *:9095 running (13m) 6m ago 22m 64.4M - 2.43.0 a07b618ecd1d 15ad26ec6fb4 2024-09-19T06:55:11.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.158+0000 7f15a6156640 1 -- 172.21.15.99:0/3316452770 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f158806e530 msgr2=0x7f15880709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:11.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.158+0000 7f15a6156640 1 --2- 172.21.15.99:0/3316452770 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f158806e530 0x7f15880709e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1590009ac0 tx=0x7f1590035040 comp rx=0 tx=0).stop 2024-09-19T06:55:11.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.158+0000 7f15a6156640 1 -- 172.21.15.99:0/3316452770 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15a0102ef0 msgr2=0x7f15a0113ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:11.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.158+0000 7f15a6156640 1 --2- 172.21.15.99:0/3316452770 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15a0102ef0 0x7f15a0113ab0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f1594002870 tx=0x7f1594004600 comp rx=0 tx=0).stop 2024-09-19T06:55:11.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.158+0000 7f15a6156640 1 -- 172.21.15.99:0/3316452770 shutdown_connections 2024-09-19T06:55:11.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.158+0000 7f15a6156640 1 --2- 172.21.15.99:0/3316452770 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f158806e530 0x7f15880709e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:11.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.158+0000 7f15a6156640 1 --2- 172.21.15.99:0/3316452770 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f15a0102ef0 0x7f15a0113ab0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:11.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.158+0000 7f15a6156640 1 --2- 172.21.15.99:0/3316452770 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15a0102550 0x7f15a0113570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:11.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.158+0000 7f15a6156640 1 -- 172.21.15.99:0/3316452770 >> 172.21.15.99:0/3316452770 conn(0x7f15a00f80f0 msgr2=0x7f15a00f90b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:11.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.159+0000 7f15a6156640 1 -- 172.21.15.99:0/3316452770 shutdown_connections 2024-09-19T06:55:11.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.159+0000 7f15a6156640 1 -- 172.21.15.99:0/3316452770 wait complete. 2024-09-19T06:55:11.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.236+0000 7fe4259d1640 1 -- 172.21.15.99:0/2953046629 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe4200fb480 msgr2=0x7fe4200fb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:11.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.236+0000 7fe4259d1640 1 --2- 172.21.15.99:0/2953046629 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe4200fb480 0x7fe4200fb8f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe4080048d0 tx=0x7fe408009da0 comp rx=0 tx=0).stop 2024-09-19T06:55:11.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.236+0000 7fe4259d1640 1 -- 172.21.15.99:0/2953046629 shutdown_connections 2024-09-19T06:55:11.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.236+0000 7fe4259d1640 1 --2- 172.21.15.99:0/2953046629 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe4200fb480 0x7fe4200fb8f0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:11.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.236+0000 7fe4259d1640 1 --2- 172.21.15.99:0/2953046629 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4201014c0 0x7fe420101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:11.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.236+0000 7fe4259d1640 1 -- 172.21.15.99:0/2953046629 >> 172.21.15.99:0/2953046629 conn(0x7fe4200f7000 msgr2=0x7fe4200f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:11.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.236+0000 7fe4259d1640 1 -- 172.21.15.99:0/2953046629 shutdown_connections 2024-09-19T06:55:11.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.236+0000 7fe4259d1640 1 -- 172.21.15.99:0/2953046629 wait complete. 2024-09-19T06:55:11.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.237+0000 7fe4259d1640 1 Processor -- start 2024-09-19T06:55:11.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.237+0000 7fe4259d1640 1 -- start start 2024-09-19T06:55:11.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.237+0000 7fe4259d1640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4200fb480 0x7fe420113190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:11.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.237+0000 7fe4259d1640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe4201014c0 0x7fe4201136d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:11.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.237+0000 7fe4259d1640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe420113cd0 con 0x7fe4201014c0 2024-09-19T06:55:11.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.237+0000 7fe4259d1640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe42010d110 con 0x7fe4200fb480 2024-09-19T06:55:11.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.237+0000 7fe417fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe4201014c0 0x7fe4201136d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:11.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.237+0000 7fe417fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe4201014c0 0x7fe4201136d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60040/0 (socket says 172.21.15.99:60040) 2024-09-19T06:55:11.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.237+0000 7fe417fff640 1 -- 172.21.15.99:0/2734314692 learned_addr learned my addr 172.21.15.99:0/2734314692 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:55:11.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.237+0000 7fe41effd640 1 --2- 172.21.15.99:0/2734314692 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4200fb480 0x7fe420113190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:11.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.238+0000 7fe417fff640 1 -- 172.21.15.99:0/2734314692 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4200fb480 msgr2=0x7fe420113190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:11.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.238+0000 7fe417fff640 1 --2- 172.21.15.99:0/2734314692 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4200fb480 0x7fe420113190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:11.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.238+0000 7fe417fff640 1 -- 172.21.15.99:0/2734314692 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe408005040 con 0x7fe4201014c0 2024-09-19T06:55:11.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.238+0000 7fe417fff640 1 --2- 172.21.15.99:0/2734314692 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe4201014c0 0x7fe4201136d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fe408003080 tx=0x7fe408009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:11.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.238+0000 7fe4177fe640 1 -- 172.21.15.99:0/2734314692 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe408038070 con 0x7fe4201014c0 2024-09-19T06:55:11.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.238+0000 7fe4259d1640 1 -- 172.21.15.99:0/2734314692 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe42010d390 con 0x7fe4201014c0 2024-09-19T06:55:11.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.238+0000 7fe4177fe640 1 -- 172.21.15.99:0/2734314692 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe4080097e0 con 0x7fe4201014c0 2024-09-19T06:55:11.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.238+0000 7fe4177fe640 1 -- 172.21.15.99:0/2734314692 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe40803d420 con 0x7fe4201014c0 2024-09-19T06:55:11.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.238+0000 7fe4259d1640 1 -- 172.21.15.99:0/2734314692 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe42010d8d0 con 0x7fe4201014c0 2024-09-19T06:55:11.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.239+0000 7fe4259d1640 1 -- 172.21.15.99:0/2734314692 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4200fcbc0 con 0x7fe4201014c0 2024-09-19T06:55:11.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.240+0000 7fe4177fe640 1 -- 172.21.15.99:0/2734314692 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fe408030020 con 0x7fe4201014c0 2024-09-19T06:55:11.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.240+0000 7fe4177fe640 1 --2- 172.21.15.99:0/2734314692 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe40c06e530 0x7fe40c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:11.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.240+0000 7fe4177fe640 1 -- 172.21.15.99:0/2734314692 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fe4080ae5e0 con 0x7fe4201014c0 2024-09-19T06:55:11.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.240+0000 7fe41effd640 1 --2- 172.21.15.99:0/2734314692 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe40c06e530 0x7fe40c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:11.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.241+0000 7fe41effd640 1 --2- 172.21.15.99:0/2734314692 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe40c06e530 0x7fe40c0709e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe410007fd0 tx=0x7fe410009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:11.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.245+0000 7fe4177fe640 1 -- 172.21.15.99:0/2734314692 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fe408077750 con 0x7fe4201014c0 2024-09-19T06:55:11.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.478+0000 7fe4259d1640 1 -- 172.21.15.99:0/2734314692 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe4201084a0 con 0x7fe4201014c0 2024-09-19T06:55:11.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.479+0000 7fe4177fe640 1 -- 172.21.15.99:0/2734314692 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7fe40807ae10 con 0x7fe4201014c0 2024-09-19T06:55:11.480 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:55:11.480 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-09-19T06:55:11.480 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T06:55:11.480 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:55:11.480 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-09-19T06:55:11.480 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T06:55:11.481 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:55:11.481 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-09-19T06:55:11.481 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 6 2024-09-19T06:55:11.481 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:55:11.481 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": { 2024-09-19T06:55:11.481 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 4 2024-09-19T06:55:11.481 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:55:11.481 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-09-19T06:55:11.481 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 14 2024-09-19T06:55:11.481 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T06:55:11.482 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:55:11.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.481+0000 7fe4259d1640 1 -- 172.21.15.99:0/2734314692 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe40c06e530 msgr2=0x7fe40c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:11.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.481+0000 7fe4259d1640 1 --2- 172.21.15.99:0/2734314692 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe40c06e530 0x7fe40c0709e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe410007fd0 tx=0x7fe410009040 comp rx=0 tx=0).stop 2024-09-19T06:55:11.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.481+0000 7fe4259d1640 1 -- 172.21.15.99:0/2734314692 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe4201014c0 msgr2=0x7fe4201136d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:11.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.481+0000 7fe4259d1640 1 --2- 172.21.15.99:0/2734314692 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe4201014c0 0x7fe4201136d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fe408003080 tx=0x7fe408009da0 comp rx=0 tx=0).stop 2024-09-19T06:55:11.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.481+0000 7fe4259d1640 1 -- 172.21.15.99:0/2734314692 shutdown_connections 2024-09-19T06:55:11.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.481+0000 7fe4259d1640 1 --2- 172.21.15.99:0/2734314692 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe40c06e530 0x7fe40c0709e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:11.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.481+0000 7fe4259d1640 1 --2- 172.21.15.99:0/2734314692 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe4201014c0 0x7fe4201136d0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:11.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.481+0000 7fe4259d1640 1 --2- 172.21.15.99:0/2734314692 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe4200fb480 0x7fe420113190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:11.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.481+0000 7fe4259d1640 1 -- 172.21.15.99:0/2734314692 >> 172.21.15.99:0/2734314692 conn(0x7fe4200f7000 msgr2=0x7fe4200659f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:11.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.481+0000 7fe4259d1640 1 -- 172.21.15.99:0/2734314692 shutdown_connections 2024-09-19T06:55:11.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.481+0000 7fe4259d1640 1 -- 172.21.15.99:0/2734314692 wait complete. 2024-09-19T06:55:11.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.558+0000 7f79a26ab640 1 -- 172.21.15.99:0/2655773481 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f799c0fdf30 msgr2=0x7f799c106600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:11.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.558+0000 7f79a26ab640 1 --2- 172.21.15.99:0/2655773481 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f799c0fdf30 0x7f799c106600 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f79900048d0 tx=0x7f7990009da0 comp rx=0 tx=0).stop 2024-09-19T06:55:11.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.558+0000 7f79a26ab640 1 -- 172.21.15.99:0/2655773481 shutdown_connections 2024-09-19T06:55:11.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.558+0000 7f79a26ab640 1 --2- 172.21.15.99:0/2655773481 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f799c0fdf30 0x7f799c106600 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:11.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.558+0000 7f79a26ab640 1 --2- 172.21.15.99:0/2655773481 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f799c0fd590 0x7f799c0fd960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:11.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.558+0000 7f79a26ab640 1 -- 172.21.15.99:0/2655773481 >> 172.21.15.99:0/2655773481 conn(0x7f799c0f7050 msgr2=0x7f799c0f9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:11.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.558+0000 7f79a26ab640 1 -- 172.21.15.99:0/2655773481 shutdown_connections 2024-09-19T06:55:11.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.558+0000 7f79a26ab640 1 -- 172.21.15.99:0/2655773481 wait complete. 2024-09-19T06:55:11.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.559+0000 7f79a26ab640 1 Processor -- start 2024-09-19T06:55:11.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.559+0000 7f79a26ab640 1 -- start start 2024-09-19T06:55:11.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.559+0000 7f79a26ab640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f799c0fd590 0x7f799c113240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:11.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.559+0000 7f79a26ab640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f799c0fdf30 0x7f799c113780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:11.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.559+0000 7f79a26ab640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799c113d80 con 0x7f799c0fd590 2024-09-19T06:55:11.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.559+0000 7f79a26ab640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799c10d1c0 con 0x7f799c0fdf30 2024-09-19T06:55:11.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.559+0000 7f799bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f799c0fd590 0x7f799c113240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:11.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.559+0000 7f799bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f799c0fd590 0x7f799c113240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60056/0 (socket says 172.21.15.99:60056) 2024-09-19T06:55:11.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.559+0000 7f799bfff640 1 -- 172.21.15.99:0/2645649897 learned_addr learned my addr 172.21.15.99:0/2645649897 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:55:11.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.559+0000 7f799b7fe640 1 --2- 172.21.15.99:0/2645649897 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f799c0fdf30 0x7f799c113780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:11.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.560+0000 7f799bfff640 1 -- 172.21.15.99:0/2645649897 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f799c0fdf30 msgr2=0x7f799c113780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:11.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.560+0000 7f799bfff640 1 --2- 172.21.15.99:0/2645649897 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f799c0fdf30 0x7f799c113780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:11.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.560+0000 7f799bfff640 1 -- 172.21.15.99:0/2645649897 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7990005040 con 0x7f799c0fd590 2024-09-19T06:55:11.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.560+0000 7f799bfff640 1 --2- 172.21.15.99:0/2645649897 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f799c0fd590 0x7f799c113240 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f798c00eb70 tx=0x7f798c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:11.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.560+0000 7f7998ff9640 1 -- 172.21.15.99:0/2645649897 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f798c007c30 con 0x7f799c0fd590 2024-09-19T06:55:11.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.560+0000 7f79a26ab640 1 -- 172.21.15.99:0/2645649897 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f799c10d440 con 0x7f799c0fd590 2024-09-19T06:55:11.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.560+0000 7f7998ff9640 1 -- 172.21.15.99:0/2645649897 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f798c00f040 con 0x7f799c0fd590 2024-09-19T06:55:11.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.560+0000 7f7998ff9640 1 -- 172.21.15.99:0/2645649897 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f798c00ca60 con 0x7f799c0fd590 2024-09-19T06:55:11.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.560+0000 7f79a26ab640 1 -- 172.21.15.99:0/2645649897 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f799c10d930 con 0x7f799c0fd590 2024-09-19T06:55:11.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.561+0000 7f79a26ab640 1 -- 172.21.15.99:0/2645649897 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f799c0662b0 con 0x7f799c0fd590 2024-09-19T06:55:11.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.562+0000 7f7998ff9640 1 -- 172.21.15.99:0/2645649897 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f798c00cbc0 con 0x7f799c0fd590 2024-09-19T06:55:11.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.563+0000 7f7998ff9640 1 --2- 172.21.15.99:0/2645649897 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f798406e530 0x7f79840709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:11.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.563+0000 7f7998ff9640 1 -- 172.21.15.99:0/2645649897 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f798c08e340 con 0x7f799c0fd590 2024-09-19T06:55:11.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.563+0000 7f799b7fe640 1 --2- 172.21.15.99:0/2645649897 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f798406e530 0x7f79840709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:11.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.563+0000 7f799b7fe640 1 --2- 172.21.15.99:0/2645649897 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f798406e530 0x7f79840709e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f799c0feaa0 tx=0x7f7990035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:11.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.566+0000 7f7998ff9640 1 -- 172.21.15.99:0/2645649897 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f798c057560 con 0x7f799c0fd590 2024-09-19T06:55:11.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.765+0000 7f79a26ab640 1 -- 172.21.15.99:0/2645649897 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f799c0fac50 con 0x7f799c0fd590 2024-09-19T06:55:11.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.765+0000 7f7998ff9640 1 -- 172.21.15.99:0/2645649897 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 29 v29) v1 ==== 76+0+1915 (secure 0 0 0) 0x7f798c05ac20 con 0x7f799c0fd590 2024-09-19T06:55:11.767 INFO:teuthology.orchestra.run.smithi099.stdout:e29 2024-09-19T06:55:11.767 INFO:teuthology.orchestra.run.smithi099.stdout:btime 2024-09-19T06:48:47:938420+0000 2024-09-19T06:55:11.767 INFO:teuthology.orchestra.run.smithi099.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T06:55:11.767 INFO:teuthology.orchestra.run.smithi099.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T06:55:11.767 INFO:teuthology.orchestra.run.smithi099.stdout:legacy client fscid: 1 2024-09-19T06:55:11.767 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:55:11.767 INFO:teuthology.orchestra.run.smithi099.stdout:Filesystem 'cephfs' (1) 2024-09-19T06:55:11.767 INFO:teuthology.orchestra.run.smithi099.stdout:fs_name cephfs 2024-09-19T06:55:11.767 INFO:teuthology.orchestra.run.smithi099.stdout:epoch 20 2024-09-19T06:55:11.767 INFO:teuthology.orchestra.run.smithi099.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-19T06:55:11.768 INFO:teuthology.orchestra.run.smithi099.stdout:created 2024-09-19T06:37:40.838146+0000 2024-09-19T06:55:11.768 INFO:teuthology.orchestra.run.smithi099.stdout:modified 2024-09-19T06:47:50.076553+0000 2024-09-19T06:55:11.768 INFO:teuthology.orchestra.run.smithi099.stdout:tableserver 0 2024-09-19T06:55:11.768 INFO:teuthology.orchestra.run.smithi099.stdout:root 0 2024-09-19T06:55:11.768 INFO:teuthology.orchestra.run.smithi099.stdout:session_timeout 60 2024-09-19T06:55:11.768 INFO:teuthology.orchestra.run.smithi099.stdout:session_autoclose 300 2024-09-19T06:55:11.768 INFO:teuthology.orchestra.run.smithi099.stdout:max_file_size 1099511627776 2024-09-19T06:55:11.768 INFO:teuthology.orchestra.run.smithi099.stdout:max_xattr_size 65536 2024-09-19T06:55:11.768 INFO:teuthology.orchestra.run.smithi099.stdout:required_client_features {} 2024-09-19T06:55:11.768 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure 0 2024-09-19T06:55:11.768 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure_osd_epoch 77 2024-09-19T06:55:11.768 INFO:teuthology.orchestra.run.smithi099.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T06:55:11.769 INFO:teuthology.orchestra.run.smithi099.stdout:max_mds 2 2024-09-19T06:55:11.769 INFO:teuthology.orchestra.run.smithi099.stdout:in 0,1 2024-09-19T06:55:11.769 INFO:teuthology.orchestra.run.smithi099.stdout:up {} 2024-09-19T06:55:11.769 INFO:teuthology.orchestra.run.smithi099.stdout:failed 0,1 2024-09-19T06:55:11.769 INFO:teuthology.orchestra.run.smithi099.stdout:damaged 2024-09-19T06:55:11.769 INFO:teuthology.orchestra.run.smithi099.stdout:stopped 2024-09-19T06:55:11.769 INFO:teuthology.orchestra.run.smithi099.stdout:data_pools [3] 2024-09-19T06:55:11.769 INFO:teuthology.orchestra.run.smithi099.stdout:metadata_pool 2 2024-09-19T06:55:11.769 INFO:teuthology.orchestra.run.smithi099.stdout:inline_data disabled 2024-09-19T06:55:11.769 INFO:teuthology.orchestra.run.smithi099.stdout:balancer 2024-09-19T06:55:11.769 INFO:teuthology.orchestra.run.smithi099.stdout:bal_rank_mask -1 2024-09-19T06:55:11.769 INFO:teuthology.orchestra.run.smithi099.stdout:standby_count_wanted 1 2024-09-19T06:55:11.770 INFO:teuthology.orchestra.run.smithi099.stdout:qdb_cluster leader: 0 members: 2024-09-19T06:55:11.770 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:55:11.770 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:55:11.770 INFO:teuthology.orchestra.run.smithi099.stdout:Standby daemons: 2024-09-19T06:55:11.770 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:55:11.770 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.obarqf{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6826/1859154203,v1:172.21.15.99:6827/1859154203] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:55:11.770 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.xehbxe{-1:34410} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6828/1939453719,v1:172.21.15.99:6829/1939453719] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:55:11.770 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.nooexo{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6824/1398895079,v1:172.21.15.117:6825/1398895079] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:55:11.770 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.bheqzh{-1:44329} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6826/3233337308,v1:172.21.15.117:6827/3233337308] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:55:11.771 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 29 2024-09-19T06:55:11.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.767+0000 7f79a26ab640 1 -- 172.21.15.99:0/2645649897 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f798406e530 msgr2=0x7f79840709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:11.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.767+0000 7f79a26ab640 1 --2- 172.21.15.99:0/2645649897 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f798406e530 0x7f79840709e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f799c0feaa0 tx=0x7f7990035040 comp rx=0 tx=0).stop 2024-09-19T06:55:11.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.767+0000 7f79a26ab640 1 -- 172.21.15.99:0/2645649897 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f799c0fd590 msgr2=0x7f799c113240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:11.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.767+0000 7f79a26ab640 1 --2- 172.21.15.99:0/2645649897 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f799c0fd590 0x7f799c113240 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f798c00eb70 tx=0x7f798c00b040 comp rx=0 tx=0).stop 2024-09-19T06:55:11.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.767+0000 7f79a26ab640 1 -- 172.21.15.99:0/2645649897 shutdown_connections 2024-09-19T06:55:11.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.767+0000 7f79a26ab640 1 --2- 172.21.15.99:0/2645649897 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f798406e530 0x7f79840709e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:11.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.767+0000 7f79a26ab640 1 --2- 172.21.15.99:0/2645649897 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f799c0fdf30 0x7f799c113780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:11.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.767+0000 7f79a26ab640 1 --2- 172.21.15.99:0/2645649897 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f799c0fd590 0x7f799c113240 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:11.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.767+0000 7f79a26ab640 1 -- 172.21.15.99:0/2645649897 >> 172.21.15.99:0/2645649897 conn(0x7f799c0f7050 msgr2=0x7f799c0f8580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:11.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.768+0000 7f79a26ab640 1 -- 172.21.15.99:0/2645649897 shutdown_connections 2024-09-19T06:55:11.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.768+0000 7f79a26ab640 1 -- 172.21.15.99:0/2645649897 wait complete. 2024-09-19T06:55:11.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.847+0000 7f0c6cc5e640 1 -- 172.21.15.99:0/3055630445 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c68101490 msgr2=0x7f0c68101860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:11.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.847+0000 7f0c6cc5e640 1 --2- 172.21.15.99:0/3055630445 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c68101490 0x7f0c68101860 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f0c580048d0 tx=0x7f0c58009da0 comp rx=0 tx=0).stop 2024-09-19T06:55:11.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.847+0000 7f0c6cc5e640 1 -- 172.21.15.99:0/3055630445 shutdown_connections 2024-09-19T06:55:11.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.847+0000 7f0c6cc5e640 1 --2- 172.21.15.99:0/3055630445 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c680fb470 0x7f0c680fb8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:11.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.847+0000 7f0c6cc5e640 1 --2- 172.21.15.99:0/3055630445 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c68101490 0x7f0c68101860 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:11.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.847+0000 7f0c6cc5e640 1 -- 172.21.15.99:0/3055630445 >> 172.21.15.99:0/3055630445 conn(0x7f0c68071450 msgr2=0x7f0c68071850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:11.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.847+0000 7f0c6cc5e640 1 -- 172.21.15.99:0/3055630445 shutdown_connections 2024-09-19T06:55:11.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.847+0000 7f0c6cc5e640 1 -- 172.21.15.99:0/3055630445 wait complete. 2024-09-19T06:55:11.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.847+0000 7f0c6cc5e640 1 Processor -- start 2024-09-19T06:55:11.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.848+0000 7f0c6cc5e640 1 -- start start 2024-09-19T06:55:11.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.848+0000 7f0c6cc5e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c680fb470 0x7f0c6810e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:11.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.848+0000 7f0c6cc5e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c68101490 0x7f0c6810e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:11.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.848+0000 7f0c6cc5e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6810ec70 con 0x7f0c68101490 2024-09-19T06:55:11.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.848+0000 7f0c6cc5e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6810ede0 con 0x7f0c680fb470 2024-09-19T06:55:11.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.848+0000 7f0c65d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c68101490 0x7f0c6810e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:11.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.848+0000 7f0c65d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c68101490 0x7f0c6810e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60082/0 (socket says 172.21.15.99:60082) 2024-09-19T06:55:11.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.848+0000 7f0c65d9b640 1 -- 172.21.15.99:0/3990744423 learned_addr learned my addr 172.21.15.99:0/3990744423 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:55:11.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.848+0000 7f0c6659c640 1 --2- 172.21.15.99:0/3990744423 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c680fb470 0x7f0c6810e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:11.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.848+0000 7f0c65d9b640 1 -- 172.21.15.99:0/3990744423 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c680fb470 msgr2=0x7f0c6810e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:11.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.848+0000 7f0c65d9b640 1 --2- 172.21.15.99:0/3990744423 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c680fb470 0x7f0c6810e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:11.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.848+0000 7f0c65d9b640 1 -- 172.21.15.99:0/3990744423 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c58005040 con 0x7f0c68101490 2024-09-19T06:55:11.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.849+0000 7f0c65d9b640 1 --2- 172.21.15.99:0/3990744423 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c68101490 0x7f0c6810e620 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c00eb70 tx=0x7f0c5c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:11.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.849+0000 7f0c56ffd640 1 -- 172.21.15.99:0/3990744423 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c5c007c30 con 0x7f0c68101490 2024-09-19T06:55:11.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.849+0000 7f0c56ffd640 1 -- 172.21.15.99:0/3990744423 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0c5c00f040 con 0x7f0c68101490 2024-09-19T06:55:11.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.849+0000 7f0c56ffd640 1 -- 172.21.15.99:0/3990744423 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c5c0094e0 con 0x7f0c68101490 2024-09-19T06:55:11.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.849+0000 7f0c6cc5e640 1 -- 172.21.15.99:0/3990744423 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c68117150 con 0x7f0c68101490 2024-09-19T06:55:11.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.849+0000 7f0c6cc5e640 1 -- 172.21.15.99:0/3990744423 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c68117610 con 0x7f0c68101490 2024-09-19T06:55:11.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.850+0000 7f0c6cc5e640 1 -- 172.21.15.99:0/3990744423 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c680fcb50 con 0x7f0c68101490 2024-09-19T06:55:11.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.851+0000 7f0c56ffd640 1 -- 172.21.15.99:0/3990744423 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f0c5c0096c0 con 0x7f0c68101490 2024-09-19T06:55:11.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.851+0000 7f0c56ffd640 1 --2- 172.21.15.99:0/3990744423 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f0c5006e530 0x7f0c500709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:11.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.852+0000 7f0c56ffd640 1 -- 172.21.15.99:0/3990744423 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f0c5c08dd70 con 0x7f0c68101490 2024-09-19T06:55:11.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.852+0000 7f0c6659c640 1 --2- 172.21.15.99:0/3990744423 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f0c5006e530 0x7f0c500709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:11.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.852+0000 7f0c6659c640 1 --2- 172.21.15.99:0/3990744423 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f0c5006e530 0x7f0c500709e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0c580048a0 tx=0x7f0c58035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:11.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:11.856+0000 7f0c56ffd640 1 -- 172.21.15.99:0/3990744423 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f0c5c056f10 con 0x7f0c68101490 2024-09-19T06:55:12.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:12.040+0000 7f0c6cc5e640 1 -- 172.21.15.99:0/3990744423 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0c6804b720 con 0x7f0c5006e530 2024-09-19T06:55:12.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:12.041+0000 7f0c56ffd640 1 -- 172.21.15.99:0/3990744423 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f0c6804b720 con 0x7f0c5006e530 2024-09-19T06:55:12.042 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:55:12.042 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T06:55:12.042 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": true, 2024-09-19T06:55:12.042 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T06:55:12.043 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [ 2024-09-19T06:55:12.043 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr", 2024-09-19T06:55:12.043 INFO:teuthology.orchestra.run.smithi099.stdout: "crash", 2024-09-19T06:55:12.043 INFO:teuthology.orchestra.run.smithi099.stdout: "mds", 2024-09-19T06:55:12.043 INFO:teuthology.orchestra.run.smithi099.stdout: "mon", 2024-09-19T06:55:12.043 INFO:teuthology.orchestra.run.smithi099.stdout: "osd" 2024-09-19T06:55:12.043 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-19T06:55:12.043 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": "16/21 daemons upgraded", 2024-09-19T06:55:12.043 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "Currently upgrading mds daemons", 2024-09-19T06:55:12.043 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-09-19T06:55:12.044 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:55:12.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:12.043+0000 7f0c6cc5e640 1 -- 172.21.15.99:0/3990744423 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f0c5006e530 msgr2=0x7f0c500709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:12.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:12.043+0000 7f0c6cc5e640 1 --2- 172.21.15.99:0/3990744423 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f0c5006e530 0x7f0c500709e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0c580048a0 tx=0x7f0c58035040 comp rx=0 tx=0).stop 2024-09-19T06:55:12.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:12.043+0000 7f0c6cc5e640 1 -- 172.21.15.99:0/3990744423 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c68101490 msgr2=0x7f0c6810e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:12.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:12.043+0000 7f0c6cc5e640 1 --2- 172.21.15.99:0/3990744423 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c68101490 0x7f0c6810e620 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c00eb70 tx=0x7f0c5c00b040 comp rx=0 tx=0).stop 2024-09-19T06:55:12.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:12.043+0000 7f0c6cc5e640 1 -- 172.21.15.99:0/3990744423 shutdown_connections 2024-09-19T06:55:12.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:12.043+0000 7f0c6cc5e640 1 --2- 172.21.15.99:0/3990744423 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f0c5006e530 0x7f0c500709e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:12.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:12.043+0000 7f0c6cc5e640 1 --2- 172.21.15.99:0/3990744423 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c68101490 0x7f0c6810e620 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:12.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:12.043+0000 7f0c6cc5e640 1 --2- 172.21.15.99:0/3990744423 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c680fb470 0x7f0c6810e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:12.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:12.043+0000 7f0c6cc5e640 1 -- 172.21.15.99:0/3990744423 >> 172.21.15.99:0/3990744423 conn(0x7f0c68071450 msgr2=0x7f0c68104180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:12.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:12.043+0000 7f0c6cc5e640 1 -- 172.21.15.99:0/3990744423 shutdown_connections 2024-09-19T06:55:12.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:12.043+0000 7f0c6cc5e640 1 -- 172.21.15.99:0/3990744423 wait complete. 2024-09-19T06:55:12.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:12.122+0000 7f175d030640 1 -- 172.21.15.99:0/3149879805 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17580fabd0 msgr2=0x7f17580fb040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:12.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:12.122+0000 7f175d030640 1 --2- 172.21.15.99:0/3149879805 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17580fabd0 0x7f17580fb040 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f174c0048d0 tx=0x7f174c009da0 comp rx=0 tx=0).stop 2024-09-19T06:55:12.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:12.122+0000 7f175d030640 1 -- 172.21.15.99:0/3149879805 shutdown_connections 2024-09-19T06:55:12.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:12.122+0000 7f175d030640 1 --2- 172.21.15.99:0/3149879805 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17580fabd0 0x7f17580fb040 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:12.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:12.122+0000 7f175d030640 1 --2- 172.21.15.99:0/3149879805 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1758102680 0x7f1758102a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:12.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:12.122+0000 7f175d030640 1 -- 172.21.15.99:0/3149879805 >> 172.21.15.99:0/3149879805 conn(0x7f1758071ac0 msgr2=0x7f1758071ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:12.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:12.122+0000 7f175d030640 1 -- 172.21.15.99:0/3149879805 shutdown_connections 2024-09-19T06:55:12.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:12.122+0000 7f175d030640 1 -- 172.21.15.99:0/3149879805 wait complete. 2024-09-19T06:55:12.125 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:55:12 smithi099 ceph-mon[97031]: from='client.34754 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:55:12.125 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:55:12 smithi099 ceph-mon[97031]: from='client.34758 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:55:12.125 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:55:12 smithi099 ceph-mon[97031]: pgmap v385: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:55:12.125 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:55:12 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/2734314692' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:55:12.125 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:55:12 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/2645649897' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:55:12.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:12.123+0000 7f175d030640 1 Processor -- start 2024-09-19T06:55:12.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:12.123+0000 7f175d030640 1 -- start start 2024-09-19T06:55:12.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:12.123+0000 7f175d030640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17580fabd0 0x7f1758113260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:12.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:12.123+0000 7f175d030640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1758102680 0x7f17581137a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:12.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:12.123+0000 7f175d030640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1758113da0 con 0x7f17580fabd0 2024-09-19T06:55:12.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:12.123+0000 7f175d030640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f175810d1e0 con 0x7f1758102680 2024-09-19T06:55:12.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:12.123+0000 7f1756d9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17580fabd0 0x7f1758113260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:12.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:12.123+0000 7f1756d9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17580fabd0 0x7f1758113260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60096/0 (socket says 172.21.15.99:60096) 2024-09-19T06:55:12.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:12.124+0000 7f1756d9d640 1 -- 172.21.15.99:0/1630290859 learned_addr learned my addr 172.21.15.99:0/1630290859 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:55:12.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:12.124+0000 7f175659c640 1 --2- 172.21.15.99:0/1630290859 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1758102680 0x7f17581137a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:12.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:12.124+0000 7f1756d9d640 1 -- 172.21.15.99:0/1630290859 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1758102680 msgr2=0x7f17581137a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:12.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:12.124+0000 7f1756d9d640 1 --2- 172.21.15.99:0/1630290859 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1758102680 0x7f17581137a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:12.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:12.124+0000 7f1756d9d640 1 -- 172.21.15.99:0/1630290859 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f174c005040 con 0x7f17580fabd0 2024-09-19T06:55:12.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:12.124+0000 7f1756d9d640 1 --2- 172.21.15.99:0/1630290859 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17580fabd0 0x7f1758113260 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f174800cb10 tx=0x7f1748007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:12.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:12.124+0000 7f173f7fe640 1 -- 172.21.15.99:0/1630290859 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1748004200 con 0x7f17580fabd0 2024-09-19T06:55:12.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:12.124+0000 7f175d030640 1 -- 172.21.15.99:0/1630290859 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f175810d4c0 con 0x7f17580fabd0 2024-09-19T06:55:12.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:12.124+0000 7f175d030640 1 -- 172.21.15.99:0/1630290859 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f175810da30 con 0x7f17580fabd0 2024-09-19T06:55:12.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:12.124+0000 7f173f7fe640 1 -- 172.21.15.99:0/1630290859 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f174800ac40 con 0x7f17580fabd0 2024-09-19T06:55:12.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:12.124+0000 7f173f7fe640 1 -- 172.21.15.99:0/1630290859 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1748003c50 con 0x7f17580fabd0 2024-09-19T06:55:12.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:12.125+0000 7f175d030640 1 -- 172.21.15.99:0/1630290859 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1744005210 con 0x7f17580fabd0 2024-09-19T06:55:12.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:12.126+0000 7f173f7fe640 1 -- 172.21.15.99:0/1630290859 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f1748003430 con 0x7f17580fabd0 2024-09-19T06:55:12.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:12.126+0000 7f173f7fe640 1 --2- 172.21.15.99:0/1630290859 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f174006e530 0x7f17400709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:12.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:12.126+0000 7f173f7fe640 1 -- 172.21.15.99:0/1630290859 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f174808e4d0 con 0x7f17580fabd0 2024-09-19T06:55:12.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:12.127+0000 7f175659c640 1 --2- 172.21.15.99:0/1630290859 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f174006e530 0x7f17400709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:12.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:12.127+0000 7f175659c640 1 --2- 172.21.15.99:0/1630290859 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f174006e530 0x7f17400709e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f174c009ac0 tx=0x7f174c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:12.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:12.131+0000 7f173f7fe640 1 -- 172.21.15.99:0/1630290859 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f1748057640 con 0x7f17580fabd0 2024-09-19T06:55:12.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:12.364+0000 7f175d030640 1 -- 172.21.15.99:0/1630290859 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f17440054c0 con 0x7f17580fabd0 2024-09-19T06:55:12.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:12.364+0000 7f173f7fe640 1 -- 172.21.15.99:0/1630290859 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7f174805ad00 con 0x7f17580fabd0 2024-09-19T06:55:12.366 INFO:teuthology.orchestra.run.smithi099.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-09-19T06:55:12.366 INFO:teuthology.orchestra.run.smithi099.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-19T06:55:12.366 INFO:teuthology.orchestra.run.smithi099.stdout: fs cephfs is degraded 2024-09-19T06:55:12.366 INFO:teuthology.orchestra.run.smithi099.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-19T06:55:12.366 INFO:teuthology.orchestra.run.smithi099.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-19T06:55:12.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:12.366+0000 7f175d030640 1 -- 172.21.15.99:0/1630290859 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f174006e530 msgr2=0x7f17400709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:12.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:12.366+0000 7f175d030640 1 --2- 172.21.15.99:0/1630290859 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f174006e530 0x7f17400709e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f174c009ac0 tx=0x7f174c035040 comp rx=0 tx=0).stop 2024-09-19T06:55:12.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:12.366+0000 7f175d030640 1 -- 172.21.15.99:0/1630290859 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17580fabd0 msgr2=0x7f1758113260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:12.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:12.366+0000 7f175d030640 1 --2- 172.21.15.99:0/1630290859 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17580fabd0 0x7f1758113260 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f174800cb10 tx=0x7f1748007ee0 comp rx=0 tx=0).stop 2024-09-19T06:55:12.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:12.366+0000 7f175d030640 1 -- 172.21.15.99:0/1630290859 shutdown_connections 2024-09-19T06:55:12.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:12.366+0000 7f175d030640 1 --2- 172.21.15.99:0/1630290859 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f174006e530 0x7f17400709e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:12.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:12.366+0000 7f175d030640 1 --2- 172.21.15.99:0/1630290859 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1758102680 0x7f17581137a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:12.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:12.366+0000 7f175d030640 1 --2- 172.21.15.99:0/1630290859 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17580fabd0 0x7f1758113260 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:12.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:12.366+0000 7f175d030640 1 -- 172.21.15.99:0/1630290859 >> 172.21.15.99:0/1630290859 conn(0x7f1758071ac0 msgr2=0x7f1758105350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:12.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:12.367+0000 7f175d030640 1 -- 172.21.15.99:0/1630290859 shutdown_connections 2024-09-19T06:55:12.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:12.367+0000 7f175d030640 1 -- 172.21.15.99:0/1630290859 wait complete. 2024-09-19T06:55:12.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:55:12 smithi117 ceph-mon[76771]: from='client.34754 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:55:12.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:55:12 smithi117 ceph-mon[76771]: from='client.34758 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:55:12.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:55:12 smithi117 ceph-mon[76771]: pgmap v385: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:55:12.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:55:12 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/2734314692' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:55:12.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:55:12 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/2645649897' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:55:13.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:55:13 smithi099 ceph-mon[97031]: from='client.34762 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:55:13.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:55:13 smithi099 ceph-mon[97031]: from='client.34774 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:55:13.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:55:13 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/1630290859' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T06:55:13.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:55:13 smithi117 ceph-mon[76771]: from='client.34762 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:55:13.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:55:13 smithi117 ceph-mon[76771]: from='client.34774 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:55:13.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:55:13 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/1630290859' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T06:55:14.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:55:14 smithi099 ceph-mon[97031]: pgmap v386: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:55:14.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:55:14 smithi117 ceph-mon[76771]: pgmap v386: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:55:16.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:55:16 smithi099 ceph-mon[97031]: pgmap v387: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:55:16.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:55:16 smithi117 ceph-mon[76771]: pgmap v387: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:55:18.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:55:18 smithi099 ceph-mon[97031]: pgmap v388: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:55:18.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:55:18 smithi117 ceph-mon[76771]: pgmap v388: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:55:20.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:55:20 smithi099 ceph-mon[97031]: pgmap v389: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:55:20.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:55:20 smithi117 ceph-mon[76771]: pgmap v389: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:55:22.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:55:22 smithi099 ceph-mon[97031]: pgmap v390: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:55:22.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:55:22 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:55:22.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:55:22 smithi117 ceph-mon[76771]: pgmap v390: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:55:22.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:55:22 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:55:24.364 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:55:24 smithi117 ceph-mon[76771]: pgmap v391: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:55:24.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:55:24 smithi099 ceph-mon[97031]: pgmap v391: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:55:26.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:55:26 smithi099 ceph-mon[97031]: pgmap v392: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:55:26.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:55:26 smithi117 ceph-mon[76771]: pgmap v392: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:55:28.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:55:28 smithi099 ceph-mon[97031]: pgmap v393: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:55:28.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:55:28 smithi117 ceph-mon[76771]: pgmap v393: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:55:29.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:55:29 smithi099 ceph-mon[97031]: pgmap v394: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:55:29.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:55:29 smithi117 ceph-mon[76771]: pgmap v394: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:55:32.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:55:32 smithi117 ceph-mon[76771]: pgmap v395: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:55:32.314 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:55:32 smithi099 ceph-mon[97031]: pgmap v395: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:55:34.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:55:34 smithi117 ceph-mon[76771]: pgmap v396: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:55:34.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:55:34 smithi099 ceph-mon[97031]: pgmap v396: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:55:36.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:55:36 smithi117 ceph-mon[76771]: pgmap v397: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:55:36.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:55:36 smithi099 ceph-mon[97031]: pgmap v397: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:55:37.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:55:37 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:55:37.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:55:37 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:55:38.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:55:38 smithi117 ceph-mon[76771]: pgmap v398: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:55:38.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:55:38 smithi099 ceph-mon[97031]: pgmap v398: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:55:40.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:55:40 smithi117 ceph-mon[76771]: pgmap v399: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:55:40.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:55:40 smithi099 ceph-mon[97031]: pgmap v399: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:55:42.315 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:55:42 smithi099 ceph-mon[97031]: pgmap v400: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:55:42.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.456+0000 7fc05711f640 1 -- 172.21.15.99:0/2739097384 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc050102ef0 msgr2=0x7fc0500fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:42.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.456+0000 7fc05711f640 1 --2- 172.21.15.99:0/2739097384 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc050102ef0 0x7fc0500fc5b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc03c0048d0 tx=0x7fc03c009da0 comp rx=0 tx=0).stop 2024-09-19T06:55:42.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.456+0000 7fc05711f640 1 -- 172.21.15.99:0/2739097384 shutdown_connections 2024-09-19T06:55:42.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.456+0000 7fc05711f640 1 --2- 172.21.15.99:0/2739097384 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc050102ef0 0x7fc0500fc5b0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:42.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.456+0000 7fc05711f640 1 --2- 172.21.15.99:0/2739097384 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc050102550 0x7fc050102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:42.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.456+0000 7fc05711f640 1 -- 172.21.15.99:0/2739097384 >> 172.21.15.99:0/2739097384 conn(0x7fc0500f80f0 msgr2=0x7fc0500fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:42.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.457+0000 7fc05711f640 1 -- 172.21.15.99:0/2739097384 shutdown_connections 2024-09-19T06:55:42.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.457+0000 7fc05711f640 1 -- 172.21.15.99:0/2739097384 wait complete. 2024-09-19T06:55:42.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.457+0000 7fc05711f640 1 Processor -- start 2024-09-19T06:55:42.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.457+0000 7fc05711f640 1 -- start start 2024-09-19T06:55:42.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.458+0000 7fc05711f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc050102550 0x7fc050113500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:42.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.458+0000 7fc05711f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc050102ef0 0x7fc050113a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:42.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.458+0000 7fc05711f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc050114090 con 0x7fc050102ef0 2024-09-19T06:55:42.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.458+0000 7fc05711f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc05010d4a0 con 0x7fc050102550 2024-09-19T06:55:42.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.458+0000 7fc04ffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc050102ef0 0x7fc050113a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:42.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.458+0000 7fc04ffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc050102ef0 0x7fc050113a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53824/0 (socket says 172.21.15.99:53824) 2024-09-19T06:55:42.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.458+0000 7fc04ffff640 1 -- 172.21.15.99:0/4185246502 learned_addr learned my addr 172.21.15.99:0/4185246502 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:55:42.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.458+0000 7fc054ebb640 1 --2- 172.21.15.99:0/4185246502 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc050102550 0x7fc050113500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:42.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.458+0000 7fc04ffff640 1 -- 172.21.15.99:0/4185246502 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc050102550 msgr2=0x7fc050113500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:42.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.458+0000 7fc04ffff640 1 --2- 172.21.15.99:0/4185246502 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc050102550 0x7fc050113500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:42.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.458+0000 7fc04ffff640 1 -- 172.21.15.99:0/4185246502 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc03c005040 con 0x7fc050102ef0 2024-09-19T06:55:42.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.458+0000 7fc04ffff640 1 --2- 172.21.15.99:0/4185246502 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc050102ef0 0x7fc050113a40 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fc03c0043d0 tx=0x7fc03c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:42.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.458+0000 7fc04d7fa640 1 -- 172.21.15.99:0/4185246502 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc03c038070 con 0x7fc050102ef0 2024-09-19T06:55:42.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.458+0000 7fc05711f640 1 -- 172.21.15.99:0/4185246502 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc05010d720 con 0x7fc050102ef0 2024-09-19T06:55:42.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.459+0000 7fc04d7fa640 1 -- 172.21.15.99:0/4185246502 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc03c0096e0 con 0x7fc050102ef0 2024-09-19T06:55:42.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.459+0000 7fc04d7fa640 1 -- 172.21.15.99:0/4185246502 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc03c02c8a0 con 0x7fc050102ef0 2024-09-19T06:55:42.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.459+0000 7fc05711f640 1 -- 172.21.15.99:0/4185246502 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc05010dc60 con 0x7fc050102ef0 2024-09-19T06:55:42.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.460+0000 7fc05711f640 1 -- 172.21.15.99:0/4185246502 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0500fdcd0 con 0x7fc050102ef0 2024-09-19T06:55:42.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.460+0000 7fc04d7fa640 1 -- 172.21.15.99:0/4185246502 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fc03c030020 con 0x7fc050102ef0 2024-09-19T06:55:42.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.461+0000 7fc04d7fa640 1 --2- 172.21.15.99:0/4185246502 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fc04006e530 0x7fc0400709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:42.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.461+0000 7fc04d7fa640 1 -- 172.21.15.99:0/4185246502 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fc03c0adfb0 con 0x7fc050102ef0 2024-09-19T06:55:42.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.461+0000 7fc054ebb640 1 --2- 172.21.15.99:0/4185246502 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fc04006e530 0x7fc0400709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:42.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.461+0000 7fc054ebb640 1 --2- 172.21.15.99:0/4185246502 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fc04006e530 0x7fc0400709e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc044009fd0 tx=0x7fc044009e50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:42.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.465+0000 7fc04d7fa640 1 -- 172.21.15.99:0/4185246502 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fc03c0e3210 con 0x7fc050102ef0 2024-09-19T06:55:42.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:55:42 smithi117 ceph-mon[76771]: pgmap v400: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:55:42.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.648+0000 7fc05711f640 1 -- 172.21.15.99:0/4185246502 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc050109560 con 0x7fc04006e530 2024-09-19T06:55:42.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.649+0000 7fc04d7fa640 1 -- 172.21.15.99:0/4185246502 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fc050109560 con 0x7fc04006e530 2024-09-19T06:55:42.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.652+0000 7fc05711f640 1 -- 172.21.15.99:0/4185246502 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fc04006e530 msgr2=0x7fc0400709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:42.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.652+0000 7fc05711f640 1 --2- 172.21.15.99:0/4185246502 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fc04006e530 0x7fc0400709e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc044009fd0 tx=0x7fc044009e50 comp rx=0 tx=0).stop 2024-09-19T06:55:42.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.652+0000 7fc05711f640 1 -- 172.21.15.99:0/4185246502 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc050102ef0 msgr2=0x7fc050113a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:42.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.652+0000 7fc05711f640 1 --2- 172.21.15.99:0/4185246502 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc050102ef0 0x7fc050113a40 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fc03c0043d0 tx=0x7fc03c009da0 comp rx=0 tx=0).stop 2024-09-19T06:55:42.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.652+0000 7fc05711f640 1 -- 172.21.15.99:0/4185246502 shutdown_connections 2024-09-19T06:55:42.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.652+0000 7fc05711f640 1 --2- 172.21.15.99:0/4185246502 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fc04006e530 0x7fc0400709e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:42.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.652+0000 7fc05711f640 1 --2- 172.21.15.99:0/4185246502 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc050102ef0 0x7fc050113a40 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:42.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.652+0000 7fc05711f640 1 --2- 172.21.15.99:0/4185246502 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc050102550 0x7fc050113500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:42.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.652+0000 7fc05711f640 1 -- 172.21.15.99:0/4185246502 >> 172.21.15.99:0/4185246502 conn(0x7fc0500f80f0 msgr2=0x7fc0500f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:42.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.652+0000 7fc05711f640 1 -- 172.21.15.99:0/4185246502 shutdown_connections 2024-09-19T06:55:42.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.652+0000 7fc05711f640 1 -- 172.21.15.99:0/4185246502 wait complete. 2024-09-19T06:55:42.662 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-09-19T06:55:42.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.732+0000 7f9a6a23c640 1 -- 172.21.15.99:0/4106774870 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a64102ef0 msgr2=0x7f9a640fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:42.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.732+0000 7f9a6a23c640 1 --2- 172.21.15.99:0/4106774870 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a64102ef0 0x7f9a640fc5b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c0048d0 tx=0x7f9a4c009da0 comp rx=0 tx=0).stop 2024-09-19T06:55:42.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.732+0000 7f9a6a23c640 1 -- 172.21.15.99:0/4106774870 shutdown_connections 2024-09-19T06:55:42.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.732+0000 7f9a6a23c640 1 --2- 172.21.15.99:0/4106774870 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a64102ef0 0x7f9a640fc5b0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:42.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.732+0000 7f9a6a23c640 1 --2- 172.21.15.99:0/4106774870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a64102550 0x7f9a64102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:42.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.732+0000 7f9a6a23c640 1 -- 172.21.15.99:0/4106774870 >> 172.21.15.99:0/4106774870 conn(0x7f9a640f80f0 msgr2=0x7f9a640fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:42.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.732+0000 7f9a6a23c640 1 -- 172.21.15.99:0/4106774870 shutdown_connections 2024-09-19T06:55:42.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.732+0000 7f9a6a23c640 1 -- 172.21.15.99:0/4106774870 wait complete. 2024-09-19T06:55:42.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.733+0000 7f9a6a23c640 1 Processor -- start 2024-09-19T06:55:42.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.733+0000 7f9a6a23c640 1 -- start start 2024-09-19T06:55:42.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.733+0000 7f9a6a23c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a64102550 0x7f9a64115740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:42.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.733+0000 7f9a6a23c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a64102ef0 0x7f9a64115c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:42.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.733+0000 7f9a6a23c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a641162d0 con 0x7f9a64102550 2024-09-19T06:55:42.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.733+0000 7f9a6a23c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6410f6e0 con 0x7f9a64102ef0 2024-09-19T06:55:42.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.733+0000 7f9a637fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a64102550 0x7f9a64115740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:42.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.733+0000 7f9a637fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a64102550 0x7f9a64115740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53842/0 (socket says 172.21.15.99:53842) 2024-09-19T06:55:42.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.733+0000 7f9a637fe640 1 -- 172.21.15.99:0/3782903751 learned_addr learned my addr 172.21.15.99:0/3782903751 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:55:42.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.733+0000 7f9a5bfff640 1 --2- 172.21.15.99:0/3782903751 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a64102ef0 0x7f9a64115c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:42.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.733+0000 7f9a637fe640 1 -- 172.21.15.99:0/3782903751 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a64102ef0 msgr2=0x7f9a64115c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:42.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.733+0000 7f9a637fe640 1 --2- 172.21.15.99:0/3782903751 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a64102ef0 0x7f9a64115c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:42.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.733+0000 7f9a637fe640 1 -- 172.21.15.99:0/3782903751 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a4c005040 con 0x7f9a64102550 2024-09-19T06:55:42.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.733+0000 7f9a5bfff640 1 --2- 172.21.15.99:0/3782903751 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a64102ef0 0x7f9a64115c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:55:42.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.734+0000 7f9a637fe640 1 --2- 172.21.15.99:0/3782903751 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a64102550 0x7f9a64115740 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f9a54002a80 tx=0x7f9a54004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:42.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.734+0000 7f9a60ff9640 1 -- 172.21.15.99:0/3782903751 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a54007c30 con 0x7f9a64102550 2024-09-19T06:55:42.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.734+0000 7f9a60ff9640 1 -- 172.21.15.99:0/3782903751 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9a5400f040 con 0x7f9a64102550 2024-09-19T06:55:42.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.734+0000 7f9a6a23c640 1 -- 172.21.15.99:0/3782903751 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a6410f9c0 con 0x7f9a64102550 2024-09-19T06:55:42.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.734+0000 7f9a60ff9640 1 -- 172.21.15.99:0/3782903751 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a54009530 con 0x7f9a64102550 2024-09-19T06:55:42.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.734+0000 7f9a6a23c640 1 -- 172.21.15.99:0/3782903751 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a6410fee0 con 0x7f9a64102550 2024-09-19T06:55:42.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.735+0000 7f9a6a23c640 1 -- 172.21.15.99:0/3782903751 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a640fdcd0 con 0x7f9a64102550 2024-09-19T06:55:42.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.735+0000 7f9a60ff9640 1 -- 172.21.15.99:0/3782903751 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f9a540097a0 con 0x7f9a64102550 2024-09-19T06:55:42.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.736+0000 7f9a60ff9640 1 --2- 172.21.15.99:0/3782903751 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f9a5006e530 0x7f9a500709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:42.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.736+0000 7f9a60ff9640 1 -- 172.21.15.99:0/3782903751 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f9a5408db40 con 0x7f9a64102550 2024-09-19T06:55:42.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.736+0000 7f9a5bfff640 1 --2- 172.21.15.99:0/3782903751 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f9a5006e530 0x7f9a500709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:42.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.736+0000 7f9a5bfff640 1 --2- 172.21.15.99:0/3782903751 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f9a5006e530 0x7f9a500709e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9a641109c0 tx=0x7f9a4c009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:42.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.740+0000 7f9a60ff9640 1 -- 172.21.15.99:0/3782903751 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f9a54056c30 con 0x7f9a64102550 2024-09-19T06:55:42.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.924+0000 7f9a6a23c640 1 -- 172.21.15.99:0/3782903751 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9a64109560 con 0x7f9a5006e530 2024-09-19T06:55:42.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.925+0000 7f9a60ff9640 1 -- 172.21.15.99:0/3782903751 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f9a64109560 con 0x7f9a5006e530 2024-09-19T06:55:42.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.927+0000 7f9a6a23c640 1 -- 172.21.15.99:0/3782903751 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f9a5006e530 msgr2=0x7f9a500709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:42.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.927+0000 7f9a6a23c640 1 --2- 172.21.15.99:0/3782903751 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f9a5006e530 0x7f9a500709e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9a641109c0 tx=0x7f9a4c009da0 comp rx=0 tx=0).stop 2024-09-19T06:55:42.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.927+0000 7f9a6a23c640 1 -- 172.21.15.99:0/3782903751 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a64102550 msgr2=0x7f9a64115740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:42.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.927+0000 7f9a6a23c640 1 --2- 172.21.15.99:0/3782903751 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a64102550 0x7f9a64115740 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f9a54002a80 tx=0x7f9a54004600 comp rx=0 tx=0).stop 2024-09-19T06:55:42.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.927+0000 7f9a6a23c640 1 -- 172.21.15.99:0/3782903751 shutdown_connections 2024-09-19T06:55:42.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.927+0000 7f9a6a23c640 1 --2- 172.21.15.99:0/3782903751 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f9a5006e530 0x7f9a500709e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:42.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.927+0000 7f9a6a23c640 1 --2- 172.21.15.99:0/3782903751 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9a64102ef0 0x7f9a64115c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:42.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.927+0000 7f9a6a23c640 1 --2- 172.21.15.99:0/3782903751 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a64102550 0x7f9a64115740 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:42.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.927+0000 7f9a6a23c640 1 -- 172.21.15.99:0/3782903751 >> 172.21.15.99:0/3782903751 conn(0x7f9a640f80f0 msgr2=0x7f9a640f9110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:42.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.927+0000 7f9a6a23c640 1 -- 172.21.15.99:0/3782903751 shutdown_connections 2024-09-19T06:55:42.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:42.927+0000 7f9a6a23c640 1 -- 172.21.15.99:0/3782903751 wait complete. 2024-09-19T06:55:43.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.006+0000 7f0fa80c9640 1 -- 172.21.15.99:0/1374589553 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fa0102550 msgr2=0x7f0fa0102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:43.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.006+0000 7f0fa80c9640 1 --2- 172.21.15.99:0/1374589553 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fa0102550 0x7f0fa0102920 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c0048d0 tx=0x7f0f9c009da0 comp rx=0 tx=0).stop 2024-09-19T06:55:43.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.006+0000 7f0fa80c9640 1 -- 172.21.15.99:0/1374589553 shutdown_connections 2024-09-19T06:55:43.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.006+0000 7f0fa80c9640 1 --2- 172.21.15.99:0/1374589553 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0fa0102ef0 0x7f0fa00fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:43.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.006+0000 7f0fa80c9640 1 --2- 172.21.15.99:0/1374589553 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fa0102550 0x7f0fa0102920 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:43.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.006+0000 7f0fa80c9640 1 -- 172.21.15.99:0/1374589553 >> 172.21.15.99:0/1374589553 conn(0x7f0fa00f80f0 msgr2=0x7f0fa00fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:43.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.006+0000 7f0fa80c9640 1 -- 172.21.15.99:0/1374589553 shutdown_connections 2024-09-19T06:55:43.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.006+0000 7f0fa80c9640 1 -- 172.21.15.99:0/1374589553 wait complete. 2024-09-19T06:55:43.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.006+0000 7f0fa80c9640 1 Processor -- start 2024-09-19T06:55:43.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.006+0000 7f0fa80c9640 1 -- start start 2024-09-19T06:55:43.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.007+0000 7f0fa80c9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fa0102550 0x7f0fa0113540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:43.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.007+0000 7f0fa80c9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0fa0102ef0 0x7f0fa0113a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:43.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.007+0000 7f0fa80c9640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa01140d0 con 0x7f0fa0102550 2024-09-19T06:55:43.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.007+0000 7f0fa80c9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa010d4e0 con 0x7f0fa0102ef0 2024-09-19T06:55:43.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.007+0000 7f0fa5e65640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fa0102550 0x7f0fa0113540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:43.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.007+0000 7f0fa5e65640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fa0102550 0x7f0fa0113540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53848/0 (socket says 172.21.15.99:53848) 2024-09-19T06:55:43.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.007+0000 7f0fa5e65640 1 -- 172.21.15.99:0/1602907287 learned_addr learned my addr 172.21.15.99:0/1602907287 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:55:43.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.007+0000 7f0fa5664640 1 --2- 172.21.15.99:0/1602907287 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0fa0102ef0 0x7f0fa0113a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:43.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.007+0000 7f0fa5e65640 1 -- 172.21.15.99:0/1602907287 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0fa0102ef0 msgr2=0x7f0fa0113a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:43.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.007+0000 7f0fa5e65640 1 --2- 172.21.15.99:0/1602907287 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0fa0102ef0 0x7f0fa0113a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:43.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.007+0000 7f0fa5e65640 1 -- 172.21.15.99:0/1602907287 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f9c005040 con 0x7f0fa0102550 2024-09-19T06:55:43.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.007+0000 7f0fa5664640 1 --2- 172.21.15.99:0/1602907287 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0fa0102ef0 0x7f0fa0113a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:55:43.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.007+0000 7f0fa5e65640 1 --2- 172.21.15.99:0/1602907287 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fa0102550 0x7f0fa0113540 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c000c00 tx=0x7f0f9c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:43.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.007+0000 7f0f927fc640 1 -- 172.21.15.99:0/1602907287 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f9c038070 con 0x7f0fa0102550 2024-09-19T06:55:43.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.007+0000 7f0f927fc640 1 -- 172.21.15.99:0/1602907287 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0f9c02ade0 con 0x7f0fa0102550 2024-09-19T06:55:43.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.007+0000 7f0fa80c9640 1 -- 172.21.15.99:0/1602907287 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fa010d760 con 0x7f0fa0102550 2024-09-19T06:55:43.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.007+0000 7f0f927fc640 1 -- 172.21.15.99:0/1602907287 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f9c02c7e0 con 0x7f0fa0102550 2024-09-19T06:55:43.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.008+0000 7f0fa80c9640 1 -- 172.21.15.99:0/1602907287 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fa010dca0 con 0x7f0fa0102550 2024-09-19T06:55:43.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.009+0000 7f0fa80c9640 1 -- 172.21.15.99:0/1602907287 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fa00fdcd0 con 0x7f0fa0102550 2024-09-19T06:55:43.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.009+0000 7f0f927fc640 1 -- 172.21.15.99:0/1602907287 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f0f9c030020 con 0x7f0fa0102550 2024-09-19T06:55:43.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.009+0000 7f0f927fc640 1 --2- 172.21.15.99:0/1602907287 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f0f8c06e530 0x7f0f8c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:43.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.010+0000 7f0f927fc640 1 -- 172.21.15.99:0/1602907287 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f0f9c0addf0 con 0x7f0fa0102550 2024-09-19T06:55:43.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.010+0000 7f0fa5664640 1 --2- 172.21.15.99:0/1602907287 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f0f8c06e530 0x7f0f8c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:43.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.010+0000 7f0fa5664640 1 --2- 172.21.15.99:0/1602907287 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f0f8c06e530 0x7f0f8c0709e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0f94007fd0 tx=0x7f0f94009e90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:43.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.014+0000 7f0f927fc640 1 -- 172.21.15.99:0/1602907287 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f0f9c076f90 con 0x7f0fa0102550 2024-09-19T06:55:43.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.191+0000 7f0fa80c9640 1 -- 172.21.15.99:0/1602907287 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0fa004b750 con 0x7f0f8c06e530 2024-09-19T06:55:43.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.200+0000 7f0f927fc640 1 -- 172.21.15.99:0/1602907287 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f0fa004b750 con 0x7f0f8c06e530 2024-09-19T06:55:43.201 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T06:55:43.201 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.smithi099 smithi099 *:9093,9094 running (14m) 7m ago 23m 23.4M - 0.25.0 c8568f914cd2 e7c1774d56b0 2024-09-19T06:55:43.202 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi099 smithi099 running (11m) 7m ago 23m 6899k - 19.1.1-361-g2f599a46 d2baa855c067 b9775f416b10 2024-09-19T06:55:43.202 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi117 smithi117 running (11m) 6m ago 22m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 38cf60c0d548 2024-09-19T06:55:43.202 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.smithi099 smithi099 *:3000 running (13m) 7m ago 22m 80.7M - 9.4.12 2bacad6d85d8 cd53a18d5410 2024-09-19T06:55:43.202 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.obarqf smithi099 running (7m) 7m ago 17m 12.2M - 19.1.1-361-g2f599a46 d2baa855c067 314a73082521 2024-09-19T06:55:43.202 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.xehbxe smithi099 running (7m) 7m ago 17m 14.4M - 19.1.1-361-g2f599a46 d2baa855c067 a2955a9d06e6 2024-09-19T06:55:43.202 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.bheqzh smithi117 running (6m) 6m ago 17m 11.8M - 19.1.1-361-g2f599a46 d2baa855c067 b1505937c0b7 2024-09-19T06:55:43.202 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.nooexo smithi117 running (7m) 6m ago 17m 13.1M - 19.1.1-361-g2f599a46 d2baa855c067 35bd7725855c 2024-09-19T06:55:43.202 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi099.pgvkqi smithi099 *:8443,9283,8765 running (14m) 7m ago 24m 505M - 19.1.1-361-g2f599a46 d2baa855c067 d5de99cb7e78 2024-09-19T06:55:43.202 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi117.ssmkcf smithi117 *:8443,9283,8765 running (13m) 6m ago 22m 444M - 19.1.1-361-g2f599a46 d2baa855c067 8b7ee0f871f5 2024-09-19T06:55:43.202 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi099 smithi099 running (12m) 7m ago 24m 52.4M 2048M 19.1.1-361-g2f599a46 d2baa855c067 ffe067438824 2024-09-19T06:55:43.202 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi117 smithi117 running (11m) 6m ago 22m 38.9M 2048M 19.1.1-361-g2f599a46 d2baa855c067 4cb7455e3ee7 2024-09-19T06:55:43.202 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi099 smithi099 *:9100 running (14m) 7m ago 23m 15.0M - 1.5.0 0da6a335fe13 dca7b4517dcc 2024-09-19T06:55:43.202 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi117 smithi117 *:9100 running (14m) 6m ago 22m 15.9M - 1.5.0 0da6a335fe13 8233ce3835d2 2024-09-19T06:55:43.203 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (10m) 7m ago 21m 100M 1557M 19.1.1-361-g2f599a46 d2baa855c067 8e22543bf933 2024-09-19T06:55:43.203 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (10m) 7m ago 21m 106M 1557M 19.1.1-361-g2f599a46 d2baa855c067 f54153d0ae09 2024-09-19T06:55:43.203 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (9m) 7m ago 20m 83.7M 1557M 19.1.1-361-g2f599a46 d2baa855c067 b1778ab88870 2024-09-19T06:55:43.203 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi117 running (9m) 6m ago 20m 102M 2581M 19.1.1-361-g2f599a46 d2baa855c067 ea5236b193d3 2024-09-19T06:55:43.203 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi117 running (8m) 6m ago 19m 93.5M 2581M 19.1.1-361-g2f599a46 d2baa855c067 27ac2c859a68 2024-09-19T06:55:43.203 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi117 running (8m) 6m ago 19m 100M 2581M 19.1.1-361-g2f599a46 d2baa855c067 de6aeb8544ce 2024-09-19T06:55:43.203 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.smithi099 smithi099 *:9095 running (13m) 7m ago 22m 64.4M - 2.43.0 a07b618ecd1d 15ad26ec6fb4 2024-09-19T06:55:43.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.202+0000 7f0fa80c9640 1 -- 172.21.15.99:0/1602907287 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f0f8c06e530 msgr2=0x7f0f8c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:43.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.202+0000 7f0fa80c9640 1 --2- 172.21.15.99:0/1602907287 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f0f8c06e530 0x7f0f8c0709e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0f94007fd0 tx=0x7f0f94009e90 comp rx=0 tx=0).stop 2024-09-19T06:55:43.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.202+0000 7f0fa80c9640 1 -- 172.21.15.99:0/1602907287 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fa0102550 msgr2=0x7f0fa0113540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:43.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.202+0000 7f0fa80c9640 1 --2- 172.21.15.99:0/1602907287 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fa0102550 0x7f0fa0113540 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c000c00 tx=0x7f0f9c009da0 comp rx=0 tx=0).stop 2024-09-19T06:55:43.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.202+0000 7f0fa80c9640 1 -- 172.21.15.99:0/1602907287 shutdown_connections 2024-09-19T06:55:43.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.202+0000 7f0fa80c9640 1 --2- 172.21.15.99:0/1602907287 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f0f8c06e530 0x7f0f8c0709e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:43.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.202+0000 7f0fa80c9640 1 --2- 172.21.15.99:0/1602907287 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0fa0102ef0 0x7f0fa0113a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:43.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.202+0000 7f0fa80c9640 1 --2- 172.21.15.99:0/1602907287 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0fa0102550 0x7f0fa0113540 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:43.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.202+0000 7f0fa80c9640 1 -- 172.21.15.99:0/1602907287 >> 172.21.15.99:0/1602907287 conn(0x7f0fa00f80f0 msgr2=0x7f0fa00f9160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:43.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.203+0000 7f0fa80c9640 1 -- 172.21.15.99:0/1602907287 shutdown_connections 2024-09-19T06:55:43.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.203+0000 7f0fa80c9640 1 -- 172.21.15.99:0/1602907287 wait complete. 2024-09-19T06:55:43.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.279+0000 7f952cd48640 1 -- 172.21.15.99:0/3006761373 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95281014c0 msgr2=0x7f9528101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:43.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.279+0000 7f952cd48640 1 --2- 172.21.15.99:0/3006761373 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95281014c0 0x7f9528101890 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f95180048d0 tx=0x7f9518009da0 comp rx=0 tx=0).stop 2024-09-19T06:55:43.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.279+0000 7f952cd48640 1 -- 172.21.15.99:0/3006761373 shutdown_connections 2024-09-19T06:55:43.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.279+0000 7f952cd48640 1 --2- 172.21.15.99:0/3006761373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95280fb480 0x7f95280fb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:43.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.279+0000 7f952cd48640 1 --2- 172.21.15.99:0/3006761373 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95281014c0 0x7f9528101890 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:43.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.279+0000 7f952cd48640 1 -- 172.21.15.99:0/3006761373 >> 172.21.15.99:0/3006761373 conn(0x7f95280f7000 msgr2=0x7f95280f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:43.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.279+0000 7f952cd48640 1 -- 172.21.15.99:0/3006761373 shutdown_connections 2024-09-19T06:55:43.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.279+0000 7f952cd48640 1 -- 172.21.15.99:0/3006761373 wait complete. 2024-09-19T06:55:43.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.280+0000 7f952cd48640 1 Processor -- start 2024-09-19T06:55:43.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.280+0000 7f952cd48640 1 -- start start 2024-09-19T06:55:43.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.280+0000 7f952cd48640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95280fb480 0x7f952810e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:43.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.280+0000 7f952cd48640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95281014c0 0x7f952810e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:43.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.280+0000 7f952cd48640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952810ecb0 con 0x7f95280fb480 2024-09-19T06:55:43.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.280+0000 7f952cd48640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952810ee20 con 0x7f95281014c0 2024-09-19T06:55:43.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.280+0000 7f952659c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95280fb480 0x7f952810e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:43.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.280+0000 7f952659c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95280fb480 0x7f952810e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53854/0 (socket says 172.21.15.99:53854) 2024-09-19T06:55:43.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.280+0000 7f952659c640 1 -- 172.21.15.99:0/1546205891 learned_addr learned my addr 172.21.15.99:0/1546205891 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:55:43.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.280+0000 7f952659c640 1 -- 172.21.15.99:0/1546205891 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95281014c0 msgr2=0x7f952810e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:43.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.280+0000 7f952659c640 1 --2- 172.21.15.99:0/1546205891 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95281014c0 0x7f952810e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:43.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.280+0000 7f952659c640 1 -- 172.21.15.99:0/1546205891 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9518005040 con 0x7f95280fb480 2024-09-19T06:55:43.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.280+0000 7f952659c640 1 --2- 172.21.15.99:0/1546205891 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95280fb480 0x7f952810e170 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f95180043d0 tx=0x7f9518009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:43.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.281+0000 7f951effd640 1 -- 172.21.15.99:0/1546205891 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9518038070 con 0x7f95280fb480 2024-09-19T06:55:43.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.281+0000 7f951effd640 1 -- 172.21.15.99:0/1546205891 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f95180096e0 con 0x7f95280fb480 2024-09-19T06:55:43.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.281+0000 7f952cd48640 1 -- 172.21.15.99:0/1546205891 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95281171e0 con 0x7f95280fb480 2024-09-19T06:55:43.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.281+0000 7f951effd640 1 -- 172.21.15.99:0/1546205891 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f951803d420 con 0x7f95280fb480 2024-09-19T06:55:43.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.281+0000 7f952cd48640 1 -- 172.21.15.99:0/1546205891 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95281176a0 con 0x7f95280fb480 2024-09-19T06:55:43.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.282+0000 7f952cd48640 1 -- 172.21.15.99:0/1546205891 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95280fcbc0 con 0x7f95280fb480 2024-09-19T06:55:43.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.282+0000 7f951effd640 1 -- 172.21.15.99:0/1546205891 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f9518030020 con 0x7f95280fb480 2024-09-19T06:55:43.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.283+0000 7f951effd640 1 --2- 172.21.15.99:0/1546205891 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f951406e530 0x7f95140709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:43.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.283+0000 7f951effd640 1 -- 172.21.15.99:0/1546205891 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f95180ae6c0 con 0x7f95280fb480 2024-09-19T06:55:43.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.283+0000 7f951ffff640 1 --2- 172.21.15.99:0/1546205891 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f951406e530 0x7f95140709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:43.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.283+0000 7f951ffff640 1 --2- 172.21.15.99:0/1546205891 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f951406e530 0x7f95140709e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9528066470 tx=0x7f9510009c50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:43.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.287+0000 7f951effd640 1 -- 172.21.15.99:0/1546205891 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f95180777b0 con 0x7f95280fb480 2024-09-19T06:55:43.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.520+0000 7f952cd48640 1 -- 172.21.15.99:0/1546205891 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f95280fac40 con 0x7f95280fb480 2024-09-19T06:55:43.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.521+0000 7f951effd640 1 -- 172.21.15.99:0/1546205891 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f951807ae70 con 0x7f95280fb480 2024-09-19T06:55:43.522 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:55:43.522 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-09-19T06:55:43.522 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T06:55:43.523 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:55:43.523 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-09-19T06:55:43.523 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T06:55:43.523 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:55:43.523 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-09-19T06:55:43.523 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 6 2024-09-19T06:55:43.523 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:55:43.523 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": { 2024-09-19T06:55:43.523 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 4 2024-09-19T06:55:43.523 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:55:43.523 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-09-19T06:55:43.523 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 14 2024-09-19T06:55:43.523 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T06:55:43.523 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:55:43.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.523+0000 7f952cd48640 1 -- 172.21.15.99:0/1546205891 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f951406e530 msgr2=0x7f95140709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:43.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.523+0000 7f952cd48640 1 --2- 172.21.15.99:0/1546205891 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f951406e530 0x7f95140709e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9528066470 tx=0x7f9510009c50 comp rx=0 tx=0).stop 2024-09-19T06:55:43.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.523+0000 7f952cd48640 1 -- 172.21.15.99:0/1546205891 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95280fb480 msgr2=0x7f952810e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:43.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.523+0000 7f952cd48640 1 --2- 172.21.15.99:0/1546205891 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95280fb480 0x7f952810e170 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f95180043d0 tx=0x7f9518009da0 comp rx=0 tx=0).stop 2024-09-19T06:55:43.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.523+0000 7f952cd48640 1 -- 172.21.15.99:0/1546205891 shutdown_connections 2024-09-19T06:55:43.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.523+0000 7f952cd48640 1 --2- 172.21.15.99:0/1546205891 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f951406e530 0x7f95140709e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:43.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.523+0000 7f952cd48640 1 --2- 172.21.15.99:0/1546205891 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95281014c0 0x7f952810e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:43.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.523+0000 7f952cd48640 1 --2- 172.21.15.99:0/1546205891 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95280fb480 0x7f952810e170 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:43.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.523+0000 7f952cd48640 1 -- 172.21.15.99:0/1546205891 >> 172.21.15.99:0/1546205891 conn(0x7f95280f7000 msgr2=0x7f95280f88b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:43.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.523+0000 7f952cd48640 1 -- 172.21.15.99:0/1546205891 shutdown_connections 2024-09-19T06:55:43.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.523+0000 7f952cd48640 1 -- 172.21.15.99:0/1546205891 wait complete. 2024-09-19T06:55:43.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.602+0000 7fa4bbe6a640 1 -- 172.21.15.99:0/3706782721 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa4b4065c10 msgr2=0x7fa4b40fe0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:43.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.602+0000 7fa4bbe6a640 1 --2- 172.21.15.99:0/3706782721 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa4b4065c10 0x7fa4b40fe0d0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fa4b00048d0 tx=0x7fa4b0009da0 comp rx=0 tx=0).stop 2024-09-19T06:55:43.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.602+0000 7fa4bbe6a640 1 -- 172.21.15.99:0/3706782721 shutdown_connections 2024-09-19T06:55:43.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.602+0000 7fa4bbe6a640 1 --2- 172.21.15.99:0/3706782721 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa4b4065c10 0x7fa4b40fe0d0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:43.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.602+0000 7fa4bbe6a640 1 --2- 172.21.15.99:0/3706782721 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4b4065300 0x7fa4b40656d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:43.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.602+0000 7fa4bbe6a640 1 -- 172.21.15.99:0/3706782721 >> 172.21.15.99:0/3706782721 conn(0x7fa4b40723b0 msgr2=0x7fa4b40727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:43.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.602+0000 7fa4bbe6a640 1 -- 172.21.15.99:0/3706782721 shutdown_connections 2024-09-19T06:55:43.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.602+0000 7fa4bbe6a640 1 -- 172.21.15.99:0/3706782721 wait complete. 2024-09-19T06:55:43.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.602+0000 7fa4bbe6a640 1 Processor -- start 2024-09-19T06:55:43.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.602+0000 7fa4bbe6a640 1 -- start start 2024-09-19T06:55:43.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.602+0000 7fa4bbe6a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa4b4065300 0x7fa4b41131b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:43.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.603+0000 7fa4bbe6a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4b4065c10 0x7fa4b41136f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:43.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.603+0000 7fa4bbe6a640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b4113cf0 con 0x7fa4b4065300 2024-09-19T06:55:43.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.603+0000 7fa4bbe6a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4b410d130 con 0x7fa4b4065c10 2024-09-19T06:55:43.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.603+0000 7fa4b9c06640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa4b4065300 0x7fa4b41131b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:43.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.603+0000 7fa4b9c06640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa4b4065300 0x7fa4b41131b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53880/0 (socket says 172.21.15.99:53880) 2024-09-19T06:55:43.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.603+0000 7fa4b9c06640 1 -- 172.21.15.99:0/254480699 learned_addr learned my addr 172.21.15.99:0/254480699 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:55:43.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.603+0000 7fa4b9405640 1 --2- 172.21.15.99:0/254480699 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4b4065c10 0x7fa4b41136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:43.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.603+0000 7fa4b9c06640 1 -- 172.21.15.99:0/254480699 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4b4065c10 msgr2=0x7fa4b41136f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:43.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.603+0000 7fa4b9c06640 1 --2- 172.21.15.99:0/254480699 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4b4065c10 0x7fa4b41136f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:43.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.603+0000 7fa4b9c06640 1 -- 172.21.15.99:0/254480699 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4b0005040 con 0x7fa4b4065300 2024-09-19T06:55:43.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.603+0000 7fa4b9c06640 1 --2- 172.21.15.99:0/254480699 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa4b4065300 0x7fa4b41131b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa4a8002a50 tx=0x7fa4a8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:43.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.603+0000 7fa4a67fc640 1 -- 172.21.15.99:0/254480699 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4a8007c30 con 0x7fa4b4065300 2024-09-19T06:55:43.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.603+0000 7fa4a67fc640 1 -- 172.21.15.99:0/254480699 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa4a800f040 con 0x7fa4b4065300 2024-09-19T06:55:43.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.603+0000 7fa4bbe6a640 1 -- 172.21.15.99:0/254480699 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4b410d410 con 0x7fa4b4065300 2024-09-19T06:55:43.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.603+0000 7fa4a67fc640 1 -- 172.21.15.99:0/254480699 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4a800da10 con 0x7fa4b4065300 2024-09-19T06:55:43.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.603+0000 7fa4bbe6a640 1 -- 172.21.15.99:0/254480699 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4b410d980 con 0x7fa4b4065300 2024-09-19T06:55:43.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.604+0000 7fa4bbe6a640 1 -- 172.21.15.99:0/254480699 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4b40fdce0 con 0x7fa4b4065300 2024-09-19T06:55:43.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.605+0000 7fa4a67fc640 1 -- 172.21.15.99:0/254480699 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fa4a800dc80 con 0x7fa4b4065300 2024-09-19T06:55:43.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.605+0000 7fa4a67fc640 1 --2- 172.21.15.99:0/254480699 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa4a006e530 0x7fa4a00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:43.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.605+0000 7fa4a67fc640 1 -- 172.21.15.99:0/254480699 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fa4a808d930 con 0x7fa4b4065300 2024-09-19T06:55:43.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.605+0000 7fa4b9405640 1 --2- 172.21.15.99:0/254480699 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa4a006e530 0x7fa4a00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:43.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.606+0000 7fa4b9405640 1 --2- 172.21.15.99:0/254480699 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa4a006e530 0x7fa4a00709e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa4b0009ac0 tx=0x7fa4b0035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:43.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.610+0000 7fa4a67fc640 1 -- 172.21.15.99:0/254480699 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fa4a8056ad0 con 0x7fa4b4065300 2024-09-19T06:55:43.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.811+0000 7fa4bbe6a640 1 -- 172.21.15.99:0/254480699 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa4b404b780 con 0x7fa4b4065300 2024-09-19T06:55:43.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.811+0000 7fa4a67fc640 1 -- 172.21.15.99:0/254480699 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 29 v29) v1 ==== 76+0+1915 (secure 0 0 0) 0x7fa4a805a190 con 0x7fa4b4065300 2024-09-19T06:55:43.813 INFO:teuthology.orchestra.run.smithi099.stdout:e29 2024-09-19T06:55:43.813 INFO:teuthology.orchestra.run.smithi099.stdout:btime 2024-09-19T06:48:47:938420+0000 2024-09-19T06:55:43.813 INFO:teuthology.orchestra.run.smithi099.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T06:55:43.813 INFO:teuthology.orchestra.run.smithi099.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T06:55:43.813 INFO:teuthology.orchestra.run.smithi099.stdout:legacy client fscid: 1 2024-09-19T06:55:43.813 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:55:43.813 INFO:teuthology.orchestra.run.smithi099.stdout:Filesystem 'cephfs' (1) 2024-09-19T06:55:43.813 INFO:teuthology.orchestra.run.smithi099.stdout:fs_name cephfs 2024-09-19T06:55:43.813 INFO:teuthology.orchestra.run.smithi099.stdout:epoch 20 2024-09-19T06:55:43.813 INFO:teuthology.orchestra.run.smithi099.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-19T06:55:43.813 INFO:teuthology.orchestra.run.smithi099.stdout:created 2024-09-19T06:37:40.838146+0000 2024-09-19T06:55:43.813 INFO:teuthology.orchestra.run.smithi099.stdout:modified 2024-09-19T06:47:50.076553+0000 2024-09-19T06:55:43.814 INFO:teuthology.orchestra.run.smithi099.stdout:tableserver 0 2024-09-19T06:55:43.814 INFO:teuthology.orchestra.run.smithi099.stdout:root 0 2024-09-19T06:55:43.814 INFO:teuthology.orchestra.run.smithi099.stdout:session_timeout 60 2024-09-19T06:55:43.814 INFO:teuthology.orchestra.run.smithi099.stdout:session_autoclose 300 2024-09-19T06:55:43.814 INFO:teuthology.orchestra.run.smithi099.stdout:max_file_size 1099511627776 2024-09-19T06:55:43.814 INFO:teuthology.orchestra.run.smithi099.stdout:max_xattr_size 65536 2024-09-19T06:55:43.814 INFO:teuthology.orchestra.run.smithi099.stdout:required_client_features {} 2024-09-19T06:55:43.814 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure 0 2024-09-19T06:55:43.814 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure_osd_epoch 77 2024-09-19T06:55:43.814 INFO:teuthology.orchestra.run.smithi099.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T06:55:43.814 INFO:teuthology.orchestra.run.smithi099.stdout:max_mds 2 2024-09-19T06:55:43.814 INFO:teuthology.orchestra.run.smithi099.stdout:in 0,1 2024-09-19T06:55:43.814 INFO:teuthology.orchestra.run.smithi099.stdout:up {} 2024-09-19T06:55:43.814 INFO:teuthology.orchestra.run.smithi099.stdout:failed 0,1 2024-09-19T06:55:43.815 INFO:teuthology.orchestra.run.smithi099.stdout:damaged 2024-09-19T06:55:43.815 INFO:teuthology.orchestra.run.smithi099.stdout:stopped 2024-09-19T06:55:43.815 INFO:teuthology.orchestra.run.smithi099.stdout:data_pools [3] 2024-09-19T06:55:43.815 INFO:teuthology.orchestra.run.smithi099.stdout:metadata_pool 2 2024-09-19T06:55:43.815 INFO:teuthology.orchestra.run.smithi099.stdout:inline_data disabled 2024-09-19T06:55:43.815 INFO:teuthology.orchestra.run.smithi099.stdout:balancer 2024-09-19T06:55:43.815 INFO:teuthology.orchestra.run.smithi099.stdout:bal_rank_mask -1 2024-09-19T06:55:43.815 INFO:teuthology.orchestra.run.smithi099.stdout:standby_count_wanted 1 2024-09-19T06:55:43.815 INFO:teuthology.orchestra.run.smithi099.stdout:qdb_cluster leader: 0 members: 2024-09-19T06:55:43.815 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:55:43.815 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:55:43.815 INFO:teuthology.orchestra.run.smithi099.stdout:Standby daemons: 2024-09-19T06:55:43.815 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:55:43.815 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.obarqf{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6826/1859154203,v1:172.21.15.99:6827/1859154203] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:55:43.815 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.xehbxe{-1:34410} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6828/1939453719,v1:172.21.15.99:6829/1939453719] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:55:43.816 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.nooexo{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6824/1398895079,v1:172.21.15.117:6825/1398895079] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:55:43.816 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.bheqzh{-1:44329} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6826/3233337308,v1:172.21.15.117:6827/3233337308] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:55:43.816 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 29 2024-09-19T06:55:43.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.814+0000 7fa4bbe6a640 1 -- 172.21.15.99:0/254480699 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa4a006e530 msgr2=0x7fa4a00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:43.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.814+0000 7fa4bbe6a640 1 --2- 172.21.15.99:0/254480699 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa4a006e530 0x7fa4a00709e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa4b0009ac0 tx=0x7fa4b0035040 comp rx=0 tx=0).stop 2024-09-19T06:55:43.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.814+0000 7fa4bbe6a640 1 -- 172.21.15.99:0/254480699 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa4b4065300 msgr2=0x7fa4b41131b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:43.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.814+0000 7fa4bbe6a640 1 --2- 172.21.15.99:0/254480699 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa4b4065300 0x7fa4b41131b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa4a8002a50 tx=0x7fa4a8004600 comp rx=0 tx=0).stop 2024-09-19T06:55:43.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.814+0000 7fa4bbe6a640 1 -- 172.21.15.99:0/254480699 shutdown_connections 2024-09-19T06:55:43.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.814+0000 7fa4bbe6a640 1 --2- 172.21.15.99:0/254480699 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa4a006e530 0x7fa4a00709e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:43.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.814+0000 7fa4bbe6a640 1 --2- 172.21.15.99:0/254480699 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4b4065c10 0x7fa4b41136f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:43.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.814+0000 7fa4bbe6a640 1 --2- 172.21.15.99:0/254480699 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa4b4065300 0x7fa4b41131b0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:43.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.814+0000 7fa4bbe6a640 1 -- 172.21.15.99:0/254480699 >> 172.21.15.99:0/254480699 conn(0x7fa4b40723b0 msgr2=0x7fa4b40fa2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:43.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.816+0000 7fa4bbe6a640 1 -- 172.21.15.99:0/254480699 shutdown_connections 2024-09-19T06:55:43.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.816+0000 7fa4bbe6a640 1 -- 172.21.15.99:0/254480699 wait complete. 2024-09-19T06:55:43.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.895+0000 7f0b3bd72640 1 -- 172.21.15.99:0/2290897053 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b34101560 msgr2=0x7f0b34101930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:43.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.895+0000 7f0b3bd72640 1 --2- 172.21.15.99:0/2290897053 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b34101560 0x7f0b34101930 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f0b240048d0 tx=0x7f0b24009da0 comp rx=0 tx=0).stop 2024-09-19T06:55:43.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.895+0000 7f0b3bd72640 1 -- 172.21.15.99:0/2290897053 shutdown_connections 2024-09-19T06:55:43.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.895+0000 7f0b3bd72640 1 --2- 172.21.15.99:0/2290897053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b340fbe00 0x7f0b340fc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:43.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.895+0000 7f0b3bd72640 1 --2- 172.21.15.99:0/2290897053 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b34101560 0x7f0b34101930 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:43.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.895+0000 7f0b3bd72640 1 -- 172.21.15.99:0/2290897053 >> 172.21.15.99:0/2290897053 conn(0x7f0b34070d50 msgr2=0x7f0b34071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:43.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.895+0000 7f0b3bd72640 1 -- 172.21.15.99:0/2290897053 shutdown_connections 2024-09-19T06:55:43.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.895+0000 7f0b3bd72640 1 -- 172.21.15.99:0/2290897053 wait complete. 2024-09-19T06:55:43.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.895+0000 7f0b3bd72640 1 Processor -- start 2024-09-19T06:55:43.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.896+0000 7f0b3bd72640 1 -- start start 2024-09-19T06:55:43.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.896+0000 7f0b3bd72640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b340fbe00 0x7f0b3410e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:43.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.896+0000 7f0b3bd72640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b34101560 0x7f0b3410e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:43.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.896+0000 7f0b3bd72640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3410ed20 con 0x7f0b34101560 2024-09-19T06:55:43.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.896+0000 7f0b3bd72640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3410ee90 con 0x7f0b340fbe00 2024-09-19T06:55:43.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.896+0000 7f0b3930d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b34101560 0x7f0b3410e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:43.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.896+0000 7f0b3930d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b34101560 0x7f0b3410e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53900/0 (socket says 172.21.15.99:53900) 2024-09-19T06:55:43.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.896+0000 7f0b3930d640 1 -- 172.21.15.99:0/1151177020 learned_addr learned my addr 172.21.15.99:0/1151177020 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:55:43.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.896+0000 7f0b3930d640 1 -- 172.21.15.99:0/1151177020 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b340fbe00 msgr2=0x7f0b3410e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:43.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.896+0000 7f0b3930d640 1 --2- 172.21.15.99:0/1151177020 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b340fbe00 0x7f0b3410e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:43.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.896+0000 7f0b3930d640 1 -- 172.21.15.99:0/1151177020 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b24005040 con 0x7f0b34101560 2024-09-19T06:55:43.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.896+0000 7f0b3930d640 1 --2- 172.21.15.99:0/1151177020 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b34101560 0x7f0b3410e6d0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f0b3000c830 tx=0x7f0b30004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:43.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.896+0000 7f0b2a7fc640 1 -- 172.21.15.99:0/1151177020 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b3000a850 con 0x7f0b34101560 2024-09-19T06:55:43.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.896+0000 7f0b3bd72640 1 -- 172.21.15.99:0/1151177020 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b34117200 con 0x7f0b34101560 2024-09-19T06:55:43.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.896+0000 7f0b2a7fc640 1 -- 172.21.15.99:0/1151177020 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0b3000ae50 con 0x7f0b34101560 2024-09-19T06:55:43.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.897+0000 7f0b2a7fc640 1 -- 172.21.15.99:0/1151177020 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b300113a0 con 0x7f0b34101560 2024-09-19T06:55:43.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.897+0000 7f0b3bd72640 1 -- 172.21.15.99:0/1151177020 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b34117710 con 0x7f0b34101560 2024-09-19T06:55:43.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.898+0000 7f0b3bd72640 1 -- 172.21.15.99:0/1151177020 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b340fce10 con 0x7f0b34101560 2024-09-19T06:55:43.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.898+0000 7f0b2a7fc640 1 -- 172.21.15.99:0/1151177020 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f0b30012400 con 0x7f0b34101560 2024-09-19T06:55:43.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.899+0000 7f0b2a7fc640 1 --2- 172.21.15.99:0/1151177020 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f0b2006e530 0x7f0b200709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:43.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.899+0000 7f0b2a7fc640 1 -- 172.21.15.99:0/1151177020 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f0b3008e360 con 0x7f0b34101560 2024-09-19T06:55:43.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.899+0000 7f0b39b0e640 1 --2- 172.21.15.99:0/1151177020 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f0b2006e530 0x7f0b200709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:43.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.899+0000 7f0b39b0e640 1 --2- 172.21.15.99:0/1151177020 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f0b2006e530 0x7f0b200709e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0b240043d0 tx=0x7f0b24009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:43.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:43.903+0000 7f0b2a7fc640 1 -- 172.21.15.99:0/1151177020 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f0b300574d0 con 0x7f0b34101560 2024-09-19T06:55:44.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:44.087+0000 7f0b3bd72640 1 -- 172.21.15.99:0/1151177020 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0b3404b720 con 0x7f0b2006e530 2024-09-19T06:55:44.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:44.088+0000 7f0b2a7fc640 1 -- 172.21.15.99:0/1151177020 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f0b3404b720 con 0x7f0b2006e530 2024-09-19T06:55:44.089 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:55:44.089 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T06:55:44.089 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": true, 2024-09-19T06:55:44.089 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T06:55:44.089 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [ 2024-09-19T06:55:44.089 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr", 2024-09-19T06:55:44.089 INFO:teuthology.orchestra.run.smithi099.stdout: "crash", 2024-09-19T06:55:44.089 INFO:teuthology.orchestra.run.smithi099.stdout: "mds", 2024-09-19T06:55:44.089 INFO:teuthology.orchestra.run.smithi099.stdout: "mon", 2024-09-19T06:55:44.090 INFO:teuthology.orchestra.run.smithi099.stdout: "osd" 2024-09-19T06:55:44.090 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-19T06:55:44.090 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": "16/21 daemons upgraded", 2024-09-19T06:55:44.090 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "Currently upgrading mds daemons", 2024-09-19T06:55:44.090 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-09-19T06:55:44.090 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:55:44.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:44.090+0000 7f0b3bd72640 1 -- 172.21.15.99:0/1151177020 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f0b2006e530 msgr2=0x7f0b200709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:44.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:44.090+0000 7f0b3bd72640 1 --2- 172.21.15.99:0/1151177020 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f0b2006e530 0x7f0b200709e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0b240043d0 tx=0x7f0b24009da0 comp rx=0 tx=0).stop 2024-09-19T06:55:44.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:44.090+0000 7f0b3bd72640 1 -- 172.21.15.99:0/1151177020 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b34101560 msgr2=0x7f0b3410e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:44.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:44.090+0000 7f0b3bd72640 1 --2- 172.21.15.99:0/1151177020 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b34101560 0x7f0b3410e6d0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f0b3000c830 tx=0x7f0b30004430 comp rx=0 tx=0).stop 2024-09-19T06:55:44.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:44.090+0000 7f0b3bd72640 1 -- 172.21.15.99:0/1151177020 shutdown_connections 2024-09-19T06:55:44.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:44.090+0000 7f0b3bd72640 1 --2- 172.21.15.99:0/1151177020 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f0b2006e530 0x7f0b200709e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:44.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:44.090+0000 7f0b3bd72640 1 --2- 172.21.15.99:0/1151177020 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b34101560 0x7f0b3410e6d0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:44.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:44.090+0000 7f0b3bd72640 1 --2- 172.21.15.99:0/1151177020 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0b340fbe00 0x7f0b3410e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:44.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:44.090+0000 7f0b3bd72640 1 -- 172.21.15.99:0/1151177020 >> 172.21.15.99:0/1151177020 conn(0x7f0b34070d50 msgr2=0x7f0b340fa010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:44.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:44.090+0000 7f0b3bd72640 1 -- 172.21.15.99:0/1151177020 shutdown_connections 2024-09-19T06:55:44.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:44.090+0000 7f0b3bd72640 1 -- 172.21.15.99:0/1151177020 wait complete. 2024-09-19T06:55:44.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:44.167+0000 7f2b8ff1e640 1 -- 172.21.15.99:0/1018442073 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b88102550 msgr2=0x7f2b88102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:44.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:44.167+0000 7f2b8ff1e640 1 --2- 172.21.15.99:0/1018442073 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b88102550 0x7f2b88102920 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f2b780048d0 tx=0x7f2b78009da0 comp rx=0 tx=0).stop 2024-09-19T06:55:44.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:44.167+0000 7f2b8ff1e640 1 -- 172.21.15.99:0/1018442073 shutdown_connections 2024-09-19T06:55:44.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:44.167+0000 7f2b8ff1e640 1 --2- 172.21.15.99:0/1018442073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b88102ef0 0x7f2b880fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:44.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:44.167+0000 7f2b8ff1e640 1 --2- 172.21.15.99:0/1018442073 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b88102550 0x7f2b88102920 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:44.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:44.167+0000 7f2b8ff1e640 1 -- 172.21.15.99:0/1018442073 >> 172.21.15.99:0/1018442073 conn(0x7f2b880f80f0 msgr2=0x7f2b880fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:44.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:44.167+0000 7f2b8ff1e640 1 -- 172.21.15.99:0/1018442073 shutdown_connections 2024-09-19T06:55:44.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:44.167+0000 7f2b8ff1e640 1 -- 172.21.15.99:0/1018442073 wait complete. 2024-09-19T06:55:44.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:44.168+0000 7f2b8ff1e640 1 Processor -- start 2024-09-19T06:55:44.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:44.168+0000 7f2b8ff1e640 1 -- start start 2024-09-19T06:55:44.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:44.168+0000 7f2b8ff1e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b88102550 0x7f2b881135b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:44.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:44.168+0000 7f2b8ff1e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b88102ef0 0x7f2b88113af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:44.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:44.168+0000 7f2b8ff1e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b881141d0 con 0x7f2b88102ef0 2024-09-19T06:55:44.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:44.168+0000 7f2b8ff1e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8810d550 con 0x7f2b88102550 2024-09-19T06:55:44.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:44.168+0000 7f2b8d4b9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b88102ef0 0x7f2b88113af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:44.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:44.168+0000 7f2b8d4b9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b88102ef0 0x7f2b88113af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53924/0 (socket says 172.21.15.99:53924) 2024-09-19T06:55:44.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:44.168+0000 7f2b8d4b9640 1 -- 172.21.15.99:0/895297308 learned_addr learned my addr 172.21.15.99:0/895297308 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:55:44.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:44.168+0000 7f2b8dcba640 1 --2- 172.21.15.99:0/895297308 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b88102550 0x7f2b881135b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:44.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:44.168+0000 7f2b8d4b9640 1 -- 172.21.15.99:0/895297308 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b88102550 msgr2=0x7f2b881135b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:44.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:44.168+0000 7f2b8d4b9640 1 --2- 172.21.15.99:0/895297308 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b88102550 0x7f2b881135b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:44.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:44.168+0000 7f2b8d4b9640 1 -- 172.21.15.99:0/895297308 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b78005040 con 0x7f2b88102ef0 2024-09-19T06:55:44.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:44.169+0000 7f2b8d4b9640 1 --2- 172.21.15.99:0/895297308 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b88102ef0 0x7f2b88113af0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f2b8400b540 tx=0x7f2b840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:44.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:44.169+0000 7f2b7e7fc640 1 -- 172.21.15.99:0/895297308 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b8400f6f0 con 0x7f2b88102ef0 2024-09-19T06:55:44.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:44.169+0000 7f2b7e7fc640 1 -- 172.21.15.99:0/895297308 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2b8400fcf0 con 0x7f2b88102ef0 2024-09-19T06:55:44.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:44.169+0000 7f2b7e7fc640 1 -- 172.21.15.99:0/895297308 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b84011e80 con 0x7f2b88102ef0 2024-09-19T06:55:44.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:44.169+0000 7f2b8ff1e640 1 -- 172.21.15.99:0/895297308 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b8810d7e0 con 0x7f2b88102ef0 2024-09-19T06:55:44.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:44.169+0000 7f2b8ff1e640 1 -- 172.21.15.99:0/895297308 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b8810dcb0 con 0x7f2b88102ef0 2024-09-19T06:55:44.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:44.170+0000 7f2b8ff1e640 1 -- 172.21.15.99:0/895297308 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b880fdcd0 con 0x7f2b88102ef0 2024-09-19T06:55:44.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:44.170+0000 7f2b7e7fc640 1 -- 172.21.15.99:0/895297308 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f2b840116b0 con 0x7f2b88102ef0 2024-09-19T06:55:44.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:44.171+0000 7f2b7e7fc640 1 --2- 172.21.15.99:0/895297308 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f2b7406e530 0x7f2b740709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:55:44.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:44.171+0000 7f2b7e7fc640 1 -- 172.21.15.99:0/895297308 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f2b8408df10 con 0x7f2b88102ef0 2024-09-19T06:55:44.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:44.171+0000 7f2b8dcba640 1 --2- 172.21.15.99:0/895297308 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f2b7406e530 0x7f2b740709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:55:44.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:44.171+0000 7f2b8dcba640 1 --2- 172.21.15.99:0/895297308 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f2b7406e530 0x7f2b740709e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2b780048a0 tx=0x7f2b78035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:55:44.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:44.175+0000 7f2b7e7fc640 1 -- 172.21.15.99:0/895297308 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f2b84057140 con 0x7f2b88102ef0 2024-09-19T06:55:44.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:44.410+0000 7f2b8ff1e640 1 -- 172.21.15.99:0/895297308 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f2b880fbd50 con 0x7f2b88102ef0 2024-09-19T06:55:44.411 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:55:44 smithi099 ceph-mon[97031]: from='client.34782 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:55:44.412 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:55:44 smithi099 ceph-mon[97031]: from='client.34786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:55:44.412 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:55:44 smithi099 ceph-mon[97031]: pgmap v401: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:55:44.412 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:55:44 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/1546205891' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:55:44.412 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:55:44 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/254480699' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:55:44.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:44.410+0000 7f2b7e7fc640 1 -- 172.21.15.99:0/895297308 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7f2b8405a800 con 0x7f2b88102ef0 2024-09-19T06:55:44.412 INFO:teuthology.orchestra.run.smithi099.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-09-19T06:55:44.412 INFO:teuthology.orchestra.run.smithi099.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-19T06:55:44.413 INFO:teuthology.orchestra.run.smithi099.stdout: fs cephfs is degraded 2024-09-19T06:55:44.413 INFO:teuthology.orchestra.run.smithi099.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-19T06:55:44.413 INFO:teuthology.orchestra.run.smithi099.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-19T06:55:44.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:44.413+0000 7f2b8ff1e640 1 -- 172.21.15.99:0/895297308 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f2b7406e530 msgr2=0x7f2b740709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:44.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:44.413+0000 7f2b8ff1e640 1 --2- 172.21.15.99:0/895297308 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f2b7406e530 0x7f2b740709e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2b780048a0 tx=0x7f2b78035040 comp rx=0 tx=0).stop 2024-09-19T06:55:44.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:44.413+0000 7f2b8ff1e640 1 -- 172.21.15.99:0/895297308 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b88102ef0 msgr2=0x7f2b88113af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:55:44.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:44.413+0000 7f2b8ff1e640 1 --2- 172.21.15.99:0/895297308 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b88102ef0 0x7f2b88113af0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f2b8400b540 tx=0x7f2b840091a0 comp rx=0 tx=0).stop 2024-09-19T06:55:44.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:44.413+0000 7f2b8ff1e640 1 -- 172.21.15.99:0/895297308 shutdown_connections 2024-09-19T06:55:44.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:44.413+0000 7f2b8ff1e640 1 --2- 172.21.15.99:0/895297308 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f2b7406e530 0x7f2b740709e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:44.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:44.413+0000 7f2b8ff1e640 1 --2- 172.21.15.99:0/895297308 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b88102ef0 0x7f2b88113af0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:44.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:44.413+0000 7f2b8ff1e640 1 --2- 172.21.15.99:0/895297308 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b88102550 0x7f2b881135b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:55:44.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:44.413+0000 7f2b8ff1e640 1 -- 172.21.15.99:0/895297308 >> 172.21.15.99:0/895297308 conn(0x7f2b880f80f0 msgr2=0x7f2b880f9180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:55:44.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:44.413+0000 7f2b8ff1e640 1 -- 172.21.15.99:0/895297308 shutdown_connections 2024-09-19T06:55:44.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:55:44.413+0000 7f2b8ff1e640 1 -- 172.21.15.99:0/895297308 wait complete. 2024-09-19T06:55:44.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:55:44 smithi117 ceph-mon[76771]: from='client.34782 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:55:44.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:55:44 smithi117 ceph-mon[76771]: from='client.34786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:55:44.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:55:44 smithi117 ceph-mon[76771]: pgmap v401: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:55:44.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:55:44 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/1546205891' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:55:44.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:55:44 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/254480699' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:55:45.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:55:45 smithi099 ceph-mon[97031]: from='client.34790 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:55:45.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:55:45 smithi099 ceph-mon[97031]: from='client.34802 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:55:45.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:55:45 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/895297308' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T06:55:45.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:55:45 smithi117 ceph-mon[76771]: from='client.34790 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:55:45.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:55:45 smithi117 ceph-mon[76771]: from='client.34802 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:55:45.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:55:45 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/895297308' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T06:55:46.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:55:46 smithi099 ceph-mon[97031]: pgmap v402: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:55:46.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:55:46 smithi117 ceph-mon[76771]: pgmap v402: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:55:48.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:55:48 smithi099 ceph-mon[97031]: pgmap v403: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:55:48.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:55:48 smithi117 ceph-mon[76771]: pgmap v403: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:55:50.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:55:50 smithi099 ceph-mon[97031]: pgmap v404: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:55:50.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:55:50 smithi117 ceph-mon[76771]: pgmap v404: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:55:52.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:55:52 smithi099 ceph-mon[97031]: pgmap v405: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:55:52.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:55:52 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:55:52.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:55:52 smithi117 ceph-mon[76771]: pgmap v405: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:55:52.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:55:52 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:55:54.364 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:55:54 smithi117 ceph-mon[76771]: pgmap v406: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:55:54.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:55:54 smithi099 ceph-mon[97031]: pgmap v406: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:55:56.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:55:56 smithi099 ceph-mon[97031]: pgmap v407: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:55:56.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:55:56 smithi117 ceph-mon[76771]: pgmap v407: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:55:58.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:55:58 smithi099 ceph-mon[97031]: pgmap v408: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:55:58.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:55:58 smithi117 ceph-mon[76771]: pgmap v408: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:56:00.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:56:00 smithi099 ceph-mon[97031]: pgmap v409: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:56:00.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:56:00 smithi117 ceph-mon[76771]: pgmap v409: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:56:02.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:56:02 smithi099 ceph-mon[97031]: pgmap v410: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:56:02.564 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:56:02 smithi117 ceph-mon[76771]: pgmap v410: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:56:04.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:56:04 smithi099 ceph-mon[97031]: pgmap v411: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:56:04.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:56:04 smithi117 ceph-mon[76771]: pgmap v411: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:56:06.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:56:06 smithi099 ceph-mon[97031]: pgmap v412: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:56:06.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:56:06 smithi117 ceph-mon[76771]: pgmap v412: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:56:07.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:56:07 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:56:07.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:56:07 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:56:08.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:56:08 smithi099 ceph-mon[97031]: pgmap v413: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:56:08.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:56:08 smithi117 ceph-mon[76771]: pgmap v413: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:56:10.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:56:10 smithi099 ceph-mon[97031]: pgmap v414: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:56:10.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:56:10 smithi117 ceph-mon[76771]: pgmap v414: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:56:11.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:56:11 smithi099 ceph-mon[97031]: pgmap v415: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:56:11.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:56:11 smithi117 ceph-mon[76771]: pgmap v415: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:56:14.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:56:14 smithi117 ceph-mon[76771]: pgmap v416: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:56:14.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:56:14 smithi099 ceph-mon[97031]: pgmap v416: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:56:14.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.505+0000 7f95196ad640 1 -- 172.21.15.99:0/1773982993 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9514102530 msgr2=0x7f9514102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:14.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.505+0000 7f95196ad640 1 --2- 172.21.15.99:0/1773982993 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9514102530 0x7f9514102900 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f9504009c50 tx=0x7f9504004d10 comp rx=0 tx=0).stop 2024-09-19T06:56:14.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.505+0000 7f95196ad640 1 -- 172.21.15.99:0/1773982993 shutdown_connections 2024-09-19T06:56:14.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.505+0000 7f95196ad640 1 --2- 172.21.15.99:0/1773982993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9514102ed0 0x7f95140fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:14.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.505+0000 7f95196ad640 1 --2- 172.21.15.99:0/1773982993 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9514102530 0x7f9514102900 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:14.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.505+0000 7f95196ad640 1 -- 172.21.15.99:0/1773982993 >> 172.21.15.99:0/1773982993 conn(0x7f95140f80f0 msgr2=0x7f95140fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:14.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.505+0000 7f95196ad640 1 -- 172.21.15.99:0/1773982993 shutdown_connections 2024-09-19T06:56:14.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.505+0000 7f95196ad640 1 -- 172.21.15.99:0/1773982993 wait complete. 2024-09-19T06:56:14.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.506+0000 7f95196ad640 1 Processor -- start 2024-09-19T06:56:14.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.506+0000 7f95196ad640 1 -- start start 2024-09-19T06:56:14.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.506+0000 7f95196ad640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9514102530 0x7f951406fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:14.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.506+0000 7f95196ad640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9514102ed0 0x7f951406ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:14.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.506+0000 7f95196ad640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9514070490 con 0x7f9514102530 2024-09-19T06:56:14.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.506+0000 7f95196ad640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9514070600 con 0x7f9514102ed0 2024-09-19T06:56:14.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.506+0000 7f9512ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9514102530 0x7f951406fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:14.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.506+0000 7f9512ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9514102530 0x7f951406fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52234/0 (socket says 172.21.15.99:52234) 2024-09-19T06:56:14.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.506+0000 7f9512ffd640 1 -- 172.21.15.99:0/3709688685 learned_addr learned my addr 172.21.15.99:0/3709688685 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:56:14.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.506+0000 7f95127fc640 1 --2- 172.21.15.99:0/3709688685 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9514102ed0 0x7f951406ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:14.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.507+0000 7f9512ffd640 1 -- 172.21.15.99:0/3709688685 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9514102ed0 msgr2=0x7f951406ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:14.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.507+0000 7f9512ffd640 1 --2- 172.21.15.99:0/3709688685 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9514102ed0 0x7f951406ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:14.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.507+0000 7f9512ffd640 1 -- 172.21.15.99:0/3709688685 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95040098b0 con 0x7f9514102530 2024-09-19T06:56:14.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.507+0000 7f9512ffd640 1 --2- 172.21.15.99:0/3709688685 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9514102530 0x7f951406fa10 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f9504004750 tx=0x7f9504004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:14.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.507+0000 7f950b7fe640 1 -- 172.21.15.99:0/3709688685 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9504009540 con 0x7f9514102530 2024-09-19T06:56:14.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.507+0000 7f95196ad640 1 -- 172.21.15.99:0/3709688685 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9514070830 con 0x7f9514102530 2024-09-19T06:56:14.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.507+0000 7f950b7fe640 1 -- 172.21.15.99:0/3709688685 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f95040096a0 con 0x7f9514102530 2024-09-19T06:56:14.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.507+0000 7f950b7fe640 1 -- 172.21.15.99:0/3709688685 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f950403d960 con 0x7f9514102530 2024-09-19T06:56:14.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.507+0000 7f95196ad640 1 -- 172.21.15.99:0/3709688685 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9514119910 con 0x7f9514102530 2024-09-19T06:56:14.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.508+0000 7f95196ad640 1 -- 172.21.15.99:0/3709688685 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95140fdcb0 con 0x7f9514102530 2024-09-19T06:56:14.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.509+0000 7f950b7fe640 1 -- 172.21.15.99:0/3709688685 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f950402f030 con 0x7f9514102530 2024-09-19T06:56:14.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.509+0000 7f950b7fe640 1 --2- 172.21.15.99:0/3709688685 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f950006e530 0x7f95000709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:14.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.509+0000 7f950b7fe640 1 -- 172.21.15.99:0/3709688685 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f95040af060 con 0x7f9514102530 2024-09-19T06:56:14.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.509+0000 7f95127fc640 1 --2- 172.21.15.99:0/3709688685 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f950006e530 0x7f95000709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:14.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.510+0000 7f95127fc640 1 --2- 172.21.15.99:0/3709688685 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f950006e530 0x7f95000709e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9514071350 tx=0x7f94fc00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:14.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.514+0000 7f950b7fe640 1 -- 172.21.15.99:0/3709688685 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f9504078150 con 0x7f9514102530 2024-09-19T06:56:14.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.696+0000 7f95196ad640 1 -- 172.21.15.99:0/3709688685 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9514071100 con 0x7f950006e530 2024-09-19T06:56:14.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.697+0000 7f950b7fe640 1 -- 172.21.15.99:0/3709688685 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f9514071100 con 0x7f950006e530 2024-09-19T06:56:14.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.699+0000 7f95196ad640 1 -- 172.21.15.99:0/3709688685 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f950006e530 msgr2=0x7f95000709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:14.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.699+0000 7f95196ad640 1 --2- 172.21.15.99:0/3709688685 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f950006e530 0x7f95000709e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9514071350 tx=0x7f94fc00b040 comp rx=0 tx=0).stop 2024-09-19T06:56:14.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.699+0000 7f95196ad640 1 -- 172.21.15.99:0/3709688685 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9514102530 msgr2=0x7f951406fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:14.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.699+0000 7f95196ad640 1 --2- 172.21.15.99:0/3709688685 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9514102530 0x7f951406fa10 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f9504004750 tx=0x7f9504004d10 comp rx=0 tx=0).stop 2024-09-19T06:56:14.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.699+0000 7f95196ad640 1 -- 172.21.15.99:0/3709688685 shutdown_connections 2024-09-19T06:56:14.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.699+0000 7f95196ad640 1 --2- 172.21.15.99:0/3709688685 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f950006e530 0x7f95000709e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:14.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.699+0000 7f95196ad640 1 --2- 172.21.15.99:0/3709688685 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9514102ed0 0x7f951406ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:14.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.699+0000 7f95196ad640 1 --2- 172.21.15.99:0/3709688685 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9514102530 0x7f951406fa10 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:14.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.699+0000 7f95196ad640 1 -- 172.21.15.99:0/3709688685 >> 172.21.15.99:0/3709688685 conn(0x7f95140f80f0 msgr2=0x7f95140f90f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:14.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.699+0000 7f95196ad640 1 -- 172.21.15.99:0/3709688685 shutdown_connections 2024-09-19T06:56:14.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.699+0000 7f95196ad640 1 -- 172.21.15.99:0/3709688685 wait complete. 2024-09-19T06:56:14.709 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-09-19T06:56:14.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.779+0000 7f62a5c7f640 1 -- 172.21.15.99:0/1658702156 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62a00fb4a0 msgr2=0x7f62a00fb910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:14.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.779+0000 7f62a5c7f640 1 --2- 172.21.15.99:0/1658702156 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62a00fb4a0 0x7f62a00fb910 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f62880048d0 tx=0x7f6288009da0 comp rx=0 tx=0).stop 2024-09-19T06:56:14.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.779+0000 7f62a5c7f640 1 -- 172.21.15.99:0/1658702156 shutdown_connections 2024-09-19T06:56:14.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.779+0000 7f62a5c7f640 1 --2- 172.21.15.99:0/1658702156 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62a00fb4a0 0x7f62a00fb910 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:14.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.779+0000 7f62a5c7f640 1 --2- 172.21.15.99:0/1658702156 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62a01014e0 0x7f62a01018b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:14.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.779+0000 7f62a5c7f640 1 -- 172.21.15.99:0/1658702156 >> 172.21.15.99:0/1658702156 conn(0x7f62a00f7060 msgr2=0x7f62a00f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:14.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.779+0000 7f62a5c7f640 1 -- 172.21.15.99:0/1658702156 shutdown_connections 2024-09-19T06:56:14.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.779+0000 7f62a5c7f640 1 -- 172.21.15.99:0/1658702156 wait complete. 2024-09-19T06:56:14.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.780+0000 7f62a5c7f640 1 Processor -- start 2024-09-19T06:56:14.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.780+0000 7f62a5c7f640 1 -- start start 2024-09-19T06:56:14.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.780+0000 7f62a5c7f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62a00fb4a0 0x7f62a01120d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:14.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.780+0000 7f62a5c7f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62a01014e0 0x7f62a0112610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:14.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.780+0000 7f62a5c7f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a0112c10 con 0x7f62a01014e0 2024-09-19T06:56:14.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.780+0000 7f62a5c7f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a010c050 con 0x7f62a00fb4a0 2024-09-19T06:56:14.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.780+0000 7f6297fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62a01014e0 0x7f62a0112610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:14.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.780+0000 7f6297fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62a01014e0 0x7f62a0112610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52256/0 (socket says 172.21.15.99:52256) 2024-09-19T06:56:14.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.780+0000 7f6297fff640 1 -- 172.21.15.99:0/3598960197 learned_addr learned my addr 172.21.15.99:0/3598960197 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:56:14.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.780+0000 7f629f7fe640 1 --2- 172.21.15.99:0/3598960197 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62a00fb4a0 0x7f62a01120d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:14.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.781+0000 7f6297fff640 1 -- 172.21.15.99:0/3598960197 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62a00fb4a0 msgr2=0x7f62a01120d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:14.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.781+0000 7f6297fff640 1 --2- 172.21.15.99:0/3598960197 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62a00fb4a0 0x7f62a01120d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:14.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.781+0000 7f6297fff640 1 -- 172.21.15.99:0/3598960197 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6288005040 con 0x7f62a01014e0 2024-09-19T06:56:14.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.781+0000 7f6297fff640 1 --2- 172.21.15.99:0/3598960197 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62a01014e0 0x7f62a0112610 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f6288000c00 tx=0x7f6288009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:14.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.781+0000 7f629cff9640 1 -- 172.21.15.99:0/3598960197 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6288038070 con 0x7f62a01014e0 2024-09-19T06:56:14.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.781+0000 7f629cff9640 1 -- 172.21.15.99:0/3598960197 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f628802ade0 con 0x7f62a01014e0 2024-09-19T06:56:14.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.781+0000 7f629cff9640 1 -- 172.21.15.99:0/3598960197 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f628802c7e0 con 0x7f62a01014e0 2024-09-19T06:56:14.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.781+0000 7f62a5c7f640 1 -- 172.21.15.99:0/3598960197 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62a010c2d0 con 0x7f62a01014e0 2024-09-19T06:56:14.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.781+0000 7f62a5c7f640 1 -- 172.21.15.99:0/3598960197 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62a010c810 con 0x7f62a01014e0 2024-09-19T06:56:14.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.782+0000 7f62a5c7f640 1 -- 172.21.15.99:0/3598960197 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62a00fcbe0 con 0x7f62a01014e0 2024-09-19T06:56:14.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.783+0000 7f629cff9640 1 -- 172.21.15.99:0/3598960197 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f6288030020 con 0x7f62a01014e0 2024-09-19T06:56:14.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.783+0000 7f629cff9640 1 --2- 172.21.15.99:0/3598960197 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f628c06e530 0x7f628c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:14.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.783+0000 7f629cff9640 1 -- 172.21.15.99:0/3598960197 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f62880add50 con 0x7f62a01014e0 2024-09-19T06:56:14.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.783+0000 7f629f7fe640 1 --2- 172.21.15.99:0/3598960197 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f628c06e530 0x7f628c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:14.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.784+0000 7f629f7fe640 1 --2- 172.21.15.99:0/3598960197 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f628c06e530 0x7f628c0709e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6290004ed0 tx=0x7f629000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:14.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.788+0000 7f629cff9640 1 -- 172.21.15.99:0/3598960197 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f6288076f70 con 0x7f62a01014e0 2024-09-19T06:56:14.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.968+0000 7f62a5c7f640 1 -- 172.21.15.99:0/3598960197 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f62a0112d50 con 0x7f628c06e530 2024-09-19T06:56:14.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.970+0000 7f629cff9640 1 -- 172.21.15.99:0/3598960197 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f629000f040 con 0x7f628c06e530 2024-09-19T06:56:14.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.972+0000 7f62a5c7f640 1 -- 172.21.15.99:0/3598960197 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f628c06e530 msgr2=0x7f628c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:14.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.972+0000 7f62a5c7f640 1 --2- 172.21.15.99:0/3598960197 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f628c06e530 0x7f628c0709e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6290004ed0 tx=0x7f629000b040 comp rx=0 tx=0).stop 2024-09-19T06:56:14.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.972+0000 7f62a5c7f640 1 -- 172.21.15.99:0/3598960197 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62a01014e0 msgr2=0x7f62a0112610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:14.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.972+0000 7f62a5c7f640 1 --2- 172.21.15.99:0/3598960197 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62a01014e0 0x7f62a0112610 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f6288000c00 tx=0x7f6288009da0 comp rx=0 tx=0).stop 2024-09-19T06:56:14.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.972+0000 7f62a5c7f640 1 -- 172.21.15.99:0/3598960197 shutdown_connections 2024-09-19T06:56:14.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.972+0000 7f62a5c7f640 1 --2- 172.21.15.99:0/3598960197 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f628c06e530 0x7f628c0709e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:14.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.972+0000 7f62a5c7f640 1 --2- 172.21.15.99:0/3598960197 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62a01014e0 0x7f62a0112610 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:14.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.972+0000 7f62a5c7f640 1 --2- 172.21.15.99:0/3598960197 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62a00fb4a0 0x7f62a01120d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:14.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.972+0000 7f62a5c7f640 1 -- 172.21.15.99:0/3598960197 >> 172.21.15.99:0/3598960197 conn(0x7f62a00f7060 msgr2=0x7f62a00f8910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:14.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.972+0000 7f62a5c7f640 1 -- 172.21.15.99:0/3598960197 shutdown_connections 2024-09-19T06:56:14.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:14.972+0000 7f62a5c7f640 1 -- 172.21.15.99:0/3598960197 wait complete. 2024-09-19T06:56:15.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.050+0000 7f6a307fe640 1 -- 172.21.15.99:0/2899171542 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a28102620 msgr2=0x7f6a281029f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:15.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.050+0000 7f6a307fe640 1 --2- 172.21.15.99:0/2899171542 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a28102620 0x7f6a281029f0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f6a18009c50 tx=0x7f6a18004d10 comp rx=0 tx=0).stop 2024-09-19T06:56:15.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.051+0000 7f6a307fe640 1 -- 172.21.15.99:0/2899171542 shutdown_connections 2024-09-19T06:56:15.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.051+0000 7f6a307fe640 1 --2- 172.21.15.99:0/2899171542 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a28102fc0 0x7f6a280facf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:15.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.051+0000 7f6a307fe640 1 --2- 172.21.15.99:0/2899171542 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a28102620 0x7f6a281029f0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:15.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.051+0000 7f6a307fe640 1 -- 172.21.15.99:0/2899171542 >> 172.21.15.99:0/2899171542 conn(0x7f6a28070d50 msgr2=0x7f6a28071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:15.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.051+0000 7f6a307fe640 1 -- 172.21.15.99:0/2899171542 shutdown_connections 2024-09-19T06:56:15.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.051+0000 7f6a307fe640 1 -- 172.21.15.99:0/2899171542 wait complete. 2024-09-19T06:56:15.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.051+0000 7f6a307fe640 1 Processor -- start 2024-09-19T06:56:15.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.051+0000 7f6a307fe640 1 -- start start 2024-09-19T06:56:15.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.051+0000 7f6a307fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a28102620 0x7f6a28113280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:15.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.051+0000 7f6a307fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a28102fc0 0x7f6a281137c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:15.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.051+0000 7f6a307fe640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a28113dc0 con 0x7f6a28102620 2024-09-19T06:56:15.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.051+0000 7f6a307fe640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2810d200 con 0x7f6a28102fc0 2024-09-19T06:56:15.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.052+0000 7f6a2e59a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a28102620 0x7f6a28113280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:15.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.052+0000 7f6a2e59a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a28102620 0x7f6a28113280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52278/0 (socket says 172.21.15.99:52278) 2024-09-19T06:56:15.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.052+0000 7f6a2e59a640 1 -- 172.21.15.99:0/100370666 learned_addr learned my addr 172.21.15.99:0/100370666 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:56:15.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.052+0000 7f6a2dd99640 1 --2- 172.21.15.99:0/100370666 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a28102fc0 0x7f6a281137c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:15.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.052+0000 7f6a2e59a640 1 -- 172.21.15.99:0/100370666 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a28102fc0 msgr2=0x7f6a281137c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:15.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.052+0000 7f6a2e59a640 1 --2- 172.21.15.99:0/100370666 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a28102fc0 0x7f6a281137c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:15.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.052+0000 7f6a2e59a640 1 -- 172.21.15.99:0/100370666 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a180098b0 con 0x7f6a28102620 2024-09-19T06:56:15.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.052+0000 7f6a2dd99640 1 --2- 172.21.15.99:0/100370666 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a28102fc0 0x7f6a281137c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:56:15.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.052+0000 7f6a2e59a640 1 --2- 172.21.15.99:0/100370666 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a28102620 0x7f6a28113280 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f6a18004750 tx=0x7f6a18004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:15.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.052+0000 7f6a26ffd640 1 -- 172.21.15.99:0/100370666 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a18009590 con 0x7f6a28102620 2024-09-19T06:56:15.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.052+0000 7f6a307fe640 1 -- 172.21.15.99:0/100370666 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a2810d480 con 0x7f6a28102620 2024-09-19T06:56:15.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.052+0000 7f6a26ffd640 1 -- 172.21.15.99:0/100370666 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6a180096f0 con 0x7f6a28102620 2024-09-19T06:56:15.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.052+0000 7f6a26ffd640 1 -- 172.21.15.99:0/100370666 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a1803d960 con 0x7f6a28102620 2024-09-19T06:56:15.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.053+0000 7f6a307fe640 1 -- 172.21.15.99:0/100370666 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a2810d9a0 con 0x7f6a28102620 2024-09-19T06:56:15.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.054+0000 7f6a307fe640 1 -- 172.21.15.99:0/100370666 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a280657c0 con 0x7f6a28102620 2024-09-19T06:56:15.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.054+0000 7f6a26ffd640 1 -- 172.21.15.99:0/100370666 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f6a1802f030 con 0x7f6a28102620 2024-09-19T06:56:15.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.055+0000 7f6a26ffd640 1 --2- 172.21.15.99:0/100370666 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f6a1006e530 0x7f6a100709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:15.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.055+0000 7f6a2dd99640 1 --2- 172.21.15.99:0/100370666 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f6a1006e530 0x7f6a100709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:15.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.055+0000 7f6a2dd99640 1 --2- 172.21.15.99:0/100370666 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f6a1006e530 0x7f6a100709e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6a2810eb40 tx=0x7f6a1c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:15.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.056+0000 7f6a26ffd640 1 -- 172.21.15.99:0/100370666 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f6a1807cc30 con 0x7f6a28102620 2024-09-19T06:56:15.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.060+0000 7f6a26ffd640 1 -- 172.21.15.99:0/100370666 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f6a180787d0 con 0x7f6a28102620 2024-09-19T06:56:15.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.236+0000 7f6a307fe640 1 -- 172.21.15.99:0/100370666 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6a2804b720 con 0x7f6a1006e530 2024-09-19T06:56:15.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.245+0000 7f6a26ffd640 1 -- 172.21.15.99:0/100370666 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f6a2804b720 con 0x7f6a1006e530 2024-09-19T06:56:15.246 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T06:56:15.246 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.smithi099 smithi099 *:9093,9094 running (15m) 7m ago 23m 23.4M - 0.25.0 c8568f914cd2 e7c1774d56b0 2024-09-19T06:56:15.246 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi099 smithi099 running (11m) 7m ago 23m 6899k - 19.1.1-361-g2f599a46 d2baa855c067 b9775f416b10 2024-09-19T06:56:15.246 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi117 smithi117 running (11m) 7m ago 23m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 38cf60c0d548 2024-09-19T06:56:15.246 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.smithi099 smithi099 *:3000 running (13m) 7m ago 23m 80.7M - 9.4.12 2bacad6d85d8 cd53a18d5410 2024-09-19T06:56:15.246 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.obarqf smithi099 running (8m) 7m ago 18m 12.2M - 19.1.1-361-g2f599a46 d2baa855c067 314a73082521 2024-09-19T06:56:15.247 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.xehbxe smithi099 running (7m) 7m ago 18m 14.4M - 19.1.1-361-g2f599a46 d2baa855c067 a2955a9d06e6 2024-09-19T06:56:15.247 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.bheqzh smithi117 running (7m) 7m ago 18m 11.8M - 19.1.1-361-g2f599a46 d2baa855c067 b1505937c0b7 2024-09-19T06:56:15.247 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.nooexo smithi117 running (7m) 7m ago 18m 13.1M - 19.1.1-361-g2f599a46 d2baa855c067 35bd7725855c 2024-09-19T06:56:15.247 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi099.pgvkqi smithi099 *:8443,9283,8765 running (14m) 7m ago 25m 505M - 19.1.1-361-g2f599a46 d2baa855c067 d5de99cb7e78 2024-09-19T06:56:15.247 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi117.ssmkcf smithi117 *:8443,9283,8765 running (14m) 7m ago 22m 444M - 19.1.1-361-g2f599a46 d2baa855c067 8b7ee0f871f5 2024-09-19T06:56:15.247 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi099 smithi099 running (12m) 7m ago 25m 52.4M 2048M 19.1.1-361-g2f599a46 d2baa855c067 ffe067438824 2024-09-19T06:56:15.247 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi117 smithi117 running (12m) 7m ago 22m 38.9M 2048M 19.1.1-361-g2f599a46 d2baa855c067 4cb7455e3ee7 2024-09-19T06:56:15.247 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi099 smithi099 *:9100 running (15m) 7m ago 23m 15.0M - 1.5.0 0da6a335fe13 dca7b4517dcc 2024-09-19T06:56:15.247 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi117 smithi117 *:9100 running (14m) 7m ago 22m 15.9M - 1.5.0 0da6a335fe13 8233ce3835d2 2024-09-19T06:56:15.247 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (11m) 7m ago 22m 100M 1557M 19.1.1-361-g2f599a46 d2baa855c067 8e22543bf933 2024-09-19T06:56:15.247 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (10m) 7m ago 21m 106M 1557M 19.1.1-361-g2f599a46 d2baa855c067 f54153d0ae09 2024-09-19T06:56:15.248 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (10m) 7m ago 21m 83.7M 1557M 19.1.1-361-g2f599a46 d2baa855c067 b1778ab88870 2024-09-19T06:56:15.248 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi117 running (9m) 7m ago 20m 102M 2581M 19.1.1-361-g2f599a46 d2baa855c067 ea5236b193d3 2024-09-19T06:56:15.248 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi117 running (9m) 7m ago 20m 93.5M 2581M 19.1.1-361-g2f599a46 d2baa855c067 27ac2c859a68 2024-09-19T06:56:15.248 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi117 running (8m) 7m ago 19m 100M 2581M 19.1.1-361-g2f599a46 d2baa855c067 de6aeb8544ce 2024-09-19T06:56:15.248 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.smithi099 smithi099 *:9095 running (14m) 7m ago 23m 64.4M - 2.43.0 a07b618ecd1d 15ad26ec6fb4 2024-09-19T06:56:15.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.247+0000 7f6a307fe640 1 -- 172.21.15.99:0/100370666 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f6a1006e530 msgr2=0x7f6a100709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:15.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.247+0000 7f6a307fe640 1 --2- 172.21.15.99:0/100370666 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f6a1006e530 0x7f6a100709e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6a2810eb40 tx=0x7f6a1c00b040 comp rx=0 tx=0).stop 2024-09-19T06:56:15.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.247+0000 7f6a307fe640 1 -- 172.21.15.99:0/100370666 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a28102620 msgr2=0x7f6a28113280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:15.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.247+0000 7f6a307fe640 1 --2- 172.21.15.99:0/100370666 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a28102620 0x7f6a28113280 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f6a18004750 tx=0x7f6a18004d10 comp rx=0 tx=0).stop 2024-09-19T06:56:15.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.247+0000 7f6a307fe640 1 -- 172.21.15.99:0/100370666 shutdown_connections 2024-09-19T06:56:15.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.247+0000 7f6a307fe640 1 --2- 172.21.15.99:0/100370666 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f6a1006e530 0x7f6a100709e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:15.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.247+0000 7f6a307fe640 1 --2- 172.21.15.99:0/100370666 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a28102fc0 0x7f6a281137c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:15.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.247+0000 7f6a307fe640 1 --2- 172.21.15.99:0/100370666 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a28102620 0x7f6a28113280 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:15.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.247+0000 7f6a307fe640 1 -- 172.21.15.99:0/100370666 >> 172.21.15.99:0/100370666 conn(0x7f6a28070d50 msgr2=0x7f6a280fa630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:15.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.247+0000 7f6a307fe640 1 -- 172.21.15.99:0/100370666 shutdown_connections 2024-09-19T06:56:15.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.247+0000 7f6a307fe640 1 -- 172.21.15.99:0/100370666 wait complete. 2024-09-19T06:56:15.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.325+0000 7f9306581640 1 -- 172.21.15.99:0/946097270 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9300102ef0 msgr2=0x7f93000fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:15.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.325+0000 7f9306581640 1 --2- 172.21.15.99:0/946097270 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9300102ef0 0x7f93000fc5b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f92f40048d0 tx=0x7f92f4009da0 comp rx=0 tx=0).stop 2024-09-19T06:56:15.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.325+0000 7f9306581640 1 -- 172.21.15.99:0/946097270 shutdown_connections 2024-09-19T06:56:15.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.325+0000 7f9306581640 1 --2- 172.21.15.99:0/946097270 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9300102ef0 0x7f93000fc5b0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:15.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.325+0000 7f9306581640 1 --2- 172.21.15.99:0/946097270 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9300102550 0x7f9300102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:15.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.325+0000 7f9306581640 1 -- 172.21.15.99:0/946097270 >> 172.21.15.99:0/946097270 conn(0x7f93000f80f0 msgr2=0x7f93000fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:15.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.325+0000 7f9306581640 1 -- 172.21.15.99:0/946097270 shutdown_connections 2024-09-19T06:56:15.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.325+0000 7f9306581640 1 -- 172.21.15.99:0/946097270 wait complete. 2024-09-19T06:56:15.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.325+0000 7f9306581640 1 Processor -- start 2024-09-19T06:56:15.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.326+0000 7f9306581640 1 -- start start 2024-09-19T06:56:15.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.326+0000 7f9306581640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9300102550 0x7f930006fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:15.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.326+0000 7f9306581640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9300102ef0 0x7f930006ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:15.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.326+0000 7f9306581640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9300070490 con 0x7f9300102550 2024-09-19T06:56:15.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.326+0000 7f9306581640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9300070600 con 0x7f9300102ef0 2024-09-19T06:56:15.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.326+0000 7f92fffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9300102550 0x7f930006fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:15.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.326+0000 7f92fffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9300102550 0x7f930006fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48104/0 (socket says 172.21.15.99:48104) 2024-09-19T06:56:15.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.326+0000 7f92fffff640 1 -- 172.21.15.99:0/32170813 learned_addr learned my addr 172.21.15.99:0/32170813 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:56:15.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.326+0000 7f92ff7fe640 1 --2- 172.21.15.99:0/32170813 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9300102ef0 0x7f930006ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:15.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.326+0000 7f92fffff640 1 -- 172.21.15.99:0/32170813 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9300102ef0 msgr2=0x7f930006ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:15.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.326+0000 7f92fffff640 1 --2- 172.21.15.99:0/32170813 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9300102ef0 0x7f930006ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:15.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.326+0000 7f92fffff640 1 -- 172.21.15.99:0/32170813 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92f4005040 con 0x7f9300102550 2024-09-19T06:56:15.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.326+0000 7f92ff7fe640 1 --2- 172.21.15.99:0/32170813 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9300102ef0 0x7f930006ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:56:15.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.326+0000 7f92fffff640 1 --2- 172.21.15.99:0/32170813 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9300102550 0x7f930006fa10 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f92f0002a50 tx=0x7f92f0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:15.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.327+0000 7f92fcff9640 1 -- 172.21.15.99:0/32170813 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92f0007c30 con 0x7f9300102550 2024-09-19T06:56:15.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.327+0000 7f92fcff9640 1 -- 172.21.15.99:0/32170813 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f92f000f040 con 0x7f9300102550 2024-09-19T06:56:15.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.327+0000 7f9306581640 1 -- 172.21.15.99:0/32170813 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9300070890 con 0x7f9300102550 2024-09-19T06:56:15.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.327+0000 7f92fcff9640 1 -- 172.21.15.99:0/32170813 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92f000da50 con 0x7f9300102550 2024-09-19T06:56:15.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.327+0000 7f9306581640 1 -- 172.21.15.99:0/32170813 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9300119c50 con 0x7f9300102550 2024-09-19T06:56:15.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.328+0000 7f9306581640 1 -- 172.21.15.99:0/32170813 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93000fdcd0 con 0x7f9300102550 2024-09-19T06:56:15.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.329+0000 7f92fcff9640 1 -- 172.21.15.99:0/32170813 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f92f000dbf0 con 0x7f9300102550 2024-09-19T06:56:15.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.329+0000 7f92fcff9640 1 --2- 172.21.15.99:0/32170813 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f92e806e530 0x7f92e80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:15.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.329+0000 7f92fcff9640 1 -- 172.21.15.99:0/32170813 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f92f008d900 con 0x7f9300102550 2024-09-19T06:56:15.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.329+0000 7f92ff7fe640 1 --2- 172.21.15.99:0/32170813 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f92e806e530 0x7f92e80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:15.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.330+0000 7f92ff7fe640 1 --2- 172.21.15.99:0/32170813 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f92e806e530 0x7f92e80709e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f92f4009ac0 tx=0x7f92f4009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:15.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.333+0000 7f92fcff9640 1 -- 172.21.15.99:0/32170813 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f92f0056a30 con 0x7f9300102550 2024-09-19T06:56:15.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.563+0000 7f9306581640 1 -- 172.21.15.99:0/32170813 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9300071100 con 0x7f9300102550 2024-09-19T06:56:15.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.564+0000 7f92fcff9640 1 -- 172.21.15.99:0/32170813 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f92f005a0f0 con 0x7f9300102550 2024-09-19T06:56:15.565 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:56:15.565 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-09-19T06:56:15.565 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T06:56:15.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:56:15.565 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-09-19T06:56:15.565 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T06:56:15.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:56:15.565 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-09-19T06:56:15.565 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 6 2024-09-19T06:56:15.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:56:15.565 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": { 2024-09-19T06:56:15.566 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 4 2024-09-19T06:56:15.566 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:56:15.566 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-09-19T06:56:15.566 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 14 2024-09-19T06:56:15.566 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T06:56:15.566 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:56:15.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.566+0000 7f9306581640 1 -- 172.21.15.99:0/32170813 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f92e806e530 msgr2=0x7f92e80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:15.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.566+0000 7f9306581640 1 --2- 172.21.15.99:0/32170813 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f92e806e530 0x7f92e80709e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f92f4009ac0 tx=0x7f92f4009da0 comp rx=0 tx=0).stop 2024-09-19T06:56:15.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.566+0000 7f9306581640 1 -- 172.21.15.99:0/32170813 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9300102550 msgr2=0x7f930006fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:15.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.566+0000 7f9306581640 1 --2- 172.21.15.99:0/32170813 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9300102550 0x7f930006fa10 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f92f0002a50 tx=0x7f92f0004600 comp rx=0 tx=0).stop 2024-09-19T06:56:15.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.566+0000 7f9306581640 1 -- 172.21.15.99:0/32170813 shutdown_connections 2024-09-19T06:56:15.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.566+0000 7f9306581640 1 --2- 172.21.15.99:0/32170813 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f92e806e530 0x7f92e80709e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:15.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.566+0000 7f9306581640 1 --2- 172.21.15.99:0/32170813 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9300102ef0 0x7f930006ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:15.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.566+0000 7f9306581640 1 --2- 172.21.15.99:0/32170813 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9300102550 0x7f930006fa10 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:15.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.566+0000 7f9306581640 1 -- 172.21.15.99:0/32170813 >> 172.21.15.99:0/32170813 conn(0x7f93000f80f0 msgr2=0x7f93000f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:15.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.566+0000 7f9306581640 1 -- 172.21.15.99:0/32170813 shutdown_connections 2024-09-19T06:56:15.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.566+0000 7f9306581640 1 -- 172.21.15.99:0/32170813 wait complete. 2024-09-19T06:56:15.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.645+0000 7f20f88be640 1 -- 172.21.15.99:0/3338011045 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f20f40fb810 msgr2=0x7f20f40fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:15.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.645+0000 7f20f88be640 1 --2- 172.21.15.99:0/3338011045 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f20f40fb810 0x7f20f40fbbe0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f20e40048d0 tx=0x7f20e4009da0 comp rx=0 tx=0).stop 2024-09-19T06:56:15.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.645+0000 7f20f88be640 1 -- 172.21.15.99:0/3338011045 shutdown_connections 2024-09-19T06:56:15.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.645+0000 7f20f88be640 1 --2- 172.21.15.99:0/3338011045 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20f40fcf80 0x7f20f40fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:15.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.645+0000 7f20f88be640 1 --2- 172.21.15.99:0/3338011045 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f20f40fb810 0x7f20f40fbbe0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:15.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.645+0000 7f20f88be640 1 -- 172.21.15.99:0/3338011045 >> 172.21.15.99:0/3338011045 conn(0x7f20f40723b0 msgr2=0x7f20f40727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:15.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.645+0000 7f20f88be640 1 -- 172.21.15.99:0/3338011045 shutdown_connections 2024-09-19T06:56:15.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.645+0000 7f20f88be640 1 -- 172.21.15.99:0/3338011045 wait complete. 2024-09-19T06:56:15.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.646+0000 7f20f88be640 1 Processor -- start 2024-09-19T06:56:15.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.646+0000 7f20f88be640 1 -- start start 2024-09-19T06:56:15.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.646+0000 7f20f88be640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f20f40fb810 0x7f20f410e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:15.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.646+0000 7f20f88be640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20f40fcf80 0x7f20f410e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:15.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.646+0000 7f20f88be640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f410ed40 con 0x7f20f40fb810 2024-09-19T06:56:15.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.646+0000 7f20f88be640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f410eeb0 con 0x7f20f40fcf80 2024-09-19T06:56:15.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.646+0000 7f20f259c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f20f40fb810 0x7f20f410e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:15.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.646+0000 7f20f259c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f20f40fb810 0x7f20f410e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48116/0 (socket says 172.21.15.99:48116) 2024-09-19T06:56:15.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.646+0000 7f20f259c640 1 -- 172.21.15.99:0/1222626977 learned_addr learned my addr 172.21.15.99:0/1222626977 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:56:15.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.646+0000 7f20f1d9b640 1 --2- 172.21.15.99:0/1222626977 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20f40fcf80 0x7f20f410e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:15.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.646+0000 7f20f259c640 1 -- 172.21.15.99:0/1222626977 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20f40fcf80 msgr2=0x7f20f410e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:15.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.646+0000 7f20f259c640 1 --2- 172.21.15.99:0/1222626977 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20f40fcf80 0x7f20f410e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:15.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.646+0000 7f20f259c640 1 -- 172.21.15.99:0/1222626977 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e4005040 con 0x7f20f40fb810 2024-09-19T06:56:15.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.647+0000 7f20f259c640 1 --2- 172.21.15.99:0/1222626977 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f20f40fb810 0x7f20f410e1b0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f20e4000c00 tx=0x7f20e4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:15.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.647+0000 7f20eaffd640 1 -- 172.21.15.99:0/1222626977 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20e4038070 con 0x7f20f40fb810 2024-09-19T06:56:15.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.647+0000 7f20eaffd640 1 -- 172.21.15.99:0/1222626977 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f20e402ade0 con 0x7f20f40fb810 2024-09-19T06:56:15.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.647+0000 7f20f88be640 1 -- 172.21.15.99:0/1222626977 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20f4117220 con 0x7f20f40fb810 2024-09-19T06:56:15.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.647+0000 7f20eaffd640 1 -- 172.21.15.99:0/1222626977 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20e402c7e0 con 0x7f20f40fb810 2024-09-19T06:56:15.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.647+0000 7f20f88be640 1 -- 172.21.15.99:0/1222626977 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20f4117680 con 0x7f20f40fb810 2024-09-19T06:56:15.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.648+0000 7f20f88be640 1 -- 172.21.15.99:0/1222626977 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20f40fcbc0 con 0x7f20f40fb810 2024-09-19T06:56:15.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.648+0000 7f20eaffd640 1 -- 172.21.15.99:0/1222626977 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f20e4030020 con 0x7f20f40fb810 2024-09-19T06:56:15.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.649+0000 7f20eaffd640 1 --2- 172.21.15.99:0/1222626977 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f20e006e530 0x7f20e00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:15.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.649+0000 7f20eaffd640 1 -- 172.21.15.99:0/1222626977 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f20e40add50 con 0x7f20f40fb810 2024-09-19T06:56:15.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.649+0000 7f20f1d9b640 1 --2- 172.21.15.99:0/1222626977 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f20e006e530 0x7f20e00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:15.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.650+0000 7f20f1d9b640 1 --2- 172.21.15.99:0/1222626977 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f20e006e530 0x7f20e00709e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f20f4065980 tx=0x7f20dc00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:15.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.654+0000 7f20eaffd640 1 -- 172.21.15.99:0/1222626977 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f20e4076f70 con 0x7f20f40fb810 2024-09-19T06:56:15.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.853+0000 7f20f88be640 1 -- 172.21.15.99:0/1222626977 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f20f4065730 con 0x7f20f40fb810 2024-09-19T06:56:15.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.853+0000 7f20eaffd640 1 -- 172.21.15.99:0/1222626977 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 29 v29) v1 ==== 76+0+1915 (secure 0 0 0) 0x7f20e407a630 con 0x7f20f40fb810 2024-09-19T06:56:15.855 INFO:teuthology.orchestra.run.smithi099.stdout:e29 2024-09-19T06:56:15.855 INFO:teuthology.orchestra.run.smithi099.stdout:btime 2024-09-19T06:48:47:938420+0000 2024-09-19T06:56:15.855 INFO:teuthology.orchestra.run.smithi099.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T06:56:15.855 INFO:teuthology.orchestra.run.smithi099.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T06:56:15.855 INFO:teuthology.orchestra.run.smithi099.stdout:legacy client fscid: 1 2024-09-19T06:56:15.855 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:56:15.856 INFO:teuthology.orchestra.run.smithi099.stdout:Filesystem 'cephfs' (1) 2024-09-19T06:56:15.856 INFO:teuthology.orchestra.run.smithi099.stdout:fs_name cephfs 2024-09-19T06:56:15.856 INFO:teuthology.orchestra.run.smithi099.stdout:epoch 20 2024-09-19T06:56:15.856 INFO:teuthology.orchestra.run.smithi099.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-19T06:56:15.856 INFO:teuthology.orchestra.run.smithi099.stdout:created 2024-09-19T06:37:40.838146+0000 2024-09-19T06:56:15.856 INFO:teuthology.orchestra.run.smithi099.stdout:modified 2024-09-19T06:47:50.076553+0000 2024-09-19T06:56:15.856 INFO:teuthology.orchestra.run.smithi099.stdout:tableserver 0 2024-09-19T06:56:15.856 INFO:teuthology.orchestra.run.smithi099.stdout:root 0 2024-09-19T06:56:15.857 INFO:teuthology.orchestra.run.smithi099.stdout:session_timeout 60 2024-09-19T06:56:15.857 INFO:teuthology.orchestra.run.smithi099.stdout:session_autoclose 300 2024-09-19T06:56:15.857 INFO:teuthology.orchestra.run.smithi099.stdout:max_file_size 1099511627776 2024-09-19T06:56:15.857 INFO:teuthology.orchestra.run.smithi099.stdout:max_xattr_size 65536 2024-09-19T06:56:15.857 INFO:teuthology.orchestra.run.smithi099.stdout:required_client_features {} 2024-09-19T06:56:15.857 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure 0 2024-09-19T06:56:15.857 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure_osd_epoch 77 2024-09-19T06:56:15.858 INFO:teuthology.orchestra.run.smithi099.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T06:56:15.858 INFO:teuthology.orchestra.run.smithi099.stdout:max_mds 2 2024-09-19T06:56:15.858 INFO:teuthology.orchestra.run.smithi099.stdout:in 0,1 2024-09-19T06:56:15.858 INFO:teuthology.orchestra.run.smithi099.stdout:up {} 2024-09-19T06:56:15.858 INFO:teuthology.orchestra.run.smithi099.stdout:failed 0,1 2024-09-19T06:56:15.858 INFO:teuthology.orchestra.run.smithi099.stdout:damaged 2024-09-19T06:56:15.858 INFO:teuthology.orchestra.run.smithi099.stdout:stopped 2024-09-19T06:56:15.858 INFO:teuthology.orchestra.run.smithi099.stdout:data_pools [3] 2024-09-19T06:56:15.859 INFO:teuthology.orchestra.run.smithi099.stdout:metadata_pool 2 2024-09-19T06:56:15.859 INFO:teuthology.orchestra.run.smithi099.stdout:inline_data disabled 2024-09-19T06:56:15.859 INFO:teuthology.orchestra.run.smithi099.stdout:balancer 2024-09-19T06:56:15.859 INFO:teuthology.orchestra.run.smithi099.stdout:bal_rank_mask -1 2024-09-19T06:56:15.859 INFO:teuthology.orchestra.run.smithi099.stdout:standby_count_wanted 1 2024-09-19T06:56:15.859 INFO:teuthology.orchestra.run.smithi099.stdout:qdb_cluster leader: 0 members: 2024-09-19T06:56:15.859 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:56:15.859 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:56:15.860 INFO:teuthology.orchestra.run.smithi099.stdout:Standby daemons: 2024-09-19T06:56:15.860 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:56:15.860 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.obarqf{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6826/1859154203,v1:172.21.15.99:6827/1859154203] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:56:15.860 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.xehbxe{-1:34410} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6828/1939453719,v1:172.21.15.99:6829/1939453719] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:56:15.860 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.nooexo{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6824/1398895079,v1:172.21.15.117:6825/1398895079] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:56:15.860 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.bheqzh{-1:44329} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6826/3233337308,v1:172.21.15.117:6827/3233337308] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:56:15.861 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 29 2024-09-19T06:56:15.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.855+0000 7f20f88be640 1 -- 172.21.15.99:0/1222626977 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f20e006e530 msgr2=0x7f20e00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:15.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.855+0000 7f20f88be640 1 --2- 172.21.15.99:0/1222626977 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f20e006e530 0x7f20e00709e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f20f4065980 tx=0x7f20dc00b040 comp rx=0 tx=0).stop 2024-09-19T06:56:15.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.855+0000 7f20f88be640 1 -- 172.21.15.99:0/1222626977 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f20f40fb810 msgr2=0x7f20f410e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:15.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.855+0000 7f20f88be640 1 --2- 172.21.15.99:0/1222626977 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f20f40fb810 0x7f20f410e1b0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f20e4000c00 tx=0x7f20e4009da0 comp rx=0 tx=0).stop 2024-09-19T06:56:15.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.855+0000 7f20f88be640 1 -- 172.21.15.99:0/1222626977 shutdown_connections 2024-09-19T06:56:15.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.855+0000 7f20f88be640 1 --2- 172.21.15.99:0/1222626977 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f20e006e530 0x7f20e00709e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:15.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.855+0000 7f20f88be640 1 --2- 172.21.15.99:0/1222626977 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20f40fcf80 0x7f20f410e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:15.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.855+0000 7f20f88be640 1 --2- 172.21.15.99:0/1222626977 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f20f40fb810 0x7f20f410e1b0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:15.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.855+0000 7f20f88be640 1 -- 172.21.15.99:0/1222626977 >> 172.21.15.99:0/1222626977 conn(0x7f20f40723b0 msgr2=0x7f20f40fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:15.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.855+0000 7f20f88be640 1 -- 172.21.15.99:0/1222626977 shutdown_connections 2024-09-19T06:56:15.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.855+0000 7f20f88be640 1 -- 172.21.15.99:0/1222626977 wait complete. 2024-09-19T06:56:15.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.935+0000 7f7a0b19a640 1 -- 172.21.15.99:0/1638292261 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7a040fcf80 msgr2=0x7f7a040fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:15.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.935+0000 7f7a0b19a640 1 --2- 172.21.15.99:0/1638292261 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7a040fcf80 0x7f7a040fd3d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f79f00048d0 tx=0x7f79f0009da0 comp rx=0 tx=0).stop 2024-09-19T06:56:15.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.935+0000 7f7a0b19a640 1 -- 172.21.15.99:0/1638292261 shutdown_connections 2024-09-19T06:56:15.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.935+0000 7f7a0b19a640 1 --2- 172.21.15.99:0/1638292261 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7a040fcf80 0x7f7a040fd3d0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:15.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.935+0000 7f7a0b19a640 1 --2- 172.21.15.99:0/1638292261 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a040fb810 0x7f7a040fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:15.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.935+0000 7f7a0b19a640 1 -- 172.21.15.99:0/1638292261 >> 172.21.15.99:0/1638292261 conn(0x7f7a040723b0 msgr2=0x7f7a040727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:15.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.935+0000 7f7a0b19a640 1 -- 172.21.15.99:0/1638292261 shutdown_connections 2024-09-19T06:56:15.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.935+0000 7f7a0b19a640 1 -- 172.21.15.99:0/1638292261 wait complete. 2024-09-19T06:56:15.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.935+0000 7f7a0b19a640 1 Processor -- start 2024-09-19T06:56:15.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.935+0000 7f7a0b19a640 1 -- start start 2024-09-19T06:56:15.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.936+0000 7f7a0b19a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7a040fb810 0x7f7a0410e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:15.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.936+0000 7f7a0b19a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a040fcf80 0x7f7a0410e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:15.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.936+0000 7f7a0b19a640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0410ed20 con 0x7f7a040fb810 2024-09-19T06:56:15.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.936+0000 7f7a0b19a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0410ee90 con 0x7f7a040fcf80 2024-09-19T06:56:15.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.936+0000 7f7a08f36640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7a040fb810 0x7f7a0410e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:15.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.936+0000 7f7a08f36640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7a040fb810 0x7f7a0410e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48134/0 (socket says 172.21.15.99:48134) 2024-09-19T06:56:15.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.936+0000 7f7a08f36640 1 -- 172.21.15.99:0/882349340 learned_addr learned my addr 172.21.15.99:0/882349340 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:56:15.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.936+0000 7f7a03fff640 1 --2- 172.21.15.99:0/882349340 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a040fcf80 0x7f7a0410e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:15.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.936+0000 7f7a08f36640 1 -- 172.21.15.99:0/882349340 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a040fcf80 msgr2=0x7f7a0410e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:15.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.936+0000 7f7a08f36640 1 --2- 172.21.15.99:0/882349340 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a040fcf80 0x7f7a0410e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:15.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.936+0000 7f7a08f36640 1 -- 172.21.15.99:0/882349340 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79f0005040 con 0x7f7a040fb810 2024-09-19T06:56:15.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.936+0000 7f7a08f36640 1 --2- 172.21.15.99:0/882349340 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7a040fb810 0x7f7a0410e190 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f79f800eb70 tx=0x7f79f800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:15.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.937+0000 7f7a017fa640 1 -- 172.21.15.99:0/882349340 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79f8007c30 con 0x7f7a040fb810 2024-09-19T06:56:15.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.937+0000 7f7a017fa640 1 -- 172.21.15.99:0/882349340 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f79f800f040 con 0x7f7a040fb810 2024-09-19T06:56:15.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.937+0000 7f7a0b19a640 1 -- 172.21.15.99:0/882349340 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a04117200 con 0x7f7a040fb810 2024-09-19T06:56:15.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.937+0000 7f7a017fa640 1 -- 172.21.15.99:0/882349340 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79f800ca60 con 0x7f7a040fb810 2024-09-19T06:56:15.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.937+0000 7f7a0b19a640 1 -- 172.21.15.99:0/882349340 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a041176c0 con 0x7f7a040fb810 2024-09-19T06:56:15.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.938+0000 7f7a0b19a640 1 -- 172.21.15.99:0/882349340 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a040fcbc0 con 0x7f7a040fb810 2024-09-19T06:56:15.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.938+0000 7f7a017fa640 1 -- 172.21.15.99:0/882349340 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f79f800cbc0 con 0x7f7a040fb810 2024-09-19T06:56:15.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.939+0000 7f7a017fa640 1 --2- 172.21.15.99:0/882349340 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f79f406e530 0x7f79f40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:15.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.939+0000 7f7a017fa640 1 -- 172.21.15.99:0/882349340 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f79f808dca0 con 0x7f7a040fb810 2024-09-19T06:56:15.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.939+0000 7f7a03fff640 1 --2- 172.21.15.99:0/882349340 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f79f406e530 0x7f79f40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:15.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.939+0000 7f7a03fff640 1 --2- 172.21.15.99:0/882349340 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f79f406e530 0x7f79f40709e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7a04065980 tx=0x7f79f0035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:15.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:15.943+0000 7f7a017fa640 1 -- 172.21.15.99:0/882349340 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f79f8056ec0 con 0x7f7a040fb810 2024-09-19T06:56:16.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:16.135+0000 7f7a0b19a640 1 -- 172.21.15.99:0/882349340 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7a04065730 con 0x7f79f406e530 2024-09-19T06:56:16.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:16.136+0000 7f7a017fa640 1 -- 172.21.15.99:0/882349340 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f7a04065730 con 0x7f79f406e530 2024-09-19T06:56:16.138 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:56:16.138 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T06:56:16.138 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": true, 2024-09-19T06:56:16.138 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T06:56:16.138 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [ 2024-09-19T06:56:16.138 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr", 2024-09-19T06:56:16.138 INFO:teuthology.orchestra.run.smithi099.stdout: "crash", 2024-09-19T06:56:16.138 INFO:teuthology.orchestra.run.smithi099.stdout: "mds", 2024-09-19T06:56:16.138 INFO:teuthology.orchestra.run.smithi099.stdout: "mon", 2024-09-19T06:56:16.138 INFO:teuthology.orchestra.run.smithi099.stdout: "osd" 2024-09-19T06:56:16.138 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-19T06:56:16.139 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": "16/21 daemons upgraded", 2024-09-19T06:56:16.139 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "Currently upgrading mds daemons", 2024-09-19T06:56:16.139 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-09-19T06:56:16.139 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:56:16.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:16.138+0000 7f7a0b19a640 1 -- 172.21.15.99:0/882349340 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f79f406e530 msgr2=0x7f79f40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:16.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:16.138+0000 7f7a0b19a640 1 --2- 172.21.15.99:0/882349340 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f79f406e530 0x7f79f40709e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7a04065980 tx=0x7f79f0035040 comp rx=0 tx=0).stop 2024-09-19T06:56:16.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:16.138+0000 7f7a0b19a640 1 -- 172.21.15.99:0/882349340 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7a040fb810 msgr2=0x7f7a0410e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:16.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:16.138+0000 7f7a0b19a640 1 --2- 172.21.15.99:0/882349340 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7a040fb810 0x7f7a0410e190 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f79f800eb70 tx=0x7f79f800b040 comp rx=0 tx=0).stop 2024-09-19T06:56:16.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:16.139+0000 7f7a0b19a640 1 -- 172.21.15.99:0/882349340 shutdown_connections 2024-09-19T06:56:16.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:16.139+0000 7f7a0b19a640 1 --2- 172.21.15.99:0/882349340 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f79f406e530 0x7f79f40709e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:16.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:16.139+0000 7f7a0b19a640 1 --2- 172.21.15.99:0/882349340 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7a040fcf80 0x7f7a0410e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:16.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:16.139+0000 7f7a0b19a640 1 --2- 172.21.15.99:0/882349340 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7a040fb810 0x7f7a0410e190 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:16.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:16.139+0000 7f7a0b19a640 1 -- 172.21.15.99:0/882349340 >> 172.21.15.99:0/882349340 conn(0x7f7a040723b0 msgr2=0x7f7a040fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:16.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:16.139+0000 7f7a0b19a640 1 -- 172.21.15.99:0/882349340 shutdown_connections 2024-09-19T06:56:16.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:16.139+0000 7f7a0b19a640 1 -- 172.21.15.99:0/882349340 wait complete. 2024-09-19T06:56:16.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:56:16 smithi099 ceph-mon[97031]: from='client.34810 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:56:16.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:56:16 smithi099 ceph-mon[97031]: from='client.34814 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:56:16.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:56:16 smithi099 ceph-mon[97031]: pgmap v417: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:56:16.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:56:16 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/32170813' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:56:16.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:56:16 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/1222626977' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:56:16.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:16.219+0000 7f8d34033640 1 -- 172.21.15.99:0/3793543813 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8d2c1014c0 msgr2=0x7f8d2c101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:16.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:16.219+0000 7f8d34033640 1 --2- 172.21.15.99:0/3793543813 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8d2c1014c0 0x7f8d2c101890 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f8d280048d0 tx=0x7f8d28009da0 comp rx=0 tx=0).stop 2024-09-19T06:56:16.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:16.219+0000 7f8d34033640 1 -- 172.21.15.99:0/3793543813 shutdown_connections 2024-09-19T06:56:16.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:16.219+0000 7f8d34033640 1 --2- 172.21.15.99:0/3793543813 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d2c0fb480 0x7f8d2c0fb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:16.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:16.219+0000 7f8d34033640 1 --2- 172.21.15.99:0/3793543813 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8d2c1014c0 0x7f8d2c101890 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:16.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:16.219+0000 7f8d34033640 1 -- 172.21.15.99:0/3793543813 >> 172.21.15.99:0/3793543813 conn(0x7f8d2c0f7000 msgr2=0x7f8d2c0f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:16.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:16.219+0000 7f8d34033640 1 -- 172.21.15.99:0/3793543813 shutdown_connections 2024-09-19T06:56:16.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:16.219+0000 7f8d34033640 1 -- 172.21.15.99:0/3793543813 wait complete. 2024-09-19T06:56:16.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:16.220+0000 7f8d34033640 1 Processor -- start 2024-09-19T06:56:16.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:16.220+0000 7f8d34033640 1 -- start start 2024-09-19T06:56:16.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:16.220+0000 7f8d34033640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8d2c0fb480 0x7f8d2c1120b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:16.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:16.220+0000 7f8d34033640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d2c1014c0 0x7f8d2c1125f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:16.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:16.220+0000 7f8d34033640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2c112bf0 con 0x7f8d2c0fb480 2024-09-19T06:56:16.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:16.220+0000 7f8d34033640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2c10c030 con 0x7f8d2c1014c0 2024-09-19T06:56:16.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:16.220+0000 7f8d31dcf640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8d2c0fb480 0x7f8d2c1120b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:16.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:16.220+0000 7f8d31dcf640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8d2c0fb480 0x7f8d2c1120b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:48154/0 (socket says 172.21.15.99:48154) 2024-09-19T06:56:16.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:16.220+0000 7f8d31dcf640 1 -- 172.21.15.99:0/129747938 learned_addr learned my addr 172.21.15.99:0/129747938 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:56:16.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:16.220+0000 7f8d315ce640 1 --2- 172.21.15.99:0/129747938 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d2c1014c0 0x7f8d2c1125f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:16.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:16.220+0000 7f8d31dcf640 1 -- 172.21.15.99:0/129747938 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d2c1014c0 msgr2=0x7f8d2c1125f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:16.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:16.220+0000 7f8d31dcf640 1 --2- 172.21.15.99:0/129747938 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d2c1014c0 0x7f8d2c1125f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:16.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:16.220+0000 7f8d31dcf640 1 -- 172.21.15.99:0/129747938 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d28005040 con 0x7f8d2c0fb480 2024-09-19T06:56:16.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:16.220+0000 7f8d315ce640 1 --2- 172.21.15.99:0/129747938 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d2c1014c0 0x7f8d2c1125f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:56:16.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:16.221+0000 7f8d31dcf640 1 --2- 172.21.15.99:0/129747938 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8d2c0fb480 0x7f8d2c1120b0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8d28003080 tx=0x7f8d28009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:16.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:16.221+0000 7f8d227fc640 1 -- 172.21.15.99:0/129747938 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d28038070 con 0x7f8d2c0fb480 2024-09-19T06:56:16.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:16.221+0000 7f8d227fc640 1 -- 172.21.15.99:0/129747938 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8d280097e0 con 0x7f8d2c0fb480 2024-09-19T06:56:16.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:16.221+0000 7f8d34033640 1 -- 172.21.15.99:0/129747938 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d2c10c2b0 con 0x7f8d2c0fb480 2024-09-19T06:56:16.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:16.221+0000 7f8d227fc640 1 -- 172.21.15.99:0/129747938 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d2803d420 con 0x7f8d2c0fb480 2024-09-19T06:56:16.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:16.221+0000 7f8d34033640 1 -- 172.21.15.99:0/129747938 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d2c10c7f0 con 0x7f8d2c0fb480 2024-09-19T06:56:16.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:16.222+0000 7f8d34033640 1 -- 172.21.15.99:0/129747938 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d2c0fcbc0 con 0x7f8d2c0fb480 2024-09-19T06:56:16.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:16.222+0000 7f8d227fc640 1 -- 172.21.15.99:0/129747938 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f8d28030020 con 0x7f8d2c0fb480 2024-09-19T06:56:16.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:16.223+0000 7f8d227fc640 1 --2- 172.21.15.99:0/129747938 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f8d1806e530 0x7f8d180709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:16.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:16.223+0000 7f8d227fc640 1 -- 172.21.15.99:0/129747938 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f8d280ae640 con 0x7f8d2c0fb480 2024-09-19T06:56:16.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:16.223+0000 7f8d315ce640 1 --2- 172.21.15.99:0/129747938 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f8d1806e530 0x7f8d180709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:16.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:16.223+0000 7f8d315ce640 1 --2- 172.21.15.99:0/129747938 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f8d1806e530 0x7f8d180709e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c10d970 tx=0x7f8d1c009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:16.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:16.227+0000 7f8d227fc640 1 -- 172.21.15.99:0/129747938 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f8d280777b0 con 0x7f8d2c0fb480 2024-09-19T06:56:16.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:56:16 smithi117 ceph-mon[76771]: from='client.34810 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:56:16.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:56:16 smithi117 ceph-mon[76771]: from='client.34814 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:56:16.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:56:16 smithi117 ceph-mon[76771]: pgmap v417: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:56:16.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:56:16 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/32170813' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:56:16.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:56:16 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/1222626977' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:56:16.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:16.457+0000 7f8d34033640 1 -- 172.21.15.99:0/129747938 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f8d2c04b720 con 0x7f8d2c0fb480 2024-09-19T06:56:16.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:16.457+0000 7f8d227fc640 1 -- 172.21.15.99:0/129747938 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7f8d2807ae70 con 0x7f8d2c0fb480 2024-09-19T06:56:16.459 INFO:teuthology.orchestra.run.smithi099.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-09-19T06:56:16.460 INFO:teuthology.orchestra.run.smithi099.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-19T06:56:16.460 INFO:teuthology.orchestra.run.smithi099.stdout: fs cephfs is degraded 2024-09-19T06:56:16.460 INFO:teuthology.orchestra.run.smithi099.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-19T06:56:16.460 INFO:teuthology.orchestra.run.smithi099.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-19T06:56:16.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:16.459+0000 7f8d34033640 1 -- 172.21.15.99:0/129747938 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f8d1806e530 msgr2=0x7f8d180709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:16.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:16.459+0000 7f8d34033640 1 --2- 172.21.15.99:0/129747938 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f8d1806e530 0x7f8d180709e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c10d970 tx=0x7f8d1c009040 comp rx=0 tx=0).stop 2024-09-19T06:56:16.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:16.459+0000 7f8d34033640 1 -- 172.21.15.99:0/129747938 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8d2c0fb480 msgr2=0x7f8d2c1120b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:16.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:16.459+0000 7f8d34033640 1 --2- 172.21.15.99:0/129747938 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8d2c0fb480 0x7f8d2c1120b0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8d28003080 tx=0x7f8d28009da0 comp rx=0 tx=0).stop 2024-09-19T06:56:16.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:16.459+0000 7f8d34033640 1 -- 172.21.15.99:0/129747938 shutdown_connections 2024-09-19T06:56:16.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:16.459+0000 7f8d34033640 1 --2- 172.21.15.99:0/129747938 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f8d1806e530 0x7f8d180709e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:16.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:16.459+0000 7f8d34033640 1 --2- 172.21.15.99:0/129747938 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8d2c1014c0 0x7f8d2c1125f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:16.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:16.459+0000 7f8d34033640 1 --2- 172.21.15.99:0/129747938 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8d2c0fb480 0x7f8d2c1120b0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:16.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:16.459+0000 7f8d34033640 1 -- 172.21.15.99:0/129747938 >> 172.21.15.99:0/129747938 conn(0x7f8d2c0f7000 msgr2=0x7f8d2c0f88b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:16.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:16.460+0000 7f8d34033640 1 -- 172.21.15.99:0/129747938 shutdown_connections 2024-09-19T06:56:16.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:16.460+0000 7f8d34033640 1 -- 172.21.15.99:0/129747938 wait complete. 2024-09-19T06:56:17.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:56:17 smithi099 ceph-mon[97031]: from='client.34818 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:56:17.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:56:17 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/129747938' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T06:56:17.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:56:17 smithi117 ceph-mon[76771]: from='client.34818 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:56:17.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:56:17 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/129747938' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T06:56:18.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:56:18 smithi099 ceph-mon[97031]: from='client.34830 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:56:18.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:56:18 smithi099 ceph-mon[97031]: pgmap v418: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:56:18.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:56:18 smithi117 ceph-mon[76771]: from='client.34830 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:56:18.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:56:18 smithi117 ceph-mon[76771]: pgmap v418: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:56:20.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:56:20 smithi099 ceph-mon[97031]: pgmap v419: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:56:20.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:56:20 smithi117 ceph-mon[76771]: pgmap v419: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:56:22.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:56:22 smithi099 ceph-mon[97031]: pgmap v420: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:56:22.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:56:22 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:56:22.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:56:22 smithi117 ceph-mon[76771]: pgmap v420: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:56:22.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:56:22 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:56:24.363 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:56:24 smithi117 ceph-mon[76771]: pgmap v421: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:56:24.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:56:24 smithi099 ceph-mon[97031]: pgmap v421: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:56:26.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:56:26 smithi099 ceph-mon[97031]: pgmap v422: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:56:26.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:56:26 smithi117 ceph-mon[76771]: pgmap v422: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:56:28.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:56:28 smithi099 ceph-mon[97031]: pgmap v423: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:56:28.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:56:28 smithi117 ceph-mon[76771]: pgmap v423: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:56:30.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:56:30 smithi099 ceph-mon[97031]: pgmap v424: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:56:30.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:56:30 smithi117 ceph-mon[76771]: pgmap v424: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:56:32.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:56:32 smithi099 ceph-mon[97031]: pgmap v425: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:56:32.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:56:32 smithi117 ceph-mon[76771]: pgmap v425: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:56:34.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:56:34 smithi099 ceph-mon[97031]: pgmap v426: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:56:34.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:56:34 smithi117 ceph-mon[76771]: pgmap v426: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:56:36.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:56:36 smithi099 ceph-mon[97031]: pgmap v427: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:56:36.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:56:36 smithi117 ceph-mon[76771]: pgmap v427: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:56:37.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:56:37 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:56:37.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:56:37 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:56:38.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:56:38 smithi099 ceph-mon[97031]: pgmap v428: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:56:38.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:56:38 smithi117 ceph-mon[76771]: pgmap v428: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:56:40.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:56:40 smithi099 ceph-mon[97031]: pgmap v429: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:56:40.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:56:40 smithi117 ceph-mon[76771]: pgmap v429: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:56:41.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:56:41 smithi099 ceph-mon[97031]: pgmap v430: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:56:42.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:56:41 smithi117 ceph-mon[76771]: pgmap v430: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:56:44.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:56:44 smithi099 ceph-mon[97031]: pgmap v431: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:56:44.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:56:44 smithi117 ceph-mon[76771]: pgmap v431: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:56:46.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:56:46 smithi099 ceph-mon[97031]: pgmap v432: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:56:46.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.550+0000 7fc2d3931640 1 -- 172.21.15.99:0/3508481820 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2cc0fcf80 msgr2=0x7fc2cc0fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:46.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.550+0000 7fc2d3931640 1 --2- 172.21.15.99:0/3508481820 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2cc0fcf80 0x7fc2cc0fd3d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fc2c00048d0 tx=0x7fc2c0009da0 comp rx=0 tx=0).stop 2024-09-19T06:56:46.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.550+0000 7fc2d3931640 1 -- 172.21.15.99:0/3508481820 shutdown_connections 2024-09-19T06:56:46.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.550+0000 7fc2d3931640 1 --2- 172.21.15.99:0/3508481820 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2cc0fcf80 0x7fc2cc0fd3d0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:46.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.550+0000 7fc2d3931640 1 --2- 172.21.15.99:0/3508481820 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2cc0fb810 0x7fc2cc0fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:46.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.550+0000 7fc2d3931640 1 -- 172.21.15.99:0/3508481820 >> 172.21.15.99:0/3508481820 conn(0x7fc2cc0723b0 msgr2=0x7fc2cc0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:46.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.550+0000 7fc2d3931640 1 -- 172.21.15.99:0/3508481820 shutdown_connections 2024-09-19T06:56:46.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.550+0000 7fc2d3931640 1 -- 172.21.15.99:0/3508481820 wait complete. 2024-09-19T06:56:46.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.551+0000 7fc2d3931640 1 Processor -- start 2024-09-19T06:56:46.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.551+0000 7fc2d3931640 1 -- start start 2024-09-19T06:56:46.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.551+0000 7fc2d3931640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2cc0fb810 0x7fc2cc10e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:46.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.551+0000 7fc2d3931640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2cc0fcf80 0x7fc2cc10e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:46.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.551+0000 7fc2d3931640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2cc10ecb0 con 0x7fc2cc0fcf80 2024-09-19T06:56:46.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.551+0000 7fc2d3931640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2cc10ee20 con 0x7fc2cc0fb810 2024-09-19T06:56:46.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.551+0000 7fc2d0ecc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2cc0fcf80 0x7fc2cc10e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:46.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.551+0000 7fc2d0ecc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2cc0fcf80 0x7fc2cc10e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:44356/0 (socket says 172.21.15.99:44356) 2024-09-19T06:56:46.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.551+0000 7fc2d0ecc640 1 -- 172.21.15.99:0/1036986875 learned_addr learned my addr 172.21.15.99:0/1036986875 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:56:46.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.551+0000 7fc2d16cd640 1 --2- 172.21.15.99:0/1036986875 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2cc0fb810 0x7fc2cc10e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:46.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.552+0000 7fc2d0ecc640 1 -- 172.21.15.99:0/1036986875 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2cc0fb810 msgr2=0x7fc2cc10e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:46.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.552+0000 7fc2d0ecc640 1 --2- 172.21.15.99:0/1036986875 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2cc0fb810 0x7fc2cc10e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:46.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.552+0000 7fc2d0ecc640 1 -- 172.21.15.99:0/1036986875 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2c0005040 con 0x7fc2cc0fcf80 2024-09-19T06:56:46.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.552+0000 7fc2d0ecc640 1 --2- 172.21.15.99:0/1036986875 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2cc0fcf80 0x7fc2cc10e6b0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc2c0000c00 tx=0x7fc2c0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:46.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.552+0000 7fc2bdffb640 1 -- 172.21.15.99:0/1036986875 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2c0038070 con 0x7fc2cc0fcf80 2024-09-19T06:56:46.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.552+0000 7fc2bdffb640 1 -- 172.21.15.99:0/1036986875 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc2c002ade0 con 0x7fc2cc0fcf80 2024-09-19T06:56:46.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.552+0000 7fc2bdffb640 1 -- 172.21.15.99:0/1036986875 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2c002c7e0 con 0x7fc2cc0fcf80 2024-09-19T06:56:46.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.552+0000 7fc2d3931640 1 -- 172.21.15.99:0/1036986875 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2cc1171e0 con 0x7fc2cc0fcf80 2024-09-19T06:56:46.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.552+0000 7fc2d3931640 1 -- 172.21.15.99:0/1036986875 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2cc117640 con 0x7fc2cc0fcf80 2024-09-19T06:56:46.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.553+0000 7fc2d3931640 1 -- 172.21.15.99:0/1036986875 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2cc0fcbc0 con 0x7fc2cc0fcf80 2024-09-19T06:56:46.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.554+0000 7fc2bdffb640 1 -- 172.21.15.99:0/1036986875 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fc2c0030020 con 0x7fc2cc0fcf80 2024-09-19T06:56:46.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.554+0000 7fc2bdffb640 1 --2- 172.21.15.99:0/1036986875 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fc2b806e530 0x7fc2b80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:46.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.555+0000 7fc2bdffb640 1 -- 172.21.15.99:0/1036986875 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fc2c00add50 con 0x7fc2cc0fcf80 2024-09-19T06:56:46.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.555+0000 7fc2d16cd640 1 --2- 172.21.15.99:0/1036986875 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fc2b806e530 0x7fc2b80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:46.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.555+0000 7fc2d16cd640 1 --2- 172.21.15.99:0/1036986875 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fc2b806e530 0x7fc2b80709e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc2c8004ed0 tx=0x7fc2c800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:46.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.559+0000 7fc2bdffb640 1 -- 172.21.15.99:0/1036986875 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fc2c0076f70 con 0x7fc2cc0fcf80 2024-09-19T06:56:46.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:56:46 smithi117 ceph-mon[76771]: pgmap v432: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:56:46.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.741+0000 7fc2d3931640 1 -- 172.21.15.99:0/1036986875 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc2cc04b720 con 0x7fc2b806e530 2024-09-19T06:56:46.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.743+0000 7fc2bdffb640 1 -- 172.21.15.99:0/1036986875 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fc2cc04b720 con 0x7fc2b806e530 2024-09-19T06:56:46.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.745+0000 7fc2d3931640 1 -- 172.21.15.99:0/1036986875 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fc2b806e530 msgr2=0x7fc2b80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:46.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.745+0000 7fc2d3931640 1 --2- 172.21.15.99:0/1036986875 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fc2b806e530 0x7fc2b80709e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc2c8004ed0 tx=0x7fc2c800b040 comp rx=0 tx=0).stop 2024-09-19T06:56:46.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.745+0000 7fc2d3931640 1 -- 172.21.15.99:0/1036986875 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2cc0fcf80 msgr2=0x7fc2cc10e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:46.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.745+0000 7fc2d3931640 1 --2- 172.21.15.99:0/1036986875 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2cc0fcf80 0x7fc2cc10e6b0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc2c0000c00 tx=0x7fc2c0009da0 comp rx=0 tx=0).stop 2024-09-19T06:56:46.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.745+0000 7fc2d3931640 1 -- 172.21.15.99:0/1036986875 shutdown_connections 2024-09-19T06:56:46.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.745+0000 7fc2d3931640 1 --2- 172.21.15.99:0/1036986875 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fc2b806e530 0x7fc2b80709e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:46.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.745+0000 7fc2d3931640 1 --2- 172.21.15.99:0/1036986875 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2cc0fcf80 0x7fc2cc10e6b0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:46.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.745+0000 7fc2d3931640 1 --2- 172.21.15.99:0/1036986875 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2cc0fb810 0x7fc2cc10e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:46.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.745+0000 7fc2d3931640 1 -- 172.21.15.99:0/1036986875 >> 172.21.15.99:0/1036986875 conn(0x7fc2cc0723b0 msgr2=0x7fc2cc0fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:46.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.745+0000 7fc2d3931640 1 -- 172.21.15.99:0/1036986875 shutdown_connections 2024-09-19T06:56:46.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.745+0000 7fc2d3931640 1 -- 172.21.15.99:0/1036986875 wait complete. 2024-09-19T06:56:46.755 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-09-19T06:56:46.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.824+0000 7f1e63a78640 1 -- 172.21.15.99:0/1720940535 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e5c102550 msgr2=0x7f1e5c102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:46.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.824+0000 7f1e63a78640 1 --2- 172.21.15.99:0/1720940535 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e5c102550 0x7f1e5c102920 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f1e500048d0 tx=0x7f1e50009da0 comp rx=0 tx=0).stop 2024-09-19T06:56:46.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.824+0000 7f1e63a78640 1 -- 172.21.15.99:0/1720940535 shutdown_connections 2024-09-19T06:56:46.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.824+0000 7f1e63a78640 1 --2- 172.21.15.99:0/1720940535 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e5c102ef0 0x7f1e5c0fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:46.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.824+0000 7f1e63a78640 1 --2- 172.21.15.99:0/1720940535 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e5c102550 0x7f1e5c102920 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:46.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.824+0000 7f1e63a78640 1 -- 172.21.15.99:0/1720940535 >> 172.21.15.99:0/1720940535 conn(0x7f1e5c0f80f0 msgr2=0x7f1e5c0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:46.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.824+0000 7f1e63a78640 1 -- 172.21.15.99:0/1720940535 shutdown_connections 2024-09-19T06:56:46.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.824+0000 7f1e63a78640 1 -- 172.21.15.99:0/1720940535 wait complete. 2024-09-19T06:56:46.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.825+0000 7f1e63a78640 1 Processor -- start 2024-09-19T06:56:46.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.825+0000 7f1e63a78640 1 -- start start 2024-09-19T06:56:46.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.825+0000 7f1e63a78640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e5c102550 0x7f1e5c113540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:46.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.825+0000 7f1e63a78640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e5c102ef0 0x7f1e5c113a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:46.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.825+0000 7f1e63a78640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5c1140d0 con 0x7f1e5c102550 2024-09-19T06:56:46.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.825+0000 7f1e63a78640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5c10d4e0 con 0x7f1e5c102ef0 2024-09-19T06:56:46.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.825+0000 7f1e61814640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e5c102550 0x7f1e5c113540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:46.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.825+0000 7f1e61814640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e5c102550 0x7f1e5c113540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:44378/0 (socket says 172.21.15.99:44378) 2024-09-19T06:56:46.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.825+0000 7f1e61814640 1 -- 172.21.15.99:0/199905018 learned_addr learned my addr 172.21.15.99:0/199905018 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:56:46.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.825+0000 7f1e61013640 1 --2- 172.21.15.99:0/199905018 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e5c102ef0 0x7f1e5c113a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:46.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.826+0000 7f1e61814640 1 -- 172.21.15.99:0/199905018 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e5c102ef0 msgr2=0x7f1e5c113a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:46.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.826+0000 7f1e61814640 1 --2- 172.21.15.99:0/199905018 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e5c102ef0 0x7f1e5c113a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:46.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.826+0000 7f1e61814640 1 -- 172.21.15.99:0/199905018 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e50005040 con 0x7f1e5c102550 2024-09-19T06:56:46.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.826+0000 7f1e61814640 1 --2- 172.21.15.99:0/199905018 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e5c102550 0x7f1e5c113540 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f1e50000c00 tx=0x7f1e50009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:46.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.826+0000 7f1e4e7fc640 1 -- 172.21.15.99:0/199905018 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e50038070 con 0x7f1e5c102550 2024-09-19T06:56:46.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.826+0000 7f1e63a78640 1 -- 172.21.15.99:0/199905018 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e5c10d760 con 0x7f1e5c102550 2024-09-19T06:56:46.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.826+0000 7f1e4e7fc640 1 -- 172.21.15.99:0/199905018 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1e5002ade0 con 0x7f1e5c102550 2024-09-19T06:56:46.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.826+0000 7f1e4e7fc640 1 -- 172.21.15.99:0/199905018 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e5002c7b0 con 0x7f1e5c102550 2024-09-19T06:56:46.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.826+0000 7f1e63a78640 1 -- 172.21.15.99:0/199905018 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e5c10dca0 con 0x7f1e5c102550 2024-09-19T06:56:46.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.827+0000 7f1e63a78640 1 -- 172.21.15.99:0/199905018 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e5c0fdcd0 con 0x7f1e5c102550 2024-09-19T06:56:46.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.828+0000 7f1e4e7fc640 1 -- 172.21.15.99:0/199905018 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f1e50030020 con 0x7f1e5c102550 2024-09-19T06:56:46.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.828+0000 7f1e4e7fc640 1 --2- 172.21.15.99:0/199905018 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f1e4806e530 0x7f1e480709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:46.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.828+0000 7f1e4e7fc640 1 -- 172.21.15.99:0/199905018 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f1e500ae410 con 0x7f1e5c102550 2024-09-19T06:56:46.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.828+0000 7f1e61013640 1 --2- 172.21.15.99:0/199905018 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f1e4806e530 0x7f1e480709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:46.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.829+0000 7f1e61013640 1 --2- 172.21.15.99:0/199905018 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f1e4806e530 0x7f1e480709e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c10e7c0 tx=0x7f1e5800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:46.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:46.833+0000 7f1e4e7fc640 1 -- 172.21.15.99:0/199905018 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f1e50077500 con 0x7f1e5c102550 2024-09-19T06:56:47.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.015+0000 7f1e63a78640 1 -- 172.21.15.99:0/199905018 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1e5c04b720 con 0x7f1e4806e530 2024-09-19T06:56:47.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.016+0000 7f1e4e7fc640 1 -- 172.21.15.99:0/199905018 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f1e5c04b720 con 0x7f1e4806e530 2024-09-19T06:56:47.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.018+0000 7f1e63a78640 1 -- 172.21.15.99:0/199905018 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f1e4806e530 msgr2=0x7f1e480709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:47.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.018+0000 7f1e63a78640 1 --2- 172.21.15.99:0/199905018 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f1e4806e530 0x7f1e480709e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c10e7c0 tx=0x7f1e5800b040 comp rx=0 tx=0).stop 2024-09-19T06:56:47.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.018+0000 7f1e63a78640 1 -- 172.21.15.99:0/199905018 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e5c102550 msgr2=0x7f1e5c113540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:47.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.018+0000 7f1e63a78640 1 --2- 172.21.15.99:0/199905018 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e5c102550 0x7f1e5c113540 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f1e50000c00 tx=0x7f1e50009da0 comp rx=0 tx=0).stop 2024-09-19T06:56:47.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.018+0000 7f1e63a78640 1 -- 172.21.15.99:0/199905018 shutdown_connections 2024-09-19T06:56:47.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.018+0000 7f1e63a78640 1 --2- 172.21.15.99:0/199905018 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f1e4806e530 0x7f1e480709e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:47.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.018+0000 7f1e63a78640 1 --2- 172.21.15.99:0/199905018 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1e5c102ef0 0x7f1e5c113a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:47.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.018+0000 7f1e63a78640 1 --2- 172.21.15.99:0/199905018 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e5c102550 0x7f1e5c113540 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:47.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.018+0000 7f1e63a78640 1 -- 172.21.15.99:0/199905018 >> 172.21.15.99:0/199905018 conn(0x7f1e5c0f80f0 msgr2=0x7f1e5c0f9160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:47.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.018+0000 7f1e63a78640 1 -- 172.21.15.99:0/199905018 shutdown_connections 2024-09-19T06:56:47.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.018+0000 7f1e63a78640 1 -- 172.21.15.99:0/199905018 wait complete. 2024-09-19T06:56:47.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.097+0000 7f0c9fa4f640 1 -- 172.21.15.99:0/1006704068 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c98102550 msgr2=0x7f0c98102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:47.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.097+0000 7f0c9fa4f640 1 --2- 172.21.15.99:0/1006704068 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c98102550 0x7f0c98102920 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f0c900048d0 tx=0x7f0c90009da0 comp rx=0 tx=0).stop 2024-09-19T06:56:47.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.097+0000 7f0c9fa4f640 1 -- 172.21.15.99:0/1006704068 shutdown_connections 2024-09-19T06:56:47.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.097+0000 7f0c9fa4f640 1 --2- 172.21.15.99:0/1006704068 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c98102ef0 0x7f0c980fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:47.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.097+0000 7f0c9fa4f640 1 --2- 172.21.15.99:0/1006704068 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c98102550 0x7f0c98102920 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:47.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.097+0000 7f0c9fa4f640 1 -- 172.21.15.99:0/1006704068 >> 172.21.15.99:0/1006704068 conn(0x7f0c980f80f0 msgr2=0x7f0c980fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:47.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.097+0000 7f0c9fa4f640 1 -- 172.21.15.99:0/1006704068 shutdown_connections 2024-09-19T06:56:47.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.097+0000 7f0c9fa4f640 1 -- 172.21.15.99:0/1006704068 wait complete. 2024-09-19T06:56:47.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.098+0000 7f0c9fa4f640 1 Processor -- start 2024-09-19T06:56:47.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.098+0000 7f0c9fa4f640 1 -- start start 2024-09-19T06:56:47.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.098+0000 7f0c9fa4f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c98102550 0x7f0c98113540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:47.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.098+0000 7f0c9fa4f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c98102ef0 0x7f0c98113a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:47.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.098+0000 7f0c9fa4f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c981140d0 con 0x7f0c98102550 2024-09-19T06:56:47.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.098+0000 7f0c9fa4f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9810d4e0 con 0x7f0c98102ef0 2024-09-19T06:56:47.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.098+0000 7f0c9d7eb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c98102550 0x7f0c98113540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:47.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.098+0000 7f0c9d7eb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c98102550 0x7f0c98113540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:44388/0 (socket says 172.21.15.99:44388) 2024-09-19T06:56:47.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.098+0000 7f0c9d7eb640 1 -- 172.21.15.99:0/3580253196 learned_addr learned my addr 172.21.15.99:0/3580253196 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:56:47.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.098+0000 7f0c9cfea640 1 --2- 172.21.15.99:0/3580253196 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c98102ef0 0x7f0c98113a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:47.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.098+0000 7f0c9d7eb640 1 -- 172.21.15.99:0/3580253196 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c98102ef0 msgr2=0x7f0c98113a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:47.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.098+0000 7f0c9d7eb640 1 --2- 172.21.15.99:0/3580253196 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c98102ef0 0x7f0c98113a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:47.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.098+0000 7f0c9d7eb640 1 -- 172.21.15.99:0/3580253196 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c90005040 con 0x7f0c98102550 2024-09-19T06:56:47.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.098+0000 7f0c9d7eb640 1 --2- 172.21.15.99:0/3580253196 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c98102550 0x7f0c98113540 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f0c90000c00 tx=0x7f0c90009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:47.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.099+0000 7f0c95ffb640 1 -- 172.21.15.99:0/3580253196 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c90038070 con 0x7f0c98102550 2024-09-19T06:56:47.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.099+0000 7f0c95ffb640 1 -- 172.21.15.99:0/3580253196 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0c9002ade0 con 0x7f0c98102550 2024-09-19T06:56:47.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.099+0000 7f0c9fa4f640 1 -- 172.21.15.99:0/3580253196 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c9810d760 con 0x7f0c98102550 2024-09-19T06:56:47.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.099+0000 7f0c95ffb640 1 -- 172.21.15.99:0/3580253196 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c9002c7b0 con 0x7f0c98102550 2024-09-19T06:56:47.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.099+0000 7f0c9fa4f640 1 -- 172.21.15.99:0/3580253196 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c9810dca0 con 0x7f0c98102550 2024-09-19T06:56:47.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.100+0000 7f0c9fa4f640 1 -- 172.21.15.99:0/3580253196 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c980fdcd0 con 0x7f0c98102550 2024-09-19T06:56:47.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.100+0000 7f0c95ffb640 1 -- 172.21.15.99:0/3580253196 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f0c90030020 con 0x7f0c98102550 2024-09-19T06:56:47.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.101+0000 7f0c95ffb640 1 --2- 172.21.15.99:0/3580253196 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f0c8006e530 0x7f0c800709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:47.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.101+0000 7f0c95ffb640 1 -- 172.21.15.99:0/3580253196 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f0c900ae4e0 con 0x7f0c98102550 2024-09-19T06:56:47.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.101+0000 7f0c9cfea640 1 --2- 172.21.15.99:0/3580253196 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f0c8006e530 0x7f0c800709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:47.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.101+0000 7f0c9cfea640 1 --2- 172.21.15.99:0/3580253196 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f0c8006e530 0x7f0c800709e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0c9810e7c0 tx=0x7f0c8c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:47.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.105+0000 7f0c95ffb640 1 -- 172.21.15.99:0/3580253196 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f0c90077650 con 0x7f0c98102550 2024-09-19T06:56:47.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.281+0000 7f0c9fa4f640 1 -- 172.21.15.99:0/3580253196 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0c9804b720 con 0x7f0c8006e530 2024-09-19T06:56:47.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.289+0000 7f0c95ffb640 1 -- 172.21.15.99:0/3580253196 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f0c9804b720 con 0x7f0c8006e530 2024-09-19T06:56:47.290 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T06:56:47.291 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.smithi099 smithi099 *:9093,9094 running (15m) 8m ago 24m 23.4M - 0.25.0 c8568f914cd2 e7c1774d56b0 2024-09-19T06:56:47.291 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi099 smithi099 running (12m) 8m ago 24m 6899k - 19.1.1-361-g2f599a46 d2baa855c067 b9775f416b10 2024-09-19T06:56:47.291 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi117 smithi117 running (12m) 7m ago 23m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 38cf60c0d548 2024-09-19T06:56:47.291 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.smithi099 smithi099 *:3000 running (14m) 8m ago 23m 80.7M - 9.4.12 2bacad6d85d8 cd53a18d5410 2024-09-19T06:56:47.291 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.obarqf smithi099 running (8m) 8m ago 19m 12.2M - 19.1.1-361-g2f599a46 d2baa855c067 314a73082521 2024-09-19T06:56:47.291 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.xehbxe smithi099 running (8m) 8m ago 18m 14.4M - 19.1.1-361-g2f599a46 d2baa855c067 a2955a9d06e6 2024-09-19T06:56:47.291 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.bheqzh smithi117 running (8m) 7m ago 18m 11.8M - 19.1.1-361-g2f599a46 d2baa855c067 b1505937c0b7 2024-09-19T06:56:47.291 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.nooexo smithi117 running (8m) 7m ago 18m 13.1M - 19.1.1-361-g2f599a46 d2baa855c067 35bd7725855c 2024-09-19T06:56:47.291 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi099.pgvkqi smithi099 *:8443,9283,8765 running (15m) 8m ago 25m 505M - 19.1.1-361-g2f599a46 d2baa855c067 d5de99cb7e78 2024-09-19T06:56:47.291 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi117.ssmkcf smithi117 *:8443,9283,8765 running (14m) 7m ago 23m 444M - 19.1.1-361-g2f599a46 d2baa855c067 8b7ee0f871f5 2024-09-19T06:56:47.291 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi099 smithi099 running (13m) 8m ago 25m 52.4M 2048M 19.1.1-361-g2f599a46 d2baa855c067 ffe067438824 2024-09-19T06:56:47.292 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi117 smithi117 running (12m) 7m ago 23m 38.9M 2048M 19.1.1-361-g2f599a46 d2baa855c067 4cb7455e3ee7 2024-09-19T06:56:47.292 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi099 smithi099 *:9100 running (15m) 8m ago 24m 15.0M - 1.5.0 0da6a335fe13 dca7b4517dcc 2024-09-19T06:56:47.292 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi117 smithi117 *:9100 running (15m) 7m ago 23m 15.9M - 1.5.0 0da6a335fe13 8233ce3835d2 2024-09-19T06:56:47.292 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (11m) 8m ago 22m 100M 1557M 19.1.1-361-g2f599a46 d2baa855c067 8e22543bf933 2024-09-19T06:56:47.292 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (11m) 8m ago 22m 106M 1557M 19.1.1-361-g2f599a46 d2baa855c067 f54153d0ae09 2024-09-19T06:56:47.292 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (10m) 8m ago 21m 83.7M 1557M 19.1.1-361-g2f599a46 d2baa855c067 b1778ab88870 2024-09-19T06:56:47.292 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi117 running (10m) 7m ago 21m 102M 2581M 19.1.1-361-g2f599a46 d2baa855c067 ea5236b193d3 2024-09-19T06:56:47.292 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi117 running (9m) 7m ago 20m 93.5M 2581M 19.1.1-361-g2f599a46 d2baa855c067 27ac2c859a68 2024-09-19T06:56:47.292 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi117 running (9m) 7m ago 20m 100M 2581M 19.1.1-361-g2f599a46 d2baa855c067 de6aeb8544ce 2024-09-19T06:56:47.292 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.smithi099 smithi099 *:9095 running (14m) 8m ago 23m 64.4M - 2.43.0 a07b618ecd1d 15ad26ec6fb4 2024-09-19T06:56:47.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.292+0000 7f0c9fa4f640 1 -- 172.21.15.99:0/3580253196 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f0c8006e530 msgr2=0x7f0c800709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:47.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.292+0000 7f0c9fa4f640 1 --2- 172.21.15.99:0/3580253196 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f0c8006e530 0x7f0c800709e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0c9810e7c0 tx=0x7f0c8c00b040 comp rx=0 tx=0).stop 2024-09-19T06:56:47.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.292+0000 7f0c9fa4f640 1 -- 172.21.15.99:0/3580253196 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c98102550 msgr2=0x7f0c98113540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:47.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.292+0000 7f0c9fa4f640 1 --2- 172.21.15.99:0/3580253196 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c98102550 0x7f0c98113540 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f0c90000c00 tx=0x7f0c90009da0 comp rx=0 tx=0).stop 2024-09-19T06:56:47.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.292+0000 7f0c9fa4f640 1 -- 172.21.15.99:0/3580253196 shutdown_connections 2024-09-19T06:56:47.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.292+0000 7f0c9fa4f640 1 --2- 172.21.15.99:0/3580253196 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f0c8006e530 0x7f0c800709e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:47.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.292+0000 7f0c9fa4f640 1 --2- 172.21.15.99:0/3580253196 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0c98102ef0 0x7f0c98113a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:47.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.292+0000 7f0c9fa4f640 1 --2- 172.21.15.99:0/3580253196 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0c98102550 0x7f0c98113540 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:47.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.292+0000 7f0c9fa4f640 1 -- 172.21.15.99:0/3580253196 >> 172.21.15.99:0/3580253196 conn(0x7f0c980f80f0 msgr2=0x7f0c980f9160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:47.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.292+0000 7f0c9fa4f640 1 -- 172.21.15.99:0/3580253196 shutdown_connections 2024-09-19T06:56:47.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.292+0000 7f0c9fa4f640 1 -- 172.21.15.99:0/3580253196 wait complete. 2024-09-19T06:56:47.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.369+0000 7f6cc1233640 1 -- 172.21.15.99:0/4060609597 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6cbc102ef0 msgr2=0x7f6cbc0fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:47.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.369+0000 7f6cc1233640 1 --2- 172.21.15.99:0/4060609597 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6cbc102ef0 0x7f6cbc0fc5b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f6ca40048d0 tx=0x7f6ca4009da0 comp rx=0 tx=0).stop 2024-09-19T06:56:47.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.369+0000 7f6cc1233640 1 -- 172.21.15.99:0/4060609597 shutdown_connections 2024-09-19T06:56:47.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.369+0000 7f6cc1233640 1 --2- 172.21.15.99:0/4060609597 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6cbc102ef0 0x7f6cbc0fc5b0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:47.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.369+0000 7f6cc1233640 1 --2- 172.21.15.99:0/4060609597 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6cbc102550 0x7f6cbc102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:47.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.369+0000 7f6cc1233640 1 -- 172.21.15.99:0/4060609597 >> 172.21.15.99:0/4060609597 conn(0x7f6cbc0f80f0 msgr2=0x7f6cbc0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:47.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.369+0000 7f6cc1233640 1 -- 172.21.15.99:0/4060609597 shutdown_connections 2024-09-19T06:56:47.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.369+0000 7f6cc1233640 1 -- 172.21.15.99:0/4060609597 wait complete. 2024-09-19T06:56:47.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.370+0000 7f6cc1233640 1 Processor -- start 2024-09-19T06:56:47.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.370+0000 7f6cc1233640 1 -- start start 2024-09-19T06:56:47.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.371+0000 7f6cc1233640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6cbc102550 0x7f6cbc113520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:47.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.371+0000 7f6cc1233640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6cbc102ef0 0x7f6cbc113a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:47.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.371+0000 7f6cc1233640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cbc1140b0 con 0x7f6cbc102ef0 2024-09-19T06:56:47.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.371+0000 7f6cc1233640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cbc10d4c0 con 0x7f6cbc102550 2024-09-19T06:56:47.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.371+0000 7f6cb259c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6cbc102ef0 0x7f6cbc113a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:47.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.371+0000 7f6cb259c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6cbc102ef0 0x7f6cbc113a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:44406/0 (socket says 172.21.15.99:44406) 2024-09-19T06:56:47.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.371+0000 7f6cb259c640 1 -- 172.21.15.99:0/3350486330 learned_addr learned my addr 172.21.15.99:0/3350486330 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:56:47.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.371+0000 7f6cbad9d640 1 --2- 172.21.15.99:0/3350486330 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6cbc102550 0x7f6cbc113520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:47.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.371+0000 7f6cbad9d640 1 -- 172.21.15.99:0/3350486330 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6cbc102ef0 msgr2=0x7f6cbc113a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:47.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.371+0000 7f6cbad9d640 1 --2- 172.21.15.99:0/3350486330 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6cbc102ef0 0x7f6cbc113a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:47.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.371+0000 7f6cbad9d640 1 -- 172.21.15.99:0/3350486330 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca4005040 con 0x7f6cbc102550 2024-09-19T06:56:47.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.371+0000 7f6cb259c640 1 --2- 172.21.15.99:0/3350486330 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6cbc102ef0 0x7f6cbc113a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:56:47.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.371+0000 7f6cbad9d640 1 --2- 172.21.15.99:0/3350486330 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6cbc102550 0x7f6cbc113520 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6cac00c760 tx=0x7f6cac004330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:47.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.372+0000 7f6cb3fff640 1 -- 172.21.15.99:0/3350486330 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6cac00a700 con 0x7f6cbc102550 2024-09-19T06:56:47.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.372+0000 7f6cb3fff640 1 -- 172.21.15.99:0/3350486330 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6cac00ad00 con 0x7f6cbc102550 2024-09-19T06:56:47.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.372+0000 7f6cc1233640 1 -- 172.21.15.99:0/3350486330 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cbc10d7a0 con 0x7f6cbc102550 2024-09-19T06:56:47.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.372+0000 7f6cb3fff640 1 -- 172.21.15.99:0/3350486330 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6cac0113a0 con 0x7f6cbc102550 2024-09-19T06:56:47.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.372+0000 7f6cc1233640 1 -- 172.21.15.99:0/3350486330 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cbc10dd40 con 0x7f6cbc102550 2024-09-19T06:56:47.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.373+0000 7f6cc1233640 1 -- 172.21.15.99:0/3350486330 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cbc0fdcd0 con 0x7f6cbc102550 2024-09-19T06:56:47.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.374+0000 7f6cb3fff640 1 -- 172.21.15.99:0/3350486330 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f6cac00a860 con 0x7f6cbc102550 2024-09-19T06:56:47.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.374+0000 7f6cb3fff640 1 --2- 172.21.15.99:0/3350486330 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f6ca806e530 0x7f6ca80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:47.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.374+0000 7f6cb3fff640 1 -- 172.21.15.99:0/3350486330 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f6cac08e010 con 0x7f6cbc102550 2024-09-19T06:56:47.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.374+0000 7f6cb259c640 1 --2- 172.21.15.99:0/3350486330 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f6ca806e530 0x7f6ca80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:47.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.375+0000 7f6cb259c640 1 --2- 172.21.15.99:0/3350486330 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f6ca806e530 0x7f6ca80709e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc10e7a0 tx=0x7f6ca4035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:47.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.379+0000 7f6cb3fff640 1 -- 172.21.15.99:0/3350486330 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f6cac057240 con 0x7f6cbc102550 2024-09-19T06:56:47.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.609+0000 7f6cc1233640 1 -- 172.21.15.99:0/3350486330 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6cbc0fbd50 con 0x7f6cbc102550 2024-09-19T06:56:47.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.610+0000 7f6cb3fff640 1 -- 172.21.15.99:0/3350486330 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f6cac05a900 con 0x7f6cbc102550 2024-09-19T06:56:47.611 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:56:47.611 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-09-19T06:56:47.611 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T06:56:47.611 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:56:47.611 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-09-19T06:56:47.611 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T06:56:47.611 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:56:47.611 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-09-19T06:56:47.611 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 6 2024-09-19T06:56:47.612 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:56:47.612 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": { 2024-09-19T06:56:47.612 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 4 2024-09-19T06:56:47.612 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:56:47.612 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-09-19T06:56:47.612 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 14 2024-09-19T06:56:47.612 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T06:56:47.612 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:56:47.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.612+0000 7f6cc1233640 1 -- 172.21.15.99:0/3350486330 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f6ca806e530 msgr2=0x7f6ca80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:47.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.612+0000 7f6cc1233640 1 --2- 172.21.15.99:0/3350486330 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f6ca806e530 0x7f6ca80709e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc10e7a0 tx=0x7f6ca4035040 comp rx=0 tx=0).stop 2024-09-19T06:56:47.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.612+0000 7f6cc1233640 1 -- 172.21.15.99:0/3350486330 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6cbc102550 msgr2=0x7f6cbc113520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:47.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.612+0000 7f6cc1233640 1 --2- 172.21.15.99:0/3350486330 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6cbc102550 0x7f6cbc113520 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6cac00c760 tx=0x7f6cac004330 comp rx=0 tx=0).stop 2024-09-19T06:56:47.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.612+0000 7f6cc1233640 1 -- 172.21.15.99:0/3350486330 shutdown_connections 2024-09-19T06:56:47.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.612+0000 7f6cc1233640 1 --2- 172.21.15.99:0/3350486330 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f6ca806e530 0x7f6ca80709e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:47.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.612+0000 7f6cc1233640 1 --2- 172.21.15.99:0/3350486330 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6cbc102ef0 0x7f6cbc113a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:47.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.612+0000 7f6cc1233640 1 --2- 172.21.15.99:0/3350486330 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6cbc102550 0x7f6cbc113520 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:47.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.612+0000 7f6cc1233640 1 -- 172.21.15.99:0/3350486330 >> 172.21.15.99:0/3350486330 conn(0x7f6cbc0f80f0 msgr2=0x7f6cbc0f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:47.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.612+0000 7f6cc1233640 1 -- 172.21.15.99:0/3350486330 shutdown_connections 2024-09-19T06:56:47.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.612+0000 7f6cc1233640 1 -- 172.21.15.99:0/3350486330 wait complete. 2024-09-19T06:56:47.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.690+0000 7ff60c26c640 1 -- 172.21.15.99:0/2906471272 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff604102ef0 msgr2=0x7ff6040fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:47.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.690+0000 7ff60c26c640 1 --2- 172.21.15.99:0/2906471272 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff604102ef0 0x7ff6040fc5b0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7ff5f80048d0 tx=0x7ff5f8009da0 comp rx=0 tx=0).stop 2024-09-19T06:56:47.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.690+0000 7ff60c26c640 1 -- 172.21.15.99:0/2906471272 shutdown_connections 2024-09-19T06:56:47.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.690+0000 7ff60c26c640 1 --2- 172.21.15.99:0/2906471272 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff604102ef0 0x7ff6040fc5b0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:47.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.690+0000 7ff60c26c640 1 --2- 172.21.15.99:0/2906471272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff604102550 0x7ff604102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:47.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.690+0000 7ff60c26c640 1 -- 172.21.15.99:0/2906471272 >> 172.21.15.99:0/2906471272 conn(0x7ff6040f80f0 msgr2=0x7ff6040fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:47.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.690+0000 7ff60c26c640 1 -- 172.21.15.99:0/2906471272 shutdown_connections 2024-09-19T06:56:47.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.690+0000 7ff60c26c640 1 -- 172.21.15.99:0/2906471272 wait complete. 2024-09-19T06:56:47.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.691+0000 7ff60c26c640 1 Processor -- start 2024-09-19T06:56:47.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.691+0000 7ff60c26c640 1 -- start start 2024-09-19T06:56:47.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.691+0000 7ff60c26c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff604102550 0x7ff604113520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:47.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.691+0000 7ff60c26c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff604102ef0 0x7ff604113a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:47.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.691+0000 7ff60c26c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6041140b0 con 0x7ff604102550 2024-09-19T06:56:47.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.691+0000 7ff60c26c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff60410d4c0 con 0x7ff604102ef0 2024-09-19T06:56:47.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.691+0000 7ff60a008640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff604102550 0x7ff604113520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:47.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.691+0000 7ff60a008640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff604102550 0x7ff604113520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:44424/0 (socket says 172.21.15.99:44424) 2024-09-19T06:56:47.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.691+0000 7ff60a008640 1 -- 172.21.15.99:0/4096854997 learned_addr learned my addr 172.21.15.99:0/4096854997 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:56:47.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.691+0000 7ff609807640 1 --2- 172.21.15.99:0/4096854997 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff604102ef0 0x7ff604113a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:47.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.691+0000 7ff60a008640 1 -- 172.21.15.99:0/4096854997 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff604102ef0 msgr2=0x7ff604113a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:47.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.691+0000 7ff60a008640 1 --2- 172.21.15.99:0/4096854997 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff604102ef0 0x7ff604113a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:47.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.691+0000 7ff60a008640 1 -- 172.21.15.99:0/4096854997 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f8005040 con 0x7ff604102550 2024-09-19T06:56:47.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.692+0000 7ff60a008640 1 --2- 172.21.15.99:0/4096854997 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff604102550 0x7ff604113520 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7ff600002a50 tx=0x7ff600004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:47.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.692+0000 7ff5f6ffd640 1 -- 172.21.15.99:0/4096854997 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff600007c30 con 0x7ff604102550 2024-09-19T06:56:47.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.692+0000 7ff5f6ffd640 1 -- 172.21.15.99:0/4096854997 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff60000f040 con 0x7ff604102550 2024-09-19T06:56:47.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.692+0000 7ff60c26c640 1 -- 172.21.15.99:0/4096854997 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff60410d7a0 con 0x7ff604102550 2024-09-19T06:56:47.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.692+0000 7ff5f6ffd640 1 -- 172.21.15.99:0/4096854997 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff60000da10 con 0x7ff604102550 2024-09-19T06:56:47.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.692+0000 7ff60c26c640 1 -- 172.21.15.99:0/4096854997 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff60410dd10 con 0x7ff604102550 2024-09-19T06:56:47.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.693+0000 7ff60c26c640 1 -- 172.21.15.99:0/4096854997 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6040fdcd0 con 0x7ff604102550 2024-09-19T06:56:47.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.693+0000 7ff5f6ffd640 1 -- 172.21.15.99:0/4096854997 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7ff60000dc80 con 0x7ff604102550 2024-09-19T06:56:47.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.694+0000 7ff5f6ffd640 1 --2- 172.21.15.99:0/4096854997 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ff5f006e530 0x7ff5f00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:47.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.694+0000 7ff5f6ffd640 1 -- 172.21.15.99:0/4096854997 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7ff60008d930 con 0x7ff604102550 2024-09-19T06:56:47.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.694+0000 7ff609807640 1 --2- 172.21.15.99:0/4096854997 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ff5f006e530 0x7ff5f00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:47.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.694+0000 7ff609807640 1 --2- 172.21.15.99:0/4096854997 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ff5f006e530 0x7ff5f00709e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff5f80048a0 tx=0x7ff5f8035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:47.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.698+0000 7ff5f6ffd640 1 -- 172.21.15.99:0/4096854997 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7ff600056ad0 con 0x7ff604102550 2024-09-19T06:56:47.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.900+0000 7ff60c26c640 1 -- 172.21.15.99:0/4096854997 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff60404b750 con 0x7ff604102550 2024-09-19T06:56:47.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.900+0000 7ff5f6ffd640 1 -- 172.21.15.99:0/4096854997 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 29 v29) v1 ==== 76+0+1915 (secure 0 0 0) 0x7ff60005a190 con 0x7ff604102550 2024-09-19T06:56:47.901 INFO:teuthology.orchestra.run.smithi099.stdout:e29 2024-09-19T06:56:47.901 INFO:teuthology.orchestra.run.smithi099.stdout:btime 2024-09-19T06:48:47:938420+0000 2024-09-19T06:56:47.902 INFO:teuthology.orchestra.run.smithi099.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T06:56:47.902 INFO:teuthology.orchestra.run.smithi099.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T06:56:47.902 INFO:teuthology.orchestra.run.smithi099.stdout:legacy client fscid: 1 2024-09-19T06:56:47.902 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:56:47.902 INFO:teuthology.orchestra.run.smithi099.stdout:Filesystem 'cephfs' (1) 2024-09-19T06:56:47.902 INFO:teuthology.orchestra.run.smithi099.stdout:fs_name cephfs 2024-09-19T06:56:47.902 INFO:teuthology.orchestra.run.smithi099.stdout:epoch 20 2024-09-19T06:56:47.902 INFO:teuthology.orchestra.run.smithi099.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-19T06:56:47.902 INFO:teuthology.orchestra.run.smithi099.stdout:created 2024-09-19T06:37:40.838146+0000 2024-09-19T06:56:47.902 INFO:teuthology.orchestra.run.smithi099.stdout:modified 2024-09-19T06:47:50.076553+0000 2024-09-19T06:56:47.902 INFO:teuthology.orchestra.run.smithi099.stdout:tableserver 0 2024-09-19T06:56:47.902 INFO:teuthology.orchestra.run.smithi099.stdout:root 0 2024-09-19T06:56:47.903 INFO:teuthology.orchestra.run.smithi099.stdout:session_timeout 60 2024-09-19T06:56:47.903 INFO:teuthology.orchestra.run.smithi099.stdout:session_autoclose 300 2024-09-19T06:56:47.903 INFO:teuthology.orchestra.run.smithi099.stdout:max_file_size 1099511627776 2024-09-19T06:56:47.903 INFO:teuthology.orchestra.run.smithi099.stdout:max_xattr_size 65536 2024-09-19T06:56:47.903 INFO:teuthology.orchestra.run.smithi099.stdout:required_client_features {} 2024-09-19T06:56:47.903 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure 0 2024-09-19T06:56:47.903 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure_osd_epoch 77 2024-09-19T06:56:47.903 INFO:teuthology.orchestra.run.smithi099.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T06:56:47.903 INFO:teuthology.orchestra.run.smithi099.stdout:max_mds 2 2024-09-19T06:56:47.903 INFO:teuthology.orchestra.run.smithi099.stdout:in 0,1 2024-09-19T06:56:47.903 INFO:teuthology.orchestra.run.smithi099.stdout:up {} 2024-09-19T06:56:47.903 INFO:teuthology.orchestra.run.smithi099.stdout:failed 0,1 2024-09-19T06:56:47.903 INFO:teuthology.orchestra.run.smithi099.stdout:damaged 2024-09-19T06:56:47.904 INFO:teuthology.orchestra.run.smithi099.stdout:stopped 2024-09-19T06:56:47.904 INFO:teuthology.orchestra.run.smithi099.stdout:data_pools [3] 2024-09-19T06:56:47.904 INFO:teuthology.orchestra.run.smithi099.stdout:metadata_pool 2 2024-09-19T06:56:47.904 INFO:teuthology.orchestra.run.smithi099.stdout:inline_data disabled 2024-09-19T06:56:47.904 INFO:teuthology.orchestra.run.smithi099.stdout:balancer 2024-09-19T06:56:47.904 INFO:teuthology.orchestra.run.smithi099.stdout:bal_rank_mask -1 2024-09-19T06:56:47.904 INFO:teuthology.orchestra.run.smithi099.stdout:standby_count_wanted 1 2024-09-19T06:56:47.904 INFO:teuthology.orchestra.run.smithi099.stdout:qdb_cluster leader: 0 members: 2024-09-19T06:56:47.904 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:56:47.904 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:56:47.904 INFO:teuthology.orchestra.run.smithi099.stdout:Standby daemons: 2024-09-19T06:56:47.905 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:56:47.905 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.obarqf{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6826/1859154203,v1:172.21.15.99:6827/1859154203] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:56:47.905 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.xehbxe{-1:34410} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6828/1939453719,v1:172.21.15.99:6829/1939453719] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:56:47.905 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.nooexo{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6824/1398895079,v1:172.21.15.117:6825/1398895079] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:56:47.905 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.bheqzh{-1:44329} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6826/3233337308,v1:172.21.15.117:6827/3233337308] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:56:47.906 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 29 2024-09-19T06:56:47.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.902+0000 7ff60c26c640 1 -- 172.21.15.99:0/4096854997 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ff5f006e530 msgr2=0x7ff5f00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:47.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.902+0000 7ff60c26c640 1 --2- 172.21.15.99:0/4096854997 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ff5f006e530 0x7ff5f00709e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff5f80048a0 tx=0x7ff5f8035040 comp rx=0 tx=0).stop 2024-09-19T06:56:47.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.902+0000 7ff60c26c640 1 -- 172.21.15.99:0/4096854997 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff604102550 msgr2=0x7ff604113520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:47.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.902+0000 7ff60c26c640 1 --2- 172.21.15.99:0/4096854997 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff604102550 0x7ff604113520 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7ff600002a50 tx=0x7ff600004600 comp rx=0 tx=0).stop 2024-09-19T06:56:47.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.902+0000 7ff60c26c640 1 -- 172.21.15.99:0/4096854997 shutdown_connections 2024-09-19T06:56:47.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.902+0000 7ff60c26c640 1 --2- 172.21.15.99:0/4096854997 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ff5f006e530 0x7ff5f00709e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:47.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.902+0000 7ff60c26c640 1 --2- 172.21.15.99:0/4096854997 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff604102ef0 0x7ff604113a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:47.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.902+0000 7ff60c26c640 1 --2- 172.21.15.99:0/4096854997 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff604102550 0x7ff604113520 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:47.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.902+0000 7ff60c26c640 1 -- 172.21.15.99:0/4096854997 >> 172.21.15.99:0/4096854997 conn(0x7ff6040f80f0 msgr2=0x7ff6040f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:47.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.902+0000 7ff60c26c640 1 -- 172.21.15.99:0/4096854997 shutdown_connections 2024-09-19T06:56:47.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.902+0000 7ff60c26c640 1 -- 172.21.15.99:0/4096854997 wait complete. 2024-09-19T06:56:47.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.982+0000 7ff456fdd640 1 -- 172.21.15.99:0/2649457078 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4501014e0 msgr2=0x7ff4501018b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:47.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.982+0000 7ff456fdd640 1 --2- 172.21.15.99:0/2649457078 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4501014e0 0x7ff4501018b0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7ff448009c50 tx=0x7ff448004d10 comp rx=0 tx=0).stop 2024-09-19T06:56:47.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.982+0000 7ff456fdd640 1 -- 172.21.15.99:0/2649457078 shutdown_connections 2024-09-19T06:56:47.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.982+0000 7ff456fdd640 1 --2- 172.21.15.99:0/2649457078 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4500fb4a0 0x7ff4500fb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:47.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.982+0000 7ff456fdd640 1 --2- 172.21.15.99:0/2649457078 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4501014e0 0x7ff4501018b0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:47.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.982+0000 7ff456fdd640 1 -- 172.21.15.99:0/2649457078 >> 172.21.15.99:0/2649457078 conn(0x7ff4500f7060 msgr2=0x7ff4500f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:47.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.982+0000 7ff456fdd640 1 -- 172.21.15.99:0/2649457078 shutdown_connections 2024-09-19T06:56:47.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.982+0000 7ff456fdd640 1 -- 172.21.15.99:0/2649457078 wait complete. 2024-09-19T06:56:47.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.982+0000 7ff456fdd640 1 Processor -- start 2024-09-19T06:56:47.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.982+0000 7ff456fdd640 1 -- start start 2024-09-19T06:56:47.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.983+0000 7ff456fdd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4500fb4a0 0x7ff45010e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:47.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.983+0000 7ff456fdd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4501014e0 0x7ff45010e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:47.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.983+0000 7ff456fdd640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff45010ed10 con 0x7ff4500fb4a0 2024-09-19T06:56:47.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.983+0000 7ff456fdd640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff45010ee80 con 0x7ff4501014e0 2024-09-19T06:56:47.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.983+0000 7ff454d79640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4500fb4a0 0x7ff45010e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:47.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.983+0000 7ff454d79640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4500fb4a0 0x7ff45010e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:44444/0 (socket says 172.21.15.99:44444) 2024-09-19T06:56:47.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.983+0000 7ff454d79640 1 -- 172.21.15.99:0/89507114 learned_addr learned my addr 172.21.15.99:0/89507114 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:56:47.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.983+0000 7ff44ffff640 1 --2- 172.21.15.99:0/89507114 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4501014e0 0x7ff45010e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:47.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.983+0000 7ff454d79640 1 -- 172.21.15.99:0/89507114 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4501014e0 msgr2=0x7ff45010e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:47.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.983+0000 7ff454d79640 1 --2- 172.21.15.99:0/89507114 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4501014e0 0x7ff45010e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:47.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.983+0000 7ff454d79640 1 -- 172.21.15.99:0/89507114 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4480098b0 con 0x7ff4500fb4a0 2024-09-19T06:56:47.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.983+0000 7ff454d79640 1 --2- 172.21.15.99:0/89507114 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4500fb4a0 0x7ff45010e180 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7ff448004750 tx=0x7ff448004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:47.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.984+0000 7ff44d7fa640 1 -- 172.21.15.99:0/89507114 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff448009590 con 0x7ff4500fb4a0 2024-09-19T06:56:47.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.984+0000 7ff456fdd640 1 -- 172.21.15.99:0/89507114 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4501171f0 con 0x7ff4500fb4a0 2024-09-19T06:56:47.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.984+0000 7ff44d7fa640 1 -- 172.21.15.99:0/89507114 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff4480096f0 con 0x7ff4500fb4a0 2024-09-19T06:56:47.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.984+0000 7ff44d7fa640 1 -- 172.21.15.99:0/89507114 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff44803d960 con 0x7ff4500fb4a0 2024-09-19T06:56:47.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.984+0000 7ff456fdd640 1 -- 172.21.15.99:0/89507114 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4501176b0 con 0x7ff4500fb4a0 2024-09-19T06:56:47.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.985+0000 7ff456fdd640 1 -- 172.21.15.99:0/89507114 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4500fcbe0 con 0x7ff4500fb4a0 2024-09-19T06:56:47.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.985+0000 7ff44d7fa640 1 -- 172.21.15.99:0/89507114 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7ff44802f030 con 0x7ff4500fb4a0 2024-09-19T06:56:47.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.986+0000 7ff44d7fa640 1 --2- 172.21.15.99:0/89507114 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ff43c06e530 0x7ff43c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:47.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.986+0000 7ff44d7fa640 1 -- 172.21.15.99:0/89507114 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7ff4480af5b0 con 0x7ff4500fb4a0 2024-09-19T06:56:47.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.986+0000 7ff44ffff640 1 --2- 172.21.15.99:0/89507114 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ff43c06e530 0x7ff43c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:47.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.986+0000 7ff44ffff640 1 --2- 172.21.15.99:0/89507114 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ff43c06e530 0x7ff43c0709e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff450066470 tx=0x7ff44000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:47.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:47.990+0000 7ff44d7fa640 1 -- 172.21.15.99:0/89507114 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7ff448078760 con 0x7ff4500fb4a0 2024-09-19T06:56:48.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:48.174+0000 7ff456fdd640 1 -- 172.21.15.99:0/89507114 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff450066220 con 0x7ff43c06e530 2024-09-19T06:56:48.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:48.175+0000 7ff44d7fa640 1 -- 172.21.15.99:0/89507114 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7ff450066220 con 0x7ff43c06e530 2024-09-19T06:56:48.176 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:56:48.176 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T06:56:48.176 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": true, 2024-09-19T06:56:48.176 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T06:56:48.176 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [ 2024-09-19T06:56:48.176 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr", 2024-09-19T06:56:48.176 INFO:teuthology.orchestra.run.smithi099.stdout: "crash", 2024-09-19T06:56:48.177 INFO:teuthology.orchestra.run.smithi099.stdout: "mds", 2024-09-19T06:56:48.177 INFO:teuthology.orchestra.run.smithi099.stdout: "mon", 2024-09-19T06:56:48.177 INFO:teuthology.orchestra.run.smithi099.stdout: "osd" 2024-09-19T06:56:48.177 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-19T06:56:48.177 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": "16/21 daemons upgraded", 2024-09-19T06:56:48.177 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "Currently upgrading mds daemons", 2024-09-19T06:56:48.177 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-09-19T06:56:48.177 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:56:48.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:48.177+0000 7ff456fdd640 1 -- 172.21.15.99:0/89507114 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ff43c06e530 msgr2=0x7ff43c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:48.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:48.177+0000 7ff456fdd640 1 --2- 172.21.15.99:0/89507114 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ff43c06e530 0x7ff43c0709e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff450066470 tx=0x7ff44000b040 comp rx=0 tx=0).stop 2024-09-19T06:56:48.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:48.177+0000 7ff456fdd640 1 -- 172.21.15.99:0/89507114 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4500fb4a0 msgr2=0x7ff45010e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:48.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:48.177+0000 7ff456fdd640 1 --2- 172.21.15.99:0/89507114 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4500fb4a0 0x7ff45010e180 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7ff448004750 tx=0x7ff448004d10 comp rx=0 tx=0).stop 2024-09-19T06:56:48.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:48.177+0000 7ff456fdd640 1 -- 172.21.15.99:0/89507114 shutdown_connections 2024-09-19T06:56:48.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:48.177+0000 7ff456fdd640 1 --2- 172.21.15.99:0/89507114 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ff43c06e530 0x7ff43c0709e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:48.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:48.177+0000 7ff456fdd640 1 --2- 172.21.15.99:0/89507114 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4501014e0 0x7ff45010e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:48.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:48.177+0000 7ff456fdd640 1 --2- 172.21.15.99:0/89507114 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4500fb4a0 0x7ff45010e180 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:48.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:48.177+0000 7ff456fdd640 1 -- 172.21.15.99:0/89507114 >> 172.21.15.99:0/89507114 conn(0x7ff4500f7060 msgr2=0x7ff4500f7430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:48.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:48.177+0000 7ff456fdd640 1 -- 172.21.15.99:0/89507114 shutdown_connections 2024-09-19T06:56:48.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:48.177+0000 7ff456fdd640 1 -- 172.21.15.99:0/89507114 wait complete. 2024-09-19T06:56:48.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:48.256+0000 7f121cc3c640 1 -- 172.21.15.99:0/3747763236 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1218102550 msgr2=0x7f1218102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:48.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:48.256+0000 7f121cc3c640 1 --2- 172.21.15.99:0/3747763236 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1218102550 0x7f1218102920 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f12080048d0 tx=0x7f1208009da0 comp rx=0 tx=0).stop 2024-09-19T06:56:48.257 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:56:48 smithi099 ceph-mon[97031]: from='client.34838 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:56:48.257 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:56:48 smithi099 ceph-mon[97031]: pgmap v433: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:56:48.257 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:56:48 smithi099 ceph-mon[97031]: from='client.34842 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:56:48.258 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:56:48 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/3350486330' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:56:48.258 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:56:48 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/4096854997' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:56:48.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:48.256+0000 7f121cc3c640 1 -- 172.21.15.99:0/3747763236 shutdown_connections 2024-09-19T06:56:48.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:48.256+0000 7f121cc3c640 1 --2- 172.21.15.99:0/3747763236 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1218102ef0 0x7f12180fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:48.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:48.256+0000 7f121cc3c640 1 --2- 172.21.15.99:0/3747763236 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1218102550 0x7f1218102920 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:48.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:48.256+0000 7f121cc3c640 1 -- 172.21.15.99:0/3747763236 >> 172.21.15.99:0/3747763236 conn(0x7f12180f80f0 msgr2=0x7f12180fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:48.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:48.256+0000 7f121cc3c640 1 -- 172.21.15.99:0/3747763236 shutdown_connections 2024-09-19T06:56:48.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:48.256+0000 7f121cc3c640 1 -- 172.21.15.99:0/3747763236 wait complete. 2024-09-19T06:56:48.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:48.257+0000 7f121cc3c640 1 Processor -- start 2024-09-19T06:56:48.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:48.257+0000 7f121cc3c640 1 -- start start 2024-09-19T06:56:48.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:48.257+0000 7f121cc3c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1218102550 0x7f121806fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:48.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:48.257+0000 7f121cc3c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1218102ef0 0x7f121806ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:48.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:48.257+0000 7f121cc3c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1218070490 con 0x7f1218102ef0 2024-09-19T06:56:48.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:48.257+0000 7f121cc3c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1218070600 con 0x7f1218102550 2024-09-19T06:56:48.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:48.257+0000 7f1215d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1218102ef0 0x7f121806ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:48.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:48.257+0000 7f1215d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1218102ef0 0x7f121806ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:44466/0 (socket says 172.21.15.99:44466) 2024-09-19T06:56:48.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:48.257+0000 7f1215d9b640 1 -- 172.21.15.99:0/818656180 learned_addr learned my addr 172.21.15.99:0/818656180 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:56:48.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:48.257+0000 7f121659c640 1 --2- 172.21.15.99:0/818656180 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1218102550 0x7f121806fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:48.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:48.258+0000 7f1215d9b640 1 -- 172.21.15.99:0/818656180 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1218102550 msgr2=0x7f121806fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:48.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:48.258+0000 7f1215d9b640 1 --2- 172.21.15.99:0/818656180 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1218102550 0x7f121806fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:48.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:48.258+0000 7f1215d9b640 1 -- 172.21.15.99:0/818656180 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1208005040 con 0x7f1218102ef0 2024-09-19T06:56:48.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:48.258+0000 7f1215d9b640 1 --2- 172.21.15.99:0/818656180 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1218102ef0 0x7f121806ff50 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f120000c790 tx=0x7f12000043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:48.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:48.258+0000 7f120effd640 1 -- 172.21.15.99:0/818656180 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f120000a7a0 con 0x7f1218102ef0 2024-09-19T06:56:48.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:48.258+0000 7f120effd640 1 -- 172.21.15.99:0/818656180 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f120000ada0 con 0x7f1218102ef0 2024-09-19T06:56:48.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:48.258+0000 7f121cc3c640 1 -- 172.21.15.99:0/818656180 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1218070890 con 0x7f1218102ef0 2024-09-19T06:56:48.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:48.258+0000 7f120effd640 1 -- 172.21.15.99:0/818656180 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1200011380 con 0x7f1218102ef0 2024-09-19T06:56:48.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:48.258+0000 7f121cc3c640 1 -- 172.21.15.99:0/818656180 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1218119c70 con 0x7f1218102ef0 2024-09-19T06:56:48.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:48.259+0000 7f121cc3c640 1 -- 172.21.15.99:0/818656180 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12180fdcd0 con 0x7f1218102ef0 2024-09-19T06:56:48.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:48.260+0000 7f120effd640 1 -- 172.21.15.99:0/818656180 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f1200012760 con 0x7f1218102ef0 2024-09-19T06:56:48.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:48.260+0000 7f120effd640 1 --2- 172.21.15.99:0/818656180 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f120406e530 0x7f12040709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:56:48.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:48.260+0000 7f120effd640 1 -- 172.21.15.99:0/818656180 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f120008e680 con 0x7f1218102ef0 2024-09-19T06:56:48.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:48.260+0000 7f121659c640 1 --2- 172.21.15.99:0/818656180 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f120406e530 0x7f12040709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:56:48.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:48.261+0000 7f121659c640 1 --2- 172.21.15.99:0/818656180 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f120406e530 0x7f12040709e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1208009ac0 tx=0x7f1208035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:56:48.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:48.265+0000 7f120effd640 1 -- 172.21.15.99:0/818656180 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f120005b320 con 0x7f1218102ef0 2024-09-19T06:56:48.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:48.495+0000 7f121cc3c640 1 -- 172.21.15.99:0/818656180 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f12180fbd50 con 0x7f1218102ef0 2024-09-19T06:56:48.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:48.495+0000 7f120effd640 1 -- 172.21.15.99:0/818656180 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7f120005aeb0 con 0x7f1218102ef0 2024-09-19T06:56:48.497 INFO:teuthology.orchestra.run.smithi099.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-09-19T06:56:48.497 INFO:teuthology.orchestra.run.smithi099.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-19T06:56:48.497 INFO:teuthology.orchestra.run.smithi099.stdout: fs cephfs is degraded 2024-09-19T06:56:48.497 INFO:teuthology.orchestra.run.smithi099.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-19T06:56:48.497 INFO:teuthology.orchestra.run.smithi099.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-19T06:56:48.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:48.497+0000 7f121cc3c640 1 -- 172.21.15.99:0/818656180 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f120406e530 msgr2=0x7f12040709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:48.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:48.497+0000 7f121cc3c640 1 --2- 172.21.15.99:0/818656180 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f120406e530 0x7f12040709e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1208009ac0 tx=0x7f1208035040 comp rx=0 tx=0).stop 2024-09-19T06:56:48.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:48.498+0000 7f121cc3c640 1 -- 172.21.15.99:0/818656180 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1218102ef0 msgr2=0x7f121806ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:56:48.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:48.498+0000 7f121cc3c640 1 --2- 172.21.15.99:0/818656180 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1218102ef0 0x7f121806ff50 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f120000c790 tx=0x7f12000043c0 comp rx=0 tx=0).stop 2024-09-19T06:56:48.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:48.498+0000 7f121cc3c640 1 -- 172.21.15.99:0/818656180 shutdown_connections 2024-09-19T06:56:48.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:48.498+0000 7f121cc3c640 1 --2- 172.21.15.99:0/818656180 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f120406e530 0x7f12040709e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:48.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:48.498+0000 7f121cc3c640 1 --2- 172.21.15.99:0/818656180 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1218102ef0 0x7f121806ff50 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:48.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:48.498+0000 7f121cc3c640 1 --2- 172.21.15.99:0/818656180 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1218102550 0x7f121806fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:56:48.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:48.498+0000 7f121cc3c640 1 -- 172.21.15.99:0/818656180 >> 172.21.15.99:0/818656180 conn(0x7f12180f80f0 msgr2=0x7f12180f9160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:56:48.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:48.498+0000 7f121cc3c640 1 -- 172.21.15.99:0/818656180 shutdown_connections 2024-09-19T06:56:48.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:56:48.498+0000 7f121cc3c640 1 -- 172.21.15.99:0/818656180 wait complete. 2024-09-19T06:56:48.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:56:48 smithi117 ceph-mon[76771]: from='client.34838 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:56:48.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:56:48 smithi117 ceph-mon[76771]: pgmap v433: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:56:48.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:56:48 smithi117 ceph-mon[76771]: from='client.34842 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:56:48.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:56:48 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/3350486330' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:56:48.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:56:48 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/4096854997' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:56:49.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:56:49 smithi099 ceph-mon[97031]: from='client.34846 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:56:49.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:56:49 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/818656180' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T06:56:49.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:56:49 smithi117 ceph-mon[76771]: from='client.34846 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:56:49.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:56:49 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/818656180' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T06:56:50.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:56:50 smithi099 ceph-mon[97031]: from='client.34858 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:56:50.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:56:50 smithi099 ceph-mon[97031]: pgmap v434: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:56:50.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:56:50 smithi117 ceph-mon[76771]: from='client.34858 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:56:50.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:56:50 smithi117 ceph-mon[76771]: pgmap v434: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:56:52.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:56:52 smithi099 ceph-mon[97031]: pgmap v435: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:56:52.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:56:52 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:56:52.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:56:52 smithi117 ceph-mon[76771]: pgmap v435: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:56:52.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:56:52 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:56:54.364 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:56:54 smithi117 ceph-mon[76771]: pgmap v436: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:56:54.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:56:54 smithi099 ceph-mon[97031]: pgmap v436: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:56:56.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:56:56 smithi099 ceph-mon[97031]: pgmap v437: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:56:56.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:56:56 smithi117 ceph-mon[76771]: pgmap v437: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:56:58.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:56:58 smithi099 ceph-mon[97031]: pgmap v438: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:56:58.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:56:58 smithi117 ceph-mon[76771]: pgmap v438: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:57:00.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:57:00 smithi099 ceph-mon[97031]: pgmap v439: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:57:00.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:57:00 smithi117 ceph-mon[76771]: pgmap v439: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:57:02.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:57:02 smithi099 ceph-mon[97031]: pgmap v440: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:57:02.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:57:02 smithi117 ceph-mon[76771]: pgmap v440: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:57:04.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:57:04 smithi099 ceph-mon[97031]: pgmap v441: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:57:04.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:57:04 smithi117 ceph-mon[76771]: pgmap v441: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:57:06.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:57:06 smithi099 ceph-mon[97031]: pgmap v442: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:57:06.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:57:06 smithi117 ceph-mon[76771]: pgmap v442: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:57:07.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:57:07 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:57:07.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:57:07 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:57:08.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:57:08 smithi099 ceph-mon[97031]: pgmap v443: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:57:08.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:57:08 smithi117 ceph-mon[76771]: pgmap v443: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:57:10.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:57:10 smithi099 ceph-mon[97031]: pgmap v444: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:57:10.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:57:10 smithi117 ceph-mon[76771]: pgmap v444: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:57:12.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:57:12 smithi099 ceph-mon[97031]: pgmap v445: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:57:12.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:57:12 smithi117 ceph-mon[76771]: pgmap v445: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:57:14.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:57:14 smithi099 ceph-mon[97031]: pgmap v446: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:57:14.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:57:14 smithi117 ceph-mon[76771]: pgmap v446: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:57:16.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:57:16 smithi099 ceph-mon[97031]: pgmap v447: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:57:16.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:57:16 smithi117 ceph-mon[76771]: pgmap v447: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:57:18.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:57:18 smithi099 ceph-mon[97031]: pgmap v448: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:57:18.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:57:18 smithi117 ceph-mon[76771]: pgmap v448: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:57:18.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.588+0000 7f2ac22db640 1 -- 172.21.15.99:0/2881233001 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2abc0fe100 msgr2=0x7f2abc1065a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:18.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.588+0000 7f2ac22db640 1 --2- 172.21.15.99:0/2881233001 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2abc0fe100 0x7f2abc1065a0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f2ab00048d0 tx=0x7f2ab0009da0 comp rx=0 tx=0).stop 2024-09-19T06:57:18.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.588+0000 7f2ac22db640 1 -- 172.21.15.99:0/2881233001 shutdown_connections 2024-09-19T06:57:18.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.588+0000 7f2ac22db640 1 --2- 172.21.15.99:0/2881233001 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2abc0fe100 0x7f2abc1065a0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:18.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.588+0000 7f2ac22db640 1 --2- 172.21.15.99:0/2881233001 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2abc0fd760 0x7f2abc0fdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:18.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.588+0000 7f2ac22db640 1 -- 172.21.15.99:0/2881233001 >> 172.21.15.99:0/2881233001 conn(0x7f2abc0f7030 msgr2=0x7f2abc0f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:18.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.588+0000 7f2ac22db640 1 -- 172.21.15.99:0/2881233001 shutdown_connections 2024-09-19T06:57:18.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.588+0000 7f2ac22db640 1 -- 172.21.15.99:0/2881233001 wait complete. 2024-09-19T06:57:18.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.589+0000 7f2ac22db640 1 Processor -- start 2024-09-19T06:57:18.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.589+0000 7f2ac22db640 1 -- start start 2024-09-19T06:57:18.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.589+0000 7f2ac22db640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2abc0fd760 0x7f2abc113310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:18.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.589+0000 7f2ac22db640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2abc0fe100 0x7f2abc113850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:18.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.589+0000 7f2ac22db640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2abc113e50 con 0x7f2abc0fd760 2024-09-19T06:57:18.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.589+0000 7f2ac22db640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2abc10d290 con 0x7f2abc0fe100 2024-09-19T06:57:18.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.589+0000 7f2abbfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2abc0fd760 0x7f2abc113310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:18.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.589+0000 7f2abbfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2abc0fd760 0x7f2abc113310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59286/0 (socket says 172.21.15.99:59286) 2024-09-19T06:57:18.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.589+0000 7f2abbfff640 1 -- 172.21.15.99:0/1563172574 learned_addr learned my addr 172.21.15.99:0/1563172574 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:57:18.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.589+0000 7f2abb7fe640 1 --2- 172.21.15.99:0/1563172574 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2abc0fe100 0x7f2abc113850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:18.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.590+0000 7f2abbfff640 1 -- 172.21.15.99:0/1563172574 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2abc0fe100 msgr2=0x7f2abc113850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:18.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.590+0000 7f2abbfff640 1 --2- 172.21.15.99:0/1563172574 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2abc0fe100 0x7f2abc113850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:18.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.590+0000 7f2abbfff640 1 -- 172.21.15.99:0/1563172574 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ab0005040 con 0x7f2abc0fd760 2024-09-19T06:57:18.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.590+0000 7f2abbfff640 1 --2- 172.21.15.99:0/1563172574 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2abc0fd760 0x7f2abc113310 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f2aac00c790 tx=0x7f2aac0043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:18.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.590+0000 7f2ab8ff9640 1 -- 172.21.15.99:0/1563172574 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2aac00a7a0 con 0x7f2abc0fd760 2024-09-19T06:57:18.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.590+0000 7f2ab8ff9640 1 -- 172.21.15.99:0/1563172574 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2aac00ada0 con 0x7f2abc0fd760 2024-09-19T06:57:18.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.590+0000 7f2ac22db640 1 -- 172.21.15.99:0/1563172574 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2abc10d570 con 0x7f2abc0fd760 2024-09-19T06:57:18.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.590+0000 7f2ab8ff9640 1 -- 172.21.15.99:0/1563172574 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2aac0113a0 con 0x7f2abc0fd760 2024-09-19T06:57:18.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.590+0000 7f2ac22db640 1 -- 172.21.15.99:0/1563172574 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2abc10dae0 con 0x7f2abc0fd760 2024-09-19T06:57:18.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.591+0000 7f2ac22db640 1 -- 172.21.15.99:0/1563172574 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2abc0fac90 con 0x7f2abc0fd760 2024-09-19T06:57:18.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.592+0000 7f2ab8ff9640 1 -- 172.21.15.99:0/1563172574 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f2aac00a900 con 0x7f2abc0fd760 2024-09-19T06:57:18.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.592+0000 7f2ab8ff9640 1 --2- 172.21.15.99:0/1563172574 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f2aa406e530 0x7f2aa40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:18.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.592+0000 7f2ab8ff9640 1 -- 172.21.15.99:0/1563172574 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f2aac08e270 con 0x7f2abc0fd760 2024-09-19T06:57:18.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.592+0000 7f2abb7fe640 1 --2- 172.21.15.99:0/1563172574 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f2aa406e530 0x7f2aa40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:18.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.593+0000 7f2abb7fe640 1 --2- 172.21.15.99:0/1563172574 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f2aa406e530 0x7f2aa40709e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2ab00048a0 tx=0x7f2ab0035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:18.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.597+0000 7f2ab8ff9640 1 -- 172.21.15.99:0/1563172574 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f2aac05af10 con 0x7f2abc0fd760 2024-09-19T06:57:18.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.778+0000 7f2ac22db640 1 -- 172.21.15.99:0/1563172574 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2abc10e980 con 0x7f2aa406e530 2024-09-19T06:57:18.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.780+0000 7f2ab8ff9640 1 -- 172.21.15.99:0/1563172574 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f2abc10e980 con 0x7f2aa406e530 2024-09-19T06:57:18.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.782+0000 7f2ac22db640 1 -- 172.21.15.99:0/1563172574 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f2aa406e530 msgr2=0x7f2aa40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:18.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.782+0000 7f2ac22db640 1 --2- 172.21.15.99:0/1563172574 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f2aa406e530 0x7f2aa40709e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2ab00048a0 tx=0x7f2ab0035040 comp rx=0 tx=0).stop 2024-09-19T06:57:18.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.782+0000 7f2ac22db640 1 -- 172.21.15.99:0/1563172574 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2abc0fd760 msgr2=0x7f2abc113310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:18.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.782+0000 7f2ac22db640 1 --2- 172.21.15.99:0/1563172574 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2abc0fd760 0x7f2abc113310 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f2aac00c790 tx=0x7f2aac0043c0 comp rx=0 tx=0).stop 2024-09-19T06:57:18.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.782+0000 7f2ac22db640 1 -- 172.21.15.99:0/1563172574 shutdown_connections 2024-09-19T06:57:18.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.782+0000 7f2ac22db640 1 --2- 172.21.15.99:0/1563172574 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f2aa406e530 0x7f2aa40709e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:18.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.782+0000 7f2ac22db640 1 --2- 172.21.15.99:0/1563172574 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2abc0fe100 0x7f2abc113850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:18.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.782+0000 7f2ac22db640 1 --2- 172.21.15.99:0/1563172574 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2abc0fd760 0x7f2abc113310 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:18.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.782+0000 7f2ac22db640 1 -- 172.21.15.99:0/1563172574 >> 172.21.15.99:0/1563172574 conn(0x7f2abc0f7030 msgr2=0x7f2abc0f8560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:18.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.782+0000 7f2ac22db640 1 -- 172.21.15.99:0/1563172574 shutdown_connections 2024-09-19T06:57:18.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.782+0000 7f2ac22db640 1 -- 172.21.15.99:0/1563172574 wait complete. 2024-09-19T06:57:18.792 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-09-19T06:57:18.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.861+0000 7f8d0140a640 1 -- 172.21.15.99:0/1019964681 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8cfc102620 msgr2=0x7f8cfc1029f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:18.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.861+0000 7f8d0140a640 1 --2- 172.21.15.99:0/1019964681 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8cfc102620 0x7f8cfc1029f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f8cec0048d0 tx=0x7f8cec009da0 comp rx=0 tx=0).stop 2024-09-19T06:57:18.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.861+0000 7f8d0140a640 1 -- 172.21.15.99:0/1019964681 shutdown_connections 2024-09-19T06:57:18.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.861+0000 7f8d0140a640 1 --2- 172.21.15.99:0/1019964681 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8cfc102fc0 0x7f8cfc0facf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:18.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.861+0000 7f8d0140a640 1 --2- 172.21.15.99:0/1019964681 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8cfc102620 0x7f8cfc1029f0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:18.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.861+0000 7f8d0140a640 1 -- 172.21.15.99:0/1019964681 >> 172.21.15.99:0/1019964681 conn(0x7f8cfc070d50 msgr2=0x7f8cfc071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:18.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.861+0000 7f8d0140a640 1 -- 172.21.15.99:0/1019964681 shutdown_connections 2024-09-19T06:57:18.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.861+0000 7f8d0140a640 1 -- 172.21.15.99:0/1019964681 wait complete. 2024-09-19T06:57:18.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.862+0000 7f8d0140a640 1 Processor -- start 2024-09-19T06:57:18.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.862+0000 7f8d0140a640 1 -- start start 2024-09-19T06:57:18.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.862+0000 7f8d0140a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8cfc102620 0x7f8cfc1132a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:18.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.862+0000 7f8d0140a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8cfc102fc0 0x7f8cfc1137e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:18.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.862+0000 7f8d0140a640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cfc113de0 con 0x7f8cfc102620 2024-09-19T06:57:18.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.862+0000 7f8d0140a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cfc10d220 con 0x7f8cfc102fc0 2024-09-19T06:57:18.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.862+0000 7f8cfaffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8cfc102620 0x7f8cfc1132a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:18.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.862+0000 7f8cfaffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8cfc102620 0x7f8cfc1132a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59302/0 (socket says 172.21.15.99:59302) 2024-09-19T06:57:18.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.862+0000 7f8cfaffd640 1 -- 172.21.15.99:0/220977664 learned_addr learned my addr 172.21.15.99:0/220977664 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:57:18.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.862+0000 7f8cf27fc640 1 --2- 172.21.15.99:0/220977664 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8cfc102fc0 0x7f8cfc1137e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:18.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.863+0000 7f8cfaffd640 1 -- 172.21.15.99:0/220977664 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8cfc102fc0 msgr2=0x7f8cfc1137e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:18.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.863+0000 7f8cfaffd640 1 --2- 172.21.15.99:0/220977664 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8cfc102fc0 0x7f8cfc1137e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:18.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.863+0000 7f8cfaffd640 1 -- 172.21.15.99:0/220977664 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cec005040 con 0x7f8cfc102620 2024-09-19T06:57:18.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.863+0000 7f8cfaffd640 1 --2- 172.21.15.99:0/220977664 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8cfc102620 0x7f8cfc1132a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f8cec0043d0 tx=0x7f8cec009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:18.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.863+0000 7f8cf3fff640 1 -- 172.21.15.99:0/220977664 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8cec038070 con 0x7f8cfc102620 2024-09-19T06:57:18.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.863+0000 7f8d0140a640 1 -- 172.21.15.99:0/220977664 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cfc10d4a0 con 0x7f8cfc102620 2024-09-19T06:57:18.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.863+0000 7f8cf3fff640 1 -- 172.21.15.99:0/220977664 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8cec0096e0 con 0x7f8cfc102620 2024-09-19T06:57:18.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.863+0000 7f8cf3fff640 1 -- 172.21.15.99:0/220977664 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8cec03d420 con 0x7f8cfc102620 2024-09-19T06:57:18.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.863+0000 7f8d0140a640 1 -- 172.21.15.99:0/220977664 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cfc10d9c0 con 0x7f8cfc102620 2024-09-19T06:57:18.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.864+0000 7f8d0140a640 1 -- 172.21.15.99:0/220977664 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cfc0657c0 con 0x7f8cfc102620 2024-09-19T06:57:18.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.865+0000 7f8cf3fff640 1 -- 172.21.15.99:0/220977664 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f8cec030020 con 0x7f8cfc102620 2024-09-19T06:57:18.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.865+0000 7f8cf3fff640 1 --2- 172.21.15.99:0/220977664 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f8ce806e530 0x7f8ce80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:18.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.866+0000 7f8cf3fff640 1 -- 172.21.15.99:0/220977664 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f8cec0ae640 con 0x7f8cfc102620 2024-09-19T06:57:18.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.866+0000 7f8cf27fc640 1 --2- 172.21.15.99:0/220977664 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f8ce806e530 0x7f8ce80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:18.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.866+0000 7f8cf27fc640 1 --2- 172.21.15.99:0/220977664 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f8ce806e530 0x7f8ce80709e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc10eb60 tx=0x7f8ce400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:18.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:18.870+0000 7f8cf3fff640 1 -- 172.21.15.99:0/220977664 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f8cec078610 con 0x7f8cfc102620 2024-09-19T06:57:19.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.053+0000 7f8d0140a640 1 -- 172.21.15.99:0/220977664 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8cfc04b720 con 0x7f8ce806e530 2024-09-19T06:57:19.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.054+0000 7f8cf3fff640 1 -- 172.21.15.99:0/220977664 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f8cfc04b720 con 0x7f8ce806e530 2024-09-19T06:57:19.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.056+0000 7f8d0140a640 1 -- 172.21.15.99:0/220977664 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f8ce806e530 msgr2=0x7f8ce80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:19.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.056+0000 7f8d0140a640 1 --2- 172.21.15.99:0/220977664 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f8ce806e530 0x7f8ce80709e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc10eb60 tx=0x7f8ce400b040 comp rx=0 tx=0).stop 2024-09-19T06:57:19.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.056+0000 7f8d0140a640 1 -- 172.21.15.99:0/220977664 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8cfc102620 msgr2=0x7f8cfc1132a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:19.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.056+0000 7f8d0140a640 1 --2- 172.21.15.99:0/220977664 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8cfc102620 0x7f8cfc1132a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f8cec0043d0 tx=0x7f8cec009da0 comp rx=0 tx=0).stop 2024-09-19T06:57:19.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.056+0000 7f8d0140a640 1 -- 172.21.15.99:0/220977664 shutdown_connections 2024-09-19T06:57:19.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.056+0000 7f8d0140a640 1 --2- 172.21.15.99:0/220977664 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f8ce806e530 0x7f8ce80709e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:19.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.056+0000 7f8d0140a640 1 --2- 172.21.15.99:0/220977664 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8cfc102fc0 0x7f8cfc1137e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:19.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.056+0000 7f8d0140a640 1 --2- 172.21.15.99:0/220977664 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8cfc102620 0x7f8cfc1132a0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:19.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.056+0000 7f8d0140a640 1 -- 172.21.15.99:0/220977664 >> 172.21.15.99:0/220977664 conn(0x7f8cfc070d50 msgr2=0x7f8cfc0fa620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:19.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.057+0000 7f8d0140a640 1 -- 172.21.15.99:0/220977664 shutdown_connections 2024-09-19T06:57:19.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.057+0000 7f8d0140a640 1 -- 172.21.15.99:0/220977664 wait complete. 2024-09-19T06:57:19.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.137+0000 7f418be68640 1 -- 172.21.15.99:0/2515400483 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4184102680 msgr2=0x7f4184102a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:19.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.137+0000 7f418be68640 1 --2- 172.21.15.99:0/2515400483 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4184102680 0x7f4184102a50 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f41800048d0 tx=0x7f4180009da0 comp rx=0 tx=0).stop 2024-09-19T06:57:19.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.137+0000 7f418be68640 1 -- 172.21.15.99:0/2515400483 shutdown_connections 2024-09-19T06:57:19.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.137+0000 7f418be68640 1 --2- 172.21.15.99:0/2515400483 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41840fabd0 0x7f41840fb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:19.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.137+0000 7f418be68640 1 --2- 172.21.15.99:0/2515400483 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4184102680 0x7f4184102a50 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:19.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.137+0000 7f418be68640 1 -- 172.21.15.99:0/2515400483 >> 172.21.15.99:0/2515400483 conn(0x7f4184071ac0 msgr2=0x7f4184071ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:19.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.137+0000 7f418be68640 1 -- 172.21.15.99:0/2515400483 shutdown_connections 2024-09-19T06:57:19.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.137+0000 7f418be68640 1 -- 172.21.15.99:0/2515400483 wait complete. 2024-09-19T06:57:19.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.137+0000 7f418be68640 1 Processor -- start 2024-09-19T06:57:19.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.138+0000 7f418be68640 1 -- start start 2024-09-19T06:57:19.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.138+0000 7f418be68640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41840fabd0 0x7f41841132b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:19.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.138+0000 7f418be68640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4184102680 0x7f41841137f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:19.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.138+0000 7f418be68640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4184113df0 con 0x7f4184102680 2024-09-19T06:57:19.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.138+0000 7f418be68640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f418410d230 con 0x7f41840fabd0 2024-09-19T06:57:19.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.138+0000 7f4189403640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4184102680 0x7f41841137f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:19.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.138+0000 7f4189403640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4184102680 0x7f41841137f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59312/0 (socket says 172.21.15.99:59312) 2024-09-19T06:57:19.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.138+0000 7f4189403640 1 -- 172.21.15.99:0/2399855813 learned_addr learned my addr 172.21.15.99:0/2399855813 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:57:19.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.138+0000 7f4189c04640 1 --2- 172.21.15.99:0/2399855813 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41840fabd0 0x7f41841132b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:19.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.138+0000 7f4189403640 1 -- 172.21.15.99:0/2399855813 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41840fabd0 msgr2=0x7f41841132b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:19.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.138+0000 7f4189403640 1 --2- 172.21.15.99:0/2399855813 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41840fabd0 0x7f41841132b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:19.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.138+0000 7f4189403640 1 -- 172.21.15.99:0/2399855813 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4180005040 con 0x7f4184102680 2024-09-19T06:57:19.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.138+0000 7f4189c04640 1 --2- 172.21.15.99:0/2399855813 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41840fabd0 0x7f41841132b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:57:19.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.138+0000 7f4189403640 1 --2- 172.21.15.99:0/2399855813 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4184102680 0x7f41841137f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f417400eb70 tx=0x7f417400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:19.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.139+0000 7f417a7fc640 1 -- 172.21.15.99:0/2399855813 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4174007c30 con 0x7f4184102680 2024-09-19T06:57:19.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.139+0000 7f418be68640 1 -- 172.21.15.99:0/2399855813 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f418410d4b0 con 0x7f4184102680 2024-09-19T06:57:19.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.139+0000 7f417a7fc640 1 -- 172.21.15.99:0/2399855813 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f417400f040 con 0x7f4184102680 2024-09-19T06:57:19.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.139+0000 7f417a7fc640 1 -- 172.21.15.99:0/2399855813 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f41740094e0 con 0x7f4184102680 2024-09-19T06:57:19.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.139+0000 7f418be68640 1 -- 172.21.15.99:0/2399855813 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f418410da50 con 0x7f4184102680 2024-09-19T06:57:19.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.140+0000 7f418be68640 1 -- 172.21.15.99:0/2399855813 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41840725d0 con 0x7f4184102680 2024-09-19T06:57:19.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.141+0000 7f417a7fc640 1 -- 172.21.15.99:0/2399855813 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f4174009640 con 0x7f4184102680 2024-09-19T06:57:19.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.141+0000 7f417a7fc640 1 --2- 172.21.15.99:0/2399855813 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f417006e530 0x7f41700709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:19.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.141+0000 7f4189c04640 1 --2- 172.21.15.99:0/2399855813 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f417006e530 0x7f41700709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:19.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.141+0000 7f417a7fc640 1 -- 172.21.15.99:0/2399855813 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f417408dac0 con 0x7f4184102680 2024-09-19T06:57:19.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.142+0000 7f4189c04640 1 --2- 172.21.15.99:0/2399855813 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f417006e530 0x7f41700709e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4180007ac0 tx=0x7f4180035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:19.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.146+0000 7f417a7fc640 1 -- 172.21.15.99:0/2399855813 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f4174056b30 con 0x7f4184102680 2024-09-19T06:57:19.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.320+0000 7f418be68640 1 -- 172.21.15.99:0/2399855813 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4184113f30 con 0x7f417006e530 2024-09-19T06:57:19.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.328+0000 7f417a7fc640 1 -- 172.21.15.99:0/2399855813 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f418002aad0 con 0x7f417006e530 2024-09-19T06:57:19.330 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T06:57:19.330 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.smithi099 smithi099 *:9093,9094 running (16m) 8m ago 24m 23.4M - 0.25.0 c8568f914cd2 e7c1774d56b0 2024-09-19T06:57:19.330 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi099 smithi099 running (12m) 8m ago 24m 6899k - 19.1.1-361-g2f599a46 d2baa855c067 b9775f416b10 2024-09-19T06:57:19.330 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi117 smithi117 running (12m) 8m ago 24m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 38cf60c0d548 2024-09-19T06:57:19.330 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.smithi099 smithi099 *:3000 running (14m) 8m ago 24m 80.7M - 9.4.12 2bacad6d85d8 cd53a18d5410 2024-09-19T06:57:19.330 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.obarqf smithi099 running (9m) 8m ago 19m 12.2M - 19.1.1-361-g2f599a46 d2baa855c067 314a73082521 2024-09-19T06:57:19.330 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.xehbxe smithi099 running (9m) 8m ago 19m 14.4M - 19.1.1-361-g2f599a46 d2baa855c067 a2955a9d06e6 2024-09-19T06:57:19.330 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.bheqzh smithi117 running (8m) 8m ago 19m 11.8M - 19.1.1-361-g2f599a46 d2baa855c067 b1505937c0b7 2024-09-19T06:57:19.330 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.nooexo smithi117 running (8m) 8m ago 19m 13.1M - 19.1.1-361-g2f599a46 d2baa855c067 35bd7725855c 2024-09-19T06:57:19.330 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi099.pgvkqi smithi099 *:8443,9283,8765 running (15m) 8m ago 26m 505M - 19.1.1-361-g2f599a46 d2baa855c067 d5de99cb7e78 2024-09-19T06:57:19.331 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi117.ssmkcf smithi117 *:8443,9283,8765 running (15m) 8m ago 23m 444M - 19.1.1-361-g2f599a46 d2baa855c067 8b7ee0f871f5 2024-09-19T06:57:19.331 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi099 smithi099 running (13m) 8m ago 26m 52.4M 2048M 19.1.1-361-g2f599a46 d2baa855c067 ffe067438824 2024-09-19T06:57:19.331 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi117 smithi117 running (13m) 8m ago 23m 38.9M 2048M 19.1.1-361-g2f599a46 d2baa855c067 4cb7455e3ee7 2024-09-19T06:57:19.331 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi099 smithi099 *:9100 running (16m) 8m ago 24m 15.0M - 1.5.0 0da6a335fe13 dca7b4517dcc 2024-09-19T06:57:19.331 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi117 smithi117 *:9100 running (15m) 8m ago 24m 15.9M - 1.5.0 0da6a335fe13 8233ce3835d2 2024-09-19T06:57:19.331 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (12m) 8m ago 23m 100M 1557M 19.1.1-361-g2f599a46 d2baa855c067 8e22543bf933 2024-09-19T06:57:19.331 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (11m) 8m ago 22m 106M 1557M 19.1.1-361-g2f599a46 d2baa855c067 f54153d0ae09 2024-09-19T06:57:19.331 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (11m) 8m ago 22m 83.7M 1557M 19.1.1-361-g2f599a46 d2baa855c067 b1778ab88870 2024-09-19T06:57:19.331 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi117 running (10m) 8m ago 21m 102M 2581M 19.1.1-361-g2f599a46 d2baa855c067 ea5236b193d3 2024-09-19T06:57:19.331 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi117 running (10m) 8m ago 21m 93.5M 2581M 19.1.1-361-g2f599a46 d2baa855c067 27ac2c859a68 2024-09-19T06:57:19.331 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi117 running (9m) 8m ago 20m 100M 2581M 19.1.1-361-g2f599a46 d2baa855c067 de6aeb8544ce 2024-09-19T06:57:19.331 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.smithi099 smithi099 *:9095 running (15m) 8m ago 24m 64.4M - 2.43.0 a07b618ecd1d 15ad26ec6fb4 2024-09-19T06:57:19.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.331+0000 7f418be68640 1 -- 172.21.15.99:0/2399855813 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f417006e530 msgr2=0x7f41700709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:19.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.331+0000 7f418be68640 1 --2- 172.21.15.99:0/2399855813 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f417006e530 0x7f41700709e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4180007ac0 tx=0x7f4180035040 comp rx=0 tx=0).stop 2024-09-19T06:57:19.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.331+0000 7f418be68640 1 -- 172.21.15.99:0/2399855813 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4184102680 msgr2=0x7f41841137f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:19.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.331+0000 7f418be68640 1 --2- 172.21.15.99:0/2399855813 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4184102680 0x7f41841137f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f417400eb70 tx=0x7f417400b040 comp rx=0 tx=0).stop 2024-09-19T06:57:19.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.331+0000 7f418be68640 1 -- 172.21.15.99:0/2399855813 shutdown_connections 2024-09-19T06:57:19.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.331+0000 7f418be68640 1 --2- 172.21.15.99:0/2399855813 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f417006e530 0x7f41700709e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:19.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.331+0000 7f418be68640 1 --2- 172.21.15.99:0/2399855813 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4184102680 0x7f41841137f0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:19.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.331+0000 7f418be68640 1 --2- 172.21.15.99:0/2399855813 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f41840fabd0 0x7f41841132b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:19.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.331+0000 7f418be68640 1 -- 172.21.15.99:0/2399855813 >> 172.21.15.99:0/2399855813 conn(0x7f4184071ac0 msgr2=0x7f4184105350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:19.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.331+0000 7f418be68640 1 -- 172.21.15.99:0/2399855813 shutdown_connections 2024-09-19T06:57:19.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.331+0000 7f418be68640 1 -- 172.21.15.99:0/2399855813 wait complete. 2024-09-19T06:57:19.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.408+0000 7f6c9c9a3640 1 -- 172.21.15.99:0/2193494249 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c98102550 msgr2=0x7f6c98102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:19.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.408+0000 7f6c9c9a3640 1 --2- 172.21.15.99:0/2193494249 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c98102550 0x7f6c98102920 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f6c880048d0 tx=0x7f6c88009da0 comp rx=0 tx=0).stop 2024-09-19T06:57:19.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.408+0000 7f6c9c9a3640 1 -- 172.21.15.99:0/2193494249 shutdown_connections 2024-09-19T06:57:19.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.408+0000 7f6c9c9a3640 1 --2- 172.21.15.99:0/2193494249 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c98102ef0 0x7f6c980fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:19.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.408+0000 7f6c9c9a3640 1 --2- 172.21.15.99:0/2193494249 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c98102550 0x7f6c98102920 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:19.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.408+0000 7f6c9c9a3640 1 -- 172.21.15.99:0/2193494249 >> 172.21.15.99:0/2193494249 conn(0x7f6c980f80f0 msgr2=0x7f6c980fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:19.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.408+0000 7f6c9c9a3640 1 -- 172.21.15.99:0/2193494249 shutdown_connections 2024-09-19T06:57:19.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.408+0000 7f6c9c9a3640 1 -- 172.21.15.99:0/2193494249 wait complete. 2024-09-19T06:57:19.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.409+0000 7f6c9c9a3640 1 Processor -- start 2024-09-19T06:57:19.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.409+0000 7f6c9c9a3640 1 -- start start 2024-09-19T06:57:19.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.409+0000 7f6c9c9a3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c98102550 0x7f6c9806fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:19.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.409+0000 7f6c9c9a3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c98102ef0 0x7f6c9806ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:19.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.409+0000 7f6c9c9a3640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c98070490 con 0x7f6c98102550 2024-09-19T06:57:19.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.409+0000 7f6c9c9a3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c98070600 con 0x7f6c98102ef0 2024-09-19T06:57:19.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.409+0000 7f6c9659c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c98102550 0x7f6c9806fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:19.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.409+0000 7f6c9659c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c98102550 0x7f6c9806fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59342/0 (socket says 172.21.15.99:59342) 2024-09-19T06:57:19.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.409+0000 7f6c9659c640 1 -- 172.21.15.99:0/2657267923 learned_addr learned my addr 172.21.15.99:0/2657267923 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:57:19.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.409+0000 7f6c95d9b640 1 --2- 172.21.15.99:0/2657267923 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c98102ef0 0x7f6c9806ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:19.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.409+0000 7f6c9659c640 1 -- 172.21.15.99:0/2657267923 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c98102ef0 msgr2=0x7f6c9806ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:19.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.409+0000 7f6c9659c640 1 --2- 172.21.15.99:0/2657267923 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c98102ef0 0x7f6c9806ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:19.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.409+0000 7f6c9659c640 1 -- 172.21.15.99:0/2657267923 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c88005040 con 0x7f6c98102550 2024-09-19T06:57:19.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.409+0000 7f6c95d9b640 1 --2- 172.21.15.99:0/2657267923 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c98102ef0 0x7f6c9806ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:57:19.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.410+0000 7f6c9659c640 1 --2- 172.21.15.99:0/2657267923 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c98102550 0x7f6c9806fa10 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f6c88003080 tx=0x7f6c88009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:19.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.410+0000 7f6c86ffd640 1 -- 172.21.15.99:0/2657267923 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c88038070 con 0x7f6c98102550 2024-09-19T06:57:19.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.410+0000 7f6c86ffd640 1 -- 172.21.15.99:0/2657267923 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6c8802ade0 con 0x7f6c98102550 2024-09-19T06:57:19.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.410+0000 7f6c9c9a3640 1 -- 172.21.15.99:0/2657267923 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c98070830 con 0x7f6c98102550 2024-09-19T06:57:19.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.410+0000 7f6c86ffd640 1 -- 172.21.15.99:0/2657267923 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c8802c880 con 0x7f6c98102550 2024-09-19T06:57:19.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.410+0000 7f6c9c9a3640 1 -- 172.21.15.99:0/2657267923 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c98119b60 con 0x7f6c98102550 2024-09-19T06:57:19.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.411+0000 7f6c9c9a3640 1 -- 172.21.15.99:0/2657267923 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c980fdcd0 con 0x7f6c98102550 2024-09-19T06:57:19.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.411+0000 7f6c86ffd640 1 -- 172.21.15.99:0/2657267923 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f6c88030020 con 0x7f6c98102550 2024-09-19T06:57:19.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.412+0000 7f6c86ffd640 1 --2- 172.21.15.99:0/2657267923 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f6c8006e530 0x7f6c800709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:19.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.412+0000 7f6c86ffd640 1 -- 172.21.15.99:0/2657267923 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f6c880ae140 con 0x7f6c98102550 2024-09-19T06:57:19.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.412+0000 7f6c95d9b640 1 --2- 172.21.15.99:0/2657267923 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f6c8006e530 0x7f6c800709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:19.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.412+0000 7f6c95d9b640 1 --2- 172.21.15.99:0/2657267923 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f6c8006e530 0x7f6c800709e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6c98071350 tx=0x7f6c8c009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:19.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.418+0000 7f6c86ffd640 1 -- 172.21.15.99:0/2657267923 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f6c880772b0 con 0x7f6c98102550 2024-09-19T06:57:19.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.647+0000 7f6c9c9a3640 1 -- 172.21.15.99:0/2657267923 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6c980fbd50 con 0x7f6c98102550 2024-09-19T06:57:19.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.647+0000 7f6c86ffd640 1 -- 172.21.15.99:0/2657267923 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f6c8807a970 con 0x7f6c98102550 2024-09-19T06:57:19.649 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:57:19.649 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-09-19T06:57:19.649 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T06:57:19.649 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:57:19.649 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-09-19T06:57:19.649 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T06:57:19.649 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:57:19.649 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-09-19T06:57:19.649 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 6 2024-09-19T06:57:19.649 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:57:19.649 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": { 2024-09-19T06:57:19.649 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 4 2024-09-19T06:57:19.650 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:57:19.650 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-09-19T06:57:19.650 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 14 2024-09-19T06:57:19.650 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T06:57:19.650 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:57:19.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.649+0000 7f6c9c9a3640 1 -- 172.21.15.99:0/2657267923 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f6c8006e530 msgr2=0x7f6c800709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:19.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.649+0000 7f6c9c9a3640 1 --2- 172.21.15.99:0/2657267923 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f6c8006e530 0x7f6c800709e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6c98071350 tx=0x7f6c8c009040 comp rx=0 tx=0).stop 2024-09-19T06:57:19.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.649+0000 7f6c9c9a3640 1 -- 172.21.15.99:0/2657267923 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c98102550 msgr2=0x7f6c9806fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:19.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.649+0000 7f6c9c9a3640 1 --2- 172.21.15.99:0/2657267923 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c98102550 0x7f6c9806fa10 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f6c88003080 tx=0x7f6c88009da0 comp rx=0 tx=0).stop 2024-09-19T06:57:19.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.649+0000 7f6c9c9a3640 1 -- 172.21.15.99:0/2657267923 shutdown_connections 2024-09-19T06:57:19.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.649+0000 7f6c9c9a3640 1 --2- 172.21.15.99:0/2657267923 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f6c8006e530 0x7f6c800709e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:19.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.649+0000 7f6c9c9a3640 1 --2- 172.21.15.99:0/2657267923 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c98102ef0 0x7f6c9806ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:19.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.649+0000 7f6c9c9a3640 1 --2- 172.21.15.99:0/2657267923 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6c98102550 0x7f6c9806fa10 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:19.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.649+0000 7f6c9c9a3640 1 -- 172.21.15.99:0/2657267923 >> 172.21.15.99:0/2657267923 conn(0x7f6c980f80f0 msgr2=0x7f6c980f9160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:19.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.649+0000 7f6c9c9a3640 1 -- 172.21.15.99:0/2657267923 shutdown_connections 2024-09-19T06:57:19.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.650+0000 7f6c9c9a3640 1 -- 172.21.15.99:0/2657267923 wait complete. 2024-09-19T06:57:19.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.728+0000 7f8740073640 1 -- 172.21.15.99:0/3084683059 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f87380fb4a0 msgr2=0x7f87380fb910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:19.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.728+0000 7f8740073640 1 --2- 172.21.15.99:0/3084683059 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f87380fb4a0 0x7f87380fb910 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f872c0048d0 tx=0x7f872c009da0 comp rx=0 tx=0).stop 2024-09-19T06:57:19.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.728+0000 7f8740073640 1 -- 172.21.15.99:0/3084683059 shutdown_connections 2024-09-19T06:57:19.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.728+0000 7f8740073640 1 --2- 172.21.15.99:0/3084683059 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f87380fb4a0 0x7f87380fb910 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:19.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.728+0000 7f8740073640 1 --2- 172.21.15.99:0/3084683059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87381014e0 0x7f87381018b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:19.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.728+0000 7f8740073640 1 -- 172.21.15.99:0/3084683059 >> 172.21.15.99:0/3084683059 conn(0x7f87380f7060 msgr2=0x7f87380f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:19.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.728+0000 7f8740073640 1 -- 172.21.15.99:0/3084683059 shutdown_connections 2024-09-19T06:57:19.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.728+0000 7f8740073640 1 -- 172.21.15.99:0/3084683059 wait complete. 2024-09-19T06:57:19.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.729+0000 7f8740073640 1 Processor -- start 2024-09-19T06:57:19.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.729+0000 7f8740073640 1 -- start start 2024-09-19T06:57:19.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.729+0000 7f8740073640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f87380fb4a0 0x7f87381120d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:19.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.729+0000 7f8740073640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87381014e0 0x7f8738112610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:19.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.729+0000 7f8740073640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8738112c10 con 0x7f87380fb4a0 2024-09-19T06:57:19.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.729+0000 7f8740073640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f873810c050 con 0x7f87381014e0 2024-09-19T06:57:19.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.729+0000 7f873de0f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f87380fb4a0 0x7f87381120d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:19.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.729+0000 7f873de0f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f87380fb4a0 0x7f87381120d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59356/0 (socket says 172.21.15.99:59356) 2024-09-19T06:57:19.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.729+0000 7f873de0f640 1 -- 172.21.15.99:0/1236028314 learned_addr learned my addr 172.21.15.99:0/1236028314 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:57:19.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.729+0000 7f873de0f640 1 -- 172.21.15.99:0/1236028314 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87381014e0 msgr2=0x7f8738112610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:19.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.729+0000 7f873de0f640 1 --2- 172.21.15.99:0/1236028314 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87381014e0 0x7f8738112610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:19.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.729+0000 7f873de0f640 1 -- 172.21.15.99:0/1236028314 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f872c005040 con 0x7f87380fb4a0 2024-09-19T06:57:19.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.729+0000 7f873de0f640 1 --2- 172.21.15.99:0/1236028314 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f87380fb4a0 0x7f87381120d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f8734002a50 tx=0x7f8734004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:19.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.730+0000 7f872a7fc640 1 -- 172.21.15.99:0/1236028314 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8734007c30 con 0x7f87380fb4a0 2024-09-19T06:57:19.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.730+0000 7f872a7fc640 1 -- 172.21.15.99:0/1236028314 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f873400f040 con 0x7f87380fb4a0 2024-09-19T06:57:19.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.730+0000 7f8740073640 1 -- 172.21.15.99:0/1236028314 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f873810c330 con 0x7f87380fb4a0 2024-09-19T06:57:19.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.730+0000 7f872a7fc640 1 -- 172.21.15.99:0/1236028314 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f873400da90 con 0x7f87380fb4a0 2024-09-19T06:57:19.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.730+0000 7f8740073640 1 -- 172.21.15.99:0/1236028314 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f873810c8d0 con 0x7f87380fb4a0 2024-09-19T06:57:19.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.731+0000 7f8740073640 1 -- 172.21.15.99:0/1236028314 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87380fcbe0 con 0x7f87380fb4a0 2024-09-19T06:57:19.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.731+0000 7f872a7fc640 1 -- 172.21.15.99:0/1236028314 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f873400dc30 con 0x7f87380fb4a0 2024-09-19T06:57:19.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.732+0000 7f872a7fc640 1 --2- 172.21.15.99:0/1236028314 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f872406e530 0x7f87240709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:19.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.732+0000 7f872a7fc640 1 -- 172.21.15.99:0/1236028314 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f873408d9c0 con 0x7f87380fb4a0 2024-09-19T06:57:19.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.732+0000 7f873d60e640 1 --2- 172.21.15.99:0/1236028314 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f872406e530 0x7f87240709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:19.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.732+0000 7f873d60e640 1 --2- 172.21.15.99:0/1236028314 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f872406e530 0x7f87240709e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f872c02a530 tx=0x7f872c009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:19.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.736+0000 7f872a7fc640 1 -- 172.21.15.99:0/1236028314 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f8734056b30 con 0x7f87380fb4a0 2024-09-19T06:57:19.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.937+0000 7f8740073640 1 -- 172.21.15.99:0/1236028314 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8738108510 con 0x7f87380fb4a0 2024-09-19T06:57:19.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.937+0000 7f872a7fc640 1 -- 172.21.15.99:0/1236028314 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 29 v29) v1 ==== 76+0+1915 (secure 0 0 0) 0x7f873405a1f0 con 0x7f87380fb4a0 2024-09-19T06:57:19.939 INFO:teuthology.orchestra.run.smithi099.stdout:e29 2024-09-19T06:57:19.939 INFO:teuthology.orchestra.run.smithi099.stdout:btime 2024-09-19T06:48:47:938420+0000 2024-09-19T06:57:19.939 INFO:teuthology.orchestra.run.smithi099.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T06:57:19.939 INFO:teuthology.orchestra.run.smithi099.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T06:57:19.939 INFO:teuthology.orchestra.run.smithi099.stdout:legacy client fscid: 1 2024-09-19T06:57:19.939 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:57:19.939 INFO:teuthology.orchestra.run.smithi099.stdout:Filesystem 'cephfs' (1) 2024-09-19T06:57:19.939 INFO:teuthology.orchestra.run.smithi099.stdout:fs_name cephfs 2024-09-19T06:57:19.939 INFO:teuthology.orchestra.run.smithi099.stdout:epoch 20 2024-09-19T06:57:19.940 INFO:teuthology.orchestra.run.smithi099.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-19T06:57:19.940 INFO:teuthology.orchestra.run.smithi099.stdout:created 2024-09-19T06:37:40.838146+0000 2024-09-19T06:57:19.940 INFO:teuthology.orchestra.run.smithi099.stdout:modified 2024-09-19T06:47:50.076553+0000 2024-09-19T06:57:19.940 INFO:teuthology.orchestra.run.smithi099.stdout:tableserver 0 2024-09-19T06:57:19.940 INFO:teuthology.orchestra.run.smithi099.stdout:root 0 2024-09-19T06:57:19.940 INFO:teuthology.orchestra.run.smithi099.stdout:session_timeout 60 2024-09-19T06:57:19.940 INFO:teuthology.orchestra.run.smithi099.stdout:session_autoclose 300 2024-09-19T06:57:19.940 INFO:teuthology.orchestra.run.smithi099.stdout:max_file_size 1099511627776 2024-09-19T06:57:19.940 INFO:teuthology.orchestra.run.smithi099.stdout:max_xattr_size 65536 2024-09-19T06:57:19.940 INFO:teuthology.orchestra.run.smithi099.stdout:required_client_features {} 2024-09-19T06:57:19.940 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure 0 2024-09-19T06:57:19.940 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure_osd_epoch 77 2024-09-19T06:57:19.940 INFO:teuthology.orchestra.run.smithi099.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T06:57:19.941 INFO:teuthology.orchestra.run.smithi099.stdout:max_mds 2 2024-09-19T06:57:19.941 INFO:teuthology.orchestra.run.smithi099.stdout:in 0,1 2024-09-19T06:57:19.941 INFO:teuthology.orchestra.run.smithi099.stdout:up {} 2024-09-19T06:57:19.941 INFO:teuthology.orchestra.run.smithi099.stdout:failed 0,1 2024-09-19T06:57:19.941 INFO:teuthology.orchestra.run.smithi099.stdout:damaged 2024-09-19T06:57:19.941 INFO:teuthology.orchestra.run.smithi099.stdout:stopped 2024-09-19T06:57:19.941 INFO:teuthology.orchestra.run.smithi099.stdout:data_pools [3] 2024-09-19T06:57:19.941 INFO:teuthology.orchestra.run.smithi099.stdout:metadata_pool 2 2024-09-19T06:57:19.941 INFO:teuthology.orchestra.run.smithi099.stdout:inline_data disabled 2024-09-19T06:57:19.941 INFO:teuthology.orchestra.run.smithi099.stdout:balancer 2024-09-19T06:57:19.941 INFO:teuthology.orchestra.run.smithi099.stdout:bal_rank_mask -1 2024-09-19T06:57:19.941 INFO:teuthology.orchestra.run.smithi099.stdout:standby_count_wanted 1 2024-09-19T06:57:19.941 INFO:teuthology.orchestra.run.smithi099.stdout:qdb_cluster leader: 0 members: 2024-09-19T06:57:19.941 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:57:19.942 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:57:19.942 INFO:teuthology.orchestra.run.smithi099.stdout:Standby daemons: 2024-09-19T06:57:19.942 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:57:19.942 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.obarqf{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6826/1859154203,v1:172.21.15.99:6827/1859154203] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:57:19.942 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.xehbxe{-1:34410} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6828/1939453719,v1:172.21.15.99:6829/1939453719] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:57:19.942 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.nooexo{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6824/1398895079,v1:172.21.15.117:6825/1398895079] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:57:19.942 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.bheqzh{-1:44329} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6826/3233337308,v1:172.21.15.117:6827/3233337308] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:57:19.943 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 29 2024-09-19T06:57:19.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.939+0000 7f8740073640 1 -- 172.21.15.99:0/1236028314 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f872406e530 msgr2=0x7f87240709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:19.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.939+0000 7f8740073640 1 --2- 172.21.15.99:0/1236028314 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f872406e530 0x7f87240709e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f872c02a530 tx=0x7f872c009da0 comp rx=0 tx=0).stop 2024-09-19T06:57:19.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.939+0000 7f8740073640 1 -- 172.21.15.99:0/1236028314 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f87380fb4a0 msgr2=0x7f87381120d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:19.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.939+0000 7f8740073640 1 --2- 172.21.15.99:0/1236028314 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f87380fb4a0 0x7f87381120d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f8734002a50 tx=0x7f8734004600 comp rx=0 tx=0).stop 2024-09-19T06:57:19.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.939+0000 7f8740073640 1 -- 172.21.15.99:0/1236028314 shutdown_connections 2024-09-19T06:57:19.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.940+0000 7f8740073640 1 --2- 172.21.15.99:0/1236028314 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f872406e530 0x7f87240709e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:19.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.940+0000 7f8740073640 1 --2- 172.21.15.99:0/1236028314 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f87381014e0 0x7f8738112610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:19.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.940+0000 7f8740073640 1 --2- 172.21.15.99:0/1236028314 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f87380fb4a0 0x7f87381120d0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:19.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.940+0000 7f8740073640 1 -- 172.21.15.99:0/1236028314 >> 172.21.15.99:0/1236028314 conn(0x7f87380f7060 msgr2=0x7f87380f8910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:19.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.940+0000 7f8740073640 1 -- 172.21.15.99:0/1236028314 shutdown_connections 2024-09-19T06:57:19.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:19.940+0000 7f8740073640 1 -- 172.21.15.99:0/1236028314 wait complete. 2024-09-19T06:57:20.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.019+0000 7f0e5ffcb640 1 -- 172.21.15.99:0/2430242173 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0e58102550 msgr2=0x7f0e58102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:20.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.019+0000 7f0e5ffcb640 1 --2- 172.21.15.99:0/2430242173 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0e58102550 0x7f0e58102920 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f0e540048d0 tx=0x7f0e54009da0 comp rx=0 tx=0).stop 2024-09-19T06:57:20.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.019+0000 7f0e5ffcb640 1 -- 172.21.15.99:0/2430242173 shutdown_connections 2024-09-19T06:57:20.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.019+0000 7f0e5ffcb640 1 --2- 172.21.15.99:0/2430242173 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0e58102ef0 0x7f0e580fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:20.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.019+0000 7f0e5ffcb640 1 --2- 172.21.15.99:0/2430242173 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0e58102550 0x7f0e58102920 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:20.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.019+0000 7f0e5ffcb640 1 -- 172.21.15.99:0/2430242173 >> 172.21.15.99:0/2430242173 conn(0x7f0e580f80f0 msgr2=0x7f0e580fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:20.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.019+0000 7f0e5ffcb640 1 -- 172.21.15.99:0/2430242173 shutdown_connections 2024-09-19T06:57:20.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.019+0000 7f0e5ffcb640 1 -- 172.21.15.99:0/2430242173 wait complete. 2024-09-19T06:57:20.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.019+0000 7f0e5ffcb640 1 Processor -- start 2024-09-19T06:57:20.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.019+0000 7f0e5ffcb640 1 -- start start 2024-09-19T06:57:20.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.020+0000 7f0e5ffcb640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0e58102550 0x7f0e58113540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:20.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.020+0000 7f0e5ffcb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0e58102ef0 0x7f0e58113a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:20.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.020+0000 7f0e5ffcb640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e581140d0 con 0x7f0e58102ef0 2024-09-19T06:57:20.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.020+0000 7f0e5ffcb640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5810d4e0 con 0x7f0e58102550 2024-09-19T06:57:20.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.020+0000 7f0e5d566640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0e58102ef0 0x7f0e58113a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:20.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.020+0000 7f0e5d566640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0e58102ef0 0x7f0e58113a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59376/0 (socket says 172.21.15.99:59376) 2024-09-19T06:57:20.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.020+0000 7f0e5d566640 1 -- 172.21.15.99:0/1353799548 learned_addr learned my addr 172.21.15.99:0/1353799548 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:57:20.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.020+0000 7f0e5dd67640 1 --2- 172.21.15.99:0/1353799548 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0e58102550 0x7f0e58113540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:20.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.020+0000 7f0e5d566640 1 -- 172.21.15.99:0/1353799548 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0e58102550 msgr2=0x7f0e58113540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:20.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.020+0000 7f0e5d566640 1 --2- 172.21.15.99:0/1353799548 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0e58102550 0x7f0e58113540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:20.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.020+0000 7f0e5d566640 1 -- 172.21.15.99:0/1353799548 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e54005040 con 0x7f0e58102ef0 2024-09-19T06:57:20.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.020+0000 7f0e5d566640 1 --2- 172.21.15.99:0/1353799548 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0e58102ef0 0x7f0e58113a80 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c00eb40 tx=0x7f0e4c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:20.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.021+0000 7f0e4a7fc640 1 -- 172.21.15.99:0/1353799548 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e4c007c30 con 0x7f0e58102ef0 2024-09-19T06:57:20.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.021+0000 7f0e5ffcb640 1 -- 172.21.15.99:0/1353799548 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e5810d760 con 0x7f0e58102ef0 2024-09-19T06:57:20.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.021+0000 7f0e4a7fc640 1 -- 172.21.15.99:0/1353799548 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0e4c00f040 con 0x7f0e58102ef0 2024-09-19T06:57:20.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.021+0000 7f0e4a7fc640 1 -- 172.21.15.99:0/1353799548 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e4c00ca90 con 0x7f0e58102ef0 2024-09-19T06:57:20.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.021+0000 7f0e5ffcb640 1 -- 172.21.15.99:0/1353799548 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e5810dd00 con 0x7f0e58102ef0 2024-09-19T06:57:20.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.022+0000 7f0e5ffcb640 1 -- 172.21.15.99:0/1353799548 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e580fdcd0 con 0x7f0e58102ef0 2024-09-19T06:57:20.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.022+0000 7f0e4a7fc640 1 -- 172.21.15.99:0/1353799548 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f0e4c00ccd0 con 0x7f0e58102ef0 2024-09-19T06:57:20.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.023+0000 7f0e4a7fc640 1 --2- 172.21.15.99:0/1353799548 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f0e4406e530 0x7f0e440709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:20.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.023+0000 7f0e4a7fc640 1 -- 172.21.15.99:0/1353799548 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f0e4c08dd70 con 0x7f0e58102ef0 2024-09-19T06:57:20.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.023+0000 7f0e5dd67640 1 --2- 172.21.15.99:0/1353799548 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f0e4406e530 0x7f0e440709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:20.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.023+0000 7f0e5dd67640 1 --2- 172.21.15.99:0/1353799548 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f0e4406e530 0x7f0e440709e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0e54004540 tx=0x7f0e54035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:20.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.028+0000 7f0e4a7fc640 1 -- 172.21.15.99:0/1353799548 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f0e4c056f10 con 0x7f0e58102ef0 2024-09-19T06:57:20.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.214+0000 7f0e5ffcb640 1 -- 172.21.15.99:0/1353799548 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0e581095c0 con 0x7f0e4406e530 2024-09-19T06:57:20.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.215+0000 7f0e4a7fc640 1 -- 172.21.15.99:0/1353799548 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f0e581095c0 con 0x7f0e4406e530 2024-09-19T06:57:20.216 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:57:20.216 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T06:57:20.216 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": true, 2024-09-19T06:57:20.216 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T06:57:20.216 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [ 2024-09-19T06:57:20.216 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr", 2024-09-19T06:57:20.216 INFO:teuthology.orchestra.run.smithi099.stdout: "crash", 2024-09-19T06:57:20.217 INFO:teuthology.orchestra.run.smithi099.stdout: "mds", 2024-09-19T06:57:20.217 INFO:teuthology.orchestra.run.smithi099.stdout: "mon", 2024-09-19T06:57:20.217 INFO:teuthology.orchestra.run.smithi099.stdout: "osd" 2024-09-19T06:57:20.217 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-19T06:57:20.217 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": "16/21 daemons upgraded", 2024-09-19T06:57:20.217 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "Currently upgrading mds daemons", 2024-09-19T06:57:20.217 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-09-19T06:57:20.217 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:57:20.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.217+0000 7f0e5ffcb640 1 -- 172.21.15.99:0/1353799548 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f0e4406e530 msgr2=0x7f0e440709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:20.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.217+0000 7f0e5ffcb640 1 --2- 172.21.15.99:0/1353799548 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f0e4406e530 0x7f0e440709e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0e54004540 tx=0x7f0e54035040 comp rx=0 tx=0).stop 2024-09-19T06:57:20.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.217+0000 7f0e5ffcb640 1 -- 172.21.15.99:0/1353799548 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0e58102ef0 msgr2=0x7f0e58113a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:20.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.217+0000 7f0e5ffcb640 1 --2- 172.21.15.99:0/1353799548 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0e58102ef0 0x7f0e58113a80 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c00eb40 tx=0x7f0e4c00b040 comp rx=0 tx=0).stop 2024-09-19T06:57:20.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.217+0000 7f0e5ffcb640 1 -- 172.21.15.99:0/1353799548 shutdown_connections 2024-09-19T06:57:20.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.217+0000 7f0e5ffcb640 1 --2- 172.21.15.99:0/1353799548 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f0e4406e530 0x7f0e440709e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:20.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.217+0000 7f0e5ffcb640 1 --2- 172.21.15.99:0/1353799548 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0e58102ef0 0x7f0e58113a80 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:20.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.217+0000 7f0e5ffcb640 1 --2- 172.21.15.99:0/1353799548 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0e58102550 0x7f0e58113540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:20.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.217+0000 7f0e5ffcb640 1 -- 172.21.15.99:0/1353799548 >> 172.21.15.99:0/1353799548 conn(0x7f0e580f80f0 msgr2=0x7f0e580f9160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:20.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.217+0000 7f0e5ffcb640 1 -- 172.21.15.99:0/1353799548 shutdown_connections 2024-09-19T06:57:20.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.217+0000 7f0e5ffcb640 1 -- 172.21.15.99:0/1353799548 wait complete. 2024-09-19T06:57:20.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.295+0000 7f53b76ca640 1 -- 172.21.15.99:0/1596266837 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f53b0102ef0 msgr2=0x7f53b00fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:20.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.296+0000 7f53b76ca640 1 --2- 172.21.15.99:0/1596266837 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f53b0102ef0 0x7f53b00fc5b0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f53a4009c50 tx=0x7f53a4004d10 comp rx=0 tx=0).stop 2024-09-19T06:57:20.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.296+0000 7f53b76ca640 1 -- 172.21.15.99:0/1596266837 shutdown_connections 2024-09-19T06:57:20.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.296+0000 7f53b76ca640 1 --2- 172.21.15.99:0/1596266837 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f53b0102ef0 0x7f53b00fc5b0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:20.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.296+0000 7f53b76ca640 1 --2- 172.21.15.99:0/1596266837 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f53b0102550 0x7f53b0102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:20.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.296+0000 7f53b76ca640 1 -- 172.21.15.99:0/1596266837 >> 172.21.15.99:0/1596266837 conn(0x7f53b00f80f0 msgr2=0x7f53b00fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:20.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.296+0000 7f53b76ca640 1 -- 172.21.15.99:0/1596266837 shutdown_connections 2024-09-19T06:57:20.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.296+0000 7f53b76ca640 1 -- 172.21.15.99:0/1596266837 wait complete. 2024-09-19T06:57:20.298 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:57:20 smithi099 ceph-mon[97031]: from='client.34866 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:57:20.298 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:57:20 smithi099 ceph-mon[97031]: pgmap v449: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:57:20.298 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:57:20 smithi099 ceph-mon[97031]: from='client.34870 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:57:20.298 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:57:20 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/2657267923' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:57:20.298 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:57:20 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/1236028314' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:57:20.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.296+0000 7f53b76ca640 1 Processor -- start 2024-09-19T06:57:20.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.296+0000 7f53b76ca640 1 -- start start 2024-09-19T06:57:20.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.296+0000 7f53b76ca640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f53b0102550 0x7f53b006fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:20.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.296+0000 7f53b76ca640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f53b0102ef0 0x7f53b006ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:20.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.297+0000 7f53b76ca640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b0070490 con 0x7f53b0102ef0 2024-09-19T06:57:20.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.297+0000 7f53b76ca640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b0070600 con 0x7f53b0102550 2024-09-19T06:57:20.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.297+0000 7f53b4c65640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f53b0102ef0 0x7f53b006ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:20.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.297+0000 7f53b4c65640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f53b0102ef0 0x7f53b006ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59390/0 (socket says 172.21.15.99:59390) 2024-09-19T06:57:20.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.297+0000 7f53b4c65640 1 -- 172.21.15.99:0/744214225 learned_addr learned my addr 172.21.15.99:0/744214225 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:57:20.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.297+0000 7f53b5466640 1 --2- 172.21.15.99:0/744214225 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f53b0102550 0x7f53b006fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:20.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.297+0000 7f53b4c65640 1 -- 172.21.15.99:0/744214225 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f53b0102550 msgr2=0x7f53b006fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:20.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.297+0000 7f53b4c65640 1 --2- 172.21.15.99:0/744214225 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f53b0102550 0x7f53b006fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:20.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.297+0000 7f53b4c65640 1 -- 172.21.15.99:0/744214225 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53a40098b0 con 0x7f53b0102ef0 2024-09-19T06:57:20.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.297+0000 7f53b5466640 1 --2- 172.21.15.99:0/744214225 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f53b0102550 0x7f53b006fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:57:20.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.297+0000 7f53b4c65640 1 --2- 172.21.15.99:0/744214225 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f53b0102ef0 0x7f53b006ff50 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f53a4004750 tx=0x7f53a4004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:20.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.297+0000 7f53adffb640 1 -- 172.21.15.99:0/744214225 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53a40094c0 con 0x7f53b0102ef0 2024-09-19T06:57:20.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.297+0000 7f53adffb640 1 -- 172.21.15.99:0/744214225 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f53a4009620 con 0x7f53b0102ef0 2024-09-19T06:57:20.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.297+0000 7f53b76ca640 1 -- 172.21.15.99:0/744214225 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53b0070830 con 0x7f53b0102ef0 2024-09-19T06:57:20.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.297+0000 7f53adffb640 1 -- 172.21.15.99:0/744214225 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53a403d8f0 con 0x7f53b0102ef0 2024-09-19T06:57:20.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.298+0000 7f53b76ca640 1 -- 172.21.15.99:0/744214225 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53b0119bd0 con 0x7f53b0102ef0 2024-09-19T06:57:20.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.299+0000 7f53b76ca640 1 -- 172.21.15.99:0/744214225 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53b00fdcd0 con 0x7f53b0102ef0 2024-09-19T06:57:20.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.299+0000 7f53adffb640 1 -- 172.21.15.99:0/744214225 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f53a402f030 con 0x7f53b0102ef0 2024-09-19T06:57:20.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.299+0000 7f53adffb640 1 --2- 172.21.15.99:0/744214225 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f539806e530 0x7f53980709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:20.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.300+0000 7f53adffb640 1 -- 172.21.15.99:0/744214225 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f53a40af160 con 0x7f53b0102ef0 2024-09-19T06:57:20.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.300+0000 7f53b5466640 1 --2- 172.21.15.99:0/744214225 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f539806e530 0x7f53980709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:20.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.300+0000 7f53b5466640 1 --2- 172.21.15.99:0/744214225 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f539806e530 0x7f53980709e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f53a8009fd0 tx=0x7f53a8009e50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:20.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.304+0000 7f53adffb640 1 -- 172.21.15.99:0/744214225 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f53a4078300 con 0x7f53b0102ef0 2024-09-19T06:57:20.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.535+0000 7f53b76ca640 1 -- 172.21.15.99:0/744214225 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f53b004b720 con 0x7f53b0102ef0 2024-09-19T06:57:20.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.536+0000 7f53adffb640 1 -- 172.21.15.99:0/744214225 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7f53a407b9c0 con 0x7f53b0102ef0 2024-09-19T06:57:20.537 INFO:teuthology.orchestra.run.smithi099.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-09-19T06:57:20.537 INFO:teuthology.orchestra.run.smithi099.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-19T06:57:20.537 INFO:teuthology.orchestra.run.smithi099.stdout: fs cephfs is degraded 2024-09-19T06:57:20.537 INFO:teuthology.orchestra.run.smithi099.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-19T06:57:20.537 INFO:teuthology.orchestra.run.smithi099.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-19T06:57:20.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.538+0000 7f53b76ca640 1 -- 172.21.15.99:0/744214225 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f539806e530 msgr2=0x7f53980709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:20.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.538+0000 7f53b76ca640 1 --2- 172.21.15.99:0/744214225 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f539806e530 0x7f53980709e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f53a8009fd0 tx=0x7f53a8009e50 comp rx=0 tx=0).stop 2024-09-19T06:57:20.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.538+0000 7f53b76ca640 1 -- 172.21.15.99:0/744214225 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f53b0102ef0 msgr2=0x7f53b006ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:20.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.538+0000 7f53b76ca640 1 --2- 172.21.15.99:0/744214225 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f53b0102ef0 0x7f53b006ff50 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f53a4004750 tx=0x7f53a4004d10 comp rx=0 tx=0).stop 2024-09-19T06:57:20.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.538+0000 7f53b76ca640 1 -- 172.21.15.99:0/744214225 shutdown_connections 2024-09-19T06:57:20.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.538+0000 7f53b76ca640 1 --2- 172.21.15.99:0/744214225 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f539806e530 0x7f53980709e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:20.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.538+0000 7f53b76ca640 1 --2- 172.21.15.99:0/744214225 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f53b0102ef0 0x7f53b006ff50 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:20.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.538+0000 7f53b76ca640 1 --2- 172.21.15.99:0/744214225 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f53b0102550 0x7f53b006fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:20.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.538+0000 7f53b76ca640 1 -- 172.21.15.99:0/744214225 >> 172.21.15.99:0/744214225 conn(0x7f53b00f80f0 msgr2=0x7f53b00f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:20.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.538+0000 7f53b76ca640 1 -- 172.21.15.99:0/744214225 shutdown_connections 2024-09-19T06:57:20.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:20.538+0000 7f53b76ca640 1 -- 172.21.15.99:0/744214225 wait complete. 2024-09-19T06:57:20.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:57:20 smithi117 ceph-mon[76771]: from='client.34866 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:57:20.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:57:20 smithi117 ceph-mon[76771]: pgmap v449: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:57:20.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:57:20 smithi117 ceph-mon[76771]: from='client.34870 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:57:20.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:57:20 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/2657267923' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:57:20.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:57:20 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/1236028314' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:57:21.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:57:21 smithi099 ceph-mon[97031]: from='client.34874 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:57:21.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:57:21 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/744214225' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T06:57:21.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:57:21 smithi117 ceph-mon[76771]: from='client.34874 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:57:21.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:57:21 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/744214225' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T06:57:22.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:57:22 smithi099 ceph-mon[97031]: from='client.34886 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:57:22.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:57:22 smithi099 ceph-mon[97031]: pgmap v450: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:57:22.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:57:22 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:57:22.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:57:22 smithi117 ceph-mon[76771]: from='client.34886 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:57:22.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:57:22 smithi117 ceph-mon[76771]: pgmap v450: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:57:22.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:57:22 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:57:23.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:57:23 smithi099 ceph-mon[97031]: pgmap v451: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:57:23.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:57:23 smithi117 ceph-mon[76771]: pgmap v451: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:57:26.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:57:26 smithi099 ceph-mon[97031]: pgmap v452: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:57:26.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:57:26 smithi117 ceph-mon[76771]: pgmap v452: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:57:28.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:57:28 smithi099 ceph-mon[97031]: pgmap v453: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:57:28.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:57:28 smithi117 ceph-mon[76771]: pgmap v453: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:57:30.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:57:30 smithi099 ceph-mon[97031]: pgmap v454: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:57:30.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:57:30 smithi117 ceph-mon[76771]: pgmap v454: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:57:32.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:57:32 smithi099 ceph-mon[97031]: pgmap v455: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:57:32.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:57:32 smithi117 ceph-mon[76771]: pgmap v455: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:57:34.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:57:34 smithi099 ceph-mon[97031]: pgmap v456: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:57:34.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:57:34 smithi117 ceph-mon[76771]: pgmap v456: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:57:36.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:57:36 smithi099 ceph-mon[97031]: pgmap v457: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:57:36.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:57:36 smithi117 ceph-mon[76771]: pgmap v457: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:57:37.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:57:37 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:57:37.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:57:37 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:57:38.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:57:38 smithi099 ceph-mon[97031]: pgmap v458: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:57:38.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:57:38 smithi117 ceph-mon[76771]: pgmap v458: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:57:40.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:57:40 smithi099 ceph-mon[97031]: pgmap v459: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:57:40.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:57:40 smithi117 ceph-mon[76771]: pgmap v459: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:57:42.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:57:42 smithi099 ceph-mon[97031]: pgmap v460: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:57:42.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:57:42 smithi117 ceph-mon[76771]: pgmap v460: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:57:44.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:57:44 smithi099 ceph-mon[97031]: pgmap v461: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:57:44.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:57:44 smithi117 ceph-mon[76771]: pgmap v461: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:57:46.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:57:46 smithi099 ceph-mon[97031]: pgmap v462: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:57:46.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:57:46 smithi117 ceph-mon[76771]: pgmap v462: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:57:48.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:57:48 smithi099 ceph-mon[97031]: pgmap v463: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:57:48.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:57:48 smithi117 ceph-mon[76771]: pgmap v463: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:57:50.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:57:50 smithi099 ceph-mon[97031]: pgmap v464: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:57:50.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:57:50 smithi117 ceph-mon[76771]: pgmap v464: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:57:50.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.627+0000 7f7964547640 1 -- 172.21.15.99:0/3492679127 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f795c102ed0 msgr2=0x7f795c0fc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:50.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.627+0000 7f7964547640 1 --2- 172.21.15.99:0/3492679127 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f795c102ed0 0x7f795c0fc590 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f79500048d0 tx=0x7f7950009da0 comp rx=0 tx=0).stop 2024-09-19T06:57:50.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.627+0000 7f7964547640 1 -- 172.21.15.99:0/3492679127 shutdown_connections 2024-09-19T06:57:50.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.627+0000 7f7964547640 1 --2- 172.21.15.99:0/3492679127 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f795c102ed0 0x7f795c0fc590 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:50.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.627+0000 7f7964547640 1 --2- 172.21.15.99:0/3492679127 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f795c102530 0x7f795c102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:50.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.627+0000 7f7964547640 1 -- 172.21.15.99:0/3492679127 >> 172.21.15.99:0/3492679127 conn(0x7f795c0f80f0 msgr2=0x7f795c0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:50.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.627+0000 7f7964547640 1 -- 172.21.15.99:0/3492679127 shutdown_connections 2024-09-19T06:57:50.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.627+0000 7f7964547640 1 -- 172.21.15.99:0/3492679127 wait complete. 2024-09-19T06:57:50.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.628+0000 7f7964547640 1 Processor -- start 2024-09-19T06:57:50.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.628+0000 7f7964547640 1 -- start start 2024-09-19T06:57:50.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.628+0000 7f7964547640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f795c102530 0x7f795c1131f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:50.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.628+0000 7f7964547640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f795c102ed0 0x7f795c113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:50.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.628+0000 7f7964547640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795c113d30 con 0x7f795c102ed0 2024-09-19T06:57:50.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.628+0000 7f7964547640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795c10d170 con 0x7f795c102530 2024-09-19T06:57:50.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.628+0000 7f7961ae2640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f795c102ed0 0x7f795c113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:50.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.628+0000 7f7961ae2640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f795c102ed0 0x7f795c113730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47040/0 (socket says 172.21.15.99:47040) 2024-09-19T06:57:50.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.628+0000 7f7961ae2640 1 -- 172.21.15.99:0/3274159132 learned_addr learned my addr 172.21.15.99:0/3274159132 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:57:50.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.629+0000 7f79622e3640 1 --2- 172.21.15.99:0/3274159132 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f795c102530 0x7f795c1131f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:50.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.629+0000 7f7961ae2640 1 -- 172.21.15.99:0/3274159132 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f795c102530 msgr2=0x7f795c1131f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:50.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.629+0000 7f7961ae2640 1 --2- 172.21.15.99:0/3274159132 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f795c102530 0x7f795c1131f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:50.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.629+0000 7f7961ae2640 1 -- 172.21.15.99:0/3274159132 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7950005040 con 0x7f795c102ed0 2024-09-19T06:57:50.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.629+0000 7f7961ae2640 1 --2- 172.21.15.99:0/3274159132 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f795c102ed0 0x7f795c113730 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f7950003080 tx=0x7f7950009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:50.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.629+0000 7f795affd640 1 -- 172.21.15.99:0/3274159132 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7950038070 con 0x7f795c102ed0 2024-09-19T06:57:50.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.629+0000 7f795affd640 1 -- 172.21.15.99:0/3274159132 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7950009760 con 0x7f795c102ed0 2024-09-19T06:57:50.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.629+0000 7f7964547640 1 -- 172.21.15.99:0/3274159132 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f795c10d3f0 con 0x7f795c102ed0 2024-09-19T06:57:50.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.629+0000 7f795affd640 1 -- 172.21.15.99:0/3274159132 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7950033420 con 0x7f795c102ed0 2024-09-19T06:57:50.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.629+0000 7f7964547640 1 -- 172.21.15.99:0/3274159132 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f795c10d8d0 con 0x7f795c102ed0 2024-09-19T06:57:50.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.630+0000 7f7964547640 1 -- 172.21.15.99:0/3274159132 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f795c0fdcb0 con 0x7f795c102ed0 2024-09-19T06:57:50.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.631+0000 7f795affd640 1 -- 172.21.15.99:0/3274159132 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f7950030020 con 0x7f795c102ed0 2024-09-19T06:57:50.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.631+0000 7f795affd640 1 --2- 172.21.15.99:0/3274159132 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f794406e530 0x7f79440709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:50.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.631+0000 7f795affd640 1 -- 172.21.15.99:0/3274159132 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f79500adda0 con 0x7f795c102ed0 2024-09-19T06:57:50.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.631+0000 7f79622e3640 1 --2- 172.21.15.99:0/3274159132 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f794406e530 0x7f79440709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:50.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.632+0000 7f79622e3640 1 --2- 172.21.15.99:0/3274159132 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f794406e530 0x7f79440709e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f794c0041d0 tx=0x7f794c009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:50.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.636+0000 7f795affd640 1 -- 172.21.15.99:0/3274159132 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f7950076f10 con 0x7f795c102ed0 2024-09-19T06:57:50.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.819+0000 7f7964547640 1 -- 172.21.15.99:0/3274159132 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f795c109560 con 0x7f794406e530 2024-09-19T06:57:50.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.820+0000 7f795affd640 1 -- 172.21.15.99:0/3274159132 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f795c109560 con 0x7f794406e530 2024-09-19T06:57:50.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.822+0000 7f7964547640 1 -- 172.21.15.99:0/3274159132 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f794406e530 msgr2=0x7f79440709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:50.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.822+0000 7f7964547640 1 --2- 172.21.15.99:0/3274159132 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f794406e530 0x7f79440709e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f794c0041d0 tx=0x7f794c009040 comp rx=0 tx=0).stop 2024-09-19T06:57:50.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.822+0000 7f7964547640 1 -- 172.21.15.99:0/3274159132 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f795c102ed0 msgr2=0x7f795c113730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:50.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.822+0000 7f7964547640 1 --2- 172.21.15.99:0/3274159132 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f795c102ed0 0x7f795c113730 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f7950003080 tx=0x7f7950009da0 comp rx=0 tx=0).stop 2024-09-19T06:57:50.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.822+0000 7f7964547640 1 -- 172.21.15.99:0/3274159132 shutdown_connections 2024-09-19T06:57:50.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.822+0000 7f7964547640 1 --2- 172.21.15.99:0/3274159132 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f794406e530 0x7f79440709e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:50.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.822+0000 7f7964547640 1 --2- 172.21.15.99:0/3274159132 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f795c102ed0 0x7f795c113730 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:50.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.822+0000 7f7964547640 1 --2- 172.21.15.99:0/3274159132 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f795c102530 0x7f795c1131f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:50.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.822+0000 7f7964547640 1 -- 172.21.15.99:0/3274159132 >> 172.21.15.99:0/3274159132 conn(0x7f795c0f80f0 msgr2=0x7f795c0f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:50.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.823+0000 7f7964547640 1 -- 172.21.15.99:0/3274159132 shutdown_connections 2024-09-19T06:57:50.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.823+0000 7f7964547640 1 -- 172.21.15.99:0/3274159132 wait complete. 2024-09-19T06:57:50.833 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-09-19T06:57:50.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.903+0000 7f60fa637640 1 -- 172.21.15.99:0/4237879191 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60f41014e0 msgr2=0x7f60f41018b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:50.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.903+0000 7f60fa637640 1 --2- 172.21.15.99:0/4237879191 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60f41014e0 0x7f60f41018b0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f60e40048d0 tx=0x7f60e4009da0 comp rx=0 tx=0).stop 2024-09-19T06:57:50.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.903+0000 7f60fa637640 1 -- 172.21.15.99:0/4237879191 shutdown_connections 2024-09-19T06:57:50.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.903+0000 7f60fa637640 1 --2- 172.21.15.99:0/4237879191 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60f40fb4a0 0x7f60f40fb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:50.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.903+0000 7f60fa637640 1 --2- 172.21.15.99:0/4237879191 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60f41014e0 0x7f60f41018b0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:50.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.903+0000 7f60fa637640 1 -- 172.21.15.99:0/4237879191 >> 172.21.15.99:0/4237879191 conn(0x7f60f40f7060 msgr2=0x7f60f40f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:50.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.903+0000 7f60fa637640 1 -- 172.21.15.99:0/4237879191 shutdown_connections 2024-09-19T06:57:50.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.903+0000 7f60fa637640 1 -- 172.21.15.99:0/4237879191 wait complete. 2024-09-19T06:57:50.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.904+0000 7f60fa637640 1 Processor -- start 2024-09-19T06:57:50.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.904+0000 7f60fa637640 1 -- start start 2024-09-19T06:57:50.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.904+0000 7f60fa637640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60f40fb4a0 0x7f60f41131c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:50.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.904+0000 7f60fa637640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60f41014e0 0x7f60f4113700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:50.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.904+0000 7f60fa637640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f4113d00 con 0x7f60f41014e0 2024-09-19T06:57:50.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.904+0000 7f60fa637640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f410d140 con 0x7f60f40fb4a0 2024-09-19T06:57:50.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.904+0000 7f60f37fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60f41014e0 0x7f60f4113700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:50.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.904+0000 7f60f37fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60f41014e0 0x7f60f4113700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47050/0 (socket says 172.21.15.99:47050) 2024-09-19T06:57:50.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.904+0000 7f60f37fe640 1 -- 172.21.15.99:0/1013435955 learned_addr learned my addr 172.21.15.99:0/1013435955 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:57:50.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.904+0000 7f60f3fff640 1 --2- 172.21.15.99:0/1013435955 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60f40fb4a0 0x7f60f41131c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:50.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.904+0000 7f60f37fe640 1 -- 172.21.15.99:0/1013435955 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60f40fb4a0 msgr2=0x7f60f41131c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:50.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.904+0000 7f60f37fe640 1 --2- 172.21.15.99:0/1013435955 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60f40fb4a0 0x7f60f41131c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:50.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.904+0000 7f60f37fe640 1 -- 172.21.15.99:0/1013435955 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e4005040 con 0x7f60f41014e0 2024-09-19T06:57:50.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.905+0000 7f60f37fe640 1 --2- 172.21.15.99:0/1013435955 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60f41014e0 0x7f60f4113700 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f60e8002a50 tx=0x7f60e8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:50.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.905+0000 7f60f0ff9640 1 -- 172.21.15.99:0/1013435955 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60e8007c30 con 0x7f60f41014e0 2024-09-19T06:57:50.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.905+0000 7f60f0ff9640 1 -- 172.21.15.99:0/1013435955 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f60e800f040 con 0x7f60f41014e0 2024-09-19T06:57:50.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.905+0000 7f60fa637640 1 -- 172.21.15.99:0/1013435955 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60f410d420 con 0x7f60f41014e0 2024-09-19T06:57:50.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.905+0000 7f60f0ff9640 1 -- 172.21.15.99:0/1013435955 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60e800da90 con 0x7f60f41014e0 2024-09-19T06:57:50.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.905+0000 7f60fa637640 1 -- 172.21.15.99:0/1013435955 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60f410d9c0 con 0x7f60f41014e0 2024-09-19T06:57:50.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.906+0000 7f60fa637640 1 -- 172.21.15.99:0/1013435955 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60f40fcbe0 con 0x7f60f41014e0 2024-09-19T06:57:50.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.906+0000 7f60f0ff9640 1 -- 172.21.15.99:0/1013435955 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f60e800dd00 con 0x7f60f41014e0 2024-09-19T06:57:50.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.907+0000 7f60f0ff9640 1 --2- 172.21.15.99:0/1013435955 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f60dc06e530 0x7f60dc0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:50.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.907+0000 7f60f0ff9640 1 -- 172.21.15.99:0/1013435955 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f60e808da70 con 0x7f60f41014e0 2024-09-19T06:57:50.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.907+0000 7f60f3fff640 1 --2- 172.21.15.99:0/1013435955 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f60dc06e530 0x7f60dc0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:50.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.907+0000 7f60f3fff640 1 --2- 172.21.15.99:0/1013435955 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f60dc06e530 0x7f60dc0709e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f60e4009ac0 tx=0x7f60e4035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:50.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:50.912+0000 7f60f0ff9640 1 -- 172.21.15.99:0/1013435955 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f60e8056b60 con 0x7f60f41014e0 2024-09-19T06:57:51.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.095+0000 7f60fa637640 1 -- 172.21.15.99:0/1013435955 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f60f41084b0 con 0x7f60dc06e530 2024-09-19T06:57:51.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.097+0000 7f60f0ff9640 1 -- 172.21.15.99:0/1013435955 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f60f41084b0 con 0x7f60dc06e530 2024-09-19T06:57:51.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.099+0000 7f60fa637640 1 -- 172.21.15.99:0/1013435955 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f60dc06e530 msgr2=0x7f60dc0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:51.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.099+0000 7f60fa637640 1 --2- 172.21.15.99:0/1013435955 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f60dc06e530 0x7f60dc0709e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f60e4009ac0 tx=0x7f60e4035040 comp rx=0 tx=0).stop 2024-09-19T06:57:51.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.099+0000 7f60fa637640 1 -- 172.21.15.99:0/1013435955 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60f41014e0 msgr2=0x7f60f4113700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:51.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.099+0000 7f60fa637640 1 --2- 172.21.15.99:0/1013435955 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60f41014e0 0x7f60f4113700 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f60e8002a50 tx=0x7f60e8004600 comp rx=0 tx=0).stop 2024-09-19T06:57:51.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.099+0000 7f60fa637640 1 -- 172.21.15.99:0/1013435955 shutdown_connections 2024-09-19T06:57:51.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.099+0000 7f60fa637640 1 --2- 172.21.15.99:0/1013435955 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f60dc06e530 0x7f60dc0709e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:51.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.099+0000 7f60fa637640 1 --2- 172.21.15.99:0/1013435955 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f60f41014e0 0x7f60f4113700 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:51.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.099+0000 7f60fa637640 1 --2- 172.21.15.99:0/1013435955 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60f40fb4a0 0x7f60f41131c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:51.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.099+0000 7f60fa637640 1 -- 172.21.15.99:0/1013435955 >> 172.21.15.99:0/1013435955 conn(0x7f60f40f7060 msgr2=0x7f60f4065a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:51.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.099+0000 7f60fa637640 1 -- 172.21.15.99:0/1013435955 shutdown_connections 2024-09-19T06:57:51.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.099+0000 7f60fa637640 1 -- 172.21.15.99:0/1013435955 wait complete. 2024-09-19T06:57:51.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.176+0000 7f741f26c640 1 -- 172.21.15.99:0/2101435871 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f74180fac80 msgr2=0x7f74180fb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:51.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.176+0000 7f741f26c640 1 --2- 172.21.15.99:0/2101435871 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f74180fac80 0x7f74180fb0f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f74080048d0 tx=0x7f7408009da0 comp rx=0 tx=0).stop 2024-09-19T06:57:51.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.176+0000 7f741f26c640 1 -- 172.21.15.99:0/2101435871 shutdown_connections 2024-09-19T06:57:51.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.176+0000 7f741f26c640 1 --2- 172.21.15.99:0/2101435871 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f74180fac80 0x7f74180fb0f0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:51.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.176+0000 7f741f26c640 1 --2- 172.21.15.99:0/2101435871 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7418102620 0x7f74181029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:51.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.176+0000 7f741f26c640 1 -- 172.21.15.99:0/2101435871 >> 172.21.15.99:0/2101435871 conn(0x7f7418070ce0 msgr2=0x7f74180710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:51.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.176+0000 7f741f26c640 1 -- 172.21.15.99:0/2101435871 shutdown_connections 2024-09-19T06:57:51.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.176+0000 7f741f26c640 1 -- 172.21.15.99:0/2101435871 wait complete. 2024-09-19T06:57:51.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.177+0000 7f741f26c640 1 Processor -- start 2024-09-19T06:57:51.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.177+0000 7f741f26c640 1 -- start start 2024-09-19T06:57:51.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.177+0000 7f741f26c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f74180fac80 0x7f74181131b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:51.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.177+0000 7f741f26c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7418102620 0x7f74181136f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:51.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.177+0000 7f741f26c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7418113cf0 con 0x7f74180fac80 2024-09-19T06:57:51.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.177+0000 7f741f26c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741810d180 con 0x7f7418102620 2024-09-19T06:57:51.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.177+0000 7f741d008640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f74180fac80 0x7f74181131b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:51.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.177+0000 7f741d008640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f74180fac80 0x7f74181131b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47076/0 (socket says 172.21.15.99:47076) 2024-09-19T06:57:51.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.177+0000 7f741d008640 1 -- 172.21.15.99:0/2995529648 learned_addr learned my addr 172.21.15.99:0/2995529648 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:57:51.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.178+0000 7f741c807640 1 --2- 172.21.15.99:0/2995529648 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7418102620 0x7f74181136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:51.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.178+0000 7f741d008640 1 -- 172.21.15.99:0/2995529648 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7418102620 msgr2=0x7f74181136f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:51.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.178+0000 7f741d008640 1 --2- 172.21.15.99:0/2995529648 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7418102620 0x7f74181136f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:51.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.178+0000 7f741d008640 1 -- 172.21.15.99:0/2995529648 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7408005040 con 0x7f74180fac80 2024-09-19T06:57:51.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.178+0000 7f741c807640 1 --2- 172.21.15.99:0/2995529648 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7418102620 0x7f74181136f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:57:51.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.178+0000 7f741d008640 1 --2- 172.21.15.99:0/2995529648 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f74180fac80 0x7f74181131b0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f7414002a50 tx=0x7f7414004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:51.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.178+0000 7f740dffb640 1 -- 172.21.15.99:0/2995529648 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7414007c30 con 0x7f74180fac80 2024-09-19T06:57:51.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.178+0000 7f740dffb640 1 -- 172.21.15.99:0/2995529648 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f741400f040 con 0x7f74180fac80 2024-09-19T06:57:51.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.178+0000 7f741f26c640 1 -- 172.21.15.99:0/2995529648 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f741810d460 con 0x7f74180fac80 2024-09-19T06:57:51.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.179+0000 7f740dffb640 1 -- 172.21.15.99:0/2995529648 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f741400db50 con 0x7f74180fac80 2024-09-19T06:57:51.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.179+0000 7f741f26c640 1 -- 172.21.15.99:0/2995529648 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f741810d9d0 con 0x7f74180fac80 2024-09-19T06:57:51.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.180+0000 7f740dffb640 1 -- 172.21.15.99:0/2995529648 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f741400dcb0 con 0x7f74180fac80 2024-09-19T06:57:51.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.180+0000 7f741f26c640 1 -- 172.21.15.99:0/2995529648 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74180657b0 con 0x7f74180fac80 2024-09-19T06:57:51.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.180+0000 7f740dffb640 1 --2- 172.21.15.99:0/2995529648 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f740406e530 0x7f74040709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:51.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.180+0000 7f740dffb640 1 -- 172.21.15.99:0/2995529648 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f741408e060 con 0x7f74180fac80 2024-09-19T06:57:51.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.180+0000 7f741c807640 1 --2- 172.21.15.99:0/2995529648 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f740406e530 0x7f74040709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:51.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.181+0000 7f741c807640 1 --2- 172.21.15.99:0/2995529648 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f740406e530 0x7f74040709e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f74180f8f80 tx=0x7f7408035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:51.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.186+0000 7f740dffb640 1 -- 172.21.15.99:0/2995529648 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f74140571d0 con 0x7f74180fac80 2024-09-19T06:57:51.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.361+0000 7f741f26c640 1 -- 172.21.15.99:0/2995529648 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f741804b720 con 0x7f740406e530 2024-09-19T06:57:51.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.370+0000 7f740dffb640 1 -- 172.21.15.99:0/2995529648 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f741804b720 con 0x7f740406e530 2024-09-19T06:57:51.372 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T06:57:51.372 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.smithi099 smithi099 *:9093,9094 running (16m) 9m ago 25m 23.4M - 0.25.0 c8568f914cd2 e7c1774d56b0 2024-09-19T06:57:51.373 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi099 smithi099 running (13m) 9m ago 25m 6899k - 19.1.1-361-g2f599a46 d2baa855c067 b9775f416b10 2024-09-19T06:57:51.373 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi117 smithi117 running (13m) 9m ago 24m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 38cf60c0d548 2024-09-19T06:57:51.373 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.smithi099 smithi099 *:3000 running (15m) 9m ago 25m 80.7M - 9.4.12 2bacad6d85d8 cd53a18d5410 2024-09-19T06:57:51.373 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.obarqf smithi099 running (9m) 9m ago 20m 12.2M - 19.1.1-361-g2f599a46 d2baa855c067 314a73082521 2024-09-19T06:57:51.373 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.xehbxe smithi099 running (9m) 9m ago 19m 14.4M - 19.1.1-361-g2f599a46 d2baa855c067 a2955a9d06e6 2024-09-19T06:57:51.373 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.bheqzh smithi117 running (9m) 9m ago 19m 11.8M - 19.1.1-361-g2f599a46 d2baa855c067 b1505937c0b7 2024-09-19T06:57:51.373 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.nooexo smithi117 running (9m) 9m ago 20m 13.1M - 19.1.1-361-g2f599a46 d2baa855c067 35bd7725855c 2024-09-19T06:57:51.373 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi099.pgvkqi smithi099 *:8443,9283,8765 running (16m) 9m ago 26m 505M - 19.1.1-361-g2f599a46 d2baa855c067 d5de99cb7e78 2024-09-19T06:57:51.373 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi117.ssmkcf smithi117 *:8443,9283,8765 running (15m) 9m ago 24m 444M - 19.1.1-361-g2f599a46 d2baa855c067 8b7ee0f871f5 2024-09-19T06:57:51.373 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi099 smithi099 running (14m) 9m ago 26m 52.4M 2048M 19.1.1-361-g2f599a46 d2baa855c067 ffe067438824 2024-09-19T06:57:51.373 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi117 smithi117 running (13m) 9m ago 24m 38.9M 2048M 19.1.1-361-g2f599a46 d2baa855c067 4cb7455e3ee7 2024-09-19T06:57:51.373 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi099 smithi099 *:9100 running (17m) 9m ago 25m 15.0M - 1.5.0 0da6a335fe13 dca7b4517dcc 2024-09-19T06:57:51.374 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi117 smithi117 *:9100 running (16m) 9m ago 24m 15.9M - 1.5.0 0da6a335fe13 8233ce3835d2 2024-09-19T06:57:51.374 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (12m) 9m ago 23m 100M 1557M 19.1.1-361-g2f599a46 d2baa855c067 8e22543bf933 2024-09-19T06:57:51.374 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (12m) 9m ago 23m 106M 1557M 19.1.1-361-g2f599a46 d2baa855c067 f54153d0ae09 2024-09-19T06:57:51.374 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (11m) 9m ago 22m 83.7M 1557M 19.1.1-361-g2f599a46 d2baa855c067 b1778ab88870 2024-09-19T06:57:51.374 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi117 running (11m) 9m ago 22m 102M 2581M 19.1.1-361-g2f599a46 d2baa855c067 ea5236b193d3 2024-09-19T06:57:51.374 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi117 running (10m) 9m ago 21m 93.5M 2581M 19.1.1-361-g2f599a46 d2baa855c067 27ac2c859a68 2024-09-19T06:57:51.374 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi117 running (10m) 9m ago 21m 100M 2581M 19.1.1-361-g2f599a46 d2baa855c067 de6aeb8544ce 2024-09-19T06:57:51.374 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.smithi099 smithi099 *:9095 running (15m) 9m ago 24m 64.4M - 2.43.0 a07b618ecd1d 15ad26ec6fb4 2024-09-19T06:57:51.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.372+0000 7f741f26c640 1 -- 172.21.15.99:0/2995529648 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f740406e530 msgr2=0x7f74040709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:51.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.372+0000 7f741f26c640 1 --2- 172.21.15.99:0/2995529648 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f740406e530 0x7f74040709e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f74180f8f80 tx=0x7f7408035040 comp rx=0 tx=0).stop 2024-09-19T06:57:51.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.372+0000 7f741f26c640 1 -- 172.21.15.99:0/2995529648 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f74180fac80 msgr2=0x7f74181131b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:51.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.372+0000 7f741f26c640 1 --2- 172.21.15.99:0/2995529648 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f74180fac80 0x7f74181131b0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f7414002a50 tx=0x7f7414004600 comp rx=0 tx=0).stop 2024-09-19T06:57:51.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.372+0000 7f741f26c640 1 -- 172.21.15.99:0/2995529648 shutdown_connections 2024-09-19T06:57:51.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.372+0000 7f741f26c640 1 --2- 172.21.15.99:0/2995529648 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f740406e530 0x7f74040709e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:51.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.372+0000 7f741f26c640 1 --2- 172.21.15.99:0/2995529648 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7418102620 0x7f74181136f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:51.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.372+0000 7f741f26c640 1 --2- 172.21.15.99:0/2995529648 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f74180fac80 0x7f74181131b0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:51.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.372+0000 7f741f26c640 1 -- 172.21.15.99:0/2995529648 >> 172.21.15.99:0/2995529648 conn(0x7f7418070ce0 msgr2=0x7f7418100130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:51.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.373+0000 7f741f26c640 1 -- 172.21.15.99:0/2995529648 shutdown_connections 2024-09-19T06:57:51.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.373+0000 7f741f26c640 1 -- 172.21.15.99:0/2995529648 wait complete. 2024-09-19T06:57:51.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.450+0000 7f5e10d70640 1 -- 172.21.15.99:0/4062277413 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e0c0fabe0 msgr2=0x7f5e0c0fb050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:51.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.450+0000 7f5e10d70640 1 --2- 172.21.15.99:0/4062277413 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e0c0fabe0 0x7f5e0c0fb050 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f5e000048d0 tx=0x7f5e00009da0 comp rx=0 tx=0).stop 2024-09-19T06:57:51.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.451+0000 7f5e10d70640 1 -- 172.21.15.99:0/4062277413 shutdown_connections 2024-09-19T06:57:51.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.451+0000 7f5e10d70640 1 --2- 172.21.15.99:0/4062277413 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e0c0fabe0 0x7f5e0c0fb050 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:51.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.451+0000 7f5e10d70640 1 --2- 172.21.15.99:0/4062277413 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e0c0fe4a0 0x7f5e0c0fe870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:51.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.451+0000 7f5e10d70640 1 -- 172.21.15.99:0/4062277413 >> 172.21.15.99:0/4062277413 conn(0x7f5e0c071b00 msgr2=0x7f5e0c071f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:51.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.451+0000 7f5e10d70640 1 -- 172.21.15.99:0/4062277413 shutdown_connections 2024-09-19T06:57:51.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.451+0000 7f5e10d70640 1 -- 172.21.15.99:0/4062277413 wait complete. 2024-09-19T06:57:51.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.451+0000 7f5e10d70640 1 Processor -- start 2024-09-19T06:57:51.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.451+0000 7f5e10d70640 1 -- start start 2024-09-19T06:57:51.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.451+0000 7f5e10d70640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e0c0fabe0 0x7f5e0c113210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:51.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.451+0000 7f5e10d70640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e0c0fe4a0 0x7f5e0c113750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:51.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.452+0000 7f5e10d70640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0c113d50 con 0x7f5e0c0fe4a0 2024-09-19T06:57:51.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.452+0000 7f5e10d70640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0c10d190 con 0x7f5e0c0fabe0 2024-09-19T06:57:51.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.452+0000 7f5e09d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e0c0fe4a0 0x7f5e0c113750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:51.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.452+0000 7f5e09d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e0c0fe4a0 0x7f5e0c113750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47084/0 (socket says 172.21.15.99:47084) 2024-09-19T06:57:51.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.452+0000 7f5e09d9b640 1 -- 172.21.15.99:0/346585030 learned_addr learned my addr 172.21.15.99:0/346585030 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:57:51.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.452+0000 7f5e0a59c640 1 --2- 172.21.15.99:0/346585030 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e0c0fabe0 0x7f5e0c113210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:51.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.452+0000 7f5e09d9b640 1 -- 172.21.15.99:0/346585030 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e0c0fabe0 msgr2=0x7f5e0c113210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:51.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.452+0000 7f5e09d9b640 1 --2- 172.21.15.99:0/346585030 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e0c0fabe0 0x7f5e0c113210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:51.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.452+0000 7f5e09d9b640 1 -- 172.21.15.99:0/346585030 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e00005040 con 0x7f5e0c0fe4a0 2024-09-19T06:57:51.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.452+0000 7f5e09d9b640 1 --2- 172.21.15.99:0/346585030 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e0c0fe4a0 0x7f5e0c113750 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f5e00003080 tx=0x7f5e00009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:51.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.452+0000 7f5dfaffd640 1 -- 172.21.15.99:0/346585030 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e00038070 con 0x7f5e0c0fe4a0 2024-09-19T06:57:51.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.452+0000 7f5dfaffd640 1 -- 172.21.15.99:0/346585030 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5e0002ade0 con 0x7f5e0c0fe4a0 2024-09-19T06:57:51.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.452+0000 7f5e10d70640 1 -- 172.21.15.99:0/346585030 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e0c10d410 con 0x7f5e0c0fe4a0 2024-09-19T06:57:51.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.452+0000 7f5dfaffd640 1 -- 172.21.15.99:0/346585030 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e0002c880 con 0x7f5e0c0fe4a0 2024-09-19T06:57:51.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.452+0000 7f5e10d70640 1 -- 172.21.15.99:0/346585030 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e0c10d8f0 con 0x7f5e0c0fe4a0 2024-09-19T06:57:51.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.453+0000 7f5e10d70640 1 -- 172.21.15.99:0/346585030 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e0c064d50 con 0x7f5e0c0fe4a0 2024-09-19T06:57:51.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.455+0000 7f5dfaffd640 1 -- 172.21.15.99:0/346585030 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f5e00030020 con 0x7f5e0c0fe4a0 2024-09-19T06:57:51.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.455+0000 7f5dfaffd640 1 --2- 172.21.15.99:0/346585030 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f5df406e530 0x7f5df40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:51.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.455+0000 7f5dfaffd640 1 -- 172.21.15.99:0/346585030 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f5e000ae140 con 0x7f5e0c0fe4a0 2024-09-19T06:57:51.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.455+0000 7f5e0a59c640 1 --2- 172.21.15.99:0/346585030 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f5df406e530 0x7f5df40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:51.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.456+0000 7f5e0a59c640 1 --2- 172.21.15.99:0/346585030 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f5df406e530 0x7f5df40709e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc0041d0 tx=0x7f5dfc009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:51.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.460+0000 7f5dfaffd640 1 -- 172.21.15.99:0/346585030 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f5e000772b0 con 0x7f5e0c0fe4a0 2024-09-19T06:57:51.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.691+0000 7f5e10d70640 1 -- 172.21.15.99:0/346585030 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5e0c10e8e0 con 0x7f5e0c0fe4a0 2024-09-19T06:57:51.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.691+0000 7f5dfaffd640 1 -- 172.21.15.99:0/346585030 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f5e0007a970 con 0x7f5e0c0fe4a0 2024-09-19T06:57:51.694 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:57:51.694 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-09-19T06:57:51.694 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T06:57:51.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:57:51.694 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-09-19T06:57:51.694 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T06:57:51.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:57:51.694 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-09-19T06:57:51.694 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 6 2024-09-19T06:57:51.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:57:51.694 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": { 2024-09-19T06:57:51.694 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 4 2024-09-19T06:57:51.695 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:57:51.695 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-09-19T06:57:51.695 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 14 2024-09-19T06:57:51.695 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T06:57:51.695 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:57:51.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.693+0000 7f5e10d70640 1 -- 172.21.15.99:0/346585030 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f5df406e530 msgr2=0x7f5df40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:51.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.693+0000 7f5e10d70640 1 --2- 172.21.15.99:0/346585030 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f5df406e530 0x7f5df40709e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc0041d0 tx=0x7f5dfc009040 comp rx=0 tx=0).stop 2024-09-19T06:57:51.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.693+0000 7f5e10d70640 1 -- 172.21.15.99:0/346585030 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e0c0fe4a0 msgr2=0x7f5e0c113750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:51.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.693+0000 7f5e10d70640 1 --2- 172.21.15.99:0/346585030 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e0c0fe4a0 0x7f5e0c113750 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f5e00003080 tx=0x7f5e00009da0 comp rx=0 tx=0).stop 2024-09-19T06:57:51.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.693+0000 7f5e10d70640 1 -- 172.21.15.99:0/346585030 shutdown_connections 2024-09-19T06:57:51.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.693+0000 7f5e10d70640 1 --2- 172.21.15.99:0/346585030 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f5df406e530 0x7f5df40709e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:51.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.693+0000 7f5e10d70640 1 --2- 172.21.15.99:0/346585030 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e0c0fe4a0 0x7f5e0c113750 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:51.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.693+0000 7f5e10d70640 1 --2- 172.21.15.99:0/346585030 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e0c0fabe0 0x7f5e0c113210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:51.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.693+0000 7f5e10d70640 1 -- 172.21.15.99:0/346585030 >> 172.21.15.99:0/346585030 conn(0x7f5e0c071b00 msgr2=0x7f5e0c101200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:51.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.694+0000 7f5e10d70640 1 -- 172.21.15.99:0/346585030 shutdown_connections 2024-09-19T06:57:51.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.694+0000 7f5e10d70640 1 -- 172.21.15.99:0/346585030 wait complete. 2024-09-19T06:57:51.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.772+0000 7f06ec2c8640 1 -- 172.21.15.99:0/575144894 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06e41014c0 msgr2=0x7f06e4101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:51.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.772+0000 7f06ec2c8640 1 --2- 172.21.15.99:0/575144894 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06e41014c0 0x7f06e4101890 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f06e00048d0 tx=0x7f06e0009da0 comp rx=0 tx=0).stop 2024-09-19T06:57:51.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.772+0000 7f06ec2c8640 1 -- 172.21.15.99:0/575144894 shutdown_connections 2024-09-19T06:57:51.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.772+0000 7f06ec2c8640 1 --2- 172.21.15.99:0/575144894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06e40fb480 0x7f06e40fb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:51.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.772+0000 7f06ec2c8640 1 --2- 172.21.15.99:0/575144894 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06e41014c0 0x7f06e4101890 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:51.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.772+0000 7f06ec2c8640 1 -- 172.21.15.99:0/575144894 >> 172.21.15.99:0/575144894 conn(0x7f06e40f7020 msgr2=0x7f06e40f9430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:51.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.772+0000 7f06ec2c8640 1 -- 172.21.15.99:0/575144894 shutdown_connections 2024-09-19T06:57:51.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.772+0000 7f06ec2c8640 1 -- 172.21.15.99:0/575144894 wait complete. 2024-09-19T06:57:51.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.773+0000 7f06ec2c8640 1 Processor -- start 2024-09-19T06:57:51.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.773+0000 7f06ec2c8640 1 -- start start 2024-09-19T06:57:51.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.773+0000 7f06ec2c8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06e40fb480 0x7f06e41153b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:51.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.773+0000 7f06ec2c8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06e41014c0 0x7f06e41158f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:51.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.773+0000 7f06ec2c8640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e4115ef0 con 0x7f06e40fb480 2024-09-19T06:57:51.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.773+0000 7f06ec2c8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e4116060 con 0x7f06e41014c0 2024-09-19T06:57:51.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.773+0000 7f06ea064640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06e40fb480 0x7f06e41153b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:51.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.773+0000 7f06ea064640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06e40fb480 0x7f06e41153b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47088/0 (socket says 172.21.15.99:47088) 2024-09-19T06:57:51.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.773+0000 7f06ea064640 1 -- 172.21.15.99:0/1445003676 learned_addr learned my addr 172.21.15.99:0/1445003676 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:57:51.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.773+0000 7f06e9863640 1 --2- 172.21.15.99:0/1445003676 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06e41014c0 0x7f06e41158f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:51.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.773+0000 7f06ea064640 1 -- 172.21.15.99:0/1445003676 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06e41014c0 msgr2=0x7f06e41158f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:51.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.773+0000 7f06ea064640 1 --2- 172.21.15.99:0/1445003676 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06e41014c0 0x7f06e41158f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:51.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.773+0000 7f06ea064640 1 -- 172.21.15.99:0/1445003676 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e0005040 con 0x7f06e40fb480 2024-09-19T06:57:51.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.773+0000 7f06ea064640 1 --2- 172.21.15.99:0/1445003676 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06e40fb480 0x7f06e41153b0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f06e0003080 tx=0x7f06e0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:51.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.773+0000 7f06d6ffd640 1 -- 172.21.15.99:0/1445003676 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06e0038070 con 0x7f06e40fb480 2024-09-19T06:57:51.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.774+0000 7f06ec2c8640 1 -- 172.21.15.99:0/1445003676 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06e410f480 con 0x7f06e40fb480 2024-09-19T06:57:51.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.774+0000 7f06d6ffd640 1 -- 172.21.15.99:0/1445003676 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f06e00097e0 con 0x7f06e40fb480 2024-09-19T06:57:51.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.774+0000 7f06d6ffd640 1 -- 172.21.15.99:0/1445003676 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06e003d420 con 0x7f06e40fb480 2024-09-19T06:57:51.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.774+0000 7f06ec2c8640 1 -- 172.21.15.99:0/1445003676 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06e410f9c0 con 0x7f06e40fb480 2024-09-19T06:57:51.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.775+0000 7f06ec2c8640 1 -- 172.21.15.99:0/1445003676 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06e40fcbc0 con 0x7f06e40fb480 2024-09-19T06:57:51.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.775+0000 7f06d6ffd640 1 -- 172.21.15.99:0/1445003676 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f06e0030020 con 0x7f06e40fb480 2024-09-19T06:57:51.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.776+0000 7f06d6ffd640 1 --2- 172.21.15.99:0/1445003676 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f06d006e530 0x7f06d00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:51.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.776+0000 7f06d6ffd640 1 -- 172.21.15.99:0/1445003676 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f06e00ae720 con 0x7f06e40fb480 2024-09-19T06:57:51.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.776+0000 7f06e9863640 1 --2- 172.21.15.99:0/1445003676 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f06d006e530 0x7f06d00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:51.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.776+0000 7f06e9863640 1 --2- 172.21.15.99:0/1445003676 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f06d006e530 0x7f06d00709e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f06e4110cb0 tx=0x7f06d8009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:51.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.780+0000 7f06d6ffd640 1 -- 172.21.15.99:0/1445003676 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f06e0077810 con 0x7f06e40fb480 2024-09-19T06:57:51.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.984+0000 7f06ec2c8640 1 -- 172.21.15.99:0/1445003676 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f06e404b720 con 0x7f06e40fb480 2024-09-19T06:57:51.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.984+0000 7f06d6ffd640 1 -- 172.21.15.99:0/1445003676 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 29 v29) v1 ==== 76+0+1915 (secure 0 0 0) 0x7f06e007aed0 con 0x7f06e40fb480 2024-09-19T06:57:51.986 INFO:teuthology.orchestra.run.smithi099.stdout:e29 2024-09-19T06:57:51.986 INFO:teuthology.orchestra.run.smithi099.stdout:btime 2024-09-19T06:48:47:938420+0000 2024-09-19T06:57:51.986 INFO:teuthology.orchestra.run.smithi099.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T06:57:51.986 INFO:teuthology.orchestra.run.smithi099.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T06:57:51.986 INFO:teuthology.orchestra.run.smithi099.stdout:legacy client fscid: 1 2024-09-19T06:57:51.987 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:57:51.987 INFO:teuthology.orchestra.run.smithi099.stdout:Filesystem 'cephfs' (1) 2024-09-19T06:57:51.987 INFO:teuthology.orchestra.run.smithi099.stdout:fs_name cephfs 2024-09-19T06:57:51.987 INFO:teuthology.orchestra.run.smithi099.stdout:epoch 20 2024-09-19T06:57:51.987 INFO:teuthology.orchestra.run.smithi099.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-19T06:57:51.987 INFO:teuthology.orchestra.run.smithi099.stdout:created 2024-09-19T06:37:40.838146+0000 2024-09-19T06:57:51.987 INFO:teuthology.orchestra.run.smithi099.stdout:modified 2024-09-19T06:47:50.076553+0000 2024-09-19T06:57:51.987 INFO:teuthology.orchestra.run.smithi099.stdout:tableserver 0 2024-09-19T06:57:51.987 INFO:teuthology.orchestra.run.smithi099.stdout:root 0 2024-09-19T06:57:51.987 INFO:teuthology.orchestra.run.smithi099.stdout:session_timeout 60 2024-09-19T06:57:51.988 INFO:teuthology.orchestra.run.smithi099.stdout:session_autoclose 300 2024-09-19T06:57:51.988 INFO:teuthology.orchestra.run.smithi099.stdout:max_file_size 1099511627776 2024-09-19T06:57:51.988 INFO:teuthology.orchestra.run.smithi099.stdout:max_xattr_size 65536 2024-09-19T06:57:51.988 INFO:teuthology.orchestra.run.smithi099.stdout:required_client_features {} 2024-09-19T06:57:51.988 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure 0 2024-09-19T06:57:51.988 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure_osd_epoch 77 2024-09-19T06:57:51.988 INFO:teuthology.orchestra.run.smithi099.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T06:57:51.988 INFO:teuthology.orchestra.run.smithi099.stdout:max_mds 2 2024-09-19T06:57:51.988 INFO:teuthology.orchestra.run.smithi099.stdout:in 0,1 2024-09-19T06:57:51.989 INFO:teuthology.orchestra.run.smithi099.stdout:up {} 2024-09-19T06:57:51.989 INFO:teuthology.orchestra.run.smithi099.stdout:failed 0,1 2024-09-19T06:57:51.989 INFO:teuthology.orchestra.run.smithi099.stdout:damaged 2024-09-19T06:57:51.989 INFO:teuthology.orchestra.run.smithi099.stdout:stopped 2024-09-19T06:57:51.989 INFO:teuthology.orchestra.run.smithi099.stdout:data_pools [3] 2024-09-19T06:57:51.989 INFO:teuthology.orchestra.run.smithi099.stdout:metadata_pool 2 2024-09-19T06:57:51.989 INFO:teuthology.orchestra.run.smithi099.stdout:inline_data disabled 2024-09-19T06:57:51.989 INFO:teuthology.orchestra.run.smithi099.stdout:balancer 2024-09-19T06:57:51.989 INFO:teuthology.orchestra.run.smithi099.stdout:bal_rank_mask -1 2024-09-19T06:57:51.989 INFO:teuthology.orchestra.run.smithi099.stdout:standby_count_wanted 1 2024-09-19T06:57:51.989 INFO:teuthology.orchestra.run.smithi099.stdout:qdb_cluster leader: 0 members: 2024-09-19T06:57:51.989 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:57:51.989 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:57:51.990 INFO:teuthology.orchestra.run.smithi099.stdout:Standby daemons: 2024-09-19T06:57:51.990 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:57:51.990 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.obarqf{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6826/1859154203,v1:172.21.15.99:6827/1859154203] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:57:51.990 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.xehbxe{-1:34410} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6828/1939453719,v1:172.21.15.99:6829/1939453719] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:57:51.990 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.nooexo{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6824/1398895079,v1:172.21.15.117:6825/1398895079] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:57:51.990 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.bheqzh{-1:44329} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6826/3233337308,v1:172.21.15.117:6827/3233337308] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:57:51.991 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 29 2024-09-19T06:57:51.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.986+0000 7f06ec2c8640 1 -- 172.21.15.99:0/1445003676 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f06d006e530 msgr2=0x7f06d00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:51.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.986+0000 7f06ec2c8640 1 --2- 172.21.15.99:0/1445003676 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f06d006e530 0x7f06d00709e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f06e4110cb0 tx=0x7f06d8009040 comp rx=0 tx=0).stop 2024-09-19T06:57:51.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.986+0000 7f06ec2c8640 1 -- 172.21.15.99:0/1445003676 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06e40fb480 msgr2=0x7f06e41153b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:51.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.986+0000 7f06ec2c8640 1 --2- 172.21.15.99:0/1445003676 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06e40fb480 0x7f06e41153b0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f06e0003080 tx=0x7f06e0009da0 comp rx=0 tx=0).stop 2024-09-19T06:57:51.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.986+0000 7f06ec2c8640 1 -- 172.21.15.99:0/1445003676 shutdown_connections 2024-09-19T06:57:51.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.986+0000 7f06ec2c8640 1 --2- 172.21.15.99:0/1445003676 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f06d006e530 0x7f06d00709e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:51.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.986+0000 7f06ec2c8640 1 --2- 172.21.15.99:0/1445003676 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06e41014c0 0x7f06e41158f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:51.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.986+0000 7f06ec2c8640 1 --2- 172.21.15.99:0/1445003676 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06e40fb480 0x7f06e41153b0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:51.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.987+0000 7f06ec2c8640 1 -- 172.21.15.99:0/1445003676 >> 172.21.15.99:0/1445003676 conn(0x7f06e40f7020 msgr2=0x7f06e4065a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:51.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.987+0000 7f06ec2c8640 1 -- 172.21.15.99:0/1445003676 shutdown_connections 2024-09-19T06:57:51.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:51.987+0000 7f06ec2c8640 1 -- 172.21.15.99:0/1445003676 wait complete. 2024-09-19T06:57:52.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.066+0000 7fdfbd77d640 1 -- 172.21.15.99:0/865828051 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdfb80fe460 msgr2=0x7fdfb80fe830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:52.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.066+0000 7fdfbd77d640 1 --2- 172.21.15.99:0/865828051 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdfb80fe460 0x7fdfb80fe830 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fdfa80048d0 tx=0x7fdfa8009da0 comp rx=0 tx=0).stop 2024-09-19T06:57:52.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.066+0000 7fdfbd77d640 1 -- 172.21.15.99:0/865828051 shutdown_connections 2024-09-19T06:57:52.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.066+0000 7fdfbd77d640 1 --2- 172.21.15.99:0/865828051 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdfb8064fc0 0x7fdfb8065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:52.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.066+0000 7fdfbd77d640 1 --2- 172.21.15.99:0/865828051 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdfb80fe460 0x7fdfb80fe830 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:52.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.067+0000 7fdfbd77d640 1 -- 172.21.15.99:0/865828051 >> 172.21.15.99:0/865828051 conn(0x7fdfb80723b0 msgr2=0x7fdfb80727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:52.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.067+0000 7fdfbd77d640 1 -- 172.21.15.99:0/865828051 shutdown_connections 2024-09-19T06:57:52.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.067+0000 7fdfbd77d640 1 -- 172.21.15.99:0/865828051 wait complete. 2024-09-19T06:57:52.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.067+0000 7fdfbd77d640 1 Processor -- start 2024-09-19T06:57:52.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.067+0000 7fdfbd77d640 1 -- start start 2024-09-19T06:57:52.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.068+0000 7fdfbd77d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdfb8064fc0 0x7fdfb8113190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:52.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.068+0000 7fdfbd77d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdfb80fe460 0x7fdfb81136d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:52.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.068+0000 7fdfbd77d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb8113cd0 con 0x7fdfb80fe460 2024-09-19T06:57:52.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.068+0000 7fdfbd77d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb810d110 con 0x7fdfb8064fc0 2024-09-19T06:57:52.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.068+0000 7fdfb67fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdfb80fe460 0x7fdfb81136d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:52.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.068+0000 7fdfb67fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdfb80fe460 0x7fdfb81136d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47100/0 (socket says 172.21.15.99:47100) 2024-09-19T06:57:52.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.068+0000 7fdfb67fc640 1 -- 172.21.15.99:0/4144948433 learned_addr learned my addr 172.21.15.99:0/4144948433 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:57:52.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.068+0000 7fdfb6ffd640 1 --2- 172.21.15.99:0/4144948433 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdfb8064fc0 0x7fdfb8113190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:52.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.068+0000 7fdfb67fc640 1 -- 172.21.15.99:0/4144948433 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdfb8064fc0 msgr2=0x7fdfb8113190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:52.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.068+0000 7fdfb67fc640 1 --2- 172.21.15.99:0/4144948433 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdfb8064fc0 0x7fdfb8113190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:52.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.068+0000 7fdfb67fc640 1 -- 172.21.15.99:0/4144948433 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfa8005040 con 0x7fdfb80fe460 2024-09-19T06:57:52.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.068+0000 7fdfb67fc640 1 --2- 172.21.15.99:0/4144948433 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdfb80fe460 0x7fdfb81136d0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fdfac002a50 tx=0x7fdfac004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:52.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.068+0000 7fdf9f7fe640 1 -- 172.21.15.99:0/4144948433 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdfac007c30 con 0x7fdfb80fe460 2024-09-19T06:57:52.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.069+0000 7fdfbd77d640 1 -- 172.21.15.99:0/4144948433 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfb810d3f0 con 0x7fdfb80fe460 2024-09-19T06:57:52.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.069+0000 7fdf9f7fe640 1 -- 172.21.15.99:0/4144948433 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fdfac00f040 con 0x7fdfb80fe460 2024-09-19T06:57:52.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.069+0000 7fdf9f7fe640 1 -- 172.21.15.99:0/4144948433 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdfac00db50 con 0x7fdfb80fe460 2024-09-19T06:57:52.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.069+0000 7fdfbd77d640 1 -- 172.21.15.99:0/4144948433 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfb810d990 con 0x7fdfb80fe460 2024-09-19T06:57:52.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.070+0000 7fdfbd77d640 1 -- 172.21.15.99:0/4144948433 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfb80fdcf0 con 0x7fdfb80fe460 2024-09-19T06:57:52.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.070+0000 7fdf9f7fe640 1 -- 172.21.15.99:0/4144948433 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fdfac00dcb0 con 0x7fdfb80fe460 2024-09-19T06:57:52.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.071+0000 7fdf9f7fe640 1 --2- 172.21.15.99:0/4144948433 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fdfa006e530 0x7fdfa00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:52.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.071+0000 7fdf9f7fe640 1 -- 172.21.15.99:0/4144948433 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fdfac08e110 con 0x7fdfb80fe460 2024-09-19T06:57:52.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.071+0000 7fdfb6ffd640 1 --2- 172.21.15.99:0/4144948433 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fdfa006e530 0x7fdfa00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:52.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.072+0000 7fdfb6ffd640 1 --2- 172.21.15.99:0/4144948433 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fdfa006e530 0x7fdfa00709e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fdfa8009ac0 tx=0x7fdfa8035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:52.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.075+0000 7fdf9f7fe640 1 -- 172.21.15.99:0/4144948433 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fdfac057200 con 0x7fdfb80fe460 2024-09-19T06:57:52.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.265+0000 7fdfbd77d640 1 -- 172.21.15.99:0/4144948433 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdfb810e800 con 0x7fdfa006e530 2024-09-19T06:57:52.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.266+0000 7fdf9f7fe640 1 -- 172.21.15.99:0/4144948433 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fdfb810e800 con 0x7fdfa006e530 2024-09-19T06:57:52.267 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:57:52.267 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T06:57:52.268 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": true, 2024-09-19T06:57:52.268 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T06:57:52.268 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [ 2024-09-19T06:57:52.268 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr", 2024-09-19T06:57:52.268 INFO:teuthology.orchestra.run.smithi099.stdout: "crash", 2024-09-19T06:57:52.268 INFO:teuthology.orchestra.run.smithi099.stdout: "mds", 2024-09-19T06:57:52.268 INFO:teuthology.orchestra.run.smithi099.stdout: "mon", 2024-09-19T06:57:52.268 INFO:teuthology.orchestra.run.smithi099.stdout: "osd" 2024-09-19T06:57:52.268 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-19T06:57:52.268 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": "16/21 daemons upgraded", 2024-09-19T06:57:52.269 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "Currently upgrading mds daemons", 2024-09-19T06:57:52.269 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-09-19T06:57:52.269 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:57:52.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.268+0000 7fdfbd77d640 1 -- 172.21.15.99:0/4144948433 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fdfa006e530 msgr2=0x7fdfa00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:52.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.268+0000 7fdfbd77d640 1 --2- 172.21.15.99:0/4144948433 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fdfa006e530 0x7fdfa00709e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fdfa8009ac0 tx=0x7fdfa8035040 comp rx=0 tx=0).stop 2024-09-19T06:57:52.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.268+0000 7fdfbd77d640 1 -- 172.21.15.99:0/4144948433 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdfb80fe460 msgr2=0x7fdfb81136d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:52.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.268+0000 7fdfbd77d640 1 --2- 172.21.15.99:0/4144948433 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdfb80fe460 0x7fdfb81136d0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fdfac002a50 tx=0x7fdfac004600 comp rx=0 tx=0).stop 2024-09-19T06:57:52.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.269+0000 7fdfbd77d640 1 -- 172.21.15.99:0/4144948433 shutdown_connections 2024-09-19T06:57:52.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.269+0000 7fdfbd77d640 1 --2- 172.21.15.99:0/4144948433 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fdfa006e530 0x7fdfa00709e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:52.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.269+0000 7fdfbd77d640 1 --2- 172.21.15.99:0/4144948433 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdfb80fe460 0x7fdfb81136d0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:52.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.269+0000 7fdfbd77d640 1 --2- 172.21.15.99:0/4144948433 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdfb8064fc0 0x7fdfb8113190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:52.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.269+0000 7fdfbd77d640 1 -- 172.21.15.99:0/4144948433 >> 172.21.15.99:0/4144948433 conn(0x7fdfb80723b0 msgr2=0x7fdfb8105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:52.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.269+0000 7fdfbd77d640 1 -- 172.21.15.99:0/4144948433 shutdown_connections 2024-09-19T06:57:52.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.269+0000 7fdfbd77d640 1 -- 172.21.15.99:0/4144948433 wait complete. 2024-09-19T06:57:52.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.347+0000 7f06d3708640 1 -- 172.21.15.99:0/3964712156 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06cc102620 msgr2=0x7f06cc1029f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:52.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.347+0000 7f06d3708640 1 --2- 172.21.15.99:0/3964712156 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06cc102620 0x7f06cc1029f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f06c40048d0 tx=0x7f06c4009da0 comp rx=0 tx=0).stop 2024-09-19T06:57:52.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.347+0000 7f06d3708640 1 -- 172.21.15.99:0/3964712156 shutdown_connections 2024-09-19T06:57:52.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.347+0000 7f06d3708640 1 --2- 172.21.15.99:0/3964712156 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06cc0fac80 0x7f06cc0fb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:52.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.347+0000 7f06d3708640 1 --2- 172.21.15.99:0/3964712156 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06cc102620 0x7f06cc1029f0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:52.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.347+0000 7f06d3708640 1 -- 172.21.15.99:0/3964712156 >> 172.21.15.99:0/3964712156 conn(0x7f06cc070ce0 msgr2=0x7f06cc0710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:52.349 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:57:52 smithi099 ceph-mon[97031]: from='client.34894 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:57:52.349 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:57:52 smithi099 ceph-mon[97031]: pgmap v465: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:57:52.349 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:57:52 smithi099 ceph-mon[97031]: from='client.34898 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:57:52.349 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:57:52 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/346585030' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:57:52.350 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:57:52 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:57:52.350 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:57:52 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/1445003676' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:57:52.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.348+0000 7f06d3708640 1 -- 172.21.15.99:0/3964712156 shutdown_connections 2024-09-19T06:57:52.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.348+0000 7f06d3708640 1 -- 172.21.15.99:0/3964712156 wait complete. 2024-09-19T06:57:52.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.348+0000 7f06d3708640 1 Processor -- start 2024-09-19T06:57:52.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.348+0000 7f06d3708640 1 -- start start 2024-09-19T06:57:52.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.348+0000 7f06d3708640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06cc0fac80 0x7f06cc1131c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:52.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.348+0000 7f06d3708640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06cc102620 0x7f06cc113700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:52.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.348+0000 7f06d3708640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06cc113d00 con 0x7f06cc102620 2024-09-19T06:57:52.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.348+0000 7f06d3708640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06cc10d140 con 0x7f06cc0fac80 2024-09-19T06:57:52.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.348+0000 7f06d0ca3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06cc102620 0x7f06cc113700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:52.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.348+0000 7f06d0ca3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06cc102620 0x7f06cc113700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47116/0 (socket says 172.21.15.99:47116) 2024-09-19T06:57:52.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.348+0000 7f06d0ca3640 1 -- 172.21.15.99:0/3293669104 learned_addr learned my addr 172.21.15.99:0/3293669104 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:57:52.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.348+0000 7f06d14a4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06cc0fac80 0x7f06cc1131c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:52.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.349+0000 7f06d0ca3640 1 -- 172.21.15.99:0/3293669104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06cc0fac80 msgr2=0x7f06cc1131c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:52.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.349+0000 7f06d0ca3640 1 --2- 172.21.15.99:0/3293669104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06cc0fac80 0x7f06cc1131c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:52.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.349+0000 7f06d0ca3640 1 -- 172.21.15.99:0/3293669104 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c4005040 con 0x7f06cc102620 2024-09-19T06:57:52.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.349+0000 7f06d0ca3640 1 --2- 172.21.15.99:0/3293669104 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06cc102620 0x7f06cc113700 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f06c000db00 tx=0x7f06c0004e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:52.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.349+0000 7f06c9ffb640 1 -- 172.21.15.99:0/3293669104 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06c0017070 con 0x7f06cc102620 2024-09-19T06:57:52.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.349+0000 7f06c9ffb640 1 -- 172.21.15.99:0/3293669104 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f06c000f040 con 0x7f06cc102620 2024-09-19T06:57:52.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.349+0000 7f06d3708640 1 -- 172.21.15.99:0/3293669104 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06cc10d420 con 0x7f06cc102620 2024-09-19T06:57:52.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.349+0000 7f06c9ffb640 1 -- 172.21.15.99:0/3293669104 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06c0003960 con 0x7f06cc102620 2024-09-19T06:57:52.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.349+0000 7f06d3708640 1 -- 172.21.15.99:0/3293669104 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06cc10d9c0 con 0x7f06cc102620 2024-09-19T06:57:52.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.350+0000 7f06d3708640 1 -- 172.21.15.99:0/3293669104 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06cc0657b0 con 0x7f06cc102620 2024-09-19T06:57:52.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.351+0000 7f06c9ffb640 1 -- 172.21.15.99:0/3293669104 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f06c000b890 con 0x7f06cc102620 2024-09-19T06:57:52.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.351+0000 7f06c9ffb640 1 --2- 172.21.15.99:0/3293669104 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f06b406e530 0x7f06b40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:57:52.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.351+0000 7f06c9ffb640 1 -- 172.21.15.99:0/3293669104 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f06c008e0e0 con 0x7f06cc102620 2024-09-19T06:57:52.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.351+0000 7f06d14a4640 1 --2- 172.21.15.99:0/3293669104 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f06b406e530 0x7f06b40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:57:52.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.352+0000 7f06d14a4640 1 --2- 172.21.15.99:0/3293669104 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f06b406e530 0x7f06b40709e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f06c4009ac0 tx=0x7f06c4035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:57:52.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.356+0000 7f06c9ffb640 1 -- 172.21.15.99:0/3293669104 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f06c0057250 con 0x7f06cc102620 2024-09-19T06:57:52.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:57:52 smithi117 ceph-mon[76771]: from='client.34894 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:57:52.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:57:52 smithi117 ceph-mon[76771]: pgmap v465: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:57:52.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:57:52 smithi117 ceph-mon[76771]: from='client.34898 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:57:52.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:57:52 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/346585030' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:57:52.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:57:52 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:57:52.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:57:52 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/1445003676' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:57:52.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.584+0000 7f06d3708640 1 -- 172.21.15.99:0/3293669104 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f06cc109590 con 0x7f06cc102620 2024-09-19T06:57:52.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.584+0000 7f06c9ffb640 1 -- 172.21.15.99:0/3293669104 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7f06c005a910 con 0x7f06cc102620 2024-09-19T06:57:52.585 INFO:teuthology.orchestra.run.smithi099.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-09-19T06:57:52.585 INFO:teuthology.orchestra.run.smithi099.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-19T06:57:52.585 INFO:teuthology.orchestra.run.smithi099.stdout: fs cephfs is degraded 2024-09-19T06:57:52.585 INFO:teuthology.orchestra.run.smithi099.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-19T06:57:52.586 INFO:teuthology.orchestra.run.smithi099.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-19T06:57:52.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.586+0000 7f06d3708640 1 -- 172.21.15.99:0/3293669104 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f06b406e530 msgr2=0x7f06b40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:52.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.586+0000 7f06d3708640 1 --2- 172.21.15.99:0/3293669104 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f06b406e530 0x7f06b40709e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f06c4009ac0 tx=0x7f06c4035040 comp rx=0 tx=0).stop 2024-09-19T06:57:52.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.586+0000 7f06d3708640 1 -- 172.21.15.99:0/3293669104 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06cc102620 msgr2=0x7f06cc113700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:57:52.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.586+0000 7f06d3708640 1 --2- 172.21.15.99:0/3293669104 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06cc102620 0x7f06cc113700 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f06c000db00 tx=0x7f06c0004e60 comp rx=0 tx=0).stop 2024-09-19T06:57:52.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.586+0000 7f06d3708640 1 -- 172.21.15.99:0/3293669104 shutdown_connections 2024-09-19T06:57:52.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.586+0000 7f06d3708640 1 --2- 172.21.15.99:0/3293669104 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f06b406e530 0x7f06b40709e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:52.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.586+0000 7f06d3708640 1 --2- 172.21.15.99:0/3293669104 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f06cc102620 0x7f06cc113700 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:52.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.586+0000 7f06d3708640 1 --2- 172.21.15.99:0/3293669104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06cc0fac80 0x7f06cc1131c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:57:52.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.586+0000 7f06d3708640 1 -- 172.21.15.99:0/3293669104 >> 172.21.15.99:0/3293669104 conn(0x7f06cc070ce0 msgr2=0x7f06cc105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:57:52.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.586+0000 7f06d3708640 1 -- 172.21.15.99:0/3293669104 shutdown_connections 2024-09-19T06:57:52.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:57:52.586+0000 7f06d3708640 1 -- 172.21.15.99:0/3293669104 wait complete. 2024-09-19T06:57:53.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:57:53 smithi099 ceph-mon[97031]: from='client.34902 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:57:53.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:57:53 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/3293669104' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T06:57:53.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:57:53 smithi117 ceph-mon[76771]: from='client.34902 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:57:53.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:57:53 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/3293669104' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T06:57:54.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:57:54 smithi099 ceph-mon[97031]: from='client.34914 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:57:54.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:57:54 smithi099 ceph-mon[97031]: pgmap v466: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:57:54.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:57:54 smithi117 ceph-mon[76771]: from='client.34914 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:57:54.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:57:54 smithi117 ceph-mon[76771]: pgmap v466: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:57:56.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:57:56 smithi099 ceph-mon[97031]: pgmap v467: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:57:56.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:57:56 smithi117 ceph-mon[76771]: pgmap v467: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:57:57.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:57:57 smithi099 ceph-mon[97031]: pgmap v468: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:57:57.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:57:57 smithi117 ceph-mon[76771]: pgmap v468: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:58:00.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:58:00 smithi099 ceph-mon[97031]: pgmap v469: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:58:00.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:58:00 smithi117 ceph-mon[76771]: pgmap v469: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:58:02.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:58:02 smithi099 ceph-mon[97031]: pgmap v470: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:58:02.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:58:02 smithi117 ceph-mon[76771]: pgmap v470: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:58:04.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:58:04 smithi099 ceph-mon[97031]: pgmap v471: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:58:04.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:58:04 smithi117 ceph-mon[76771]: pgmap v471: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:58:06.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:58:06 smithi099 ceph-mon[97031]: pgmap v472: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:58:06.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:58:06 smithi117 ceph-mon[76771]: pgmap v472: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:58:07.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:58:07 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:58:07.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:58:07 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:58:08.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:58:08 smithi099 ceph-mon[97031]: pgmap v473: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:58:08.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:58:08 smithi117 ceph-mon[76771]: pgmap v473: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:58:10.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:58:10 smithi099 ceph-mon[97031]: pgmap v474: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:58:10.565 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:58:10 smithi117 ceph-mon[76771]: pgmap v474: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:58:12.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:58:12 smithi099 ceph-mon[97031]: pgmap v475: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:58:12.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:58:12 smithi117 ceph-mon[76771]: pgmap v475: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:58:14.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:58:14 smithi099 ceph-mon[97031]: pgmap v476: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:58:14.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:58:14 smithi117 ceph-mon[76771]: pgmap v476: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:58:16.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:58:16 smithi099 ceph-mon[97031]: pgmap v477: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:58:16.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:58:16 smithi117 ceph-mon[76771]: pgmap v477: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:58:18.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:58:18 smithi099 ceph-mon[97031]: pgmap v478: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:58:18.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:58:18 smithi117 ceph-mon[76771]: pgmap v478: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:58:20.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:58:20 smithi099 ceph-mon[97031]: pgmap v479: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:58:20.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:58:20 smithi117 ceph-mon[76771]: pgmap v479: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:58:22.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:58:22 smithi099 ceph-mon[97031]: pgmap v480: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:58:22.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:58:22 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:58:22.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:58:22 smithi117 ceph-mon[76771]: pgmap v480: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:58:22.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:58:22 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:58:22.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.677+0000 7fc72d62b640 1 -- 172.21.15.99:0/1364220773 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc72806fa30 msgr2=0x7fc72806fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:22.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.677+0000 7fc72d62b640 1 --2- 172.21.15.99:0/1364220773 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc72806fa30 0x7fc72806fe00 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fc7180048d0 tx=0x7fc718009da0 comp rx=0 tx=0).stop 2024-09-19T06:58:22.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.677+0000 7fc72d62b640 1 -- 172.21.15.99:0/1364220773 shutdown_connections 2024-09-19T06:58:22.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.677+0000 7fc72d62b640 1 --2- 172.21.15.99:0/1364220773 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc728070340 0x7fc728108910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:22.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.677+0000 7fc72d62b640 1 --2- 172.21.15.99:0/1364220773 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc72806fa30 0x7fc72806fe00 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:22.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.677+0000 7fc72d62b640 1 -- 172.21.15.99:0/1364220773 >> 172.21.15.99:0/1364220773 conn(0x7fc7280f80f0 msgr2=0x7fc7280fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:58:22.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.677+0000 7fc72d62b640 1 -- 172.21.15.99:0/1364220773 shutdown_connections 2024-09-19T06:58:22.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.677+0000 7fc72d62b640 1 -- 172.21.15.99:0/1364220773 wait complete. 2024-09-19T06:58:22.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.678+0000 7fc72d62b640 1 Processor -- start 2024-09-19T06:58:22.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.678+0000 7fc72d62b640 1 -- start start 2024-09-19T06:58:22.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.678+0000 7fc72d62b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc72806fa30 0x7fc728115730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:22.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.678+0000 7fc72d62b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc728070340 0x7fc728115c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:22.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.678+0000 7fc72d62b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7281162c0 con 0x7fc72806fa30 2024-09-19T06:58:22.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.678+0000 7fc72d62b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc72810f6d0 con 0x7fc728070340 2024-09-19T06:58:22.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.679+0000 7fc726ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc72806fa30 0x7fc728115730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:22.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.679+0000 7fc726ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc72806fa30 0x7fc728115730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34006/0 (socket says 172.21.15.99:34006) 2024-09-19T06:58:22.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.679+0000 7fc726ffd640 1 -- 172.21.15.99:0/368871258 learned_addr learned my addr 172.21.15.99:0/368871258 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:58:22.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.679+0000 7fc71e7fc640 1 --2- 172.21.15.99:0/368871258 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc728070340 0x7fc728115c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:22.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.679+0000 7fc726ffd640 1 -- 172.21.15.99:0/368871258 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc728070340 msgr2=0x7fc728115c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:22.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.679+0000 7fc726ffd640 1 --2- 172.21.15.99:0/368871258 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc728070340 0x7fc728115c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:22.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.679+0000 7fc726ffd640 1 -- 172.21.15.99:0/368871258 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc718005040 con 0x7fc72806fa30 2024-09-19T06:58:22.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.679+0000 7fc726ffd640 1 --2- 172.21.15.99:0/368871258 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc72806fa30 0x7fc728115730 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fc7180043d0 tx=0x7fc718009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:22.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.679+0000 7fc71ffff640 1 -- 172.21.15.99:0/368871258 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc718038070 con 0x7fc72806fa30 2024-09-19T06:58:22.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.679+0000 7fc71ffff640 1 -- 172.21.15.99:0/368871258 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc7180096e0 con 0x7fc72806fa30 2024-09-19T06:58:22.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.679+0000 7fc72d62b640 1 -- 172.21.15.99:0/368871258 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc72810f950 con 0x7fc72806fa30 2024-09-19T06:58:22.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.679+0000 7fc71ffff640 1 -- 172.21.15.99:0/368871258 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc71803d420 con 0x7fc72806fa30 2024-09-19T06:58:22.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.679+0000 7fc72d62b640 1 -- 172.21.15.99:0/368871258 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc72810fe70 con 0x7fc72806fa30 2024-09-19T06:58:22.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.680+0000 7fc72d62b640 1 -- 172.21.15.99:0/368871258 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc728071170 con 0x7fc72806fa30 2024-09-19T06:58:22.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.681+0000 7fc71ffff640 1 -- 172.21.15.99:0/368871258 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fc718030020 con 0x7fc72806fa30 2024-09-19T06:58:22.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.681+0000 7fc71ffff640 1 --2- 172.21.15.99:0/368871258 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fc71406e530 0x7fc7140709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:22.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.682+0000 7fc71ffff640 1 -- 172.21.15.99:0/368871258 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fc7180ae5f0 con 0x7fc72806fa30 2024-09-19T06:58:22.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.682+0000 7fc71e7fc640 1 --2- 172.21.15.99:0/368871258 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fc71406e530 0x7fc7140709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:22.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.682+0000 7fc71e7fc640 1 --2- 172.21.15.99:0/368871258 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fc71406e530 0x7fc7140709e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc7281109b0 tx=0x7fc71000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:22.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.686+0000 7fc71ffff640 1 -- 172.21.15.99:0/368871258 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fc7180776e0 con 0x7fc72806fa30 2024-09-19T06:58:22.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.869+0000 7fc72d62b640 1 -- 172.21.15.99:0/368871258 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc72810b760 con 0x7fc71406e530 2024-09-19T06:58:22.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.870+0000 7fc71ffff640 1 -- 172.21.15.99:0/368871258 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fc72810b760 con 0x7fc71406e530 2024-09-19T06:58:22.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.872+0000 7fc72d62b640 1 -- 172.21.15.99:0/368871258 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fc71406e530 msgr2=0x7fc7140709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:22.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.872+0000 7fc72d62b640 1 --2- 172.21.15.99:0/368871258 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fc71406e530 0x7fc7140709e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc7281109b0 tx=0x7fc71000b040 comp rx=0 tx=0).stop 2024-09-19T06:58:22.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.872+0000 7fc72d62b640 1 -- 172.21.15.99:0/368871258 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc72806fa30 msgr2=0x7fc728115730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:22.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.872+0000 7fc72d62b640 1 --2- 172.21.15.99:0/368871258 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc72806fa30 0x7fc728115730 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fc7180043d0 tx=0x7fc718009da0 comp rx=0 tx=0).stop 2024-09-19T06:58:22.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.872+0000 7fc72d62b640 1 -- 172.21.15.99:0/368871258 shutdown_connections 2024-09-19T06:58:22.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.872+0000 7fc72d62b640 1 --2- 172.21.15.99:0/368871258 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fc71406e530 0x7fc7140709e0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:22.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.872+0000 7fc72d62b640 1 --2- 172.21.15.99:0/368871258 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc728070340 0x7fc728115c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:22.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.872+0000 7fc72d62b640 1 --2- 172.21.15.99:0/368871258 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc72806fa30 0x7fc728115730 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:22.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.872+0000 7fc72d62b640 1 -- 172.21.15.99:0/368871258 >> 172.21.15.99:0/368871258 conn(0x7fc7280f80f0 msgr2=0x7fc7280f96c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:58:22.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.873+0000 7fc72d62b640 1 -- 172.21.15.99:0/368871258 shutdown_connections 2024-09-19T06:58:22.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.873+0000 7fc72d62b640 1 -- 172.21.15.99:0/368871258 wait complete. 2024-09-19T06:58:22.883 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-09-19T06:58:22.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.952+0000 7f2bb8125640 1 -- 172.21.15.99:0/2910232263 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2bb00fb480 msgr2=0x7f2bb00fb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:22.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.952+0000 7f2bb8125640 1 --2- 172.21.15.99:0/2910232263 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2bb00fb480 0x7f2bb00fb8f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f2ba00048d0 tx=0x7f2ba0009da0 comp rx=0 tx=0).stop 2024-09-19T06:58:22.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.952+0000 7f2bb8125640 1 -- 172.21.15.99:0/2910232263 shutdown_connections 2024-09-19T06:58:22.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.952+0000 7f2bb8125640 1 --2- 172.21.15.99:0/2910232263 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2bb00fb480 0x7f2bb00fb8f0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:22.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.952+0000 7f2bb8125640 1 --2- 172.21.15.99:0/2910232263 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2bb01014c0 0x7f2bb0101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:22.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.952+0000 7f2bb8125640 1 -- 172.21.15.99:0/2910232263 >> 172.21.15.99:0/2910232263 conn(0x7f2bb00f7000 msgr2=0x7f2bb00f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:58:22.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.952+0000 7f2bb8125640 1 -- 172.21.15.99:0/2910232263 shutdown_connections 2024-09-19T06:58:22.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.952+0000 7f2bb8125640 1 -- 172.21.15.99:0/2910232263 wait complete. 2024-09-19T06:58:22.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.953+0000 7f2bb8125640 1 Processor -- start 2024-09-19T06:58:22.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.953+0000 7f2bb8125640 1 -- start start 2024-09-19T06:58:22.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.953+0000 7f2bb8125640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2bb00fb480 0x7f2bb0115430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:22.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.953+0000 7f2bb8125640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2bb01014c0 0x7f2bb0115970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:22.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.953+0000 7f2bb8125640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb0115f70 con 0x7f2bb00fb480 2024-09-19T06:58:22.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.953+0000 7f2bb8125640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb01160e0 con 0x7f2bb01014c0 2024-09-19T06:58:22.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.953+0000 7f2bb5ec1640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2bb00fb480 0x7f2bb0115430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:22.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.953+0000 7f2bb5ec1640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2bb00fb480 0x7f2bb0115430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34020/0 (socket says 172.21.15.99:34020) 2024-09-19T06:58:22.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.953+0000 7f2bb5ec1640 1 -- 172.21.15.99:0/3129438640 learned_addr learned my addr 172.21.15.99:0/3129438640 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:58:22.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.953+0000 7f2bb56c0640 1 --2- 172.21.15.99:0/3129438640 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2bb01014c0 0x7f2bb0115970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:22.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.953+0000 7f2bb5ec1640 1 -- 172.21.15.99:0/3129438640 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2bb01014c0 msgr2=0x7f2bb0115970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:22.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.953+0000 7f2bb5ec1640 1 --2- 172.21.15.99:0/3129438640 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2bb01014c0 0x7f2bb0115970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:22.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.953+0000 7f2bb5ec1640 1 -- 172.21.15.99:0/3129438640 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba0005040 con 0x7f2bb00fb480 2024-09-19T06:58:22.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.954+0000 7f2bb5ec1640 1 --2- 172.21.15.99:0/3129438640 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2bb00fb480 0x7f2bb0115430 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f2bac00eb70 tx=0x7f2bac00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:22.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.954+0000 7f2ba67fc640 1 -- 172.21.15.99:0/3129438640 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2bac007c30 con 0x7f2bb00fb480 2024-09-19T06:58:22.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.954+0000 7f2ba67fc640 1 -- 172.21.15.99:0/3129438640 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2bac00f040 con 0x7f2bb00fb480 2024-09-19T06:58:22.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.954+0000 7f2bb8125640 1 -- 172.21.15.99:0/3129438640 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bb010f500 con 0x7f2bb00fb480 2024-09-19T06:58:22.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.954+0000 7f2ba67fc640 1 -- 172.21.15.99:0/3129438640 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2bac00ca60 con 0x7f2bb00fb480 2024-09-19T06:58:22.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.954+0000 7f2bb8125640 1 -- 172.21.15.99:0/3129438640 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bb010fa20 con 0x7f2bb00fb480 2024-09-19T06:58:22.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.955+0000 7f2bb8125640 1 -- 172.21.15.99:0/3129438640 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bb00fcbc0 con 0x7f2bb00fb480 2024-09-19T06:58:22.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.955+0000 7f2ba67fc640 1 -- 172.21.15.99:0/3129438640 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f2bac00cbc0 con 0x7f2bb00fb480 2024-09-19T06:58:22.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.956+0000 7f2ba67fc640 1 --2- 172.21.15.99:0/3129438640 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f2b9c06e530 0x7f2b9c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:22.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.956+0000 7f2ba67fc640 1 -- 172.21.15.99:0/3129438640 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f2bac08ddd0 con 0x7f2bb00fb480 2024-09-19T06:58:22.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.956+0000 7f2bb56c0640 1 --2- 172.21.15.99:0/3129438640 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f2b9c06e530 0x7f2b9c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:22.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.956+0000 7f2bb56c0640 1 --2- 172.21.15.99:0/3129438640 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f2b9c06e530 0x7f2b9c0709e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2bb0110d30 tx=0x7f2ba0035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:22.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:22.960+0000 7f2ba67fc640 1 -- 172.21.15.99:0/3129438640 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f2bac056f70 con 0x7f2bb00fb480 2024-09-19T06:58:23.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.145+0000 7f2bb8125640 1 -- 172.21.15.99:0/3129438640 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2bb004b750 con 0x7f2b9c06e530 2024-09-19T06:58:23.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.146+0000 7f2ba67fc640 1 -- 172.21.15.99:0/3129438640 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f2bb004b750 con 0x7f2b9c06e530 2024-09-19T06:58:23.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.149+0000 7f2bb8125640 1 -- 172.21.15.99:0/3129438640 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f2b9c06e530 msgr2=0x7f2b9c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:23.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.149+0000 7f2bb8125640 1 --2- 172.21.15.99:0/3129438640 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f2b9c06e530 0x7f2b9c0709e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2bb0110d30 tx=0x7f2ba0035040 comp rx=0 tx=0).stop 2024-09-19T06:58:23.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.149+0000 7f2bb8125640 1 -- 172.21.15.99:0/3129438640 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2bb00fb480 msgr2=0x7f2bb0115430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:23.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.149+0000 7f2bb8125640 1 --2- 172.21.15.99:0/3129438640 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2bb00fb480 0x7f2bb0115430 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f2bac00eb70 tx=0x7f2bac00b040 comp rx=0 tx=0).stop 2024-09-19T06:58:23.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.149+0000 7f2bb8125640 1 -- 172.21.15.99:0/3129438640 shutdown_connections 2024-09-19T06:58:23.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.149+0000 7f2bb8125640 1 --2- 172.21.15.99:0/3129438640 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f2b9c06e530 0x7f2b9c0709e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:23.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.149+0000 7f2bb8125640 1 --2- 172.21.15.99:0/3129438640 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2bb01014c0 0x7f2bb0115970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:23.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.149+0000 7f2bb8125640 1 --2- 172.21.15.99:0/3129438640 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2bb00fb480 0x7f2bb0115430 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:23.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.149+0000 7f2bb8125640 1 -- 172.21.15.99:0/3129438640 >> 172.21.15.99:0/3129438640 conn(0x7f2bb00f7000 msgr2=0x7f2bb0065a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:58:23.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.149+0000 7f2bb8125640 1 -- 172.21.15.99:0/3129438640 shutdown_connections 2024-09-19T06:58:23.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.149+0000 7f2bb8125640 1 -- 172.21.15.99:0/3129438640 wait complete. 2024-09-19T06:58:23.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.227+0000 7f6a0a244640 1 -- 172.21.15.99:0/43547705 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a040fdf20 msgr2=0x7f6a04106560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:23.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.227+0000 7f6a0a244640 1 --2- 172.21.15.99:0/43547705 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a040fdf20 0x7f6a04106560 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f69f80048d0 tx=0x7f69f8009da0 comp rx=0 tx=0).stop 2024-09-19T06:58:23.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.227+0000 7f6a0a244640 1 -- 172.21.15.99:0/43547705 shutdown_connections 2024-09-19T06:58:23.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.227+0000 7f6a0a244640 1 --2- 172.21.15.99:0/43547705 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a040fdf20 0x7f6a04106560 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:23.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.227+0000 7f6a0a244640 1 --2- 172.21.15.99:0/43547705 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a040fd580 0x7f6a040fd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:23.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.227+0000 7f6a0a244640 1 -- 172.21.15.99:0/43547705 >> 172.21.15.99:0/43547705 conn(0x7f6a040f7010 msgr2=0x7f6a040f9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:58:23.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.227+0000 7f6a0a244640 1 -- 172.21.15.99:0/43547705 shutdown_connections 2024-09-19T06:58:23.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.228+0000 7f6a0a244640 1 -- 172.21.15.99:0/43547705 wait complete. 2024-09-19T06:58:23.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.228+0000 7f6a0a244640 1 Processor -- start 2024-09-19T06:58:23.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.228+0000 7f6a0a244640 1 -- start start 2024-09-19T06:58:23.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.228+0000 7f6a0a244640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a040fd580 0x7f6a04113290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:23.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.228+0000 7f6a0a244640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a040fdf20 0x7f6a041137d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:23.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.228+0000 7f6a0a244640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a04113e60 con 0x7f6a040fdf20 2024-09-19T06:58:23.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.228+0000 7f6a0a244640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0410d210 con 0x7f6a040fd580 2024-09-19T06:58:23.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.229+0000 7f6a02ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a040fdf20 0x7f6a041137d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:23.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.229+0000 7f6a02ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a040fdf20 0x7f6a041137d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34028/0 (socket says 172.21.15.99:34028) 2024-09-19T06:58:23.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.229+0000 7f6a02ffd640 1 -- 172.21.15.99:0/1813571581 learned_addr learned my addr 172.21.15.99:0/1813571581 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:58:23.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.229+0000 7f6a037fe640 1 --2- 172.21.15.99:0/1813571581 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a040fd580 0x7f6a04113290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:23.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.229+0000 7f6a02ffd640 1 -- 172.21.15.99:0/1813571581 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a040fd580 msgr2=0x7f6a04113290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:23.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.229+0000 7f6a02ffd640 1 --2- 172.21.15.99:0/1813571581 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a040fd580 0x7f6a04113290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:23.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.229+0000 7f6a02ffd640 1 -- 172.21.15.99:0/1813571581 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f8005040 con 0x7f6a040fdf20 2024-09-19T06:58:23.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.229+0000 7f6a037fe640 1 --2- 172.21.15.99:0/1813571581 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a040fd580 0x7f6a04113290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:58:23.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.229+0000 7f6a02ffd640 1 --2- 172.21.15.99:0/1813571581 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a040fdf20 0x7f6a041137d0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f69f8003080 tx=0x7f69f8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:23.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.229+0000 7f69ebfff640 1 -- 172.21.15.99:0/1813571581 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69f8038070 con 0x7f6a040fdf20 2024-09-19T06:58:23.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.229+0000 7f69ebfff640 1 -- 172.21.15.99:0/1813571581 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f69f80097e0 con 0x7f6a040fdf20 2024-09-19T06:58:23.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.229+0000 7f6a0a244640 1 -- 172.21.15.99:0/1813571581 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a0410d490 con 0x7f6a040fdf20 2024-09-19T06:58:23.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.229+0000 7f69ebfff640 1 -- 172.21.15.99:0/1813571581 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69f803d420 con 0x7f6a040fdf20 2024-09-19T06:58:23.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.229+0000 7f6a0a244640 1 -- 172.21.15.99:0/1813571581 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a0410d950 con 0x7f6a040fdf20 2024-09-19T06:58:23.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.230+0000 7f6a0a244640 1 -- 172.21.15.99:0/1813571581 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a040663b0 con 0x7f6a040fdf20 2024-09-19T06:58:23.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.231+0000 7f69ebfff640 1 -- 172.21.15.99:0/1813571581 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f69f8030020 con 0x7f6a040fdf20 2024-09-19T06:58:23.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.231+0000 7f69ebfff640 1 --2- 172.21.15.99:0/1813571581 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f69ec06e530 0x7f69ec0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:23.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.231+0000 7f69ebfff640 1 -- 172.21.15.99:0/1813571581 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f69f80ae6b0 con 0x7f6a040fdf20 2024-09-19T06:58:23.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.231+0000 7f6a037fe640 1 --2- 172.21.15.99:0/1813571581 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f69ec06e530 0x7f69ec0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:23.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.232+0000 7f6a037fe640 1 --2- 172.21.15.99:0/1813571581 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f69ec06e530 0x7f69ec0709e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f69f4006fd0 tx=0x7f69f4008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:23.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.235+0000 7f69ebfff640 1 -- 172.21.15.99:0/1813571581 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f69f80777a0 con 0x7f6a040fdf20 2024-09-19T06:58:23.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.408+0000 7f6a0a244640 1 -- 172.21.15.99:0/1813571581 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6a041095e0 con 0x7f69ec06e530 2024-09-19T06:58:23.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.417+0000 7f69ebfff640 1 -- 172.21.15.99:0/1813571581 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f6a041095e0 con 0x7f69ec06e530 2024-09-19T06:58:23.418 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T06:58:23.418 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.smithi099 smithi099 *:9093,9094 running (17m) 10m ago 25m 23.4M - 0.25.0 c8568f914cd2 e7c1774d56b0 2024-09-19T06:58:23.418 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi099 smithi099 running (13m) 10m ago 25m 6899k - 19.1.1-361-g2f599a46 d2baa855c067 b9775f416b10 2024-09-19T06:58:23.418 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi117 smithi117 running (13m) 9m ago 25m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 38cf60c0d548 2024-09-19T06:58:23.419 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.smithi099 smithi099 *:3000 running (15m) 10m ago 25m 80.7M - 9.4.12 2bacad6d85d8 cd53a18d5410 2024-09-19T06:58:23.419 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.obarqf smithi099 running (10m) 10m ago 20m 12.2M - 19.1.1-361-g2f599a46 d2baa855c067 314a73082521 2024-09-19T06:58:23.419 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.xehbxe smithi099 running (10m) 10m ago 20m 14.4M - 19.1.1-361-g2f599a46 d2baa855c067 a2955a9d06e6 2024-09-19T06:58:23.419 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.bheqzh smithi117 running (9m) 9m ago 20m 11.8M - 19.1.1-361-g2f599a46 d2baa855c067 b1505937c0b7 2024-09-19T06:58:23.419 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.nooexo smithi117 running (9m) 9m ago 20m 13.1M - 19.1.1-361-g2f599a46 d2baa855c067 35bd7725855c 2024-09-19T06:58:23.419 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi099.pgvkqi smithi099 *:8443,9283,8765 running (16m) 10m ago 27m 505M - 19.1.1-361-g2f599a46 d2baa855c067 d5de99cb7e78 2024-09-19T06:58:23.419 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi117.ssmkcf smithi117 *:8443,9283,8765 running (16m) 9m ago 25m 444M - 19.1.1-361-g2f599a46 d2baa855c067 8b7ee0f871f5 2024-09-19T06:58:23.419 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi099 smithi099 running (14m) 10m ago 27m 52.4M 2048M 19.1.1-361-g2f599a46 d2baa855c067 ffe067438824 2024-09-19T06:58:23.419 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi117 smithi117 running (14m) 9m ago 24m 38.9M 2048M 19.1.1-361-g2f599a46 d2baa855c067 4cb7455e3ee7 2024-09-19T06:58:23.419 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi099 smithi099 *:9100 running (17m) 10m ago 25m 15.0M - 1.5.0 0da6a335fe13 dca7b4517dcc 2024-09-19T06:58:23.419 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi117 smithi117 *:9100 running (17m) 9m ago 25m 15.9M - 1.5.0 0da6a335fe13 8233ce3835d2 2024-09-19T06:58:23.419 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (13m) 10m ago 24m 100M 1557M 19.1.1-361-g2f599a46 d2baa855c067 8e22543bf933 2024-09-19T06:58:23.419 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (12m) 10m ago 23m 106M 1557M 19.1.1-361-g2f599a46 d2baa855c067 f54153d0ae09 2024-09-19T06:58:23.420 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (12m) 10m ago 23m 83.7M 1557M 19.1.1-361-g2f599a46 d2baa855c067 b1778ab88870 2024-09-19T06:58:23.420 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi117 running (11m) 9m ago 22m 102M 2581M 19.1.1-361-g2f599a46 d2baa855c067 ea5236b193d3 2024-09-19T06:58:23.420 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi117 running (11m) 9m ago 22m 93.5M 2581M 19.1.1-361-g2f599a46 d2baa855c067 27ac2c859a68 2024-09-19T06:58:23.420 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi117 running (10m) 9m ago 22m 100M 2581M 19.1.1-361-g2f599a46 d2baa855c067 de6aeb8544ce 2024-09-19T06:58:23.420 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.smithi099 smithi099 *:9095 running (16m) 10m ago 25m 64.4M - 2.43.0 a07b618ecd1d 15ad26ec6fb4 2024-09-19T06:58:23.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.419+0000 7f6a0a244640 1 -- 172.21.15.99:0/1813571581 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f69ec06e530 msgr2=0x7f69ec0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:23.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.419+0000 7f6a0a244640 1 --2- 172.21.15.99:0/1813571581 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f69ec06e530 0x7f69ec0709e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f69f4006fd0 tx=0x7f69f4008040 comp rx=0 tx=0).stop 2024-09-19T06:58:23.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.419+0000 7f6a0a244640 1 -- 172.21.15.99:0/1813571581 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a040fdf20 msgr2=0x7f6a041137d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:23.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.419+0000 7f6a0a244640 1 --2- 172.21.15.99:0/1813571581 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a040fdf20 0x7f6a041137d0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f69f8003080 tx=0x7f69f8009da0 comp rx=0 tx=0).stop 2024-09-19T06:58:23.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.419+0000 7f6a0a244640 1 -- 172.21.15.99:0/1813571581 shutdown_connections 2024-09-19T06:58:23.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.419+0000 7f6a0a244640 1 --2- 172.21.15.99:0/1813571581 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f69ec06e530 0x7f69ec0709e0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:23.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.419+0000 7f6a0a244640 1 --2- 172.21.15.99:0/1813571581 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a040fdf20 0x7f6a041137d0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:23.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.419+0000 7f6a0a244640 1 --2- 172.21.15.99:0/1813571581 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a040fd580 0x7f6a04113290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:23.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.419+0000 7f6a0a244640 1 -- 172.21.15.99:0/1813571581 >> 172.21.15.99:0/1813571581 conn(0x7f6a040f7010 msgr2=0x7f6a040f85d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:58:23.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.419+0000 7f6a0a244640 1 -- 172.21.15.99:0/1813571581 shutdown_connections 2024-09-19T06:58:23.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.419+0000 7f6a0a244640 1 -- 172.21.15.99:0/1813571581 wait complete. 2024-09-19T06:58:23.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.496+0000 7f7d245cd640 1 -- 172.21.15.99:0/794285685 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7d1c1014e0 msgr2=0x7f7d1c1018b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:23.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.496+0000 7f7d245cd640 1 --2- 172.21.15.99:0/794285685 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7d1c1014e0 0x7f7d1c1018b0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f7d180048d0 tx=0x7f7d18009da0 comp rx=0 tx=0).stop 2024-09-19T06:58:23.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.496+0000 7f7d245cd640 1 -- 172.21.15.99:0/794285685 shutdown_connections 2024-09-19T06:58:23.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.496+0000 7f7d245cd640 1 --2- 172.21.15.99:0/794285685 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d1c0fb4a0 0x7f7d1c0fb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:23.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.496+0000 7f7d245cd640 1 --2- 172.21.15.99:0/794285685 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7d1c1014e0 0x7f7d1c1018b0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:23.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.496+0000 7f7d245cd640 1 -- 172.21.15.99:0/794285685 >> 172.21.15.99:0/794285685 conn(0x7f7d1c0f7060 msgr2=0x7f7d1c0f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:58:23.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.496+0000 7f7d245cd640 1 -- 172.21.15.99:0/794285685 shutdown_connections 2024-09-19T06:58:23.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.496+0000 7f7d245cd640 1 -- 172.21.15.99:0/794285685 wait complete. 2024-09-19T06:58:23.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.497+0000 7f7d245cd640 1 Processor -- start 2024-09-19T06:58:23.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.497+0000 7f7d245cd640 1 -- start start 2024-09-19T06:58:23.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.497+0000 7f7d245cd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d1c0fb4a0 0x7f7d1c10e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:23.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.497+0000 7f7d245cd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7d1c1014e0 0x7f7d1c10e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:23.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.497+0000 7f7d245cd640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1c10ed10 con 0x7f7d1c1014e0 2024-09-19T06:58:23.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.497+0000 7f7d245cd640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1c10ee80 con 0x7f7d1c0fb4a0 2024-09-19T06:58:23.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.497+0000 7f7d21b68640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7d1c1014e0 0x7f7d1c10e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:23.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.497+0000 7f7d21b68640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7d1c1014e0 0x7f7d1c10e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34048/0 (socket says 172.21.15.99:34048) 2024-09-19T06:58:23.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.497+0000 7f7d21b68640 1 -- 172.21.15.99:0/2472400201 learned_addr learned my addr 172.21.15.99:0/2472400201 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:58:23.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.497+0000 7f7d22369640 1 --2- 172.21.15.99:0/2472400201 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d1c0fb4a0 0x7f7d1c10e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:23.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.497+0000 7f7d21b68640 1 -- 172.21.15.99:0/2472400201 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d1c0fb4a0 msgr2=0x7f7d1c10e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:23.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.497+0000 7f7d21b68640 1 --2- 172.21.15.99:0/2472400201 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d1c0fb4a0 0x7f7d1c10e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:23.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.497+0000 7f7d21b68640 1 -- 172.21.15.99:0/2472400201 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d18005040 con 0x7f7d1c1014e0 2024-09-19T06:58:23.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.498+0000 7f7d21b68640 1 --2- 172.21.15.99:0/2472400201 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7d1c1014e0 0x7f7d1c10e6c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c002a50 tx=0x7f7d0c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:23.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.498+0000 7f7d12ffd640 1 -- 172.21.15.99:0/2472400201 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d0c007c30 con 0x7f7d1c1014e0 2024-09-19T06:58:23.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.498+0000 7f7d12ffd640 1 -- 172.21.15.99:0/2472400201 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7d0c00f040 con 0x7f7d1c1014e0 2024-09-19T06:58:23.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.498+0000 7f7d12ffd640 1 -- 172.21.15.99:0/2472400201 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d0c00da90 con 0x7f7d1c1014e0 2024-09-19T06:58:23.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.498+0000 7f7d245cd640 1 -- 172.21.15.99:0/2472400201 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d1c1171f0 con 0x7f7d1c1014e0 2024-09-19T06:58:23.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.498+0000 7f7d245cd640 1 -- 172.21.15.99:0/2472400201 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d1c117700 con 0x7f7d1c1014e0 2024-09-19T06:58:23.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.499+0000 7f7d245cd640 1 -- 172.21.15.99:0/2472400201 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d1c0fcbe0 con 0x7f7d1c1014e0 2024-09-19T06:58:23.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.500+0000 7f7d12ffd640 1 -- 172.21.15.99:0/2472400201 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f7d0c00dc30 con 0x7f7d1c1014e0 2024-09-19T06:58:23.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.500+0000 7f7d12ffd640 1 --2- 172.21.15.99:0/2472400201 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f7d0806e530 0x7f7d080709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:23.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.500+0000 7f7d12ffd640 1 -- 172.21.15.99:0/2472400201 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f7d0c08d930 con 0x7f7d1c1014e0 2024-09-19T06:58:23.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.500+0000 7f7d22369640 1 --2- 172.21.15.99:0/2472400201 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f7d0806e530 0x7f7d080709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:23.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.501+0000 7f7d22369640 1 --2- 172.21.15.99:0/2472400201 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f7d0806e530 0x7f7d080709e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7d18004540 tx=0x7f7d18009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:23.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.507+0000 7f7d12ffd640 1 -- 172.21.15.99:0/2472400201 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f7d0c056aa0 con 0x7f7d1c1014e0 2024-09-19T06:58:23.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.739+0000 7f7d245cd640 1 -- 172.21.15.99:0/2472400201 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7d1c04b720 con 0x7f7d1c1014e0 2024-09-19T06:58:23.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.740+0000 7f7d12ffd640 1 -- 172.21.15.99:0/2472400201 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f7d0c05a160 con 0x7f7d1c1014e0 2024-09-19T06:58:23.741 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:58:23.741 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-09-19T06:58:23.741 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T06:58:23.742 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:58:23.742 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-09-19T06:58:23.742 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T06:58:23.742 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:58:23.742 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-09-19T06:58:23.742 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 6 2024-09-19T06:58:23.742 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:58:23.742 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": { 2024-09-19T06:58:23.742 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 4 2024-09-19T06:58:23.742 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:58:23.742 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-09-19T06:58:23.742 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 14 2024-09-19T06:58:23.742 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T06:58:23.743 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:58:23.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.742+0000 7f7d245cd640 1 -- 172.21.15.99:0/2472400201 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f7d0806e530 msgr2=0x7f7d080709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:23.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.742+0000 7f7d245cd640 1 --2- 172.21.15.99:0/2472400201 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f7d0806e530 0x7f7d080709e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7d18004540 tx=0x7f7d18009da0 comp rx=0 tx=0).stop 2024-09-19T06:58:23.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.742+0000 7f7d245cd640 1 -- 172.21.15.99:0/2472400201 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7d1c1014e0 msgr2=0x7f7d1c10e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:23.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.742+0000 7f7d245cd640 1 --2- 172.21.15.99:0/2472400201 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7d1c1014e0 0x7f7d1c10e6c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c002a50 tx=0x7f7d0c004600 comp rx=0 tx=0).stop 2024-09-19T06:58:23.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.742+0000 7f7d245cd640 1 -- 172.21.15.99:0/2472400201 shutdown_connections 2024-09-19T06:58:23.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.742+0000 7f7d245cd640 1 --2- 172.21.15.99:0/2472400201 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f7d0806e530 0x7f7d080709e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:23.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.742+0000 7f7d245cd640 1 --2- 172.21.15.99:0/2472400201 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7d1c1014e0 0x7f7d1c10e6c0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:23.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.742+0000 7f7d245cd640 1 --2- 172.21.15.99:0/2472400201 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d1c0fb4a0 0x7f7d1c10e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:23.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.742+0000 7f7d245cd640 1 -- 172.21.15.99:0/2472400201 >> 172.21.15.99:0/2472400201 conn(0x7f7d1c0f7060 msgr2=0x7f7d1c0f7430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:58:23.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.743+0000 7f7d245cd640 1 -- 172.21.15.99:0/2472400201 shutdown_connections 2024-09-19T06:58:23.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.743+0000 7f7d245cd640 1 -- 172.21.15.99:0/2472400201 wait complete. 2024-09-19T06:58:23.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.821+0000 7f79d73be640 1 -- 172.21.15.99:0/3371943057 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f79d0102ef0 msgr2=0x7f79d00fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:23.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.821+0000 7f79d73be640 1 --2- 172.21.15.99:0/3371943057 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f79d0102ef0 0x7f79d00fc5b0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f79c40048d0 tx=0x7f79c4009da0 comp rx=0 tx=0).stop 2024-09-19T06:58:23.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.821+0000 7f79d73be640 1 -- 172.21.15.99:0/3371943057 shutdown_connections 2024-09-19T06:58:23.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.821+0000 7f79d73be640 1 --2- 172.21.15.99:0/3371943057 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f79d0102ef0 0x7f79d00fc5b0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:23.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.821+0000 7f79d73be640 1 --2- 172.21.15.99:0/3371943057 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79d0102550 0x7f79d0102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:23.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.821+0000 7f79d73be640 1 -- 172.21.15.99:0/3371943057 >> 172.21.15.99:0/3371943057 conn(0x7f79d00f80f0 msgr2=0x7f79d00fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:58:23.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.821+0000 7f79d73be640 1 -- 172.21.15.99:0/3371943057 shutdown_connections 2024-09-19T06:58:23.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.821+0000 7f79d73be640 1 -- 172.21.15.99:0/3371943057 wait complete. 2024-09-19T06:58:23.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.822+0000 7f79d73be640 1 Processor -- start 2024-09-19T06:58:23.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.822+0000 7f79d73be640 1 -- start start 2024-09-19T06:58:23.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.822+0000 7f79d73be640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79d0102550 0x7f79d0113500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:23.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.822+0000 7f79d73be640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f79d0102ef0 0x7f79d0113a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:23.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.822+0000 7f79d73be640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d0114090 con 0x7f79d0102ef0 2024-09-19T06:58:23.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.822+0000 7f79d73be640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d010d4a0 con 0x7f79d0102550 2024-09-19T06:58:23.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.822+0000 7f79d4959640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f79d0102ef0 0x7f79d0113a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:23.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.822+0000 7f79d4959640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f79d0102ef0 0x7f79d0113a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34066/0 (socket says 172.21.15.99:34066) 2024-09-19T06:58:23.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.822+0000 7f79d4959640 1 -- 172.21.15.99:0/4263547472 learned_addr learned my addr 172.21.15.99:0/4263547472 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:58:23.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.822+0000 7f79d515a640 1 --2- 172.21.15.99:0/4263547472 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79d0102550 0x7f79d0113500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:23.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.822+0000 7f79d4959640 1 -- 172.21.15.99:0/4263547472 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79d0102550 msgr2=0x7f79d0113500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:23.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.822+0000 7f79d4959640 1 --2- 172.21.15.99:0/4263547472 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79d0102550 0x7f79d0113500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:23.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.822+0000 7f79d4959640 1 -- 172.21.15.99:0/4263547472 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c4005040 con 0x7f79d0102ef0 2024-09-19T06:58:23.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.823+0000 7f79d4959640 1 --2- 172.21.15.99:0/4263547472 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f79d0102ef0 0x7f79d0113a40 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f79c40043d0 tx=0x7f79c4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:23.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.823+0000 7f79c1ffb640 1 -- 172.21.15.99:0/4263547472 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79c4038070 con 0x7f79d0102ef0 2024-09-19T06:58:23.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.823+0000 7f79c1ffb640 1 -- 172.21.15.99:0/4263547472 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f79c40096e0 con 0x7f79d0102ef0 2024-09-19T06:58:23.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.823+0000 7f79d73be640 1 -- 172.21.15.99:0/4263547472 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79d010d720 con 0x7f79d0102ef0 2024-09-19T06:58:23.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.823+0000 7f79c1ffb640 1 -- 172.21.15.99:0/4263547472 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79c402c8a0 con 0x7f79d0102ef0 2024-09-19T06:58:23.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.823+0000 7f79d73be640 1 -- 172.21.15.99:0/4263547472 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79d010dbe0 con 0x7f79d0102ef0 2024-09-19T06:58:23.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.824+0000 7f79d73be640 1 -- 172.21.15.99:0/4263547472 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79d00fdcd0 con 0x7f79d0102ef0 2024-09-19T06:58:23.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.825+0000 7f79c1ffb640 1 -- 172.21.15.99:0/4263547472 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f79c4030020 con 0x7f79d0102ef0 2024-09-19T06:58:23.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.825+0000 7f79c1ffb640 1 --2- 172.21.15.99:0/4263547472 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f79bc06e530 0x7f79bc0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:23.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.825+0000 7f79c1ffb640 1 -- 172.21.15.99:0/4263547472 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f79c40adec0 con 0x7f79d0102ef0 2024-09-19T06:58:23.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.825+0000 7f79d515a640 1 --2- 172.21.15.99:0/4263547472 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f79bc06e530 0x7f79bc0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:23.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.826+0000 7f79d515a640 1 --2- 172.21.15.99:0/4263547472 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f79bc06e530 0x7f79bc0709e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f79cc009fd0 tx=0x7f79cc00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:23.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:23.830+0000 7f79c1ffb640 1 -- 172.21.15.99:0/4263547472 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f79c4077020 con 0x7f79d0102ef0 2024-09-19T06:58:24.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.031+0000 7f79d73be640 1 -- 172.21.15.99:0/4263547472 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f79d0109560 con 0x7f79d0102ef0 2024-09-19T06:58:24.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.031+0000 7f79c1ffb640 1 -- 172.21.15.99:0/4263547472 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 29 v29) v1 ==== 76+0+1915 (secure 0 0 0) 0x7f79c407a6e0 con 0x7f79d0102ef0 2024-09-19T06:58:24.032 INFO:teuthology.orchestra.run.smithi099.stdout:e29 2024-09-19T06:58:24.033 INFO:teuthology.orchestra.run.smithi099.stdout:btime 2024-09-19T06:48:47:938420+0000 2024-09-19T06:58:24.033 INFO:teuthology.orchestra.run.smithi099.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T06:58:24.033 INFO:teuthology.orchestra.run.smithi099.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T06:58:24.033 INFO:teuthology.orchestra.run.smithi099.stdout:legacy client fscid: 1 2024-09-19T06:58:24.033 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:58:24.033 INFO:teuthology.orchestra.run.smithi099.stdout:Filesystem 'cephfs' (1) 2024-09-19T06:58:24.033 INFO:teuthology.orchestra.run.smithi099.stdout:fs_name cephfs 2024-09-19T06:58:24.033 INFO:teuthology.orchestra.run.smithi099.stdout:epoch 20 2024-09-19T06:58:24.033 INFO:teuthology.orchestra.run.smithi099.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-19T06:58:24.033 INFO:teuthology.orchestra.run.smithi099.stdout:created 2024-09-19T06:37:40.838146+0000 2024-09-19T06:58:24.033 INFO:teuthology.orchestra.run.smithi099.stdout:modified 2024-09-19T06:47:50.076553+0000 2024-09-19T06:58:24.034 INFO:teuthology.orchestra.run.smithi099.stdout:tableserver 0 2024-09-19T06:58:24.034 INFO:teuthology.orchestra.run.smithi099.stdout:root 0 2024-09-19T06:58:24.034 INFO:teuthology.orchestra.run.smithi099.stdout:session_timeout 60 2024-09-19T06:58:24.034 INFO:teuthology.orchestra.run.smithi099.stdout:session_autoclose 300 2024-09-19T06:58:24.034 INFO:teuthology.orchestra.run.smithi099.stdout:max_file_size 1099511627776 2024-09-19T06:58:24.034 INFO:teuthology.orchestra.run.smithi099.stdout:max_xattr_size 65536 2024-09-19T06:58:24.034 INFO:teuthology.orchestra.run.smithi099.stdout:required_client_features {} 2024-09-19T06:58:24.034 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure 0 2024-09-19T06:58:24.034 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure_osd_epoch 77 2024-09-19T06:58:24.034 INFO:teuthology.orchestra.run.smithi099.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T06:58:24.034 INFO:teuthology.orchestra.run.smithi099.stdout:max_mds 2 2024-09-19T06:58:24.034 INFO:teuthology.orchestra.run.smithi099.stdout:in 0,1 2024-09-19T06:58:24.034 INFO:teuthology.orchestra.run.smithi099.stdout:up {} 2024-09-19T06:58:24.034 INFO:teuthology.orchestra.run.smithi099.stdout:failed 0,1 2024-09-19T06:58:24.035 INFO:teuthology.orchestra.run.smithi099.stdout:damaged 2024-09-19T06:58:24.035 INFO:teuthology.orchestra.run.smithi099.stdout:stopped 2024-09-19T06:58:24.035 INFO:teuthology.orchestra.run.smithi099.stdout:data_pools [3] 2024-09-19T06:58:24.035 INFO:teuthology.orchestra.run.smithi099.stdout:metadata_pool 2 2024-09-19T06:58:24.035 INFO:teuthology.orchestra.run.smithi099.stdout:inline_data disabled 2024-09-19T06:58:24.035 INFO:teuthology.orchestra.run.smithi099.stdout:balancer 2024-09-19T06:58:24.035 INFO:teuthology.orchestra.run.smithi099.stdout:bal_rank_mask -1 2024-09-19T06:58:24.035 INFO:teuthology.orchestra.run.smithi099.stdout:standby_count_wanted 1 2024-09-19T06:58:24.035 INFO:teuthology.orchestra.run.smithi099.stdout:qdb_cluster leader: 0 members: 2024-09-19T06:58:24.035 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:58:24.035 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:58:24.035 INFO:teuthology.orchestra.run.smithi099.stdout:Standby daemons: 2024-09-19T06:58:24.035 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:58:24.035 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.obarqf{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6826/1859154203,v1:172.21.15.99:6827/1859154203] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:58:24.036 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.xehbxe{-1:34410} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6828/1939453719,v1:172.21.15.99:6829/1939453719] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:58:24.036 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.nooexo{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6824/1398895079,v1:172.21.15.117:6825/1398895079] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:58:24.036 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.bheqzh{-1:44329} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6826/3233337308,v1:172.21.15.117:6827/3233337308] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:58:24.036 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 29 2024-09-19T06:58:24.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.034+0000 7f79d73be640 1 -- 172.21.15.99:0/4263547472 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f79bc06e530 msgr2=0x7f79bc0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:24.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.034+0000 7f79d73be640 1 --2- 172.21.15.99:0/4263547472 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f79bc06e530 0x7f79bc0709e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f79cc009fd0 tx=0x7f79cc00b040 comp rx=0 tx=0).stop 2024-09-19T06:58:24.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.034+0000 7f79d73be640 1 -- 172.21.15.99:0/4263547472 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f79d0102ef0 msgr2=0x7f79d0113a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:24.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.034+0000 7f79d73be640 1 --2- 172.21.15.99:0/4263547472 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f79d0102ef0 0x7f79d0113a40 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f79c40043d0 tx=0x7f79c4009da0 comp rx=0 tx=0).stop 2024-09-19T06:58:24.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.034+0000 7f79d73be640 1 -- 172.21.15.99:0/4263547472 shutdown_connections 2024-09-19T06:58:24.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.034+0000 7f79d73be640 1 --2- 172.21.15.99:0/4263547472 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f79bc06e530 0x7f79bc0709e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:24.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.034+0000 7f79d73be640 1 --2- 172.21.15.99:0/4263547472 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f79d0102ef0 0x7f79d0113a40 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:24.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.034+0000 7f79d73be640 1 --2- 172.21.15.99:0/4263547472 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f79d0102550 0x7f79d0113500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:24.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.034+0000 7f79d73be640 1 -- 172.21.15.99:0/4263547472 >> 172.21.15.99:0/4263547472 conn(0x7f79d00f80f0 msgr2=0x7f79d00f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:58:24.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.034+0000 7f79d73be640 1 -- 172.21.15.99:0/4263547472 shutdown_connections 2024-09-19T06:58:24.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.034+0000 7f79d73be640 1 -- 172.21.15.99:0/4263547472 wait complete. 2024-09-19T06:58:24.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.114+0000 7efccf141640 1 -- 172.21.15.99:0/492270970 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efcc8102620 msgr2=0x7efcc81029f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:24.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.114+0000 7efccf141640 1 --2- 172.21.15.99:0/492270970 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efcc8102620 0x7efcc81029f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7efcbc0048d0 tx=0x7efcbc009da0 comp rx=0 tx=0).stop 2024-09-19T06:58:24.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.114+0000 7efccf141640 1 -- 172.21.15.99:0/492270970 shutdown_connections 2024-09-19T06:58:24.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.114+0000 7efccf141640 1 --2- 172.21.15.99:0/492270970 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcc80fac80 0x7efcc80fb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:24.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.114+0000 7efccf141640 1 --2- 172.21.15.99:0/492270970 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efcc8102620 0x7efcc81029f0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:24.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.114+0000 7efccf141640 1 -- 172.21.15.99:0/492270970 >> 172.21.15.99:0/492270970 conn(0x7efcc8070ce0 msgr2=0x7efcc80710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:58:24.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.114+0000 7efccf141640 1 -- 172.21.15.99:0/492270970 shutdown_connections 2024-09-19T06:58:24.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.114+0000 7efccf141640 1 -- 172.21.15.99:0/492270970 wait complete. 2024-09-19T06:58:24.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.114+0000 7efccf141640 1 Processor -- start 2024-09-19T06:58:24.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.114+0000 7efccf141640 1 -- start start 2024-09-19T06:58:24.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.115+0000 7efccf141640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efcc80fac80 0x7efcc81131b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:24.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.115+0000 7efccf141640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcc8102620 0x7efcc81136f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:24.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.115+0000 7efccf141640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcc8113cf0 con 0x7efcc80fac80 2024-09-19T06:58:24.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.115+0000 7efccf141640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcc810d130 con 0x7efcc8102620 2024-09-19T06:58:24.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.115+0000 7efcccedd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efcc80fac80 0x7efcc81131b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:24.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.115+0000 7efcccedd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efcc80fac80 0x7efcc81131b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34088/0 (socket says 172.21.15.99:34088) 2024-09-19T06:58:24.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.115+0000 7efcccedd640 1 -- 172.21.15.99:0/3786214637 learned_addr learned my addr 172.21.15.99:0/3786214637 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:58:24.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.115+0000 7efcc7fff640 1 --2- 172.21.15.99:0/3786214637 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcc8102620 0x7efcc81136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:24.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.115+0000 7efcccedd640 1 -- 172.21.15.99:0/3786214637 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcc8102620 msgr2=0x7efcc81136f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:24.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.115+0000 7efcccedd640 1 --2- 172.21.15.99:0/3786214637 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcc8102620 0x7efcc81136f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:24.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.115+0000 7efcccedd640 1 -- 172.21.15.99:0/3786214637 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcbc005040 con 0x7efcc80fac80 2024-09-19T06:58:24.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.115+0000 7efcc7fff640 1 --2- 172.21.15.99:0/3786214637 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcc8102620 0x7efcc81136f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:58:24.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.115+0000 7efcccedd640 1 --2- 172.21.15.99:0/3786214637 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efcc80fac80 0x7efcc81131b0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7efcbc003080 tx=0x7efcbc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:24.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.116+0000 7efcc57fa640 1 -- 172.21.15.99:0/3786214637 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efcbc038070 con 0x7efcc80fac80 2024-09-19T06:58:24.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.116+0000 7efccf141640 1 -- 172.21.15.99:0/3786214637 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcc810d3b0 con 0x7efcc80fac80 2024-09-19T06:58:24.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.116+0000 7efccf141640 1 -- 172.21.15.99:0/3786214637 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcc810d890 con 0x7efcc80fac80 2024-09-19T06:58:24.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.116+0000 7efcc57fa640 1 -- 172.21.15.99:0/3786214637 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7efcbc009760 con 0x7efcc80fac80 2024-09-19T06:58:24.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.116+0000 7efcc57fa640 1 -- 172.21.15.99:0/3786214637 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efcbc033420 con 0x7efcc80fac80 2024-09-19T06:58:24.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.117+0000 7efccf141640 1 -- 172.21.15.99:0/3786214637 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcac005210 con 0x7efcc80fac80 2024-09-19T06:58:24.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.117+0000 7efcc57fa640 1 -- 172.21.15.99:0/3786214637 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7efcbc030020 con 0x7efcc80fac80 2024-09-19T06:58:24.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.118+0000 7efcc57fa640 1 --2- 172.21.15.99:0/3786214637 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7efcb806e530 0x7efcb80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:24.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.118+0000 7efcc57fa640 1 -- 172.21.15.99:0/3786214637 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7efcbc0add70 con 0x7efcc80fac80 2024-09-19T06:58:24.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.118+0000 7efcc7fff640 1 --2- 172.21.15.99:0/3786214637 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7efcb806e530 0x7efcb80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:24.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.118+0000 7efcc7fff640 1 --2- 172.21.15.99:0/3786214637 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7efcb806e530 0x7efcb80709e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7efcc810ea70 tx=0x7efcb4009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:24.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.123+0000 7efcc57fa640 1 -- 172.21.15.99:0/3786214637 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7efcbc076ee0 con 0x7efcc80fac80 2024-09-19T06:58:24.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.313+0000 7efccf141640 1 -- 172.21.15.99:0/3786214637 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efcac000bc0 con 0x7efcb806e530 2024-09-19T06:58:24.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.314+0000 7efcc57fa640 1 -- 172.21.15.99:0/3786214637 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7efcac000bc0 con 0x7efcb806e530 2024-09-19T06:58:24.315 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:58:24.316 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T06:58:24.316 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": true, 2024-09-19T06:58:24.316 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T06:58:24.316 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [ 2024-09-19T06:58:24.316 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr", 2024-09-19T06:58:24.316 INFO:teuthology.orchestra.run.smithi099.stdout: "crash", 2024-09-19T06:58:24.316 INFO:teuthology.orchestra.run.smithi099.stdout: "mds", 2024-09-19T06:58:24.316 INFO:teuthology.orchestra.run.smithi099.stdout: "mon", 2024-09-19T06:58:24.316 INFO:teuthology.orchestra.run.smithi099.stdout: "osd" 2024-09-19T06:58:24.316 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-19T06:58:24.316 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": "16/21 daemons upgraded", 2024-09-19T06:58:24.316 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "Currently upgrading mds daemons", 2024-09-19T06:58:24.316 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-09-19T06:58:24.317 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:58:24.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.317+0000 7efccf141640 1 -- 172.21.15.99:0/3786214637 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7efcb806e530 msgr2=0x7efcb80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:24.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.317+0000 7efccf141640 1 --2- 172.21.15.99:0/3786214637 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7efcb806e530 0x7efcb80709e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7efcc810ea70 tx=0x7efcb4009040 comp rx=0 tx=0).stop 2024-09-19T06:58:24.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.317+0000 7efccf141640 1 -- 172.21.15.99:0/3786214637 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efcc80fac80 msgr2=0x7efcc81131b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:24.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.317+0000 7efccf141640 1 --2- 172.21.15.99:0/3786214637 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efcc80fac80 0x7efcc81131b0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7efcbc003080 tx=0x7efcbc009da0 comp rx=0 tx=0).stop 2024-09-19T06:58:24.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.317+0000 7efccf141640 1 -- 172.21.15.99:0/3786214637 shutdown_connections 2024-09-19T06:58:24.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.317+0000 7efccf141640 1 --2- 172.21.15.99:0/3786214637 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7efcb806e530 0x7efcb80709e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:24.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.317+0000 7efccf141640 1 --2- 172.21.15.99:0/3786214637 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcc8102620 0x7efcc81136f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:24.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.317+0000 7efccf141640 1 --2- 172.21.15.99:0/3786214637 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efcc80fac80 0x7efcc81131b0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:24.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.317+0000 7efccf141640 1 -- 172.21.15.99:0/3786214637 >> 172.21.15.99:0/3786214637 conn(0x7efcc8070ce0 msgr2=0x7efcc80f8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:58:24.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.317+0000 7efccf141640 1 -- 172.21.15.99:0/3786214637 shutdown_connections 2024-09-19T06:58:24.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.317+0000 7efccf141640 1 -- 172.21.15.99:0/3786214637 wait complete. 2024-09-19T06:58:24.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.395+0000 7f08604ba640 1 -- 172.21.15.99:0/3453271866 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f08580fb480 msgr2=0x7f08580fb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:24.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.395+0000 7f08604ba640 1 --2- 172.21.15.99:0/3453271866 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f08580fb480 0x7f08580fb8f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f08480048d0 tx=0x7f0848009da0 comp rx=0 tx=0).stop 2024-09-19T06:58:24.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.395+0000 7f08604ba640 1 -- 172.21.15.99:0/3453271866 shutdown_connections 2024-09-19T06:58:24.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.395+0000 7f08604ba640 1 --2- 172.21.15.99:0/3453271866 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f08580fb480 0x7f08580fb8f0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:24.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.395+0000 7f08604ba640 1 --2- 172.21.15.99:0/3453271866 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08581014c0 0x7f0858101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:24.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.395+0000 7f08604ba640 1 -- 172.21.15.99:0/3453271866 >> 172.21.15.99:0/3453271866 conn(0x7f08580f7000 msgr2=0x7f08580f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:58:24.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.395+0000 7f08604ba640 1 -- 172.21.15.99:0/3453271866 shutdown_connections 2024-09-19T06:58:24.397 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:58:24 smithi099 ceph-mon[97031]: from='client.34922 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:58:24.397 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:58:24 smithi099 ceph-mon[97031]: pgmap v481: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:58:24.397 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:58:24 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/2472400201' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:58:24.398 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:58:24 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/4263547472' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:58:24.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.395+0000 7f08604ba640 1 -- 172.21.15.99:0/3453271866 wait complete. 2024-09-19T06:58:24.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.396+0000 7f08604ba640 1 Processor -- start 2024-09-19T06:58:24.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.396+0000 7f08604ba640 1 -- start start 2024-09-19T06:58:24.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.396+0000 7f08604ba640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f08580fb480 0x7f085810e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:24.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.396+0000 7f08604ba640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08581014c0 0x7f085810e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:24.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.396+0000 7f08604ba640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f085810ed20 con 0x7f08580fb480 2024-09-19T06:58:24.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.396+0000 7f08604ba640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f085810ee90 con 0x7f08581014c0 2024-09-19T06:58:24.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.396+0000 7f085e256640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f08580fb480 0x7f085810e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:24.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.396+0000 7f085e256640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f08580fb480 0x7f085810e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34110/0 (socket says 172.21.15.99:34110) 2024-09-19T06:58:24.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.396+0000 7f085e256640 1 -- 172.21.15.99:0/3584488755 learned_addr learned my addr 172.21.15.99:0/3584488755 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:58:24.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.396+0000 7f085da55640 1 --2- 172.21.15.99:0/3584488755 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08581014c0 0x7f085810e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:24.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.397+0000 7f085e256640 1 -- 172.21.15.99:0/3584488755 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08581014c0 msgr2=0x7f085810e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:24.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.397+0000 7f085e256640 1 --2- 172.21.15.99:0/3584488755 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08581014c0 0x7f085810e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:24.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.397+0000 7f085e256640 1 -- 172.21.15.99:0/3584488755 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0848005040 con 0x7f08580fb480 2024-09-19T06:58:24.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.397+0000 7f085e256640 1 --2- 172.21.15.99:0/3584488755 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f08580fb480 0x7f085810e190 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f0854002a50 tx=0x7f0854004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:24.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.397+0000 7f084effd640 1 -- 172.21.15.99:0/3584488755 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0854007c30 con 0x7f08580fb480 2024-09-19T06:58:24.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.397+0000 7f084effd640 1 -- 172.21.15.99:0/3584488755 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f085400f040 con 0x7f08580fb480 2024-09-19T06:58:24.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.397+0000 7f084effd640 1 -- 172.21.15.99:0/3584488755 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f085400dad0 con 0x7f08580fb480 2024-09-19T06:58:24.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.397+0000 7f08604ba640 1 -- 172.21.15.99:0/3584488755 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0858117200 con 0x7f08580fb480 2024-09-19T06:58:24.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.397+0000 7f08604ba640 1 -- 172.21.15.99:0/3584488755 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08581176c0 con 0x7f08580fb480 2024-09-19T06:58:24.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.398+0000 7f08604ba640 1 -- 172.21.15.99:0/3584488755 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08580fcbc0 con 0x7f08580fb480 2024-09-19T06:58:24.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.399+0000 7f084effd640 1 -- 172.21.15.99:0/3584488755 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f085400dc30 con 0x7f08580fb480 2024-09-19T06:58:24.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.399+0000 7f084effd640 1 --2- 172.21.15.99:0/3584488755 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f084406e530 0x7f08440709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:24.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.399+0000 7f084effd640 1 -- 172.21.15.99:0/3584488755 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f085408dfb0 con 0x7f08580fb480 2024-09-19T06:58:24.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.399+0000 7f085da55640 1 --2- 172.21.15.99:0/3584488755 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f084406e530 0x7f08440709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:24.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.400+0000 7f085da55640 1 --2- 172.21.15.99:0/3584488755 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f084406e530 0x7f08440709e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0848009ac0 tx=0x7f0848035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:24.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.404+0000 7f084effd640 1 -- 172.21.15.99:0/3584488755 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f08540c3210 con 0x7f08580fb480 2024-09-19T06:58:24.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:58:24 smithi117 ceph-mon[76771]: from='client.34922 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:58:24.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:58:24 smithi117 ceph-mon[76771]: pgmap v481: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:58:24.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:58:24 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/2472400201' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:58:24.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:58:24 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/4263547472' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:58:24.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.634+0000 7f08604ba640 1 -- 172.21.15.99:0/3584488755 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f08580fac40 con 0x7f08580fb480 2024-09-19T06:58:24.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.635+0000 7f084effd640 1 -- 172.21.15.99:0/3584488755 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7f08580fac40 con 0x7f08580fb480 2024-09-19T06:58:24.636 INFO:teuthology.orchestra.run.smithi099.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-09-19T06:58:24.636 INFO:teuthology.orchestra.run.smithi099.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-19T06:58:24.636 INFO:teuthology.orchestra.run.smithi099.stdout: fs cephfs is degraded 2024-09-19T06:58:24.636 INFO:teuthology.orchestra.run.smithi099.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-19T06:58:24.636 INFO:teuthology.orchestra.run.smithi099.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-19T06:58:24.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.637+0000 7f08604ba640 1 -- 172.21.15.99:0/3584488755 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f084406e530 msgr2=0x7f08440709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:24.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.637+0000 7f08604ba640 1 --2- 172.21.15.99:0/3584488755 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f084406e530 0x7f08440709e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0848009ac0 tx=0x7f0848035040 comp rx=0 tx=0).stop 2024-09-19T06:58:24.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.637+0000 7f08604ba640 1 -- 172.21.15.99:0/3584488755 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f08580fb480 msgr2=0x7f085810e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:24.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.637+0000 7f08604ba640 1 --2- 172.21.15.99:0/3584488755 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f08580fb480 0x7f085810e190 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f0854002a50 tx=0x7f0854004600 comp rx=0 tx=0).stop 2024-09-19T06:58:24.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.637+0000 7f08604ba640 1 -- 172.21.15.99:0/3584488755 shutdown_connections 2024-09-19T06:58:24.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.637+0000 7f08604ba640 1 --2- 172.21.15.99:0/3584488755 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f084406e530 0x7f08440709e0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:24.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.637+0000 7f08604ba640 1 --2- 172.21.15.99:0/3584488755 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08581014c0 0x7f085810e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:24.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.637+0000 7f08604ba640 1 --2- 172.21.15.99:0/3584488755 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f08580fb480 0x7f085810e190 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:24.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.637+0000 7f08604ba640 1 -- 172.21.15.99:0/3584488755 >> 172.21.15.99:0/3584488755 conn(0x7f08580f7000 msgr2=0x7f08580f73d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:58:24.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.637+0000 7f08604ba640 1 -- 172.21.15.99:0/3584488755 shutdown_connections 2024-09-19T06:58:24.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:24.637+0000 7f08604ba640 1 -- 172.21.15.99:0/3584488755 wait complete. 2024-09-19T06:58:25.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:58:25 smithi099 ceph-mon[97031]: from='client.34926 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:58:25.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:58:25 smithi099 ceph-mon[97031]: from='client.34930 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:58:25.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:58:25 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/3584488755' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T06:58:25.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:58:25 smithi117 ceph-mon[76771]: from='client.34926 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:58:25.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:58:25 smithi117 ceph-mon[76771]: from='client.34930 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:58:25.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:58:25 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/3584488755' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T06:58:26.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:58:26 smithi099 ceph-mon[97031]: from='client.34942 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:58:26.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:58:26 smithi099 ceph-mon[97031]: pgmap v482: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:58:26.462 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:58:26 smithi117 ceph-mon[76771]: from='client.34942 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:58:26.462 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:58:26 smithi117 ceph-mon[76771]: pgmap v482: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:58:28.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:58:28 smithi099 ceph-mon[97031]: pgmap v483: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:58:28.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:58:28 smithi117 ceph-mon[76771]: pgmap v483: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:58:29.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:58:29 smithi099 ceph-mon[97031]: pgmap v484: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:58:29.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:58:29 smithi117 ceph-mon[76771]: pgmap v484: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:58:32.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:58:32 smithi099 ceph-mon[97031]: pgmap v485: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:58:32.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:58:32 smithi117 ceph-mon[76771]: pgmap v485: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:58:34.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:58:34 smithi099 ceph-mon[97031]: pgmap v486: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:58:34.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:58:34 smithi117 ceph-mon[76771]: pgmap v486: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:58:36.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:58:36 smithi099 ceph-mon[97031]: pgmap v487: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:58:36.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:58:36 smithi117 ceph-mon[76771]: pgmap v487: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:58:37.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:58:37 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:58:37.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:58:37 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:58:38.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:58:38 smithi099 ceph-mon[97031]: pgmap v488: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:58:38.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:58:38 smithi117 ceph-mon[76771]: pgmap v488: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:58:40.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:58:40 smithi099 ceph-mon[97031]: pgmap v489: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:58:40.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:58:40 smithi117 ceph-mon[76771]: pgmap v489: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:58:42.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:58:42 smithi099 ceph-mon[97031]: pgmap v490: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:58:42.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:58:42 smithi117 ceph-mon[76771]: pgmap v490: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:58:44.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:58:44 smithi099 ceph-mon[97031]: pgmap v491: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:58:44.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:58:44 smithi117 ceph-mon[76771]: pgmap v491: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:58:46.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:58:46 smithi099 ceph-mon[97031]: pgmap v492: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:58:46.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:58:46 smithi117 ceph-mon[76771]: pgmap v492: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:58:48.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:58:48 smithi099 ceph-mon[97031]: pgmap v493: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:58:48.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:58:48 smithi117 ceph-mon[76771]: pgmap v493: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:58:50.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:58:50 smithi099 ceph-mon[97031]: pgmap v494: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:58:50.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:58:50 smithi117 ceph-mon[76771]: pgmap v494: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:58:52.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:58:52 smithi099 ceph-mon[97031]: pgmap v495: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:58:52.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:58:52 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:58:52.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:58:52 smithi117 ceph-mon[76771]: pgmap v495: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:58:52.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:58:52 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:58:54.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:58:54 smithi099 ceph-mon[97031]: pgmap v496: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:58:54.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:58:54 smithi117 ceph-mon[76771]: pgmap v496: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:58:54.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:54.727+0000 7f2728dc5640 1 -- 172.21.15.99:0/2402006807 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2724102680 msgr2=0x7f2724102a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:54.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:54.727+0000 7f2728dc5640 1 --2- 172.21.15.99:0/2402006807 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2724102680 0x7f2724102a50 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f270c0048d0 tx=0x7f270c009da0 comp rx=0 tx=0).stop 2024-09-19T06:58:54.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:54.727+0000 7f2728dc5640 1 -- 172.21.15.99:0/2402006807 shutdown_connections 2024-09-19T06:58:54.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:54.727+0000 7f2728dc5640 1 --2- 172.21.15.99:0/2402006807 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27240fabd0 0x7f27240fb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:54.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:54.727+0000 7f2728dc5640 1 --2- 172.21.15.99:0/2402006807 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2724102680 0x7f2724102a50 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:54.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:54.727+0000 7f2728dc5640 1 -- 172.21.15.99:0/2402006807 >> 172.21.15.99:0/2402006807 conn(0x7f2724071ac0 msgr2=0x7f2724071ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:58:54.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:54.727+0000 7f2728dc5640 1 -- 172.21.15.99:0/2402006807 shutdown_connections 2024-09-19T06:58:54.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:54.727+0000 7f2728dc5640 1 -- 172.21.15.99:0/2402006807 wait complete. 2024-09-19T06:58:54.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:54.728+0000 7f2728dc5640 1 Processor -- start 2024-09-19T06:58:54.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:54.728+0000 7f2728dc5640 1 -- start start 2024-09-19T06:58:54.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:54.728+0000 7f2728dc5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27240fabd0 0x7f27241132b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:54.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:54.728+0000 7f2728dc5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2724102680 0x7f27241137f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:54.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:54.728+0000 7f2728dc5640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2724113df0 con 0x7f2724102680 2024-09-19T06:58:54.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:54.728+0000 7f2728dc5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272410d230 con 0x7f27240fabd0 2024-09-19T06:58:54.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:54.728+0000 7f2721d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2724102680 0x7f27241137f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:54.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:54.728+0000 7f2721d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2724102680 0x7f27241137f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59656/0 (socket says 172.21.15.99:59656) 2024-09-19T06:58:54.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:54.728+0000 7f2721d9b640 1 -- 172.21.15.99:0/455940464 learned_addr learned my addr 172.21.15.99:0/455940464 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:58:54.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:54.728+0000 7f272259c640 1 --2- 172.21.15.99:0/455940464 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27240fabd0 0x7f27241132b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:54.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:54.729+0000 7f2721d9b640 1 -- 172.21.15.99:0/455940464 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27240fabd0 msgr2=0x7f27241132b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:54.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:54.729+0000 7f2721d9b640 1 --2- 172.21.15.99:0/455940464 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27240fabd0 0x7f27241132b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:54.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:54.729+0000 7f2721d9b640 1 -- 172.21.15.99:0/455940464 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f270c005040 con 0x7f2724102680 2024-09-19T06:58:54.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:54.729+0000 7f2721d9b640 1 --2- 172.21.15.99:0/455940464 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2724102680 0x7f27241137f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f271400c790 tx=0x7f27140043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:54.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:54.729+0000 7f271affd640 1 -- 172.21.15.99:0/455940464 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f271400a820 con 0x7f2724102680 2024-09-19T06:58:54.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:54.729+0000 7f2728dc5640 1 -- 172.21.15.99:0/455940464 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f272410d510 con 0x7f2724102680 2024-09-19T06:58:54.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:54.729+0000 7f271affd640 1 -- 172.21.15.99:0/455940464 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f271400ae20 con 0x7f2724102680 2024-09-19T06:58:54.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:54.729+0000 7f2728dc5640 1 -- 172.21.15.99:0/455940464 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f272410dab0 con 0x7f2724102680 2024-09-19T06:58:54.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:54.729+0000 7f271affd640 1 -- 172.21.15.99:0/455940464 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27140113a0 con 0x7f2724102680 2024-09-19T06:58:54.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:54.730+0000 7f2728dc5640 1 -- 172.21.15.99:0/455940464 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27240725d0 con 0x7f2724102680 2024-09-19T06:58:54.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:54.731+0000 7f271affd640 1 -- 172.21.15.99:0/455940464 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f2714012400 con 0x7f2724102680 2024-09-19T06:58:54.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:54.731+0000 7f271affd640 1 --2- 172.21.15.99:0/455940464 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f271006e530 0x7f27100709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:54.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:54.732+0000 7f271affd640 1 -- 172.21.15.99:0/455940464 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f271408e330 con 0x7f2724102680 2024-09-19T06:58:54.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:54.732+0000 7f272259c640 1 --2- 172.21.15.99:0/455940464 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f271006e530 0x7f27100709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:54.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:54.732+0000 7f272259c640 1 --2- 172.21.15.99:0/455940464 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f271006e530 0x7f27100709e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f270c004540 tx=0x7f270c009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:54.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:54.736+0000 7f271affd640 1 -- 172.21.15.99:0/455940464 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f27140574a0 con 0x7f2724102680 2024-09-19T06:58:54.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:54.918+0000 7f2728dc5640 1 -- 172.21.15.99:0/455940464 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2724109630 con 0x7f271006e530 2024-09-19T06:58:54.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:54.920+0000 7f271affd640 1 -- 172.21.15.99:0/455940464 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f2724109630 con 0x7f271006e530 2024-09-19T06:58:54.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:54.922+0000 7f2728dc5640 1 -- 172.21.15.99:0/455940464 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f271006e530 msgr2=0x7f27100709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:54.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:54.922+0000 7f2728dc5640 1 --2- 172.21.15.99:0/455940464 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f271006e530 0x7f27100709e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f270c004540 tx=0x7f270c009da0 comp rx=0 tx=0).stop 2024-09-19T06:58:54.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:54.922+0000 7f2728dc5640 1 -- 172.21.15.99:0/455940464 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2724102680 msgr2=0x7f27241137f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:54.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:54.922+0000 7f2728dc5640 1 --2- 172.21.15.99:0/455940464 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2724102680 0x7f27241137f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f271400c790 tx=0x7f27140043c0 comp rx=0 tx=0).stop 2024-09-19T06:58:54.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:54.922+0000 7f2728dc5640 1 -- 172.21.15.99:0/455940464 shutdown_connections 2024-09-19T06:58:54.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:54.922+0000 7f2728dc5640 1 --2- 172.21.15.99:0/455940464 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f271006e530 0x7f27100709e0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:54.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:54.922+0000 7f2728dc5640 1 --2- 172.21.15.99:0/455940464 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2724102680 0x7f27241137f0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:54.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:54.922+0000 7f2728dc5640 1 --2- 172.21.15.99:0/455940464 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27240fabd0 0x7f27241132b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:54.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:54.922+0000 7f2728dc5640 1 -- 172.21.15.99:0/455940464 >> 172.21.15.99:0/455940464 conn(0x7f2724071ac0 msgr2=0x7f2724105350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:58:54.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:54.922+0000 7f2728dc5640 1 -- 172.21.15.99:0/455940464 shutdown_connections 2024-09-19T06:58:54.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:54.922+0000 7f2728dc5640 1 -- 172.21.15.99:0/455940464 wait complete. 2024-09-19T06:58:54.932 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-09-19T06:58:55.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.001+0000 7fd60fe11640 1 -- 172.21.15.99:0/4174801987 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd6080fac60 msgr2=0x7fd6080fb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:55.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.001+0000 7fd60fe11640 1 --2- 172.21.15.99:0/4174801987 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd6080fac60 0x7fd6080fb0b0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc0048d0 tx=0x7fd5fc009da0 comp rx=0 tx=0).stop 2024-09-19T06:58:55.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.001+0000 7fd60fe11640 1 -- 172.21.15.99:0/4174801987 shutdown_connections 2024-09-19T06:58:55.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.001+0000 7fd60fe11640 1 --2- 172.21.15.99:0/4174801987 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd6080fac60 0x7fd6080fb0b0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:55.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.001+0000 7fd60fe11640 1 --2- 172.21.15.99:0/4174801987 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6081025f0 0x7fd6081029c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:55.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.001+0000 7fd60fe11640 1 -- 172.21.15.99:0/4174801987 >> 172.21.15.99:0/4174801987 conn(0x7fd608070c80 msgr2=0x7fd608071080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:58:55.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.001+0000 7fd60fe11640 1 -- 172.21.15.99:0/4174801987 shutdown_connections 2024-09-19T06:58:55.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.001+0000 7fd60fe11640 1 -- 172.21.15.99:0/4174801987 wait complete. 2024-09-19T06:58:55.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.002+0000 7fd60fe11640 1 Processor -- start 2024-09-19T06:58:55.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.002+0000 7fd60fe11640 1 -- start start 2024-09-19T06:58:55.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.002+0000 7fd60fe11640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd6080fac60 0x7fd6081153e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:55.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.002+0000 7fd60fe11640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6081025f0 0x7fd608115920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:55.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.002+0000 7fd60fe11640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd608115f20 con 0x7fd6080fac60 2024-09-19T06:58:55.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.002+0000 7fd60fe11640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd608116090 con 0x7fd6081025f0 2024-09-19T06:58:55.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.002+0000 7fd60dbad640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd6080fac60 0x7fd6081153e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:55.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.002+0000 7fd60dbad640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd6080fac60 0x7fd6081153e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59664/0 (socket says 172.21.15.99:59664) 2024-09-19T06:58:55.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.002+0000 7fd60dbad640 1 -- 172.21.15.99:0/474129927 learned_addr learned my addr 172.21.15.99:0/474129927 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:58:55.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.002+0000 7fd60d3ac640 1 --2- 172.21.15.99:0/474129927 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6081025f0 0x7fd608115920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:55.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.002+0000 7fd60dbad640 1 -- 172.21.15.99:0/474129927 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6081025f0 msgr2=0x7fd608115920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:55.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.002+0000 7fd60dbad640 1 --2- 172.21.15.99:0/474129927 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6081025f0 0x7fd608115920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:55.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.002+0000 7fd60dbad640 1 -- 172.21.15.99:0/474129927 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5fc005040 con 0x7fd6080fac60 2024-09-19T06:58:55.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.003+0000 7fd60dbad640 1 --2- 172.21.15.99:0/474129927 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd6080fac60 0x7fd6081153e0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fd604002a50 tx=0x7fd604004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:55.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.003+0000 7fd5fa7fc640 1 -- 172.21.15.99:0/474129927 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd604007c30 con 0x7fd6080fac60 2024-09-19T06:58:55.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.003+0000 7fd5fa7fc640 1 -- 172.21.15.99:0/474129927 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd60400f040 con 0x7fd6080fac60 2024-09-19T06:58:55.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.003+0000 7fd60fe11640 1 -- 172.21.15.99:0/474129927 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd60810f510 con 0x7fd6080fac60 2024-09-19T06:58:55.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.003+0000 7fd5fa7fc640 1 -- 172.21.15.99:0/474129927 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd60400da90 con 0x7fd6080fac60 2024-09-19T06:58:55.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.003+0000 7fd60fe11640 1 -- 172.21.15.99:0/474129927 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd60810fab0 con 0x7fd6080fac60 2024-09-19T06:58:55.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.004+0000 7fd60fe11640 1 -- 172.21.15.99:0/474129927 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd608065810 con 0x7fd6080fac60 2024-09-19T06:58:55.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.004+0000 7fd5fa7fc640 1 -- 172.21.15.99:0/474129927 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fd60400dc30 con 0x7fd6080fac60 2024-09-19T06:58:55.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.005+0000 7fd5fa7fc640 1 --2- 172.21.15.99:0/474129927 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd5f406e530 0x7fd5f40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:55.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.005+0000 7fd60d3ac640 1 --2- 172.21.15.99:0/474129927 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd5f406e530 0x7fd5f40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:55.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.005+0000 7fd5fa7fc640 1 -- 172.21.15.99:0/474129927 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fd60408d9c0 con 0x7fd6080fac60 2024-09-19T06:58:55.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.006+0000 7fd60d3ac640 1 --2- 172.21.15.99:0/474129927 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd5f406e530 0x7fd5f40709e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd608110ce0 tx=0x7fd5fc035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:55.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.009+0000 7fd5fa7fc640 1 -- 172.21.15.99:0/474129927 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fd604056b30 con 0x7fd6080fac60 2024-09-19T06:58:55.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.194+0000 7fd60fe11640 1 -- 172.21.15.99:0/474129927 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd608110a90 con 0x7fd5f406e530 2024-09-19T06:58:55.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.195+0000 7fd5fa7fc640 1 -- 172.21.15.99:0/474129927 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fd608110a90 con 0x7fd5f406e530 2024-09-19T06:58:55.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.197+0000 7fd60fe11640 1 -- 172.21.15.99:0/474129927 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd5f406e530 msgr2=0x7fd5f40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:55.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.197+0000 7fd60fe11640 1 --2- 172.21.15.99:0/474129927 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd5f406e530 0x7fd5f40709e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd608110ce0 tx=0x7fd5fc035040 comp rx=0 tx=0).stop 2024-09-19T06:58:55.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.197+0000 7fd60fe11640 1 -- 172.21.15.99:0/474129927 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd6080fac60 msgr2=0x7fd6081153e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:55.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.197+0000 7fd60fe11640 1 --2- 172.21.15.99:0/474129927 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd6080fac60 0x7fd6081153e0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fd604002a50 tx=0x7fd604004600 comp rx=0 tx=0).stop 2024-09-19T06:58:55.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.197+0000 7fd60fe11640 1 -- 172.21.15.99:0/474129927 shutdown_connections 2024-09-19T06:58:55.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.197+0000 7fd60fe11640 1 --2- 172.21.15.99:0/474129927 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd5f406e530 0x7fd5f40709e0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:55.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.197+0000 7fd60fe11640 1 --2- 172.21.15.99:0/474129927 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6081025f0 0x7fd608115920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:55.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.197+0000 7fd60fe11640 1 --2- 172.21.15.99:0/474129927 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd6080fac60 0x7fd6081153e0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:55.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.197+0000 7fd60fe11640 1 -- 172.21.15.99:0/474129927 >> 172.21.15.99:0/474129927 conn(0x7fd608070c80 msgr2=0x7fd6080f9d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:58:55.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.198+0000 7fd60fe11640 1 -- 172.21.15.99:0/474129927 shutdown_connections 2024-09-19T06:58:55.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.198+0000 7fd60fe11640 1 -- 172.21.15.99:0/474129927 wait complete. 2024-09-19T06:58:55.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.275+0000 7f02b0c29640 1 -- 172.21.15.99:0/1908307670 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f02ac102ef0 msgr2=0x7f02ac0fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:55.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.275+0000 7f02b0c29640 1 --2- 172.21.15.99:0/1908307670 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f02ac102ef0 0x7f02ac0fc5b0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f02a00048d0 tx=0x7f02a0009da0 comp rx=0 tx=0).stop 2024-09-19T06:58:55.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.275+0000 7f02b0c29640 1 -- 172.21.15.99:0/1908307670 shutdown_connections 2024-09-19T06:58:55.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.275+0000 7f02b0c29640 1 --2- 172.21.15.99:0/1908307670 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f02ac102ef0 0x7f02ac0fc5b0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:55.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.275+0000 7f02b0c29640 1 --2- 172.21.15.99:0/1908307670 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02ac102550 0x7f02ac102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:55.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.275+0000 7f02b0c29640 1 -- 172.21.15.99:0/1908307670 >> 172.21.15.99:0/1908307670 conn(0x7f02ac0f80f0 msgr2=0x7f02ac0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:58:55.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.276+0000 7f02b0c29640 1 -- 172.21.15.99:0/1908307670 shutdown_connections 2024-09-19T06:58:55.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.276+0000 7f02b0c29640 1 -- 172.21.15.99:0/1908307670 wait complete. 2024-09-19T06:58:55.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.276+0000 7f02b0c29640 1 Processor -- start 2024-09-19T06:58:55.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.276+0000 7f02b0c29640 1 -- start start 2024-09-19T06:58:55.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.276+0000 7f02b0c29640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f02ac102550 0x7f02ac06fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:55.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.276+0000 7f02b0c29640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02ac102ef0 0x7f02ac06ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:55.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.276+0000 7f02b0c29640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02ac070490 con 0x7f02ac102550 2024-09-19T06:58:55.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.276+0000 7f02b0c29640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02ac070600 con 0x7f02ac102ef0 2024-09-19T06:58:55.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.276+0000 7f02aa59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f02ac102550 0x7f02ac06fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:55.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.276+0000 7f02aa59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f02ac102550 0x7f02ac06fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59686/0 (socket says 172.21.15.99:59686) 2024-09-19T06:58:55.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.276+0000 7f02aa59c640 1 -- 172.21.15.99:0/2800256860 learned_addr learned my addr 172.21.15.99:0/2800256860 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:58:55.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.277+0000 7f02a9d9b640 1 --2- 172.21.15.99:0/2800256860 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02ac102ef0 0x7f02ac06ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:55.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.277+0000 7f02aa59c640 1 -- 172.21.15.99:0/2800256860 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02ac102ef0 msgr2=0x7f02ac06ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:55.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.277+0000 7f02aa59c640 1 --2- 172.21.15.99:0/2800256860 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02ac102ef0 0x7f02ac06ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:55.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.277+0000 7f02aa59c640 1 -- 172.21.15.99:0/2800256860 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a0005040 con 0x7f02ac102550 2024-09-19T06:58:55.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.277+0000 7f02aa59c640 1 --2- 172.21.15.99:0/2800256860 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f02ac102550 0x7f02ac06fa10 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f029c002a50 tx=0x7f029c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:55.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.277+0000 7f029affd640 1 -- 172.21.15.99:0/2800256860 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f029c007c30 con 0x7f02ac102550 2024-09-19T06:58:55.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.277+0000 7f02b0c29640 1 -- 172.21.15.99:0/2800256860 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02ac070890 con 0x7f02ac102550 2024-09-19T06:58:55.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.277+0000 7f029affd640 1 -- 172.21.15.99:0/2800256860 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f029c00f040 con 0x7f02ac102550 2024-09-19T06:58:55.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.277+0000 7f029affd640 1 -- 172.21.15.99:0/2800256860 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f029c00da10 con 0x7f02ac102550 2024-09-19T06:58:55.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.277+0000 7f02b0c29640 1 -- 172.21.15.99:0/2800256860 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02ac119c20 con 0x7f02ac102550 2024-09-19T06:58:55.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.279+0000 7f02b0c29640 1 -- 172.21.15.99:0/2800256860 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02ac0fdcd0 con 0x7f02ac102550 2024-09-19T06:58:55.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.279+0000 7f029affd640 1 -- 172.21.15.99:0/2800256860 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f029c00dbb0 con 0x7f02ac102550 2024-09-19T06:58:55.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.279+0000 7f029affd640 1 --2- 172.21.15.99:0/2800256860 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f029406e530 0x7f02940709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:55.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.279+0000 7f029affd640 1 -- 172.21.15.99:0/2800256860 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f029c08d8c0 con 0x7f02ac102550 2024-09-19T06:58:55.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.279+0000 7f02a9d9b640 1 --2- 172.21.15.99:0/2800256860 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f029406e530 0x7f02940709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:55.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.280+0000 7f02a9d9b640 1 --2- 172.21.15.99:0/2800256860 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f029406e530 0x7f02940709e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f02a00048a0 tx=0x7f02a0035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:55.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.284+0000 7f029affd640 1 -- 172.21.15.99:0/2800256860 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f029c056ae0 con 0x7f02ac102550 2024-09-19T06:58:55.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.456+0000 7f02b0c29640 1 -- 172.21.15.99:0/2800256860 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f02ac071100 con 0x7f029406e530 2024-09-19T06:58:55.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.465+0000 7f029affd640 1 -- 172.21.15.99:0/2800256860 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f02ac071100 con 0x7f029406e530 2024-09-19T06:58:55.466 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T06:58:55.466 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.smithi099 smithi099 *:9093,9094 running (17m) 10m ago 26m 23.4M - 0.25.0 c8568f914cd2 e7c1774d56b0 2024-09-19T06:58:55.466 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi099 smithi099 running (14m) 10m ago 26m 6899k - 19.1.1-361-g2f599a46 d2baa855c067 b9775f416b10 2024-09-19T06:58:55.466 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi117 smithi117 running (14m) 10m ago 25m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 38cf60c0d548 2024-09-19T06:58:55.466 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.smithi099 smithi099 *:3000 running (16m) 10m ago 26m 80.7M - 9.4.12 2bacad6d85d8 cd53a18d5410 2024-09-19T06:58:55.467 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.obarqf smithi099 running (10m) 10m ago 21m 12.2M - 19.1.1-361-g2f599a46 d2baa855c067 314a73082521 2024-09-19T06:58:55.467 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.xehbxe smithi099 running (10m) 10m ago 21m 14.4M - 19.1.1-361-g2f599a46 d2baa855c067 a2955a9d06e6 2024-09-19T06:58:55.467 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.bheqzh smithi117 running (10m) 10m ago 21m 11.8M - 19.1.1-361-g2f599a46 d2baa855c067 b1505937c0b7 2024-09-19T06:58:55.467 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.nooexo smithi117 running (10m) 10m ago 21m 13.1M - 19.1.1-361-g2f599a46 d2baa855c067 35bd7725855c 2024-09-19T06:58:55.467 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi099.pgvkqi smithi099 *:8443,9283,8765 running (17m) 10m ago 27m 505M - 19.1.1-361-g2f599a46 d2baa855c067 d5de99cb7e78 2024-09-19T06:58:55.467 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi117.ssmkcf smithi117 *:8443,9283,8765 running (16m) 10m ago 25m 444M - 19.1.1-361-g2f599a46 d2baa855c067 8b7ee0f871f5 2024-09-19T06:58:55.467 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi099 smithi099 running (15m) 10m ago 27m 52.4M 2048M 19.1.1-361-g2f599a46 d2baa855c067 ffe067438824 2024-09-19T06:58:55.467 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi117 smithi117 running (15m) 10m ago 25m 38.9M 2048M 19.1.1-361-g2f599a46 d2baa855c067 4cb7455e3ee7 2024-09-19T06:58:55.467 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi099 smithi099 *:9100 running (18m) 10m ago 26m 15.0M - 1.5.0 0da6a335fe13 dca7b4517dcc 2024-09-19T06:58:55.467 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi117 smithi117 *:9100 running (17m) 10m ago 25m 15.9M - 1.5.0 0da6a335fe13 8233ce3835d2 2024-09-19T06:58:55.467 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (14m) 10m ago 24m 100M 1557M 19.1.1-361-g2f599a46 d2baa855c067 8e22543bf933 2024-09-19T06:58:55.467 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (13m) 10m ago 24m 106M 1557M 19.1.1-361-g2f599a46 d2baa855c067 f54153d0ae09 2024-09-19T06:58:55.467 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (12m) 10m ago 23m 83.7M 1557M 19.1.1-361-g2f599a46 d2baa855c067 b1778ab88870 2024-09-19T06:58:55.468 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi117 running (12m) 10m ago 23m 102M 2581M 19.1.1-361-g2f599a46 d2baa855c067 ea5236b193d3 2024-09-19T06:58:55.468 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi117 running (11m) 10m ago 23m 93.5M 2581M 19.1.1-361-g2f599a46 d2baa855c067 27ac2c859a68 2024-09-19T06:58:55.468 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi117 running (11m) 10m ago 22m 100M 2581M 19.1.1-361-g2f599a46 d2baa855c067 de6aeb8544ce 2024-09-19T06:58:55.468 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.smithi099 smithi099 *:9095 running (16m) 10m ago 25m 64.4M - 2.43.0 a07b618ecd1d 15ad26ec6fb4 2024-09-19T06:58:55.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.467+0000 7f02b0c29640 1 -- 172.21.15.99:0/2800256860 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f029406e530 msgr2=0x7f02940709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:55.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.467+0000 7f02b0c29640 1 --2- 172.21.15.99:0/2800256860 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f029406e530 0x7f02940709e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f02a00048a0 tx=0x7f02a0035040 comp rx=0 tx=0).stop 2024-09-19T06:58:55.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.467+0000 7f02b0c29640 1 -- 172.21.15.99:0/2800256860 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f02ac102550 msgr2=0x7f02ac06fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:55.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.467+0000 7f02b0c29640 1 --2- 172.21.15.99:0/2800256860 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f02ac102550 0x7f02ac06fa10 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f029c002a50 tx=0x7f029c004600 comp rx=0 tx=0).stop 2024-09-19T06:58:55.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.467+0000 7f02b0c29640 1 -- 172.21.15.99:0/2800256860 shutdown_connections 2024-09-19T06:58:55.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.467+0000 7f02b0c29640 1 --2- 172.21.15.99:0/2800256860 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f029406e530 0x7f02940709e0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:55.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.467+0000 7f02b0c29640 1 --2- 172.21.15.99:0/2800256860 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f02ac102ef0 0x7f02ac06ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:55.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.467+0000 7f02b0c29640 1 --2- 172.21.15.99:0/2800256860 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f02ac102550 0x7f02ac06fa10 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:55.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.467+0000 7f02b0c29640 1 -- 172.21.15.99:0/2800256860 >> 172.21.15.99:0/2800256860 conn(0x7f02ac0f80f0 msgr2=0x7f02ac0f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:58:55.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.467+0000 7f02b0c29640 1 -- 172.21.15.99:0/2800256860 shutdown_connections 2024-09-19T06:58:55.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.467+0000 7f02b0c29640 1 -- 172.21.15.99:0/2800256860 wait complete. 2024-09-19T06:58:55.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.544+0000 7f630772e640 1 -- 172.21.15.99:0/2245675029 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63000fb4a0 msgr2=0x7f63000fb910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:55.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.544+0000 7f630772e640 1 --2- 172.21.15.99:0/2245675029 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63000fb4a0 0x7f63000fb910 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f62f4009c50 tx=0x7f62f4004d10 comp rx=0 tx=0).stop 2024-09-19T06:58:55.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.544+0000 7f630772e640 1 -- 172.21.15.99:0/2245675029 shutdown_connections 2024-09-19T06:58:55.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.544+0000 7f630772e640 1 --2- 172.21.15.99:0/2245675029 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63000fb4a0 0x7f63000fb910 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:55.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.544+0000 7f630772e640 1 --2- 172.21.15.99:0/2245675029 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63001014e0 0x7f63001018b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:55.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.544+0000 7f630772e640 1 -- 172.21.15.99:0/2245675029 >> 172.21.15.99:0/2245675029 conn(0x7f63000f7060 msgr2=0x7f63000f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:58:55.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.544+0000 7f630772e640 1 -- 172.21.15.99:0/2245675029 shutdown_connections 2024-09-19T06:58:55.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.544+0000 7f630772e640 1 -- 172.21.15.99:0/2245675029 wait complete. 2024-09-19T06:58:55.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.545+0000 7f630772e640 1 Processor -- start 2024-09-19T06:58:55.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.545+0000 7f630772e640 1 -- start start 2024-09-19T06:58:55.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.545+0000 7f630772e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63000fb4a0 0x7f630010bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:55.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.545+0000 7f630772e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63001014e0 0x7f630010c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:55.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.545+0000 7f630772e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f630010ca00 con 0x7f63001014e0 2024-09-19T06:58:55.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.545+0000 7f630772e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f630010cb40 con 0x7f63000fb4a0 2024-09-19T06:58:55.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.545+0000 7f6304cc9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63001014e0 0x7f630010c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:55.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.545+0000 7f6304cc9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63001014e0 0x7f630010c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45478/0 (socket says 172.21.15.99:45478) 2024-09-19T06:58:55.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.545+0000 7f6304cc9640 1 -- 172.21.15.99:0/2693827277 learned_addr learned my addr 172.21.15.99:0/2693827277 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:58:55.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.545+0000 7f63054ca640 1 --2- 172.21.15.99:0/2693827277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63000fb4a0 0x7f630010bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:55.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.546+0000 7f6304cc9640 1 -- 172.21.15.99:0/2693827277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63000fb4a0 msgr2=0x7f630010bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:55.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.546+0000 7f6304cc9640 1 --2- 172.21.15.99:0/2693827277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63000fb4a0 0x7f630010bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:55.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.546+0000 7f6304cc9640 1 -- 172.21.15.99:0/2693827277 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f40098b0 con 0x7f63001014e0 2024-09-19T06:58:55.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.546+0000 7f63054ca640 1 --2- 172.21.15.99:0/2693827277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63000fb4a0 0x7f630010bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T06:58:55.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.546+0000 7f6304cc9640 1 --2- 172.21.15.99:0/2693827277 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63001014e0 0x7f630010c4c0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f62f4004750 tx=0x7f62f4004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:55.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.546+0000 7f62fdffb640 1 -- 172.21.15.99:0/2693827277 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62f4009590 con 0x7f63001014e0 2024-09-19T06:58:55.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.546+0000 7f62fdffb640 1 -- 172.21.15.99:0/2693827277 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f62f40096f0 con 0x7f63001014e0 2024-09-19T06:58:55.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.546+0000 7f62fdffb640 1 -- 172.21.15.99:0/2693827277 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62f403d960 con 0x7f63001014e0 2024-09-19T06:58:55.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.546+0000 7f630772e640 1 -- 172.21.15.99:0/2693827277 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f630010cdc0 con 0x7f63001014e0 2024-09-19T06:58:55.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.546+0000 7f630772e640 1 -- 172.21.15.99:0/2693827277 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6300119920 con 0x7f63001014e0 2024-09-19T06:58:55.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.547+0000 7f630772e640 1 -- 172.21.15.99:0/2693827277 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63000fcbe0 con 0x7f63001014e0 2024-09-19T06:58:55.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.548+0000 7f62fdffb640 1 -- 172.21.15.99:0/2693827277 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f62f402f030 con 0x7f63001014e0 2024-09-19T06:58:55.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.548+0000 7f62fdffb640 1 --2- 172.21.15.99:0/2693827277 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f62e806e530 0x7f62e80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:55.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.548+0000 7f62fdffb640 1 -- 172.21.15.99:0/2693827277 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f62f40af420 con 0x7f63001014e0 2024-09-19T06:58:55.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.548+0000 7f63054ca640 1 --2- 172.21.15.99:0/2693827277 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f62e806e530 0x7f62e80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:55.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.549+0000 7f63054ca640 1 --2- 172.21.15.99:0/2693827277 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f62e806e530 0x7f62e80709e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f62f8004fd0 tx=0x7f62f800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:55.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.553+0000 7f62fdffb640 1 -- 172.21.15.99:0/2693827277 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f62f4078650 con 0x7f63001014e0 2024-09-19T06:58:55.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.785+0000 7f630772e640 1 -- 172.21.15.99:0/2693827277 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f63000fac60 con 0x7f63001014e0 2024-09-19T06:58:55.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.785+0000 7f62fdffb640 1 -- 172.21.15.99:0/2693827277 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f62f407bd10 con 0x7f63001014e0 2024-09-19T06:58:55.787 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:58:55.787 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-09-19T06:58:55.787 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T06:58:55.787 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:58:55.787 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-09-19T06:58:55.787 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T06:58:55.787 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:58:55.787 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-09-19T06:58:55.787 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 6 2024-09-19T06:58:55.787 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:58:55.787 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": { 2024-09-19T06:58:55.787 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 4 2024-09-19T06:58:55.788 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:58:55.788 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-09-19T06:58:55.788 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 14 2024-09-19T06:58:55.788 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T06:58:55.788 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:58:55.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.787+0000 7f630772e640 1 -- 172.21.15.99:0/2693827277 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f62e806e530 msgr2=0x7f62e80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:55.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.787+0000 7f630772e640 1 --2- 172.21.15.99:0/2693827277 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f62e806e530 0x7f62e80709e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f62f8004fd0 tx=0x7f62f800b040 comp rx=0 tx=0).stop 2024-09-19T06:58:55.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.787+0000 7f630772e640 1 -- 172.21.15.99:0/2693827277 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63001014e0 msgr2=0x7f630010c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:55.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.787+0000 7f630772e640 1 --2- 172.21.15.99:0/2693827277 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63001014e0 0x7f630010c4c0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f62f4004750 tx=0x7f62f4004d10 comp rx=0 tx=0).stop 2024-09-19T06:58:55.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.787+0000 7f630772e640 1 -- 172.21.15.99:0/2693827277 shutdown_connections 2024-09-19T06:58:55.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.787+0000 7f630772e640 1 --2- 172.21.15.99:0/2693827277 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f62e806e530 0x7f62e80709e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:55.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.787+0000 7f630772e640 1 --2- 172.21.15.99:0/2693827277 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f63001014e0 0x7f630010c4c0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:55.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.787+0000 7f630772e640 1 --2- 172.21.15.99:0/2693827277 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63000fb4a0 0x7f630010bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:55.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.787+0000 7f630772e640 1 -- 172.21.15.99:0/2693827277 >> 172.21.15.99:0/2693827277 conn(0x7f63000f7060 msgr2=0x7f63000f8910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:58:55.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.788+0000 7f630772e640 1 -- 172.21.15.99:0/2693827277 shutdown_connections 2024-09-19T06:58:55.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.788+0000 7f630772e640 1 -- 172.21.15.99:0/2693827277 wait complete. 2024-09-19T06:58:55.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.865+0000 7f98c5445640 1 -- 172.21.15.99:0/1598568082 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98c0064fe0 msgr2=0x7f98c00653b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:55.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.865+0000 7f98c5445640 1 --2- 172.21.15.99:0/1598568082 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98c0064fe0 0x7f98c00653b0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f98b00048d0 tx=0x7f98b0009da0 comp rx=0 tx=0).stop 2024-09-19T06:58:55.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.866+0000 7f98c5445640 1 -- 172.21.15.99:0/1598568082 shutdown_connections 2024-09-19T06:58:55.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.866+0000 7f98c5445640 1 --2- 172.21.15.99:0/1598568082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98c00658f0 0x7f98c0108b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:55.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.866+0000 7f98c5445640 1 --2- 172.21.15.99:0/1598568082 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98c0064fe0 0x7f98c00653b0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:55.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.866+0000 7f98c5445640 1 -- 172.21.15.99:0/1598568082 >> 172.21.15.99:0/1598568082 conn(0x7f98c00723b0 msgr2=0x7f98c00727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:58:55.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.866+0000 7f98c5445640 1 -- 172.21.15.99:0/1598568082 shutdown_connections 2024-09-19T06:58:55.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.866+0000 7f98c5445640 1 -- 172.21.15.99:0/1598568082 wait complete. 2024-09-19T06:58:55.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.866+0000 7f98c5445640 1 Processor -- start 2024-09-19T06:58:55.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.866+0000 7f98c5445640 1 -- start start 2024-09-19T06:58:55.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.867+0000 7f98c5445640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98c0064fe0 0x7f98c01153f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:55.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.867+0000 7f98c5445640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98c00658f0 0x7f98c0115930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:55.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.867+0000 7f98c5445640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98c0115f30 con 0x7f98c0064fe0 2024-09-19T06:58:55.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.867+0000 7f98c5445640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98c01160a0 con 0x7f98c00658f0 2024-09-19T06:58:55.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.867+0000 7f98beffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98c0064fe0 0x7f98c01153f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:55.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.867+0000 7f98beffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98c0064fe0 0x7f98c01153f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45488/0 (socket says 172.21.15.99:45488) 2024-09-19T06:58:55.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.867+0000 7f98beffd640 1 -- 172.21.15.99:0/298705647 learned_addr learned my addr 172.21.15.99:0/298705647 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:58:55.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.867+0000 7f98b67fc640 1 --2- 172.21.15.99:0/298705647 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98c00658f0 0x7f98c0115930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:55.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.867+0000 7f98beffd640 1 -- 172.21.15.99:0/298705647 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98c00658f0 msgr2=0x7f98c0115930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:55.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.867+0000 7f98beffd640 1 --2- 172.21.15.99:0/298705647 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98c00658f0 0x7f98c0115930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:55.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.867+0000 7f98beffd640 1 -- 172.21.15.99:0/298705647 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98b0005040 con 0x7f98c0064fe0 2024-09-19T06:58:55.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.867+0000 7f98beffd640 1 --2- 172.21.15.99:0/298705647 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98c0064fe0 0x7f98c01153f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f98b0003080 tx=0x7f98b0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:55.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.867+0000 7f98b7fff640 1 -- 172.21.15.99:0/298705647 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98b0038070 con 0x7f98c0064fe0 2024-09-19T06:58:55.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.867+0000 7f98c5445640 1 -- 172.21.15.99:0/298705647 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98c010f510 con 0x7f98c0064fe0 2024-09-19T06:58:55.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.868+0000 7f98b7fff640 1 -- 172.21.15.99:0/298705647 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f98b00097e0 con 0x7f98c0064fe0 2024-09-19T06:58:55.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.868+0000 7f98c5445640 1 -- 172.21.15.99:0/298705647 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98c010f9d0 con 0x7f98c0064fe0 2024-09-19T06:58:55.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.868+0000 7f98b7fff640 1 -- 172.21.15.99:0/298705647 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98b003d420 con 0x7f98c0064fe0 2024-09-19T06:58:55.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.868+0000 7f98c5445640 1 -- 172.21.15.99:0/298705647 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98c00fbad0 con 0x7f98c0064fe0 2024-09-19T06:58:55.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.869+0000 7f98b7fff640 1 -- 172.21.15.99:0/298705647 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f98b0030020 con 0x7f98c0064fe0 2024-09-19T06:58:55.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.870+0000 7f98b7fff640 1 --2- 172.21.15.99:0/298705647 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f98ac06e530 0x7f98ac0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:55.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.870+0000 7f98b7fff640 1 -- 172.21.15.99:0/298705647 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f98b00ae5e0 con 0x7f98c0064fe0 2024-09-19T06:58:55.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.870+0000 7f98b67fc640 1 --2- 172.21.15.99:0/298705647 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f98ac06e530 0x7f98ac0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:55.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.870+0000 7f98b67fc640 1 --2- 172.21.15.99:0/298705647 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f98ac06e530 0x7f98ac0709e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f98c0110cf0 tx=0x7f98a8009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:55.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:55.874+0000 7f98b7fff640 1 -- 172.21.15.99:0/298705647 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f98b0077750 con 0x7f98c0064fe0 2024-09-19T06:58:56.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.076+0000 7f98c5445640 1 -- 172.21.15.99:0/298705647 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f98c0110aa0 con 0x7f98c0064fe0 2024-09-19T06:58:56.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.076+0000 7f98b7fff640 1 -- 172.21.15.99:0/298705647 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 29 v29) v1 ==== 76+0+1915 (secure 0 0 0) 0x7f98b007ae10 con 0x7f98c0064fe0 2024-09-19T06:58:56.078 INFO:teuthology.orchestra.run.smithi099.stdout:e29 2024-09-19T06:58:56.078 INFO:teuthology.orchestra.run.smithi099.stdout:btime 2024-09-19T06:48:47:938420+0000 2024-09-19T06:58:56.078 INFO:teuthology.orchestra.run.smithi099.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T06:58:56.078 INFO:teuthology.orchestra.run.smithi099.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T06:58:56.078 INFO:teuthology.orchestra.run.smithi099.stdout:legacy client fscid: 1 2024-09-19T06:58:56.078 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:58:56.078 INFO:teuthology.orchestra.run.smithi099.stdout:Filesystem 'cephfs' (1) 2024-09-19T06:58:56.078 INFO:teuthology.orchestra.run.smithi099.stdout:fs_name cephfs 2024-09-19T06:58:56.078 INFO:teuthology.orchestra.run.smithi099.stdout:epoch 20 2024-09-19T06:58:56.078 INFO:teuthology.orchestra.run.smithi099.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-19T06:58:56.078 INFO:teuthology.orchestra.run.smithi099.stdout:created 2024-09-19T06:37:40.838146+0000 2024-09-19T06:58:56.079 INFO:teuthology.orchestra.run.smithi099.stdout:modified 2024-09-19T06:47:50.076553+0000 2024-09-19T06:58:56.079 INFO:teuthology.orchestra.run.smithi099.stdout:tableserver 0 2024-09-19T06:58:56.079 INFO:teuthology.orchestra.run.smithi099.stdout:root 0 2024-09-19T06:58:56.079 INFO:teuthology.orchestra.run.smithi099.stdout:session_timeout 60 2024-09-19T06:58:56.079 INFO:teuthology.orchestra.run.smithi099.stdout:session_autoclose 300 2024-09-19T06:58:56.079 INFO:teuthology.orchestra.run.smithi099.stdout:max_file_size 1099511627776 2024-09-19T06:58:56.079 INFO:teuthology.orchestra.run.smithi099.stdout:max_xattr_size 65536 2024-09-19T06:58:56.079 INFO:teuthology.orchestra.run.smithi099.stdout:required_client_features {} 2024-09-19T06:58:56.079 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure 0 2024-09-19T06:58:56.079 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure_osd_epoch 77 2024-09-19T06:58:56.079 INFO:teuthology.orchestra.run.smithi099.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T06:58:56.079 INFO:teuthology.orchestra.run.smithi099.stdout:max_mds 2 2024-09-19T06:58:56.079 INFO:teuthology.orchestra.run.smithi099.stdout:in 0,1 2024-09-19T06:58:56.079 INFO:teuthology.orchestra.run.smithi099.stdout:up {} 2024-09-19T06:58:56.080 INFO:teuthology.orchestra.run.smithi099.stdout:failed 0,1 2024-09-19T06:58:56.080 INFO:teuthology.orchestra.run.smithi099.stdout:damaged 2024-09-19T06:58:56.080 INFO:teuthology.orchestra.run.smithi099.stdout:stopped 2024-09-19T06:58:56.080 INFO:teuthology.orchestra.run.smithi099.stdout:data_pools [3] 2024-09-19T06:58:56.080 INFO:teuthology.orchestra.run.smithi099.stdout:metadata_pool 2 2024-09-19T06:58:56.080 INFO:teuthology.orchestra.run.smithi099.stdout:inline_data disabled 2024-09-19T06:58:56.080 INFO:teuthology.orchestra.run.smithi099.stdout:balancer 2024-09-19T06:58:56.080 INFO:teuthology.orchestra.run.smithi099.stdout:bal_rank_mask -1 2024-09-19T06:58:56.080 INFO:teuthology.orchestra.run.smithi099.stdout:standby_count_wanted 1 2024-09-19T06:58:56.080 INFO:teuthology.orchestra.run.smithi099.stdout:qdb_cluster leader: 0 members: 2024-09-19T06:58:56.080 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:58:56.080 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:58:56.080 INFO:teuthology.orchestra.run.smithi099.stdout:Standby daemons: 2024-09-19T06:58:56.081 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:58:56.081 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.obarqf{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6826/1859154203,v1:172.21.15.99:6827/1859154203] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:58:56.081 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.xehbxe{-1:34410} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6828/1939453719,v1:172.21.15.99:6829/1939453719] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:58:56.081 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.nooexo{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6824/1398895079,v1:172.21.15.117:6825/1398895079] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:58:56.081 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.bheqzh{-1:44329} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6826/3233337308,v1:172.21.15.117:6827/3233337308] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:58:56.082 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 29 2024-09-19T06:58:56.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.079+0000 7f98c5445640 1 -- 172.21.15.99:0/298705647 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f98ac06e530 msgr2=0x7f98ac0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:56.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.079+0000 7f98c5445640 1 --2- 172.21.15.99:0/298705647 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f98ac06e530 0x7f98ac0709e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f98c0110cf0 tx=0x7f98a8009040 comp rx=0 tx=0).stop 2024-09-19T06:58:56.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.079+0000 7f98c5445640 1 -- 172.21.15.99:0/298705647 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98c0064fe0 msgr2=0x7f98c01153f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:56.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.079+0000 7f98c5445640 1 --2- 172.21.15.99:0/298705647 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98c0064fe0 0x7f98c01153f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f98b0003080 tx=0x7f98b0009da0 comp rx=0 tx=0).stop 2024-09-19T06:58:56.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.079+0000 7f98c5445640 1 -- 172.21.15.99:0/298705647 shutdown_connections 2024-09-19T06:58:56.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.079+0000 7f98c5445640 1 --2- 172.21.15.99:0/298705647 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f98ac06e530 0x7f98ac0709e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:56.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.079+0000 7f98c5445640 1 --2- 172.21.15.99:0/298705647 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98c00658f0 0x7f98c0115930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:56.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.079+0000 7f98c5445640 1 --2- 172.21.15.99:0/298705647 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98c0064fe0 0x7f98c01153f0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:56.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.079+0000 7f98c5445640 1 -- 172.21.15.99:0/298705647 >> 172.21.15.99:0/298705647 conn(0x7f98c00723b0 msgr2=0x7f98c0103ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:58:56.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.079+0000 7f98c5445640 1 -- 172.21.15.99:0/298705647 shutdown_connections 2024-09-19T06:58:56.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.079+0000 7f98c5445640 1 -- 172.21.15.99:0/298705647 wait complete. 2024-09-19T06:58:56.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.160+0000 7f46c99df640 1 -- 172.21.15.99:0/1078690938 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46c4102680 msgr2=0x7f46c4102a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:56.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.160+0000 7f46c99df640 1 --2- 172.21.15.99:0/1078690938 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46c4102680 0x7f46c4102a50 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f46b40048d0 tx=0x7f46b4009da0 comp rx=0 tx=0).stop 2024-09-19T06:58:56.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.160+0000 7f46c99df640 1 -- 172.21.15.99:0/1078690938 shutdown_connections 2024-09-19T06:58:56.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.160+0000 7f46c99df640 1 --2- 172.21.15.99:0/1078690938 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46c40facf0 0x7f46c40fb160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:56.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.160+0000 7f46c99df640 1 --2- 172.21.15.99:0/1078690938 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46c4102680 0x7f46c4102a50 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:56.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.160+0000 7f46c99df640 1 -- 172.21.15.99:0/1078690938 >> 172.21.15.99:0/1078690938 conn(0x7f46c4070d50 msgr2=0x7f46c4071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:58:56.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.160+0000 7f46c99df640 1 -- 172.21.15.99:0/1078690938 shutdown_connections 2024-09-19T06:58:56.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.160+0000 7f46c99df640 1 -- 172.21.15.99:0/1078690938 wait complete. 2024-09-19T06:58:56.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.161+0000 7f46c99df640 1 Processor -- start 2024-09-19T06:58:56.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.161+0000 7f46c99df640 1 -- start start 2024-09-19T06:58:56.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.161+0000 7f46c99df640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46c40facf0 0x7f46c4115480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:56.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.161+0000 7f46c99df640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46c4102680 0x7f46c41159c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:56.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.161+0000 7f46c99df640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c4115fc0 con 0x7f46c4102680 2024-09-19T06:58:56.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.161+0000 7f46c99df640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c410f440 con 0x7f46c40facf0 2024-09-19T06:58:56.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.161+0000 7f46c27fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46c4102680 0x7f46c41159c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:56.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.161+0000 7f46c27fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46c4102680 0x7f46c41159c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45508/0 (socket says 172.21.15.99:45508) 2024-09-19T06:58:56.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.161+0000 7f46c27fc640 1 -- 172.21.15.99:0/2052789741 learned_addr learned my addr 172.21.15.99:0/2052789741 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:58:56.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.161+0000 7f46c2ffd640 1 --2- 172.21.15.99:0/2052789741 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46c40facf0 0x7f46c4115480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:56.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.161+0000 7f46c27fc640 1 -- 172.21.15.99:0/2052789741 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46c40facf0 msgr2=0x7f46c4115480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:56.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.161+0000 7f46c27fc640 1 --2- 172.21.15.99:0/2052789741 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46c40facf0 0x7f46c4115480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:56.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.161+0000 7f46c27fc640 1 -- 172.21.15.99:0/2052789741 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b4005040 con 0x7f46c4102680 2024-09-19T06:58:56.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.161+0000 7f46c2ffd640 1 --2- 172.21.15.99:0/2052789741 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46c40facf0 0x7f46c4115480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:58:56.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.161+0000 7f46c27fc640 1 --2- 172.21.15.99:0/2052789741 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46c4102680 0x7f46c41159c0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f46b8002a50 tx=0x7f46b8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:56.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.162+0000 7f46ab7fe640 1 -- 172.21.15.99:0/2052789741 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46b8007c30 con 0x7f46c4102680 2024-09-19T06:58:56.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.162+0000 7f46ab7fe640 1 -- 172.21.15.99:0/2052789741 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f46b800f040 con 0x7f46c4102680 2024-09-19T06:58:56.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.162+0000 7f46c99df640 1 -- 172.21.15.99:0/2052789741 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46c410f720 con 0x7f46c4102680 2024-09-19T06:58:56.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.162+0000 7f46ab7fe640 1 -- 172.21.15.99:0/2052789741 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46b800da90 con 0x7f46c4102680 2024-09-19T06:58:56.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.162+0000 7f46c99df640 1 -- 172.21.15.99:0/2052789741 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46c410fc40 con 0x7f46c4102680 2024-09-19T06:58:56.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.163+0000 7f46c99df640 1 -- 172.21.15.99:0/2052789741 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46c40657f0 con 0x7f46c4102680 2024-09-19T06:58:56.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.163+0000 7f46ab7fe640 1 -- 172.21.15.99:0/2052789741 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f46b800dc30 con 0x7f46c4102680 2024-09-19T06:58:56.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.163+0000 7f46ab7fe640 1 --2- 172.21.15.99:0/2052789741 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f46ac06e530 0x7f46ac0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:56.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.164+0000 7f46ab7fe640 1 -- 172.21.15.99:0/2052789741 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f46b808d9c0 con 0x7f46c4102680 2024-09-19T06:58:56.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.164+0000 7f46c2ffd640 1 --2- 172.21.15.99:0/2052789741 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f46ac06e530 0x7f46ac0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:56.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.164+0000 7f46c2ffd640 1 --2- 172.21.15.99:0/2052789741 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f46ac06e530 0x7f46ac0709e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f46b4007ac0 tx=0x7f46b4035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:56.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.168+0000 7f46ab7fe640 1 -- 172.21.15.99:0/2052789741 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f46b8056b30 con 0x7f46c4102680 2024-09-19T06:58:56.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.351+0000 7f46c99df640 1 -- 172.21.15.99:0/2052789741 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f46c41096a0 con 0x7f46ac06e530 2024-09-19T06:58:56.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.352+0000 7f46ab7fe640 1 -- 172.21.15.99:0/2052789741 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f46c41096a0 con 0x7f46ac06e530 2024-09-19T06:58:56.353 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:58:56.353 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T06:58:56.353 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": true, 2024-09-19T06:58:56.353 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T06:58:56.354 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [ 2024-09-19T06:58:56.354 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr", 2024-09-19T06:58:56.354 INFO:teuthology.orchestra.run.smithi099.stdout: "crash", 2024-09-19T06:58:56.354 INFO:teuthology.orchestra.run.smithi099.stdout: "mds", 2024-09-19T06:58:56.354 INFO:teuthology.orchestra.run.smithi099.stdout: "mon", 2024-09-19T06:58:56.354 INFO:teuthology.orchestra.run.smithi099.stdout: "osd" 2024-09-19T06:58:56.354 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-19T06:58:56.354 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": "16/21 daemons upgraded", 2024-09-19T06:58:56.354 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "Currently upgrading mds daemons", 2024-09-19T06:58:56.354 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-09-19T06:58:56.354 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:58:56.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.354+0000 7f46c99df640 1 -- 172.21.15.99:0/2052789741 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f46ac06e530 msgr2=0x7f46ac0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:56.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.354+0000 7f46c99df640 1 --2- 172.21.15.99:0/2052789741 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f46ac06e530 0x7f46ac0709e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f46b4007ac0 tx=0x7f46b4035040 comp rx=0 tx=0).stop 2024-09-19T06:58:56.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.354+0000 7f46c99df640 1 -- 172.21.15.99:0/2052789741 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46c4102680 msgr2=0x7f46c41159c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:56.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.354+0000 7f46c99df640 1 --2- 172.21.15.99:0/2052789741 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46c4102680 0x7f46c41159c0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f46b8002a50 tx=0x7f46b8004600 comp rx=0 tx=0).stop 2024-09-19T06:58:56.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.354+0000 7f46c99df640 1 -- 172.21.15.99:0/2052789741 shutdown_connections 2024-09-19T06:58:56.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.354+0000 7f46c99df640 1 --2- 172.21.15.99:0/2052789741 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f46ac06e530 0x7f46ac0709e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:56.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.354+0000 7f46c99df640 1 --2- 172.21.15.99:0/2052789741 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46c4102680 0x7f46c41159c0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:56.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.354+0000 7f46c99df640 1 --2- 172.21.15.99:0/2052789741 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46c40facf0 0x7f46c4115480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:56.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.354+0000 7f46c99df640 1 -- 172.21.15.99:0/2052789741 >> 172.21.15.99:0/2052789741 conn(0x7f46c4070d50 msgr2=0x7f46c40fc790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:58:56.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.354+0000 7f46c99df640 1 -- 172.21.15.99:0/2052789741 shutdown_connections 2024-09-19T06:58:56.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.354+0000 7f46c99df640 1 -- 172.21.15.99:0/2052789741 wait complete. 2024-09-19T06:58:56.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.433+0000 7f21c5f04640 1 -- 172.21.15.99:0/3770458087 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21c01014c0 msgr2=0x7f21c0101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:56.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.433+0000 7f21c5f04640 1 --2- 172.21.15.99:0/3770458087 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21c01014c0 0x7f21c0101890 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f21b00048d0 tx=0x7f21b0009da0 comp rx=0 tx=0).stop 2024-09-19T06:58:56.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.433+0000 7f21c5f04640 1 -- 172.21.15.99:0/3770458087 shutdown_connections 2024-09-19T06:58:56.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.433+0000 7f21c5f04640 1 --2- 172.21.15.99:0/3770458087 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21c00fb480 0x7f21c00fb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:56.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.433+0000 7f21c5f04640 1 --2- 172.21.15.99:0/3770458087 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21c01014c0 0x7f21c0101890 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:56.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.433+0000 7f21c5f04640 1 -- 172.21.15.99:0/3770458087 >> 172.21.15.99:0/3770458087 conn(0x7f21c00f7000 msgr2=0x7f21c00f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:58:56.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.433+0000 7f21c5f04640 1 -- 172.21.15.99:0/3770458087 shutdown_connections 2024-09-19T06:58:56.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.433+0000 7f21c5f04640 1 -- 172.21.15.99:0/3770458087 wait complete. 2024-09-19T06:58:56.435 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:58:56 smithi099 ceph-mon[97031]: from='client.34950 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:58:56.435 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:58:56 smithi099 ceph-mon[97031]: pgmap v497: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:58:56.435 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:58:56 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/2693827277' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:58:56.436 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:58:56 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/298705647' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:58:56.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.433+0000 7f21c5f04640 1 Processor -- start 2024-09-19T06:58:56.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.434+0000 7f21c5f04640 1 -- start start 2024-09-19T06:58:56.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.434+0000 7f21c5f04640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21c00fb480 0x7f21c010e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:56.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.434+0000 7f21c5f04640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21c01014c0 0x7f21c010e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:56.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.434+0000 7f21c5f04640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c010ee00 con 0x7f21c00fb480 2024-09-19T06:58:56.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.434+0000 7f21c5f04640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c010ef70 con 0x7f21c01014c0 2024-09-19T06:58:56.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.434+0000 7f21bf7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21c00fb480 0x7f21c010e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:56.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.434+0000 7f21bf7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21c00fb480 0x7f21c010e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45530/0 (socket says 172.21.15.99:45530) 2024-09-19T06:58:56.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.434+0000 7f21bf7fe640 1 -- 172.21.15.99:0/569269123 learned_addr learned my addr 172.21.15.99:0/569269123 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:58:56.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.434+0000 7f21beffd640 1 --2- 172.21.15.99:0/569269123 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21c01014c0 0x7f21c010e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:56.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.434+0000 7f21bf7fe640 1 -- 172.21.15.99:0/569269123 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21c01014c0 msgr2=0x7f21c010e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:56.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.434+0000 7f21bf7fe640 1 --2- 172.21.15.99:0/569269123 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21c01014c0 0x7f21c010e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:56.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.434+0000 7f21bf7fe640 1 -- 172.21.15.99:0/569269123 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b0005040 con 0x7f21c00fb480 2024-09-19T06:58:56.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.434+0000 7f21beffd640 1 --2- 172.21.15.99:0/569269123 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21c01014c0 0x7f21c010e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:58:56.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.435+0000 7f21bf7fe640 1 --2- 172.21.15.99:0/569269123 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21c00fb480 0x7f21c010e1e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f21b0003080 tx=0x7f21b0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:56.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.435+0000 7f21a7fff640 1 -- 172.21.15.99:0/569269123 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21b0038070 con 0x7f21c00fb480 2024-09-19T06:58:56.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.435+0000 7f21a7fff640 1 -- 172.21.15.99:0/569269123 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f21b002ade0 con 0x7f21c00fb480 2024-09-19T06:58:56.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.435+0000 7f21c5f04640 1 -- 172.21.15.99:0/569269123 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21c0117250 con 0x7f21c00fb480 2024-09-19T06:58:56.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.435+0000 7f21a7fff640 1 -- 172.21.15.99:0/569269123 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21b002c880 con 0x7f21c00fb480 2024-09-19T06:58:56.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.435+0000 7f21c5f04640 1 -- 172.21.15.99:0/569269123 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21c0117660 con 0x7f21c00fb480 2024-09-19T06:58:56.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.436+0000 7f21c5f04640 1 -- 172.21.15.99:0/569269123 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21c00fcbc0 con 0x7f21c00fb480 2024-09-19T06:58:56.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.436+0000 7f21a7fff640 1 -- 172.21.15.99:0/569269123 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f21b0030020 con 0x7f21c00fb480 2024-09-19T06:58:56.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.437+0000 7f21a7fff640 1 --2- 172.21.15.99:0/569269123 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f21a806e530 0x7f21a80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:58:56.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.437+0000 7f21a7fff640 1 -- 172.21.15.99:0/569269123 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f21b00ae180 con 0x7f21c00fb480 2024-09-19T06:58:56.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.437+0000 7f21beffd640 1 --2- 172.21.15.99:0/569269123 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f21a806e530 0x7f21a80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:58:56.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.438+0000 7f21beffd640 1 --2- 172.21.15.99:0/569269123 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f21a806e530 0x7f21a80709e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f21b4006fd0 tx=0x7f21b4008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:58:56.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.441+0000 7f21a7fff640 1 -- 172.21.15.99:0/569269123 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f21b00772f0 con 0x7f21c00fb480 2024-09-19T06:58:56.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:58:56 smithi117 ceph-mon[76771]: from='client.34950 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:58:56.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:58:56 smithi117 ceph-mon[76771]: pgmap v497: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:58:56.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:58:56 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/2693827277' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:58:56.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:58:56 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/298705647' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:58:56.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.669+0000 7f21c5f04640 1 -- 172.21.15.99:0/569269123 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f21c00fac40 con 0x7f21c00fb480 2024-09-19T06:58:56.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.670+0000 7f21a7fff640 1 -- 172.21.15.99:0/569269123 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7f21b007a9b0 con 0x7f21c00fb480 2024-09-19T06:58:56.671 INFO:teuthology.orchestra.run.smithi099.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-09-19T06:58:56.671 INFO:teuthology.orchestra.run.smithi099.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-19T06:58:56.671 INFO:teuthology.orchestra.run.smithi099.stdout: fs cephfs is degraded 2024-09-19T06:58:56.671 INFO:teuthology.orchestra.run.smithi099.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-19T06:58:56.671 INFO:teuthology.orchestra.run.smithi099.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-19T06:58:56.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.672+0000 7f21c5f04640 1 -- 172.21.15.99:0/569269123 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f21a806e530 msgr2=0x7f21a80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:56.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.672+0000 7f21c5f04640 1 --2- 172.21.15.99:0/569269123 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f21a806e530 0x7f21a80709e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f21b4006fd0 tx=0x7f21b4008040 comp rx=0 tx=0).stop 2024-09-19T06:58:56.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.672+0000 7f21c5f04640 1 -- 172.21.15.99:0/569269123 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21c00fb480 msgr2=0x7f21c010e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:58:56.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.672+0000 7f21c5f04640 1 --2- 172.21.15.99:0/569269123 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21c00fb480 0x7f21c010e1e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f21b0003080 tx=0x7f21b0009da0 comp rx=0 tx=0).stop 2024-09-19T06:58:56.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.672+0000 7f21c5f04640 1 -- 172.21.15.99:0/569269123 shutdown_connections 2024-09-19T06:58:56.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.672+0000 7f21c5f04640 1 --2- 172.21.15.99:0/569269123 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f21a806e530 0x7f21a80709e0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:56.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.672+0000 7f21c5f04640 1 --2- 172.21.15.99:0/569269123 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21c01014c0 0x7f21c010e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:56.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.672+0000 7f21c5f04640 1 --2- 172.21.15.99:0/569269123 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21c00fb480 0x7f21c010e1e0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:58:56.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.672+0000 7f21c5f04640 1 -- 172.21.15.99:0/569269123 >> 172.21.15.99:0/569269123 conn(0x7f21c00f7000 msgr2=0x7f21c00f88b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:58:56.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.672+0000 7f21c5f04640 1 -- 172.21.15.99:0/569269123 shutdown_connections 2024-09-19T06:58:56.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:58:56.672+0000 7f21c5f04640 1 -- 172.21.15.99:0/569269123 wait complete. 2024-09-19T06:58:57.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:58:57 smithi099 ceph-mon[97031]: from='client.34954 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:58:57.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:58:57 smithi099 ceph-mon[97031]: from='client.34958 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:58:57.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:58:57 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/569269123' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T06:58:57.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:58:57 smithi117 ceph-mon[76771]: from='client.34954 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:58:57.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:58:57 smithi117 ceph-mon[76771]: from='client.34958 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:58:57.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:58:57 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/569269123' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T06:58:58.458 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:58:58 smithi099 ceph-mon[97031]: from='client.34970 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:58:58.574 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:58:58 smithi099 ceph-mon[97031]: pgmap v498: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:58:58.574 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:58:58 smithi117 ceph-mon[76771]: from='client.34970 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:58:58.574 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:58:58 smithi117 ceph-mon[76771]: pgmap v498: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:59:00.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:59:00 smithi099 ceph-mon[97031]: pgmap v499: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:59:00.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:59:00 smithi117 ceph-mon[76771]: pgmap v499: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:59:02.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:59:02 smithi099 ceph-mon[97031]: pgmap v500: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:59:02.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:59:02 smithi117 ceph-mon[76771]: pgmap v500: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:59:03.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:59:03 smithi099 ceph-mon[97031]: pgmap v501: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:59:03.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:59:03 smithi117 ceph-mon[76771]: pgmap v501: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:59:06.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:59:06 smithi099 ceph-mon[97031]: pgmap v502: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:59:06.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:59:06 smithi117 ceph-mon[76771]: pgmap v502: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:59:07.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:59:07 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:59:07.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:59:07 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:59:08.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:59:08 smithi099 ceph-mon[97031]: pgmap v503: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:59:08.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:59:08 smithi117 ceph-mon[76771]: pgmap v503: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:59:10.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:59:10 smithi099 ceph-mon[97031]: pgmap v504: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:59:10.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:59:10 smithi117 ceph-mon[76771]: pgmap v504: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:59:12.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:59:12 smithi099 ceph-mon[97031]: pgmap v505: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:59:12.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:59:12 smithi117 ceph-mon[76771]: pgmap v505: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:59:14.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:59:14 smithi099 ceph-mon[97031]: pgmap v506: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:59:14.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:59:14 smithi117 ceph-mon[76771]: pgmap v506: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:59:16.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:59:16 smithi099 ceph-mon[97031]: pgmap v507: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:59:16.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:59:16 smithi117 ceph-mon[76771]: pgmap v507: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:59:18.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:59:18 smithi099 ceph-mon[97031]: pgmap v508: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:59:18.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:59:18 smithi117 ceph-mon[76771]: pgmap v508: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:59:20.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:59:20 smithi099 ceph-mon[97031]: pgmap v509: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:59:20.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:59:20 smithi117 ceph-mon[76771]: pgmap v509: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:59:22.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:59:22 smithi099 ceph-mon[97031]: pgmap v510: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:59:22.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:59:22 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:59:22.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:59:22 smithi117 ceph-mon[76771]: pgmap v510: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:59:22.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:59:22 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:59:24.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:59:24 smithi099 ceph-mon[97031]: pgmap v511: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:59:24.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:59:24 smithi117 ceph-mon[76771]: pgmap v511: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:59:26.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:59:26 smithi099 ceph-mon[97031]: pgmap v512: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:59:26.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:59:26 smithi117 ceph-mon[76771]: pgmap v512: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:59:26.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:26.762+0000 7f564498e640 1 -- 172.21.15.99:0/1206476190 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f56401014d0 msgr2=0x7f56401018a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:26.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:26.762+0000 7f564498e640 1 --2- 172.21.15.99:0/1206476190 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f56401014d0 0x7f56401018a0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f56300048d0 tx=0x7f5630009da0 comp rx=0 tx=0).stop 2024-09-19T06:59:26.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:26.762+0000 7f564498e640 1 -- 172.21.15.99:0/1206476190 shutdown_connections 2024-09-19T06:59:26.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:26.762+0000 7f564498e640 1 --2- 172.21.15.99:0/1206476190 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f56400fb490 0x7f56400fb900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:26.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:26.762+0000 7f564498e640 1 --2- 172.21.15.99:0/1206476190 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f56401014d0 0x7f56401018a0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:26.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:26.762+0000 7f564498e640 1 -- 172.21.15.99:0/1206476190 >> 172.21.15.99:0/1206476190 conn(0x7f56400f7010 msgr2=0x7f56400f9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:59:26.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:26.762+0000 7f564498e640 1 -- 172.21.15.99:0/1206476190 shutdown_connections 2024-09-19T06:59:26.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:26.762+0000 7f564498e640 1 -- 172.21.15.99:0/1206476190 wait complete. 2024-09-19T06:59:26.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:26.763+0000 7f564498e640 1 Processor -- start 2024-09-19T06:59:26.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:26.763+0000 7f564498e640 1 -- start start 2024-09-19T06:59:26.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:26.763+0000 7f564498e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f56400fb490 0x7f564010e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:26.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:26.763+0000 7f564498e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f56401014d0 0x7f564010e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:26.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:26.763+0000 7f564498e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f564010ee20 con 0x7f56401014d0 2024-09-19T06:59:26.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:26.763+0000 7f564498e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f564010ef90 con 0x7f56400fb490 2024-09-19T06:59:26.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:26.763+0000 7f563dd9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f56401014d0 0x7f564010e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:26.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:26.763+0000 7f563dd9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f56401014d0 0x7f564010e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53192/0 (socket says 172.21.15.99:53192) 2024-09-19T06:59:26.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:26.763+0000 7f563dd9b640 1 -- 172.21.15.99:0/4057498064 learned_addr learned my addr 172.21.15.99:0/4057498064 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:59:26.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:26.763+0000 7f563e59c640 1 --2- 172.21.15.99:0/4057498064 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f56400fb490 0x7f564010e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:26.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:26.764+0000 7f563dd9b640 1 -- 172.21.15.99:0/4057498064 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f56400fb490 msgr2=0x7f564010e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:26.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:26.764+0000 7f563dd9b640 1 --2- 172.21.15.99:0/4057498064 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f56400fb490 0x7f564010e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:26.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:26.764+0000 7f563dd9b640 1 -- 172.21.15.99:0/4057498064 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5630005040 con 0x7f56401014d0 2024-09-19T06:59:26.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:26.764+0000 7f563dd9b640 1 --2- 172.21.15.99:0/4057498064 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f56401014d0 0x7f564010e740 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f563400b790 tx=0x7f56340091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:26.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:26.764+0000 7f562effd640 1 -- 172.21.15.99:0/4057498064 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f563400c700 con 0x7f56401014d0 2024-09-19T06:59:26.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:26.764+0000 7f562effd640 1 -- 172.21.15.99:0/4057498064 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f563400cd00 con 0x7f56401014d0 2024-09-19T06:59:26.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:26.764+0000 7f564498e640 1 -- 172.21.15.99:0/4057498064 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5640117270 con 0x7f56401014d0 2024-09-19T06:59:26.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:26.764+0000 7f562effd640 1 -- 172.21.15.99:0/4057498064 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5634015e70 con 0x7f56401014d0 2024-09-19T06:59:26.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:26.764+0000 7f564498e640 1 -- 172.21.15.99:0/4057498064 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5640117790 con 0x7f56401014d0 2024-09-19T06:59:26.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:26.765+0000 7f564498e640 1 -- 172.21.15.99:0/4057498064 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56400f7710 con 0x7f56401014d0 2024-09-19T06:59:26.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:26.766+0000 7f562effd640 1 -- 172.21.15.99:0/4057498064 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f5634012070 con 0x7f56401014d0 2024-09-19T06:59:26.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:26.766+0000 7f562effd640 1 --2- 172.21.15.99:0/4057498064 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f562806e530 0x7f56280709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:26.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:26.766+0000 7f563e59c640 1 --2- 172.21.15.99:0/4057498064 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f562806e530 0x7f56280709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:26.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:26.766+0000 7f562effd640 1 -- 172.21.15.99:0/4057498064 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f563408de00 con 0x7f56401014d0 2024-09-19T06:59:26.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:26.767+0000 7f563e59c640 1 --2- 172.21.15.99:0/4057498064 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f562806e530 0x7f56280709e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5630009ac0 tx=0x7f5630035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:26.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:26.771+0000 7f562effd640 1 -- 172.21.15.99:0/4057498064 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f5634056e70 con 0x7f56401014d0 2024-09-19T06:59:26.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:26.957+0000 7f564498e640 1 -- 172.21.15.99:0/4057498064 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5640108540 con 0x7f562806e530 2024-09-19T06:59:26.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:26.959+0000 7f562effd640 1 -- 172.21.15.99:0/4057498064 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f5640108540 con 0x7f562806e530 2024-09-19T06:59:26.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:26.961+0000 7f564498e640 1 -- 172.21.15.99:0/4057498064 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f562806e530 msgr2=0x7f56280709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:26.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:26.961+0000 7f564498e640 1 --2- 172.21.15.99:0/4057498064 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f562806e530 0x7f56280709e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5630009ac0 tx=0x7f5630035040 comp rx=0 tx=0).stop 2024-09-19T06:59:26.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:26.961+0000 7f564498e640 1 -- 172.21.15.99:0/4057498064 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f56401014d0 msgr2=0x7f564010e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:26.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:26.961+0000 7f564498e640 1 --2- 172.21.15.99:0/4057498064 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f56401014d0 0x7f564010e740 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f563400b790 tx=0x7f56340091d0 comp rx=0 tx=0).stop 2024-09-19T06:59:26.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:26.961+0000 7f564498e640 1 -- 172.21.15.99:0/4057498064 shutdown_connections 2024-09-19T06:59:26.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:26.961+0000 7f564498e640 1 --2- 172.21.15.99:0/4057498064 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f562806e530 0x7f56280709e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:26.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:26.961+0000 7f564498e640 1 --2- 172.21.15.99:0/4057498064 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f56401014d0 0x7f564010e740 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:26.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:26.961+0000 7f564498e640 1 --2- 172.21.15.99:0/4057498064 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f56400fb490 0x7f564010e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:26.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:26.961+0000 7f564498e640 1 -- 172.21.15.99:0/4057498064 >> 172.21.15.99:0/4057498064 conn(0x7f56400f7010 msgr2=0x7f56400f8910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:59:26.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:26.961+0000 7f564498e640 1 -- 172.21.15.99:0/4057498064 shutdown_connections 2024-09-19T06:59:26.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:26.961+0000 7f564498e640 1 -- 172.21.15.99:0/4057498064 wait complete. 2024-09-19T06:59:26.971 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-09-19T06:59:27.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.040+0000 7f0336b98640 1 -- 172.21.15.99:0/3635171241 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0330102ed0 msgr2=0x7f03300fc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:27.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.041+0000 7f0336b98640 1 --2- 172.21.15.99:0/3635171241 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0330102ed0 0x7f03300fc590 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f031c0048d0 tx=0x7f031c009da0 comp rx=0 tx=0).stop 2024-09-19T06:59:27.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.041+0000 7f0336b98640 1 -- 172.21.15.99:0/3635171241 shutdown_connections 2024-09-19T06:59:27.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.041+0000 7f0336b98640 1 --2- 172.21.15.99:0/3635171241 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0330102ed0 0x7f03300fc590 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:27.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.041+0000 7f0336b98640 1 --2- 172.21.15.99:0/3635171241 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0330102530 0x7f0330102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:27.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.041+0000 7f0336b98640 1 -- 172.21.15.99:0/3635171241 >> 172.21.15.99:0/3635171241 conn(0x7f03300f80f0 msgr2=0x7f03300fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:59:27.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.041+0000 7f0336b98640 1 -- 172.21.15.99:0/3635171241 shutdown_connections 2024-09-19T06:59:27.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.041+0000 7f0336b98640 1 -- 172.21.15.99:0/3635171241 wait complete. 2024-09-19T06:59:27.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.041+0000 7f0336b98640 1 Processor -- start 2024-09-19T06:59:27.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.041+0000 7f0336b98640 1 -- start start 2024-09-19T06:59:27.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.042+0000 7f0336b98640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0330102530 0x7f033006fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:27.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.042+0000 7f0336b98640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0330102ed0 0x7f033006ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:27.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.042+0000 7f0336b98640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0330070490 con 0x7f0330102530 2024-09-19T06:59:27.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.042+0000 7f0336b98640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0330070600 con 0x7f0330102ed0 2024-09-19T06:59:27.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.042+0000 7f0334934640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0330102530 0x7f033006fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:27.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.042+0000 7f0334934640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0330102530 0x7f033006fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53210/0 (socket says 172.21.15.99:53210) 2024-09-19T06:59:27.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.042+0000 7f0334934640 1 -- 172.21.15.99:0/1027066788 learned_addr learned my addr 172.21.15.99:0/1027066788 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:59:27.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.042+0000 7f032ffff640 1 --2- 172.21.15.99:0/1027066788 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0330102ed0 0x7f033006ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:27.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.042+0000 7f0334934640 1 -- 172.21.15.99:0/1027066788 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0330102ed0 msgr2=0x7f033006ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:27.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.042+0000 7f0334934640 1 --2- 172.21.15.99:0/1027066788 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0330102ed0 0x7f033006ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:27.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.042+0000 7f0334934640 1 -- 172.21.15.99:0/1027066788 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f031c005040 con 0x7f0330102530 2024-09-19T06:59:27.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.042+0000 7f032ffff640 1 --2- 172.21.15.99:0/1027066788 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0330102ed0 0x7f033006ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:59:27.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.042+0000 7f0334934640 1 --2- 172.21.15.99:0/1027066788 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0330102530 0x7f033006fa10 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f0324002a50 tx=0x7f0324004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:27.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.043+0000 7f032d7fa640 1 -- 172.21.15.99:0/1027066788 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0324007c30 con 0x7f0330102530 2024-09-19T06:59:27.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.043+0000 7f0336b98640 1 -- 172.21.15.99:0/1027066788 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0330070890 con 0x7f0330102530 2024-09-19T06:59:27.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.043+0000 7f032d7fa640 1 -- 172.21.15.99:0/1027066788 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f032400f040 con 0x7f0330102530 2024-09-19T06:59:27.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.043+0000 7f032d7fa640 1 -- 172.21.15.99:0/1027066788 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f032400da90 con 0x7f0330102530 2024-09-19T06:59:27.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.043+0000 7f0336b98640 1 -- 172.21.15.99:0/1027066788 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03301198f0 con 0x7f0330102530 2024-09-19T06:59:27.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.044+0000 7f0336b98640 1 -- 172.21.15.99:0/1027066788 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03300fdcb0 con 0x7f0330102530 2024-09-19T06:59:27.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.044+0000 7f032d7fa640 1 -- 172.21.15.99:0/1027066788 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f032400dd00 con 0x7f0330102530 2024-09-19T06:59:27.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.045+0000 7f032d7fa640 1 --2- 172.21.15.99:0/1027066788 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f032006e530 0x7f03200709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:27.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.045+0000 7f032d7fa640 1 -- 172.21.15.99:0/1027066788 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f032408da90 con 0x7f0330102530 2024-09-19T06:59:27.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.045+0000 7f032ffff640 1 --2- 172.21.15.99:0/1027066788 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f032006e530 0x7f03200709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:27.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.045+0000 7f032ffff640 1 --2- 172.21.15.99:0/1027066788 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f032006e530 0x7f03200709e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f031c000c00 tx=0x7f031c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:27.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.049+0000 7f032d7fa640 1 -- 172.21.15.99:0/1027066788 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f0324056b80 con 0x7f0330102530 2024-09-19T06:59:27.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.235+0000 7f0336b98640 1 -- 172.21.15.99:0/1027066788 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0330071100 con 0x7f032006e530 2024-09-19T06:59:27.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.236+0000 7f032d7fa640 1 -- 172.21.15.99:0/1027066788 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f0330071100 con 0x7f032006e530 2024-09-19T06:59:27.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.238+0000 7f0336b98640 1 -- 172.21.15.99:0/1027066788 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f032006e530 msgr2=0x7f03200709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:27.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.238+0000 7f0336b98640 1 --2- 172.21.15.99:0/1027066788 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f032006e530 0x7f03200709e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f031c000c00 tx=0x7f031c035040 comp rx=0 tx=0).stop 2024-09-19T06:59:27.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.238+0000 7f0336b98640 1 -- 172.21.15.99:0/1027066788 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0330102530 msgr2=0x7f033006fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:27.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.238+0000 7f0336b98640 1 --2- 172.21.15.99:0/1027066788 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0330102530 0x7f033006fa10 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f0324002a50 tx=0x7f0324004600 comp rx=0 tx=0).stop 2024-09-19T06:59:27.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.238+0000 7f0336b98640 1 -- 172.21.15.99:0/1027066788 shutdown_connections 2024-09-19T06:59:27.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.238+0000 7f0336b98640 1 --2- 172.21.15.99:0/1027066788 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f032006e530 0x7f03200709e0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:27.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.238+0000 7f0336b98640 1 --2- 172.21.15.99:0/1027066788 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0330102ed0 0x7f033006ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:27.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.238+0000 7f0336b98640 1 --2- 172.21.15.99:0/1027066788 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0330102530 0x7f033006fa10 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:27.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.238+0000 7f0336b98640 1 -- 172.21.15.99:0/1027066788 >> 172.21.15.99:0/1027066788 conn(0x7f03300f80f0 msgr2=0x7f03300f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:59:27.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.238+0000 7f0336b98640 1 -- 172.21.15.99:0/1027066788 shutdown_connections 2024-09-19T06:59:27.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.238+0000 7f0336b98640 1 -- 172.21.15.99:0/1027066788 wait complete. 2024-09-19T06:59:27.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.317+0000 7f6fae319640 1 -- 172.21.15.99:0/843963925 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6fa80fbd90 msgr2=0x7f6fa80fc200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:27.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.317+0000 7f6fae319640 1 --2- 172.21.15.99:0/843963925 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6fa80fbd90 0x7f6fa80fc200 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f6f900048d0 tx=0x7f6f90009da0 comp rx=0 tx=0).stop 2024-09-19T06:59:27.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.317+0000 7f6fae319640 1 -- 172.21.15.99:0/843963925 shutdown_connections 2024-09-19T06:59:27.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.317+0000 7f6fae319640 1 --2- 172.21.15.99:0/843963925 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6fa80fbd90 0x7f6fa80fc200 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:27.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.317+0000 7f6fae319640 1 --2- 172.21.15.99:0/843963925 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6fa81014f0 0x7f6fa81018c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:27.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.317+0000 7f6fae319640 1 -- 172.21.15.99:0/843963925 >> 172.21.15.99:0/843963925 conn(0x7f6fa8070ce0 msgr2=0x7f6fa80710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:59:27.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.317+0000 7f6fae319640 1 -- 172.21.15.99:0/843963925 shutdown_connections 2024-09-19T06:59:27.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.317+0000 7f6fae319640 1 -- 172.21.15.99:0/843963925 wait complete. 2024-09-19T06:59:27.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.317+0000 7f6fae319640 1 Processor -- start 2024-09-19T06:59:27.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.318+0000 7f6fae319640 1 -- start start 2024-09-19T06:59:27.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.318+0000 7f6fae319640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6fa80fbd90 0x7f6fa81121b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:27.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.318+0000 7f6fae319640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6fa81014f0 0x7f6fa81126f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:27.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.318+0000 7f6fae319640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa8112d80 con 0x7f6fa81014f0 2024-09-19T06:59:27.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.318+0000 7f6fae319640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa810c130 con 0x7f6fa80fbd90 2024-09-19T06:59:27.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.318+0000 7f6fa77fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6fa81014f0 0x7f6fa81126f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:27.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.318+0000 7f6fa77fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6fa81014f0 0x7f6fa81126f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53218/0 (socket says 172.21.15.99:53218) 2024-09-19T06:59:27.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.318+0000 7f6fa77fe640 1 -- 172.21.15.99:0/1963995426 learned_addr learned my addr 172.21.15.99:0/1963995426 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:59:27.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.318+0000 7f6fa7fff640 1 --2- 172.21.15.99:0/1963995426 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6fa80fbd90 0x7f6fa81121b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:27.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.318+0000 7f6fa77fe640 1 -- 172.21.15.99:0/1963995426 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6fa80fbd90 msgr2=0x7f6fa81121b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:27.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.318+0000 7f6fa77fe640 1 --2- 172.21.15.99:0/1963995426 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6fa80fbd90 0x7f6fa81121b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:27.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.318+0000 7f6fa77fe640 1 -- 172.21.15.99:0/1963995426 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f90005040 con 0x7f6fa81014f0 2024-09-19T06:59:27.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.318+0000 7f6fa7fff640 1 --2- 172.21.15.99:0/1963995426 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6fa80fbd90 0x7f6fa81121b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:59:27.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.318+0000 7f6fa77fe640 1 --2- 172.21.15.99:0/1963995426 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6fa81014f0 0x7f6fa81126f0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f6f90000c00 tx=0x7f6f90009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:27.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.319+0000 7f6fa4ff9640 1 -- 172.21.15.99:0/1963995426 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f9003a070 con 0x7f6fa81014f0 2024-09-19T06:59:27.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.319+0000 7f6fae319640 1 -- 172.21.15.99:0/1963995426 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fa810c3b0 con 0x7f6fa81014f0 2024-09-19T06:59:27.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.319+0000 7f6fa4ff9640 1 -- 172.21.15.99:0/1963995426 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6f90009880 con 0x7f6fa81014f0 2024-09-19T06:59:27.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.319+0000 7f6fa4ff9640 1 -- 172.21.15.99:0/1963995426 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f900338f0 con 0x7f6fa81014f0 2024-09-19T06:59:27.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.319+0000 7f6fae319640 1 -- 172.21.15.99:0/1963995426 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fa810c870 con 0x7f6fa81014f0 2024-09-19T06:59:27.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.320+0000 7f6fae319640 1 -- 172.21.15.99:0/1963995426 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fa80fcda0 con 0x7f6fa81014f0 2024-09-19T06:59:27.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.320+0000 7f6fa4ff9640 1 -- 172.21.15.99:0/1963995426 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f6f90030020 con 0x7f6fa81014f0 2024-09-19T06:59:27.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.321+0000 7f6fa4ff9640 1 --2- 172.21.15.99:0/1963995426 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f6f94072940 0x7f6f94074df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:27.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.321+0000 7f6fa4ff9640 1 -- 172.21.15.99:0/1963995426 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f6f900ae220 con 0x7f6fa81014f0 2024-09-19T06:59:27.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.321+0000 7f6fa7fff640 1 --2- 172.21.15.99:0/1963995426 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f6f94072940 0x7f6f94074df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:27.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.321+0000 7f6fa7fff640 1 --2- 172.21.15.99:0/1963995426 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f6f94072940 0x7f6f94074df0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6f98006fd0 tx=0x7f6f98008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:27.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.325+0000 7f6fa4ff9640 1 -- 172.21.15.99:0/1963995426 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f6f90077310 con 0x7f6fa81014f0 2024-09-19T06:59:27.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.500+0000 7f6fae319640 1 -- 172.21.15.99:0/1963995426 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6fa8108580 con 0x7f6f94072940 2024-09-19T06:59:27.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.508+0000 7f6fa4ff9640 1 -- 172.21.15.99:0/1963995426 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f6fa8108580 con 0x7f6f94072940 2024-09-19T06:59:27.509 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T06:59:27.510 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.smithi099 smithi099 *:9093,9094 running (18m) 11m ago 26m 23.4M - 0.25.0 c8568f914cd2 e7c1774d56b0 2024-09-19T06:59:27.510 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi099 smithi099 running (14m) 11m ago 27m 6899k - 19.1.1-361-g2f599a46 d2baa855c067 b9775f416b10 2024-09-19T06:59:27.510 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi117 smithi117 running (14m) 10m ago 26m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 38cf60c0d548 2024-09-19T06:59:27.510 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.smithi099 smithi099 *:3000 running (16m) 11m ago 26m 80.7M - 9.4.12 2bacad6d85d8 cd53a18d5410 2024-09-19T06:59:27.510 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.obarqf smithi099 running (11m) 11m ago 21m 12.2M - 19.1.1-361-g2f599a46 d2baa855c067 314a73082521 2024-09-19T06:59:27.510 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.xehbxe smithi099 running (11m) 11m ago 21m 14.4M - 19.1.1-361-g2f599a46 d2baa855c067 a2955a9d06e6 2024-09-19T06:59:27.510 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.bheqzh smithi117 running (10m) 10m ago 21m 11.8M - 19.1.1-361-g2f599a46 d2baa855c067 b1505937c0b7 2024-09-19T06:59:27.510 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.nooexo smithi117 running (10m) 10m ago 21m 13.1M - 19.1.1-361-g2f599a46 d2baa855c067 35bd7725855c 2024-09-19T06:59:27.510 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi099.pgvkqi smithi099 *:8443,9283,8765 running (17m) 11m ago 28m 505M - 19.1.1-361-g2f599a46 d2baa855c067 d5de99cb7e78 2024-09-19T06:59:27.510 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi117.ssmkcf smithi117 *:8443,9283,8765 running (17m) 10m ago 26m 444M - 19.1.1-361-g2f599a46 d2baa855c067 8b7ee0f871f5 2024-09-19T06:59:27.511 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi099 smithi099 running (15m) 11m ago 28m 52.4M 2048M 19.1.1-361-g2f599a46 d2baa855c067 ffe067438824 2024-09-19T06:59:27.511 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi117 smithi117 running (15m) 10m ago 25m 38.9M 2048M 19.1.1-361-g2f599a46 d2baa855c067 4cb7455e3ee7 2024-09-19T06:59:27.511 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi099 smithi099 *:9100 running (18m) 11m ago 26m 15.0M - 1.5.0 0da6a335fe13 dca7b4517dcc 2024-09-19T06:59:27.511 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi117 smithi117 *:9100 running (18m) 10m ago 26m 15.9M - 1.5.0 0da6a335fe13 8233ce3835d2 2024-09-19T06:59:27.511 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (14m) 11m ago 25m 100M 1557M 19.1.1-361-g2f599a46 d2baa855c067 8e22543bf933 2024-09-19T06:59:27.511 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (14m) 11m ago 24m 106M 1557M 19.1.1-361-g2f599a46 d2baa855c067 f54153d0ae09 2024-09-19T06:59:27.511 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (13m) 11m ago 24m 83.7M 1557M 19.1.1-361-g2f599a46 d2baa855c067 b1778ab88870 2024-09-19T06:59:27.511 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi117 running (12m) 10m ago 23m 102M 2581M 19.1.1-361-g2f599a46 d2baa855c067 ea5236b193d3 2024-09-19T06:59:27.511 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi117 running (12m) 10m ago 23m 93.5M 2581M 19.1.1-361-g2f599a46 d2baa855c067 27ac2c859a68 2024-09-19T06:59:27.511 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi117 running (11m) 10m ago 23m 100M 2581M 19.1.1-361-g2f599a46 d2baa855c067 de6aeb8544ce 2024-09-19T06:59:27.511 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.smithi099 smithi099 *:9095 running (17m) 11m ago 26m 64.4M - 2.43.0 a07b618ecd1d 15ad26ec6fb4 2024-09-19T06:59:27.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.510+0000 7f6fae319640 1 -- 172.21.15.99:0/1963995426 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f6f94072940 msgr2=0x7f6f94074df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:27.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.510+0000 7f6fae319640 1 --2- 172.21.15.99:0/1963995426 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f6f94072940 0x7f6f94074df0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6f98006fd0 tx=0x7f6f98008040 comp rx=0 tx=0).stop 2024-09-19T06:59:27.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.510+0000 7f6fae319640 1 -- 172.21.15.99:0/1963995426 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6fa81014f0 msgr2=0x7f6fa81126f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:27.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.510+0000 7f6fae319640 1 --2- 172.21.15.99:0/1963995426 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6fa81014f0 0x7f6fa81126f0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f6f90000c00 tx=0x7f6f90009da0 comp rx=0 tx=0).stop 2024-09-19T06:59:27.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.510+0000 7f6fae319640 1 -- 172.21.15.99:0/1963995426 shutdown_connections 2024-09-19T06:59:27.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.510+0000 7f6fae319640 1 --2- 172.21.15.99:0/1963995426 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f6f94072940 0x7f6f94074df0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:27.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.510+0000 7f6fae319640 1 --2- 172.21.15.99:0/1963995426 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6fa81014f0 0x7f6fa81126f0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:27.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.510+0000 7f6fae319640 1 --2- 172.21.15.99:0/1963995426 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6fa80fbd90 0x7f6fa81121b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:27.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.510+0000 7f6fae319640 1 -- 172.21.15.99:0/1963995426 >> 172.21.15.99:0/1963995426 conn(0x7f6fa8070ce0 msgr2=0x7f6fa8104240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:59:27.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.511+0000 7f6fae319640 1 -- 172.21.15.99:0/1963995426 shutdown_connections 2024-09-19T06:59:27.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.511+0000 7f6fae319640 1 -- 172.21.15.99:0/1963995426 wait complete. 2024-09-19T06:59:27.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.588+0000 7f3ebc77b640 1 -- 172.21.15.99:0/3183098423 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3eb40fac80 msgr2=0x7f3eb40fb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:27.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.588+0000 7f3ebc77b640 1 --2- 172.21.15.99:0/3183098423 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3eb40fac80 0x7f3eb40fb0f0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f3ea80048d0 tx=0x7f3ea8009da0 comp rx=0 tx=0).stop 2024-09-19T06:59:27.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.588+0000 7f3ebc77b640 1 -- 172.21.15.99:0/3183098423 shutdown_connections 2024-09-19T06:59:27.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.588+0000 7f3ebc77b640 1 --2- 172.21.15.99:0/3183098423 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3eb40fac80 0x7f3eb40fb0f0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:27.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.588+0000 7f3ebc77b640 1 --2- 172.21.15.99:0/3183098423 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3eb4102620 0x7f3eb41029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:27.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.588+0000 7f3ebc77b640 1 -- 172.21.15.99:0/3183098423 >> 172.21.15.99:0/3183098423 conn(0x7f3eb4070ce0 msgr2=0x7f3eb40710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:59:27.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.588+0000 7f3ebc77b640 1 -- 172.21.15.99:0/3183098423 shutdown_connections 2024-09-19T06:59:27.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.588+0000 7f3ebc77b640 1 -- 172.21.15.99:0/3183098423 wait complete. 2024-09-19T06:59:27.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.589+0000 7f3ebc77b640 1 Processor -- start 2024-09-19T06:59:27.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.589+0000 7f3ebc77b640 1 -- start start 2024-09-19T06:59:27.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.589+0000 7f3ebc77b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3eb40fac80 0x7f3eb41131b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:27.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.589+0000 7f3ebc77b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3eb4102620 0x7f3eb41136f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:27.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.589+0000 7f3ebc77b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb4113cf0 con 0x7f3eb4102620 2024-09-19T06:59:27.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.589+0000 7f3ebc77b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb410d180 con 0x7f3eb40fac80 2024-09-19T06:59:27.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.589+0000 7f3eb9d16640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3eb4102620 0x7f3eb41136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:27.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.589+0000 7f3eb9d16640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3eb4102620 0x7f3eb41136f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53230/0 (socket says 172.21.15.99:53230) 2024-09-19T06:59:27.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.589+0000 7f3eb9d16640 1 -- 172.21.15.99:0/858417953 learned_addr learned my addr 172.21.15.99:0/858417953 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:59:27.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.590+0000 7f3eba517640 1 --2- 172.21.15.99:0/858417953 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3eb40fac80 0x7f3eb41131b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:27.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.590+0000 7f3eb9d16640 1 -- 172.21.15.99:0/858417953 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3eb40fac80 msgr2=0x7f3eb41131b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:27.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.590+0000 7f3eb9d16640 1 --2- 172.21.15.99:0/858417953 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3eb40fac80 0x7f3eb41131b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:27.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.590+0000 7f3eb9d16640 1 -- 172.21.15.99:0/858417953 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea8005040 con 0x7f3eb4102620 2024-09-19T06:59:27.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.590+0000 7f3eb9d16640 1 --2- 172.21.15.99:0/858417953 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3eb4102620 0x7f3eb41136f0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f3ea8003080 tx=0x7f3ea8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:27.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.590+0000 7f3ea6ffd640 1 -- 172.21.15.99:0/858417953 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ea8038070 con 0x7f3eb4102620 2024-09-19T06:59:27.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.590+0000 7f3ea6ffd640 1 -- 172.21.15.99:0/858417953 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3ea80097e0 con 0x7f3eb4102620 2024-09-19T06:59:27.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.590+0000 7f3ebc77b640 1 -- 172.21.15.99:0/858417953 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3eb410d400 con 0x7f3eb4102620 2024-09-19T06:59:27.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.590+0000 7f3ea6ffd640 1 -- 172.21.15.99:0/858417953 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ea803d420 con 0x7f3eb4102620 2024-09-19T06:59:27.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.590+0000 7f3ebc77b640 1 -- 172.21.15.99:0/858417953 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eb410d940 con 0x7f3eb4102620 2024-09-19T06:59:27.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.591+0000 7f3ebc77b640 1 -- 172.21.15.99:0/858417953 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3eb40657b0 con 0x7f3eb4102620 2024-09-19T06:59:27.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.592+0000 7f3ea6ffd640 1 -- 172.21.15.99:0/858417953 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f3ea8030020 con 0x7f3eb4102620 2024-09-19T06:59:27.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.592+0000 7f3ea6ffd640 1 --2- 172.21.15.99:0/858417953 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f3ea006e530 0x7f3ea00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:27.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.593+0000 7f3ea6ffd640 1 -- 172.21.15.99:0/858417953 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f3ea80ae900 con 0x7f3eb4102620 2024-09-19T06:59:27.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.593+0000 7f3eba517640 1 --2- 172.21.15.99:0/858417953 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f3ea006e530 0x7f3ea00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:27.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.593+0000 7f3eba517640 1 --2- 172.21.15.99:0/858417953 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f3ea006e530 0x7f3ea00709e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3eb0004c40 tx=0x7f3eb0009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:27.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.598+0000 7f3ea6ffd640 1 -- 172.21.15.99:0/858417953 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f3ea8077a70 con 0x7f3eb4102620 2024-09-19T06:59:27.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.828+0000 7f3ebc77b640 1 -- 172.21.15.99:0/858417953 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3eb4074c00 con 0x7f3eb4102620 2024-09-19T06:59:27.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.828+0000 7f3ea6ffd640 1 -- 172.21.15.99:0/858417953 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f3ea807b130 con 0x7f3eb4102620 2024-09-19T06:59:27.830 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:59:27.830 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-09-19T06:59:27.830 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T06:59:27.830 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:59:27.830 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-09-19T06:59:27.830 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T06:59:27.830 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:59:27.830 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-09-19T06:59:27.830 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 6 2024-09-19T06:59:27.831 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:59:27.831 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": { 2024-09-19T06:59:27.831 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 4 2024-09-19T06:59:27.831 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:59:27.831 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-09-19T06:59:27.831 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 14 2024-09-19T06:59:27.831 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T06:59:27.831 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:59:27.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.830+0000 7f3ebc77b640 1 -- 172.21.15.99:0/858417953 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f3ea006e530 msgr2=0x7f3ea00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:27.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.830+0000 7f3ebc77b640 1 --2- 172.21.15.99:0/858417953 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f3ea006e530 0x7f3ea00709e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3eb0004c40 tx=0x7f3eb0009040 comp rx=0 tx=0).stop 2024-09-19T06:59:27.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.830+0000 7f3ebc77b640 1 -- 172.21.15.99:0/858417953 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3eb4102620 msgr2=0x7f3eb41136f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:27.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.830+0000 7f3ebc77b640 1 --2- 172.21.15.99:0/858417953 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3eb4102620 0x7f3eb41136f0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f3ea8003080 tx=0x7f3ea8009da0 comp rx=0 tx=0).stop 2024-09-19T06:59:27.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.830+0000 7f3ebc77b640 1 -- 172.21.15.99:0/858417953 shutdown_connections 2024-09-19T06:59:27.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.830+0000 7f3ebc77b640 1 --2- 172.21.15.99:0/858417953 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f3ea006e530 0x7f3ea00709e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:27.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.830+0000 7f3ebc77b640 1 --2- 172.21.15.99:0/858417953 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3eb4102620 0x7f3eb41136f0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:27.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.830+0000 7f3ebc77b640 1 --2- 172.21.15.99:0/858417953 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3eb40fac80 0x7f3eb41131b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:27.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.830+0000 7f3ebc77b640 1 -- 172.21.15.99:0/858417953 >> 172.21.15.99:0/858417953 conn(0x7f3eb4070ce0 msgr2=0x7f3eb4100130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:59:27.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.831+0000 7f3ebc77b640 1 -- 172.21.15.99:0/858417953 shutdown_connections 2024-09-19T06:59:27.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.831+0000 7f3ebc77b640 1 -- 172.21.15.99:0/858417953 wait complete. 2024-09-19T06:59:27.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.909+0000 7f13d1e8b640 1 -- 172.21.15.99:0/1212586346 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13cc102ef0 msgr2=0x7f13cc0fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:27.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.909+0000 7f13d1e8b640 1 --2- 172.21.15.99:0/1212586346 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13cc102ef0 0x7f13cc0fc5b0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f13c00048d0 tx=0x7f13c0009da0 comp rx=0 tx=0).stop 2024-09-19T06:59:27.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.909+0000 7f13d1e8b640 1 -- 172.21.15.99:0/1212586346 shutdown_connections 2024-09-19T06:59:27.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.909+0000 7f13d1e8b640 1 --2- 172.21.15.99:0/1212586346 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13cc102ef0 0x7f13cc0fc5b0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:27.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.909+0000 7f13d1e8b640 1 --2- 172.21.15.99:0/1212586346 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13cc102550 0x7f13cc102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:27.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.909+0000 7f13d1e8b640 1 -- 172.21.15.99:0/1212586346 >> 172.21.15.99:0/1212586346 conn(0x7f13cc0f80f0 msgr2=0x7f13cc0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:59:27.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.909+0000 7f13d1e8b640 1 -- 172.21.15.99:0/1212586346 shutdown_connections 2024-09-19T06:59:27.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.909+0000 7f13d1e8b640 1 -- 172.21.15.99:0/1212586346 wait complete. 2024-09-19T06:59:27.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.909+0000 7f13d1e8b640 1 Processor -- start 2024-09-19T06:59:27.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.910+0000 7f13d1e8b640 1 -- start start 2024-09-19T06:59:27.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.910+0000 7f13d1e8b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13cc102550 0x7f13cc06fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:27.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.910+0000 7f13d1e8b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13cc102ef0 0x7f13cc06ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:27.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.910+0000 7f13d1e8b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13cc070490 con 0x7f13cc102ef0 2024-09-19T06:59:27.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.910+0000 7f13d1e8b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13cc070600 con 0x7f13cc102550 2024-09-19T06:59:27.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.910+0000 7f13caffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13cc102ef0 0x7f13cc06ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:27.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.910+0000 7f13caffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13cc102ef0 0x7f13cc06ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53254/0 (socket says 172.21.15.99:53254) 2024-09-19T06:59:27.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.910+0000 7f13caffd640 1 -- 172.21.15.99:0/2464060097 learned_addr learned my addr 172.21.15.99:0/2464060097 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:59:27.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.910+0000 7f13cb7fe640 1 --2- 172.21.15.99:0/2464060097 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13cc102550 0x7f13cc06fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:27.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.910+0000 7f13caffd640 1 -- 172.21.15.99:0/2464060097 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13cc102550 msgr2=0x7f13cc06fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:27.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.910+0000 7f13caffd640 1 --2- 172.21.15.99:0/2464060097 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13cc102550 0x7f13cc06fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:27.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.910+0000 7f13caffd640 1 -- 172.21.15.99:0/2464060097 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13c0005040 con 0x7f13cc102ef0 2024-09-19T06:59:27.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.911+0000 7f13caffd640 1 --2- 172.21.15.99:0/2464060097 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13cc102ef0 0x7f13cc06ff50 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f13c0003080 tx=0x7f13c0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:27.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.911+0000 7f13b3fff640 1 -- 172.21.15.99:0/2464060097 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13c0038070 con 0x7f13cc102ef0 2024-09-19T06:59:27.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.911+0000 7f13b3fff640 1 -- 172.21.15.99:0/2464060097 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f13c0009760 con 0x7f13cc102ef0 2024-09-19T06:59:27.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.911+0000 7f13d1e8b640 1 -- 172.21.15.99:0/2464060097 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13cc070830 con 0x7f13cc102ef0 2024-09-19T06:59:27.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.911+0000 7f13b3fff640 1 -- 172.21.15.99:0/2464060097 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13c0033420 con 0x7f13cc102ef0 2024-09-19T06:59:27.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.911+0000 7f13d1e8b640 1 -- 172.21.15.99:0/2464060097 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13cc119b40 con 0x7f13cc102ef0 2024-09-19T06:59:27.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.912+0000 7f13d1e8b640 1 -- 172.21.15.99:0/2464060097 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13cc0fdcd0 con 0x7f13cc102ef0 2024-09-19T06:59:27.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.912+0000 7f13b3fff640 1 -- 172.21.15.99:0/2464060097 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f13c0030020 con 0x7f13cc102ef0 2024-09-19T06:59:27.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.913+0000 7f13b3fff640 1 --2- 172.21.15.99:0/2464060097 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f13b406e530 0x7f13b40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:27.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.913+0000 7f13b3fff640 1 -- 172.21.15.99:0/2464060097 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f13c00ade20 con 0x7f13cc102ef0 2024-09-19T06:59:27.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.913+0000 7f13cb7fe640 1 --2- 172.21.15.99:0/2464060097 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f13b406e530 0x7f13b40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:27.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.913+0000 7f13cb7fe640 1 --2- 172.21.15.99:0/2464060097 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f13b406e530 0x7f13b40709e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f13bc0041d0 tx=0x7f13bc004330 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:27.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:27.918+0000 7f13b3fff640 1 -- 172.21.15.99:0/2464060097 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f13c0076f10 con 0x7f13cc102ef0 2024-09-19T06:59:28.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.121+0000 7f13d1e8b640 1 -- 172.21.15.99:0/2464060097 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f13cc0fbd50 con 0x7f13cc102ef0 2024-09-19T06:59:28.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.121+0000 7f13b3fff640 1 -- 172.21.15.99:0/2464060097 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 29 v29) v1 ==== 76+0+1915 (secure 0 0 0) 0x7f13c007a5d0 con 0x7f13cc102ef0 2024-09-19T06:59:28.123 INFO:teuthology.orchestra.run.smithi099.stdout:e29 2024-09-19T06:59:28.123 INFO:teuthology.orchestra.run.smithi099.stdout:btime 2024-09-19T06:48:47:938420+0000 2024-09-19T06:59:28.123 INFO:teuthology.orchestra.run.smithi099.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T06:59:28.123 INFO:teuthology.orchestra.run.smithi099.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T06:59:28.123 INFO:teuthology.orchestra.run.smithi099.stdout:legacy client fscid: 1 2024-09-19T06:59:28.123 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:59:28.123 INFO:teuthology.orchestra.run.smithi099.stdout:Filesystem 'cephfs' (1) 2024-09-19T06:59:28.123 INFO:teuthology.orchestra.run.smithi099.stdout:fs_name cephfs 2024-09-19T06:59:28.123 INFO:teuthology.orchestra.run.smithi099.stdout:epoch 20 2024-09-19T06:59:28.123 INFO:teuthology.orchestra.run.smithi099.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-19T06:59:28.123 INFO:teuthology.orchestra.run.smithi099.stdout:created 2024-09-19T06:37:40.838146+0000 2024-09-19T06:59:28.123 INFO:teuthology.orchestra.run.smithi099.stdout:modified 2024-09-19T06:47:50.076553+0000 2024-09-19T06:59:28.124 INFO:teuthology.orchestra.run.smithi099.stdout:tableserver 0 2024-09-19T06:59:28.124 INFO:teuthology.orchestra.run.smithi099.stdout:root 0 2024-09-19T06:59:28.124 INFO:teuthology.orchestra.run.smithi099.stdout:session_timeout 60 2024-09-19T06:59:28.124 INFO:teuthology.orchestra.run.smithi099.stdout:session_autoclose 300 2024-09-19T06:59:28.124 INFO:teuthology.orchestra.run.smithi099.stdout:max_file_size 1099511627776 2024-09-19T06:59:28.124 INFO:teuthology.orchestra.run.smithi099.stdout:max_xattr_size 65536 2024-09-19T06:59:28.124 INFO:teuthology.orchestra.run.smithi099.stdout:required_client_features {} 2024-09-19T06:59:28.124 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure 0 2024-09-19T06:59:28.124 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure_osd_epoch 77 2024-09-19T06:59:28.124 INFO:teuthology.orchestra.run.smithi099.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T06:59:28.124 INFO:teuthology.orchestra.run.smithi099.stdout:max_mds 2 2024-09-19T06:59:28.125 INFO:teuthology.orchestra.run.smithi099.stdout:in 0,1 2024-09-19T06:59:28.125 INFO:teuthology.orchestra.run.smithi099.stdout:up {} 2024-09-19T06:59:28.125 INFO:teuthology.orchestra.run.smithi099.stdout:failed 0,1 2024-09-19T06:59:28.125 INFO:teuthology.orchestra.run.smithi099.stdout:damaged 2024-09-19T06:59:28.125 INFO:teuthology.orchestra.run.smithi099.stdout:stopped 2024-09-19T06:59:28.125 INFO:teuthology.orchestra.run.smithi099.stdout:data_pools [3] 2024-09-19T06:59:28.125 INFO:teuthology.orchestra.run.smithi099.stdout:metadata_pool 2 2024-09-19T06:59:28.125 INFO:teuthology.orchestra.run.smithi099.stdout:inline_data disabled 2024-09-19T06:59:28.125 INFO:teuthology.orchestra.run.smithi099.stdout:balancer 2024-09-19T06:59:28.125 INFO:teuthology.orchestra.run.smithi099.stdout:bal_rank_mask -1 2024-09-19T06:59:28.125 INFO:teuthology.orchestra.run.smithi099.stdout:standby_count_wanted 1 2024-09-19T06:59:28.125 INFO:teuthology.orchestra.run.smithi099.stdout:qdb_cluster leader: 0 members: 2024-09-19T06:59:28.126 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:59:28.126 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:59:28.126 INFO:teuthology.orchestra.run.smithi099.stdout:Standby daemons: 2024-09-19T06:59:28.126 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T06:59:28.126 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.obarqf{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6826/1859154203,v1:172.21.15.99:6827/1859154203] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:59:28.126 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.xehbxe{-1:34410} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6828/1939453719,v1:172.21.15.99:6829/1939453719] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:59:28.126 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.nooexo{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6824/1398895079,v1:172.21.15.117:6825/1398895079] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:59:28.126 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.bheqzh{-1:44329} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6826/3233337308,v1:172.21.15.117:6827/3233337308] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T06:59:28.127 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 29 2024-09-19T06:59:28.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.123+0000 7f13d1e8b640 1 -- 172.21.15.99:0/2464060097 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f13b406e530 msgr2=0x7f13b40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:28.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.123+0000 7f13d1e8b640 1 --2- 172.21.15.99:0/2464060097 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f13b406e530 0x7f13b40709e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f13bc0041d0 tx=0x7f13bc004330 comp rx=0 tx=0).stop 2024-09-19T06:59:28.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.123+0000 7f13d1e8b640 1 -- 172.21.15.99:0/2464060097 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13cc102ef0 msgr2=0x7f13cc06ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:28.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.123+0000 7f13d1e8b640 1 --2- 172.21.15.99:0/2464060097 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13cc102ef0 0x7f13cc06ff50 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f13c0003080 tx=0x7f13c0009da0 comp rx=0 tx=0).stop 2024-09-19T06:59:28.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.123+0000 7f13d1e8b640 1 -- 172.21.15.99:0/2464060097 shutdown_connections 2024-09-19T06:59:28.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.123+0000 7f13d1e8b640 1 --2- 172.21.15.99:0/2464060097 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f13b406e530 0x7f13b40709e0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:28.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.123+0000 7f13d1e8b640 1 --2- 172.21.15.99:0/2464060097 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13cc102ef0 0x7f13cc06ff50 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:28.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.123+0000 7f13d1e8b640 1 --2- 172.21.15.99:0/2464060097 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f13cc102550 0x7f13cc06fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:28.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.123+0000 7f13d1e8b640 1 -- 172.21.15.99:0/2464060097 >> 172.21.15.99:0/2464060097 conn(0x7f13cc0f80f0 msgr2=0x7f13cc0f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:59:28.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.123+0000 7f13d1e8b640 1 -- 172.21.15.99:0/2464060097 shutdown_connections 2024-09-19T06:59:28.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.123+0000 7f13d1e8b640 1 -- 172.21.15.99:0/2464060097 wait complete. 2024-09-19T06:59:28.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.203+0000 7fd9b2e68640 1 -- 172.21.15.99:0/2679242423 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9ac0fb810 msgr2=0x7fd9ac0fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:28.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.203+0000 7fd9b2e68640 1 --2- 172.21.15.99:0/2679242423 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9ac0fb810 0x7fd9ac0fbbe0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fd9a00048d0 tx=0x7fd9a0009da0 comp rx=0 tx=0).stop 2024-09-19T06:59:28.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.203+0000 7fd9b2e68640 1 -- 172.21.15.99:0/2679242423 shutdown_connections 2024-09-19T06:59:28.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.203+0000 7fd9b2e68640 1 --2- 172.21.15.99:0/2679242423 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd9ac0fcf80 0x7fd9ac0fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:28.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.203+0000 7fd9b2e68640 1 --2- 172.21.15.99:0/2679242423 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9ac0fb810 0x7fd9ac0fbbe0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:28.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.203+0000 7fd9b2e68640 1 -- 172.21.15.99:0/2679242423 >> 172.21.15.99:0/2679242423 conn(0x7fd9ac0723b0 msgr2=0x7fd9ac0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:59:28.205 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:59:28 smithi099 ceph-mon[97031]: from='client.34978 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:59:28.205 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:59:28 smithi099 ceph-mon[97031]: pgmap v513: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:59:28.205 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:59:28 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/858417953' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:59:28.205 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:59:28 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/2464060097' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:59:28.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.203+0000 7fd9b2e68640 1 -- 172.21.15.99:0/2679242423 shutdown_connections 2024-09-19T06:59:28.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.203+0000 7fd9b2e68640 1 -- 172.21.15.99:0/2679242423 wait complete. 2024-09-19T06:59:28.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.203+0000 7fd9b2e68640 1 Processor -- start 2024-09-19T06:59:28.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.203+0000 7fd9b2e68640 1 -- start start 2024-09-19T06:59:28.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.204+0000 7fd9b2e68640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd9ac0fb810 0x7fd9ac10bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:28.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.204+0000 7fd9b2e68640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9ac0fcf80 0x7fd9ac10c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:28.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.204+0000 7fd9b2e68640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ac10c9c0 con 0x7fd9ac0fcf80 2024-09-19T06:59:28.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.204+0000 7fd9b2e68640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ac10cb00 con 0x7fd9ac0fb810 2024-09-19T06:59:28.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.204+0000 7fd9abfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9ac0fcf80 0x7fd9ac10c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:28.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.204+0000 7fd9abfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9ac0fcf80 0x7fd9ac10c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53276/0 (socket says 172.21.15.99:53276) 2024-09-19T06:59:28.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.204+0000 7fd9abfff640 1 -- 172.21.15.99:0/1580300083 learned_addr learned my addr 172.21.15.99:0/1580300083 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:59:28.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.204+0000 7fd9b0c04640 1 --2- 172.21.15.99:0/1580300083 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd9ac0fb810 0x7fd9ac10bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:28.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.204+0000 7fd9abfff640 1 -- 172.21.15.99:0/1580300083 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd9ac0fb810 msgr2=0x7fd9ac10bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:28.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.204+0000 7fd9abfff640 1 --2- 172.21.15.99:0/1580300083 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd9ac0fb810 0x7fd9ac10bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:28.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.204+0000 7fd9abfff640 1 -- 172.21.15.99:0/1580300083 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9a0005040 con 0x7fd9ac0fcf80 2024-09-19T06:59:28.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.204+0000 7fd9abfff640 1 --2- 172.21.15.99:0/1580300083 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9ac0fcf80 0x7fd9ac10c480 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fd998002a50 tx=0x7fd998004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:28.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.205+0000 7fd9a97fa640 1 -- 172.21.15.99:0/1580300083 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd998007c30 con 0x7fd9ac0fcf80 2024-09-19T06:59:28.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.205+0000 7fd9a97fa640 1 -- 172.21.15.99:0/1580300083 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd99800f040 con 0x7fd9ac0fcf80 2024-09-19T06:59:28.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.205+0000 7fd9a97fa640 1 -- 172.21.15.99:0/1580300083 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd99800da10 con 0x7fd9ac0fcf80 2024-09-19T06:59:28.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.205+0000 7fd9b2e68640 1 -- 172.21.15.99:0/1580300083 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9ac10cdb0 con 0x7fd9ac0fcf80 2024-09-19T06:59:28.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.205+0000 7fd9b2e68640 1 -- 172.21.15.99:0/1580300083 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9ac119960 con 0x7fd9ac0fcf80 2024-09-19T06:59:28.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.206+0000 7fd9b2e68640 1 -- 172.21.15.99:0/1580300083 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9ac0fcbc0 con 0x7fd9ac0fcf80 2024-09-19T06:59:28.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.208+0000 7fd9a97fa640 1 -- 172.21.15.99:0/1580300083 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fd99800dbb0 con 0x7fd9ac0fcf80 2024-09-19T06:59:28.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.208+0000 7fd9a97fa640 1 --2- 172.21.15.99:0/1580300083 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd99c06e600 0x7fd99c070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:28.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.209+0000 7fd9a97fa640 1 -- 172.21.15.99:0/1580300083 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fd99808d6e0 con 0x7fd9ac0fcf80 2024-09-19T06:59:28.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.209+0000 7fd9b0c04640 1 --2- 172.21.15.99:0/1580300083 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd99c06e600 0x7fd99c070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:28.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.209+0000 7fd9b0c04640 1 --2- 172.21.15.99:0/1580300083 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd99c06e600 0x7fd99c070ab0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd9a0009ac0 tx=0x7fd9a0035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:28.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.213+0000 7fd9a97fa640 1 -- 172.21.15.99:0/1580300083 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fd998056880 con 0x7fd9ac0fcf80 2024-09-19T06:59:28.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.393+0000 7fd9b2e68640 1 -- 172.21.15.99:0/1580300083 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd9ac04b720 con 0x7fd99c06e600 2024-09-19T06:59:28.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.395+0000 7fd9a97fa640 1 -- 172.21.15.99:0/1580300083 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fd9ac04b720 con 0x7fd99c06e600 2024-09-19T06:59:28.396 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:59:28.396 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T06:59:28.396 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": true, 2024-09-19T06:59:28.396 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T06:59:28.396 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [ 2024-09-19T06:59:28.396 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr", 2024-09-19T06:59:28.396 INFO:teuthology.orchestra.run.smithi099.stdout: "crash", 2024-09-19T06:59:28.396 INFO:teuthology.orchestra.run.smithi099.stdout: "mds", 2024-09-19T06:59:28.397 INFO:teuthology.orchestra.run.smithi099.stdout: "mon", 2024-09-19T06:59:28.397 INFO:teuthology.orchestra.run.smithi099.stdout: "osd" 2024-09-19T06:59:28.397 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-19T06:59:28.397 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": "16/21 daemons upgraded", 2024-09-19T06:59:28.397 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "Currently upgrading mds daemons", 2024-09-19T06:59:28.397 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-09-19T06:59:28.397 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:59:28.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.397+0000 7fd9b2e68640 1 -- 172.21.15.99:0/1580300083 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd99c06e600 msgr2=0x7fd99c070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:28.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.397+0000 7fd9b2e68640 1 --2- 172.21.15.99:0/1580300083 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd99c06e600 0x7fd99c070ab0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd9a0009ac0 tx=0x7fd9a0035040 comp rx=0 tx=0).stop 2024-09-19T06:59:28.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.397+0000 7fd9b2e68640 1 -- 172.21.15.99:0/1580300083 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9ac0fcf80 msgr2=0x7fd9ac10c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:28.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.397+0000 7fd9b2e68640 1 --2- 172.21.15.99:0/1580300083 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9ac0fcf80 0x7fd9ac10c480 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fd998002a50 tx=0x7fd998004600 comp rx=0 tx=0).stop 2024-09-19T06:59:28.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.397+0000 7fd9b2e68640 1 -- 172.21.15.99:0/1580300083 shutdown_connections 2024-09-19T06:59:28.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.397+0000 7fd9b2e68640 1 --2- 172.21.15.99:0/1580300083 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd99c06e600 0x7fd99c070ab0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:28.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.397+0000 7fd9b2e68640 1 --2- 172.21.15.99:0/1580300083 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd9ac0fcf80 0x7fd9ac10c480 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:28.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.397+0000 7fd9b2e68640 1 --2- 172.21.15.99:0/1580300083 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd9ac0fb810 0x7fd9ac10bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:28.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.397+0000 7fd9b2e68640 1 -- 172.21.15.99:0/1580300083 >> 172.21.15.99:0/1580300083 conn(0x7fd9ac0723b0 msgr2=0x7fd9ac0fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:59:28.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.397+0000 7fd9b2e68640 1 -- 172.21.15.99:0/1580300083 shutdown_connections 2024-09-19T06:59:28.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.397+0000 7fd9b2e68640 1 -- 172.21.15.99:0/1580300083 wait complete. 2024-09-19T06:59:28.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.475+0000 7f37357c4640 1 -- 172.21.15.99:0/3523199662 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37300fdf10 msgr2=0x7f37301065e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:28.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.475+0000 7f37357c4640 1 --2- 172.21.15.99:0/3523199662 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37300fdf10 0x7f37301065e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f3718004900 tx=0x7f3718009da0 comp rx=0 tx=0).stop 2024-09-19T06:59:28.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.475+0000 7f37357c4640 1 -- 172.21.15.99:0/3523199662 shutdown_connections 2024-09-19T06:59:28.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.475+0000 7f37357c4640 1 --2- 172.21.15.99:0/3523199662 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37300fdf10 0x7f37301065e0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:28.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.475+0000 7f37357c4640 1 --2- 172.21.15.99:0/3523199662 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f37300fd570 0x7f37300fd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:28.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.475+0000 7f37357c4640 1 -- 172.21.15.99:0/3523199662 >> 172.21.15.99:0/3523199662 conn(0x7f37300f7010 msgr2=0x7f37300f9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:59:28.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.475+0000 7f37357c4640 1 -- 172.21.15.99:0/3523199662 shutdown_connections 2024-09-19T06:59:28.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.475+0000 7f37357c4640 1 -- 172.21.15.99:0/3523199662 wait complete. 2024-09-19T06:59:28.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.476+0000 7f37357c4640 1 Processor -- start 2024-09-19T06:59:28.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.476+0000 7f37357c4640 1 -- start start 2024-09-19T06:59:28.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.476+0000 7f37357c4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f37300fd570 0x7f3730113260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:28.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.476+0000 7f37357c4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37300fdf10 0x7f37301137a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:28.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.476+0000 7f37357c4640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3730113da0 con 0x7f37300fdf10 2024-09-19T06:59:28.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.476+0000 7f37357c4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f373010d1e0 con 0x7f37300fd570 2024-09-19T06:59:28.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.476+0000 7f37267fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37300fdf10 0x7f37301137a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:28.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.476+0000 7f37267fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37300fdf10 0x7f37301137a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53306/0 (socket says 172.21.15.99:53306) 2024-09-19T06:59:28.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.476+0000 7f37267fc640 1 -- 172.21.15.99:0/3212906553 learned_addr learned my addr 172.21.15.99:0/3212906553 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:59:28.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.476+0000 7f372effd640 1 --2- 172.21.15.99:0/3212906553 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f37300fd570 0x7f3730113260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:28.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.477+0000 7f37267fc640 1 -- 172.21.15.99:0/3212906553 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f37300fd570 msgr2=0x7f3730113260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:28.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.477+0000 7f37267fc640 1 --2- 172.21.15.99:0/3212906553 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f37300fd570 0x7f3730113260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:28.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.477+0000 7f37267fc640 1 -- 172.21.15.99:0/3212906553 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3718005040 con 0x7f37300fdf10 2024-09-19T06:59:28.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.477+0000 7f372effd640 1 --2- 172.21.15.99:0/3212906553 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f37300fd570 0x7f3730113260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T06:59:28.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.477+0000 7f37267fc640 1 --2- 172.21.15.99:0/3212906553 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37300fdf10 0x7f37301137a0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f3718004960 tx=0x7f3718009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:28.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.477+0000 7f3727fff640 1 -- 172.21.15.99:0/3212906553 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3718038070 con 0x7f37300fdf10 2024-09-19T06:59:28.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.477+0000 7f37357c4640 1 -- 172.21.15.99:0/3212906553 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f373010d460 con 0x7f37300fdf10 2024-09-19T06:59:28.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.477+0000 7f3727fff640 1 -- 172.21.15.99:0/3212906553 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3718008ed0 con 0x7f37300fdf10 2024-09-19T06:59:28.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.477+0000 7f3727fff640 1 -- 172.21.15.99:0/3212906553 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f37180095a0 con 0x7f37300fdf10 2024-09-19T06:59:28.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.477+0000 7f37357c4640 1 -- 172.21.15.99:0/3212906553 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f373010d920 con 0x7f37300fdf10 2024-09-19T06:59:28.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.478+0000 7f37357c4640 1 -- 172.21.15.99:0/3212906553 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3730066330 con 0x7f37300fdf10 2024-09-19T06:59:28.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.478+0000 7f3727fff640 1 -- 172.21.15.99:0/3212906553 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f3718030020 con 0x7f37300fdf10 2024-09-19T06:59:28.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.479+0000 7f3727fff640 1 --2- 172.21.15.99:0/3212906553 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f371c06e530 0x7f371c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:28.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.479+0000 7f3727fff640 1 -- 172.21.15.99:0/3212906553 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f37180ae0f0 con 0x7f37300fdf10 2024-09-19T06:59:28.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.479+0000 7f372effd640 1 --2- 172.21.15.99:0/3212906553 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f371c06e530 0x7f371c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:28.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.479+0000 7f372effd640 1 --2- 172.21.15.99:0/3212906553 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f371c06e530 0x7f371c0709e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3720004c60 tx=0x7f3720009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:28.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.483+0000 7f3727fff640 1 -- 172.21.15.99:0/3212906553 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f37180771e0 con 0x7f37300fdf10 2024-09-19T06:59:28.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:59:28 smithi117 ceph-mon[76771]: from='client.34978 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:59:28.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:59:28 smithi117 ceph-mon[76771]: pgmap v513: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:59:28.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:59:28 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/858417953' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T06:59:28.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:59:28 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/2464060097' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T06:59:28.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.711+0000 7f37357c4640 1 -- 172.21.15.99:0/3212906553 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f3730109570 con 0x7f37300fdf10 2024-09-19T06:59:28.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.712+0000 7f3727fff640 1 -- 172.21.15.99:0/3212906553 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7f371807a8a0 con 0x7f37300fdf10 2024-09-19T06:59:28.713 INFO:teuthology.orchestra.run.smithi099.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-09-19T06:59:28.713 INFO:teuthology.orchestra.run.smithi099.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-19T06:59:28.713 INFO:teuthology.orchestra.run.smithi099.stdout: fs cephfs is degraded 2024-09-19T06:59:28.713 INFO:teuthology.orchestra.run.smithi099.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-19T06:59:28.713 INFO:teuthology.orchestra.run.smithi099.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-19T06:59:28.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.714+0000 7f37357c4640 1 -- 172.21.15.99:0/3212906553 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f371c06e530 msgr2=0x7f371c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:28.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.714+0000 7f37357c4640 1 --2- 172.21.15.99:0/3212906553 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f371c06e530 0x7f371c0709e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3720004c60 tx=0x7f3720009040 comp rx=0 tx=0).stop 2024-09-19T06:59:28.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.714+0000 7f37357c4640 1 -- 172.21.15.99:0/3212906553 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37300fdf10 msgr2=0x7f37301137a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:28.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.714+0000 7f37357c4640 1 --2- 172.21.15.99:0/3212906553 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37300fdf10 0x7f37301137a0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f3718004960 tx=0x7f3718009da0 comp rx=0 tx=0).stop 2024-09-19T06:59:28.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.714+0000 7f37357c4640 1 -- 172.21.15.99:0/3212906553 shutdown_connections 2024-09-19T06:59:28.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.714+0000 7f37357c4640 1 --2- 172.21.15.99:0/3212906553 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f371c06e530 0x7f371c0709e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:28.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.714+0000 7f37357c4640 1 --2- 172.21.15.99:0/3212906553 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f37300fdf10 0x7f37301137a0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:28.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.714+0000 7f37357c4640 1 --2- 172.21.15.99:0/3212906553 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f37300fd570 0x7f3730113260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:28.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.714+0000 7f37357c4640 1 -- 172.21.15.99:0/3212906553 >> 172.21.15.99:0/3212906553 conn(0x7f37300f7010 msgr2=0x7f3730105ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:59:28.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.714+0000 7f37357c4640 1 -- 172.21.15.99:0/3212906553 shutdown_connections 2024-09-19T06:59:28.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:28.714+0000 7f37357c4640 1 -- 172.21.15.99:0/3212906553 wait complete. 2024-09-19T06:59:29.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:59:29 smithi099 ceph-mon[97031]: from='client.34982 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:59:29.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:59:29 smithi099 ceph-mon[97031]: from='client.34986 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:59:29.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:59:29 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/3212906553' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T06:59:29.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:59:29 smithi117 ceph-mon[76771]: from='client.34982 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:59:29.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:59:29 smithi117 ceph-mon[76771]: from='client.34986 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:59:29.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:59:29 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/3212906553' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T06:59:30.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:59:30 smithi099 ceph-mon[97031]: from='client.34998 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:59:30.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:59:30 smithi099 ceph-mon[97031]: pgmap v514: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:59:30.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:59:30 smithi117 ceph-mon[76771]: from='client.34998 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T06:59:30.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:59:30 smithi117 ceph-mon[76771]: pgmap v514: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:59:32.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:59:32 smithi099 ceph-mon[97031]: pgmap v515: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:59:32.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:59:32 smithi117 ceph-mon[76771]: pgmap v515: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:59:33.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:59:33 smithi099 ceph-mon[97031]: pgmap v516: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:59:33.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:59:33 smithi117 ceph-mon[76771]: pgmap v516: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:59:36.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:59:36 smithi099 ceph-mon[97031]: pgmap v517: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:59:36.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:59:36 smithi117 ceph-mon[76771]: pgmap v517: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:59:37.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:59:37 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:59:37.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:59:37 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:59:38.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:59:38 smithi099 ceph-mon[97031]: pgmap v518: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:59:38.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:59:38 smithi117 ceph-mon[76771]: pgmap v518: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:59:40.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:59:40 smithi099 ceph-mon[97031]: pgmap v519: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:59:40.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:59:40 smithi117 ceph-mon[76771]: pgmap v519: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:59:42.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:59:42 smithi099 ceph-mon[97031]: pgmap v520: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:59:42.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:59:42 smithi117 ceph-mon[76771]: pgmap v520: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:59:44.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:59:44 smithi099 ceph-mon[97031]: pgmap v521: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:59:44.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:59:44 smithi117 ceph-mon[76771]: pgmap v521: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:59:46.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:59:46 smithi099 ceph-mon[97031]: pgmap v522: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:59:46.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:59:46 smithi117 ceph-mon[76771]: pgmap v522: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:59:48.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:59:48 smithi099 ceph-mon[97031]: pgmap v523: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:59:48.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:59:48 smithi117 ceph-mon[76771]: pgmap v523: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:59:50.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:59:50 smithi099 ceph-mon[97031]: pgmap v524: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:59:50.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:59:50 smithi117 ceph-mon[76771]: pgmap v524: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:59:52.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:59:52 smithi099 ceph-mon[97031]: pgmap v525: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:59:52.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:59:52 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:59:52.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:59:52 smithi117 ceph-mon[76771]: pgmap v525: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:59:52.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:59:52 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T06:59:54.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:59:54 smithi099 ceph-mon[97031]: pgmap v526: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:59:54.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:59:54 smithi117 ceph-mon[76771]: pgmap v526: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:59:56.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:59:56 smithi099 ceph-mon[97031]: pgmap v527: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:59:56.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:59:56 smithi117 ceph-mon[76771]: pgmap v527: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:59:58.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 06:59:58 smithi099 ceph-mon[97031]: pgmap v528: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:59:58.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 06:59:58 smithi117 ceph-mon[76771]: pgmap v528: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T06:59:58.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:58.803+0000 7f5ec442f640 1 -- 172.21.15.99:0/3600705086 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ebc102550 msgr2=0x7f5ebc102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:58.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:58.803+0000 7f5ec442f640 1 --2- 172.21.15.99:0/3600705086 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ebc102550 0x7f5ebc102920 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f5eb80048d0 tx=0x7f5eb8009da0 comp rx=0 tx=0).stop 2024-09-19T06:59:58.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:58.804+0000 7f5ec442f640 1 -- 172.21.15.99:0/3600705086 shutdown_connections 2024-09-19T06:59:58.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:58.804+0000 7f5ec442f640 1 --2- 172.21.15.99:0/3600705086 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ebc102ef0 0x7f5ebc0fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:58.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:58.804+0000 7f5ec442f640 1 --2- 172.21.15.99:0/3600705086 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ebc102550 0x7f5ebc102920 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:58.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:58.804+0000 7f5ec442f640 1 -- 172.21.15.99:0/3600705086 >> 172.21.15.99:0/3600705086 conn(0x7f5ebc0f80f0 msgr2=0x7f5ebc0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:59:58.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:58.804+0000 7f5ec442f640 1 -- 172.21.15.99:0/3600705086 shutdown_connections 2024-09-19T06:59:58.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:58.804+0000 7f5ec442f640 1 -- 172.21.15.99:0/3600705086 wait complete. 2024-09-19T06:59:58.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:58.804+0000 7f5ec442f640 1 Processor -- start 2024-09-19T06:59:58.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:58.804+0000 7f5ec442f640 1 -- start start 2024-09-19T06:59:58.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:58.805+0000 7f5ec442f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ebc102550 0x7f5ebc113570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:58.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:58.805+0000 7f5ec442f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ebc102ef0 0x7f5ebc113ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:58.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:58.805+0000 7f5ec442f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ebc114100 con 0x7f5ebc102550 2024-09-19T06:59:58.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:58.805+0000 7f5ec442f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ebc10d510 con 0x7f5ebc102ef0 2024-09-19T06:59:58.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:58.805+0000 7f5ec21cb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ebc102550 0x7f5ebc113570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:58.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:58.805+0000 7f5ec21cb640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ebc102550 0x7f5ebc113570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49892/0 (socket says 172.21.15.99:49892) 2024-09-19T06:59:58.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:58.805+0000 7f5ec21cb640 1 -- 172.21.15.99:0/649066188 learned_addr learned my addr 172.21.15.99:0/649066188 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:59:58.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:58.805+0000 7f5ec19ca640 1 --2- 172.21.15.99:0/649066188 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ebc102ef0 0x7f5ebc113ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:58.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:58.805+0000 7f5ec21cb640 1 -- 172.21.15.99:0/649066188 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ebc102ef0 msgr2=0x7f5ebc113ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:58.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:58.805+0000 7f5ec21cb640 1 --2- 172.21.15.99:0/649066188 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ebc102ef0 0x7f5ebc113ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:58.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:58.805+0000 7f5ec21cb640 1 -- 172.21.15.99:0/649066188 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb8005040 con 0x7f5ebc102550 2024-09-19T06:59:58.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:58.805+0000 7f5ec19ca640 1 --2- 172.21.15.99:0/649066188 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ebc102ef0 0x7f5ebc113ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:59:58.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:58.805+0000 7f5ec21cb640 1 --2- 172.21.15.99:0/649066188 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ebc102550 0x7f5ebc113570 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f5eb8000c00 tx=0x7f5eb8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:58.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:58.805+0000 7f5eb2ffd640 1 -- 172.21.15.99:0/649066188 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5eb8038070 con 0x7f5ebc102550 2024-09-19T06:59:58.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:58.806+0000 7f5eb2ffd640 1 -- 172.21.15.99:0/649066188 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5eb802ade0 con 0x7f5ebc102550 2024-09-19T06:59:58.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:58.806+0000 7f5ec442f640 1 -- 172.21.15.99:0/649066188 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ebc10d790 con 0x7f5ebc102550 2024-09-19T06:59:58.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:58.806+0000 7f5eb2ffd640 1 -- 172.21.15.99:0/649066188 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5eb802c7e0 con 0x7f5ebc102550 2024-09-19T06:59:58.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:58.806+0000 7f5ec442f640 1 -- 172.21.15.99:0/649066188 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ebc10dc50 con 0x7f5ebc102550 2024-09-19T06:59:58.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:58.807+0000 7f5ec442f640 1 -- 172.21.15.99:0/649066188 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ebc0fdcd0 con 0x7f5ebc102550 2024-09-19T06:59:58.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:58.807+0000 7f5eb2ffd640 1 -- 172.21.15.99:0/649066188 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f5eb8030020 con 0x7f5ebc102550 2024-09-19T06:59:58.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:58.808+0000 7f5eb2ffd640 1 --2- 172.21.15.99:0/649066188 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f5ea806e530 0x7f5ea80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:58.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:58.808+0000 7f5eb2ffd640 1 -- 172.21.15.99:0/649066188 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f5eb80addf0 con 0x7f5ebc102550 2024-09-19T06:59:58.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:58.808+0000 7f5ec19ca640 1 --2- 172.21.15.99:0/649066188 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f5ea806e530 0x7f5ea80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:58.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:58.808+0000 7f5ec19ca640 1 --2- 172.21.15.99:0/649066188 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f5ea806e530 0x7f5ea80709e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5eac009af0 tx=0x7f5eac00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:58.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:58.812+0000 7f5eb2ffd640 1 -- 172.21.15.99:0/649066188 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f5eb8076f90 con 0x7f5ebc102550 2024-09-19T06:59:58.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:58.995+0000 7f5ec442f640 1 -- 172.21.15.99:0/649066188 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5ebc04b7b0 con 0x7f5ea806e530 2024-09-19T06:59:58.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:58.996+0000 7f5eb2ffd640 1 -- 172.21.15.99:0/649066188 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f5ebc04b7b0 con 0x7f5ea806e530 2024-09-19T06:59:58.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:58.998+0000 7f5ec442f640 1 -- 172.21.15.99:0/649066188 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f5ea806e530 msgr2=0x7f5ea80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:58.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:58.998+0000 7f5ec442f640 1 --2- 172.21.15.99:0/649066188 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f5ea806e530 0x7f5ea80709e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5eac009af0 tx=0x7f5eac00b040 comp rx=0 tx=0).stop 2024-09-19T06:59:59.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:58.998+0000 7f5ec442f640 1 -- 172.21.15.99:0/649066188 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ebc102550 msgr2=0x7f5ebc113570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:59.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:58.998+0000 7f5ec442f640 1 --2- 172.21.15.99:0/649066188 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ebc102550 0x7f5ebc113570 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f5eb8000c00 tx=0x7f5eb8009da0 comp rx=0 tx=0).stop 2024-09-19T06:59:59.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:58.998+0000 7f5ec442f640 1 -- 172.21.15.99:0/649066188 shutdown_connections 2024-09-19T06:59:59.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:58.998+0000 7f5ec442f640 1 --2- 172.21.15.99:0/649066188 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f5ea806e530 0x7f5ea80709e0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:59.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:58.998+0000 7f5ec442f640 1 --2- 172.21.15.99:0/649066188 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ebc102ef0 0x7f5ebc113ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:59.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:58.998+0000 7f5ec442f640 1 --2- 172.21.15.99:0/649066188 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ebc102550 0x7f5ebc113570 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:59.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:58.998+0000 7f5ec442f640 1 -- 172.21.15.99:0/649066188 >> 172.21.15.99:0/649066188 conn(0x7f5ebc0f80f0 msgr2=0x7f5ebc0f90b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:59:59.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:58.999+0000 7f5ec442f640 1 -- 172.21.15.99:0/649066188 shutdown_connections 2024-09-19T06:59:59.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:58.999+0000 7f5ec442f640 1 -- 172.21.15.99:0/649066188 wait complete. 2024-09-19T06:59:59.008 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-09-19T06:59:59.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.078+0000 7fa62c2ba640 1 -- 172.21.15.99:0/3389449678 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa624102530 msgr2=0x7fa624102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:59.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.078+0000 7fa62c2ba640 1 --2- 172.21.15.99:0/3389449678 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa624102530 0x7fa624102900 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fa61c0048d0 tx=0x7fa61c009da0 comp rx=0 tx=0).stop 2024-09-19T06:59:59.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.078+0000 7fa62c2ba640 1 -- 172.21.15.99:0/3389449678 shutdown_connections 2024-09-19T06:59:59.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.078+0000 7fa62c2ba640 1 --2- 172.21.15.99:0/3389449678 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa624102ed0 0x7fa6240fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:59.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.078+0000 7fa62c2ba640 1 --2- 172.21.15.99:0/3389449678 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa624102530 0x7fa624102900 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:59.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.078+0000 7fa62c2ba640 1 -- 172.21.15.99:0/3389449678 >> 172.21.15.99:0/3389449678 conn(0x7fa6240f8110 msgr2=0x7fa6240fa520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:59:59.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.078+0000 7fa62c2ba640 1 -- 172.21.15.99:0/3389449678 shutdown_connections 2024-09-19T06:59:59.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.078+0000 7fa62c2ba640 1 -- 172.21.15.99:0/3389449678 wait complete. 2024-09-19T06:59:59.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.079+0000 7fa62c2ba640 1 Processor -- start 2024-09-19T06:59:59.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.079+0000 7fa62c2ba640 1 -- start start 2024-09-19T06:59:59.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.079+0000 7fa62c2ba640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa624102530 0x7fa62406fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:59.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.079+0000 7fa62c2ba640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa624102ed0 0x7fa62406ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:59.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.079+0000 7fa62c2ba640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa624070490 con 0x7fa624102ed0 2024-09-19T06:59:59.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.079+0000 7fa62c2ba640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa624070600 con 0x7fa624102530 2024-09-19T06:59:59.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.079+0000 7fa629855640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa624102ed0 0x7fa62406ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:59.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.079+0000 7fa629855640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa624102ed0 0x7fa62406ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49910/0 (socket says 172.21.15.99:49910) 2024-09-19T06:59:59.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.079+0000 7fa629855640 1 -- 172.21.15.99:0/1593917466 learned_addr learned my addr 172.21.15.99:0/1593917466 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:59:59.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.079+0000 7fa62a056640 1 --2- 172.21.15.99:0/1593917466 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa624102530 0x7fa62406fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:59.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.079+0000 7fa629855640 1 -- 172.21.15.99:0/1593917466 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa624102530 msgr2=0x7fa62406fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:59.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.079+0000 7fa629855640 1 --2- 172.21.15.99:0/1593917466 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa624102530 0x7fa62406fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:59.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.079+0000 7fa629855640 1 -- 172.21.15.99:0/1593917466 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa61c005040 con 0x7fa624102ed0 2024-09-19T06:59:59.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.080+0000 7fa629855640 1 --2- 172.21.15.99:0/1593917466 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa624102ed0 0x7fa62406ff50 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fa61400eb40 tx=0x7fa61400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:59.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.080+0000 7fa61affd640 1 -- 172.21.15.99:0/1593917466 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa614007c30 con 0x7fa624102ed0 2024-09-19T06:59:59.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.080+0000 7fa61affd640 1 -- 172.21.15.99:0/1593917466 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa61400f040 con 0x7fa624102ed0 2024-09-19T06:59:59.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.080+0000 7fa62c2ba640 1 -- 172.21.15.99:0/1593917466 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa624070830 con 0x7fa624102ed0 2024-09-19T06:59:59.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.080+0000 7fa61affd640 1 -- 172.21.15.99:0/1593917466 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa61400ca90 con 0x7fa624102ed0 2024-09-19T06:59:59.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.080+0000 7fa62c2ba640 1 -- 172.21.15.99:0/1593917466 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6241198c0 con 0x7fa624102ed0 2024-09-19T06:59:59.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.081+0000 7fa62c2ba640 1 -- 172.21.15.99:0/1593917466 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6240fdcb0 con 0x7fa624102ed0 2024-09-19T06:59:59.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.081+0000 7fa61affd640 1 -- 172.21.15.99:0/1593917466 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fa61400cbf0 con 0x7fa624102ed0 2024-09-19T06:59:59.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.082+0000 7fa61affd640 1 --2- 172.21.15.99:0/1593917466 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa61006e530 0x7fa6100709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:59.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.082+0000 7fa61affd640 1 -- 172.21.15.99:0/1593917466 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fa61408dc60 con 0x7fa624102ed0 2024-09-19T06:59:59.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.082+0000 7fa62a056640 1 --2- 172.21.15.99:0/1593917466 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa61006e530 0x7fa6100709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:59.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.082+0000 7fa62a056640 1 --2- 172.21.15.99:0/1593917466 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa61006e530 0x7fa6100709e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa61c004540 tx=0x7fa61c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:59.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.086+0000 7fa61affd640 1 -- 172.21.15.99:0/1593917466 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fa614056e80 con 0x7fa624102ed0 2024-09-19T06:59:59.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.270+0000 7fa62c2ba640 1 -- 172.21.15.99:0/1593917466 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa624109610 con 0x7fa61006e530 2024-09-19T06:59:59.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.271+0000 7fa61affd640 1 -- 172.21.15.99:0/1593917466 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fa624109610 con 0x7fa61006e530 2024-09-19T06:59:59.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.273+0000 7fa62c2ba640 1 -- 172.21.15.99:0/1593917466 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa61006e530 msgr2=0x7fa6100709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:59.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.273+0000 7fa62c2ba640 1 --2- 172.21.15.99:0/1593917466 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa61006e530 0x7fa6100709e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa61c004540 tx=0x7fa61c035040 comp rx=0 tx=0).stop 2024-09-19T06:59:59.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.273+0000 7fa62c2ba640 1 -- 172.21.15.99:0/1593917466 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa624102ed0 msgr2=0x7fa62406ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:59.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.273+0000 7fa62c2ba640 1 --2- 172.21.15.99:0/1593917466 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa624102ed0 0x7fa62406ff50 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fa61400eb40 tx=0x7fa61400b040 comp rx=0 tx=0).stop 2024-09-19T06:59:59.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.273+0000 7fa62c2ba640 1 -- 172.21.15.99:0/1593917466 shutdown_connections 2024-09-19T06:59:59.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.273+0000 7fa62c2ba640 1 --2- 172.21.15.99:0/1593917466 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa61006e530 0x7fa6100709e0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:59.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.273+0000 7fa62c2ba640 1 --2- 172.21.15.99:0/1593917466 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa624102ed0 0x7fa62406ff50 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:59.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.273+0000 7fa62c2ba640 1 --2- 172.21.15.99:0/1593917466 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa624102530 0x7fa62406fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:59.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.273+0000 7fa62c2ba640 1 -- 172.21.15.99:0/1593917466 >> 172.21.15.99:0/1593917466 conn(0x7fa6240f8110 msgr2=0x7fa6240f9190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:59:59.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.274+0000 7fa62c2ba640 1 -- 172.21.15.99:0/1593917466 shutdown_connections 2024-09-19T06:59:59.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.274+0000 7fa62c2ba640 1 -- 172.21.15.99:0/1593917466 wait complete. 2024-09-19T06:59:59.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.352+0000 7fdf1e876640 1 -- 172.21.15.99:0/3591457059 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf18102550 msgr2=0x7fdf18102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:59.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.352+0000 7fdf1e876640 1 --2- 172.21.15.99:0/3591457059 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf18102550 0x7fdf18102920 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fdf080048d0 tx=0x7fdf08009da0 comp rx=0 tx=0).stop 2024-09-19T06:59:59.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.352+0000 7fdf1e876640 1 -- 172.21.15.99:0/3591457059 shutdown_connections 2024-09-19T06:59:59.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.352+0000 7fdf1e876640 1 --2- 172.21.15.99:0/3591457059 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf18102ef0 0x7fdf180fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:59.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.352+0000 7fdf1e876640 1 --2- 172.21.15.99:0/3591457059 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf18102550 0x7fdf18102920 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:59.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.352+0000 7fdf1e876640 1 -- 172.21.15.99:0/3591457059 >> 172.21.15.99:0/3591457059 conn(0x7fdf180f80f0 msgr2=0x7fdf180fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:59:59.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.352+0000 7fdf1e876640 1 -- 172.21.15.99:0/3591457059 shutdown_connections 2024-09-19T06:59:59.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.352+0000 7fdf1e876640 1 -- 172.21.15.99:0/3591457059 wait complete. 2024-09-19T06:59:59.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.352+0000 7fdf1e876640 1 Processor -- start 2024-09-19T06:59:59.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.353+0000 7fdf1e876640 1 -- start start 2024-09-19T06:59:59.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.353+0000 7fdf1e876640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf18102550 0x7fdf1806fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:59.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.353+0000 7fdf1e876640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf18102ef0 0x7fdf1806ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:59.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.353+0000 7fdf1e876640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf18070520 con 0x7fdf18102ef0 2024-09-19T06:59:59.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.353+0000 7fdf1e876640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf18070690 con 0x7fdf18102550 2024-09-19T06:59:59.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.353+0000 7fdf177fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf18102ef0 0x7fdf1806ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:59.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.353+0000 7fdf177fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf18102ef0 0x7fdf1806ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49920/0 (socket says 172.21.15.99:49920) 2024-09-19T06:59:59.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.353+0000 7fdf177fe640 1 -- 172.21.15.99:0/4136234332 learned_addr learned my addr 172.21.15.99:0/4136234332 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:59:59.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.353+0000 7fdf17fff640 1 --2- 172.21.15.99:0/4136234332 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf18102550 0x7fdf1806fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:59.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.353+0000 7fdf177fe640 1 -- 172.21.15.99:0/4136234332 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf18102550 msgr2=0x7fdf1806fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:59.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.353+0000 7fdf177fe640 1 --2- 172.21.15.99:0/4136234332 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf18102550 0x7fdf1806fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:59.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.353+0000 7fdf177fe640 1 -- 172.21.15.99:0/4136234332 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf08005040 con 0x7fdf18102ef0 2024-09-19T06:59:59.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.354+0000 7fdf177fe640 1 --2- 172.21.15.99:0/4136234332 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf18102ef0 0x7fdf1806ff50 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c00b540 tx=0x7fdf0c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:59.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.354+0000 7fdf14ff9640 1 -- 172.21.15.99:0/4136234332 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf0c00f6f0 con 0x7fdf18102ef0 2024-09-19T06:59:59.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.354+0000 7fdf1e876640 1 -- 172.21.15.99:0/4136234332 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf181198d0 con 0x7fdf18102ef0 2024-09-19T06:59:59.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.354+0000 7fdf14ff9640 1 -- 172.21.15.99:0/4136234332 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fdf0c00fcf0 con 0x7fdf18102ef0 2024-09-19T06:59:59.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.354+0000 7fdf14ff9640 1 -- 172.21.15.99:0/4136234332 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf0c011e80 con 0x7fdf18102ef0 2024-09-19T06:59:59.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.354+0000 7fdf1e876640 1 -- 172.21.15.99:0/4136234332 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf18119d10 con 0x7fdf18102ef0 2024-09-19T06:59:59.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.355+0000 7fdf1e876640 1 -- 172.21.15.99:0/4136234332 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf180fdcd0 con 0x7fdf18102ef0 2024-09-19T06:59:59.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.355+0000 7fdf14ff9640 1 -- 172.21.15.99:0/4136234332 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fdf0c0116b0 con 0x7fdf18102ef0 2024-09-19T06:59:59.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.356+0000 7fdf14ff9640 1 --2- 172.21.15.99:0/4136234332 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fdf0006e530 0x7fdf000709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:59.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.356+0000 7fdf17fff640 1 --2- 172.21.15.99:0/4136234332 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fdf0006e530 0x7fdf000709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:59.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.356+0000 7fdf14ff9640 1 -- 172.21.15.99:0/4136234332 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fdf0c08dfb0 con 0x7fdf18102ef0 2024-09-19T06:59:59.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.356+0000 7fdf17fff640 1 --2- 172.21.15.99:0/4136234332 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fdf0006e530 0x7fdf000709e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fdf080048a0 tx=0x7fdf08035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:59.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.360+0000 7fdf14ff9640 1 -- 172.21.15.99:0/4136234332 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fdf0c0c3210 con 0x7fdf18102ef0 2024-09-19T06:59:59.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.535+0000 7fdf1e876640 1 -- 172.21.15.99:0/4136234332 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fdf1804b720 con 0x7fdf0006e530 2024-09-19T06:59:59.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.544+0000 7fdf14ff9640 1 -- 172.21.15.99:0/4136234332 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7fdf1804b720 con 0x7fdf0006e530 2024-09-19T06:59:59.545 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T06:59:59.545 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.smithi099 smithi099 *:9093,9094 running (19m) 11m ago 27m 23.4M - 0.25.0 c8568f914cd2 e7c1774d56b0 2024-09-19T06:59:59.545 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi099 smithi099 running (15m) 11m ago 27m 6899k - 19.1.1-361-g2f599a46 d2baa855c067 b9775f416b10 2024-09-19T06:59:59.545 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi117 smithi117 running (15m) 11m ago 26m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 38cf60c0d548 2024-09-19T06:59:59.545 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.smithi099 smithi099 *:3000 running (17m) 11m ago 27m 80.7M - 9.4.12 2bacad6d85d8 cd53a18d5410 2024-09-19T06:59:59.545 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.obarqf smithi099 running (12m) 11m ago 22m 12.2M - 19.1.1-361-g2f599a46 d2baa855c067 314a73082521 2024-09-19T06:59:59.545 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.xehbxe smithi099 running (11m) 11m ago 22m 14.4M - 19.1.1-361-g2f599a46 d2baa855c067 a2955a9d06e6 2024-09-19T06:59:59.545 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.bheqzh smithi117 running (11m) 11m ago 22m 11.8M - 19.1.1-361-g2f599a46 d2baa855c067 b1505937c0b7 2024-09-19T06:59:59.545 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.nooexo smithi117 running (11m) 11m ago 22m 13.1M - 19.1.1-361-g2f599a46 d2baa855c067 35bd7725855c 2024-09-19T06:59:59.545 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi099.pgvkqi smithi099 *:8443,9283,8765 running (18m) 11m ago 28m 505M - 19.1.1-361-g2f599a46 d2baa855c067 d5de99cb7e78 2024-09-19T06:59:59.546 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi117.ssmkcf smithi117 *:8443,9283,8765 running (17m) 11m ago 26m 444M - 19.1.1-361-g2f599a46 d2baa855c067 8b7ee0f871f5 2024-09-19T06:59:59.546 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi099 smithi099 running (16m) 11m ago 28m 52.4M 2048M 19.1.1-361-g2f599a46 d2baa855c067 ffe067438824 2024-09-19T06:59:59.546 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi117 smithi117 running (16m) 11m ago 26m 38.9M 2048M 19.1.1-361-g2f599a46 d2baa855c067 4cb7455e3ee7 2024-09-19T06:59:59.546 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi099 smithi099 *:9100 running (19m) 11m ago 27m 15.0M - 1.5.0 0da6a335fe13 dca7b4517dcc 2024-09-19T06:59:59.546 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi117 smithi117 *:9100 running (18m) 11m ago 26m 15.9M - 1.5.0 0da6a335fe13 8233ce3835d2 2024-09-19T06:59:59.546 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (15m) 11m ago 25m 100M 1557M 19.1.1-361-g2f599a46 d2baa855c067 8e22543bf933 2024-09-19T06:59:59.546 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (14m) 11m ago 25m 106M 1557M 19.1.1-361-g2f599a46 d2baa855c067 f54153d0ae09 2024-09-19T06:59:59.546 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (13m) 11m ago 24m 83.7M 1557M 19.1.1-361-g2f599a46 d2baa855c067 b1778ab88870 2024-09-19T06:59:59.546 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi117 running (13m) 11m ago 24m 102M 2581M 19.1.1-361-g2f599a46 d2baa855c067 ea5236b193d3 2024-09-19T06:59:59.546 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi117 running (12m) 11m ago 24m 93.5M 2581M 19.1.1-361-g2f599a46 d2baa855c067 27ac2c859a68 2024-09-19T06:59:59.546 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi117 running (12m) 11m ago 23m 100M 2581M 19.1.1-361-g2f599a46 d2baa855c067 de6aeb8544ce 2024-09-19T06:59:59.546 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.smithi099 smithi099 *:9095 running (17m) 11m ago 27m 64.4M - 2.43.0 a07b618ecd1d 15ad26ec6fb4 2024-09-19T06:59:59.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.546+0000 7fdf1e876640 1 -- 172.21.15.99:0/4136234332 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fdf0006e530 msgr2=0x7fdf000709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:59.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.546+0000 7fdf1e876640 1 --2- 172.21.15.99:0/4136234332 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fdf0006e530 0x7fdf000709e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fdf080048a0 tx=0x7fdf08035040 comp rx=0 tx=0).stop 2024-09-19T06:59:59.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.546+0000 7fdf1e876640 1 -- 172.21.15.99:0/4136234332 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf18102ef0 msgr2=0x7fdf1806ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:59.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.546+0000 7fdf1e876640 1 --2- 172.21.15.99:0/4136234332 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf18102ef0 0x7fdf1806ff50 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c00b540 tx=0x7fdf0c0091a0 comp rx=0 tx=0).stop 2024-09-19T06:59:59.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.546+0000 7fdf1e876640 1 -- 172.21.15.99:0/4136234332 shutdown_connections 2024-09-19T06:59:59.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.546+0000 7fdf1e876640 1 --2- 172.21.15.99:0/4136234332 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fdf0006e530 0x7fdf000709e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:59.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.546+0000 7fdf1e876640 1 --2- 172.21.15.99:0/4136234332 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdf18102ef0 0x7fdf1806ff50 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:59.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.546+0000 7fdf1e876640 1 --2- 172.21.15.99:0/4136234332 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdf18102550 0x7fdf1806fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:59.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.546+0000 7fdf1e876640 1 -- 172.21.15.99:0/4136234332 >> 172.21.15.99:0/4136234332 conn(0x7fdf180f80f0 msgr2=0x7fdf180f9180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:59:59.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.546+0000 7fdf1e876640 1 -- 172.21.15.99:0/4136234332 shutdown_connections 2024-09-19T06:59:59.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.546+0000 7fdf1e876640 1 -- 172.21.15.99:0/4136234332 wait complete. 2024-09-19T06:59:59.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.623+0000 7f4a7b897640 1 -- 172.21.15.99:0/3179406200 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4a74102ef0 msgr2=0x7f4a740fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:59.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.623+0000 7f4a7b897640 1 --2- 172.21.15.99:0/3179406200 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4a74102ef0 0x7f4a740fc5b0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f4a680048d0 tx=0x7f4a68009da0 comp rx=0 tx=0).stop 2024-09-19T06:59:59.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.623+0000 7f4a7b897640 1 -- 172.21.15.99:0/3179406200 shutdown_connections 2024-09-19T06:59:59.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.623+0000 7f4a7b897640 1 --2- 172.21.15.99:0/3179406200 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4a74102ef0 0x7f4a740fc5b0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:59.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.623+0000 7f4a7b897640 1 --2- 172.21.15.99:0/3179406200 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a74102550 0x7f4a74102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:59.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.623+0000 7f4a7b897640 1 -- 172.21.15.99:0/3179406200 >> 172.21.15.99:0/3179406200 conn(0x7f4a740f80f0 msgr2=0x7f4a740fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:59:59.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.623+0000 7f4a7b897640 1 -- 172.21.15.99:0/3179406200 shutdown_connections 2024-09-19T06:59:59.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.623+0000 7f4a7b897640 1 -- 172.21.15.99:0/3179406200 wait complete. 2024-09-19T06:59:59.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.624+0000 7f4a7b897640 1 Processor -- start 2024-09-19T06:59:59.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.624+0000 7f4a7b897640 1 -- start start 2024-09-19T06:59:59.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.624+0000 7f4a7b897640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4a74102550 0x7f4a74113520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:59.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.624+0000 7f4a7b897640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a74102ef0 0x7f4a74113a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:59.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.624+0000 7f4a7b897640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a741140b0 con 0x7f4a74102550 2024-09-19T06:59:59.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.624+0000 7f4a7b897640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7410d4c0 con 0x7f4a74102ef0 2024-09-19T06:59:59.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.624+0000 7f4a79633640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4a74102550 0x7f4a74113520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:59.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.624+0000 7f4a79633640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4a74102550 0x7f4a74113520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49940/0 (socket says 172.21.15.99:49940) 2024-09-19T06:59:59.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.624+0000 7f4a79633640 1 -- 172.21.15.99:0/1206191918 learned_addr learned my addr 172.21.15.99:0/1206191918 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:59:59.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.624+0000 7f4a78e32640 1 --2- 172.21.15.99:0/1206191918 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a74102ef0 0x7f4a74113a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:59.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.624+0000 7f4a79633640 1 -- 172.21.15.99:0/1206191918 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a74102ef0 msgr2=0x7f4a74113a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:59.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.624+0000 7f4a79633640 1 --2- 172.21.15.99:0/1206191918 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a74102ef0 0x7f4a74113a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:59.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.624+0000 7f4a79633640 1 -- 172.21.15.99:0/1206191918 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a68005040 con 0x7f4a74102550 2024-09-19T06:59:59.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.625+0000 7f4a79633640 1 --2- 172.21.15.99:0/1206191918 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4a74102550 0x7f4a74113520 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c002a50 tx=0x7f4a6c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:59.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.625+0000 7f4a71ffb640 1 -- 172.21.15.99:0/1206191918 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a6c007c30 con 0x7f4a74102550 2024-09-19T06:59:59.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.625+0000 7f4a71ffb640 1 -- 172.21.15.99:0/1206191918 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4a6c00f040 con 0x7f4a74102550 2024-09-19T06:59:59.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.625+0000 7f4a7b897640 1 -- 172.21.15.99:0/1206191918 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a7410d7a0 con 0x7f4a74102550 2024-09-19T06:59:59.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.625+0000 7f4a71ffb640 1 -- 172.21.15.99:0/1206191918 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a6c00da90 con 0x7f4a74102550 2024-09-19T06:59:59.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.625+0000 7f4a7b897640 1 -- 172.21.15.99:0/1206191918 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a7410dd40 con 0x7f4a74102550 2024-09-19T06:59:59.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.626+0000 7f4a7b897640 1 -- 172.21.15.99:0/1206191918 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a740fdcd0 con 0x7f4a74102550 2024-09-19T06:59:59.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.627+0000 7f4a71ffb640 1 -- 172.21.15.99:0/1206191918 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f4a6c00dc30 con 0x7f4a74102550 2024-09-19T06:59:59.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.628+0000 7f4a71ffb640 1 --2- 172.21.15.99:0/1206191918 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f4a5c06e530 0x7f4a5c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:59.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.628+0000 7f4a71ffb640 1 -- 172.21.15.99:0/1206191918 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f4a6c08d9c0 con 0x7f4a74102550 2024-09-19T06:59:59.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.628+0000 7f4a78e32640 1 --2- 172.21.15.99:0/1206191918 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f4a5c06e530 0x7f4a5c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:59.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.628+0000 7f4a78e32640 1 --2- 172.21.15.99:0/1206191918 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f4a5c06e530 0x7f4a5c0709e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4a7410e7a0 tx=0x7f4a68009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:59.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.632+0000 7f4a71ffb640 1 -- 172.21.15.99:0/1206191918 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f4a6c056b30 con 0x7f4a74102550 2024-09-19T06:59:59.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.863+0000 7f4a7b897640 1 -- 172.21.15.99:0/1206191918 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4a7404b7b0 con 0x7f4a74102550 2024-09-19T06:59:59.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.863+0000 7f4a71ffb640 1 -- 172.21.15.99:0/1206191918 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f4a6c05a1f0 con 0x7f4a74102550 2024-09-19T06:59:59.865 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T06:59:59.865 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-09-19T06:59:59.865 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T06:59:59.865 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:59:59.865 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-09-19T06:59:59.865 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T06:59:59.865 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:59:59.865 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-09-19T06:59:59.865 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 6 2024-09-19T06:59:59.865 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:59:59.865 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": { 2024-09-19T06:59:59.865 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 4 2024-09-19T06:59:59.866 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T06:59:59.866 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-09-19T06:59:59.866 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 14 2024-09-19T06:59:59.866 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T06:59:59.866 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T06:59:59.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.865+0000 7f4a7b897640 1 -- 172.21.15.99:0/1206191918 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f4a5c06e530 msgr2=0x7f4a5c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:59.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.865+0000 7f4a7b897640 1 --2- 172.21.15.99:0/1206191918 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f4a5c06e530 0x7f4a5c0709e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4a7410e7a0 tx=0x7f4a68009da0 comp rx=0 tx=0).stop 2024-09-19T06:59:59.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.865+0000 7f4a7b897640 1 -- 172.21.15.99:0/1206191918 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4a74102550 msgr2=0x7f4a74113520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:59.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.865+0000 7f4a7b897640 1 --2- 172.21.15.99:0/1206191918 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4a74102550 0x7f4a74113520 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c002a50 tx=0x7f4a6c004600 comp rx=0 tx=0).stop 2024-09-19T06:59:59.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.866+0000 7f4a7b897640 1 -- 172.21.15.99:0/1206191918 shutdown_connections 2024-09-19T06:59:59.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.866+0000 7f4a7b897640 1 --2- 172.21.15.99:0/1206191918 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f4a5c06e530 0x7f4a5c0709e0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:59.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.866+0000 7f4a7b897640 1 --2- 172.21.15.99:0/1206191918 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4a74102ef0 0x7f4a74113a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:59.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.866+0000 7f4a7b897640 1 --2- 172.21.15.99:0/1206191918 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4a74102550 0x7f4a74113520 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:59.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.866+0000 7f4a7b897640 1 -- 172.21.15.99:0/1206191918 >> 172.21.15.99:0/1206191918 conn(0x7f4a740f80f0 msgr2=0x7f4a740f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:59:59.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.866+0000 7f4a7b897640 1 -- 172.21.15.99:0/1206191918 shutdown_connections 2024-09-19T06:59:59.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.866+0000 7f4a7b897640 1 -- 172.21.15.99:0/1206191918 wait complete. 2024-09-19T06:59:59.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.944+0000 7fdce14a5640 1 -- 172.21.15.99:0/3173528126 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdcdc0fd580 msgr2=0x7fdcdc0fd950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:59.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.944+0000 7fdce14a5640 1 --2- 172.21.15.99:0/3173528126 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdcdc0fd580 0x7fdcdc0fd950 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fdccc0048d0 tx=0x7fdccc009da0 comp rx=0 tx=0).stop 2024-09-19T06:59:59.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.944+0000 7fdce14a5640 1 -- 172.21.15.99:0/3173528126 shutdown_connections 2024-09-19T06:59:59.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.944+0000 7fdce14a5640 1 --2- 172.21.15.99:0/3173528126 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdcdc0fdf20 0x7fdcdc106560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:59.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.944+0000 7fdce14a5640 1 --2- 172.21.15.99:0/3173528126 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdcdc0fd580 0x7fdcdc0fd950 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:59.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.944+0000 7fdce14a5640 1 -- 172.21.15.99:0/3173528126 >> 172.21.15.99:0/3173528126 conn(0x7fdcdc0f7010 msgr2=0x7fdcdc0f9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T06:59:59.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.944+0000 7fdce14a5640 1 -- 172.21.15.99:0/3173528126 shutdown_connections 2024-09-19T06:59:59.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.944+0000 7fdce14a5640 1 -- 172.21.15.99:0/3173528126 wait complete. 2024-09-19T06:59:59.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.945+0000 7fdce14a5640 1 Processor -- start 2024-09-19T06:59:59.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.945+0000 7fdce14a5640 1 -- start start 2024-09-19T06:59:59.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.945+0000 7fdce14a5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdcdc0fd580 0x7fdcdc113230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:59.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.945+0000 7fdce14a5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdcdc0fdf20 0x7fdcdc113770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:59.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.945+0000 7fdce14a5640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc113d70 con 0x7fdcdc0fdf20 2024-09-19T06:59:59.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.945+0000 7fdce14a5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc10d1b0 con 0x7fdcdc0fd580 2024-09-19T06:59:59.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.945+0000 7fdcda7fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdcdc0fdf20 0x7fdcdc113770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:59.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.945+0000 7fdcda7fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdcdc0fdf20 0x7fdcdc113770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49970/0 (socket says 172.21.15.99:49970) 2024-09-19T06:59:59.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.945+0000 7fdcda7fc640 1 -- 172.21.15.99:0/3880825443 learned_addr learned my addr 172.21.15.99:0/3880825443 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T06:59:59.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.945+0000 7fdcda7fc640 1 -- 172.21.15.99:0/3880825443 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdcdc0fd580 msgr2=0x7fdcdc113230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T06:59:59.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.945+0000 7fdcdaffd640 1 --2- 172.21.15.99:0/3880825443 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdcdc0fd580 0x7fdcdc113230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:59.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.945+0000 7fdcda7fc640 1 --2- 172.21.15.99:0/3880825443 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdcdc0fd580 0x7fdcdc113230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T06:59:59.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.946+0000 7fdcda7fc640 1 -- 172.21.15.99:0/3880825443 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdccc005040 con 0x7fdcdc0fdf20 2024-09-19T06:59:59.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.946+0000 7fdcdaffd640 1 --2- 172.21.15.99:0/3880825443 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdcdc0fd580 0x7fdcdc113230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T06:59:59.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.946+0000 7fdcda7fc640 1 --2- 172.21.15.99:0/3880825443 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdcdc0fdf20 0x7fdcdc113770 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fdcd0002a80 tx=0x7fdcd0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:59.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.946+0000 7fdcc37fe640 1 -- 172.21.15.99:0/3880825443 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdcd0007c30 con 0x7fdcdc0fdf20 2024-09-19T06:59:59.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.946+0000 7fdcc37fe640 1 -- 172.21.15.99:0/3880825443 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fdcd000f040 con 0x7fdcdc0fdf20 2024-09-19T06:59:59.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.946+0000 7fdcc37fe640 1 -- 172.21.15.99:0/3880825443 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdcd0009530 con 0x7fdcdc0fdf20 2024-09-19T06:59:59.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.946+0000 7fdce14a5640 1 -- 172.21.15.99:0/3880825443 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcdc10d490 con 0x7fdcdc0fdf20 2024-09-19T06:59:59.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.946+0000 7fdce14a5640 1 -- 172.21.15.99:0/3880825443 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcdc10d9b0 con 0x7fdcdc0fdf20 2024-09-19T06:59:59.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.948+0000 7fdce14a5640 1 -- 172.21.15.99:0/3880825443 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcdc0663b0 con 0x7fdcdc0fdf20 2024-09-19T06:59:59.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.948+0000 7fdcc37fe640 1 -- 172.21.15.99:0/3880825443 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fdcd00097a0 con 0x7fdcdc0fdf20 2024-09-19T06:59:59.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.948+0000 7fdcc37fe640 1 --2- 172.21.15.99:0/3880825443 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fdcc406e530 0x7fdcc40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T06:59:59.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.949+0000 7fdcc37fe640 1 -- 172.21.15.99:0/3880825443 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fdcd008db80 con 0x7fdcdc0fdf20 2024-09-19T06:59:59.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.949+0000 7fdcdaffd640 1 --2- 172.21.15.99:0/3880825443 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fdcc406e530 0x7fdcc40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T06:59:59.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.949+0000 7fdcdaffd640 1 --2- 172.21.15.99:0/3880825443 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fdcc406e530 0x7fdcc40709e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fdccc00b020 tx=0x7fdccc009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T06:59:59.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T06:59:59.953+0000 7fdcc37fe640 1 -- 172.21.15.99:0/3880825443 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fdcd0056c70 con 0x7fdcdc0fdf20 2024-09-19T07:00:00.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.152+0000 7fdce14a5640 1 -- 172.21.15.99:0/3880825443 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fdcdc0fac50 con 0x7fdcdc0fdf20 2024-09-19T07:00:00.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.152+0000 7fdcc37fe640 1 -- 172.21.15.99:0/3880825443 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 29 v29) v1 ==== 76+0+1915 (secure 0 0 0) 0x7fdcd005a330 con 0x7fdcdc0fdf20 2024-09-19T07:00:00.154 INFO:teuthology.orchestra.run.smithi099.stdout:e29 2024-09-19T07:00:00.154 INFO:teuthology.orchestra.run.smithi099.stdout:btime 2024-09-19T06:48:47:938420+0000 2024-09-19T07:00:00.154 INFO:teuthology.orchestra.run.smithi099.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T07:00:00.154 INFO:teuthology.orchestra.run.smithi099.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T07:00:00.154 INFO:teuthology.orchestra.run.smithi099.stdout:legacy client fscid: 1 2024-09-19T07:00:00.154 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T07:00:00.154 INFO:teuthology.orchestra.run.smithi099.stdout:Filesystem 'cephfs' (1) 2024-09-19T07:00:00.154 INFO:teuthology.orchestra.run.smithi099.stdout:fs_name cephfs 2024-09-19T07:00:00.154 INFO:teuthology.orchestra.run.smithi099.stdout:epoch 20 2024-09-19T07:00:00.154 INFO:teuthology.orchestra.run.smithi099.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-19T07:00:00.154 INFO:teuthology.orchestra.run.smithi099.stdout:created 2024-09-19T06:37:40.838146+0000 2024-09-19T07:00:00.154 INFO:teuthology.orchestra.run.smithi099.stdout:modified 2024-09-19T06:47:50.076553+0000 2024-09-19T07:00:00.155 INFO:teuthology.orchestra.run.smithi099.stdout:tableserver 0 2024-09-19T07:00:00.155 INFO:teuthology.orchestra.run.smithi099.stdout:root 0 2024-09-19T07:00:00.155 INFO:teuthology.orchestra.run.smithi099.stdout:session_timeout 60 2024-09-19T07:00:00.155 INFO:teuthology.orchestra.run.smithi099.stdout:session_autoclose 300 2024-09-19T07:00:00.155 INFO:teuthology.orchestra.run.smithi099.stdout:max_file_size 1099511627776 2024-09-19T07:00:00.155 INFO:teuthology.orchestra.run.smithi099.stdout:max_xattr_size 65536 2024-09-19T07:00:00.155 INFO:teuthology.orchestra.run.smithi099.stdout:required_client_features {} 2024-09-19T07:00:00.155 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure 0 2024-09-19T07:00:00.155 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure_osd_epoch 77 2024-09-19T07:00:00.155 INFO:teuthology.orchestra.run.smithi099.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T07:00:00.155 INFO:teuthology.orchestra.run.smithi099.stdout:max_mds 2 2024-09-19T07:00:00.155 INFO:teuthology.orchestra.run.smithi099.stdout:in 0,1 2024-09-19T07:00:00.155 INFO:teuthology.orchestra.run.smithi099.stdout:up {} 2024-09-19T07:00:00.155 INFO:teuthology.orchestra.run.smithi099.stdout:failed 0,1 2024-09-19T07:00:00.156 INFO:teuthology.orchestra.run.smithi099.stdout:damaged 2024-09-19T07:00:00.156 INFO:teuthology.orchestra.run.smithi099.stdout:stopped 2024-09-19T07:00:00.156 INFO:teuthology.orchestra.run.smithi099.stdout:data_pools [3] 2024-09-19T07:00:00.156 INFO:teuthology.orchestra.run.smithi099.stdout:metadata_pool 2 2024-09-19T07:00:00.156 INFO:teuthology.orchestra.run.smithi099.stdout:inline_data disabled 2024-09-19T07:00:00.156 INFO:teuthology.orchestra.run.smithi099.stdout:balancer 2024-09-19T07:00:00.156 INFO:teuthology.orchestra.run.smithi099.stdout:bal_rank_mask -1 2024-09-19T07:00:00.156 INFO:teuthology.orchestra.run.smithi099.stdout:standby_count_wanted 1 2024-09-19T07:00:00.156 INFO:teuthology.orchestra.run.smithi099.stdout:qdb_cluster leader: 0 members: 2024-09-19T07:00:00.156 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T07:00:00.156 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T07:00:00.156 INFO:teuthology.orchestra.run.smithi099.stdout:Standby daemons: 2024-09-19T07:00:00.156 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T07:00:00.157 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.obarqf{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6826/1859154203,v1:172.21.15.99:6827/1859154203] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:00:00.157 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.xehbxe{-1:34410} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6828/1939453719,v1:172.21.15.99:6829/1939453719] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:00:00.157 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.nooexo{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6824/1398895079,v1:172.21.15.117:6825/1398895079] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:00:00.157 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.bheqzh{-1:44329} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6826/3233337308,v1:172.21.15.117:6827/3233337308] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:00:00.158 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 29 2024-09-19T07:00:00.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.154+0000 7fdce14a5640 1 -- 172.21.15.99:0/3880825443 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fdcc406e530 msgr2=0x7fdcc40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:00:00.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.154+0000 7fdce14a5640 1 --2- 172.21.15.99:0/3880825443 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fdcc406e530 0x7fdcc40709e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fdccc00b020 tx=0x7fdccc009da0 comp rx=0 tx=0).stop 2024-09-19T07:00:00.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.155+0000 7fdce14a5640 1 -- 172.21.15.99:0/3880825443 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdcdc0fdf20 msgr2=0x7fdcdc113770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:00:00.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.155+0000 7fdce14a5640 1 --2- 172.21.15.99:0/3880825443 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdcdc0fdf20 0x7fdcdc113770 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fdcd0002a80 tx=0x7fdcd0004600 comp rx=0 tx=0).stop 2024-09-19T07:00:00.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.155+0000 7fdce14a5640 1 -- 172.21.15.99:0/3880825443 shutdown_connections 2024-09-19T07:00:00.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.155+0000 7fdce14a5640 1 --2- 172.21.15.99:0/3880825443 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fdcc406e530 0x7fdcc40709e0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:00.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.155+0000 7fdce14a5640 1 --2- 172.21.15.99:0/3880825443 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdcdc0fdf20 0x7fdcdc113770 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:00.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.155+0000 7fdce14a5640 1 --2- 172.21.15.99:0/3880825443 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdcdc0fd580 0x7fdcdc113230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:00.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.155+0000 7fdce14a5640 1 -- 172.21.15.99:0/3880825443 >> 172.21.15.99:0/3880825443 conn(0x7fdcdc0f7010 msgr2=0x7fdcdc0f85b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:00:00.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.155+0000 7fdce14a5640 1 -- 172.21.15.99:0/3880825443 shutdown_connections 2024-09-19T07:00:00.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.155+0000 7fdce14a5640 1 -- 172.21.15.99:0/3880825443 wait complete. 2024-09-19T07:00:00.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:00:00 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-mon-smithi099[97027]: 2024-09-19T06:59:59.999+0000 7f687d00b640 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-09-19T07:00:00.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:00:00 smithi099 ceph-mon[97031]: from='client.35006 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:00:00.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:00:00 smithi099 ceph-mon[97031]: pgmap v529: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:00:00.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:00:00 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/1206191918' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T07:00:00.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:00:00 smithi099 ceph-mon[97031]: overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-09-19T07:00:00.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.236+0000 7f8b659d7640 1 -- 172.21.15.99:0/2265236644 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b60102560 msgr2=0x7f8b60102930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:00:00.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.236+0000 7f8b659d7640 1 --2- 172.21.15.99:0/2265236644 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b60102560 0x7f8b60102930 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f8b50009c50 tx=0x7f8b50004d10 comp rx=0 tx=0).stop 2024-09-19T07:00:00.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.236+0000 7f8b659d7640 1 -- 172.21.15.99:0/2265236644 shutdown_connections 2024-09-19T07:00:00.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.236+0000 7f8b659d7640 1 --2- 172.21.15.99:0/2265236644 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b60102f00 0x7f8b600fc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:00.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.236+0000 7f8b659d7640 1 --2- 172.21.15.99:0/2265236644 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b60102560 0x7f8b60102930 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:00.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.236+0000 7f8b659d7640 1 -- 172.21.15.99:0/2265236644 >> 172.21.15.99:0/2265236644 conn(0x7f8b600f8100 msgr2=0x7f8b600fa510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:00:00.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.236+0000 7f8b659d7640 1 -- 172.21.15.99:0/2265236644 shutdown_connections 2024-09-19T07:00:00.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.236+0000 7f8b659d7640 1 -- 172.21.15.99:0/2265236644 wait complete. 2024-09-19T07:00:00.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.237+0000 7f8b659d7640 1 Processor -- start 2024-09-19T07:00:00.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.237+0000 7f8b659d7640 1 -- start start 2024-09-19T07:00:00.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.237+0000 7f8b659d7640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b60102560 0x7f8b60113200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:00:00.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.237+0000 7f8b659d7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b60102f00 0x7f8b60113740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:00:00.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.237+0000 7f8b659d7640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b60113d40 con 0x7f8b60102560 2024-09-19T07:00:00.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.237+0000 7f8b659d7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6010d180 con 0x7f8b60102f00 2024-09-19T07:00:00.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.237+0000 7f8b5effd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b60102560 0x7f8b60113200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:00:00.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.238+0000 7f8b5effd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b60102560 0x7f8b60113200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49974/0 (socket says 172.21.15.99:49974) 2024-09-19T07:00:00.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.238+0000 7f8b5effd640 1 -- 172.21.15.99:0/1988478031 learned_addr learned my addr 172.21.15.99:0/1988478031 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:00:00.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.238+0000 7f8b5e7fc640 1 --2- 172.21.15.99:0/1988478031 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b60102f00 0x7f8b60113740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:00:00.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.238+0000 7f8b5effd640 1 -- 172.21.15.99:0/1988478031 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b60102f00 msgr2=0x7f8b60113740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:00:00.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.238+0000 7f8b5effd640 1 --2- 172.21.15.99:0/1988478031 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b60102f00 0x7f8b60113740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:00.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.238+0000 7f8b5effd640 1 -- 172.21.15.99:0/1988478031 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b500098b0 con 0x7f8b60102560 2024-09-19T07:00:00.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.238+0000 7f8b5effd640 1 --2- 172.21.15.99:0/1988478031 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b60102560 0x7f8b60113200 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f8b50004750 tx=0x7f8b50004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:00:00.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.238+0000 7f8b477fe640 1 -- 172.21.15.99:0/1988478031 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b50009610 con 0x7f8b60102560 2024-09-19T07:00:00.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.238+0000 7f8b477fe640 1 -- 172.21.15.99:0/1988478031 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8b50032b10 con 0x7f8b60102560 2024-09-19T07:00:00.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.238+0000 7f8b659d7640 1 -- 172.21.15.99:0/1988478031 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b6010d400 con 0x7f8b60102560 2024-09-19T07:00:00.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.238+0000 7f8b477fe640 1 -- 172.21.15.99:0/1988478031 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b5003d990 con 0x7f8b60102560 2024-09-19T07:00:00.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.238+0000 7f8b659d7640 1 -- 172.21.15.99:0/1988478031 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b6010d9a0 con 0x7f8b60102560 2024-09-19T07:00:00.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.239+0000 7f8b659d7640 1 -- 172.21.15.99:0/1988478031 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b600fdce0 con 0x7f8b60102560 2024-09-19T07:00:00.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.240+0000 7f8b477fe640 1 -- 172.21.15.99:0/1988478031 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f8b5002f030 con 0x7f8b60102560 2024-09-19T07:00:00.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.240+0000 7f8b477fe640 1 --2- 172.21.15.99:0/1988478031 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f8b4806e530 0x7f8b480709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:00:00.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.240+0000 7f8b477fe640 1 -- 172.21.15.99:0/1988478031 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f8b500af220 con 0x7f8b60102560 2024-09-19T07:00:00.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.240+0000 7f8b5e7fc640 1 --2- 172.21.15.99:0/1988478031 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f8b4806e530 0x7f8b480709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:00:00.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.241+0000 7f8b5e7fc640 1 --2- 172.21.15.99:0/1988478031 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f8b4806e530 0x7f8b480709e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8b6010eac0 tx=0x7f8b5400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:00:00.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.245+0000 7f8b477fe640 1 -- 172.21.15.99:0/1988478031 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f8b50078310 con 0x7f8b60102560 2024-09-19T07:00:00.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.427+0000 7f8b659d7640 1 -- 172.21.15.99:0/1988478031 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8b6004b720 con 0x7f8b4806e530 2024-09-19T07:00:00.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.428+0000 7f8b477fe640 1 -- 172.21.15.99:0/1988478031 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f8b6004b720 con 0x7f8b4806e530 2024-09-19T07:00:00.429 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T07:00:00.429 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T07:00:00.429 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": true, 2024-09-19T07:00:00.429 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T07:00:00.430 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [ 2024-09-19T07:00:00.430 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr", 2024-09-19T07:00:00.430 INFO:teuthology.orchestra.run.smithi099.stdout: "crash", 2024-09-19T07:00:00.430 INFO:teuthology.orchestra.run.smithi099.stdout: "mds", 2024-09-19T07:00:00.430 INFO:teuthology.orchestra.run.smithi099.stdout: "mon", 2024-09-19T07:00:00.430 INFO:teuthology.orchestra.run.smithi099.stdout: "osd" 2024-09-19T07:00:00.430 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-19T07:00:00.430 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": "16/21 daemons upgraded", 2024-09-19T07:00:00.430 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "Currently upgrading mds daemons", 2024-09-19T07:00:00.431 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-09-19T07:00:00.431 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T07:00:00.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.430+0000 7f8b659d7640 1 -- 172.21.15.99:0/1988478031 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f8b4806e530 msgr2=0x7f8b480709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:00:00.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.430+0000 7f8b659d7640 1 --2- 172.21.15.99:0/1988478031 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f8b4806e530 0x7f8b480709e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8b6010eac0 tx=0x7f8b5400b040 comp rx=0 tx=0).stop 2024-09-19T07:00:00.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.430+0000 7f8b659d7640 1 -- 172.21.15.99:0/1988478031 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b60102560 msgr2=0x7f8b60113200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:00:00.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.430+0000 7f8b659d7640 1 --2- 172.21.15.99:0/1988478031 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b60102560 0x7f8b60113200 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f8b50004750 tx=0x7f8b50004d10 comp rx=0 tx=0).stop 2024-09-19T07:00:00.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.430+0000 7f8b659d7640 1 -- 172.21.15.99:0/1988478031 shutdown_connections 2024-09-19T07:00:00.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.430+0000 7f8b659d7640 1 --2- 172.21.15.99:0/1988478031 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f8b4806e530 0x7f8b480709e0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:00.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.430+0000 7f8b659d7640 1 --2- 172.21.15.99:0/1988478031 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b60102f00 0x7f8b60113740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:00.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.430+0000 7f8b659d7640 1 --2- 172.21.15.99:0/1988478031 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b60102560 0x7f8b60113200 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:00.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.430+0000 7f8b659d7640 1 -- 172.21.15.99:0/1988478031 >> 172.21.15.99:0/1988478031 conn(0x7f8b600f8100 msgr2=0x7f8b600f9180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:00:00.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.430+0000 7f8b659d7640 1 -- 172.21.15.99:0/1988478031 shutdown_connections 2024-09-19T07:00:00.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.430+0000 7f8b659d7640 1 -- 172.21.15.99:0/1988478031 wait complete. 2024-09-19T07:00:00.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.509+0000 7f6609e22640 1 -- 172.21.15.99:0/1083935908 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6604102530 msgr2=0x7f6604102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:00:00.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.509+0000 7f6609e22640 1 --2- 172.21.15.99:0/1083935908 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6604102530 0x7f6604102900 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f65f40048d0 tx=0x7f65f4009da0 comp rx=0 tx=0).stop 2024-09-19T07:00:00.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.509+0000 7f6609e22640 1 -- 172.21.15.99:0/1083935908 shutdown_connections 2024-09-19T07:00:00.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.509+0000 7f6609e22640 1 --2- 172.21.15.99:0/1083935908 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6604102ed0 0x7f66040fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:00.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.509+0000 7f6609e22640 1 --2- 172.21.15.99:0/1083935908 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6604102530 0x7f6604102900 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:00.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.509+0000 7f6609e22640 1 -- 172.21.15.99:0/1083935908 >> 172.21.15.99:0/1083935908 conn(0x7f66040f80f0 msgr2=0x7f66040fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:00:00.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.509+0000 7f6609e22640 1 -- 172.21.15.99:0/1083935908 shutdown_connections 2024-09-19T07:00:00.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.509+0000 7f6609e22640 1 -- 172.21.15.99:0/1083935908 wait complete. 2024-09-19T07:00:00.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.509+0000 7f6609e22640 1 Processor -- start 2024-09-19T07:00:00.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.510+0000 7f6609e22640 1 -- start start 2024-09-19T07:00:00.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.510+0000 7f6609e22640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6604102530 0x7f660406fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:00:00.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.510+0000 7f6609e22640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6604102ed0 0x7f660406ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:00:00.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.510+0000 7f6609e22640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6604070490 con 0x7f6604102ed0 2024-09-19T07:00:00.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.510+0000 7f6609e22640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6604070600 con 0x7f6604102530 2024-09-19T07:00:00.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.510+0000 7f65fbfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6604102ed0 0x7f660406ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:00:00.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.510+0000 7f65fbfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6604102ed0 0x7f660406ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:49988/0 (socket says 172.21.15.99:49988) 2024-09-19T07:00:00.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.510+0000 7f65fbfff640 1 -- 172.21.15.99:0/1056337015 learned_addr learned my addr 172.21.15.99:0/1056337015 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:00:00.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.510+0000 7f66037fe640 1 --2- 172.21.15.99:0/1056337015 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6604102530 0x7f660406fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:00:00.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.510+0000 7f65fbfff640 1 -- 172.21.15.99:0/1056337015 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6604102530 msgr2=0x7f660406fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:00:00.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.510+0000 7f65fbfff640 1 --2- 172.21.15.99:0/1056337015 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6604102530 0x7f660406fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:00.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.510+0000 7f65fbfff640 1 -- 172.21.15.99:0/1056337015 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f4005040 con 0x7f6604102ed0 2024-09-19T07:00:00.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.510+0000 7f65fbfff640 1 --2- 172.21.15.99:0/1056337015 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6604102ed0 0x7f660406ff50 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f65ec00c790 tx=0x7f65ec0043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:00:00.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.510+0000 7f6600ff9640 1 -- 172.21.15.99:0/1056337015 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65ec00a7a0 con 0x7f6604102ed0 2024-09-19T07:00:00.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.510+0000 7f6600ff9640 1 -- 172.21.15.99:0/1056337015 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f65ec00ada0 con 0x7f6604102ed0 2024-09-19T07:00:00.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.510+0000 7f6609e22640 1 -- 172.21.15.99:0/1056337015 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6604070890 con 0x7f6604102ed0 2024-09-19T07:00:00.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.511+0000 7f6600ff9640 1 -- 172.21.15.99:0/1056337015 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65ec011380 con 0x7f6604102ed0 2024-09-19T07:00:00.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.511+0000 7f6609e22640 1 -- 172.21.15.99:0/1056337015 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6604119970 con 0x7f6604102ed0 2024-09-19T07:00:00.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.512+0000 7f6609e22640 1 -- 172.21.15.99:0/1056337015 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66040fdcb0 con 0x7f6604102ed0 2024-09-19T07:00:00.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.512+0000 7f6600ff9640 1 -- 172.21.15.99:0/1056337015 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f65ec012420 con 0x7f6604102ed0 2024-09-19T07:00:00.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.513+0000 7f6600ff9640 1 --2- 172.21.15.99:0/1056337015 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f65f006e530 0x7f65f00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:00:00.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.513+0000 7f6600ff9640 1 -- 172.21.15.99:0/1056337015 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f65ec08e5f0 con 0x7f6604102ed0 2024-09-19T07:00:00.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.513+0000 7f66037fe640 1 --2- 172.21.15.99:0/1056337015 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f65f006e530 0x7f65f00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:00:00.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.513+0000 7f66037fe640 1 --2- 172.21.15.99:0/1056337015 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f65f006e530 0x7f65f00709e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f65f4003080 tx=0x7f65f4009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:00:00.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.517+0000 7f6600ff9640 1 -- 172.21.15.99:0/1056337015 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f65ec057760 con 0x7f6604102ed0 2024-09-19T07:00:00.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:00:00 smithi117 ceph-mon[76771]: from='client.35006 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:00:00.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:00:00 smithi117 ceph-mon[76771]: pgmap v529: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:00:00.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:00:00 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/1206191918' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T07:00:00.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:00:00 smithi117 ceph-mon[76771]: overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-09-19T07:00:00.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.746+0000 7f6609e22640 1 -- 172.21.15.99:0/1056337015 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f66040fbd30 con 0x7f6604102ed0 2024-09-19T07:00:00.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.747+0000 7f6600ff9640 1 -- 172.21.15.99:0/1056337015 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7f65ec05ae20 con 0x7f6604102ed0 2024-09-19T07:00:00.748 INFO:teuthology.orchestra.run.smithi099.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-09-19T07:00:00.748 INFO:teuthology.orchestra.run.smithi099.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-19T07:00:00.748 INFO:teuthology.orchestra.run.smithi099.stdout: fs cephfs is degraded 2024-09-19T07:00:00.748 INFO:teuthology.orchestra.run.smithi099.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-19T07:00:00.748 INFO:teuthology.orchestra.run.smithi099.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-19T07:00:00.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.749+0000 7f6609e22640 1 -- 172.21.15.99:0/1056337015 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f65f006e530 msgr2=0x7f65f00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:00:00.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.749+0000 7f6609e22640 1 --2- 172.21.15.99:0/1056337015 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f65f006e530 0x7f65f00709e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f65f4003080 tx=0x7f65f4009da0 comp rx=0 tx=0).stop 2024-09-19T07:00:00.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.749+0000 7f6609e22640 1 -- 172.21.15.99:0/1056337015 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6604102ed0 msgr2=0x7f660406ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:00:00.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.749+0000 7f6609e22640 1 --2- 172.21.15.99:0/1056337015 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6604102ed0 0x7f660406ff50 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f65ec00c790 tx=0x7f65ec0043c0 comp rx=0 tx=0).stop 2024-09-19T07:00:00.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.749+0000 7f6609e22640 1 -- 172.21.15.99:0/1056337015 shutdown_connections 2024-09-19T07:00:00.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.749+0000 7f6609e22640 1 --2- 172.21.15.99:0/1056337015 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f65f006e530 0x7f65f00709e0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:00.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.749+0000 7f6609e22640 1 --2- 172.21.15.99:0/1056337015 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6604102ed0 0x7f660406ff50 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:00.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.749+0000 7f6609e22640 1 --2- 172.21.15.99:0/1056337015 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6604102530 0x7f660406fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:00.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.749+0000 7f6609e22640 1 -- 172.21.15.99:0/1056337015 >> 172.21.15.99:0/1056337015 conn(0x7f66040f80f0 msgr2=0x7f66040f90f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:00:00.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.749+0000 7f6609e22640 1 -- 172.21.15.99:0/1056337015 shutdown_connections 2024-09-19T07:00:00.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:00.749+0000 7f6609e22640 1 -- 172.21.15.99:0/1056337015 wait complete. 2024-09-19T07:00:01.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:00:01 smithi099 ceph-mon[97031]: from='client.35010 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:00:01.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:00:01 smithi099 ceph-mon[97031]: from='client.35014 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:00:01.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:00:01 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/3880825443' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T07:00:01.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:00:01 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/1056337015' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T07:00:01.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:00:01 smithi117 ceph-mon[76771]: from='client.35010 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:00:01.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:00:01 smithi117 ceph-mon[76771]: from='client.35014 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:00:01.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:00:01 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/3880825443' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T07:00:01.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:00:01 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/1056337015' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T07:00:02.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:00:02 smithi099 ceph-mon[97031]: from='client.35026 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:00:02.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:00:02 smithi099 ceph-mon[97031]: pgmap v530: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:00:02.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:00:02 smithi117 ceph-mon[76771]: from='client.35026 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:00:02.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:00:02 smithi117 ceph-mon[76771]: pgmap v530: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:00:03.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:00:03 smithi099 ceph-mon[97031]: pgmap v531: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:00:03.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:00:03 smithi117 ceph-mon[76771]: pgmap v531: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:00:06.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:00:06 smithi099 ceph-mon[97031]: pgmap v532: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:00:06.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:00:06 smithi117 ceph-mon[76771]: pgmap v532: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:00:07.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:00:07 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:00:07.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:00:07 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:00:08.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:00:08 smithi099 ceph-mon[97031]: pgmap v533: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:00:08.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:00:08 smithi117 ceph-mon[76771]: pgmap v533: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:00:10.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:00:10 smithi099 ceph-mon[97031]: pgmap v534: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:00:10.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:00:10 smithi117 ceph-mon[76771]: pgmap v534: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:00:12.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:00:12 smithi099 ceph-mon[97031]: pgmap v535: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:00:12.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:00:12 smithi117 ceph-mon[76771]: pgmap v535: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:00:14.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:00:14 smithi099 ceph-mon[97031]: pgmap v536: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:00:14.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:00:14 smithi117 ceph-mon[76771]: pgmap v536: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:00:16.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:00:16 smithi099 ceph-mon[97031]: pgmap v537: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:00:16.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:00:16 smithi117 ceph-mon[76771]: pgmap v537: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:00:18.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:00:18 smithi099 ceph-mon[97031]: pgmap v538: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:00:18.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:00:18 smithi117 ceph-mon[76771]: pgmap v538: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:00:20.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:00:20 smithi099 ceph-mon[97031]: pgmap v539: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:00:20.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:00:20 smithi117 ceph-mon[76771]: pgmap v539: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:00:22.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:00:22 smithi099 ceph-mon[97031]: pgmap v540: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:00:22.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:00:22 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:00:22.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:00:22 smithi117 ceph-mon[76771]: pgmap v540: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:00:22.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:00:22 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:00:24.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:00:24 smithi099 ceph-mon[97031]: pgmap v541: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:00:24.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:00:24 smithi117 ceph-mon[76771]: pgmap v541: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:00:26.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:00:26 smithi099 ceph-mon[97031]: pgmap v542: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:00:26.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:00:26 smithi117 ceph-mon[76771]: pgmap v542: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:00:28.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:00:28 smithi099 ceph-mon[97031]: pgmap v543: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:00:28.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:00:28 smithi117 ceph-mon[76771]: pgmap v543: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:00:30.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:00:30 smithi099 ceph-mon[97031]: pgmap v544: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:00:30.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:00:30 smithi117 ceph-mon[76771]: pgmap v544: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:00:30.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:30.840+0000 7fb086160640 1 -- 172.21.15.99:0/4286984193 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0801014c0 msgr2=0x7fb080101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:00:30.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:30.840+0000 7fb086160640 1 --2- 172.21.15.99:0/4286984193 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0801014c0 0x7fb080101890 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fb0700048d0 tx=0x7fb070009da0 comp rx=0 tx=0).stop 2024-09-19T07:00:30.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:30.840+0000 7fb086160640 1 -- 172.21.15.99:0/4286984193 shutdown_connections 2024-09-19T07:00:30.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:30.840+0000 7fb086160640 1 --2- 172.21.15.99:0/4286984193 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0800fb480 0x7fb0800fb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:30.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:30.840+0000 7fb086160640 1 --2- 172.21.15.99:0/4286984193 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0801014c0 0x7fb080101890 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:30.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:30.840+0000 7fb086160640 1 -- 172.21.15.99:0/4286984193 >> 172.21.15.99:0/4286984193 conn(0x7fb0800f7000 msgr2=0x7fb0800f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:00:30.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:30.840+0000 7fb086160640 1 -- 172.21.15.99:0/4286984193 shutdown_connections 2024-09-19T07:00:30.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:30.840+0000 7fb086160640 1 -- 172.21.15.99:0/4286984193 wait complete. 2024-09-19T07:00:30.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:30.841+0000 7fb086160640 1 Processor -- start 2024-09-19T07:00:30.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:30.841+0000 7fb086160640 1 -- start start 2024-09-19T07:00:30.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:30.841+0000 7fb086160640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0800fb480 0x7fb0801131e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:00:30.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:30.841+0000 7fb086160640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0801014c0 0x7fb080113720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:00:30.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:30.841+0000 7fb086160640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb080113d20 con 0x7fb0801014c0 2024-09-19T07:00:30.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:30.841+0000 7fb086160640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb08010d160 con 0x7fb0800fb480 2024-09-19T07:00:30.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:30.841+0000 7fb076ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0801014c0 0x7fb080113720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:00:30.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:30.842+0000 7fb076ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0801014c0 0x7fb080113720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52992/0 (socket says 172.21.15.99:52992) 2024-09-19T07:00:30.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:30.842+0000 7fb076ffd640 1 -- 172.21.15.99:0/659480111 learned_addr learned my addr 172.21.15.99:0/659480111 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:00:30.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:30.842+0000 7fb07f7fe640 1 --2- 172.21.15.99:0/659480111 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0800fb480 0x7fb0801131e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:00:30.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:30.842+0000 7fb076ffd640 1 -- 172.21.15.99:0/659480111 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0800fb480 msgr2=0x7fb0801131e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:00:30.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:30.842+0000 7fb076ffd640 1 --2- 172.21.15.99:0/659480111 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0800fb480 0x7fb0801131e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:30.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:30.842+0000 7fb076ffd640 1 -- 172.21.15.99:0/659480111 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb070005040 con 0x7fb0801014c0 2024-09-19T07:00:30.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:30.842+0000 7fb076ffd640 1 --2- 172.21.15.99:0/659480111 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0801014c0 0x7fb080113720 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fb068002a50 tx=0x7fb068004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:00:30.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:30.842+0000 7fb07cff9640 1 -- 172.21.15.99:0/659480111 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb068007c30 con 0x7fb0801014c0 2024-09-19T07:00:30.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:30.842+0000 7fb07cff9640 1 -- 172.21.15.99:0/659480111 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb06800f040 con 0x7fb0801014c0 2024-09-19T07:00:30.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:30.842+0000 7fb086160640 1 -- 172.21.15.99:0/659480111 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb08010d440 con 0x7fb0801014c0 2024-09-19T07:00:30.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:30.842+0000 7fb07cff9640 1 -- 172.21.15.99:0/659480111 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb06800da10 con 0x7fb0801014c0 2024-09-19T07:00:30.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:30.842+0000 7fb086160640 1 -- 172.21.15.99:0/659480111 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb08010d9e0 con 0x7fb0801014c0 2024-09-19T07:00:30.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:30.844+0000 7fb086160640 1 -- 172.21.15.99:0/659480111 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0800fcbc0 con 0x7fb0801014c0 2024-09-19T07:00:30.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:30.844+0000 7fb07cff9640 1 -- 172.21.15.99:0/659480111 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fb06800dc80 con 0x7fb0801014c0 2024-09-19T07:00:30.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:30.844+0000 7fb07cff9640 1 --2- 172.21.15.99:0/659480111 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fb06c06e530 0x7fb06c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:00:30.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:30.845+0000 7fb07cff9640 1 -- 172.21.15.99:0/659480111 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fb06808d970 con 0x7fb0801014c0 2024-09-19T07:00:30.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:30.845+0000 7fb07f7fe640 1 --2- 172.21.15.99:0/659480111 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fb06c06e530 0x7fb06c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:00:30.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:30.845+0000 7fb07f7fe640 1 --2- 172.21.15.99:0/659480111 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fb06c06e530 0x7fb06c0709e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb070009ac0 tx=0x7fb070035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:00:30.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:30.849+0000 7fb07cff9640 1 -- 172.21.15.99:0/659480111 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fb068056b10 con 0x7fb0801014c0 2024-09-19T07:00:31.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.034+0000 7fb086160640 1 -- 172.21.15.99:0/659480111 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb080108460 con 0x7fb06c06e530 2024-09-19T07:00:31.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.035+0000 7fb07cff9640 1 -- 172.21.15.99:0/659480111 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fb080108460 con 0x7fb06c06e530 2024-09-19T07:00:31.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.037+0000 7fb086160640 1 -- 172.21.15.99:0/659480111 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fb06c06e530 msgr2=0x7fb06c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:00:31.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.037+0000 7fb086160640 1 --2- 172.21.15.99:0/659480111 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fb06c06e530 0x7fb06c0709e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb070009ac0 tx=0x7fb070035040 comp rx=0 tx=0).stop 2024-09-19T07:00:31.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.037+0000 7fb086160640 1 -- 172.21.15.99:0/659480111 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0801014c0 msgr2=0x7fb080113720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:00:31.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.037+0000 7fb086160640 1 --2- 172.21.15.99:0/659480111 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0801014c0 0x7fb080113720 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fb068002a50 tx=0x7fb068004600 comp rx=0 tx=0).stop 2024-09-19T07:00:31.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.037+0000 7fb086160640 1 -- 172.21.15.99:0/659480111 shutdown_connections 2024-09-19T07:00:31.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.037+0000 7fb086160640 1 --2- 172.21.15.99:0/659480111 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fb06c06e530 0x7fb06c0709e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:31.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.037+0000 7fb086160640 1 --2- 172.21.15.99:0/659480111 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb0801014c0 0x7fb080113720 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:31.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.037+0000 7fb086160640 1 --2- 172.21.15.99:0/659480111 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb0800fb480 0x7fb0801131e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:31.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.037+0000 7fb086160640 1 -- 172.21.15.99:0/659480111 >> 172.21.15.99:0/659480111 conn(0x7fb0800f7000 msgr2=0x7fb080065a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:00:31.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.037+0000 7fb086160640 1 -- 172.21.15.99:0/659480111 shutdown_connections 2024-09-19T07:00:31.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.037+0000 7fb086160640 1 -- 172.21.15.99:0/659480111 wait complete. 2024-09-19T07:00:31.047 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-09-19T07:00:31.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.117+0000 7fce1118a640 1 -- 172.21.15.99:0/3412791497 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce0c0facf0 msgr2=0x7fce0c0fb160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:00:31.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.117+0000 7fce1118a640 1 --2- 172.21.15.99:0/3412791497 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce0c0facf0 0x7fce0c0fb160 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc009c50 tx=0x7fcdfc004d10 comp rx=0 tx=0).stop 2024-09-19T07:00:31.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.117+0000 7fce1118a640 1 -- 172.21.15.99:0/3412791497 shutdown_connections 2024-09-19T07:00:31.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.117+0000 7fce1118a640 1 --2- 172.21.15.99:0/3412791497 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce0c0facf0 0x7fce0c0fb160 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:31.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.117+0000 7fce1118a640 1 --2- 172.21.15.99:0/3412791497 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce0c102680 0x7fce0c102a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:31.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.117+0000 7fce1118a640 1 -- 172.21.15.99:0/3412791497 >> 172.21.15.99:0/3412791497 conn(0x7fce0c070d50 msgr2=0x7fce0c071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:00:31.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.117+0000 7fce1118a640 1 -- 172.21.15.99:0/3412791497 shutdown_connections 2024-09-19T07:00:31.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.118+0000 7fce1118a640 1 -- 172.21.15.99:0/3412791497 wait complete. 2024-09-19T07:00:31.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.118+0000 7fce1118a640 1 Processor -- start 2024-09-19T07:00:31.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.118+0000 7fce1118a640 1 -- start start 2024-09-19T07:00:31.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.118+0000 7fce1118a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce0c0facf0 0x7fce0c0fbed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:00:31.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.118+0000 7fce1118a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce0c102680 0x7fce0c0fc410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:00:31.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.118+0000 7fce1118a640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce0c0fc950 con 0x7fce0c102680 2024-09-19T07:00:31.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.118+0000 7fce1118a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce0c0fcac0 con 0x7fce0c0facf0 2024-09-19T07:00:31.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.119+0000 7fce0a59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce0c102680 0x7fce0c0fc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:00:31.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.119+0000 7fce0a59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce0c102680 0x7fce0c0fc410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53006/0 (socket says 172.21.15.99:53006) 2024-09-19T07:00:31.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.119+0000 7fce0a59c640 1 -- 172.21.15.99:0/352067346 learned_addr learned my addr 172.21.15.99:0/352067346 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:00:31.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.119+0000 7fce0ad9d640 1 --2- 172.21.15.99:0/352067346 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce0c0facf0 0x7fce0c0fbed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:00:31.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.119+0000 7fce0a59c640 1 -- 172.21.15.99:0/352067346 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce0c0facf0 msgr2=0x7fce0c0fbed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:00:31.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.119+0000 7fce0a59c640 1 --2- 172.21.15.99:0/352067346 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce0c0facf0 0x7fce0c0fbed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:31.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.119+0000 7fce0a59c640 1 -- 172.21.15.99:0/352067346 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdfc0098b0 con 0x7fce0c102680 2024-09-19T07:00:31.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.119+0000 7fce0a59c640 1 --2- 172.21.15.99:0/352067346 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce0c102680 0x7fce0c0fc410 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc004a30 tx=0x7fcdfc004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:00:31.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.119+0000 7fcdf37fe640 1 -- 172.21.15.99:0/352067346 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcdfc009690 con 0x7fce0c102680 2024-09-19T07:00:31.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.119+0000 7fce1118a640 1 -- 172.21.15.99:0/352067346 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce0c0fccf0 con 0x7fce0c102680 2024-09-19T07:00:31.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.119+0000 7fcdf37fe640 1 -- 172.21.15.99:0/352067346 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fcdfc032b10 con 0x7fce0c102680 2024-09-19T07:00:31.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.119+0000 7fcdf37fe640 1 -- 172.21.15.99:0/352067346 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcdfc03daa0 con 0x7fce0c102680 2024-09-19T07:00:31.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.119+0000 7fce1118a640 1 -- 172.21.15.99:0/352067346 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce0c119920 con 0x7fce0c102680 2024-09-19T07:00:31.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.120+0000 7fce1118a640 1 -- 172.21.15.99:0/352067346 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce0c0657f0 con 0x7fce0c102680 2024-09-19T07:00:31.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.121+0000 7fcdf37fe640 1 -- 172.21.15.99:0/352067346 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fcdfc02f030 con 0x7fce0c102680 2024-09-19T07:00:31.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.121+0000 7fcdf37fe640 1 --2- 172.21.15.99:0/352067346 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fcdf406e530 0x7fcdf40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:00:31.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.121+0000 7fcdf37fe640 1 -- 172.21.15.99:0/352067346 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fcdfc0af1d0 con 0x7fce0c102680 2024-09-19T07:00:31.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.121+0000 7fce0ad9d640 1 --2- 172.21.15.99:0/352067346 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fcdf406e530 0x7fcdf40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:00:31.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.122+0000 7fce0ad9d640 1 --2- 172.21.15.99:0/352067346 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fcdf406e530 0x7fcdf40709e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fce000041d0 tx=0x7fce00009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:00:31.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.126+0000 7fcdf37fe640 1 -- 172.21.15.99:0/352067346 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fcdfc078340 con 0x7fce0c102680 2024-09-19T07:00:31.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.309+0000 7fce1118a640 1 -- 172.21.15.99:0/352067346 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fce0c1096a0 con 0x7fcdf406e530 2024-09-19T07:00:31.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.310+0000 7fcdf37fe640 1 -- 172.21.15.99:0/352067346 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fce0c1096a0 con 0x7fcdf406e530 2024-09-19T07:00:31.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.313+0000 7fce1118a640 1 -- 172.21.15.99:0/352067346 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fcdf406e530 msgr2=0x7fcdf40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:00:31.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.313+0000 7fce1118a640 1 --2- 172.21.15.99:0/352067346 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fcdf406e530 0x7fcdf40709e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fce000041d0 tx=0x7fce00009040 comp rx=0 tx=0).stop 2024-09-19T07:00:31.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.313+0000 7fce1118a640 1 -- 172.21.15.99:0/352067346 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce0c102680 msgr2=0x7fce0c0fc410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:00:31.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.313+0000 7fce1118a640 1 --2- 172.21.15.99:0/352067346 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce0c102680 0x7fce0c0fc410 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc004a30 tx=0x7fcdfc004d10 comp rx=0 tx=0).stop 2024-09-19T07:00:31.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.313+0000 7fce1118a640 1 -- 172.21.15.99:0/352067346 shutdown_connections 2024-09-19T07:00:31.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.313+0000 7fce1118a640 1 --2- 172.21.15.99:0/352067346 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fcdf406e530 0x7fcdf40709e0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:31.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.313+0000 7fce1118a640 1 --2- 172.21.15.99:0/352067346 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce0c102680 0x7fce0c0fc410 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:31.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.313+0000 7fce1118a640 1 --2- 172.21.15.99:0/352067346 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fce0c0facf0 0x7fce0c0fbed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:31.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.313+0000 7fce1118a640 1 -- 172.21.15.99:0/352067346 >> 172.21.15.99:0/352067346 conn(0x7fce0c070d50 msgr2=0x7fce0c0fe740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:00:31.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.313+0000 7fce1118a640 1 -- 172.21.15.99:0/352067346 shutdown_connections 2024-09-19T07:00:31.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.313+0000 7fce1118a640 1 -- 172.21.15.99:0/352067346 wait complete. 2024-09-19T07:00:31.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.390+0000 7f2043ec4640 1 -- 172.21.15.99:0/1605009516 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f203c0fdee0 msgr2=0x7f203c1065b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:00:31.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.390+0000 7f2043ec4640 1 --2- 172.21.15.99:0/1605009516 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f203c0fdee0 0x7f203c1065b0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f202c004900 tx=0x7f202c009da0 comp rx=0 tx=0).stop 2024-09-19T07:00:31.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.390+0000 7f2043ec4640 1 -- 172.21.15.99:0/1605009516 shutdown_connections 2024-09-19T07:00:31.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.390+0000 7f2043ec4640 1 --2- 172.21.15.99:0/1605009516 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f203c0fdee0 0x7f203c1065b0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:31.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.390+0000 7f2043ec4640 1 --2- 172.21.15.99:0/1605009516 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f203c0fd540 0x7f203c0fd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:31.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.390+0000 7f2043ec4640 1 -- 172.21.15.99:0/1605009516 >> 172.21.15.99:0/1605009516 conn(0x7f203c0f7000 msgr2=0x7f203c0f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:00:31.393 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:00:31 smithi099 ceph-mon[97031]: from='client.35034 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:00:31.393 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:00:31 smithi099 ceph-mon[97031]: pgmap v545: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:00:31.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.391+0000 7f2043ec4640 1 -- 172.21.15.99:0/1605009516 shutdown_connections 2024-09-19T07:00:31.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.391+0000 7f2043ec4640 1 -- 172.21.15.99:0/1605009516 wait complete. 2024-09-19T07:00:31.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.391+0000 7f2043ec4640 1 Processor -- start 2024-09-19T07:00:31.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.391+0000 7f2043ec4640 1 -- start start 2024-09-19T07:00:31.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.392+0000 7f2043ec4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f203c0fd540 0x7f203c1132b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:00:31.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.392+0000 7f2043ec4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f203c0fdee0 0x7f203c1137f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:00:31.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.392+0000 7f2043ec4640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f203c113df0 con 0x7f203c0fd540 2024-09-19T07:00:31.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.392+0000 7f2043ec4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f203c113f60 con 0x7f203c0fdee0 2024-09-19T07:00:31.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.392+0000 7f2041c60640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f203c0fd540 0x7f203c1132b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:00:31.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.392+0000 7f2041c60640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f203c0fd540 0x7f203c1132b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53028/0 (socket says 172.21.15.99:53028) 2024-09-19T07:00:31.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.392+0000 7f2041c60640 1 -- 172.21.15.99:0/4047576814 learned_addr learned my addr 172.21.15.99:0/4047576814 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:00:31.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.392+0000 7f204145f640 1 --2- 172.21.15.99:0/4047576814 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f203c0fdee0 0x7f203c1137f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:00:31.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.392+0000 7f2041c60640 1 -- 172.21.15.99:0/4047576814 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f203c0fdee0 msgr2=0x7f203c1137f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:00:31.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.392+0000 7f2041c60640 1 --2- 172.21.15.99:0/4047576814 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f203c0fdee0 0x7f203c1137f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:31.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.392+0000 7f2041c60640 1 -- 172.21.15.99:0/4047576814 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f202c005040 con 0x7f203c0fd540 2024-09-19T07:00:31.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.392+0000 7f2041c60640 1 --2- 172.21.15.99:0/4047576814 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f203c0fd540 0x7f203c1132b0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f203800c830 tx=0x7f2038004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:00:31.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.392+0000 7f20327fc640 1 -- 172.21.15.99:0/4047576814 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f203800a850 con 0x7f203c0fd540 2024-09-19T07:00:31.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.392+0000 7f20327fc640 1 -- 172.21.15.99:0/4047576814 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f203800ae50 con 0x7f203c0fd540 2024-09-19T07:00:31.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.392+0000 7f20327fc640 1 -- 172.21.15.99:0/4047576814 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20380113a0 con 0x7f203c0fd540 2024-09-19T07:00:31.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.392+0000 7f2043ec4640 1 -- 172.21.15.99:0/4047576814 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f203c10d3e0 con 0x7f203c0fd540 2024-09-19T07:00:31.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.393+0000 7f2043ec4640 1 -- 172.21.15.99:0/4047576814 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f203c10d900 con 0x7f203c0fd540 2024-09-19T07:00:31.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.394+0000 7f2043ec4640 1 -- 172.21.15.99:0/4047576814 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f203c0662d0 con 0x7f203c0fd540 2024-09-19T07:00:31.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.394+0000 7f20327fc640 1 -- 172.21.15.99:0/4047576814 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f2038012400 con 0x7f203c0fd540 2024-09-19T07:00:31.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.394+0000 7f20327fc640 1 --2- 172.21.15.99:0/4047576814 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f202806e530 0x7f20280709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:00:31.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.394+0000 7f20327fc640 1 -- 172.21.15.99:0/4047576814 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f203808e2b0 con 0x7f203c0fd540 2024-09-19T07:00:31.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.395+0000 7f204145f640 1 --2- 172.21.15.99:0/4047576814 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f202806e530 0x7f20280709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:00:31.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.395+0000 7f204145f640 1 --2- 172.21.15.99:0/4047576814 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f202806e530 0x7f20280709e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f202c007ac0 tx=0x7f202c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:00:31.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.399+0000 7f20327fc640 1 -- 172.21.15.99:0/4047576814 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f20380574e0 con 0x7f203c0fd540 2024-09-19T07:00:31.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:00:31 smithi117 ceph-mon[76771]: from='client.35034 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:00:31.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:00:31 smithi117 ceph-mon[76771]: pgmap v545: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:00:31.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.570+0000 7f2043ec4640 1 -- 172.21.15.99:0/4047576814 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f203c04b770 con 0x7f202806e530 2024-09-19T07:00:31.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.579+0000 7f20327fc640 1 -- 172.21.15.99:0/4047576814 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f203c04b770 con 0x7f202806e530 2024-09-19T07:00:31.580 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T07:00:31.580 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.smithi099 smithi099 *:9093,9094 running (19m) 12m ago 27m 23.4M - 0.25.0 c8568f914cd2 e7c1774d56b0 2024-09-19T07:00:31.580 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi099 smithi099 running (16m) 12m ago 28m 6899k - 19.1.1-361-g2f599a46 d2baa855c067 b9775f416b10 2024-09-19T07:00:31.580 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi117 smithi117 running (15m) 11m ago 27m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 38cf60c0d548 2024-09-19T07:00:31.581 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.smithi099 smithi099 *:3000 running (17m) 12m ago 27m 80.7M - 9.4.12 2bacad6d85d8 cd53a18d5410 2024-09-19T07:00:31.581 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.obarqf smithi099 running (12m) 12m ago 22m 12.2M - 19.1.1-361-g2f599a46 d2baa855c067 314a73082521 2024-09-19T07:00:31.581 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.xehbxe smithi099 running (12m) 12m ago 22m 14.4M - 19.1.1-361-g2f599a46 d2baa855c067 a2955a9d06e6 2024-09-19T07:00:31.581 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.bheqzh smithi117 running (11m) 11m ago 22m 11.8M - 19.1.1-361-g2f599a46 d2baa855c067 b1505937c0b7 2024-09-19T07:00:31.581 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.nooexo smithi117 running (12m) 11m ago 22m 13.1M - 19.1.1-361-g2f599a46 d2baa855c067 35bd7725855c 2024-09-19T07:00:31.581 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi099.pgvkqi smithi099 *:8443,9283,8765 running (18m) 12m ago 29m 505M - 19.1.1-361-g2f599a46 d2baa855c067 d5de99cb7e78 2024-09-19T07:00:31.581 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi117.ssmkcf smithi117 *:8443,9283,8765 running (18m) 11m ago 27m 444M - 19.1.1-361-g2f599a46 d2baa855c067 8b7ee0f871f5 2024-09-19T07:00:31.581 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi099 smithi099 running (17m) 12m ago 29m 52.4M 2048M 19.1.1-361-g2f599a46 d2baa855c067 ffe067438824 2024-09-19T07:00:31.581 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi117 smithi117 running (16m) 11m ago 27m 38.9M 2048M 19.1.1-361-g2f599a46 d2baa855c067 4cb7455e3ee7 2024-09-19T07:00:31.581 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi099 smithi099 *:9100 running (19m) 12m ago 28m 15.0M - 1.5.0 0da6a335fe13 dca7b4517dcc 2024-09-19T07:00:31.581 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi117 smithi117 *:9100 running (19m) 11m ago 27m 15.9M - 1.5.0 0da6a335fe13 8233ce3835d2 2024-09-19T07:00:31.581 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (15m) 12m ago 26m 100M 1557M 19.1.1-361-g2f599a46 d2baa855c067 8e22543bf933 2024-09-19T07:00:31.581 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (15m) 12m ago 25m 106M 1557M 19.1.1-361-g2f599a46 d2baa855c067 f54153d0ae09 2024-09-19T07:00:31.582 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (14m) 12m ago 25m 83.7M 1557M 19.1.1-361-g2f599a46 d2baa855c067 b1778ab88870 2024-09-19T07:00:31.582 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi117 running (13m) 11m ago 25m 102M 2581M 19.1.1-361-g2f599a46 d2baa855c067 ea5236b193d3 2024-09-19T07:00:31.582 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi117 running (13m) 11m ago 24m 93.5M 2581M 19.1.1-361-g2f599a46 d2baa855c067 27ac2c859a68 2024-09-19T07:00:31.582 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi117 running (12m) 11m ago 24m 100M 2581M 19.1.1-361-g2f599a46 d2baa855c067 de6aeb8544ce 2024-09-19T07:00:31.582 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.smithi099 smithi099 *:9095 running (18m) 12m ago 27m 64.4M - 2.43.0 a07b618ecd1d 15ad26ec6fb4 2024-09-19T07:00:31.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.581+0000 7f2043ec4640 1 -- 172.21.15.99:0/4047576814 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f202806e530 msgr2=0x7f20280709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:00:31.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.581+0000 7f2043ec4640 1 --2- 172.21.15.99:0/4047576814 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f202806e530 0x7f20280709e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f202c007ac0 tx=0x7f202c035040 comp rx=0 tx=0).stop 2024-09-19T07:00:31.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.581+0000 7f2043ec4640 1 -- 172.21.15.99:0/4047576814 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f203c0fd540 msgr2=0x7f203c1132b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:00:31.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.581+0000 7f2043ec4640 1 --2- 172.21.15.99:0/4047576814 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f203c0fd540 0x7f203c1132b0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f203800c830 tx=0x7f2038004430 comp rx=0 tx=0).stop 2024-09-19T07:00:31.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.581+0000 7f2043ec4640 1 -- 172.21.15.99:0/4047576814 shutdown_connections 2024-09-19T07:00:31.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.581+0000 7f2043ec4640 1 --2- 172.21.15.99:0/4047576814 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f202806e530 0x7f20280709e0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:31.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.581+0000 7f2043ec4640 1 --2- 172.21.15.99:0/4047576814 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f203c0fdee0 0x7f203c1137f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:31.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.581+0000 7f2043ec4640 1 --2- 172.21.15.99:0/4047576814 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f203c0fd540 0x7f203c1132b0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:31.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.581+0000 7f2043ec4640 1 -- 172.21.15.99:0/4047576814 >> 172.21.15.99:0/4047576814 conn(0x7f203c0f7000 msgr2=0x7f203c0f8510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:00:31.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.581+0000 7f2043ec4640 1 -- 172.21.15.99:0/4047576814 shutdown_connections 2024-09-19T07:00:31.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.581+0000 7f2043ec4640 1 -- 172.21.15.99:0/4047576814 wait complete. 2024-09-19T07:00:31.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.658+0000 7fb8656c9640 1 -- 172.21.15.99:0/1599462657 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb860102550 msgr2=0x7fb860102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:00:31.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.658+0000 7fb8656c9640 1 --2- 172.21.15.99:0/1599462657 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb860102550 0x7fb860102920 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fb8580048d0 tx=0x7fb858009da0 comp rx=0 tx=0).stop 2024-09-19T07:00:31.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.658+0000 7fb8656c9640 1 -- 172.21.15.99:0/1599462657 shutdown_connections 2024-09-19T07:00:31.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.658+0000 7fb8656c9640 1 --2- 172.21.15.99:0/1599462657 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb860102ef0 0x7fb8600fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:31.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.658+0000 7fb8656c9640 1 --2- 172.21.15.99:0/1599462657 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb860102550 0x7fb860102920 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:31.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.658+0000 7fb8656c9640 1 -- 172.21.15.99:0/1599462657 >> 172.21.15.99:0/1599462657 conn(0x7fb8600f80f0 msgr2=0x7fb8600fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:00:31.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.658+0000 7fb8656c9640 1 -- 172.21.15.99:0/1599462657 shutdown_connections 2024-09-19T07:00:31.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.658+0000 7fb8656c9640 1 -- 172.21.15.99:0/1599462657 wait complete. 2024-09-19T07:00:31.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.658+0000 7fb8656c9640 1 Processor -- start 2024-09-19T07:00:31.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.659+0000 7fb8656c9640 1 -- start start 2024-09-19T07:00:31.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.659+0000 7fb8656c9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb860102550 0x7fb860113570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:00:31.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.659+0000 7fb8656c9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb860102ef0 0x7fb860113ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:00:31.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.659+0000 7fb8656c9640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb860114100 con 0x7fb860102ef0 2024-09-19T07:00:31.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.659+0000 7fb8656c9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb86010d510 con 0x7fb860102550 2024-09-19T07:00:31.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.659+0000 7fb85e7fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb860102ef0 0x7fb860113ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:00:31.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.659+0000 7fb85effd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb860102550 0x7fb860113570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:00:31.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.659+0000 7fb85e7fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb860102ef0 0x7fb860113ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53048/0 (socket says 172.21.15.99:53048) 2024-09-19T07:00:31.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.659+0000 7fb85e7fc640 1 -- 172.21.15.99:0/3657023794 learned_addr learned my addr 172.21.15.99:0/3657023794 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:00:31.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.659+0000 7fb85e7fc640 1 -- 172.21.15.99:0/3657023794 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb860102550 msgr2=0x7fb860113570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:00:31.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.659+0000 7fb85e7fc640 1 --2- 172.21.15.99:0/3657023794 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb860102550 0x7fb860113570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:31.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.659+0000 7fb85e7fc640 1 -- 172.21.15.99:0/3657023794 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb858005040 con 0x7fb860102ef0 2024-09-19T07:00:31.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.659+0000 7fb85e7fc640 1 --2- 172.21.15.99:0/3657023794 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb860102ef0 0x7fb860113ab0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fb84800c760 tx=0x7fb84800cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:00:31.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.660+0000 7fb8577fe640 1 -- 172.21.15.99:0/3657023794 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb84800a7a0 con 0x7fb860102ef0 2024-09-19T07:00:31.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.660+0000 7fb8577fe640 1 -- 172.21.15.99:0/3657023794 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb84800ada0 con 0x7fb860102ef0 2024-09-19T07:00:31.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.660+0000 7fb8656c9640 1 -- 172.21.15.99:0/3657023794 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb86010d7f0 con 0x7fb860102ef0 2024-09-19T07:00:31.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.660+0000 7fb8577fe640 1 -- 172.21.15.99:0/3657023794 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8480113a0 con 0x7fb860102ef0 2024-09-19T07:00:31.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.660+0000 7fb8656c9640 1 -- 172.21.15.99:0/3657023794 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb86010dd90 con 0x7fb860102ef0 2024-09-19T07:00:31.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.661+0000 7fb8656c9640 1 -- 172.21.15.99:0/3657023794 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8600fdcd0 con 0x7fb860102ef0 2024-09-19T07:00:31.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.661+0000 7fb8577fe640 1 -- 172.21.15.99:0/3657023794 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fb848012400 con 0x7fb860102ef0 2024-09-19T07:00:31.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.662+0000 7fb8577fe640 1 --2- 172.21.15.99:0/3657023794 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fb84c06e530 0x7fb84c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:00:31.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.662+0000 7fb8577fe640 1 -- 172.21.15.99:0/3657023794 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fb84808e190 con 0x7fb860102ef0 2024-09-19T07:00:31.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.662+0000 7fb85effd640 1 --2- 172.21.15.99:0/3657023794 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fb84c06e530 0x7fb84c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:00:31.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.662+0000 7fb85effd640 1 --2- 172.21.15.99:0/3657023794 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fb84c06e530 0x7fb84c0709e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb858009ac0 tx=0x7fb858035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:00:31.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.666+0000 7fb8577fe640 1 -- 172.21.15.99:0/3657023794 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fb8480573c0 con 0x7fb860102ef0 2024-09-19T07:00:31.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.908+0000 7fb8656c9640 1 -- 172.21.15.99:0/3657023794 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb8601095a0 con 0x7fb860102ef0 2024-09-19T07:00:31.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.908+0000 7fb8577fe640 1 -- 172.21.15.99:0/3657023794 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7fb84805aa80 con 0x7fb860102ef0 2024-09-19T07:00:31.909 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T07:00:31.909 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-09-19T07:00:31.910 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T07:00:31.910 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T07:00:31.910 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-09-19T07:00:31.910 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T07:00:31.910 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T07:00:31.910 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-09-19T07:00:31.910 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 6 2024-09-19T07:00:31.910 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T07:00:31.910 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": { 2024-09-19T07:00:31.910 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 4 2024-09-19T07:00:31.910 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T07:00:31.910 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-09-19T07:00:31.911 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 14 2024-09-19T07:00:31.911 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T07:00:31.911 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T07:00:31.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.910+0000 7fb8656c9640 1 -- 172.21.15.99:0/3657023794 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fb84c06e530 msgr2=0x7fb84c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:00:31.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.910+0000 7fb8656c9640 1 --2- 172.21.15.99:0/3657023794 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fb84c06e530 0x7fb84c0709e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb858009ac0 tx=0x7fb858035040 comp rx=0 tx=0).stop 2024-09-19T07:00:31.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.911+0000 7fb8656c9640 1 -- 172.21.15.99:0/3657023794 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb860102ef0 msgr2=0x7fb860113ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:00:31.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.911+0000 7fb8656c9640 1 --2- 172.21.15.99:0/3657023794 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb860102ef0 0x7fb860113ab0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fb84800c760 tx=0x7fb84800cb60 comp rx=0 tx=0).stop 2024-09-19T07:00:31.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.911+0000 7fb8656c9640 1 -- 172.21.15.99:0/3657023794 shutdown_connections 2024-09-19T07:00:31.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.911+0000 7fb8656c9640 1 --2- 172.21.15.99:0/3657023794 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fb84c06e530 0x7fb84c0709e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:31.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.911+0000 7fb8656c9640 1 --2- 172.21.15.99:0/3657023794 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb860102ef0 0x7fb860113ab0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:31.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.911+0000 7fb8656c9640 1 --2- 172.21.15.99:0/3657023794 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb860102550 0x7fb860113570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:31.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.911+0000 7fb8656c9640 1 -- 172.21.15.99:0/3657023794 >> 172.21.15.99:0/3657023794 conn(0x7fb8600f80f0 msgr2=0x7fb8600f90b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:00:31.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.911+0000 7fb8656c9640 1 -- 172.21.15.99:0/3657023794 shutdown_connections 2024-09-19T07:00:31.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.911+0000 7fb8656c9640 1 -- 172.21.15.99:0/3657023794 wait complete. 2024-09-19T07:00:31.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.989+0000 7fb70efae640 1 -- 172.21.15.99:0/2457624351 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7080fd5a0 msgr2=0x7fb7080fd970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:00:31.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.989+0000 7fb70efae640 1 --2- 172.21.15.99:0/2457624351 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7080fd5a0 0x7fb7080fd970 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc0048d0 tx=0x7fb6fc009da0 comp rx=0 tx=0).stop 2024-09-19T07:00:31.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.989+0000 7fb70efae640 1 -- 172.21.15.99:0/2457624351 shutdown_connections 2024-09-19T07:00:31.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.989+0000 7fb70efae640 1 --2- 172.21.15.99:0/2457624351 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7080fdf40 0x7fb708106580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:31.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.989+0000 7fb70efae640 1 --2- 172.21.15.99:0/2457624351 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7080fd5a0 0x7fb7080fd970 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:31.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.989+0000 7fb70efae640 1 -- 172.21.15.99:0/2457624351 >> 172.21.15.99:0/2457624351 conn(0x7fb7080f7030 msgr2=0x7fb7080f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:00:31.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.989+0000 7fb70efae640 1 -- 172.21.15.99:0/2457624351 shutdown_connections 2024-09-19T07:00:31.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.989+0000 7fb70efae640 1 -- 172.21.15.99:0/2457624351 wait complete. 2024-09-19T07:00:31.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.990+0000 7fb70efae640 1 Processor -- start 2024-09-19T07:00:31.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.990+0000 7fb70efae640 1 -- start start 2024-09-19T07:00:31.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.990+0000 7fb70efae640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7080fd5a0 0x7fb7080fb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:00:31.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.990+0000 7fb70efae640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7080fdf40 0x7fb7080fb910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:00:31.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.990+0000 7fb70efae640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7080fbe50 con 0x7fb7080fdf40 2024-09-19T07:00:31.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.990+0000 7fb70efae640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7080fbfc0 con 0x7fb7080fd5a0 2024-09-19T07:00:31.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.990+0000 7fb707fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7080fdf40 0x7fb7080fb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:00:31.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.990+0000 7fb707fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7080fdf40 0x7fb7080fb910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53066/0 (socket says 172.21.15.99:53066) 2024-09-19T07:00:31.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.990+0000 7fb707fff640 1 -- 172.21.15.99:0/1032603752 learned_addr learned my addr 172.21.15.99:0/1032603752 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:00:31.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.990+0000 7fb70cd4a640 1 --2- 172.21.15.99:0/1032603752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7080fd5a0 0x7fb7080fb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:00:31.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.991+0000 7fb707fff640 1 -- 172.21.15.99:0/1032603752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7080fd5a0 msgr2=0x7fb7080fb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:00:31.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.991+0000 7fb707fff640 1 --2- 172.21.15.99:0/1032603752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7080fd5a0 0x7fb7080fb3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:31.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.991+0000 7fb707fff640 1 -- 172.21.15.99:0/1032603752 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6fc005040 con 0x7fb7080fdf40 2024-09-19T07:00:31.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.991+0000 7fb707fff640 1 --2- 172.21.15.99:0/1032603752 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7080fdf40 0x7fb7080fb910 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fb6f4002a50 tx=0x7fb6f4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:00:31.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.991+0000 7fb7057fa640 1 -- 172.21.15.99:0/1032603752 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb6f4007c30 con 0x7fb7080fdf40 2024-09-19T07:00:31.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.991+0000 7fb7057fa640 1 -- 172.21.15.99:0/1032603752 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb6f400f040 con 0x7fb7080fdf40 2024-09-19T07:00:31.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.991+0000 7fb70efae640 1 -- 172.21.15.99:0/1032603752 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7080fc250 con 0x7fb7080fdf40 2024-09-19T07:00:31.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.991+0000 7fb7057fa640 1 -- 172.21.15.99:0/1032603752 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb6f400da10 con 0x7fb7080fdf40 2024-09-19T07:00:31.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.991+0000 7fb70efae640 1 -- 172.21.15.99:0/1032603752 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7081198e0 con 0x7fb7080fdf40 2024-09-19T07:00:31.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.992+0000 7fb70efae640 1 -- 172.21.15.99:0/1032603752 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb708066370 con 0x7fb7080fdf40 2024-09-19T07:00:31.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.993+0000 7fb7057fa640 1 -- 172.21.15.99:0/1032603752 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fb6f400dc80 con 0x7fb7080fdf40 2024-09-19T07:00:31.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.993+0000 7fb7057fa640 1 --2- 172.21.15.99:0/1032603752 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fb6f806e530 0x7fb6f80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:00:31.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.993+0000 7fb7057fa640 1 -- 172.21.15.99:0/1032603752 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fb6f408d970 con 0x7fb7080fdf40 2024-09-19T07:00:31.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.993+0000 7fb70cd4a640 1 --2- 172.21.15.99:0/1032603752 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fb6f806e530 0x7fb6f80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:00:31.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.994+0000 7fb70cd4a640 1 --2- 172.21.15.99:0/1032603752 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fb6f806e530 0x7fb6f80709e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc009ac0 tx=0x7fb6fc035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:00:31.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:31.997+0000 7fb7057fa640 1 -- 172.21.15.99:0/1032603752 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fb6f4056b10 con 0x7fb7080fdf40 2024-09-19T07:00:32.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.197+0000 7fb70efae640 1 -- 172.21.15.99:0/1032603752 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb7081095a0 con 0x7fb7080fdf40 2024-09-19T07:00:32.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.198+0000 7fb7057fa640 1 -- 172.21.15.99:0/1032603752 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 29 v29) v1 ==== 76+0+1915 (secure 0 0 0) 0x7fb6f405a1d0 con 0x7fb7080fdf40 2024-09-19T07:00:32.199 INFO:teuthology.orchestra.run.smithi099.stdout:e29 2024-09-19T07:00:32.199 INFO:teuthology.orchestra.run.smithi099.stdout:btime 2024-09-19T06:48:47:938420+0000 2024-09-19T07:00:32.199 INFO:teuthology.orchestra.run.smithi099.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T07:00:32.199 INFO:teuthology.orchestra.run.smithi099.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T07:00:32.200 INFO:teuthology.orchestra.run.smithi099.stdout:legacy client fscid: 1 2024-09-19T07:00:32.200 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T07:00:32.200 INFO:teuthology.orchestra.run.smithi099.stdout:Filesystem 'cephfs' (1) 2024-09-19T07:00:32.200 INFO:teuthology.orchestra.run.smithi099.stdout:fs_name cephfs 2024-09-19T07:00:32.200 INFO:teuthology.orchestra.run.smithi099.stdout:epoch 20 2024-09-19T07:00:32.200 INFO:teuthology.orchestra.run.smithi099.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-19T07:00:32.200 INFO:teuthology.orchestra.run.smithi099.stdout:created 2024-09-19T06:37:40.838146+0000 2024-09-19T07:00:32.200 INFO:teuthology.orchestra.run.smithi099.stdout:modified 2024-09-19T06:47:50.076553+0000 2024-09-19T07:00:32.200 INFO:teuthology.orchestra.run.smithi099.stdout:tableserver 0 2024-09-19T07:00:32.200 INFO:teuthology.orchestra.run.smithi099.stdout:root 0 2024-09-19T07:00:32.200 INFO:teuthology.orchestra.run.smithi099.stdout:session_timeout 60 2024-09-19T07:00:32.200 INFO:teuthology.orchestra.run.smithi099.stdout:session_autoclose 300 2024-09-19T07:00:32.200 INFO:teuthology.orchestra.run.smithi099.stdout:max_file_size 1099511627776 2024-09-19T07:00:32.201 INFO:teuthology.orchestra.run.smithi099.stdout:max_xattr_size 65536 2024-09-19T07:00:32.201 INFO:teuthology.orchestra.run.smithi099.stdout:required_client_features {} 2024-09-19T07:00:32.201 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure 0 2024-09-19T07:00:32.201 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure_osd_epoch 77 2024-09-19T07:00:32.201 INFO:teuthology.orchestra.run.smithi099.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T07:00:32.201 INFO:teuthology.orchestra.run.smithi099.stdout:max_mds 2 2024-09-19T07:00:32.201 INFO:teuthology.orchestra.run.smithi099.stdout:in 0,1 2024-09-19T07:00:32.201 INFO:teuthology.orchestra.run.smithi099.stdout:up {} 2024-09-19T07:00:32.201 INFO:teuthology.orchestra.run.smithi099.stdout:failed 0,1 2024-09-19T07:00:32.201 INFO:teuthology.orchestra.run.smithi099.stdout:damaged 2024-09-19T07:00:32.201 INFO:teuthology.orchestra.run.smithi099.stdout:stopped 2024-09-19T07:00:32.201 INFO:teuthology.orchestra.run.smithi099.stdout:data_pools [3] 2024-09-19T07:00:32.201 INFO:teuthology.orchestra.run.smithi099.stdout:metadata_pool 2 2024-09-19T07:00:32.202 INFO:teuthology.orchestra.run.smithi099.stdout:inline_data disabled 2024-09-19T07:00:32.202 INFO:teuthology.orchestra.run.smithi099.stdout:balancer 2024-09-19T07:00:32.202 INFO:teuthology.orchestra.run.smithi099.stdout:bal_rank_mask -1 2024-09-19T07:00:32.202 INFO:teuthology.orchestra.run.smithi099.stdout:standby_count_wanted 1 2024-09-19T07:00:32.202 INFO:teuthology.orchestra.run.smithi099.stdout:qdb_cluster leader: 0 members: 2024-09-19T07:00:32.202 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T07:00:32.202 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T07:00:32.202 INFO:teuthology.orchestra.run.smithi099.stdout:Standby daemons: 2024-09-19T07:00:32.202 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T07:00:32.202 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.obarqf{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6826/1859154203,v1:172.21.15.99:6827/1859154203] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:00:32.202 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.xehbxe{-1:34410} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6828/1939453719,v1:172.21.15.99:6829/1939453719] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:00:32.202 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.nooexo{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6824/1398895079,v1:172.21.15.117:6825/1398895079] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:00:32.202 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.bheqzh{-1:44329} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6826/3233337308,v1:172.21.15.117:6827/3233337308] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:00:32.203 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 29 2024-09-19T07:00:32.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.200+0000 7fb70efae640 1 -- 172.21.15.99:0/1032603752 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fb6f806e530 msgr2=0x7fb6f80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:00:32.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.200+0000 7fb70efae640 1 --2- 172.21.15.99:0/1032603752 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fb6f806e530 0x7fb6f80709e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc009ac0 tx=0x7fb6fc035040 comp rx=0 tx=0).stop 2024-09-19T07:00:32.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.200+0000 7fb70efae640 1 -- 172.21.15.99:0/1032603752 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7080fdf40 msgr2=0x7fb7080fb910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:00:32.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.200+0000 7fb70efae640 1 --2- 172.21.15.99:0/1032603752 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7080fdf40 0x7fb7080fb910 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fb6f4002a50 tx=0x7fb6f4004600 comp rx=0 tx=0).stop 2024-09-19T07:00:32.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.200+0000 7fb70efae640 1 -- 172.21.15.99:0/1032603752 shutdown_connections 2024-09-19T07:00:32.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.200+0000 7fb70efae640 1 --2- 172.21.15.99:0/1032603752 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fb6f806e530 0x7fb6f80709e0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:32.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.200+0000 7fb70efae640 1 --2- 172.21.15.99:0/1032603752 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb7080fdf40 0x7fb7080fb910 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:32.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.200+0000 7fb70efae640 1 --2- 172.21.15.99:0/1032603752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7080fd5a0 0x7fb7080fb3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:32.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.200+0000 7fb70efae640 1 -- 172.21.15.99:0/1032603752 >> 172.21.15.99:0/1032603752 conn(0x7fb7080f7030 msgr2=0x7fb7080f8560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:00:32.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.200+0000 7fb70efae640 1 -- 172.21.15.99:0/1032603752 shutdown_connections 2024-09-19T07:00:32.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.200+0000 7fb70efae640 1 -- 172.21.15.99:0/1032603752 wait complete. 2024-09-19T07:00:32.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.280+0000 7f280c308640 1 -- 172.21.15.99:0/3601048274 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28040fac60 msgr2=0x7f28040fb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:00:32.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.280+0000 7f280c308640 1 --2- 172.21.15.99:0/3601048274 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28040fac60 0x7f28040fb0b0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f27f40048d0 tx=0x7f27f4009da0 comp rx=0 tx=0).stop 2024-09-19T07:00:32.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.280+0000 7f280c308640 1 -- 172.21.15.99:0/3601048274 shutdown_connections 2024-09-19T07:00:32.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.280+0000 7f280c308640 1 --2- 172.21.15.99:0/3601048274 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28040fac60 0x7f28040fb0b0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:32.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.280+0000 7f280c308640 1 --2- 172.21.15.99:0/3601048274 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28041025f0 0x7f28041029c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:32.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.280+0000 7f280c308640 1 -- 172.21.15.99:0/3601048274 >> 172.21.15.99:0/3601048274 conn(0x7f2804070c80 msgr2=0x7f2804071080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:00:32.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.280+0000 7f280c308640 1 -- 172.21.15.99:0/3601048274 shutdown_connections 2024-09-19T07:00:32.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.280+0000 7f280c308640 1 -- 172.21.15.99:0/3601048274 wait complete. 2024-09-19T07:00:32.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.280+0000 7f280c308640 1 Processor -- start 2024-09-19T07:00:32.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.281+0000 7f280c308640 1 -- start start 2024-09-19T07:00:32.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.281+0000 7f280c308640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28040fac60 0x7f2804113230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:00:32.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.281+0000 7f280c308640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28041025f0 0x7f2804113770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:00:32.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.281+0000 7f280c308640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2804113e00 con 0x7f28041025f0 2024-09-19T07:00:32.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.281+0000 7f280c308640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f280410d1b0 con 0x7f28040fac60 2024-09-19T07:00:32.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.281+0000 7f28098a3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28041025f0 0x7f2804113770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:00:32.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.281+0000 7f28098a3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28041025f0 0x7f2804113770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53088/0 (socket says 172.21.15.99:53088) 2024-09-19T07:00:32.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.281+0000 7f28098a3640 1 -- 172.21.15.99:0/857206382 learned_addr learned my addr 172.21.15.99:0/857206382 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:00:32.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.281+0000 7f280a0a4640 1 --2- 172.21.15.99:0/857206382 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28040fac60 0x7f2804113230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:00:32.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.281+0000 7f28098a3640 1 -- 172.21.15.99:0/857206382 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28040fac60 msgr2=0x7f2804113230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:00:32.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.281+0000 7f28098a3640 1 --2- 172.21.15.99:0/857206382 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28040fac60 0x7f2804113230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:32.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.281+0000 7f28098a3640 1 -- 172.21.15.99:0/857206382 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f4005040 con 0x7f28041025f0 2024-09-19T07:00:32.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.281+0000 7f28098a3640 1 --2- 172.21.15.99:0/857206382 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28041025f0 0x7f2804113770 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f27f4003080 tx=0x7f27f4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:00:32.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.281+0000 7f27faffd640 1 -- 172.21.15.99:0/857206382 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27f4038070 con 0x7f28041025f0 2024-09-19T07:00:32.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.281+0000 7f27faffd640 1 -- 172.21.15.99:0/857206382 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f27f40097e0 con 0x7f28041025f0 2024-09-19T07:00:32.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.282+0000 7f280c308640 1 -- 172.21.15.99:0/857206382 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f280410d430 con 0x7f28041025f0 2024-09-19T07:00:32.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.282+0000 7f27faffd640 1 -- 172.21.15.99:0/857206382 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27f403d420 con 0x7f28041025f0 2024-09-19T07:00:32.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.282+0000 7f280c308640 1 -- 172.21.15.99:0/857206382 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f280410d8f0 con 0x7f28041025f0 2024-09-19T07:00:32.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.283+0000 7f280c308640 1 -- 172.21.15.99:0/857206382 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2804065810 con 0x7f28041025f0 2024-09-19T07:00:32.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.283+0000 7f27faffd640 1 -- 172.21.15.99:0/857206382 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f27f4030020 con 0x7f28041025f0 2024-09-19T07:00:32.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.283+0000 7f27faffd640 1 --2- 172.21.15.99:0/857206382 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f27f006e530 0x7f27f00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:00:32.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.284+0000 7f280a0a4640 1 --2- 172.21.15.99:0/857206382 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f27f006e530 0x7f27f00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:00:32.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.284+0000 7f27faffd640 1 -- 172.21.15.99:0/857206382 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f27f40ae720 con 0x7f28041025f0 2024-09-19T07:00:32.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.284+0000 7f280a0a4640 1 --2- 172.21.15.99:0/857206382 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f27f006e530 0x7f27f00709e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2800006fd0 tx=0x7f2800008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:00:32.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.288+0000 7f27faffd640 1 -- 172.21.15.99:0/857206382 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f27f4077810 con 0x7f28041025f0 2024-09-19T07:00:32.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:00:32 smithi099 ceph-mon[97031]: from='client.35038 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:00:32.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:00:32 smithi099 ceph-mon[97031]: from='client.35042 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:00:32.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:00:32 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/3657023794' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T07:00:32.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.472+0000 7f280c308640 1 -- 172.21.15.99:0/857206382 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2804109680 con 0x7f27f006e530 2024-09-19T07:00:32.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.474+0000 7f27faffd640 1 -- 172.21.15.99:0/857206382 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f2804109680 con 0x7f27f006e530 2024-09-19T07:00:32.475 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T07:00:32.475 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T07:00:32.475 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": true, 2024-09-19T07:00:32.475 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T07:00:32.475 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [ 2024-09-19T07:00:32.475 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr", 2024-09-19T07:00:32.475 INFO:teuthology.orchestra.run.smithi099.stdout: "crash", 2024-09-19T07:00:32.475 INFO:teuthology.orchestra.run.smithi099.stdout: "mds", 2024-09-19T07:00:32.475 INFO:teuthology.orchestra.run.smithi099.stdout: "mon", 2024-09-19T07:00:32.475 INFO:teuthology.orchestra.run.smithi099.stdout: "osd" 2024-09-19T07:00:32.476 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-19T07:00:32.476 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": "16/21 daemons upgraded", 2024-09-19T07:00:32.476 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "Currently upgrading mds daemons", 2024-09-19T07:00:32.476 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-09-19T07:00:32.476 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T07:00:32.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.476+0000 7f280c308640 1 -- 172.21.15.99:0/857206382 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f27f006e530 msgr2=0x7f27f00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:00:32.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.476+0000 7f280c308640 1 --2- 172.21.15.99:0/857206382 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f27f006e530 0x7f27f00709e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2800006fd0 tx=0x7f2800008040 comp rx=0 tx=0).stop 2024-09-19T07:00:32.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.476+0000 7f280c308640 1 -- 172.21.15.99:0/857206382 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28041025f0 msgr2=0x7f2804113770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:00:32.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.476+0000 7f280c308640 1 --2- 172.21.15.99:0/857206382 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28041025f0 0x7f2804113770 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f27f4003080 tx=0x7f27f4009da0 comp rx=0 tx=0).stop 2024-09-19T07:00:32.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.476+0000 7f280c308640 1 -- 172.21.15.99:0/857206382 shutdown_connections 2024-09-19T07:00:32.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.476+0000 7f280c308640 1 --2- 172.21.15.99:0/857206382 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f27f006e530 0x7f27f00709e0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:32.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.476+0000 7f280c308640 1 --2- 172.21.15.99:0/857206382 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28041025f0 0x7f2804113770 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:32.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.476+0000 7f280c308640 1 --2- 172.21.15.99:0/857206382 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28040fac60 0x7f2804113230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:32.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.476+0000 7f280c308640 1 -- 172.21.15.99:0/857206382 >> 172.21.15.99:0/857206382 conn(0x7f2804070c80 msgr2=0x7f28040f9ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:00:32.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.476+0000 7f280c308640 1 -- 172.21.15.99:0/857206382 shutdown_connections 2024-09-19T07:00:32.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.476+0000 7f280c308640 1 -- 172.21.15.99:0/857206382 wait complete. 2024-09-19T07:00:32.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.553+0000 7ff805911640 1 -- 172.21.15.99:0/2514902176 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff8000fd560 msgr2=0x7ff8000fd930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:00:32.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.553+0000 7ff805911640 1 --2- 172.21.15.99:0/2514902176 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff8000fd560 0x7ff8000fd930 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7ff7f0009c50 tx=0x7ff7f0004d10 comp rx=0 tx=0).stop 2024-09-19T07:00:32.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.553+0000 7ff805911640 1 -- 172.21.15.99:0/2514902176 shutdown_connections 2024-09-19T07:00:32.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.553+0000 7ff805911640 1 --2- 172.21.15.99:0/2514902176 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8000fdf00 0x7ff800106540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:32.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.553+0000 7ff805911640 1 --2- 172.21.15.99:0/2514902176 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff8000fd560 0x7ff8000fd930 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:32.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.553+0000 7ff805911640 1 -- 172.21.15.99:0/2514902176 >> 172.21.15.99:0/2514902176 conn(0x7ff8000f7030 msgr2=0x7ff8000f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:00:32.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.553+0000 7ff805911640 1 -- 172.21.15.99:0/2514902176 shutdown_connections 2024-09-19T07:00:32.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.554+0000 7ff805911640 1 -- 172.21.15.99:0/2514902176 wait complete. 2024-09-19T07:00:32.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.554+0000 7ff805911640 1 Processor -- start 2024-09-19T07:00:32.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.554+0000 7ff805911640 1 -- start start 2024-09-19T07:00:32.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.554+0000 7ff805911640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff8000fd560 0x7ff8001153a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:00:32.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.554+0000 7ff805911640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8000fdf00 0x7ff8001158e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:00:32.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.554+0000 7ff805911640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff800115ee0 con 0x7ff8000fd560 2024-09-19T07:00:32.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.554+0000 7ff805911640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff800116050 con 0x7ff8000fdf00 2024-09-19T07:00:32.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.554+0000 7ff7feffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff8000fd560 0x7ff8001153a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:00:32.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.555+0000 7ff7feffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff8000fd560 0x7ff8001153a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53106/0 (socket says 172.21.15.99:53106) 2024-09-19T07:00:32.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.555+0000 7ff7feffd640 1 -- 172.21.15.99:0/3690781782 learned_addr learned my addr 172.21.15.99:0/3690781782 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:00:32.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.555+0000 7ff7fe7fc640 1 --2- 172.21.15.99:0/3690781782 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8000fdf00 0x7ff8001158e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:00:32.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.555+0000 7ff7feffd640 1 -- 172.21.15.99:0/3690781782 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8000fdf00 msgr2=0x7ff8001158e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:00:32.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.555+0000 7ff7feffd640 1 --2- 172.21.15.99:0/3690781782 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8000fdf00 0x7ff8001158e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:32.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.555+0000 7ff7feffd640 1 -- 172.21.15.99:0/3690781782 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f00098b0 con 0x7ff8000fd560 2024-09-19T07:00:32.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.555+0000 7ff7fe7fc640 1 --2- 172.21.15.99:0/3690781782 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8000fdf00 0x7ff8001158e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:00:32.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.555+0000 7ff7feffd640 1 --2- 172.21.15.99:0/3690781782 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff8000fd560 0x7ff8001153a0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7ff7f0004750 tx=0x7ff7f0004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:00:32.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.555+0000 7ff7f77fe640 1 -- 172.21.15.99:0/3690781782 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7f0009610 con 0x7ff8000fd560 2024-09-19T07:00:32.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.555+0000 7ff805911640 1 -- 172.21.15.99:0/3690781782 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff80010f470 con 0x7ff8000fd560 2024-09-19T07:00:32.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.555+0000 7ff7f77fe640 1 -- 172.21.15.99:0/3690781782 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff7f0032b10 con 0x7ff8000fd560 2024-09-19T07:00:32.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.555+0000 7ff7f77fe640 1 -- 172.21.15.99:0/3690781782 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7f003d990 con 0x7ff8000fd560 2024-09-19T07:00:32.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.555+0000 7ff805911640 1 -- 172.21.15.99:0/3690781782 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff80010f990 con 0x7ff8000fd560 2024-09-19T07:00:32.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.556+0000 7ff805911640 1 -- 172.21.15.99:0/3690781782 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8000660f0 con 0x7ff8000fd560 2024-09-19T07:00:32.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.557+0000 7ff7f77fe640 1 -- 172.21.15.99:0/3690781782 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7ff7f002f030 con 0x7ff8000fd560 2024-09-19T07:00:32.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.557+0000 7ff7f77fe640 1 --2- 172.21.15.99:0/3690781782 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ff7ec06e530 0x7ff7ec0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:00:32.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.557+0000 7ff7f77fe640 1 -- 172.21.15.99:0/3690781782 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7ff7f00af240 con 0x7ff8000fd560 2024-09-19T07:00:32.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.557+0000 7ff7fe7fc640 1 --2- 172.21.15.99:0/3690781782 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ff7ec06e530 0x7ff7ec0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:00:32.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.558+0000 7ff7fe7fc640 1 --2- 172.21.15.99:0/3690781782 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ff7ec06e530 0x7ff7ec0709e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff7e8009af0 tx=0x7ff7e800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:00:32.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:00:32 smithi117 ceph-mon[76771]: from='client.35038 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:00:32.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:00:32 smithi117 ceph-mon[76771]: from='client.35042 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:00:32.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:00:32 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/3657023794' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T07:00:32.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.562+0000 7ff7f77fe640 1 -- 172.21.15.99:0/3690781782 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7ff7f0078330 con 0x7ff8000fd560 2024-09-19T07:00:32.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.788+0000 7ff805911640 1 -- 172.21.15.99:0/3690781782 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7ff800110a50 con 0x7ff8000fd560 2024-09-19T07:00:32.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.788+0000 7ff7f77fe640 1 -- 172.21.15.99:0/3690781782 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7ff7f007b9f0 con 0x7ff8000fd560 2024-09-19T07:00:32.791 INFO:teuthology.orchestra.run.smithi099.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-09-19T07:00:32.791 INFO:teuthology.orchestra.run.smithi099.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-19T07:00:32.791 INFO:teuthology.orchestra.run.smithi099.stdout: fs cephfs is degraded 2024-09-19T07:00:32.791 INFO:teuthology.orchestra.run.smithi099.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-19T07:00:32.791 INFO:teuthology.orchestra.run.smithi099.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-19T07:00:32.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.790+0000 7ff805911640 1 -- 172.21.15.99:0/3690781782 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ff7ec06e530 msgr2=0x7ff7ec0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:00:32.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.790+0000 7ff805911640 1 --2- 172.21.15.99:0/3690781782 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ff7ec06e530 0x7ff7ec0709e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff7e8009af0 tx=0x7ff7e800b040 comp rx=0 tx=0).stop 2024-09-19T07:00:32.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.790+0000 7ff805911640 1 -- 172.21.15.99:0/3690781782 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff8000fd560 msgr2=0x7ff8001153a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:00:32.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.790+0000 7ff805911640 1 --2- 172.21.15.99:0/3690781782 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff8000fd560 0x7ff8001153a0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7ff7f0004750 tx=0x7ff7f0004d10 comp rx=0 tx=0).stop 2024-09-19T07:00:32.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.790+0000 7ff805911640 1 -- 172.21.15.99:0/3690781782 shutdown_connections 2024-09-19T07:00:32.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.790+0000 7ff805911640 1 --2- 172.21.15.99:0/3690781782 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ff7ec06e530 0x7ff7ec0709e0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:32.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.790+0000 7ff805911640 1 --2- 172.21.15.99:0/3690781782 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff8000fdf00 0x7ff8001158e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:32.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.790+0000 7ff805911640 1 --2- 172.21.15.99:0/3690781782 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff8000fd560 0x7ff8001153a0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:00:32.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.791+0000 7ff805911640 1 -- 172.21.15.99:0/3690781782 >> 172.21.15.99:0/3690781782 conn(0x7ff8000f7030 msgr2=0x7ff8000f8560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:00:32.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.791+0000 7ff805911640 1 -- 172.21.15.99:0/3690781782 shutdown_connections 2024-09-19T07:00:32.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:00:32.791+0000 7ff805911640 1 -- 172.21.15.99:0/3690781782 wait complete. 2024-09-19T07:00:33.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:00:33 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/1032603752' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T07:00:33.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:00:33 smithi099 ceph-mon[97031]: from='client.35054 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:00:33.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:00:33 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/3690781782' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T07:00:33.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:00:33 smithi099 ceph-mon[97031]: pgmap v546: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:00:33.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:00:33 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/1032603752' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T07:00:33.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:00:33 smithi117 ceph-mon[76771]: from='client.35054 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:00:33.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:00:33 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/3690781782' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T07:00:33.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:00:33 smithi117 ceph-mon[76771]: pgmap v546: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:00:36.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:00:36 smithi099 ceph-mon[97031]: pgmap v547: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:00:36.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:00:36 smithi117 ceph-mon[76771]: pgmap v547: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:00:37.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:00:37 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:00:37.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:00:37 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:00:38.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:00:38 smithi099 ceph-mon[97031]: pgmap v548: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:00:38.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:00:38 smithi117 ceph-mon[76771]: pgmap v548: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:00:40.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:00:40 smithi099 ceph-mon[97031]: pgmap v549: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:00:40.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:00:40 smithi117 ceph-mon[76771]: pgmap v549: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:00:42.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:00:42 smithi099 ceph-mon[97031]: pgmap v550: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:00:42.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:00:42 smithi117 ceph-mon[76771]: pgmap v550: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:00:44.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:00:44 smithi099 ceph-mon[97031]: pgmap v551: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:00:44.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:00:44 smithi117 ceph-mon[76771]: pgmap v551: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:00:46.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:00:46 smithi099 ceph-mon[97031]: pgmap v552: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:00:46.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:00:46 smithi117 ceph-mon[76771]: pgmap v552: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:00:48.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:00:48 smithi099 ceph-mon[97031]: pgmap v553: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:00:48.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:00:48 smithi117 ceph-mon[76771]: pgmap v553: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:00:50.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:00:50 smithi099 ceph-mon[97031]: pgmap v554: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:00:50.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:00:50 smithi117 ceph-mon[76771]: pgmap v554: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:00:52.449 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:00:52 smithi117 ceph-mon[76771]: pgmap v555: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:00:52.449 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:00:52 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:00:52.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:00:52 smithi099 ceph-mon[97031]: pgmap v555: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:00:52.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:00:52 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:00:54.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:00:54 smithi099 ceph-mon[97031]: pgmap v556: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:00:54.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:00:54 smithi117 ceph-mon[76771]: pgmap v556: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:00:56.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:00:56 smithi099 ceph-mon[97031]: pgmap v557: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:00:56.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:00:56 smithi117 ceph-mon[76771]: pgmap v557: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:00:58.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:00:58 smithi099 ceph-mon[97031]: pgmap v558: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:00:58.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:00:58 smithi117 ceph-mon[76771]: pgmap v558: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:00:59.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:00:59 smithi117 ceph-mon[76771]: pgmap v559: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:00:59.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:00:59 smithi099 ceph-mon[97031]: pgmap v559: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:01:02.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:01:02 smithi099 ceph-mon[97031]: pgmap v560: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:01:02.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:01:02 smithi117 ceph-mon[76771]: pgmap v560: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:01:02.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:02.883+0000 7f425abf9640 1 -- 172.21.15.99:0/340309646 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f42540fb480 msgr2=0x7f42540fb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:02.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:02.883+0000 7f425abf9640 1 --2- 172.21.15.99:0/340309646 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f42540fb480 0x7f42540fb8f0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f42400048d0 tx=0x7f4240009da0 comp rx=0 tx=0).stop 2024-09-19T07:01:02.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:02.883+0000 7f425abf9640 1 -- 172.21.15.99:0/340309646 shutdown_connections 2024-09-19T07:01:02.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:02.883+0000 7f425abf9640 1 --2- 172.21.15.99:0/340309646 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f42540fb480 0x7f42540fb8f0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:02.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:02.883+0000 7f425abf9640 1 --2- 172.21.15.99:0/340309646 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f42541014c0 0x7f4254101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:02.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:02.883+0000 7f425abf9640 1 -- 172.21.15.99:0/340309646 >> 172.21.15.99:0/340309646 conn(0x7f42540f7000 msgr2=0x7f42540f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:01:02.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:02.883+0000 7f425abf9640 1 -- 172.21.15.99:0/340309646 shutdown_connections 2024-09-19T07:01:02.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:02.883+0000 7f425abf9640 1 -- 172.21.15.99:0/340309646 wait complete. 2024-09-19T07:01:02.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:02.884+0000 7f425abf9640 1 Processor -- start 2024-09-19T07:01:02.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:02.884+0000 7f425abf9640 1 -- start start 2024-09-19T07:01:02.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:02.884+0000 7f425abf9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f42540fb480 0x7f42541120d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:01:02.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:02.885+0000 7f425abf9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f42541014c0 0x7f4254112610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:01:02.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:02.885+0000 7f425abf9640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4254112c10 con 0x7f42541014c0 2024-09-19T07:01:02.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:02.885+0000 7f425abf9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f425410c050 con 0x7f42540fb480 2024-09-19T07:01:02.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:02.885+0000 7f4253fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f42541014c0 0x7f4254112610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:01:02.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:02.885+0000 7f4253fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f42541014c0 0x7f4254112610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42434/0 (socket says 172.21.15.99:42434) 2024-09-19T07:01:02.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:02.885+0000 7f4253fff640 1 -- 172.21.15.99:0/926351497 learned_addr learned my addr 172.21.15.99:0/926351497 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:01:02.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:02.885+0000 7f4258995640 1 --2- 172.21.15.99:0/926351497 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f42540fb480 0x7f42541120d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:01:02.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:02.885+0000 7f4253fff640 1 -- 172.21.15.99:0/926351497 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f42540fb480 msgr2=0x7f42541120d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:02.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:02.885+0000 7f4253fff640 1 --2- 172.21.15.99:0/926351497 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f42540fb480 0x7f42541120d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:02.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:02.885+0000 7f4253fff640 1 -- 172.21.15.99:0/926351497 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4240005040 con 0x7f42541014c0 2024-09-19T07:01:02.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:02.885+0000 7f4253fff640 1 --2- 172.21.15.99:0/926351497 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f42541014c0 0x7f4254112610 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f4240003080 tx=0x7f4240009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:01:02.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:02.885+0000 7f42517fa640 1 -- 172.21.15.99:0/926351497 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4240038070 con 0x7f42541014c0 2024-09-19T07:01:02.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:02.885+0000 7f425abf9640 1 -- 172.21.15.99:0/926351497 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f425410c2d0 con 0x7f42541014c0 2024-09-19T07:01:02.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:02.885+0000 7f42517fa640 1 -- 172.21.15.99:0/926351497 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f42400097e0 con 0x7f42541014c0 2024-09-19T07:01:02.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:02.886+0000 7f42517fa640 1 -- 172.21.15.99:0/926351497 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f424003d420 con 0x7f42541014c0 2024-09-19T07:01:02.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:02.886+0000 7f425abf9640 1 -- 172.21.15.99:0/926351497 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f425410c810 con 0x7f42541014c0 2024-09-19T07:01:02.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:02.887+0000 7f425abf9640 1 -- 172.21.15.99:0/926351497 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42540fcbc0 con 0x7f42541014c0 2024-09-19T07:01:02.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:02.887+0000 7f42517fa640 1 -- 172.21.15.99:0/926351497 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f4240030020 con 0x7f42541014c0 2024-09-19T07:01:02.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:02.887+0000 7f42517fa640 1 --2- 172.21.15.99:0/926351497 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f424406e530 0x7f42440709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:01:02.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:02.888+0000 7f42517fa640 1 -- 172.21.15.99:0/926351497 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f42400ae670 con 0x7f42541014c0 2024-09-19T07:01:02.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:02.888+0000 7f4258995640 1 --2- 172.21.15.99:0/926351497 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f424406e530 0x7f42440709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:01:02.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:02.888+0000 7f4258995640 1 --2- 172.21.15.99:0/926351497 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f424406e530 0x7f42440709e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f42480041d0 tx=0x7f4248004330 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:01:02.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:02.892+0000 7f42517fa640 1 -- 172.21.15.99:0/926351497 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f4240077760 con 0x7f42541014c0 2024-09-19T07:01:03.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.074+0000 7f425abf9640 1 -- 172.21.15.99:0/926351497 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4254108440 con 0x7f424406e530 2024-09-19T07:01:03.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.075+0000 7f42517fa640 1 -- 172.21.15.99:0/926351497 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f4254108440 con 0x7f424406e530 2024-09-19T07:01:03.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.077+0000 7f425abf9640 1 -- 172.21.15.99:0/926351497 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f424406e530 msgr2=0x7f42440709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:03.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.077+0000 7f425abf9640 1 --2- 172.21.15.99:0/926351497 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f424406e530 0x7f42440709e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f42480041d0 tx=0x7f4248004330 comp rx=0 tx=0).stop 2024-09-19T07:01:03.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.077+0000 7f425abf9640 1 -- 172.21.15.99:0/926351497 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f42541014c0 msgr2=0x7f4254112610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:03.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.077+0000 7f425abf9640 1 --2- 172.21.15.99:0/926351497 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f42541014c0 0x7f4254112610 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f4240003080 tx=0x7f4240009da0 comp rx=0 tx=0).stop 2024-09-19T07:01:03.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.077+0000 7f425abf9640 1 -- 172.21.15.99:0/926351497 shutdown_connections 2024-09-19T07:01:03.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.077+0000 7f425abf9640 1 --2- 172.21.15.99:0/926351497 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f424406e530 0x7f42440709e0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:03.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.077+0000 7f425abf9640 1 --2- 172.21.15.99:0/926351497 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f42541014c0 0x7f4254112610 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:03.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.077+0000 7f425abf9640 1 --2- 172.21.15.99:0/926351497 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f42540fb480 0x7f42541120d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:03.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.077+0000 7f425abf9640 1 -- 172.21.15.99:0/926351497 >> 172.21.15.99:0/926351497 conn(0x7f42540f7000 msgr2=0x7f42540f73d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:01:03.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.077+0000 7f425abf9640 1 -- 172.21.15.99:0/926351497 shutdown_connections 2024-09-19T07:01:03.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.077+0000 7f425abf9640 1 -- 172.21.15.99:0/926351497 wait complete. 2024-09-19T07:01:03.087 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-09-19T07:01:03.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.159+0000 7f757d9f4640 1 -- 172.21.15.99:0/2751192881 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f75780fac60 msgr2=0x7f75780fb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:03.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.159+0000 7f757d9f4640 1 --2- 172.21.15.99:0/2751192881 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f75780fac60 0x7f75780fb0b0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f75600048d0 tx=0x7f7560009da0 comp rx=0 tx=0).stop 2024-09-19T07:01:03.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.159+0000 7f757d9f4640 1 -- 172.21.15.99:0/2751192881 shutdown_connections 2024-09-19T07:01:03.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.159+0000 7f757d9f4640 1 --2- 172.21.15.99:0/2751192881 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f75780fac60 0x7f75780fb0b0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:03.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.159+0000 7f757d9f4640 1 --2- 172.21.15.99:0/2751192881 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75781025f0 0x7f75781029c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:03.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.159+0000 7f757d9f4640 1 -- 172.21.15.99:0/2751192881 >> 172.21.15.99:0/2751192881 conn(0x7f7578070c80 msgr2=0x7f7578071080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:01:03.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.159+0000 7f757d9f4640 1 -- 172.21.15.99:0/2751192881 shutdown_connections 2024-09-19T07:01:03.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.159+0000 7f757d9f4640 1 -- 172.21.15.99:0/2751192881 wait complete. 2024-09-19T07:01:03.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.159+0000 7f757d9f4640 1 Processor -- start 2024-09-19T07:01:03.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.159+0000 7f757d9f4640 1 -- start start 2024-09-19T07:01:03.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.160+0000 7f757d9f4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f75780fac60 0x7f7578113230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:01:03.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.160+0000 7f757d9f4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75781025f0 0x7f7578113770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:01:03.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.160+0000 7f757d9f4640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7578113d70 con 0x7f75780fac60 2024-09-19T07:01:03.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.160+0000 7f757d9f4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f757810d1b0 con 0x7f75781025f0 2024-09-19T07:01:03.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.160+0000 7f7576ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f75780fac60 0x7f7578113230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:01:03.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.160+0000 7f7576ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f75780fac60 0x7f7578113230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42450/0 (socket says 172.21.15.99:42450) 2024-09-19T07:01:03.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.160+0000 7f7576ffd640 1 -- 172.21.15.99:0/1482219410 learned_addr learned my addr 172.21.15.99:0/1482219410 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:01:03.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.160+0000 7f75767fc640 1 --2- 172.21.15.99:0/1482219410 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75781025f0 0x7f7578113770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:01:03.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.160+0000 7f7576ffd640 1 -- 172.21.15.99:0/1482219410 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75781025f0 msgr2=0x7f7578113770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:03.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.160+0000 7f7576ffd640 1 --2- 172.21.15.99:0/1482219410 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75781025f0 0x7f7578113770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:03.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.160+0000 7f7576ffd640 1 -- 172.21.15.99:0/1482219410 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7560005040 con 0x7f75780fac60 2024-09-19T07:01:03.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.160+0000 7f7576ffd640 1 --2- 172.21.15.99:0/1482219410 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f75780fac60 0x7f7578113230 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f756800db00 tx=0x7f7568004e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:01:03.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.160+0000 7f756f7fe640 1 -- 172.21.15.99:0/1482219410 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7568017070 con 0x7f75780fac60 2024-09-19T07:01:03.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.160+0000 7f756f7fe640 1 -- 172.21.15.99:0/1482219410 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f756800f040 con 0x7f75780fac60 2024-09-19T07:01:03.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.160+0000 7f757d9f4640 1 -- 172.21.15.99:0/1482219410 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f757810d490 con 0x7f75780fac60 2024-09-19T07:01:03.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.160+0000 7f756f7fe640 1 -- 172.21.15.99:0/1482219410 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7568003960 con 0x7f75780fac60 2024-09-19T07:01:03.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.160+0000 7f757d9f4640 1 -- 172.21.15.99:0/1482219410 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f757810da00 con 0x7f75780fac60 2024-09-19T07:01:03.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.161+0000 7f757d9f4640 1 -- 172.21.15.99:0/1482219410 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7578065810 con 0x7f75780fac60 2024-09-19T07:01:03.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.162+0000 7f756f7fe640 1 -- 172.21.15.99:0/1482219410 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f7568003ac0 con 0x7f75780fac60 2024-09-19T07:01:03.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.162+0000 7f756f7fe640 1 --2- 172.21.15.99:0/1482219410 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f756406e530 0x7f75640709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:01:03.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.162+0000 7f756f7fe640 1 -- 172.21.15.99:0/1482219410 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f756808e0b0 con 0x7f75780fac60 2024-09-19T07:01:03.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.162+0000 7f75767fc640 1 --2- 172.21.15.99:0/1482219410 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f756406e530 0x7f75640709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:01:03.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.163+0000 7f75767fc640 1 --2- 172.21.15.99:0/1482219410 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f756406e530 0x7f75640709e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7560009ac0 tx=0x7f7560035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:01:03.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.167+0000 7f756f7fe640 1 -- 172.21.15.99:0/1482219410 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f7568057220 con 0x7f75780fac60 2024-09-19T07:01:03.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.349+0000 7f757d9f4640 1 -- 172.21.15.99:0/1482219410 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f757810d620 con 0x7f756406e530 2024-09-19T07:01:03.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.350+0000 7f756f7fe640 1 -- 172.21.15.99:0/1482219410 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f757810d620 con 0x7f756406e530 2024-09-19T07:01:03.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.352+0000 7f757d9f4640 1 -- 172.21.15.99:0/1482219410 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f756406e530 msgr2=0x7f75640709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:03.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.352+0000 7f757d9f4640 1 --2- 172.21.15.99:0/1482219410 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f756406e530 0x7f75640709e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7560009ac0 tx=0x7f7560035040 comp rx=0 tx=0).stop 2024-09-19T07:01:03.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.352+0000 7f757d9f4640 1 -- 172.21.15.99:0/1482219410 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f75780fac60 msgr2=0x7f7578113230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:03.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.352+0000 7f757d9f4640 1 --2- 172.21.15.99:0/1482219410 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f75780fac60 0x7f7578113230 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f756800db00 tx=0x7f7568004e60 comp rx=0 tx=0).stop 2024-09-19T07:01:03.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.352+0000 7f757d9f4640 1 -- 172.21.15.99:0/1482219410 shutdown_connections 2024-09-19T07:01:03.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.352+0000 7f757d9f4640 1 --2- 172.21.15.99:0/1482219410 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f756406e530 0x7f75640709e0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:03.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.352+0000 7f757d9f4640 1 --2- 172.21.15.99:0/1482219410 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75781025f0 0x7f7578113770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:03.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.352+0000 7f757d9f4640 1 --2- 172.21.15.99:0/1482219410 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f75780fac60 0x7f7578113230 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:03.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.352+0000 7f757d9f4640 1 -- 172.21.15.99:0/1482219410 >> 172.21.15.99:0/1482219410 conn(0x7f7578070c80 msgr2=0x7f75780f9f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:01:03.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.352+0000 7f757d9f4640 1 -- 172.21.15.99:0/1482219410 shutdown_connections 2024-09-19T07:01:03.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.352+0000 7f757d9f4640 1 -- 172.21.15.99:0/1482219410 wait complete. 2024-09-19T07:01:03.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.431+0000 7f5e8459d640 1 -- 172.21.15.99:0/4153537585 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e7c1025f0 msgr2=0x7f5e7c1029c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:03.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.431+0000 7f5e8459d640 1 --2- 172.21.15.99:0/4153537585 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e7c1025f0 0x7f5e7c1029c0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c0048d0 tx=0x7f5e6c009da0 comp rx=0 tx=0).stop 2024-09-19T07:01:03.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.431+0000 7f5e8459d640 1 -- 172.21.15.99:0/4153537585 shutdown_connections 2024-09-19T07:01:03.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.431+0000 7f5e8459d640 1 --2- 172.21.15.99:0/4153537585 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e7c0fac60 0x7f5e7c0fb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:03.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.431+0000 7f5e8459d640 1 --2- 172.21.15.99:0/4153537585 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e7c1025f0 0x7f5e7c1029c0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:03.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.431+0000 7f5e8459d640 1 -- 172.21.15.99:0/4153537585 >> 172.21.15.99:0/4153537585 conn(0x7f5e7c070c80 msgr2=0x7f5e7c071080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:01:03.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.431+0000 7f5e8459d640 1 -- 172.21.15.99:0/4153537585 shutdown_connections 2024-09-19T07:01:03.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.431+0000 7f5e8459d640 1 -- 172.21.15.99:0/4153537585 wait complete. 2024-09-19T07:01:03.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.431+0000 7f5e8459d640 1 Processor -- start 2024-09-19T07:01:03.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.432+0000 7f5e8459d640 1 -- start start 2024-09-19T07:01:03.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.432+0000 7f5e8459d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e7c0fac60 0x7f5e7c113230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:01:03.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.432+0000 7f5e8459d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e7c1025f0 0x7f5e7c113770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:01:03.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.432+0000 7f5e8459d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7c113d70 con 0x7f5e7c1025f0 2024-09-19T07:01:03.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.432+0000 7f5e8459d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7c113ee0 con 0x7f5e7c0fac60 2024-09-19T07:01:03.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.432+0000 7f5e81b38640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e7c1025f0 0x7f5e7c113770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:01:03.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.432+0000 7f5e81b38640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e7c1025f0 0x7f5e7c113770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42482/0 (socket says 172.21.15.99:42482) 2024-09-19T07:01:03.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.432+0000 7f5e81b38640 1 -- 172.21.15.99:0/2254345188 learned_addr learned my addr 172.21.15.99:0/2254345188 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:01:03.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.432+0000 7f5e82339640 1 --2- 172.21.15.99:0/2254345188 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e7c0fac60 0x7f5e7c113230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:01:03.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.432+0000 7f5e81b38640 1 -- 172.21.15.99:0/2254345188 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e7c0fac60 msgr2=0x7f5e7c113230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:03.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.432+0000 7f5e81b38640 1 --2- 172.21.15.99:0/2254345188 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e7c0fac60 0x7f5e7c113230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:03.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.432+0000 7f5e81b38640 1 -- 172.21.15.99:0/2254345188 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e6c005040 con 0x7f5e7c1025f0 2024-09-19T07:01:03.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.432+0000 7f5e82339640 1 --2- 172.21.15.99:0/2254345188 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e7c0fac60 0x7f5e7c113230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:01:03.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.432+0000 7f5e81b38640 1 --2- 172.21.15.99:0/2254345188 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e7c1025f0 0x7f5e7c113770 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f5e7800eb70 tx=0x7f5e7800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:01:03.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.433+0000 7f5e72ffd640 1 -- 172.21.15.99:0/2254345188 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e78007c30 con 0x7f5e7c1025f0 2024-09-19T07:01:03.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.433+0000 7f5e72ffd640 1 -- 172.21.15.99:0/2254345188 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5e7800f040 con 0x7f5e7c1025f0 2024-09-19T07:01:03.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.433+0000 7f5e8459d640 1 -- 172.21.15.99:0/2254345188 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e7c10d300 con 0x7f5e7c1025f0 2024-09-19T07:01:03.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.433+0000 7f5e72ffd640 1 -- 172.21.15.99:0/2254345188 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e780094e0 con 0x7f5e7c1025f0 2024-09-19T07:01:03.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.433+0000 7f5e8459d640 1 -- 172.21.15.99:0/2254345188 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e7c10d7d0 con 0x7f5e7c1025f0 2024-09-19T07:01:03.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.434+0000 7f5e8459d640 1 -- 172.21.15.99:0/2254345188 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e7c065810 con 0x7f5e7c1025f0 2024-09-19T07:01:03.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.434+0000 7f5e72ffd640 1 -- 172.21.15.99:0/2254345188 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f5e78009660 con 0x7f5e7c1025f0 2024-09-19T07:01:03.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.435+0000 7f5e72ffd640 1 --2- 172.21.15.99:0/2254345188 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f5e6806e530 0x7f5e680709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:01:03.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.435+0000 7f5e72ffd640 1 -- 172.21.15.99:0/2254345188 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f5e7808df00 con 0x7f5e7c1025f0 2024-09-19T07:01:03.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.435+0000 7f5e82339640 1 --2- 172.21.15.99:0/2254345188 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f5e6806e530 0x7f5e680709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:01:03.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.435+0000 7f5e82339640 1 --2- 172.21.15.99:0/2254345188 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f5e6806e530 0x7f5e680709e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c007ac0 tx=0x7f5e6c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:01:03.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.439+0000 7f5e72ffd640 1 -- 172.21.15.99:0/2254345188 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f5e78056ff0 con 0x7f5e7c1025f0 2024-09-19T07:01:03.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.613+0000 7f5e8459d640 1 -- 172.21.15.99:0/2254345188 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5e7c04b720 con 0x7f5e6806e530 2024-09-19T07:01:03.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.622+0000 7f5e72ffd640 1 -- 172.21.15.99:0/2254345188 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f5e7c04b720 con 0x7f5e6806e530 2024-09-19T07:01:03.623 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T07:01:03.623 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.smithi099 smithi099 *:9093,9094 running (20m) 12m ago 28m 23.4M - 0.25.0 c8568f914cd2 e7c1774d56b0 2024-09-19T07:01:03.623 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi099 smithi099 running (16m) 12m ago 28m 6899k - 19.1.1-361-g2f599a46 d2baa855c067 b9775f416b10 2024-09-19T07:01:03.623 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi117 smithi117 running (16m) 12m ago 27m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 38cf60c0d548 2024-09-19T07:01:03.624 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.smithi099 smithi099 *:3000 running (18m) 12m ago 28m 80.7M - 9.4.12 2bacad6d85d8 cd53a18d5410 2024-09-19T07:01:03.624 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.obarqf smithi099 running (13m) 12m ago 23m 12.2M - 19.1.1-361-g2f599a46 d2baa855c067 314a73082521 2024-09-19T07:01:03.624 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.xehbxe smithi099 running (12m) 12m ago 23m 14.4M - 19.1.1-361-g2f599a46 d2baa855c067 a2955a9d06e6 2024-09-19T07:01:03.624 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.bheqzh smithi117 running (12m) 12m ago 23m 11.8M - 19.1.1-361-g2f599a46 d2baa855c067 b1505937c0b7 2024-09-19T07:01:03.624 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.nooexo smithi117 running (12m) 12m ago 23m 13.1M - 19.1.1-361-g2f599a46 d2baa855c067 35bd7725855c 2024-09-19T07:01:03.624 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi099.pgvkqi smithi099 *:8443,9283,8765 running (19m) 12m ago 29m 505M - 19.1.1-361-g2f599a46 d2baa855c067 d5de99cb7e78 2024-09-19T07:01:03.624 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi117.ssmkcf smithi117 *:8443,9283,8765 running (18m) 12m ago 27m 444M - 19.1.1-361-g2f599a46 d2baa855c067 8b7ee0f871f5 2024-09-19T07:01:03.624 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi099 smithi099 running (17m) 12m ago 29m 52.4M 2048M 19.1.1-361-g2f599a46 d2baa855c067 ffe067438824 2024-09-19T07:01:03.624 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi117 smithi117 running (17m) 12m ago 27m 38.9M 2048M 19.1.1-361-g2f599a46 d2baa855c067 4cb7455e3ee7 2024-09-19T07:01:03.624 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi099 smithi099 *:9100 running (20m) 12m ago 28m 15.0M - 1.5.0 0da6a335fe13 dca7b4517dcc 2024-09-19T07:01:03.624 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi117 smithi117 *:9100 running (19m) 12m ago 27m 15.9M - 1.5.0 0da6a335fe13 8233ce3835d2 2024-09-19T07:01:03.624 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (16m) 12m ago 26m 100M 1557M 19.1.1-361-g2f599a46 d2baa855c067 8e22543bf933 2024-09-19T07:01:03.624 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (15m) 12m ago 26m 106M 1557M 19.1.1-361-g2f599a46 d2baa855c067 f54153d0ae09 2024-09-19T07:01:03.625 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (15m) 12m ago 25m 83.7M 1557M 19.1.1-361-g2f599a46 d2baa855c067 b1778ab88870 2024-09-19T07:01:03.625 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi117 running (14m) 12m ago 25m 102M 2581M 19.1.1-361-g2f599a46 d2baa855c067 ea5236b193d3 2024-09-19T07:01:03.625 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi117 running (13m) 12m ago 25m 93.5M 2581M 19.1.1-361-g2f599a46 d2baa855c067 27ac2c859a68 2024-09-19T07:01:03.625 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi117 running (13m) 12m ago 24m 100M 2581M 19.1.1-361-g2f599a46 d2baa855c067 de6aeb8544ce 2024-09-19T07:01:03.625 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.smithi099 smithi099 *:9095 running (18m) 12m ago 28m 64.4M - 2.43.0 a07b618ecd1d 15ad26ec6fb4 2024-09-19T07:01:03.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.625+0000 7f5e8459d640 1 -- 172.21.15.99:0/2254345188 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f5e6806e530 msgr2=0x7f5e680709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:03.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.625+0000 7f5e8459d640 1 --2- 172.21.15.99:0/2254345188 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f5e6806e530 0x7f5e680709e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c007ac0 tx=0x7f5e6c035040 comp rx=0 tx=0).stop 2024-09-19T07:01:03.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.625+0000 7f5e8459d640 1 -- 172.21.15.99:0/2254345188 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e7c1025f0 msgr2=0x7f5e7c113770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:03.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.625+0000 7f5e8459d640 1 --2- 172.21.15.99:0/2254345188 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e7c1025f0 0x7f5e7c113770 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f5e7800eb70 tx=0x7f5e7800b040 comp rx=0 tx=0).stop 2024-09-19T07:01:03.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.625+0000 7f5e8459d640 1 -- 172.21.15.99:0/2254345188 shutdown_connections 2024-09-19T07:01:03.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.625+0000 7f5e8459d640 1 --2- 172.21.15.99:0/2254345188 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f5e6806e530 0x7f5e680709e0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:03.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.625+0000 7f5e8459d640 1 --2- 172.21.15.99:0/2254345188 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5e7c1025f0 0x7f5e7c113770 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:03.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.625+0000 7f5e8459d640 1 --2- 172.21.15.99:0/2254345188 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e7c0fac60 0x7f5e7c113230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:03.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.625+0000 7f5e8459d640 1 -- 172.21.15.99:0/2254345188 >> 172.21.15.99:0/2254345188 conn(0x7f5e7c070c80 msgr2=0x7f5e7c0f9ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:01:03.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.625+0000 7f5e8459d640 1 -- 172.21.15.99:0/2254345188 shutdown_connections 2024-09-19T07:01:03.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.625+0000 7f5e8459d640 1 -- 172.21.15.99:0/2254345188 wait complete. 2024-09-19T07:01:03.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.702+0000 7fcf7f955640 1 -- 172.21.15.99:0/467907119 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf78102620 msgr2=0x7fcf781029f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:03.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.702+0000 7fcf7f955640 1 --2- 172.21.15.99:0/467907119 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf78102620 0x7fcf781029f0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fcf680048d0 tx=0x7fcf68009da0 comp rx=0 tx=0).stop 2024-09-19T07:01:03.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.702+0000 7fcf7f955640 1 -- 172.21.15.99:0/467907119 shutdown_connections 2024-09-19T07:01:03.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.702+0000 7fcf7f955640 1 --2- 172.21.15.99:0/467907119 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf780fac80 0x7fcf780fb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:03.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.702+0000 7fcf7f955640 1 --2- 172.21.15.99:0/467907119 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf78102620 0x7fcf781029f0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:03.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.702+0000 7fcf7f955640 1 -- 172.21.15.99:0/467907119 >> 172.21.15.99:0/467907119 conn(0x7fcf78070ce0 msgr2=0x7fcf780710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:01:03.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.702+0000 7fcf7f955640 1 -- 172.21.15.99:0/467907119 shutdown_connections 2024-09-19T07:01:03.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.702+0000 7fcf7f955640 1 -- 172.21.15.99:0/467907119 wait complete. 2024-09-19T07:01:03.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.703+0000 7fcf7f955640 1 Processor -- start 2024-09-19T07:01:03.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.703+0000 7fcf7f955640 1 -- start start 2024-09-19T07:01:03.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.703+0000 7fcf7f955640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf780fac80 0x7fcf780fbe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:01:03.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.703+0000 7fcf7f955640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf78102620 0x7fcf780fc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:01:03.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.703+0000 7fcf7f955640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf780fc8e0 con 0x7fcf780fac80 2024-09-19T07:01:03.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.703+0000 7fcf7f955640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf780fca50 con 0x7fcf78102620 2024-09-19T07:01:03.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.703+0000 7fcf7d6f1640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf780fac80 0x7fcf780fbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:01:03.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.703+0000 7fcf7d6f1640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf780fac80 0x7fcf780fbe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42490/0 (socket says 172.21.15.99:42490) 2024-09-19T07:01:03.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.703+0000 7fcf7d6f1640 1 -- 172.21.15.99:0/3931763913 learned_addr learned my addr 172.21.15.99:0/3931763913 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:01:03.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.703+0000 7fcf7cef0640 1 --2- 172.21.15.99:0/3931763913 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf78102620 0x7fcf780fc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:01:03.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.703+0000 7fcf7d6f1640 1 -- 172.21.15.99:0/3931763913 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf78102620 msgr2=0x7fcf780fc3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:03.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.703+0000 7fcf7d6f1640 1 --2- 172.21.15.99:0/3931763913 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf78102620 0x7fcf780fc3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:03.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.703+0000 7fcf7d6f1640 1 -- 172.21.15.99:0/3931763913 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf68005040 con 0x7fcf780fac80 2024-09-19T07:01:03.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.704+0000 7fcf7d6f1640 1 --2- 172.21.15.99:0/3931763913 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf780fac80 0x7fcf780fbe60 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fcf68000c00 tx=0x7fcf68009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:01:03.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.704+0000 7fcf6dffb640 1 -- 172.21.15.99:0/3931763913 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf68038070 con 0x7fcf780fac80 2024-09-19T07:01:03.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.704+0000 7fcf7f955640 1 -- 172.21.15.99:0/3931763913 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf780fcc80 con 0x7fcf780fac80 2024-09-19T07:01:03.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.704+0000 7fcf6dffb640 1 -- 172.21.15.99:0/3931763913 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fcf6802ade0 con 0x7fcf780fac80 2024-09-19T07:01:03.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.704+0000 7fcf6dffb640 1 -- 172.21.15.99:0/3931763913 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf6802c7e0 con 0x7fcf780fac80 2024-09-19T07:01:03.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.704+0000 7fcf7f955640 1 -- 172.21.15.99:0/3931763913 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf78119840 con 0x7fcf780fac80 2024-09-19T07:01:03.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.705+0000 7fcf7f955640 1 -- 172.21.15.99:0/3931763913 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf780657b0 con 0x7fcf780fac80 2024-09-19T07:01:03.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.706+0000 7fcf6dffb640 1 -- 172.21.15.99:0/3931763913 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fcf68030020 con 0x7fcf780fac80 2024-09-19T07:01:03.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.706+0000 7fcf6dffb640 1 --2- 172.21.15.99:0/3931763913 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fcf6406e530 0x7fcf640709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:01:03.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.706+0000 7fcf6dffb640 1 -- 172.21.15.99:0/3931763913 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fcf680add50 con 0x7fcf780fac80 2024-09-19T07:01:03.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.706+0000 7fcf7cef0640 1 --2- 172.21.15.99:0/3931763913 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fcf6406e530 0x7fcf640709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:01:03.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.707+0000 7fcf7cef0640 1 --2- 172.21.15.99:0/3931763913 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fcf6406e530 0x7fcf640709e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fcf780fd7a0 tx=0x7fcf7400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:01:03.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.711+0000 7fcf6dffb640 1 -- 172.21.15.99:0/3931763913 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fcf68076f70 con 0x7fcf780fac80 2024-09-19T07:01:03.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.942+0000 7fcf7f955640 1 -- 172.21.15.99:0/3931763913 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fcf780fd550 con 0x7fcf780fac80 2024-09-19T07:01:03.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.943+0000 7fcf6dffb640 1 -- 172.21.15.99:0/3931763913 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7fcf6807a630 con 0x7fcf780fac80 2024-09-19T07:01:03.944 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T07:01:03.944 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-09-19T07:01:03.944 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T07:01:03.945 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T07:01:03.945 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-09-19T07:01:03.945 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T07:01:03.945 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T07:01:03.945 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-09-19T07:01:03.945 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 6 2024-09-19T07:01:03.945 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T07:01:03.945 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": { 2024-09-19T07:01:03.945 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 4 2024-09-19T07:01:03.945 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T07:01:03.946 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-09-19T07:01:03.946 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 14 2024-09-19T07:01:03.946 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T07:01:03.946 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T07:01:03.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.945+0000 7fcf7f955640 1 -- 172.21.15.99:0/3931763913 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fcf6406e530 msgr2=0x7fcf640709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:03.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.945+0000 7fcf7f955640 1 --2- 172.21.15.99:0/3931763913 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fcf6406e530 0x7fcf640709e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fcf780fd7a0 tx=0x7fcf7400b040 comp rx=0 tx=0).stop 2024-09-19T07:01:03.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.945+0000 7fcf7f955640 1 -- 172.21.15.99:0/3931763913 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf780fac80 msgr2=0x7fcf780fbe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:03.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.945+0000 7fcf7f955640 1 --2- 172.21.15.99:0/3931763913 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf780fac80 0x7fcf780fbe60 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fcf68000c00 tx=0x7fcf68009da0 comp rx=0 tx=0).stop 2024-09-19T07:01:03.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.945+0000 7fcf7f955640 1 -- 172.21.15.99:0/3931763913 shutdown_connections 2024-09-19T07:01:03.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.945+0000 7fcf7f955640 1 --2- 172.21.15.99:0/3931763913 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fcf6406e530 0x7fcf640709e0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:03.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.945+0000 7fcf7f955640 1 --2- 172.21.15.99:0/3931763913 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf78102620 0x7fcf780fc3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:03.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.945+0000 7fcf7f955640 1 --2- 172.21.15.99:0/3931763913 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcf780fac80 0x7fcf780fbe60 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:03.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.945+0000 7fcf7f955640 1 -- 172.21.15.99:0/3931763913 >> 172.21.15.99:0/3931763913 conn(0x7fcf78070ce0 msgr2=0x7fcf78105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:01:03.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.945+0000 7fcf7f955640 1 -- 172.21.15.99:0/3931763913 shutdown_connections 2024-09-19T07:01:03.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:03.945+0000 7fcf7f955640 1 -- 172.21.15.99:0/3931763913 wait complete. 2024-09-19T07:01:04.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.023+0000 7effa6d0b640 1 -- 172.21.15.99:0/3451073694 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7effa0102620 msgr2=0x7effa01029f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:04.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.023+0000 7effa6d0b640 1 --2- 172.21.15.99:0/3451073694 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7effa0102620 0x7effa01029f0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7eff940048d0 tx=0x7eff94009da0 comp rx=0 tx=0).stop 2024-09-19T07:01:04.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.023+0000 7effa6d0b640 1 -- 172.21.15.99:0/3451073694 shutdown_connections 2024-09-19T07:01:04.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.023+0000 7effa6d0b640 1 --2- 172.21.15.99:0/3451073694 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effa00fac80 0x7effa00fb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:04.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.023+0000 7effa6d0b640 1 --2- 172.21.15.99:0/3451073694 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7effa0102620 0x7effa01029f0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:04.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.023+0000 7effa6d0b640 1 -- 172.21.15.99:0/3451073694 >> 172.21.15.99:0/3451073694 conn(0x7effa0070ce0 msgr2=0x7effa00710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:01:04.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.023+0000 7effa6d0b640 1 -- 172.21.15.99:0/3451073694 shutdown_connections 2024-09-19T07:01:04.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.023+0000 7effa6d0b640 1 -- 172.21.15.99:0/3451073694 wait complete. 2024-09-19T07:01:04.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.023+0000 7effa6d0b640 1 Processor -- start 2024-09-19T07:01:04.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.023+0000 7effa6d0b640 1 -- start start 2024-09-19T07:01:04.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.024+0000 7effa6d0b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effa00fac80 0x7effa01131f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:01:04.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.024+0000 7effa6d0b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7effa0102620 0x7effa0113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:01:04.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.024+0000 7effa6d0b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa0113dc0 con 0x7effa0102620 2024-09-19T07:01:04.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.024+0000 7effa6d0b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa010d170 con 0x7effa00fac80 2024-09-19T07:01:04.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.024+0000 7eff9ffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7effa0102620 0x7effa0113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:01:04.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.024+0000 7eff9ffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7effa0102620 0x7effa0113730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42500/0 (socket says 172.21.15.99:42500) 2024-09-19T07:01:04.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.024+0000 7eff9ffff640 1 -- 172.21.15.99:0/2495408138 learned_addr learned my addr 172.21.15.99:0/2495408138 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:01:04.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.024+0000 7effa4aa7640 1 --2- 172.21.15.99:0/2495408138 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effa00fac80 0x7effa01131f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:01:04.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.024+0000 7eff9ffff640 1 -- 172.21.15.99:0/2495408138 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effa00fac80 msgr2=0x7effa01131f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:04.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.024+0000 7eff9ffff640 1 --2- 172.21.15.99:0/2495408138 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effa00fac80 0x7effa01131f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:04.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.024+0000 7eff9ffff640 1 -- 172.21.15.99:0/2495408138 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff94005040 con 0x7effa0102620 2024-09-19T07:01:04.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.024+0000 7eff9ffff640 1 --2- 172.21.15.99:0/2495408138 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7effa0102620 0x7effa0113730 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7eff8c00b790 tx=0x7eff8c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:01:04.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.025+0000 7eff9d7fa640 1 -- 172.21.15.99:0/2495408138 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff8c00c700 con 0x7effa0102620 2024-09-19T07:01:04.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.025+0000 7eff9d7fa640 1 -- 172.21.15.99:0/2495408138 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7eff8c00cd00 con 0x7effa0102620 2024-09-19T07:01:04.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.025+0000 7effa6d0b640 1 -- 172.21.15.99:0/2495408138 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effa010d450 con 0x7effa0102620 2024-09-19T07:01:04.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.025+0000 7eff9d7fa640 1 -- 172.21.15.99:0/2495408138 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff8c015e70 con 0x7effa0102620 2024-09-19T07:01:04.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.025+0000 7effa6d0b640 1 -- 172.21.15.99:0/2495408138 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effa010d970 con 0x7effa0102620 2024-09-19T07:01:04.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.026+0000 7effa6d0b640 1 -- 172.21.15.99:0/2495408138 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effa00657b0 con 0x7effa0102620 2024-09-19T07:01:04.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.026+0000 7eff9d7fa640 1 -- 172.21.15.99:0/2495408138 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7eff8c012070 con 0x7effa0102620 2024-09-19T07:01:04.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.027+0000 7eff9d7fa640 1 --2- 172.21.15.99:0/2495408138 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7eff9006e530 0x7eff900709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:01:04.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.027+0000 7effa4aa7640 1 --2- 172.21.15.99:0/2495408138 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7eff9006e530 0x7eff900709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:01:04.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.027+0000 7eff9d7fa640 1 -- 172.21.15.99:0/2495408138 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7eff8c08dd30 con 0x7effa0102620 2024-09-19T07:01:04.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.027+0000 7effa4aa7640 1 --2- 172.21.15.99:0/2495408138 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7eff9006e530 0x7eff900709e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7eff94004540 tx=0x7eff94009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:01:04.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.031+0000 7eff9d7fa640 1 -- 172.21.15.99:0/2495408138 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7eff8c056e20 con 0x7effa0102620 2024-09-19T07:01:04.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.249+0000 7effa6d0b640 1 -- 172.21.15.99:0/2495408138 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7effa0109650 con 0x7effa0102620 2024-09-19T07:01:04.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.249+0000 7eff9d7fa640 1 -- 172.21.15.99:0/2495408138 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 29 v29) v1 ==== 76+0+1915 (secure 0 0 0) 0x7eff8c05a4e0 con 0x7effa0102620 2024-09-19T07:01:04.251 INFO:teuthology.orchestra.run.smithi099.stdout:e29 2024-09-19T07:01:04.251 INFO:teuthology.orchestra.run.smithi099.stdout:btime 2024-09-19T06:48:47:938420+0000 2024-09-19T07:01:04.251 INFO:teuthology.orchestra.run.smithi099.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T07:01:04.251 INFO:teuthology.orchestra.run.smithi099.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T07:01:04.251 INFO:teuthology.orchestra.run.smithi099.stdout:legacy client fscid: 1 2024-09-19T07:01:04.251 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T07:01:04.251 INFO:teuthology.orchestra.run.smithi099.stdout:Filesystem 'cephfs' (1) 2024-09-19T07:01:04.251 INFO:teuthology.orchestra.run.smithi099.stdout:fs_name cephfs 2024-09-19T07:01:04.251 INFO:teuthology.orchestra.run.smithi099.stdout:epoch 20 2024-09-19T07:01:04.251 INFO:teuthology.orchestra.run.smithi099.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-19T07:01:04.251 INFO:teuthology.orchestra.run.smithi099.stdout:created 2024-09-19T06:37:40.838146+0000 2024-09-19T07:01:04.251 INFO:teuthology.orchestra.run.smithi099.stdout:modified 2024-09-19T06:47:50.076553+0000 2024-09-19T07:01:04.252 INFO:teuthology.orchestra.run.smithi099.stdout:tableserver 0 2024-09-19T07:01:04.252 INFO:teuthology.orchestra.run.smithi099.stdout:root 0 2024-09-19T07:01:04.252 INFO:teuthology.orchestra.run.smithi099.stdout:session_timeout 60 2024-09-19T07:01:04.252 INFO:teuthology.orchestra.run.smithi099.stdout:session_autoclose 300 2024-09-19T07:01:04.252 INFO:teuthology.orchestra.run.smithi099.stdout:max_file_size 1099511627776 2024-09-19T07:01:04.252 INFO:teuthology.orchestra.run.smithi099.stdout:max_xattr_size 65536 2024-09-19T07:01:04.252 INFO:teuthology.orchestra.run.smithi099.stdout:required_client_features {} 2024-09-19T07:01:04.252 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure 0 2024-09-19T07:01:04.252 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure_osd_epoch 77 2024-09-19T07:01:04.252 INFO:teuthology.orchestra.run.smithi099.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T07:01:04.252 INFO:teuthology.orchestra.run.smithi099.stdout:max_mds 2 2024-09-19T07:01:04.253 INFO:teuthology.orchestra.run.smithi099.stdout:in 0,1 2024-09-19T07:01:04.253 INFO:teuthology.orchestra.run.smithi099.stdout:up {} 2024-09-19T07:01:04.253 INFO:teuthology.orchestra.run.smithi099.stdout:failed 0,1 2024-09-19T07:01:04.253 INFO:teuthology.orchestra.run.smithi099.stdout:damaged 2024-09-19T07:01:04.253 INFO:teuthology.orchestra.run.smithi099.stdout:stopped 2024-09-19T07:01:04.253 INFO:teuthology.orchestra.run.smithi099.stdout:data_pools [3] 2024-09-19T07:01:04.253 INFO:teuthology.orchestra.run.smithi099.stdout:metadata_pool 2 2024-09-19T07:01:04.253 INFO:teuthology.orchestra.run.smithi099.stdout:inline_data disabled 2024-09-19T07:01:04.253 INFO:teuthology.orchestra.run.smithi099.stdout:balancer 2024-09-19T07:01:04.253 INFO:teuthology.orchestra.run.smithi099.stdout:bal_rank_mask -1 2024-09-19T07:01:04.253 INFO:teuthology.orchestra.run.smithi099.stdout:standby_count_wanted 1 2024-09-19T07:01:04.253 INFO:teuthology.orchestra.run.smithi099.stdout:qdb_cluster leader: 0 members: 2024-09-19T07:01:04.254 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T07:01:04.254 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T07:01:04.254 INFO:teuthology.orchestra.run.smithi099.stdout:Standby daemons: 2024-09-19T07:01:04.254 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T07:01:04.254 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.obarqf{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6826/1859154203,v1:172.21.15.99:6827/1859154203] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:01:04.254 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.xehbxe{-1:34410} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6828/1939453719,v1:172.21.15.99:6829/1939453719] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:01:04.254 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.nooexo{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6824/1398895079,v1:172.21.15.117:6825/1398895079] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:01:04.254 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.bheqzh{-1:44329} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6826/3233337308,v1:172.21.15.117:6827/3233337308] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:01:04.255 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 29 2024-09-19T07:01:04.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.251+0000 7effa6d0b640 1 -- 172.21.15.99:0/2495408138 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7eff9006e530 msgr2=0x7eff900709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:04.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.251+0000 7effa6d0b640 1 --2- 172.21.15.99:0/2495408138 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7eff9006e530 0x7eff900709e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7eff94004540 tx=0x7eff94009da0 comp rx=0 tx=0).stop 2024-09-19T07:01:04.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.251+0000 7effa6d0b640 1 -- 172.21.15.99:0/2495408138 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7effa0102620 msgr2=0x7effa0113730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:04.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.251+0000 7effa6d0b640 1 --2- 172.21.15.99:0/2495408138 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7effa0102620 0x7effa0113730 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7eff8c00b790 tx=0x7eff8c0091d0 comp rx=0 tx=0).stop 2024-09-19T07:01:04.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.251+0000 7effa6d0b640 1 -- 172.21.15.99:0/2495408138 shutdown_connections 2024-09-19T07:01:04.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.251+0000 7effa6d0b640 1 --2- 172.21.15.99:0/2495408138 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7eff9006e530 0x7eff900709e0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:04.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.251+0000 7effa6d0b640 1 --2- 172.21.15.99:0/2495408138 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7effa0102620 0x7effa0113730 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:04.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.251+0000 7effa6d0b640 1 --2- 172.21.15.99:0/2495408138 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7effa00fac80 0x7effa01131f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:04.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.251+0000 7effa6d0b640 1 -- 172.21.15.99:0/2495408138 >> 172.21.15.99:0/2495408138 conn(0x7effa0070ce0 msgr2=0x7effa0105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:01:04.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.251+0000 7effa6d0b640 1 -- 172.21.15.99:0/2495408138 shutdown_connections 2024-09-19T07:01:04.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.252+0000 7effa6d0b640 1 -- 172.21.15.99:0/2495408138 wait complete. 2024-09-19T07:01:04.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.333+0000 7f972f425640 1 -- 172.21.15.99:0/190720393 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9728065c10 msgr2=0x7f97280fe0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:04.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.333+0000 7f972f425640 1 --2- 172.21.15.99:0/190720393 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9728065c10 0x7f97280fe0d0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f97240048d0 tx=0x7f9724009da0 comp rx=0 tx=0).stop 2024-09-19T07:01:04.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.333+0000 7f972f425640 1 -- 172.21.15.99:0/190720393 shutdown_connections 2024-09-19T07:01:04.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.333+0000 7f972f425640 1 --2- 172.21.15.99:0/190720393 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9728065c10 0x7f97280fe0d0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:04.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.333+0000 7f972f425640 1 --2- 172.21.15.99:0/190720393 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9728065300 0x7f97280656d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:04.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.333+0000 7f972f425640 1 -- 172.21.15.99:0/190720393 >> 172.21.15.99:0/190720393 conn(0x7f97280723b0 msgr2=0x7f97280727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:01:04.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.333+0000 7f972f425640 1 -- 172.21.15.99:0/190720393 shutdown_connections 2024-09-19T07:01:04.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.333+0000 7f972f425640 1 -- 172.21.15.99:0/190720393 wait complete. 2024-09-19T07:01:04.335 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:01:04 smithi099 ceph-mon[97031]: pgmap v561: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:01:04.335 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:01:04 smithi099 ceph-mon[97031]: from='client.35062 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:01:04.335 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:01:04 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/3931763913' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T07:01:04.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.334+0000 7f972f425640 1 Processor -- start 2024-09-19T07:01:04.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.334+0000 7f972f425640 1 -- start start 2024-09-19T07:01:04.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.334+0000 7f972f425640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9728065300 0x7f97281131b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:01:04.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.334+0000 7f972f425640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9728065c10 0x7f97281136f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:01:04.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.334+0000 7f972f425640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9728113cf0 con 0x7f9728065c10 2024-09-19T07:01:04.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.334+0000 7f972f425640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f972810d130 con 0x7f9728065300 2024-09-19T07:01:04.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.334+0000 7f972c9c0640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9728065c10 0x7f97281136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:01:04.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.334+0000 7f972c9c0640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9728065c10 0x7f97281136f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42520/0 (socket says 172.21.15.99:42520) 2024-09-19T07:01:04.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.334+0000 7f972c9c0640 1 -- 172.21.15.99:0/218760050 learned_addr learned my addr 172.21.15.99:0/218760050 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:01:04.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.334+0000 7f972d1c1640 1 --2- 172.21.15.99:0/218760050 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9728065300 0x7f97281131b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:01:04.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.334+0000 7f972c9c0640 1 -- 172.21.15.99:0/218760050 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9728065300 msgr2=0x7f97281131b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:04.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.334+0000 7f972c9c0640 1 --2- 172.21.15.99:0/218760050 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9728065300 0x7f97281131b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:04.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.334+0000 7f972c9c0640 1 -- 172.21.15.99:0/218760050 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9724005040 con 0x7f9728065c10 2024-09-19T07:01:04.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.335+0000 7f972c9c0640 1 --2- 172.21.15.99:0/218760050 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9728065c10 0x7f97281136f0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f9724000c00 tx=0x7f9724009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:01:04.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.335+0000 7f971dffb640 1 -- 172.21.15.99:0/218760050 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9724038070 con 0x7f9728065c10 2024-09-19T07:01:04.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.335+0000 7f971dffb640 1 -- 172.21.15.99:0/218760050 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f972402ade0 con 0x7f9728065c10 2024-09-19T07:01:04.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.335+0000 7f972f425640 1 -- 172.21.15.99:0/218760050 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f972810d3b0 con 0x7f9728065c10 2024-09-19T07:01:04.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.335+0000 7f971dffb640 1 -- 172.21.15.99:0/218760050 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f972402c7e0 con 0x7f9728065c10 2024-09-19T07:01:04.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.335+0000 7f972f425640 1 -- 172.21.15.99:0/218760050 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f972810d8f0 con 0x7f9728065c10 2024-09-19T07:01:04.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.336+0000 7f972f425640 1 -- 172.21.15.99:0/218760050 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97280fdce0 con 0x7f9728065c10 2024-09-19T07:01:04.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.338+0000 7f971dffb640 1 -- 172.21.15.99:0/218760050 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f9724030020 con 0x7f9728065c10 2024-09-19T07:01:04.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.338+0000 7f971dffb640 1 --2- 172.21.15.99:0/218760050 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f971406e530 0x7f97140709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:01:04.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.338+0000 7f971dffb640 1 -- 172.21.15.99:0/218760050 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f97240add50 con 0x7f9728065c10 2024-09-19T07:01:04.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.338+0000 7f972d1c1640 1 --2- 172.21.15.99:0/218760050 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f971406e530 0x7f97140709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:01:04.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.339+0000 7f972d1c1640 1 --2- 172.21.15.99:0/218760050 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f971406e530 0x7f97140709e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9718004ed0 tx=0x7f971800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:01:04.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.343+0000 7f971dffb640 1 -- 172.21.15.99:0/218760050 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f9724076f70 con 0x7f9728065c10 2024-09-19T07:01:04.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.535+0000 7f972f425640 1 -- 172.21.15.99:0/218760050 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f972810e8b0 con 0x7f971406e530 2024-09-19T07:01:04.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.536+0000 7f971dffb640 1 -- 172.21.15.99:0/218760050 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f971800f040 con 0x7f971406e530 2024-09-19T07:01:04.537 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T07:01:04.537 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T07:01:04.537 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": true, 2024-09-19T07:01:04.537 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T07:01:04.537 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [ 2024-09-19T07:01:04.537 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr", 2024-09-19T07:01:04.538 INFO:teuthology.orchestra.run.smithi099.stdout: "crash", 2024-09-19T07:01:04.538 INFO:teuthology.orchestra.run.smithi099.stdout: "mds", 2024-09-19T07:01:04.538 INFO:teuthology.orchestra.run.smithi099.stdout: "mon", 2024-09-19T07:01:04.538 INFO:teuthology.orchestra.run.smithi099.stdout: "osd" 2024-09-19T07:01:04.538 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-19T07:01:04.538 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": "16/21 daemons upgraded", 2024-09-19T07:01:04.538 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "Currently upgrading mds daemons", 2024-09-19T07:01:04.538 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-09-19T07:01:04.538 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T07:01:04.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.538+0000 7f972f425640 1 -- 172.21.15.99:0/218760050 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f971406e530 msgr2=0x7f97140709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:04.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.538+0000 7f972f425640 1 --2- 172.21.15.99:0/218760050 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f971406e530 0x7f97140709e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9718004ed0 tx=0x7f971800b040 comp rx=0 tx=0).stop 2024-09-19T07:01:04.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.538+0000 7f972f425640 1 -- 172.21.15.99:0/218760050 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9728065c10 msgr2=0x7f97281136f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:04.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.538+0000 7f972f425640 1 --2- 172.21.15.99:0/218760050 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9728065c10 0x7f97281136f0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f9724000c00 tx=0x7f9724009da0 comp rx=0 tx=0).stop 2024-09-19T07:01:04.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.538+0000 7f972f425640 1 -- 172.21.15.99:0/218760050 shutdown_connections 2024-09-19T07:01:04.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.538+0000 7f972f425640 1 --2- 172.21.15.99:0/218760050 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f971406e530 0x7f97140709e0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:04.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.538+0000 7f972f425640 1 --2- 172.21.15.99:0/218760050 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9728065c10 0x7f97281136f0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:04.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.538+0000 7f972f425640 1 --2- 172.21.15.99:0/218760050 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9728065300 0x7f97281131b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:04.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.538+0000 7f972f425640 1 -- 172.21.15.99:0/218760050 >> 172.21.15.99:0/218760050 conn(0x7f97280723b0 msgr2=0x7f97280fa2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:01:04.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.538+0000 7f972f425640 1 -- 172.21.15.99:0/218760050 shutdown_connections 2024-09-19T07:01:04.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.538+0000 7f972f425640 1 -- 172.21.15.99:0/218760050 wait complete. 2024-09-19T07:01:04.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:01:04 smithi117 ceph-mon[76771]: pgmap v561: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:01:04.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:01:04 smithi117 ceph-mon[76771]: from='client.35062 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:01:04.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:01:04 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/3931763913' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T07:01:04.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.619+0000 7f150cd7e640 1 -- 172.21.15.99:0/3825132565 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1508102530 msgr2=0x7f1508102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:04.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.619+0000 7f150cd7e640 1 --2- 172.21.15.99:0/3825132565 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1508102530 0x7f1508102900 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f14f80048d0 tx=0x7f14f8009da0 comp rx=0 tx=0).stop 2024-09-19T07:01:04.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.620+0000 7f150cd7e640 1 -- 172.21.15.99:0/3825132565 shutdown_connections 2024-09-19T07:01:04.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.620+0000 7f150cd7e640 1 --2- 172.21.15.99:0/3825132565 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1508102ed0 0x7f15080fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:04.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.620+0000 7f150cd7e640 1 --2- 172.21.15.99:0/3825132565 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1508102530 0x7f1508102900 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:04.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.620+0000 7f150cd7e640 1 -- 172.21.15.99:0/3825132565 >> 172.21.15.99:0/3825132565 conn(0x7f15080f80f0 msgr2=0x7f15080fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:01:04.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.620+0000 7f150cd7e640 1 -- 172.21.15.99:0/3825132565 shutdown_connections 2024-09-19T07:01:04.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.620+0000 7f150cd7e640 1 -- 172.21.15.99:0/3825132565 wait complete. 2024-09-19T07:01:04.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.620+0000 7f150cd7e640 1 Processor -- start 2024-09-19T07:01:04.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.620+0000 7f150cd7e640 1 -- start start 2024-09-19T07:01:04.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.620+0000 7f150cd7e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1508102530 0x7f1508113240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:01:04.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.620+0000 7f150cd7e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1508102ed0 0x7f1508113780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:01:04.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.620+0000 7f150cd7e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1508113d80 con 0x7f1508102ed0 2024-09-19T07:01:04.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.620+0000 7f150cd7e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f150810d1c0 con 0x7f1508102530 2024-09-19T07:01:04.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.621+0000 7f1505d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1508102ed0 0x7f1508113780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:01:04.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.621+0000 7f1505d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1508102ed0 0x7f1508113780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42534/0 (socket says 172.21.15.99:42534) 2024-09-19T07:01:04.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.621+0000 7f1505d9b640 1 -- 172.21.15.99:0/318418166 learned_addr learned my addr 172.21.15.99:0/318418166 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:01:04.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.621+0000 7f150659c640 1 --2- 172.21.15.99:0/318418166 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1508102530 0x7f1508113240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:01:04.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.621+0000 7f1505d9b640 1 -- 172.21.15.99:0/318418166 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1508102530 msgr2=0x7f1508113240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:04.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.621+0000 7f1505d9b640 1 --2- 172.21.15.99:0/318418166 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1508102530 0x7f1508113240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:04.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.621+0000 7f1505d9b640 1 -- 172.21.15.99:0/318418166 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14f8005040 con 0x7f1508102ed0 2024-09-19T07:01:04.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.621+0000 7f150659c640 1 --2- 172.21.15.99:0/318418166 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1508102530 0x7f1508113240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:01:04.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.621+0000 7f1505d9b640 1 --2- 172.21.15.99:0/318418166 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1508102ed0 0x7f1508113780 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f14fc00c790 tx=0x7f14fc0043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:01:04.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.621+0000 7f14f6ffd640 1 -- 172.21.15.99:0/318418166 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14fc00a820 con 0x7f1508102ed0 2024-09-19T07:01:04.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.621+0000 7f150cd7e640 1 -- 172.21.15.99:0/318418166 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f150810d4a0 con 0x7f1508102ed0 2024-09-19T07:01:04.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.621+0000 7f150cd7e640 1 -- 172.21.15.99:0/318418166 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f150810da40 con 0x7f1508102ed0 2024-09-19T07:01:04.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.621+0000 7f14f6ffd640 1 -- 172.21.15.99:0/318418166 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f14fc00ae20 con 0x7f1508102ed0 2024-09-19T07:01:04.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.621+0000 7f14f6ffd640 1 -- 172.21.15.99:0/318418166 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14fc011380 con 0x7f1508102ed0 2024-09-19T07:01:04.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.622+0000 7f150cd7e640 1 -- 172.21.15.99:0/318418166 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15080fdcb0 con 0x7f1508102ed0 2024-09-19T07:01:04.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.623+0000 7f14f6ffd640 1 -- 172.21.15.99:0/318418166 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f14fc012420 con 0x7f1508102ed0 2024-09-19T07:01:04.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.624+0000 7f14f6ffd640 1 --2- 172.21.15.99:0/318418166 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f14f006e530 0x7f14f00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:01:04.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.624+0000 7f14f6ffd640 1 -- 172.21.15.99:0/318418166 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f14fc08e6c0 con 0x7f1508102ed0 2024-09-19T07:01:04.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.624+0000 7f150659c640 1 --2- 172.21.15.99:0/318418166 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f14f006e530 0x7f14f00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:01:04.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.625+0000 7f150659c640 1 --2- 172.21.15.99:0/318418166 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f14f006e530 0x7f14f00709e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f14f8007ac0 tx=0x7f14f8035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:01:04.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.628+0000 7f14f6ffd640 1 -- 172.21.15.99:0/318418166 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f14fc0577b0 con 0x7f1508102ed0 2024-09-19T07:01:04.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.863+0000 7f150cd7e640 1 -- 172.21.15.99:0/318418166 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f15081095a0 con 0x7f1508102ed0 2024-09-19T07:01:04.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.864+0000 7f14f6ffd640 1 -- 172.21.15.99:0/318418166 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7f14fc05ae70 con 0x7f1508102ed0 2024-09-19T07:01:04.865 INFO:teuthology.orchestra.run.smithi099.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-09-19T07:01:04.865 INFO:teuthology.orchestra.run.smithi099.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-19T07:01:04.865 INFO:teuthology.orchestra.run.smithi099.stdout: fs cephfs is degraded 2024-09-19T07:01:04.865 INFO:teuthology.orchestra.run.smithi099.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-19T07:01:04.865 INFO:teuthology.orchestra.run.smithi099.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-19T07:01:04.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.866+0000 7f150cd7e640 1 -- 172.21.15.99:0/318418166 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f14f006e530 msgr2=0x7f14f00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:04.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.866+0000 7f150cd7e640 1 --2- 172.21.15.99:0/318418166 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f14f006e530 0x7f14f00709e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f14f8007ac0 tx=0x7f14f8035040 comp rx=0 tx=0).stop 2024-09-19T07:01:04.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.866+0000 7f150cd7e640 1 -- 172.21.15.99:0/318418166 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1508102ed0 msgr2=0x7f1508113780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:04.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.866+0000 7f150cd7e640 1 --2- 172.21.15.99:0/318418166 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1508102ed0 0x7f1508113780 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f14fc00c790 tx=0x7f14fc0043c0 comp rx=0 tx=0).stop 2024-09-19T07:01:04.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.866+0000 7f150cd7e640 1 -- 172.21.15.99:0/318418166 shutdown_connections 2024-09-19T07:01:04.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.866+0000 7f150cd7e640 1 --2- 172.21.15.99:0/318418166 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f14f006e530 0x7f14f00709e0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:04.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.866+0000 7f150cd7e640 1 --2- 172.21.15.99:0/318418166 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1508102ed0 0x7f1508113780 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:04.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.866+0000 7f150cd7e640 1 --2- 172.21.15.99:0/318418166 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1508102530 0x7f1508113240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:04.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.866+0000 7f150cd7e640 1 -- 172.21.15.99:0/318418166 >> 172.21.15.99:0/318418166 conn(0x7f15080f80f0 msgr2=0x7f15080f90f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:01:04.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.866+0000 7f150cd7e640 1 -- 172.21.15.99:0/318418166 shutdown_connections 2024-09-19T07:01:04.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:04.866+0000 7f150cd7e640 1 -- 172.21.15.99:0/318418166 wait complete. 2024-09-19T07:01:05.386 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:01:05 smithi099 ceph-mon[97031]: from='client.35066 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:01:05.387 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:01:05 smithi099 ceph-mon[97031]: from='client.35070 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:01:05.387 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:01:05 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/2495408138' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T07:01:05.387 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:01:05 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/318418166' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T07:01:05.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:01:05 smithi117 ceph-mon[76771]: from='client.35066 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:01:05.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:01:05 smithi117 ceph-mon[76771]: from='client.35070 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:01:05.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:01:05 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/2495408138' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T07:01:05.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:01:05 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/318418166' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T07:01:06.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:01:06 smithi099 ceph-mon[97031]: from='client.35082 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:01:06.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:01:06 smithi099 ceph-mon[97031]: pgmap v562: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:01:06.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:01:06 smithi117 ceph-mon[76771]: from='client.35082 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:01:06.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:01:06 smithi117 ceph-mon[76771]: pgmap v562: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:01:07.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:01:07 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:01:07.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:01:07 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:01:08.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:01:08 smithi099 ceph-mon[97031]: pgmap v563: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:01:08.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:01:08 smithi117 ceph-mon[76771]: pgmap v563: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:01:10.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:01:10 smithi099 ceph-mon[97031]: pgmap v564: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:01:10.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:01:10 smithi117 ceph-mon[76771]: pgmap v564: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:01:12.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:01:12 smithi099 ceph-mon[97031]: pgmap v565: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:01:12.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:01:12 smithi117 ceph-mon[76771]: pgmap v565: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:01:14.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:01:14 smithi099 ceph-mon[97031]: pgmap v566: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:01:14.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:01:14 smithi117 ceph-mon[76771]: pgmap v566: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:01:16.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:01:16 smithi099 ceph-mon[97031]: pgmap v567: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:01:16.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:01:16 smithi117 ceph-mon[76771]: pgmap v567: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:01:18.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:01:18 smithi099 ceph-mon[97031]: pgmap v568: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:01:18.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:01:18 smithi117 ceph-mon[76771]: pgmap v568: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:01:20.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:01:20 smithi099 ceph-mon[97031]: pgmap v569: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:01:20.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:01:20 smithi117 ceph-mon[76771]: pgmap v569: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:01:21.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:01:21 smithi099 ceph-mon[97031]: pgmap v570: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:01:21.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:01:21 smithi117 ceph-mon[76771]: pgmap v570: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:01:22.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:01:22 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:01:22.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:01:22 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:01:23.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:01:23 smithi099 ceph-mon[97031]: pgmap v571: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:01:23.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:01:23 smithi117 ceph-mon[76771]: pgmap v571: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:01:26.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:01:26 smithi099 ceph-mon[97031]: pgmap v572: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:01:26.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:01:26 smithi117 ceph-mon[76771]: pgmap v572: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:01:28.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:01:28 smithi099 ceph-mon[97031]: pgmap v573: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:01:28.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:01:28 smithi117 ceph-mon[76771]: pgmap v573: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:01:30.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:01:30 smithi099 ceph-mon[97031]: pgmap v574: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:01:30.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:01:30 smithi117 ceph-mon[76771]: pgmap v574: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:01:32.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:01:32 smithi099 ceph-mon[97031]: pgmap v575: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:01:32.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:01:32 smithi117 ceph-mon[76771]: pgmap v575: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:01:34.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:01:34 smithi099 ceph-mon[97031]: pgmap v576: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:01:34.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:01:34 smithi117 ceph-mon[76771]: pgmap v576: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:01:34.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:34.955+0000 7fbffcef2640 1 -- 172.21.15.99:0/2538464690 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbff80fabe0 msgr2=0x7fbff80fb050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:34.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:34.956+0000 7fbffcef2640 1 --2- 172.21.15.99:0/2538464690 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbff80fabe0 0x7fbff80fb050 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fbfe00048d0 tx=0x7fbfe0009da0 comp rx=0 tx=0).stop 2024-09-19T07:01:34.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:34.956+0000 7fbffcef2640 1 -- 172.21.15.99:0/2538464690 shutdown_connections 2024-09-19T07:01:34.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:34.956+0000 7fbffcef2640 1 --2- 172.21.15.99:0/2538464690 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbff80fabe0 0x7fbff80fb050 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:34.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:34.956+0000 7fbffcef2640 1 --2- 172.21.15.99:0/2538464690 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbff80fe4a0 0x7fbff80fe870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:34.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:34.956+0000 7fbffcef2640 1 -- 172.21.15.99:0/2538464690 >> 172.21.15.99:0/2538464690 conn(0x7fbff8071b00 msgr2=0x7fbff8071f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:01:34.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:34.956+0000 7fbffcef2640 1 -- 172.21.15.99:0/2538464690 shutdown_connections 2024-09-19T07:01:34.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:34.956+0000 7fbffcef2640 1 -- 172.21.15.99:0/2538464690 wait complete. 2024-09-19T07:01:34.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:34.956+0000 7fbffcef2640 1 Processor -- start 2024-09-19T07:01:34.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:34.956+0000 7fbffcef2640 1 -- start start 2024-09-19T07:01:34.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:34.957+0000 7fbffcef2640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbff80fabe0 0x7fbff8113210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:01:34.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:34.957+0000 7fbffcef2640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbff80fe4a0 0x7fbff8113750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:01:34.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:34.957+0000 7fbffcef2640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff8113d50 con 0x7fbff80fabe0 2024-09-19T07:01:34.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:34.957+0000 7fbffcef2640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff810d190 con 0x7fbff80fe4a0 2024-09-19T07:01:34.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:34.957+0000 7fbff659c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbff80fabe0 0x7fbff8113210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:01:34.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:34.957+0000 7fbff659c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbff80fabe0 0x7fbff8113210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33872/0 (socket says 172.21.15.99:33872) 2024-09-19T07:01:34.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:34.957+0000 7fbff659c640 1 -- 172.21.15.99:0/1687411453 learned_addr learned my addr 172.21.15.99:0/1687411453 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:01:34.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:34.957+0000 7fbfedd9b640 1 --2- 172.21.15.99:0/1687411453 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbff80fe4a0 0x7fbff8113750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:01:34.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:34.957+0000 7fbff659c640 1 -- 172.21.15.99:0/1687411453 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbff80fe4a0 msgr2=0x7fbff8113750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:34.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:34.957+0000 7fbff659c640 1 --2- 172.21.15.99:0/1687411453 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbff80fe4a0 0x7fbff8113750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:34.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:34.957+0000 7fbff659c640 1 -- 172.21.15.99:0/1687411453 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe0005040 con 0x7fbff80fabe0 2024-09-19T07:01:34.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:34.957+0000 7fbff659c640 1 --2- 172.21.15.99:0/1687411453 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbff80fabe0 0x7fbff8113210 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fbfe8002a50 tx=0x7fbfe8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:01:34.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:34.958+0000 7fbfef7fe640 1 -- 172.21.15.99:0/1687411453 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbfe8007c30 con 0x7fbff80fabe0 2024-09-19T07:01:34.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:34.958+0000 7fbfef7fe640 1 -- 172.21.15.99:0/1687411453 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fbfe800f040 con 0x7fbff80fabe0 2024-09-19T07:01:34.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:34.958+0000 7fbffcef2640 1 -- 172.21.15.99:0/1687411453 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbff810d470 con 0x7fbff80fabe0 2024-09-19T07:01:34.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:34.958+0000 7fbfef7fe640 1 -- 172.21.15.99:0/1687411453 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbfe800da10 con 0x7fbff80fabe0 2024-09-19T07:01:34.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:34.958+0000 7fbffcef2640 1 -- 172.21.15.99:0/1687411453 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbff810d9e0 con 0x7fbff80fabe0 2024-09-19T07:01:34.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:34.959+0000 7fbffcef2640 1 -- 172.21.15.99:0/1687411453 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbff8064d50 con 0x7fbff80fabe0 2024-09-19T07:01:34.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:34.959+0000 7fbfef7fe640 1 -- 172.21.15.99:0/1687411453 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fbfe800dc80 con 0x7fbff80fabe0 2024-09-19T07:01:34.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:34.960+0000 7fbfef7fe640 1 --2- 172.21.15.99:0/1687411453 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fbfe406e530 0x7fbfe40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:01:34.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:34.960+0000 7fbfef7fe640 1 -- 172.21.15.99:0/1687411453 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fbfe808d930 con 0x7fbff80fabe0 2024-09-19T07:01:34.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:34.960+0000 7fbfedd9b640 1 --2- 172.21.15.99:0/1687411453 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fbfe406e530 0x7fbfe40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:01:34.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:34.960+0000 7fbfedd9b640 1 --2- 172.21.15.99:0/1687411453 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fbfe406e530 0x7fbfe40709e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fbfe0009ac0 tx=0x7fbfe0035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:01:34.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:34.964+0000 7fbfef7fe640 1 -- 172.21.15.99:0/1687411453 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fbfe8056ad0 con 0x7fbff80fabe0 2024-09-19T07:01:35.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.146+0000 7fbffcef2640 1 -- 172.21.15.99:0/1687411453 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbff804b780 con 0x7fbfe406e530 2024-09-19T07:01:35.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.148+0000 7fbfef7fe640 1 -- 172.21.15.99:0/1687411453 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fbff804b780 con 0x7fbfe406e530 2024-09-19T07:01:35.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.150+0000 7fbffcef2640 1 -- 172.21.15.99:0/1687411453 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fbfe406e530 msgr2=0x7fbfe40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:35.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.150+0000 7fbffcef2640 1 --2- 172.21.15.99:0/1687411453 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fbfe406e530 0x7fbfe40709e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fbfe0009ac0 tx=0x7fbfe0035040 comp rx=0 tx=0).stop 2024-09-19T07:01:35.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.150+0000 7fbffcef2640 1 -- 172.21.15.99:0/1687411453 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbff80fabe0 msgr2=0x7fbff8113210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:35.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.150+0000 7fbffcef2640 1 --2- 172.21.15.99:0/1687411453 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbff80fabe0 0x7fbff8113210 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fbfe8002a50 tx=0x7fbfe8004600 comp rx=0 tx=0).stop 2024-09-19T07:01:35.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.150+0000 7fbffcef2640 1 -- 172.21.15.99:0/1687411453 shutdown_connections 2024-09-19T07:01:35.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.150+0000 7fbffcef2640 1 --2- 172.21.15.99:0/1687411453 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fbfe406e530 0x7fbfe40709e0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:35.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.150+0000 7fbffcef2640 1 --2- 172.21.15.99:0/1687411453 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbff80fe4a0 0x7fbff8113750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:35.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.150+0000 7fbffcef2640 1 --2- 172.21.15.99:0/1687411453 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbff80fabe0 0x7fbff8113210 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:35.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.150+0000 7fbffcef2640 1 -- 172.21.15.99:0/1687411453 >> 172.21.15.99:0/1687411453 conn(0x7fbff8071b00 msgr2=0x7fbff8101200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:01:35.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.150+0000 7fbffcef2640 1 -- 172.21.15.99:0/1687411453 shutdown_connections 2024-09-19T07:01:35.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.150+0000 7fbffcef2640 1 -- 172.21.15.99:0/1687411453 wait complete. 2024-09-19T07:01:35.160 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-09-19T07:01:35.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.230+0000 7f16d9ba9640 1 -- 172.21.15.99:0/2719455214 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f16d40fb4a0 msgr2=0x7f16d40fb910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:35.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.230+0000 7f16d9ba9640 1 --2- 172.21.15.99:0/2719455214 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f16d40fb4a0 0x7f16d40fb910 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f16c80048d0 tx=0x7f16c8009da0 comp rx=0 tx=0).stop 2024-09-19T07:01:35.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.230+0000 7f16d9ba9640 1 -- 172.21.15.99:0/2719455214 shutdown_connections 2024-09-19T07:01:35.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.230+0000 7f16d9ba9640 1 --2- 172.21.15.99:0/2719455214 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f16d40fb4a0 0x7f16d40fb910 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:35.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.230+0000 7f16d9ba9640 1 --2- 172.21.15.99:0/2719455214 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16d41014e0 0x7f16d41018b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:35.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.230+0000 7f16d9ba9640 1 -- 172.21.15.99:0/2719455214 >> 172.21.15.99:0/2719455214 conn(0x7f16d40f7020 msgr2=0x7f16d40f9430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:01:35.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.230+0000 7f16d9ba9640 1 -- 172.21.15.99:0/2719455214 shutdown_connections 2024-09-19T07:01:35.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.230+0000 7f16d9ba9640 1 -- 172.21.15.99:0/2719455214 wait complete. 2024-09-19T07:01:35.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.231+0000 7f16d9ba9640 1 Processor -- start 2024-09-19T07:01:35.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.231+0000 7f16d9ba9640 1 -- start start 2024-09-19T07:01:35.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.231+0000 7f16d9ba9640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16d40fb4a0 0x7f16d410e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:01:35.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.231+0000 7f16d9ba9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f16d41014e0 0x7f16d410e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:01:35.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.231+0000 7f16d9ba9640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16d410ec90 con 0x7f16d41014e0 2024-09-19T07:01:35.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.231+0000 7f16d9ba9640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16d410ee00 con 0x7f16d40fb4a0 2024-09-19T07:01:35.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.232+0000 7f16d2ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f16d41014e0 0x7f16d410e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:01:35.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.232+0000 7f16d2ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f16d41014e0 0x7f16d410e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:33888/0 (socket says 172.21.15.99:33888) 2024-09-19T07:01:35.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.232+0000 7f16d2ffd640 1 -- 172.21.15.99:0/65708164 learned_addr learned my addr 172.21.15.99:0/65708164 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:01:35.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.232+0000 7f16d37fe640 1 --2- 172.21.15.99:0/65708164 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16d40fb4a0 0x7f16d410e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:01:35.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.232+0000 7f16d2ffd640 1 -- 172.21.15.99:0/65708164 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16d40fb4a0 msgr2=0x7f16d410e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:35.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.232+0000 7f16d2ffd640 1 --2- 172.21.15.99:0/65708164 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16d40fb4a0 0x7f16d410e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:35.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.232+0000 7f16d2ffd640 1 -- 172.21.15.99:0/65708164 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c8005040 con 0x7f16d41014e0 2024-09-19T07:01:35.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.232+0000 7f16d2ffd640 1 --2- 172.21.15.99:0/65708164 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f16d41014e0 0x7f16d410e690 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f16c8000c00 tx=0x7f16c8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:01:35.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.232+0000 7f16bbfff640 1 -- 172.21.15.99:0/65708164 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16c8038070 con 0x7f16d41014e0 2024-09-19T07:01:35.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.232+0000 7f16bbfff640 1 -- 172.21.15.99:0/65708164 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f16c802ade0 con 0x7f16d41014e0 2024-09-19T07:01:35.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.232+0000 7f16d9ba9640 1 -- 172.21.15.99:0/65708164 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16d41171c0 con 0x7f16d41014e0 2024-09-19T07:01:35.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.232+0000 7f16bbfff640 1 -- 172.21.15.99:0/65708164 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16c802c7b0 con 0x7f16d41014e0 2024-09-19T07:01:35.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.232+0000 7f16d9ba9640 1 -- 172.21.15.99:0/65708164 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16d4117620 con 0x7f16d41014e0 2024-09-19T07:01:35.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.233+0000 7f16d9ba9640 1 -- 172.21.15.99:0/65708164 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16d40fcbe0 con 0x7f16d41014e0 2024-09-19T07:01:35.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.234+0000 7f16bbfff640 1 -- 172.21.15.99:0/65708164 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f16c8030020 con 0x7f16d41014e0 2024-09-19T07:01:35.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.234+0000 7f16bbfff640 1 --2- 172.21.15.99:0/65708164 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f16bc06e530 0x7f16bc0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:01:35.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.235+0000 7f16bbfff640 1 -- 172.21.15.99:0/65708164 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f16c80ae4d0 con 0x7f16d41014e0 2024-09-19T07:01:35.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.235+0000 7f16d37fe640 1 --2- 172.21.15.99:0/65708164 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f16bc06e530 0x7f16bc0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:01:35.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.235+0000 7f16d37fe640 1 --2- 172.21.15.99:0/65708164 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f16bc06e530 0x7f16bc0709e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f16c4009af0 tx=0x7f16c400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:01:35.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.239+0000 7f16bbfff640 1 -- 172.21.15.99:0/65708164 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f16c8077640 con 0x7f16d41014e0 2024-09-19T07:01:35.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.420+0000 7f16d9ba9640 1 -- 172.21.15.99:0/65708164 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f16d404b720 con 0x7f16bc06e530 2024-09-19T07:01:35.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.421+0000 7f16bbfff640 1 -- 172.21.15.99:0/65708164 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f16d404b720 con 0x7f16bc06e530 2024-09-19T07:01:35.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.423+0000 7f16d9ba9640 1 -- 172.21.15.99:0/65708164 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f16bc06e530 msgr2=0x7f16bc0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:35.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.423+0000 7f16d9ba9640 1 --2- 172.21.15.99:0/65708164 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f16bc06e530 0x7f16bc0709e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f16c4009af0 tx=0x7f16c400b040 comp rx=0 tx=0).stop 2024-09-19T07:01:35.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.423+0000 7f16d9ba9640 1 -- 172.21.15.99:0/65708164 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f16d41014e0 msgr2=0x7f16d410e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:35.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.423+0000 7f16d9ba9640 1 --2- 172.21.15.99:0/65708164 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f16d41014e0 0x7f16d410e690 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f16c8000c00 tx=0x7f16c8009da0 comp rx=0 tx=0).stop 2024-09-19T07:01:35.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.423+0000 7f16d9ba9640 1 -- 172.21.15.99:0/65708164 shutdown_connections 2024-09-19T07:01:35.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.423+0000 7f16d9ba9640 1 --2- 172.21.15.99:0/65708164 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f16bc06e530 0x7f16bc0709e0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:35.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.423+0000 7f16d9ba9640 1 --2- 172.21.15.99:0/65708164 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f16d41014e0 0x7f16d410e690 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:35.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.423+0000 7f16d9ba9640 1 --2- 172.21.15.99:0/65708164 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16d40fb4a0 0x7f16d410e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:35.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.423+0000 7f16d9ba9640 1 -- 172.21.15.99:0/65708164 >> 172.21.15.99:0/65708164 conn(0x7f16d40f7020 msgr2=0x7f16d40f8920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:01:35.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.423+0000 7f16d9ba9640 1 -- 172.21.15.99:0/65708164 shutdown_connections 2024-09-19T07:01:35.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.423+0000 7f16d9ba9640 1 -- 172.21.15.99:0/65708164 wait complete. 2024-09-19T07:01:35.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.501+0000 7f989e679640 1 -- 172.21.15.99:0/2314606685 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98980fb480 msgr2=0x7f98980fb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:35.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.501+0000 7f989e679640 1 --2- 172.21.15.99:0/2314606685 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98980fb480 0x7f98980fb8f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f988c0048d0 tx=0x7f988c009da0 comp rx=0 tx=0).stop 2024-09-19T07:01:35.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.501+0000 7f989e679640 1 -- 172.21.15.99:0/2314606685 shutdown_connections 2024-09-19T07:01:35.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.501+0000 7f989e679640 1 --2- 172.21.15.99:0/2314606685 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98980fb480 0x7f98980fb8f0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:35.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.501+0000 7f989e679640 1 --2- 172.21.15.99:0/2314606685 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98981014c0 0x7f9898101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:35.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.501+0000 7f989e679640 1 -- 172.21.15.99:0/2314606685 >> 172.21.15.99:0/2314606685 conn(0x7f98980f7000 msgr2=0x7f98980f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:01:35.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.501+0000 7f989e679640 1 -- 172.21.15.99:0/2314606685 shutdown_connections 2024-09-19T07:01:35.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.501+0000 7f989e679640 1 -- 172.21.15.99:0/2314606685 wait complete. 2024-09-19T07:01:35.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.502+0000 7f989e679640 1 Processor -- start 2024-09-19T07:01:35.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.502+0000 7f989e679640 1 -- start start 2024-09-19T07:01:35.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.503+0000 7f989e679640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98980fb480 0x7f98981120d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:01:35.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.503+0000 7f989e679640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98981014c0 0x7f9898112610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:01:35.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.503+0000 7f989e679640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9898112c10 con 0x7f98981014c0 2024-09-19T07:01:35.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.503+0000 7f989e679640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f989810c050 con 0x7f98980fb480 2024-09-19T07:01:35.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.503+0000 7f98977fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98981014c0 0x7f9898112610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:01:35.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.503+0000 7f98977fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98981014c0 0x7f9898112610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46988/0 (socket says 172.21.15.99:46988) 2024-09-19T07:01:35.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.503+0000 7f98977fe640 1 -- 172.21.15.99:0/3618435916 learned_addr learned my addr 172.21.15.99:0/3618435916 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:01:35.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.503+0000 7f9897fff640 1 --2- 172.21.15.99:0/3618435916 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98980fb480 0x7f98981120d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:01:35.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.503+0000 7f98977fe640 1 -- 172.21.15.99:0/3618435916 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98980fb480 msgr2=0x7f98981120d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:35.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.503+0000 7f98977fe640 1 --2- 172.21.15.99:0/3618435916 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98980fb480 0x7f98981120d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:35.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.503+0000 7f98977fe640 1 -- 172.21.15.99:0/3618435916 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f988c005040 con 0x7f98981014c0 2024-09-19T07:01:35.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.503+0000 7f9897fff640 1 --2- 172.21.15.99:0/3618435916 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98980fb480 0x7f98981120d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:01:35.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.503+0000 7f98977fe640 1 --2- 172.21.15.99:0/3618435916 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98981014c0 0x7f9898112610 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f988c0043d0 tx=0x7f988c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:01:35.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.503+0000 7f9894ff9640 1 -- 172.21.15.99:0/3618435916 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f988c038070 con 0x7f98981014c0 2024-09-19T07:01:35.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.504+0000 7f9894ff9640 1 -- 172.21.15.99:0/3618435916 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f988c0096e0 con 0x7f98981014c0 2024-09-19T07:01:35.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.504+0000 7f9894ff9640 1 -- 172.21.15.99:0/3618435916 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f988c03d420 con 0x7f98981014c0 2024-09-19T07:01:35.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.504+0000 7f989e679640 1 -- 172.21.15.99:0/3618435916 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f989810c2d0 con 0x7f98981014c0 2024-09-19T07:01:35.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.504+0000 7f989e679640 1 -- 172.21.15.99:0/3618435916 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f989810c870 con 0x7f98981014c0 2024-09-19T07:01:35.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.505+0000 7f989e679640 1 -- 172.21.15.99:0/3618435916 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98980fcbc0 con 0x7f98981014c0 2024-09-19T07:01:35.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.505+0000 7f9894ff9640 1 -- 172.21.15.99:0/3618435916 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f988c030020 con 0x7f98981014c0 2024-09-19T07:01:35.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.505+0000 7f9894ff9640 1 --2- 172.21.15.99:0/3618435916 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f988006e530 0x7f98800709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:01:35.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.506+0000 7f9894ff9640 1 -- 172.21.15.99:0/3618435916 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f988c0ae5f0 con 0x7f98981014c0 2024-09-19T07:01:35.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.506+0000 7f9897fff640 1 --2- 172.21.15.99:0/3618435916 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f988006e530 0x7f98800709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:01:35.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.506+0000 7f9897fff640 1 --2- 172.21.15.99:0/3618435916 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f988006e530 0x7f98800709e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9888009fd0 tx=0x7f9888009e50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:01:35.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.510+0000 7f9894ff9640 1 -- 172.21.15.99:0/3618435916 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f988c077760 con 0x7f98981014c0 2024-09-19T07:01:35.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.682+0000 7f989e679640 1 -- 172.21.15.99:0/3618435916 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9898108440 con 0x7f988006e530 2024-09-19T07:01:35.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.691+0000 7f9894ff9640 1 -- 172.21.15.99:0/3618435916 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f9898108440 con 0x7f988006e530 2024-09-19T07:01:35.692 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T07:01:35.692 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.smithi099 smithi099 *:9093,9094 running (20m) 13m ago 28m 23.4M - 0.25.0 c8568f914cd2 e7c1774d56b0 2024-09-19T07:01:35.692 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi099 smithi099 running (17m) 13m ago 29m 6899k - 19.1.1-361-g2f599a46 d2baa855c067 b9775f416b10 2024-09-19T07:01:35.692 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi117 smithi117 running (17m) 12m ago 28m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 38cf60c0d548 2024-09-19T07:01:35.692 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.smithi099 smithi099 *:3000 running (19m) 13m ago 28m 80.7M - 9.4.12 2bacad6d85d8 cd53a18d5410 2024-09-19T07:01:35.692 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.obarqf smithi099 running (13m) 13m ago 23m 12.2M - 19.1.1-361-g2f599a46 d2baa855c067 314a73082521 2024-09-19T07:01:35.692 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.xehbxe smithi099 running (13m) 13m ago 23m 14.4M - 19.1.1-361-g2f599a46 d2baa855c067 a2955a9d06e6 2024-09-19T07:01:35.693 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.bheqzh smithi117 running (12m) 12m ago 23m 11.8M - 19.1.1-361-g2f599a46 d2baa855c067 b1505937c0b7 2024-09-19T07:01:35.693 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.nooexo smithi117 running (13m) 12m ago 23m 13.1M - 19.1.1-361-g2f599a46 d2baa855c067 35bd7725855c 2024-09-19T07:01:35.693 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi099.pgvkqi smithi099 *:8443,9283,8765 running (20m) 13m ago 30m 505M - 19.1.1-361-g2f599a46 d2baa855c067 d5de99cb7e78 2024-09-19T07:01:35.693 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi117.ssmkcf smithi117 *:8443,9283,8765 running (19m) 12m ago 28m 444M - 19.1.1-361-g2f599a46 d2baa855c067 8b7ee0f871f5 2024-09-19T07:01:35.693 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi099 smithi099 running (18m) 13m ago 30m 52.4M 2048M 19.1.1-361-g2f599a46 d2baa855c067 ffe067438824 2024-09-19T07:01:35.693 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi117 smithi117 running (17m) 12m ago 28m 38.9M 2048M 19.1.1-361-g2f599a46 d2baa855c067 4cb7455e3ee7 2024-09-19T07:01:35.693 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi099 smithi099 *:9100 running (20m) 13m ago 29m 15.0M - 1.5.0 0da6a335fe13 dca7b4517dcc 2024-09-19T07:01:35.693 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi117 smithi117 *:9100 running (20m) 12m ago 28m 15.9M - 1.5.0 0da6a335fe13 8233ce3835d2 2024-09-19T07:01:35.693 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (16m) 13m ago 27m 100M 1557M 19.1.1-361-g2f599a46 d2baa855c067 8e22543bf933 2024-09-19T07:01:35.693 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (16m) 13m ago 26m 106M 1557M 19.1.1-361-g2f599a46 d2baa855c067 f54153d0ae09 2024-09-19T07:01:35.694 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (15m) 13m ago 26m 83.7M 1557M 19.1.1-361-g2f599a46 d2baa855c067 b1778ab88870 2024-09-19T07:01:35.694 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi117 running (14m) 12m ago 26m 102M 2581M 19.1.1-361-g2f599a46 d2baa855c067 ea5236b193d3 2024-09-19T07:01:35.694 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi117 running (14m) 12m ago 25m 93.5M 2581M 19.1.1-361-g2f599a46 d2baa855c067 27ac2c859a68 2024-09-19T07:01:35.694 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi117 running (13m) 12m ago 25m 100M 2581M 19.1.1-361-g2f599a46 d2baa855c067 de6aeb8544ce 2024-09-19T07:01:35.694 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.smithi099 smithi099 *:9095 running (19m) 13m ago 28m 64.4M - 2.43.0 a07b618ecd1d 15ad26ec6fb4 2024-09-19T07:01:35.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.693+0000 7f989e679640 1 -- 172.21.15.99:0/3618435916 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f988006e530 msgr2=0x7f98800709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:35.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.693+0000 7f989e679640 1 --2- 172.21.15.99:0/3618435916 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f988006e530 0x7f98800709e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9888009fd0 tx=0x7f9888009e50 comp rx=0 tx=0).stop 2024-09-19T07:01:35.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.693+0000 7f989e679640 1 -- 172.21.15.99:0/3618435916 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98981014c0 msgr2=0x7f9898112610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:35.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.693+0000 7f989e679640 1 --2- 172.21.15.99:0/3618435916 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98981014c0 0x7f9898112610 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f988c0043d0 tx=0x7f988c009da0 comp rx=0 tx=0).stop 2024-09-19T07:01:35.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.693+0000 7f989e679640 1 -- 172.21.15.99:0/3618435916 shutdown_connections 2024-09-19T07:01:35.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.693+0000 7f989e679640 1 --2- 172.21.15.99:0/3618435916 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f988006e530 0x7f98800709e0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:35.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.693+0000 7f989e679640 1 --2- 172.21.15.99:0/3618435916 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f98981014c0 0x7f9898112610 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:35.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.693+0000 7f989e679640 1 --2- 172.21.15.99:0/3618435916 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98980fb480 0x7f98981120d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:35.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.693+0000 7f989e679640 1 -- 172.21.15.99:0/3618435916 >> 172.21.15.99:0/3618435916 conn(0x7f98980f7000 msgr2=0x7f98980f73d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:01:35.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.693+0000 7f989e679640 1 -- 172.21.15.99:0/3618435916 shutdown_connections 2024-09-19T07:01:35.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.693+0000 7f989e679640 1 -- 172.21.15.99:0/3618435916 wait complete. 2024-09-19T07:01:35.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.770+0000 7fd3143a5640 1 -- 172.21.15.99:0/2278592580 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd30c1014c0 msgr2=0x7fd30c101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:35.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.770+0000 7fd3143a5640 1 --2- 172.21.15.99:0/2278592580 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd30c1014c0 0x7fd30c101890 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fd3080048d0 tx=0x7fd308009da0 comp rx=0 tx=0).stop 2024-09-19T07:01:35.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.770+0000 7fd3143a5640 1 -- 172.21.15.99:0/2278592580 shutdown_connections 2024-09-19T07:01:35.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.770+0000 7fd3143a5640 1 --2- 172.21.15.99:0/2278592580 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd30c0fb480 0x7fd30c0fb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:35.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.770+0000 7fd3143a5640 1 --2- 172.21.15.99:0/2278592580 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd30c1014c0 0x7fd30c101890 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:35.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.770+0000 7fd3143a5640 1 -- 172.21.15.99:0/2278592580 >> 172.21.15.99:0/2278592580 conn(0x7fd30c0f7000 msgr2=0x7fd30c0f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:01:35.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.770+0000 7fd3143a5640 1 -- 172.21.15.99:0/2278592580 shutdown_connections 2024-09-19T07:01:35.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.771+0000 7fd3143a5640 1 -- 172.21.15.99:0/2278592580 wait complete. 2024-09-19T07:01:35.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.771+0000 7fd3143a5640 1 Processor -- start 2024-09-19T07:01:35.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.771+0000 7fd3143a5640 1 -- start start 2024-09-19T07:01:35.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.771+0000 7fd3143a5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd30c0fb480 0x7fd30c10e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:01:35.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.771+0000 7fd3143a5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd30c1014c0 0x7fd30c10e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:01:35.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.771+0000 7fd3143a5640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd30c10ed20 con 0x7fd30c1014c0 2024-09-19T07:01:35.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.771+0000 7fd3143a5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd30c10ee90 con 0x7fd30c0fb480 2024-09-19T07:01:35.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.771+0000 7fd311940640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd30c1014c0 0x7fd30c10e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:01:35.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.771+0000 7fd311940640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd30c1014c0 0x7fd30c10e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47004/0 (socket says 172.21.15.99:47004) 2024-09-19T07:01:35.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.771+0000 7fd311940640 1 -- 172.21.15.99:0/2779148631 learned_addr learned my addr 172.21.15.99:0/2779148631 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:01:35.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.772+0000 7fd312141640 1 --2- 172.21.15.99:0/2779148631 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd30c0fb480 0x7fd30c10e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:01:35.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.772+0000 7fd311940640 1 -- 172.21.15.99:0/2779148631 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd30c0fb480 msgr2=0x7fd30c10e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:35.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.772+0000 7fd311940640 1 --2- 172.21.15.99:0/2779148631 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd30c0fb480 0x7fd30c10e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:35.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.772+0000 7fd311940640 1 -- 172.21.15.99:0/2779148631 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd308005040 con 0x7fd30c1014c0 2024-09-19T07:01:35.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.772+0000 7fd311940640 1 --2- 172.21.15.99:0/2779148631 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd30c1014c0 0x7fd30c10e6d0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc002a50 tx=0x7fd2fc004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:01:35.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.772+0000 7fd302ffd640 1 -- 172.21.15.99:0/2779148631 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2fc007c30 con 0x7fd30c1014c0 2024-09-19T07:01:35.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.772+0000 7fd302ffd640 1 -- 172.21.15.99:0/2779148631 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd2fc00f040 con 0x7fd30c1014c0 2024-09-19T07:01:35.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.772+0000 7fd3143a5640 1 -- 172.21.15.99:0/2779148631 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd30c117200 con 0x7fd30c1014c0 2024-09-19T07:01:35.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.772+0000 7fd302ffd640 1 -- 172.21.15.99:0/2779148631 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2fc00da10 con 0x7fd30c1014c0 2024-09-19T07:01:35.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.772+0000 7fd3143a5640 1 -- 172.21.15.99:0/2779148631 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd30c117710 con 0x7fd30c1014c0 2024-09-19T07:01:35.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.773+0000 7fd3143a5640 1 -- 172.21.15.99:0/2779148631 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd30c0fcbc0 con 0x7fd30c1014c0 2024-09-19T07:01:35.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.774+0000 7fd302ffd640 1 -- 172.21.15.99:0/2779148631 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fd2fc00dbb0 con 0x7fd30c1014c0 2024-09-19T07:01:35.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.774+0000 7fd302ffd640 1 --2- 172.21.15.99:0/2779148631 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd2f806e530 0x7fd2f80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:01:35.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.775+0000 7fd302ffd640 1 -- 172.21.15.99:0/2779148631 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fd2fc08d870 con 0x7fd30c1014c0 2024-09-19T07:01:35.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.775+0000 7fd312141640 1 --2- 172.21.15.99:0/2779148631 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd2f806e530 0x7fd2f80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:01:35.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.775+0000 7fd312141640 1 --2- 172.21.15.99:0/2779148631 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd2f806e530 0x7fd2f80709e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd308009ac0 tx=0x7fd308035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:01:35.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:35.779+0000 7fd302ffd640 1 -- 172.21.15.99:0/2779148631 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fd2fc056a10 con 0x7fd30c1014c0 2024-09-19T07:01:36.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.009+0000 7fd3143a5640 1 -- 172.21.15.99:0/2779148631 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd30c1084f0 con 0x7fd30c1014c0 2024-09-19T07:01:36.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.010+0000 7fd302ffd640 1 -- 172.21.15.99:0/2779148631 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7fd2fc05a0d0 con 0x7fd30c1014c0 2024-09-19T07:01:36.011 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T07:01:36.011 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-09-19T07:01:36.011 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T07:01:36.011 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T07:01:36.012 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-09-19T07:01:36.012 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T07:01:36.012 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T07:01:36.012 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-09-19T07:01:36.012 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 6 2024-09-19T07:01:36.012 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T07:01:36.012 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": { 2024-09-19T07:01:36.012 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 4 2024-09-19T07:01:36.012 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T07:01:36.012 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-09-19T07:01:36.012 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 14 2024-09-19T07:01:36.012 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T07:01:36.012 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T07:01:36.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.012+0000 7fd3143a5640 1 -- 172.21.15.99:0/2779148631 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd2f806e530 msgr2=0x7fd2f80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:36.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.012+0000 7fd3143a5640 1 --2- 172.21.15.99:0/2779148631 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd2f806e530 0x7fd2f80709e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd308009ac0 tx=0x7fd308035040 comp rx=0 tx=0).stop 2024-09-19T07:01:36.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.012+0000 7fd3143a5640 1 -- 172.21.15.99:0/2779148631 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd30c1014c0 msgr2=0x7fd30c10e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:36.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.012+0000 7fd3143a5640 1 --2- 172.21.15.99:0/2779148631 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd30c1014c0 0x7fd30c10e6d0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc002a50 tx=0x7fd2fc004600 comp rx=0 tx=0).stop 2024-09-19T07:01:36.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.012+0000 7fd3143a5640 1 -- 172.21.15.99:0/2779148631 shutdown_connections 2024-09-19T07:01:36.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.012+0000 7fd3143a5640 1 --2- 172.21.15.99:0/2779148631 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd2f806e530 0x7fd2f80709e0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:36.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.012+0000 7fd3143a5640 1 --2- 172.21.15.99:0/2779148631 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd30c1014c0 0x7fd30c10e6d0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:36.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.012+0000 7fd3143a5640 1 --2- 172.21.15.99:0/2779148631 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd30c0fb480 0x7fd30c10e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:36.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.012+0000 7fd3143a5640 1 -- 172.21.15.99:0/2779148631 >> 172.21.15.99:0/2779148631 conn(0x7fd30c0f7000 msgr2=0x7fd30c0f88b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:01:36.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.012+0000 7fd3143a5640 1 -- 172.21.15.99:0/2779148631 shutdown_connections 2024-09-19T07:01:36.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.012+0000 7fd3143a5640 1 -- 172.21.15.99:0/2779148631 wait complete. 2024-09-19T07:01:36.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.090+0000 7fbc1cd7d640 1 -- 172.21.15.99:0/1281576916 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc181025f0 msgr2=0x7fbc181029c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:36.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.090+0000 7fbc1cd7d640 1 --2- 172.21.15.99:0/1281576916 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc181025f0 0x7fbc181029c0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fbc080048d0 tx=0x7fbc08009da0 comp rx=0 tx=0).stop 2024-09-19T07:01:36.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.090+0000 7fbc1cd7d640 1 -- 172.21.15.99:0/1281576916 shutdown_connections 2024-09-19T07:01:36.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.090+0000 7fbc1cd7d640 1 --2- 172.21.15.99:0/1281576916 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc180fac60 0x7fbc180fb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:36.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.090+0000 7fbc1cd7d640 1 --2- 172.21.15.99:0/1281576916 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc181025f0 0x7fbc181029c0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:36.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.090+0000 7fbc1cd7d640 1 -- 172.21.15.99:0/1281576916 >> 172.21.15.99:0/1281576916 conn(0x7fbc18070c80 msgr2=0x7fbc18071080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:01:36.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.090+0000 7fbc1cd7d640 1 -- 172.21.15.99:0/1281576916 shutdown_connections 2024-09-19T07:01:36.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.090+0000 7fbc1cd7d640 1 -- 172.21.15.99:0/1281576916 wait complete. 2024-09-19T07:01:36.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.091+0000 7fbc1cd7d640 1 Processor -- start 2024-09-19T07:01:36.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.091+0000 7fbc1cd7d640 1 -- start start 2024-09-19T07:01:36.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.091+0000 7fbc1cd7d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc180fac60 0x7fbc1810ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:01:36.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.091+0000 7fbc1cd7d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc181025f0 0x7fbc181104a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:01:36.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.091+0000 7fbc1cd7d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc18110af0 con 0x7fbc180fac60 2024-09-19T07:01:36.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.091+0000 7fbc1cd7d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc18115d90 con 0x7fbc181025f0 2024-09-19T07:01:36.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.091+0000 7fbc1659c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc180fac60 0x7fbc1810ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:01:36.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.091+0000 7fbc1659c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc180fac60 0x7fbc1810ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47030/0 (socket says 172.21.15.99:47030) 2024-09-19T07:01:36.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.091+0000 7fbc1659c640 1 -- 172.21.15.99:0/1667073762 learned_addr learned my addr 172.21.15.99:0/1667073762 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:01:36.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.091+0000 7fbc15d9b640 1 --2- 172.21.15.99:0/1667073762 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc181025f0 0x7fbc181104a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:01:36.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.091+0000 7fbc1659c640 1 -- 172.21.15.99:0/1667073762 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc181025f0 msgr2=0x7fbc181104a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:36.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.091+0000 7fbc1659c640 1 --2- 172.21.15.99:0/1667073762 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc181025f0 0x7fbc181104a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:36.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.092+0000 7fbc1659c640 1 -- 172.21.15.99:0/1667073762 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc08005040 con 0x7fbc180fac60 2024-09-19T07:01:36.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.092+0000 7fbc1659c640 1 --2- 172.21.15.99:0/1667073762 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc180fac60 0x7fbc1810ff40 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fbc08003080 tx=0x7fbc08009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:01:36.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.092+0000 7fbc06ffd640 1 -- 172.21.15.99:0/1667073762 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc08038070 con 0x7fbc180fac60 2024-09-19T07:01:36.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.092+0000 7fbc1cd7d640 1 -- 172.21.15.99:0/1667073762 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc18116010 con 0x7fbc180fac60 2024-09-19T07:01:36.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.092+0000 7fbc06ffd640 1 -- 172.21.15.99:0/1667073762 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fbc080097e0 con 0x7fbc180fac60 2024-09-19T07:01:36.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.092+0000 7fbc06ffd640 1 -- 172.21.15.99:0/1667073762 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc0803d420 con 0x7fbc180fac60 2024-09-19T07:01:36.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.092+0000 7fbc1cd7d640 1 -- 172.21.15.99:0/1667073762 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc181164d0 con 0x7fbc180fac60 2024-09-19T07:01:36.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.093+0000 7fbc1cd7d640 1 -- 172.21.15.99:0/1667073762 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc18065810 con 0x7fbc180fac60 2024-09-19T07:01:36.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.094+0000 7fbc06ffd640 1 -- 172.21.15.99:0/1667073762 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fbc08030020 con 0x7fbc180fac60 2024-09-19T07:01:36.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.094+0000 7fbc06ffd640 1 --2- 172.21.15.99:0/1667073762 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fbc0006e530 0x7fbc000709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:01:36.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.094+0000 7fbc06ffd640 1 -- 172.21.15.99:0/1667073762 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fbc080ae720 con 0x7fbc180fac60 2024-09-19T07:01:36.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.095+0000 7fbc15d9b640 1 --2- 172.21.15.99:0/1667073762 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fbc0006e530 0x7fbc000709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:01:36.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.095+0000 7fbc15d9b640 1 --2- 172.21.15.99:0/1667073762 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fbc0006e530 0x7fbc000709e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fbc1810c8a0 tx=0x7fbc0c009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:01:36.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.099+0000 7fbc06ffd640 1 -- 172.21.15.99:0/1667073762 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fbc08077810 con 0x7fbc180fac60 2024-09-19T07:01:36.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.303+0000 7fbc1cd7d640 1 -- 172.21.15.99:0/1667073762 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fbc1804b750 con 0x7fbc180fac60 2024-09-19T07:01:36.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.303+0000 7fbc06ffd640 1 -- 172.21.15.99:0/1667073762 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 29 v29) v1 ==== 76+0+1915 (secure 0 0 0) 0x7fbc0807aed0 con 0x7fbc180fac60 2024-09-19T07:01:36.305 INFO:teuthology.orchestra.run.smithi099.stdout:e29 2024-09-19T07:01:36.305 INFO:teuthology.orchestra.run.smithi099.stdout:btime 2024-09-19T06:48:47:938420+0000 2024-09-19T07:01:36.305 INFO:teuthology.orchestra.run.smithi099.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T07:01:36.305 INFO:teuthology.orchestra.run.smithi099.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T07:01:36.305 INFO:teuthology.orchestra.run.smithi099.stdout:legacy client fscid: 1 2024-09-19T07:01:36.305 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T07:01:36.305 INFO:teuthology.orchestra.run.smithi099.stdout:Filesystem 'cephfs' (1) 2024-09-19T07:01:36.305 INFO:teuthology.orchestra.run.smithi099.stdout:fs_name cephfs 2024-09-19T07:01:36.305 INFO:teuthology.orchestra.run.smithi099.stdout:epoch 20 2024-09-19T07:01:36.305 INFO:teuthology.orchestra.run.smithi099.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-19T07:01:36.305 INFO:teuthology.orchestra.run.smithi099.stdout:created 2024-09-19T06:37:40.838146+0000 2024-09-19T07:01:36.305 INFO:teuthology.orchestra.run.smithi099.stdout:modified 2024-09-19T06:47:50.076553+0000 2024-09-19T07:01:36.306 INFO:teuthology.orchestra.run.smithi099.stdout:tableserver 0 2024-09-19T07:01:36.306 INFO:teuthology.orchestra.run.smithi099.stdout:root 0 2024-09-19T07:01:36.306 INFO:teuthology.orchestra.run.smithi099.stdout:session_timeout 60 2024-09-19T07:01:36.306 INFO:teuthology.orchestra.run.smithi099.stdout:session_autoclose 300 2024-09-19T07:01:36.306 INFO:teuthology.orchestra.run.smithi099.stdout:max_file_size 1099511627776 2024-09-19T07:01:36.306 INFO:teuthology.orchestra.run.smithi099.stdout:max_xattr_size 65536 2024-09-19T07:01:36.306 INFO:teuthology.orchestra.run.smithi099.stdout:required_client_features {} 2024-09-19T07:01:36.306 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure 0 2024-09-19T07:01:36.306 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure_osd_epoch 77 2024-09-19T07:01:36.306 INFO:teuthology.orchestra.run.smithi099.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T07:01:36.306 INFO:teuthology.orchestra.run.smithi099.stdout:max_mds 2 2024-09-19T07:01:36.306 INFO:teuthology.orchestra.run.smithi099.stdout:in 0,1 2024-09-19T07:01:36.307 INFO:teuthology.orchestra.run.smithi099.stdout:up {} 2024-09-19T07:01:36.307 INFO:teuthology.orchestra.run.smithi099.stdout:failed 0,1 2024-09-19T07:01:36.307 INFO:teuthology.orchestra.run.smithi099.stdout:damaged 2024-09-19T07:01:36.307 INFO:teuthology.orchestra.run.smithi099.stdout:stopped 2024-09-19T07:01:36.307 INFO:teuthology.orchestra.run.smithi099.stdout:data_pools [3] 2024-09-19T07:01:36.307 INFO:teuthology.orchestra.run.smithi099.stdout:metadata_pool 2 2024-09-19T07:01:36.307 INFO:teuthology.orchestra.run.smithi099.stdout:inline_data disabled 2024-09-19T07:01:36.307 INFO:teuthology.orchestra.run.smithi099.stdout:balancer 2024-09-19T07:01:36.307 INFO:teuthology.orchestra.run.smithi099.stdout:bal_rank_mask -1 2024-09-19T07:01:36.307 INFO:teuthology.orchestra.run.smithi099.stdout:standby_count_wanted 1 2024-09-19T07:01:36.307 INFO:teuthology.orchestra.run.smithi099.stdout:qdb_cluster leader: 0 members: 2024-09-19T07:01:36.307 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T07:01:36.307 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T07:01:36.307 INFO:teuthology.orchestra.run.smithi099.stdout:Standby daemons: 2024-09-19T07:01:36.307 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T07:01:36.308 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.obarqf{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6826/1859154203,v1:172.21.15.99:6827/1859154203] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:01:36.308 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.xehbxe{-1:34410} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6828/1939453719,v1:172.21.15.99:6829/1939453719] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:01:36.308 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.nooexo{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6824/1398895079,v1:172.21.15.117:6825/1398895079] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:01:36.308 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.bheqzh{-1:44329} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6826/3233337308,v1:172.21.15.117:6827/3233337308] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:01:36.309 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 29 2024-09-19T07:01:36.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.305+0000 7fbc1cd7d640 1 -- 172.21.15.99:0/1667073762 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fbc0006e530 msgr2=0x7fbc000709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:36.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.305+0000 7fbc1cd7d640 1 --2- 172.21.15.99:0/1667073762 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fbc0006e530 0x7fbc000709e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fbc1810c8a0 tx=0x7fbc0c009040 comp rx=0 tx=0).stop 2024-09-19T07:01:36.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.305+0000 7fbc1cd7d640 1 -- 172.21.15.99:0/1667073762 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc180fac60 msgr2=0x7fbc1810ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:36.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.305+0000 7fbc1cd7d640 1 --2- 172.21.15.99:0/1667073762 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc180fac60 0x7fbc1810ff40 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fbc08003080 tx=0x7fbc08009da0 comp rx=0 tx=0).stop 2024-09-19T07:01:36.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.305+0000 7fbc1cd7d640 1 -- 172.21.15.99:0/1667073762 shutdown_connections 2024-09-19T07:01:36.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.305+0000 7fbc1cd7d640 1 --2- 172.21.15.99:0/1667073762 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fbc0006e530 0x7fbc000709e0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:36.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.305+0000 7fbc1cd7d640 1 --2- 172.21.15.99:0/1667073762 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc181025f0 0x7fbc181104a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:36.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.305+0000 7fbc1cd7d640 1 --2- 172.21.15.99:0/1667073762 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbc180fac60 0x7fbc1810ff40 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:36.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.305+0000 7fbc1cd7d640 1 -- 172.21.15.99:0/1667073762 >> 172.21.15.99:0/1667073762 conn(0x7fbc18070c80 msgr2=0x7fbc180fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:01:36.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.306+0000 7fbc1cd7d640 1 -- 172.21.15.99:0/1667073762 shutdown_connections 2024-09-19T07:01:36.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.306+0000 7fbc1cd7d640 1 -- 172.21.15.99:0/1667073762 wait complete. 2024-09-19T07:01:36.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.384+0000 7f35e3cef640 1 -- 172.21.15.99:0/386680002 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35dc102ef0 msgr2=0x7f35dc0fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:36.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.384+0000 7f35e3cef640 1 --2- 172.21.15.99:0/386680002 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35dc102ef0 0x7f35dc0fc5b0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f35cc0048d0 tx=0x7f35cc009da0 comp rx=0 tx=0).stop 2024-09-19T07:01:36.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.384+0000 7f35e3cef640 1 -- 172.21.15.99:0/386680002 shutdown_connections 2024-09-19T07:01:36.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.384+0000 7f35e3cef640 1 --2- 172.21.15.99:0/386680002 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35dc102ef0 0x7f35dc0fc5b0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:36.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.384+0000 7f35e3cef640 1 --2- 172.21.15.99:0/386680002 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35dc102550 0x7f35dc102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:36.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.384+0000 7f35e3cef640 1 -- 172.21.15.99:0/386680002 >> 172.21.15.99:0/386680002 conn(0x7f35dc0f80f0 msgr2=0x7f35dc0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:01:36.386 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:01:36 smithi099 ceph-mon[97031]: pgmap v577: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:01:36.386 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:01:36 smithi099 ceph-mon[97031]: from='client.35090 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:01:36.386 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:01:36 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/2779148631' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T07:01:36.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.384+0000 7f35e3cef640 1 -- 172.21.15.99:0/386680002 shutdown_connections 2024-09-19T07:01:36.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.384+0000 7f35e3cef640 1 -- 172.21.15.99:0/386680002 wait complete. 2024-09-19T07:01:36.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.385+0000 7f35e3cef640 1 Processor -- start 2024-09-19T07:01:36.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.385+0000 7f35e3cef640 1 -- start start 2024-09-19T07:01:36.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.385+0000 7f35e3cef640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35dc102550 0x7f35dc113520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:01:36.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.385+0000 7f35e3cef640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35dc102ef0 0x7f35dc113a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:01:36.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.385+0000 7f35e3cef640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35dc1140b0 con 0x7f35dc102550 2024-09-19T07:01:36.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.385+0000 7f35e3cef640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35dc10d4c0 con 0x7f35dc102ef0 2024-09-19T07:01:36.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.385+0000 7f35e1a8b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35dc102550 0x7f35dc113520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:01:36.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.385+0000 7f35e1a8b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35dc102550 0x7f35dc113520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47056/0 (socket says 172.21.15.99:47056) 2024-09-19T07:01:36.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.385+0000 7f35e1a8b640 1 -- 172.21.15.99:0/3692725871 learned_addr learned my addr 172.21.15.99:0/3692725871 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:01:36.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.385+0000 7f35e128a640 1 --2- 172.21.15.99:0/3692725871 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35dc102ef0 0x7f35dc113a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:01:36.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.385+0000 7f35e1a8b640 1 -- 172.21.15.99:0/3692725871 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35dc102ef0 msgr2=0x7f35dc113a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:36.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.385+0000 7f35e1a8b640 1 --2- 172.21.15.99:0/3692725871 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35dc102ef0 0x7f35dc113a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:36.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.385+0000 7f35e1a8b640 1 -- 172.21.15.99:0/3692725871 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35cc005040 con 0x7f35dc102550 2024-09-19T07:01:36.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.386+0000 7f35e1a8b640 1 --2- 172.21.15.99:0/3692725871 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35dc102550 0x7f35dc113520 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f35d8002a50 tx=0x7f35d8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:01:36.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.386+0000 7f35d27fc640 1 -- 172.21.15.99:0/3692725871 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35d8007c30 con 0x7f35dc102550 2024-09-19T07:01:36.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.386+0000 7f35d27fc640 1 -- 172.21.15.99:0/3692725871 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f35d800f040 con 0x7f35dc102550 2024-09-19T07:01:36.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.386+0000 7f35e3cef640 1 -- 172.21.15.99:0/3692725871 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35dc10d7a0 con 0x7f35dc102550 2024-09-19T07:01:36.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.386+0000 7f35d27fc640 1 -- 172.21.15.99:0/3692725871 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35d800da90 con 0x7f35dc102550 2024-09-19T07:01:36.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.386+0000 7f35e3cef640 1 -- 172.21.15.99:0/3692725871 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35dc10dd40 con 0x7f35dc102550 2024-09-19T07:01:36.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.387+0000 7f35e3cef640 1 -- 172.21.15.99:0/3692725871 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35dc0fdcd0 con 0x7f35dc102550 2024-09-19T07:01:36.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.387+0000 7f35d27fc640 1 -- 172.21.15.99:0/3692725871 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f35d800dc30 con 0x7f35dc102550 2024-09-19T07:01:36.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.388+0000 7f35d27fc640 1 --2- 172.21.15.99:0/3692725871 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f35c806e530 0x7f35c80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:01:36.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.388+0000 7f35d27fc640 1 -- 172.21.15.99:0/3692725871 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f35d808d9c0 con 0x7f35dc102550 2024-09-19T07:01:36.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.388+0000 7f35e128a640 1 --2- 172.21.15.99:0/3692725871 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f35c806e530 0x7f35c80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:01:36.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.388+0000 7f35e128a640 1 --2- 172.21.15.99:0/3692725871 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f35c806e530 0x7f35c80709e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f35dc10e7a0 tx=0x7f35cc009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:01:36.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.392+0000 7f35d27fc640 1 -- 172.21.15.99:0/3692725871 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f35d8056b30 con 0x7f35dc102550 2024-09-19T07:01:36.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:01:36 smithi117 ceph-mon[76771]: pgmap v577: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:01:36.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:01:36 smithi117 ceph-mon[76771]: from='client.35090 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:01:36.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:01:36 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/2779148631' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T07:01:36.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.575+0000 7f35e3cef640 1 -- 172.21.15.99:0/3692725871 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f35dc04b720 con 0x7f35c806e530 2024-09-19T07:01:36.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.576+0000 7f35d27fc640 1 -- 172.21.15.99:0/3692725871 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f35dc04b720 con 0x7f35c806e530 2024-09-19T07:01:36.577 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T07:01:36.577 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T07:01:36.578 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": true, 2024-09-19T07:01:36.578 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T07:01:36.578 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [ 2024-09-19T07:01:36.578 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr", 2024-09-19T07:01:36.578 INFO:teuthology.orchestra.run.smithi099.stdout: "crash", 2024-09-19T07:01:36.578 INFO:teuthology.orchestra.run.smithi099.stdout: "mds", 2024-09-19T07:01:36.578 INFO:teuthology.orchestra.run.smithi099.stdout: "mon", 2024-09-19T07:01:36.578 INFO:teuthology.orchestra.run.smithi099.stdout: "osd" 2024-09-19T07:01:36.578 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-19T07:01:36.578 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": "16/21 daemons upgraded", 2024-09-19T07:01:36.578 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "Currently upgrading mds daemons", 2024-09-19T07:01:36.578 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-09-19T07:01:36.578 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T07:01:36.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.579+0000 7f35e3cef640 1 -- 172.21.15.99:0/3692725871 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f35c806e530 msgr2=0x7f35c80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:36.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.579+0000 7f35e3cef640 1 --2- 172.21.15.99:0/3692725871 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f35c806e530 0x7f35c80709e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f35dc10e7a0 tx=0x7f35cc009da0 comp rx=0 tx=0).stop 2024-09-19T07:01:36.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.579+0000 7f35e3cef640 1 -- 172.21.15.99:0/3692725871 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35dc102550 msgr2=0x7f35dc113520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:36.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.579+0000 7f35e3cef640 1 --2- 172.21.15.99:0/3692725871 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35dc102550 0x7f35dc113520 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f35d8002a50 tx=0x7f35d8004600 comp rx=0 tx=0).stop 2024-09-19T07:01:36.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.579+0000 7f35e3cef640 1 -- 172.21.15.99:0/3692725871 shutdown_connections 2024-09-19T07:01:36.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.579+0000 7f35e3cef640 1 --2- 172.21.15.99:0/3692725871 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f35c806e530 0x7f35c80709e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:36.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.579+0000 7f35e3cef640 1 --2- 172.21.15.99:0/3692725871 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35dc102ef0 0x7f35dc113a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:36.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.579+0000 7f35e3cef640 1 --2- 172.21.15.99:0/3692725871 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f35dc102550 0x7f35dc113520 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:36.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.579+0000 7f35e3cef640 1 -- 172.21.15.99:0/3692725871 >> 172.21.15.99:0/3692725871 conn(0x7f35dc0f80f0 msgr2=0x7f35dc0f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:01:36.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.579+0000 7f35e3cef640 1 -- 172.21.15.99:0/3692725871 shutdown_connections 2024-09-19T07:01:36.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.579+0000 7f35e3cef640 1 -- 172.21.15.99:0/3692725871 wait complete. 2024-09-19T07:01:36.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.657+0000 7efdb94bc640 1 -- 172.21.15.99:0/3722216752 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efdb41025f0 msgr2=0x7efdb41029c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:36.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.657+0000 7efdb94bc640 1 --2- 172.21.15.99:0/3722216752 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efdb41025f0 0x7efdb41029c0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7efda40048d0 tx=0x7efda4009da0 comp rx=0 tx=0).stop 2024-09-19T07:01:36.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.657+0000 7efdb94bc640 1 -- 172.21.15.99:0/3722216752 shutdown_connections 2024-09-19T07:01:36.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.657+0000 7efdb94bc640 1 --2- 172.21.15.99:0/3722216752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efdb40fac60 0x7efdb40fb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:36.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.657+0000 7efdb94bc640 1 --2- 172.21.15.99:0/3722216752 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efdb41025f0 0x7efdb41029c0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:36.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.657+0000 7efdb94bc640 1 -- 172.21.15.99:0/3722216752 >> 172.21.15.99:0/3722216752 conn(0x7efdb4070c80 msgr2=0x7efdb4071080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:01:36.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.657+0000 7efdb94bc640 1 -- 172.21.15.99:0/3722216752 shutdown_connections 2024-09-19T07:01:36.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.657+0000 7efdb94bc640 1 -- 172.21.15.99:0/3722216752 wait complete. 2024-09-19T07:01:36.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.658+0000 7efdb94bc640 1 Processor -- start 2024-09-19T07:01:36.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.658+0000 7efdb94bc640 1 -- start start 2024-09-19T07:01:36.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.658+0000 7efdb94bc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efdb40fac60 0x7efdb41131f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:01:36.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.658+0000 7efdb94bc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efdb41025f0 0x7efdb4113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:01:36.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.658+0000 7efdb94bc640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb4113d30 con 0x7efdb41025f0 2024-09-19T07:01:36.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.658+0000 7efdb94bc640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb410d170 con 0x7efdb40fac60 2024-09-19T07:01:36.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.658+0000 7efdb27fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efdb41025f0 0x7efdb4113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:01:36.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.658+0000 7efdb27fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efdb41025f0 0x7efdb4113730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47066/0 (socket says 172.21.15.99:47066) 2024-09-19T07:01:36.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.658+0000 7efdb27fc640 1 -- 172.21.15.99:0/1853389095 learned_addr learned my addr 172.21.15.99:0/1853389095 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:01:36.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.658+0000 7efdb2ffd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efdb40fac60 0x7efdb41131f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:01:36.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.659+0000 7efdb27fc640 1 -- 172.21.15.99:0/1853389095 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efdb40fac60 msgr2=0x7efdb41131f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:36.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.659+0000 7efdb27fc640 1 --2- 172.21.15.99:0/1853389095 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efdb40fac60 0x7efdb41131f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:36.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.659+0000 7efdb27fc640 1 -- 172.21.15.99:0/1853389095 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda4005040 con 0x7efdb41025f0 2024-09-19T07:01:36.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.659+0000 7efdb27fc640 1 --2- 172.21.15.99:0/1853389095 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efdb41025f0 0x7efdb4113730 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7efda8002a50 tx=0x7efda8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:01:36.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.659+0000 7efd9b7fe640 1 -- 172.21.15.99:0/1853389095 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efda8007c30 con 0x7efdb41025f0 2024-09-19T07:01:36.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.659+0000 7efd9b7fe640 1 -- 172.21.15.99:0/1853389095 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7efda800f040 con 0x7efdb41025f0 2024-09-19T07:01:36.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.659+0000 7efdb94bc640 1 -- 172.21.15.99:0/1853389095 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdb410d450 con 0x7efdb41025f0 2024-09-19T07:01:36.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.659+0000 7efd9b7fe640 1 -- 172.21.15.99:0/1853389095 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efda800dad0 con 0x7efdb41025f0 2024-09-19T07:01:36.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.659+0000 7efdb94bc640 1 -- 172.21.15.99:0/1853389095 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdb410d9f0 con 0x7efdb41025f0 2024-09-19T07:01:36.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.660+0000 7efdb94bc640 1 -- 172.21.15.99:0/1853389095 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdb4065810 con 0x7efdb41025f0 2024-09-19T07:01:36.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.661+0000 7efd9b7fe640 1 -- 172.21.15.99:0/1853389095 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7efda800dc30 con 0x7efdb41025f0 2024-09-19T07:01:36.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.661+0000 7efd9b7fe640 1 --2- 172.21.15.99:0/1853389095 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7efd9c06e530 0x7efd9c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:01:36.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.661+0000 7efd9b7fe640 1 -- 172.21.15.99:0/1853389095 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7efda808df90 con 0x7efdb41025f0 2024-09-19T07:01:36.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.661+0000 7efdb2ffd640 1 --2- 172.21.15.99:0/1853389095 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7efd9c06e530 0x7efd9c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:01:36.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.662+0000 7efdb2ffd640 1 --2- 172.21.15.99:0/1853389095 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7efd9c06e530 0x7efd9c0709e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7efda4009ac0 tx=0x7efda4035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:01:36.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.666+0000 7efd9b7fe640 1 -- 172.21.15.99:0/1853389095 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7efda80c3210 con 0x7efdb41025f0 2024-09-19T07:01:36.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.897+0000 7efdb94bc640 1 -- 172.21.15.99:0/1853389095 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7efdb4109600 con 0x7efdb41025f0 2024-09-19T07:01:36.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.898+0000 7efd9b7fe640 1 -- 172.21.15.99:0/1853389095 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7efda80570c0 con 0x7efdb41025f0 2024-09-19T07:01:36.899 INFO:teuthology.orchestra.run.smithi099.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-09-19T07:01:36.899 INFO:teuthology.orchestra.run.smithi099.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-19T07:01:36.899 INFO:teuthology.orchestra.run.smithi099.stdout: fs cephfs is degraded 2024-09-19T07:01:36.899 INFO:teuthology.orchestra.run.smithi099.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-19T07:01:36.899 INFO:teuthology.orchestra.run.smithi099.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-19T07:01:36.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.900+0000 7efdb94bc640 1 -- 172.21.15.99:0/1853389095 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7efd9c06e530 msgr2=0x7efd9c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:36.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.900+0000 7efdb94bc640 1 --2- 172.21.15.99:0/1853389095 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7efd9c06e530 0x7efd9c0709e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7efda4009ac0 tx=0x7efda4035040 comp rx=0 tx=0).stop 2024-09-19T07:01:36.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.900+0000 7efdb94bc640 1 -- 172.21.15.99:0/1853389095 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efdb41025f0 msgr2=0x7efdb4113730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:01:36.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.900+0000 7efdb94bc640 1 --2- 172.21.15.99:0/1853389095 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efdb41025f0 0x7efdb4113730 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7efda8002a50 tx=0x7efda8004600 comp rx=0 tx=0).stop 2024-09-19T07:01:36.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.900+0000 7efdb94bc640 1 -- 172.21.15.99:0/1853389095 shutdown_connections 2024-09-19T07:01:36.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.900+0000 7efdb94bc640 1 --2- 172.21.15.99:0/1853389095 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7efd9c06e530 0x7efd9c0709e0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:36.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.900+0000 7efdb94bc640 1 --2- 172.21.15.99:0/1853389095 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efdb41025f0 0x7efdb4113730 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:36.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.900+0000 7efdb94bc640 1 --2- 172.21.15.99:0/1853389095 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efdb40fac60 0x7efdb41131f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:01:36.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.900+0000 7efdb94bc640 1 -- 172.21.15.99:0/1853389095 >> 172.21.15.99:0/1853389095 conn(0x7efdb4070c80 msgr2=0x7efdb40f9ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:01:36.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.900+0000 7efdb94bc640 1 -- 172.21.15.99:0/1853389095 shutdown_connections 2024-09-19T07:01:36.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:01:36.900+0000 7efdb94bc640 1 -- 172.21.15.99:0/1853389095 wait complete. 2024-09-19T07:01:37.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:01:37 smithi099 ceph-mon[97031]: from='client.35094 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:01:37.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:01:37 smithi099 ceph-mon[97031]: from='client.35098 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:01:37.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:01:37 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/1667073762' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T07:01:37.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:01:37 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:01:37.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:01:37 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/1853389095' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T07:01:37.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:01:37 smithi117 ceph-mon[76771]: from='client.35094 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:01:37.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:01:37 smithi117 ceph-mon[76771]: from='client.35098 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:01:37.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:01:37 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/1667073762' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T07:01:37.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:01:37 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:01:37.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:01:37 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/1853389095' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T07:01:38.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:01:38 smithi099 ceph-mon[97031]: from='client.35110 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:01:38.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:01:38 smithi099 ceph-mon[97031]: pgmap v578: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:01:38.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:01:38 smithi117 ceph-mon[76771]: from='client.35110 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:01:38.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:01:38 smithi117 ceph-mon[76771]: pgmap v578: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:01:40.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:01:40 smithi099 ceph-mon[97031]: pgmap v579: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:01:40.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:01:40 smithi117 ceph-mon[76771]: pgmap v579: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:01:42.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:01:42 smithi099 ceph-mon[97031]: pgmap v580: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:01:42.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:01:42 smithi117 ceph-mon[76771]: pgmap v580: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:01:44.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:01:44 smithi099 ceph-mon[97031]: pgmap v581: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:01:44.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:01:44 smithi117 ceph-mon[76771]: pgmap v581: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:01:45.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:01:45 smithi099 ceph-mon[97031]: pgmap v582: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:01:45.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:01:45 smithi117 ceph-mon[76771]: pgmap v582: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:01:48.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:01:48 smithi099 ceph-mon[97031]: pgmap v583: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:01:48.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:01:48 smithi117 ceph-mon[76771]: pgmap v583: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:01:50.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:01:50 smithi099 ceph-mon[97031]: pgmap v584: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:01:50.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:01:50 smithi117 ceph-mon[76771]: pgmap v584: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:01:52.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:01:52 smithi099 ceph-mon[97031]: pgmap v585: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:01:52.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:01:52 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:01:52.566 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:01:52 smithi117 ceph-mon[76771]: pgmap v585: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:01:52.566 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:01:52 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:01:54.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:01:54 smithi099 ceph-mon[97031]: pgmap v586: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:01:54.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:01:54 smithi117 ceph-mon[76771]: pgmap v586: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:01:56.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:01:56 smithi099 ceph-mon[97031]: pgmap v587: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:01:56.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:01:56 smithi117 ceph-mon[76771]: pgmap v587: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:01:58.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:01:58 smithi099 ceph-mon[97031]: pgmap v588: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:01:58.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:01:58 smithi117 ceph-mon[76771]: pgmap v588: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:02:00.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:02:00 smithi099 ceph-mon[97031]: pgmap v589: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:02:00.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:02:00 smithi117 ceph-mon[76771]: pgmap v589: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:02:02.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:02:02 smithi099 ceph-mon[97031]: pgmap v590: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:02:02.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:02:02 smithi117 ceph-mon[76771]: pgmap v590: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:02:04.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:02:04 smithi099 ceph-mon[97031]: pgmap v591: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:02:04.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:02:04 smithi117 ceph-mon[76771]: pgmap v591: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:02:06.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:02:06 smithi099 ceph-mon[97031]: pgmap v592: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:02:06.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:02:06 smithi117 ceph-mon[76771]: pgmap v592: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:02:06.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:06.990+0000 7f911e606640 1 -- 172.21.15.99:0/1142032361 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f91180fd580 msgr2=0x7f91180fd950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:06.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:06.990+0000 7f911e606640 1 --2- 172.21.15.99:0/1142032361 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f91180fd580 0x7f91180fd950 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f91080048d0 tx=0x7f9108009da0 comp rx=0 tx=0).stop 2024-09-19T07:02:06.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:06.990+0000 7f911e606640 1 -- 172.21.15.99:0/1142032361 shutdown_connections 2024-09-19T07:02:06.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:06.990+0000 7f911e606640 1 --2- 172.21.15.99:0/1142032361 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f91180fdf20 0x7f9118106560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:06.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:06.990+0000 7f911e606640 1 --2- 172.21.15.99:0/1142032361 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f91180fd580 0x7f91180fd950 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:06.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:06.990+0000 7f911e606640 1 -- 172.21.15.99:0/1142032361 >> 172.21.15.99:0/1142032361 conn(0x7f91180f7010 msgr2=0x7f91180f9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:06.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:06.990+0000 7f911e606640 1 -- 172.21.15.99:0/1142032361 shutdown_connections 2024-09-19T07:02:06.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:06.990+0000 7f911e606640 1 -- 172.21.15.99:0/1142032361 wait complete. 2024-09-19T07:02:06.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:06.991+0000 7f911e606640 1 Processor -- start 2024-09-19T07:02:06.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:06.991+0000 7f911e606640 1 -- start start 2024-09-19T07:02:06.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:06.991+0000 7f911e606640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f91180fd580 0x7f9118113230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:06.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:06.991+0000 7f911e606640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f91180fdf20 0x7f9118113770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:06.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:06.991+0000 7f911e606640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9118113d70 con 0x7f91180fd580 2024-09-19T07:02:06.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:06.991+0000 7f911e606640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f911810d1b0 con 0x7f91180fdf20 2024-09-19T07:02:06.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:06.991+0000 7f9117fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f91180fd580 0x7f9118113230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:06.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:06.991+0000 7f9117fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f91180fd580 0x7f9118113230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52874/0 (socket says 172.21.15.99:52874) 2024-09-19T07:02:06.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:06.991+0000 7f9117fff640 1 -- 172.21.15.99:0/3295327147 learned_addr learned my addr 172.21.15.99:0/3295327147 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:02:06.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:06.992+0000 7f91177fe640 1 --2- 172.21.15.99:0/3295327147 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f91180fdf20 0x7f9118113770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:06.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:06.992+0000 7f9117fff640 1 -- 172.21.15.99:0/3295327147 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f91180fdf20 msgr2=0x7f9118113770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:06.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:06.992+0000 7f9117fff640 1 --2- 172.21.15.99:0/3295327147 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f91180fdf20 0x7f9118113770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:06.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:06.992+0000 7f9117fff640 1 -- 172.21.15.99:0/3295327147 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9108005040 con 0x7f91180fd580 2024-09-19T07:02:06.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:06.992+0000 7f91177fe640 1 --2- 172.21.15.99:0/3295327147 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f91180fdf20 0x7f9118113770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:02:06.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:06.992+0000 7f9117fff640 1 --2- 172.21.15.99:0/3295327147 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f91180fd580 0x7f9118113230 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f9108000c00 tx=0x7f9108009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:06.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:06.992+0000 7f9114ff9640 1 -- 172.21.15.99:0/3295327147 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9108038070 con 0x7f91180fd580 2024-09-19T07:02:06.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:06.992+0000 7f911e606640 1 -- 172.21.15.99:0/3295327147 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f911810d430 con 0x7f91180fd580 2024-09-19T07:02:06.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:06.992+0000 7f9114ff9640 1 -- 172.21.15.99:0/3295327147 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f910802ade0 con 0x7f91180fd580 2024-09-19T07:02:06.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:06.992+0000 7f9114ff9640 1 -- 172.21.15.99:0/3295327147 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f910802c7e0 con 0x7f91180fd580 2024-09-19T07:02:06.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:06.992+0000 7f911e606640 1 -- 172.21.15.99:0/3295327147 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f911810d8f0 con 0x7f91180fd580 2024-09-19T07:02:06.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:06.993+0000 7f911e606640 1 -- 172.21.15.99:0/3295327147 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91180663b0 con 0x7f91180fd580 2024-09-19T07:02:06.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:06.994+0000 7f9114ff9640 1 -- 172.21.15.99:0/3295327147 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f9108030020 con 0x7f91180fd580 2024-09-19T07:02:06.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:06.994+0000 7f9114ff9640 1 --2- 172.21.15.99:0/3295327147 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f910006e530 0x7f91000709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:06.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:06.994+0000 7f9114ff9640 1 -- 172.21.15.99:0/3295327147 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f91080addf0 con 0x7f91180fd580 2024-09-19T07:02:06.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:06.994+0000 7f91177fe640 1 --2- 172.21.15.99:0/3295327147 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f910006e530 0x7f91000709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:06.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:06.995+0000 7f91177fe640 1 --2- 172.21.15.99:0/3295327147 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f910006e530 0x7f91000709e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f910c007fd0 tx=0x7f910c009e90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:06.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:06.999+0000 7f9114ff9640 1 -- 172.21.15.99:0/3295327147 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f9108076f90 con 0x7f91180fd580 2024-09-19T07:02:07.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.184+0000 7f911e606640 1 -- 172.21.15.99:0/3295327147 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f911804b720 con 0x7f910006e530 2024-09-19T07:02:07.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.185+0000 7f9114ff9640 1 -- 172.21.15.99:0/3295327147 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f911804b720 con 0x7f910006e530 2024-09-19T07:02:07.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.187+0000 7f911e606640 1 -- 172.21.15.99:0/3295327147 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f910006e530 msgr2=0x7f91000709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:07.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.187+0000 7f911e606640 1 --2- 172.21.15.99:0/3295327147 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f910006e530 0x7f91000709e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f910c007fd0 tx=0x7f910c009e90 comp rx=0 tx=0).stop 2024-09-19T07:02:07.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.187+0000 7f911e606640 1 -- 172.21.15.99:0/3295327147 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f91180fd580 msgr2=0x7f9118113230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:07.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.187+0000 7f911e606640 1 --2- 172.21.15.99:0/3295327147 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f91180fd580 0x7f9118113230 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f9108000c00 tx=0x7f9108009da0 comp rx=0 tx=0).stop 2024-09-19T07:02:07.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.187+0000 7f911e606640 1 -- 172.21.15.99:0/3295327147 shutdown_connections 2024-09-19T07:02:07.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.187+0000 7f911e606640 1 --2- 172.21.15.99:0/3295327147 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f910006e530 0x7f91000709e0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:07.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.187+0000 7f911e606640 1 --2- 172.21.15.99:0/3295327147 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f91180fdf20 0x7f9118113770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:07.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.187+0000 7f911e606640 1 --2- 172.21.15.99:0/3295327147 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f91180fd580 0x7f9118113230 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:07.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.187+0000 7f911e606640 1 -- 172.21.15.99:0/3295327147 >> 172.21.15.99:0/3295327147 conn(0x7f91180f7010 msgr2=0x7f91180f85d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:07.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.187+0000 7f911e606640 1 -- 172.21.15.99:0/3295327147 shutdown_connections 2024-09-19T07:02:07.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.187+0000 7f911e606640 1 -- 172.21.15.99:0/3295327147 wait complete. 2024-09-19T07:02:07.197 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-09-19T07:02:07.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.267+0000 7f49f7fff640 1 -- 172.21.15.99:0/3269832198 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49f8101c50 msgr2=0x7f49f80fb2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:07.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.267+0000 7f49f7fff640 1 --2- 172.21.15.99:0/3269832198 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49f8101c50 0x7f49f80fb2e0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f49e80048d0 tx=0x7f49e8009da0 comp rx=0 tx=0).stop 2024-09-19T07:02:07.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.267+0000 7f49f7fff640 1 -- 172.21.15.99:0/3269832198 shutdown_connections 2024-09-19T07:02:07.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.267+0000 7f49f7fff640 1 --2- 172.21.15.99:0/3269832198 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49f8101c50 0x7f49f80fb2e0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:07.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.267+0000 7f49f7fff640 1 --2- 172.21.15.99:0/3269832198 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49f81012b0 0x7f49f8101680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:07.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.267+0000 7f49f7fff640 1 -- 172.21.15.99:0/3269832198 >> 172.21.15.99:0/3269832198 conn(0x7f49f80f6e40 msgr2=0x7f49f80f9250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:07.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.267+0000 7f49f7fff640 1 -- 172.21.15.99:0/3269832198 shutdown_connections 2024-09-19T07:02:07.269 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:02:07 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:02:07.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.267+0000 7f49f7fff640 1 -- 172.21.15.99:0/3269832198 wait complete. 2024-09-19T07:02:07.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.268+0000 7f49f7fff640 1 Processor -- start 2024-09-19T07:02:07.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.268+0000 7f49f7fff640 1 -- start start 2024-09-19T07:02:07.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.268+0000 7f49f7fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49f81012b0 0x7f49f80fcf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:07.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.268+0000 7f49f7fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49f8101c50 0x7f49f80fd490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:07.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.268+0000 7f49f7fff640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f80fd9d0 con 0x7f49f81012b0 2024-09-19T07:02:07.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.268+0000 7f49f7fff640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f80fdb40 con 0x7f49f8101c50 2024-09-19T07:02:07.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.268+0000 7f49f6ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49f81012b0 0x7f49f80fcf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:07.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.268+0000 7f49f6ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49f81012b0 0x7f49f80fcf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52878/0 (socket says 172.21.15.99:52878) 2024-09-19T07:02:07.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.268+0000 7f49f6ffd640 1 -- 172.21.15.99:0/2634248862 learned_addr learned my addr 172.21.15.99:0/2634248862 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:02:07.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.268+0000 7f49f67fc640 1 --2- 172.21.15.99:0/2634248862 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49f8101c50 0x7f49f80fd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:07.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.269+0000 7f49f6ffd640 1 -- 172.21.15.99:0/2634248862 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49f8101c50 msgr2=0x7f49f80fd490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:07.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.269+0000 7f49f6ffd640 1 --2- 172.21.15.99:0/2634248862 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49f8101c50 0x7f49f80fd490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:07.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.269+0000 7f49f6ffd640 1 -- 172.21.15.99:0/2634248862 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e8005040 con 0x7f49f81012b0 2024-09-19T07:02:07.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.269+0000 7f49f6ffd640 1 --2- 172.21.15.99:0/2634248862 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49f81012b0 0x7f49f80fcf50 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f49ec002a50 tx=0x7f49ec004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:07.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.269+0000 7f49df7fe640 1 -- 172.21.15.99:0/2634248862 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49ec007c30 con 0x7f49f81012b0 2024-09-19T07:02:07.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.269+0000 7f49df7fe640 1 -- 172.21.15.99:0/2634248862 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f49ec00f040 con 0x7f49f81012b0 2024-09-19T07:02:07.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.269+0000 7f49f7fff640 1 -- 172.21.15.99:0/2634248862 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49f80fddd0 con 0x7f49f81012b0 2024-09-19T07:02:07.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.269+0000 7f49df7fe640 1 -- 172.21.15.99:0/2634248862 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49ec00da10 con 0x7f49f81012b0 2024-09-19T07:02:07.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.269+0000 7f49f7fff640 1 -- 172.21.15.99:0/2634248862 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49f8119710 con 0x7f49f81012b0 2024-09-19T07:02:07.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.270+0000 7f49f7fff640 1 -- 172.21.15.99:0/2634248862 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49f80fca20 con 0x7f49f81012b0 2024-09-19T07:02:07.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.271+0000 7f49df7fe640 1 -- 172.21.15.99:0/2634248862 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f49ec00dc50 con 0x7f49f81012b0 2024-09-19T07:02:07.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.271+0000 7f49df7fe640 1 --2- 172.21.15.99:0/2634248862 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f49e006e530 0x7f49e00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:07.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.271+0000 7f49f67fc640 1 --2- 172.21.15.99:0/2634248862 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f49e006e530 0x7f49e00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:07.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.271+0000 7f49df7fe640 1 -- 172.21.15.99:0/2634248862 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f49ec08d8b0 con 0x7f49f81012b0 2024-09-19T07:02:07.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.272+0000 7f49f67fc640 1 --2- 172.21.15.99:0/2634248862 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f49e006e530 0x7f49e00709e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f49e8009ac0 tx=0x7f49e8035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:07.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.275+0000 7f49df7fe640 1 -- 172.21.15.99:0/2634248862 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f49ec056ad0 con 0x7f49f81012b0 2024-09-19T07:02:07.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.460+0000 7f49f7fff640 1 -- 172.21.15.99:0/2634248862 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f49f80fe640 con 0x7f49e006e530 2024-09-19T07:02:07.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.461+0000 7f49df7fe640 1 -- 172.21.15.99:0/2634248862 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f49f80fe640 con 0x7f49e006e530 2024-09-19T07:02:07.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.463+0000 7f49f7fff640 1 -- 172.21.15.99:0/2634248862 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f49e006e530 msgr2=0x7f49e00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:07.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.463+0000 7f49f7fff640 1 --2- 172.21.15.99:0/2634248862 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f49e006e530 0x7f49e00709e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f49e8009ac0 tx=0x7f49e8035040 comp rx=0 tx=0).stop 2024-09-19T07:02:07.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.463+0000 7f49f7fff640 1 -- 172.21.15.99:0/2634248862 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49f81012b0 msgr2=0x7f49f80fcf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:07.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.463+0000 7f49f7fff640 1 --2- 172.21.15.99:0/2634248862 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49f81012b0 0x7f49f80fcf50 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f49ec002a50 tx=0x7f49ec004600 comp rx=0 tx=0).stop 2024-09-19T07:02:07.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.463+0000 7f49f7fff640 1 -- 172.21.15.99:0/2634248862 shutdown_connections 2024-09-19T07:02:07.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.463+0000 7f49f7fff640 1 --2- 172.21.15.99:0/2634248862 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f49e006e530 0x7f49e00709e0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:07.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.463+0000 7f49f7fff640 1 --2- 172.21.15.99:0/2634248862 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f49f8101c50 0x7f49f80fd490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:07.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.463+0000 7f49f7fff640 1 --2- 172.21.15.99:0/2634248862 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49f81012b0 0x7f49f80fcf50 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:07.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.463+0000 7f49f7fff640 1 -- 172.21.15.99:0/2634248862 >> 172.21.15.99:0/2634248862 conn(0x7f49f80f6e40 msgr2=0x7f49f80658b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:07.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.463+0000 7f49f7fff640 1 -- 172.21.15.99:0/2634248862 shutdown_connections 2024-09-19T07:02:07.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.464+0000 7f49f7fff640 1 -- 172.21.15.99:0/2634248862 wait complete. 2024-09-19T07:02:07.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.543+0000 7f94e1a67640 1 -- 172.21.15.99:0/472752156 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f94dc0fcf80 msgr2=0x7f94dc0fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:07.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.543+0000 7f94e1a67640 1 --2- 172.21.15.99:0/472752156 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f94dc0fcf80 0x7f94dc0fd3d0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f94c40048d0 tx=0x7f94c4009da0 comp rx=0 tx=0).stop 2024-09-19T07:02:07.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.543+0000 7f94e1a67640 1 -- 172.21.15.99:0/472752156 shutdown_connections 2024-09-19T07:02:07.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.543+0000 7f94e1a67640 1 --2- 172.21.15.99:0/472752156 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f94dc0fcf80 0x7f94dc0fd3d0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:07.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.543+0000 7f94e1a67640 1 --2- 172.21.15.99:0/472752156 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94dc0fb810 0x7f94dc0fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:07.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.543+0000 7f94e1a67640 1 -- 172.21.15.99:0/472752156 >> 172.21.15.99:0/472752156 conn(0x7f94dc0723b0 msgr2=0x7f94dc0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:07.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.543+0000 7f94e1a67640 1 -- 172.21.15.99:0/472752156 shutdown_connections 2024-09-19T07:02:07.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.543+0000 7f94e1a67640 1 -- 172.21.15.99:0/472752156 wait complete. 2024-09-19T07:02:07.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.543+0000 7f94e1a67640 1 Processor -- start 2024-09-19T07:02:07.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.543+0000 7f94e1a67640 1 -- start start 2024-09-19T07:02:07.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.544+0000 7f94e1a67640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f94dc0fb810 0x7f94dc113160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:07.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.544+0000 7f94e1a67640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94dc0fcf80 0x7f94dc1136a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:07.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.544+0000 7f94e1a67640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94dc113ca0 con 0x7f94dc0fb810 2024-09-19T07:02:07.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.544+0000 7f94e1a67640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94dc10d0e0 con 0x7f94dc0fcf80 2024-09-19T07:02:07.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.544+0000 7f94db7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f94dc0fb810 0x7f94dc113160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:07.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.544+0000 7f94db7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f94dc0fb810 0x7f94dc113160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52908/0 (socket says 172.21.15.99:52908) 2024-09-19T07:02:07.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.544+0000 7f94db7fe640 1 -- 172.21.15.99:0/3477086729 learned_addr learned my addr 172.21.15.99:0/3477086729 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:02:07.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.544+0000 7f94d3fff640 1 --2- 172.21.15.99:0/3477086729 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94dc0fcf80 0x7f94dc1136a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:07.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.544+0000 7f94db7fe640 1 -- 172.21.15.99:0/3477086729 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94dc0fcf80 msgr2=0x7f94dc1136a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:07.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.544+0000 7f94db7fe640 1 --2- 172.21.15.99:0/3477086729 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94dc0fcf80 0x7f94dc1136a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:07.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.544+0000 7f94db7fe640 1 -- 172.21.15.99:0/3477086729 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c4005040 con 0x7f94dc0fb810 2024-09-19T07:02:07.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.544+0000 7f94db7fe640 1 --2- 172.21.15.99:0/3477086729 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f94dc0fb810 0x7f94dc113160 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f94cc002a80 tx=0x7f94cc004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:07.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.544+0000 7f94d8ff9640 1 -- 172.21.15.99:0/3477086729 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94cc007c30 con 0x7f94dc0fb810 2024-09-19T07:02:07.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.545+0000 7f94e1a67640 1 -- 172.21.15.99:0/3477086729 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94dc10d3c0 con 0x7f94dc0fb810 2024-09-19T07:02:07.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.545+0000 7f94d8ff9640 1 -- 172.21.15.99:0/3477086729 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f94cc00f040 con 0x7f94dc0fb810 2024-09-19T07:02:07.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.545+0000 7f94d8ff9640 1 -- 172.21.15.99:0/3477086729 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94cc009530 con 0x7f94dc0fb810 2024-09-19T07:02:07.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.545+0000 7f94e1a67640 1 -- 172.21.15.99:0/3477086729 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94dc10d8b0 con 0x7f94dc0fb810 2024-09-19T07:02:07.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.546+0000 7f94e1a67640 1 -- 172.21.15.99:0/3477086729 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94dc0fcbc0 con 0x7f94dc0fb810 2024-09-19T07:02:07.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.546+0000 7f94d8ff9640 1 -- 172.21.15.99:0/3477086729 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f94cc0097a0 con 0x7f94dc0fb810 2024-09-19T07:02:07.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.546+0000 7f94d8ff9640 1 --2- 172.21.15.99:0/3477086729 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f94c806e530 0x7f94c80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:07.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.547+0000 7f94d8ff9640 1 -- 172.21.15.99:0/3477086729 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f94cc08db80 con 0x7f94dc0fb810 2024-09-19T07:02:07.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.547+0000 7f94d3fff640 1 --2- 172.21.15.99:0/3477086729 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f94c806e530 0x7f94c80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:07.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.547+0000 7f94d3fff640 1 --2- 172.21.15.99:0/3477086729 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f94c806e530 0x7f94c80709e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f94dc0fe4d0 tx=0x7f94c4035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:07.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.551+0000 7f94d8ff9640 1 -- 172.21.15.99:0/3477086729 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f94cc056c70 con 0x7f94dc0fb810 2024-09-19T07:02:07.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:02:07 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:02:07.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.729+0000 7f94e1a67640 1 -- 172.21.15.99:0/3477086729 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f94dc04b750 con 0x7f94c806e530 2024-09-19T07:02:07.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.737+0000 7f94d8ff9640 1 -- 172.21.15.99:0/3477086729 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f94dc04b750 con 0x7f94c806e530 2024-09-19T07:02:07.738 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T07:02:07.738 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.smithi099 smithi099 *:9093,9094 running (21m) 13m ago 29m 23.4M - 0.25.0 c8568f914cd2 e7c1774d56b0 2024-09-19T07:02:07.738 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi099 smithi099 running (17m) 13m ago 29m 6899k - 19.1.1-361-g2f599a46 d2baa855c067 b9775f416b10 2024-09-19T07:02:07.739 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi117 smithi117 running (17m) 13m ago 28m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 38cf60c0d548 2024-09-19T07:02:07.739 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.smithi099 smithi099 *:3000 running (19m) 13m ago 29m 80.7M - 9.4.12 2bacad6d85d8 cd53a18d5410 2024-09-19T07:02:07.739 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.obarqf smithi099 running (14m) 13m ago 24m 12.2M - 19.1.1-361-g2f599a46 d2baa855c067 314a73082521 2024-09-19T07:02:07.739 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.xehbxe smithi099 running (13m) 13m ago 24m 14.4M - 19.1.1-361-g2f599a46 d2baa855c067 a2955a9d06e6 2024-09-19T07:02:07.739 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.bheqzh smithi117 running (13m) 13m ago 24m 11.8M - 19.1.1-361-g2f599a46 d2baa855c067 b1505937c0b7 2024-09-19T07:02:07.739 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.nooexo smithi117 running (13m) 13m ago 24m 13.1M - 19.1.1-361-g2f599a46 d2baa855c067 35bd7725855c 2024-09-19T07:02:07.739 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi099.pgvkqi smithi099 *:8443,9283,8765 running (20m) 13m ago 30m 505M - 19.1.1-361-g2f599a46 d2baa855c067 d5de99cb7e78 2024-09-19T07:02:07.739 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi117.ssmkcf smithi117 *:8443,9283,8765 running (19m) 13m ago 28m 444M - 19.1.1-361-g2f599a46 d2baa855c067 8b7ee0f871f5 2024-09-19T07:02:07.739 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi099 smithi099 running (18m) 13m ago 30m 52.4M 2048M 19.1.1-361-g2f599a46 d2baa855c067 ffe067438824 2024-09-19T07:02:07.739 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi117 smithi117 running (18m) 13m ago 28m 38.9M 2048M 19.1.1-361-g2f599a46 d2baa855c067 4cb7455e3ee7 2024-09-19T07:02:07.739 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi099 smithi099 *:9100 running (21m) 13m ago 29m 15.0M - 1.5.0 0da6a335fe13 dca7b4517dcc 2024-09-19T07:02:07.739 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi117 smithi117 *:9100 running (20m) 13m ago 28m 15.9M - 1.5.0 0da6a335fe13 8233ce3835d2 2024-09-19T07:02:07.739 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (17m) 13m ago 27m 100M 1557M 19.1.1-361-g2f599a46 d2baa855c067 8e22543bf933 2024-09-19T07:02:07.739 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (16m) 13m ago 27m 106M 1557M 19.1.1-361-g2f599a46 d2baa855c067 f54153d0ae09 2024-09-19T07:02:07.740 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (16m) 13m ago 26m 83.7M 1557M 19.1.1-361-g2f599a46 d2baa855c067 b1778ab88870 2024-09-19T07:02:07.740 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi117 running (15m) 13m ago 26m 102M 2581M 19.1.1-361-g2f599a46 d2baa855c067 ea5236b193d3 2024-09-19T07:02:07.740 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi117 running (14m) 13m ago 26m 93.5M 2581M 19.1.1-361-g2f599a46 d2baa855c067 27ac2c859a68 2024-09-19T07:02:07.740 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi117 running (14m) 13m ago 25m 100M 2581M 19.1.1-361-g2f599a46 d2baa855c067 de6aeb8544ce 2024-09-19T07:02:07.740 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.smithi099 smithi099 *:9095 running (20m) 13m ago 29m 64.4M - 2.43.0 a07b618ecd1d 15ad26ec6fb4 2024-09-19T07:02:07.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.740+0000 7f94e1a67640 1 -- 172.21.15.99:0/3477086729 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f94c806e530 msgr2=0x7f94c80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:07.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.740+0000 7f94e1a67640 1 --2- 172.21.15.99:0/3477086729 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f94c806e530 0x7f94c80709e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f94dc0fe4d0 tx=0x7f94c4035040 comp rx=0 tx=0).stop 2024-09-19T07:02:07.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.740+0000 7f94e1a67640 1 -- 172.21.15.99:0/3477086729 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f94dc0fb810 msgr2=0x7f94dc113160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:07.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.740+0000 7f94e1a67640 1 --2- 172.21.15.99:0/3477086729 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f94dc0fb810 0x7f94dc113160 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f94cc002a80 tx=0x7f94cc004600 comp rx=0 tx=0).stop 2024-09-19T07:02:07.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.740+0000 7f94e1a67640 1 -- 172.21.15.99:0/3477086729 shutdown_connections 2024-09-19T07:02:07.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.740+0000 7f94e1a67640 1 --2- 172.21.15.99:0/3477086729 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f94c806e530 0x7f94c80709e0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:07.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.740+0000 7f94e1a67640 1 --2- 172.21.15.99:0/3477086729 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f94dc0fcf80 0x7f94dc1136a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:07.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.740+0000 7f94e1a67640 1 --2- 172.21.15.99:0/3477086729 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f94dc0fb810 0x7f94dc113160 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:07.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.740+0000 7f94e1a67640 1 -- 172.21.15.99:0/3477086729 >> 172.21.15.99:0/3477086729 conn(0x7f94dc0723b0 msgr2=0x7f94dc065810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:07.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.740+0000 7f94e1a67640 1 -- 172.21.15.99:0/3477086729 shutdown_connections 2024-09-19T07:02:07.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.740+0000 7f94e1a67640 1 -- 172.21.15.99:0/3477086729 wait complete. 2024-09-19T07:02:07.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.817+0000 7f209eb8e640 1 -- 172.21.15.99:0/42776959 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2098102ef0 msgr2=0x7f20980fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:07.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.817+0000 7f209eb8e640 1 --2- 172.21.15.99:0/42776959 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2098102ef0 0x7f20980fc5b0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f2088009c50 tx=0x7f2088004d10 comp rx=0 tx=0).stop 2024-09-19T07:02:07.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.817+0000 7f209eb8e640 1 -- 172.21.15.99:0/42776959 shutdown_connections 2024-09-19T07:02:07.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.817+0000 7f209eb8e640 1 --2- 172.21.15.99:0/42776959 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2098102ef0 0x7f20980fc5b0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:07.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.817+0000 7f209eb8e640 1 --2- 172.21.15.99:0/42776959 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2098102550 0x7f2098102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:07.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.817+0000 7f209eb8e640 1 -- 172.21.15.99:0/42776959 >> 172.21.15.99:0/42776959 conn(0x7f20980f80f0 msgr2=0x7f20980fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:07.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.817+0000 7f209eb8e640 1 -- 172.21.15.99:0/42776959 shutdown_connections 2024-09-19T07:02:07.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.817+0000 7f209eb8e640 1 -- 172.21.15.99:0/42776959 wait complete. 2024-09-19T07:02:07.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.817+0000 7f209eb8e640 1 Processor -- start 2024-09-19T07:02:07.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.818+0000 7f209eb8e640 1 -- start start 2024-09-19T07:02:07.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.818+0000 7f209eb8e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2098102550 0x7f2098113520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:07.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.818+0000 7f209eb8e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2098102ef0 0x7f2098113a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:07.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.818+0000 7f209eb8e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20981140b0 con 0x7f2098102ef0 2024-09-19T07:02:07.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.818+0000 7f209eb8e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f209810d4c0 con 0x7f2098102550 2024-09-19T07:02:07.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.818+0000 7f2097fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2098102ef0 0x7f2098113a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:07.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.818+0000 7f2097fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2098102ef0 0x7f2098113a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52932/0 (socket says 172.21.15.99:52932) 2024-09-19T07:02:07.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.818+0000 7f2097fff640 1 -- 172.21.15.99:0/2907879252 learned_addr learned my addr 172.21.15.99:0/2907879252 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:02:07.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.818+0000 7f209c92a640 1 --2- 172.21.15.99:0/2907879252 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2098102550 0x7f2098113520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:07.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.818+0000 7f2097fff640 1 -- 172.21.15.99:0/2907879252 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2098102550 msgr2=0x7f2098113520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:07.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.818+0000 7f2097fff640 1 --2- 172.21.15.99:0/2907879252 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2098102550 0x7f2098113520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:07.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.818+0000 7f2097fff640 1 -- 172.21.15.99:0/2907879252 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20880098b0 con 0x7f2098102ef0 2024-09-19T07:02:07.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.819+0000 7f2097fff640 1 --2- 172.21.15.99:0/2907879252 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2098102ef0 0x7f2098113a60 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f2088003400 tx=0x7f2088004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:07.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.819+0000 7f20957fa640 1 -- 172.21.15.99:0/2907879252 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2088009610 con 0x7f2098102ef0 2024-09-19T07:02:07.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.819+0000 7f20957fa640 1 -- 172.21.15.99:0/2907879252 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2088032b10 con 0x7f2098102ef0 2024-09-19T07:02:07.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.819+0000 7f209eb8e640 1 -- 172.21.15.99:0/2907879252 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f209810d740 con 0x7f2098102ef0 2024-09-19T07:02:07.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.819+0000 7f20957fa640 1 -- 172.21.15.99:0/2907879252 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f208803d9c0 con 0x7f2098102ef0 2024-09-19T07:02:07.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.819+0000 7f209eb8e640 1 -- 172.21.15.99:0/2907879252 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f209810dce0 con 0x7f2098102ef0 2024-09-19T07:02:07.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.820+0000 7f209eb8e640 1 -- 172.21.15.99:0/2907879252 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20980fdcd0 con 0x7f2098102ef0 2024-09-19T07:02:07.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.821+0000 7f20957fa640 1 -- 172.21.15.99:0/2907879252 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f208802f030 con 0x7f2098102ef0 2024-09-19T07:02:07.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.821+0000 7f20957fa640 1 --2- 172.21.15.99:0/2907879252 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f208406e530 0x7f20840709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:07.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.821+0000 7f20957fa640 1 -- 172.21.15.99:0/2907879252 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f20880af2e0 con 0x7f2098102ef0 2024-09-19T07:02:07.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.821+0000 7f209c92a640 1 --2- 172.21.15.99:0/2907879252 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f208406e530 0x7f20840709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:07.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.822+0000 7f209c92a640 1 --2- 172.21.15.99:0/2907879252 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f208406e530 0x7f20840709e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2090007fd0 tx=0x7f2090009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:07.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:07.826+0000 7f20957fa640 1 -- 172.21.15.99:0/2907879252 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f20880783d0 con 0x7f2098102ef0 2024-09-19T07:02:08.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.067+0000 7f209eb8e640 1 -- 172.21.15.99:0/2907879252 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2098109580 con 0x7f2098102ef0 2024-09-19T07:02:08.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.067+0000 7f20957fa640 1 -- 172.21.15.99:0/2907879252 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f208807ba90 con 0x7f2098102ef0 2024-09-19T07:02:08.069 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T07:02:08.069 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-09-19T07:02:08.069 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T07:02:08.069 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T07:02:08.069 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-09-19T07:02:08.069 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T07:02:08.069 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T07:02:08.069 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-09-19T07:02:08.069 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 6 2024-09-19T07:02:08.069 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T07:02:08.069 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": { 2024-09-19T07:02:08.070 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 4 2024-09-19T07:02:08.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T07:02:08.070 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-09-19T07:02:08.070 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 14 2024-09-19T07:02:08.070 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T07:02:08.070 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T07:02:08.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.070+0000 7f209eb8e640 1 -- 172.21.15.99:0/2907879252 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f208406e530 msgr2=0x7f20840709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:08.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.070+0000 7f209eb8e640 1 --2- 172.21.15.99:0/2907879252 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f208406e530 0x7f20840709e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2090007fd0 tx=0x7f2090009040 comp rx=0 tx=0).stop 2024-09-19T07:02:08.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.070+0000 7f209eb8e640 1 -- 172.21.15.99:0/2907879252 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2098102ef0 msgr2=0x7f2098113a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:08.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.070+0000 7f209eb8e640 1 --2- 172.21.15.99:0/2907879252 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2098102ef0 0x7f2098113a60 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f2088003400 tx=0x7f2088004d10 comp rx=0 tx=0).stop 2024-09-19T07:02:08.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.070+0000 7f209eb8e640 1 -- 172.21.15.99:0/2907879252 shutdown_connections 2024-09-19T07:02:08.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.070+0000 7f209eb8e640 1 --2- 172.21.15.99:0/2907879252 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f208406e530 0x7f20840709e0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:08.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.070+0000 7f209eb8e640 1 --2- 172.21.15.99:0/2907879252 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2098102ef0 0x7f2098113a60 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:08.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.070+0000 7f209eb8e640 1 --2- 172.21.15.99:0/2907879252 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2098102550 0x7f2098113520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:08.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.070+0000 7f209eb8e640 1 -- 172.21.15.99:0/2907879252 >> 172.21.15.99:0/2907879252 conn(0x7f20980f80f0 msgr2=0x7f20980f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:08.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.070+0000 7f209eb8e640 1 -- 172.21.15.99:0/2907879252 shutdown_connections 2024-09-19T07:02:08.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.070+0000 7f209eb8e640 1 -- 172.21.15.99:0/2907879252 wait complete. 2024-09-19T07:02:08.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.147+0000 7f056fdbd640 1 -- 172.21.15.99:0/1035369469 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f05680fb810 msgr2=0x7f05680fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:08.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.148+0000 7f056fdbd640 1 --2- 172.21.15.99:0/1035369469 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f05680fb810 0x7f05680fbbe0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f05640048d0 tx=0x7f0564009da0 comp rx=0 tx=0).stop 2024-09-19T07:02:08.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.148+0000 7f056fdbd640 1 -- 172.21.15.99:0/1035369469 shutdown_connections 2024-09-19T07:02:08.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.148+0000 7f056fdbd640 1 --2- 172.21.15.99:0/1035369469 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05680fcf80 0x7f05680fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:08.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.148+0000 7f056fdbd640 1 --2- 172.21.15.99:0/1035369469 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f05680fb810 0x7f05680fbbe0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:08.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.148+0000 7f056fdbd640 1 -- 172.21.15.99:0/1035369469 >> 172.21.15.99:0/1035369469 conn(0x7f05680723b0 msgr2=0x7f05680727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:08.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.148+0000 7f056fdbd640 1 -- 172.21.15.99:0/1035369469 shutdown_connections 2024-09-19T07:02:08.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.148+0000 7f056fdbd640 1 -- 172.21.15.99:0/1035369469 wait complete. 2024-09-19T07:02:08.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.148+0000 7f056fdbd640 1 Processor -- start 2024-09-19T07:02:08.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.148+0000 7f056fdbd640 1 -- start start 2024-09-19T07:02:08.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.148+0000 7f056fdbd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f05680fb810 0x7f056810e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:08.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.148+0000 7f056fdbd640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05680fcf80 0x7f056810e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:08.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.148+0000 7f056fdbd640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f056810ed40 con 0x7f05680fb810 2024-09-19T07:02:08.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.148+0000 7f056fdbd640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f056810eeb0 con 0x7f05680fcf80 2024-09-19T07:02:08.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.149+0000 7f056db59640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f05680fb810 0x7f056810e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:08.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.149+0000 7f056db59640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f05680fb810 0x7f056810e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52948/0 (socket says 172.21.15.99:52948) 2024-09-19T07:02:08.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.149+0000 7f056db59640 1 -- 172.21.15.99:0/3133264857 learned_addr learned my addr 172.21.15.99:0/3133264857 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:02:08.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.149+0000 7f056d358640 1 --2- 172.21.15.99:0/3133264857 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05680fcf80 0x7f056810e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:08.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.149+0000 7f056db59640 1 -- 172.21.15.99:0/3133264857 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05680fcf80 msgr2=0x7f056810e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:08.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.149+0000 7f056db59640 1 --2- 172.21.15.99:0/3133264857 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05680fcf80 0x7f056810e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:08.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.149+0000 7f056db59640 1 -- 172.21.15.99:0/3133264857 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0564005040 con 0x7f05680fb810 2024-09-19T07:02:08.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.149+0000 7f056d358640 1 --2- 172.21.15.99:0/3133264857 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05680fcf80 0x7f056810e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:02:08.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.149+0000 7f056db59640 1 --2- 172.21.15.99:0/3133264857 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f05680fb810 0x7f056810e1b0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f0564003080 tx=0x7f0564009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:08.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.149+0000 7f055e7fc640 1 -- 172.21.15.99:0/3133264857 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0564038070 con 0x7f05680fb810 2024-09-19T07:02:08.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.149+0000 7f055e7fc640 1 -- 172.21.15.99:0/3133264857 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f056402ade0 con 0x7f05680fb810 2024-09-19T07:02:08.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.149+0000 7f056fdbd640 1 -- 172.21.15.99:0/3133264857 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0568117220 con 0x7f05680fb810 2024-09-19T07:02:08.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.149+0000 7f055e7fc640 1 -- 172.21.15.99:0/3133264857 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f056402c880 con 0x7f05680fb810 2024-09-19T07:02:08.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.149+0000 7f056fdbd640 1 -- 172.21.15.99:0/3133264857 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0568117620 con 0x7f05680fb810 2024-09-19T07:02:08.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.150+0000 7f056fdbd640 1 -- 172.21.15.99:0/3133264857 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05680fcbc0 con 0x7f05680fb810 2024-09-19T07:02:08.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.151+0000 7f055e7fc640 1 -- 172.21.15.99:0/3133264857 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f0564030020 con 0x7f05680fb810 2024-09-19T07:02:08.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.151+0000 7f055e7fc640 1 --2- 172.21.15.99:0/3133264857 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f055406e530 0x7f05540709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:08.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.151+0000 7f055e7fc640 1 -- 172.21.15.99:0/3133264857 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f05640ae170 con 0x7f05680fb810 2024-09-19T07:02:08.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.151+0000 7f056d358640 1 --2- 172.21.15.99:0/3133264857 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f055406e530 0x7f05540709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:08.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.152+0000 7f056d358640 1 --2- 172.21.15.99:0/3133264857 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f055406e530 0x7f05540709e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0568065980 tx=0x7f0558009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:08.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.156+0000 7f055e7fc640 1 -- 172.21.15.99:0/3133264857 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f05640772e0 con 0x7f05680fb810 2024-09-19T07:02:08.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.358+0000 7f056fdbd640 1 -- 172.21.15.99:0/3133264857 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0568065730 con 0x7f05680fb810 2024-09-19T07:02:08.360 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:02:08 smithi099 ceph-mon[97031]: pgmap v593: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:02:08.360 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:02:08 smithi099 ceph-mon[97031]: from='client.35118 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:02:08.360 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:02:08 smithi099 ceph-mon[97031]: from='client.35122 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:02:08.360 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:02:08 smithi099 ceph-mon[97031]: from='client.35126 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:02:08.360 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:02:08 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/2907879252' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T07:02:08.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.359+0000 7f055e7fc640 1 -- 172.21.15.99:0/3133264857 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 29 v29) v1 ==== 76+0+1915 (secure 0 0 0) 0x7f056407a9a0 con 0x7f05680fb810 2024-09-19T07:02:08.361 INFO:teuthology.orchestra.run.smithi099.stdout:e29 2024-09-19T07:02:08.361 INFO:teuthology.orchestra.run.smithi099.stdout:btime 2024-09-19T06:48:47:938420+0000 2024-09-19T07:02:08.361 INFO:teuthology.orchestra.run.smithi099.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T07:02:08.361 INFO:teuthology.orchestra.run.smithi099.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T07:02:08.361 INFO:teuthology.orchestra.run.smithi099.stdout:legacy client fscid: 1 2024-09-19T07:02:08.361 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T07:02:08.361 INFO:teuthology.orchestra.run.smithi099.stdout:Filesystem 'cephfs' (1) 2024-09-19T07:02:08.361 INFO:teuthology.orchestra.run.smithi099.stdout:fs_name cephfs 2024-09-19T07:02:08.362 INFO:teuthology.orchestra.run.smithi099.stdout:epoch 20 2024-09-19T07:02:08.362 INFO:teuthology.orchestra.run.smithi099.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-19T07:02:08.362 INFO:teuthology.orchestra.run.smithi099.stdout:created 2024-09-19T06:37:40.838146+0000 2024-09-19T07:02:08.362 INFO:teuthology.orchestra.run.smithi099.stdout:modified 2024-09-19T06:47:50.076553+0000 2024-09-19T07:02:08.362 INFO:teuthology.orchestra.run.smithi099.stdout:tableserver 0 2024-09-19T07:02:08.362 INFO:teuthology.orchestra.run.smithi099.stdout:root 0 2024-09-19T07:02:08.362 INFO:teuthology.orchestra.run.smithi099.stdout:session_timeout 60 2024-09-19T07:02:08.362 INFO:teuthology.orchestra.run.smithi099.stdout:session_autoclose 300 2024-09-19T07:02:08.362 INFO:teuthology.orchestra.run.smithi099.stdout:max_file_size 1099511627776 2024-09-19T07:02:08.362 INFO:teuthology.orchestra.run.smithi099.stdout:max_xattr_size 65536 2024-09-19T07:02:08.362 INFO:teuthology.orchestra.run.smithi099.stdout:required_client_features {} 2024-09-19T07:02:08.362 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure 0 2024-09-19T07:02:08.362 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure_osd_epoch 77 2024-09-19T07:02:08.363 INFO:teuthology.orchestra.run.smithi099.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T07:02:08.363 INFO:teuthology.orchestra.run.smithi099.stdout:max_mds 2 2024-09-19T07:02:08.363 INFO:teuthology.orchestra.run.smithi099.stdout:in 0,1 2024-09-19T07:02:08.363 INFO:teuthology.orchestra.run.smithi099.stdout:up {} 2024-09-19T07:02:08.363 INFO:teuthology.orchestra.run.smithi099.stdout:failed 0,1 2024-09-19T07:02:08.363 INFO:teuthology.orchestra.run.smithi099.stdout:damaged 2024-09-19T07:02:08.363 INFO:teuthology.orchestra.run.smithi099.stdout:stopped 2024-09-19T07:02:08.363 INFO:teuthology.orchestra.run.smithi099.stdout:data_pools [3] 2024-09-19T07:02:08.363 INFO:teuthology.orchestra.run.smithi099.stdout:metadata_pool 2 2024-09-19T07:02:08.363 INFO:teuthology.orchestra.run.smithi099.stdout:inline_data disabled 2024-09-19T07:02:08.363 INFO:teuthology.orchestra.run.smithi099.stdout:balancer 2024-09-19T07:02:08.363 INFO:teuthology.orchestra.run.smithi099.stdout:bal_rank_mask -1 2024-09-19T07:02:08.363 INFO:teuthology.orchestra.run.smithi099.stdout:standby_count_wanted 1 2024-09-19T07:02:08.363 INFO:teuthology.orchestra.run.smithi099.stdout:qdb_cluster leader: 0 members: 2024-09-19T07:02:08.363 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T07:02:08.364 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T07:02:08.364 INFO:teuthology.orchestra.run.smithi099.stdout:Standby daemons: 2024-09-19T07:02:08.364 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T07:02:08.364 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.obarqf{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6826/1859154203,v1:172.21.15.99:6827/1859154203] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:02:08.364 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.xehbxe{-1:34410} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6828/1939453719,v1:172.21.15.99:6829/1939453719] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:02:08.364 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.nooexo{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6824/1398895079,v1:172.21.15.117:6825/1398895079] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:02:08.364 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.bheqzh{-1:44329} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6826/3233337308,v1:172.21.15.117:6827/3233337308] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:02:08.365 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 29 2024-09-19T07:02:08.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.361+0000 7f056fdbd640 1 -- 172.21.15.99:0/3133264857 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f055406e530 msgr2=0x7f05540709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:08.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.361+0000 7f056fdbd640 1 --2- 172.21.15.99:0/3133264857 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f055406e530 0x7f05540709e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0568065980 tx=0x7f0558009040 comp rx=0 tx=0).stop 2024-09-19T07:02:08.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.361+0000 7f056fdbd640 1 -- 172.21.15.99:0/3133264857 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f05680fb810 msgr2=0x7f056810e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:08.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.361+0000 7f056fdbd640 1 --2- 172.21.15.99:0/3133264857 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f05680fb810 0x7f056810e1b0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f0564003080 tx=0x7f0564009da0 comp rx=0 tx=0).stop 2024-09-19T07:02:08.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.361+0000 7f056fdbd640 1 -- 172.21.15.99:0/3133264857 shutdown_connections 2024-09-19T07:02:08.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.361+0000 7f056fdbd640 1 --2- 172.21.15.99:0/3133264857 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f055406e530 0x7f05540709e0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:08.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.361+0000 7f056fdbd640 1 --2- 172.21.15.99:0/3133264857 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f05680fcf80 0x7f056810e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:08.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.361+0000 7f056fdbd640 1 --2- 172.21.15.99:0/3133264857 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f05680fb810 0x7f056810e1b0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:08.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.361+0000 7f056fdbd640 1 -- 172.21.15.99:0/3133264857 >> 172.21.15.99:0/3133264857 conn(0x7f05680723b0 msgr2=0x7f05680fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:08.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.361+0000 7f056fdbd640 1 -- 172.21.15.99:0/3133264857 shutdown_connections 2024-09-19T07:02:08.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.361+0000 7f056fdbd640 1 -- 172.21.15.99:0/3133264857 wait complete. 2024-09-19T07:02:08.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.440+0000 7fe25f295640 1 -- 172.21.15.99:0/1097300204 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe2580fe450 msgr2=0x7fe2580fe820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:08.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.440+0000 7fe25f295640 1 --2- 172.21.15.99:0/1097300204 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe2580fe450 0x7fe2580fe820 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fe248009c50 tx=0x7fe248004d10 comp rx=0 tx=0).stop 2024-09-19T07:02:08.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.441+0000 7fe25f295640 1 -- 172.21.15.99:0/1097300204 shutdown_connections 2024-09-19T07:02:08.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.441+0000 7fe25f295640 1 --2- 172.21.15.99:0/1097300204 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe258064fe0 0x7fe258065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:08.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.441+0000 7fe25f295640 1 --2- 172.21.15.99:0/1097300204 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe2580fe450 0x7fe2580fe820 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:08.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.441+0000 7fe25f295640 1 -- 172.21.15.99:0/1097300204 >> 172.21.15.99:0/1097300204 conn(0x7fe2580723b0 msgr2=0x7fe2580727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:08.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.441+0000 7fe25f295640 1 -- 172.21.15.99:0/1097300204 shutdown_connections 2024-09-19T07:02:08.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.441+0000 7fe25f295640 1 -- 172.21.15.99:0/1097300204 wait complete. 2024-09-19T07:02:08.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.441+0000 7fe25f295640 1 Processor -- start 2024-09-19T07:02:08.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.441+0000 7fe25f295640 1 -- start start 2024-09-19T07:02:08.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.441+0000 7fe25f295640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe258064fe0 0x7fe258113210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:08.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.441+0000 7fe25f295640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2580fe450 0x7fe258113750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:08.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.441+0000 7fe25f295640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe258113d50 con 0x7fe258064fe0 2024-09-19T07:02:08.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.441+0000 7fe25f295640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe25810d190 con 0x7fe2580fe450 2024-09-19T07:02:08.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.441+0000 7fe25d031640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe258064fe0 0x7fe258113210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:08.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.442+0000 7fe25d031640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe258064fe0 0x7fe258113210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52962/0 (socket says 172.21.15.99:52962) 2024-09-19T07:02:08.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.442+0000 7fe25d031640 1 -- 172.21.15.99:0/1833985094 learned_addr learned my addr 172.21.15.99:0/1833985094 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:02:08.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.442+0000 7fe25c830640 1 --2- 172.21.15.99:0/1833985094 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2580fe450 0x7fe258113750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:08.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.442+0000 7fe25d031640 1 -- 172.21.15.99:0/1833985094 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2580fe450 msgr2=0x7fe258113750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:08.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.442+0000 7fe25d031640 1 --2- 172.21.15.99:0/1833985094 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2580fe450 0x7fe258113750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:08.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.442+0000 7fe25d031640 1 -- 172.21.15.99:0/1833985094 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2480098b0 con 0x7fe258064fe0 2024-09-19T07:02:08.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.442+0000 7fe25c830640 1 --2- 172.21.15.99:0/1833985094 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2580fe450 0x7fe258113750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:02:08.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.442+0000 7fe25d031640 1 --2- 172.21.15.99:0/1833985094 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe258064fe0 0x7fe258113210 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fe248004a30 tx=0x7fe248004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:08.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.442+0000 7fe255ffb640 1 -- 172.21.15.99:0/1833985094 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe248009690 con 0x7fe258064fe0 2024-09-19T07:02:08.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.442+0000 7fe255ffb640 1 -- 172.21.15.99:0/1833985094 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe248032b10 con 0x7fe258064fe0 2024-09-19T07:02:08.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.442+0000 7fe25f295640 1 -- 172.21.15.99:0/1833985094 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe25810d410 con 0x7fe258064fe0 2024-09-19T07:02:08.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.442+0000 7fe255ffb640 1 -- 172.21.15.99:0/1833985094 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe24803daa0 con 0x7fe258064fe0 2024-09-19T07:02:08.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.442+0000 7fe25f295640 1 -- 172.21.15.99:0/1833985094 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe25810d930 con 0x7fe258064fe0 2024-09-19T07:02:08.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.443+0000 7fe25f295640 1 -- 172.21.15.99:0/1833985094 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2580fdce0 con 0x7fe258064fe0 2024-09-19T07:02:08.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.444+0000 7fe255ffb640 1 -- 172.21.15.99:0/1833985094 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fe24802f030 con 0x7fe258064fe0 2024-09-19T07:02:08.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.444+0000 7fe255ffb640 1 --2- 172.21.15.99:0/1833985094 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe24006e530 0x7fe2400709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:08.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.445+0000 7fe255ffb640 1 -- 172.21.15.99:0/1833985094 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fe2480af2d0 con 0x7fe258064fe0 2024-09-19T07:02:08.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.445+0000 7fe25c830640 1 --2- 172.21.15.99:0/1833985094 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe24006e530 0x7fe2400709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:08.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.445+0000 7fe25c830640 1 --2- 172.21.15.99:0/1833985094 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe24006e530 0x7fe2400709e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe25810ead0 tx=0x7fe24c009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:08.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.449+0000 7fe255ffb640 1 -- 172.21.15.99:0/1833985094 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fe2480783c0 con 0x7fe258064fe0 2024-09-19T07:02:08.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:02:08 smithi117 ceph-mon[76771]: pgmap v593: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:02:08.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:02:08 smithi117 ceph-mon[76771]: from='client.35118 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:02:08.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:02:08 smithi117 ceph-mon[76771]: from='client.35122 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:02:08.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:02:08 smithi117 ceph-mon[76771]: from='client.35126 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:02:08.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:02:08 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/2907879252' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T07:02:08.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.631+0000 7fe25f295640 1 -- 172.21.15.99:0/1833985094 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe25804b750 con 0x7fe24006e530 2024-09-19T07:02:08.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.632+0000 7fe255ffb640 1 -- 172.21.15.99:0/1833985094 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fe25804b750 con 0x7fe24006e530 2024-09-19T07:02:08.634 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T07:02:08.634 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T07:02:08.634 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": true, 2024-09-19T07:02:08.634 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T07:02:08.634 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [ 2024-09-19T07:02:08.634 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr", 2024-09-19T07:02:08.634 INFO:teuthology.orchestra.run.smithi099.stdout: "crash", 2024-09-19T07:02:08.634 INFO:teuthology.orchestra.run.smithi099.stdout: "mds", 2024-09-19T07:02:08.634 INFO:teuthology.orchestra.run.smithi099.stdout: "mon", 2024-09-19T07:02:08.634 INFO:teuthology.orchestra.run.smithi099.stdout: "osd" 2024-09-19T07:02:08.634 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-19T07:02:08.634 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": "16/21 daemons upgraded", 2024-09-19T07:02:08.634 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "Currently upgrading mds daemons", 2024-09-19T07:02:08.635 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-09-19T07:02:08.635 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T07:02:08.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.634+0000 7fe25f295640 1 -- 172.21.15.99:0/1833985094 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe24006e530 msgr2=0x7fe2400709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:08.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.634+0000 7fe25f295640 1 --2- 172.21.15.99:0/1833985094 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe24006e530 0x7fe2400709e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe25810ead0 tx=0x7fe24c009040 comp rx=0 tx=0).stop 2024-09-19T07:02:08.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.634+0000 7fe25f295640 1 -- 172.21.15.99:0/1833985094 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe258064fe0 msgr2=0x7fe258113210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:08.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.634+0000 7fe25f295640 1 --2- 172.21.15.99:0/1833985094 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe258064fe0 0x7fe258113210 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fe248004a30 tx=0x7fe248004d10 comp rx=0 tx=0).stop 2024-09-19T07:02:08.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.635+0000 7fe25f295640 1 -- 172.21.15.99:0/1833985094 shutdown_connections 2024-09-19T07:02:08.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.635+0000 7fe25f295640 1 --2- 172.21.15.99:0/1833985094 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe24006e530 0x7fe2400709e0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:08.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.635+0000 7fe25f295640 1 --2- 172.21.15.99:0/1833985094 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe2580fe450 0x7fe258113750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:08.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.635+0000 7fe25f295640 1 --2- 172.21.15.99:0/1833985094 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe258064fe0 0x7fe258113210 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:08.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.635+0000 7fe25f295640 1 -- 172.21.15.99:0/1833985094 >> 172.21.15.99:0/1833985094 conn(0x7fe2580723b0 msgr2=0x7fe2580fa2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:08.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.635+0000 7fe25f295640 1 -- 172.21.15.99:0/1833985094 shutdown_connections 2024-09-19T07:02:08.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.635+0000 7fe25f295640 1 -- 172.21.15.99:0/1833985094 wait complete. 2024-09-19T07:02:08.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.713+0000 7fa263538640 1 -- 172.21.15.99:0/1671669462 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa25c0fdf00 msgr2=0x7fa25c1065d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:08.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.713+0000 7fa263538640 1 --2- 172.21.15.99:0/1671669462 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa25c0fdf00 0x7fa25c1065d0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fa24c004900 tx=0x7fa24c009da0 comp rx=0 tx=0).stop 2024-09-19T07:02:08.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.713+0000 7fa263538640 1 -- 172.21.15.99:0/1671669462 shutdown_connections 2024-09-19T07:02:08.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.713+0000 7fa263538640 1 --2- 172.21.15.99:0/1671669462 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa25c0fdf00 0x7fa25c1065d0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:08.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.713+0000 7fa263538640 1 --2- 172.21.15.99:0/1671669462 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa25c0fd560 0x7fa25c0fd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:08.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.713+0000 7fa263538640 1 -- 172.21.15.99:0/1671669462 >> 172.21.15.99:0/1671669462 conn(0x7fa25c0f7060 msgr2=0x7fa25c0f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:08.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.713+0000 7fa263538640 1 -- 172.21.15.99:0/1671669462 shutdown_connections 2024-09-19T07:02:08.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.713+0000 7fa263538640 1 -- 172.21.15.99:0/1671669462 wait complete. 2024-09-19T07:02:08.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.714+0000 7fa263538640 1 Processor -- start 2024-09-19T07:02:08.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.714+0000 7fa263538640 1 -- start start 2024-09-19T07:02:08.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.714+0000 7fa263538640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa25c0fd560 0x7fa25c113310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:08.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.714+0000 7fa263538640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa25c0fdf00 0x7fa25c113850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:08.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.714+0000 7fa263538640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa25c113e50 con 0x7fa25c0fdf00 2024-09-19T07:02:08.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.714+0000 7fa263538640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa25c10d290 con 0x7fa25c0fd560 2024-09-19T07:02:08.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.714+0000 7fa260ad3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa25c0fdf00 0x7fa25c113850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:08.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.714+0000 7fa260ad3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa25c0fdf00 0x7fa25c113850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52980/0 (socket says 172.21.15.99:52980) 2024-09-19T07:02:08.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.714+0000 7fa260ad3640 1 -- 172.21.15.99:0/4041681556 learned_addr learned my addr 172.21.15.99:0/4041681556 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:02:08.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.715+0000 7fa2612d4640 1 --2- 172.21.15.99:0/4041681556 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa25c0fd560 0x7fa25c113310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:08.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.715+0000 7fa260ad3640 1 -- 172.21.15.99:0/4041681556 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa25c0fd560 msgr2=0x7fa25c113310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:08.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.715+0000 7fa260ad3640 1 --2- 172.21.15.99:0/4041681556 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa25c0fd560 0x7fa25c113310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:08.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.715+0000 7fa260ad3640 1 -- 172.21.15.99:0/4041681556 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa24c005040 con 0x7fa25c0fdf00 2024-09-19T07:02:08.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.715+0000 7fa2612d4640 1 --2- 172.21.15.99:0/4041681556 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa25c0fd560 0x7fa25c113310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:02:08.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.715+0000 7fa260ad3640 1 --2- 172.21.15.99:0/4041681556 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa25c0fdf00 0x7fa25c113850 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fa24c004960 tx=0x7fa24c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:08.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.715+0000 7fa251ffb640 1 -- 172.21.15.99:0/4041681556 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa24c038070 con 0x7fa25c0fdf00 2024-09-19T07:02:08.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.715+0000 7fa251ffb640 1 -- 172.21.15.99:0/4041681556 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa24c008ed0 con 0x7fa25c0fdf00 2024-09-19T07:02:08.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.715+0000 7fa263538640 1 -- 172.21.15.99:0/4041681556 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa25c10d510 con 0x7fa25c0fdf00 2024-09-19T07:02:08.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.715+0000 7fa251ffb640 1 -- 172.21.15.99:0/4041681556 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa24c0095a0 con 0x7fa25c0fdf00 2024-09-19T07:02:08.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.715+0000 7fa263538640 1 -- 172.21.15.99:0/4041681556 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa25c10d9d0 con 0x7fa25c0fdf00 2024-09-19T07:02:08.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.716+0000 7fa263538640 1 -- 172.21.15.99:0/4041681556 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa25c0662f0 con 0x7fa25c0fdf00 2024-09-19T07:02:08.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.717+0000 7fa251ffb640 1 -- 172.21.15.99:0/4041681556 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fa24c030020 con 0x7fa25c0fdf00 2024-09-19T07:02:08.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.717+0000 7fa251ffb640 1 --2- 172.21.15.99:0/4041681556 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa24806e530 0x7fa2480709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:08.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.717+0000 7fa251ffb640 1 -- 172.21.15.99:0/4041681556 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fa24c0ae0f0 con 0x7fa25c0fdf00 2024-09-19T07:02:08.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.717+0000 7fa2612d4640 1 --2- 172.21.15.99:0/4041681556 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa24806e530 0x7fa2480709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:08.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.718+0000 7fa2612d4640 1 --2- 172.21.15.99:0/4041681556 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa24806e530 0x7fa2480709e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa258004c80 tx=0x7fa258009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:08.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.722+0000 7fa251ffb640 1 -- 172.21.15.99:0/4041681556 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fa24c0771e0 con 0x7fa25c0fdf00 2024-09-19T07:02:08.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.957+0000 7fa263538640 1 -- 172.21.15.99:0/4041681556 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fa25c109580 con 0x7fa25c0fdf00 2024-09-19T07:02:08.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.957+0000 7fa251ffb640 1 -- 172.21.15.99:0/4041681556 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7fa24c07a8a0 con 0x7fa25c0fdf00 2024-09-19T07:02:08.958 INFO:teuthology.orchestra.run.smithi099.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-09-19T07:02:08.958 INFO:teuthology.orchestra.run.smithi099.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-19T07:02:08.958 INFO:teuthology.orchestra.run.smithi099.stdout: fs cephfs is degraded 2024-09-19T07:02:08.958 INFO:teuthology.orchestra.run.smithi099.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-19T07:02:08.959 INFO:teuthology.orchestra.run.smithi099.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-19T07:02:08.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.959+0000 7fa263538640 1 -- 172.21.15.99:0/4041681556 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa24806e530 msgr2=0x7fa2480709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:08.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.959+0000 7fa263538640 1 --2- 172.21.15.99:0/4041681556 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa24806e530 0x7fa2480709e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa258004c80 tx=0x7fa258009040 comp rx=0 tx=0).stop 2024-09-19T07:02:08.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.959+0000 7fa263538640 1 -- 172.21.15.99:0/4041681556 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa25c0fdf00 msgr2=0x7fa25c113850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:08.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.959+0000 7fa263538640 1 --2- 172.21.15.99:0/4041681556 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa25c0fdf00 0x7fa25c113850 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fa24c004960 tx=0x7fa24c009da0 comp rx=0 tx=0).stop 2024-09-19T07:02:08.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.960+0000 7fa263538640 1 -- 172.21.15.99:0/4041681556 shutdown_connections 2024-09-19T07:02:08.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.960+0000 7fa263538640 1 --2- 172.21.15.99:0/4041681556 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa24806e530 0x7fa2480709e0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:08.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.960+0000 7fa263538640 1 --2- 172.21.15.99:0/4041681556 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa25c0fdf00 0x7fa25c113850 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:08.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.960+0000 7fa263538640 1 --2- 172.21.15.99:0/4041681556 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa25c0fd560 0x7fa25c113310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:08.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.960+0000 7fa263538640 1 -- 172.21.15.99:0/4041681556 >> 172.21.15.99:0/4041681556 conn(0x7fa25c0f7060 msgr2=0x7fa25c0f8580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:08.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.960+0000 7fa263538640 1 -- 172.21.15.99:0/4041681556 shutdown_connections 2024-09-19T07:02:08.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:08.960+0000 7fa263538640 1 -- 172.21.15.99:0/4041681556 wait complete. 2024-09-19T07:02:09.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:02:09 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/3133264857' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T07:02:09.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:02:09 smithi099 ceph-mon[97031]: from='client.35138 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:02:09.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:02:09 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/4041681556' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T07:02:09.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:02:09 smithi099 ceph-mon[97031]: pgmap v594: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:02:09.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:02:09 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/3133264857' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T07:02:09.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:02:09 smithi117 ceph-mon[76771]: from='client.35138 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:02:09.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:02:09 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/4041681556' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T07:02:09.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:02:09 smithi117 ceph-mon[76771]: pgmap v594: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:02:12.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:02:12 smithi099 ceph-mon[97031]: pgmap v595: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:02:12.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:02:12 smithi117 ceph-mon[76771]: pgmap v595: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:02:14.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:02:14 smithi099 ceph-mon[97031]: pgmap v596: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:02:14.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:02:14 smithi117 ceph-mon[76771]: pgmap v596: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:02:16.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:02:16 smithi099 ceph-mon[97031]: pgmap v597: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:02:16.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:02:16 smithi117 ceph-mon[76771]: pgmap v597: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:02:18.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:02:18 smithi099 ceph-mon[97031]: pgmap v598: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:02:18.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:02:18 smithi117 ceph-mon[76771]: pgmap v598: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:02:20.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:02:20 smithi099 ceph-mon[97031]: pgmap v599: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:02:20.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:02:20 smithi117 ceph-mon[76771]: pgmap v599: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:02:22.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:02:22 smithi099 ceph-mon[97031]: pgmap v600: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:02:22.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:02:22 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:02:22.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:02:22 smithi117 ceph-mon[76771]: pgmap v600: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:02:22.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:02:22 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:02:24.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:02:24 smithi099 ceph-mon[97031]: pgmap v601: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:02:24.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:02:24 smithi117 ceph-mon[76771]: pgmap v601: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:02:26.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:02:26 smithi099 ceph-mon[97031]: pgmap v602: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:02:26.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:02:26 smithi117 ceph-mon[76771]: pgmap v602: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:02:28.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:02:28 smithi099 ceph-mon[97031]: pgmap v603: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:02:28.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:02:28 smithi117 ceph-mon[76771]: pgmap v603: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:02:29.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:02:29 smithi117 ceph-mon[76771]: pgmap v604: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:02:29.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:02:29 smithi099 ceph-mon[97031]: pgmap v604: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:02:32.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:02:32 smithi099 ceph-mon[97031]: pgmap v605: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:02:32.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:02:32 smithi117 ceph-mon[76771]: pgmap v605: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:02:34.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:02:34 smithi099 ceph-mon[97031]: pgmap v606: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:02:34.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:02:34 smithi117 ceph-mon[76771]: pgmap v606: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:02:36.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:02:36 smithi099 ceph-mon[97031]: pgmap v607: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:02:36.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:02:36 smithi117 ceph-mon[76771]: pgmap v607: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:02:37.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:02:37 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:02:37.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:02:37 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:02:38.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:02:38 smithi099 ceph-mon[97031]: pgmap v608: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:02:38.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:02:38 smithi117 ceph-mon[76771]: pgmap v608: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:02:39.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.050+0000 7f86a93b3640 1 -- 172.21.15.99:0/239516393 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86a41014e0 msgr2=0x7f86a41018b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:39.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.050+0000 7f86a93b3640 1 --2- 172.21.15.99:0/239516393 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86a41014e0 0x7f86a41018b0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f86940048d0 tx=0x7f8694009da0 comp rx=0 tx=0).stop 2024-09-19T07:02:39.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.050+0000 7f86a93b3640 1 -- 172.21.15.99:0/239516393 shutdown_connections 2024-09-19T07:02:39.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.050+0000 7f86a93b3640 1 --2- 172.21.15.99:0/239516393 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86a40fb4a0 0x7f86a40fb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:39.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.050+0000 7f86a93b3640 1 --2- 172.21.15.99:0/239516393 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86a41014e0 0x7f86a41018b0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:39.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.050+0000 7f86a93b3640 1 -- 172.21.15.99:0/239516393 >> 172.21.15.99:0/239516393 conn(0x7f86a40f7060 msgr2=0x7f86a40f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:39.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.050+0000 7f86a93b3640 1 -- 172.21.15.99:0/239516393 shutdown_connections 2024-09-19T07:02:39.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.050+0000 7f86a93b3640 1 -- 172.21.15.99:0/239516393 wait complete. 2024-09-19T07:02:39.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.051+0000 7f86a93b3640 1 Processor -- start 2024-09-19T07:02:39.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.051+0000 7f86a93b3640 1 -- start start 2024-09-19T07:02:39.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.051+0000 7f86a93b3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86a40fb4a0 0x7f86a41120c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:39.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.051+0000 7f86a93b3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86a41014e0 0x7f86a4112600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:39.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.051+0000 7f86a93b3640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a4112c00 con 0x7f86a40fb4a0 2024-09-19T07:02:39.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.051+0000 7f86a93b3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a410c040 con 0x7f86a41014e0 2024-09-19T07:02:39.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.052+0000 7f86a2ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86a40fb4a0 0x7f86a41120c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:39.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.052+0000 7f86a2ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86a40fb4a0 0x7f86a41120c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41454/0 (socket says 172.21.15.99:41454) 2024-09-19T07:02:39.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.052+0000 7f86a2ffd640 1 -- 172.21.15.99:0/3179929769 learned_addr learned my addr 172.21.15.99:0/3179929769 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:02:39.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.052+0000 7f869a7fc640 1 --2- 172.21.15.99:0/3179929769 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86a41014e0 0x7f86a4112600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:39.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.052+0000 7f86a2ffd640 1 -- 172.21.15.99:0/3179929769 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86a41014e0 msgr2=0x7f86a4112600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:39.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.052+0000 7f86a2ffd640 1 --2- 172.21.15.99:0/3179929769 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86a41014e0 0x7f86a4112600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:39.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.052+0000 7f86a2ffd640 1 -- 172.21.15.99:0/3179929769 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8694005040 con 0x7f86a40fb4a0 2024-09-19T07:02:39.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.052+0000 7f869a7fc640 1 --2- 172.21.15.99:0/3179929769 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86a41014e0 0x7f86a4112600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:02:39.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.052+0000 7f86a2ffd640 1 --2- 172.21.15.99:0/3179929769 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86a40fb4a0 0x7f86a41120c0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f8694000c00 tx=0x7f8694009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:39.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.052+0000 7f869bfff640 1 -- 172.21.15.99:0/3179929769 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8694038070 con 0x7f86a40fb4a0 2024-09-19T07:02:39.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.052+0000 7f869bfff640 1 -- 172.21.15.99:0/3179929769 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f869402ade0 con 0x7f86a40fb4a0 2024-09-19T07:02:39.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.052+0000 7f86a93b3640 1 -- 172.21.15.99:0/3179929769 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86a410c2c0 con 0x7f86a40fb4a0 2024-09-19T07:02:39.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.052+0000 7f869bfff640 1 -- 172.21.15.99:0/3179929769 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f869402c7e0 con 0x7f86a40fb4a0 2024-09-19T07:02:39.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.052+0000 7f86a93b3640 1 -- 172.21.15.99:0/3179929769 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86a410c800 con 0x7f86a40fb4a0 2024-09-19T07:02:39.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.053+0000 7f86a93b3640 1 -- 172.21.15.99:0/3179929769 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86a40fcbe0 con 0x7f86a40fb4a0 2024-09-19T07:02:39.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.054+0000 7f869bfff640 1 -- 172.21.15.99:0/3179929769 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f8694030020 con 0x7f86a40fb4a0 2024-09-19T07:02:39.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.054+0000 7f869bfff640 1 --2- 172.21.15.99:0/3179929769 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f869006e530 0x7f86900709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:39.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.055+0000 7f869bfff640 1 -- 172.21.15.99:0/3179929769 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f86940add50 con 0x7f86a40fb4a0 2024-09-19T07:02:39.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.055+0000 7f869a7fc640 1 --2- 172.21.15.99:0/3179929769 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f869006e530 0x7f86900709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:39.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.055+0000 7f869a7fc640 1 --2- 172.21.15.99:0/3179929769 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f869006e530 0x7f86900709e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f868c007fd0 tx=0x7f868c009e90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:39.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.059+0000 7f869bfff640 1 -- 172.21.15.99:0/3179929769 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f8694076f70 con 0x7f86a40fb4a0 2024-09-19T07:02:39.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.243+0000 7f86a93b3640 1 -- 172.21.15.99:0/3179929769 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f86a404b720 con 0x7f869006e530 2024-09-19T07:02:39.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.245+0000 7f869bfff640 1 -- 172.21.15.99:0/3179929769 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f86a404b720 con 0x7f869006e530 2024-09-19T07:02:39.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.247+0000 7f86a93b3640 1 -- 172.21.15.99:0/3179929769 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f869006e530 msgr2=0x7f86900709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:39.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.247+0000 7f86a93b3640 1 --2- 172.21.15.99:0/3179929769 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f869006e530 0x7f86900709e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f868c007fd0 tx=0x7f868c009e90 comp rx=0 tx=0).stop 2024-09-19T07:02:39.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.247+0000 7f86a93b3640 1 -- 172.21.15.99:0/3179929769 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86a40fb4a0 msgr2=0x7f86a41120c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:39.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.247+0000 7f86a93b3640 1 --2- 172.21.15.99:0/3179929769 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86a40fb4a0 0x7f86a41120c0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f8694000c00 tx=0x7f8694009da0 comp rx=0 tx=0).stop 2024-09-19T07:02:39.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.247+0000 7f86a93b3640 1 -- 172.21.15.99:0/3179929769 shutdown_connections 2024-09-19T07:02:39.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.247+0000 7f86a93b3640 1 --2- 172.21.15.99:0/3179929769 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f869006e530 0x7f86900709e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:39.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.247+0000 7f86a93b3640 1 --2- 172.21.15.99:0/3179929769 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86a41014e0 0x7f86a4112600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:39.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.247+0000 7f86a93b3640 1 --2- 172.21.15.99:0/3179929769 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f86a40fb4a0 0x7f86a41120c0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:39.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.247+0000 7f86a93b3640 1 -- 172.21.15.99:0/3179929769 >> 172.21.15.99:0/3179929769 conn(0x7f86a40f7060 msgr2=0x7f86a40f7430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:39.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.247+0000 7f86a93b3640 1 -- 172.21.15.99:0/3179929769 shutdown_connections 2024-09-19T07:02:39.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.247+0000 7f86a93b3640 1 -- 172.21.15.99:0/3179929769 wait complete. 2024-09-19T07:02:39.256 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-09-19T07:02:39.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.326+0000 7f50e7605640 1 -- 172.21.15.99:0/1965439843 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f50e00fcf80 msgr2=0x7f50e00fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:39.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.326+0000 7f50e7605640 1 --2- 172.21.15.99:0/1965439843 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f50e00fcf80 0x7f50e00fd3d0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f50d40048d0 tx=0x7f50d4009da0 comp rx=0 tx=0).stop 2024-09-19T07:02:39.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.326+0000 7f50e7605640 1 -- 172.21.15.99:0/1965439843 shutdown_connections 2024-09-19T07:02:39.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.326+0000 7f50e7605640 1 --2- 172.21.15.99:0/1965439843 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f50e00fcf80 0x7f50e00fd3d0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:39.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.326+0000 7f50e7605640 1 --2- 172.21.15.99:0/1965439843 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50e00fb810 0x7f50e00fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:39.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.326+0000 7f50e7605640 1 -- 172.21.15.99:0/1965439843 >> 172.21.15.99:0/1965439843 conn(0x7f50e00723b0 msgr2=0x7f50e00727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:39.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.327+0000 7f50e7605640 1 -- 172.21.15.99:0/1965439843 shutdown_connections 2024-09-19T07:02:39.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.327+0000 7f50e7605640 1 -- 172.21.15.99:0/1965439843 wait complete. 2024-09-19T07:02:39.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.327+0000 7f50e7605640 1 Processor -- start 2024-09-19T07:02:39.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.327+0000 7f50e7605640 1 -- start start 2024-09-19T07:02:39.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.327+0000 7f50e7605640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f50e00fb810 0x7f50e01153d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:39.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.327+0000 7f50e7605640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50e00fcf80 0x7f50e0115910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:39.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.327+0000 7f50e7605640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e0115f10 con 0x7f50e00fb810 2024-09-19T07:02:39.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.327+0000 7f50e7605640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e010f350 con 0x7f50e00fcf80 2024-09-19T07:02:39.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.327+0000 7f50e53a1640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f50e00fb810 0x7f50e01153d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:39.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.327+0000 7f50e53a1640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f50e00fb810 0x7f50e01153d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41466/0 (socket says 172.21.15.99:41466) 2024-09-19T07:02:39.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.327+0000 7f50e53a1640 1 -- 172.21.15.99:0/3297962082 learned_addr learned my addr 172.21.15.99:0/3297962082 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:02:39.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.328+0000 7f50e4ba0640 1 --2- 172.21.15.99:0/3297962082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50e00fcf80 0x7f50e0115910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:39.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.328+0000 7f50e53a1640 1 -- 172.21.15.99:0/3297962082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50e00fcf80 msgr2=0x7f50e0115910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:39.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.328+0000 7f50e53a1640 1 --2- 172.21.15.99:0/3297962082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50e00fcf80 0x7f50e0115910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:39.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.328+0000 7f50e53a1640 1 -- 172.21.15.99:0/3297962082 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50d4005040 con 0x7f50e00fb810 2024-09-19T07:02:39.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.328+0000 7f50e53a1640 1 --2- 172.21.15.99:0/3297962082 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f50e00fb810 0x7f50e01153d0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f50d000db00 tx=0x7f50d0004e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:39.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.328+0000 7f50ddffb640 1 -- 172.21.15.99:0/3297962082 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50d0017070 con 0x7f50e00fb810 2024-09-19T07:02:39.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.328+0000 7f50e7605640 1 -- 172.21.15.99:0/3297962082 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50e010f630 con 0x7f50e00fb810 2024-09-19T07:02:39.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.328+0000 7f50ddffb640 1 -- 172.21.15.99:0/3297962082 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f50d000f040 con 0x7f50e00fb810 2024-09-19T07:02:39.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.328+0000 7f50ddffb640 1 -- 172.21.15.99:0/3297962082 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50d0003960 con 0x7f50e00fb810 2024-09-19T07:02:39.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.329+0000 7f50e7605640 1 -- 172.21.15.99:0/3297962082 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50e010fb20 con 0x7f50e00fb810 2024-09-19T07:02:39.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.329+0000 7f50e7605640 1 -- 172.21.15.99:0/3297962082 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50e00fcbc0 con 0x7f50e00fb810 2024-09-19T07:02:39.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.330+0000 7f50ddffb640 1 -- 172.21.15.99:0/3297962082 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f50d000b890 con 0x7f50e00fb810 2024-09-19T07:02:39.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.330+0000 7f50ddffb640 1 --2- 172.21.15.99:0/3297962082 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f50c806e530 0x7f50c80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:39.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.330+0000 7f50ddffb640 1 -- 172.21.15.99:0/3297962082 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f50d008e1a0 con 0x7f50e00fb810 2024-09-19T07:02:39.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.330+0000 7f50e4ba0640 1 --2- 172.21.15.99:0/3297962082 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f50c806e530 0x7f50c80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:39.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.331+0000 7f50e4ba0640 1 --2- 172.21.15.99:0/3297962082 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f50c806e530 0x7f50c80709e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f50d4009ac0 tx=0x7f50d4035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:39.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.335+0000 7f50ddffb640 1 -- 172.21.15.99:0/3297962082 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f50d0057290 con 0x7f50e00fb810 2024-09-19T07:02:39.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.518+0000 7f50e7605640 1 -- 172.21.15.99:0/3297962082 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f50e004b750 con 0x7f50c806e530 2024-09-19T07:02:39.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.520+0000 7f50ddffb640 1 -- 172.21.15.99:0/3297962082 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f50e004b750 con 0x7f50c806e530 2024-09-19T07:02:39.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.522+0000 7f50e7605640 1 -- 172.21.15.99:0/3297962082 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f50c806e530 msgr2=0x7f50c80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:39.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.522+0000 7f50e7605640 1 --2- 172.21.15.99:0/3297962082 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f50c806e530 0x7f50c80709e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f50d4009ac0 tx=0x7f50d4035040 comp rx=0 tx=0).stop 2024-09-19T07:02:39.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.522+0000 7f50e7605640 1 -- 172.21.15.99:0/3297962082 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f50e00fb810 msgr2=0x7f50e01153d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:39.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.522+0000 7f50e7605640 1 --2- 172.21.15.99:0/3297962082 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f50e00fb810 0x7f50e01153d0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f50d000db00 tx=0x7f50d0004e60 comp rx=0 tx=0).stop 2024-09-19T07:02:39.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.522+0000 7f50e7605640 1 -- 172.21.15.99:0/3297962082 shutdown_connections 2024-09-19T07:02:39.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.522+0000 7f50e7605640 1 --2- 172.21.15.99:0/3297962082 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f50c806e530 0x7f50c80709e0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:39.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.522+0000 7f50e7605640 1 --2- 172.21.15.99:0/3297962082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50e00fcf80 0x7f50e0115910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:39.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.522+0000 7f50e7605640 1 --2- 172.21.15.99:0/3297962082 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f50e00fb810 0x7f50e01153d0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:39.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.522+0000 7f50e7605640 1 -- 172.21.15.99:0/3297962082 >> 172.21.15.99:0/3297962082 conn(0x7f50e00723b0 msgr2=0x7f50e00f8470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:39.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.522+0000 7f50e7605640 1 -- 172.21.15.99:0/3297962082 shutdown_connections 2024-09-19T07:02:39.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.522+0000 7f50e7605640 1 -- 172.21.15.99:0/3297962082 wait complete. 2024-09-19T07:02:39.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.600+0000 7fa4c5eb0640 1 -- 172.21.15.99:0/3216851177 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa4c0102ed0 msgr2=0x7fa4c00fc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:39.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.600+0000 7fa4c5eb0640 1 --2- 172.21.15.99:0/3216851177 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa4c0102ed0 0x7fa4c00fc590 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fa4a80048d0 tx=0x7fa4a8009da0 comp rx=0 tx=0).stop 2024-09-19T07:02:39.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.600+0000 7fa4c5eb0640 1 -- 172.21.15.99:0/3216851177 shutdown_connections 2024-09-19T07:02:39.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.600+0000 7fa4c5eb0640 1 --2- 172.21.15.99:0/3216851177 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa4c0102ed0 0x7fa4c00fc590 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:39.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.600+0000 7fa4c5eb0640 1 --2- 172.21.15.99:0/3216851177 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4c0102530 0x7fa4c0102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:39.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.600+0000 7fa4c5eb0640 1 -- 172.21.15.99:0/3216851177 >> 172.21.15.99:0/3216851177 conn(0x7fa4c00f80f0 msgr2=0x7fa4c00fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:39.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.600+0000 7fa4c5eb0640 1 -- 172.21.15.99:0/3216851177 shutdown_connections 2024-09-19T07:02:39.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.600+0000 7fa4c5eb0640 1 -- 172.21.15.99:0/3216851177 wait complete. 2024-09-19T07:02:39.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.601+0000 7fa4c5eb0640 1 Processor -- start 2024-09-19T07:02:39.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.601+0000 7fa4c5eb0640 1 -- start start 2024-09-19T07:02:39.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.601+0000 7fa4c5eb0640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4c0102530 0x7fa4c006fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:39.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.601+0000 7fa4c5eb0640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa4c0102ed0 0x7fa4c006ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:39.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.601+0000 7fa4c5eb0640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c0070490 con 0x7fa4c0102ed0 2024-09-19T07:02:39.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.601+0000 7fa4c5eb0640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c0070600 con 0x7fa4c0102530 2024-09-19T07:02:39.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.601+0000 7fa4b7fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa4c0102ed0 0x7fa4c006ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:39.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.601+0000 7fa4b7fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa4c0102ed0 0x7fa4c006ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41478/0 (socket says 172.21.15.99:41478) 2024-09-19T07:02:39.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.601+0000 7fa4b7fff640 1 -- 172.21.15.99:0/1061938479 learned_addr learned my addr 172.21.15.99:0/1061938479 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:02:39.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.601+0000 7fa4bf7fe640 1 --2- 172.21.15.99:0/1061938479 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4c0102530 0x7fa4c006fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:39.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.601+0000 7fa4b7fff640 1 -- 172.21.15.99:0/1061938479 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4c0102530 msgr2=0x7fa4c006fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:39.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.601+0000 7fa4b7fff640 1 --2- 172.21.15.99:0/1061938479 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4c0102530 0x7fa4c006fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:39.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.601+0000 7fa4b7fff640 1 -- 172.21.15.99:0/1061938479 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4a8005040 con 0x7fa4c0102ed0 2024-09-19T07:02:39.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.602+0000 7fa4b7fff640 1 --2- 172.21.15.99:0/1061938479 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa4c0102ed0 0x7fa4c006ff50 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fa4a80043d0 tx=0x7fa4a8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:39.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.602+0000 7fa4bcff9640 1 -- 172.21.15.99:0/1061938479 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4a8038070 con 0x7fa4c0102ed0 2024-09-19T07:02:39.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.602+0000 7fa4bcff9640 1 -- 172.21.15.99:0/1061938479 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa4a80096e0 con 0x7fa4c0102ed0 2024-09-19T07:02:39.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.602+0000 7fa4c5eb0640 1 -- 172.21.15.99:0/1061938479 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4c0070830 con 0x7fa4c0102ed0 2024-09-19T07:02:39.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.602+0000 7fa4bcff9640 1 -- 172.21.15.99:0/1061938479 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4a802c8a0 con 0x7fa4c0102ed0 2024-09-19T07:02:39.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.602+0000 7fa4c5eb0640 1 -- 172.21.15.99:0/1061938479 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4c0119870 con 0x7fa4c0102ed0 2024-09-19T07:02:39.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.603+0000 7fa4c5eb0640 1 -- 172.21.15.99:0/1061938479 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4c00fdcb0 con 0x7fa4c0102ed0 2024-09-19T07:02:39.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.603+0000 7fa4bcff9640 1 -- 172.21.15.99:0/1061938479 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fa4a8030020 con 0x7fa4c0102ed0 2024-09-19T07:02:39.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.604+0000 7fa4bcff9640 1 --2- 172.21.15.99:0/1061938479 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa4ac06e530 0x7fa4ac0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:39.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.604+0000 7fa4bcff9640 1 -- 172.21.15.99:0/1061938479 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fa4a80ade10 con 0x7fa4c0102ed0 2024-09-19T07:02:39.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.604+0000 7fa4bf7fe640 1 --2- 172.21.15.99:0/1061938479 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa4ac06e530 0x7fa4ac0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:39.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.604+0000 7fa4bf7fe640 1 --2- 172.21.15.99:0/1061938479 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa4ac06e530 0x7fa4ac0709e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa4b0004ed0 tx=0x7fa4b000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:39.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.608+0000 7fa4bcff9640 1 -- 172.21.15.99:0/1061938479 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fa4a8077f00 con 0x7fa4c0102ed0 2024-09-19T07:02:39.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.782+0000 7fa4c5eb0640 1 -- 172.21.15.99:0/1061938479 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa4c004b720 con 0x7fa4ac06e530 2024-09-19T07:02:39.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.791+0000 7fa4bcff9640 1 -- 172.21.15.99:0/1061938479 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7fa4c004b720 con 0x7fa4ac06e530 2024-09-19T07:02:39.792 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T07:02:39.792 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.smithi099 smithi099 *:9093,9094 running (21m) 14m ago 30m 23.4M - 0.25.0 c8568f914cd2 e7c1774d56b0 2024-09-19T07:02:39.792 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi099 smithi099 running (18m) 14m ago 30m 6899k - 19.1.1-361-g2f599a46 d2baa855c067 b9775f416b10 2024-09-19T07:02:39.792 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi117 smithi117 running (18m) 13m ago 29m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 38cf60c0d548 2024-09-19T07:02:39.792 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.smithi099 smithi099 *:3000 running (20m) 14m ago 29m 80.7M - 9.4.12 2bacad6d85d8 cd53a18d5410 2024-09-19T07:02:39.792 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.obarqf smithi099 running (14m) 14m ago 24m 12.2M - 19.1.1-361-g2f599a46 d2baa855c067 314a73082521 2024-09-19T07:02:39.792 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.xehbxe smithi099 running (14m) 14m ago 24m 14.4M - 19.1.1-361-g2f599a46 d2baa855c067 a2955a9d06e6 2024-09-19T07:02:39.792 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.bheqzh smithi117 running (13m) 13m ago 24m 11.8M - 19.1.1-361-g2f599a46 d2baa855c067 b1505937c0b7 2024-09-19T07:02:39.792 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.nooexo smithi117 running (14m) 13m ago 24m 13.1M - 19.1.1-361-g2f599a46 d2baa855c067 35bd7725855c 2024-09-19T07:02:39.792 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi099.pgvkqi smithi099 *:8443,9283,8765 running (21m) 14m ago 31m 505M - 19.1.1-361-g2f599a46 d2baa855c067 d5de99cb7e78 2024-09-19T07:02:39.792 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi117.ssmkcf smithi117 *:8443,9283,8765 running (20m) 13m ago 29m 444M - 19.1.1-361-g2f599a46 d2baa855c067 8b7ee0f871f5 2024-09-19T07:02:39.792 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi099 smithi099 running (19m) 14m ago 31m 52.4M 2048M 19.1.1-361-g2f599a46 d2baa855c067 ffe067438824 2024-09-19T07:02:39.793 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi117 smithi117 running (18m) 13m ago 29m 38.9M 2048M 19.1.1-361-g2f599a46 d2baa855c067 4cb7455e3ee7 2024-09-19T07:02:39.793 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi099 smithi099 *:9100 running (21m) 14m ago 30m 15.0M - 1.5.0 0da6a335fe13 dca7b4517dcc 2024-09-19T07:02:39.793 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi117 smithi117 *:9100 running (21m) 13m ago 29m 15.9M - 1.5.0 0da6a335fe13 8233ce3835d2 2024-09-19T07:02:39.793 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (17m) 14m ago 28m 100M 1557M 19.1.1-361-g2f599a46 d2baa855c067 8e22543bf933 2024-09-19T07:02:39.793 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (17m) 14m ago 27m 106M 1557M 19.1.1-361-g2f599a46 d2baa855c067 f54153d0ae09 2024-09-19T07:02:39.793 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (16m) 14m ago 27m 83.7M 1557M 19.1.1-361-g2f599a46 d2baa855c067 b1778ab88870 2024-09-19T07:02:39.793 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi117 running (16m) 13m ago 27m 102M 2581M 19.1.1-361-g2f599a46 d2baa855c067 ea5236b193d3 2024-09-19T07:02:39.793 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi117 running (15m) 13m ago 26m 93.5M 2581M 19.1.1-361-g2f599a46 d2baa855c067 27ac2c859a68 2024-09-19T07:02:39.793 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi117 running (14m) 13m ago 26m 100M 2581M 19.1.1-361-g2f599a46 d2baa855c067 de6aeb8544ce 2024-09-19T07:02:39.793 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.smithi099 smithi099 *:9095 running (20m) 14m ago 29m 64.4M - 2.43.0 a07b618ecd1d 15ad26ec6fb4 2024-09-19T07:02:39.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.793+0000 7fa4c5eb0640 1 -- 172.21.15.99:0/1061938479 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa4ac06e530 msgr2=0x7fa4ac0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:39.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.793+0000 7fa4c5eb0640 1 --2- 172.21.15.99:0/1061938479 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa4ac06e530 0x7fa4ac0709e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa4b0004ed0 tx=0x7fa4b000b040 comp rx=0 tx=0).stop 2024-09-19T07:02:39.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.793+0000 7fa4c5eb0640 1 -- 172.21.15.99:0/1061938479 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa4c0102ed0 msgr2=0x7fa4c006ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:39.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.793+0000 7fa4c5eb0640 1 --2- 172.21.15.99:0/1061938479 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa4c0102ed0 0x7fa4c006ff50 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fa4a80043d0 tx=0x7fa4a8009da0 comp rx=0 tx=0).stop 2024-09-19T07:02:39.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.793+0000 7fa4c5eb0640 1 -- 172.21.15.99:0/1061938479 shutdown_connections 2024-09-19T07:02:39.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.793+0000 7fa4c5eb0640 1 --2- 172.21.15.99:0/1061938479 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fa4ac06e530 0x7fa4ac0709e0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:39.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.793+0000 7fa4c5eb0640 1 --2- 172.21.15.99:0/1061938479 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa4c0102ed0 0x7fa4c006ff50 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:39.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.793+0000 7fa4c5eb0640 1 --2- 172.21.15.99:0/1061938479 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4c0102530 0x7fa4c006fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:39.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.793+0000 7fa4c5eb0640 1 -- 172.21.15.99:0/1061938479 >> 172.21.15.99:0/1061938479 conn(0x7fa4c00f80f0 msgr2=0x7fa4c00f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:39.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.793+0000 7fa4c5eb0640 1 -- 172.21.15.99:0/1061938479 shutdown_connections 2024-09-19T07:02:39.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.793+0000 7fa4c5eb0640 1 -- 172.21.15.99:0/1061938479 wait complete. 2024-09-19T07:02:39.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.871+0000 7f183445e640 1 -- 172.21.15.99:0/366065445 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f182c102ef0 msgr2=0x7f182c0fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:39.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.871+0000 7f183445e640 1 --2- 172.21.15.99:0/366065445 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f182c102ef0 0x7f182c0fc5b0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f181c0048d0 tx=0x7f181c009da0 comp rx=0 tx=0).stop 2024-09-19T07:02:39.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.872+0000 7f183445e640 1 -- 172.21.15.99:0/366065445 shutdown_connections 2024-09-19T07:02:39.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.872+0000 7f183445e640 1 --2- 172.21.15.99:0/366065445 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f182c102ef0 0x7f182c0fc5b0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:39.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.872+0000 7f183445e640 1 --2- 172.21.15.99:0/366065445 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f182c102550 0x7f182c102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:39.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.872+0000 7f183445e640 1 -- 172.21.15.99:0/366065445 >> 172.21.15.99:0/366065445 conn(0x7f182c0f80f0 msgr2=0x7f182c0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:39.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.872+0000 7f183445e640 1 -- 172.21.15.99:0/366065445 shutdown_connections 2024-09-19T07:02:39.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.872+0000 7f183445e640 1 -- 172.21.15.99:0/366065445 wait complete. 2024-09-19T07:02:39.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.872+0000 7f183445e640 1 Processor -- start 2024-09-19T07:02:39.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.872+0000 7f183445e640 1 -- start start 2024-09-19T07:02:39.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.872+0000 7f183445e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f182c102550 0x7f182c113510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:39.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.872+0000 7f183445e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f182c102ef0 0x7f182c113a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:39.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.872+0000 7f183445e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f182c1140a0 con 0x7f182c102550 2024-09-19T07:02:39.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.872+0000 7f183445e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f182c10d4b0 con 0x7f182c102ef0 2024-09-19T07:02:39.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.873+0000 7f18321fa640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f182c102550 0x7f182c113510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:39.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.873+0000 7f18321fa640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f182c102550 0x7f182c113510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41490/0 (socket says 172.21.15.99:41490) 2024-09-19T07:02:39.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.873+0000 7f18321fa640 1 -- 172.21.15.99:0/2152814933 learned_addr learned my addr 172.21.15.99:0/2152814933 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:02:39.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.873+0000 7f18319f9640 1 --2- 172.21.15.99:0/2152814933 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f182c102ef0 0x7f182c113a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:39.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.873+0000 7f18321fa640 1 -- 172.21.15.99:0/2152814933 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f182c102ef0 msgr2=0x7f182c113a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:39.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.873+0000 7f18321fa640 1 --2- 172.21.15.99:0/2152814933 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f182c102ef0 0x7f182c113a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:39.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.873+0000 7f18321fa640 1 -- 172.21.15.99:0/2152814933 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f181c005040 con 0x7f182c102550 2024-09-19T07:02:39.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.873+0000 7f18321fa640 1 --2- 172.21.15.99:0/2152814933 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f182c102550 0x7f182c113510 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f182800c830 tx=0x7f1828004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:39.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.873+0000 7f1822ffd640 1 -- 172.21.15.99:0/2152814933 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f182800a850 con 0x7f182c102550 2024-09-19T07:02:39.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.873+0000 7f1822ffd640 1 -- 172.21.15.99:0/2152814933 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f182800ae50 con 0x7f182c102550 2024-09-19T07:02:39.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.873+0000 7f183445e640 1 -- 172.21.15.99:0/2152814933 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f182c10d790 con 0x7f182c102550 2024-09-19T07:02:39.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.873+0000 7f1822ffd640 1 -- 172.21.15.99:0/2152814933 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18280113a0 con 0x7f182c102550 2024-09-19T07:02:39.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.873+0000 7f183445e640 1 -- 172.21.15.99:0/2152814933 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f182c10dd00 con 0x7f182c102550 2024-09-19T07:02:39.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.874+0000 7f183445e640 1 -- 172.21.15.99:0/2152814933 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f182c0fdcd0 con 0x7f182c102550 2024-09-19T07:02:39.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.875+0000 7f1822ffd640 1 -- 172.21.15.99:0/2152814933 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f1828012400 con 0x7f182c102550 2024-09-19T07:02:39.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.876+0000 7f1822ffd640 1 --2- 172.21.15.99:0/2152814933 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f181806e530 0x7f18180709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:39.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.876+0000 7f1822ffd640 1 -- 172.21.15.99:0/2152814933 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f182808e3b0 con 0x7f182c102550 2024-09-19T07:02:39.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.876+0000 7f18319f9640 1 --2- 172.21.15.99:0/2152814933 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f181806e530 0x7f18180709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:39.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.876+0000 7f18319f9640 1 --2- 172.21.15.99:0/2152814933 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f181806e530 0x7f18180709e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f181c000c00 tx=0x7f181c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:39.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:39.880+0000 7f1822ffd640 1 -- 172.21.15.99:0/2152814933 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f1828057520 con 0x7f182c102550 2024-09-19T07:02:40.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.115+0000 7f183445e640 1 -- 172.21.15.99:0/2152814933 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f182c04b780 con 0x7f182c102550 2024-09-19T07:02:40.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.116+0000 7f1822ffd640 1 -- 172.21.15.99:0/2152814933 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f182805abe0 con 0x7f182c102550 2024-09-19T07:02:40.117 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T07:02:40.117 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-09-19T07:02:40.117 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T07:02:40.117 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T07:02:40.118 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-09-19T07:02:40.118 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T07:02:40.118 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T07:02:40.118 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-09-19T07:02:40.118 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 6 2024-09-19T07:02:40.118 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T07:02:40.118 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": { 2024-09-19T07:02:40.118 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 4 2024-09-19T07:02:40.118 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T07:02:40.118 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-09-19T07:02:40.118 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 14 2024-09-19T07:02:40.118 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T07:02:40.118 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T07:02:40.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.118+0000 7f183445e640 1 -- 172.21.15.99:0/2152814933 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f181806e530 msgr2=0x7f18180709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:40.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.118+0000 7f183445e640 1 --2- 172.21.15.99:0/2152814933 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f181806e530 0x7f18180709e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f181c000c00 tx=0x7f181c035040 comp rx=0 tx=0).stop 2024-09-19T07:02:40.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.118+0000 7f183445e640 1 -- 172.21.15.99:0/2152814933 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f182c102550 msgr2=0x7f182c113510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:40.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.118+0000 7f183445e640 1 --2- 172.21.15.99:0/2152814933 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f182c102550 0x7f182c113510 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f182800c830 tx=0x7f1828004430 comp rx=0 tx=0).stop 2024-09-19T07:02:40.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.118+0000 7f183445e640 1 -- 172.21.15.99:0/2152814933 shutdown_connections 2024-09-19T07:02:40.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.118+0000 7f183445e640 1 --2- 172.21.15.99:0/2152814933 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f181806e530 0x7f18180709e0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:40.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.118+0000 7f183445e640 1 --2- 172.21.15.99:0/2152814933 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f182c102ef0 0x7f182c113a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:40.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.118+0000 7f183445e640 1 --2- 172.21.15.99:0/2152814933 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f182c102550 0x7f182c113510 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:40.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.118+0000 7f183445e640 1 -- 172.21.15.99:0/2152814933 >> 172.21.15.99:0/2152814933 conn(0x7f182c0f80f0 msgr2=0x7f182c0f9120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:40.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.118+0000 7f183445e640 1 -- 172.21.15.99:0/2152814933 shutdown_connections 2024-09-19T07:02:40.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.118+0000 7f183445e640 1 -- 172.21.15.99:0/2152814933 wait complete. 2024-09-19T07:02:40.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.197+0000 7fe0a9622640 1 -- 172.21.15.99:0/748543993 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe0a40fb000 msgr2=0x7fe0a40fb3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:40.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.197+0000 7fe0a9622640 1 --2- 172.21.15.99:0/748543993 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe0a40fb000 0x7fe0a40fb3d0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fe09c009c50 tx=0x7fe09c004d10 comp rx=0 tx=0).stop 2024-09-19T07:02:40.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.197+0000 7fe0a9622640 1 -- 172.21.15.99:0/748543993 shutdown_connections 2024-09-19T07:02:40.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.197+0000 7fe0a9622640 1 --2- 172.21.15.99:0/748543993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe0a40fc780 0x7fe0a40fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:40.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.197+0000 7fe0a9622640 1 --2- 172.21.15.99:0/748543993 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe0a40fb000 0x7fe0a40fb3d0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:40.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.197+0000 7fe0a9622640 1 -- 172.21.15.99:0/748543993 >> 172.21.15.99:0/748543993 conn(0x7fe0a4071b00 msgr2=0x7fe0a4071f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:40.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.197+0000 7fe0a9622640 1 -- 172.21.15.99:0/748543993 shutdown_connections 2024-09-19T07:02:40.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.197+0000 7fe0a9622640 1 -- 172.21.15.99:0/748543993 wait complete. 2024-09-19T07:02:40.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.198+0000 7fe0a9622640 1 Processor -- start 2024-09-19T07:02:40.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.198+0000 7fe0a9622640 1 -- start start 2024-09-19T07:02:40.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.198+0000 7fe0a9622640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe0a40fb000 0x7fe0a41131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:40.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.198+0000 7fe0a9622640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe0a40fc780 0x7fe0a4113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:40.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.198+0000 7fe0a9622640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a4113d10 con 0x7fe0a40fc780 2024-09-19T07:02:40.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.198+0000 7fe0a9622640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a410d150 con 0x7fe0a40fb000 2024-09-19T07:02:40.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.198+0000 7fe0a27fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe0a40fc780 0x7fe0a4113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:40.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.198+0000 7fe0a27fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe0a40fc780 0x7fe0a4113710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41504/0 (socket says 172.21.15.99:41504) 2024-09-19T07:02:40.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.198+0000 7fe0a27fc640 1 -- 172.21.15.99:0/2689328942 learned_addr learned my addr 172.21.15.99:0/2689328942 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:02:40.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.198+0000 7fe0a27fc640 1 -- 172.21.15.99:0/2689328942 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe0a40fb000 msgr2=0x7fe0a41131d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:40.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.198+0000 7fe0a27fc640 1 --2- 172.21.15.99:0/2689328942 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe0a40fb000 0x7fe0a41131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:40.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.198+0000 7fe0a27fc640 1 -- 172.21.15.99:0/2689328942 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe09c0098b0 con 0x7fe0a40fc780 2024-09-19T07:02:40.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.199+0000 7fe0a27fc640 1 --2- 172.21.15.99:0/2689328942 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe0a40fc780 0x7fe0a4113710 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fe08c002a80 tx=0x7fe08c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:40.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.199+0000 7fe09b7fe640 1 -- 172.21.15.99:0/2689328942 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe08c007c30 con 0x7fe0a40fc780 2024-09-19T07:02:40.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.199+0000 7fe09b7fe640 1 -- 172.21.15.99:0/2689328942 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe08c00f040 con 0x7fe0a40fc780 2024-09-19T07:02:40.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.199+0000 7fe09b7fe640 1 -- 172.21.15.99:0/2689328942 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe08c009530 con 0x7fe0a40fc780 2024-09-19T07:02:40.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.199+0000 7fe0a9622640 1 -- 172.21.15.99:0/2689328942 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0a410d430 con 0x7fe0a40fc780 2024-09-19T07:02:40.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.200+0000 7fe0a9622640 1 -- 172.21.15.99:0/2689328942 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0a410d950 con 0x7fe0a40fc780 2024-09-19T07:02:40.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.201+0000 7fe0a9622640 1 -- 172.21.15.99:0/2689328942 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0a40fc320 con 0x7fe0a40fc780 2024-09-19T07:02:40.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.201+0000 7fe09b7fe640 1 -- 172.21.15.99:0/2689328942 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fe08c009690 con 0x7fe0a40fc780 2024-09-19T07:02:40.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.201+0000 7fe09b7fe640 1 --2- 172.21.15.99:0/2689328942 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe09006e530 0x7fe0900709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:40.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.202+0000 7fe09b7fe640 1 -- 172.21.15.99:0/2689328942 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fe08c08dab0 con 0x7fe0a40fc780 2024-09-19T07:02:40.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.202+0000 7fe0a2ffd640 1 --2- 172.21.15.99:0/2689328942 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe09006e530 0x7fe0900709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:40.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.202+0000 7fe0a2ffd640 1 --2- 172.21.15.99:0/2689328942 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe09006e530 0x7fe0900709e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe09c02a8b0 tx=0x7fe09c004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:40.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.206+0000 7fe09b7fe640 1 -- 172.21.15.99:0/2689328942 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fe08c056c20 con 0x7fe0a40fc780 2024-09-19T07:02:40.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.406+0000 7fe0a9622640 1 -- 172.21.15.99:0/2689328942 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe0a410e840 con 0x7fe0a40fc780 2024-09-19T07:02:40.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.407+0000 7fe09b7fe640 1 -- 172.21.15.99:0/2689328942 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 29 v29) v1 ==== 76+0+1915 (secure 0 0 0) 0x7fe08c05a2e0 con 0x7fe0a40fc780 2024-09-19T07:02:40.408 INFO:teuthology.orchestra.run.smithi099.stdout:e29 2024-09-19T07:02:40.408 INFO:teuthology.orchestra.run.smithi099.stdout:btime 2024-09-19T06:48:47:938420+0000 2024-09-19T07:02:40.408 INFO:teuthology.orchestra.run.smithi099.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T07:02:40.408 INFO:teuthology.orchestra.run.smithi099.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T07:02:40.408 INFO:teuthology.orchestra.run.smithi099.stdout:legacy client fscid: 1 2024-09-19T07:02:40.409 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T07:02:40.409 INFO:teuthology.orchestra.run.smithi099.stdout:Filesystem 'cephfs' (1) 2024-09-19T07:02:40.409 INFO:teuthology.orchestra.run.smithi099.stdout:fs_name cephfs 2024-09-19T07:02:40.409 INFO:teuthology.orchestra.run.smithi099.stdout:epoch 20 2024-09-19T07:02:40.409 INFO:teuthology.orchestra.run.smithi099.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-19T07:02:40.409 INFO:teuthology.orchestra.run.smithi099.stdout:created 2024-09-19T06:37:40.838146+0000 2024-09-19T07:02:40.409 INFO:teuthology.orchestra.run.smithi099.stdout:modified 2024-09-19T06:47:50.076553+0000 2024-09-19T07:02:40.409 INFO:teuthology.orchestra.run.smithi099.stdout:tableserver 0 2024-09-19T07:02:40.409 INFO:teuthology.orchestra.run.smithi099.stdout:root 0 2024-09-19T07:02:40.409 INFO:teuthology.orchestra.run.smithi099.stdout:session_timeout 60 2024-09-19T07:02:40.409 INFO:teuthology.orchestra.run.smithi099.stdout:session_autoclose 300 2024-09-19T07:02:40.409 INFO:teuthology.orchestra.run.smithi099.stdout:max_file_size 1099511627776 2024-09-19T07:02:40.409 INFO:teuthology.orchestra.run.smithi099.stdout:max_xattr_size 65536 2024-09-19T07:02:40.410 INFO:teuthology.orchestra.run.smithi099.stdout:required_client_features {} 2024-09-19T07:02:40.410 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure 0 2024-09-19T07:02:40.410 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure_osd_epoch 77 2024-09-19T07:02:40.410 INFO:teuthology.orchestra.run.smithi099.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T07:02:40.410 INFO:teuthology.orchestra.run.smithi099.stdout:max_mds 2 2024-09-19T07:02:40.410 INFO:teuthology.orchestra.run.smithi099.stdout:in 0,1 2024-09-19T07:02:40.410 INFO:teuthology.orchestra.run.smithi099.stdout:up {} 2024-09-19T07:02:40.410 INFO:teuthology.orchestra.run.smithi099.stdout:failed 0,1 2024-09-19T07:02:40.410 INFO:teuthology.orchestra.run.smithi099.stdout:damaged 2024-09-19T07:02:40.410 INFO:teuthology.orchestra.run.smithi099.stdout:stopped 2024-09-19T07:02:40.410 INFO:teuthology.orchestra.run.smithi099.stdout:data_pools [3] 2024-09-19T07:02:40.410 INFO:teuthology.orchestra.run.smithi099.stdout:metadata_pool 2 2024-09-19T07:02:40.410 INFO:teuthology.orchestra.run.smithi099.stdout:inline_data disabled 2024-09-19T07:02:40.411 INFO:teuthology.orchestra.run.smithi099.stdout:balancer 2024-09-19T07:02:40.411 INFO:teuthology.orchestra.run.smithi099.stdout:bal_rank_mask -1 2024-09-19T07:02:40.411 INFO:teuthology.orchestra.run.smithi099.stdout:standby_count_wanted 1 2024-09-19T07:02:40.411 INFO:teuthology.orchestra.run.smithi099.stdout:qdb_cluster leader: 0 members: 2024-09-19T07:02:40.411 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T07:02:40.411 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T07:02:40.411 INFO:teuthology.orchestra.run.smithi099.stdout:Standby daemons: 2024-09-19T07:02:40.411 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T07:02:40.411 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.obarqf{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6826/1859154203,v1:172.21.15.99:6827/1859154203] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:02:40.411 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.xehbxe{-1:34410} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6828/1939453719,v1:172.21.15.99:6829/1939453719] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:02:40.411 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.nooexo{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6824/1398895079,v1:172.21.15.117:6825/1398895079] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:02:40.411 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.bheqzh{-1:44329} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6826/3233337308,v1:172.21.15.117:6827/3233337308] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:02:40.412 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 29 2024-09-19T07:02:40.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.409+0000 7fe0a9622640 1 -- 172.21.15.99:0/2689328942 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe09006e530 msgr2=0x7fe0900709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:40.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.409+0000 7fe0a9622640 1 --2- 172.21.15.99:0/2689328942 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe09006e530 0x7fe0900709e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe09c02a8b0 tx=0x7fe09c004d10 comp rx=0 tx=0).stop 2024-09-19T07:02:40.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.409+0000 7fe0a9622640 1 -- 172.21.15.99:0/2689328942 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe0a40fc780 msgr2=0x7fe0a4113710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:40.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.409+0000 7fe0a9622640 1 --2- 172.21.15.99:0/2689328942 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe0a40fc780 0x7fe0a4113710 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fe08c002a80 tx=0x7fe08c004600 comp rx=0 tx=0).stop 2024-09-19T07:02:40.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.409+0000 7fe0a9622640 1 -- 172.21.15.99:0/2689328942 shutdown_connections 2024-09-19T07:02:40.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.409+0000 7fe0a9622640 1 --2- 172.21.15.99:0/2689328942 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe09006e530 0x7fe0900709e0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:40.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.409+0000 7fe0a9622640 1 --2- 172.21.15.99:0/2689328942 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe0a40fc780 0x7fe0a4113710 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:40.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.409+0000 7fe0a9622640 1 --2- 172.21.15.99:0/2689328942 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe0a40fb000 0x7fe0a41131d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:40.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.409+0000 7fe0a9622640 1 -- 172.21.15.99:0/2689328942 >> 172.21.15.99:0/2689328942 conn(0x7fe0a4071b00 msgr2=0x7fe0a4103a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:40.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.409+0000 7fe0a9622640 1 -- 172.21.15.99:0/2689328942 shutdown_connections 2024-09-19T07:02:40.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.409+0000 7fe0a9622640 1 -- 172.21.15.99:0/2689328942 wait complete. 2024-09-19T07:02:40.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:02:40 smithi099 ceph-mon[97031]: pgmap v609: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:02:40.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:02:40 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/2152814933' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T07:02:40.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.492+0000 7eff86778640 1 -- 172.21.15.99:0/3711222713 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff80064fe0 msgr2=0x7eff80065430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:40.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.492+0000 7eff86778640 1 --2- 172.21.15.99:0/3711222713 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff80064fe0 0x7eff80065430 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7eff680048d0 tx=0x7eff68009da0 comp rx=0 tx=0).stop 2024-09-19T07:02:40.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.492+0000 7eff86778640 1 -- 172.21.15.99:0/3711222713 shutdown_connections 2024-09-19T07:02:40.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.492+0000 7eff86778640 1 --2- 172.21.15.99:0/3711222713 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff80064fe0 0x7eff80065430 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:40.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.492+0000 7eff86778640 1 --2- 172.21.15.99:0/3711222713 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff800fe450 0x7eff800fe820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:40.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.492+0000 7eff86778640 1 -- 172.21.15.99:0/3711222713 >> 172.21.15.99:0/3711222713 conn(0x7eff800723b0 msgr2=0x7eff800727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:40.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.492+0000 7eff86778640 1 -- 172.21.15.99:0/3711222713 shutdown_connections 2024-09-19T07:02:40.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.492+0000 7eff86778640 1 -- 172.21.15.99:0/3711222713 wait complete. 2024-09-19T07:02:40.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.492+0000 7eff86778640 1 Processor -- start 2024-09-19T07:02:40.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.493+0000 7eff86778640 1 -- start start 2024-09-19T07:02:40.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.493+0000 7eff86778640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff80064fe0 0x7eff80113220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:40.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.493+0000 7eff86778640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff800fe450 0x7eff80113760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:40.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.493+0000 7eff86778640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff80113d60 con 0x7eff800fe450 2024-09-19T07:02:40.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.493+0000 7eff86778640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff8010d1a0 con 0x7eff80064fe0 2024-09-19T07:02:40.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.493+0000 7eff7f7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff800fe450 0x7eff80113760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:40.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.493+0000 7eff7f7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff800fe450 0x7eff80113760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41512/0 (socket says 172.21.15.99:41512) 2024-09-19T07:02:40.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.493+0000 7eff7f7fe640 1 -- 172.21.15.99:0/1035584881 learned_addr learned my addr 172.21.15.99:0/1035584881 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:02:40.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.493+0000 7eff7ffff640 1 --2- 172.21.15.99:0/1035584881 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff80064fe0 0x7eff80113220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:40.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.493+0000 7eff7f7fe640 1 -- 172.21.15.99:0/1035584881 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff80064fe0 msgr2=0x7eff80113220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:40.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.493+0000 7eff7f7fe640 1 --2- 172.21.15.99:0/1035584881 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff80064fe0 0x7eff80113220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:40.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.493+0000 7eff7f7fe640 1 -- 172.21.15.99:0/1035584881 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff68005040 con 0x7eff800fe450 2024-09-19T07:02:40.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.493+0000 7eff7f7fe640 1 --2- 172.21.15.99:0/1035584881 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff800fe450 0x7eff80113760 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7eff68000c00 tx=0x7eff68009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:40.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.494+0000 7eff7cff9640 1 -- 172.21.15.99:0/1035584881 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff68038070 con 0x7eff800fe450 2024-09-19T07:02:40.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.494+0000 7eff7cff9640 1 -- 172.21.15.99:0/1035584881 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7eff6802ade0 con 0x7eff800fe450 2024-09-19T07:02:40.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.494+0000 7eff7cff9640 1 -- 172.21.15.99:0/1035584881 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff6802c7b0 con 0x7eff800fe450 2024-09-19T07:02:40.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.494+0000 7eff86778640 1 -- 172.21.15.99:0/1035584881 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff8010d420 con 0x7eff800fe450 2024-09-19T07:02:40.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.494+0000 7eff86778640 1 -- 172.21.15.99:0/1035584881 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff8010d8e0 con 0x7eff800fe450 2024-09-19T07:02:40.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.495+0000 7eff86778640 1 -- 172.21.15.99:0/1035584881 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff800fdce0 con 0x7eff800fe450 2024-09-19T07:02:40.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.495+0000 7eff7cff9640 1 -- 172.21.15.99:0/1035584881 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7eff68030020 con 0x7eff800fe450 2024-09-19T07:02:40.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.496+0000 7eff7cff9640 1 --2- 172.21.15.99:0/1035584881 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7eff6c06e530 0x7eff6c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:40.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.496+0000 7eff7cff9640 1 -- 172.21.15.99:0/1035584881 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7eff680ae680 con 0x7eff800fe450 2024-09-19T07:02:40.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.496+0000 7eff7ffff640 1 --2- 172.21.15.99:0/1035584881 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7eff6c06e530 0x7eff6c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:40.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.496+0000 7eff7ffff640 1 --2- 172.21.15.99:0/1035584881 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7eff6c06e530 0x7eff6c0709e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7eff700049b0 tx=0x7eff7000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:40.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.500+0000 7eff7cff9640 1 -- 172.21.15.99:0/1035584881 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7eff68077770 con 0x7eff800fe450 2024-09-19T07:02:40.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:02:40 smithi117 ceph-mon[76771]: pgmap v609: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:02:40.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:02:40 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/2152814933' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T07:02:40.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.682+0000 7eff86778640 1 -- 172.21.15.99:0/1035584881 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7eff8010e890 con 0x7eff6c06e530 2024-09-19T07:02:40.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.684+0000 7eff7cff9640 1 -- 172.21.15.99:0/1035584881 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7eff8010e890 con 0x7eff6c06e530 2024-09-19T07:02:40.685 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T07:02:40.685 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T07:02:40.685 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": true, 2024-09-19T07:02:40.685 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T07:02:40.685 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [ 2024-09-19T07:02:40.685 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr", 2024-09-19T07:02:40.685 INFO:teuthology.orchestra.run.smithi099.stdout: "crash", 2024-09-19T07:02:40.685 INFO:teuthology.orchestra.run.smithi099.stdout: "mds", 2024-09-19T07:02:40.685 INFO:teuthology.orchestra.run.smithi099.stdout: "mon", 2024-09-19T07:02:40.685 INFO:teuthology.orchestra.run.smithi099.stdout: "osd" 2024-09-19T07:02:40.685 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-19T07:02:40.685 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": "16/21 daemons upgraded", 2024-09-19T07:02:40.686 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "Currently upgrading mds daemons", 2024-09-19T07:02:40.686 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-09-19T07:02:40.686 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T07:02:40.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.686+0000 7eff86778640 1 -- 172.21.15.99:0/1035584881 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7eff6c06e530 msgr2=0x7eff6c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:40.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.686+0000 7eff86778640 1 --2- 172.21.15.99:0/1035584881 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7eff6c06e530 0x7eff6c0709e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7eff700049b0 tx=0x7eff7000b040 comp rx=0 tx=0).stop 2024-09-19T07:02:40.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.686+0000 7eff86778640 1 -- 172.21.15.99:0/1035584881 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff800fe450 msgr2=0x7eff80113760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:40.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.686+0000 7eff86778640 1 --2- 172.21.15.99:0/1035584881 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff800fe450 0x7eff80113760 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7eff68000c00 tx=0x7eff68009da0 comp rx=0 tx=0).stop 2024-09-19T07:02:40.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.686+0000 7eff86778640 1 -- 172.21.15.99:0/1035584881 shutdown_connections 2024-09-19T07:02:40.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.686+0000 7eff86778640 1 --2- 172.21.15.99:0/1035584881 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7eff6c06e530 0x7eff6c0709e0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:40.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.686+0000 7eff86778640 1 --2- 172.21.15.99:0/1035584881 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff800fe450 0x7eff80113760 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:40.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.686+0000 7eff86778640 1 --2- 172.21.15.99:0/1035584881 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff80064fe0 0x7eff80113220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:40.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.686+0000 7eff86778640 1 -- 172.21.15.99:0/1035584881 >> 172.21.15.99:0/1035584881 conn(0x7eff800723b0 msgr2=0x7eff80105390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:40.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.686+0000 7eff86778640 1 -- 172.21.15.99:0/1035584881 shutdown_connections 2024-09-19T07:02:40.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.686+0000 7eff86778640 1 -- 172.21.15.99:0/1035584881 wait complete. 2024-09-19T07:02:40.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.764+0000 7f8454038640 1 -- 172.21.15.99:0/2978605507 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f844c0fcf80 msgr2=0x7f844c0fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:40.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.764+0000 7f8454038640 1 --2- 172.21.15.99:0/2978605507 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f844c0fcf80 0x7f844c0fd3d0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f84400048d0 tx=0x7f8440009da0 comp rx=0 tx=0).stop 2024-09-19T07:02:40.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.764+0000 7f8454038640 1 -- 172.21.15.99:0/2978605507 shutdown_connections 2024-09-19T07:02:40.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.764+0000 7f8454038640 1 --2- 172.21.15.99:0/2978605507 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f844c0fcf80 0x7f844c0fd3d0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:40.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.764+0000 7f8454038640 1 --2- 172.21.15.99:0/2978605507 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f844c0fb810 0x7f844c0fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:40.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.765+0000 7f8454038640 1 -- 172.21.15.99:0/2978605507 >> 172.21.15.99:0/2978605507 conn(0x7f844c0723b0 msgr2=0x7f844c0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:40.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.765+0000 7f8454038640 1 -- 172.21.15.99:0/2978605507 shutdown_connections 2024-09-19T07:02:40.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.765+0000 7f8454038640 1 -- 172.21.15.99:0/2978605507 wait complete. 2024-09-19T07:02:40.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.765+0000 7f8454038640 1 Processor -- start 2024-09-19T07:02:40.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.765+0000 7f8454038640 1 -- start start 2024-09-19T07:02:40.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.766+0000 7f8454038640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f844c0fb810 0x7f844c112140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:40.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.766+0000 7f8454038640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f844c0fcf80 0x7f844c112680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:40.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.766+0000 7f8454038640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f844c112d10 con 0x7f844c0fb810 2024-09-19T07:02:40.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.766+0000 7f8454038640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f844c10c100 con 0x7f844c0fcf80 2024-09-19T07:02:40.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.766+0000 7f8451dd4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f844c0fb810 0x7f844c112140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:40.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.766+0000 7f8451dd4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f844c0fb810 0x7f844c112140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41532/0 (socket says 172.21.15.99:41532) 2024-09-19T07:02:40.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.766+0000 7f8451dd4640 1 -- 172.21.15.99:0/1019100104 learned_addr learned my addr 172.21.15.99:0/1019100104 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:02:40.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.766+0000 7f84515d3640 1 --2- 172.21.15.99:0/1019100104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f844c0fcf80 0x7f844c112680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:40.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.766+0000 7f8451dd4640 1 -- 172.21.15.99:0/1019100104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f844c0fcf80 msgr2=0x7f844c112680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:40.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.766+0000 7f8451dd4640 1 --2- 172.21.15.99:0/1019100104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f844c0fcf80 0x7f844c112680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:40.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.766+0000 7f8451dd4640 1 -- 172.21.15.99:0/1019100104 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8440005040 con 0x7f844c0fb810 2024-09-19T07:02:40.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.766+0000 7f8451dd4640 1 --2- 172.21.15.99:0/1019100104 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f844c0fb810 0x7f844c112140 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f843c00bbb0 tx=0x7f843c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:40.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.766+0000 7f844a7fc640 1 -- 172.21.15.99:0/1019100104 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f843c00c940 con 0x7f844c0fb810 2024-09-19T07:02:40.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.766+0000 7f8454038640 1 -- 172.21.15.99:0/1019100104 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f844c10c3e0 con 0x7f844c0fb810 2024-09-19T07:02:40.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.767+0000 7f844a7fc640 1 -- 172.21.15.99:0/1019100104 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f843c0092e0 con 0x7f844c0fb810 2024-09-19T07:02:40.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.767+0000 7f844a7fc640 1 -- 172.21.15.99:0/1019100104 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f843c007640 con 0x7f844c0fb810 2024-09-19T07:02:40.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.767+0000 7f8454038640 1 -- 172.21.15.99:0/1019100104 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f844c10c8d0 con 0x7f844c0fb810 2024-09-19T07:02:40.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.768+0000 7f8454038640 1 -- 172.21.15.99:0/1019100104 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f844c0fcbc0 con 0x7f844c0fb810 2024-09-19T07:02:40.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.769+0000 7f844a7fc640 1 -- 172.21.15.99:0/1019100104 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f843c012070 con 0x7f844c0fb810 2024-09-19T07:02:40.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.769+0000 7f844a7fc640 1 --2- 172.21.15.99:0/1019100104 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f843406e530 0x7f84340709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:02:40.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.769+0000 7f844a7fc640 1 -- 172.21.15.99:0/1019100104 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f843c08e230 con 0x7f844c0fb810 2024-09-19T07:02:40.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.769+0000 7f84515d3640 1 --2- 172.21.15.99:0/1019100104 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f843406e530 0x7f84340709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:02:40.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.770+0000 7f84515d3640 1 --2- 172.21.15.99:0/1019100104 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f843406e530 0x7f84340709e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8440009ac0 tx=0x7f8440035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:02:40.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:40.774+0000 7f844a7fc640 1 -- 172.21.15.99:0/1019100104 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f843c057320 con 0x7f844c0fb810 2024-09-19T07:02:41.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:41.007+0000 7f8454038640 1 -- 172.21.15.99:0/1019100104 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f844c072ec0 con 0x7f844c0fb810 2024-09-19T07:02:41.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:41.008+0000 7f844a7fc640 1 -- 172.21.15.99:0/1019100104 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7f843c05a9e0 con 0x7f844c0fb810 2024-09-19T07:02:41.009 INFO:teuthology.orchestra.run.smithi099.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-09-19T07:02:41.009 INFO:teuthology.orchestra.run.smithi099.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-19T07:02:41.009 INFO:teuthology.orchestra.run.smithi099.stdout: fs cephfs is degraded 2024-09-19T07:02:41.009 INFO:teuthology.orchestra.run.smithi099.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-19T07:02:41.009 INFO:teuthology.orchestra.run.smithi099.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-19T07:02:41.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:41.009+0000 7f8454038640 1 -- 172.21.15.99:0/1019100104 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f843406e530 msgr2=0x7f84340709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:41.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:41.009+0000 7f8454038640 1 --2- 172.21.15.99:0/1019100104 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f843406e530 0x7f84340709e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8440009ac0 tx=0x7f8440035040 comp rx=0 tx=0).stop 2024-09-19T07:02:41.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:41.010+0000 7f8454038640 1 -- 172.21.15.99:0/1019100104 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f844c0fb810 msgr2=0x7f844c112140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:02:41.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:41.010+0000 7f8454038640 1 --2- 172.21.15.99:0/1019100104 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f844c0fb810 0x7f844c112140 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f843c00bbb0 tx=0x7f843c009840 comp rx=0 tx=0).stop 2024-09-19T07:02:41.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:41.010+0000 7f8454038640 1 -- 172.21.15.99:0/1019100104 shutdown_connections 2024-09-19T07:02:41.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:41.010+0000 7f8454038640 1 --2- 172.21.15.99:0/1019100104 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f843406e530 0x7f84340709e0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:41.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:41.010+0000 7f8454038640 1 --2- 172.21.15.99:0/1019100104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f844c0fcf80 0x7f844c112680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:41.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:41.010+0000 7f8454038640 1 --2- 172.21.15.99:0/1019100104 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f844c0fb810 0x7f844c112140 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:02:41.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:41.010+0000 7f8454038640 1 -- 172.21.15.99:0/1019100104 >> 172.21.15.99:0/1019100104 conn(0x7f844c0723b0 msgr2=0x7f844c0fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:02:41.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:41.010+0000 7f8454038640 1 -- 172.21.15.99:0/1019100104 shutdown_connections 2024-09-19T07:02:41.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:02:41.010+0000 7f8454038640 1 -- 172.21.15.99:0/1019100104 wait complete. 2024-09-19T07:02:41.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:02:41 smithi099 ceph-mon[97031]: from='client.35146 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:02:41.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:02:41 smithi099 ceph-mon[97031]: from='client.35150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:02:41.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:02:41 smithi099 ceph-mon[97031]: from='client.35154 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:02:41.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:02:41 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/2689328942' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T07:02:41.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:02:41 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/1019100104' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T07:02:41.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:02:41 smithi117 ceph-mon[76771]: from='client.35146 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:02:41.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:02:41 smithi117 ceph-mon[76771]: from='client.35150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:02:41.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:02:41 smithi117 ceph-mon[76771]: from='client.35154 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:02:41.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:02:41 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/2689328942' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T07:02:41.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:02:41 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/1019100104' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T07:02:42.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:02:42 smithi099 ceph-mon[97031]: from='client.35166 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:02:42.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:02:42 smithi099 ceph-mon[97031]: pgmap v610: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:02:42.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:02:42 smithi117 ceph-mon[76771]: from='client.35166 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:02:42.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:02:42 smithi117 ceph-mon[76771]: pgmap v610: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:02:43.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:02:43 smithi099 ceph-mon[97031]: pgmap v611: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:02:43.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:02:43 smithi117 ceph-mon[76771]: pgmap v611: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:02:46.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:02:46 smithi099 ceph-mon[97031]: pgmap v612: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:02:46.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:02:46 smithi117 ceph-mon[76771]: pgmap v612: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:02:48.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:02:48 smithi099 ceph-mon[97031]: pgmap v613: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:02:48.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:02:48 smithi117 ceph-mon[76771]: pgmap v613: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:02:50.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:02:50 smithi099 ceph-mon[97031]: pgmap v614: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:02:50.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:02:50 smithi117 ceph-mon[76771]: pgmap v614: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:02:52.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:02:52 smithi099 ceph-mon[97031]: pgmap v615: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:02:52.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:02:52 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:02:52.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:02:52 smithi117 ceph-mon[76771]: pgmap v615: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:02:52.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:02:52 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:02:54.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:02:54 smithi099 ceph-mon[97031]: pgmap v616: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:02:54.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:02:54 smithi117 ceph-mon[76771]: pgmap v616: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:02:56.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:02:56 smithi099 ceph-mon[97031]: pgmap v617: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:02:56.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:02:56 smithi117 ceph-mon[76771]: pgmap v617: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:02:58.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:02:58 smithi099 ceph-mon[97031]: pgmap v618: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:02:58.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:02:58 smithi117 ceph-mon[76771]: pgmap v618: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:03:00.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:00 smithi099 ceph-mon[97031]: pgmap v619: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:03:00.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:00 smithi117 ceph-mon[76771]: pgmap v619: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:03:01.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:01 smithi117 ceph-mon[76771]: pgmap v620: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:03:01.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:01 smithi099 ceph-mon[97031]: pgmap v620: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:03:04.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:04 smithi099 ceph-mon[97031]: pgmap v621: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:03:04.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:04 smithi117 ceph-mon[76771]: pgmap v621: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:03:06.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:06 smithi099 ceph-mon[97031]: pgmap v622: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:03:06.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:06 smithi117 ceph-mon[76771]: pgmap v622: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:03:07.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:07 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:03:07.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:07 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:03:08.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:08 smithi099 ceph-mon[97031]: pgmap v623: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:03:08.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:08 smithi117 ceph-mon[76771]: pgmap v623: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:03:10.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:10 smithi099 ceph-mon[97031]: pgmap v624: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:03:10.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:10 smithi117 ceph-mon[76771]: pgmap v624: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:03:11.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.100+0000 7fb95e66a640 1 -- 172.21.15.99:0/416644053 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb958102550 msgr2=0x7fb958102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:11.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.100+0000 7fb95e66a640 1 --2- 172.21.15.99:0/416644053 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb958102550 0x7fb958102920 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fb9480048d0 tx=0x7fb948009da0 comp rx=0 tx=0).stop 2024-09-19T07:03:11.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.100+0000 7fb95e66a640 1 -- 172.21.15.99:0/416644053 shutdown_connections 2024-09-19T07:03:11.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.100+0000 7fb95e66a640 1 --2- 172.21.15.99:0/416644053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb958102ef0 0x7fb9580fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:11.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.100+0000 7fb95e66a640 1 --2- 172.21.15.99:0/416644053 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb958102550 0x7fb958102920 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:11.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.100+0000 7fb95e66a640 1 -- 172.21.15.99:0/416644053 >> 172.21.15.99:0/416644053 conn(0x7fb9580f80f0 msgr2=0x7fb9580fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:03:11.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.100+0000 7fb95e66a640 1 -- 172.21.15.99:0/416644053 shutdown_connections 2024-09-19T07:03:11.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.100+0000 7fb95e66a640 1 -- 172.21.15.99:0/416644053 wait complete. 2024-09-19T07:03:11.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.101+0000 7fb95e66a640 1 Processor -- start 2024-09-19T07:03:11.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.101+0000 7fb95e66a640 1 -- start start 2024-09-19T07:03:11.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.101+0000 7fb95e66a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb958102550 0x7fb958113540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:11.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.101+0000 7fb95e66a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb958102ef0 0x7fb958113a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:11.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.101+0000 7fb95e66a640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9581140d0 con 0x7fb958102550 2024-09-19T07:03:11.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.101+0000 7fb95e66a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb95810d4e0 con 0x7fb958102ef0 2024-09-19T07:03:11.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.102+0000 7fb9577fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb958102ef0 0x7fb958113a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:11.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.102+0000 7fb9577fe640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb958102ef0 0x7fb958113a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.99:34956/0 (socket says 172.21.15.99:34956) 2024-09-19T07:03:11.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.102+0000 7fb9577fe640 1 -- 172.21.15.99:0/216867621 learned_addr learned my addr 172.21.15.99:0/216867621 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:03:11.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.102+0000 7fb957fff640 1 --2- 172.21.15.99:0/216867621 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb958102550 0x7fb958113540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:11.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.102+0000 7fb957fff640 1 -- 172.21.15.99:0/216867621 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb958102ef0 msgr2=0x7fb958113a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:11.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.102+0000 7fb957fff640 1 --2- 172.21.15.99:0/216867621 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb958102ef0 0x7fb958113a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:11.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.102+0000 7fb957fff640 1 -- 172.21.15.99:0/216867621 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb948005040 con 0x7fb958102550 2024-09-19T07:03:11.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.102+0000 7fb9577fe640 1 --2- 172.21.15.99:0/216867621 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb958102ef0 0x7fb958113a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T07:03:11.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.102+0000 7fb957fff640 1 --2- 172.21.15.99:0/216867621 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb958102550 0x7fb958113540 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fb94802a530 tx=0x7fb948009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:03:11.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.102+0000 7fb954ff9640 1 -- 172.21.15.99:0/216867621 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb948038070 con 0x7fb958102550 2024-09-19T07:03:11.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.102+0000 7fb954ff9640 1 -- 172.21.15.99:0/216867621 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb94802ade0 con 0x7fb958102550 2024-09-19T07:03:11.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.102+0000 7fb95e66a640 1 -- 172.21.15.99:0/216867621 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb95810d760 con 0x7fb958102550 2024-09-19T07:03:11.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.102+0000 7fb954ff9640 1 -- 172.21.15.99:0/216867621 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb94802c770 con 0x7fb958102550 2024-09-19T07:03:11.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.102+0000 7fb95e66a640 1 -- 172.21.15.99:0/216867621 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb95810dca0 con 0x7fb958102550 2024-09-19T07:03:11.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.104+0000 7fb95e66a640 1 -- 172.21.15.99:0/216867621 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9580fdcd0 con 0x7fb958102550 2024-09-19T07:03:11.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.104+0000 7fb954ff9640 1 -- 172.21.15.99:0/216867621 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fb948030020 con 0x7fb958102550 2024-09-19T07:03:11.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.104+0000 7fb954ff9640 1 --2- 172.21.15.99:0/216867621 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fb94006e530 0x7fb9400709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:11.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.105+0000 7fb954ff9640 1 -- 172.21.15.99:0/216867621 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fb9480ae440 con 0x7fb958102550 2024-09-19T07:03:11.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.105+0000 7fb9577fe640 1 --2- 172.21.15.99:0/216867621 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fb94006e530 0x7fb9400709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:11.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.105+0000 7fb9577fe640 1 --2- 172.21.15.99:0/216867621 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fb94006e530 0x7fb9400709e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb94c004fd0 tx=0x7fb94c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:03:11.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.109+0000 7fb954ff9640 1 -- 172.21.15.99:0/216867621 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fb9480775b0 con 0x7fb958102550 2024-09-19T07:03:11.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.292+0000 7fb95e66a640 1 -- 172.21.15.99:0/216867621 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb95804b720 con 0x7fb94006e530 2024-09-19T07:03:11.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.293+0000 7fb954ff9640 1 -- 172.21.15.99:0/216867621 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fb95804b720 con 0x7fb94006e530 2024-09-19T07:03:11.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.296+0000 7fb95e66a640 1 -- 172.21.15.99:0/216867621 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fb94006e530 msgr2=0x7fb9400709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:11.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.296+0000 7fb95e66a640 1 --2- 172.21.15.99:0/216867621 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fb94006e530 0x7fb9400709e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb94c004fd0 tx=0x7fb94c00b040 comp rx=0 tx=0).stop 2024-09-19T07:03:11.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.296+0000 7fb95e66a640 1 -- 172.21.15.99:0/216867621 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb958102550 msgr2=0x7fb958113540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:11.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.296+0000 7fb95e66a640 1 --2- 172.21.15.99:0/216867621 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb958102550 0x7fb958113540 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fb94802a530 tx=0x7fb948009da0 comp rx=0 tx=0).stop 2024-09-19T07:03:11.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.296+0000 7fb95e66a640 1 -- 172.21.15.99:0/216867621 shutdown_connections 2024-09-19T07:03:11.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.296+0000 7fb95e66a640 1 --2- 172.21.15.99:0/216867621 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fb94006e530 0x7fb9400709e0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:11.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.296+0000 7fb95e66a640 1 --2- 172.21.15.99:0/216867621 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb958102ef0 0x7fb958113a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:11.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.296+0000 7fb95e66a640 1 --2- 172.21.15.99:0/216867621 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb958102550 0x7fb958113540 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:11.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.296+0000 7fb95e66a640 1 -- 172.21.15.99:0/216867621 >> 172.21.15.99:0/216867621 conn(0x7fb9580f80f0 msgr2=0x7fb9580f9160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:03:11.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.296+0000 7fb95e66a640 1 -- 172.21.15.99:0/216867621 shutdown_connections 2024-09-19T07:03:11.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.296+0000 7fb95e66a640 1 -- 172.21.15.99:0/216867621 wait complete. 2024-09-19T07:03:11.305 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-09-19T07:03:11.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.376+0000 7f20e3785640 1 -- 172.21.15.99:0/103293423 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f20dc102550 msgr2=0x7f20dc102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:11.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.376+0000 7f20e3785640 1 --2- 172.21.15.99:0/103293423 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f20dc102550 0x7f20dc102920 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f20d80048d0 tx=0x7f20d8009da0 comp rx=0 tx=0).stop 2024-09-19T07:03:11.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.376+0000 7f20e3785640 1 -- 172.21.15.99:0/103293423 shutdown_connections 2024-09-19T07:03:11.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.376+0000 7f20e3785640 1 --2- 172.21.15.99:0/103293423 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20dc102ef0 0x7f20dc0fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:11.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.376+0000 7f20e3785640 1 --2- 172.21.15.99:0/103293423 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f20dc102550 0x7f20dc102920 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:11.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.376+0000 7f20e3785640 1 -- 172.21.15.99:0/103293423 >> 172.21.15.99:0/103293423 conn(0x7f20dc0f80f0 msgr2=0x7f20dc0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:03:11.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.376+0000 7f20e3785640 1 -- 172.21.15.99:0/103293423 shutdown_connections 2024-09-19T07:03:11.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.376+0000 7f20e3785640 1 -- 172.21.15.99:0/103293423 wait complete. 2024-09-19T07:03:11.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.377+0000 7f20e3785640 1 Processor -- start 2024-09-19T07:03:11.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.377+0000 7f20e3785640 1 -- start start 2024-09-19T07:03:11.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.377+0000 7f20e3785640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20dc102550 0x7f20dc06fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:11.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.377+0000 7f20e3785640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f20dc102ef0 0x7f20dc06ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:11.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.377+0000 7f20e3785640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20dc070520 con 0x7f20dc102ef0 2024-09-19T07:03:11.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.377+0000 7f20e3785640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20dc070690 con 0x7f20dc102550 2024-09-19T07:03:11.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.377+0000 7f20e0d20640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f20dc102ef0 0x7f20dc06ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:11.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.377+0000 7f20e0d20640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f20dc102ef0 0x7f20dc06ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47500/0 (socket says 172.21.15.99:47500) 2024-09-19T07:03:11.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.377+0000 7f20e0d20640 1 -- 172.21.15.99:0/3554798864 learned_addr learned my addr 172.21.15.99:0/3554798864 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:03:11.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.377+0000 7f20e1521640 1 --2- 172.21.15.99:0/3554798864 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20dc102550 0x7f20dc06fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:11.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.377+0000 7f20e0d20640 1 -- 172.21.15.99:0/3554798864 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20dc102550 msgr2=0x7f20dc06fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:11.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.377+0000 7f20e0d20640 1 --2- 172.21.15.99:0/3554798864 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20dc102550 0x7f20dc06fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:11.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.377+0000 7f20e0d20640 1 -- 172.21.15.99:0/3554798864 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d8005040 con 0x7f20dc102ef0 2024-09-19T07:03:11.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.378+0000 7f20e0d20640 1 --2- 172.21.15.99:0/3554798864 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f20dc102ef0 0x7f20dc06ff50 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f20cc00b540 tx=0x7f20cc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:03:11.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.378+0000 7f20d1ffb640 1 -- 172.21.15.99:0/3554798864 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20cc00f6f0 con 0x7f20dc102ef0 2024-09-19T07:03:11.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.378+0000 7f20d1ffb640 1 -- 172.21.15.99:0/3554798864 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f20cc00fcf0 con 0x7f20dc102ef0 2024-09-19T07:03:11.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.378+0000 7f20e3785640 1 -- 172.21.15.99:0/3554798864 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20dc1198d0 con 0x7f20dc102ef0 2024-09-19T07:03:11.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.378+0000 7f20d1ffb640 1 -- 172.21.15.99:0/3554798864 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20cc0103a0 con 0x7f20dc102ef0 2024-09-19T07:03:11.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.378+0000 7f20e3785640 1 -- 172.21.15.99:0/3554798864 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20dc119d10 con 0x7f20dc102ef0 2024-09-19T07:03:11.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.379+0000 7f20e3785640 1 -- 172.21.15.99:0/3554798864 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20dc0fdcd0 con 0x7f20dc102ef0 2024-09-19T07:03:11.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.379+0000 7f20d1ffb640 1 -- 172.21.15.99:0/3554798864 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f20cc00f850 con 0x7f20dc102ef0 2024-09-19T07:03:11.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.380+0000 7f20d1ffb640 1 --2- 172.21.15.99:0/3554798864 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f20c806e530 0x7f20c80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:11.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.380+0000 7f20d1ffb640 1 -- 172.21.15.99:0/3554798864 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f20cc08e000 con 0x7f20dc102ef0 2024-09-19T07:03:11.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.380+0000 7f20e1521640 1 --2- 172.21.15.99:0/3554798864 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f20c806e530 0x7f20c80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:11.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.380+0000 7f20e1521640 1 --2- 172.21.15.99:0/3554798864 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f20c806e530 0x7f20c80709e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f20d8000c00 tx=0x7f20d8035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:03:11.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.384+0000 7f20d1ffb640 1 -- 172.21.15.99:0/3554798864 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f20cc057230 con 0x7f20dc102ef0 2024-09-19T07:03:11.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.565+0000 7f20e3785640 1 -- 172.21.15.99:0/3554798864 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f20dc04b720 con 0x7f20c806e530 2024-09-19T07:03:11.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.566+0000 7f20d1ffb640 1 -- 172.21.15.99:0/3554798864 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f20dc04b720 con 0x7f20c806e530 2024-09-19T07:03:11.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.568+0000 7f20e3785640 1 -- 172.21.15.99:0/3554798864 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f20c806e530 msgr2=0x7f20c80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:11.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.568+0000 7f20e3785640 1 --2- 172.21.15.99:0/3554798864 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f20c806e530 0x7f20c80709e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f20d8000c00 tx=0x7f20d8035040 comp rx=0 tx=0).stop 2024-09-19T07:03:11.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.568+0000 7f20e3785640 1 -- 172.21.15.99:0/3554798864 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f20dc102ef0 msgr2=0x7f20dc06ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:11.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.568+0000 7f20e3785640 1 --2- 172.21.15.99:0/3554798864 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f20dc102ef0 0x7f20dc06ff50 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f20cc00b540 tx=0x7f20cc0091a0 comp rx=0 tx=0).stop 2024-09-19T07:03:11.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.568+0000 7f20e3785640 1 -- 172.21.15.99:0/3554798864 shutdown_connections 2024-09-19T07:03:11.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.568+0000 7f20e3785640 1 --2- 172.21.15.99:0/3554798864 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f20c806e530 0x7f20c80709e0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:11.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.568+0000 7f20e3785640 1 --2- 172.21.15.99:0/3554798864 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f20dc102ef0 0x7f20dc06ff50 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:11.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.568+0000 7f20e3785640 1 --2- 172.21.15.99:0/3554798864 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f20dc102550 0x7f20dc06fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:11.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.568+0000 7f20e3785640 1 -- 172.21.15.99:0/3554798864 >> 172.21.15.99:0/3554798864 conn(0x7f20dc0f80f0 msgr2=0x7f20dc0f9180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:03:11.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.569+0000 7f20e3785640 1 -- 172.21.15.99:0/3554798864 shutdown_connections 2024-09-19T07:03:11.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.569+0000 7f20e3785640 1 -- 172.21.15.99:0/3554798864 wait complete. 2024-09-19T07:03:11.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.647+0000 7f170f3f4640 1 -- 172.21.15.99:0/2222773616 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17081025f0 msgr2=0x7f17081029c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:11.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.647+0000 7f170f3f4640 1 --2- 172.21.15.99:0/2222773616 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17081025f0 0x7f17081029c0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f17040048d0 tx=0x7f1704009da0 comp rx=0 tx=0).stop 2024-09-19T07:03:11.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.647+0000 7f170f3f4640 1 -- 172.21.15.99:0/2222773616 shutdown_connections 2024-09-19T07:03:11.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.647+0000 7f170f3f4640 1 --2- 172.21.15.99:0/2222773616 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17080fac60 0x7f17080fb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:11.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.647+0000 7f170f3f4640 1 --2- 172.21.15.99:0/2222773616 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17081025f0 0x7f17081029c0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:11.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.647+0000 7f170f3f4640 1 -- 172.21.15.99:0/2222773616 >> 172.21.15.99:0/2222773616 conn(0x7f1708070c80 msgr2=0x7f1708071080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:03:11.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.648+0000 7f170f3f4640 1 -- 172.21.15.99:0/2222773616 shutdown_connections 2024-09-19T07:03:11.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.648+0000 7f170f3f4640 1 -- 172.21.15.99:0/2222773616 wait complete. 2024-09-19T07:03:11.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.648+0000 7f170f3f4640 1 Processor -- start 2024-09-19T07:03:11.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.648+0000 7f170f3f4640 1 -- start start 2024-09-19T07:03:11.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.648+0000 7f170f3f4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17080fac60 0x7f1708113230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:11.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.648+0000 7f170f3f4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17081025f0 0x7f1708113770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:11.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.648+0000 7f170f3f4640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1708113d70 con 0x7f17080fac60 2024-09-19T07:03:11.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.648+0000 7f170f3f4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1708113ee0 con 0x7f17081025f0 2024-09-19T07:03:11.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.648+0000 7f170d190640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17080fac60 0x7f1708113230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:11.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.648+0000 7f170d190640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17080fac60 0x7f1708113230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47516/0 (socket says 172.21.15.99:47516) 2024-09-19T07:03:11.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.648+0000 7f170d190640 1 -- 172.21.15.99:0/3711379689 learned_addr learned my addr 172.21.15.99:0/3711379689 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:03:11.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.649+0000 7f170c98f640 1 --2- 172.21.15.99:0/3711379689 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17081025f0 0x7f1708113770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:11.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.649+0000 7f170d190640 1 -- 172.21.15.99:0/3711379689 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17081025f0 msgr2=0x7f1708113770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:11.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.649+0000 7f170d190640 1 --2- 172.21.15.99:0/3711379689 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17081025f0 0x7f1708113770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:11.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.649+0000 7f170d190640 1 -- 172.21.15.99:0/3711379689 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1704005040 con 0x7f17080fac60 2024-09-19T07:03:11.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.649+0000 7f170d190640 1 --2- 172.21.15.99:0/3711379689 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17080fac60 0x7f1708113230 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f1704000c00 tx=0x7f1704009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:03:11.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.649+0000 7f16fdffb640 1 -- 172.21.15.99:0/3711379689 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1704038070 con 0x7f17080fac60 2024-09-19T07:03:11.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.649+0000 7f16fdffb640 1 -- 172.21.15.99:0/3711379689 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f170402ade0 con 0x7f17080fac60 2024-09-19T07:03:11.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.649+0000 7f16fdffb640 1 -- 172.21.15.99:0/3711379689 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f170402c7e0 con 0x7f17080fac60 2024-09-19T07:03:11.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.649+0000 7f170f3f4640 1 -- 172.21.15.99:0/3711379689 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f170810d300 con 0x7f17080fac60 2024-09-19T07:03:11.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.649+0000 7f170f3f4640 1 -- 172.21.15.99:0/3711379689 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f170810d7c0 con 0x7f17080fac60 2024-09-19T07:03:11.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.650+0000 7f170f3f4640 1 -- 172.21.15.99:0/3711379689 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1708065810 con 0x7f17080fac60 2024-09-19T07:03:11.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.651+0000 7f16fdffb640 1 -- 172.21.15.99:0/3711379689 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f1704030020 con 0x7f17080fac60 2024-09-19T07:03:11.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.651+0000 7f16fdffb640 1 --2- 172.21.15.99:0/3711379689 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f16f406e530 0x7f16f40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:11.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.651+0000 7f16fdffb640 1 -- 172.21.15.99:0/3711379689 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f17040add50 con 0x7f17080fac60 2024-09-19T07:03:11.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.652+0000 7f170c98f640 1 --2- 172.21.15.99:0/3711379689 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f16f406e530 0x7f16f40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:11.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.652+0000 7f170c98f640 1 --2- 172.21.15.99:0/3711379689 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f16f406e530 0x7f16f40709e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f16f8007fd0 tx=0x7f16f8009e90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:03:11.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.656+0000 7f16fdffb640 1 -- 172.21.15.99:0/3711379689 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f1704076f70 con 0x7f17080fac60 2024-09-19T07:03:11.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.827+0000 7f170f3f4640 1 -- 172.21.15.99:0/3711379689 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f170810e8e0 con 0x7f16f406e530 2024-09-19T07:03:11.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.836+0000 7f16fdffb640 1 -- 172.21.15.99:0/3711379689 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f170810e8e0 con 0x7f16f406e530 2024-09-19T07:03:11.837 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T07:03:11.837 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.smithi099 smithi099 *:9093,9094 running (22m) 14m ago 30m 23.4M - 0.25.0 c8568f914cd2 e7c1774d56b0 2024-09-19T07:03:11.838 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi099 smithi099 running (18m) 14m ago 30m 6899k - 19.1.1-361-g2f599a46 d2baa855c067 b9775f416b10 2024-09-19T07:03:11.838 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi117 smithi117 running (18m) 14m ago 29m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 38cf60c0d548 2024-09-19T07:03:11.838 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.smithi099 smithi099 *:3000 running (20m) 14m ago 30m 80.7M - 9.4.12 2bacad6d85d8 cd53a18d5410 2024-09-19T07:03:11.838 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.obarqf smithi099 running (15m) 14m ago 25m 12.2M - 19.1.1-361-g2f599a46 d2baa855c067 314a73082521 2024-09-19T07:03:11.838 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.xehbxe smithi099 running (14m) 14m ago 25m 14.4M - 19.1.1-361-g2f599a46 d2baa855c067 a2955a9d06e6 2024-09-19T07:03:11.838 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.bheqzh smithi117 running (14m) 14m ago 25m 11.8M - 19.1.1-361-g2f599a46 d2baa855c067 b1505937c0b7 2024-09-19T07:03:11.838 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.nooexo smithi117 running (14m) 14m ago 25m 13.1M - 19.1.1-361-g2f599a46 d2baa855c067 35bd7725855c 2024-09-19T07:03:11.838 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi099.pgvkqi smithi099 *:8443,9283,8765 running (21m) 14m ago 31m 505M - 19.1.1-361-g2f599a46 d2baa855c067 d5de99cb7e78 2024-09-19T07:03:11.838 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi117.ssmkcf smithi117 *:8443,9283,8765 running (20m) 14m ago 29m 444M - 19.1.1-361-g2f599a46 d2baa855c067 8b7ee0f871f5 2024-09-19T07:03:11.839 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi099 smithi099 running (19m) 14m ago 32m 52.4M 2048M 19.1.1-361-g2f599a46 d2baa855c067 ffe067438824 2024-09-19T07:03:11.839 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi117 smithi117 running (19m) 14m ago 29m 38.9M 2048M 19.1.1-361-g2f599a46 d2baa855c067 4cb7455e3ee7 2024-09-19T07:03:11.839 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi099 smithi099 *:9100 running (22m) 14m ago 30m 15.0M - 1.5.0 0da6a335fe13 dca7b4517dcc 2024-09-19T07:03:11.839 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi117 smithi117 *:9100 running (21m) 14m ago 29m 15.9M - 1.5.0 0da6a335fe13 8233ce3835d2 2024-09-19T07:03:11.839 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (18m) 14m ago 28m 100M 1557M 19.1.1-361-g2f599a46 d2baa855c067 8e22543bf933 2024-09-19T07:03:11.839 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (17m) 14m ago 28m 106M 1557M 19.1.1-361-g2f599a46 d2baa855c067 f54153d0ae09 2024-09-19T07:03:11.839 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (17m) 14m ago 28m 83.7M 1557M 19.1.1-361-g2f599a46 d2baa855c067 b1778ab88870 2024-09-19T07:03:11.839 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi117 running (16m) 14m ago 27m 102M 2581M 19.1.1-361-g2f599a46 d2baa855c067 ea5236b193d3 2024-09-19T07:03:11.839 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi117 running (16m) 14m ago 27m 93.5M 2581M 19.1.1-361-g2f599a46 d2baa855c067 27ac2c859a68 2024-09-19T07:03:11.839 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi117 running (15m) 14m ago 26m 100M 2581M 19.1.1-361-g2f599a46 d2baa855c067 de6aeb8544ce 2024-09-19T07:03:11.839 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.smithi099 smithi099 *:9095 running (21m) 14m ago 30m 64.4M - 2.43.0 a07b618ecd1d 15ad26ec6fb4 2024-09-19T07:03:11.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.838+0000 7f170f3f4640 1 -- 172.21.15.99:0/3711379689 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f16f406e530 msgr2=0x7f16f40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:11.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.838+0000 7f170f3f4640 1 --2- 172.21.15.99:0/3711379689 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f16f406e530 0x7f16f40709e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f16f8007fd0 tx=0x7f16f8009e90 comp rx=0 tx=0).stop 2024-09-19T07:03:11.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.838+0000 7f170f3f4640 1 -- 172.21.15.99:0/3711379689 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17080fac60 msgr2=0x7f1708113230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:11.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.838+0000 7f170f3f4640 1 --2- 172.21.15.99:0/3711379689 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17080fac60 0x7f1708113230 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f1704000c00 tx=0x7f1704009da0 comp rx=0 tx=0).stop 2024-09-19T07:03:11.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.838+0000 7f170f3f4640 1 -- 172.21.15.99:0/3711379689 shutdown_connections 2024-09-19T07:03:11.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.838+0000 7f170f3f4640 1 --2- 172.21.15.99:0/3711379689 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f16f406e530 0x7f16f40709e0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:11.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.838+0000 7f170f3f4640 1 --2- 172.21.15.99:0/3711379689 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17081025f0 0x7f1708113770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:11.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.838+0000 7f170f3f4640 1 --2- 172.21.15.99:0/3711379689 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f17080fac60 0x7f1708113230 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:11.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.838+0000 7f170f3f4640 1 -- 172.21.15.99:0/3711379689 >> 172.21.15.99:0/3711379689 conn(0x7f1708070c80 msgr2=0x7f17080f9ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:03:11.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.839+0000 7f170f3f4640 1 -- 172.21.15.99:0/3711379689 shutdown_connections 2024-09-19T07:03:11.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.839+0000 7f170f3f4640 1 -- 172.21.15.99:0/3711379689 wait complete. 2024-09-19T07:03:11.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.916+0000 7f8a5c5c8640 1 -- 172.21.15.99:0/2326088217 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a540fb810 msgr2=0x7f8a540fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:11.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.916+0000 7f8a5c5c8640 1 --2- 172.21.15.99:0/2326088217 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a540fb810 0x7f8a540fbbe0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c009c50 tx=0x7f8a4c004d10 comp rx=0 tx=0).stop 2024-09-19T07:03:11.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.917+0000 7f8a5c5c8640 1 -- 172.21.15.99:0/2326088217 shutdown_connections 2024-09-19T07:03:11.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.917+0000 7f8a5c5c8640 1 --2- 172.21.15.99:0/2326088217 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a540fcf80 0x7f8a540fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:11.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.917+0000 7f8a5c5c8640 1 --2- 172.21.15.99:0/2326088217 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a540fb810 0x7f8a540fbbe0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:11.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.917+0000 7f8a5c5c8640 1 -- 172.21.15.99:0/2326088217 >> 172.21.15.99:0/2326088217 conn(0x7f8a540723b0 msgr2=0x7f8a540727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:03:11.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.917+0000 7f8a5c5c8640 1 -- 172.21.15.99:0/2326088217 shutdown_connections 2024-09-19T07:03:11.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.917+0000 7f8a5c5c8640 1 -- 172.21.15.99:0/2326088217 wait complete. 2024-09-19T07:03:11.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.917+0000 7f8a5c5c8640 1 Processor -- start 2024-09-19T07:03:11.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.917+0000 7f8a5c5c8640 1 -- start start 2024-09-19T07:03:11.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.918+0000 7f8a5c5c8640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a540fb810 0x7f8a541120b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:11.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.918+0000 7f8a5c5c8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a540fcf80 0x7f8a541125f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:11.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.918+0000 7f8a5c5c8640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a54112bf0 con 0x7f8a540fcf80 2024-09-19T07:03:11.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.918+0000 7f8a5c5c8640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a5410c030 con 0x7f8a540fb810 2024-09-19T07:03:11.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.918+0000 7f8a59b63640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a540fcf80 0x7f8a541125f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:11.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.918+0000 7f8a59b63640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a540fcf80 0x7f8a541125f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47540/0 (socket says 172.21.15.99:47540) 2024-09-19T07:03:11.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.918+0000 7f8a59b63640 1 -- 172.21.15.99:0/272136513 learned_addr learned my addr 172.21.15.99:0/272136513 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:03:11.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.918+0000 7f8a5a364640 1 --2- 172.21.15.99:0/272136513 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a540fb810 0x7f8a541120b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:11.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.918+0000 7f8a59b63640 1 -- 172.21.15.99:0/272136513 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a540fb810 msgr2=0x7f8a541120b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:11.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.918+0000 7f8a59b63640 1 --2- 172.21.15.99:0/272136513 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a540fb810 0x7f8a541120b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:11.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.918+0000 7f8a59b63640 1 -- 172.21.15.99:0/272136513 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a4c0098b0 con 0x7f8a540fcf80 2024-09-19T07:03:11.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.918+0000 7f8a5a364640 1 --2- 172.21.15.99:0/272136513 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a540fb810 0x7f8a541120b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:03:11.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.918+0000 7f8a59b63640 1 --2- 172.21.15.99:0/272136513 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a540fcf80 0x7f8a541125f0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f8a4800c830 tx=0x7f8a48004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:03:11.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.918+0000 7f8a52ffd640 1 -- 172.21.15.99:0/272136513 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a4800a850 con 0x7f8a540fcf80 2024-09-19T07:03:11.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.919+0000 7f8a5c5c8640 1 -- 172.21.15.99:0/272136513 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a5410c310 con 0x7f8a540fcf80 2024-09-19T07:03:11.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.919+0000 7f8a52ffd640 1 -- 172.21.15.99:0/272136513 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8a4800ae50 con 0x7f8a540fcf80 2024-09-19T07:03:11.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.919+0000 7f8a5c5c8640 1 -- 172.21.15.99:0/272136513 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a5410c8b0 con 0x7f8a540fcf80 2024-09-19T07:03:11.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.919+0000 7f8a52ffd640 1 -- 172.21.15.99:0/272136513 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a480113a0 con 0x7f8a540fcf80 2024-09-19T07:03:11.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.920+0000 7f8a5c5c8640 1 -- 172.21.15.99:0/272136513 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a40005210 con 0x7f8a540fcf80 2024-09-19T07:03:11.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.920+0000 7f8a52ffd640 1 -- 172.21.15.99:0/272136513 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f8a4800a9b0 con 0x7f8a540fcf80 2024-09-19T07:03:11.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.921+0000 7f8a52ffd640 1 --2- 172.21.15.99:0/272136513 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f8a3c06e530 0x7f8a3c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:11.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.921+0000 7f8a52ffd640 1 -- 172.21.15.99:0/272136513 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f8a4808e180 con 0x7f8a540fcf80 2024-09-19T07:03:11.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.921+0000 7f8a5a364640 1 --2- 172.21.15.99:0/272136513 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f8a3c06e530 0x7f8a3c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:11.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.921+0000 7f8a5a364640 1 --2- 172.21.15.99:0/272136513 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f8a3c06e530 0x7f8a3c0709e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c004a30 tx=0x7f8a4c004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:03:11.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:11.925+0000 7f8a52ffd640 1 -- 172.21.15.99:0/272136513 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f8a480573b0 con 0x7f8a540fcf80 2024-09-19T07:03:12.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.161+0000 7f8a5c5c8640 1 -- 172.21.15.99:0/272136513 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8a40005cd0 con 0x7f8a540fcf80 2024-09-19T07:03:12.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.161+0000 7f8a52ffd640 1 -- 172.21.15.99:0/272136513 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f8a4805aa70 con 0x7f8a540fcf80 2024-09-19T07:03:12.163 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T07:03:12.163 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-09-19T07:03:12.163 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T07:03:12.163 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T07:03:12.163 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-09-19T07:03:12.163 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T07:03:12.163 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T07:03:12.164 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-09-19T07:03:12.164 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 6 2024-09-19T07:03:12.164 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T07:03:12.164 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": { 2024-09-19T07:03:12.164 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 4 2024-09-19T07:03:12.164 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T07:03:12.164 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-09-19T07:03:12.164 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 14 2024-09-19T07:03:12.164 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T07:03:12.164 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T07:03:12.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.164+0000 7f8a5c5c8640 1 -- 172.21.15.99:0/272136513 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f8a3c06e530 msgr2=0x7f8a3c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:12.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.164+0000 7f8a5c5c8640 1 --2- 172.21.15.99:0/272136513 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f8a3c06e530 0x7f8a3c0709e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c004a30 tx=0x7f8a4c004d10 comp rx=0 tx=0).stop 2024-09-19T07:03:12.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.164+0000 7f8a5c5c8640 1 -- 172.21.15.99:0/272136513 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a540fcf80 msgr2=0x7f8a541125f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:12.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.164+0000 7f8a5c5c8640 1 --2- 172.21.15.99:0/272136513 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a540fcf80 0x7f8a541125f0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f8a4800c830 tx=0x7f8a48004430 comp rx=0 tx=0).stop 2024-09-19T07:03:12.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.164+0000 7f8a5c5c8640 1 -- 172.21.15.99:0/272136513 shutdown_connections 2024-09-19T07:03:12.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.164+0000 7f8a5c5c8640 1 --2- 172.21.15.99:0/272136513 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f8a3c06e530 0x7f8a3c0709e0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:12.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.164+0000 7f8a5c5c8640 1 --2- 172.21.15.99:0/272136513 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a540fcf80 0x7f8a541125f0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:12.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.164+0000 7f8a5c5c8640 1 --2- 172.21.15.99:0/272136513 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a540fb810 0x7f8a541120b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:12.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.164+0000 7f8a5c5c8640 1 -- 172.21.15.99:0/272136513 >> 172.21.15.99:0/272136513 conn(0x7f8a540723b0 msgr2=0x7f8a540fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:03:12.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.164+0000 7f8a5c5c8640 1 -- 172.21.15.99:0/272136513 shutdown_connections 2024-09-19T07:03:12.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.164+0000 7f8a5c5c8640 1 -- 172.21.15.99:0/272136513 wait complete. 2024-09-19T07:03:12.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.245+0000 7f54b6d4c640 1 -- 172.21.15.99:0/4060945570 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54b00fcf80 msgr2=0x7f54b00fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:12.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.245+0000 7f54b6d4c640 1 --2- 172.21.15.99:0/4060945570 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54b00fcf80 0x7f54b00fd3d0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f54a00048d0 tx=0x7f54a0009da0 comp rx=0 tx=0).stop 2024-09-19T07:03:12.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.245+0000 7f54b6d4c640 1 -- 172.21.15.99:0/4060945570 shutdown_connections 2024-09-19T07:03:12.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.245+0000 7f54b6d4c640 1 --2- 172.21.15.99:0/4060945570 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54b00fcf80 0x7f54b00fd3d0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:12.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.245+0000 7f54b6d4c640 1 --2- 172.21.15.99:0/4060945570 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54b00fb810 0x7f54b00fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:12.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.245+0000 7f54b6d4c640 1 -- 172.21.15.99:0/4060945570 >> 172.21.15.99:0/4060945570 conn(0x7f54b00723b0 msgr2=0x7f54b00727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:03:12.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.245+0000 7f54b6d4c640 1 -- 172.21.15.99:0/4060945570 shutdown_connections 2024-09-19T07:03:12.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.245+0000 7f54b6d4c640 1 -- 172.21.15.99:0/4060945570 wait complete. 2024-09-19T07:03:12.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.245+0000 7f54b6d4c640 1 Processor -- start 2024-09-19T07:03:12.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.245+0000 7f54b6d4c640 1 -- start start 2024-09-19T07:03:12.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.246+0000 7f54b6d4c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54b00fb810 0x7f54b0113130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:12.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.246+0000 7f54b6d4c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54b00fcf80 0x7f54b0113670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:12.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.246+0000 7f54b6d4c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b0113c70 con 0x7f54b00fcf80 2024-09-19T07:03:12.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.246+0000 7f54b6d4c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b010d0b0 con 0x7f54b00fb810 2024-09-19T07:03:12.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.246+0000 7f54affff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54b00fcf80 0x7f54b0113670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:12.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.246+0000 7f54affff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54b00fcf80 0x7f54b0113670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47554/0 (socket says 172.21.15.99:47554) 2024-09-19T07:03:12.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.246+0000 7f54affff640 1 -- 172.21.15.99:0/3226085287 learned_addr learned my addr 172.21.15.99:0/3226085287 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:03:12.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.246+0000 7f54b4ae8640 1 --2- 172.21.15.99:0/3226085287 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54b00fb810 0x7f54b0113130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:12.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.246+0000 7f54affff640 1 -- 172.21.15.99:0/3226085287 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54b00fb810 msgr2=0x7f54b0113130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:12.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.246+0000 7f54affff640 1 --2- 172.21.15.99:0/3226085287 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54b00fb810 0x7f54b0113130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:12.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.246+0000 7f54affff640 1 -- 172.21.15.99:0/3226085287 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a0005040 con 0x7f54b00fcf80 2024-09-19T07:03:12.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.246+0000 7f54b4ae8640 1 --2- 172.21.15.99:0/3226085287 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54b00fb810 0x7f54b0113130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:03:12.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.246+0000 7f54affff640 1 --2- 172.21.15.99:0/3226085287 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54b00fcf80 0x7f54b0113670 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f54a0000c00 tx=0x7f54a0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:03:12.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.247+0000 7f54ad7fa640 1 -- 172.21.15.99:0/3226085287 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54a0038070 con 0x7f54b00fcf80 2024-09-19T07:03:12.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.247+0000 7f54b6d4c640 1 -- 172.21.15.99:0/3226085287 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54b010d330 con 0x7f54b00fcf80 2024-09-19T07:03:12.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.247+0000 7f54ad7fa640 1 -- 172.21.15.99:0/3226085287 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f54a002ade0 con 0x7f54b00fcf80 2024-09-19T07:03:12.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.247+0000 7f54ad7fa640 1 -- 172.21.15.99:0/3226085287 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54a002c7e0 con 0x7f54b00fcf80 2024-09-19T07:03:12.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.247+0000 7f54b6d4c640 1 -- 172.21.15.99:0/3226085287 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54b010d7f0 con 0x7f54b00fcf80 2024-09-19T07:03:12.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.248+0000 7f54b6d4c640 1 -- 172.21.15.99:0/3226085287 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54b00fcbc0 con 0x7f54b00fcf80 2024-09-19T07:03:12.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.248+0000 7f54ad7fa640 1 -- 172.21.15.99:0/3226085287 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f54a0030020 con 0x7f54b00fcf80 2024-09-19T07:03:12.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.248+0000 7f54ad7fa640 1 --2- 172.21.15.99:0/3226085287 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f549c06e530 0x7f549c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:12.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.249+0000 7f54ad7fa640 1 -- 172.21.15.99:0/3226085287 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f54a00ade00 con 0x7f54b00fcf80 2024-09-19T07:03:12.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.249+0000 7f54b4ae8640 1 --2- 172.21.15.99:0/3226085287 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f549c06e530 0x7f549c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:12.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.249+0000 7f54b4ae8640 1 --2- 172.21.15.99:0/3226085287 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f549c06e530 0x7f549c0709e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f5498009af0 tx=0x7f549800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:03:12.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.253+0000 7f54ad7fa640 1 -- 172.21.15.99:0/3226085287 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f54a0076fa0 con 0x7f54b00fcf80 2024-09-19T07:03:12.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.451+0000 7f54b6d4c640 1 -- 172.21.15.99:0/3226085287 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f54b010e7a0 con 0x7f54b00fcf80 2024-09-19T07:03:12.452 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:12 smithi099 ceph-mon[97031]: pgmap v625: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:03:12.453 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:12 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/272136513' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T07:03:12.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.451+0000 7f54ad7fa640 1 -- 172.21.15.99:0/3226085287 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 29 v29) v1 ==== 76+0+1915 (secure 0 0 0) 0x7f54a007a660 con 0x7f54b00fcf80 2024-09-19T07:03:12.453 INFO:teuthology.orchestra.run.smithi099.stdout:e29 2024-09-19T07:03:12.453 INFO:teuthology.orchestra.run.smithi099.stdout:btime 2024-09-19T06:48:47:938420+0000 2024-09-19T07:03:12.453 INFO:teuthology.orchestra.run.smithi099.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T07:03:12.453 INFO:teuthology.orchestra.run.smithi099.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T07:03:12.454 INFO:teuthology.orchestra.run.smithi099.stdout:legacy client fscid: 1 2024-09-19T07:03:12.454 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T07:03:12.454 INFO:teuthology.orchestra.run.smithi099.stdout:Filesystem 'cephfs' (1) 2024-09-19T07:03:12.454 INFO:teuthology.orchestra.run.smithi099.stdout:fs_name cephfs 2024-09-19T07:03:12.454 INFO:teuthology.orchestra.run.smithi099.stdout:epoch 20 2024-09-19T07:03:12.454 INFO:teuthology.orchestra.run.smithi099.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-19T07:03:12.454 INFO:teuthology.orchestra.run.smithi099.stdout:created 2024-09-19T06:37:40.838146+0000 2024-09-19T07:03:12.454 INFO:teuthology.orchestra.run.smithi099.stdout:modified 2024-09-19T06:47:50.076553+0000 2024-09-19T07:03:12.454 INFO:teuthology.orchestra.run.smithi099.stdout:tableserver 0 2024-09-19T07:03:12.454 INFO:teuthology.orchestra.run.smithi099.stdout:root 0 2024-09-19T07:03:12.454 INFO:teuthology.orchestra.run.smithi099.stdout:session_timeout 60 2024-09-19T07:03:12.454 INFO:teuthology.orchestra.run.smithi099.stdout:session_autoclose 300 2024-09-19T07:03:12.454 INFO:teuthology.orchestra.run.smithi099.stdout:max_file_size 1099511627776 2024-09-19T07:03:12.454 INFO:teuthology.orchestra.run.smithi099.stdout:max_xattr_size 65536 2024-09-19T07:03:12.455 INFO:teuthology.orchestra.run.smithi099.stdout:required_client_features {} 2024-09-19T07:03:12.455 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure 0 2024-09-19T07:03:12.455 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure_osd_epoch 77 2024-09-19T07:03:12.455 INFO:teuthology.orchestra.run.smithi099.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T07:03:12.455 INFO:teuthology.orchestra.run.smithi099.stdout:max_mds 2 2024-09-19T07:03:12.455 INFO:teuthology.orchestra.run.smithi099.stdout:in 0,1 2024-09-19T07:03:12.455 INFO:teuthology.orchestra.run.smithi099.stdout:up {} 2024-09-19T07:03:12.455 INFO:teuthology.orchestra.run.smithi099.stdout:failed 0,1 2024-09-19T07:03:12.455 INFO:teuthology.orchestra.run.smithi099.stdout:damaged 2024-09-19T07:03:12.455 INFO:teuthology.orchestra.run.smithi099.stdout:stopped 2024-09-19T07:03:12.455 INFO:teuthology.orchestra.run.smithi099.stdout:data_pools [3] 2024-09-19T07:03:12.455 INFO:teuthology.orchestra.run.smithi099.stdout:metadata_pool 2 2024-09-19T07:03:12.455 INFO:teuthology.orchestra.run.smithi099.stdout:inline_data disabled 2024-09-19T07:03:12.456 INFO:teuthology.orchestra.run.smithi099.stdout:balancer 2024-09-19T07:03:12.456 INFO:teuthology.orchestra.run.smithi099.stdout:bal_rank_mask -1 2024-09-19T07:03:12.456 INFO:teuthology.orchestra.run.smithi099.stdout:standby_count_wanted 1 2024-09-19T07:03:12.456 INFO:teuthology.orchestra.run.smithi099.stdout:qdb_cluster leader: 0 members: 2024-09-19T07:03:12.456 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T07:03:12.456 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T07:03:12.456 INFO:teuthology.orchestra.run.smithi099.stdout:Standby daemons: 2024-09-19T07:03:12.456 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T07:03:12.456 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.obarqf{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6826/1859154203,v1:172.21.15.99:6827/1859154203] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:03:12.456 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.xehbxe{-1:34410} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6828/1939453719,v1:172.21.15.99:6829/1939453719] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:03:12.456 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.nooexo{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6824/1398895079,v1:172.21.15.117:6825/1398895079] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:03:12.456 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.bheqzh{-1:44329} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6826/3233337308,v1:172.21.15.117:6827/3233337308] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:03:12.457 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 29 2024-09-19T07:03:12.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.454+0000 7f54b6d4c640 1 -- 172.21.15.99:0/3226085287 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f549c06e530 msgr2=0x7f549c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:12.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.454+0000 7f54b6d4c640 1 --2- 172.21.15.99:0/3226085287 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f549c06e530 0x7f549c0709e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f5498009af0 tx=0x7f549800b040 comp rx=0 tx=0).stop 2024-09-19T07:03:12.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.454+0000 7f54b6d4c640 1 -- 172.21.15.99:0/3226085287 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54b00fcf80 msgr2=0x7f54b0113670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:12.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.454+0000 7f54b6d4c640 1 --2- 172.21.15.99:0/3226085287 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54b00fcf80 0x7f54b0113670 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f54a0000c00 tx=0x7f54a0009da0 comp rx=0 tx=0).stop 2024-09-19T07:03:12.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.455+0000 7f54b6d4c640 1 -- 172.21.15.99:0/3226085287 shutdown_connections 2024-09-19T07:03:12.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.455+0000 7f54b6d4c640 1 --2- 172.21.15.99:0/3226085287 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f549c06e530 0x7f549c0709e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:12.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.455+0000 7f54b6d4c640 1 --2- 172.21.15.99:0/3226085287 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54b00fcf80 0x7f54b0113670 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:12.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.455+0000 7f54b6d4c640 1 --2- 172.21.15.99:0/3226085287 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54b00fb810 0x7f54b0113130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:12.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.455+0000 7f54b6d4c640 1 -- 172.21.15.99:0/3226085287 >> 172.21.15.99:0/3226085287 conn(0x7f54b00723b0 msgr2=0x7f54b0101170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:03:12.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.455+0000 7f54b6d4c640 1 -- 172.21.15.99:0/3226085287 shutdown_connections 2024-09-19T07:03:12.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.455+0000 7f54b6d4c640 1 -- 172.21.15.99:0/3226085287 wait complete. 2024-09-19T07:03:12.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.534+0000 7f761d732640 1 -- 172.21.15.99:0/308140209 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f76180fac60 msgr2=0x7f76180fb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:12.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.534+0000 7f761d732640 1 --2- 172.21.15.99:0/308140209 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f76180fac60 0x7f76180fb0b0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f760c0048d0 tx=0x7f760c009da0 comp rx=0 tx=0).stop 2024-09-19T07:03:12.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.534+0000 7f761d732640 1 -- 172.21.15.99:0/308140209 shutdown_connections 2024-09-19T07:03:12.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.534+0000 7f761d732640 1 --2- 172.21.15.99:0/308140209 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f76180fac60 0x7f76180fb0b0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:12.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.534+0000 7f761d732640 1 --2- 172.21.15.99:0/308140209 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76181025f0 0x7f76181029c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:12.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.534+0000 7f761d732640 1 -- 172.21.15.99:0/308140209 >> 172.21.15.99:0/308140209 conn(0x7f7618070c80 msgr2=0x7f7618071080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:03:12.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.534+0000 7f761d732640 1 -- 172.21.15.99:0/308140209 shutdown_connections 2024-09-19T07:03:12.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.534+0000 7f761d732640 1 -- 172.21.15.99:0/308140209 wait complete. 2024-09-19T07:03:12.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.535+0000 7f761d732640 1 Processor -- start 2024-09-19T07:03:12.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.535+0000 7f761d732640 1 -- start start 2024-09-19T07:03:12.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.535+0000 7f761d732640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f76180fac60 0x7f76180fbe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:12.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.535+0000 7f761d732640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76181025f0 0x7f76180fc380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:12.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.535+0000 7f761d732640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76180fc8c0 con 0x7f76180fac60 2024-09-19T07:03:12.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.535+0000 7f761d732640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76180fca30 con 0x7f76181025f0 2024-09-19T07:03:12.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.535+0000 7f7616ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f76180fac60 0x7f76180fbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:12.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.535+0000 7f7616ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f76180fac60 0x7f76180fbe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47568/0 (socket says 172.21.15.99:47568) 2024-09-19T07:03:12.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.535+0000 7f7616ffd640 1 -- 172.21.15.99:0/315861678 learned_addr learned my addr 172.21.15.99:0/315861678 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:03:12.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.535+0000 7f76167fc640 1 --2- 172.21.15.99:0/315861678 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76181025f0 0x7f76180fc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:12.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.536+0000 7f7616ffd640 1 -- 172.21.15.99:0/315861678 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76181025f0 msgr2=0x7f76180fc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:12.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.536+0000 7f7616ffd640 1 --2- 172.21.15.99:0/315861678 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76181025f0 0x7f76180fc380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:12.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.536+0000 7f7616ffd640 1 -- 172.21.15.99:0/315861678 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f760c005040 con 0x7f76180fac60 2024-09-19T07:03:12.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.536+0000 7f76167fc640 1 --2- 172.21.15.99:0/315861678 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76181025f0 0x7f76180fc380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:03:12.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.536+0000 7f7616ffd640 1 --2- 172.21.15.99:0/315861678 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f76180fac60 0x7f76180fbe40 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f760800cb10 tx=0x7f7608007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:03:12.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.536+0000 7f75ff7fe640 1 -- 172.21.15.99:0/315861678 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7608004200 con 0x7f76180fac60 2024-09-19T07:03:12.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.536+0000 7f761d732640 1 -- 172.21.15.99:0/315861678 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76180fccc0 con 0x7f76180fac60 2024-09-19T07:03:12.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.536+0000 7f75ff7fe640 1 -- 172.21.15.99:0/315861678 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f760800acc0 con 0x7f76180fac60 2024-09-19T07:03:12.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.536+0000 7f75ff7fe640 1 -- 172.21.15.99:0/315861678 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7608003cd0 con 0x7f76180fac60 2024-09-19T07:03:12.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.536+0000 7f761d732640 1 -- 172.21.15.99:0/315861678 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7618119960 con 0x7f76180fac60 2024-09-19T07:03:12.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.537+0000 7f761d732640 1 -- 172.21.15.99:0/315861678 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7618065810 con 0x7f76180fac60 2024-09-19T07:03:12.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.538+0000 7f75ff7fe640 1 -- 172.21.15.99:0/315861678 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f760800a820 con 0x7f76180fac60 2024-09-19T07:03:12.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.538+0000 7f75ff7fe640 1 --2- 172.21.15.99:0/315861678 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f760006e530 0x7f76000709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:12.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.538+0000 7f75ff7fe640 1 -- 172.21.15.99:0/315861678 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f760808e830 con 0x7f76180fac60 2024-09-19T07:03:12.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.538+0000 7f76167fc640 1 --2- 172.21.15.99:0/315861678 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f760006e530 0x7f76000709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:12.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.538+0000 7f76167fc640 1 --2- 172.21.15.99:0/315861678 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f760006e530 0x7f76000709e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f76180fd780 tx=0x7f760c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:03:12.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.542+0000 7f75ff7fe640 1 -- 172.21.15.99:0/315861678 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f76080579a0 con 0x7f76180fac60 2024-09-19T07:03:12.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:12 smithi117 ceph-mon[76771]: pgmap v625: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:03:12.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:12 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/272136513' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T07:03:12.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.725+0000 7f761d732640 1 -- 172.21.15.99:0/315861678 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f76180fd530 con 0x7f760006e530 2024-09-19T07:03:12.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.726+0000 7f75ff7fe640 1 -- 172.21.15.99:0/315861678 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f76180fd530 con 0x7f760006e530 2024-09-19T07:03:12.727 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T07:03:12.727 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T07:03:12.727 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": true, 2024-09-19T07:03:12.728 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T07:03:12.728 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [ 2024-09-19T07:03:12.728 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr", 2024-09-19T07:03:12.728 INFO:teuthology.orchestra.run.smithi099.stdout: "crash", 2024-09-19T07:03:12.728 INFO:teuthology.orchestra.run.smithi099.stdout: "mds", 2024-09-19T07:03:12.728 INFO:teuthology.orchestra.run.smithi099.stdout: "mon", 2024-09-19T07:03:12.728 INFO:teuthology.orchestra.run.smithi099.stdout: "osd" 2024-09-19T07:03:12.728 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-19T07:03:12.728 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": "16/21 daemons upgraded", 2024-09-19T07:03:12.728 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "Currently upgrading mds daemons", 2024-09-19T07:03:12.728 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-09-19T07:03:12.728 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T07:03:12.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.729+0000 7f761d732640 1 -- 172.21.15.99:0/315861678 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f760006e530 msgr2=0x7f76000709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:12.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.729+0000 7f761d732640 1 --2- 172.21.15.99:0/315861678 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f760006e530 0x7f76000709e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f76180fd780 tx=0x7f760c035040 comp rx=0 tx=0).stop 2024-09-19T07:03:12.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.729+0000 7f761d732640 1 -- 172.21.15.99:0/315861678 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f76180fac60 msgr2=0x7f76180fbe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:12.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.729+0000 7f761d732640 1 --2- 172.21.15.99:0/315861678 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f76180fac60 0x7f76180fbe40 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f760800cb10 tx=0x7f7608007ee0 comp rx=0 tx=0).stop 2024-09-19T07:03:12.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.729+0000 7f761d732640 1 -- 172.21.15.99:0/315861678 shutdown_connections 2024-09-19T07:03:12.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.729+0000 7f761d732640 1 --2- 172.21.15.99:0/315861678 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f760006e530 0x7f76000709e0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:12.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.729+0000 7f761d732640 1 --2- 172.21.15.99:0/315861678 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76181025f0 0x7f76180fc380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:12.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.729+0000 7f761d732640 1 --2- 172.21.15.99:0/315861678 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f76180fac60 0x7f76180fbe40 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:12.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.729+0000 7f761d732640 1 -- 172.21.15.99:0/315861678 >> 172.21.15.99:0/315861678 conn(0x7f7618070c80 msgr2=0x7f76180f9f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:03:12.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.729+0000 7f761d732640 1 -- 172.21.15.99:0/315861678 shutdown_connections 2024-09-19T07:03:12.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.729+0000 7f761d732640 1 -- 172.21.15.99:0/315861678 wait complete. 2024-09-19T07:03:12.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.806+0000 7f68181b5640 1 -- 172.21.15.99:0/90993498 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f68101014e0 msgr2=0x7f68101018b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:12.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.806+0000 7f68181b5640 1 --2- 172.21.15.99:0/90993498 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f68101014e0 0x7f68101018b0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f680c0048d0 tx=0x7f680c009da0 comp rx=0 tx=0).stop 2024-09-19T07:03:12.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.806+0000 7f68181b5640 1 -- 172.21.15.99:0/90993498 shutdown_connections 2024-09-19T07:03:12.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.806+0000 7f68181b5640 1 --2- 172.21.15.99:0/90993498 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68100fb4a0 0x7f68100fb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:12.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.806+0000 7f68181b5640 1 --2- 172.21.15.99:0/90993498 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f68101014e0 0x7f68101018b0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:12.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.806+0000 7f68181b5640 1 -- 172.21.15.99:0/90993498 >> 172.21.15.99:0/90993498 conn(0x7f68100f7060 msgr2=0x7f68100f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:03:12.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.806+0000 7f68181b5640 1 -- 172.21.15.99:0/90993498 shutdown_connections 2024-09-19T07:03:12.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.806+0000 7f68181b5640 1 -- 172.21.15.99:0/90993498 wait complete. 2024-09-19T07:03:12.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.807+0000 7f68181b5640 1 Processor -- start 2024-09-19T07:03:12.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.807+0000 7f68181b5640 1 -- start start 2024-09-19T07:03:12.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.807+0000 7f68181b5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f68100fb4a0 0x7f68101120a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:12.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.807+0000 7f68181b5640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68101014e0 0x7f68101125e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:12.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.807+0000 7f68181b5640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6810112be0 con 0x7f68100fb4a0 2024-09-19T07:03:12.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.807+0000 7f68181b5640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f681010c020 con 0x7f68101014e0 2024-09-19T07:03:12.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.807+0000 7f6815f51640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f68100fb4a0 0x7f68101120a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:12.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.807+0000 7f6815f51640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f68100fb4a0 0x7f68101120a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47594/0 (socket says 172.21.15.99:47594) 2024-09-19T07:03:12.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.807+0000 7f6815f51640 1 -- 172.21.15.99:0/3379055239 learned_addr learned my addr 172.21.15.99:0/3379055239 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:03:12.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.807+0000 7f6815f51640 1 -- 172.21.15.99:0/3379055239 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68101014e0 msgr2=0x7f68101125e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:12.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.807+0000 7f6815f51640 1 --2- 172.21.15.99:0/3379055239 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68101014e0 0x7f68101125e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:12.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.807+0000 7f6815f51640 1 -- 172.21.15.99:0/3379055239 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f680c005040 con 0x7f68100fb4a0 2024-09-19T07:03:12.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.808+0000 7f6815f51640 1 --2- 172.21.15.99:0/3379055239 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f68100fb4a0 0x7f68101120a0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f680c003080 tx=0x7f680c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:03:12.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.808+0000 7f68067fc640 1 -- 172.21.15.99:0/3379055239 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f680c038070 con 0x7f68100fb4a0 2024-09-19T07:03:12.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.808+0000 7f68181b5640 1 -- 172.21.15.99:0/3379055239 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f681010c2a0 con 0x7f68100fb4a0 2024-09-19T07:03:12.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.808+0000 7f68067fc640 1 -- 172.21.15.99:0/3379055239 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f680c02ade0 con 0x7f68100fb4a0 2024-09-19T07:03:12.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.808+0000 7f68067fc640 1 -- 172.21.15.99:0/3379055239 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f680c02c880 con 0x7f68100fb4a0 2024-09-19T07:03:12.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.808+0000 7f68181b5640 1 -- 172.21.15.99:0/3379055239 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f681010c780 con 0x7f68100fb4a0 2024-09-19T07:03:12.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.809+0000 7f68181b5640 1 -- 172.21.15.99:0/3379055239 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68100fcbe0 con 0x7f68100fb4a0 2024-09-19T07:03:12.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.809+0000 7f68067fc640 1 -- 172.21.15.99:0/3379055239 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f680c030020 con 0x7f68100fb4a0 2024-09-19T07:03:12.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.810+0000 7f68067fc640 1 --2- 172.21.15.99:0/3379055239 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f67fc06e530 0x7f67fc0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:12.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.810+0000 7f68067fc640 1 -- 172.21.15.99:0/3379055239 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f680c0ae220 con 0x7f68100fb4a0 2024-09-19T07:03:12.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.810+0000 7f6815750640 1 --2- 172.21.15.99:0/3379055239 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f67fc06e530 0x7f67fc0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:12.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.810+0000 7f6815750640 1 --2- 172.21.15.99:0/3379055239 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f67fc06e530 0x7f67fc0709e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f681010d960 tx=0x7f6800007c30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:03:12.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:12.814+0000 7f68067fc640 1 -- 172.21.15.99:0/3379055239 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f680c077310 con 0x7f68100fb4a0 2024-09-19T07:03:13.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:13.046+0000 7f68181b5640 1 -- 172.21.15.99:0/3379055239 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f68101084c0 con 0x7f68100fb4a0 2024-09-19T07:03:13.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:13.047+0000 7f68067fc640 1 -- 172.21.15.99:0/3379055239 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7f680c07a9d0 con 0x7f68100fb4a0 2024-09-19T07:03:13.048 INFO:teuthology.orchestra.run.smithi099.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-09-19T07:03:13.048 INFO:teuthology.orchestra.run.smithi099.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-19T07:03:13.048 INFO:teuthology.orchestra.run.smithi099.stdout: fs cephfs is degraded 2024-09-19T07:03:13.048 INFO:teuthology.orchestra.run.smithi099.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-19T07:03:13.048 INFO:teuthology.orchestra.run.smithi099.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-19T07:03:13.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:13.050+0000 7f68181b5640 1 -- 172.21.15.99:0/3379055239 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f67fc06e530 msgr2=0x7f67fc0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:13.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:13.050+0000 7f68181b5640 1 --2- 172.21.15.99:0/3379055239 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f67fc06e530 0x7f67fc0709e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f681010d960 tx=0x7f6800007c30 comp rx=0 tx=0).stop 2024-09-19T07:03:13.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:13.050+0000 7f68181b5640 1 -- 172.21.15.99:0/3379055239 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f68100fb4a0 msgr2=0x7f68101120a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:13.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:13.050+0000 7f68181b5640 1 --2- 172.21.15.99:0/3379055239 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f68100fb4a0 0x7f68101120a0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f680c003080 tx=0x7f680c009da0 comp rx=0 tx=0).stop 2024-09-19T07:03:13.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:13.050+0000 7f68181b5640 1 -- 172.21.15.99:0/3379055239 shutdown_connections 2024-09-19T07:03:13.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:13.050+0000 7f68181b5640 1 --2- 172.21.15.99:0/3379055239 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f67fc06e530 0x7f67fc0709e0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:13.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:13.050+0000 7f68181b5640 1 --2- 172.21.15.99:0/3379055239 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68101014e0 0x7f68101125e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:13.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:13.050+0000 7f68181b5640 1 --2- 172.21.15.99:0/3379055239 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f68100fb4a0 0x7f68101120a0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:13.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:13.050+0000 7f68181b5640 1 -- 172.21.15.99:0/3379055239 >> 172.21.15.99:0/3379055239 conn(0x7f68100f7060 msgr2=0x7f68100f7430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:03:13.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:13.050+0000 7f68181b5640 1 -- 172.21.15.99:0/3379055239 shutdown_connections 2024-09-19T07:03:13.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:13.050+0000 7f68181b5640 1 -- 172.21.15.99:0/3379055239 wait complete. 2024-09-19T07:03:13.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:13 smithi099 ceph-mon[97031]: from='client.35174 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:03:13.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:13 smithi099 ceph-mon[97031]: from='client.35178 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:03:13.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:13 smithi099 ceph-mon[97031]: from='client.35182 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:03:13.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:13 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/3226085287' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T07:03:13.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:13 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/3379055239' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T07:03:13.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:13 smithi117 ceph-mon[76771]: from='client.35174 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:03:13.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:13 smithi117 ceph-mon[76771]: from='client.35178 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:03:13.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:13 smithi117 ceph-mon[76771]: from='client.35182 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:03:13.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:13 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/3226085287' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T07:03:13.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:13 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/3379055239' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T07:03:14.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:14 smithi099 ceph-mon[97031]: from='client.35194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:03:14.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:14 smithi099 ceph-mon[97031]: pgmap v626: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:03:14.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:14 smithi117 ceph-mon[76771]: from='client.35194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:03:14.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:14 smithi117 ceph-mon[76771]: pgmap v626: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:03:15.455 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:15 smithi099 ceph-mon[97031]: pgmap v627: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:03:15.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:15 smithi117 ceph-mon[76771]: pgmap v627: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:03:18.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:18 smithi099 ceph-mon[97031]: pgmap v628: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:03:18.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:18 smithi117 ceph-mon[76771]: pgmap v628: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:03:20.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:20 smithi099 ceph-mon[97031]: pgmap v629: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:03:20.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:20 smithi117 ceph-mon[76771]: pgmap v629: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:03:22.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:22 smithi099 ceph-mon[97031]: pgmap v630: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:03:22.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:22 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:03:22.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:22 smithi117 ceph-mon[76771]: pgmap v630: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:03:22.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:22 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:03:24.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:24 smithi099 ceph-mon[97031]: pgmap v631: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:03:24.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:24 smithi117 ceph-mon[76771]: pgmap v631: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:03:26.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:26 smithi099 ceph-mon[97031]: pgmap v632: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:03:26.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:26 smithi117 ceph-mon[76771]: pgmap v632: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:03:28.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:28 smithi099 ceph-mon[97031]: pgmap v633: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:03:28.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:28 smithi117 ceph-mon[76771]: pgmap v633: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:03:29.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:29 smithi117 ceph-mon[76771]: pgmap v634: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:03:29.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:29 smithi099 ceph-mon[97031]: pgmap v634: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:03:32.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:32 smithi099 ceph-mon[97031]: pgmap v635: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:03:32.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:32 smithi117 ceph-mon[76771]: pgmap v635: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:03:34.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:34 smithi099 ceph-mon[97031]: pgmap v636: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:03:34.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:34 smithi117 ceph-mon[76771]: pgmap v636: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:03:36.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:36 smithi099 ceph-mon[97031]: pgmap v637: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:03:36.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:36 smithi117 ceph-mon[76771]: pgmap v637: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:03:37.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:37 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:03:37.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:37 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:03:38.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:38 smithi099 ceph-mon[97031]: pgmap v638: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:03:38.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:38 smithi117 ceph-mon[76771]: pgmap v638: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:03:40.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:40 smithi099 ceph-mon[97031]: pgmap v639: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:03:40.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:40 smithi117 ceph-mon[76771]: pgmap v639: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:03:41.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:41 smithi099 ceph-mon[97031]: pgmap v640: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:03:41.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:41 smithi117 ceph-mon[76771]: pgmap v640: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:03:43.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.140+0000 7f113061d640 1 -- 172.21.15.99:0/1671376455 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1128064fc0 msgr2=0x7f1128065430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:43.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.140+0000 7f113061d640 1 --2- 172.21.15.99:0/1671376455 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1128064fc0 0x7f1128065430 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f11180048d0 tx=0x7f1118009da0 comp rx=0 tx=0).stop 2024-09-19T07:03:43.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.140+0000 7f113061d640 1 -- 172.21.15.99:0/1671376455 shutdown_connections 2024-09-19T07:03:43.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.140+0000 7f113061d640 1 --2- 172.21.15.99:0/1671376455 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1128064fc0 0x7f1128065430 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:43.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.140+0000 7f113061d640 1 --2- 172.21.15.99:0/1671376455 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11280fe460 0x7f11280fe830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:43.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.140+0000 7f113061d640 1 -- 172.21.15.99:0/1671376455 >> 172.21.15.99:0/1671376455 conn(0x7f11280723b0 msgr2=0x7f11280727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:03:43.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.140+0000 7f113061d640 1 -- 172.21.15.99:0/1671376455 shutdown_connections 2024-09-19T07:03:43.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.140+0000 7f113061d640 1 -- 172.21.15.99:0/1671376455 wait complete. 2024-09-19T07:03:43.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.141+0000 7f113061d640 1 Processor -- start 2024-09-19T07:03:43.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.141+0000 7f113061d640 1 -- start start 2024-09-19T07:03:43.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.141+0000 7f113061d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1128064fc0 0x7f1128113230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:43.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.141+0000 7f113061d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11280fe460 0x7f1128113770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:43.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.141+0000 7f113061d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1128113e00 con 0x7f1128064fc0 2024-09-19T07:03:43.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.141+0000 7f113061d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f112810d1b0 con 0x7f11280fe460 2024-09-19T07:03:43.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.141+0000 7f112e3b9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1128064fc0 0x7f1128113230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:43.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.141+0000 7f112e3b9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1128064fc0 0x7f1128113230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55668/0 (socket says 172.21.15.99:55668) 2024-09-19T07:03:43.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.141+0000 7f112e3b9640 1 -- 172.21.15.99:0/3221719828 learned_addr learned my addr 172.21.15.99:0/3221719828 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:03:43.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.142+0000 7f112dbb8640 1 --2- 172.21.15.99:0/3221719828 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11280fe460 0x7f1128113770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:43.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.142+0000 7f112e3b9640 1 -- 172.21.15.99:0/3221719828 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11280fe460 msgr2=0x7f1128113770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:43.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.142+0000 7f112e3b9640 1 --2- 172.21.15.99:0/3221719828 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11280fe460 0x7f1128113770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:43.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.142+0000 7f112e3b9640 1 -- 172.21.15.99:0/3221719828 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1118005040 con 0x7f1128064fc0 2024-09-19T07:03:43.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.142+0000 7f112e3b9640 1 --2- 172.21.15.99:0/3221719828 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1128064fc0 0x7f1128113230 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f112400b790 tx=0x7f11240091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:03:43.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.142+0000 7f111effd640 1 -- 172.21.15.99:0/3221719828 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f112400c700 con 0x7f1128064fc0 2024-09-19T07:03:43.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.142+0000 7f111effd640 1 -- 172.21.15.99:0/3221719828 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f112400cd00 con 0x7f1128064fc0 2024-09-19T07:03:43.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.142+0000 7f113061d640 1 -- 172.21.15.99:0/3221719828 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f112810d490 con 0x7f1128064fc0 2024-09-19T07:03:43.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.142+0000 7f111effd640 1 -- 172.21.15.99:0/3221719828 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1124015e80 con 0x7f1128064fc0 2024-09-19T07:03:43.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.142+0000 7f113061d640 1 -- 172.21.15.99:0/3221719828 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f112810d980 con 0x7f1128064fc0 2024-09-19T07:03:43.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.143+0000 7f113061d640 1 -- 172.21.15.99:0/3221719828 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11280fdcf0 con 0x7f1128064fc0 2024-09-19T07:03:43.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.144+0000 7f111effd640 1 -- 172.21.15.99:0/3221719828 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f1124012070 con 0x7f1128064fc0 2024-09-19T07:03:43.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.144+0000 7f111effd640 1 --2- 172.21.15.99:0/3221719828 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f111406e530 0x7f11140709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:43.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.144+0000 7f111effd640 1 -- 172.21.15.99:0/3221719828 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f112408d990 con 0x7f1128064fc0 2024-09-19T07:03:43.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.144+0000 7f112dbb8640 1 --2- 172.21.15.99:0/3221719828 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f111406e530 0x7f11140709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:43.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.145+0000 7f112dbb8640 1 --2- 172.21.15.99:0/3221719828 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f111406e530 0x7f11140709e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f1118009ac0 tx=0x7f1118035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:03:43.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.149+0000 7f111effd640 1 -- 172.21.15.99:0/3221719828 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f1124056b00 con 0x7f1128064fc0 2024-09-19T07:03:43.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.334+0000 7f113061d640 1 -- 172.21.15.99:0/3221719828 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f112804b7b0 con 0x7f111406e530 2024-09-19T07:03:43.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.336+0000 7f111effd640 1 -- 172.21.15.99:0/3221719828 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f112804b7b0 con 0x7f111406e530 2024-09-19T07:03:43.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.338+0000 7f113061d640 1 -- 172.21.15.99:0/3221719828 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f111406e530 msgr2=0x7f11140709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:43.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.338+0000 7f113061d640 1 --2- 172.21.15.99:0/3221719828 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f111406e530 0x7f11140709e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f1118009ac0 tx=0x7f1118035040 comp rx=0 tx=0).stop 2024-09-19T07:03:43.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.338+0000 7f113061d640 1 -- 172.21.15.99:0/3221719828 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1128064fc0 msgr2=0x7f1128113230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:43.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.338+0000 7f113061d640 1 --2- 172.21.15.99:0/3221719828 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1128064fc0 0x7f1128113230 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f112400b790 tx=0x7f11240091d0 comp rx=0 tx=0).stop 2024-09-19T07:03:43.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.338+0000 7f113061d640 1 -- 172.21.15.99:0/3221719828 shutdown_connections 2024-09-19T07:03:43.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.338+0000 7f113061d640 1 --2- 172.21.15.99:0/3221719828 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f111406e530 0x7f11140709e0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:43.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.338+0000 7f113061d640 1 --2- 172.21.15.99:0/3221719828 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11280fe460 0x7f1128113770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:43.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.338+0000 7f113061d640 1 --2- 172.21.15.99:0/3221719828 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1128064fc0 0x7f1128113230 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:43.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.338+0000 7f113061d640 1 -- 172.21.15.99:0/3221719828 >> 172.21.15.99:0/3221719828 conn(0x7f11280723b0 msgr2=0x7f1128105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:03:43.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.338+0000 7f113061d640 1 -- 172.21.15.99:0/3221719828 shutdown_connections 2024-09-19T07:03:43.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.338+0000 7f113061d640 1 -- 172.21.15.99:0/3221719828 wait complete. 2024-09-19T07:03:43.348 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-09-19T07:03:43.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.416+0000 7f9688f0b640 1 -- 172.21.15.99:0/341845959 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9684102560 msgr2=0x7f9684102930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:43.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.416+0000 7f9688f0b640 1 --2- 172.21.15.99:0/341845959 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9684102560 0x7f9684102930 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f967c009c50 tx=0x7f967c004d10 comp rx=0 tx=0).stop 2024-09-19T07:03:43.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.417+0000 7f9688f0b640 1 -- 172.21.15.99:0/341845959 shutdown_connections 2024-09-19T07:03:43.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.417+0000 7f9688f0b640 1 --2- 172.21.15.99:0/341845959 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9684102f00 0x7f96840fc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:43.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.417+0000 7f9688f0b640 1 --2- 172.21.15.99:0/341845959 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9684102560 0x7f9684102930 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:43.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.417+0000 7f9688f0b640 1 -- 172.21.15.99:0/341845959 >> 172.21.15.99:0/341845959 conn(0x7f96840f8120 msgr2=0x7f96840fa530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:03:43.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.417+0000 7f9688f0b640 1 -- 172.21.15.99:0/341845959 shutdown_connections 2024-09-19T07:03:43.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.417+0000 7f9688f0b640 1 -- 172.21.15.99:0/341845959 wait complete. 2024-09-19T07:03:43.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.417+0000 7f9688f0b640 1 Processor -- start 2024-09-19T07:03:43.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.417+0000 7f9688f0b640 1 -- start start 2024-09-19T07:03:43.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.417+0000 7f9688f0b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9684102560 0x7f9684115420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:43.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.417+0000 7f9688f0b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9684102f00 0x7f9684115960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:43.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.417+0000 7f9688f0b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9684115f60 con 0x7f9684102560 2024-09-19T07:03:43.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.417+0000 7f9688f0b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f968410f370 con 0x7f9684102f00 2024-09-19T07:03:43.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.418+0000 7f968259c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9684102560 0x7f9684115420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:43.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.418+0000 7f968259c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9684102560 0x7f9684115420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55682/0 (socket says 172.21.15.99:55682) 2024-09-19T07:03:43.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.418+0000 7f968259c640 1 -- 172.21.15.99:0/457926210 learned_addr learned my addr 172.21.15.99:0/457926210 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:03:43.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.418+0000 7f9681d9b640 1 --2- 172.21.15.99:0/457926210 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9684102f00 0x7f9684115960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:43.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.418+0000 7f968259c640 1 -- 172.21.15.99:0/457926210 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9684102f00 msgr2=0x7f9684115960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:43.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.418+0000 7f968259c640 1 --2- 172.21.15.99:0/457926210 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9684102f00 0x7f9684115960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:43.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.418+0000 7f968259c640 1 -- 172.21.15.99:0/457926210 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f967c0098b0 con 0x7f9684102560 2024-09-19T07:03:43.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.418+0000 7f968259c640 1 --2- 172.21.15.99:0/457926210 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9684102560 0x7f9684115420 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f967c004a30 tx=0x7f967c004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:03:43.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.418+0000 7f967affd640 1 -- 172.21.15.99:0/457926210 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f967c009690 con 0x7f9684102560 2024-09-19T07:03:43.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.418+0000 7f967affd640 1 -- 172.21.15.99:0/457926210 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f967c032b10 con 0x7f9684102560 2024-09-19T07:03:43.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.418+0000 7f9688f0b640 1 -- 172.21.15.99:0/457926210 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f968410f5f0 con 0x7f9684102560 2024-09-19T07:03:43.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.418+0000 7f967affd640 1 -- 172.21.15.99:0/457926210 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f967c03daa0 con 0x7f9684102560 2024-09-19T07:03:43.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.418+0000 7f9688f0b640 1 -- 172.21.15.99:0/457926210 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f968410fb90 con 0x7f9684102560 2024-09-19T07:03:43.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.420+0000 7f9688f0b640 1 -- 172.21.15.99:0/457926210 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96840fdce0 con 0x7f9684102560 2024-09-19T07:03:43.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.420+0000 7f967affd640 1 -- 172.21.15.99:0/457926210 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f967c02f030 con 0x7f9684102560 2024-09-19T07:03:43.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.420+0000 7f967affd640 1 --2- 172.21.15.99:0/457926210 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f967006e530 0x7f96700709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:43.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.421+0000 7f967affd640 1 -- 172.21.15.99:0/457926210 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f967c0af240 con 0x7f9684102560 2024-09-19T07:03:43.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.421+0000 7f9681d9b640 1 --2- 172.21.15.99:0/457926210 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f967006e530 0x7f96700709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:43.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.421+0000 7f9681d9b640 1 --2- 172.21.15.99:0/457926210 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f967006e530 0x7f96700709e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9684110d60 tx=0x7f966c009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:03:43.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.425+0000 7f967affd640 1 -- 172.21.15.99:0/457926210 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f967c078330 con 0x7f9684102560 2024-09-19T07:03:43.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.608+0000 7f9688f0b640 1 -- 172.21.15.99:0/457926210 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f968404b720 con 0x7f967006e530 2024-09-19T07:03:43.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.610+0000 7f967affd640 1 -- 172.21.15.99:0/457926210 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f968404b720 con 0x7f967006e530 2024-09-19T07:03:43.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.612+0000 7f9688f0b640 1 -- 172.21.15.99:0/457926210 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f967006e530 msgr2=0x7f96700709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:43.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.612+0000 7f9688f0b640 1 --2- 172.21.15.99:0/457926210 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f967006e530 0x7f96700709e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9684110d60 tx=0x7f966c009040 comp rx=0 tx=0).stop 2024-09-19T07:03:43.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.612+0000 7f9688f0b640 1 -- 172.21.15.99:0/457926210 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9684102560 msgr2=0x7f9684115420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:43.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.612+0000 7f9688f0b640 1 --2- 172.21.15.99:0/457926210 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9684102560 0x7f9684115420 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f967c004a30 tx=0x7f967c004d10 comp rx=0 tx=0).stop 2024-09-19T07:03:43.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.612+0000 7f9688f0b640 1 -- 172.21.15.99:0/457926210 shutdown_connections 2024-09-19T07:03:43.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.612+0000 7f9688f0b640 1 --2- 172.21.15.99:0/457926210 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f967006e530 0x7f96700709e0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:43.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.612+0000 7f9688f0b640 1 --2- 172.21.15.99:0/457926210 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9684102f00 0x7f9684115960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:43.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.612+0000 7f9688f0b640 1 --2- 172.21.15.99:0/457926210 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9684102560 0x7f9684115420 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:43.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.612+0000 7f9688f0b640 1 -- 172.21.15.99:0/457926210 >> 172.21.15.99:0/457926210 conn(0x7f96840f8120 msgr2=0x7f96840f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:03:43.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.612+0000 7f9688f0b640 1 -- 172.21.15.99:0/457926210 shutdown_connections 2024-09-19T07:03:43.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.612+0000 7f9688f0b640 1 -- 172.21.15.99:0/457926210 wait complete. 2024-09-19T07:03:43.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.690+0000 7fb6bf97c640 1 -- 172.21.15.99:0/3358668741 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb6b8102550 msgr2=0x7fb6b8102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:43.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.690+0000 7fb6bf97c640 1 --2- 172.21.15.99:0/3358668741 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb6b8102550 0x7fb6b8102920 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fb6b40048d0 tx=0x7fb6b4009da0 comp rx=0 tx=0).stop 2024-09-19T07:03:43.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.690+0000 7fb6bf97c640 1 -- 172.21.15.99:0/3358668741 shutdown_connections 2024-09-19T07:03:43.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.690+0000 7fb6bf97c640 1 --2- 172.21.15.99:0/3358668741 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6b8102ef0 0x7fb6b80fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:43.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.690+0000 7fb6bf97c640 1 --2- 172.21.15.99:0/3358668741 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb6b8102550 0x7fb6b8102920 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:43.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.690+0000 7fb6bf97c640 1 -- 172.21.15.99:0/3358668741 >> 172.21.15.99:0/3358668741 conn(0x7fb6b80f80f0 msgr2=0x7fb6b80fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:03:43.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.691+0000 7fb6bf97c640 1 -- 172.21.15.99:0/3358668741 shutdown_connections 2024-09-19T07:03:43.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.691+0000 7fb6bf97c640 1 -- 172.21.15.99:0/3358668741 wait complete. 2024-09-19T07:03:43.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.691+0000 7fb6bf97c640 1 Processor -- start 2024-09-19T07:03:43.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.691+0000 7fb6bf97c640 1 -- start start 2024-09-19T07:03:43.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.692+0000 7fb6bf97c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb6b8102550 0x7fb6b8113540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:43.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.692+0000 7fb6bf97c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6b8102ef0 0x7fb6b8113a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:43.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.692+0000 7fb6bf97c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b81140d0 con 0x7fb6b8102550 2024-09-19T07:03:43.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.692+0000 7fb6bf97c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b810d4e0 con 0x7fb6b8102ef0 2024-09-19T07:03:43.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.692+0000 7fb6bd718640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb6b8102550 0x7fb6b8113540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:43.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.692+0000 7fb6bd718640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb6b8102550 0x7fb6b8113540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55708/0 (socket says 172.21.15.99:55708) 2024-09-19T07:03:43.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.692+0000 7fb6bd718640 1 -- 172.21.15.99:0/283406953 learned_addr learned my addr 172.21.15.99:0/283406953 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:03:43.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.692+0000 7fb6bcf17640 1 --2- 172.21.15.99:0/283406953 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6b8102ef0 0x7fb6b8113a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:43.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.692+0000 7fb6bd718640 1 -- 172.21.15.99:0/283406953 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6b8102ef0 msgr2=0x7fb6b8113a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:43.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.692+0000 7fb6bd718640 1 --2- 172.21.15.99:0/283406953 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6b8102ef0 0x7fb6b8113a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:43.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.692+0000 7fb6bd718640 1 -- 172.21.15.99:0/283406953 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6b4005040 con 0x7fb6b8102550 2024-09-19T07:03:43.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.692+0000 7fb6bd718640 1 --2- 172.21.15.99:0/283406953 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb6b8102550 0x7fb6b8113540 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fb6b4000c00 tx=0x7fb6b4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:03:43.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.692+0000 7fb6adffb640 1 -- 172.21.15.99:0/283406953 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb6b4038070 con 0x7fb6b8102550 2024-09-19T07:03:43.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.692+0000 7fb6adffb640 1 -- 172.21.15.99:0/283406953 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb6b402ade0 con 0x7fb6b8102550 2024-09-19T07:03:43.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.692+0000 7fb6bf97c640 1 -- 172.21.15.99:0/283406953 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6b810d760 con 0x7fb6b8102550 2024-09-19T07:03:43.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.692+0000 7fb6adffb640 1 -- 172.21.15.99:0/283406953 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb6b402c7e0 con 0x7fb6b8102550 2024-09-19T07:03:43.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.693+0000 7fb6bf97c640 1 -- 172.21.15.99:0/283406953 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6b810dca0 con 0x7fb6b8102550 2024-09-19T07:03:43.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.694+0000 7fb6bf97c640 1 -- 172.21.15.99:0/283406953 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6b80fdcd0 con 0x7fb6b8102550 2024-09-19T07:03:43.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.694+0000 7fb6adffb640 1 -- 172.21.15.99:0/283406953 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fb6b4030020 con 0x7fb6b8102550 2024-09-19T07:03:43.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.695+0000 7fb6adffb640 1 --2- 172.21.15.99:0/283406953 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fb6a406e530 0x7fb6a40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:43.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.695+0000 7fb6adffb640 1 -- 172.21.15.99:0/283406953 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fb6b40add00 con 0x7fb6b8102550 2024-09-19T07:03:43.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.695+0000 7fb6bcf17640 1 --2- 172.21.15.99:0/283406953 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fb6a406e530 0x7fb6a40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:43.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.695+0000 7fb6bcf17640 1 --2- 172.21.15.99:0/283406953 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fb6a406e530 0x7fb6a40709e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb6b810e7c0 tx=0x7fb6a800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:03:43.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.699+0000 7fb6adffb640 1 -- 172.21.15.99:0/283406953 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fb6b4076f20 con 0x7fb6b8102550 2024-09-19T07:03:43.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.872+0000 7fb6bf97c640 1 -- 172.21.15.99:0/283406953 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb6b804b750 con 0x7fb6a406e530 2024-09-19T07:03:43.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.881+0000 7fb6adffb640 1 -- 172.21.15.99:0/283406953 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7fb6b804b750 con 0x7fb6a406e530 2024-09-19T07:03:43.882 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T07:03:43.882 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.smithi099 smithi099 *:9093,9094 running (22m) 15m ago 31m 23.4M - 0.25.0 c8568f914cd2 e7c1774d56b0 2024-09-19T07:03:43.882 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi099 smithi099 running (19m) 15m ago 31m 6899k - 19.1.1-361-g2f599a46 d2baa855c067 b9775f416b10 2024-09-19T07:03:43.882 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi117 smithi117 running (19m) 14m ago 30m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 38cf60c0d548 2024-09-19T07:03:43.883 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.smithi099 smithi099 *:3000 running (21m) 15m ago 30m 80.7M - 9.4.12 2bacad6d85d8 cd53a18d5410 2024-09-19T07:03:43.883 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.obarqf smithi099 running (15m) 15m ago 25m 12.2M - 19.1.1-361-g2f599a46 d2baa855c067 314a73082521 2024-09-19T07:03:43.883 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.xehbxe smithi099 running (15m) 15m ago 25m 14.4M - 19.1.1-361-g2f599a46 d2baa855c067 a2955a9d06e6 2024-09-19T07:03:43.883 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.bheqzh smithi117 running (14m) 14m ago 25m 11.8M - 19.1.1-361-g2f599a46 d2baa855c067 b1505937c0b7 2024-09-19T07:03:43.883 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.nooexo smithi117 running (15m) 14m ago 25m 13.1M - 19.1.1-361-g2f599a46 d2baa855c067 35bd7725855c 2024-09-19T07:03:43.883 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi099.pgvkqi smithi099 *:8443,9283,8765 running (22m) 15m ago 32m 505M - 19.1.1-361-g2f599a46 d2baa855c067 d5de99cb7e78 2024-09-19T07:03:43.883 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi117.ssmkcf smithi117 *:8443,9283,8765 running (21m) 14m ago 30m 444M - 19.1.1-361-g2f599a46 d2baa855c067 8b7ee0f871f5 2024-09-19T07:03:43.883 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi099 smithi099 running (20m) 15m ago 32m 52.4M 2048M 19.1.1-361-g2f599a46 d2baa855c067 ffe067438824 2024-09-19T07:03:43.883 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi117 smithi117 running (19m) 14m ago 30m 38.9M 2048M 19.1.1-361-g2f599a46 d2baa855c067 4cb7455e3ee7 2024-09-19T07:03:43.883 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi099 smithi099 *:9100 running (22m) 15m ago 31m 15.0M - 1.5.0 0da6a335fe13 dca7b4517dcc 2024-09-19T07:03:43.883 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi117 smithi117 *:9100 running (22m) 14m ago 30m 15.9M - 1.5.0 0da6a335fe13 8233ce3835d2 2024-09-19T07:03:43.883 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (18m) 15m ago 29m 100M 1557M 19.1.1-361-g2f599a46 d2baa855c067 8e22543bf933 2024-09-19T07:03:43.883 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (18m) 15m ago 29m 106M 1557M 19.1.1-361-g2f599a46 d2baa855c067 f54153d0ae09 2024-09-19T07:03:43.883 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (17m) 15m ago 28m 83.7M 1557M 19.1.1-361-g2f599a46 d2baa855c067 b1778ab88870 2024-09-19T07:03:43.884 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi117 running (17m) 14m ago 28m 102M 2581M 19.1.1-361-g2f599a46 d2baa855c067 ea5236b193d3 2024-09-19T07:03:43.884 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi117 running (16m) 14m ago 27m 93.5M 2581M 19.1.1-361-g2f599a46 d2baa855c067 27ac2c859a68 2024-09-19T07:03:43.884 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi117 running (16m) 14m ago 27m 100M 2581M 19.1.1-361-g2f599a46 d2baa855c067 de6aeb8544ce 2024-09-19T07:03:43.884 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.smithi099 smithi099 *:9095 running (21m) 15m ago 30m 64.4M - 2.43.0 a07b618ecd1d 15ad26ec6fb4 2024-09-19T07:03:43.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.883+0000 7fb6bf97c640 1 -- 172.21.15.99:0/283406953 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fb6a406e530 msgr2=0x7fb6a40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:43.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.883+0000 7fb6bf97c640 1 --2- 172.21.15.99:0/283406953 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fb6a406e530 0x7fb6a40709e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb6b810e7c0 tx=0x7fb6a800b040 comp rx=0 tx=0).stop 2024-09-19T07:03:43.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.883+0000 7fb6bf97c640 1 -- 172.21.15.99:0/283406953 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb6b8102550 msgr2=0x7fb6b8113540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:43.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.883+0000 7fb6bf97c640 1 --2- 172.21.15.99:0/283406953 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb6b8102550 0x7fb6b8113540 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fb6b4000c00 tx=0x7fb6b4009da0 comp rx=0 tx=0).stop 2024-09-19T07:03:43.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.883+0000 7fb6bf97c640 1 -- 172.21.15.99:0/283406953 shutdown_connections 2024-09-19T07:03:43.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.883+0000 7fb6bf97c640 1 --2- 172.21.15.99:0/283406953 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fb6a406e530 0x7fb6a40709e0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:43.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.883+0000 7fb6bf97c640 1 --2- 172.21.15.99:0/283406953 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb6b8102ef0 0x7fb6b8113a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:43.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.883+0000 7fb6bf97c640 1 --2- 172.21.15.99:0/283406953 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb6b8102550 0x7fb6b8113540 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:43.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.883+0000 7fb6bf97c640 1 -- 172.21.15.99:0/283406953 >> 172.21.15.99:0/283406953 conn(0x7fb6b80f80f0 msgr2=0x7fb6b80f9160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:03:43.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.883+0000 7fb6bf97c640 1 -- 172.21.15.99:0/283406953 shutdown_connections 2024-09-19T07:03:43.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.883+0000 7fb6bf97c640 1 -- 172.21.15.99:0/283406953 wait complete. 2024-09-19T07:03:43.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.961+0000 7f85c6f07640 1 -- 172.21.15.99:0/4231189471 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85c0100410 msgr2=0x7f85c01007e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:43.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.961+0000 7f85c6f07640 1 --2- 172.21.15.99:0/4231189471 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85c0100410 0x7f85c01007e0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f85b40048d0 tx=0x7f85b4009da0 comp rx=0 tx=0).stop 2024-09-19T07:03:43.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.961+0000 7f85c6f07640 1 -- 172.21.15.99:0/4231189471 shutdown_connections 2024-09-19T07:03:43.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.961+0000 7f85c6f07640 1 --2- 172.21.15.99:0/4231189471 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85c00fbd90 0x7f85c00fc200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:43.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.961+0000 7f85c6f07640 1 --2- 172.21.15.99:0/4231189471 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85c0100410 0x7f85c01007e0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:43.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.961+0000 7f85c6f07640 1 -- 172.21.15.99:0/4231189471 >> 172.21.15.99:0/4231189471 conn(0x7f85c0070ce0 msgr2=0x7f85c00710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:03:43.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.961+0000 7f85c6f07640 1 -- 172.21.15.99:0/4231189471 shutdown_connections 2024-09-19T07:03:43.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.961+0000 7f85c6f07640 1 -- 172.21.15.99:0/4231189471 wait complete. 2024-09-19T07:03:43.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.961+0000 7f85c6f07640 1 Processor -- start 2024-09-19T07:03:43.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.962+0000 7f85c6f07640 1 -- start start 2024-09-19T07:03:43.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.962+0000 7f85c6f07640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85c00fbd90 0x7f85c01121d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:43.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.962+0000 7f85c6f07640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85c0100410 0x7f85c0112710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:43.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.962+0000 7f85c6f07640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c0112da0 con 0x7f85c0100410 2024-09-19T07:03:43.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.962+0000 7f85c6f07640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c010c150 con 0x7f85c00fbd90 2024-09-19T07:03:43.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.962+0000 7f85bffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85c0100410 0x7f85c0112710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:43.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.962+0000 7f85bffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85c0100410 0x7f85c0112710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55736/0 (socket says 172.21.15.99:55736) 2024-09-19T07:03:43.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.962+0000 7f85bffff640 1 -- 172.21.15.99:0/459454016 learned_addr learned my addr 172.21.15.99:0/459454016 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:03:43.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.962+0000 7f85c4ca3640 1 --2- 172.21.15.99:0/459454016 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85c00fbd90 0x7f85c01121d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:43.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.962+0000 7f85bffff640 1 -- 172.21.15.99:0/459454016 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85c00fbd90 msgr2=0x7f85c01121d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:43.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.962+0000 7f85bffff640 1 --2- 172.21.15.99:0/459454016 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85c00fbd90 0x7f85c01121d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:43.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.962+0000 7f85bffff640 1 -- 172.21.15.99:0/459454016 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85b4005040 con 0x7f85c0100410 2024-09-19T07:03:43.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.963+0000 7f85bffff640 1 --2- 172.21.15.99:0/459454016 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85c0100410 0x7f85c0112710 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f85ac00daf0 tx=0x7f85ac00b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:03:43.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.963+0000 7f85bd7fa640 1 -- 172.21.15.99:0/459454016 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85ac00edb0 con 0x7f85c0100410 2024-09-19T07:03:43.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.963+0000 7f85bd7fa640 1 -- 172.21.15.99:0/459454016 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f85ac017910 con 0x7f85c0100410 2024-09-19T07:03:43.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.963+0000 7f85c6f07640 1 -- 172.21.15.99:0/459454016 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85c010c3d0 con 0x7f85c0100410 2024-09-19T07:03:43.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.963+0000 7f85bd7fa640 1 -- 172.21.15.99:0/459454016 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85ac0169f0 con 0x7f85c0100410 2024-09-19T07:03:43.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.963+0000 7f85c6f07640 1 -- 172.21.15.99:0/459454016 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85c010c8f0 con 0x7f85c0100410 2024-09-19T07:03:43.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.964+0000 7f85bd7fa640 1 -- 172.21.15.99:0/459454016 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f85ac014070 con 0x7f85c0100410 2024-09-19T07:03:43.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.964+0000 7f85c6f07640 1 -- 172.21.15.99:0/459454016 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85c00fcda0 con 0x7f85c0100410 2024-09-19T07:03:43.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.965+0000 7f85bd7fa640 1 --2- 172.21.15.99:0/459454016 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f85b006e530 0x7f85b00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:43.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.965+0000 7f85bd7fa640 1 -- 172.21.15.99:0/459454016 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f85ac090520 con 0x7f85c0100410 2024-09-19T07:03:43.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.965+0000 7f85c4ca3640 1 --2- 172.21.15.99:0/459454016 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f85b006e530 0x7f85b00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:43.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.965+0000 7f85c4ca3640 1 --2- 172.21.15.99:0/459454016 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f85b006e530 0x7f85b00709e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f85b4009ac0 tx=0x7f85b4035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:03:43.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:43.969+0000 7f85bd7fa640 1 -- 172.21.15.99:0/459454016 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f85ac059690 con 0x7f85c0100410 2024-09-19T07:03:44.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.203+0000 7f85c6f07640 1 -- 172.21.15.99:0/459454016 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f85c01085e0 con 0x7f85c0100410 2024-09-19T07:03:44.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.203+0000 7f85bd7fa640 1 -- 172.21.15.99:0/459454016 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f85ac05cd50 con 0x7f85c0100410 2024-09-19T07:03:44.204 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T07:03:44.205 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-09-19T07:03:44.205 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T07:03:44.205 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T07:03:44.205 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-09-19T07:03:44.205 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T07:03:44.205 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T07:03:44.205 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-09-19T07:03:44.205 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 6 2024-09-19T07:03:44.205 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T07:03:44.205 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": { 2024-09-19T07:03:44.205 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 4 2024-09-19T07:03:44.205 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T07:03:44.205 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-09-19T07:03:44.205 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 14 2024-09-19T07:03:44.206 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T07:03:44.206 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T07:03:44.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.205+0000 7f85c6f07640 1 -- 172.21.15.99:0/459454016 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f85b006e530 msgr2=0x7f85b00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:44.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.205+0000 7f85c6f07640 1 --2- 172.21.15.99:0/459454016 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f85b006e530 0x7f85b00709e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f85b4009ac0 tx=0x7f85b4035040 comp rx=0 tx=0).stop 2024-09-19T07:03:44.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.205+0000 7f85c6f07640 1 -- 172.21.15.99:0/459454016 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85c0100410 msgr2=0x7f85c0112710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:44.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.205+0000 7f85c6f07640 1 --2- 172.21.15.99:0/459454016 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85c0100410 0x7f85c0112710 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f85ac00daf0 tx=0x7f85ac00b460 comp rx=0 tx=0).stop 2024-09-19T07:03:44.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.206+0000 7f85c6f07640 1 -- 172.21.15.99:0/459454016 shutdown_connections 2024-09-19T07:03:44.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.206+0000 7f85c6f07640 1 --2- 172.21.15.99:0/459454016 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f85b006e530 0x7f85b00709e0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:44.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.206+0000 7f85c6f07640 1 --2- 172.21.15.99:0/459454016 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85c0100410 0x7f85c0112710 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:44.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.206+0000 7f85c6f07640 1 --2- 172.21.15.99:0/459454016 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f85c00fbd90 0x7f85c01121d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:44.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.206+0000 7f85c6f07640 1 -- 172.21.15.99:0/459454016 >> 172.21.15.99:0/459454016 conn(0x7f85c0070ce0 msgr2=0x7f85c00fa420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:03:44.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.206+0000 7f85c6f07640 1 -- 172.21.15.99:0/459454016 shutdown_connections 2024-09-19T07:03:44.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.206+0000 7f85c6f07640 1 -- 172.21.15.99:0/459454016 wait complete. 2024-09-19T07:03:44.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.286+0000 7f6a80d7a640 1 -- 172.21.15.99:0/2516725384 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a7c0fe460 msgr2=0x7f6a7c0fe830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:44.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.286+0000 7f6a80d7a640 1 --2- 172.21.15.99:0/2516725384 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a7c0fe460 0x7f6a7c0fe830 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c009c50 tx=0x7f6a6c004d10 comp rx=0 tx=0).stop 2024-09-19T07:03:44.287 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:44 smithi099 ceph-mon[97031]: pgmap v641: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:03:44.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.286+0000 7f6a80d7a640 1 -- 172.21.15.99:0/2516725384 shutdown_connections 2024-09-19T07:03:44.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.286+0000 7f6a80d7a640 1 --2- 172.21.15.99:0/2516725384 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a7c064fc0 0x7f6a7c065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:44.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.286+0000 7f6a80d7a640 1 --2- 172.21.15.99:0/2516725384 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a7c0fe460 0x7f6a7c0fe830 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:44.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.286+0000 7f6a80d7a640 1 -- 172.21.15.99:0/2516725384 >> 172.21.15.99:0/2516725384 conn(0x7f6a7c0723b0 msgr2=0x7f6a7c0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:03:44.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.286+0000 7f6a80d7a640 1 -- 172.21.15.99:0/2516725384 shutdown_connections 2024-09-19T07:03:44.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.286+0000 7f6a80d7a640 1 -- 172.21.15.99:0/2516725384 wait complete. 2024-09-19T07:03:44.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.286+0000 7f6a80d7a640 1 Processor -- start 2024-09-19T07:03:44.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.286+0000 7f6a80d7a640 1 -- start start 2024-09-19T07:03:44.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.287+0000 7f6a80d7a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a7c064fc0 0x7f6a7c1131b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:44.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.287+0000 7f6a80d7a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a7c0fe460 0x7f6a7c1136f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:44.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.287+0000 7f6a80d7a640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7c113cf0 con 0x7f6a7c064fc0 2024-09-19T07:03:44.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.287+0000 7f6a80d7a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7c10d130 con 0x7f6a7c0fe460 2024-09-19T07:03:44.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.287+0000 7f6a7a59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a7c064fc0 0x7f6a7c1131b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:44.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.287+0000 7f6a7a59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a7c064fc0 0x7f6a7c1131b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55748/0 (socket says 172.21.15.99:55748) 2024-09-19T07:03:44.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.287+0000 7f6a7a59c640 1 -- 172.21.15.99:0/830910303 learned_addr learned my addr 172.21.15.99:0/830910303 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:03:44.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.287+0000 7f6a79d9b640 1 --2- 172.21.15.99:0/830910303 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a7c0fe460 0x7f6a7c1136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:44.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.287+0000 7f6a7a59c640 1 -- 172.21.15.99:0/830910303 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a7c0fe460 msgr2=0x7f6a7c1136f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:44.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.287+0000 7f6a7a59c640 1 --2- 172.21.15.99:0/830910303 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a7c0fe460 0x7f6a7c1136f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:44.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.287+0000 7f6a7a59c640 1 -- 172.21.15.99:0/830910303 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a6c0098b0 con 0x7f6a7c064fc0 2024-09-19T07:03:44.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.287+0000 7f6a7a59c640 1 --2- 172.21.15.99:0/830910303 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a7c064fc0 0x7f6a7c1131b0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c004750 tx=0x7f6a6c004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:03:44.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.287+0000 7f6a6affd640 1 -- 172.21.15.99:0/830910303 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a6c009610 con 0x7f6a7c064fc0 2024-09-19T07:03:44.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.287+0000 7f6a6affd640 1 -- 172.21.15.99:0/830910303 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6a6c032b10 con 0x7f6a7c064fc0 2024-09-19T07:03:44.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.287+0000 7f6a80d7a640 1 -- 172.21.15.99:0/830910303 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a7c10d3b0 con 0x7f6a7c064fc0 2024-09-19T07:03:44.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.287+0000 7f6a6affd640 1 -- 172.21.15.99:0/830910303 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a6c03d990 con 0x7f6a7c064fc0 2024-09-19T07:03:44.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.288+0000 7f6a80d7a640 1 -- 172.21.15.99:0/830910303 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a7c10d950 con 0x7f6a7c064fc0 2024-09-19T07:03:44.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.289+0000 7f6a80d7a640 1 -- 172.21.15.99:0/830910303 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a7c0fdcf0 con 0x7f6a7c064fc0 2024-09-19T07:03:44.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.289+0000 7f6a6affd640 1 -- 172.21.15.99:0/830910303 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f6a6c02f030 con 0x7f6a7c064fc0 2024-09-19T07:03:44.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.290+0000 7f6a6affd640 1 --2- 172.21.15.99:0/830910303 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f6a6406e530 0x7f6a640709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:44.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.290+0000 7f6a6affd640 1 -- 172.21.15.99:0/830910303 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f6a6c0af220 con 0x7f6a7c064fc0 2024-09-19T07:03:44.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.290+0000 7f6a79d9b640 1 --2- 172.21.15.99:0/830910303 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f6a6406e530 0x7f6a640709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:44.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.290+0000 7f6a79d9b640 1 --2- 172.21.15.99:0/830910303 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f6a6406e530 0x7f6a640709e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6a70007fd0 tx=0x7f6a70009e90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:03:44.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.294+0000 7f6a6affd640 1 -- 172.21.15.99:0/830910303 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f6a6c078390 con 0x7f6a7c064fc0 2024-09-19T07:03:44.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.495+0000 7f6a80d7a640 1 -- 172.21.15.99:0/830910303 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6a7c04b720 con 0x7f6a7c064fc0 2024-09-19T07:03:44.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.496+0000 7f6a6affd640 1 -- 172.21.15.99:0/830910303 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 29 v29) v1 ==== 76+0+1915 (secure 0 0 0) 0x7f6a6c07ba50 con 0x7f6a7c064fc0 2024-09-19T07:03:44.497 INFO:teuthology.orchestra.run.smithi099.stdout:e29 2024-09-19T07:03:44.497 INFO:teuthology.orchestra.run.smithi099.stdout:btime 2024-09-19T06:48:47:938420+0000 2024-09-19T07:03:44.497 INFO:teuthology.orchestra.run.smithi099.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T07:03:44.497 INFO:teuthology.orchestra.run.smithi099.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T07:03:44.497 INFO:teuthology.orchestra.run.smithi099.stdout:legacy client fscid: 1 2024-09-19T07:03:44.498 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T07:03:44.498 INFO:teuthology.orchestra.run.smithi099.stdout:Filesystem 'cephfs' (1) 2024-09-19T07:03:44.498 INFO:teuthology.orchestra.run.smithi099.stdout:fs_name cephfs 2024-09-19T07:03:44.498 INFO:teuthology.orchestra.run.smithi099.stdout:epoch 20 2024-09-19T07:03:44.498 INFO:teuthology.orchestra.run.smithi099.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-19T07:03:44.498 INFO:teuthology.orchestra.run.smithi099.stdout:created 2024-09-19T06:37:40.838146+0000 2024-09-19T07:03:44.498 INFO:teuthology.orchestra.run.smithi099.stdout:modified 2024-09-19T06:47:50.076553+0000 2024-09-19T07:03:44.498 INFO:teuthology.orchestra.run.smithi099.stdout:tableserver 0 2024-09-19T07:03:44.498 INFO:teuthology.orchestra.run.smithi099.stdout:root 0 2024-09-19T07:03:44.498 INFO:teuthology.orchestra.run.smithi099.stdout:session_timeout 60 2024-09-19T07:03:44.498 INFO:teuthology.orchestra.run.smithi099.stdout:session_autoclose 300 2024-09-19T07:03:44.498 INFO:teuthology.orchestra.run.smithi099.stdout:max_file_size 1099511627776 2024-09-19T07:03:44.498 INFO:teuthology.orchestra.run.smithi099.stdout:max_xattr_size 65536 2024-09-19T07:03:44.498 INFO:teuthology.orchestra.run.smithi099.stdout:required_client_features {} 2024-09-19T07:03:44.499 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure 0 2024-09-19T07:03:44.499 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure_osd_epoch 77 2024-09-19T07:03:44.499 INFO:teuthology.orchestra.run.smithi099.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T07:03:44.499 INFO:teuthology.orchestra.run.smithi099.stdout:max_mds 2 2024-09-19T07:03:44.499 INFO:teuthology.orchestra.run.smithi099.stdout:in 0,1 2024-09-19T07:03:44.499 INFO:teuthology.orchestra.run.smithi099.stdout:up {} 2024-09-19T07:03:44.499 INFO:teuthology.orchestra.run.smithi099.stdout:failed 0,1 2024-09-19T07:03:44.499 INFO:teuthology.orchestra.run.smithi099.stdout:damaged 2024-09-19T07:03:44.499 INFO:teuthology.orchestra.run.smithi099.stdout:stopped 2024-09-19T07:03:44.499 INFO:teuthology.orchestra.run.smithi099.stdout:data_pools [3] 2024-09-19T07:03:44.499 INFO:teuthology.orchestra.run.smithi099.stdout:metadata_pool 2 2024-09-19T07:03:44.499 INFO:teuthology.orchestra.run.smithi099.stdout:inline_data disabled 2024-09-19T07:03:44.499 INFO:teuthology.orchestra.run.smithi099.stdout:balancer 2024-09-19T07:03:44.500 INFO:teuthology.orchestra.run.smithi099.stdout:bal_rank_mask -1 2024-09-19T07:03:44.500 INFO:teuthology.orchestra.run.smithi099.stdout:standby_count_wanted 1 2024-09-19T07:03:44.500 INFO:teuthology.orchestra.run.smithi099.stdout:qdb_cluster leader: 0 members: 2024-09-19T07:03:44.500 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T07:03:44.500 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T07:03:44.500 INFO:teuthology.orchestra.run.smithi099.stdout:Standby daemons: 2024-09-19T07:03:44.500 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T07:03:44.500 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.obarqf{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6826/1859154203,v1:172.21.15.99:6827/1859154203] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:03:44.500 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.xehbxe{-1:34410} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.99:6828/1939453719,v1:172.21.15.99:6829/1939453719] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:03:44.500 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.nooexo{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6824/1398895079,v1:172.21.15.117:6825/1398895079] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:03:44.500 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.bheqzh{-1:44329} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6826/3233337308,v1:172.21.15.117:6827/3233337308] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:03:44.501 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 29 2024-09-19T07:03:44.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.498+0000 7f6a80d7a640 1 -- 172.21.15.99:0/830910303 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f6a6406e530 msgr2=0x7f6a640709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:44.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.498+0000 7f6a80d7a640 1 --2- 172.21.15.99:0/830910303 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f6a6406e530 0x7f6a640709e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6a70007fd0 tx=0x7f6a70009e90 comp rx=0 tx=0).stop 2024-09-19T07:03:44.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.498+0000 7f6a80d7a640 1 -- 172.21.15.99:0/830910303 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a7c064fc0 msgr2=0x7f6a7c1131b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:44.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.498+0000 7f6a80d7a640 1 --2- 172.21.15.99:0/830910303 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a7c064fc0 0x7f6a7c1131b0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c004750 tx=0x7f6a6c004d10 comp rx=0 tx=0).stop 2024-09-19T07:03:44.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.498+0000 7f6a80d7a640 1 -- 172.21.15.99:0/830910303 shutdown_connections 2024-09-19T07:03:44.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.498+0000 7f6a80d7a640 1 --2- 172.21.15.99:0/830910303 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f6a6406e530 0x7f6a640709e0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:44.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.498+0000 7f6a80d7a640 1 --2- 172.21.15.99:0/830910303 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a7c0fe460 0x7f6a7c1136f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:44.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.498+0000 7f6a80d7a640 1 --2- 172.21.15.99:0/830910303 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a7c064fc0 0x7f6a7c1131b0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:44.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.498+0000 7f6a80d7a640 1 -- 172.21.15.99:0/830910303 >> 172.21.15.99:0/830910303 conn(0x7f6a7c0723b0 msgr2=0x7f6a7c105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:03:44.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.498+0000 7f6a80d7a640 1 -- 172.21.15.99:0/830910303 shutdown_connections 2024-09-19T07:03:44.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.498+0000 7f6a80d7a640 1 -- 172.21.15.99:0/830910303 wait complete. 2024-09-19T07:03:44.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:44 smithi117 ceph-mon[76771]: pgmap v641: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:03:44.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.576+0000 7fb1291e4640 1 -- 172.21.15.99:0/3268817082 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1240fb4a0 msgr2=0x7fb1240fb910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:44.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.576+0000 7fb1291e4640 1 --2- 172.21.15.99:0/3268817082 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1240fb4a0 0x7fb1240fb910 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fb1140048d0 tx=0x7fb114009da0 comp rx=0 tx=0).stop 2024-09-19T07:03:44.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.576+0000 7fb1291e4640 1 -- 172.21.15.99:0/3268817082 shutdown_connections 2024-09-19T07:03:44.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.576+0000 7fb1291e4640 1 --2- 172.21.15.99:0/3268817082 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1240fb4a0 0x7fb1240fb910 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:44.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.576+0000 7fb1291e4640 1 --2- 172.21.15.99:0/3268817082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1241014e0 0x7fb1241018b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:44.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.576+0000 7fb1291e4640 1 -- 172.21.15.99:0/3268817082 >> 172.21.15.99:0/3268817082 conn(0x7fb1240f7060 msgr2=0x7fb1240f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:03:44.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.576+0000 7fb1291e4640 1 -- 172.21.15.99:0/3268817082 shutdown_connections 2024-09-19T07:03:44.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.576+0000 7fb1291e4640 1 -- 172.21.15.99:0/3268817082 wait complete. 2024-09-19T07:03:44.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.577+0000 7fb1291e4640 1 Processor -- start 2024-09-19T07:03:44.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.577+0000 7fb1291e4640 1 -- start start 2024-09-19T07:03:44.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.577+0000 7fb1291e4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1240fb4a0 0x7fb12410e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:44.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.577+0000 7fb1291e4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1241014e0 0x7fb12410e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:44.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.577+0000 7fb1291e4640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb12410eda0 con 0x7fb1240fb4a0 2024-09-19T07:03:44.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.577+0000 7fb1291e4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb12410ef10 con 0x7fb1241014e0 2024-09-19T07:03:44.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.577+0000 7fb122d9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1240fb4a0 0x7fb12410e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:44.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.577+0000 7fb122d9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1240fb4a0 0x7fb12410e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55778/0 (socket says 172.21.15.99:55778) 2024-09-19T07:03:44.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.577+0000 7fb122d9d640 1 -- 172.21.15.99:0/2377604809 learned_addr learned my addr 172.21.15.99:0/2377604809 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:03:44.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.577+0000 7fb12259c640 1 --2- 172.21.15.99:0/2377604809 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1241014e0 0x7fb12410e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:44.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.578+0000 7fb122d9d640 1 -- 172.21.15.99:0/2377604809 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1241014e0 msgr2=0x7fb12410e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:44.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.578+0000 7fb122d9d640 1 --2- 172.21.15.99:0/2377604809 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1241014e0 0x7fb12410e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:44.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.578+0000 7fb122d9d640 1 -- 172.21.15.99:0/2377604809 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb114005040 con 0x7fb1240fb4a0 2024-09-19T07:03:44.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.578+0000 7fb122d9d640 1 --2- 172.21.15.99:0/2377604809 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1240fb4a0 0x7fb12410e1d0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fb10c00b790 tx=0x7fb10c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:03:44.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.578+0000 7fb11b7fe640 1 -- 172.21.15.99:0/2377604809 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb10c00c700 con 0x7fb1240fb4a0 2024-09-19T07:03:44.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.578+0000 7fb1291e4640 1 -- 172.21.15.99:0/2377604809 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1241172a0 con 0x7fb1240fb4a0 2024-09-19T07:03:44.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.578+0000 7fb11b7fe640 1 -- 172.21.15.99:0/2377604809 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb10c00cd00 con 0x7fb1240fb4a0 2024-09-19T07:03:44.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.579+0000 7fb11b7fe640 1 -- 172.21.15.99:0/2377604809 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb10c015e70 con 0x7fb1240fb4a0 2024-09-19T07:03:44.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.579+0000 7fb1291e4640 1 -- 172.21.15.99:0/2377604809 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb124117770 con 0x7fb1240fb4a0 2024-09-19T07:03:44.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.580+0000 7fb11b7fe640 1 -- 172.21.15.99:0/2377604809 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fb10c012070 con 0x7fb1240fb4a0 2024-09-19T07:03:44.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.580+0000 7fb1291e4640 1 -- 172.21.15.99:0/2377604809 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1240fcbe0 con 0x7fb1240fb4a0 2024-09-19T07:03:44.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.580+0000 7fb11b7fe640 1 --2- 172.21.15.99:0/2377604809 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fb11006e530 0x7fb1100709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:44.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.580+0000 7fb12259c640 1 --2- 172.21.15.99:0/2377604809 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fb11006e530 0x7fb1100709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:44.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.580+0000 7fb11b7fe640 1 -- 172.21.15.99:0/2377604809 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fb10c08dd30 con 0x7fb1240fb4a0 2024-09-19T07:03:44.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.581+0000 7fb12259c640 1 --2- 172.21.15.99:0/2377604809 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fb11006e530 0x7fb1100709e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb124066490 tx=0x7fb114035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:03:44.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.585+0000 7fb11b7fe640 1 -- 172.21.15.99:0/2377604809 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fb10c056e20 con 0x7fb1240fb4a0 2024-09-19T07:03:44.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.769+0000 7fb1291e4640 1 -- 172.21.15.99:0/2377604809 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb124066240 con 0x7fb11006e530 2024-09-19T07:03:44.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.770+0000 7fb11b7fe640 1 -- 172.21.15.99:0/2377604809 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fb124066240 con 0x7fb11006e530 2024-09-19T07:03:44.771 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T07:03:44.771 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e", 2024-09-19T07:03:44.772 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": true, 2024-09-19T07:03:44.772 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-19T07:03:44.772 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [ 2024-09-19T07:03:44.772 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr", 2024-09-19T07:03:44.772 INFO:teuthology.orchestra.run.smithi099.stdout: "crash", 2024-09-19T07:03:44.772 INFO:teuthology.orchestra.run.smithi099.stdout: "mds", 2024-09-19T07:03:44.772 INFO:teuthology.orchestra.run.smithi099.stdout: "mon", 2024-09-19T07:03:44.772 INFO:teuthology.orchestra.run.smithi099.stdout: "osd" 2024-09-19T07:03:44.772 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-19T07:03:44.772 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": "16/21 daemons upgraded", 2024-09-19T07:03:44.772 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "Currently upgrading mds daemons", 2024-09-19T07:03:44.773 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-09-19T07:03:44.773 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T07:03:44.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.773+0000 7fb1291e4640 1 -- 172.21.15.99:0/2377604809 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fb11006e530 msgr2=0x7fb1100709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:44.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.773+0000 7fb1291e4640 1 --2- 172.21.15.99:0/2377604809 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fb11006e530 0x7fb1100709e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb124066490 tx=0x7fb114035040 comp rx=0 tx=0).stop 2024-09-19T07:03:44.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.773+0000 7fb1291e4640 1 -- 172.21.15.99:0/2377604809 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1240fb4a0 msgr2=0x7fb12410e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:44.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.773+0000 7fb1291e4640 1 --2- 172.21.15.99:0/2377604809 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1240fb4a0 0x7fb12410e1d0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fb10c00b790 tx=0x7fb10c0091d0 comp rx=0 tx=0).stop 2024-09-19T07:03:44.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.773+0000 7fb1291e4640 1 -- 172.21.15.99:0/2377604809 shutdown_connections 2024-09-19T07:03:44.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.773+0000 7fb1291e4640 1 --2- 172.21.15.99:0/2377604809 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fb11006e530 0x7fb1100709e0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:44.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.773+0000 7fb1291e4640 1 --2- 172.21.15.99:0/2377604809 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1241014e0 0x7fb12410e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:44.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.773+0000 7fb1291e4640 1 --2- 172.21.15.99:0/2377604809 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1240fb4a0 0x7fb12410e1d0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:44.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.773+0000 7fb1291e4640 1 -- 172.21.15.99:0/2377604809 >> 172.21.15.99:0/2377604809 conn(0x7fb1240f7060 msgr2=0x7fb1240f8960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:03:44.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.773+0000 7fb1291e4640 1 -- 172.21.15.99:0/2377604809 shutdown_connections 2024-09-19T07:03:44.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.773+0000 7fb1291e4640 1 -- 172.21.15.99:0/2377604809 wait complete. 2024-09-19T07:03:44.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.851+0000 7ff5aed4d640 1 -- 172.21.15.99:0/3695197207 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5a80fdf00 msgr2=0x7ff5a81065d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:44.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.851+0000 7ff5aed4d640 1 --2- 172.21.15.99:0/3695197207 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5a80fdf00 0x7ff5a81065d0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7ff594004900 tx=0x7ff594009da0 comp rx=0 tx=0).stop 2024-09-19T07:03:44.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.851+0000 7ff5aed4d640 1 -- 172.21.15.99:0/3695197207 shutdown_connections 2024-09-19T07:03:44.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.851+0000 7ff5aed4d640 1 --2- 172.21.15.99:0/3695197207 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5a80fdf00 0x7ff5a81065d0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:44.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.851+0000 7ff5aed4d640 1 --2- 172.21.15.99:0/3695197207 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5a80fd560 0x7ff5a80fd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:44.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.851+0000 7ff5aed4d640 1 -- 172.21.15.99:0/3695197207 >> 172.21.15.99:0/3695197207 conn(0x7ff5a80f7020 msgr2=0x7ff5a80f9430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:03:44.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.851+0000 7ff5aed4d640 1 -- 172.21.15.99:0/3695197207 shutdown_connections 2024-09-19T07:03:44.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.851+0000 7ff5aed4d640 1 -- 172.21.15.99:0/3695197207 wait complete. 2024-09-19T07:03:44.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.852+0000 7ff5aed4d640 1 Processor -- start 2024-09-19T07:03:44.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.852+0000 7ff5aed4d640 1 -- start start 2024-09-19T07:03:44.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.852+0000 7ff5aed4d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5a80fd560 0x7ff5a8113250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:44.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.852+0000 7ff5aed4d640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5a80fdf00 0x7ff5a8113790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:44.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.852+0000 7ff5aed4d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a8113d90 con 0x7ff5a80fd560 2024-09-19T07:03:44.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.852+0000 7ff5aed4d640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a8113f00 con 0x7ff5a80fdf00 2024-09-19T07:03:44.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.852+0000 7ff5acae9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5a80fd560 0x7ff5a8113250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:44.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.852+0000 7ff5acae9640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5a80fd560 0x7ff5a8113250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55788/0 (socket says 172.21.15.99:55788) 2024-09-19T07:03:44.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.852+0000 7ff5acae9640 1 -- 172.21.15.99:0/2318716984 learned_addr learned my addr 172.21.15.99:0/2318716984 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:03:44.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.852+0000 7ff5a7fff640 1 --2- 172.21.15.99:0/2318716984 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5a80fdf00 0x7ff5a8113790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:44.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.853+0000 7ff5acae9640 1 -- 172.21.15.99:0/2318716984 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5a80fdf00 msgr2=0x7ff5a8113790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:44.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.853+0000 7ff5acae9640 1 --2- 172.21.15.99:0/2318716984 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5a80fdf00 0x7ff5a8113790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:44.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.853+0000 7ff5acae9640 1 -- 172.21.15.99:0/2318716984 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff594005040 con 0x7ff5a80fd560 2024-09-19T07:03:44.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.853+0000 7ff5acae9640 1 --2- 172.21.15.99:0/2318716984 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5a80fd560 0x7ff5a8113250 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7ff59c00c830 tx=0x7ff59c004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:03:44.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.853+0000 7ff5a57fa640 1 -- 172.21.15.99:0/2318716984 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff59c00a7d0 con 0x7ff5a80fd560 2024-09-19T07:03:44.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.853+0000 7ff5a57fa640 1 -- 172.21.15.99:0/2318716984 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff59c00add0 con 0x7ff5a80fd560 2024-09-19T07:03:44.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.853+0000 7ff5aed4d640 1 -- 172.21.15.99:0/2318716984 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5a810d380 con 0x7ff5a80fd560 2024-09-19T07:03:44.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.853+0000 7ff5a57fa640 1 -- 172.21.15.99:0/2318716984 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff59c0113a0 con 0x7ff5a80fd560 2024-09-19T07:03:44.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.853+0000 7ff5aed4d640 1 -- 172.21.15.99:0/2318716984 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5a810d8a0 con 0x7ff5a80fd560 2024-09-19T07:03:44.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.854+0000 7ff5aed4d640 1 -- 172.21.15.99:0/2318716984 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5a80662f0 con 0x7ff5a80fd560 2024-09-19T07:03:44.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.855+0000 7ff5a57fa640 1 -- 172.21.15.99:0/2318716984 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7ff59c012400 con 0x7ff5a80fd560 2024-09-19T07:03:44.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.855+0000 7ff5a57fa640 1 --2- 172.21.15.99:0/2318716984 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ff59806e530 0x7ff5980709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:03:44.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.855+0000 7ff5a57fa640 1 -- 172.21.15.99:0/2318716984 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7ff59c08e270 con 0x7ff5a80fd560 2024-09-19T07:03:44.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.855+0000 7ff5a7fff640 1 --2- 172.21.15.99:0/2318716984 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ff59806e530 0x7ff5980709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:03:44.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.856+0000 7ff5a7fff640 1 --2- 172.21.15.99:0/2318716984 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ff59806e530 0x7ff5980709e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff5a810eb50 tx=0x7ff594035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:03:44.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:44.860+0000 7ff5a57fa640 1 -- 172.21.15.99:0/2318716984 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7ff59c0573e0 con 0x7ff5a80fd560 2024-09-19T07:03:45.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:45.091+0000 7ff5aed4d640 1 -- 172.21.15.99:0/2318716984 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7ff5a804b7b0 con 0x7ff5a80fd560 2024-09-19T07:03:45.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:45.091+0000 7ff5a57fa640 1 -- 172.21.15.99:0/2318716984 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7ff59c05aaa0 con 0x7ff5a80fd560 2024-09-19T07:03:45.093 INFO:teuthology.orchestra.run.smithi099.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-09-19T07:03:45.093 INFO:teuthology.orchestra.run.smithi099.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-19T07:03:45.093 INFO:teuthology.orchestra.run.smithi099.stdout: fs cephfs is degraded 2024-09-19T07:03:45.093 INFO:teuthology.orchestra.run.smithi099.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-19T07:03:45.093 INFO:teuthology.orchestra.run.smithi099.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-19T07:03:45.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:45.093+0000 7ff5aed4d640 1 -- 172.21.15.99:0/2318716984 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ff59806e530 msgr2=0x7ff5980709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:45.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:45.093+0000 7ff5aed4d640 1 --2- 172.21.15.99:0/2318716984 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ff59806e530 0x7ff5980709e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff5a810eb50 tx=0x7ff594035040 comp rx=0 tx=0).stop 2024-09-19T07:03:45.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:45.093+0000 7ff5aed4d640 1 -- 172.21.15.99:0/2318716984 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5a80fd560 msgr2=0x7ff5a8113250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:03:45.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:45.093+0000 7ff5aed4d640 1 --2- 172.21.15.99:0/2318716984 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5a80fd560 0x7ff5a8113250 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7ff59c00c830 tx=0x7ff59c004430 comp rx=0 tx=0).stop 2024-09-19T07:03:45.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:45.093+0000 7ff5aed4d640 1 -- 172.21.15.99:0/2318716984 shutdown_connections 2024-09-19T07:03:45.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:45.093+0000 7ff5aed4d640 1 --2- 172.21.15.99:0/2318716984 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7ff59806e530 0x7ff5980709e0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:45.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:45.093+0000 7ff5aed4d640 1 --2- 172.21.15.99:0/2318716984 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff5a80fdf00 0x7ff5a8113790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:45.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:45.093+0000 7ff5aed4d640 1 --2- 172.21.15.99:0/2318716984 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5a80fd560 0x7ff5a8113250 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:03:45.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:45.093+0000 7ff5aed4d640 1 -- 172.21.15.99:0/2318716984 >> 172.21.15.99:0/2318716984 conn(0x7ff5a80f7020 msgr2=0x7ff5a80f86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:03:45.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:45.093+0000 7ff5aed4d640 1 -- 172.21.15.99:0/2318716984 shutdown_connections 2024-09-19T07:03:45.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:03:45.093+0000 7ff5aed4d640 1 -- 172.21.15.99:0/2318716984 wait complete. 2024-09-19T07:03:45.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:45 smithi099 ceph-mon[97031]: from='client.35202 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:03:45.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:45 smithi099 ceph-mon[97031]: from='client.35206 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:03:45.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:45 smithi099 ceph-mon[97031]: from='client.35210 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:03:45.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:45 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/459454016' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T07:03:45.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:45 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/830910303' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T07:03:45.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:45 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/2318716984' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T07:03:45.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:45 smithi117 ceph-mon[76771]: from='client.35202 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:03:45.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:45 smithi117 ceph-mon[76771]: from='client.35206 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:03:45.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:45 smithi117 ceph-mon[76771]: from='client.35210 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:03:45.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:45 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/459454016' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T07:03:45.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:45 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/830910303' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T07:03:45.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:45 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/2318716984' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T07:03:46.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:46 smithi099 ceph-mon[97031]: from='client.35222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:03:46.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:46 smithi099 ceph-mon[97031]: pgmap v642: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:03:46.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:46 smithi117 ceph-mon[76771]: from='client.35222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:03:46.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:46 smithi117 ceph-mon[76771]: pgmap v642: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:03:47.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:47 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:47.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:47 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:03:47.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:47 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T07:03:47.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:47 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:03:47.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:47 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T07:03:47.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:47 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T07:03:47.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:47 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T07:03:47.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:47 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T07:03:47.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:47 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T07:03:47.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:47 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T07:03:47.458 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:47 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi099.obarqf"}]: dispatch 2024-09-19T07:03:47.458 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:47 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi099.obarqf"}]': finished 2024-09-19T07:03:47.458 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:47 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi099.xehbxe"}]: dispatch 2024-09-19T07:03:47.458 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:47 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi099.xehbxe"}]': finished 2024-09-19T07:03:47.458 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:47 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi117.bheqzh"}]: dispatch 2024-09-19T07:03:47.458 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:47 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi117.bheqzh"}]': finished 2024-09-19T07:03:47.458 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:47 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi117.nooexo"}]: dispatch 2024-09-19T07:03:47.458 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:47 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi117.nooexo"}]': finished 2024-09-19T07:03:47.459 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:47 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-09-19T07:03:47.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:47 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:47.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:47 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:03:47.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:47 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T07:03:47.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:47 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:03:47.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:47 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T07:03:47.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:47 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T07:03:47.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:47 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T07:03:47.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:47 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T07:03:47.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:47 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T07:03:47.563 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:47 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T07:03:47.563 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:47 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi099.obarqf"}]: dispatch 2024-09-19T07:03:47.563 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:47 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi099.obarqf"}]': finished 2024-09-19T07:03:47.563 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:47 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi099.xehbxe"}]: dispatch 2024-09-19T07:03:47.563 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:47 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi099.xehbxe"}]': finished 2024-09-19T07:03:47.563 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:47 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi117.bheqzh"}]: dispatch 2024-09-19T07:03:47.563 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:47 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi117.bheqzh"}]': finished 2024-09-19T07:03:47.563 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:47 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi117.nooexo"}]: dispatch 2024-09-19T07:03:47.563 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:47 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi117.nooexo"}]': finished 2024-09-19T07:03:47.563 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:47 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-09-19T07:03:48.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:48 smithi099 ceph-mon[97031]: pgmap v643: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:03:48.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:48 smithi099 ceph-mon[97031]: Upgrade: Setting container_image for all mds 2024-09-19T07:03:48.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:48 smithi099 ceph-mon[97031]: Upgrade: Setting filesystem cephfs Joinable 2024-09-19T07:03:48.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:48 smithi099 ceph-mon[97031]: Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED) 2024-09-19T07:03:48.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:48 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-19T07:03:48.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:48 smithi099 ceph-mon[97031]: Standby daemon mds.cephfs.smithi099.obarqf assigned to filesystem cephfs as rank 0 2024-09-19T07:03:48.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:48 smithi099 ceph-mon[97031]: Standby daemon mds.cephfs.smithi099.xehbxe assigned to filesystem cephfs as rank 1 2024-09-19T07:03:48.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:48 smithi099 ceph-mon[97031]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T07:03:48.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:48 smithi099 ceph-mon[97031]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-19T07:03:48.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:48 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T07:03:48.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:48 smithi099 ceph-mon[97031]: fsmap cephfs:2/2 {0=cephfs.smithi099.obarqf=up:replay,1=cephfs.smithi099.xehbxe=up:replay} 2 up:standby 2024-09-19T07:03:48.458 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:48 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T07:03:48.458 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:48 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T07:03:48.458 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:48 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T07:03:48.458 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:48 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T07:03:48.458 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:48 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T07:03:48.458 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:48 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T07:03:48.458 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:48 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T07:03:48.458 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:48 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T07:03:48.458 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:48 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T07:03:48.458 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:48 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T07:03:48.458 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:48 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T07:03:48.458 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:48 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T07:03:48.458 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:48 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T07:03:48.459 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:48 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T07:03:48.459 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:48 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T07:03:48.459 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:48 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T07:03:48.459 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:48 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T07:03:48.459 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:48 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T07:03:48.459 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:48 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-19T07:03:48.459 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:48 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-19T07:03:48.459 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:48 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T07:03:48.460 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:48 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-19T07:03:48.460 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:48 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-19T07:03:48.460 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:48 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-19T07:03:48.460 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:48 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-19T07:03:48.460 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:48 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-19T07:03:48.460 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:48 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-19T07:03:48.460 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:48 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-19T07:03:48.460 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:48 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-19T07:03:48.460 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:48 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-19T07:03:48.460 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:48 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-19T07:03:48.460 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:48 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-19T07:03:48.460 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:48 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T07:03:48.461 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:48 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-19T07:03:48.461 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:48 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-19T07:03:48.461 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:48 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-19T07:03:48.461 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:48 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-19T07:03:48.461 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:48 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-19T07:03:48.461 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:48 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-19T07:03:48.461 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:48 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-19T07:03:48.461 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:48 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-19T07:03:48.461 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:48 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T07:03:48.461 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:48 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T07:03:48.461 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:48 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T07:03:48.462 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:48 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T07:03:48.462 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:48 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T07:03:48.462 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:48 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T07:03:48.462 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:48 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-19T07:03:48.462 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:48 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-19T07:03:48.462 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:48 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:03:48.462 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:48 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T07:03:48.462 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:48 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T07:03:48.462 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:48 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T07:03:48.462 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:48 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T07:03:48.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:48 smithi117 ceph-mon[76771]: pgmap v643: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:03:48.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:48 smithi117 ceph-mon[76771]: Upgrade: Setting container_image for all mds 2024-09-19T07:03:48.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:48 smithi117 ceph-mon[76771]: Upgrade: Setting filesystem cephfs Joinable 2024-09-19T07:03:48.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:48 smithi117 ceph-mon[76771]: Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED) 2024-09-19T07:03:48.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:48 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-19T07:03:48.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:48 smithi117 ceph-mon[76771]: Standby daemon mds.cephfs.smithi099.obarqf assigned to filesystem cephfs as rank 0 2024-09-19T07:03:48.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:48 smithi117 ceph-mon[76771]: Standby daemon mds.cephfs.smithi099.xehbxe assigned to filesystem cephfs as rank 1 2024-09-19T07:03:48.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:48 smithi117 ceph-mon[76771]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T07:03:48.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:48 smithi117 ceph-mon[76771]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-19T07:03:48.563 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:48 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T07:03:48.563 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:48 smithi117 ceph-mon[76771]: fsmap cephfs:2/2 {0=cephfs.smithi099.obarqf=up:replay,1=cephfs.smithi099.xehbxe=up:replay} 2 up:standby 2024-09-19T07:03:48.563 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:48 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T07:03:48.563 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:48 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T07:03:48.563 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:48 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T07:03:48.563 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:48 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T07:03:48.563 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:48 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T07:03:48.563 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:48 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T07:03:48.563 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:48 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T07:03:48.563 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:48 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T07:03:48.563 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:48 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T07:03:48.563 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:48 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T07:03:48.563 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:48 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T07:03:48.564 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:48 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T07:03:48.564 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:48 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T07:03:48.564 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:48 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T07:03:48.564 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:48 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T07:03:48.564 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:48 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T07:03:48.564 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:48 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T07:03:48.564 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:48 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T07:03:48.564 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:48 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-19T07:03:48.564 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:48 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-19T07:03:48.565 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:48 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T07:03:48.565 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:48 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-19T07:03:48.565 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:48 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-19T07:03:48.565 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:48 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-19T07:03:48.565 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:48 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-19T07:03:48.565 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:48 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-19T07:03:48.565 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:48 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-19T07:03:48.565 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:48 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-19T07:03:48.565 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:48 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-19T07:03:48.565 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:48 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-19T07:03:48.565 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:48 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-19T07:03:48.565 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:48 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-19T07:03:48.565 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:48 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T07:03:48.566 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:48 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-19T07:03:48.566 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:48 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-19T07:03:48.566 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:48 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-19T07:03:48.566 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:48 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-19T07:03:48.566 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:48 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-19T07:03:48.566 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:48 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-19T07:03:48.566 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:48 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-19T07:03:48.566 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:48 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-19T07:03:48.566 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:48 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T07:03:48.566 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:48 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T07:03:48.566 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:48 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T07:03:48.566 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:48 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T07:03:48.566 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:48 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T07:03:48.567 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:48 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-19T07:03:48.567 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:48 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-19T07:03:48.567 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:48 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-19T07:03:48.567 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:48 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:03:48.567 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:48 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T07:03:48.567 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:48 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T07:03:48.567 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:48 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T07:03:48.567 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:48 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T07:03:49.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:49 smithi117 ceph-mon[76771]: Upgrade: Setting container_image for all rgw 2024-09-19T07:03:49.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:49 smithi117 ceph-mon[76771]: Upgrade: Setting container_image for all rbd-mirror 2024-09-19T07:03:49.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:49 smithi117 ceph-mon[76771]: Upgrade: Setting container_image for all ceph-exporter 2024-09-19T07:03:49.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:49 smithi117 ceph-mon[76771]: Upgrade: Setting container_image for all iscsi 2024-09-19T07:03:49.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:49 smithi117 ceph-mon[76771]: Upgrade: Setting container_image for all nfs 2024-09-19T07:03:49.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:49 smithi117 ceph-mon[76771]: Upgrade: Setting container_image for all nvmeof 2024-09-19T07:03:49.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:49 smithi117 ceph-mon[76771]: Upgrade: Finalizing container_image settings 2024-09-19T07:03:49.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:49 smithi117 ceph-mon[76771]: Upgrade: Complete! 2024-09-19T07:03:49.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:49 smithi117 ceph-mon[76771]: pgmap v644: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 718 KiB/s rd, 0 op/s 2024-09-19T07:03:49.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:49 smithi099 ceph-mon[97031]: Upgrade: Setting container_image for all rgw 2024-09-19T07:03:49.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:49 smithi099 ceph-mon[97031]: Upgrade: Setting container_image for all rbd-mirror 2024-09-19T07:03:49.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:49 smithi099 ceph-mon[97031]: Upgrade: Setting container_image for all ceph-exporter 2024-09-19T07:03:49.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:49 smithi099 ceph-mon[97031]: Upgrade: Setting container_image for all iscsi 2024-09-19T07:03:49.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:49 smithi099 ceph-mon[97031]: Upgrade: Setting container_image for all nfs 2024-09-19T07:03:49.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:49 smithi099 ceph-mon[97031]: Upgrade: Setting container_image for all nvmeof 2024-09-19T07:03:49.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:49 smithi099 ceph-mon[97031]: Upgrade: Finalizing container_image settings 2024-09-19T07:03:49.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:49 smithi099 ceph-mon[97031]: Upgrade: Complete! 2024-09-19T07:03:49.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:49 smithi099 ceph-mon[97031]: pgmap v644: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 718 KiB/s rd, 0 op/s 2024-09-19T07:03:51.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:51 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T07:03:51.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:51 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T07:03:51.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:51 smithi099 ceph-mon[97031]: pgmap v645: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 9.8 MiB/s rd, 4 op/s 2024-09-19T07:03:51.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:51 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T07:03:51.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:51 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T07:03:51.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:51 smithi117 ceph-mon[76771]: pgmap v645: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 9.8 MiB/s rd, 4 op/s 2024-09-19T07:03:53.152 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:52 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T07:03:53.152 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:52 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:03:53.152 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:52 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T07:03:53.152 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:52 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T07:03:53.152 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:52 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T07:03:53.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:52 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T07:03:53.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:52 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:03:53.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:52 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T07:03:53.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:52 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T07:03:53.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:52 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T07:03:54.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:54 smithi117 ceph-mon[76771]: pgmap v646: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 19 MiB/s rd, 6 op/s 2024-09-19T07:03:54.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:54 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:54.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:54 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:03:54.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:54 smithi117 ceph-mon[76771]: pgmap v647: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 7 op/s 2024-09-19T07:03:54.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:54 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T07:03:54.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:54 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:03:54.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:54 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:54.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:54 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:03:54.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:54 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T07:03:54.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:54 smithi099 ceph-mon[97031]: pgmap v646: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 19 MiB/s rd, 6 op/s 2024-09-19T07:03:54.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:54 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:54.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:54 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:03:54.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:54 smithi099 ceph-mon[97031]: pgmap v647: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 7 op/s 2024-09-19T07:03:54.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:54 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T07:03:54.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:54 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:03:54.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:54 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:03:54.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:54 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:03:54.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:54 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T07:03:55.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:55 smithi117 ceph-mon[76771]: Health check cleared: CEPHADM_REFRESH_FAILED (was: failed to probe daemons or devices) 2024-09-19T07:03:55.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:55 smithi117 ceph-mon[76771]: mds.? [v2:172.21.15.99:6828/1939453719,v1:172.21.15.99:6829/1939453719] up:resolve 2024-09-19T07:03:55.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:55 smithi117 ceph-mon[76771]: mds.? [v2:172.21.15.99:6826/1859154203,v1:172.21.15.99:6827/1859154203] up:resolve 2024-09-19T07:03:55.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:55 smithi117 ceph-mon[76771]: fsmap cephfs:2/2 {0=cephfs.smithi099.obarqf=up:resolve,1=cephfs.smithi099.xehbxe=up:resolve} 2 up:standby 2024-09-19T07:03:55.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:55 smithi099 ceph-mon[97031]: Health check cleared: CEPHADM_REFRESH_FAILED (was: failed to probe daemons or devices) 2024-09-19T07:03:55.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:55 smithi099 ceph-mon[97031]: mds.? [v2:172.21.15.99:6828/1939453719,v1:172.21.15.99:6829/1939453719] up:resolve 2024-09-19T07:03:55.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:55 smithi099 ceph-mon[97031]: mds.? [v2:172.21.15.99:6826/1859154203,v1:172.21.15.99:6827/1859154203] up:resolve 2024-09-19T07:03:55.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:55 smithi099 ceph-mon[97031]: fsmap cephfs:2/2 {0=cephfs.smithi099.obarqf=up:resolve,1=cephfs.smithi099.xehbxe=up:resolve} 2 up:standby 2024-09-19T07:03:56.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:56 smithi099 ceph-mon[97031]: pgmap v648: 65 pgs: 65 active+clean; 254 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 8 op/s 2024-09-19T07:03:56.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:56 smithi099 ceph-mon[97031]: reconnect by client.14514 192.168.0.1:0/3783729462 after 0.000999975 2024-09-19T07:03:56.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:56 smithi099 ceph-mon[97031]: reconnect by client.14514 192.168.0.1:0/3783729462 after 0.000999975 2024-09-19T07:03:56.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:56 smithi099 ceph-mon[97031]: reconnect by client.24315 192.168.0.1:0/2424309154 after 0.00199995 2024-09-19T07:03:56.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:56 smithi099 ceph-mon[97031]: reconnect by client.24315 192.168.0.1:0/2424309154 after 0.00199995 2024-09-19T07:03:56.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:56 smithi099 ceph-mon[97031]: mds.? [v2:172.21.15.99:6828/1939453719,v1:172.21.15.99:6829/1939453719] up:reconnect 2024-09-19T07:03:56.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:56 smithi099 ceph-mon[97031]: mds.? [v2:172.21.15.99:6826/1859154203,v1:172.21.15.99:6827/1859154203] up:reconnect 2024-09-19T07:03:56.457 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:56 smithi099 ceph-mon[97031]: fsmap cephfs:2/2 {0=cephfs.smithi099.obarqf=up:reconnect,1=cephfs.smithi099.xehbxe=up:reconnect} 2 up:standby 2024-09-19T07:03:56.474 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:56 smithi117 ceph-mon[76771]: pgmap v648: 65 pgs: 65 active+clean; 254 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 8 op/s 2024-09-19T07:03:56.474 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:56 smithi117 ceph-mon[76771]: reconnect by client.14514 192.168.0.1:0/3783729462 after 0.000999975 2024-09-19T07:03:56.474 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:56 smithi117 ceph-mon[76771]: reconnect by client.14514 192.168.0.1:0/3783729462 after 0.000999975 2024-09-19T07:03:56.474 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:56 smithi117 ceph-mon[76771]: reconnect by client.24315 192.168.0.1:0/2424309154 after 0.00199995 2024-09-19T07:03:56.474 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:56 smithi117 ceph-mon[76771]: reconnect by client.24315 192.168.0.1:0/2424309154 after 0.00199995 2024-09-19T07:03:56.474 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:56 smithi117 ceph-mon[76771]: mds.? [v2:172.21.15.99:6828/1939453719,v1:172.21.15.99:6829/1939453719] up:reconnect 2024-09-19T07:03:56.474 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:56 smithi117 ceph-mon[76771]: mds.? [v2:172.21.15.99:6826/1859154203,v1:172.21.15.99:6827/1859154203] up:reconnect 2024-09-19T07:03:56.474 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:56 smithi117 ceph-mon[76771]: fsmap cephfs:2/2 {0=cephfs.smithi099.obarqf=up:reconnect,1=cephfs.smithi099.xehbxe=up:reconnect} 2 up:standby 2024-09-19T07:03:57.441 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:57 smithi117 ceph-mon[76771]: mds.? [v2:172.21.15.99:6828/1939453719,v1:172.21.15.99:6829/1939453719] up:rejoin 2024-09-19T07:03:57.441 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:57 smithi117 ceph-mon[76771]: mds.? [v2:172.21.15.99:6826/1859154203,v1:172.21.15.99:6827/1859154203] up:rejoin 2024-09-19T07:03:57.441 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:57 smithi117 ceph-mon[76771]: fsmap cephfs:2/2 {0=cephfs.smithi099.obarqf=up:rejoin,1=cephfs.smithi099.xehbxe=up:rejoin} 2 up:standby 2024-09-19T07:03:57.441 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:57 smithi117 ceph-mon[76771]: daemon mds.cephfs.smithi099.xehbxe is now active in filesystem cephfs as rank 1 2024-09-19T07:03:57.441 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:57 smithi117 ceph-mon[76771]: daemon mds.cephfs.smithi099.obarqf is now active in filesystem cephfs as rank 0 2024-09-19T07:03:57.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:57 smithi099 ceph-mon[97031]: mds.? [v2:172.21.15.99:6828/1939453719,v1:172.21.15.99:6829/1939453719] up:rejoin 2024-09-19T07:03:57.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:57 smithi099 ceph-mon[97031]: mds.? [v2:172.21.15.99:6826/1859154203,v1:172.21.15.99:6827/1859154203] up:rejoin 2024-09-19T07:03:57.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:57 smithi099 ceph-mon[97031]: fsmap cephfs:2/2 {0=cephfs.smithi099.obarqf=up:rejoin,1=cephfs.smithi099.xehbxe=up:rejoin} 2 up:standby 2024-09-19T07:03:57.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:57 smithi099 ceph-mon[97031]: daemon mds.cephfs.smithi099.xehbxe is now active in filesystem cephfs as rank 1 2024-09-19T07:03:57.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:57 smithi099 ceph-mon[97031]: daemon mds.cephfs.smithi099.obarqf is now active in filesystem cephfs as rank 0 2024-09-19T07:03:58.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:58 smithi099 ceph-mon[97031]: pgmap v649: 65 pgs: 65 active+clean; 254 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 24 MiB/s rd, 96 B/s wr, 8 op/s 2024-09-19T07:03:58.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:58 smithi099 ceph-mon[97031]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T07:03:58.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:58 smithi099 ceph-mon[97031]: Cluster is now healthy 2024-09-19T07:03:58.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:58 smithi099 ceph-mon[97031]: mds.? [v2:172.21.15.99:6828/1939453719,v1:172.21.15.99:6829/1939453719] up:active 2024-09-19T07:03:58.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:58 smithi099 ceph-mon[97031]: mds.? [v2:172.21.15.99:6826/1859154203,v1:172.21.15.99:6827/1859154203] up:active 2024-09-19T07:03:58.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:58 smithi099 ceph-mon[97031]: fsmap cephfs:2 {0=cephfs.smithi099.obarqf=up:active,1=cephfs.smithi099.xehbxe=up:active} 2 up:standby 2024-09-19T07:03:58.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:58 smithi117 ceph-mon[76771]: pgmap v649: 65 pgs: 65 active+clean; 254 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 24 MiB/s rd, 96 B/s wr, 8 op/s 2024-09-19T07:03:58.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:58 smithi117 ceph-mon[76771]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T07:03:58.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:58 smithi117 ceph-mon[76771]: Cluster is now healthy 2024-09-19T07:03:58.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:58 smithi117 ceph-mon[76771]: mds.? [v2:172.21.15.99:6828/1939453719,v1:172.21.15.99:6829/1939453719] up:active 2024-09-19T07:03:58.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:58 smithi117 ceph-mon[76771]: mds.? [v2:172.21.15.99:6826/1859154203,v1:172.21.15.99:6827/1859154203] up:active 2024-09-19T07:03:58.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:58 smithi117 ceph-mon[76771]: fsmap cephfs:2 {0=cephfs.smithi099.obarqf=up:active,1=cephfs.smithi099.xehbxe=up:active} 2 up:standby 2024-09-19T07:03:59.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:03:59 smithi099 ceph-mon[97031]: pgmap v650: 65 pgs: 65 active+clean; 254 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 96 B/s wr, 8 op/s 2024-09-19T07:03:59.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:03:59 smithi117 ceph-mon[76771]: pgmap v650: 65 pgs: 65 active+clean; 254 MiB data, 977 MiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 96 B/s wr, 8 op/s 2024-09-19T07:04:02.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:04:01 smithi117 ceph-mon[76771]: pgmap v651: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 13 MiB/s rd, 5.1 KiB/s wr, 10 op/s 2024-09-19T07:04:02.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:04:01 smithi099 ceph-mon[97031]: pgmap v651: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 13 MiB/s rd, 5.1 KiB/s wr, 10 op/s 2024-09-19T07:04:03.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:04:03 smithi099 ceph-mon[97031]: pgmap v652: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 3.3 MiB/s rd, 5.1 KiB/s wr, 10 op/s 2024-09-19T07:04:03.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:04:03 smithi117 ceph-mon[76771]: pgmap v652: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 3.3 MiB/s rd, 5.1 KiB/s wr, 10 op/s 2024-09-19T07:04:05.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:04:05 smithi117 ceph-mon[76771]: pgmap v653: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.9 MiB/s rd, 8.4 KiB/s wr, 10 op/s 2024-09-19T07:04:05.705 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:04:05 smithi099 ceph-mon[97031]: pgmap v653: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.9 MiB/s rd, 8.4 KiB/s wr, 10 op/s 2024-09-19T07:04:08.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:04:07 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T07:04:08.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:04:07 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:04:08.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:04:07 smithi099 ceph-mon[97031]: pgmap v654: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 8.4 KiB/s wr, 10 op/s 2024-09-19T07:04:08.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:04:07 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T07:04:08.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:04:07 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:04:08.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:04:07 smithi117 ceph-mon[76771]: pgmap v654: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 8.4 KiB/s wr, 10 op/s 2024-09-19T07:04:09.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:04:09 smithi117 ceph-mon[76771]: pgmap v655: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 6.2 KiB/s rd, 8.3 KiB/s wr, 9 op/s 2024-09-19T07:04:09.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:04:09 smithi099 ceph-mon[97031]: pgmap v655: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 6.2 KiB/s rd, 8.3 KiB/s wr, 9 op/s 2024-09-19T07:04:12.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:04:11 smithi117 ceph-mon[76771]: pgmap v656: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 6.0 KiB/s rd, 8.3 KiB/s wr, 9 op/s 2024-09-19T07:04:12.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:04:11 smithi099 ceph-mon[97031]: pgmap v656: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 6.0 KiB/s rd, 8.3 KiB/s wr, 9 op/s 2024-09-19T07:04:13.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:04:13 smithi099 ceph-mon[97031]: pgmap v657: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3.9 KiB/s wr, 3 op/s 2024-09-19T07:04:13.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:04:13 smithi117 ceph-mon[76771]: pgmap v657: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3.9 KiB/s wr, 3 op/s 2024-09-19T07:04:15.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:15.184+0000 7f30e4567640 1 -- 172.21.15.99:0/1169454031 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f30dc102ef0 msgr2=0x7f30dc0fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:04:15.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:15.184+0000 7f30e4567640 1 --2- 172.21.15.99:0/1169454031 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f30dc102ef0 0x7f30dc0fc5b0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f30cc0048d0 tx=0x7f30cc009da0 comp rx=0 tx=0).stop 2024-09-19T07:04:15.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:15.185+0000 7f30e4567640 1 -- 172.21.15.99:0/1169454031 shutdown_connections 2024-09-19T07:04:15.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:15.185+0000 7f30e4567640 1 --2- 172.21.15.99:0/1169454031 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f30dc102ef0 0x7f30dc0fc5b0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:04:15.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:15.185+0000 7f30e4567640 1 --2- 172.21.15.99:0/1169454031 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30dc102550 0x7f30dc102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:04:15.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:15.185+0000 7f30e4567640 1 -- 172.21.15.99:0/1169454031 >> 172.21.15.99:0/1169454031 conn(0x7f30dc0f80f0 msgr2=0x7f30dc0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:04:15.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:15.185+0000 7f30e4567640 1 -- 172.21.15.99:0/1169454031 shutdown_connections 2024-09-19T07:04:15.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:15.185+0000 7f30e4567640 1 -- 172.21.15.99:0/1169454031 wait complete. 2024-09-19T07:04:15.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:15.185+0000 7f30e4567640 1 Processor -- start 2024-09-19T07:04:15.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:15.185+0000 7f30e4567640 1 -- start start 2024-09-19T07:04:15.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:15.186+0000 7f30e4567640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f30dc102550 0x7f30dc113520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:04:15.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:15.186+0000 7f30e4567640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30dc102ef0 0x7f30dc113a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:04:15.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:15.186+0000 7f30e4567640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30dc1140b0 con 0x7f30dc102550 2024-09-19T07:04:15.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:15.186+0000 7f30e4567640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30dc10d4c0 con 0x7f30dc102ef0 2024-09-19T07:04:15.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:15.186+0000 7f30e2303640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f30dc102550 0x7f30dc113520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:04:15.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:15.186+0000 7f30e2303640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f30dc102550 0x7f30dc113520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41560/0 (socket says 172.21.15.99:41560) 2024-09-19T07:04:15.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:15.186+0000 7f30e2303640 1 -- 172.21.15.99:0/2952413644 learned_addr learned my addr 172.21.15.99:0/2952413644 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:04:15.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:15.186+0000 7f30e2303640 1 -- 172.21.15.99:0/2952413644 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30dc102ef0 msgr2=0x7f30dc113a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:04:15.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:15.186+0000 7f30e2303640 1 --2- 172.21.15.99:0/2952413644 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30dc102ef0 0x7f30dc113a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:04:15.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:15.186+0000 7f30e2303640 1 -- 172.21.15.99:0/2952413644 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30cc005040 con 0x7f30dc102550 2024-09-19T07:04:15.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:15.186+0000 7f30e2303640 1 --2- 172.21.15.99:0/2952413644 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f30dc102550 0x7f30dc113520 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f30d8002a50 tx=0x7f30d8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:04:15.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:15.186+0000 7f30d2ffd640 1 -- 172.21.15.99:0/2952413644 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30d8007c30 con 0x7f30dc102550 2024-09-19T07:04:15.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:15.187+0000 7f30e4567640 1 -- 172.21.15.99:0/2952413644 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30dc10d7a0 con 0x7f30dc102550 2024-09-19T07:04:15.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:15.187+0000 7f30d2ffd640 1 -- 172.21.15.99:0/2952413644 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f30d800f040 con 0x7f30dc102550 2024-09-19T07:04:15.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:15.187+0000 7f30d2ffd640 1 -- 172.21.15.99:0/2952413644 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30d800da90 con 0x7f30dc102550 2024-09-19T07:04:15.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:15.187+0000 7f30e4567640 1 -- 172.21.15.99:0/2952413644 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30dc10dd40 con 0x7f30dc102550 2024-09-19T07:04:15.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:15.188+0000 7f30e4567640 1 -- 172.21.15.99:0/2952413644 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30dc0fdcd0 con 0x7f30dc102550 2024-09-19T07:04:15.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:15.188+0000 7f30d2ffd640 1 -- 172.21.15.99:0/2952413644 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f30d800dd00 con 0x7f30dc102550 2024-09-19T07:04:15.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:15.189+0000 7f30d2ffd640 1 --2- 172.21.15.99:0/2952413644 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f30c806e530 0x7f30c80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:04:15.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:15.189+0000 7f30d2ffd640 1 -- 172.21.15.99:0/2952413644 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f30d808da70 con 0x7f30dc102550 2024-09-19T07:04:15.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:15.189+0000 7f30e1b02640 1 --2- 172.21.15.99:0/2952413644 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f30c806e530 0x7f30c80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:04:15.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:15.189+0000 7f30e1b02640 1 --2- 172.21.15.99:0/2952413644 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f30c806e530 0x7f30c80709e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f30cc009ac0 tx=0x7f30cc009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:04:15.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:15.193+0000 7f30d2ffd640 1 -- 172.21.15.99:0/2952413644 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f30d8056b60 con 0x7f30dc102550 2024-09-19T07:04:15.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:15.378+0000 7f30e4567640 1 -- 172.21.15.99:0/2952413644 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f30dc109610 con 0x7f30c806e530 2024-09-19T07:04:15.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:15.379+0000 7f30d2ffd640 1 -- 172.21.15.99:0/2952413644 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f30dc109610 con 0x7f30c806e530 2024-09-19T07:04:15.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:15.381+0000 7f30e4567640 1 -- 172.21.15.99:0/2952413644 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f30c806e530 msgr2=0x7f30c80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:04:15.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:15.381+0000 7f30e4567640 1 --2- 172.21.15.99:0/2952413644 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f30c806e530 0x7f30c80709e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f30cc009ac0 tx=0x7f30cc009da0 comp rx=0 tx=0).stop 2024-09-19T07:04:15.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:15.381+0000 7f30e4567640 1 -- 172.21.15.99:0/2952413644 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f30dc102550 msgr2=0x7f30dc113520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:04:15.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:15.381+0000 7f30e4567640 1 --2- 172.21.15.99:0/2952413644 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f30dc102550 0x7f30dc113520 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f30d8002a50 tx=0x7f30d8004600 comp rx=0 tx=0).stop 2024-09-19T07:04:15.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:15.381+0000 7f30e4567640 1 -- 172.21.15.99:0/2952413644 shutdown_connections 2024-09-19T07:04:15.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:15.381+0000 7f30e4567640 1 --2- 172.21.15.99:0/2952413644 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f30c806e530 0x7f30c80709e0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:04:15.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:15.381+0000 7f30e4567640 1 --2- 172.21.15.99:0/2952413644 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f30dc102ef0 0x7f30dc113a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:04:15.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:15.381+0000 7f30e4567640 1 --2- 172.21.15.99:0/2952413644 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f30dc102550 0x7f30dc113520 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:04:15.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:15.381+0000 7f30e4567640 1 -- 172.21.15.99:0/2952413644 >> 172.21.15.99:0/2952413644 conn(0x7f30dc0f80f0 msgr2=0x7f30dc0f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:04:15.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:15.381+0000 7f30e4567640 1 -- 172.21.15.99:0/2952413644 shutdown_connections 2024-09-19T07:04:15.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:15.381+0000 7f30e4567640 1 -- 172.21.15.99:0/2952413644 wait complete. 2024-09-19T07:04:15.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:04:15 smithi099 ceph-mon[97031]: pgmap v658: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 3.9 KiB/s wr, 1 op/s 2024-09-19T07:04:15.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:04:15 smithi117 ceph-mon[76771]: pgmap v658: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail; 3.9 KiB/s wr, 1 op/s 2024-09-19T07:04:16.101 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -e sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 -- bash -c 'ceph orch ps' 2024-09-19T07:04:16.393 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T07:04:16.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:04:16 smithi099 ceph-mon[97031]: from='client.35230 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:04:16.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:04:16 smithi117 ceph-mon[76771]: from='client.35230 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:04:17.467 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:04:17 smithi099 ceph-mon[97031]: pgmap v659: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:04:17.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:04:17 smithi117 ceph-mon[76771]: pgmap v659: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:04:17.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:17.948+0000 7febfc7dc640 1 -- 172.21.15.99:0/1067497867 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7febf4064fc0 msgr2=0x7febf4065430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:04:17.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:17.948+0000 7febfc7dc640 1 --2- 172.21.15.99:0/1067497867 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7febf4064fc0 0x7febf4065430 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7febe80048d0 tx=0x7febe8009da0 comp rx=0 tx=0).stop 2024-09-19T07:04:17.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:17.948+0000 7febfc7dc640 1 -- 172.21.15.99:0/1067497867 shutdown_connections 2024-09-19T07:04:17.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:17.948+0000 7febfc7dc640 1 --2- 172.21.15.99:0/1067497867 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7febf4064fc0 0x7febf4065430 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:04:17.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:17.948+0000 7febfc7dc640 1 --2- 172.21.15.99:0/1067497867 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7febf40fe460 0x7febf40fe830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:04:17.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:17.948+0000 7febfc7dc640 1 -- 172.21.15.99:0/1067497867 >> 172.21.15.99:0/1067497867 conn(0x7febf40723b0 msgr2=0x7febf40727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:04:17.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:17.948+0000 7febfc7dc640 1 -- 172.21.15.99:0/1067497867 shutdown_connections 2024-09-19T07:04:17.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:17.948+0000 7febfc7dc640 1 -- 172.21.15.99:0/1067497867 wait complete. 2024-09-19T07:04:17.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:17.949+0000 7febfc7dc640 1 Processor -- start 2024-09-19T07:04:17.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:17.949+0000 7febfc7dc640 1 -- start start 2024-09-19T07:04:17.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:17.949+0000 7febfc7dc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7febf4064fc0 0x7febf41131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:04:17.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:17.949+0000 7febfc7dc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7febf40fe460 0x7febf4113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:04:17.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:17.949+0000 7febfc7dc640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf4113d10 con 0x7febf40fe460 2024-09-19T07:04:17.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:17.949+0000 7febfc7dc640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf410d1a0 con 0x7febf4064fc0 2024-09-19T07:04:17.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:17.949+0000 7febf9d77640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7febf40fe460 0x7febf4113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:04:17.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:17.949+0000 7febf9d77640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7febf40fe460 0x7febf4113710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45716/0 (socket says 172.21.15.99:45716) 2024-09-19T07:04:17.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:17.949+0000 7febf9d77640 1 -- 172.21.15.99:0/1880063780 learned_addr learned my addr 172.21.15.99:0/1880063780 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:04:17.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:17.949+0000 7febfa578640 1 --2- 172.21.15.99:0/1880063780 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7febf4064fc0 0x7febf41131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:04:17.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:17.949+0000 7febf9d77640 1 -- 172.21.15.99:0/1880063780 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7febf4064fc0 msgr2=0x7febf41131d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:04:17.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:17.949+0000 7febf9d77640 1 --2- 172.21.15.99:0/1880063780 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7febf4064fc0 0x7febf41131d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:04:17.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:17.949+0000 7febf9d77640 1 -- 172.21.15.99:0/1880063780 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe8005040 con 0x7febf40fe460 2024-09-19T07:04:17.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:17.950+0000 7febf9d77640 1 --2- 172.21.15.99:0/1880063780 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7febf40fe460 0x7febf4113710 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7febe8003080 tx=0x7febe8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:04:17.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:17.950+0000 7febf2ffd640 1 -- 172.21.15.99:0/1880063780 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7febe8038070 con 0x7febf40fe460 2024-09-19T07:04:17.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:17.950+0000 7febf2ffd640 1 -- 172.21.15.99:0/1880063780 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7febe80097e0 con 0x7febf40fe460 2024-09-19T07:04:17.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:17.950+0000 7febfc7dc640 1 -- 172.21.15.99:0/1880063780 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febf410d420 con 0x7febf40fe460 2024-09-19T07:04:17.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:17.950+0000 7febf2ffd640 1 -- 172.21.15.99:0/1880063780 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7febe803d420 con 0x7febf40fe460 2024-09-19T07:04:17.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:17.950+0000 7febfc7dc640 1 -- 172.21.15.99:0/1880063780 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febf410d960 con 0x7febf40fe460 2024-09-19T07:04:17.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:17.951+0000 7febfc7dc640 1 -- 172.21.15.99:0/1880063780 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febf40fdcf0 con 0x7febf40fe460 2024-09-19T07:04:17.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:17.951+0000 7febf2ffd640 1 -- 172.21.15.99:0/1880063780 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7febe8030020 con 0x7febf40fe460 2024-09-19T07:04:17.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:17.952+0000 7febf2ffd640 1 --2- 172.21.15.99:0/1880063780 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7febdc06e530 0x7febdc0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:04:17.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:17.952+0000 7febf2ffd640 1 -- 172.21.15.99:0/1880063780 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7febe80ae720 con 0x7febf40fe460 2024-09-19T07:04:17.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:17.952+0000 7febfa578640 1 --2- 172.21.15.99:0/1880063780 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7febdc06e530 0x7febdc0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:04:17.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:17.952+0000 7febfa578640 1 --2- 172.21.15.99:0/1880063780 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7febdc06e530 0x7febdc0709e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7febe4004550 tx=0x7febe4009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:04:17.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:17.956+0000 7febf2ffd640 1 -- 172.21.15.99:0/1880063780 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7febe8077810 con 0x7febf40fe460 2024-09-19T07:04:18.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:18.133+0000 7febfc7dc640 1 -- 172.21.15.99:0/1880063780 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7febf410e840 con 0x7febdc06e530 2024-09-19T07:04:18.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:18.143+0000 7febf2ffd640 1 -- 172.21.15.99:0/1880063780 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7febf410e840 con 0x7febdc06e530 2024-09-19T07:04:18.144 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T07:04:18.144 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.smithi099 smithi099 *:9093,9094 running (23m) 25s ago 31m 23.9M - 0.25.0 c8568f914cd2 e7c1774d56b0 2024-09-19T07:04:18.144 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi099 smithi099 running (19m) 25s ago 31m 6899k - 19.1.1-361-g2f599a46 d2baa855c067 b9775f416b10 2024-09-19T07:04:18.144 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi117 smithi117 running (19m) 27s ago 31m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 38cf60c0d548 2024-09-19T07:04:18.144 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.smithi099 smithi099 *:3000 running (21m) 25s ago 31m 81.4M - 9.4.12 2bacad6d85d8 cd53a18d5410 2024-09-19T07:04:18.144 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.obarqf smithi099 running (16m) 25s ago 26m 86.0M - 19.1.1-361-g2f599a46 d2baa855c067 314a73082521 2024-09-19T07:04:18.145 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.xehbxe smithi099 running (16m) 25s ago 26m 93.2M - 19.1.1-361-g2f599a46 d2baa855c067 a2955a9d06e6 2024-09-19T07:04:18.145 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.bheqzh smithi117 running (15m) 27s ago 26m 18.4M - 19.1.1-361-g2f599a46 d2baa855c067 b1505937c0b7 2024-09-19T07:04:18.145 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.nooexo smithi117 running (15m) 27s ago 26m 18.4M - 19.1.1-361-g2f599a46 d2baa855c067 35bd7725855c 2024-09-19T07:04:18.145 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi099.pgvkqi smithi099 *:8443,9283,8765 running (22m) 25s ago 33m 508M - 19.1.1-361-g2f599a46 d2baa855c067 d5de99cb7e78 2024-09-19T07:04:18.145 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi117.ssmkcf smithi117 *:8443,9283,8765 running (22m) 27s ago 30m 450M - 19.1.1-361-g2f599a46 d2baa855c067 8b7ee0f871f5 2024-09-19T07:04:18.145 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi099 smithi099 running (20m) 25s ago 33m 70.0M 2048M 19.1.1-361-g2f599a46 d2baa855c067 ffe067438824 2024-09-19T07:04:18.145 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi117 smithi117 running (20m) 27s ago 30m 49.7M 2048M 19.1.1-361-g2f599a46 d2baa855c067 4cb7455e3ee7 2024-09-19T07:04:18.145 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi099 smithi099 *:9100 running (23m) 25s ago 31m 15.3M - 1.5.0 0da6a335fe13 dca7b4517dcc 2024-09-19T07:04:18.145 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi117 smithi117 *:9100 running (22m) 27s ago 30m 15.5M - 1.5.0 0da6a335fe13 8233ce3835d2 2024-09-19T07:04:18.145 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (19m) 25s ago 30m 113M 1557M 19.1.1-361-g2f599a46 d2baa855c067 8e22543bf933 2024-09-19T07:04:18.145 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (18m) 25s ago 29m 115M 1557M 19.1.1-361-g2f599a46 d2baa855c067 f54153d0ae09 2024-09-19T07:04:18.145 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (18m) 25s ago 29m 89.6M 1557M 19.1.1-361-g2f599a46 d2baa855c067 b1778ab88870 2024-09-19T07:04:18.146 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi117 running (17m) 27s ago 28m 116M 2581M 19.1.1-361-g2f599a46 d2baa855c067 ea5236b193d3 2024-09-19T07:04:18.146 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi117 running (17m) 27s ago 28m 99.9M 2581M 19.1.1-361-g2f599a46 d2baa855c067 27ac2c859a68 2024-09-19T07:04:18.146 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi117 running (16m) 27s ago 27m 108M 2581M 19.1.1-361-g2f599a46 d2baa855c067 de6aeb8544ce 2024-09-19T07:04:18.146 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.smithi099 smithi099 *:9095 running (22m) 25s ago 31m 77.4M - 2.43.0 a07b618ecd1d 15ad26ec6fb4 2024-09-19T07:04:18.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:18.145+0000 7febfc7dc640 1 -- 172.21.15.99:0/1880063780 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7febdc06e530 msgr2=0x7febdc0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:04:18.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:18.145+0000 7febfc7dc640 1 --2- 172.21.15.99:0/1880063780 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7febdc06e530 0x7febdc0709e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7febe4004550 tx=0x7febe4009040 comp rx=0 tx=0).stop 2024-09-19T07:04:18.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:18.145+0000 7febfc7dc640 1 -- 172.21.15.99:0/1880063780 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7febf40fe460 msgr2=0x7febf4113710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:04:18.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:18.145+0000 7febfc7dc640 1 --2- 172.21.15.99:0/1880063780 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7febf40fe460 0x7febf4113710 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7febe8003080 tx=0x7febe8009da0 comp rx=0 tx=0).stop 2024-09-19T07:04:18.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:18.145+0000 7febfc7dc640 1 -- 172.21.15.99:0/1880063780 shutdown_connections 2024-09-19T07:04:18.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:18.145+0000 7febfc7dc640 1 --2- 172.21.15.99:0/1880063780 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7febdc06e530 0x7febdc0709e0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:04:18.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:18.145+0000 7febfc7dc640 1 --2- 172.21.15.99:0/1880063780 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7febf40fe460 0x7febf4113710 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:04:18.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:18.145+0000 7febfc7dc640 1 --2- 172.21.15.99:0/1880063780 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7febf4064fc0 0x7febf41131d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:04:18.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:18.145+0000 7febfc7dc640 1 -- 172.21.15.99:0/1880063780 >> 172.21.15.99:0/1880063780 conn(0x7febf40723b0 msgr2=0x7febf41053f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:04:18.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:18.145+0000 7febfc7dc640 1 -- 172.21.15.99:0/1880063780 shutdown_connections 2024-09-19T07:04:18.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:18.145+0000 7febfc7dc640 1 -- 172.21.15.99:0/1880063780 wait complete. 2024-09-19T07:04:18.388 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:04:18 smithi099 ceph-mon[97031]: from='client.35234 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:04:18.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:04:18 smithi117 ceph-mon[76771]: from='client.35234 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:04:18.849 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -e sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 -- bash -c 'ceph orch upgrade status' 2024-09-19T07:04:19.109 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T07:04:19.486 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:04:19 smithi099 ceph-mon[97031]: pgmap v660: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:04:19.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:04:19 smithi117 ceph-mon[76771]: pgmap v660: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:04:20.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:20.739+0000 7f665f69c640 1 -- 172.21.15.99:0/1225865319 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f66580716e0 msgr2=0x7f665806fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:04:20.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:20.739+0000 7f665f69c640 1 --2- 172.21.15.99:0/1225865319 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f66580716e0 0x7f665806fab0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f66540048d0 tx=0x7f6654009da0 comp rx=0 tx=0).stop 2024-09-19T07:04:20.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:20.739+0000 7f665f69c640 1 -- 172.21.15.99:0/1225865319 shutdown_connections 2024-09-19T07:04:20.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:20.739+0000 7f665f69c640 1 --2- 172.21.15.99:0/1225865319 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f665806fff0 0x7f6658070460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:04:20.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:20.739+0000 7f665f69c640 1 --2- 172.21.15.99:0/1225865319 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f66580716e0 0x7f665806fab0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:04:20.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:20.739+0000 7f665f69c640 1 -- 172.21.15.99:0/1225865319 >> 172.21.15.99:0/1225865319 conn(0x7f66580f80f0 msgr2=0x7f66580fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:04:20.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:20.739+0000 7f665f69c640 1 -- 172.21.15.99:0/1225865319 shutdown_connections 2024-09-19T07:04:20.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:20.739+0000 7f665f69c640 1 -- 172.21.15.99:0/1225865319 wait complete. 2024-09-19T07:04:20.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:20.740+0000 7f665f69c640 1 Processor -- start 2024-09-19T07:04:20.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:20.740+0000 7f665f69c640 1 -- start start 2024-09-19T07:04:20.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:20.740+0000 7f665f69c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f665806fff0 0x7f6658119b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:04:20.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:20.740+0000 7f665f69c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66580716e0 0x7f665811a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:04:20.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:20.740+0000 7f665f69c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f665811a6d0 con 0x7f665806fff0 2024-09-19T07:04:20.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:20.740+0000 7f665f69c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f665811a840 con 0x7f66580716e0 2024-09-19T07:04:20.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:20.740+0000 7f665d438640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f665806fff0 0x7f6658119b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:04:20.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:20.740+0000 7f665d438640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f665806fff0 0x7f6658119b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45732/0 (socket says 172.21.15.99:45732) 2024-09-19T07:04:20.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:20.740+0000 7f665d438640 1 -- 172.21.15.99:0/1759866165 learned_addr learned my addr 172.21.15.99:0/1759866165 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:04:20.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:20.740+0000 7f665cc37640 1 --2- 172.21.15.99:0/1759866165 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66580716e0 0x7f665811a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:04:20.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:20.740+0000 7f665d438640 1 -- 172.21.15.99:0/1759866165 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66580716e0 msgr2=0x7f665811a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:04:20.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:20.740+0000 7f665d438640 1 --2- 172.21.15.99:0/1759866165 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66580716e0 0x7f665811a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:04:20.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:20.740+0000 7f665d438640 1 -- 172.21.15.99:0/1759866165 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6654005040 con 0x7f665806fff0 2024-09-19T07:04:20.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:20.741+0000 7f665cc37640 1 --2- 172.21.15.99:0/1759866165 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66580716e0 0x7f665811a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:04:20.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:20.741+0000 7f665d438640 1 --2- 172.21.15.99:0/1759866165 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f665806fff0 0x7f6658119b90 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f6654003080 tx=0x7f6654009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:04:20.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:20.741+0000 7f664dffb640 1 -- 172.21.15.99:0/1759866165 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6654038070 con 0x7f665806fff0 2024-09-19T07:04:20.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:20.741+0000 7f664dffb640 1 -- 172.21.15.99:0/1759866165 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6654032b20 con 0x7f665806fff0 2024-09-19T07:04:20.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:20.741+0000 7f664dffb640 1 -- 172.21.15.99:0/1759866165 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f665403d9e0 con 0x7f665806fff0 2024-09-19T07:04:20.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:20.741+0000 7f665f69c640 1 -- 172.21.15.99:0/1759866165 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6658113c60 con 0x7f665806fff0 2024-09-19T07:04:20.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:20.741+0000 7f665f69c640 1 -- 172.21.15.99:0/1759866165 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6658114120 con 0x7f665806fff0 2024-09-19T07:04:20.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:20.742+0000 7f665f69c640 1 -- 172.21.15.99:0/1759866165 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66580711f0 con 0x7f665806fff0 2024-09-19T07:04:20.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:20.743+0000 7f664dffb640 1 -- 172.21.15.99:0/1759866165 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f6654030020 con 0x7f665806fff0 2024-09-19T07:04:20.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:20.743+0000 7f664dffb640 1 --2- 172.21.15.99:0/1759866165 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f664406e530 0x7f66440709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:04:20.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:20.743+0000 7f664dffb640 1 -- 172.21.15.99:0/1759866165 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f66540aea10 con 0x7f665806fff0 2024-09-19T07:04:20.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:20.743+0000 7f665cc37640 1 --2- 172.21.15.99:0/1759866165 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f664406e530 0x7f66440709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:04:20.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:20.744+0000 7f665cc37640 1 --2- 172.21.15.99:0/1759866165 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f664406e530 0x7f66440709e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6658115450 tx=0x7f6648009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:04:20.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:20.747+0000 7f664dffb640 1 -- 172.21.15.99:0/1759866165 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f6654077b00 con 0x7f665806fff0 2024-09-19T07:04:20.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:20.931+0000 7f665f69c640 1 -- 172.21.15.99:0/1759866165 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6658115200 con 0x7f664406e530 2024-09-19T07:04:20.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:20.932+0000 7f664dffb640 1 -- 172.21.15.99:0/1759866165 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f6658115200 con 0x7f664406e530 2024-09-19T07:04:20.933 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T07:04:20.933 INFO:teuthology.orchestra.run.smithi099.stdout: "target_image": null, 2024-09-19T07:04:20.933 INFO:teuthology.orchestra.run.smithi099.stdout: "in_progress": false, 2024-09-19T07:04:20.933 INFO:teuthology.orchestra.run.smithi099.stdout: "which": "", 2024-09-19T07:04:20.934 INFO:teuthology.orchestra.run.smithi099.stdout: "services_complete": [], 2024-09-19T07:04:20.934 INFO:teuthology.orchestra.run.smithi099.stdout: "progress": null, 2024-09-19T07:04:20.934 INFO:teuthology.orchestra.run.smithi099.stdout: "message": "", 2024-09-19T07:04:20.934 INFO:teuthology.orchestra.run.smithi099.stdout: "is_paused": false 2024-09-19T07:04:20.934 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T07:04:20.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:20.934+0000 7f665f69c640 1 -- 172.21.15.99:0/1759866165 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f664406e530 msgr2=0x7f66440709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:04:20.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:20.934+0000 7f665f69c640 1 --2- 172.21.15.99:0/1759866165 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f664406e530 0x7f66440709e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6658115450 tx=0x7f6648009040 comp rx=0 tx=0).stop 2024-09-19T07:04:20.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:20.934+0000 7f665f69c640 1 -- 172.21.15.99:0/1759866165 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f665806fff0 msgr2=0x7f6658119b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:04:20.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:20.934+0000 7f665f69c640 1 --2- 172.21.15.99:0/1759866165 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f665806fff0 0x7f6658119b90 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f6654003080 tx=0x7f6654009da0 comp rx=0 tx=0).stop 2024-09-19T07:04:20.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:20.934+0000 7f665f69c640 1 -- 172.21.15.99:0/1759866165 shutdown_connections 2024-09-19T07:04:20.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:20.934+0000 7f665f69c640 1 --2- 172.21.15.99:0/1759866165 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f664406e530 0x7f66440709e0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:04:20.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:20.934+0000 7f665f69c640 1 --2- 172.21.15.99:0/1759866165 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66580716e0 0x7f665811a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:04:20.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:20.934+0000 7f665f69c640 1 --2- 172.21.15.99:0/1759866165 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f665806fff0 0x7f6658119b90 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:04:20.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:20.934+0000 7f665f69c640 1 -- 172.21.15.99:0/1759866165 >> 172.21.15.99:0/1759866165 conn(0x7f66580f80f0 msgr2=0x7f66580f9590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:04:20.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:20.934+0000 7f665f69c640 1 -- 172.21.15.99:0/1759866165 shutdown_connections 2024-09-19T07:04:20.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:20.935+0000 7f665f69c640 1 -- 172.21.15.99:0/1759866165 wait complete. 2024-09-19T07:04:21.553 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:04:21 smithi099 ceph-mon[97031]: from='client.35238 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:04:21.553 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:04:21 smithi099 ceph-mon[97031]: pgmap v661: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:04:21.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:04:21 smithi117 ceph-mon[76771]: from='client.35238 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:04:21.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:04:21 smithi117 ceph-mon[76771]: pgmap v661: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:04:21.577 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -e sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 -- bash -c 'ceph health detail' 2024-09-19T07:04:21.822 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T07:04:22.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:04:22 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:04:22.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:04:22 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:04:23.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:04:23 smithi099 ceph-mon[97031]: pgmap v662: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:04:23.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:23.503+0000 7f73024b3640 1 -- 172.21.15.99:0/1965795131 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72fc064fe0 msgr2=0x7f72fc065430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:04:23.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:23.503+0000 7f73024b3640 1 --2- 172.21.15.99:0/1965795131 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72fc064fe0 0x7f72fc065430 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f72e40048d0 tx=0x7f72e4009da0 comp rx=0 tx=0).stop 2024-09-19T07:04:23.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:23.503+0000 7f73024b3640 1 -- 172.21.15.99:0/1965795131 shutdown_connections 2024-09-19T07:04:23.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:23.503+0000 7f73024b3640 1 --2- 172.21.15.99:0/1965795131 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72fc064fe0 0x7f72fc065430 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:04:23.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:23.503+0000 7f73024b3640 1 --2- 172.21.15.99:0/1965795131 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72fc0fe450 0x7f72fc0fe820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:04:23.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:23.503+0000 7f73024b3640 1 -- 172.21.15.99:0/1965795131 >> 172.21.15.99:0/1965795131 conn(0x7f72fc0723b0 msgr2=0x7f72fc0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:04:23.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:23.503+0000 7f73024b3640 1 -- 172.21.15.99:0/1965795131 shutdown_connections 2024-09-19T07:04:23.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:23.503+0000 7f73024b3640 1 -- 172.21.15.99:0/1965795131 wait complete. 2024-09-19T07:04:23.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:23.504+0000 7f73024b3640 1 Processor -- start 2024-09-19T07:04:23.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:23.504+0000 7f73024b3640 1 -- start start 2024-09-19T07:04:23.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:23.504+0000 7f73024b3640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72fc064fe0 0x7f72fc0fb560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:04:23.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:23.504+0000 7f73024b3640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72fc0fe450 0x7f72fc0fbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:04:23.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:23.504+0000 7f73024b3640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72fc0fbfe0 con 0x7f72fc0fe450 2024-09-19T07:04:23.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:23.504+0000 7f73024b3640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72fc0fc150 con 0x7f72fc064fe0 2024-09-19T07:04:23.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:23.504+0000 7f72f3fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72fc0fe450 0x7f72fc0fbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:04:23.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:23.504+0000 7f72f3fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72fc0fe450 0x7f72fc0fbaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45754/0 (socket says 172.21.15.99:45754) 2024-09-19T07:04:23.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:23.504+0000 7f72f3fff640 1 -- 172.21.15.99:0/2280341131 learned_addr learned my addr 172.21.15.99:0/2280341131 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:04:23.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:23.504+0000 7f72fbfff640 1 --2- 172.21.15.99:0/2280341131 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72fc064fe0 0x7f72fc0fb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:04:23.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:23.504+0000 7f72f3fff640 1 -- 172.21.15.99:0/2280341131 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72fc064fe0 msgr2=0x7f72fc0fb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:04:23.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:23.504+0000 7f72f3fff640 1 --2- 172.21.15.99:0/2280341131 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72fc064fe0 0x7f72fc0fb560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:04:23.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:23.504+0000 7f72f3fff640 1 -- 172.21.15.99:0/2280341131 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e4005040 con 0x7f72fc0fe450 2024-09-19T07:04:23.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:23.505+0000 7f72f3fff640 1 --2- 172.21.15.99:0/2280341131 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72fc0fe450 0x7f72fc0fbaa0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f72e4003080 tx=0x7f72e4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:04:23.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:23.505+0000 7f72f97fa640 1 -- 172.21.15.99:0/2280341131 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72e4038070 con 0x7f72fc0fe450 2024-09-19T07:04:23.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:23.505+0000 7f73024b3640 1 -- 172.21.15.99:0/2280341131 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72fc0fc380 con 0x7f72fc0fe450 2024-09-19T07:04:23.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:23.505+0000 7f73024b3640 1 -- 172.21.15.99:0/2280341131 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72fc119830 con 0x7f72fc0fe450 2024-09-19T07:04:23.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:23.505+0000 7f72f97fa640 1 -- 172.21.15.99:0/2280341131 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f72e40097e0 con 0x7f72fc0fe450 2024-09-19T07:04:23.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:23.505+0000 7f72f97fa640 1 -- 172.21.15.99:0/2280341131 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72e402c630 con 0x7f72fc0fe450 2024-09-19T07:04:23.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:23.506+0000 7f73024b3640 1 -- 172.21.15.99:0/2280341131 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72dc005210 con 0x7f72fc0fe450 2024-09-19T07:04:23.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:23.507+0000 7f72f97fa640 1 -- 172.21.15.99:0/2280341131 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f72e4030020 con 0x7f72fc0fe450 2024-09-19T07:04:23.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:23.507+0000 7f72f97fa640 1 --2- 172.21.15.99:0/2280341131 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f72e806e530 0x7f72e80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:04:23.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:23.507+0000 7f72f97fa640 1 -- 172.21.15.99:0/2280341131 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f72e40ae540 con 0x7f72fc0fe450 2024-09-19T07:04:23.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:23.507+0000 7f72fbfff640 1 --2- 172.21.15.99:0/2280341131 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f72e806e530 0x7f72e80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:04:23.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:23.508+0000 7f72fbfff640 1 --2- 172.21.15.99:0/2280341131 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f72e806e530 0x7f72e80709e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f72ec004bc0 tx=0x7f72ec009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:04:23.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:23.511+0000 7f72f97fa640 1 -- 172.21.15.99:0/2280341131 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f72e4077630 con 0x7f72fc0fe450 2024-09-19T07:04:23.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:04:23 smithi117 ceph-mon[76771]: pgmap v662: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:04:23.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:23.741+0000 7f73024b3640 1 -- 172.21.15.99:0/2280341131 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f72dc0054c0 con 0x7f72fc0fe450 2024-09-19T07:04:23.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:23.741+0000 7f72f97fa640 1 -- 172.21.15.99:0/2280341131 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f72e407acf0 con 0x7f72fc0fe450 2024-09-19T07:04:23.743 INFO:teuthology.orchestra.run.smithi099.stdout:HEALTH_OK 2024-09-19T07:04:23.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:23.743+0000 7f73024b3640 1 -- 172.21.15.99:0/2280341131 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f72e806e530 msgr2=0x7f72e80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:04:23.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:23.743+0000 7f73024b3640 1 --2- 172.21.15.99:0/2280341131 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f72e806e530 0x7f72e80709e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f72ec004bc0 tx=0x7f72ec009040 comp rx=0 tx=0).stop 2024-09-19T07:04:23.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:23.743+0000 7f73024b3640 1 -- 172.21.15.99:0/2280341131 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72fc0fe450 msgr2=0x7f72fc0fbaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:04:23.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:23.743+0000 7f73024b3640 1 --2- 172.21.15.99:0/2280341131 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72fc0fe450 0x7f72fc0fbaa0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f72e4003080 tx=0x7f72e4009da0 comp rx=0 tx=0).stop 2024-09-19T07:04:23.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:23.743+0000 7f73024b3640 1 -- 172.21.15.99:0/2280341131 shutdown_connections 2024-09-19T07:04:23.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:23.743+0000 7f73024b3640 1 --2- 172.21.15.99:0/2280341131 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f72e806e530 0x7f72e80709e0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:04:23.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:23.743+0000 7f73024b3640 1 --2- 172.21.15.99:0/2280341131 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72fc0fe450 0x7f72fc0fbaa0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:04:23.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:23.743+0000 7f73024b3640 1 --2- 172.21.15.99:0/2280341131 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72fc064fe0 0x7f72fc0fb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:04:23.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:23.743+0000 7f73024b3640 1 -- 172.21.15.99:0/2280341131 >> 172.21.15.99:0/2280341131 conn(0x7f72fc0723b0 msgr2=0x7f72fc105390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:04:23.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:23.744+0000 7f73024b3640 1 -- 172.21.15.99:0/2280341131 shutdown_connections 2024-09-19T07:04:23.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:23.744+0000 7f73024b3640 1 -- 172.21.15.99:0/2280341131 wait complete. 2024-09-19T07:04:24.371 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:04:24 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/2280341131' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T07:04:24.398 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -e sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 -- bash -c 'ceph versions' 2024-09-19T07:04:24.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:04:24 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/2280341131' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-19T07:04:24.644 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T07:04:25.337 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:04:25 smithi099 ceph-mon[97031]: pgmap v663: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:04:25.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:04:25 smithi117 ceph-mon[76771]: pgmap v663: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:04:26.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:26.116+0000 7f230883f640 1 -- 172.21.15.99:0/2861063964 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f230406fff0 msgr2=0x7f2304070460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:04:26.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:26.116+0000 7f230883f640 1 --2- 172.21.15.99:0/2861063964 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f230406fff0 0x7f2304070460 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f22ec0048d0 tx=0x7f22ec009da0 comp rx=0 tx=0).stop 2024-09-19T07:04:26.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:26.116+0000 7f230883f640 1 -- 172.21.15.99:0/2861063964 shutdown_connections 2024-09-19T07:04:26.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:26.116+0000 7f230883f640 1 --2- 172.21.15.99:0/2861063964 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f230406fff0 0x7f2304070460 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:04:26.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:26.116+0000 7f230883f640 1 --2- 172.21.15.99:0/2861063964 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f23040716e0 0x7f230406fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:04:26.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:26.116+0000 7f230883f640 1 -- 172.21.15.99:0/2861063964 >> 172.21.15.99:0/2861063964 conn(0x7f23040f8120 msgr2=0x7f23040fa530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:04:26.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:26.116+0000 7f230883f640 1 -- 172.21.15.99:0/2861063964 shutdown_connections 2024-09-19T07:04:26.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:26.116+0000 7f230883f640 1 -- 172.21.15.99:0/2861063964 wait complete. 2024-09-19T07:04:26.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:26.117+0000 7f230883f640 1 Processor -- start 2024-09-19T07:04:26.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:26.117+0000 7f230883f640 1 -- start start 2024-09-19T07:04:26.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:26.118+0000 7f230883f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f230406fff0 0x7f2304119980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:04:26.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:26.118+0000 7f230883f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23040716e0 0x7f2304119ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:04:26.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:26.118+0000 7f230883f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f230411a510 con 0x7f23040716e0 2024-09-19T07:04:26.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:26.118+0000 7f230883f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2304113920 con 0x7f230406fff0 2024-09-19T07:04:26.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:26.118+0000 7f22f9d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23040716e0 0x7f2304119ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:04:26.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:26.118+0000 7f22f9d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23040716e0 0x7f2304119ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47318/0 (socket says 172.21.15.99:47318) 2024-09-19T07:04:26.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:26.118+0000 7f22f9d9b640 1 -- 172.21.15.99:0/10177170 learned_addr learned my addr 172.21.15.99:0/10177170 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:04:26.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:26.118+0000 7f22f9d9b640 1 -- 172.21.15.99:0/10177170 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f230406fff0 msgr2=0x7f2304119980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:04:26.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:26.118+0000 7f22f9d9b640 1 --2- 172.21.15.99:0/10177170 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f230406fff0 0x7f2304119980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:04:26.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:26.118+0000 7f22f9d9b640 1 -- 172.21.15.99:0/10177170 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22ec005040 con 0x7f23040716e0 2024-09-19T07:04:26.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:26.118+0000 7f22f9d9b640 1 --2- 172.21.15.99:0/10177170 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23040716e0 0x7f2304119ec0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f22ec003080 tx=0x7f22ec009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:04:26.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:26.118+0000 7f22fb7fe640 1 -- 172.21.15.99:0/10177170 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22ec038070 con 0x7f23040716e0 2024-09-19T07:04:26.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:26.118+0000 7f22fb7fe640 1 -- 172.21.15.99:0/10177170 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f22ec032b20 con 0x7f23040716e0 2024-09-19T07:04:26.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:26.118+0000 7f230883f640 1 -- 172.21.15.99:0/10177170 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2304113ba0 con 0x7f23040716e0 2024-09-19T07:04:26.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:26.118+0000 7f22fb7fe640 1 -- 172.21.15.99:0/10177170 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22ec03d990 con 0x7f23040716e0 2024-09-19T07:04:26.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:26.119+0000 7f230883f640 1 -- 172.21.15.99:0/10177170 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2304114060 con 0x7f23040716e0 2024-09-19T07:04:26.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:26.119+0000 7f230883f640 1 -- 172.21.15.99:0/10177170 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23040711f0 con 0x7f23040716e0 2024-09-19T07:04:26.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:26.120+0000 7f22fb7fe640 1 -- 172.21.15.99:0/10177170 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f22ec030020 con 0x7f23040716e0 2024-09-19T07:04:26.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:26.120+0000 7f22fb7fe640 1 --2- 172.21.15.99:0/10177170 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f22f006e530 0x7f22f00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:04:26.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:26.120+0000 7f22fb7fe640 1 -- 172.21.15.99:0/10177170 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f22ec0aeb50 con 0x7f23040716e0 2024-09-19T07:04:26.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:26.121+0000 7f230259c640 1 --2- 172.21.15.99:0/10177170 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f22f006e530 0x7f22f00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:04:26.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:26.121+0000 7f230259c640 1 --2- 172.21.15.99:0/10177170 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f22f006e530 0x7f22f00709e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f22f4004af0 tx=0x7f22f4007c30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:04:26.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:26.125+0000 7f22fb7fe640 1 -- 172.21.15.99:0/10177170 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f22ec077c40 con 0x7f23040716e0 2024-09-19T07:04:26.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:26.360+0000 7f230883f640 1 -- 172.21.15.99:0/10177170 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f230410fb30 con 0x7f23040716e0 2024-09-19T07:04:26.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:26.360+0000 7f22fb7fe640 1 -- 172.21.15.99:0/10177170 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f22ec032c90 con 0x7f23040716e0 2024-09-19T07:04:26.361 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T07:04:26.362 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-09-19T07:04:26.362 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T07:04:26.362 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T07:04:26.362 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-09-19T07:04:26.362 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T07:04:26.362 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T07:04:26.362 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-09-19T07:04:26.362 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 6 2024-09-19T07:04:26.362 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T07:04:26.362 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": { 2024-09-19T07:04:26.362 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 4 2024-09-19T07:04:26.362 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T07:04:26.362 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-09-19T07:04:26.363 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 14 2024-09-19T07:04:26.363 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T07:04:26.363 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T07:04:26.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:26.362+0000 7f230883f640 1 -- 172.21.15.99:0/10177170 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f22f006e530 msgr2=0x7f22f00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:04:26.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:26.362+0000 7f230883f640 1 --2- 172.21.15.99:0/10177170 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f22f006e530 0x7f22f00709e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f22f4004af0 tx=0x7f22f4007c30 comp rx=0 tx=0).stop 2024-09-19T07:04:26.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:26.362+0000 7f230883f640 1 -- 172.21.15.99:0/10177170 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23040716e0 msgr2=0x7f2304119ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:04:26.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:26.362+0000 7f230883f640 1 --2- 172.21.15.99:0/10177170 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23040716e0 0x7f2304119ec0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f22ec003080 tx=0x7f22ec009da0 comp rx=0 tx=0).stop 2024-09-19T07:04:26.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:26.362+0000 7f230883f640 1 -- 172.21.15.99:0/10177170 shutdown_connections 2024-09-19T07:04:26.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:26.362+0000 7f230883f640 1 --2- 172.21.15.99:0/10177170 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f22f006e530 0x7f22f00709e0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:04:26.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:26.362+0000 7f230883f640 1 --2- 172.21.15.99:0/10177170 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f23040716e0 0x7f2304119ec0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:04:26.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:26.362+0000 7f230883f640 1 --2- 172.21.15.99:0/10177170 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f230406fff0 0x7f2304119980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:04:26.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:26.362+0000 7f230883f640 1 -- 172.21.15.99:0/10177170 >> 172.21.15.99:0/10177170 conn(0x7f23040f8120 msgr2=0x7f23040f9400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:04:26.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:26.363+0000 7f230883f640 1 -- 172.21.15.99:0/10177170 shutdown_connections 2024-09-19T07:04:26.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:04:26.363+0000 7f230883f640 1 -- 172.21.15.99:0/10177170 wait complete. 2024-09-19T07:04:26.651 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:04:26 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/10177170' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T07:04:26.811 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:04:26 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/10177170' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T07:04:26.985 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -e sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-09-19T07:04:27.230 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T07:04:27.663 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:04:27 smithi099 ceph-mon[97031]: pgmap v664: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:04:27.811 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:04:27 smithi117 ceph-mon[76771]: pgmap v664: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:04:28.879 INFO:teuthology.orchestra.run.smithi099.stdout:wait for servicemap items w/ changing names to refresh 2024-09-19T07:04:29.516 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:04:29 smithi099 ceph-mon[97031]: pgmap v665: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:04:29.539 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -e sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 -- bash -c 'sleep 60' 2024-09-19T07:04:29.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:04:29 smithi117 ceph-mon[76771]: pgmap v665: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:04:29.784 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T07:04:31.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:04:31 smithi099 ceph-mon[97031]: pgmap v666: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:04:31.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:04:31 smithi117 ceph-mon[76771]: pgmap v666: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:04:33.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:04:33 smithi099 ceph-mon[97031]: pgmap v667: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:04:33.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:04:33 smithi117 ceph-mon[76771]: pgmap v667: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:04:35.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:04:35 smithi117 ceph-mon[76771]: pgmap v668: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:04:35.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:04:35 smithi099 ceph-mon[97031]: pgmap v668: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:04:37.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:04:36 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:04:37.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:04:36 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:04:38.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:04:37 smithi099 ceph-mon[97031]: pgmap v669: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:04:38.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:04:37 smithi117 ceph-mon[76771]: pgmap v669: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:04:39.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:04:39 smithi117 ceph-mon[76771]: pgmap v670: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:04:39.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:04:39 smithi099 ceph-mon[97031]: pgmap v670: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:04:41.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:04:41 smithi117 ceph-mon[76771]: pgmap v671: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:04:41.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:04:41 smithi099 ceph-mon[97031]: pgmap v671: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:04:43.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:04:43 smithi099 ceph-mon[97031]: pgmap v672: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:04:43.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:04:43 smithi117 ceph-mon[76771]: pgmap v672: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:04:45.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:04:45 smithi117 ceph-mon[76771]: pgmap v673: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:04:45.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:04:45 smithi099 ceph-mon[97031]: pgmap v673: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:04:47.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:04:47 smithi117 ceph-mon[76771]: pgmap v674: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:04:47.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:04:47 smithi099 ceph-mon[97031]: pgmap v674: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:04:49.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:04:49 smithi117 ceph-mon[76771]: pgmap v675: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:04:49.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:04:49 smithi099 ceph-mon[97031]: pgmap v675: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:04:51.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:04:51 smithi117 ceph-mon[76771]: pgmap v676: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:04:51.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:04:51 smithi099 ceph-mon[97031]: pgmap v676: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:04:52.565 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:04:52 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:04:52.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:04:52 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:04:53.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:04:53 smithi099 ceph-mon[97031]: pgmap v677: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:04:53.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:04:53 smithi117 ceph-mon[76771]: pgmap v677: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:04:54.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:04:54 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:04:54.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:04:54 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:04:54.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:04:54 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:04:54.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:04:54 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T07:04:54.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:04:54 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:04:54.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:04:54 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:04:54.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:04:54 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:04:54.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:04:54 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T07:04:55.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:04:55 smithi117 ceph-mon[76771]: pgmap v678: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:04:55.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:04:55 smithi099 ceph-mon[97031]: pgmap v678: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:04:57.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:04:57 smithi117 ceph-mon[76771]: pgmap v679: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:04:57.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:04:57 smithi099 ceph-mon[97031]: pgmap v679: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:04:59.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:04:59 smithi117 ceph-mon[76771]: pgmap v680: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:04:59.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:04:59 smithi099 ceph-mon[97031]: pgmap v680: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:05:01.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:05:01 smithi117 ceph-mon[76771]: pgmap v681: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:05:01.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:05:01 smithi099 ceph-mon[97031]: pgmap v681: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:05:03.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:05:03 smithi099 ceph-mon[97031]: pgmap v682: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:05:03.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:05:03 smithi117 ceph-mon[76771]: pgmap v682: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:05:05.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:05:05 smithi117 ceph-mon[76771]: pgmap v683: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:05:05.682 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:05:05 smithi099 ceph-mon[97031]: pgmap v683: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:05:07.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:05:06 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:05:07.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:05:06 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:05:08.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:05:07 smithi099 ceph-mon[97031]: pgmap v684: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:05:08.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:05:07 smithi117 ceph-mon[76771]: pgmap v684: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:05:09.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:05:09 smithi117 ceph-mon[76771]: pgmap v685: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:05:09.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:05:09 smithi099 ceph-mon[97031]: pgmap v685: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:05:11.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:05:11 smithi117 ceph-mon[76771]: pgmap v686: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:05:11.705 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:05:11 smithi099 ceph-mon[97031]: pgmap v686: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:05:13.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:05:13 smithi099 ceph-mon[97031]: pgmap v687: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:05:13.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:05:13 smithi117 ceph-mon[76771]: pgmap v687: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:05:15.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:05:15 smithi099 ceph-mon[97031]: pgmap v688: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:05:15.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:05:15 smithi117 ceph-mon[76771]: pgmap v688: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:05:17.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:05:17 smithi117 ceph-mon[76771]: pgmap v689: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:05:17.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:05:17 smithi099 ceph-mon[97031]: pgmap v689: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:05:19.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:05:19 smithi117 ceph-mon[76771]: pgmap v690: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:05:19.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:05:19 smithi099 ceph-mon[97031]: pgmap v690: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:05:21.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:05:21 smithi117 ceph-mon[76771]: pgmap v691: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:05:21.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:05:21 smithi099 ceph-mon[97031]: pgmap v691: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:05:22.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:05:22 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:05:22.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:05:22 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:05:23.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:05:23 smithi099 ceph-mon[97031]: pgmap v692: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:05:23.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:05:23 smithi117 ceph-mon[76771]: pgmap v692: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:05:25.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:05:25 smithi117 ceph-mon[76771]: pgmap v693: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:05:25.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:05:25 smithi099 ceph-mon[97031]: pgmap v693: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:05:27.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:05:27 smithi117 ceph-mon[76771]: pgmap v694: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:05:27.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:05:27 smithi099 ceph-mon[97031]: pgmap v694: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:05:29.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:05:29 smithi117 ceph-mon[76771]: pgmap v695: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:05:29.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:05:29 smithi099 ceph-mon[97031]: pgmap v695: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:05:31.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:05:31 smithi117 ceph-mon[76771]: pgmap v696: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:05:31.683 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:05:31 smithi099 ceph-mon[97031]: pgmap v696: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:05:31.987 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -e sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 -- bash -c 'ceph orch ps' 2024-09-19T07:05:32.243 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T07:05:33.306 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:05:33 smithi099 ceph-mon[97031]: pgmap v697: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:05:33.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:05:33 smithi117 ceph-mon[76771]: pgmap v697: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:05:33.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:33.785+0000 7f7499141640 1 -- 172.21.15.99:0/1979400219 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7494102550 msgr2=0x7f7494102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:33.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:33.785+0000 7f7499141640 1 --2- 172.21.15.99:0/1979400219 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7494102550 0x7f7494102920 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f748c009c50 tx=0x7f748c004d10 comp rx=0 tx=0).stop 2024-09-19T07:05:33.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:33.785+0000 7f7499141640 1 -- 172.21.15.99:0/1979400219 shutdown_connections 2024-09-19T07:05:33.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:33.785+0000 7f7499141640 1 --2- 172.21.15.99:0/1979400219 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7494102ef0 0x7f74940fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:33.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:33.785+0000 7f7499141640 1 --2- 172.21.15.99:0/1979400219 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7494102550 0x7f7494102920 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:33.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:33.785+0000 7f7499141640 1 -- 172.21.15.99:0/1979400219 >> 172.21.15.99:0/1979400219 conn(0x7f74940f80f0 msgr2=0x7f74940fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:05:33.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:33.785+0000 7f7499141640 1 -- 172.21.15.99:0/1979400219 shutdown_connections 2024-09-19T07:05:33.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:33.785+0000 7f7499141640 1 -- 172.21.15.99:0/1979400219 wait complete. 2024-09-19T07:05:33.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:33.786+0000 7f7499141640 1 Processor -- start 2024-09-19T07:05:33.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:33.786+0000 7f7499141640 1 -- start start 2024-09-19T07:05:33.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:33.786+0000 7f7499141640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7494102550 0x7f7494113570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:33.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:33.786+0000 7f7499141640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7494102ef0 0x7f7494113ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:33.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:33.786+0000 7f7499141640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7494114100 con 0x7f7494102ef0 2024-09-19T07:05:33.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:33.786+0000 7f7499141640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f749410d510 con 0x7f7494102550 2024-09-19T07:05:33.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:33.786+0000 7f749259c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7494102ef0 0x7f7494113ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:33.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:33.786+0000 7f749259c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7494102ef0 0x7f7494113ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50162/0 (socket says 172.21.15.99:50162) 2024-09-19T07:05:33.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:33.786+0000 7f749259c640 1 -- 172.21.15.99:0/1400030108 learned_addr learned my addr 172.21.15.99:0/1400030108 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:05:33.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:33.786+0000 7f7492d9d640 1 --2- 172.21.15.99:0/1400030108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7494102550 0x7f7494113570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:33.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:33.786+0000 7f749259c640 1 -- 172.21.15.99:0/1400030108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7494102550 msgr2=0x7f7494113570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:33.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:33.786+0000 7f749259c640 1 --2- 172.21.15.99:0/1400030108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7494102550 0x7f7494113570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:33.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:33.786+0000 7f749259c640 1 -- 172.21.15.99:0/1400030108 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f748c0098b0 con 0x7f7494102ef0 2024-09-19T07:05:33.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:33.786+0000 7f749259c640 1 --2- 172.21.15.99:0/1400030108 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7494102ef0 0x7f7494113ab0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f747c009af0 tx=0x7f747c004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:05:33.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:33.786+0000 7f748b7fe640 1 -- 172.21.15.99:0/1400030108 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f747c007c30 con 0x7f7494102ef0 2024-09-19T07:05:33.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:33.787+0000 7f748b7fe640 1 -- 172.21.15.99:0/1400030108 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f747c00f040 con 0x7f7494102ef0 2024-09-19T07:05:33.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:33.787+0000 7f7499141640 1 -- 172.21.15.99:0/1400030108 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f749410d7f0 con 0x7f7494102ef0 2024-09-19T07:05:33.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:33.787+0000 7f748b7fe640 1 -- 172.21.15.99:0/1400030108 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f747c0094b0 con 0x7f7494102ef0 2024-09-19T07:05:33.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:33.787+0000 7f7499141640 1 -- 172.21.15.99:0/1400030108 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f749410dd90 con 0x7f7494102ef0 2024-09-19T07:05:33.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:33.788+0000 7f7499141640 1 -- 172.21.15.99:0/1400030108 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74940fdcd0 con 0x7f7494102ef0 2024-09-19T07:05:33.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:33.788+0000 7f748b7fe640 1 -- 172.21.15.99:0/1400030108 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f747c0096e0 con 0x7f7494102ef0 2024-09-19T07:05:33.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:33.789+0000 7f748b7fe640 1 --2- 172.21.15.99:0/1400030108 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f748006e530 0x7f74800709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:33.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:33.789+0000 7f748b7fe640 1 -- 172.21.15.99:0/1400030108 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f747c08e060 con 0x7f7494102ef0 2024-09-19T07:05:33.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:33.789+0000 7f7492d9d640 1 --2- 172.21.15.99:0/1400030108 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f748006e530 0x7f74800709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:33.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:33.789+0000 7f7492d9d640 1 --2- 172.21.15.99:0/1400030108 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f748006e530 0x7f74800709e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f748c004a30 tx=0x7f748c004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:05:33.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:33.793+0000 7f748b7fe640 1 -- 172.21.15.99:0/1400030108 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f747c0571d0 con 0x7f7494102ef0 2024-09-19T07:05:33.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:33.970+0000 7f7499141640 1 -- 172.21.15.99:0/1400030108 --> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7494113260 con 0x7f748006e530 2024-09-19T07:05:33.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:33.978+0000 7f748b7fe640 1 -- 172.21.15.99:0/1400030108 <== mgr.34104 v2:172.21.15.99:6800/3704270170 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f7494113260 con 0x7f748006e530 2024-09-19T07:05:33.979 INFO:teuthology.orchestra.run.smithi099.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T07:05:33.980 INFO:teuthology.orchestra.run.smithi099.stdout:alertmanager.smithi099 smithi099 *:9093,9094 running (24m) 101s ago 32m 23.9M - 0.25.0 c8568f914cd2 e7c1774d56b0 2024-09-19T07:05:33.980 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi099 smithi099 running (21m) 101s ago 33m 6899k - 19.1.1-361-g2f599a46 d2baa855c067 b9775f416b10 2024-09-19T07:05:33.980 INFO:teuthology.orchestra.run.smithi099.stdout:crash.smithi117 smithi117 running (21m) 103s ago 32m 6895k - 19.1.1-361-g2f599a46 d2baa855c067 38cf60c0d548 2024-09-19T07:05:33.980 INFO:teuthology.orchestra.run.smithi099.stdout:grafana.smithi099 smithi099 *:3000 running (23m) 101s ago 32m 81.4M - 9.4.12 2bacad6d85d8 cd53a18d5410 2024-09-19T07:05:33.980 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.obarqf smithi099 running (17m) 101s ago 27m 86.0M - 19.1.1-361-g2f599a46 d2baa855c067 314a73082521 2024-09-19T07:05:33.980 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi099.xehbxe smithi099 running (17m) 101s ago 27m 93.2M - 19.1.1-361-g2f599a46 d2baa855c067 a2955a9d06e6 2024-09-19T07:05:33.980 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.bheqzh smithi117 running (16m) 103s ago 27m 18.4M - 19.1.1-361-g2f599a46 d2baa855c067 b1505937c0b7 2024-09-19T07:05:33.980 INFO:teuthology.orchestra.run.smithi099.stdout:mds.cephfs.smithi117.nooexo smithi117 running (17m) 103s ago 27m 18.4M - 19.1.1-361-g2f599a46 d2baa855c067 35bd7725855c 2024-09-19T07:05:33.980 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi099.pgvkqi smithi099 *:8443,9283,8765 running (24m) 101s ago 34m 508M - 19.1.1-361-g2f599a46 d2baa855c067 d5de99cb7e78 2024-09-19T07:05:33.980 INFO:teuthology.orchestra.run.smithi099.stdout:mgr.smithi117.ssmkcf smithi117 *:8443,9283,8765 running (23m) 103s ago 32m 450M - 19.1.1-361-g2f599a46 d2baa855c067 8b7ee0f871f5 2024-09-19T07:05:33.980 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi099 smithi099 running (22m) 101s ago 34m 70.0M 2048M 19.1.1-361-g2f599a46 d2baa855c067 ffe067438824 2024-09-19T07:05:33.980 INFO:teuthology.orchestra.run.smithi099.stdout:mon.smithi117 smithi117 running (21m) 103s ago 32m 49.7M 2048M 19.1.1-361-g2f599a46 d2baa855c067 4cb7455e3ee7 2024-09-19T07:05:33.981 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi099 smithi099 *:9100 running (24m) 101s ago 33m 15.3M - 1.5.0 0da6a335fe13 dca7b4517dcc 2024-09-19T07:05:33.981 INFO:teuthology.orchestra.run.smithi099.stdout:node-exporter.smithi117 smithi117 *:9100 running (24m) 103s ago 32m 15.5M - 1.5.0 0da6a335fe13 8233ce3835d2 2024-09-19T07:05:33.981 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 smithi099 running (20m) 101s ago 31m 113M 1557M 19.1.1-361-g2f599a46 d2baa855c067 8e22543bf933 2024-09-19T07:05:33.981 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 smithi099 running (20m) 101s ago 30m 115M 1557M 19.1.1-361-g2f599a46 d2baa855c067 f54153d0ae09 2024-09-19T07:05:33.981 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 smithi099 running (19m) 101s ago 30m 89.6M 1557M 19.1.1-361-g2f599a46 d2baa855c067 b1778ab88870 2024-09-19T07:05:33.984 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 smithi117 running (18m) 103s ago 30m 116M 2581M 19.1.1-361-g2f599a46 d2baa855c067 ea5236b193d3 2024-09-19T07:05:33.984 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 smithi117 running (18m) 103s ago 29m 99.9M 2581M 19.1.1-361-g2f599a46 d2baa855c067 27ac2c859a68 2024-09-19T07:05:33.984 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 smithi117 running (17m) 103s ago 29m 108M 2581M 19.1.1-361-g2f599a46 d2baa855c067 de6aeb8544ce 2024-09-19T07:05:33.984 INFO:teuthology.orchestra.run.smithi099.stdout:prometheus.smithi099 smithi099 *:9095 running (23m) 101s ago 32m 77.4M - 2.43.0 a07b618ecd1d 15ad26ec6fb4 2024-09-19T07:05:33.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:33.981+0000 7f7499141640 1 -- 172.21.15.99:0/1400030108 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f748006e530 msgr2=0x7f74800709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:33.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:33.981+0000 7f7499141640 1 --2- 172.21.15.99:0/1400030108 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f748006e530 0x7f74800709e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f748c004a30 tx=0x7f748c004d10 comp rx=0 tx=0).stop 2024-09-19T07:05:33.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:33.981+0000 7f7499141640 1 -- 172.21.15.99:0/1400030108 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7494102ef0 msgr2=0x7f7494113ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:33.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:33.981+0000 7f7499141640 1 --2- 172.21.15.99:0/1400030108 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7494102ef0 0x7f7494113ab0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f747c009af0 tx=0x7f747c004570 comp rx=0 tx=0).stop 2024-09-19T07:05:33.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:33.981+0000 7f7499141640 1 -- 172.21.15.99:0/1400030108 shutdown_connections 2024-09-19T07:05:33.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:33.981+0000 7f7499141640 1 --2- 172.21.15.99:0/1400030108 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f748006e530 0x7f74800709e0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:33.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:33.981+0000 7f7499141640 1 --2- 172.21.15.99:0/1400030108 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7494102ef0 0x7f7494113ab0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:33.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:33.981+0000 7f7499141640 1 --2- 172.21.15.99:0/1400030108 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7494102550 0x7f7494113570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:33.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:33.981+0000 7f7499141640 1 -- 172.21.15.99:0/1400030108 >> 172.21.15.99:0/1400030108 conn(0x7f74940f80f0 msgr2=0x7f74940f90b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:05:33.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:33.981+0000 7f7499141640 1 -- 172.21.15.99:0/1400030108 shutdown_connections 2024-09-19T07:05:33.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:33.981+0000 7f7499141640 1 -- 172.21.15.99:0/1400030108 wait complete. 2024-09-19T07:05:34.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:05:34 smithi117 ceph-mon[76771]: from='client.35250 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:05:34.580 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:05:34 smithi099 ceph-mon[97031]: from='client.35250 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T07:05:34.607 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -e sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 -- bash -c 'ceph versions' 2024-09-19T07:05:34.873 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T07:05:35.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:05:35 smithi117 ceph-mon[76771]: pgmap v698: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:05:35.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:05:35 smithi099 ceph-mon[97031]: pgmap v698: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:05:36.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:36.423+0000 7f8682f1b640 1 -- 172.21.15.99:0/771195580 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f867c102ef0 msgr2=0x7f867c0fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:36.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:36.423+0000 7f8682f1b640 1 --2- 172.21.15.99:0/771195580 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f867c102ef0 0x7f867c0fc5b0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f86680048d0 tx=0x7f8668009da0 comp rx=0 tx=0).stop 2024-09-19T07:05:36.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:36.424+0000 7f8682f1b640 1 -- 172.21.15.99:0/771195580 shutdown_connections 2024-09-19T07:05:36.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:36.424+0000 7f8682f1b640 1 --2- 172.21.15.99:0/771195580 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f867c102ef0 0x7f867c0fc5b0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:36.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:36.424+0000 7f8682f1b640 1 --2- 172.21.15.99:0/771195580 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f867c102550 0x7f867c102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:36.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:36.424+0000 7f8682f1b640 1 -- 172.21.15.99:0/771195580 >> 172.21.15.99:0/771195580 conn(0x7f867c0f80f0 msgr2=0x7f867c0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:05:36.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:36.424+0000 7f8682f1b640 1 -- 172.21.15.99:0/771195580 shutdown_connections 2024-09-19T07:05:36.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:36.424+0000 7f8682f1b640 1 -- 172.21.15.99:0/771195580 wait complete. 2024-09-19T07:05:36.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:36.424+0000 7f8682f1b640 1 Processor -- start 2024-09-19T07:05:36.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:36.424+0000 7f8682f1b640 1 -- start start 2024-09-19T07:05:36.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:36.424+0000 7f8682f1b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f867c102550 0x7f867c113520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:36.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:36.425+0000 7f8682f1b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f867c102ef0 0x7f867c113a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:36.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:36.425+0000 7f8682f1b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867c1140b0 con 0x7f867c102550 2024-09-19T07:05:36.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:36.425+0000 7f8682f1b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867c10d4c0 con 0x7f867c102ef0 2024-09-19T07:05:36.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:36.425+0000 7f8680cb7640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f867c102550 0x7f867c113520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:36.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:36.425+0000 7f8680cb7640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f867c102550 0x7f867c113520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:43050/0 (socket says 172.21.15.99:43050) 2024-09-19T07:05:36.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:36.425+0000 7f8680cb7640 1 -- 172.21.15.99:0/2411218301 learned_addr learned my addr 172.21.15.99:0/2411218301 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:05:36.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:36.425+0000 7f867bfff640 1 --2- 172.21.15.99:0/2411218301 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f867c102ef0 0x7f867c113a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:36.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:36.425+0000 7f8680cb7640 1 -- 172.21.15.99:0/2411218301 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f867c102ef0 msgr2=0x7f867c113a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:36.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:36.425+0000 7f8680cb7640 1 --2- 172.21.15.99:0/2411218301 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f867c102ef0 0x7f867c113a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:36.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:36.425+0000 7f8680cb7640 1 -- 172.21.15.99:0/2411218301 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8668005040 con 0x7f867c102550 2024-09-19T07:05:36.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:36.425+0000 7f8680cb7640 1 --2- 172.21.15.99:0/2411218301 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f867c102550 0x7f867c113520 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f867000eb70 tx=0x7f867000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:05:36.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:36.425+0000 7f86797fa640 1 -- 172.21.15.99:0/2411218301 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8670007c30 con 0x7f867c102550 2024-09-19T07:05:36.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:36.425+0000 7f86797fa640 1 -- 172.21.15.99:0/2411218301 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f867000f040 con 0x7f867c102550 2024-09-19T07:05:36.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:36.425+0000 7f8682f1b640 1 -- 172.21.15.99:0/2411218301 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f867c10d740 con 0x7f867c102550 2024-09-19T07:05:36.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:36.425+0000 7f86797fa640 1 -- 172.21.15.99:0/2411218301 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f867000ca60 con 0x7f867c102550 2024-09-19T07:05:36.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:36.425+0000 7f8682f1b640 1 -- 172.21.15.99:0/2411218301 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f867c10dcb0 con 0x7f867c102550 2024-09-19T07:05:36.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:36.426+0000 7f8682f1b640 1 -- 172.21.15.99:0/2411218301 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f867c0fdcd0 con 0x7f867c102550 2024-09-19T07:05:36.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:36.427+0000 7f86797fa640 1 -- 172.21.15.99:0/2411218301 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f867000cbc0 con 0x7f867c102550 2024-09-19T07:05:36.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:36.427+0000 7f86797fa640 1 --2- 172.21.15.99:0/2411218301 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f866c06e530 0x7f866c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:36.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:36.427+0000 7f86797fa640 1 -- 172.21.15.99:0/2411218301 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f867008dcf0 con 0x7f867c102550 2024-09-19T07:05:36.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:36.427+0000 7f867bfff640 1 --2- 172.21.15.99:0/2411218301 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f866c06e530 0x7f866c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:36.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:36.428+0000 7f867bfff640 1 --2- 172.21.15.99:0/2411218301 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f866c06e530 0x7f866c0709e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8668000c00 tx=0x7f8668035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:05:36.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:36.432+0000 7f86797fa640 1 -- 172.21.15.99:0/2411218301 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f8670056f10 con 0x7f867c102550 2024-09-19T07:05:36.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:36.662+0000 7f8682f1b640 1 -- 172.21.15.99:0/2411218301 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f867c04b750 con 0x7f867c102550 2024-09-19T07:05:36.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:36.663+0000 7f86797fa640 1 -- 172.21.15.99:0/2411218301 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f867005a5d0 con 0x7f867c102550 2024-09-19T07:05:36.664 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-19T07:05:36.665 INFO:teuthology.orchestra.run.smithi099.stdout: "mon": { 2024-09-19T07:05:36.665 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T07:05:36.665 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T07:05:36.665 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": { 2024-09-19T07:05:36.665 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 2 2024-09-19T07:05:36.665 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T07:05:36.665 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": { 2024-09-19T07:05:36.665 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 6 2024-09-19T07:05:36.665 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T07:05:36.665 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": { 2024-09-19T07:05:36.665 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 4 2024-09-19T07:05:36.665 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-19T07:05:36.666 INFO:teuthology.orchestra.run.smithi099.stdout: "overall": { 2024-09-19T07:05:36.666 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)": 14 2024-09-19T07:05:36.666 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-19T07:05:36.666 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-19T07:05:36.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:36.665+0000 7f8682f1b640 1 -- 172.21.15.99:0/2411218301 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f866c06e530 msgr2=0x7f866c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:36.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:36.665+0000 7f8682f1b640 1 --2- 172.21.15.99:0/2411218301 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f866c06e530 0x7f866c0709e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8668000c00 tx=0x7f8668035040 comp rx=0 tx=0).stop 2024-09-19T07:05:36.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:36.665+0000 7f8682f1b640 1 -- 172.21.15.99:0/2411218301 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f867c102550 msgr2=0x7f867c113520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:36.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:36.665+0000 7f8682f1b640 1 --2- 172.21.15.99:0/2411218301 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f867c102550 0x7f867c113520 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f867000eb70 tx=0x7f867000b040 comp rx=0 tx=0).stop 2024-09-19T07:05:36.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:36.665+0000 7f8682f1b640 1 -- 172.21.15.99:0/2411218301 shutdown_connections 2024-09-19T07:05:36.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:36.665+0000 7f8682f1b640 1 --2- 172.21.15.99:0/2411218301 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f866c06e530 0x7f866c0709e0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:36.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:36.665+0000 7f8682f1b640 1 --2- 172.21.15.99:0/2411218301 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f867c102ef0 0x7f867c113a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:36.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:36.665+0000 7f8682f1b640 1 --2- 172.21.15.99:0/2411218301 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f867c102550 0x7f867c113520 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:36.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:36.665+0000 7f8682f1b640 1 -- 172.21.15.99:0/2411218301 >> 172.21.15.99:0/2411218301 conn(0x7f867c0f80f0 msgr2=0x7f867c0f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:05:36.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:36.666+0000 7f8682f1b640 1 -- 172.21.15.99:0/2411218301 shutdown_connections 2024-09-19T07:05:36.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:36.666+0000 7f8682f1b640 1 -- 172.21.15.99:0/2411218301 wait complete. 2024-09-19T07:05:36.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:05:36 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/2411218301' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T07:05:37.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:05:36 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/2411218301' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T07:05:37.342 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -e sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-09-19T07:05:37.585 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T07:05:37.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:05:37 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:05:37.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:05:37 smithi099 ceph-mon[97031]: pgmap v699: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:05:38.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:05:37 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:05:38.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:05:37 smithi117 ceph-mon[76771]: pgmap v699: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:05:39.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:39.096+0000 7f6ebde69640 1 -- 172.21.15.99:0/3721484484 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6eb80fb4d0 msgr2=0x7f6eb80fb940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:39.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:39.096+0000 7f6ebde69640 1 --2- 172.21.15.99:0/3721484484 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6eb80fb4d0 0x7f6eb80fb940 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f6eac0048d0 tx=0x7f6eac009da0 comp rx=0 tx=0).stop 2024-09-19T07:05:39.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:39.096+0000 7f6ebde69640 1 -- 172.21.15.99:0/3721484484 shutdown_connections 2024-09-19T07:05:39.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:39.096+0000 7f6ebde69640 1 --2- 172.21.15.99:0/3721484484 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6eb80fb4d0 0x7f6eb80fb940 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:39.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:39.096+0000 7f6ebde69640 1 --2- 172.21.15.99:0/3721484484 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6eb8101510 0x7f6eb81018e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:39.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:39.096+0000 7f6ebde69640 1 -- 172.21.15.99:0/3721484484 >> 172.21.15.99:0/3721484484 conn(0x7f6eb80f7050 msgr2=0x7f6eb80f9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:05:39.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:39.096+0000 7f6ebde69640 1 -- 172.21.15.99:0/3721484484 shutdown_connections 2024-09-19T07:05:39.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:39.096+0000 7f6ebde69640 1 -- 172.21.15.99:0/3721484484 wait complete. 2024-09-19T07:05:39.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:39.096+0000 7f6ebde69640 1 Processor -- start 2024-09-19T07:05:39.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:39.097+0000 7f6ebde69640 1 -- start start 2024-09-19T07:05:39.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:39.097+0000 7f6ebde69640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6eb80fb4d0 0x7f6eb8112120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:39.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:39.097+0000 7f6ebde69640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6eb8101510 0x7f6eb8112660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:39.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:39.097+0000 7f6ebde69640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb8112cf0 con 0x7f6eb8101510 2024-09-19T07:05:39.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:39.097+0000 7f6ebde69640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb810c0a0 con 0x7f6eb80fb4d0 2024-09-19T07:05:39.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:39.097+0000 7f6eb6ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6eb8101510 0x7f6eb8112660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:39.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:39.097+0000 7f6eb6ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6eb8101510 0x7f6eb8112660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:43064/0 (socket says 172.21.15.99:43064) 2024-09-19T07:05:39.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:39.097+0000 7f6eb6ffd640 1 -- 172.21.15.99:0/2619339962 learned_addr learned my addr 172.21.15.99:0/2619339962 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:05:39.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:39.097+0000 7f6eb77fe640 1 --2- 172.21.15.99:0/2619339962 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6eb80fb4d0 0x7f6eb8112120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:39.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:39.097+0000 7f6eb6ffd640 1 -- 172.21.15.99:0/2619339962 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6eb80fb4d0 msgr2=0x7f6eb8112120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:39.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:39.097+0000 7f6eb6ffd640 1 --2- 172.21.15.99:0/2619339962 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6eb80fb4d0 0x7f6eb8112120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:39.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:39.097+0000 7f6eb6ffd640 1 -- 172.21.15.99:0/2619339962 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eac005040 con 0x7f6eb8101510 2024-09-19T07:05:39.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:39.097+0000 7f6eb6ffd640 1 --2- 172.21.15.99:0/2619339962 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6eb8101510 0x7f6eb8112660 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f6eac000c00 tx=0x7f6eac009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:05:39.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:39.098+0000 7f6e9ffff640 1 -- 172.21.15.99:0/2619339962 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6eac03a070 con 0x7f6eb8101510 2024-09-19T07:05:39.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:39.098+0000 7f6e9ffff640 1 -- 172.21.15.99:0/2619339962 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6eac009880 con 0x7f6eb8101510 2024-09-19T07:05:39.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:39.098+0000 7f6e9ffff640 1 -- 172.21.15.99:0/2619339962 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6eac0338f0 con 0x7f6eb8101510 2024-09-19T07:05:39.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:39.098+0000 7f6ebde69640 1 -- 172.21.15.99:0/2619339962 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eb810c320 con 0x7f6eb8101510 2024-09-19T07:05:39.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:39.098+0000 7f6ebde69640 1 -- 172.21.15.99:0/2619339962 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eb810c7e0 con 0x7f6eb8101510 2024-09-19T07:05:39.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:39.099+0000 7f6ebde69640 1 -- 172.21.15.99:0/2619339962 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6eb80fcc10 con 0x7f6eb8101510 2024-09-19T07:05:39.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:39.099+0000 7f6e9ffff640 1 -- 172.21.15.99:0/2619339962 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f6eac030020 con 0x7f6eb8101510 2024-09-19T07:05:39.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:39.100+0000 7f6e9ffff640 1 --2- 172.21.15.99:0/2619339962 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f6ea006e530 0x7f6ea00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:39.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:39.100+0000 7f6e9ffff640 1 -- 172.21.15.99:0/2619339962 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f6eac0b09f0 con 0x7f6eb8101510 2024-09-19T07:05:39.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:39.100+0000 7f6eb77fe640 1 --2- 172.21.15.99:0/2619339962 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f6ea006e530 0x7f6ea00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:39.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:39.100+0000 7f6eb77fe640 1 --2- 172.21.15.99:0/2619339962 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f6ea006e530 0x7f6ea00709e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6ea800a900 tx=0x7f6ea8008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:05:39.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:39.104+0000 7f6e9ffff640 1 -- 172.21.15.99:0/2619339962 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f6eac079ae0 con 0x7f6eb8101510 2024-09-19T07:05:39.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:39.341+0000 7f6ebde69640 1 -- 172.21.15.99:0/2619339962 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6eb8108570 con 0x7f6eb8101510 2024-09-19T07:05:39.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:39.342+0000 7f6e9ffff640 1 -- 172.21.15.99:0/2619339962 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f6eac07d1a0 con 0x7f6eb8101510 2024-09-19T07:05:39.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:39.344+0000 7f6ebde69640 1 -- 172.21.15.99:0/2619339962 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f6ea006e530 msgr2=0x7f6ea00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:39.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:39.344+0000 7f6ebde69640 1 --2- 172.21.15.99:0/2619339962 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f6ea006e530 0x7f6ea00709e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6ea800a900 tx=0x7f6ea8008040 comp rx=0 tx=0).stop 2024-09-19T07:05:39.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:39.344+0000 7f6ebde69640 1 -- 172.21.15.99:0/2619339962 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6eb8101510 msgr2=0x7f6eb8112660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:39.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:39.344+0000 7f6ebde69640 1 --2- 172.21.15.99:0/2619339962 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6eb8101510 0x7f6eb8112660 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f6eac000c00 tx=0x7f6eac009da0 comp rx=0 tx=0).stop 2024-09-19T07:05:39.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:39.344+0000 7f6ebde69640 1 -- 172.21.15.99:0/2619339962 shutdown_connections 2024-09-19T07:05:39.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:39.344+0000 7f6ebde69640 1 --2- 172.21.15.99:0/2619339962 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f6ea006e530 0x7f6ea00709e0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:39.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:39.344+0000 7f6ebde69640 1 --2- 172.21.15.99:0/2619339962 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6eb8101510 0x7f6eb8112660 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:39.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:39.344+0000 7f6ebde69640 1 --2- 172.21.15.99:0/2619339962 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6eb80fb4d0 0x7f6eb8112120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:39.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:39.344+0000 7f6ebde69640 1 -- 172.21.15.99:0/2619339962 >> 172.21.15.99:0/2619339962 conn(0x7f6eb80f7050 msgr2=0x7f6eb80f88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:05:39.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:39.344+0000 7f6ebde69640 1 -- 172.21.15.99:0/2619339962 shutdown_connections 2024-09-19T07:05:39.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:39.344+0000 7f6ebde69640 1 -- 172.21.15.99:0/2619339962 wait complete. 2024-09-19T07:05:39.354 INFO:teuthology.orchestra.run.smithi099.stdout:true 2024-09-19T07:05:39.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:05:39 smithi117 ceph-mon[76771]: pgmap v700: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:05:39.705 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:05:39 smithi099 ceph-mon[97031]: pgmap v700: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:05:40.010 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -e sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-09-19T07:05:40.257 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T07:05:40.549 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:05:40 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/2619339962' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T07:05:40.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:05:40 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/2619339962' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T07:05:41.556 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:05:41 smithi099 ceph-mon[97031]: pgmap v701: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:05:41.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:05:41 smithi117 ceph-mon[76771]: pgmap v701: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:05:41.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:41.870+0000 7facd646f640 1 -- 172.21.15.99:0/3708540662 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7facd00fb810 msgr2=0x7facd00fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:41.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:41.870+0000 7facd646f640 1 --2- 172.21.15.99:0/3708540662 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7facd00fb810 0x7facd00fbbe0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7facc00048d0 tx=0x7facc0009da0 comp rx=0 tx=0).stop 2024-09-19T07:05:41.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:41.870+0000 7facd646f640 1 -- 172.21.15.99:0/3708540662 shutdown_connections 2024-09-19T07:05:41.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:41.870+0000 7facd646f640 1 --2- 172.21.15.99:0/3708540662 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7facd00fcf80 0x7facd00fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:41.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:41.870+0000 7facd646f640 1 --2- 172.21.15.99:0/3708540662 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7facd00fb810 0x7facd00fbbe0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:41.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:41.870+0000 7facd646f640 1 -- 172.21.15.99:0/3708540662 >> 172.21.15.99:0/3708540662 conn(0x7facd00723b0 msgr2=0x7facd00727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:05:41.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:41.870+0000 7facd646f640 1 -- 172.21.15.99:0/3708540662 shutdown_connections 2024-09-19T07:05:41.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:41.870+0000 7facd646f640 1 -- 172.21.15.99:0/3708540662 wait complete. 2024-09-19T07:05:41.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:41.870+0000 7facd646f640 1 Processor -- start 2024-09-19T07:05:41.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:41.870+0000 7facd646f640 1 -- start start 2024-09-19T07:05:41.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:41.871+0000 7facd646f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7facd00fb810 0x7facd0113200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:41.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:41.871+0000 7facd646f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7facd00fcf80 0x7facd0113740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:41.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:41.871+0000 7facd646f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd0113d40 con 0x7facd00fb810 2024-09-19T07:05:41.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:41.871+0000 7facd646f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd010d180 con 0x7facd00fcf80 2024-09-19T07:05:41.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:41.871+0000 7faccffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7facd00fb810 0x7facd0113200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:41.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:41.871+0000 7faccffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7facd00fb810 0x7facd0113200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:43070/0 (socket says 172.21.15.99:43070) 2024-09-19T07:05:41.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:41.871+0000 7faccffff640 1 -- 172.21.15.99:0/1062262585 learned_addr learned my addr 172.21.15.99:0/1062262585 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:05:41.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:41.871+0000 7facc7fff640 1 --2- 172.21.15.99:0/1062262585 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7facd00fcf80 0x7facd0113740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:41.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:41.871+0000 7faccffff640 1 -- 172.21.15.99:0/1062262585 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7facd00fcf80 msgr2=0x7facd0113740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:41.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:41.871+0000 7faccffff640 1 --2- 172.21.15.99:0/1062262585 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7facd00fcf80 0x7facd0113740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:41.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:41.871+0000 7faccffff640 1 -- 172.21.15.99:0/1062262585 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facc0005040 con 0x7facd00fb810 2024-09-19T07:05:41.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:41.871+0000 7faccffff640 1 --2- 172.21.15.99:0/1062262585 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7facd00fb810 0x7facd0113200 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7facc0000c00 tx=0x7facc0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:05:41.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:41.871+0000 7faccd7fa640 1 -- 172.21.15.99:0/1062262585 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7facc0038070 con 0x7facd00fb810 2024-09-19T07:05:41.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:41.872+0000 7faccd7fa640 1 -- 172.21.15.99:0/1062262585 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7facc002ade0 con 0x7facd00fb810 2024-09-19T07:05:41.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:41.872+0000 7facd646f640 1 -- 172.21.15.99:0/1062262585 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facd010d400 con 0x7facd00fb810 2024-09-19T07:05:41.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:41.872+0000 7faccd7fa640 1 -- 172.21.15.99:0/1062262585 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7facc002c7e0 con 0x7facd00fb810 2024-09-19T07:05:41.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:41.872+0000 7facd646f640 1 -- 172.21.15.99:0/1062262585 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facd010d940 con 0x7facd00fb810 2024-09-19T07:05:41.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:41.873+0000 7facd646f640 1 -- 172.21.15.99:0/1062262585 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facd00fcbc0 con 0x7facd00fb810 2024-09-19T07:05:41.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:41.873+0000 7faccd7fa640 1 -- 172.21.15.99:0/1062262585 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7facc0030020 con 0x7facd00fb810 2024-09-19T07:05:41.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:41.874+0000 7faccd7fa640 1 --2- 172.21.15.99:0/1062262585 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7facbc06e530 0x7facbc0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:41.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:41.874+0000 7faccd7fa640 1 -- 172.21.15.99:0/1062262585 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7facc00addf0 con 0x7facd00fb810 2024-09-19T07:05:41.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:41.874+0000 7facc7fff640 1 --2- 172.21.15.99:0/1062262585 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7facbc06e530 0x7facbc0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:41.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:41.874+0000 7facc7fff640 1 --2- 172.21.15.99:0/1062262585 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7facbc06e530 0x7facbc0709e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7facd010eac0 tx=0x7facb800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:05:41.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:41.878+0000 7faccd7fa640 1 -- 172.21.15.99:0/1062262585 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7facc0076f90 con 0x7facd00fb810 2024-09-19T07:05:42.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:42.111+0000 7facd646f640 1 -- 172.21.15.99:0/1062262585 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7facd004b750 con 0x7facd00fb810 2024-09-19T07:05:42.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:42.111+0000 7faccd7fa640 1 -- 172.21.15.99:0/1062262585 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7facc007a650 con 0x7facd00fb810 2024-09-19T07:05:42.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:42.114+0000 7facd646f640 1 -- 172.21.15.99:0/1062262585 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7facbc06e530 msgr2=0x7facbc0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:42.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:42.114+0000 7facd646f640 1 --2- 172.21.15.99:0/1062262585 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7facbc06e530 0x7facbc0709e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7facd010eac0 tx=0x7facb800b040 comp rx=0 tx=0).stop 2024-09-19T07:05:42.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:42.114+0000 7facd646f640 1 -- 172.21.15.99:0/1062262585 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7facd00fb810 msgr2=0x7facd0113200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:42.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:42.114+0000 7facd646f640 1 --2- 172.21.15.99:0/1062262585 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7facd00fb810 0x7facd0113200 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7facc0000c00 tx=0x7facc0009da0 comp rx=0 tx=0).stop 2024-09-19T07:05:42.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:42.114+0000 7facd646f640 1 -- 172.21.15.99:0/1062262585 shutdown_connections 2024-09-19T07:05:42.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:42.114+0000 7facd646f640 1 --2- 172.21.15.99:0/1062262585 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7facbc06e530 0x7facbc0709e0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:42.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:42.114+0000 7facd646f640 1 --2- 172.21.15.99:0/1062262585 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7facd00fcf80 0x7facd0113740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:42.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:42.114+0000 7facd646f640 1 --2- 172.21.15.99:0/1062262585 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7facd00fb810 0x7facd0113200 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:42.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:42.114+0000 7facd646f640 1 -- 172.21.15.99:0/1062262585 >> 172.21.15.99:0/1062262585 conn(0x7facd00723b0 msgr2=0x7facd0064f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:05:42.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:42.114+0000 7facd646f640 1 -- 172.21.15.99:0/1062262585 shutdown_connections 2024-09-19T07:05:42.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:42.114+0000 7facd646f640 1 -- 172.21.15.99:0/1062262585 wait complete. 2024-09-19T07:05:42.123 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)" 2024-09-19T07:05:42.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:05:42 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/1062262585' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T07:05:42.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:05:42 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/1062262585' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-19T07:05:42.817 DEBUG:teuthology.parallel:result is None 2024-09-19T07:05:42.817 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T07:05:42.831 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi099.front.sepia.ceph.com 2024-09-19T07:05:42.832 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-19T07:05:43.080 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T07:05:43.411 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:05:43 smithi099 ceph-mon[97031]: pgmap v702: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:05:43.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:05:43 smithi117 ceph-mon[76771]: pgmap v702: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:05:44.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:44.603+0000 7f83c06ef640 1 -- 172.21.15.99:0/2082989087 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83b8102ef0 msgr2=0x7f83b80fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:44.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:44.603+0000 7f83c06ef640 1 --2- 172.21.15.99:0/2082989087 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83b8102ef0 0x7f83b80fc5b0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f83a80048d0 tx=0x7f83a8009da0 comp rx=0 tx=0).stop 2024-09-19T07:05:44.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:44.603+0000 7f83c06ef640 1 -- 172.21.15.99:0/2082989087 shutdown_connections 2024-09-19T07:05:44.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:44.603+0000 7f83c06ef640 1 --2- 172.21.15.99:0/2082989087 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83b8102ef0 0x7f83b80fc5b0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:44.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:44.603+0000 7f83c06ef640 1 --2- 172.21.15.99:0/2082989087 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83b8102550 0x7f83b8102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:44.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:44.603+0000 7f83c06ef640 1 -- 172.21.15.99:0/2082989087 >> 172.21.15.99:0/2082989087 conn(0x7f83b80f80f0 msgr2=0x7f83b80fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:05:44.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:44.603+0000 7f83c06ef640 1 -- 172.21.15.99:0/2082989087 shutdown_connections 2024-09-19T07:05:44.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:44.603+0000 7f83c06ef640 1 -- 172.21.15.99:0/2082989087 wait complete. 2024-09-19T07:05:44.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:44.603+0000 7f83c06ef640 1 Processor -- start 2024-09-19T07:05:44.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:44.603+0000 7f83c06ef640 1 -- start start 2024-09-19T07:05:44.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:44.604+0000 7f83c06ef640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83b8102550 0x7f83b806fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:44.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:44.604+0000 7f83c06ef640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83b8102ef0 0x7f83b806ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:44.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:44.604+0000 7f83c06ef640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b8070490 con 0x7f83b8102550 2024-09-19T07:05:44.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:44.604+0000 7f83c06ef640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b8070600 con 0x7f83b8102ef0 2024-09-19T07:05:44.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:44.604+0000 7f83be48b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83b8102550 0x7f83b806fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:44.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:44.604+0000 7f83be48b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83b8102550 0x7f83b806fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:43084/0 (socket says 172.21.15.99:43084) 2024-09-19T07:05:44.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:44.604+0000 7f83be48b640 1 -- 172.21.15.99:0/1455438082 learned_addr learned my addr 172.21.15.99:0/1455438082 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:05:44.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:44.604+0000 7f83be48b640 1 -- 172.21.15.99:0/1455438082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83b8102ef0 msgr2=0x7f83b806ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:44.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:44.604+0000 7f83be48b640 1 --2- 172.21.15.99:0/1455438082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83b8102ef0 0x7f83b806ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:44.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:44.604+0000 7f83be48b640 1 -- 172.21.15.99:0/1455438082 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83a8005040 con 0x7f83b8102550 2024-09-19T07:05:44.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:44.604+0000 7f83be48b640 1 --2- 172.21.15.99:0/1455438082 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83b8102550 0x7f83b806fa10 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f83b4002a50 tx=0x7f83b4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:05:44.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:44.604+0000 7f83aeffd640 1 -- 172.21.15.99:0/1455438082 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83b4007c30 con 0x7f83b8102550 2024-09-19T07:05:44.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:44.604+0000 7f83aeffd640 1 -- 172.21.15.99:0/1455438082 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f83b400f040 con 0x7f83b8102550 2024-09-19T07:05:44.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:44.604+0000 7f83c06ef640 1 -- 172.21.15.99:0/1455438082 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83b8070890 con 0x7f83b8102550 2024-09-19T07:05:44.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:44.604+0000 7f83aeffd640 1 -- 172.21.15.99:0/1455438082 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83b400da90 con 0x7f83b8102550 2024-09-19T07:05:44.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:44.604+0000 7f83c06ef640 1 -- 172.21.15.99:0/1455438082 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83b8119c50 con 0x7f83b8102550 2024-09-19T07:05:44.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:44.605+0000 7f83c06ef640 1 -- 172.21.15.99:0/1455438082 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83b80fdcd0 con 0x7f83b8102550 2024-09-19T07:05:44.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:44.606+0000 7f83aeffd640 1 -- 172.21.15.99:0/1455438082 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f83b400dd00 con 0x7f83b8102550 2024-09-19T07:05:44.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:44.606+0000 7f83aeffd640 1 --2- 172.21.15.99:0/1455438082 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f83a406e530 0x7f83a40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:44.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:44.606+0000 7f83aeffd640 1 -- 172.21.15.99:0/1455438082 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f83b408da70 con 0x7f83b8102550 2024-09-19T07:05:44.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:44.606+0000 7f83bdc8a640 1 --2- 172.21.15.99:0/1455438082 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f83a406e530 0x7f83a40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:44.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:44.607+0000 7f83bdc8a640 1 --2- 172.21.15.99:0/1455438082 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f83a406e530 0x7f83a40709e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f83a8000c00 tx=0x7f83a8009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:05:44.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:44.611+0000 7f83aeffd640 1 -- 172.21.15.99:0/1455438082 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f83b4056b60 con 0x7f83b8102550 2024-09-19T07:05:44.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:44.812+0000 7f83c06ef640 1 -- 172.21.15.99:0/1455438082 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f83b804b720 con 0x7f83b8102550 2024-09-19T07:05:44.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:44.812+0000 7f83aeffd640 1 -- 172.21.15.99:0/1455438082 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 35 v35) v1 ==== 76+0+1995 (secure 0 0 0) 0x7f83b405a220 con 0x7f83b8102550 2024-09-19T07:05:44.814 INFO:teuthology.orchestra.run.smithi099.stdout:e35 2024-09-19T07:05:44.814 INFO:teuthology.orchestra.run.smithi099.stdout:btime 2024-09-19T07:03:57:181594+0000 2024-09-19T07:05:44.814 INFO:teuthology.orchestra.run.smithi099.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T07:05:44.814 INFO:teuthology.orchestra.run.smithi099.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-19T07:05:44.814 INFO:teuthology.orchestra.run.smithi099.stdout:legacy client fscid: 1 2024-09-19T07:05:44.814 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T07:05:44.814 INFO:teuthology.orchestra.run.smithi099.stdout:Filesystem 'cephfs' (1) 2024-09-19T07:05:44.815 INFO:teuthology.orchestra.run.smithi099.stdout:fs_name cephfs 2024-09-19T07:05:44.815 INFO:teuthology.orchestra.run.smithi099.stdout:epoch 35 2024-09-19T07:05:44.815 INFO:teuthology.orchestra.run.smithi099.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-19T07:05:44.815 INFO:teuthology.orchestra.run.smithi099.stdout:created 2024-09-19T06:37:40.838146+0000 2024-09-19T07:05:44.815 INFO:teuthology.orchestra.run.smithi099.stdout:modified 2024-09-19T07:03:57.181591+0000 2024-09-19T07:05:44.815 INFO:teuthology.orchestra.run.smithi099.stdout:tableserver 0 2024-09-19T07:05:44.815 INFO:teuthology.orchestra.run.smithi099.stdout:root 0 2024-09-19T07:05:44.815 INFO:teuthology.orchestra.run.smithi099.stdout:session_timeout 60 2024-09-19T07:05:44.815 INFO:teuthology.orchestra.run.smithi099.stdout:session_autoclose 300 2024-09-19T07:05:44.815 INFO:teuthology.orchestra.run.smithi099.stdout:max_file_size 1099511627776 2024-09-19T07:05:44.815 INFO:teuthology.orchestra.run.smithi099.stdout:max_xattr_size 65536 2024-09-19T07:05:44.815 INFO:teuthology.orchestra.run.smithi099.stdout:required_client_features {} 2024-09-19T07:05:44.815 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure 0 2024-09-19T07:05:44.815 INFO:teuthology.orchestra.run.smithi099.stdout:last_failure_osd_epoch 77 2024-09-19T07:05:44.816 INFO:teuthology.orchestra.run.smithi099.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T07:05:44.816 INFO:teuthology.orchestra.run.smithi099.stdout:max_mds 2 2024-09-19T07:05:44.816 INFO:teuthology.orchestra.run.smithi099.stdout:in 0,1 2024-09-19T07:05:44.816 INFO:teuthology.orchestra.run.smithi099.stdout:up {0=34378,1=34410} 2024-09-19T07:05:44.816 INFO:teuthology.orchestra.run.smithi099.stdout:failed 2024-09-19T07:05:44.816 INFO:teuthology.orchestra.run.smithi099.stdout:damaged 2024-09-19T07:05:44.816 INFO:teuthology.orchestra.run.smithi099.stdout:stopped 2024-09-19T07:05:44.816 INFO:teuthology.orchestra.run.smithi099.stdout:data_pools [3] 2024-09-19T07:05:44.816 INFO:teuthology.orchestra.run.smithi099.stdout:metadata_pool 2 2024-09-19T07:05:44.816 INFO:teuthology.orchestra.run.smithi099.stdout:inline_data disabled 2024-09-19T07:05:44.816 INFO:teuthology.orchestra.run.smithi099.stdout:balancer 2024-09-19T07:05:44.817 INFO:teuthology.orchestra.run.smithi099.stdout:bal_rank_mask -1 2024-09-19T07:05:44.817 INFO:teuthology.orchestra.run.smithi099.stdout:standby_count_wanted 1 2024-09-19T07:05:44.817 INFO:teuthology.orchestra.run.smithi099.stdout:qdb_cluster leader: 34378 members: 34378,34410 2024-09-19T07:05:44.817 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.obarqf{0:34378} state up:active seq 243 join_fscid=1 addr [v2:172.21.15.99:6826/1859154203,v1:172.21.15.99:6827/1859154203] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:05:44.817 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi099.xehbxe{1:34410} state up:active seq 239 join_fscid=1 addr [v2:172.21.15.99:6828/1939453719,v1:172.21.15.99:6829/1939453719] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:05:44.817 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T07:05:44.817 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T07:05:44.817 INFO:teuthology.orchestra.run.smithi099.stdout:Standby daemons: 2024-09-19T07:05:44.817 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T07:05:44.817 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.nooexo{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6824/1398895079,v1:172.21.15.117:6825/1398895079] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:05:44.817 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.cephfs.smithi117.bheqzh{-1:44329} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.117:6826/3233337308,v1:172.21.15.117:6827/3233337308] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T07:05:44.818 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 35 2024-09-19T07:05:44.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:44.814+0000 7f83c06ef640 1 -- 172.21.15.99:0/1455438082 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f83a406e530 msgr2=0x7f83a40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:44.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:44.814+0000 7f83c06ef640 1 --2- 172.21.15.99:0/1455438082 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f83a406e530 0x7f83a40709e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f83a8000c00 tx=0x7f83a8009da0 comp rx=0 tx=0).stop 2024-09-19T07:05:44.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:44.814+0000 7f83c06ef640 1 -- 172.21.15.99:0/1455438082 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83b8102550 msgr2=0x7f83b806fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:44.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:44.814+0000 7f83c06ef640 1 --2- 172.21.15.99:0/1455438082 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83b8102550 0x7f83b806fa10 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f83b4002a50 tx=0x7f83b4004600 comp rx=0 tx=0).stop 2024-09-19T07:05:44.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:44.814+0000 7f83c06ef640 1 -- 172.21.15.99:0/1455438082 shutdown_connections 2024-09-19T07:05:44.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:44.814+0000 7f83c06ef640 1 --2- 172.21.15.99:0/1455438082 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f83a406e530 0x7f83a40709e0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:44.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:44.814+0000 7f83c06ef640 1 --2- 172.21.15.99:0/1455438082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83b8102ef0 0x7f83b806ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:44.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:44.814+0000 7f83c06ef640 1 --2- 172.21.15.99:0/1455438082 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f83b8102550 0x7f83b806fa10 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:44.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:44.814+0000 7f83c06ef640 1 -- 172.21.15.99:0/1455438082 >> 172.21.15.99:0/1455438082 conn(0x7f83b80f80f0 msgr2=0x7f83b80f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:05:44.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:44.814+0000 7f83c06ef640 1 -- 172.21.15.99:0/1455438082 shutdown_connections 2024-09-19T07:05:44.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:44.814+0000 7f83c06ef640 1 -- 172.21.15.99:0/1455438082 wait complete. 2024-09-19T07:05:45.188 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:05:44 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/1455438082' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T07:05:45.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:05:44 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/1455438082' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T07:05:45.563 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-09-19T07:05:45.574 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T07:05:45.819 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T07:05:46.184 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:05:45 smithi099 ceph-mon[97031]: pgmap v703: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:05:46.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:05:45 smithi117 ceph-mon[76771]: pgmap v703: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:05:47.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:47.432+0000 7f77f8186640 1 -- 172.21.15.99:0/3757559008 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f77f00fb810 msgr2=0x7f77f00fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:47.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:47.432+0000 7f77f8186640 1 --2- 172.21.15.99:0/3757559008 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f77f00fb810 0x7f77f00fbbe0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f77e0009c50 tx=0x7f77e0004d10 comp rx=0 tx=0).stop 2024-09-19T07:05:47.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:47.433+0000 7f77f8186640 1 -- 172.21.15.99:0/3757559008 shutdown_connections 2024-09-19T07:05:47.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:47.433+0000 7f77f8186640 1 --2- 172.21.15.99:0/3757559008 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77f00fcf80 0x7f77f00fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:47.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:47.433+0000 7f77f8186640 1 --2- 172.21.15.99:0/3757559008 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f77f00fb810 0x7f77f00fbbe0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:47.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:47.433+0000 7f77f8186640 1 -- 172.21.15.99:0/3757559008 >> 172.21.15.99:0/3757559008 conn(0x7f77f00723b0 msgr2=0x7f77f00727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:05:47.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:47.433+0000 7f77f8186640 1 -- 172.21.15.99:0/3757559008 shutdown_connections 2024-09-19T07:05:47.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:47.433+0000 7f77f8186640 1 -- 172.21.15.99:0/3757559008 wait complete. 2024-09-19T07:05:47.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:47.433+0000 7f77f8186640 1 Processor -- start 2024-09-19T07:05:47.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:47.433+0000 7f77f8186640 1 -- start start 2024-09-19T07:05:47.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:47.433+0000 7f77f8186640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77f00fb810 0x7f77f0113200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:47.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:47.433+0000 7f77f8186640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f77f00fcf80 0x7f77f0113740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:47.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:47.433+0000 7f77f8186640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f0113d40 con 0x7f77f00fcf80 2024-09-19T07:05:47.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:47.433+0000 7f77f8186640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f010d180 con 0x7f77f00fb810 2024-09-19T07:05:47.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:47.434+0000 7f77f5721640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f77f00fcf80 0x7f77f0113740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:47.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:47.434+0000 7f77f5721640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f77f00fcf80 0x7f77f0113740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59624/0 (socket says 172.21.15.99:59624) 2024-09-19T07:05:47.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:47.434+0000 7f77f5721640 1 -- 172.21.15.99:0/3521601464 learned_addr learned my addr 172.21.15.99:0/3521601464 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:05:47.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:47.434+0000 7f77f5f22640 1 --2- 172.21.15.99:0/3521601464 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77f00fb810 0x7f77f0113200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:47.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:47.434+0000 7f77f5721640 1 -- 172.21.15.99:0/3521601464 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77f00fb810 msgr2=0x7f77f0113200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:47.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:47.434+0000 7f77f5721640 1 --2- 172.21.15.99:0/3521601464 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77f00fb810 0x7f77f0113200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:47.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:47.434+0000 7f77f5721640 1 -- 172.21.15.99:0/3521601464 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e00098b0 con 0x7f77f00fcf80 2024-09-19T07:05:47.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:47.434+0000 7f77f5721640 1 --2- 172.21.15.99:0/3521601464 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f77f00fcf80 0x7f77f0113740 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f77e4002a50 tx=0x7f77e4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:05:47.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:47.434+0000 7f77ee7fc640 1 -- 172.21.15.99:0/3521601464 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77e4007c30 con 0x7f77f00fcf80 2024-09-19T07:05:47.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:47.434+0000 7f77ee7fc640 1 -- 172.21.15.99:0/3521601464 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f77e400f040 con 0x7f77f00fcf80 2024-09-19T07:05:47.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:47.434+0000 7f77f8186640 1 -- 172.21.15.99:0/3521601464 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77f010d460 con 0x7f77f00fcf80 2024-09-19T07:05:47.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:47.434+0000 7f77ee7fc640 1 -- 172.21.15.99:0/3521601464 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77e400da90 con 0x7f77f00fcf80 2024-09-19T07:05:47.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:47.434+0000 7f77f8186640 1 -- 172.21.15.99:0/3521601464 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77f010da00 con 0x7f77f00fcf80 2024-09-19T07:05:47.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:47.435+0000 7f77f8186640 1 -- 172.21.15.99:0/3521601464 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77f00fcbc0 con 0x7f77f00fcf80 2024-09-19T07:05:47.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:47.436+0000 7f77ee7fc640 1 -- 172.21.15.99:0/3521601464 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f77e400dd00 con 0x7f77f00fcf80 2024-09-19T07:05:47.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:47.436+0000 7f77ee7fc640 1 --2- 172.21.15.99:0/3521601464 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f77d806e530 0x7f77d80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:47.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:47.436+0000 7f77f5f22640 1 --2- 172.21.15.99:0/3521601464 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f77d806e530 0x7f77d80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:47.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:47.436+0000 7f77ee7fc640 1 -- 172.21.15.99:0/3521601464 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f77e408d9c0 con 0x7f77f00fcf80 2024-09-19T07:05:47.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:47.437+0000 7f77f5f22640 1 --2- 172.21.15.99:0/3521601464 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f77d806e530 0x7f77d80709e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f77e0009c20 tx=0x7f77e0004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:05:47.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:47.441+0000 7f77ee7fc640 1 -- 172.21.15.99:0/3521601464 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f77e4056b60 con 0x7f77f00fcf80 2024-09-19T07:05:47.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:05:47 smithi117 ceph-mon[76771]: pgmap v704: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:05:47.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:47.642+0000 7f77f8186640 1 -- 172.21.15.99:0/3521601464 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f77f0072ec0 con 0x7f77f00fcf80 2024-09-19T07:05:47.643 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:05:47 smithi099 ceph-mon[97031]: pgmap v704: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:05:47.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:47.643+0000 7f77ee7fc640 1 -- 172.21.15.99:0/3521601464 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+5280 (secure 0 0 0) 0x7f77e405a220 con 0x7f77f00fcf80 2024-09-19T07:05:47.644 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T07:05:47.644 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":35,"btime":"2024-09-19T07:03:57:181594+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44309,"name":"cephfs.smithi117.nooexo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6825/1398895079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":1398895079},{"type":"v1","addr":"172.21.15.117:6825","nonce":1398895079}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":44329,"name":"cephfs.smithi117.bheqzh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6827/3233337308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3233337308},{"type":"v1","addr":"172.21.15.117:6827","nonce":3233337308}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:40.838146+0000","modified":"2024-09-19T07:03:57.181591+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":77,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34378,"mds_1":34410},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34378":{"gid":34378,"name":"cephfs.smithi099.obarqf","rank":0,"incarnation":31,"state":"up:active","state_seq":243,"addr":"172.21.15.99:6827/1859154203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1859154203},{"type":"v1","addr":"172.21.15.99:6827","nonce":1859154203}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34410":{"gid":34410,"name":"cephfs.smithi099.xehbxe","rank":1,"incarnation":31,"state":"up:active","state_seq":239,"addr":"172.21.15.99:6829/1939453719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1939453719},{"type":"v1","addr":"172.21.15.99:6829","nonce":1939453719}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34378,"qdb_cluster":[34378,34410]},"id":1}]} 2024-09-19T07:05:47.645 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 35 2024-09-19T07:05:47.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:47.645+0000 7f77f8186640 1 -- 172.21.15.99:0/3521601464 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f77d806e530 msgr2=0x7f77d80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:47.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:47.645+0000 7f77f8186640 1 --2- 172.21.15.99:0/3521601464 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f77d806e530 0x7f77d80709e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f77e0009c20 tx=0x7f77e0004d10 comp rx=0 tx=0).stop 2024-09-19T07:05:47.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:47.645+0000 7f77f8186640 1 -- 172.21.15.99:0/3521601464 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f77f00fcf80 msgr2=0x7f77f0113740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:47.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:47.645+0000 7f77f8186640 1 --2- 172.21.15.99:0/3521601464 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f77f00fcf80 0x7f77f0113740 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f77e4002a50 tx=0x7f77e4004600 comp rx=0 tx=0).stop 2024-09-19T07:05:47.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:47.645+0000 7f77f8186640 1 -- 172.21.15.99:0/3521601464 shutdown_connections 2024-09-19T07:05:47.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:47.645+0000 7f77f8186640 1 --2- 172.21.15.99:0/3521601464 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f77d806e530 0x7f77d80709e0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:47.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:47.645+0000 7f77f8186640 1 --2- 172.21.15.99:0/3521601464 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f77f00fcf80 0x7f77f0113740 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:47.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:47.645+0000 7f77f8186640 1 --2- 172.21.15.99:0/3521601464 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77f00fb810 0x7f77f0113200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:47.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:47.645+0000 7f77f8186640 1 -- 172.21.15.99:0/3521601464 >> 172.21.15.99:0/3521601464 conn(0x7f77f00723b0 msgr2=0x7f77f0064f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:05:47.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:47.645+0000 7f77f8186640 1 -- 172.21.15.99:0/3521601464 shutdown_connections 2024-09-19T07:05:47.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:47.645+0000 7f77f8186640 1 -- 172.21.15.99:0/3521601464 wait complete. 2024-09-19T07:05:48.270 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 15, 'max_mds': 2, 'flags': 18} 2024-09-19T07:05:48.270 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 16 2024-09-19T07:05:48.516 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T07:05:48.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:05:48 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/3521601464' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:05:48.636 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:05:48 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/3521601464' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T07:05:49.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:05:49 smithi117 ceph-mon[76771]: pgmap v705: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:05:49.569 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:05:49 smithi099 ceph-mon[97031]: pgmap v705: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:05:50.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:50.062+0000 7f1f303ce640 1 -- 172.21.15.99:0/1004857124 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f28102550 msgr2=0x7f1f28102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:50.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:50.062+0000 7f1f303ce640 1 --2- 172.21.15.99:0/1004857124 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f28102550 0x7f1f28102920 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f1f240048d0 tx=0x7f1f24009da0 comp rx=0 tx=0).stop 2024-09-19T07:05:50.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:50.063+0000 7f1f303ce640 1 -- 172.21.15.99:0/1004857124 shutdown_connections 2024-09-19T07:05:50.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:50.063+0000 7f1f303ce640 1 --2- 172.21.15.99:0/1004857124 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f28102ef0 0x7f1f280fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:50.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:50.063+0000 7f1f303ce640 1 --2- 172.21.15.99:0/1004857124 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f28102550 0x7f1f28102920 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:50.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:50.063+0000 7f1f303ce640 1 -- 172.21.15.99:0/1004857124 >> 172.21.15.99:0/1004857124 conn(0x7f1f280f80f0 msgr2=0x7f1f280fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:05:50.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:50.063+0000 7f1f303ce640 1 -- 172.21.15.99:0/1004857124 shutdown_connections 2024-09-19T07:05:50.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:50.063+0000 7f1f303ce640 1 -- 172.21.15.99:0/1004857124 wait complete. 2024-09-19T07:05:50.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:50.063+0000 7f1f303ce640 1 Processor -- start 2024-09-19T07:05:50.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:50.063+0000 7f1f303ce640 1 -- start start 2024-09-19T07:05:50.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:50.063+0000 7f1f303ce640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f28102550 0x7f1f28113540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:50.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:50.063+0000 7f1f303ce640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f28102ef0 0x7f1f28113a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:50.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:50.063+0000 7f1f303ce640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f281140d0 con 0x7f1f28102550 2024-09-19T07:05:50.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:50.063+0000 7f1f303ce640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2810d4e0 con 0x7f1f28102ef0 2024-09-19T07:05:50.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:50.063+0000 7f1f2e16a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f28102550 0x7f1f28113540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:50.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:50.063+0000 7f1f2e16a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f28102550 0x7f1f28113540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59642/0 (socket says 172.21.15.99:59642) 2024-09-19T07:05:50.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:50.063+0000 7f1f2e16a640 1 -- 172.21.15.99:0/251524597 learned_addr learned my addr 172.21.15.99:0/251524597 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:05:50.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:50.064+0000 7f1f2d969640 1 --2- 172.21.15.99:0/251524597 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f28102ef0 0x7f1f28113a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:50.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:50.064+0000 7f1f2e16a640 1 -- 172.21.15.99:0/251524597 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f28102ef0 msgr2=0x7f1f28113a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:50.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:50.064+0000 7f1f2e16a640 1 --2- 172.21.15.99:0/251524597 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f28102ef0 0x7f1f28113a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:50.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:50.064+0000 7f1f2e16a640 1 -- 172.21.15.99:0/251524597 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f24005040 con 0x7f1f28102550 2024-09-19T07:05:50.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:50.064+0000 7f1f2e16a640 1 --2- 172.21.15.99:0/251524597 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f28102550 0x7f1f28113540 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f1f24003080 tx=0x7f1f24009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:05:50.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:50.064+0000 7f1f1effd640 1 -- 172.21.15.99:0/251524597 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f24038070 con 0x7f1f28102550 2024-09-19T07:05:50.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:50.064+0000 7f1f303ce640 1 -- 172.21.15.99:0/251524597 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f2810d760 con 0x7f1f28102550 2024-09-19T07:05:50.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:50.064+0000 7f1f1effd640 1 -- 172.21.15.99:0/251524597 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1f240097e0 con 0x7f1f28102550 2024-09-19T07:05:50.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:50.064+0000 7f1f1effd640 1 -- 172.21.15.99:0/251524597 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f2403d420 con 0x7f1f28102550 2024-09-19T07:05:50.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:50.064+0000 7f1f303ce640 1 -- 172.21.15.99:0/251524597 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f2810dca0 con 0x7f1f28102550 2024-09-19T07:05:50.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:50.065+0000 7f1f303ce640 1 -- 172.21.15.99:0/251524597 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f280fdcd0 con 0x7f1f28102550 2024-09-19T07:05:50.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:50.066+0000 7f1f1effd640 1 -- 172.21.15.99:0/251524597 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f1f24030020 con 0x7f1f28102550 2024-09-19T07:05:50.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:50.066+0000 7f1f1effd640 1 --2- 172.21.15.99:0/251524597 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f1f1406e530 0x7f1f140709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:50.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:50.066+0000 7f1f1effd640 1 -- 172.21.15.99:0/251524597 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f1f240ae720 con 0x7f1f28102550 2024-09-19T07:05:50.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:50.066+0000 7f1f2d969640 1 --2- 172.21.15.99:0/251524597 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f1f1406e530 0x7f1f140709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:50.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:50.067+0000 7f1f2d969640 1 --2- 172.21.15.99:0/251524597 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f1f1406e530 0x7f1f140709e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1f2810e7c0 tx=0x7f1f18009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:05:50.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:50.071+0000 7f1f1effd640 1 -- 172.21.15.99:0/251524597 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f1f24077810 con 0x7f1f28102550 2024-09-19T07:05:50.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:50.273+0000 7f1f303ce640 1 -- 172.21.15.99:0/251524597 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 16, "format": "json"} v 0) v1 -- 0x7f1f2804b720 con 0x7f1f28102550 2024-09-19T07:05:50.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:50.273+0000 7f1f1effd640 1 -- 172.21.15.99:0/251524597 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 16, "format": "json"}]=0 dumped fsmap epoch 16 v35) v1 ==== 107+0+4918 (secure 0 0 0) 0x7f1f2407aed0 con 0x7f1f28102550 2024-09-19T07:05:50.275 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T07:05:50.276 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":16,"btime":"1970-01-01T00:00:00:000000+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14490,"name":"cephfs.smithi099.obarqf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6827/388324528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":388324528},{"type":"v1","addr":"172.21.15.99:6827","nonce":388324528}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24283,"name":"cephfs.smithi117.bheqzh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.117:6827/4072877365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":4072877365},{"type":"v1","addr":"172.21.15.117:6827","nonce":4072877365}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:40.838146+0000","modified":"2024-09-19T06:39:41.732788+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":45,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14482,"mds_1":24269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14482":{"gid":14482,"name":"cephfs.smithi099.xehbxe","rank":0,"incarnation":11,"state":"up:active","state_seq":6,"addr":"172.21.15.99:6829/1508711176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1508711176},{"type":"v1","addr":"172.21.15.99:6829","nonce":1508711176}]},"join_fscid":1,"export_targets":[1],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24269":{"gid":24269,"name":"cephfs.smithi117.nooexo","rank":1,"incarnation":6,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6825/2367330767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":2367330767},{"type":"v1","addr":"172.21.15.117:6825","nonce":2367330767}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T07:05:50.277 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 16 2024-09-19T07:05:50.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:50.275+0000 7f1f303ce640 1 -- 172.21.15.99:0/251524597 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f1f1406e530 msgr2=0x7f1f140709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:50.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:50.275+0000 7f1f303ce640 1 --2- 172.21.15.99:0/251524597 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f1f1406e530 0x7f1f140709e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1f2810e7c0 tx=0x7f1f18009040 comp rx=0 tx=0).stop 2024-09-19T07:05:50.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:50.275+0000 7f1f303ce640 1 -- 172.21.15.99:0/251524597 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f28102550 msgr2=0x7f1f28113540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:50.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:50.275+0000 7f1f303ce640 1 --2- 172.21.15.99:0/251524597 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f28102550 0x7f1f28113540 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f1f24003080 tx=0x7f1f24009da0 comp rx=0 tx=0).stop 2024-09-19T07:05:50.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:50.275+0000 7f1f303ce640 1 -- 172.21.15.99:0/251524597 shutdown_connections 2024-09-19T07:05:50.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:50.275+0000 7f1f303ce640 1 --2- 172.21.15.99:0/251524597 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f1f1406e530 0x7f1f140709e0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:50.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:50.275+0000 7f1f303ce640 1 --2- 172.21.15.99:0/251524597 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1f28102ef0 0x7f1f28113a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:50.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:50.275+0000 7f1f303ce640 1 --2- 172.21.15.99:0/251524597 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f28102550 0x7f1f28113540 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:50.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:50.275+0000 7f1f303ce640 1 -- 172.21.15.99:0/251524597 >> 172.21.15.99:0/251524597 conn(0x7f1f280f80f0 msgr2=0x7f1f280f9160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:05:50.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:50.276+0000 7f1f303ce640 1 -- 172.21.15.99:0/251524597 shutdown_connections 2024-09-19T07:05:50.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:50.276+0000 7f1f303ce640 1 -- 172.21.15.99:0/251524597 wait complete. 2024-09-19T07:05:50.573 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:05:50 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/251524597' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 16, "format": "json"}]: dispatch 2024-09-19T07:05:50.811 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:05:50 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/251524597' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 16, "format": "json"}]: dispatch 2024-09-19T07:05:50.899 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 17 2024-09-19T07:05:51.142 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T07:05:51.535 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:05:51 smithi099 ceph-mon[97031]: pgmap v706: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:05:51.811 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:05:51 smithi117 ceph-mon[76771]: pgmap v706: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:05:52.553 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:05:52 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:05:52.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:52.753+0000 7f720ea8a640 1 -- 172.21.15.99:0/2338324905 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72080fac60 msgr2=0x7f72080fb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:52.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:52.753+0000 7f720ea8a640 1 --2- 172.21.15.99:0/2338324905 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72080fac60 0x7f72080fb0b0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f71f8009c50 tx=0x7f71f8004d10 comp rx=0 tx=0).stop 2024-09-19T07:05:52.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:52.753+0000 7f720ea8a640 1 -- 172.21.15.99:0/2338324905 shutdown_connections 2024-09-19T07:05:52.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:52.753+0000 7f720ea8a640 1 --2- 172.21.15.99:0/2338324905 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72080fac60 0x7f72080fb0b0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:52.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:52.753+0000 7f720ea8a640 1 --2- 172.21.15.99:0/2338324905 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72081025f0 0x7f72081029c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:52.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:52.753+0000 7f720ea8a640 1 -- 172.21.15.99:0/2338324905 >> 172.21.15.99:0/2338324905 conn(0x7f7208070c80 msgr2=0x7f7208071080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:05:52.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:52.753+0000 7f720ea8a640 1 -- 172.21.15.99:0/2338324905 shutdown_connections 2024-09-19T07:05:52.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:52.753+0000 7f720ea8a640 1 -- 172.21.15.99:0/2338324905 wait complete. 2024-09-19T07:05:52.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:52.754+0000 7f720ea8a640 1 Processor -- start 2024-09-19T07:05:52.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:52.754+0000 7f720ea8a640 1 -- start start 2024-09-19T07:05:52.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:52.754+0000 7f720ea8a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72080fac60 0x7f7208113230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:52.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:52.754+0000 7f720ea8a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72081025f0 0x7f7208113770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:52.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:52.754+0000 7f720ea8a640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7208113d70 con 0x7f72081025f0 2024-09-19T07:05:52.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:52.754+0000 7f720ea8a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f720810d1b0 con 0x7f72080fac60 2024-09-19T07:05:52.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:52.754+0000 7f7207fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72081025f0 0x7f7208113770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:52.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:52.754+0000 7f7207fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72081025f0 0x7f7208113770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59674/0 (socket says 172.21.15.99:59674) 2024-09-19T07:05:52.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:52.755+0000 7f7207fff640 1 -- 172.21.15.99:0/1287128435 learned_addr learned my addr 172.21.15.99:0/1287128435 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:05:52.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:52.755+0000 7f720c826640 1 --2- 172.21.15.99:0/1287128435 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72080fac60 0x7f7208113230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:52.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:52.755+0000 7f7207fff640 1 -- 172.21.15.99:0/1287128435 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72080fac60 msgr2=0x7f7208113230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:52.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:52.755+0000 7f7207fff640 1 --2- 172.21.15.99:0/1287128435 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72080fac60 0x7f7208113230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:52.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:52.755+0000 7f7207fff640 1 -- 172.21.15.99:0/1287128435 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f80098b0 con 0x7f72081025f0 2024-09-19T07:05:52.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:52.755+0000 7f720c826640 1 --2- 172.21.15.99:0/1287128435 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72080fac60 0x7f7208113230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:05:52.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:52.755+0000 7f7207fff640 1 --2- 172.21.15.99:0/1287128435 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72081025f0 0x7f7208113770 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f71f8004750 tx=0x7f71f8004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:05:52.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:52.755+0000 7f72057fa640 1 -- 172.21.15.99:0/1287128435 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71f8009610 con 0x7f72081025f0 2024-09-19T07:05:52.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:52.755+0000 7f720ea8a640 1 -- 172.21.15.99:0/1287128435 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f720810d430 con 0x7f72081025f0 2024-09-19T07:05:52.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:52.755+0000 7f72057fa640 1 -- 172.21.15.99:0/1287128435 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f71f8032b10 con 0x7f72081025f0 2024-09-19T07:05:52.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:52.755+0000 7f72057fa640 1 -- 172.21.15.99:0/1287128435 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71f803d990 con 0x7f72081025f0 2024-09-19T07:05:52.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:52.755+0000 7f720ea8a640 1 -- 172.21.15.99:0/1287128435 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f720810d9d0 con 0x7f72081025f0 2024-09-19T07:05:52.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:52.756+0000 7f720ea8a640 1 -- 172.21.15.99:0/1287128435 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7208065810 con 0x7f72081025f0 2024-09-19T07:05:52.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:52.757+0000 7f72057fa640 1 -- 172.21.15.99:0/1287128435 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f71f802f030 con 0x7f72081025f0 2024-09-19T07:05:52.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:52.757+0000 7f72057fa640 1 --2- 172.21.15.99:0/1287128435 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f71f406e530 0x7f71f40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:52.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:52.757+0000 7f720c826640 1 --2- 172.21.15.99:0/1287128435 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f71f406e530 0x7f71f40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:52.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:52.757+0000 7f72057fa640 1 -- 172.21.15.99:0/1287128435 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f71f80af2e0 con 0x7f72081025f0 2024-09-19T07:05:52.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:52.758+0000 7f720c826640 1 --2- 172.21.15.99:0/1287128435 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f71f406e530 0x7f71f40709e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f7200007fd0 tx=0x7f7200009e90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:05:52.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:52.762+0000 7f72057fa640 1 -- 172.21.15.99:0/1287128435 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f71f80783d0 con 0x7f72081025f0 2024-09-19T07:05:52.811 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:05:52 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:05:52.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:52.962+0000 7f720ea8a640 1 -- 172.21.15.99:0/1287128435 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 17, "format": "json"} v 0) v1 -- 0x7f7208109620 con 0x7f72081025f0 2024-09-19T07:05:52.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:52.963+0000 7f72057fa640 1 -- 172.21.15.99:0/1287128435 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 17, "format": "json"}]=0 dumped fsmap epoch 17 v35) v1 ==== 107+0+4919 (secure 0 0 0) 0x7f71f807ba90 con 0x7f72081025f0 2024-09-19T07:05:52.964 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T07:05:52.964 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":17,"btime":"1970-01-01T00:00:00:000000+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14490,"name":"cephfs.smithi099.obarqf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6827/388324528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":388324528},{"type":"v1","addr":"172.21.15.99:6827","nonce":388324528}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24283,"name":"cephfs.smithi117.bheqzh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.117:6827/4072877365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":4072877365},{"type":"v1","addr":"172.21.15.117:6827","nonce":4072877365}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:40.838146+0000","modified":"2024-09-19T06:41:18.134083+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":45,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14482,"mds_1":24269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14482":{"gid":14482,"name":"cephfs.smithi099.xehbxe","rank":0,"incarnation":11,"state":"up:active","state_seq":6,"addr":"172.21.15.99:6829/1508711176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1508711176},{"type":"v1","addr":"172.21.15.99:6829","nonce":1508711176}]},"join_fscid":1,"export_targets":[1],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24269":{"gid":24269,"name":"cephfs.smithi117.nooexo","rank":1,"incarnation":6,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6825/2367330767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":2367330767},{"type":"v1","addr":"172.21.15.117:6825","nonce":2367330767}]},"join_fscid":1,"export_targets":[0],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T07:05:52.965 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 17 2024-09-19T07:05:52.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:52.965+0000 7f720ea8a640 1 -- 172.21.15.99:0/1287128435 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f71f406e530 msgr2=0x7f71f40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:52.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:52.965+0000 7f720ea8a640 1 --2- 172.21.15.99:0/1287128435 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f71f406e530 0x7f71f40709e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f7200007fd0 tx=0x7f7200009e90 comp rx=0 tx=0).stop 2024-09-19T07:05:52.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:52.965+0000 7f720ea8a640 1 -- 172.21.15.99:0/1287128435 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72081025f0 msgr2=0x7f7208113770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:52.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:52.965+0000 7f720ea8a640 1 --2- 172.21.15.99:0/1287128435 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72081025f0 0x7f7208113770 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f71f8004750 tx=0x7f71f8004d10 comp rx=0 tx=0).stop 2024-09-19T07:05:52.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:52.966+0000 7f720ea8a640 1 -- 172.21.15.99:0/1287128435 shutdown_connections 2024-09-19T07:05:52.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:52.966+0000 7f720ea8a640 1 --2- 172.21.15.99:0/1287128435 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f71f406e530 0x7f71f40709e0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:52.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:52.966+0000 7f720ea8a640 1 --2- 172.21.15.99:0/1287128435 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f72081025f0 0x7f7208113770 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:52.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:52.966+0000 7f720ea8a640 1 --2- 172.21.15.99:0/1287128435 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f72080fac60 0x7f7208113230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:52.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:52.966+0000 7f720ea8a640 1 -- 172.21.15.99:0/1287128435 >> 172.21.15.99:0/1287128435 conn(0x7f7208070c80 msgr2=0x7f72080f9f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:05:52.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:52.966+0000 7f720ea8a640 1 -- 172.21.15.99:0/1287128435 shutdown_connections 2024-09-19T07:05:52.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:52.966+0000 7f720ea8a640 1 -- 172.21.15.99:0/1287128435 wait complete. 2024-09-19T07:05:53.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:05:53 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/1287128435' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-09-19T07:05:53.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:05:53 smithi099 ceph-mon[97031]: pgmap v707: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:05:53.746 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 18 2024-09-19T07:05:53.811 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:05:53 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/1287128435' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-09-19T07:05:53.811 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:05:53 smithi117 ceph-mon[76771]: pgmap v707: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:05:53.997 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T07:05:54.440 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:05:54 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:05:54.811 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:05:54 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:05:55.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:55.573+0000 7f9e2886c640 1 -- 172.21.15.99:0/1136117322 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9e24102550 msgr2=0x7f9e24102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:55.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:55.573+0000 7f9e2886c640 1 --2- 172.21.15.99:0/1136117322 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9e24102550 0x7f9e24102920 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c0048d0 tx=0x7f9e1c009da0 comp rx=0 tx=0).stop 2024-09-19T07:05:55.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:55.573+0000 7f9e2886c640 1 -- 172.21.15.99:0/1136117322 shutdown_connections 2024-09-19T07:05:55.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:55.573+0000 7f9e2886c640 1 --2- 172.21.15.99:0/1136117322 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e24102ef0 0x7f9e240fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:55.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:55.573+0000 7f9e2886c640 1 --2- 172.21.15.99:0/1136117322 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9e24102550 0x7f9e24102920 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:55.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:55.573+0000 7f9e2886c640 1 -- 172.21.15.99:0/1136117322 >> 172.21.15.99:0/1136117322 conn(0x7f9e240f80f0 msgr2=0x7f9e240fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:05:55.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:55.573+0000 7f9e2886c640 1 -- 172.21.15.99:0/1136117322 shutdown_connections 2024-09-19T07:05:55.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:55.573+0000 7f9e2886c640 1 -- 172.21.15.99:0/1136117322 wait complete. 2024-09-19T07:05:55.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:55.574+0000 7f9e2886c640 1 Processor -- start 2024-09-19T07:05:55.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:55.574+0000 7f9e2886c640 1 -- start start 2024-09-19T07:05:55.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:55.574+0000 7f9e2886c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e24102550 0x7f9e24113540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:55.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:55.574+0000 7f9e2886c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9e24102ef0 0x7f9e24113a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:55.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:55.574+0000 7f9e2886c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e241140d0 con 0x7f9e24102ef0 2024-09-19T07:05:55.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:55.574+0000 7f9e2886c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2410d4e0 con 0x7f9e24102550 2024-09-19T07:05:55.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:55.574+0000 7f9e21d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9e24102ef0 0x7f9e24113a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:55.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:55.574+0000 7f9e21d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9e24102ef0 0x7f9e24113a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46446/0 (socket says 172.21.15.99:46446) 2024-09-19T07:05:55.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:55.574+0000 7f9e21d9b640 1 -- 172.21.15.99:0/2626687689 learned_addr learned my addr 172.21.15.99:0/2626687689 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:05:55.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:55.575+0000 7f9e2259c640 1 --2- 172.21.15.99:0/2626687689 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e24102550 0x7f9e24113540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:55.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:55.575+0000 7f9e21d9b640 1 -- 172.21.15.99:0/2626687689 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e24102550 msgr2=0x7f9e24113540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:55.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:55.575+0000 7f9e21d9b640 1 --2- 172.21.15.99:0/2626687689 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e24102550 0x7f9e24113540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:55.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:55.575+0000 7f9e21d9b640 1 -- 172.21.15.99:0/2626687689 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e1c005040 con 0x7f9e24102ef0 2024-09-19T07:05:55.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:55.575+0000 7f9e21d9b640 1 --2- 172.21.15.99:0/2626687689 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9e24102ef0 0x7f9e24113a80 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c002840 tx=0x7f9e0c004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:05:55.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:55.575+0000 7f9e1affd640 1 -- 172.21.15.99:0/2626687689 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e0c007c30 con 0x7f9e24102ef0 2024-09-19T07:05:55.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:55.575+0000 7f9e2886c640 1 -- 172.21.15.99:0/2626687689 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e2410d7c0 con 0x7f9e24102ef0 2024-09-19T07:05:55.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:55.575+0000 7f9e1affd640 1 -- 172.21.15.99:0/2626687689 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9e0c00f040 con 0x7f9e24102ef0 2024-09-19T07:05:55.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:55.575+0000 7f9e1affd640 1 -- 172.21.15.99:0/2626687689 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e0c00d990 con 0x7f9e24102ef0 2024-09-19T07:05:55.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:55.575+0000 7f9e2886c640 1 -- 172.21.15.99:0/2626687689 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e2410dd60 con 0x7f9e24102ef0 2024-09-19T07:05:55.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:55.576+0000 7f9e2886c640 1 -- 172.21.15.99:0/2626687689 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e240fdcd0 con 0x7f9e24102ef0 2024-09-19T07:05:55.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:55.577+0000 7f9e1affd640 1 -- 172.21.15.99:0/2626687689 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f9e0c009600 con 0x7f9e24102ef0 2024-09-19T07:05:55.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:55.577+0000 7f9e1affd640 1 --2- 172.21.15.99:0/2626687689 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f9e1006e530 0x7f9e100709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:55.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:55.577+0000 7f9e1affd640 1 -- 172.21.15.99:0/2626687689 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f9e0c08d8d0 con 0x7f9e24102ef0 2024-09-19T07:05:55.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:55.577+0000 7f9e2259c640 1 --2- 172.21.15.99:0/2626687689 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f9e1006e530 0x7f9e100709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:55.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:55.578+0000 7f9e2259c640 1 --2- 172.21.15.99:0/2626687689 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f9e1006e530 0x7f9e100709e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c009ac0 tx=0x7f9e1c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:05:55.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:55.581+0000 7f9e1affd640 1 -- 172.21.15.99:0/2626687689 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f9e0c056a70 con 0x7f9e24102ef0 2024-09-19T07:05:55.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:05:55 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:55.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:05:55 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:05:55.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:05:55 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T07:05:55.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:05:55 smithi099 ceph-mon[97031]: pgmap v708: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:05:55.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:55.783+0000 7f9e2886c640 1 -- 172.21.15.99:0/2626687689 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 18, "format": "json"} v 0) v1 -- 0x7f9e240fbd50 con 0x7f9e24102ef0 2024-09-19T07:05:55.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:55.784+0000 7f9e1affd640 1 -- 172.21.15.99:0/2626687689 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 18, "format": "json"}]=0 dumped fsmap epoch 18 v35) v1 ==== 107+0+4933 (secure 0 0 0) 0x7f9e0c05a130 con 0x7f9e24102ef0 2024-09-19T07:05:55.785 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T07:05:55.785 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":18,"btime":"2024-09-19T06:43:47:392296+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14490,"name":"cephfs.smithi099.obarqf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6827/388324528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":388324528},{"type":"v1","addr":"172.21.15.99:6827","nonce":388324528}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24283,"name":"cephfs.smithi117.bheqzh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.117:6827/4072877365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":4072877365},{"type":"v1","addr":"172.21.15.117:6827","nonce":4072877365}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:40.838146+0000","modified":"2024-09-19T06:43:47.392294+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":45,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14482,"mds_1":24269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14482":{"gid":14482,"name":"cephfs.smithi099.xehbxe","rank":0,"incarnation":11,"state":"up:active","state_seq":6,"addr":"172.21.15.99:6829/1508711176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1508711176},{"type":"v1","addr":"172.21.15.99:6829","nonce":1508711176}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24269":{"gid":24269,"name":"cephfs.smithi117.nooexo","rank":1,"incarnation":6,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6825/2367330767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":2367330767},{"type":"v1","addr":"172.21.15.117:6825","nonce":2367330767}]},"join_fscid":1,"export_targets":[0],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14482,"qdb_cluster":[14482,24269]},"id":1}]} 2024-09-19T07:05:55.785 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 18 2024-09-19T07:05:55.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:55.786+0000 7f9e2886c640 1 -- 172.21.15.99:0/2626687689 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f9e1006e530 msgr2=0x7f9e100709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:55.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:55.786+0000 7f9e2886c640 1 --2- 172.21.15.99:0/2626687689 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f9e1006e530 0x7f9e100709e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c009ac0 tx=0x7f9e1c035040 comp rx=0 tx=0).stop 2024-09-19T07:05:55.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:55.786+0000 7f9e2886c640 1 -- 172.21.15.99:0/2626687689 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9e24102ef0 msgr2=0x7f9e24113a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:55.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:55.786+0000 7f9e2886c640 1 --2- 172.21.15.99:0/2626687689 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9e24102ef0 0x7f9e24113a80 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c002840 tx=0x7f9e0c004570 comp rx=0 tx=0).stop 2024-09-19T07:05:55.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:55.786+0000 7f9e2886c640 1 -- 172.21.15.99:0/2626687689 shutdown_connections 2024-09-19T07:05:55.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:55.786+0000 7f9e2886c640 1 --2- 172.21.15.99:0/2626687689 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f9e1006e530 0x7f9e100709e0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:55.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:55.786+0000 7f9e2886c640 1 --2- 172.21.15.99:0/2626687689 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9e24102ef0 0x7f9e24113a80 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:55.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:55.786+0000 7f9e2886c640 1 --2- 172.21.15.99:0/2626687689 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9e24102550 0x7f9e24113540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:55.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:55.786+0000 7f9e2886c640 1 -- 172.21.15.99:0/2626687689 >> 172.21.15.99:0/2626687689 conn(0x7f9e240f80f0 msgr2=0x7f9e240f9160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:05:55.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:55.786+0000 7f9e2886c640 1 -- 172.21.15.99:0/2626687689 shutdown_connections 2024-09-19T07:05:55.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:55.786+0000 7f9e2886c640 1 -- 172.21.15.99:0/2626687689 wait complete. 2024-09-19T07:05:55.811 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:05:55 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:05:55.811 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:05:55 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:05:55.811 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:05:55 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T07:05:55.811 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:05:55 smithi117 ceph-mon[76771]: pgmap v708: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:05:56.417 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 19 2024-09-19T07:05:56.662 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T07:05:56.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:05:56 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/2626687689' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-09-19T07:05:56.811 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:05:56 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/2626687689' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-09-19T07:05:57.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:05:57 smithi099 ceph-mon[97031]: pgmap v709: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:05:57.712 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:05:57 smithi117 ceph-mon[76771]: pgmap v709: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:05:58.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:58.219+0000 7f90adefa640 1 -- 172.21.15.99:0/4072160267 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f90a8102620 msgr2=0x7f90a81029f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:58.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:58.219+0000 7f90adefa640 1 --2- 172.21.15.99:0/4072160267 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f90a8102620 0x7f90a81029f0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f90980048d0 tx=0x7f9098009da0 comp rx=0 tx=0).stop 2024-09-19T07:05:58.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:58.219+0000 7f90adefa640 1 -- 172.21.15.99:0/4072160267 shutdown_connections 2024-09-19T07:05:58.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:58.219+0000 7f90adefa640 1 --2- 172.21.15.99:0/4072160267 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90a80fac80 0x7f90a80fb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:58.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:58.219+0000 7f90adefa640 1 --2- 172.21.15.99:0/4072160267 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f90a8102620 0x7f90a81029f0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:58.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:58.219+0000 7f90adefa640 1 -- 172.21.15.99:0/4072160267 >> 172.21.15.99:0/4072160267 conn(0x7f90a8070ce0 msgr2=0x7f90a80710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:05:58.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:58.219+0000 7f90adefa640 1 -- 172.21.15.99:0/4072160267 shutdown_connections 2024-09-19T07:05:58.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:58.219+0000 7f90adefa640 1 -- 172.21.15.99:0/4072160267 wait complete. 2024-09-19T07:05:58.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:58.220+0000 7f90adefa640 1 Processor -- start 2024-09-19T07:05:58.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:58.220+0000 7f90adefa640 1 -- start start 2024-09-19T07:05:58.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:58.220+0000 7f90adefa640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90a80fac80 0x7f90a81131f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:58.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:58.220+0000 7f90adefa640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f90a8102620 0x7f90a8113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:58.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:58.220+0000 7f90adefa640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a8113d30 con 0x7f90a8102620 2024-09-19T07:05:58.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:58.220+0000 7f90adefa640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a810d170 con 0x7f90a80fac80 2024-09-19T07:05:58.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:58.220+0000 7f90a6ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f90a8102620 0x7f90a8113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:58.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:58.220+0000 7f90a6ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f90a8102620 0x7f90a8113730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46466/0 (socket says 172.21.15.99:46466) 2024-09-19T07:05:58.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:58.220+0000 7f90a6ffd640 1 -- 172.21.15.99:0/324033147 learned_addr learned my addr 172.21.15.99:0/324033147 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:05:58.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:58.220+0000 7f90a77fe640 1 --2- 172.21.15.99:0/324033147 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90a80fac80 0x7f90a81131f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:58.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:58.220+0000 7f90a6ffd640 1 -- 172.21.15.99:0/324033147 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90a80fac80 msgr2=0x7f90a81131f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:58.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:58.220+0000 7f90a6ffd640 1 --2- 172.21.15.99:0/324033147 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90a80fac80 0x7f90a81131f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:58.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:58.220+0000 7f90a6ffd640 1 -- 172.21.15.99:0/324033147 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9098005040 con 0x7f90a8102620 2024-09-19T07:05:58.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:58.221+0000 7f90a6ffd640 1 --2- 172.21.15.99:0/324033147 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f90a8102620 0x7f90a8113730 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f909000c790 tx=0x7f90900043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:05:58.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:58.221+0000 7f909ffff640 1 -- 172.21.15.99:0/324033147 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f909000a7a0 con 0x7f90a8102620 2024-09-19T07:05:58.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:58.221+0000 7f909ffff640 1 -- 172.21.15.99:0/324033147 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f909000ada0 con 0x7f90a8102620 2024-09-19T07:05:58.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:58.221+0000 7f90adefa640 1 -- 172.21.15.99:0/324033147 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90a810d450 con 0x7f90a8102620 2024-09-19T07:05:58.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:58.221+0000 7f909ffff640 1 -- 172.21.15.99:0/324033147 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90900113a0 con 0x7f90a8102620 2024-09-19T07:05:58.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:58.221+0000 7f90adefa640 1 -- 172.21.15.99:0/324033147 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90a810d9f0 con 0x7f90a8102620 2024-09-19T07:05:58.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:58.222+0000 7f90adefa640 1 -- 172.21.15.99:0/324033147 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90a80657b0 con 0x7f90a8102620 2024-09-19T07:05:58.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:58.222+0000 7f909ffff640 1 -- 172.21.15.99:0/324033147 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f909000a900 con 0x7f90a8102620 2024-09-19T07:05:58.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:58.223+0000 7f909ffff640 1 --2- 172.21.15.99:0/324033147 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f909406e530 0x7f90940709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:05:58.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:58.223+0000 7f909ffff640 1 -- 172.21.15.99:0/324033147 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f909008e200 con 0x7f90a8102620 2024-09-19T07:05:58.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:58.223+0000 7f90a77fe640 1 --2- 172.21.15.99:0/324033147 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f909406e530 0x7f90940709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:05:58.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:58.223+0000 7f90a77fe640 1 --2- 172.21.15.99:0/324033147 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f909406e530 0x7f90940709e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f9098007ac0 tx=0x7f9098035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:05:58.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:58.227+0000 7f909ffff640 1 -- 172.21.15.99:0/324033147 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f9090057430 con 0x7f90a8102620 2024-09-19T07:05:58.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:58.426+0000 7f90adefa640 1 -- 172.21.15.99:0/324033147 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 19, "format": "json"} v 0) v1 -- 0x7f90a8109590 con 0x7f90a8102620 2024-09-19T07:05:58.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:58.427+0000 7f909ffff640 1 -- 172.21.15.99:0/324033147 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 19, "format": "json"}]=0 dumped fsmap epoch 19 v35) v1 ==== 107+0+4932 (secure 0 0 0) 0x7f909005aaf0 con 0x7f90a8102620 2024-09-19T07:05:58.428 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T07:05:58.428 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":19,"btime":"2024-09-19T06:44:03:270764+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14490,"name":"cephfs.smithi099.obarqf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6827/388324528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":388324528},{"type":"v1","addr":"172.21.15.99:6827","nonce":388324528}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24283,"name":"cephfs.smithi117.bheqzh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.117:6827/4072877365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":4072877365},{"type":"v1","addr":"172.21.15.117:6827","nonce":4072877365}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:40.838146+0000","modified":"2024-09-19T06:44:02.356718+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":45,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14482,"mds_1":24269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14482":{"gid":14482,"name":"cephfs.smithi099.xehbxe","rank":0,"incarnation":11,"state":"up:active","state_seq":6,"addr":"172.21.15.99:6829/1508711176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1508711176},{"type":"v1","addr":"172.21.15.99:6829","nonce":1508711176}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24269":{"gid":24269,"name":"cephfs.smithi117.nooexo","rank":1,"incarnation":6,"state":"up:active","state_seq":4,"addr":"172.21.15.117:6825/2367330767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":2367330767},{"type":"v1","addr":"172.21.15.117:6825","nonce":2367330767}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14482,"qdb_cluster":[24269,14482]},"id":1}]} 2024-09-19T07:05:58.428 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 19 2024-09-19T07:05:58.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:58.429+0000 7f90adefa640 1 -- 172.21.15.99:0/324033147 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f909406e530 msgr2=0x7f90940709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:58.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:58.429+0000 7f90adefa640 1 --2- 172.21.15.99:0/324033147 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f909406e530 0x7f90940709e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f9098007ac0 tx=0x7f9098035040 comp rx=0 tx=0).stop 2024-09-19T07:05:58.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:58.429+0000 7f90adefa640 1 -- 172.21.15.99:0/324033147 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f90a8102620 msgr2=0x7f90a8113730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:05:58.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:58.429+0000 7f90adefa640 1 --2- 172.21.15.99:0/324033147 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f90a8102620 0x7f90a8113730 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f909000c790 tx=0x7f90900043c0 comp rx=0 tx=0).stop 2024-09-19T07:05:58.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:58.429+0000 7f90adefa640 1 -- 172.21.15.99:0/324033147 shutdown_connections 2024-09-19T07:05:58.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:58.429+0000 7f90adefa640 1 --2- 172.21.15.99:0/324033147 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f909406e530 0x7f90940709e0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:58.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:58.429+0000 7f90adefa640 1 --2- 172.21.15.99:0/324033147 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f90a8102620 0x7f90a8113730 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:58.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:58.429+0000 7f90adefa640 1 --2- 172.21.15.99:0/324033147 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90a80fac80 0x7f90a81131f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:05:58.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:58.429+0000 7f90adefa640 1 -- 172.21.15.99:0/324033147 >> 172.21.15.99:0/324033147 conn(0x7f90a8070ce0 msgr2=0x7f90a8105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:05:58.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:58.429+0000 7f90adefa640 1 -- 172.21.15.99:0/324033147 shutdown_connections 2024-09-19T07:05:58.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:05:58.429+0000 7f90adefa640 1 -- 172.21.15.99:0/324033147 wait complete. 2024-09-19T07:05:58.705 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:05:58 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/324033147' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-09-19T07:05:58.811 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:05:58 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/324033147' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-09-19T07:05:59.065 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 20 2024-09-19T07:05:59.310 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T07:05:59.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:05:59 smithi099 ceph-mon[97031]: pgmap v710: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:05:59.811 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:05:59 smithi117 ceph-mon[76771]: pgmap v710: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:06:00.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:00.932+0000 7f4ad9514640 1 -- 172.21.15.99:0/231147810 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ad4102530 msgr2=0x7f4ad4102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:00.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:00.932+0000 7f4ad9514640 1 --2- 172.21.15.99:0/231147810 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ad4102530 0x7f4ad4102900 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f4ac4009c50 tx=0x7f4ac4004d10 comp rx=0 tx=0).stop 2024-09-19T07:06:00.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:00.932+0000 7f4ad9514640 1 -- 172.21.15.99:0/231147810 shutdown_connections 2024-09-19T07:06:00.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:00.932+0000 7f4ad9514640 1 --2- 172.21.15.99:0/231147810 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ad4102ed0 0x7f4ad40fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:00.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:00.932+0000 7f4ad9514640 1 --2- 172.21.15.99:0/231147810 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ad4102530 0x7f4ad4102900 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:00.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:00.932+0000 7f4ad9514640 1 -- 172.21.15.99:0/231147810 >> 172.21.15.99:0/231147810 conn(0x7f4ad40f80f0 msgr2=0x7f4ad40fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:00.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:00.932+0000 7f4ad9514640 1 -- 172.21.15.99:0/231147810 shutdown_connections 2024-09-19T07:06:00.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:00.932+0000 7f4ad9514640 1 -- 172.21.15.99:0/231147810 wait complete. 2024-09-19T07:06:00.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:00.933+0000 7f4ad9514640 1 Processor -- start 2024-09-19T07:06:00.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:00.933+0000 7f4ad9514640 1 -- start start 2024-09-19T07:06:00.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:00.933+0000 7f4ad9514640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ad4102530 0x7f4ad4113240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:00.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:00.933+0000 7f4ad9514640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ad4102ed0 0x7f4ad4113780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:00.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:00.933+0000 7f4ad9514640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad4113d80 con 0x7f4ad4102530 2024-09-19T07:06:00.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:00.933+0000 7f4ad9514640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad410d1c0 con 0x7f4ad4102ed0 2024-09-19T07:06:00.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:00.933+0000 7f4ad2ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ad4102530 0x7f4ad4113240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:00.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:00.933+0000 7f4ad2ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ad4102530 0x7f4ad4113240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46482/0 (socket says 172.21.15.99:46482) 2024-09-19T07:06:00.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:00.933+0000 7f4ad2ffd640 1 -- 172.21.15.99:0/1442464154 learned_addr learned my addr 172.21.15.99:0/1442464154 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:06:00.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:00.933+0000 7f4ad27fc640 1 --2- 172.21.15.99:0/1442464154 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ad4102ed0 0x7f4ad4113780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:00.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:00.934+0000 7f4ad2ffd640 1 -- 172.21.15.99:0/1442464154 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ad4102ed0 msgr2=0x7f4ad4113780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:00.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:00.934+0000 7f4ad2ffd640 1 --2- 172.21.15.99:0/1442464154 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ad4102ed0 0x7f4ad4113780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:00.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:00.934+0000 7f4ad2ffd640 1 -- 172.21.15.99:0/1442464154 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ac40098b0 con 0x7f4ad4102530 2024-09-19T07:06:00.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:00.934+0000 7f4ad2ffd640 1 --2- 172.21.15.99:0/1442464154 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ad4102530 0x7f4ad4113240 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f4ac4004750 tx=0x7f4ac4004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:00.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:00.934+0000 7f4abb7fe640 1 -- 172.21.15.99:0/1442464154 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ac4009610 con 0x7f4ad4102530 2024-09-19T07:06:00.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:00.934+0000 7f4abb7fe640 1 -- 172.21.15.99:0/1442464154 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4ac4032b10 con 0x7f4ad4102530 2024-09-19T07:06:00.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:00.934+0000 7f4ad9514640 1 -- 172.21.15.99:0/1442464154 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ad410d440 con 0x7f4ad4102530 2024-09-19T07:06:00.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:00.934+0000 7f4abb7fe640 1 -- 172.21.15.99:0/1442464154 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ac403d990 con 0x7f4ad4102530 2024-09-19T07:06:00.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:00.934+0000 7f4ad9514640 1 -- 172.21.15.99:0/1442464154 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ad410d9e0 con 0x7f4ad4102530 2024-09-19T07:06:00.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:00.935+0000 7f4ad9514640 1 -- 172.21.15.99:0/1442464154 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ad40fdcb0 con 0x7f4ad4102530 2024-09-19T07:06:00.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:00.936+0000 7f4abb7fe640 1 -- 172.21.15.99:0/1442464154 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f4ac402f030 con 0x7f4ad4102530 2024-09-19T07:06:00.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:00.936+0000 7f4abb7fe640 1 --2- 172.21.15.99:0/1442464154 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f4abc06e530 0x7f4abc0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:00.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:00.936+0000 7f4abb7fe640 1 -- 172.21.15.99:0/1442464154 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f4ac40af130 con 0x7f4ad4102530 2024-09-19T07:06:00.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:00.936+0000 7f4ad27fc640 1 --2- 172.21.15.99:0/1442464154 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f4abc06e530 0x7f4abc0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:00.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:00.937+0000 7f4ad27fc640 1 --2- 172.21.15.99:0/1442464154 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f4abc06e530 0x7f4abc0709e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f4ad410eb00 tx=0x7f4ac800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:00.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:00.940+0000 7f4abb7fe640 1 -- 172.21.15.99:0/1442464154 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f4ac40782a0 con 0x7f4ad4102530 2024-09-19T07:06:01.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:01.145+0000 7f4ad9514640 1 -- 172.21.15.99:0/1442464154 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) v1 -- 0x7f4ad404b720 con 0x7f4ad4102530 2024-09-19T07:06:01.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:01.146+0000 7f4abb7fe640 1 -- 172.21.15.99:0/1442464154 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v35) v1 ==== 107+0+3335 (secure 0 0 0) 0x7f4ac4041d20 con 0x7f4ad4102530 2024-09-19T07:06:01.147 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T07:06:01.147 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":20,"btime":"2024-09-19T06:47:50:076555+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14490,"name":"cephfs.smithi099.obarqf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6827/388324528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":388324528},{"type":"v1","addr":"172.21.15.99:6827","nonce":388324528}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24283,"name":"cephfs.smithi117.bheqzh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.117:6827/4072877365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":4072877365},{"type":"v1","addr":"172.21.15.117:6827","nonce":4072877365}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":20,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:40.838146+0000","modified":"2024-09-19T06:47:50.076553+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":77,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T07:06:01.147 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 20 2024-09-19T07:06:01.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:01.148+0000 7f4ad9514640 1 -- 172.21.15.99:0/1442464154 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f4abc06e530 msgr2=0x7f4abc0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:01.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:01.148+0000 7f4ad9514640 1 --2- 172.21.15.99:0/1442464154 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f4abc06e530 0x7f4abc0709e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f4ad410eb00 tx=0x7f4ac800b040 comp rx=0 tx=0).stop 2024-09-19T07:06:01.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:01.148+0000 7f4ad9514640 1 -- 172.21.15.99:0/1442464154 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ad4102530 msgr2=0x7f4ad4113240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:01.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:01.148+0000 7f4ad9514640 1 --2- 172.21.15.99:0/1442464154 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ad4102530 0x7f4ad4113240 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f4ac4004750 tx=0x7f4ac4004d10 comp rx=0 tx=0).stop 2024-09-19T07:06:01.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:01.148+0000 7f4ad9514640 1 -- 172.21.15.99:0/1442464154 shutdown_connections 2024-09-19T07:06:01.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:01.148+0000 7f4ad9514640 1 --2- 172.21.15.99:0/1442464154 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f4abc06e530 0x7f4abc0709e0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:01.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:01.148+0000 7f4ad9514640 1 --2- 172.21.15.99:0/1442464154 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ad4102ed0 0x7f4ad4113780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:01.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:01.148+0000 7f4ad9514640 1 --2- 172.21.15.99:0/1442464154 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4ad4102530 0x7f4ad4113240 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:01.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:01.148+0000 7f4ad9514640 1 -- 172.21.15.99:0/1442464154 >> 172.21.15.99:0/1442464154 conn(0x7f4ad40f80f0 msgr2=0x7f4ad40f90f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:01.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:01.148+0000 7f4ad9514640 1 -- 172.21.15.99:0/1442464154 shutdown_connections 2024-09-19T07:06:01.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:01.148+0000 7f4ad9514640 1 -- 172.21.15.99:0/1442464154 wait complete. 2024-09-19T07:06:01.452 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:06:01 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/1442464154' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-09-19T07:06:01.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:06:01 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/1442464154' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-09-19T07:06:01.760 DEBUG:tasks.fs:max_mds not reduced in epoch 20 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-19T07:06:01.760 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 21 2024-09-19T07:06:02.007 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T07:06:02.421 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:06:02 smithi099 ceph-mon[97031]: pgmap v711: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:06:02.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:06:02 smithi117 ceph-mon[76771]: pgmap v711: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:06:03.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:03.646+0000 7fe2a2639640 1 -- 172.21.15.99:0/736324165 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe29c0fe450 msgr2=0x7fe29c0fe820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:03.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:03.646+0000 7fe2a2639640 1 --2- 172.21.15.99:0/736324165 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe29c0fe450 0x7fe29c0fe820 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fe28c0048d0 tx=0x7fe28c009da0 comp rx=0 tx=0).stop 2024-09-19T07:06:03.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:03.646+0000 7fe2a2639640 1 -- 172.21.15.99:0/736324165 shutdown_connections 2024-09-19T07:06:03.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:03.646+0000 7fe2a2639640 1 --2- 172.21.15.99:0/736324165 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe29c064fe0 0x7fe29c065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:03.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:03.646+0000 7fe2a2639640 1 --2- 172.21.15.99:0/736324165 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe29c0fe450 0x7fe29c0fe820 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:03.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:03.646+0000 7fe2a2639640 1 -- 172.21.15.99:0/736324165 >> 172.21.15.99:0/736324165 conn(0x7fe29c0723b0 msgr2=0x7fe29c0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:03.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:03.646+0000 7fe2a2639640 1 -- 172.21.15.99:0/736324165 shutdown_connections 2024-09-19T07:06:03.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:03.647+0000 7fe2a2639640 1 -- 172.21.15.99:0/736324165 wait complete. 2024-09-19T07:06:03.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:03.647+0000 7fe2a2639640 1 Processor -- start 2024-09-19T07:06:03.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:03.647+0000 7fe2a2639640 1 -- start start 2024-09-19T07:06:03.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:03.647+0000 7fe2a2639640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe29c064fe0 0x7fe29c115380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:03.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:03.647+0000 7fe2a2639640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe29c0fe450 0x7fe29c1158c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:03.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:03.647+0000 7fe2a2639640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe29c115ec0 con 0x7fe29c0fe450 2024-09-19T07:06:03.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:03.647+0000 7fe2a2639640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe29c10f300 con 0x7fe29c064fe0 2024-09-19T07:06:03.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:03.648+0000 7fe29b7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe29c0fe450 0x7fe29c1158c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:03.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:03.648+0000 7fe29b7fe640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe29c0fe450 0x7fe29c1158c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46486/0 (socket says 172.21.15.99:46486) 2024-09-19T07:06:03.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:03.648+0000 7fe29b7fe640 1 -- 172.21.15.99:0/336697949 learned_addr learned my addr 172.21.15.99:0/336697949 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:06:03.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:03.648+0000 7fe29bfff640 1 --2- 172.21.15.99:0/336697949 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe29c064fe0 0x7fe29c115380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:03.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:03.648+0000 7fe29b7fe640 1 -- 172.21.15.99:0/336697949 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe29c064fe0 msgr2=0x7fe29c115380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:03.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:03.648+0000 7fe29b7fe640 1 --2- 172.21.15.99:0/336697949 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe29c064fe0 0x7fe29c115380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:03.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:03.648+0000 7fe29b7fe640 1 -- 172.21.15.99:0/336697949 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe28c005040 con 0x7fe29c0fe450 2024-09-19T07:06:03.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:03.648+0000 7fe29b7fe640 1 --2- 172.21.15.99:0/336697949 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe29c0fe450 0x7fe29c1158c0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fe29000eb70 tx=0x7fe29000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:03.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:03.648+0000 7fe298ff9640 1 -- 172.21.15.99:0/336697949 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe290007c30 con 0x7fe29c0fe450 2024-09-19T07:06:03.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:03.648+0000 7fe298ff9640 1 -- 172.21.15.99:0/336697949 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe29000f040 con 0x7fe29c0fe450 2024-09-19T07:06:03.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:03.648+0000 7fe2a2639640 1 -- 172.21.15.99:0/336697949 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe29c10f580 con 0x7fe29c0fe450 2024-09-19T07:06:03.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:03.648+0000 7fe298ff9640 1 -- 172.21.15.99:0/336697949 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe29000ca60 con 0x7fe29c0fe450 2024-09-19T07:06:03.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:03.648+0000 7fe2a2639640 1 -- 172.21.15.99:0/336697949 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe29c10fb20 con 0x7fe29c0fe450 2024-09-19T07:06:03.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:03.650+0000 7fe2a2639640 1 -- 172.21.15.99:0/336697949 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe29c0fdce0 con 0x7fe29c0fe450 2024-09-19T07:06:03.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:03.650+0000 7fe298ff9640 1 -- 172.21.15.99:0/336697949 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fe29000cbc0 con 0x7fe29c0fe450 2024-09-19T07:06:03.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:03.650+0000 7fe298ff9640 1 --2- 172.21.15.99:0/336697949 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe28406e530 0x7fe2840709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:03.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:03.651+0000 7fe298ff9640 1 -- 172.21.15.99:0/336697949 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fe29008ddd0 con 0x7fe29c0fe450 2024-09-19T07:06:03.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:03.651+0000 7fe29bfff640 1 --2- 172.21.15.99:0/336697949 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe28406e530 0x7fe2840709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:03.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:03.651+0000 7fe29bfff640 1 --2- 172.21.15.99:0/336697949 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe28406e530 0x7fe2840709e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe28c003080 tx=0x7fe28c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:03.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:03.655+0000 7fe298ff9640 1 -- 172.21.15.99:0/336697949 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fe290056f70 con 0x7fe29c0fe450 2024-09-19T07:06:03.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:03.856+0000 7fe2a2639640 1 -- 172.21.15.99:0/336697949 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) v1 -- 0x7fe29c1109f0 con 0x7fe29c0fe450 2024-09-19T07:06:03.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:03.857+0000 7fe298ff9640 1 -- 172.21.15.99:0/336697949 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v35) v1 ==== 107+0+4896 (secure 0 0 0) 0x7fe29005a630 con 0x7fe29c0fe450 2024-09-19T07:06:03.858 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T07:06:03.859 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":21,"btime":"2024-09-19T06:47:51:078381+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14490,"name":"cephfs.smithi099.obarqf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6827/388324528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":388324528},{"type":"v1","addr":"172.21.15.99:6827","nonce":388324528}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24283,"name":"cephfs.smithi117.bheqzh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.117:6827/4072877365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":4072877365},{"type":"v1","addr":"172.21.15.117:6827","nonce":4072877365}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":34374,"name":"cephfs.smithi099.xehbxe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6829/1319728944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1319728944},{"type":"v1","addr":"172.21.15.99:6829","nonce":1319728944}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":44283,"name":"cephfs.smithi117.nooexo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6825/3050129703","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3050129703},{"type":"v1","addr":"172.21.15.117:6825","nonce":3050129703}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":20,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:40.838146+0000","modified":"2024-09-19T06:47:50.076553+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":77,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T07:06:03.859 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 21 2024-09-19T07:06:03.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:03.859+0000 7fe2a2639640 1 -- 172.21.15.99:0/336697949 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe28406e530 msgr2=0x7fe2840709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:03.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:03.859+0000 7fe2a2639640 1 --2- 172.21.15.99:0/336697949 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe28406e530 0x7fe2840709e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe28c003080 tx=0x7fe28c035040 comp rx=0 tx=0).stop 2024-09-19T07:06:03.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:03.859+0000 7fe2a2639640 1 -- 172.21.15.99:0/336697949 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe29c0fe450 msgr2=0x7fe29c1158c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:03.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:03.859+0000 7fe2a2639640 1 --2- 172.21.15.99:0/336697949 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe29c0fe450 0x7fe29c1158c0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fe29000eb70 tx=0x7fe29000b040 comp rx=0 tx=0).stop 2024-09-19T07:06:03.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:03.859+0000 7fe2a2639640 1 -- 172.21.15.99:0/336697949 shutdown_connections 2024-09-19T07:06:03.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:03.859+0000 7fe2a2639640 1 --2- 172.21.15.99:0/336697949 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe28406e530 0x7fe2840709e0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:03.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:03.859+0000 7fe2a2639640 1 --2- 172.21.15.99:0/336697949 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe29c0fe450 0x7fe29c1158c0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:03.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:03.859+0000 7fe2a2639640 1 --2- 172.21.15.99:0/336697949 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe29c064fe0 0x7fe29c115380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:03.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:03.859+0000 7fe2a2639640 1 -- 172.21.15.99:0/336697949 >> 172.21.15.99:0/336697949 conn(0x7fe29c0723b0 msgr2=0x7fe29c1011f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:03.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:03.859+0000 7fe2a2639640 1 -- 172.21.15.99:0/336697949 shutdown_connections 2024-09-19T07:06:03.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:03.859+0000 7fe2a2639640 1 -- 172.21.15.99:0/336697949 wait complete. 2024-09-19T07:06:04.532 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:06:04 smithi099 ceph-mon[97031]: pgmap v712: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:06:04.532 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:06:04 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/336697949' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-09-19T07:06:04.556 DEBUG:tasks.fs:max_mds not reduced in epoch 21 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-19T07:06:04.557 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 22 2024-09-19T07:06:04.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:06:04 smithi117 ceph-mon[76771]: pgmap v712: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:06:04.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:06:04 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/336697949' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-09-19T07:06:04.810 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T07:06:06.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:06.309+0000 7febcd057640 1 -- 172.21.15.99:0/2132657846 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7febc8102ed0 msgr2=0x7febc80fc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:06.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:06.309+0000 7febcd057640 1 --2- 172.21.15.99:0/2132657846 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7febc8102ed0 0x7febc80fc590 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7febbc0048d0 tx=0x7febbc009da0 comp rx=0 tx=0).stop 2024-09-19T07:06:06.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:06.309+0000 7febcd057640 1 -- 172.21.15.99:0/2132657846 shutdown_connections 2024-09-19T07:06:06.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:06.309+0000 7febcd057640 1 --2- 172.21.15.99:0/2132657846 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7febc8102ed0 0x7febc80fc590 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:06.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:06.309+0000 7febcd057640 1 --2- 172.21.15.99:0/2132657846 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7febc8102530 0x7febc8102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:06.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:06.309+0000 7febcd057640 1 -- 172.21.15.99:0/2132657846 >> 172.21.15.99:0/2132657846 conn(0x7febc80f8110 msgr2=0x7febc80fa520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:06.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:06.310+0000 7febcd057640 1 -- 172.21.15.99:0/2132657846 shutdown_connections 2024-09-19T07:06:06.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:06.310+0000 7febcd057640 1 -- 172.21.15.99:0/2132657846 wait complete. 2024-09-19T07:06:06.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:06.310+0000 7febcd057640 1 Processor -- start 2024-09-19T07:06:06.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:06.310+0000 7febcd057640 1 -- start start 2024-09-19T07:06:06.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:06.310+0000 7febcd057640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7febc8102530 0x7febc8113210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:06.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:06.310+0000 7febcd057640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7febc8102ed0 0x7febc8113750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:06.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:06.310+0000 7febcd057640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc8113d50 con 0x7febc8102530 2024-09-19T07:06:06.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:06.310+0000 7febcd057640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc810d190 con 0x7febc8102ed0 2024-09-19T07:06:06.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:06.311+0000 7febc6d9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7febc8102530 0x7febc8113210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:06.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:06.311+0000 7febc6d9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7febc8102530 0x7febc8113210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52516/0 (socket says 172.21.15.99:52516) 2024-09-19T07:06:06.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:06.311+0000 7febc6d9d640 1 -- 172.21.15.99:0/3418320648 learned_addr learned my addr 172.21.15.99:0/3418320648 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:06:06.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:06.311+0000 7febc659c640 1 --2- 172.21.15.99:0/3418320648 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7febc8102ed0 0x7febc8113750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:06.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:06.311+0000 7febc6d9d640 1 -- 172.21.15.99:0/3418320648 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7febc8102ed0 msgr2=0x7febc8113750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:06.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:06.311+0000 7febc6d9d640 1 --2- 172.21.15.99:0/3418320648 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7febc8102ed0 0x7febc8113750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:06.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:06.311+0000 7febc6d9d640 1 -- 172.21.15.99:0/3418320648 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febbc005040 con 0x7febc8102530 2024-09-19T07:06:06.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:06.311+0000 7febc659c640 1 --2- 172.21.15.99:0/3418320648 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7febc8102ed0 0x7febc8113750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T07:06:06.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:06.311+0000 7febc6d9d640 1 --2- 172.21.15.99:0/3418320648 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7febc8102530 0x7febc8113210 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7febb800c790 tx=0x7febb80043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:06.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:06.311+0000 7febaf7fe640 1 -- 172.21.15.99:0/3418320648 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7febb800a820 con 0x7febc8102530 2024-09-19T07:06:06.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:06.311+0000 7febaf7fe640 1 -- 172.21.15.99:0/3418320648 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7febb800ae20 con 0x7febc8102530 2024-09-19T07:06:06.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:06.311+0000 7febcd057640 1 -- 172.21.15.99:0/3418320648 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febc810d470 con 0x7febc8102530 2024-09-19T07:06:06.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:06.311+0000 7febaf7fe640 1 -- 172.21.15.99:0/3418320648 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7febb80113a0 con 0x7febc8102530 2024-09-19T07:06:06.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:06.311+0000 7febcd057640 1 -- 172.21.15.99:0/3418320648 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febc810d9e0 con 0x7febc8102530 2024-09-19T07:06:06.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:06.312+0000 7febcd057640 1 -- 172.21.15.99:0/3418320648 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febc80fdcb0 con 0x7febc8102530 2024-09-19T07:06:06.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:06.313+0000 7febaf7fe640 1 -- 172.21.15.99:0/3418320648 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7febb8012400 con 0x7febc8102530 2024-09-19T07:06:06.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:06.313+0000 7febaf7fe640 1 --2- 172.21.15.99:0/3418320648 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7febb006e530 0x7febb00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:06.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:06.313+0000 7febaf7fe640 1 -- 172.21.15.99:0/3418320648 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7febb808e320 con 0x7febc8102530 2024-09-19T07:06:06.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:06.313+0000 7febc659c640 1 --2- 172.21.15.99:0/3418320648 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7febb006e530 0x7febb00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:06.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:06.314+0000 7febc659c640 1 --2- 172.21.15.99:0/3418320648 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7febb006e530 0x7febb00709e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7febbc000c00 tx=0x7febbc035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:06.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:06.317+0000 7febaf7fe640 1 -- 172.21.15.99:0/3418320648 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7febb8057490 con 0x7febc8102530 2024-09-19T07:06:06.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:06:06 smithi099 ceph-mon[97031]: pgmap v713: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:06:06.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:06.519+0000 7febcd057640 1 -- 172.21.15.99:0/3418320648 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) v1 -- 0x7febc804b720 con 0x7febc8102530 2024-09-19T07:06:06.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:06.520+0000 7febaf7fe640 1 -- 172.21.15.99:0/3418320648 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v35) v1 ==== 107+0+4120 (secure 0 0 0) 0x7febb800a980 con 0x7febc8102530 2024-09-19T07:06:06.521 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T07:06:06.521 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":22,"btime":"2024-09-19T06:47:53:931986+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24283,"name":"cephfs.smithi117.bheqzh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.117:6827/4072877365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":4072877365},{"type":"v1","addr":"172.21.15.117:6827","nonce":4072877365}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":34374,"name":"cephfs.smithi099.xehbxe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6829/1319728944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1319728944},{"type":"v1","addr":"172.21.15.99:6829","nonce":1319728944}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":44283,"name":"cephfs.smithi117.nooexo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6825/3050129703","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3050129703},{"type":"v1","addr":"172.21.15.117:6825","nonce":3050129703}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":20,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:40.838146+0000","modified":"2024-09-19T06:47:50.076553+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":77,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T07:06:06.521 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 22 2024-09-19T07:06:06.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:06.522+0000 7febcd057640 1 -- 172.21.15.99:0/3418320648 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7febb006e530 msgr2=0x7febb00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:06.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:06.522+0000 7febcd057640 1 --2- 172.21.15.99:0/3418320648 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7febb006e530 0x7febb00709e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7febbc000c00 tx=0x7febbc035040 comp rx=0 tx=0).stop 2024-09-19T07:06:06.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:06.522+0000 7febcd057640 1 -- 172.21.15.99:0/3418320648 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7febc8102530 msgr2=0x7febc8113210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:06.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:06.522+0000 7febcd057640 1 --2- 172.21.15.99:0/3418320648 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7febc8102530 0x7febc8113210 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7febb800c790 tx=0x7febb80043c0 comp rx=0 tx=0).stop 2024-09-19T07:06:06.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:06.522+0000 7febcd057640 1 -- 172.21.15.99:0/3418320648 shutdown_connections 2024-09-19T07:06:06.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:06.522+0000 7febcd057640 1 --2- 172.21.15.99:0/3418320648 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7febb006e530 0x7febb00709e0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:06.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:06.522+0000 7febcd057640 1 --2- 172.21.15.99:0/3418320648 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7febc8102ed0 0x7febc8113750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:06.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:06.522+0000 7febcd057640 1 --2- 172.21.15.99:0/3418320648 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7febc8102530 0x7febc8113210 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:06.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:06.522+0000 7febcd057640 1 -- 172.21.15.99:0/3418320648 >> 172.21.15.99:0/3418320648 conn(0x7febc80f8110 msgr2=0x7febc80f91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:06.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:06.522+0000 7febcd057640 1 -- 172.21.15.99:0/3418320648 shutdown_connections 2024-09-19T07:06:06.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:06.522+0000 7febcd057640 1 -- 172.21.15.99:0/3418320648 wait complete. 2024-09-19T07:06:06.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:06:06 smithi117 ceph-mon[76771]: pgmap v713: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:06:07.120 DEBUG:tasks.fs:max_mds not reduced in epoch 22 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-19T07:06:07.120 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 23 2024-09-19T07:06:07.369 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T07:06:07.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:06:07 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/3418320648' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-09-19T07:06:07.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:06:07 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:06:07.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:06:07 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/3418320648' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-09-19T07:06:07.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:06:07 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:06:08.493 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:06:08 smithi099 ceph-mon[97031]: pgmap v714: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:06:08.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:06:08 smithi117 ceph-mon[76771]: pgmap v714: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:06:08.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:08.947+0000 7f64d1114640 1 -- 172.21.15.99:0/716272140 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f64cc102550 msgr2=0x7f64cc102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:08.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:08.947+0000 7f64d1114640 1 --2- 172.21.15.99:0/716272140 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f64cc102550 0x7f64cc102920 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f64bc0048d0 tx=0x7f64bc009da0 comp rx=0 tx=0).stop 2024-09-19T07:06:08.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:08.947+0000 7f64d1114640 1 -- 172.21.15.99:0/716272140 shutdown_connections 2024-09-19T07:06:08.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:08.947+0000 7f64d1114640 1 --2- 172.21.15.99:0/716272140 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64cc102ef0 0x7f64cc0fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:08.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:08.947+0000 7f64d1114640 1 --2- 172.21.15.99:0/716272140 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f64cc102550 0x7f64cc102920 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:08.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:08.947+0000 7f64d1114640 1 -- 172.21.15.99:0/716272140 >> 172.21.15.99:0/716272140 conn(0x7f64cc0f80f0 msgr2=0x7f64cc0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:08.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:08.947+0000 7f64d1114640 1 -- 172.21.15.99:0/716272140 shutdown_connections 2024-09-19T07:06:08.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:08.947+0000 7f64d1114640 1 -- 172.21.15.99:0/716272140 wait complete. 2024-09-19T07:06:08.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:08.948+0000 7f64d1114640 1 Processor -- start 2024-09-19T07:06:08.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:08.948+0000 7f64d1114640 1 -- start start 2024-09-19T07:06:08.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:08.948+0000 7f64d1114640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64cc102550 0x7f64cc113540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:08.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:08.948+0000 7f64d1114640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f64cc102ef0 0x7f64cc113a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:08.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:08.948+0000 7f64d1114640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64cc1140d0 con 0x7f64cc102ef0 2024-09-19T07:06:08.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:08.948+0000 7f64d1114640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64cc10d4e0 con 0x7f64cc102550 2024-09-19T07:06:08.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:08.948+0000 7f64ca59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f64cc102ef0 0x7f64cc113a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:08.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:08.948+0000 7f64ca59c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f64cc102ef0 0x7f64cc113a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52538/0 (socket says 172.21.15.99:52538) 2024-09-19T07:06:08.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:08.948+0000 7f64ca59c640 1 -- 172.21.15.99:0/1286914635 learned_addr learned my addr 172.21.15.99:0/1286914635 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:06:08.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:08.948+0000 7f64cad9d640 1 --2- 172.21.15.99:0/1286914635 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64cc102550 0x7f64cc113540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:08.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:08.948+0000 7f64ca59c640 1 -- 172.21.15.99:0/1286914635 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64cc102550 msgr2=0x7f64cc113540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:08.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:08.948+0000 7f64ca59c640 1 --2- 172.21.15.99:0/1286914635 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64cc102550 0x7f64cc113540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:08.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:08.948+0000 7f64ca59c640 1 -- 172.21.15.99:0/1286914635 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64bc005040 con 0x7f64cc102ef0 2024-09-19T07:06:08.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:08.948+0000 7f64cad9d640 1 --2- 172.21.15.99:0/1286914635 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64cc102550 0x7f64cc113540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:06:08.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:08.949+0000 7f64ca59c640 1 --2- 172.21.15.99:0/1286914635 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f64cc102ef0 0x7f64cc113a80 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f64c000c790 tx=0x7f64c00043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:08.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:08.949+0000 7f64b37fe640 1 -- 172.21.15.99:0/1286914635 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64c000a820 con 0x7f64cc102ef0 2024-09-19T07:06:08.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:08.949+0000 7f64b37fe640 1 -- 172.21.15.99:0/1286914635 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f64c000ae20 con 0x7f64cc102ef0 2024-09-19T07:06:08.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:08.949+0000 7f64b37fe640 1 -- 172.21.15.99:0/1286914635 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64c0011380 con 0x7f64cc102ef0 2024-09-19T07:06:08.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:08.949+0000 7f64d1114640 1 -- 172.21.15.99:0/1286914635 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64cc10d7c0 con 0x7f64cc102ef0 2024-09-19T07:06:08.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:08.949+0000 7f64d1114640 1 -- 172.21.15.99:0/1286914635 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64cc10dd60 con 0x7f64cc102ef0 2024-09-19T07:06:08.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:08.950+0000 7f64d1114640 1 -- 172.21.15.99:0/1286914635 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64cc0fdcd0 con 0x7f64cc102ef0 2024-09-19T07:06:08.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:08.950+0000 7f64b37fe640 1 -- 172.21.15.99:0/1286914635 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f64c0012420 con 0x7f64cc102ef0 2024-09-19T07:06:08.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:08.950+0000 7f64b37fe640 1 --2- 172.21.15.99:0/1286914635 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f64b406e530 0x7f64b40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:08.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:08.951+0000 7f64b37fe640 1 -- 172.21.15.99:0/1286914635 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f64c008e640 con 0x7f64cc102ef0 2024-09-19T07:06:08.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:08.951+0000 7f64cad9d640 1 --2- 172.21.15.99:0/1286914635 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f64b406e530 0x7f64b40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:08.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:08.951+0000 7f64cad9d640 1 --2- 172.21.15.99:0/1286914635 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f64b406e530 0x7f64b40709e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f64bc00b020 tx=0x7f64bc009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:08.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:08.955+0000 7f64b37fe640 1 -- 172.21.15.99:0/1286914635 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f64c00577b0 con 0x7f64cc102ef0 2024-09-19T07:06:09.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:09.156+0000 7f64d1114640 1 -- 172.21.15.99:0/1286914635 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) v1 -- 0x7f64cc0fbd50 con 0x7f64cc102ef0 2024-09-19T07:06:09.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:09.156+0000 7f64b37fe640 1 -- 172.21.15.99:0/1286914635 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v35) v1 ==== 107+0+4967 (secure 0 0 0) 0x7f64c005ae70 con 0x7f64cc102ef0 2024-09-19T07:06:09.157 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T07:06:09.158 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":23,"btime":"2024-09-19T06:47:58:991157+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24283,"name":"cephfs.smithi117.bheqzh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.117:6827/4072877365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":4072877365},{"type":"v1","addr":"172.21.15.117:6827","nonce":4072877365}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":34374,"name":"cephfs.smithi099.xehbxe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6829/1319728944","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1319728944},{"type":"v1","addr":"172.21.15.99:6829","nonce":1319728944}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":34378,"name":"cephfs.smithi099.obarqf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6827/1859154203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1859154203},{"type":"v1","addr":"172.21.15.99:6827","nonce":1859154203}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":44283,"name":"cephfs.smithi117.nooexo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6825/3050129703","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3050129703},{"type":"v1","addr":"172.21.15.117:6825","nonce":3050129703}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":20,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:40.838146+0000","modified":"2024-09-19T06:47:50.076553+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":77,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T07:06:09.158 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 23 2024-09-19T07:06:09.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:09.158+0000 7f64d1114640 1 -- 172.21.15.99:0/1286914635 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f64b406e530 msgr2=0x7f64b40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:09.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:09.158+0000 7f64d1114640 1 --2- 172.21.15.99:0/1286914635 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f64b406e530 0x7f64b40709e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f64bc00b020 tx=0x7f64bc009da0 comp rx=0 tx=0).stop 2024-09-19T07:06:09.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:09.158+0000 7f64d1114640 1 -- 172.21.15.99:0/1286914635 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f64cc102ef0 msgr2=0x7f64cc113a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:09.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:09.158+0000 7f64d1114640 1 --2- 172.21.15.99:0/1286914635 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f64cc102ef0 0x7f64cc113a80 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f64c000c790 tx=0x7f64c00043c0 comp rx=0 tx=0).stop 2024-09-19T07:06:09.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:09.158+0000 7f64d1114640 1 -- 172.21.15.99:0/1286914635 shutdown_connections 2024-09-19T07:06:09.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:09.158+0000 7f64d1114640 1 --2- 172.21.15.99:0/1286914635 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f64b406e530 0x7f64b40709e0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:09.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:09.158+0000 7f64d1114640 1 --2- 172.21.15.99:0/1286914635 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f64cc102ef0 0x7f64cc113a80 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:09.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:09.158+0000 7f64d1114640 1 --2- 172.21.15.99:0/1286914635 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64cc102550 0x7f64cc113540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:09.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:09.158+0000 7f64d1114640 1 -- 172.21.15.99:0/1286914635 >> 172.21.15.99:0/1286914635 conn(0x7f64cc0f80f0 msgr2=0x7f64cc0f9160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:09.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:09.158+0000 7f64d1114640 1 -- 172.21.15.99:0/1286914635 shutdown_connections 2024-09-19T07:06:09.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:09.158+0000 7f64d1114640 1 -- 172.21.15.99:0/1286914635 wait complete. 2024-09-19T07:06:09.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:06:09 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/1286914635' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-09-19T07:06:09.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:06:09 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/1286914635' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-09-19T07:06:09.783 DEBUG:tasks.fs:max_mds not reduced in epoch 23 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-19T07:06:09.783 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 24 2024-09-19T07:06:10.029 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T07:06:10.428 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:06:10 smithi099 ceph-mon[97031]: pgmap v715: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:06:10.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:06:10 smithi117 ceph-mon[76771]: pgmap v715: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:06:11.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:11.637+0000 7fe608a6e640 1 -- 172.21.15.99:0/1777683185 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe6040658f0 msgr2=0x7fe604108b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:11.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:11.637+0000 7fe608a6e640 1 --2- 172.21.15.99:0/1777683185 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe6040658f0 0x7fe604108b00 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec0048d0 tx=0x7fe5ec009da0 comp rx=0 tx=0).stop 2024-09-19T07:06:11.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:11.637+0000 7fe608a6e640 1 -- 172.21.15.99:0/1777683185 shutdown_connections 2024-09-19T07:06:11.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:11.637+0000 7fe608a6e640 1 --2- 172.21.15.99:0/1777683185 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe6040658f0 0x7fe604108b00 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:11.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:11.637+0000 7fe608a6e640 1 --2- 172.21.15.99:0/1777683185 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe604064fe0 0x7fe6040653b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:11.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:11.637+0000 7fe608a6e640 1 -- 172.21.15.99:0/1777683185 >> 172.21.15.99:0/1777683185 conn(0x7fe6040723b0 msgr2=0x7fe6040727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:11.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:11.637+0000 7fe608a6e640 1 -- 172.21.15.99:0/1777683185 shutdown_connections 2024-09-19T07:06:11.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:11.637+0000 7fe608a6e640 1 -- 172.21.15.99:0/1777683185 wait complete. 2024-09-19T07:06:11.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:11.638+0000 7fe608a6e640 1 Processor -- start 2024-09-19T07:06:11.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:11.638+0000 7fe608a6e640 1 -- start start 2024-09-19T07:06:11.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:11.638+0000 7fe608a6e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe604064fe0 0x7fe604115430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:11.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:11.638+0000 7fe608a6e640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe6040658f0 0x7fe604115970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:11.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:11.638+0000 7fe608a6e640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe604115f70 con 0x7fe6040658f0 2024-09-19T07:06:11.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:11.638+0000 7fe608a6e640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6041160e0 con 0x7fe604064fe0 2024-09-19T07:06:11.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:11.638+0000 7fe601d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe6040658f0 0x7fe604115970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:11.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:11.638+0000 7fe601d9b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe6040658f0 0x7fe604115970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52550/0 (socket says 172.21.15.99:52550) 2024-09-19T07:06:11.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:11.638+0000 7fe601d9b640 1 -- 172.21.15.99:0/2542928481 learned_addr learned my addr 172.21.15.99:0/2542928481 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:06:11.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:11.638+0000 7fe60259c640 1 --2- 172.21.15.99:0/2542928481 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe604064fe0 0x7fe604115430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:11.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:11.638+0000 7fe601d9b640 1 -- 172.21.15.99:0/2542928481 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe604064fe0 msgr2=0x7fe604115430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:11.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:11.638+0000 7fe601d9b640 1 --2- 172.21.15.99:0/2542928481 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe604064fe0 0x7fe604115430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:11.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:11.638+0000 7fe601d9b640 1 -- 172.21.15.99:0/2542928481 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5ec005040 con 0x7fe6040658f0 2024-09-19T07:06:11.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:11.638+0000 7fe60259c640 1 --2- 172.21.15.99:0/2542928481 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe604064fe0 0x7fe604115430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:06:11.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:11.638+0000 7fe601d9b640 1 --2- 172.21.15.99:0/2542928481 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe6040658f0 0x7fe604115970 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec0043d0 tx=0x7fe5ec009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:11.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:11.639+0000 7fe5faffd640 1 -- 172.21.15.99:0/2542928481 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5ec038070 con 0x7fe6040658f0 2024-09-19T07:06:11.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:11.639+0000 7fe5faffd640 1 -- 172.21.15.99:0/2542928481 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe5ec0096e0 con 0x7fe6040658f0 2024-09-19T07:06:11.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:11.639+0000 7fe608a6e640 1 -- 172.21.15.99:0/2542928481 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe60410f550 con 0x7fe6040658f0 2024-09-19T07:06:11.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:11.639+0000 7fe5faffd640 1 -- 172.21.15.99:0/2542928481 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5ec02c830 con 0x7fe6040658f0 2024-09-19T07:06:11.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:11.639+0000 7fe608a6e640 1 -- 172.21.15.99:0/2542928481 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe60410fa10 con 0x7fe6040658f0 2024-09-19T07:06:11.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:11.640+0000 7fe608a6e640 1 -- 172.21.15.99:0/2542928481 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6040fbad0 con 0x7fe6040658f0 2024-09-19T07:06:11.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:11.640+0000 7fe5faffd640 1 -- 172.21.15.99:0/2542928481 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fe5ec030020 con 0x7fe6040658f0 2024-09-19T07:06:11.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:11.641+0000 7fe5faffd640 1 --2- 172.21.15.99:0/2542928481 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe5f006e530 0x7fe5f00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:11.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:11.641+0000 7fe5faffd640 1 -- 172.21.15.99:0/2542928481 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fe5ec0ade60 con 0x7fe6040658f0 2024-09-19T07:06:11.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:11.641+0000 7fe60259c640 1 --2- 172.21.15.99:0/2542928481 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe5f006e530 0x7fe5f00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:11.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:11.641+0000 7fe60259c640 1 --2- 172.21.15.99:0/2542928481 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe5f006e530 0x7fe5f00709e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe5f4007ee0 tx=0x7fe5f400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:11.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:11.645+0000 7fe5faffd640 1 -- 172.21.15.99:0/2542928481 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fe5ec076fd0 con 0x7fe6040658f0 2024-09-19T07:06:11.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:11.849+0000 7fe608a6e640 1 -- 172.21.15.99:0/2542928481 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) v1 -- 0x7fe60404b720 con 0x7fe6040658f0 2024-09-19T07:06:11.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:11.849+0000 7fe5faffd640 1 -- 172.21.15.99:0/2542928481 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v35) v1 ==== 107+0+4188 (secure 0 0 0) 0x7fe5ec07a690 con 0x7fe6040658f0 2024-09-19T07:06:11.850 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T07:06:11.851 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":24,"btime":"2024-09-19T06:48:10:851648+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24283,"name":"cephfs.smithi117.bheqzh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.117:6827/4072877365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":4072877365},{"type":"v1","addr":"172.21.15.117:6827","nonce":4072877365}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":34378,"name":"cephfs.smithi099.obarqf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6827/1859154203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1859154203},{"type":"v1","addr":"172.21.15.99:6827","nonce":1859154203}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":44283,"name":"cephfs.smithi117.nooexo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6825/3050129703","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3050129703},{"type":"v1","addr":"172.21.15.117:6825","nonce":3050129703}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":20,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:40.838146+0000","modified":"2024-09-19T06:47:50.076553+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":77,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T07:06:11.851 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 24 2024-09-19T07:06:11.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:11.853+0000 7fe608a6e640 1 -- 172.21.15.99:0/2542928481 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe5f006e530 msgr2=0x7fe5f00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:11.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:11.853+0000 7fe608a6e640 1 --2- 172.21.15.99:0/2542928481 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe5f006e530 0x7fe5f00709e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe5f4007ee0 tx=0x7fe5f400b040 comp rx=0 tx=0).stop 2024-09-19T07:06:11.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:11.853+0000 7fe608a6e640 1 -- 172.21.15.99:0/2542928481 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe6040658f0 msgr2=0x7fe604115970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:11.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:11.853+0000 7fe608a6e640 1 --2- 172.21.15.99:0/2542928481 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe6040658f0 0x7fe604115970 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec0043d0 tx=0x7fe5ec009da0 comp rx=0 tx=0).stop 2024-09-19T07:06:11.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:11.853+0000 7fe608a6e640 1 -- 172.21.15.99:0/2542928481 shutdown_connections 2024-09-19T07:06:11.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:11.853+0000 7fe608a6e640 1 --2- 172.21.15.99:0/2542928481 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fe5f006e530 0x7fe5f00709e0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:11.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:11.853+0000 7fe608a6e640 1 --2- 172.21.15.99:0/2542928481 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe6040658f0 0x7fe604115970 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:11.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:11.853+0000 7fe608a6e640 1 --2- 172.21.15.99:0/2542928481 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe604064fe0 0x7fe604115430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:11.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:11.853+0000 7fe608a6e640 1 -- 172.21.15.99:0/2542928481 >> 172.21.15.99:0/2542928481 conn(0x7fe6040723b0 msgr2=0x7fe604103ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:11.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:11.853+0000 7fe608a6e640 1 -- 172.21.15.99:0/2542928481 shutdown_connections 2024-09-19T07:06:11.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:11.853+0000 7fe608a6e640 1 -- 172.21.15.99:0/2542928481 wait complete. 2024-09-19T07:06:12.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:06:12 smithi099 ceph-mon[97031]: pgmap v716: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:06:12.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:06:12 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/2542928481' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-09-19T07:06:12.497 DEBUG:tasks.fs:max_mds not reduced in epoch 24 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-19T07:06:12.497 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 25 2024-09-19T07:06:12.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:06:12 smithi117 ceph-mon[76771]: pgmap v716: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:06:12.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:06:12 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/2542928481' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-09-19T07:06:12.741 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T07:06:14.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:14.316+0000 7f62668ae640 1 -- 172.21.15.99:0/3740696922 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62600fb480 msgr2=0x7f62600fb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:14.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:14.316+0000 7f62668ae640 1 --2- 172.21.15.99:0/3740696922 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62600fb480 0x7f62600fb8f0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f62540048d0 tx=0x7f6254009da0 comp rx=0 tx=0).stop 2024-09-19T07:06:14.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:14.316+0000 7f62668ae640 1 -- 172.21.15.99:0/3740696922 shutdown_connections 2024-09-19T07:06:14.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:14.316+0000 7f62668ae640 1 --2- 172.21.15.99:0/3740696922 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62600fb480 0x7f62600fb8f0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:14.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:14.316+0000 7f62668ae640 1 --2- 172.21.15.99:0/3740696922 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62601014c0 0x7f6260101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:14.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:14.316+0000 7f62668ae640 1 -- 172.21.15.99:0/3740696922 >> 172.21.15.99:0/3740696922 conn(0x7f62600f7000 msgr2=0x7f62600f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:14.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:14.316+0000 7f62668ae640 1 -- 172.21.15.99:0/3740696922 shutdown_connections 2024-09-19T07:06:14.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:14.316+0000 7f62668ae640 1 -- 172.21.15.99:0/3740696922 wait complete. 2024-09-19T07:06:14.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:14.316+0000 7f62668ae640 1 Processor -- start 2024-09-19T07:06:14.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:14.316+0000 7f62668ae640 1 -- start start 2024-09-19T07:06:14.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:14.317+0000 7f62668ae640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62600fb480 0x7f62601120f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:14.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:14.317+0000 7f62668ae640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62601014c0 0x7f6260112630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:14.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:14.317+0000 7f62668ae640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6260112c30 con 0x7f62600fb480 2024-09-19T07:06:14.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:14.317+0000 7f62668ae640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f626010c070 con 0x7f62601014c0 2024-09-19T07:06:14.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:14.317+0000 7f625ffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62600fb480 0x7f62601120f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:14.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:14.317+0000 7f625ffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62600fb480 0x7f62601120f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52564/0 (socket says 172.21.15.99:52564) 2024-09-19T07:06:14.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:14.317+0000 7f625ffff640 1 -- 172.21.15.99:0/3538407196 learned_addr learned my addr 172.21.15.99:0/3538407196 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:06:14.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:14.317+0000 7f625f7fe640 1 --2- 172.21.15.99:0/3538407196 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62601014c0 0x7f6260112630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:14.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:14.317+0000 7f625ffff640 1 -- 172.21.15.99:0/3538407196 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62601014c0 msgr2=0x7f6260112630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:14.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:14.317+0000 7f625ffff640 1 --2- 172.21.15.99:0/3538407196 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62601014c0 0x7f6260112630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:14.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:14.317+0000 7f625ffff640 1 -- 172.21.15.99:0/3538407196 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6254005040 con 0x7f62600fb480 2024-09-19T07:06:14.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:14.317+0000 7f625ffff640 1 --2- 172.21.15.99:0/3538407196 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62600fb480 0x7f62601120f0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f625000c790 tx=0x7f62500043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:14.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:14.317+0000 7f625cff9640 1 -- 172.21.15.99:0/3538407196 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f625000a820 con 0x7f62600fb480 2024-09-19T07:06:14.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:14.317+0000 7f62668ae640 1 -- 172.21.15.99:0/3538407196 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f626010c350 con 0x7f62600fb480 2024-09-19T07:06:14.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:14.317+0000 7f625cff9640 1 -- 172.21.15.99:0/3538407196 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f625000ae20 con 0x7f62600fb480 2024-09-19T07:06:14.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:14.317+0000 7f625cff9640 1 -- 172.21.15.99:0/3538407196 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62500113a0 con 0x7f62600fb480 2024-09-19T07:06:14.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:14.317+0000 7f62668ae640 1 -- 172.21.15.99:0/3538407196 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f626010c8c0 con 0x7f62600fb480 2024-09-19T07:06:14.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:14.318+0000 7f62668ae640 1 -- 172.21.15.99:0/3538407196 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62600fcbc0 con 0x7f62600fb480 2024-09-19T07:06:14.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:14.319+0000 7f625cff9640 1 -- 172.21.15.99:0/3538407196 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f6250012400 con 0x7f62600fb480 2024-09-19T07:06:14.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:14.319+0000 7f625cff9640 1 --2- 172.21.15.99:0/3538407196 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f624806e530 0x7f62480709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:14.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:14.320+0000 7f625cff9640 1 -- 172.21.15.99:0/3538407196 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f625008e320 con 0x7f62600fb480 2024-09-19T07:06:14.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:14.320+0000 7f625f7fe640 1 --2- 172.21.15.99:0/3538407196 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f624806e530 0x7f62480709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:14.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:14.320+0000 7f625f7fe640 1 --2- 172.21.15.99:0/3538407196 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f624806e530 0x7f62480709e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f62600f7440 tx=0x7f6254035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:14.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:14.324+0000 7f625cff9640 1 -- 172.21.15.99:0/3538407196 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f6250057490 con 0x7f62600fb480 2024-09-19T07:06:14.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:06:14 smithi099 ceph-mon[97031]: pgmap v717: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:06:14.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:14.526+0000 7f62668ae640 1 -- 172.21.15.99:0/3538407196 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) v1 -- 0x7f626004b720 con 0x7f62600fb480 2024-09-19T07:06:14.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:14.526+0000 7f625cff9640 1 -- 172.21.15.99:0/3538407196 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v35) v1 ==== 107+0+5035 (secure 0 0 0) 0x7f625000a980 con 0x7f62600fb480 2024-09-19T07:06:14.527 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T07:06:14.528 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":25,"btime":"2024-09-19T06:48:15:936688+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24283,"name":"cephfs.smithi117.bheqzh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.117:6827/4072877365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":4072877365},{"type":"v1","addr":"172.21.15.117:6827","nonce":4072877365}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":34378,"name":"cephfs.smithi099.obarqf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6827/1859154203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1859154203},{"type":"v1","addr":"172.21.15.99:6827","nonce":1859154203}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":34410,"name":"cephfs.smithi099.xehbxe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6829/1939453719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1939453719},{"type":"v1","addr":"172.21.15.99:6829","nonce":1939453719}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44283,"name":"cephfs.smithi117.nooexo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6825/3050129703","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3050129703},{"type":"v1","addr":"172.21.15.117:6825","nonce":3050129703}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":20,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:40.838146+0000","modified":"2024-09-19T06:47:50.076553+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":77,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T07:06:14.528 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 25 2024-09-19T07:06:14.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:14.528+0000 7f62668ae640 1 -- 172.21.15.99:0/3538407196 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f624806e530 msgr2=0x7f62480709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:14.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:14.528+0000 7f62668ae640 1 --2- 172.21.15.99:0/3538407196 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f624806e530 0x7f62480709e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f62600f7440 tx=0x7f6254035040 comp rx=0 tx=0).stop 2024-09-19T07:06:14.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:14.528+0000 7f62668ae640 1 -- 172.21.15.99:0/3538407196 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62600fb480 msgr2=0x7f62601120f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:14.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:14.528+0000 7f62668ae640 1 --2- 172.21.15.99:0/3538407196 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62600fb480 0x7f62601120f0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f625000c790 tx=0x7f62500043c0 comp rx=0 tx=0).stop 2024-09-19T07:06:14.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:14.528+0000 7f62668ae640 1 -- 172.21.15.99:0/3538407196 shutdown_connections 2024-09-19T07:06:14.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:14.528+0000 7f62668ae640 1 --2- 172.21.15.99:0/3538407196 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f624806e530 0x7f62480709e0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:14.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:14.528+0000 7f62668ae640 1 --2- 172.21.15.99:0/3538407196 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62601014c0 0x7f6260112630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:14.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:14.528+0000 7f62668ae640 1 --2- 172.21.15.99:0/3538407196 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62600fb480 0x7f62601120f0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:14.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:14.528+0000 7f62668ae640 1 -- 172.21.15.99:0/3538407196 >> 172.21.15.99:0/3538407196 conn(0x7f62600f7000 msgr2=0x7f62600f8900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:14.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:14.529+0000 7f62668ae640 1 -- 172.21.15.99:0/3538407196 shutdown_connections 2024-09-19T07:06:14.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:14.529+0000 7f62668ae640 1 -- 172.21.15.99:0/3538407196 wait complete. 2024-09-19T07:06:14.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:06:14 smithi117 ceph-mon[76771]: pgmap v717: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:06:15.101 DEBUG:tasks.fs:max_mds not reduced in epoch 25 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-19T07:06:15.102 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 26 2024-09-19T07:06:15.348 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T07:06:15.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:06:15 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/3538407196' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-09-19T07:06:15.577 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:06:15 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/3538407196' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-09-19T07:06:16.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:16.871+0000 7f991d5ac640 1 -- 172.21.15.99:0/2290254149 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9918102560 msgr2=0x7f9918102930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:16.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:16.871+0000 7f991d5ac640 1 --2- 172.21.15.99:0/2290254149 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9918102560 0x7f9918102930 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f99080048d0 tx=0x7f9908009da0 comp rx=0 tx=0).stop 2024-09-19T07:06:16.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:16.871+0000 7f991d5ac640 1 -- 172.21.15.99:0/2290254149 shutdown_connections 2024-09-19T07:06:16.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:16.871+0000 7f991d5ac640 1 --2- 172.21.15.99:0/2290254149 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9918102f00 0x7f99180fc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:16.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:16.871+0000 7f991d5ac640 1 --2- 172.21.15.99:0/2290254149 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9918102560 0x7f9918102930 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:16.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:16.871+0000 7f991d5ac640 1 -- 172.21.15.99:0/2290254149 >> 172.21.15.99:0/2290254149 conn(0x7f99180f8120 msgr2=0x7f99180fa530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:16.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:16.871+0000 7f991d5ac640 1 -- 172.21.15.99:0/2290254149 shutdown_connections 2024-09-19T07:06:16.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:16.871+0000 7f991d5ac640 1 -- 172.21.15.99:0/2290254149 wait complete. 2024-09-19T07:06:16.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:16.872+0000 7f991d5ac640 1 Processor -- start 2024-09-19T07:06:16.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:16.872+0000 7f991d5ac640 1 -- start start 2024-09-19T07:06:16.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:16.872+0000 7f991d5ac640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9918102560 0x7f9918113230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:16.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:16.872+0000 7f991d5ac640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9918102f00 0x7f9918113770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:16.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:16.872+0000 7f991d5ac640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9918113d70 con 0x7f9918102560 2024-09-19T07:06:16.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:16.872+0000 7f991d5ac640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f991810d1b0 con 0x7f9918102f00 2024-09-19T07:06:16.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:16.872+0000 7f9916ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9918102560 0x7f9918113230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:16.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:16.872+0000 7f9916ffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9918102560 0x7f9918113230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:58572/0 (socket says 172.21.15.99:58572) 2024-09-19T07:06:16.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:16.872+0000 7f9916ffd640 1 -- 172.21.15.99:0/1303127894 learned_addr learned my addr 172.21.15.99:0/1303127894 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:06:16.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:16.872+0000 7f99167fc640 1 --2- 172.21.15.99:0/1303127894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9918102f00 0x7f9918113770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:16.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:16.872+0000 7f9916ffd640 1 -- 172.21.15.99:0/1303127894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9918102f00 msgr2=0x7f9918113770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:16.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:16.872+0000 7f9916ffd640 1 --2- 172.21.15.99:0/1303127894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9918102f00 0x7f9918113770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:16.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:16.872+0000 7f9916ffd640 1 -- 172.21.15.99:0/1303127894 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9908005040 con 0x7f9918102560 2024-09-19T07:06:16.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:16.872+0000 7f9916ffd640 1 --2- 172.21.15.99:0/1303127894 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9918102560 0x7f9918113230 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f9908003080 tx=0x7f9908009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:16.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:16.872+0000 7f98ff7fe640 1 -- 172.21.15.99:0/1303127894 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9908038070 con 0x7f9918102560 2024-09-19T07:06:16.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:16.873+0000 7f98ff7fe640 1 -- 172.21.15.99:0/1303127894 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f99080097e0 con 0x7f9918102560 2024-09-19T07:06:16.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:16.873+0000 7f991d5ac640 1 -- 172.21.15.99:0/1303127894 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f991810d430 con 0x7f9918102560 2024-09-19T07:06:16.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:16.873+0000 7f98ff7fe640 1 -- 172.21.15.99:0/1303127894 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f990803d420 con 0x7f9918102560 2024-09-19T07:06:16.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:16.873+0000 7f991d5ac640 1 -- 172.21.15.99:0/1303127894 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f991810d970 con 0x7f9918102560 2024-09-19T07:06:16.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:16.873+0000 7f991d5ac640 1 -- 172.21.15.99:0/1303127894 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99180fdce0 con 0x7f9918102560 2024-09-19T07:06:16.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:16.874+0000 7f98ff7fe640 1 -- 172.21.15.99:0/1303127894 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f9908030020 con 0x7f9918102560 2024-09-19T07:06:16.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:16.874+0000 7f98ff7fe640 1 --2- 172.21.15.99:0/1303127894 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f990006e530 0x7f99000709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:16.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:16.875+0000 7f98ff7fe640 1 -- 172.21.15.99:0/1303127894 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f99080ae6c0 con 0x7f9918102560 2024-09-19T07:06:16.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:16.875+0000 7f99167fc640 1 --2- 172.21.15.99:0/1303127894 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f990006e530 0x7f99000709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:16.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:16.875+0000 7f99167fc640 1 --2- 172.21.15.99:0/1303127894 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f990006e530 0x7f99000709e0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f991810eaf0 tx=0x7f990c009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:16.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:16.879+0000 7f98ff7fe640 1 -- 172.21.15.99:0/1303127894 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f99080777b0 con 0x7f9918102560 2024-09-19T07:06:16.955 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:06:16 smithi099 ceph-mon[97031]: pgmap v718: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:06:17.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:06:16 smithi117 ceph-mon[76771]: pgmap v718: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:06:17.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:17.083+0000 7f991d5ac640 1 -- 172.21.15.99:0/1303127894 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) v1 -- 0x7f99180fbd60 con 0x7f9918102560 2024-09-19T07:06:17.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:17.083+0000 7f98ff7fe640 1 -- 172.21.15.99:0/1303127894 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v35) v1 ==== 107+0+4253 (secure 0 0 0) 0x7f990807ae70 con 0x7f9918102560 2024-09-19T07:06:17.084 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T07:06:17.084 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":26,"btime":"2024-09-19T06:48:27:558605+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24283,"name":"cephfs.smithi117.bheqzh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.117:6827/4072877365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":4072877365},{"type":"v1","addr":"172.21.15.117:6827","nonce":4072877365}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":34378,"name":"cephfs.smithi099.obarqf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6827/1859154203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1859154203},{"type":"v1","addr":"172.21.15.99:6827","nonce":1859154203}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":34410,"name":"cephfs.smithi099.xehbxe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6829/1939453719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1939453719},{"type":"v1","addr":"172.21.15.99:6829","nonce":1939453719}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":20,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:40.838146+0000","modified":"2024-09-19T06:47:50.076553+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":77,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T07:06:17.085 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 26 2024-09-19T07:06:17.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:17.085+0000 7f991d5ac640 1 -- 172.21.15.99:0/1303127894 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f990006e530 msgr2=0x7f99000709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:17.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:17.085+0000 7f991d5ac640 1 --2- 172.21.15.99:0/1303127894 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f990006e530 0x7f99000709e0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f991810eaf0 tx=0x7f990c009040 comp rx=0 tx=0).stop 2024-09-19T07:06:17.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:17.085+0000 7f991d5ac640 1 -- 172.21.15.99:0/1303127894 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9918102560 msgr2=0x7f9918113230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:17.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:17.085+0000 7f991d5ac640 1 --2- 172.21.15.99:0/1303127894 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9918102560 0x7f9918113230 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f9908003080 tx=0x7f9908009da0 comp rx=0 tx=0).stop 2024-09-19T07:06:17.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:17.085+0000 7f991d5ac640 1 -- 172.21.15.99:0/1303127894 shutdown_connections 2024-09-19T07:06:17.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:17.085+0000 7f991d5ac640 1 --2- 172.21.15.99:0/1303127894 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f990006e530 0x7f99000709e0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:17.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:17.085+0000 7f991d5ac640 1 --2- 172.21.15.99:0/1303127894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9918102f00 0x7f9918113770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:17.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:17.085+0000 7f991d5ac640 1 --2- 172.21.15.99:0/1303127894 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9918102560 0x7f9918113230 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:17.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:17.085+0000 7f991d5ac640 1 -- 172.21.15.99:0/1303127894 >> 172.21.15.99:0/1303127894 conn(0x7f99180f8120 msgr2=0x7f99180f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:17.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:17.086+0000 7f991d5ac640 1 -- 172.21.15.99:0/1303127894 shutdown_connections 2024-09-19T07:06:17.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:17.086+0000 7f991d5ac640 1 -- 172.21.15.99:0/1303127894 wait complete. 2024-09-19T07:06:17.740 DEBUG:tasks.fs:max_mds not reduced in epoch 26 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-19T07:06:17.741 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 27 2024-09-19T07:06:17.986 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T07:06:18.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:06:17 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/1303127894' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-09-19T07:06:18.106 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:06:17 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/1303127894' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-09-19T07:06:19.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:06:18 smithi117 ceph-mon[76771]: pgmap v719: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:06:19.072 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:06:18 smithi099 ceph-mon[97031]: pgmap v719: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:06:19.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:19.550+0000 7f4e2b19a640 1 -- 172.21.15.99:0/2689720789 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e24102ef0 msgr2=0x7f4e240fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:19.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:19.550+0000 7f4e2b19a640 1 --2- 172.21.15.99:0/2689720789 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e24102ef0 0x7f4e240fc5b0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c0048d0 tx=0x7f4e0c009da0 comp rx=0 tx=0).stop 2024-09-19T07:06:19.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:19.550+0000 7f4e2b19a640 1 -- 172.21.15.99:0/2689720789 shutdown_connections 2024-09-19T07:06:19.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:19.550+0000 7f4e2b19a640 1 --2- 172.21.15.99:0/2689720789 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e24102ef0 0x7f4e240fc5b0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:19.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:19.550+0000 7f4e2b19a640 1 --2- 172.21.15.99:0/2689720789 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e24102550 0x7f4e24102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:19.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:19.550+0000 7f4e2b19a640 1 -- 172.21.15.99:0/2689720789 >> 172.21.15.99:0/2689720789 conn(0x7f4e240f80f0 msgr2=0x7f4e240fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:19.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:19.550+0000 7f4e2b19a640 1 -- 172.21.15.99:0/2689720789 shutdown_connections 2024-09-19T07:06:19.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:19.550+0000 7f4e2b19a640 1 -- 172.21.15.99:0/2689720789 wait complete. 2024-09-19T07:06:19.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:19.551+0000 7f4e2b19a640 1 Processor -- start 2024-09-19T07:06:19.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:19.551+0000 7f4e2b19a640 1 -- start start 2024-09-19T07:06:19.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:19.551+0000 7f4e2b19a640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e24102550 0x7f4e24113520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:19.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:19.551+0000 7f4e2b19a640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e24102ef0 0x7f4e24113a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:19.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:19.551+0000 7f4e2b19a640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e241140b0 con 0x7f4e24102ef0 2024-09-19T07:06:19.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:19.551+0000 7f4e2b19a640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2410d4c0 con 0x7f4e24102550 2024-09-19T07:06:19.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:19.552+0000 7f4e23fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e24102ef0 0x7f4e24113a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:19.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:19.552+0000 7f4e23fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e24102ef0 0x7f4e24113a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:58592/0 (socket says 172.21.15.99:58592) 2024-09-19T07:06:19.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:19.552+0000 7f4e23fff640 1 -- 172.21.15.99:0/2882312628 learned_addr learned my addr 172.21.15.99:0/2882312628 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:06:19.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:19.552+0000 7f4e28f36640 1 --2- 172.21.15.99:0/2882312628 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e24102550 0x7f4e24113520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:19.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:19.552+0000 7f4e23fff640 1 -- 172.21.15.99:0/2882312628 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e24102550 msgr2=0x7f4e24113520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:19.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:19.552+0000 7f4e23fff640 1 --2- 172.21.15.99:0/2882312628 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e24102550 0x7f4e24113520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:19.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:19.552+0000 7f4e23fff640 1 -- 172.21.15.99:0/2882312628 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e0c005040 con 0x7f4e24102ef0 2024-09-19T07:06:19.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:19.552+0000 7f4e23fff640 1 --2- 172.21.15.99:0/2882312628 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e24102ef0 0x7f4e24113a60 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c02a530 tx=0x7f4e0c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:19.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:19.552+0000 7f4e217fa640 1 -- 172.21.15.99:0/2882312628 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e0c038070 con 0x7f4e24102ef0 2024-09-19T07:06:19.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:19.552+0000 7f4e217fa640 1 -- 172.21.15.99:0/2882312628 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4e0c02ade0 con 0x7f4e24102ef0 2024-09-19T07:06:19.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:19.552+0000 7f4e2b19a640 1 -- 172.21.15.99:0/2882312628 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e2410d740 con 0x7f4e24102ef0 2024-09-19T07:06:19.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:19.552+0000 7f4e217fa640 1 -- 172.21.15.99:0/2882312628 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e0c02c810 con 0x7f4e24102ef0 2024-09-19T07:06:19.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:19.552+0000 7f4e2b19a640 1 -- 172.21.15.99:0/2882312628 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e2410dc80 con 0x7f4e24102ef0 2024-09-19T07:06:19.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:19.553+0000 7f4e2b19a640 1 -- 172.21.15.99:0/2882312628 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e240fdcd0 con 0x7f4e24102ef0 2024-09-19T07:06:19.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:19.554+0000 7f4e217fa640 1 -- 172.21.15.99:0/2882312628 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f4e0c030020 con 0x7f4e24102ef0 2024-09-19T07:06:19.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:19.554+0000 7f4e217fa640 1 --2- 172.21.15.99:0/2882312628 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f4e1006e530 0x7f4e100709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:19.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:19.554+0000 7f4e217fa640 1 -- 172.21.15.99:0/2882312628 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f4e0c0addd0 con 0x7f4e24102ef0 2024-09-19T07:06:19.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:19.554+0000 7f4e28f36640 1 --2- 172.21.15.99:0/2882312628 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f4e1006e530 0x7f4e100709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:19.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:19.555+0000 7f4e28f36640 1 --2- 172.21.15.99:0/2882312628 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f4e1006e530 0x7f4e100709e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f4e14004ed0 tx=0x7f4e1400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:19.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:19.558+0000 7f4e217fa640 1 -- 172.21.15.99:0/2882312628 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f4e0c076f70 con 0x7f4e24102ef0 2024-09-19T07:06:19.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:19.759+0000 7f4e2b19a640 1 -- 172.21.15.99:0/2882312628 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) v1 -- 0x7f4e240fbd50 con 0x7f4e24102ef0 2024-09-19T07:06:19.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:19.759+0000 7f4e217fa640 1 -- 172.21.15.99:0/2882312628 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v35) v1 ==== 107+0+5103 (secure 0 0 0) 0x7f4e0c07a630 con 0x7f4e24102ef0 2024-09-19T07:06:19.761 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T07:06:19.761 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":27,"btime":"2024-09-19T06:48:31:932161+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24283,"name":"cephfs.smithi117.bheqzh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.117:6827/4072877365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":4072877365},{"type":"v1","addr":"172.21.15.117:6827","nonce":4072877365}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":34378,"name":"cephfs.smithi099.obarqf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6827/1859154203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1859154203},{"type":"v1","addr":"172.21.15.99:6827","nonce":1859154203}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":34410,"name":"cephfs.smithi099.xehbxe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6829/1939453719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1939453719},{"type":"v1","addr":"172.21.15.99:6829","nonce":1939453719}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44309,"name":"cephfs.smithi117.nooexo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6825/1398895079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":1398895079},{"type":"v1","addr":"172.21.15.117:6825","nonce":1398895079}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":20,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:40.838146+0000","modified":"2024-09-19T06:47:50.076553+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":77,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T07:06:19.761 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 27 2024-09-19T07:06:19.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:19.761+0000 7f4e2b19a640 1 -- 172.21.15.99:0/2882312628 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f4e1006e530 msgr2=0x7f4e100709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:19.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:19.761+0000 7f4e2b19a640 1 --2- 172.21.15.99:0/2882312628 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f4e1006e530 0x7f4e100709e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f4e14004ed0 tx=0x7f4e1400b040 comp rx=0 tx=0).stop 2024-09-19T07:06:19.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:19.761+0000 7f4e2b19a640 1 -- 172.21.15.99:0/2882312628 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e24102ef0 msgr2=0x7f4e24113a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:19.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:19.761+0000 7f4e2b19a640 1 --2- 172.21.15.99:0/2882312628 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e24102ef0 0x7f4e24113a60 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c02a530 tx=0x7f4e0c009da0 comp rx=0 tx=0).stop 2024-09-19T07:06:19.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:19.762+0000 7f4e2b19a640 1 -- 172.21.15.99:0/2882312628 shutdown_connections 2024-09-19T07:06:19.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:19.762+0000 7f4e2b19a640 1 --2- 172.21.15.99:0/2882312628 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f4e1006e530 0x7f4e100709e0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:19.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:19.762+0000 7f4e2b19a640 1 --2- 172.21.15.99:0/2882312628 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4e24102ef0 0x7f4e24113a60 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:19.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:19.762+0000 7f4e2b19a640 1 --2- 172.21.15.99:0/2882312628 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e24102550 0x7f4e24113520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:19.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:19.762+0000 7f4e2b19a640 1 -- 172.21.15.99:0/2882312628 >> 172.21.15.99:0/2882312628 conn(0x7f4e240f80f0 msgr2=0x7f4e240f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:19.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:19.762+0000 7f4e2b19a640 1 -- 172.21.15.99:0/2882312628 shutdown_connections 2024-09-19T07:06:19.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:19.762+0000 7f4e2b19a640 1 -- 172.21.15.99:0/2882312628 wait complete. 2024-09-19T07:06:20.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:06:19 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/2882312628' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-09-19T07:06:20.136 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:06:19 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/2882312628' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-09-19T07:06:20.376 DEBUG:tasks.fs:max_mds not reduced in epoch 27 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-19T07:06:20.377 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 28 2024-09-19T07:06:20.620 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T07:06:21.057 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:06:20 smithi099 ceph-mon[97031]: pgmap v720: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:06:21.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:06:20 smithi117 ceph-mon[76771]: pgmap v720: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:06:22.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:22.206+0000 7fd3f574f640 1 -- 172.21.15.99:0/124557084 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd3f00fd560 msgr2=0x7fd3f00fd930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:22.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:22.206+0000 7fd3f574f640 1 --2- 172.21.15.99:0/124557084 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd3f00fd560 0x7fd3f00fd930 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fd3e0004900 tx=0x7fd3e0009da0 comp rx=0 tx=0).stop 2024-09-19T07:06:22.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:22.207+0000 7fd3f574f640 1 -- 172.21.15.99:0/124557084 shutdown_connections 2024-09-19T07:06:22.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:22.207+0000 7fd3f574f640 1 --2- 172.21.15.99:0/124557084 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3f00fdf00 0x7fd3f01065d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:22.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:22.207+0000 7fd3f574f640 1 --2- 172.21.15.99:0/124557084 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd3f00fd560 0x7fd3f00fd930 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:22.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:22.207+0000 7fd3f574f640 1 -- 172.21.15.99:0/124557084 >> 172.21.15.99:0/124557084 conn(0x7fd3f00f7060 msgr2=0x7fd3f00f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:22.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:22.207+0000 7fd3f574f640 1 -- 172.21.15.99:0/124557084 shutdown_connections 2024-09-19T07:06:22.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:22.207+0000 7fd3f574f640 1 -- 172.21.15.99:0/124557084 wait complete. 2024-09-19T07:06:22.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:22.207+0000 7fd3f574f640 1 Processor -- start 2024-09-19T07:06:22.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:22.207+0000 7fd3f574f640 1 -- start start 2024-09-19T07:06:22.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:22.208+0000 7fd3f574f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd3f00fd560 0x7fd3f00fb420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:22.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:22.208+0000 7fd3f574f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3f00fdf00 0x7fd3f00fb960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:22.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:22.208+0000 7fd3f574f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f00fbea0 con 0x7fd3f00fd560 2024-09-19T07:06:22.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:22.208+0000 7fd3f574f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f00fc010 con 0x7fd3f00fdf00 2024-09-19T07:06:22.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:22.208+0000 7fd3eeffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd3f00fd560 0x7fd3f00fb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:22.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:22.208+0000 7fd3eeffd640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd3f00fd560 0x7fd3f00fb420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:58612/0 (socket says 172.21.15.99:58612) 2024-09-19T07:06:22.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:22.208+0000 7fd3eeffd640 1 -- 172.21.15.99:0/3933950596 learned_addr learned my addr 172.21.15.99:0/3933950596 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:06:22.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:22.208+0000 7fd3e67fc640 1 --2- 172.21.15.99:0/3933950596 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3f00fdf00 0x7fd3f00fb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:22.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:22.208+0000 7fd3eeffd640 1 -- 172.21.15.99:0/3933950596 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3f00fdf00 msgr2=0x7fd3f00fb960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:22.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:22.208+0000 7fd3eeffd640 1 --2- 172.21.15.99:0/3933950596 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3f00fdf00 0x7fd3f00fb960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:22.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:22.208+0000 7fd3eeffd640 1 -- 172.21.15.99:0/3933950596 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3e0005040 con 0x7fd3f00fd560 2024-09-19T07:06:22.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:22.208+0000 7fd3e67fc640 1 --2- 172.21.15.99:0/3933950596 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3f00fdf00 0x7fd3f00fb960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:06:22.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:22.208+0000 7fd3eeffd640 1 --2- 172.21.15.99:0/3933950596 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd3f00fd560 0x7fd3f00fb420 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fd3e0009ac0 tx=0x7fd3e0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:22.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:22.208+0000 7fd3e7fff640 1 -- 172.21.15.99:0/3933950596 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3e0038070 con 0x7fd3f00fd560 2024-09-19T07:06:22.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:22.208+0000 7fd3e7fff640 1 -- 172.21.15.99:0/3933950596 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd3e002ae80 con 0x7fd3f00fd560 2024-09-19T07:06:22.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:22.208+0000 7fd3f574f640 1 -- 172.21.15.99:0/3933950596 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3f00fc240 con 0x7fd3f00fd560 2024-09-19T07:06:22.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:22.208+0000 7fd3e7fff640 1 -- 172.21.15.99:0/3933950596 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3e0009680 con 0x7fd3f00fd560 2024-09-19T07:06:22.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:22.208+0000 7fd3f574f640 1 -- 172.21.15.99:0/3933950596 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3f0119840 con 0x7fd3f00fd560 2024-09-19T07:06:22.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:22.209+0000 7fd3f574f640 1 -- 172.21.15.99:0/3933950596 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3f00662f0 con 0x7fd3f00fd560 2024-09-19T07:06:22.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:22.210+0000 7fd3e7fff640 1 -- 172.21.15.99:0/3933950596 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fd3e0030020 con 0x7fd3f00fd560 2024-09-19T07:06:22.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:22.210+0000 7fd3e7fff640 1 --2- 172.21.15.99:0/3933950596 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd3dc06e530 0x7fd3dc0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:22.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:22.210+0000 7fd3e7fff640 1 -- 172.21.15.99:0/3933950596 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fd3e00ae630 con 0x7fd3f00fd560 2024-09-19T07:06:22.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:22.211+0000 7fd3e67fc640 1 --2- 172.21.15.99:0/3933950596 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd3dc06e530 0x7fd3dc0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:22.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:22.211+0000 7fd3e67fc640 1 --2- 172.21.15.99:0/3933950596 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd3dc06e530 0x7fd3dc0709e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fd3f00fcd60 tx=0x7fd3d800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:22.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:22.215+0000 7fd3e7fff640 1 -- 172.21.15.99:0/3933950596 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7fd3e00777a0 con 0x7fd3f00fd560 2024-09-19T07:06:22.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:22.417+0000 7fd3f574f640 1 -- 172.21.15.99:0/3933950596 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) v1 -- 0x7fd3f00fac60 con 0x7fd3f00fd560 2024-09-19T07:06:22.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:22.418+0000 7fd3e7fff640 1 -- 172.21.15.99:0/3933950596 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v35) v1 ==== 107+0+4321 (secure 0 0 0) 0x7fd3e007ae60 con 0x7fd3f00fd560 2024-09-19T07:06:22.419 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T07:06:22.419 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":28,"btime":"2024-09-19T06:48:41:704374+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34378,"name":"cephfs.smithi099.obarqf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6827/1859154203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1859154203},{"type":"v1","addr":"172.21.15.99:6827","nonce":1859154203}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":34410,"name":"cephfs.smithi099.xehbxe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6829/1939453719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1939453719},{"type":"v1","addr":"172.21.15.99:6829","nonce":1939453719}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44309,"name":"cephfs.smithi117.nooexo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6825/1398895079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":1398895079},{"type":"v1","addr":"172.21.15.117:6825","nonce":1398895079}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":20,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:40.838146+0000","modified":"2024-09-19T06:47:50.076553+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":77,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T07:06:22.420 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 28 2024-09-19T07:06:22.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:22.420+0000 7fd3f574f640 1 -- 172.21.15.99:0/3933950596 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd3dc06e530 msgr2=0x7fd3dc0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:22.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:22.420+0000 7fd3f574f640 1 --2- 172.21.15.99:0/3933950596 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd3dc06e530 0x7fd3dc0709e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fd3f00fcd60 tx=0x7fd3d800b040 comp rx=0 tx=0).stop 2024-09-19T07:06:22.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:22.420+0000 7fd3f574f640 1 -- 172.21.15.99:0/3933950596 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd3f00fd560 msgr2=0x7fd3f00fb420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:22.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:22.420+0000 7fd3f574f640 1 --2- 172.21.15.99:0/3933950596 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd3f00fd560 0x7fd3f00fb420 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fd3e0009ac0 tx=0x7fd3e0009da0 comp rx=0 tx=0).stop 2024-09-19T07:06:22.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:22.420+0000 7fd3f574f640 1 -- 172.21.15.99:0/3933950596 shutdown_connections 2024-09-19T07:06:22.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:22.420+0000 7fd3f574f640 1 --2- 172.21.15.99:0/3933950596 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7fd3dc06e530 0x7fd3dc0709e0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:22.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:22.420+0000 7fd3f574f640 1 --2- 172.21.15.99:0/3933950596 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd3f00fdf00 0x7fd3f00fb960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:22.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:22.420+0000 7fd3f574f640 1 --2- 172.21.15.99:0/3933950596 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd3f00fd560 0x7fd3f00fb420 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:22.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:22.421+0000 7fd3f574f640 1 -- 172.21.15.99:0/3933950596 >> 172.21.15.99:0/3933950596 conn(0x7fd3f00f7060 msgr2=0x7fd3f00f85b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:22.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:22.421+0000 7fd3f574f640 1 -- 172.21.15.99:0/3933950596 shutdown_connections 2024-09-19T07:06:22.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:22.421+0000 7fd3f574f640 1 -- 172.21.15.99:0/3933950596 wait complete. 2024-09-19T07:06:23.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:06:22 smithi099 ceph-mon[97031]: pgmap v721: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:06:23.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:06:22 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:06:23.042 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:06:22 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/3933950596' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-09-19T07:06:23.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:06:22 smithi117 ceph-mon[76771]: pgmap v721: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:06:23.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:06:22 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:06:23.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:06:22 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/3933950596' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-09-19T07:06:23.065 DEBUG:tasks.fs:max_mds not reduced in epoch 28 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-19T07:06:23.066 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 29 2024-09-19T07:06:23.313 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T07:06:24.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:24.979+0000 7f783467b640 1 -- 172.21.15.99:0/2383490735 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f782c0fe450 msgr2=0x7f782c0fe820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:24.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:24.979+0000 7f783467b640 1 --2- 172.21.15.99:0/2383490735 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f782c0fe450 0x7f782c0fe820 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f78280048d0 tx=0x7f7828009da0 comp rx=0 tx=0).stop 2024-09-19T07:06:24.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:24.979+0000 7f783467b640 1 -- 172.21.15.99:0/2383490735 shutdown_connections 2024-09-19T07:06:24.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:24.979+0000 7f783467b640 1 --2- 172.21.15.99:0/2383490735 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f782c064fe0 0x7f782c065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:24.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:24.979+0000 7f783467b640 1 --2- 172.21.15.99:0/2383490735 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f782c0fe450 0x7f782c0fe820 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:24.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:24.979+0000 7f783467b640 1 -- 172.21.15.99:0/2383490735 >> 172.21.15.99:0/2383490735 conn(0x7f782c0723b0 msgr2=0x7f782c0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:24.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:24.979+0000 7f783467b640 1 -- 172.21.15.99:0/2383490735 shutdown_connections 2024-09-19T07:06:24.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:24.979+0000 7f783467b640 1 -- 172.21.15.99:0/2383490735 wait complete. 2024-09-19T07:06:24.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:24.979+0000 7f783467b640 1 Processor -- start 2024-09-19T07:06:24.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:24.979+0000 7f783467b640 1 -- start start 2024-09-19T07:06:24.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:24.980+0000 7f783467b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f782c064fe0 0x7f782c113210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:24.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:24.980+0000 7f783467b640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f782c0fe450 0x7f782c113750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:24.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:24.980+0000 7f783467b640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f782c113d50 con 0x7f782c064fe0 2024-09-19T07:06:24.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:24.980+0000 7f783467b640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f782c10d190 con 0x7f782c0fe450 2024-09-19T07:06:24.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:24.980+0000 7f7832417640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f782c064fe0 0x7f782c113210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:24.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:24.980+0000 7f7832417640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f782c064fe0 0x7f782c113210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:58634/0 (socket says 172.21.15.99:58634) 2024-09-19T07:06:24.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:24.980+0000 7f7832417640 1 -- 172.21.15.99:0/2603820356 learned_addr learned my addr 172.21.15.99:0/2603820356 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:06:24.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:24.980+0000 7f7831c16640 1 --2- 172.21.15.99:0/2603820356 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f782c0fe450 0x7f782c113750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:24.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:24.980+0000 7f7832417640 1 -- 172.21.15.99:0/2603820356 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f782c0fe450 msgr2=0x7f782c113750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:24.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:24.980+0000 7f7832417640 1 --2- 172.21.15.99:0/2603820356 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f782c0fe450 0x7f782c113750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:24.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:24.980+0000 7f7832417640 1 -- 172.21.15.99:0/2603820356 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7828005040 con 0x7f782c064fe0 2024-09-19T07:06:24.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:24.980+0000 7f7832417640 1 --2- 172.21.15.99:0/2603820356 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f782c064fe0 0x7f782c113210 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f7828000c00 tx=0x7f7828009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:24.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:24.980+0000 7f7822ffd640 1 -- 172.21.15.99:0/2603820356 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7828038070 con 0x7f782c064fe0 2024-09-19T07:06:24.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:24.980+0000 7f7822ffd640 1 -- 172.21.15.99:0/2603820356 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f782802ade0 con 0x7f782c064fe0 2024-09-19T07:06:24.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:24.980+0000 7f783467b640 1 -- 172.21.15.99:0/2603820356 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f782c10d410 con 0x7f782c064fe0 2024-09-19T07:06:24.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:24.980+0000 7f7822ffd640 1 -- 172.21.15.99:0/2603820356 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f782802c7b0 con 0x7f782c064fe0 2024-09-19T07:06:24.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:24.980+0000 7f783467b640 1 -- 172.21.15.99:0/2603820356 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f782c10d8d0 con 0x7f782c064fe0 2024-09-19T07:06:24.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:24.981+0000 7f783467b640 1 -- 172.21.15.99:0/2603820356 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f782c0fdce0 con 0x7f782c064fe0 2024-09-19T07:06:24.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:24.982+0000 7f7822ffd640 1 -- 172.21.15.99:0/2603820356 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f7828030020 con 0x7f782c064fe0 2024-09-19T07:06:24.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:24.982+0000 7f7822ffd640 1 --2- 172.21.15.99:0/2603820356 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f781806e530 0x7f78180709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:24.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:24.982+0000 7f7831c16640 1 --2- 172.21.15.99:0/2603820356 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f781806e530 0x7f78180709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:24.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:24.983+0000 7f7822ffd640 1 -- 172.21.15.99:0/2603820356 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f78280ae4e0 con 0x7f782c064fe0 2024-09-19T07:06:24.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:24.983+0000 7f7831c16640 1 --2- 172.21.15.99:0/2603820356 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f781806e530 0x7f78180709e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f782c10ead0 tx=0x7f781c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:24.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:24.987+0000 7f7822ffd640 1 -- 172.21.15.99:0/2603820356 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f7828077650 con 0x7f782c064fe0 2024-09-19T07:06:25.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:06:24 smithi117 ceph-mon[76771]: pgmap v722: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:06:25.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:25.191+0000 7f783467b640 1 -- 172.21.15.99:0/2603820356 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) v1 -- 0x7f782c04b720 con 0x7f782c064fe0 2024-09-19T07:06:25.192 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:06:24 smithi099 ceph-mon[97031]: pgmap v722: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:06:25.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:25.191+0000 7f7822ffd640 1 -- 172.21.15.99:0/2603820356 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v35) v1 ==== 107+0+5171 (secure 0 0 0) 0x7f782807ad10 con 0x7f782c064fe0 2024-09-19T07:06:25.193 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T07:06:25.193 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":29,"btime":"2024-09-19T06:48:47:938420+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34378,"name":"cephfs.smithi099.obarqf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6827/1859154203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1859154203},{"type":"v1","addr":"172.21.15.99:6827","nonce":1859154203}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":34410,"name":"cephfs.smithi099.xehbxe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6829/1939453719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1939453719},{"type":"v1","addr":"172.21.15.99:6829","nonce":1939453719}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44309,"name":"cephfs.smithi117.nooexo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6825/1398895079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":1398895079},{"type":"v1","addr":"172.21.15.117:6825","nonce":1398895079}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":44329,"name":"cephfs.smithi117.bheqzh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6827/3233337308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3233337308},{"type":"v1","addr":"172.21.15.117:6827","nonce":3233337308}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":20,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:40.838146+0000","modified":"2024-09-19T06:47:50.076553+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":77,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T07:06:25.193 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 29 2024-09-19T07:06:25.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:25.193+0000 7f783467b640 1 -- 172.21.15.99:0/2603820356 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f781806e530 msgr2=0x7f78180709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:25.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:25.193+0000 7f783467b640 1 --2- 172.21.15.99:0/2603820356 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f781806e530 0x7f78180709e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f782c10ead0 tx=0x7f781c00b040 comp rx=0 tx=0).stop 2024-09-19T07:06:25.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:25.193+0000 7f783467b640 1 -- 172.21.15.99:0/2603820356 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f782c064fe0 msgr2=0x7f782c113210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:25.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:25.193+0000 7f783467b640 1 --2- 172.21.15.99:0/2603820356 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f782c064fe0 0x7f782c113210 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f7828000c00 tx=0x7f7828009da0 comp rx=0 tx=0).stop 2024-09-19T07:06:25.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:25.194+0000 7f783467b640 1 -- 172.21.15.99:0/2603820356 shutdown_connections 2024-09-19T07:06:25.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:25.194+0000 7f783467b640 1 --2- 172.21.15.99:0/2603820356 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f781806e530 0x7f78180709e0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:25.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:25.194+0000 7f783467b640 1 --2- 172.21.15.99:0/2603820356 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f782c0fe450 0x7f782c113750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:25.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:25.194+0000 7f783467b640 1 --2- 172.21.15.99:0/2603820356 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f782c064fe0 0x7f782c113210 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:25.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:25.194+0000 7f783467b640 1 -- 172.21.15.99:0/2603820356 >> 172.21.15.99:0/2603820356 conn(0x7f782c0723b0 msgr2=0x7f782c0fa2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:25.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:25.194+0000 7f783467b640 1 -- 172.21.15.99:0/2603820356 shutdown_connections 2024-09-19T07:06:25.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:25.194+0000 7f783467b640 1 -- 172.21.15.99:0/2603820356 wait complete. 2024-09-19T07:06:25.822 DEBUG:tasks.fs:max_mds not reduced in epoch 29 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-19T07:06:25.822 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 30 2024-09-19T07:06:26.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:06:25 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/2603820356' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-09-19T07:06:26.072 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T07:06:26.192 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:06:25 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/2603820356' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-09-19T07:06:27.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:06:26 smithi117 ceph-mon[76771]: pgmap v723: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:06:27.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:06:26 smithi099 ceph-mon[97031]: pgmap v723: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:06:27.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:27.691+0000 7f257ed8f640 1 -- 172.21.15.99:0/2403200377 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2578102680 msgr2=0x7f2578102a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:27.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:27.691+0000 7f257ed8f640 1 --2- 172.21.15.99:0/2403200377 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2578102680 0x7f2578102a50 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2570004810 tx=0x7f2570009da0 comp rx=0 tx=0).stop 2024-09-19T07:06:27.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:27.691+0000 7f257ed8f640 1 -- 172.21.15.99:0/2403200377 shutdown_connections 2024-09-19T07:06:27.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:27.691+0000 7f257ed8f640 1 --2- 172.21.15.99:0/2403200377 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f25780facf0 0x7f25780fb160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:27.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:27.691+0000 7f257ed8f640 1 --2- 172.21.15.99:0/2403200377 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2578102680 0x7f2578102a50 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:27.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:27.691+0000 7f257ed8f640 1 -- 172.21.15.99:0/2403200377 >> 172.21.15.99:0/2403200377 conn(0x7f2578070d50 msgr2=0x7f2578071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:27.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:27.691+0000 7f257ed8f640 1 -- 172.21.15.99:0/2403200377 shutdown_connections 2024-09-19T07:06:27.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:27.691+0000 7f257ed8f640 1 -- 172.21.15.99:0/2403200377 wait complete. 2024-09-19T07:06:27.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:27.691+0000 7f257ed8f640 1 Processor -- start 2024-09-19T07:06:27.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:27.692+0000 7f257ed8f640 1 -- start start 2024-09-19T07:06:27.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:27.692+0000 7f257ed8f640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f25780facf0 0x7f25781132d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:27.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:27.692+0000 7f257ed8f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2578102680 0x7f2578113810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:27.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:27.692+0000 7f257ed8f640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2578113e10 con 0x7f25780facf0 2024-09-19T07:06:27.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:27.692+0000 7f257ed8f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f257810d250 con 0x7f2578102680 2024-09-19T07:06:27.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:27.692+0000 7f257cb2b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f25780facf0 0x7f25781132d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:27.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:27.692+0000 7f257cb2b640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f25780facf0 0x7f25781132d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:44608/0 (socket says 172.21.15.99:44608) 2024-09-19T07:06:27.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:27.692+0000 7f257cb2b640 1 -- 172.21.15.99:0/4070543137 learned_addr learned my addr 172.21.15.99:0/4070543137 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:06:27.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:27.692+0000 7f2577fff640 1 --2- 172.21.15.99:0/4070543137 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2578102680 0x7f2578113810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:27.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:27.692+0000 7f257cb2b640 1 -- 172.21.15.99:0/4070543137 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2578102680 msgr2=0x7f2578113810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:27.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:27.692+0000 7f257cb2b640 1 --2- 172.21.15.99:0/4070543137 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2578102680 0x7f2578113810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:27.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:27.692+0000 7f257cb2b640 1 -- 172.21.15.99:0/4070543137 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2570005040 con 0x7f25780facf0 2024-09-19T07:06:27.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:27.692+0000 7f2577fff640 1 --2- 172.21.15.99:0/4070543137 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2578102680 0x7f2578113810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:06:27.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:27.693+0000 7f257cb2b640 1 --2- 172.21.15.99:0/4070543137 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f25780facf0 0x7f25781132d0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f2570004870 tx=0x7f2570009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:27.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:27.693+0000 7f25757fa640 1 -- 172.21.15.99:0/4070543137 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2570038070 con 0x7f25780facf0 2024-09-19T07:06:27.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:27.693+0000 7f25757fa640 1 -- 172.21.15.99:0/4070543137 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f257002ad30 con 0x7f25780facf0 2024-09-19T07:06:27.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:27.693+0000 7f257ed8f640 1 -- 172.21.15.99:0/4070543137 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f257810d4d0 con 0x7f25780facf0 2024-09-19T07:06:27.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:27.693+0000 7f25757fa640 1 -- 172.21.15.99:0/4070543137 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f257002c6e0 con 0x7f25780facf0 2024-09-19T07:06:27.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:27.693+0000 7f257ed8f640 1 -- 172.21.15.99:0/4070543137 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f257810d990 con 0x7f25780facf0 2024-09-19T07:06:27.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:27.694+0000 7f257ed8f640 1 -- 172.21.15.99:0/4070543137 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25780657f0 con 0x7f25780facf0 2024-09-19T07:06:27.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:27.694+0000 7f25757fa640 1 -- 172.21.15.99:0/4070543137 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f2570030020 con 0x7f25780facf0 2024-09-19T07:06:27.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:27.695+0000 7f25757fa640 1 --2- 172.21.15.99:0/4070543137 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f256406e530 0x7f25640709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:27.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:27.695+0000 7f25757fa640 1 -- 172.21.15.99:0/4070543137 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f25700adec0 con 0x7f25780facf0 2024-09-19T07:06:27.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:27.695+0000 7f2577fff640 1 --2- 172.21.15.99:0/4070543137 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f256406e530 0x7f25640709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:27.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:27.695+0000 7f2577fff640 1 --2- 172.21.15.99:0/4070543137 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f256406e530 0x7f25640709e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f2568004a60 tx=0x7f256800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:27.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:27.699+0000 7f25757fa640 1 -- 172.21.15.99:0/4070543137 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f2570077020 con 0x7f25780facf0 2024-09-19T07:06:27.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:27.901+0000 7f257ed8f640 1 -- 172.21.15.99:0/4070543137 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) v1 -- 0x7f257804b720 con 0x7f25780facf0 2024-09-19T07:06:27.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:27.902+0000 7f25757fa640 1 -- 172.21.15.99:0/4070543137 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v35) v1 ==== 107+0+5170 (secure 0 0 0) 0x7f257007a6e0 con 0x7f25780facf0 2024-09-19T07:06:27.903 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T07:06:27.903 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":30,"btime":"2024-09-19T07:03:47:677051+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34378,"name":"cephfs.smithi099.obarqf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6827/1859154203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1859154203},{"type":"v1","addr":"172.21.15.99:6827","nonce":1859154203}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":34410,"name":"cephfs.smithi099.xehbxe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6829/1939453719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1939453719},{"type":"v1","addr":"172.21.15.99:6829","nonce":1939453719}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44309,"name":"cephfs.smithi117.nooexo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6825/1398895079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":1398895079},{"type":"v1","addr":"172.21.15.117:6825","nonce":1398895079}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":44329,"name":"cephfs.smithi117.bheqzh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6827/3233337308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3233337308},{"type":"v1","addr":"172.21.15.117:6827","nonce":3233337308}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:40.838146+0000","modified":"2024-09-19T07:03:46.679864+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":77,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T07:06:27.903 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 30 2024-09-19T07:06:27.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:27.904+0000 7f257ed8f640 1 -- 172.21.15.99:0/4070543137 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f256406e530 msgr2=0x7f25640709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:27.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:27.904+0000 7f257ed8f640 1 --2- 172.21.15.99:0/4070543137 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f256406e530 0x7f25640709e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f2568004a60 tx=0x7f256800b040 comp rx=0 tx=0).stop 2024-09-19T07:06:27.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:27.904+0000 7f257ed8f640 1 -- 172.21.15.99:0/4070543137 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f25780facf0 msgr2=0x7f25781132d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:27.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:27.904+0000 7f257ed8f640 1 --2- 172.21.15.99:0/4070543137 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f25780facf0 0x7f25781132d0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f2570004870 tx=0x7f2570009da0 comp rx=0 tx=0).stop 2024-09-19T07:06:27.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:27.904+0000 7f257ed8f640 1 -- 172.21.15.99:0/4070543137 shutdown_connections 2024-09-19T07:06:27.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:27.904+0000 7f257ed8f640 1 --2- 172.21.15.99:0/4070543137 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f256406e530 0x7f25640709e0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:27.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:27.904+0000 7f257ed8f640 1 --2- 172.21.15.99:0/4070543137 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2578102680 0x7f2578113810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:27.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:27.904+0000 7f257ed8f640 1 --2- 172.21.15.99:0/4070543137 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f25780facf0 0x7f25781132d0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:27.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:27.904+0000 7f257ed8f640 1 -- 172.21.15.99:0/4070543137 >> 172.21.15.99:0/4070543137 conn(0x7f2578070d50 msgr2=0x7f25780f9f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:27.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:27.904+0000 7f257ed8f640 1 -- 172.21.15.99:0/4070543137 shutdown_connections 2024-09-19T07:06:27.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:27.904+0000 7f257ed8f640 1 -- 172.21.15.99:0/4070543137 wait complete. 2024-09-19T07:06:28.569 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 31 2024-09-19T07:06:28.816 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T07:06:29.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:06:28 smithi117 ceph-mon[76771]: pgmap v724: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:06:29.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:06:28 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/4070543137' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-09-19T07:06:29.062 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:06:28 smithi099 ceph-mon[97031]: pgmap v724: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:06:29.062 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:06:28 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/4070543137' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-09-19T07:06:30.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:30.337+0000 7f3f16d5c640 1 -- 172.21.15.99:0/1014254407 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f10102ed0 msgr2=0x7f3f100fc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:30.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:30.337+0000 7f3f16d5c640 1 --2- 172.21.15.99:0/1014254407 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f10102ed0 0x7f3f100fc590 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f3f000048d0 tx=0x7f3f00009da0 comp rx=0 tx=0).stop 2024-09-19T07:06:30.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:30.337+0000 7f3f16d5c640 1 -- 172.21.15.99:0/1014254407 shutdown_connections 2024-09-19T07:06:30.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:30.337+0000 7f3f16d5c640 1 --2- 172.21.15.99:0/1014254407 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f10102ed0 0x7f3f100fc590 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:30.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:30.337+0000 7f3f16d5c640 1 --2- 172.21.15.99:0/1014254407 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f10102530 0x7f3f10102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:30.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:30.337+0000 7f3f16d5c640 1 -- 172.21.15.99:0/1014254407 >> 172.21.15.99:0/1014254407 conn(0x7f3f100f8110 msgr2=0x7f3f100fa520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:30.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:30.337+0000 7f3f16d5c640 1 -- 172.21.15.99:0/1014254407 shutdown_connections 2024-09-19T07:06:30.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:30.337+0000 7f3f16d5c640 1 -- 172.21.15.99:0/1014254407 wait complete. 2024-09-19T07:06:30.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:30.338+0000 7f3f16d5c640 1 Processor -- start 2024-09-19T07:06:30.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:30.338+0000 7f3f16d5c640 1 -- start start 2024-09-19T07:06:30.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:30.338+0000 7f3f16d5c640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f10102530 0x7f3f10113270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:30.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:30.338+0000 7f3f16d5c640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f10102ed0 0x7f3f101137b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:30.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:30.338+0000 7f3f16d5c640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f10113e40 con 0x7f3f10102ed0 2024-09-19T07:06:30.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:30.338+0000 7f3f16d5c640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1010d1f0 con 0x7f3f10102530 2024-09-19T07:06:30.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:30.338+0000 7f3f07fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f10102ed0 0x7f3f101137b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:30.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:30.338+0000 7f3f07fff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f10102ed0 0x7f3f101137b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:44616/0 (socket says 172.21.15.99:44616) 2024-09-19T07:06:30.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:30.338+0000 7f3f07fff640 1 -- 172.21.15.99:0/3125309045 learned_addr learned my addr 172.21.15.99:0/3125309045 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:06:30.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:30.338+0000 7f3f14af8640 1 --2- 172.21.15.99:0/3125309045 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f10102530 0x7f3f10113270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:30.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:30.338+0000 7f3f07fff640 1 -- 172.21.15.99:0/3125309045 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f10102530 msgr2=0x7f3f10113270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:30.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:30.339+0000 7f3f07fff640 1 --2- 172.21.15.99:0/3125309045 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f10102530 0x7f3f10113270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:30.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:30.339+0000 7f3f07fff640 1 -- 172.21.15.99:0/3125309045 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f00005040 con 0x7f3f10102ed0 2024-09-19T07:06:30.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:30.339+0000 7f3f14af8640 1 --2- 172.21.15.99:0/3125309045 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f10102530 0x7f3f10113270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T07:06:30.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:30.339+0000 7f3f07fff640 1 --2- 172.21.15.99:0/3125309045 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f10102ed0 0x7f3f101137b0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f3f00003080 tx=0x7f3f00009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:30.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:30.339+0000 7f3f057fa640 1 -- 172.21.15.99:0/3125309045 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f00038070 con 0x7f3f10102ed0 2024-09-19T07:06:30.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:30.339+0000 7f3f057fa640 1 -- 172.21.15.99:0/3125309045 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3f00009760 con 0x7f3f10102ed0 2024-09-19T07:06:30.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:30.339+0000 7f3f16d5c640 1 -- 172.21.15.99:0/3125309045 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f1010d470 con 0x7f3f10102ed0 2024-09-19T07:06:30.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:30.339+0000 7f3f057fa640 1 -- 172.21.15.99:0/3125309045 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f00033420 con 0x7f3f10102ed0 2024-09-19T07:06:30.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:30.339+0000 7f3f16d5c640 1 -- 172.21.15.99:0/3125309045 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f1010d8d0 con 0x7f3f10102ed0 2024-09-19T07:06:30.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:30.340+0000 7f3f16d5c640 1 -- 172.21.15.99:0/3125309045 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f100fdcb0 con 0x7f3f10102ed0 2024-09-19T07:06:30.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:30.341+0000 7f3f057fa640 1 -- 172.21.15.99:0/3125309045 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f3f00030020 con 0x7f3f10102ed0 2024-09-19T07:06:30.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:30.341+0000 7f3f057fa640 1 --2- 172.21.15.99:0/3125309045 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f3ef806e530 0x7f3ef80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:30.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:30.341+0000 7f3f057fa640 1 -- 172.21.15.99:0/3125309045 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f3f000adf30 con 0x7f3f10102ed0 2024-09-19T07:06:30.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:30.341+0000 7f3f14af8640 1 --2- 172.21.15.99:0/3125309045 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f3ef806e530 0x7f3ef80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:30.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:30.342+0000 7f3f14af8640 1 --2- 172.21.15.99:0/3125309045 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f3ef806e530 0x7f3ef80709e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c006fd0 tx=0x7f3f0c008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:30.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:30.345+0000 7f3f057fa640 1 -- 172.21.15.99:0/3125309045 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f3f00077020 con 0x7f3f10102ed0 2024-09-19T07:06:30.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:30.545+0000 7f3f16d5c640 1 -- 172.21.15.99:0/3125309045 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) v1 -- 0x7f3f100fbd30 con 0x7f3f10102ed0 2024-09-19T07:06:30.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:30.546+0000 7f3f057fa640 1 -- 172.21.15.99:0/3125309045 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v35) v1 ==== 107+0+5261 (secure 0 0 0) 0x7f3f0007a6e0 con 0x7f3f10102ed0 2024-09-19T07:06:30.547 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T07:06:30.547 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":31,"btime":"2024-09-19T07:03:47:681842+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44309,"name":"cephfs.smithi117.nooexo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6825/1398895079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":1398895079},{"type":"v1","addr":"172.21.15.117:6825","nonce":1398895079}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":44329,"name":"cephfs.smithi117.bheqzh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6827/3233337308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3233337308},{"type":"v1","addr":"172.21.15.117:6827","nonce":3233337308}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:40.838146+0000","modified":"2024-09-19T07:03:47.681831+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":77,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34378,"mds_1":34410},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34378":{"gid":34378,"name":"cephfs.smithi099.obarqf","rank":0,"incarnation":31,"state":"up:replay","state_seq":1,"addr":"172.21.15.99:6827/1859154203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1859154203},{"type":"v1","addr":"172.21.15.99:6827","nonce":1859154203}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34410":{"gid":34410,"name":"cephfs.smithi099.xehbxe","rank":1,"incarnation":31,"state":"up:replay","state_seq":1,"addr":"172.21.15.99:6829/1939453719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1939453719},{"type":"v1","addr":"172.21.15.99:6829","nonce":1939453719}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T07:06:30.548 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 31 2024-09-19T07:06:30.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:30.548+0000 7f3f16d5c640 1 -- 172.21.15.99:0/3125309045 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f3ef806e530 msgr2=0x7f3ef80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:30.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:30.548+0000 7f3f16d5c640 1 --2- 172.21.15.99:0/3125309045 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f3ef806e530 0x7f3ef80709e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c006fd0 tx=0x7f3f0c008040 comp rx=0 tx=0).stop 2024-09-19T07:06:30.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:30.548+0000 7f3f16d5c640 1 -- 172.21.15.99:0/3125309045 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f10102ed0 msgr2=0x7f3f101137b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:30.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:30.548+0000 7f3f16d5c640 1 --2- 172.21.15.99:0/3125309045 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f10102ed0 0x7f3f101137b0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f3f00003080 tx=0x7f3f00009da0 comp rx=0 tx=0).stop 2024-09-19T07:06:30.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:30.548+0000 7f3f16d5c640 1 -- 172.21.15.99:0/3125309045 shutdown_connections 2024-09-19T07:06:30.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:30.548+0000 7f3f16d5c640 1 --2- 172.21.15.99:0/3125309045 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f3ef806e530 0x7f3ef80709e0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:30.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:30.548+0000 7f3f16d5c640 1 --2- 172.21.15.99:0/3125309045 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f10102ed0 0x7f3f101137b0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:30.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:30.548+0000 7f3f16d5c640 1 --2- 172.21.15.99:0/3125309045 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3f10102530 0x7f3f10113270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:30.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:30.548+0000 7f3f16d5c640 1 -- 172.21.15.99:0/3125309045 >> 172.21.15.99:0/3125309045 conn(0x7f3f100f8110 msgr2=0x7f3f100f91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:30.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:30.548+0000 7f3f16d5c640 1 -- 172.21.15.99:0/3125309045 shutdown_connections 2024-09-19T07:06:30.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:30.548+0000 7f3f16d5c640 1 -- 172.21.15.99:0/3125309045 wait complete. 2024-09-19T07:06:30.797 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:06:30 smithi099 ceph-mon[97031]: pgmap v725: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:06:30.797 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:06:30 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/3125309045' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-09-19T07:06:31.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:06:30 smithi117 ceph-mon[76771]: pgmap v725: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:06:31.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:06:30 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/3125309045' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-09-19T07:06:31.183 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 32 2024-09-19T07:06:31.428 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T07:06:32.934 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:06:32 smithi099 ceph-mon[97031]: pgmap v726: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:06:33.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:33.011+0000 7f54dd545640 1 -- 172.21.15.99:0/384270147 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54d80fcf80 msgr2=0x7f54d80fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:33.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:33.011+0000 7f54dd545640 1 --2- 172.21.15.99:0/384270147 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54d80fcf80 0x7f54d80fd3d0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f54c00048d0 tx=0x7f54c0009da0 comp rx=0 tx=0).stop 2024-09-19T07:06:33.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:33.011+0000 7f54dd545640 1 -- 172.21.15.99:0/384270147 shutdown_connections 2024-09-19T07:06:33.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:33.011+0000 7f54dd545640 1 --2- 172.21.15.99:0/384270147 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54d80fcf80 0x7f54d80fd3d0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:33.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:33.011+0000 7f54dd545640 1 --2- 172.21.15.99:0/384270147 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54d80fb810 0x7f54d80fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:33.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:33.011+0000 7f54dd545640 1 -- 172.21.15.99:0/384270147 >> 172.21.15.99:0/384270147 conn(0x7f54d80723b0 msgr2=0x7f54d80727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:33.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:33.011+0000 7f54dd545640 1 -- 172.21.15.99:0/384270147 shutdown_connections 2024-09-19T07:06:33.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:33.011+0000 7f54dd545640 1 -- 172.21.15.99:0/384270147 wait complete. 2024-09-19T07:06:33.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:33.011+0000 7f54dd545640 1 Processor -- start 2024-09-19T07:06:33.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:33.012+0000 7f54dd545640 1 -- start start 2024-09-19T07:06:33.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:33.012+0000 7f54dd545640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54d80fb810 0x7f54d810e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:33.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:33.012+0000 7f54dd545640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54d80fcf80 0x7f54d810e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:33.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:33.012+0000 7f54dd545640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d810ed20 con 0x7f54d80fcf80 2024-09-19T07:06:33.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:33.012+0000 7f54dd545640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d810ee90 con 0x7f54d80fb810 2024-09-19T07:06:33.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:33.012+0000 7f54ce7fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54d80fcf80 0x7f54d810e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:33.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:33.012+0000 7f54ce7fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54d80fcf80 0x7f54d810e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:44638/0 (socket says 172.21.15.99:44638) 2024-09-19T07:06:33.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:33.012+0000 7f54ce7fc640 1 -- 172.21.15.99:0/3078245769 learned_addr learned my addr 172.21.15.99:0/3078245769 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:06:33.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:33.012+0000 7f54ce7fc640 1 -- 172.21.15.99:0/3078245769 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54d80fb810 msgr2=0x7f54d810e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:33.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:33.012+0000 7f54ce7fc640 1 --2- 172.21.15.99:0/3078245769 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54d80fb810 0x7f54d810e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:33.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:33.012+0000 7f54ce7fc640 1 -- 172.21.15.99:0/3078245769 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c0005040 con 0x7f54d80fcf80 2024-09-19T07:06:33.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:33.012+0000 7f54ce7fc640 1 --2- 172.21.15.99:0/3078245769 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54d80fcf80 0x7f54d810e6d0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f54c0000c00 tx=0x7f54c0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:33.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:33.012+0000 7f54cffff640 1 -- 172.21.15.99:0/3078245769 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54c0038070 con 0x7f54d80fcf80 2024-09-19T07:06:33.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:33.013+0000 7f54dd545640 1 -- 172.21.15.99:0/3078245769 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54d8117200 con 0x7f54d80fcf80 2024-09-19T07:06:33.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:33.013+0000 7f54cffff640 1 -- 172.21.15.99:0/3078245769 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f54c002ade0 con 0x7f54d80fcf80 2024-09-19T07:06:33.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:33.013+0000 7f54cffff640 1 -- 172.21.15.99:0/3078245769 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54c002c7e0 con 0x7f54d80fcf80 2024-09-19T07:06:33.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:33.013+0000 7f54dd545640 1 -- 172.21.15.99:0/3078245769 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54d8117660 con 0x7f54d80fcf80 2024-09-19T07:06:33.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:33.014+0000 7f54dd545640 1 -- 172.21.15.99:0/3078245769 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54d80fcbc0 con 0x7f54d80fcf80 2024-09-19T07:06:33.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:33.014+0000 7f54cffff640 1 -- 172.21.15.99:0/3078245769 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f54c0030020 con 0x7f54d80fcf80 2024-09-19T07:06:33.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:33.014+0000 7f54cffff640 1 --2- 172.21.15.99:0/3078245769 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f54c406e530 0x7f54c40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:33.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:33.015+0000 7f54cffff640 1 -- 172.21.15.99:0/3078245769 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f54c00add00 con 0x7f54d80fcf80 2024-09-19T07:06:33.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:33.015+0000 7f54d6ffd640 1 --2- 172.21.15.99:0/3078245769 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f54c406e530 0x7f54c40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:33.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:33.015+0000 7f54d6ffd640 1 --2- 172.21.15.99:0/3078245769 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f54c406e530 0x7f54c40709e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f54c8004c80 tx=0x7f54c8009c50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:33.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:33.019+0000 7f54cffff640 1 -- 172.21.15.99:0/3078245769 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f54c0076f20 con 0x7f54d80fcf80 2024-09-19T07:06:33.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:06:32 smithi117 ceph-mon[76771]: pgmap v726: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:06:33.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:33.221+0000 7f54dd545640 1 -- 172.21.15.99:0/3078245769 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) v1 -- 0x7f54d804b720 con 0x7f54d80fcf80 2024-09-19T07:06:33.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:33.222+0000 7f54cffff640 1 -- 172.21.15.99:0/3078245769 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v35) v1 ==== 107+0+5267 (secure 0 0 0) 0x7f54c0035050 con 0x7f54d80fcf80 2024-09-19T07:06:33.224 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T07:06:33.224 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":32,"btime":"2024-09-19T07:03:54:170958+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44309,"name":"cephfs.smithi117.nooexo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6825/1398895079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":1398895079},{"type":"v1","addr":"172.21.15.117:6825","nonce":1398895079}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":44329,"name":"cephfs.smithi117.bheqzh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6827/3233337308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3233337308},{"type":"v1","addr":"172.21.15.117:6827","nonce":3233337308}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:40.838146+0000","modified":"2024-09-19T07:03:53.535693+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":77,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34378,"mds_1":34410},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34378":{"gid":34378,"name":"cephfs.smithi099.obarqf","rank":0,"incarnation":31,"state":"up:resolve","state_seq":240,"addr":"172.21.15.99:6827/1859154203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1859154203},{"type":"v1","addr":"172.21.15.99:6827","nonce":1859154203}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34410":{"gid":34410,"name":"cephfs.smithi099.xehbxe","rank":1,"incarnation":31,"state":"up:resolve","state_seq":236,"addr":"172.21.15.99:6829/1939453719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1939453719},{"type":"v1","addr":"172.21.15.99:6829","nonce":1939453719}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T07:06:33.224 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 32 2024-09-19T07:06:33.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:33.224+0000 7f54dd545640 1 -- 172.21.15.99:0/3078245769 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f54c406e530 msgr2=0x7f54c40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:33.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:33.224+0000 7f54dd545640 1 --2- 172.21.15.99:0/3078245769 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f54c406e530 0x7f54c40709e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f54c8004c80 tx=0x7f54c8009c50 comp rx=0 tx=0).stop 2024-09-19T07:06:33.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:33.224+0000 7f54dd545640 1 -- 172.21.15.99:0/3078245769 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54d80fcf80 msgr2=0x7f54d810e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:33.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:33.224+0000 7f54dd545640 1 --2- 172.21.15.99:0/3078245769 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54d80fcf80 0x7f54d810e6d0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f54c0000c00 tx=0x7f54c0009da0 comp rx=0 tx=0).stop 2024-09-19T07:06:33.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:33.225+0000 7f54dd545640 1 -- 172.21.15.99:0/3078245769 shutdown_connections 2024-09-19T07:06:33.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:33.225+0000 7f54dd545640 1 --2- 172.21.15.99:0/3078245769 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f54c406e530 0x7f54c40709e0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:33.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:33.225+0000 7f54dd545640 1 --2- 172.21.15.99:0/3078245769 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54d80fcf80 0x7f54d810e6d0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:33.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:33.225+0000 7f54dd545640 1 --2- 172.21.15.99:0/3078245769 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54d80fb810 0x7f54d810e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:33.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:33.225+0000 7f54dd545640 1 -- 172.21.15.99:0/3078245769 >> 172.21.15.99:0/3078245769 conn(0x7f54d80723b0 msgr2=0x7f54d80fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:33.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:33.225+0000 7f54dd545640 1 -- 172.21.15.99:0/3078245769 shutdown_connections 2024-09-19T07:06:33.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:33.225+0000 7f54dd545640 1 -- 172.21.15.99:0/3078245769 wait complete. 2024-09-19T07:06:33.921 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 33 2024-09-19T07:06:34.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:06:33 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/3078245769' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-09-19T07:06:34.178 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T07:06:34.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:06:33 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/3078245769' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-09-19T07:06:34.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:06:34 smithi099 ceph-mon[97031]: pgmap v727: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:06:35.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:06:34 smithi117 ceph-mon[76771]: pgmap v727: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:06:35.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:35.757+0000 7f2c49674640 1 -- 172.21.15.99:0/3989454385 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c44102530 msgr2=0x7f2c44102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:35.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:35.757+0000 7f2c49674640 1 --2- 172.21.15.99:0/3989454385 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c44102530 0x7f2c44102900 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f2c34009c50 tx=0x7f2c34004d10 comp rx=0 tx=0).stop 2024-09-19T07:06:35.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:35.758+0000 7f2c49674640 1 -- 172.21.15.99:0/3989454385 shutdown_connections 2024-09-19T07:06:35.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:35.758+0000 7f2c49674640 1 --2- 172.21.15.99:0/3989454385 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c44102ed0 0x7f2c440fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:35.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:35.758+0000 7f2c49674640 1 --2- 172.21.15.99:0/3989454385 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c44102530 0x7f2c44102900 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:35.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:35.758+0000 7f2c49674640 1 -- 172.21.15.99:0/3989454385 >> 172.21.15.99:0/3989454385 conn(0x7f2c440f80f0 msgr2=0x7f2c440fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:35.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:35.758+0000 7f2c49674640 1 -- 172.21.15.99:0/3989454385 shutdown_connections 2024-09-19T07:06:35.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:35.758+0000 7f2c49674640 1 -- 172.21.15.99:0/3989454385 wait complete. 2024-09-19T07:06:35.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:35.758+0000 7f2c49674640 1 Processor -- start 2024-09-19T07:06:35.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:35.758+0000 7f2c49674640 1 -- start start 2024-09-19T07:06:35.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:35.758+0000 7f2c49674640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c44102530 0x7f2c44113240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:35.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:35.758+0000 7f2c49674640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c44102ed0 0x7f2c44113780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:35.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:35.758+0000 7f2c49674640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c44113d80 con 0x7f2c44102ed0 2024-09-19T07:06:35.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:35.758+0000 7f2c49674640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4410d1c0 con 0x7f2c44102530 2024-09-19T07:06:35.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:35.759+0000 7f2c427fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c44102ed0 0x7f2c44113780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:35.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:35.759+0000 7f2c427fc640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c44102ed0 0x7f2c44113780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46426/0 (socket says 172.21.15.99:46426) 2024-09-19T07:06:35.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:35.759+0000 7f2c427fc640 1 -- 172.21.15.99:0/4161591054 learned_addr learned my addr 172.21.15.99:0/4161591054 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:06:35.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:35.759+0000 7f2c42ffd640 1 --2- 172.21.15.99:0/4161591054 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c44102530 0x7f2c44113240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:35.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:35.759+0000 7f2c427fc640 1 -- 172.21.15.99:0/4161591054 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c44102530 msgr2=0x7f2c44113240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:35.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:35.759+0000 7f2c427fc640 1 --2- 172.21.15.99:0/4161591054 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c44102530 0x7f2c44113240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:35.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:35.759+0000 7f2c427fc640 1 -- 172.21.15.99:0/4161591054 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c340098b0 con 0x7f2c44102ed0 2024-09-19T07:06:35.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:35.759+0000 7f2c427fc640 1 --2- 172.21.15.99:0/4161591054 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c44102ed0 0x7f2c44113780 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c00c790 tx=0x7f2c2c0043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:35.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:35.759+0000 7f2c3b7fe640 1 -- 172.21.15.99:0/4161591054 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c2c00a820 con 0x7f2c44102ed0 2024-09-19T07:06:35.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:35.759+0000 7f2c3b7fe640 1 -- 172.21.15.99:0/4161591054 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2c2c00ae20 con 0x7f2c44102ed0 2024-09-19T07:06:35.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:35.759+0000 7f2c49674640 1 -- 172.21.15.99:0/4161591054 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c4410d4a0 con 0x7f2c44102ed0 2024-09-19T07:06:35.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:35.759+0000 7f2c3b7fe640 1 -- 172.21.15.99:0/4161591054 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c2c011380 con 0x7f2c44102ed0 2024-09-19T07:06:35.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:35.759+0000 7f2c49674640 1 -- 172.21.15.99:0/4161591054 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c4410da40 con 0x7f2c44102ed0 2024-09-19T07:06:35.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:35.760+0000 7f2c49674640 1 -- 172.21.15.99:0/4161591054 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c440fdcb0 con 0x7f2c44102ed0 2024-09-19T07:06:35.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:35.761+0000 7f2c3b7fe640 1 -- 172.21.15.99:0/4161591054 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f2c2c012420 con 0x7f2c44102ed0 2024-09-19T07:06:35.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:35.761+0000 7f2c3b7fe640 1 --2- 172.21.15.99:0/4161591054 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f2c3006e600 0x7f2c30070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:35.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:35.761+0000 7f2c3b7fe640 1 -- 172.21.15.99:0/4161591054 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f2c2c08e6c0 con 0x7f2c44102ed0 2024-09-19T07:06:35.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:35.761+0000 7f2c42ffd640 1 --2- 172.21.15.99:0/4161591054 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f2c3006e600 0x7f2c30070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:35.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:35.762+0000 7f2c42ffd640 1 --2- 172.21.15.99:0/4161591054 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f2c3006e600 0x7f2c30070ab0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f2c34004a30 tx=0x7f2c34004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:35.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:35.766+0000 7f2c3b7fe640 1 -- 172.21.15.99:0/4161591054 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f2c2c0577b0 con 0x7f2c44102ed0 2024-09-19T07:06:35.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:35.966+0000 7f2c49674640 1 -- 172.21.15.99:0/4161591054 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 33, "format": "json"} v 0) v1 -- 0x7f2c441095a0 con 0x7f2c44102ed0 2024-09-19T07:06:35.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:35.967+0000 7f2c3b7fe640 1 -- 172.21.15.99:0/4161591054 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 33, "format": "json"}]=0 dumped fsmap epoch 33 v35) v1 ==== 107+0+5271 (secure 0 0 0) 0x7f2c2c05ae70 con 0x7f2c44102ed0 2024-09-19T07:06:35.968 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T07:06:35.968 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":33,"btime":"2024-09-19T07:03:55:172564+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44309,"name":"cephfs.smithi117.nooexo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6825/1398895079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":1398895079},{"type":"v1","addr":"172.21.15.117:6825","nonce":1398895079}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":44329,"name":"cephfs.smithi117.bheqzh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6827/3233337308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3233337308},{"type":"v1","addr":"172.21.15.117:6827","nonce":3233337308}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:40.838146+0000","modified":"2024-09-19T07:03:54.211640+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":77,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34378,"mds_1":34410},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34378":{"gid":34378,"name":"cephfs.smithi099.obarqf","rank":0,"incarnation":31,"state":"up:reconnect","state_seq":241,"addr":"172.21.15.99:6827/1859154203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1859154203},{"type":"v1","addr":"172.21.15.99:6827","nonce":1859154203}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34410":{"gid":34410,"name":"cephfs.smithi099.xehbxe","rank":1,"incarnation":31,"state":"up:reconnect","state_seq":237,"addr":"172.21.15.99:6829/1939453719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1939453719},{"type":"v1","addr":"172.21.15.99:6829","nonce":1939453719}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T07:06:35.969 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 33 2024-09-19T07:06:35.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:35.969+0000 7f2c49674640 1 -- 172.21.15.99:0/4161591054 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f2c3006e600 msgr2=0x7f2c30070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:35.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:35.969+0000 7f2c49674640 1 --2- 172.21.15.99:0/4161591054 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f2c3006e600 0x7f2c30070ab0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f2c34004a30 tx=0x7f2c34004d10 comp rx=0 tx=0).stop 2024-09-19T07:06:35.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:35.969+0000 7f2c49674640 1 -- 172.21.15.99:0/4161591054 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c44102ed0 msgr2=0x7f2c44113780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:35.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:35.969+0000 7f2c49674640 1 --2- 172.21.15.99:0/4161591054 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c44102ed0 0x7f2c44113780 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c00c790 tx=0x7f2c2c0043c0 comp rx=0 tx=0).stop 2024-09-19T07:06:35.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:35.969+0000 7f2c49674640 1 -- 172.21.15.99:0/4161591054 shutdown_connections 2024-09-19T07:06:35.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:35.969+0000 7f2c49674640 1 --2- 172.21.15.99:0/4161591054 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f2c3006e600 0x7f2c30070ab0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:35.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:35.969+0000 7f2c49674640 1 --2- 172.21.15.99:0/4161591054 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2c44102ed0 0x7f2c44113780 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:35.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:35.969+0000 7f2c49674640 1 --2- 172.21.15.99:0/4161591054 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2c44102530 0x7f2c44113240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:35.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:35.969+0000 7f2c49674640 1 -- 172.21.15.99:0/4161591054 >> 172.21.15.99:0/4161591054 conn(0x7f2c440f80f0 msgr2=0x7f2c440f90f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:35.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:35.969+0000 7f2c49674640 1 -- 172.21.15.99:0/4161591054 shutdown_connections 2024-09-19T07:06:35.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:35.969+0000 7f2c49674640 1 -- 172.21.15.99:0/4161591054 wait complete. 2024-09-19T07:06:36.605 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 34 2024-09-19T07:06:36.854 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T07:06:36.955 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:06:36 smithi099 ceph-mon[97031]: pgmap v728: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:06:36.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:06:36 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/4161591054' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-09-19T07:06:37.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:06:36 smithi117 ceph-mon[76771]: pgmap v728: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:06:37.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:06:36 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/4161591054' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-09-19T07:06:37.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:06:37 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:06:38.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:06:37 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:06:38.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:38.531+0000 7f14326d4640 1 -- 172.21.15.99:0/2019864003 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f142c102ed0 msgr2=0x7f142c0fc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:38.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:38.531+0000 7f14326d4640 1 --2- 172.21.15.99:0/2019864003 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f142c102ed0 0x7f142c0fc590 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f14140048d0 tx=0x7f1414009da0 comp rx=0 tx=0).stop 2024-09-19T07:06:38.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:38.531+0000 7f14326d4640 1 -- 172.21.15.99:0/2019864003 shutdown_connections 2024-09-19T07:06:38.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:38.531+0000 7f14326d4640 1 --2- 172.21.15.99:0/2019864003 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f142c102ed0 0x7f142c0fc590 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:38.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:38.531+0000 7f14326d4640 1 --2- 172.21.15.99:0/2019864003 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f142c102530 0x7f142c102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:38.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:38.531+0000 7f14326d4640 1 -- 172.21.15.99:0/2019864003 >> 172.21.15.99:0/2019864003 conn(0x7f142c0f80f0 msgr2=0x7f142c0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:38.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:38.531+0000 7f14326d4640 1 -- 172.21.15.99:0/2019864003 shutdown_connections 2024-09-19T07:06:38.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:38.531+0000 7f14326d4640 1 -- 172.21.15.99:0/2019864003 wait complete. 2024-09-19T07:06:38.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:38.531+0000 7f14326d4640 1 Processor -- start 2024-09-19T07:06:38.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:38.531+0000 7f14326d4640 1 -- start start 2024-09-19T07:06:38.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:38.532+0000 7f14326d4640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f142c102530 0x7f142c06fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:38.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:38.532+0000 7f14326d4640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f142c102ed0 0x7f142c06ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:38.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:38.532+0000 7f14326d4640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f142c070520 con 0x7f142c102530 2024-09-19T07:06:38.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:38.532+0000 7f14326d4640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f142c070690 con 0x7f142c102ed0 2024-09-19T07:06:38.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:38.532+0000 7f142bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f142c102530 0x7f142c06fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:38.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:38.532+0000 7f142bfff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f142c102530 0x7f142c06fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46450/0 (socket says 172.21.15.99:46450) 2024-09-19T07:06:38.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:38.532+0000 7f142bfff640 1 -- 172.21.15.99:0/3098571361 learned_addr learned my addr 172.21.15.99:0/3098571361 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:06:38.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:38.532+0000 7f1423fff640 1 --2- 172.21.15.99:0/3098571361 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f142c102ed0 0x7f142c06ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:38.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:38.532+0000 7f142bfff640 1 -- 172.21.15.99:0/3098571361 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f142c102ed0 msgr2=0x7f142c06ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:38.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:38.532+0000 7f142bfff640 1 --2- 172.21.15.99:0/3098571361 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f142c102ed0 0x7f142c06ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:38.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:38.532+0000 7f142bfff640 1 -- 172.21.15.99:0/3098571361 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1414005040 con 0x7f142c102530 2024-09-19T07:06:38.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:38.532+0000 7f142bfff640 1 --2- 172.21.15.99:0/3098571361 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f142c102530 0x7f142c06fa10 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f141c00b790 tx=0x7f141c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:38.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:38.532+0000 7f14297fa640 1 -- 172.21.15.99:0/3098571361 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f141c00c700 con 0x7f142c102530 2024-09-19T07:06:38.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:38.532+0000 7f14326d4640 1 -- 172.21.15.99:0/3098571361 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f142c1195d0 con 0x7f142c102530 2024-09-19T07:06:38.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:38.532+0000 7f14297fa640 1 -- 172.21.15.99:0/3098571361 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f141c00cd00 con 0x7f142c102530 2024-09-19T07:06:38.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:38.532+0000 7f14297fa640 1 -- 172.21.15.99:0/3098571361 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f141c015e70 con 0x7f142c102530 2024-09-19T07:06:38.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:38.532+0000 7f14326d4640 1 -- 172.21.15.99:0/3098571361 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f142c1199c0 con 0x7f142c102530 2024-09-19T07:06:38.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:38.533+0000 7f14326d4640 1 -- 172.21.15.99:0/3098571361 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f142c0fdcb0 con 0x7f142c102530 2024-09-19T07:06:38.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:38.534+0000 7f14297fa640 1 -- 172.21.15.99:0/3098571361 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f141c012070 con 0x7f142c102530 2024-09-19T07:06:38.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:38.534+0000 7f14297fa640 1 --2- 172.21.15.99:0/3098571361 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f141806e530 0x7f14180709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:38.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:38.535+0000 7f14297fa640 1 -- 172.21.15.99:0/3098571361 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f141c08dc90 con 0x7f142c102530 2024-09-19T07:06:38.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:38.535+0000 7f1423fff640 1 --2- 172.21.15.99:0/3098571361 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f141806e530 0x7f14180709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:38.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:38.535+0000 7f1423fff640 1 --2- 172.21.15.99:0/3098571361 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f141806e530 0x7f14180709e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f1414000c00 tx=0x7f1414035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:38.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:38.539+0000 7f14297fa640 1 -- 172.21.15.99:0/3098571361 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f141c05a930 con 0x7f142c102530 2024-09-19T07:06:38.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:38.741+0000 7f14326d4640 1 -- 172.21.15.99:0/3098571361 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 34, "format": "json"} v 0) v1 -- 0x7f142c071100 con 0x7f142c102530 2024-09-19T07:06:38.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:38.741+0000 7f14297fa640 1 -- 172.21.15.99:0/3098571361 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 34, "format": "json"}]=0 dumped fsmap epoch 34 v35) v1 ==== 107+0+5265 (secure 0 0 0) 0x7f141c05a4c0 con 0x7f142c102530 2024-09-19T07:06:38.743 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-19T07:06:38.743 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":34,"btime":"2024-09-19T07:03:56:174572+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44309,"name":"cephfs.smithi117.nooexo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6825/1398895079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":1398895079},{"type":"v1","addr":"172.21.15.117:6825","nonce":1398895079}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":44329,"name":"cephfs.smithi117.bheqzh","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6827/3233337308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3233337308},{"type":"v1","addr":"172.21.15.117:6827","nonce":3233337308}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T06:37:40.838146+0000","modified":"2024-09-19T07:03:55.178056+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":77,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34378,"mds_1":34410},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34378":{"gid":34378,"name":"cephfs.smithi099.obarqf","rank":0,"incarnation":31,"state":"up:rejoin","state_seq":242,"addr":"172.21.15.99:6827/1859154203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1859154203},{"type":"v1","addr":"172.21.15.99:6827","nonce":1859154203}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34410":{"gid":34410,"name":"cephfs.smithi099.xehbxe","rank":1,"incarnation":31,"state":"up:rejoin","state_seq":238,"addr":"172.21.15.99:6829/1939453719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1939453719},{"type":"v1","addr":"172.21.15.99:6829","nonce":1939453719}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-19T07:06:38.743 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 34 2024-09-19T07:06:38.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:38.743+0000 7f14326d4640 1 -- 172.21.15.99:0/3098571361 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f141806e530 msgr2=0x7f14180709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:38.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:38.743+0000 7f14326d4640 1 --2- 172.21.15.99:0/3098571361 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f141806e530 0x7f14180709e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f1414000c00 tx=0x7f1414035040 comp rx=0 tx=0).stop 2024-09-19T07:06:38.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:38.743+0000 7f14326d4640 1 -- 172.21.15.99:0/3098571361 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f142c102530 msgr2=0x7f142c06fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:38.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:38.743+0000 7f14326d4640 1 --2- 172.21.15.99:0/3098571361 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f142c102530 0x7f142c06fa10 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f141c00b790 tx=0x7f141c0091d0 comp rx=0 tx=0).stop 2024-09-19T07:06:38.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:38.743+0000 7f14326d4640 1 -- 172.21.15.99:0/3098571361 shutdown_connections 2024-09-19T07:06:38.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:38.743+0000 7f14326d4640 1 --2- 172.21.15.99:0/3098571361 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f141806e530 0x7f14180709e0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:38.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:38.743+0000 7f14326d4640 1 --2- 172.21.15.99:0/3098571361 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f142c102ed0 0x7f142c06ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:38.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:38.743+0000 7f14326d4640 1 --2- 172.21.15.99:0/3098571361 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f142c102530 0x7f142c06fa10 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:38.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:38.743+0000 7f14326d4640 1 -- 172.21.15.99:0/3098571361 >> 172.21.15.99:0/3098571361 conn(0x7f142c0f80f0 msgr2=0x7f142c0f9130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:38.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:38.743+0000 7f14326d4640 1 -- 172.21.15.99:0/3098571361 shutdown_connections 2024-09-19T07:06:38.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:38.743+0000 7f14326d4640 1 -- 172.21.15.99:0/3098571361 wait complete. 2024-09-19T07:06:39.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:06:38 smithi099 ceph-mon[97031]: pgmap v729: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:06:39.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:06:38 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/3098571361' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-09-19T07:06:39.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:06:38 smithi117 ceph-mon[76771]: pgmap v729: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:06:39.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:06:38 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/3098571361' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-09-19T07:06:39.375 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-19T07:06:39.388 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-19T07:06:39.388 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-19T07:06:39.388 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T07:06:39.407 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-19T07:06:39.407 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T07:06:39.464 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-19T07:06:39.750 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T07:06:41.084 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:06:40 smithi099 ceph-mon[97031]: pgmap v730: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:06:41.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:06:40 smithi117 ceph-mon[76771]: pgmap v730: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:06:41.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:41.295+0000 7f95ce042640 1 -- 172.21.15.99:0/4231927661 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95c8101f40 msgr2=0x7f95c80fb4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:41.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:41.295+0000 7f95ce042640 1 --2- 172.21.15.99:0/4231927661 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95c8101f40 0x7f95c80fb4f0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f95b00048d0 tx=0x7f95b0009da0 comp rx=0 tx=0).stop 2024-09-19T07:06:41.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:41.295+0000 7f95ce042640 1 -- 172.21.15.99:0/4231927661 shutdown_connections 2024-09-19T07:06:41.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:41.295+0000 7f95ce042640 1 --2- 172.21.15.99:0/4231927661 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95c8101f40 0x7f95c80fb4f0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:41.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:41.295+0000 7f95ce042640 1 --2- 172.21.15.99:0/4231927661 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95c81015a0 0x7f95c8101970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:41.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:41.295+0000 7f95ce042640 1 -- 172.21.15.99:0/4231927661 >> 172.21.15.99:0/4231927661 conn(0x7f95c80f7030 msgr2=0x7f95c80f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:41.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:41.295+0000 7f95ce042640 1 -- 172.21.15.99:0/4231927661 shutdown_connections 2024-09-19T07:06:41.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:41.295+0000 7f95ce042640 1 -- 172.21.15.99:0/4231927661 wait complete. 2024-09-19T07:06:41.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:41.296+0000 7f95ce042640 1 Processor -- start 2024-09-19T07:06:41.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:41.296+0000 7f95ce042640 1 -- start start 2024-09-19T07:06:41.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:41.296+0000 7f95ce042640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95c81015a0 0x7f95c810e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:41.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:41.296+0000 7f95ce042640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95c8101f40 0x7f95c810e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:41.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:41.296+0000 7f95ce042640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c810ee80 con 0x7f95c8101f40 2024-09-19T07:06:41.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:41.296+0000 7f95ce042640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c810eff0 con 0x7f95c81015a0 2024-09-19T07:06:41.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:41.296+0000 7f95bffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95c8101f40 0x7f95c810e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:41.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:41.296+0000 7f95bffff640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95c8101f40 0x7f95c810e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46476/0 (socket says 172.21.15.99:46476) 2024-09-19T07:06:41.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:41.296+0000 7f95bffff640 1 -- 172.21.15.99:0/3235701873 learned_addr learned my addr 172.21.15.99:0/3235701873 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:06:41.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:41.296+0000 7f95c77fe640 1 --2- 172.21.15.99:0/3235701873 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95c81015a0 0x7f95c810e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:41.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:41.296+0000 7f95bffff640 1 -- 172.21.15.99:0/3235701873 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95c81015a0 msgr2=0x7f95c810e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:41.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:41.296+0000 7f95bffff640 1 --2- 172.21.15.99:0/3235701873 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95c81015a0 0x7f95c810e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:41.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:41.296+0000 7f95bffff640 1 -- 172.21.15.99:0/3235701873 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b0005040 con 0x7f95c8101f40 2024-09-19T07:06:41.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:41.296+0000 7f95bffff640 1 --2- 172.21.15.99:0/3235701873 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95c8101f40 0x7f95c810e830 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f95b00043d0 tx=0x7f95b0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:41.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:41.297+0000 7f95c4ff9640 1 -- 172.21.15.99:0/3235701873 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f95b0038070 con 0x7f95c8101f40 2024-09-19T07:06:41.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:41.297+0000 7f95c4ff9640 1 -- 172.21.15.99:0/3235701873 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f95b00096e0 con 0x7f95c8101f40 2024-09-19T07:06:41.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:41.297+0000 7f95ce042640 1 -- 172.21.15.99:0/3235701873 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95c8117360 con 0x7f95c8101f40 2024-09-19T07:06:41.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:41.297+0000 7f95c4ff9640 1 -- 172.21.15.99:0/3235701873 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f95b002c8a0 con 0x7f95c8101f40 2024-09-19T07:06:41.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:41.297+0000 7f95ce042640 1 -- 172.21.15.99:0/3235701873 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95c81177c0 con 0x7f95c8101f40 2024-09-19T07:06:41.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:41.298+0000 7f95ce042640 1 -- 172.21.15.99:0/3235701873 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95c80fac90 con 0x7f95c8101f40 2024-09-19T07:06:41.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:41.298+0000 7f95c4ff9640 1 -- 172.21.15.99:0/3235701873 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f95b0030020 con 0x7f95c8101f40 2024-09-19T07:06:41.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:41.299+0000 7f95c4ff9640 1 --2- 172.21.15.99:0/3235701873 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f95b406e530 0x7f95b40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:41.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:41.299+0000 7f95c77fe640 1 --2- 172.21.15.99:0/3235701873 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f95b406e530 0x7f95b40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:41.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:41.299+0000 7f95c4ff9640 1 -- 172.21.15.99:0/3235701873 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f95b00aded0 con 0x7f95c8101f40 2024-09-19T07:06:41.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:41.300+0000 7f95c77fe640 1 --2- 172.21.15.99:0/3235701873 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f95b406e530 0x7f95b40709e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f95b8004ce0 tx=0x7f95b800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:41.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:41.303+0000 7f95c4ff9640 1 -- 172.21.15.99:0/3235701873 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f95b0077000 con 0x7f95c8101f40 2024-09-19T07:06:41.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:41.483+0000 7f95ce042640 1 -- 172.21.15.99:0/3235701873 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f95c8066200 con 0x7f95c8101f40 2024-09-19T07:06:41.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:41.483+0000 7f95c4ff9640 1 -- 172.21.15.99:0/3235701873 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 39 entries v83) v1 ==== 81+0+2320 (secure 0 0 0) 0x7f95b007a6c0 con 0x7f95c8101f40 2024-09-19T07:06:41.485 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.117:6825/2367330767 2024-09-20T06:47:50.076348+0000 2024-09-19T07:06:41.485 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.117:6824/2367330767 2024-09-20T06:47:50.076348+0000 2024-09-19T07:06:41.485 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:6828/1508711176 2024-09-20T06:47:50.076335+0000 2024-09-19T07:06:41.485 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:0/1329438591 2024-09-20T06:43:36.797433+0000 2024-09-19T07:06:41.485 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:6801/3542536515 2024-09-20T06:43:36.797433+0000 2024-09-19T07:06:41.485 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:0/1020291091 2024-09-20T06:43:36.797433+0000 2024-09-19T07:06:41.485 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.117:6828/1735340892 2024-09-20T06:41:51.055236+0000 2024-09-19T07:06:41.485 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:6826/3597497125 2024-09-20T06:37:56.550420+0000 2024-09-19T07:06:41.485 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.117:6829/1735340892 2024-09-20T06:41:51.055236+0000 2024-09-19T07:06:41.485 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:0/3333547531 2024-09-20T06:40:09.041793+0000 2024-09-19T07:06:41.485 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:0/1304237604 2024-09-20T06:31:28.226981+0000 2024-09-19T07:06:41.486 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:0/2624442023 2024-09-20T06:40:09.041793+0000 2024-09-19T07:06:41.486 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:6827/3597497125 2024-09-20T06:37:56.550420+0000 2024-09-19T07:06:41.486 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:0/2540279353 2024-09-20T06:31:28.226981+0000 2024-09-19T07:06:41.486 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.117:0/3655701025 2024-09-20T06:41:51.055236+0000 2024-09-19T07:06:41.486 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:0/2384298149 2024-09-20T06:43:36.797433+0000 2024-09-19T07:06:41.486 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:0/1529455887 2024-09-20T06:32:05.259470+0000 2024-09-19T07:06:41.486 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:6800/2333024932 2024-09-20T06:33:04.480906+0000 2024-09-19T07:06:41.486 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.117:0/1717534112 2024-09-20T06:41:51.055236+0000 2024-09-19T07:06:41.486 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:0/2972598697 2024-09-20T06:43:36.797433+0000 2024-09-19T07:06:41.486 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:6801/3738534523 2024-09-20T06:32:05.259470+0000 2024-09-19T07:06:41.486 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.117:0/3390899782 2024-09-20T06:41:51.055236+0000 2024-09-19T07:06:41.486 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:6800/3677321821 2024-09-20T06:31:28.226981+0000 2024-09-19T07:06:41.486 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:6801/886909451 2024-09-20T06:40:09.041793+0000 2024-09-19T07:06:41.487 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:6801/2333024932 2024-09-20T06:33:04.480906+0000 2024-09-19T07:06:41.487 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:6801/3677321821 2024-09-20T06:31:28.226981+0000 2024-09-19T07:06:41.487 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:6829/1508711176 2024-09-20T06:47:50.076335+0000 2024-09-19T07:06:41.487 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.117:0/1469354350 2024-09-20T06:41:51.055236+0000 2024-09-19T07:06:41.487 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:6800/3542536515 2024-09-20T06:43:36.797433+0000 2024-09-19T07:06:41.487 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:0/1213923731 2024-09-20T06:33:04.480906+0000 2024-09-19T07:06:41.487 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:0/294185414 2024-09-20T06:33:04.480906+0000 2024-09-19T07:06:41.487 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:6800/886909451 2024-09-20T06:40:09.041793+0000 2024-09-19T07:06:41.487 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:0/2555968755 2024-09-20T06:40:09.041793+0000 2024-09-19T07:06:41.487 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:0/1060821876 2024-09-20T06:33:04.480906+0000 2024-09-19T07:06:41.487 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:6800/3738534523 2024-09-20T06:32:05.259470+0000 2024-09-19T07:06:41.487 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:0/1023918254 2024-09-20T06:32:05.259470+0000 2024-09-19T07:06:41.487 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:0/1101178780 2024-09-20T06:40:09.041793+0000 2024-09-19T07:06:41.488 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:0/3847616959 2024-09-20T06:32:05.259470+0000 2024-09-19T07:06:41.488 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:0/354724072 2024-09-20T06:31:28.226981+0000 2024-09-19T07:06:41.488 INFO:teuthology.orchestra.run.smithi099.stderr:listed 39 entries 2024-09-19T07:06:41.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:41.485+0000 7f95ce042640 1 -- 172.21.15.99:0/3235701873 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f95b406e530 msgr2=0x7f95b40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:41.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:41.485+0000 7f95ce042640 1 --2- 172.21.15.99:0/3235701873 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f95b406e530 0x7f95b40709e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f95b8004ce0 tx=0x7f95b800b040 comp rx=0 tx=0).stop 2024-09-19T07:06:41.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:41.485+0000 7f95ce042640 1 -- 172.21.15.99:0/3235701873 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95c8101f40 msgr2=0x7f95c810e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:41.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:41.485+0000 7f95ce042640 1 --2- 172.21.15.99:0/3235701873 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95c8101f40 0x7f95c810e830 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f95b00043d0 tx=0x7f95b0009da0 comp rx=0 tx=0).stop 2024-09-19T07:06:41.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:41.485+0000 7f95ce042640 1 -- 172.21.15.99:0/3235701873 shutdown_connections 2024-09-19T07:06:41.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:41.485+0000 7f95ce042640 1 --2- 172.21.15.99:0/3235701873 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f95b406e530 0x7f95b40709e0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:41.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:41.485+0000 7f95ce042640 1 --2- 172.21.15.99:0/3235701873 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f95c8101f40 0x7f95c810e830 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:41.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:41.485+0000 7f95ce042640 1 --2- 172.21.15.99:0/3235701873 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95c81015a0 0x7f95c810e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:41.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:41.485+0000 7f95ce042640 1 -- 172.21.15.99:0/3235701873 >> 172.21.15.99:0/3235701873 conn(0x7f95c80f7030 msgr2=0x7f95c80f8090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:41.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:41.486+0000 7f95ce042640 1 -- 172.21.15.99:0/3235701873 shutdown_connections 2024-09-19T07:06:41.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:41.486+0000 7f95ce042640 1 -- 172.21.15.99:0/3235701873 wait complete. 2024-09-19T07:06:42.088 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:06:41 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/3235701873' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T07:06:42.112 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-19T07:06:42.112 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T07:06:42.130 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid a73eb958-7650-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-19T07:06:42.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:06:41 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/3235701873' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T07:06:42.418 INFO:teuthology.orchestra.run.smithi099.stderr:Inferring config /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/mon.smithi099/config 2024-09-19T07:06:43.148 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:06:42 smithi099 ceph-mon[97031]: pgmap v731: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:06:43.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:06:42 smithi117 ceph-mon[76771]: pgmap v731: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:06:43.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:43.949+0000 7f45d1230640 1 -- 172.21.15.99:0/3920924754 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45cc102ef0 msgr2=0x7f45cc0fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:43.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:43.949+0000 7f45d1230640 1 --2- 172.21.15.99:0/3920924754 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45cc102ef0 0x7f45cc0fc5b0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f45b40048d0 tx=0x7f45b4009da0 comp rx=0 tx=0).stop 2024-09-19T07:06:43.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:43.949+0000 7f45d1230640 1 -- 172.21.15.99:0/3920924754 shutdown_connections 2024-09-19T07:06:43.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:43.949+0000 7f45d1230640 1 --2- 172.21.15.99:0/3920924754 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45cc102ef0 0x7f45cc0fc5b0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:43.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:43.949+0000 7f45d1230640 1 --2- 172.21.15.99:0/3920924754 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45cc102550 0x7f45cc102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:43.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:43.950+0000 7f45d1230640 1 -- 172.21.15.99:0/3920924754 >> 172.21.15.99:0/3920924754 conn(0x7f45cc0f80f0 msgr2=0x7f45cc0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:43.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:43.950+0000 7f45d1230640 1 -- 172.21.15.99:0/3920924754 shutdown_connections 2024-09-19T07:06:43.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:43.950+0000 7f45d1230640 1 -- 172.21.15.99:0/3920924754 wait complete. 2024-09-19T07:06:43.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:43.950+0000 7f45d1230640 1 Processor -- start 2024-09-19T07:06:43.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:43.950+0000 7f45d1230640 1 -- start start 2024-09-19T07:06:43.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:43.950+0000 7f45d1230640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45cc102550 0x7f45cc113500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:43.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:43.950+0000 7f45d1230640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45cc102ef0 0x7f45cc113a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:43.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:43.950+0000 7f45d1230640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45cc114090 con 0x7f45cc102550 2024-09-19T07:06:43.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:43.950+0000 7f45d1230640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45cc10d4a0 con 0x7f45cc102ef0 2024-09-19T07:06:43.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:43.951+0000 7f45cad9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45cc102550 0x7f45cc113500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:43.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:43.951+0000 7f45cad9d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45cc102550 0x7f45cc113500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46490/0 (socket says 172.21.15.99:46490) 2024-09-19T07:06:43.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:43.951+0000 7f45cad9d640 1 -- 172.21.15.99:0/3826462462 learned_addr learned my addr 172.21.15.99:0/3826462462 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-09-19T07:06:43.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:43.951+0000 7f45ca59c640 1 --2- 172.21.15.99:0/3826462462 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45cc102ef0 0x7f45cc113a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:43.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:43.951+0000 7f45cad9d640 1 -- 172.21.15.99:0/3826462462 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45cc102ef0 msgr2=0x7f45cc113a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:43.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:43.951+0000 7f45cad9d640 1 --2- 172.21.15.99:0/3826462462 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45cc102ef0 0x7f45cc113a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:43.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:43.951+0000 7f45cad9d640 1 -- 172.21.15.99:0/3826462462 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b4005040 con 0x7f45cc102550 2024-09-19T07:06:43.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:43.951+0000 7f45cad9d640 1 --2- 172.21.15.99:0/3826462462 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45cc102550 0x7f45cc113500 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f45c4002a50 tx=0x7f45c4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:43.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:43.951+0000 7f45c37fe640 1 -- 172.21.15.99:0/3826462462 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45c4007c30 con 0x7f45cc102550 2024-09-19T07:06:43.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:43.951+0000 7f45c37fe640 1 -- 172.21.15.99:0/3826462462 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f45c400f040 con 0x7f45cc102550 2024-09-19T07:06:43.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:43.951+0000 7f45d1230640 1 -- 172.21.15.99:0/3826462462 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45cc10d780 con 0x7f45cc102550 2024-09-19T07:06:43.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:43.951+0000 7f45c37fe640 1 -- 172.21.15.99:0/3826462462 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45c400dad0 con 0x7f45cc102550 2024-09-19T07:06:43.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:43.951+0000 7f45d1230640 1 -- 172.21.15.99:0/3826462462 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45cc10dcf0 con 0x7f45cc102550 2024-09-19T07:06:43.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:43.952+0000 7f45d1230640 1 -- 172.21.15.99:0/3826462462 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45cc0fdcd0 con 0x7f45cc102550 2024-09-19T07:06:43.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:43.953+0000 7f45c37fe640 1 -- 172.21.15.99:0/3826462462 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 41) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f45c400dc30 con 0x7f45cc102550 2024-09-19T07:06:43.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:43.953+0000 7f45c37fe640 1 --2- 172.21.15.99:0/3826462462 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f45b806e530 0x7f45b80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T07:06:43.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:43.953+0000 7f45c37fe640 1 -- 172.21.15.99:0/3826462462 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f45c408df30 con 0x7f45cc102550 2024-09-19T07:06:43.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:43.953+0000 7f45ca59c640 1 --2- 172.21.15.99:0/3826462462 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f45b806e530 0x7f45b80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T07:06:43.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:43.954+0000 7f45ca59c640 1 --2- 172.21.15.99:0/3826462462 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f45b806e530 0x7f45b80709e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f45b40048a0 tx=0x7f45b4035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T07:06:43.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:43.958+0000 7f45c37fe640 1 -- 172.21.15.99:0/3826462462 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188913 (secure 0 0 0) 0x7f45c40570a0 con 0x7f45cc102550 2024-09-19T07:06:44.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:44.134+0000 7f45d1230640 1 -- 172.21.15.99:0/3826462462 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f45cc109590 con 0x7f45cc102550 2024-09-19T07:06:44.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:44.134+0000 7f45c37fe640 1 -- 172.21.15.99:0/3826462462 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 39 entries v83) v1 ==== 81+0+2320 (secure 0 0 0) 0x7f45c405a760 con 0x7f45cc102550 2024-09-19T07:06:44.136 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.117:6825/2367330767 2024-09-20T06:47:50.076348+0000 2024-09-19T07:06:44.136 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.117:6824/2367330767 2024-09-20T06:47:50.076348+0000 2024-09-19T07:06:44.136 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:6828/1508711176 2024-09-20T06:47:50.076335+0000 2024-09-19T07:06:44.136 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:0/1329438591 2024-09-20T06:43:36.797433+0000 2024-09-19T07:06:44.137 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:6801/3542536515 2024-09-20T06:43:36.797433+0000 2024-09-19T07:06:44.137 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:0/1020291091 2024-09-20T06:43:36.797433+0000 2024-09-19T07:06:44.137 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.117:6828/1735340892 2024-09-20T06:41:51.055236+0000 2024-09-19T07:06:44.137 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:6826/3597497125 2024-09-20T06:37:56.550420+0000 2024-09-19T07:06:44.137 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.117:6829/1735340892 2024-09-20T06:41:51.055236+0000 2024-09-19T07:06:44.138 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:0/3333547531 2024-09-20T06:40:09.041793+0000 2024-09-19T07:06:44.138 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:0/1304237604 2024-09-20T06:31:28.226981+0000 2024-09-19T07:06:44.138 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:0/2624442023 2024-09-20T06:40:09.041793+0000 2024-09-19T07:06:44.138 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:6827/3597497125 2024-09-20T06:37:56.550420+0000 2024-09-19T07:06:44.139 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:0/2540279353 2024-09-20T06:31:28.226981+0000 2024-09-19T07:06:44.139 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.117:0/3655701025 2024-09-20T06:41:51.055236+0000 2024-09-19T07:06:44.139 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:0/2384298149 2024-09-20T06:43:36.797433+0000 2024-09-19T07:06:44.139 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:0/1529455887 2024-09-20T06:32:05.259470+0000 2024-09-19T07:06:44.140 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:6800/2333024932 2024-09-20T06:33:04.480906+0000 2024-09-19T07:06:44.140 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.117:0/1717534112 2024-09-20T06:41:51.055236+0000 2024-09-19T07:06:44.140 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:0/2972598697 2024-09-20T06:43:36.797433+0000 2024-09-19T07:06:44.140 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:6801/3738534523 2024-09-20T06:32:05.259470+0000 2024-09-19T07:06:44.140 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.117:0/3390899782 2024-09-20T06:41:51.055236+0000 2024-09-19T07:06:44.140 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:6800/3677321821 2024-09-20T06:31:28.226981+0000 2024-09-19T07:06:44.140 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:6801/886909451 2024-09-20T06:40:09.041793+0000 2024-09-19T07:06:44.141 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:6801/2333024932 2024-09-20T06:33:04.480906+0000 2024-09-19T07:06:44.141 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:6801/3677321821 2024-09-20T06:31:28.226981+0000 2024-09-19T07:06:44.141 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:6829/1508711176 2024-09-20T06:47:50.076335+0000 2024-09-19T07:06:44.141 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.117:0/1469354350 2024-09-20T06:41:51.055236+0000 2024-09-19T07:06:44.141 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:6800/3542536515 2024-09-20T06:43:36.797433+0000 2024-09-19T07:06:44.141 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:0/1213923731 2024-09-20T06:33:04.480906+0000 2024-09-19T07:06:44.141 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:0/294185414 2024-09-20T06:33:04.480906+0000 2024-09-19T07:06:44.141 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:6800/886909451 2024-09-20T06:40:09.041793+0000 2024-09-19T07:06:44.141 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:0/2555968755 2024-09-20T06:40:09.041793+0000 2024-09-19T07:06:44.141 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:0/1060821876 2024-09-20T06:33:04.480906+0000 2024-09-19T07:06:44.141 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:6800/3738534523 2024-09-20T06:32:05.259470+0000 2024-09-19T07:06:44.142 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:0/1023918254 2024-09-20T06:32:05.259470+0000 2024-09-19T07:06:44.142 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:0/1101178780 2024-09-20T06:40:09.041793+0000 2024-09-19T07:06:44.142 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:0/3847616959 2024-09-20T06:32:05.259470+0000 2024-09-19T07:06:44.142 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99:0/354724072 2024-09-20T06:31:28.226981+0000 2024-09-19T07:06:44.143 INFO:teuthology.orchestra.run.smithi099.stderr:listed 39 entries 2024-09-19T07:06:44.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:44.136+0000 7f45d1230640 1 -- 172.21.15.99:0/3826462462 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f45b806e530 msgr2=0x7f45b80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:44.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:44.136+0000 7f45d1230640 1 --2- 172.21.15.99:0/3826462462 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f45b806e530 0x7f45b80709e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f45b40048a0 tx=0x7f45b4035040 comp rx=0 tx=0).stop 2024-09-19T07:06:44.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:44.136+0000 7f45d1230640 1 -- 172.21.15.99:0/3826462462 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45cc102550 msgr2=0x7f45cc113500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T07:06:44.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:44.136+0000 7f45d1230640 1 --2- 172.21.15.99:0/3826462462 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45cc102550 0x7f45cc113500 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f45c4002a50 tx=0x7f45c4004600 comp rx=0 tx=0).stop 2024-09-19T07:06:44.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:44.136+0000 7f45d1230640 1 -- 172.21.15.99:0/3826462462 shutdown_connections 2024-09-19T07:06:44.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:44.136+0000 7f45d1230640 1 --2- 172.21.15.99:0/3826462462 >> [v2:172.21.15.99:6800/3704270170,v1:172.21.15.99:6801/3704270170] conn(0x7f45b806e530 0x7f45b80709e0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:44.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:44.136+0000 7f45d1230640 1 --2- 172.21.15.99:0/3826462462 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45cc102ef0 0x7f45cc113a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:44.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:44.136+0000 7f45d1230640 1 --2- 172.21.15.99:0/3826462462 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f45cc102550 0x7f45cc113500 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T07:06:44.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:44.136+0000 7f45d1230640 1 -- 172.21.15.99:0/3826462462 >> 172.21.15.99:0/3826462462 conn(0x7f45cc0f80f0 msgr2=0x7f45cc0f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T07:06:44.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:44.137+0000 7f45d1230640 1 -- 172.21.15.99:0/3826462462 shutdown_connections 2024-09-19T07:06:44.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-19T07:06:44.137+0000 7f45d1230640 1 -- 172.21.15.99:0/3826462462 wait complete. 2024-09-19T07:06:44.767 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi099.front.sepia.ceph.com... 2024-09-19T07:06:44.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T07:06:44.767 DEBUG:teuthology.orchestra.run.smithi099:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-19T07:06:44.795 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T07:06:44.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:06:44 smithi099 ceph-mon[97031]: pgmap v732: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:06:44.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:06:44 smithi099 ceph-mon[97031]: from='client.? 172.21.15.99:0/3826462462' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T07:06:45.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:06:44 smithi117 ceph-mon[76771]: pgmap v732: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:06:45.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:06:44 smithi117 ceph-mon[76771]: from='client.? 172.21.15.99:0/3826462462' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T07:06:46.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:06:46 smithi099 ceph-mon[97031]: pgmap v733: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:06:47.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:06:46 smithi117 ceph-mon[76771]: pgmap v733: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:06:49.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:06:48 smithi099 ceph-mon[97031]: pgmap v734: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:06:49.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:06:48 smithi117 ceph-mon[76771]: pgmap v734: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:06:51.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:06:50 smithi099 ceph-mon[97031]: pgmap v735: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:06:51.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:06:50 smithi117 ceph-mon[76771]: pgmap v735: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:06:53.149 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:06:52 smithi099 ceph-mon[97031]: pgmap v736: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:06:53.149 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:06:52 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:06:53.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:06:52 smithi117 ceph-mon[76771]: pgmap v736: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:06:53.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:06:52 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:06:55.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:06:54 smithi099 ceph-mon[97031]: pgmap v737: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:06:55.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:06:54 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:06:55.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:06:54 smithi117 ceph-mon[76771]: pgmap v737: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:06:55.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:06:54 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:06:56.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:06:55 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:06:56.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:06:55 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:06:56.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:06:55 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T07:06:56.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:06:55 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:06:56.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:06:55 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:06:56.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:06:55 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T07:06:57.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:06:56 smithi099 ceph-mon[97031]: pgmap v738: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:06:57.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:06:56 smithi117 ceph-mon[76771]: pgmap v738: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:06:59.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:06:58 smithi099 ceph-mon[97031]: pgmap v739: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:06:59.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:06:58 smithi117 ceph-mon[76771]: pgmap v739: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:07:01.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:07:00 smithi099 ceph-mon[97031]: pgmap v740: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:07:01.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:07:00 smithi117 ceph-mon[76771]: pgmap v740: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:07:03.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:07:02 smithi099 ceph-mon[97031]: pgmap v741: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:07:03.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:07:02 smithi117 ceph-mon[76771]: pgmap v741: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:07:05.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:07:04 smithi099 ceph-mon[97031]: pgmap v742: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:07:05.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:07:04 smithi117 ceph-mon[76771]: pgmap v742: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:07:07.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:07:06 smithi099 ceph-mon[97031]: pgmap v743: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:07:07.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:07:06 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:07:07.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:07:06 smithi117 ceph-mon[76771]: pgmap v743: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:07:07.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:07:06 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:07:09.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:07:08 smithi099 ceph-mon[97031]: pgmap v744: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:07:09.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:07:08 smithi117 ceph-mon[76771]: pgmap v744: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:07:11.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:07:10 smithi117 ceph-mon[76771]: pgmap v745: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:07:11.455 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:07:10 smithi099 ceph-mon[97031]: pgmap v745: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:07:13.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:07:12 smithi117 ceph-mon[76771]: pgmap v746: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:07:13.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:07:12 smithi099 ceph-mon[97031]: pgmap v746: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:07:15.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:07:14 smithi117 ceph-mon[76771]: pgmap v747: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:07:15.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:07:14 smithi099 ceph-mon[97031]: pgmap v747: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:07:17.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:07:16 smithi117 ceph-mon[76771]: pgmap v748: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:07:17.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:07:16 smithi099 ceph-mon[97031]: pgmap v748: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:07:19.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:07:18 smithi117 ceph-mon[76771]: pgmap v749: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:07:19.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:07:18 smithi099 ceph-mon[97031]: pgmap v749: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:07:21.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:07:20 smithi117 ceph-mon[76771]: pgmap v750: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:07:21.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:07:20 smithi099 ceph-mon[97031]: pgmap v750: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:07:22.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:07:21 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:07:22.314 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:07:21 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:07:23.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:07:22 smithi117 ceph-mon[76771]: pgmap v751: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:07:23.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:07:22 smithi099 ceph-mon[97031]: pgmap v751: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:07:25.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:07:24 smithi117 ceph-mon[76771]: pgmap v752: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:07:25.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:07:24 smithi099 ceph-mon[97031]: pgmap v752: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:07:27.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:07:26 smithi117 ceph-mon[76771]: pgmap v753: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:07:27.915 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:07:26 smithi099 ceph-mon[97031]: pgmap v753: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:07:29.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:07:28 smithi117 ceph-mon[76771]: pgmap v754: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:07:29.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:07:28 smithi099 ceph-mon[97031]: pgmap v754: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:07:31.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:07:30 smithi117 ceph-mon[76771]: pgmap v755: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:07:31.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:07:30 smithi099 ceph-mon[97031]: pgmap v755: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:07:33.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:07:32 smithi117 ceph-mon[76771]: pgmap v756: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:07:33.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:07:32 smithi099 ceph-mon[97031]: pgmap v756: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:07:35.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:07:34 smithi117 ceph-mon[76771]: pgmap v757: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:07:35.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:07:34 smithi099 ceph-mon[97031]: pgmap v757: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:07:37.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:07:37 smithi117 ceph-mon[76771]: pgmap v758: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:07:37.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:07:37 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:07:37.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:07:37 smithi099 ceph-mon[97031]: pgmap v758: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:07:37.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:07:37 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:07:39.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:07:39 smithi117 ceph-mon[76771]: pgmap v759: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:07:39.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:07:39 smithi099 ceph-mon[97031]: pgmap v759: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:07:41.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:07:41 smithi117 ceph-mon[76771]: pgmap v760: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:07:41.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:07:41 smithi099 ceph-mon[97031]: pgmap v760: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:07:43.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:07:43 smithi117 ceph-mon[76771]: pgmap v761: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:07:43.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:07:43 smithi099 ceph-mon[97031]: pgmap v761: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:07:45.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:07:45 smithi117 ceph-mon[76771]: pgmap v762: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:07:45.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:07:45 smithi099 ceph-mon[97031]: pgmap v762: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:07:47.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:07:47 smithi117 ceph-mon[76771]: pgmap v763: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:07:47.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:07:47 smithi099 ceph-mon[97031]: pgmap v763: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:07:49.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:07:49 smithi117 ceph-mon[76771]: pgmap v764: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:07:49.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:07:49 smithi099 ceph-mon[97031]: pgmap v764: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:07:51.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:07:51 smithi117 ceph-mon[76771]: pgmap v765: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:07:51.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:07:51 smithi099 ceph-mon[97031]: pgmap v765: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:07:52.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:07:52 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:07:52.314 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:07:52 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:07:53.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:07:53 smithi117 ceph-mon[76771]: pgmap v766: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:07:53.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:07:53 smithi099 ceph-mon[97031]: pgmap v766: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:07:55.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:07:55 smithi117 ceph-mon[76771]: pgmap v767: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:07:55.455 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:07:55 smithi099 ceph-mon[97031]: pgmap v767: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:07:56.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:07:56 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:07:56.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:07:56 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:07:56.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:07:56 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:07:56.312 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:07:56 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T07:07:56.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:07:56 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:07:56.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:07:56 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:07:56.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:07:56 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:07:56.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:07:56 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T07:07:57.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:07:57 smithi117 ceph-mon[76771]: pgmap v768: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:07:57.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:07:57 smithi099 ceph-mon[97031]: pgmap v768: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:07:59.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:07:59 smithi117 ceph-mon[76771]: pgmap v769: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:07:59.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:07:59 smithi099 ceph-mon[97031]: pgmap v769: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:08:01.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:08:01 smithi117 ceph-mon[76771]: pgmap v770: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:08:01.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:08:01 smithi099 ceph-mon[97031]: pgmap v770: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:08:03.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:08:03 smithi117 ceph-mon[76771]: pgmap v771: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:08:03.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:08:03 smithi099 ceph-mon[97031]: pgmap v771: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:08:05.206 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:08:05 smithi099 ceph-mon[97031]: pgmap v772: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:08:05.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:08:05 smithi117 ceph-mon[76771]: pgmap v772: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:08:07.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:08:07 smithi117 ceph-mon[76771]: pgmap v773: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:08:07.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:08:07 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:08:07.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:08:07 smithi099 ceph-mon[97031]: pgmap v773: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:08:07.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:08:07 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:08:09.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:08:09 smithi099 ceph-mon[97031]: pgmap v774: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:08:09.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:08:09 smithi117 ceph-mon[76771]: pgmap v774: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:08:11.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:08:11 smithi099 ceph-mon[97031]: pgmap v775: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:08:11.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:08:11 smithi117 ceph-mon[76771]: pgmap v775: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:08:13.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:08:13 smithi099 ceph-mon[97031]: pgmap v776: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:08:13.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:08:13 smithi117 ceph-mon[76771]: pgmap v776: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:08:15.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:08:15 smithi099 ceph-mon[97031]: pgmap v777: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:08:15.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:08:15 smithi117 ceph-mon[76771]: pgmap v777: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:08:17.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:08:17 smithi099 ceph-mon[97031]: pgmap v778: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:08:17.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:08:17 smithi117 ceph-mon[76771]: pgmap v778: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:08:19.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:08:19 smithi099 ceph-mon[97031]: pgmap v779: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:08:19.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:08:19 smithi117 ceph-mon[76771]: pgmap v779: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:08:21.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:08:21 smithi099 ceph-mon[97031]: pgmap v780: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:08:21.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:08:21 smithi117 ceph-mon[76771]: pgmap v780: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:08:22.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:08:22 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:08:22.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:08:22 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:08:23.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:08:23 smithi099 ceph-mon[97031]: pgmap v781: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:08:23.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:08:23 smithi117 ceph-mon[76771]: pgmap v781: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:08:25.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:08:25 smithi099 ceph-mon[97031]: pgmap v782: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:08:25.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:08:25 smithi117 ceph-mon[76771]: pgmap v782: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:08:27.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:08:27 smithi099 ceph-mon[97031]: pgmap v783: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:08:27.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:08:27 smithi117 ceph-mon[76771]: pgmap v783: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:08:29.363 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:08:29 smithi117 ceph-mon[76771]: pgmap v784: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:08:29.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:08:29 smithi099 ceph-mon[97031]: pgmap v784: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:08:31.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:08:31 smithi099 ceph-mon[97031]: pgmap v785: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:08:31.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:08:31 smithi117 ceph-mon[76771]: pgmap v785: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:08:33.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:08:33 smithi099 ceph-mon[97031]: pgmap v786: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:08:33.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:08:33 smithi117 ceph-mon[76771]: pgmap v786: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:08:35.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:08:35 smithi099 ceph-mon[97031]: pgmap v787: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:08:35.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:08:35 smithi117 ceph-mon[76771]: pgmap v787: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:08:37.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:08:37 smithi099 ceph-mon[97031]: pgmap v788: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:08:37.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:08:37 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:08:37.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:08:37 smithi117 ceph-mon[76771]: pgmap v788: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:08:37.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:08:37 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:08:39.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:08:39 smithi099 ceph-mon[97031]: pgmap v789: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:08:39.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:08:39 smithi117 ceph-mon[76771]: pgmap v789: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:08:41.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:08:41 smithi099 ceph-mon[97031]: pgmap v790: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:08:41.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:08:41 smithi117 ceph-mon[76771]: pgmap v790: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:08:43.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:08:43 smithi099 ceph-mon[97031]: pgmap v791: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:08:43.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:08:43 smithi117 ceph-mon[76771]: pgmap v791: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:08:45.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:08:45 smithi099 ceph-mon[97031]: pgmap v792: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:08:45.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:08:45 smithi117 ceph-mon[76771]: pgmap v792: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:08:47.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:08:47 smithi099 ceph-mon[97031]: pgmap v793: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:08:47.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:08:47 smithi117 ceph-mon[76771]: pgmap v793: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:08:49.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:08:49 smithi099 ceph-mon[97031]: pgmap v794: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:08:49.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:08:49 smithi117 ceph-mon[76771]: pgmap v794: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:08:51.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:08:51 smithi099 ceph-mon[97031]: pgmap v795: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:08:51.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:08:51 smithi117 ceph-mon[76771]: pgmap v795: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:08:52.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:08:52 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:08:52.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:08:52 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:08:53.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:08:53 smithi099 ceph-mon[97031]: pgmap v796: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:08:53.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:08:53 smithi117 ceph-mon[76771]: pgmap v796: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:08:55.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:08:55 smithi099 ceph-mon[97031]: pgmap v797: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:08:55.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:08:55 smithi117 ceph-mon[76771]: pgmap v797: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:08:56.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:08:56 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:08:56.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:08:56 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:08:56.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:08:56 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:08:56.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:08:56 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T07:08:56.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:08:56 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:08:56.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:08:56 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:08:56.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:08:56 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:08:56.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:08:56 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T07:08:57.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:08:57 smithi099 ceph-mon[97031]: pgmap v798: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:08:57.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:08:57 smithi117 ceph-mon[76771]: pgmap v798: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:08:59.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:08:59 smithi099 ceph-mon[97031]: pgmap v799: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:08:59.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:08:59 smithi117 ceph-mon[76771]: pgmap v799: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:09:01.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:09:01 smithi099 ceph-mon[97031]: pgmap v800: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:09:01.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:09:01 smithi117 ceph-mon[76771]: pgmap v800: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:09:03.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:09:03 smithi099 ceph-mon[97031]: pgmap v801: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:09:03.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:09:03 smithi117 ceph-mon[76771]: pgmap v801: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:09:05.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:09:05 smithi099 ceph-mon[97031]: pgmap v802: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:09:05.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:09:05 smithi117 ceph-mon[76771]: pgmap v802: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:09:07.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:09:07 smithi099 ceph-mon[97031]: pgmap v803: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:09:07.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:09:07 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:09:07.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:09:07 smithi117 ceph-mon[76771]: pgmap v803: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:09:07.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:09:07 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:09:09.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:09:09 smithi099 ceph-mon[97031]: pgmap v804: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:09:09.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:09:09 smithi117 ceph-mon[76771]: pgmap v804: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:09:11.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:09:11 smithi099 ceph-mon[97031]: pgmap v805: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:09:11.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:09:11 smithi117 ceph-mon[76771]: pgmap v805: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:09:13.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:09:13 smithi099 ceph-mon[97031]: pgmap v806: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:09:13.562 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:09:13 smithi117 ceph-mon[76771]: pgmap v806: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:09:15.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:09:15 smithi099 ceph-mon[97031]: pgmap v807: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:09:15.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:09:15 smithi117 ceph-mon[76771]: pgmap v807: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:09:17.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:09:17 smithi099 ceph-mon[97031]: pgmap v808: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:09:17.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:09:17 smithi117 ceph-mon[76771]: pgmap v808: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:09:19.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:09:19 smithi099 ceph-mon[97031]: pgmap v809: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:09:19.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:09:19 smithi117 ceph-mon[76771]: pgmap v809: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:09:21.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:09:21 smithi099 ceph-mon[97031]: pgmap v810: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:09:21.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:09:21 smithi117 ceph-mon[76771]: pgmap v810: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:09:22.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:09:22 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:09:22.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:09:22 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:09:23.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:09:23 smithi099 ceph-mon[97031]: pgmap v811: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:09:23.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:09:23 smithi117 ceph-mon[76771]: pgmap v811: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:09:25.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:09:25 smithi099 ceph-mon[97031]: pgmap v812: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:09:25.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:09:25 smithi117 ceph-mon[76771]: pgmap v812: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:09:27.455 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:09:27 smithi099 ceph-mon[97031]: pgmap v813: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:09:27.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:09:27 smithi117 ceph-mon[76771]: pgmap v813: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:09:29.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:09:29 smithi117 ceph-mon[76771]: pgmap v814: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:09:29.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:09:29 smithi099 ceph-mon[97031]: pgmap v814: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:09:31.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:09:31 smithi117 ceph-mon[76771]: pgmap v815: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:09:31.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:09:31 smithi099 ceph-mon[97031]: pgmap v815: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:09:33.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:09:33 smithi099 ceph-mon[97031]: pgmap v816: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:09:33.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:09:33 smithi117 ceph-mon[76771]: pgmap v816: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:09:35.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:09:35 smithi117 ceph-mon[76771]: pgmap v817: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:09:35.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:09:35 smithi099 ceph-mon[97031]: pgmap v817: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:09:37.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:09:37 smithi117 ceph-mon[76771]: pgmap v818: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:09:37.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:09:37 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:09:37.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:09:37 smithi099 ceph-mon[97031]: pgmap v818: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:09:37.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:09:37 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:09:39.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:09:39 smithi117 ceph-mon[76771]: pgmap v819: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:09:39.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:09:39 smithi099 ceph-mon[97031]: pgmap v819: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:09:41.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:09:41 smithi117 ceph-mon[76771]: pgmap v820: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:09:41.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:09:41 smithi099 ceph-mon[97031]: pgmap v820: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:09:43.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:09:43 smithi099 ceph-mon[97031]: pgmap v821: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:09:43.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:09:43 smithi117 ceph-mon[76771]: pgmap v821: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:09:45.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:09:45 smithi117 ceph-mon[76771]: pgmap v822: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:09:45.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:09:45 smithi099 ceph-mon[97031]: pgmap v822: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:09:47.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:09:47 smithi117 ceph-mon[76771]: pgmap v823: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:09:47.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:09:47 smithi099 ceph-mon[97031]: pgmap v823: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:09:48.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:09:48 smithi117 ceph-mon[76771]: pgmap v824: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:09:48.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:09:48 smithi099 ceph-mon[97031]: pgmap v824: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:09:50.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:09:50 smithi117 ceph-mon[76771]: pgmap v825: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:09:50.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:09:50 smithi099 ceph-mon[97031]: pgmap v825: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:09:52.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:09:52 smithi117 ceph-mon[76771]: pgmap v826: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:09:52.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:09:52 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:09:52.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:09:52 smithi099 ceph-mon[97031]: pgmap v826: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:09:52.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:09:52 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:09:54.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:09:54 smithi117 ceph-mon[76771]: pgmap v827: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:09:54.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:09:54 smithi099 ceph-mon[97031]: pgmap v827: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:09:56.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:09:56 smithi117 ceph-mon[76771]: pgmap v828: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:09:56.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:09:56 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:09:56.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:09:56 smithi099 ceph-mon[97031]: pgmap v828: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:09:56.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:09:56 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:09:57.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:09:57 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:09:57.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:09:57 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:09:57.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:09:57 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T07:09:57.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:09:57 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:09:57.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:09:57 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:09:57.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:09:57 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T07:09:58.811 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:09:58 smithi117 ceph-mon[76771]: pgmap v829: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:09:58.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:09:58 smithi099 ceph-mon[97031]: pgmap v829: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:10:00.811 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:10:00 smithi117 ceph-mon[76771]: pgmap v830: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:10:00.811 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:10:00 smithi117 ceph-mon[76771]: overall HEALTH_OK 2024-09-19T07:10:00.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:10:00 smithi099 ceph-mon[97031]: pgmap v830: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:10:00.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:10:00 smithi099 ceph-mon[97031]: overall HEALTH_OK 2024-09-19T07:10:02.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:10:02 smithi099 ceph-mon[97031]: pgmap v831: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:10:02.811 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:10:02 smithi117 ceph-mon[76771]: pgmap v831: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:10:04.811 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:10:04 smithi117 ceph-mon[76771]: pgmap v832: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:10:04.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:10:04 smithi099 ceph-mon[97031]: pgmap v832: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:10:06.811 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:10:06 smithi117 ceph-mon[76771]: pgmap v833: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:10:06.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:10:06 smithi099 ceph-mon[97031]: pgmap v833: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:10:07.811 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:10:07 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:10:07.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:10:07 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:10:08.811 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:10:08 smithi117 ceph-mon[76771]: pgmap v834: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:10:08.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:10:08 smithi099 ceph-mon[97031]: pgmap v834: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:10:10.811 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:10:10 smithi117 ceph-mon[76771]: pgmap v835: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:10:10.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:10:10 smithi099 ceph-mon[97031]: pgmap v835: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:10:12.707 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:10:12 smithi099 ceph-mon[97031]: pgmap v836: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:10:12.824 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:10:12 smithi117 ceph-mon[76771]: pgmap v836: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:10:14.811 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:10:14 smithi117 ceph-mon[76771]: pgmap v837: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:10:14.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:10:14 smithi099 ceph-mon[97031]: pgmap v837: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:10:16.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:10:16 smithi099 ceph-mon[97031]: pgmap v838: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:10:17.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:10:16 smithi117 ceph-mon[76771]: pgmap v838: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:10:18.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:10:18 smithi099 ceph-mon[97031]: pgmap v839: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:10:19.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:10:18 smithi117 ceph-mon[76771]: pgmap v839: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:10:20.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:10:20 smithi099 ceph-mon[97031]: pgmap v840: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:10:21.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:10:20 smithi117 ceph-mon[76771]: pgmap v840: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:10:22.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:10:22 smithi099 ceph-mon[97031]: pgmap v841: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:10:22.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:10:22 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:10:23.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:10:22 smithi117 ceph-mon[76771]: pgmap v841: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:10:23.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:10:22 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:10:24.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:10:24 smithi099 ceph-mon[97031]: pgmap v842: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:10:25.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:10:24 smithi117 ceph-mon[76771]: pgmap v842: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:10:26.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:10:26 smithi099 ceph-mon[97031]: pgmap v843: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:10:27.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:10:26 smithi117 ceph-mon[76771]: pgmap v843: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:10:28.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:10:28 smithi099 ceph-mon[97031]: pgmap v844: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:10:29.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:10:28 smithi117 ceph-mon[76771]: pgmap v844: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:10:30.864 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:10:30 smithi117 ceph-mon[76771]: pgmap v845: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:10:30.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:10:30 smithi099 ceph-mon[97031]: pgmap v845: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:10:32.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:10:32 smithi099 ceph-mon[97031]: pgmap v846: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:10:33.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:10:32 smithi117 ceph-mon[76771]: pgmap v846: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:10:34.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:10:34 smithi099 ceph-mon[97031]: pgmap v847: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:10:35.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:10:34 smithi117 ceph-mon[76771]: pgmap v847: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:10:36.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:10:36 smithi099 ceph-mon[97031]: pgmap v848: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:10:37.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:10:36 smithi117 ceph-mon[76771]: pgmap v848: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:10:37.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:10:37 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:10:38.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:10:37 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:10:38.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:10:38 smithi099 ceph-mon[97031]: pgmap v849: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:10:39.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:10:38 smithi117 ceph-mon[76771]: pgmap v849: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:10:40.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:10:40 smithi099 ceph-mon[97031]: pgmap v850: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:10:41.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:10:40 smithi117 ceph-mon[76771]: pgmap v850: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:10:42.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:10:42 smithi099 ceph-mon[97031]: pgmap v851: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:10:43.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:10:42 smithi117 ceph-mon[76771]: pgmap v851: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:10:44.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:10:44 smithi099 ceph-mon[97031]: pgmap v852: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:10:45.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:10:44 smithi117 ceph-mon[76771]: pgmap v852: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:10:46.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:10:46 smithi099 ceph-mon[97031]: pgmap v853: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:10:47.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:10:46 smithi117 ceph-mon[76771]: pgmap v853: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:10:48.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:10:48 smithi099 ceph-mon[97031]: pgmap v854: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:10:49.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:10:48 smithi117 ceph-mon[76771]: pgmap v854: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:10:50.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:10:50 smithi099 ceph-mon[97031]: pgmap v855: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:10:51.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:10:50 smithi117 ceph-mon[76771]: pgmap v855: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:10:52.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:10:52 smithi099 ceph-mon[97031]: pgmap v856: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:10:52.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:10:52 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:10:53.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:10:52 smithi117 ceph-mon[76771]: pgmap v856: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:10:53.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:10:52 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:10:54.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:10:54 smithi099 ceph-mon[97031]: pgmap v857: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:10:55.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:10:54 smithi117 ceph-mon[76771]: pgmap v857: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:10:56.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:10:56 smithi099 ceph-mon[97031]: pgmap v858: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:10:57.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:10:56 smithi117 ceph-mon[76771]: pgmap v858: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:10:57.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:10:57 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:10:57.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:10:57 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:10:57.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:10:57 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:10:57.956 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:10:57 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T07:10:58.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:10:57 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T07:10:58.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:10:57 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T07:10:58.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:10:57 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T07:10:58.062 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:10:57 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' 2024-09-19T07:10:59.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:10:59 smithi117 ceph-mon[76771]: pgmap v859: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:10:59.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:10:59 smithi099 ceph-mon[97031]: pgmap v859: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:11:01.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:11:01 smithi099 ceph-mon[97031]: pgmap v860: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:11:01.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:11:01 smithi117 ceph-mon[76771]: pgmap v860: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:11:03.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:11:03 smithi099 ceph-mon[97031]: pgmap v861: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:11:03.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:11:03 smithi117 ceph-mon[76771]: pgmap v861: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:11:05.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:11:05 smithi099 ceph-mon[97031]: pgmap v862: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:11:05.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:11:05 smithi117 ceph-mon[76771]: pgmap v862: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:11:07.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:11:07 smithi099 ceph-mon[97031]: pgmap v863: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:11:07.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:11:07 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:11:07.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:11:07 smithi117 ceph-mon[76771]: pgmap v863: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:11:07.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:11:07 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:11:09.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:11:09 smithi099 ceph-mon[97031]: pgmap v864: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:11:09.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:11:09 smithi117 ceph-mon[76771]: pgmap v864: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:11:11.455 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:11:11 smithi099 ceph-mon[97031]: pgmap v865: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:11:11.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:11:11 smithi117 ceph-mon[76771]: pgmap v865: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:11:13.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:11:13 smithi099 ceph-mon[97031]: pgmap v866: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:11:13.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:11:13 smithi117 ceph-mon[76771]: pgmap v866: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:11:15.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:11:15 smithi099 ceph-mon[97031]: pgmap v867: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:11:15.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:11:15 smithi117 ceph-mon[76771]: pgmap v867: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:11:17.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:11:17 smithi099 ceph-mon[97031]: pgmap v868: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:11:17.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:11:17 smithi117 ceph-mon[76771]: pgmap v868: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:11:19.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:11:19 smithi099 ceph-mon[97031]: pgmap v869: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:11:19.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:11:19 smithi117 ceph-mon[76771]: pgmap v869: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:11:21.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:11:21 smithi099 ceph-mon[97031]: pgmap v870: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:11:21.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:11:21 smithi117 ceph-mon[76771]: pgmap v870: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:11:22.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:11:22 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:11:22.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:11:22 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:11:23.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:11:23 smithi099 ceph-mon[97031]: pgmap v871: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:11:23.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:11:23 smithi117 ceph-mon[76771]: pgmap v871: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:11:25.459 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:11:25 smithi099 ceph-mon[97031]: pgmap v872: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:11:25.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:11:25 smithi117 ceph-mon[76771]: pgmap v872: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:11:27.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:11:27 smithi099 ceph-mon[97031]: pgmap v873: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:11:27.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:11:27 smithi117 ceph-mon[76771]: pgmap v873: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:11:29.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:11:29 smithi099 ceph-mon[97031]: pgmap v874: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:11:29.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:11:29 smithi117 ceph-mon[76771]: pgmap v874: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:11:31.363 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:11:31 smithi117 ceph-mon[76771]: pgmap v875: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:11:31.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:11:31 smithi099 ceph-mon[97031]: pgmap v875: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:11:33.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:11:33 smithi099 ceph-mon[97031]: pgmap v876: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:11:33.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:11:33 smithi117 ceph-mon[76771]: pgmap v876: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:11:35.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:11:35 smithi099 ceph-mon[97031]: pgmap v877: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:11:35.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:11:35 smithi117 ceph-mon[76771]: pgmap v877: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:11:37.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:11:37 smithi099 ceph-mon[97031]: pgmap v878: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:11:37.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:11:37 smithi099 ceph-mon[97031]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:11:37.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:11:37 smithi117 ceph-mon[76771]: pgmap v878: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:11:37.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:11:37 smithi117 ceph-mon[76771]: from='mgr.34104 172.21.15.99:0/1241672642' entity='mgr.smithi099.pgvkqi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-19T07:11:39.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:11:39 smithi099 ceph-mon[97031]: pgmap v879: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:11:39.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:11:39 smithi117 ceph-mon[76771]: pgmap v879: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:11:41.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:11:41 smithi099 ceph-mon[97031]: pgmap v880: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:11:41.564 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:11:41 smithi117 ceph-mon[76771]: pgmap v880: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:11:43.456 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:11:43 smithi099 ceph-mon[97031]: pgmap v881: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:11:43.561 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:11:43 smithi117 ceph-mon[76771]: pgmap v881: 65 pgs: 65 active+clean; 254 MiB data, 978 MiB used, 535 GiB / 536 GiB avail 2024-09-19T07:11:44.279 ERROR:tasks.cephfs.fuse_mount:process failed to terminate after unmount. This probably indicates a bug within ceph-fuse. 2024-09-19T07:11:44.279 ERROR:teuthology.run_tasks:Manager failed: ceph-fuse Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-19T07:11:44.282 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-19T07:11:44.294 INFO:tasks.cephadm:Teardown begin 2024-09-19T07:11:44.294 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/cephadm.py", line 2236, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-19T07:11:44.296 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T07:11:44.331 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T07:11:44.365 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-19T07:11:44.365 DEBUG:teuthology.orchestra.run.smithi099:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T07:11:44.391 DEBUG:teuthology.orchestra.run.smithi117:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T07:11:44.423 INFO:tasks.cephadm:Stopping all daemons... 2024-09-19T07:11:44.423 INFO:tasks.cephadm.mon.smithi099:Stopping mon.smithi099... 2024-09-19T07:11:44.424 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ceph-a73eb958-7650-11ef-bceb-c7b262605968@mon.smithi099 2024-09-19T07:11:44.706 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:11:44 smithi099 systemd[1]: Stopping Ceph mon.smithi099 for a73eb958-7650-11ef-bceb-c7b262605968... 2024-09-19T07:11:45.152 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:11:44 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-mon-smithi099[97027]: 2024-09-19T07:11:44.726+0000 7f6880011640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi099 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:11:45.152 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:11:44 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-mon-smithi099[97027]: 2024-09-19T07:11:44.726+0000 7f6880011640 -1 mon.smithi099@0(leader) e3 *** Got Signal Terminated *** 2024-09-19T07:11:45.153 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:11:44 smithi099 podman[144517]: 2024-09-19 07:11:44.910405164 +0000 UTC m=+0.288432193 container died ffe067438824ccd8af87fa6b0d5cc583e61608ecd5ff04a978f9f68499a4a2a9 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-mon-smithi099, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T07:11:45.855 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:11:45 smithi099 podman[144517]: 2024-09-19 07:11:45.493200051 +0000 UTC m=+0.871227077 container cleanup ffe067438824ccd8af87fa6b0d5cc583e61608ecd5ff04a978f9f68499a4a2a9 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-mon-smithi099, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-19T07:11:45.856 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:11:45 smithi099 bash[144517]: ceph-a73eb958-7650-11ef-bceb-c7b262605968-mon-smithi099 2024-09-19T07:11:45.856 INFO:journalctl@ceph.mon.smithi099.smithi099.stdout:Sep 19 07:11:45 smithi099 podman[144530]: 2024-09-19 07:11:45.736083509 +0000 UTC m=+0.822344315 container remove ffe067438824ccd8af87fa6b0d5cc583e61608ecd5ff04a978f9f68499a4a2a9 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-mon-smithi099, ceph=True, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-19T07:11:45.875 DEBUG:teuthology.orchestra.run.smithi099:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a73eb958-7650-11ef-bceb-c7b262605968@mon.smithi099.service' 2024-09-19T07:11:45.925 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:11:45.926 INFO:tasks.cephadm.mon.smithi099:Stopped mon.smithi099 2024-09-19T07:11:45.926 INFO:tasks.cephadm.mon.smithi117:Stopping mon.smithi117... 2024-09-19T07:11:45.926 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ceph-a73eb958-7650-11ef-bceb-c7b262605968@mon.smithi117 2024-09-19T07:11:46.311 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:11:45 smithi117 systemd[1]: Stopping Ceph mon.smithi117 for a73eb958-7650-11ef-bceb-c7b262605968... 2024-09-19T07:11:46.658 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:11:46 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-mon-smithi117[76767]: 2024-09-19T07:11:46.324+0000 7f5ba6ce9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi117 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:11:46.658 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:11:46 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-mon-smithi117[76767]: 2024-09-19T07:11:46.324+0000 7f5ba6ce9640 -1 mon.smithi117@1(peon) e3 *** Got Signal Terminated *** 2024-09-19T07:11:46.659 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:11:46 smithi117 podman[109443]: 2024-09-19 07:11:46.386106081 +0000 UTC m=+0.258999472 container died 4cb7455e3ee7cfd4b771ad5abb6bf92aa1128f744dd13f3362cb80ca68f3d70e (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-mon-smithi117, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4) 2024-09-19T07:11:47.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:11:46 smithi117 podman[109443]: 2024-09-19 07:11:46.874579949 +0000 UTC m=+0.747473379 container cleanup 4cb7455e3ee7cfd4b771ad5abb6bf92aa1128f744dd13f3362cb80ca68f3d70e (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-mon-smithi117, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T07:11:47.061 INFO:journalctl@ceph.mon.smithi117.smithi117.stdout:Sep 19 07:11:46 smithi117 bash[109443]: ceph-a73eb958-7650-11ef-bceb-c7b262605968-mon-smithi117 2024-09-19T07:11:47.226 DEBUG:teuthology.orchestra.run.smithi117:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a73eb958-7650-11ef-bceb-c7b262605968@mon.smithi117.service' 2024-09-19T07:11:47.270 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:11:47.270 INFO:tasks.cephadm.mon.smithi117:Stopped mon.smithi117 2024-09-19T07:11:47.271 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-19T07:11:47.271 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ceph-a73eb958-7650-11ef-bceb-c7b262605968@osd.0 2024-09-19T07:11:47.706 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 07:11:47 smithi099 systemd[1]: Stopping Ceph osd.0 for a73eb958-7650-11ef-bceb-c7b262605968... 2024-09-19T07:11:48.206 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 07:11:47 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-0[107756]: 2024-09-19T07:11:47.721+0000 7fd82cb96640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:11:48.206 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 07:11:47 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-0[107756]: 2024-09-19T07:11:47.721+0000 7fd82cb96640 -1 osd.0 83 *** Got signal Terminated *** 2024-09-19T07:11:48.206 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 07:11:47 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-0[107756]: 2024-09-19T07:11:47.721+0000 7fd82cb96640 -1 osd.0 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T07:11:53.425 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 07:11:53 smithi099 podman[144648]: 2024-09-19 07:11:53.131773322 +0000 UTC m=+5.674465847 container died 8e22543bf93312497d3d51ea5c56f9399f85cf8cf6b6f170156c5a047a2ff005 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-19T07:11:53.706 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 07:11:53 smithi099 podman[144648]: 2024-09-19 07:11:53.513878418 +0000 UTC m=+6.056570983 container cleanup 8e22543bf93312497d3d51ea5c56f9399f85cf8cf6b6f170156c5a047a2ff005 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4) 2024-09-19T07:11:53.706 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 07:11:53 smithi099 bash[144648]: ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-0 2024-09-19T07:11:54.146 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 07:11:53 smithi099 podman[144663]: 2024-09-19 07:11:53.714939411 +0000 UTC m=+0.584528742 container remove 8e22543bf93312497d3d51ea5c56f9399f85cf8cf6b6f170156c5a047a2ff005 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-19T07:11:54.456 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 07:11:54 smithi099 podman[144752]: 2024-09-19 07:11:54.049563099 +0000 UTC m=+0.016197083 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:11:54.456 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 07:11:54 smithi099 podman[144752]: 2024-09-19 07:11:54.15739758 +0000 UTC m=+0.124031595 container create 7e12192b0745c21464544a53d8fc993687a2ee454edf2266c34c4c0475fc570b (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-19T07:11:54.456 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 07:11:54 smithi099 podman[144752]: 2024-09-19 07:11:54.376618145 +0000 UTC m=+0.343252130 container init 7e12192b0745c21464544a53d8fc993687a2ee454edf2266c34c4c0475fc570b (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-19T07:11:54.456 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 07:11:54 smithi099 podman[144752]: 2024-09-19 07:11:54.380183813 +0000 UTC m=+0.346817789 container start 7e12192b0745c21464544a53d8fc993687a2ee454edf2266c34c4c0475fc570b (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T07:11:54.889 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 07:11:54 smithi099 podman[144752]: 2024-09-19 07:11:54.488197784 +0000 UTC m=+0.454831758 container attach 7e12192b0745c21464544a53d8fc993687a2ee454edf2266c34c4c0475fc570b (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-19T07:11:54.889 INFO:journalctl@ceph.osd.0.smithi099.stdout:Sep 19 07:11:54 smithi099 podman[144752]: 2024-09-19 07:11:54.57519792 +0000 UTC m=+0.541831902 container died 7e12192b0745c21464544a53d8fc993687a2ee454edf2266c34c4c0475fc570b (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_CLEAN=True) 2024-09-19T07:11:55.210 DEBUG:teuthology.orchestra.run.smithi099:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a73eb958-7650-11ef-bceb-c7b262605968@osd.0.service' 2024-09-19T07:11:55.254 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:11:55.255 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-19T07:11:55.255 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-19T07:11:55.255 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ceph-a73eb958-7650-11ef-bceb-c7b262605968@osd.1 2024-09-19T07:11:55.456 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 07:11:55 smithi099 systemd[1]: Stopping Ceph osd.1 for a73eb958-7650-11ef-bceb-c7b262605968... 2024-09-19T07:11:55.956 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 07:11:55 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-1[113096]: 2024-09-19T07:11:55.616+0000 7f4610ff6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:11:55.956 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 07:11:55 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-1[113096]: 2024-09-19T07:11:55.616+0000 7f4610ff6640 -1 osd.1 83 *** Got signal Terminated *** 2024-09-19T07:11:55.956 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 07:11:55 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-1[113096]: 2024-09-19T07:11:55.616+0000 7f4610ff6640 -1 osd.1 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T07:12:01.410 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 07:12:01 smithi099 podman[144855]: 2024-09-19 07:12:01.151189684 +0000 UTC m=+5.648236907 container died f54153d0ae09157af984e5942dc32ce9ec2fa724cdbd7e05b463f28921f5d588 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-1, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T07:12:01.706 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 07:12:01 smithi099 podman[144855]: 2024-09-19 07:12:01.494531517 +0000 UTC m=+5.991578778 container cleanup f54153d0ae09157af984e5942dc32ce9ec2fa724cdbd7e05b463f28921f5d588 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-1, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-19T07:12:01.706 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 07:12:01 smithi099 bash[144855]: ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-1 2024-09-19T07:12:01.706 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 07:12:01 smithi099 podman[144881]: 2024-09-19 07:12:01.658842101 +0000 UTC m=+0.501632761 container remove f54153d0ae09157af984e5942dc32ce9ec2fa724cdbd7e05b463f28921f5d588 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-1, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T07:12:02.312 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 07:12:02 smithi099 podman[144972]: 2024-09-19 07:12:01.963121323 +0000 UTC m=+0.015760216 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:12:02.312 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 07:12:02 smithi099 podman[144972]: 2024-09-19 07:12:02.084710724 +0000 UTC m=+0.137349602 container create dd7c0f125830d00133167b78a44fbe1ff57c08eb109c18da2ca21adf26d67a4e (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-1-deactivate, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T07:12:02.312 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 07:12:02 smithi099 podman[144972]: 2024-09-19 07:12:02.312326155 +0000 UTC m=+0.364965033 container init dd7c0f125830d00133167b78a44fbe1ff57c08eb109c18da2ca21adf26d67a4e (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-19T07:12:02.706 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 07:12:02 smithi099 podman[144972]: 2024-09-19 07:12:02.315783712 +0000 UTC m=+0.368422591 container start dd7c0f125830d00133167b78a44fbe1ff57c08eb109c18da2ca21adf26d67a4e (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4) 2024-09-19T07:12:02.706 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 07:12:02 smithi099 podman[144972]: 2024-09-19 07:12:02.403765239 +0000 UTC m=+0.456404117 container attach dd7c0f125830d00133167b78a44fbe1ff57c08eb109c18da2ca21adf26d67a4e (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-19T07:12:02.706 INFO:journalctl@ceph.osd.1.smithi099.stdout:Sep 19 07:12:02 smithi099 podman[144972]: 2024-09-19 07:12:02.505663294 +0000 UTC m=+0.558302183 container died dd7c0f125830d00133167b78a44fbe1ff57c08eb109c18da2ca21adf26d67a4e (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-19T07:12:03.066 DEBUG:teuthology.orchestra.run.smithi099:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a73eb958-7650-11ef-bceb-c7b262605968@osd.1.service' 2024-09-19T07:12:03.106 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:12:03.107 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-19T07:12:03.107 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-19T07:12:03.108 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ceph-a73eb958-7650-11ef-bceb-c7b262605968@osd.2 2024-09-19T07:12:03.418 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 07:12:03 smithi099 systemd[1]: Stopping Ceph osd.2 for a73eb958-7650-11ef-bceb-c7b262605968... 2024-09-19T07:12:03.706 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 07:12:03 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-2[118860]: 2024-09-19T07:12:03.417+0000 7f74a5c26640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:12:03.706 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 07:12:03 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-2[118860]: 2024-09-19T07:12:03.417+0000 7f74a5c26640 -1 osd.2 83 *** Got signal Terminated *** 2024-09-19T07:12:03.706 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 07:12:03 smithi099 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-2[118860]: 2024-09-19T07:12:03.418+0000 7f74a5c26640 -1 osd.2 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T07:12:09.068 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 07:12:08 smithi099 podman[145077]: 2024-09-19 07:12:08.779050708 +0000 UTC m=+5.451701393 container died b1778ab8887074112f6bcdb2330d07ec6a171bf52d03cdbfe24724cfc8679127 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-2, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-19T07:12:09.435 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 07:12:09 smithi099 podman[145077]: 2024-09-19 07:12:09.14231367 +0000 UTC m=+5.814964356 container cleanup b1778ab8887074112f6bcdb2330d07ec6a171bf52d03cdbfe24724cfc8679127 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, ceph=True) 2024-09-19T07:12:09.435 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 07:12:09 smithi099 bash[145077]: ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-2 2024-09-19T07:12:09.706 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 07:12:09 smithi099 podman[145092]: 2024-09-19 07:12:09.435561807 +0000 UTC m=+0.659263099 container remove b1778ab8887074112f6bcdb2330d07ec6a171bf52d03cdbfe24724cfc8679127 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4) 2024-09-19T07:12:10.063 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 07:12:09 smithi099 podman[145183]: 2024-09-19 07:12:09.657323228 +0000 UTC m=+0.015828601 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:12:10.064 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 07:12:09 smithi099 podman[145183]: 2024-09-19 07:12:09.778148423 +0000 UTC m=+0.136653836 container create 6cfd583a58aa7113b8efbee8757f50e1763a57b42f3e4e0937f2ef14ca222cc8 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731) 2024-09-19T07:12:10.064 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 07:12:09 smithi099 podman[145183]: 2024-09-19 07:12:09.988865472 +0000 UTC m=+0.347370840 container init 6cfd583a58aa7113b8efbee8757f50e1763a57b42f3e4e0937f2ef14ca222cc8 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T07:12:10.064 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 07:12:09 smithi099 podman[145183]: 2024-09-19 07:12:09.992184061 +0000 UTC m=+0.350689430 container start 6cfd583a58aa7113b8efbee8757f50e1763a57b42f3e4e0937f2ef14ca222cc8 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4) 2024-09-19T07:12:10.064 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 07:12:10 smithi099 podman[145183]: 2024-09-19 07:12:10.063637349 +0000 UTC m=+0.422142721 container attach 6cfd583a58aa7113b8efbee8757f50e1763a57b42f3e4e0937f2ef14ca222cc8 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T07:12:10.456 INFO:journalctl@ceph.osd.2.smithi099.stdout:Sep 19 07:12:10 smithi099 podman[145183]: 2024-09-19 07:12:10.19622751 +0000 UTC m=+0.554732878 container died 6cfd583a58aa7113b8efbee8757f50e1763a57b42f3e4e0937f2ef14ca222cc8 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-19T07:12:10.782 DEBUG:teuthology.orchestra.run.smithi099:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a73eb958-7650-11ef-bceb-c7b262605968@osd.2.service' 2024-09-19T07:12:10.823 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:12:10.824 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-19T07:12:10.824 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-19T07:12:10.824 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ceph-a73eb958-7650-11ef-bceb-c7b262605968@osd.3 2024-09-19T07:12:11.143 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 07:12:10 smithi117 systemd[1]: Stopping Ceph osd.3 for a73eb958-7650-11ef-bceb-c7b262605968... 2024-09-19T07:12:11.457 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 07:12:11 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-3[86048]: 2024-09-19T07:12:11.140+0000 7ff143469640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:12:11.457 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 07:12:11 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-3[86048]: 2024-09-19T07:12:11.140+0000 7ff143469640 -1 osd.3 83 *** Got signal Terminated *** 2024-09-19T07:12:11.457 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 07:12:11 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-3[86048]: 2024-09-19T07:12:11.140+0000 7ff143469640 -1 osd.3 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T07:12:13.811 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 07:12:13 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5[95894]: 2024-09-19T07:12:13.445+0000 7efd9218c640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-09-19T07:11:51.094663+0000 front 2024-09-19T07:11:51.094777+0000 (oldest deadline 2024-09-19T07:12:13.394633+0000) 2024-09-19T07:12:14.811 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 07:12:14 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-3[86048]: 2024-09-19T07:12:14.426+0000 7ff13fa6e640 -1 osd.3 83 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-09-19T07:11:51.952803+0000 front 2024-09-19T07:11:51.952729+0000 (oldest deadline 2024-09-19T07:12:14.252575+0000) 2024-09-19T07:12:14.812 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 07:12:14 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5[95894]: 2024-09-19T07:12:14.431+0000 7efd9218c640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-09-19T07:11:51.094663+0000 front 2024-09-19T07:11:51.094777+0000 (oldest deadline 2024-09-19T07:12:13.394633+0000) 2024-09-19T07:12:15.561 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 07:12:15 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-3[86048]: 2024-09-19T07:12:15.398+0000 7ff13fa6e640 -1 osd.3 83 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-09-19T07:11:51.952803+0000 front 2024-09-19T07:11:51.952729+0000 (oldest deadline 2024-09-19T07:12:14.252575+0000) 2024-09-19T07:12:15.562 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 07:12:15 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-4[91035]: 2024-09-19T07:12:15.212+0000 7f693f790640 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-09-19T07:11:51.292930+0000 front 2024-09-19T07:11:51.293001+0000 (oldest deadline 2024-09-19T07:12:14.192688+0000) 2024-09-19T07:12:15.562 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 07:12:15 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5[95894]: 2024-09-19T07:12:15.419+0000 7efd9218c640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-09-19T07:11:51.094663+0000 front 2024-09-19T07:11:51.094777+0000 (oldest deadline 2024-09-19T07:12:13.394633+0000) 2024-09-19T07:12:16.522 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 07:12:16 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-4[91035]: 2024-09-19T07:12:16.246+0000 7f693f790640 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-09-19T07:11:51.292930+0000 front 2024-09-19T07:11:51.293001+0000 (oldest deadline 2024-09-19T07:12:14.192688+0000) 2024-09-19T07:12:16.522 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 07:12:16 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5[95894]: 2024-09-19T07:12:16.434+0000 7efd9218c640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-09-19T07:11:51.094663+0000 front 2024-09-19T07:11:51.094777+0000 (oldest deadline 2024-09-19T07:12:13.394633+0000) 2024-09-19T07:12:16.811 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 07:12:16 smithi117 podman[109565]: 2024-09-19 07:12:16.522422574 +0000 UTC m=+5.501421937 container died ea5236b193d3e56717db974d1262607e06e27cdcdce442ffae5f72f53348a118 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD) 2024-09-19T07:12:17.218 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 07:12:17 smithi117 podman[109565]: 2024-09-19 07:12:17.033552376 +0000 UTC m=+6.012551776 container cleanup ea5236b193d3e56717db974d1262607e06e27cdcdce442ffae5f72f53348a118 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-3, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-19T07:12:17.218 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 07:12:17 smithi117 bash[109565]: ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-3 2024-09-19T07:12:17.561 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 07:12:17 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-4[91035]: 2024-09-19T07:12:17.217+0000 7f693f790640 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-09-19T07:11:51.292930+0000 front 2024-09-19T07:11:51.293001+0000 (oldest deadline 2024-09-19T07:12:14.192688+0000) 2024-09-19T07:12:17.561 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 07:12:17 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5[95894]: 2024-09-19T07:12:17.408+0000 7efd9218c640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-09-19T07:11:51.094663+0000 front 2024-09-19T07:11:51.094777+0000 (oldest deadline 2024-09-19T07:12:13.394633+0000) 2024-09-19T07:12:17.562 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 07:12:17 smithi117 podman[109591]: 2024-09-19 07:12:17.284931173 +0000 UTC m=+0.756420394 container remove ea5236b193d3e56717db974d1262607e06e27cdcdce442ffae5f72f53348a118 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-19T07:12:17.889 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 07:12:17 smithi117 podman[109684]: 2024-09-19 07:12:17.502220008 +0000 UTC m=+0.015676567 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:12:17.889 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 07:12:17 smithi117 podman[109684]: 2024-09-19 07:12:17.60249718 +0000 UTC m=+0.115953772 container create c682dbd11ebb1a320194ded085d404499ffd27e23def65892124ccf7dd6607dd (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T07:12:17.889 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 07:12:17 smithi117 podman[109684]: 2024-09-19 07:12:17.805234404 +0000 UTC m=+0.318690972 container init c682dbd11ebb1a320194ded085d404499ffd27e23def65892124ccf7dd6607dd (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-3-deactivate, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T07:12:17.889 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 07:12:17 smithi117 podman[109684]: 2024-09-19 07:12:17.808366593 +0000 UTC m=+0.321823139 container start c682dbd11ebb1a320194ded085d404499ffd27e23def65892124ccf7dd6607dd (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-19T07:12:17.889 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 07:12:17 smithi117 podman[109684]: 2024-09-19 07:12:17.888395328 +0000 UTC m=+0.401851889 container attach c682dbd11ebb1a320194ded085d404499ffd27e23def65892124ccf7dd6607dd (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-3-deactivate, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T07:12:18.216 INFO:journalctl@ceph.osd.3.smithi117.stdout:Sep 19 07:12:18 smithi117 podman[109684]: 2024-09-19 07:12:18.000113894 +0000 UTC m=+0.513570455 container died c682dbd11ebb1a320194ded085d404499ffd27e23def65892124ccf7dd6607dd (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-19T07:12:18.561 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 07:12:18 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-4[91035]: 2024-09-19T07:12:18.214+0000 7f693f790640 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-09-19T07:11:51.292930+0000 front 2024-09-19T07:11:51.293001+0000 (oldest deadline 2024-09-19T07:12:14.192688+0000) 2024-09-19T07:12:18.562 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 07:12:18 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5[95894]: 2024-09-19T07:12:18.433+0000 7efd9218c640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-09-19T07:11:51.094663+0000 front 2024-09-19T07:11:51.094777+0000 (oldest deadline 2024-09-19T07:12:13.394633+0000) 2024-09-19T07:12:18.661 DEBUG:teuthology.orchestra.run.smithi117:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a73eb958-7650-11ef-bceb-c7b262605968@osd.3.service' 2024-09-19T07:12:18.705 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:12:18.706 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-19T07:12:18.706 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-19T07:12:18.706 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ceph-a73eb958-7650-11ef-bceb-c7b262605968@osd.4 2024-09-19T07:12:19.061 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 07:12:18 smithi117 systemd[1]: Stopping Ceph osd.4 for a73eb958-7650-11ef-bceb-c7b262605968... 2024-09-19T07:12:19.439 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 07:12:19 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-4[91035]: 2024-09-19T07:12:19.063+0000 7f694318b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:12:19.440 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 07:12:19 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-4[91035]: 2024-09-19T07:12:19.063+0000 7f694318b640 -1 osd.4 83 *** Got signal Terminated *** 2024-09-19T07:12:19.440 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 07:12:19 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-4[91035]: 2024-09-19T07:12:19.063+0000 7f694318b640 -1 osd.4 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T07:12:19.440 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 07:12:19 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-4[91035]: 2024-09-19T07:12:19.202+0000 7f693f790640 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-09-19T07:11:51.292930+0000 front 2024-09-19T07:11:51.293001+0000 (oldest deadline 2024-09-19T07:12:14.192688+0000) 2024-09-19T07:12:19.811 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 07:12:19 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5[95894]: 2024-09-19T07:12:19.438+0000 7efd9218c640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-09-19T07:11:51.094663+0000 front 2024-09-19T07:11:51.094777+0000 (oldest deadline 2024-09-19T07:12:13.394633+0000) 2024-09-19T07:12:20.472 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 07:12:20 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-4[91035]: 2024-09-19T07:12:20.190+0000 7f693f790640 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-09-19T07:11:51.292930+0000 front 2024-09-19T07:11:51.293001+0000 (oldest deadline 2024-09-19T07:12:14.192688+0000) 2024-09-19T07:12:20.811 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 07:12:20 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5[95894]: 2024-09-19T07:12:20.471+0000 7efd9218c640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-09-19T07:11:51.094663+0000 front 2024-09-19T07:11:51.094777+0000 (oldest deadline 2024-09-19T07:12:13.394633+0000) 2024-09-19T07:12:21.561 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 07:12:21 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-4[91035]: 2024-09-19T07:12:21.220+0000 7f693f790640 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-09-19T07:11:51.292930+0000 front 2024-09-19T07:11:51.293001+0000 (oldest deadline 2024-09-19T07:12:14.192688+0000) 2024-09-19T07:12:21.561 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 07:12:21 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5[95894]: 2024-09-19T07:12:21.437+0000 7efd9218c640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-09-19T07:11:51.094663+0000 front 2024-09-19T07:11:51.094777+0000 (oldest deadline 2024-09-19T07:12:13.394633+0000) 2024-09-19T07:12:22.561 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 07:12:22 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-4[91035]: 2024-09-19T07:12:22.229+0000 7f693f790640 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-09-19T07:11:51.292930+0000 front 2024-09-19T07:11:51.293001+0000 (oldest deadline 2024-09-19T07:12:14.192688+0000) 2024-09-19T07:12:22.562 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 07:12:22 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5[95894]: 2024-09-19T07:12:22.449+0000 7efd9218c640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-09-19T07:11:51.094663+0000 front 2024-09-19T07:11:51.094777+0000 (oldest deadline 2024-09-19T07:12:13.394633+0000) 2024-09-19T07:12:22.562 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 07:12:22 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5[95894]: 2024-09-19T07:12:22.449+0000 7efd9218c640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-09-19T07:11:59.795613+0000 front 2024-09-19T07:11:59.795709+0000 (oldest deadline 2024-09-19T07:12:21.495582+0000) 2024-09-19T07:12:23.561 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 07:12:23 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-4[91035]: 2024-09-19T07:12:23.223+0000 7f693f790640 -1 osd.4 83 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-09-19T07:11:51.292930+0000 front 2024-09-19T07:11:51.293001+0000 (oldest deadline 2024-09-19T07:12:14.192688+0000) 2024-09-19T07:12:23.561 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 07:12:23 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5[95894]: 2024-09-19T07:12:23.449+0000 7efd9218c640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-09-19T07:11:51.094663+0000 front 2024-09-19T07:11:51.094777+0000 (oldest deadline 2024-09-19T07:12:13.394633+0000) 2024-09-19T07:12:23.562 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 07:12:23 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5[95894]: 2024-09-19T07:12:23.449+0000 7efd9218c640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-09-19T07:11:59.795613+0000 front 2024-09-19T07:11:59.795709+0000 (oldest deadline 2024-09-19T07:12:21.495582+0000) 2024-09-19T07:12:24.811 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 07:12:24 smithi117 podman[109787]: 2024-09-19 07:12:24.619838812 +0000 UTC m=+5.686183046 container died 27ac2c859a688e9db983302f0d4def550fff0d1198a1163e58eba2cb0c112534 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-4, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T07:12:24.812 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 07:12:24 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5[95894]: 2024-09-19T07:12:24.427+0000 7efd9218c640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-09-19T07:11:51.094663+0000 front 2024-09-19T07:11:51.094777+0000 (oldest deadline 2024-09-19T07:12:13.394633+0000) 2024-09-19T07:12:24.812 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 07:12:24 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5[95894]: 2024-09-19T07:12:24.427+0000 7efd9218c640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-09-19T07:11:59.795613+0000 front 2024-09-19T07:11:59.795709+0000 (oldest deadline 2024-09-19T07:12:21.495582+0000) 2024-09-19T07:12:25.196 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 07:12:24 smithi117 podman[109787]: 2024-09-19 07:12:24.961179161 +0000 UTC m=+6.027523391 container cleanup 27ac2c859a688e9db983302f0d4def550fff0d1198a1163e58eba2cb0c112534 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-4, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0) 2024-09-19T07:12:25.196 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 07:12:24 smithi117 bash[109787]: ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-4 2024-09-19T07:12:25.561 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 07:12:25 smithi117 podman[109803]: 2024-09-19 07:12:25.195866945 +0000 UTC m=+0.572740744 container remove 27ac2c859a688e9db983302f0d4def550fff0d1198a1163e58eba2cb0c112534 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-4, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-19T07:12:25.561 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 07:12:25 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5[95894]: 2024-09-19T07:12:25.429+0000 7efd9218c640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-09-19T07:11:51.094663+0000 front 2024-09-19T07:11:51.094777+0000 (oldest deadline 2024-09-19T07:12:13.394633+0000) 2024-09-19T07:12:25.562 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 07:12:25 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5[95894]: 2024-09-19T07:12:25.429+0000 7efd9218c640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-09-19T07:11:59.795613+0000 front 2024-09-19T07:11:59.795709+0000 (oldest deadline 2024-09-19T07:12:21.495582+0000) 2024-09-19T07:12:25.874 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 07:12:25 smithi117 podman[109898]: 2024-09-19 07:12:25.519511753 +0000 UTC m=+0.015928505 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:12:25.875 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 07:12:25 smithi117 podman[109898]: 2024-09-19 07:12:25.638445617 +0000 UTC m=+0.134862376 container create 8afdad558b4dc0494d94e04d18107d54a2c2463972f51fea39211474cbe2ce31 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-19T07:12:25.875 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 07:12:25 smithi117 podman[109898]: 2024-09-19 07:12:25.874205349 +0000 UTC m=+0.370622107 container init 8afdad558b4dc0494d94e04d18107d54a2c2463972f51fea39211474cbe2ce31 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T07:12:26.311 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 07:12:25 smithi117 podman[109898]: 2024-09-19 07:12:25.877693659 +0000 UTC m=+0.374110412 container start 8afdad558b4dc0494d94e04d18107d54a2c2463972f51fea39211474cbe2ce31 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-19T07:12:26.312 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 07:12:25 smithi117 podman[109898]: 2024-09-19 07:12:25.974100763 +0000 UTC m=+0.470517531 container attach 8afdad558b4dc0494d94e04d18107d54a2c2463972f51fea39211474cbe2ce31 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-19T07:12:26.312 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 19 07:12:26 smithi117 podman[109898]: 2024-09-19 07:12:26.073842649 +0000 UTC m=+0.570259407 container died 8afdad558b4dc0494d94e04d18107d54a2c2463972f51fea39211474cbe2ce31 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-4-deactivate, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD) 2024-09-19T07:12:26.669 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 07:12:26 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5[95894]: 2024-09-19T07:12:26.478+0000 7efd9218c640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-09-19T07:11:51.094663+0000 front 2024-09-19T07:11:51.094777+0000 (oldest deadline 2024-09-19T07:12:13.394633+0000) 2024-09-19T07:12:26.669 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 07:12:26 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5[95894]: 2024-09-19T07:12:26.478+0000 7efd9218c640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-09-19T07:11:59.795613+0000 front 2024-09-19T07:11:59.795709+0000 (oldest deadline 2024-09-19T07:12:21.495582+0000) 2024-09-19T07:12:26.697 DEBUG:teuthology.orchestra.run.smithi117:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a73eb958-7650-11ef-bceb-c7b262605968@osd.4.service' 2024-09-19T07:12:26.736 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:12:26.737 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-19T07:12:26.737 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-19T07:12:26.737 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ceph-a73eb958-7650-11ef-bceb-c7b262605968@osd.5 2024-09-19T07:12:27.056 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 07:12:26 smithi117 systemd[1]: Stopping Ceph osd.5 for a73eb958-7650-11ef-bceb-c7b262605968... 2024-09-19T07:12:27.311 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 07:12:27 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5[95894]: 2024-09-19T07:12:27.055+0000 7efd99b8f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T07:12:27.311 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 07:12:27 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5[95894]: 2024-09-19T07:12:27.055+0000 7efd99b8f640 -1 osd.5 83 *** Got signal Terminated *** 2024-09-19T07:12:27.311 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 07:12:27 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5[95894]: 2024-09-19T07:12:27.055+0000 7efd99b8f640 -1 osd.5 83 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T07:12:27.811 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 07:12:27 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5[95894]: 2024-09-19T07:12:27.519+0000 7efd9218c640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-09-19T07:11:51.094663+0000 front 2024-09-19T07:11:51.094777+0000 (oldest deadline 2024-09-19T07:12:13.394633+0000) 2024-09-19T07:12:27.811 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 07:12:27 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5[95894]: 2024-09-19T07:12:27.519+0000 7efd9218c640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-09-19T07:11:59.795613+0000 front 2024-09-19T07:11:59.795709+0000 (oldest deadline 2024-09-19T07:12:21.495582+0000) 2024-09-19T07:12:28.811 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 07:12:28 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5[95894]: 2024-09-19T07:12:28.558+0000 7efd9218c640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-09-19T07:11:51.094663+0000 front 2024-09-19T07:11:51.094777+0000 (oldest deadline 2024-09-19T07:12:13.394633+0000) 2024-09-19T07:12:28.811 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 07:12:28 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5[95894]: 2024-09-19T07:12:28.558+0000 7efd9218c640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-09-19T07:11:59.795613+0000 front 2024-09-19T07:11:59.795709+0000 (oldest deadline 2024-09-19T07:12:21.495582+0000) 2024-09-19T07:12:29.811 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 07:12:29 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5[95894]: 2024-09-19T07:12:29.522+0000 7efd9218c640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-09-19T07:11:51.094663+0000 front 2024-09-19T07:11:51.094777+0000 (oldest deadline 2024-09-19T07:12:13.394633+0000) 2024-09-19T07:12:29.811 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 07:12:29 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5[95894]: 2024-09-19T07:12:29.522+0000 7efd9218c640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-09-19T07:11:59.795613+0000 front 2024-09-19T07:11:59.795709+0000 (oldest deadline 2024-09-19T07:12:21.495582+0000) 2024-09-19T07:12:30.811 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 07:12:30 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5[95894]: 2024-09-19T07:12:30.528+0000 7efd9218c640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-09-19T07:11:51.094663+0000 front 2024-09-19T07:11:51.094777+0000 (oldest deadline 2024-09-19T07:12:13.394633+0000) 2024-09-19T07:12:30.811 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 07:12:30 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5[95894]: 2024-09-19T07:12:30.528+0000 7efd9218c640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-09-19T07:11:59.795613+0000 front 2024-09-19T07:11:59.795709+0000 (oldest deadline 2024-09-19T07:12:21.495582+0000) 2024-09-19T07:12:30.812 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 07:12:30 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5[95894]: 2024-09-19T07:12:30.528+0000 7efd9218c640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-09-19T07:12:06.196424+0000 front 2024-09-19T07:12:06.196511+0000 (oldest deadline 2024-09-19T07:12:30.296337+0000) 2024-09-19T07:12:32.061 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 07:12:31 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5[95894]: 2024-09-19T07:12:31.562+0000 7efd9218c640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.99:6806 osd.0 since back 2024-09-19T07:11:51.094663+0000 front 2024-09-19T07:11:51.094777+0000 (oldest deadline 2024-09-19T07:12:13.394633+0000) 2024-09-19T07:12:32.061 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 07:12:31 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5[95894]: 2024-09-19T07:12:31.562+0000 7efd9218c640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.99:6814 osd.1 since back 2024-09-19T07:11:59.795613+0000 front 2024-09-19T07:11:59.795709+0000 (oldest deadline 2024-09-19T07:12:21.495582+0000) 2024-09-19T07:12:32.061 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 07:12:31 smithi117 ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5[95894]: 2024-09-19T07:12:31.562+0000 7efd9218c640 -1 osd.5 83 heartbeat_check: no reply from 172.21.15.99:6822 osd.2 since back 2024-09-19T07:12:06.196424+0000 front 2024-09-19T07:12:06.196511+0000 (oldest deadline 2024-09-19T07:12:30.296337+0000) 2024-09-19T07:12:32.765 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 07:12:32 smithi117 podman[110003]: 2024-09-19 07:12:32.493574839 +0000 UTC m=+5.538553712 container died de6aeb8544ce3ac3d6d374382463f0c7c9778cbd81b9c5c38917185b17cc736c (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-19T07:12:33.061 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 07:12:32 smithi117 podman[110003]: 2024-09-19 07:12:32.863160787 +0000 UTC m=+5.908139663 container cleanup de6aeb8544ce3ac3d6d374382463f0c7c9778cbd81b9c5c38917185b17cc736c (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-19T07:12:33.061 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 07:12:32 smithi117 bash[110003]: ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5 2024-09-19T07:12:33.473 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 07:12:33 smithi117 podman[110018]: 2024-09-19 07:12:33.147773194 +0000 UTC m=+0.652676443 container remove de6aeb8544ce3ac3d6d374382463f0c7c9778cbd81b9c5c38917185b17cc736c (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-19T07:12:33.751 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 07:12:33 smithi117 podman[110105]: 2024-09-19 07:12:33.473442443 +0000 UTC m=+0.107608308 container create 9a09348592a7d6edf21d4ed8281b1f1acfd350d5bf5034ae46e6c7c64ed912c7 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T07:12:33.751 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 07:12:33 smithi117 podman[110105]: 2024-09-19 07:12:33.381331073 +0000 UTC m=+0.015496953 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T07:12:33.751 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 07:12:33 smithi117 podman[110105]: 2024-09-19 07:12:33.667922762 +0000 UTC m=+0.302088638 container init 9a09348592a7d6edf21d4ed8281b1f1acfd350d5bf5034ae46e6c7c64ed912c7 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T07:12:33.751 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 07:12:33 smithi117 podman[110105]: 2024-09-19 07:12:33.671245374 +0000 UTC m=+0.305411257 container start 9a09348592a7d6edf21d4ed8281b1f1acfd350d5bf5034ae46e6c7c64ed912c7 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4) 2024-09-19T07:12:33.751 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 07:12:33 smithi117 podman[110105]: 2024-09-19 07:12:33.750981384 +0000 UTC m=+0.385147257 container attach 9a09348592a7d6edf21d4ed8281b1f1acfd350d5bf5034ae46e6c7c64ed912c7 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5-deactivate, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-19T07:12:34.061 INFO:journalctl@ceph.osd.5.smithi117.stdout:Sep 19 07:12:33 smithi117 podman[110105]: 2024-09-19 07:12:33.857468509 +0000 UTC m=+0.491634376 container died 9a09348592a7d6edf21d4ed8281b1f1acfd350d5bf5034ae46e6c7c64ed912c7 (image=quay.ceph.io/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-a73eb958-7650-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-19T07:12:34.429 DEBUG:teuthology.orchestra.run.smithi117:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a73eb958-7650-11ef-bceb-c7b262605968@osd.5.service' 2024-09-19T07:12:34.468 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T07:12:34.468 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-19T07:12:34.469 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid a73eb958-7650-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T07:12:37.551 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi099.stderr:ceph-fuse[73869]: fuse finished with error 0 and tester_r 0 2024-09-19T07:12:54.814 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid a73eb958-7650-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T07:13:08.666 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T07:13:08.694 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T07:13:08.721 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-19T07:13:08.723 DEBUG:teuthology.misc:Transferring archived files from smithi099:/var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911742/remote/smithi099/crash 2024-09-19T07:13:08.723 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/crash -- . 2024-09-19T07:13:08.759 INFO:teuthology.orchestra.run.smithi099.stderr:tar: /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T07:13:08.759 INFO:teuthology.orchestra.run.smithi099.stderr:tar: Error is not recoverable: exiting now 2024-09-19T07:13:08.761 DEBUG:teuthology.misc:Transferring archived files from smithi117:/var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911742/remote/smithi117/crash 2024-09-19T07:13:08.762 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar c -f - -C /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/crash -- . 2024-09-19T07:13:08.786 INFO:teuthology.orchestra.run.smithi117.stderr:tar: /var/lib/ceph/a73eb958-7650-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T07:13:08.786 INFO:teuthology.orchestra.run.smithi117.stderr:tar: Error is not recoverable: exiting now 2024-09-19T07:13:08.787 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-19T07:13:08.787 DEBUG:teuthology.orchestra.run.smithi099:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/a73eb958-7650-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-19T07:13:08.840 INFO:teuthology.orchestra.run.smithi099.stdout:2024-09-19T06:50:00.000147+0000 mon.smithi099 (mon.0) 672 : cluster [ERR] Health detail: HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-09-19T07:13:08.840 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-09-19T07:13:08.841 INFO:tasks.cephadm:Compressing logs... 2024-09-19T07:13:08.841 DEBUG:teuthology.orchestra.run.smithi099:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T07:13:08.883 DEBUG:teuthology.orchestra.run.smithi117:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T07:13:08.905 INFO:teuthology.orchestra.run.smithi099.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/a73eb958-7650-11ef-bceb-c7b262605968/ceph-osd.0.log 2024-09-19T07:13:08.905 INFO:teuthology.orchestra.run.smithi099.stderr:: No such file or directory 2024-09-19T07:13:08.906 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/a73eb958-7650-11ef-bceb-c7b262605968/ceph-osd.1.log 2024-09-19T07:13:08.906 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/a73eb958-7650-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T07:13:08.906 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/a73eb958-7650-11ef-bceb-c7b262605968/ceph-osd.0.log: /var/log/ceph/a73eb958-7650-11ef-bceb-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/a73eb958-7650-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T07:13:08.907 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/a73eb958-7650-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/a73eb958-7650-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi099.obarqf.log 2024-09-19T07:13:08.907 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/a73eb958-7650-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/a73eb958-7650-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T07:13:08.908 INFO:teuthology.orchestra.run.smithi117.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/a73eb958-7650-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi117.nooexo.log 2024-09-19T07:13:08.908 INFO:teuthology.orchestra.run.smithi117.stderr:: No such file or directory 2024-09-19T07:13:08.908 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/a73eb958-7650-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T07:13:08.908 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/a73eb958-7650-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi117.nooexo.log: gzip -5 --verbose -- /var/log/ceph/a73eb958-7650-11ef-bceb-c7b262605968/ceph-mon.smithi117.log 2024-09-19T07:13:08.908 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/a73eb958-7650-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/a73eb958-7650-11ef-bceb-c7b262605968/ceph-osd.4.log 2024-09-19T07:13:08.913 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/a73eb958-7650-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi099.obarqf.log: gzip -5 --verbose -- /var/log/ceph/a73eb958-7650-11ef-bceb-c7b262605968/ceph-mon.smithi099.log 2024-09-19T07:13:08.913 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/a73eb958-7650-11ef-bceb-c7b262605968/ceph.cephadm.log: /var/log/ceph/a73eb958-7650-11ef-bceb-c7b262605968/ceph-mon.smithi099.log: 86.4% -- replaced with /var/log/ceph/a73eb958-7650-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T07:13:08.913 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/a73eb958-7650-11ef-bceb-c7b262605968/ceph-osd.2.log 2024-09-19T07:13:08.914 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/a73eb958-7650-11ef-bceb-c7b262605968/ceph.log 2024-09-19T07:13:08.914 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/a73eb958-7650-11ef-bceb-c7b262605968/ceph-osd.2.log: 91.1% -- replaced with /var/log/ceph/a73eb958-7650-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T07:13:08.914 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/a73eb958-7650-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi099.xehbxe.log 2024-09-19T07:13:08.915 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/a73eb958-7650-11ef-bceb-c7b262605968/ceph-mon.smithi117.log: gzip -5 --verbose -- /var/log/ceph/a73eb958-7650-11ef-bceb-c7b262605968/ceph-mgr.smithi117.ssmkcf.log 2024-09-19T07:13:08.915 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/a73eb958-7650-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T07:13:08.915 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/a73eb958-7650-11ef-bceb-c7b262605968/ceph-osd.4.log: /var/log/ceph/a73eb958-7650-11ef-bceb-c7b262605968/ceph-mgr.smithi117.ssmkcf.log: gzip -5 --verbose -- /var/log/ceph/a73eb958-7650-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi117.bheqzh.log 2024-09-19T07:13:08.915 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/a73eb958-7650-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/a73eb958-7650-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T07:13:08.915 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/a73eb958-7650-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi117.bheqzh.log: /var/log/ceph/a73eb958-7650-11ef-bceb-c7b262605968/ceph.cephadm.log: 85.2% -- replaced with /var/log/ceph/a73eb958-7650-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T07:13:08.915 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/a73eb958-7650-11ef-bceb-c7b262605968/ceph-osd.5.log 2024-09-19T07:13:08.915 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/a73eb958-7650-11ef-bceb-c7b262605968/ceph.log 2024-09-19T07:13:08.916 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/a73eb958-7650-11ef-bceb-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/a73eb958-7650-11ef-bceb-c7b262605968/ceph-osd.3.log 2024-09-19T07:13:08.916 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/a73eb958-7650-11ef-bceb-c7b262605968/ceph.log: 91.3% -- replaced with /var/log/ceph/a73eb958-7650-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T07:13:08.917 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/a73eb958-7650-11ef-bceb-c7b262605968/ceph.log: 89.2% -- replaced with /var/log/ceph/a73eb958-7650-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T07:13:08.917 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/a73eb958-7650-11ef-bceb-c7b262605968/ceph-mgr.smithi099.pgvkqi.log 2024-09-19T07:13:08.918 INFO:teuthology.orchestra.run.smithi117.stderr: 89.2% -- replaced with /var/log/ceph/a73eb958-7650-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T07:13:08.918 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.log 2024-09-19T07:13:08.918 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/a73eb958-7650-11ef-bceb-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T07:13:08.927 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/a73eb958-7650-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi099.xehbxe.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-09-19T07:13:08.928 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/ceph-client.1.log: 91.0% -- replaced with /var/log/ceph/a73eb958-7650-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T07:13:08.931 INFO:teuthology.orchestra.run.smithi117.stderr: 94.4% -- replaced with /var/log/ceph/a73eb958-7650-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi117.bheqzh.log.gz 2024-09-19T07:13:08.936 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/a73eb958-7650-11ef-bceb-c7b262605968/ceph-mgr.smithi099.pgvkqi.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T07:13:08.938 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.log: 91.0% -- replaced with /var/log/ceph/a73eb958-7650-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T07:13:08.940 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/cephadm.log: 92.0% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T07:13:08.978 INFO:teuthology.orchestra.run.smithi117.stderr: 90.0% -- replaced with /var/log/ceph/a73eb958-7650-11ef-bceb-c7b262605968/ceph-mgr.smithi117.ssmkcf.log.gz 2024-09-19T07:13:09.013 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/cephadm.log: 92.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T07:13:09.410 INFO:teuthology.orchestra.run.smithi099.stderr: 89.4% -- replaced with /var/log/ceph/a73eb958-7650-11ef-bceb-c7b262605968/ceph-mgr.smithi099.pgvkqi.log.gz 2024-09-19T07:13:09.537 INFO:teuthology.orchestra.run.smithi117.stderr: 92.5% -- replaced with /var/log/ceph/a73eb958-7650-11ef-bceb-c7b262605968/ceph-mon.smithi117.log.gz 2024-09-19T07:13:10.648 INFO:teuthology.orchestra.run.smithi099.stderr: 90.2% -- replaced with /var/log/ceph/a73eb958-7650-11ef-bceb-c7b262605968/ceph-mon.smithi099.log.gz 2024-09-19T07:13:13.160 INFO:teuthology.orchestra.run.smithi117.stderr: 93.3% -- replaced with /var/log/ceph/a73eb958-7650-11ef-bceb-c7b262605968/ceph-osd.4.log.gz 2024-09-19T07:13:13.811 INFO:teuthology.orchestra.run.smithi099.stderr: 93.3% -- replaced with /var/log/ceph/a73eb958-7650-11ef-bceb-c7b262605968/ceph-osd.0.log.gz 2024-09-19T07:13:14.600 INFO:teuthology.orchestra.run.smithi117.stderr: 93.5% -- replaced with /var/log/ceph/a73eb958-7650-11ef-bceb-c7b262605968/ceph-osd.5.log.gz 2024-09-19T07:13:14.808 INFO:teuthology.orchestra.run.smithi099.stderr: 95.2% -- replaced with /var/log/ceph/a73eb958-7650-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi099.obarqf.log.gz 2024-09-19T07:13:15.179 INFO:teuthology.orchestra.run.smithi099.stderr: 93.3% -- replaced with /var/log/ceph/a73eb958-7650-11ef-bceb-c7b262605968/ceph-osd.2.log.gz 2024-09-19T07:13:15.980 INFO:teuthology.orchestra.run.smithi099.stderr: 93.4% -- replaced with /var/log/ceph/a73eb958-7650-11ef-bceb-c7b262605968/ceph-osd.1.log.gz 2024-09-19T07:13:16.469 INFO:teuthology.orchestra.run.smithi117.stderr: 93.4% -- replaced with /var/log/ceph/a73eb958-7650-11ef-bceb-c7b262605968/ceph-osd.3.log.gz 2024-09-19T07:13:22.927 INFO:teuthology.orchestra.run.smithi117.stderr:gzip: /var/log/ceph/ceph-client.1.log: file size changed while zipping 2024-09-19T07:13:22.928 INFO:teuthology.orchestra.run.smithi117.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.1.log.gz 2024-09-19T07:13:24.017 INFO:teuthology.orchestra.run.smithi099.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-09-19T07:13:49.205 INFO:teuthology.orchestra.run.smithi117.stderr: 93.3% -- replaced with /var/log/ceph/a73eb958-7650-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi117.nooexo.log.gz 2024-09-19T07:13:49.206 INFO:teuthology.orchestra.run.smithi117.stderr: 2024-09-19T07:13:49.206 INFO:teuthology.orchestra.run.smithi117.stderr:real 0m40.308s 2024-09-19T07:13:49.207 INFO:teuthology.orchestra.run.smithi117.stderr:user 1m10.215s 2024-09-19T07:13:49.207 INFO:teuthology.orchestra.run.smithi117.stderr:sys 0m2.215s 2024-09-19T07:13:59.470 INFO:teuthology.orchestra.run.smithi099.stderr: 93.3% -- replaced with /var/log/ceph/a73eb958-7650-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi099.xehbxe.log.gz 2024-09-19T07:13:59.472 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-09-19T07:13:59.472 INFO:teuthology.orchestra.run.smithi099.stderr:real 0m50.577s 2024-09-19T07:13:59.472 INFO:teuthology.orchestra.run.smithi099.stderr:user 1m28.577s 2024-09-19T07:13:59.472 INFO:teuthology.orchestra.run.smithi099.stderr:sys 0m2.881s 2024-09-19T07:13:59.473 INFO:tasks.cephadm:Archiving logs... 2024-09-19T07:13:59.473 DEBUG:teuthology.misc:Transferring archived files from smithi099:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911742/remote/smithi099/log 2024-09-19T07:13:59.475 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T07:14:11.507 DEBUG:teuthology.misc:Transferring archived files from smithi117:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911742/remote/smithi117/log 2024-09-19T07:14:11.508 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T07:14:21.958 INFO:tasks.cephadm:Removing cluster... 2024-09-19T07:14:21.959 DEBUG:teuthology.orchestra.run.smithi099:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid a73eb958-7650-11ef-bceb-c7b262605968 --force 2024-09-19T07:14:22.509 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid a73eb958-7650-11ef-bceb-c7b262605968 --force 2024-09-19T07:14:23.037 INFO:tasks.cephadm:Removing cephadm ... 2024-09-19T07:14:23.037 DEBUG:teuthology.orchestra.run.smithi099:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T07:14:23.053 DEBUG:teuthology.orchestra.run.smithi117:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T07:14:23.068 INFO:tasks.cephadm:Teardown complete 2024-09-19T07:14:23.069 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-19T07:14:23.080 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/install/__init__.py", line 641, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-19T07:14:23.081 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-19T07:14:23.081 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T07:14:23.096 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T07:14:23.178 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-19T07:14:23.189 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-19T07:14:23.189 DEBUG:teuthology.orchestra.run.smithi099:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T07:14:23.192 DEBUG:teuthology.orchestra.run.smithi117:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T07:14:23.205 INFO:teuthology.orchestra.run.smithi099.stderr:bash: line 1: ntpq: command not found 2024-09-19T07:14:23.206 INFO:teuthology.orchestra.run.smithi117.stderr:bash: line 1: ntpq: command not found 2024-09-19T07:14:23.208 INFO:teuthology.orchestra.run.smithi099.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T07:14:23.208 INFO:teuthology.orchestra.run.smithi099.stdout:=============================================================================== 2024-09-19T07:14:23.208 INFO:teuthology.orchestra.run.smithi099.stdout:^* hv01.front.sepia.ceph.com 3 6 377 52 +732us[ +722us] +/- 55ms 2024-09-19T07:14:23.208 INFO:teuthology.orchestra.run.smithi099.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 47 -1432us[-1432us] +/- 61ms 2024-09-19T07:14:23.209 INFO:teuthology.orchestra.run.smithi099.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 52 +548us[ +539us] +/- 79ms 2024-09-19T07:14:23.209 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T07:14:23.210 INFO:teuthology.orchestra.run.smithi117.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T07:14:23.210 INFO:teuthology.orchestra.run.smithi117.stdout:=============================================================================== 2024-09-19T07:14:23.210 INFO:teuthology.orchestra.run.smithi117.stdout:^* hv01.front.sepia.ceph.com 3 6 377 49 +745us[ +730us] +/- 55ms 2024-09-19T07:14:23.211 INFO:teuthology.orchestra.run.smithi117.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 48 -1392us[-1392us] +/- 61ms 2024-09-19T07:14:23.211 INFO:teuthology.orchestra.run.smithi117.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 50 +570us[ +555us] +/- 79ms 2024-09-19T07:14:23.211 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T07:14:23.212 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-19T07:14:23.223 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-19T07:14:23.223 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-19T07:14:23.233 DEBUG:teuthology.orchestra.run.smithi099:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T07:14:23.330 DEBUG:teuthology.orchestra.run.smithi117:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T07:14:23.404 DEBUG:teuthology.orchestra.run.smithi099:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T07:14:23.432 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T07:14:23.433 DEBUG:teuthology.orchestra.run.smithi117:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T07:14:23.461 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T07:14:23.461 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-19T07:14:23.472 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-19T07:14:23.482 INFO:teuthology.task.internal:Duration was 2997.358012 seconds 2024-09-19T07:14:23.483 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-19T07:14:23.494 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-19T07:14:23.494 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T07:14:23.497 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T07:14:23.533 INFO:teuthology.orchestra.run.smithi099.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T07:14:23.540 INFO:teuthology.orchestra.run.smithi117.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T07:14:23.847 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-19T07:14:23.847 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi099.front.sepia.ceph.com 2024-09-19T07:14:23.848 DEBUG:teuthology.orchestra.run.smithi099:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T07:14:23.868 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi117.front.sepia.ceph.com 2024-09-19T07:14:23.869 DEBUG:teuthology.orchestra.run.smithi117:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T07:14:23.914 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-19T07:14:23.915 DEBUG:teuthology.orchestra.run.smithi099:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T07:14:23.917 DEBUG:teuthology.orchestra.run.smithi117:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T07:14:23.980 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-19T07:14:23.981 DEBUG:teuthology.orchestra.run.smithi099:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T07:14:23.984 DEBUG:teuthology.orchestra.run.smithi117:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T07:14:24.913 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-19T07:14:24.925 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-19T07:14:24.925 DEBUG:teuthology.orchestra.run.smithi099:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T07:14:24.950 DEBUG:teuthology.orchestra.run.smithi117:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T07:14:24.976 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-19T07:14:24.988 DEBUG:teuthology.orchestra.run.smithi099:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T07:14:24.992 DEBUG:teuthology.orchestra.run.smithi117:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T07:14:25.013 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern = core 2024-09-19T07:14:25.045 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern = core 2024-09-19T07:14:25.069 DEBUG:teuthology.orchestra.run.smithi099:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T07:14:25.094 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T07:14:25.095 DEBUG:teuthology.orchestra.run.smithi117:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T07:14:25.123 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T07:14:25.124 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-19T07:14:25.136 INFO:teuthology.task.internal:Transferring archived files... 2024-09-19T07:14:25.138 DEBUG:teuthology.misc:Transferring archived files from smithi099:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911742/remote/smithi099 2024-09-19T07:14:25.138 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T07:14:25.191 DEBUG:teuthology.misc:Transferring archived files from smithi117:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911742/remote/smithi117 2024-09-19T07:14:25.192 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T07:14:25.231 INFO:teuthology.task.internal:Removing archive directory... 2024-09-19T07:14:25.232 DEBUG:teuthology.orchestra.run.smithi099:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T07:14:25.234 DEBUG:teuthology.orchestra.run.smithi117:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T07:14:25.281 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-19T07:14:25.295 INFO:teuthology.task.internal:Not uploading archives. 2024-09-19T07:14:25.295 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-19T07:14:25.307 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-19T07:14:25.308 DEBUG:teuthology.orchestra.run.smithi099:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T07:14:25.310 DEBUG:teuthology.orchestra.run.smithi117:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T07:14:25.323 INFO:teuthology.orchestra.run.smithi099.stdout: 265324 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Sep 19 07:14 /home/ubuntu/cephtest 2024-09-19T07:14:25.323 INFO:teuthology.orchestra.run.smithi099.stdout: 655688 4 d--------- 2 ubuntu ubuntu 4096 Sep 19 06:38 /home/ubuntu/cephtest/mnt.0 2024-09-19T07:14:25.325 INFO:teuthology.orchestra.run.smithi099.stderr:find: ‘/home/ubuntu/cephtest/mnt.0’: Permission denied 2024-09-19T07:14:25.325 INFO:teuthology.orchestra.run.smithi099.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-09-19T07:14:25.327 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T07:14:25.327 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 153, in __exit__ self.gen.throw(typ, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi099 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-09-19T07:14:25.328 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-19T07:14:25.340 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-19T07:14:25.353 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-19T07:14:25.357 INFO:teuthology.run:Summary data: description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 2997.3580119609833 failure_reason: reached maximum tries (50) after waiting for 300 seconds flavor: default owner: scheduled_teuthology@teuthology status: fail success: false 2024-09-19T07:14:25.357 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T07:14:25.449 INFO:teuthology.run:FAIL